Multimedia Evaluation Report

by

Rose Bertin

University of the West Indies Open Campus

A Paper Presented in Partial Fulfillment

of the Requirements of

Masters of Science in Instructional Design Technology

EDID 6508 Developing Instructional Media

(January- April 2018)

Email: rose.bertin@my.open.uwi.edu

University: University of the West Indies Open Campus

eTutor: Leroy Hill

Course Coordinator: Leroy Hill

 Contents

Evaluators Feedback ............................................................................................................... 3

Responses to Comments ......................................................................................................... 4

Revisions................................................................................................................................. 4

Content ................................................................................................................................. 4

Stylistic ................................................................................................................................ 4

Appendix 1: Peer Evaluation Project Rubric .......................................................................... 5

Evaluators Feedback

The evaluators indicated that there were many positive aspects of our multimedia project. The

following is an overview of what worked from the evaluators’ point of view or things that are fine the way

they are:

 The storyboard is somewhat complete, with the necessary URL’s and resources provided and

formative assessments used frequently.

 Logical sequence in the organisation of the content, with adequate navigational tools and buttons

on each screen. Subject knowledge was evident and all information was clear, appropriate and

correct.

 Originality and inventiveness, with multiple forms of assessments and learning activities, proper

citation of sources and relevant copyright actions taken.

 Presentation displayed and played properly on multiple platforms or devices. Combination of

multimedia elements was used effectively to entice users to learn and enrich experiences and the

duration of videos was appropriate. Appealing, colourful animation.

 No spelling or grammatical errors.

Notwithstanding the overall positive evaluation, some deficiencies were highlighted, which point to

things which will require revisions to the program:

 Include a recap section before the final quiz and provide content for advanced learners. There were

no instructions on one slide.

 Apply program to Caribbean situation or setting.

 Use of actual persons for narration would have made audio more appealing. The computerized

voice was not well received. Some directions were spoken quickly and some scenes are plain and

boring
  Some buttons did not work and main menu buttons were also unresponsive. For the first quiz, only

the first button worked and the answer for the last question was already selected. Some scenes

took long to load.

Responses to Comments

I actually agree with most of the deficiencies pointed out by the evaluators and will address the

revisions to be made in the following section. The only points of contention are the suggestions to include

content for advanced learners and that some scenes are plain.

I do not agree that any of the scenes are plain or boring. This inclusion of content for advanced leaners

would not be appropriate or relevant as the program is entitled: “Introduction to Science”. The primary

focus of the program is on providing a basic overview of the importance and applicability of science to

everyday life from the perspective of young children.

Revisions

Content

 A brief review section will be included before the final quiz. The main points will be highlighted in

summary form using visual and audio reinforcement.

 Instructions will be included on the slide where it was missing.

 The program will be tailored to Caribbean situation or setting be making the following changes:

o Replace the teacher characters to reflect the more predominant Caribbean ethnic groups, i.e.

Black, Indian and mixed.

o Replace computerised voice with real life Caribbean voices and accents.

Stylistic

 Record some of the directions at a slower pace.

 Activate option buttons which do not work.

Appendix 1: Peer Evaluation Project Rubric

1 2 3 4
Story Board or Story board is Story board is not Story board is Story board is
Planning Sheet incomplete and complete. somewhat complete. Includes
lacks necessary Includes few complete. all assigned
URL’s, formats, and assigned elements Includes many elements, in
resources to or planned assigned addition to planned
complete project. formats, elements, in formats, necessary
necessary URL’s, addition to most URL’s, and
and resources. planned formats, resources.
necessary URL’s,
and resources.
Organization of No logical Some logical Logical sequence Logical, intuitive
Content sequence of sequence of of information. sequence of
information; menus information, but Menus and paths information.
and paths to menus and paths to more Menus and paths
information are not are confusing or information are to all information
evident. flawed. clear and direct. are clear and
direct.
Originality The work is a The work is an The product shows The product shows
minimal collection extensive evidence of significant evidence
or rehash of other collection and originality and of originality and
people’s ideas, rehash of other inventiveness. inventiveness. The
products, images people’s ideas, While based on an majority of the
and inventions. products, images extensive content and many of
There is no and inventions. collection of other the ideas are fresh,
evidence of new There is no people’s ideas, original, inventive,
thought. evidence of new products, images and based upon
thought or and inventions, the logical conclusions
inventiveness. work extends and sound research.
beyond that
collection to offer
new insights.
Copyright and Sources have not Some sources Most sources and All sources are
Documentation been properly cited have not been property cited properly cited
and permissions properly cited and according to MLA according to MLA
have not been all permissions style; Permissions style; Permissions
received. have not been to use any graphics to use any graphics
received. from web pages or from commercial
other sources have web pages on other
been received, sources have been
printed, received, printed,
and saved
 and saved for for future
future reference. reference.
Format and The stack, The stack, Most of the stack, The stack,
Platform presentation, or presentation, or presentation, or presentation, or
Transferability web page plays web page plays web page plays web page plays
only on either Mac best on either easily on both easily on both Mac
or PC. There are Mac or PC. There Mac and PC. and PC. Care has
problems with the are problems with Although there are been taken in
operation of some the operation of minor problems naming files,
files and the project some files and the with a few files, selecting
is not cross- project is not care has been technologies, or
platform. cross-platform. taken in naming creating
files, selecting enhancements to
technologies, or produce a final
creating product that is
enhancements to cross-platform.
produce a final
product that is
cross-platform.

Subject Subject knowledge Some subject Subject knowledge Subject knowledge

Knowledge is not evident. knowledge is is evident in much is evident
Information is evident. Some of the product. throughout (more
confusing, incorrect information is Information is than required). All
or flawed. confusing, clear, appropriate, information is clear,
incorrect or and correct. appropriate, and
flawed. correct.
Graphical Design Exaggerated Graphical and Design elements The combination of
emphasis upon multimedia and content multimedia
graphics and elements combine elements with words
special effects accompany effectively to and ideas takes
weakens the content but there deliver a high communication and
message and is little sign of impact message persuasion to a very
interferes with the mutual with the graphics high level, superior
communication of reinforcement. and the words to what could be
content and ideas. There’s no reinforcing each accomplished with
attention paid to other. either alone. The
visual design mixture brings
criteria such as about synergy and
proportion, dramatic effects
balance, and which reach the
harmony restraint. intended audience.
There is some
tendency toward
random use of
graphics.
 7

Mechanics Presentation has Presentation has Presentation has Presentation has no

four or more three of more fewer than two misspellings or
spelling errors misspellings misspellings grammatical
and/or and/or and/or errors.
grammatical grammatical grammatical
errors. errors. errors.
Screen Design Screens are either Screens are Screens contain Screens contain all
confusing and difficult to adequate necessary
cluttered or barren navigate, but navigational tools navigational tools
and stark. Buttons some buttons and and buttons. Users and buttons. Users
or navigational tools navigational tools can progress can progress
are absent or work. Users can through screens in intuitively through
confusing navigate a few a logical path to screens in a logical
screens. find information. path to find
information.
Use of No video, audio Limited video, Some Video, audio Appropriate
Enhancements enhancements are audio enhancements are amounts of Video,
present or use of enhancements are used appropriately audio
these tools is present. In most to entice users to enhancements are
inappropriate. instances, use of learn and to enrich used effectively to
these tools is the experience. In entice users to learn
appropriate. some cases, clips and to enrich the
are either too long experience. Clips
or too short to be are long enough
meaningful. convey meaning
without being too
lengthy.