Академический Документы
Профессиональный Документы
Культура Документы
Part 2. Analysis Report (contd)
Needs assessment data:
Out of 21 enrolled students, we received 15 responses to our survey. The following
summarizes the key findings and implications regarding learners needs based on the
survey results.
Key Findings:
Relative to self-assessed competency with Excel or Google Spreadsheets
(common programs leveraged in data analysis and map creation), there is
significant experience. No one was completely new to such programs.
10%
20%
30%
40%
50%
60%
Majority of learners have experience creating the most basic data visualizations -bar/column charts and pie/doughnut charts.
No
No
27%
Yes
73%
Yes
0%
20%
40%
60%
80%
100%
ReinventED
20%
40%
60%
80%
Implications:
Ability to create a realistic and effective instructional design plan that covers
both map and infographic driven new stories in 2-3 days of class time is
unrealistic. As such, this ID plan will focus on map driven news stories.
ReinventED
Appropriate software tutorials will need to be identified (or created) and made
available to learners
In classifying learner provided links relative to what they would like to be able to
learn how to create, infographics are at the top of the list and not maps.
10%
20%
30%
40%
50%
60%
ReinventED
From the survey:
The learners represent a range of years in school: 13% first year, 40% second
year, 27% third year and 20% fourth year or higher
The average learner has taken 2.5 Film and Media courses at Lafayette (including
current courses) with the range being between 1 and 9
Film and media studies program at Lafayette is more conceptual than technical
Students are generally used to being told what to do, rather than having to figure
it out or teach themselves
That said, ability and openness of students to engage with new technology thus
far in course has been high
Formula of exposing student to examples and then having them go off on their
own and create artifacts (leveraging identified tutorials) has been successful
Overall attitude of the students towards intensive use of technology and high
rate of novelty (i.e., new programs/apps introduced virtually every week) is
positive, but there was a challenging initial adjustment period.
Data visualization unit will fall at end of class and follows what is anticipated to
be the most popular course module regarding video story telling
Class attendance is typically high, but there are a fair amount of athletes in
program who have excused absences
ReinventED
Physical setting
Instructor
First time teaching this course, but has taught other departmental courses
Very open minded to use of technology and highly adaptive once exposed
Though perhaps not ideal, in this scenario the instructional designer and the lead
subject matter expert are by necessity one in the same (me)
o I have close to two decades in the marketing analytics industry
ReinventED
Instructional approach
Links and resources (as well as student artifacts) are shared via Pearltrees
o Students are part of class Pearltree team and contribute resources
All students have their own Wordpress blog which they contribute to weekly
ReinventED
o Typeform was utilized in the class wide crowdsourcing effort, individual
blogging exercises and now to survey learners
o Flipboard was used to curate topic specific magazines and then used as an
input for individual word cloud visualization efforts
o Pearltrees is used to curate resources but was also used as a means to
tell a non-linear news story through the use of links
Transfer Context
There are two relevant transfer environments relative to this class.
The first and most pressing transfer environment is a small group capstone
project where all means of visualizing information that have been studied will be
incorporated (e.g., blogging, content curation, podcasting, video, hypermedia
mash-ups and data visualization).
o As of the initial drafting of this ID document, the capstone project was
envisioned to focus on the results of a recent local election. As heat
maps are often a key element in election reporting, there was initially a
critical need to teach heat maps.
o As of later drafting of this document, the capstone project focus shifted
away from the election theme. Any type of map-based visualization can
now be leveraged in the capstone project. This creates the need to
provide equal coverage of geographic and heat maps as well as story map
type applications.
o This was further argument for spinning off infographics into a separate
module and focusing this module (& ID project) on map driven stories.
o The transfer setting differs from the instructional setting in that this is a
small group (4-5 people) project as opposed to an individual undertaking
with different team members dedicated to specific executional
elements/topics (e.g., not everyone creates data visualizations)
The second one is the ability of the students to continue to be a part of the
journalistic conversation beyond this course setting. The instructional
technologies leveraged and skills learned in this course should enable this.
Conscious choices have been made to leverage technologies that will be available
to students (free of charge) outside of the college setting. One exception is that
class blogs would need to be eventually transferred outside of the college blog
hosting environment.
ReinventED
Content analysis
A flow chart of the revised learning goals and objectives is shown below (& via this link):
Part 3. Planning
Rationale
Why this topic? What need does it meet?
In todays world, journalists need to be equally adept at writing, multimedia and data
visualization. As where is one of the five Ws of journalism, the need to be able to
communicate effectively via maps is one of the most common data visualization needs.
ReinventED
I also chose this topic because of all of the modules in the multimedia journalism course
that I have been helping out with this semester, data visualization and mapping is the one
area where I have the most first-hand experience, having worked in the data analytics
field for over 15 years. Finally, data visualization is a subject matter that I believe many
people judge to be significantly less creative than other areas of journalism. I wanted to
help dispel that notion.
Supplantive or generative strategies:
The general path of instruction for the course for which this module is being designed:
Given this, the general instructional approach for the course would definitely be
classified as almost 100% learner driven (generative) rather than instructor driven
(supplantive). There is little information or knowledge that is fed directly to the
learners by the instructor in this course.
The starting point was to design this module to be consistent with others in this course.
However, based on initial discussions with the instructor, review of the learner survey
data and first-hand observation of the learners, there were some key distinctions
between the data visualization module and other modules in the course (e.g., blogging,
tweeting, podcasts, photo stories, etc.):
Concern over learner ability to create heat maps on their chosen topic
ReinventED
10
So a key decision needed to be made as to whether to alter the general instructional
approach for this module (more supplantive) or alter the initial instructional design plan.
We opted for the latter alter the instructional design. The following changes were
made to the initial plan so as to accommodate the considerations listed above:
Substitution of more user friendly software (as will be discussed, the alteration of
the capstone project also enabled this)
Shifting of core artifact assignment from heat map to a story map (more
universal, ties into photo/video stories created in previous modules)
Several of these points will be further elaborated upon in subsequent sections of this
document.
Pedagogical approach:
The underlying pedagogy of this course and this module would be best described as
modified connectivism.
Key connectivist elements:
ReinventED
11
Key modifications or constraints to ensure positive learner experience:
Use of small group and pairs activities (to offset cognitive load)
Learning Objectives
A simple way to think about and structure objectives and sub-objectives is from a what
do learners need to know/be able to do before they can succeed approach. As such,
sub-objectives are shown below in reverse, building up to the terminal objective.
There are two paths of instruction related to the two different types of maps being
studied. These ultimately merge in the terminal objective of being able to tell effective
map driven news stories. Also note that the locational map objective path does not
included all sub-objectives given the higher learner familiarity with the topic (i.e.,
learners dont need significant instruction as to the data that feeds a location map).
Heat Map Objective Path:
1.2.6: Identify purpose and appropriate use of heat maps & necessary data
1.2.4: Identify and obtain appropriate data to support heat map creation
Terminal objective: Students will learn how to create effective map driven
visualization to support data driven news stories and capstone project execution.
ReinventED
12
Matrix of objectives, Bloom's taxonomy, and assessments
Key comment relative to assessments:
Out in the real world a journalist is evaluated on their output (i.e., the news stories
they create). In this course and module, the focus of evaluation is exclusively on the
quality of the final journalistic artifacts. While homework and in-class activities
contribute to a homework grade, that evaluation is participation oriented (was the
assigned work completed/valiantly attempted). There are no quizzes or tests.
Consequently, assessments are not tied to sub-objectives in this module design. This
type of gestalt evaluation is consistent with the underlying connectivist pedagogy.
To maximize the value of the matrix utilized below we have substituted a column for
key objective word (i.e., the key word in the objective that ties it to the Bloom
taxonomy) and dropped the assessment type column. In completing the matrices shown
on the following pages, the following Blooms rose was referenced.
Image credit: By K. Aainsqatsi (Own work) [CC-BY-SA-3.0 (http://creativecommons.org/licenses/bysa/3.0) via Wikimedia Commons
ReinventED
13
Objective
1.2.7
1.2.6
1.2.5
1.2.4
1.2.3
1.2.2
1.2.1
Key Word
Recognize
Identify
Analyze
Identify/Obtain
Use
Evaluate
Create
Scaffolding Strategy
Generative
Generative & Supplantive
Generative
Generative
Generative
Generative
Generative
The sole supplantive aspect relates to some instruction that will need to be provided
relative to where to source data for heat maps, accounting for population differences
and other finer details that example discussion alone might not illuminate.
Objective
1.1.5
1.1.4
1.1.3
1.1.2
1.1.1
Key Word
Analyze
Identify
Use
Create
Create
Scaffolding Strategy
Generative
Generative
Generative
Generative
Generative
ARCS Table
Attention
A1: Perceptual
Arousal (key
tactics employed)
ReinventED
14
A2: Inquiry
Arousal (key
tactics employed)
Participation
Kick-off activity (dialect quiz) solicits immediate participation and
engagement. Learners also participate in the identification and analysis of
relevant map driven story examples (during which they are able to project
their terminal to the big TV screens). Learners respond to a poll (about
their childhoods) to drive the content of the Google map. Learners actively
participate to create both heat maps and map stories.
Inquiry
Sample questions to help guide discussions of map driven stories have been
provided in the instructor guide. For example, relative to the kick-off
activity, one can probe for things such as: How do you think this was done?
How would this have been done differently ten years ago? Is this the most
effective way to visualize this data? And so forth.
A3: Variability
Active efforts have been made to create variability in materials, voice and
tone and activities. For example, day one has learners participate in an
online quiz (on their terminal), view a portion of an animated video (on the
big screens) and view and discuss other live broadcasted examples.
Examples leveraged in the day one plan cover everything from baseball
fandom, to best sledding spots, to dialect quizzes, to election results to
airline tragedies.
Relevance
R1: Goal
Orientation (key
tactics employed)
Present Worth
Present worth will be established by communicating how the students will
need to create map driven stories as their gradable artifact for this module.
Future Usefulness
Future usefulness will be established by identifying data visualization (and
mapping in particular) as key modern day journalistic skills. Relative to the
more immediate future, it will be also conveyed that capstone projects will
require the inclusion of a data visualization element.
R2: Motive
Matching (key
tactics employed)
The primary motivation for most of the students in this class is to get good
grades (achievement), though many have expressed the notion that is one of
the few classes that will have relevance to their future lives.
Learners selected their own topic of journalistic interest at the beginning of
the semester and which carries forth into this module as well. They also
have a choice to use the recommended applications or create artifacts with
other like tools. Learners also get to choose the examples that they analyze
and who they tag up with in their pairs assignment.
ReinventED
15
R3: Familiarity
(key tactics
employed)
Modeling
In this module, the instructor models the desired artifact creation behavior
by showcasing examples that they have created with the identified
technology. Desire behavior is also modeled by identifying best in class
examples to share. Skyping with industry experts is often incorporated into
modules based on leveraging instructor contacts. This has not been built
into this design plan but could be accommodated.
Experience
Recognizing that map creation is something most students have less personal
experience with than say making video or photo stories, efforts have been
made to connect the instruction to other learner experiences (inside and
outside this course). Google map creation has been worked into the
module because it is familiar to users (though only have direct experience
with Google Maps). The culminating assignment is the creation of a map
story that allows students to draw on their previous course experience in
creating multimedia stories.
Confidence
C1: Learning
Requirements
(key tactics
employed)
The strategy employed in this course and carried forward in this module is
to outline artifact requirements after discussing and analyzing examples,
rather than immediately at the start of the module. As learners lack
experience with this particular type of artifact (i.e., map driven stories), we
believe the artifacts would actually appear more daunting to create and be
demotivating. After one has seen the desired elements embodied by other
examples, the perceived difficulty of creation and associated cognitive load
will be lower.
C2: Success
Opportunities
(key tactics
employed)
C3: Personal
control (key
tactics employed)
In an artifact driven class, the connection between personal effort and time
spent and outcome success is well established. By laying out grading criteria
through relevant rubrics and then providing feedback consistent with said
rubrics, learners are able to establish direct correlations between their
project efforts and their grades. Finally, by soliciting feedback from students
on the module itself, we are fostering a further sense of personal control.
ReinventED
16
Satisfaction
S1: Natural
Consequences
(key tactics
employed)
S2: Positive
Consequences
(key tactics
employed)
The key external motivation in this module (and course) is the feedback
from instructor and fellow learners. Almost all major artifacts are presented
and discussed publicly and applause is common. There is an option for a
backchannel to be incorporated into the lesson during the review process,
so as to provide a written record of peer feedback.
The use of rubric based grading ensures that learners feel that they are being
evaluated on a fair and equitable basis. Granting all learners equal
opportunity to share their work publicly and receive feedback is equally
important.
References:
Keller, J. M. (1987). The systematic process of motivational design. Performance & Instruction,
26 (9/10), 1-8.
Instructor Guide:
Day 0:
Assign students the following:
1. Read Journalism Next by Mark Briggs, Chapter 9 Data Driven Journalism
2. Identify map based news story that you find interesting. Add link to our Google+
community forum entitled Map Based Storytelling
Be sure that you (as instructor) contribute a link as well.
3. Respond to short survey about state of childhood via link: http://tinyurl.com/m49nlxj
Note survey contains questions designed to support both map based and
infographics based visualization (subsequent module).
ReinventED
17
Day 1:
Introduce topic of data driven storytelling and acknowledge incoming
mindset
Acknowledge reticence some learners may have about this module (given quantitative
and analytical bent).
Feel free to weigh in with own thoughts on the topic as appropriate.
Express belief that they will find data visualization to be more creative than expected
and the selected tools to be very journalist friendly.
Announce intention to start with an interesting example that was identified by one of
the learners in the initial learner surveys leading up to this topic.
Activity 1: Dialect quiz/heat map introduction
1. Post link on presentation screen: http://tinyurl.com/pke94a2
2. Ask learners to take 5 minutes or so to individually complete (using their
terminals) the 25-question survey created by the New York Times regarding
personal dialects. Complete survey along side learners.
Ask learners to take note of how the results are being visualized as they
complete the survey.
Note: with each question answered (as well as in total), a heat map will be
displayed that expresses the degree to which their answer is similar to other
respondents in different areas of the United States.
3. 10-15 minute discussion of this data visualization driven story. Topics:
Accuracy of results. Have they lived near the cities identified as being
most similar to their answers?
How would this have been presented differently ten years ago? (audience
participation, visualization, social media sharing, etc.)
ReinventED
18
4. As situation dictates/time allows, share this second heat map example from the
New York Times depicting baseball team fandom: http://tinyurl.com/mseuboy
Activity 2: Heat Map Hero Video
Introduce animated video regarding heat maps: http://youtu.be/QkJ1ni4PG5w
1. Watch video up until 2:50 mark (end of Step 1)
2. Summarize heat map concept idea substituting colors for values. Note how
they saw two different heat map types (the dialect quiz type and choropleths).
Going to explore example of latter
Activity 3: Election results reporting (choropleth example)
Show heat map of PA presidential results by county (or alternatively a heat map that you
have created): http://shar.es/Sr9pB
Note that this was created with the program mentioned in video Open
Heat Map
Note the distinct boundaries (county lines) between colors. This is what
makes it a choropleth as opposed to a traditional heat map.
Now if one looks closely at the data, one interesting story it tells is that Obama won PA
despite losing most of the counties. But this isnt obvious in original heat map.
Show an alternate version of same heat map, where the scale has been changed
(anything below 50% is now same color): http://shar.es/S5fVE
Note how this tells a more effective story and communicates faster.
Talk about how students are going to get opportunity to create heat map in-class
with Open Heat Map in next class.
ReinventED
19
Note that a heat map is just one type of data driven map. The other is the more
traditional location driven map
Show Google map that was created leveraging data (about site of favorite
childhood memory) from the state of your childhood survey.
o You will actually create the map yourself using the survey reply data and
the provided Google Map Engine Lite tutorial. Your map will not have
visuals initially. Just pinpoints. See example: http://tinyurl.com/mjup6lb
o Make sure share settings in created map allow for others to edit.
o Please communicate to learners that you created this map.
o Note that their homework will involve adding to this Google map.
Provide example of location map driven news story. Can use example below, but would
even better if drawn from learner identified resources.
Ask what kind of map like this could be created for their area
Conclude with example of map driven story crossed with a photo/video story.
Note how this was created with free app Map Story JS
Make connection with the photo/video stories they have already done
Note that concluding module assignment will be to create a map driven story
using Map Story JS
Day 1 Homework
ReinventED
20
Probe for any issues. See if everyone feels confident in being able to create from
scratch moving forward
Day 2 Homework
ReinventED
21
o 5 locations minimum
o Fields needed for each location:
Where? (Specific geographic definition depends on idea)
What? (Description of what happens/happened here)
When? (As relating to story)
Add who, how and why as separate fields as relevant
A relevant image or link
Day 2.5:
Activity 1: Review heat map & headline activity
Probe for any issues. See if everyone feels confident in being able to create heat
maps moving forward
Activity 2: Review collaborative class map that has now been moved into
Map Story JS
Get people excited about how much cooler this looks now that it has been
migrated from Google Maps Engine
Individual map driven story on your topic of interest using the data points you
have already collected
Discuss rubric
ReinventED
22
Learner Content Examples
Learning Materials
Kick-off activity
Image credit: Katz, J., & Andrews, W. (2013, December 19). How
Yall, Youse and You Guys Talk. Retrieved May 07, 2014, from
http://tinyurl.com/k5zkj3v
Image credit: Giratikanon, T., Katz, J., Leonhardt, D., & Quealy, K.
(2014, April 23). A Map of Baseball Nation. Retrieved from
http://tinyurl.com/qe6etva
Personal creation
ReinventED
23
Effective Heat Map Creation (Presentation)
Document: http://tinyurl.com/m6plywr
http://tinyurl.com/mjup6lb
Pearltrees Links
ReinventED
24
Learner Assessment
ReinventED
25
Technology Tools
Identification of core map creation technologies
Significant time was invested in exploring the various software options to support this
instructional design initiative. As core technology course infrastructure (Chalkup LMS,
Google+ and Pearltrees) was a given, the focus here was on which geographic map
creation applications to leverage.
Key criteria for identification of optimal mapping applications.
Intuitiveness/ease of interface
Visual attractiveness
Existence of tutorials was a plus, but not overly significant as we anticipated the need for
custom tutorials particularly for the more complicated heat map creation process.
Assessing which applications were optimal for this instructional module necessitated not
merely research, but actual usage of the candidate products. The visuals shown below
represent personally created artifacts.
While initially we had hoped that one application might be able to satisfy all of the
instructional needs of this project, this was quickly dismissed as a possibility. Ultimately,
it was decided that three different applications were going to be needed. Each of these
will be delineated along with rationale for selections.
Heat Maps
For the creation of heat maps, our first
choice was to use OpenHeatMap as it was
created specifically for journalists and is
extremely easy to use. However, in the
original conception of the capstone project,
heat maps were likely going to be needed to
be constructed at a very low level of
geography (by voting district within a certain
county). OpenHeatMap is not able to
support that level of detail.
ReinventED
26
As such, the choice was made to utilize Google
Fusion tables. As students already have Google
Drive accounts as a result of being a part of the
class Google+ community, this would eliminate
the need to create new accounts. Further
more, there would be synergy with using
another Google product (Map Engine Lite) to
created location-based maps.
While Google Fusion Tables is a very powerful application, it looks complicated and
rather alien on first encounter. This was a concern, as this would demand additional
degrees of scaffolding (which there wasnt really time for) and a more instructivist
approach (which would have been a significant deviation from course practices).
The problem resolved itself when the capstone project was recast to not focus on
elections. With highly localized heat map visualization no longer a capstone project
need, OpenHeatMap was re-slotted as the lead heat map technology.
Location based mapping
While alternatives such as ZeeMaps
(http://www.zeemaps.com) were briefly
considered, the familiarity and ease of
use of Google Map Engine
(https://mapsengine.google.com) made it
the obvious choice. Google Maps
Engine Lite is a free application.
Map based story telling
Google Maps does incorporate some
narrative capability such as the ability
to associate an image or video with
each map pushpin. However, for the
purposes of telling a news story there
are more powerful and attractive
applications available. Unfortunately,
many of these applications (such as
the story maps engine provided by
ArcGIS) represent premium services
and thus were inappropriate for this
project.
A relatively new resource, StoryMap JS was identified as the optimal technology for our
needs. It supports headlines as well as all forms of media and is extremely easy to learn
ReinventED
27
and use. The only reservation regarding StoryMap JS surrounded its newness and thus
lack of significant support materials and documentation. Ultimately, the applications
ease of use mitigated such concerns.
Tutorial Resources
As the connectivist pedagogy associated with this course has dictated the use of existing
Internet resources reflecting a variety of different sources and voices, the initial decision
was made not to personally create any tutorial resources for the design of this module.
The following criteria was utilized in seeking out optimal tutorial resources for the key
mapping technologies:
OpenHeatMap: Create own dual purpose animation video (and refer learners to
website resources). This will be further discussed.
It should be noted that as this module is designed to be one of the last modules in the
semester long course, learners will have extensive practice in teaching themselves to
utilize Web 2.0 applications at this juncture. Furthermore, learners will have had very
recent experience with multimedia applications in creating their photo and video stories.
Part 4. Evaluation
Evaluation Plan
An overview of our evaluation, as viewed through the lens of Kirkpatricks four levels:
ReinventED
28
o Learners will be also be formally surveyed relative to their module
experiences via this brief survey: http://tinyurl.com/n5krfrd
o This survey will be positioned to learners as a means to shape/reshape
future versions of the module
Expert Review
Two different SMEs were utilized in the review of the design of the course.
The first SME was the instructor in the class, Kathleen Parrish. Key topics that
were probed with this SME (http://tinyurl.com/p6sxp86):
o Big picture evaluation
Fit with other modules in course (weak, average, strong)?
Favorite elements?
Least favorite elements/biggest concerns?
Overall quantity of content 2.5 day timeframe (too much, too
little, just right)
Comfort level in teaching this module (low, medium, high)?
What could be done to enhance your comfort level?
ReinventED
29
Other comments?
30
Please note that the instructor had also provided earlier informal feedback that helped
shape some of the changes discussed in the document.
Strengths:
Fit with other modules in course judged to be strong
Amount of content in module plan deemed just right for 2.5 day period
Rubrics
It did a good job of identifying graded elements of each project and expectations for each element.
Instructor felt heat map partner project was valued too highly versus individual
story map assignment
I would have made the individual assignment worth more points than the in-class project. Maybe it
would have been a 3-1 ratio as opposed to 2-1.
While not directly relevant to this ID project, the instructor would prefer
infographics be taught before this mapping unit, rather than vice versa
ReinventED
31
Strengths:
Rated all proposed tutorial resources as very good. Did not feel Story Map JS,
which lacked a tutorial, necessitated one.
Felt that Google Maps Engine Lite and OpenHeatMap were optimal options
relative to quality and ease of use
Again, this is probably the best and easiest to use free tool that I am personally aware of.
Summative comments:
This is tremendous, the materials are thorough, well thought out, and complete. Having sat through
(and delivered) many similar trainings in the past I can honestly say that this is heads and shoulders
better than nearly anything I have been exposed to. I particularly liked the use of humor in the Heat
Map Hero video--it goes a long way towards softening the shock of introducing learners to an unfamiliar
subject matter.
Comments on Change
While SME feedback was overall very positive, there are definite changes to implement
based on this feedback.
Expand scale of homework activities (and likely the state of our childhood
survey)
ReinventED
32
o As technical challenge judged by SME #2 is only average and time needed
to master software lower than originally envisioned, scale of homework
and graded assignments can be increased. Specific ideas:
Although not judged necessary by SME #2, would go ahead and create a short
tutorial on StoryMap JS.
o To aid learner comfort level. And to reinforce notion of increasing the
intelligence of the network (if no tutorial exists, one should create one
and make it available to others!)
Again, though outside the scope of the final ID project (thought not its original
scope which included infographics), I would honor request to lead with
infographics to introduce data visualization and then move into mapping.
o Use mapping limitations within infographics programs as transition into
mapping topic
ReinventED
33
Appendix: Full Learner Survey
http://tinyurl.com/p27vhvh
ReinventED
34