High-Tech Assessment

The tools to use

 Objectives
• Recognize some high-tech
assessment technologies.
• Understand how they can be used
effectively.
• Know where to go for more
information.
Traditional Pedagogy and
Traditional Assessment
• Class lectures • Tests, tests, tests
• Assigned reading • Class participation
• Individual projects • Portfolios
• Papers and
presentations
 Pedagogy and
Assessment 2.0
• Online courses • Course management systems
– Online quizzes – Online quizzes
– Online discussion – ePortfolios
forums – Online discussion forums
• Group projects – Audience response
systems
– ePortfolios Podcasted lectures
•
– Online Discussion – Download rates
Forums – Online discussion forums
• On-demand online training • Gaming/Simulation
– Online quizzes – Game scores
– Response times for – Response Times
online tests
 On-Demand Online
Tutorials
• “Screencasts”
• Recorded demonstrations of using
computer programs.
• Camtasia
– Leading screencasting system.
– Allows audio, video, highlights, mouse-clicks,
etc.
– Includes quiz function to assess learning.
 Examples of tutorial
w/quiz in Libraries
• TILT
• Park Library Online Tutorial
• Colorado State
 Online Quizzes
• Course Management • Can track
Systems (CMS) respondents’:
– Blackboard – Answers
– Moodle – When started/completed
– Time on quiz
• Online survey systems – Time on question (some,
– SurveyMonkey (base not all)
version is free)
• Assessment Uses
• Online Tutorials – Pre-test/Post-tests
– Camtasia – Knowledge retained
• Provides instant – Longitudinal assessment
summaries of results.
Online Quiz/Test
Example
Learning Assessment
 Audience Response
Systems
• “Clickers”
• Enable anonymous or non-anonymous responses to
ad-hoc questions during a lecture.
• Can be used to assess learning and direct course
of lecture.
• Often integrated with MS Office programs
– PowerPoint for presentation
– Excel for reporting
• …and Class Management Systems
Demo of ARS and ARS in
Libraries
• Quizdom Remotes Demo
• Lehigh University Library
• Dickinson College
Learning Assessment
 ePortfolios
• Digital repository of work completed by
student.
• Meant to assess progress “as a whole.”
• Often included with CMS
– Blackboard
• Other tools:
– Wikis (PBWiki – cheap and easy to use)
– Blogs (MovableType)
– Digital Archives (DSpace – campus-wide
implementation)
 Examples of ePortfolios
• Polaris (UT)
• ePortfolio at LaGuardia
• Valdosta State
– Assessment of instruction services
– Article in Reference Services Review
• UNISA
– Research Information Skills in distance ed
class
– Article in Education for Information
 Gaming/Simulation
• Simulation of real-world experiences
• Good for assessing higher-ordered
thinking skills
• Formative assessment is better.
– Based on choices made.
– Can be used to compare with others.
• Other measures
– Completion time
– Self-correction rates
 Examples of Gaming in
Libraries
• UNC Greensboro (a Web-based board
game)
• Ohio State – set of games to assess
learning.
• Arizona State University – developing
a simulation game
– Quarantined
Learning Assessment
Online Discussion Forums
• Similar to class participation
• Can be scheduled or unscheduled
• Better to be synchronous
• Assessment measures:
– Quality of participation
– Quantity of participation (minutes, lines, etc.)
– Frequency of participation
Demo of Online Discussion
Forum in Libraries
 Tool Summary
• Online Quizzes/Tests
– Similar to paper-based.
– CMS or SurveyMonkey
– Good for “open-book” tests. No checks for
“cheating”.
– Better at assessing lower-ordered thinking
skills
• Recorded Demonstrations
– Good for short segments of training.
– Better for demonstrations.
– Include a quiz for assessment.
– Not good for difficult topics.
 More Tools Summary
• ARS
– Useful for continuous feedback from students
to guide lecture.
– Good for assessing the class/course.
• Gaming/Simulation
– Better at assessing higher-order thinking
skills.
– Complex to create.
 References
• Wikipedia • E-Portfolios for Learning blog
– ePortfolio • Proof of learning: Assessmen
• EDUCAUSE
• ePortfolios: Hi-Octane Asses
– E-Portfolios (a bit old,
but still has some good • Bibliographic Gaming
background)
• Game on: Games in Libraries
– Gaming
– Screencasting
– ARS
 More References
• Leach, Guy J and Tammy S. Sugarman. 2006. Play to win! Using game
Research Strategies, v. 20(3):191-203.
• Fourie, I. and van Niekerk, D. (1999). Using portfolio
assessment in a module in research information skills.
Education for Information, 17(4), pp. 333-352.
• Chapman, J. M., Perrway, C., and White, M. (2001) The
portfolio: an instruction program assessment tool .
Reference Services Review, 29, 294-300 .[CrossRef]
 Vendor List
• Online Testing • ePortfolios
– Blackboard – Blackboard
– SurveyMonkey – Dspace
– OpenSource Portfolios (OS
• Screencasting/Onli
ne Tutorials • Audience Response
Systems
– Camtasia
– TurningPoint
– Adobe Captivate
– Quizdom