María Fernanda Longoria Mejía

Carolina Agundez Rodríguez

Scenarios Practicality Rater Reliability Test Reliability Content Validity Face Validity Authenticity

Scenario 1: Standardized multiple-choice proficiency test, no oral or written production, S receives a 3 5 5 2 4 2

report from listing a total score and part scores for listening, grammar, proofreading, and reading
comprehension.

Scenario 2: Timed impromptu test of written English (TWE). S receives a report from listing one 0 2 1 0 0 2
holistic score ranging between 0 and 6.

Scenario 3: One-on-one oral interview to assess overall oral production ability. S receives one holistic 1 1 0 3 3 0
score ranging between 0 and 5.

Scenario 4: Multiple-choice listening quiz provided by a textbook with taped prompts, covering the 4 3 1 5 3 2
content of a three-week module of a course. S receives a total score from T with no indication of
which items were correct/incorrect.

Scenario 5: S is given a sheet with a 10 vocabulary items and directed to write 10 sentences using 1 0 1 3 3 2
each word. T marks each item as acceptable/unacceptable, and S receives the test sheet back with
items marked and a total score ranging from 0 to 10.

Scenario 6: S reads a passage of three paragraphs and responds to six multiple choice general 3 4 4 4 3 3
comprehension items. S receives a score report showing which items were correct and incorrect.

Scenario 7: S gives a 5-minute prepared oral presentation in class. T evaluates by filling in a rating 4 4 4 4 1 3
sheet indicating S’s success in delivery, rapport, pronunciation, grammar, and content.

Scenario 8: S listens to a 15-minute video lecture and takes notes. T makes individual comments on 0 1 0 2 0 1
each S’s notes.

Scenario 9: S writes a take-home (overnight) one-page essay on an assigned topic. T reads paper 3 2 3 2 3 2
and comments on organization and content only, and returns essay to S for a subsequent draft.

Scenario 10: S creates multiple drafts of a three-page essay peer and T-reviewed, and turns in a final 0 0 1 4 2 5
version. T comments on grammatical/rhetorical errors only, and returns it to S.

Scenario 11: S assembles a portfolio of materials over a semester-long course. T conferences with S 5 3 3 5 5 3
on the portfolio at the end of the semester.

Scenario 12: S writes a dialogue journal over the course of a semester. T comments on entries every 4 3 3 5 3 5
two weeks.