IE 3 Activity: Usability Testing

Names: _____________________________________________________________
Group Name: __________________________________________

Usability Testing
Objectives: To simulate the usability testing process for mobile applications

Basic Structure of a usability test session

A usability test session generally has three sets – (1) gathering of user demographics using
pre-test questionnaires and/or interviews, (2) observing participants performance by giving out
task scenarios and (3) getting user feelings and opinions of the interface using post-test
questionnaires.

Simulate the usability testing process for mobile applications by testing the usability of Shopee,
and OLX. Perform the activity by pair, one will be a subject for usability test of Shopee and
one for usability of OLX. Each student should be a subject once and a recorder once. Make
sure to download the respective applications before the start of the activity.

Part One

Pre-testing
Please accomplish the pre-test questionnaire below.
Table 1 Pre-test questionnaire
SUBJECT 1 SUBJECT 2
Name Name
Recorder Recorder
Age Age
Gender [ ] Male [ ] Female Gender [ ] Male [ ] Female
Do you know Shopee? [ ] Yes Do you know OLX? [ ] Yes
[ ] No [ ] No
Have you used its app before? [ ] Yes Have you used its app before? [ ] Yes
[ ] No [ ] No
Have you looked for item(s) to [ ] Yes Have you looked for item(s) to [ ] Yes
buy? [ ] No buy? [ ] No
How many times have you [ ] Never How many times have you [ ] Never
used the app for the last [ ] 1 or 2 used the app for the last [ ] 1 or 2
month? [ ] 3 or more month? [ ] 3 or
more

1
 Part Two

Usability testing proper by performing the given task scenarios

Perform the necessary steps to accomplish the following task scenarios. While performing
each task, the tester must think aloud. The recorder may record his/her partners’ voice during
the test run. Furthermore, the recorder may also note the tester’s facial expression,
vocalization, hand motion and body language for each task.

Task Scenario 1: You want to look for the cheapest 64GB iPhone 6s plus “rose gold”.
SHOPEE OLX
Cheapest price Cheapest price
~ # of phone taps ~ # of phone taps
(including text (including text
typed) typed)
Time needed to Time needed to
finish the task finish the task
Tester’s comments while performing the task Tester’s comments while performing the task

Answer the post-task questionnaire after performing task 1.

Task Scenario 2: You want to return to the app’s homepage to explore the site.
SHOPEE OLX
~ # of phone taps ~ # of phone taps
Time needed to Time needed to
finish the task finish the task
Tester’s comments while performing the task Tester’s comments while performing the task

Answer the post-task questionnaire after performing task 2.

2
Task Scenario 3. You need create an account in the assigned application. Please encode
real data.
SHOPEE OLX
~ # of phone taps ~ # of phone taps
(including text (including text
typed) typed)
Time needed to Time needed to
finish the task finish the task
Tester’s comments while performing the task Tester’s comments while performing the task

Answer the post-task questionnaire after performing task 3.

Task Scenario 4. You realized you won’t be able to maintain your account. You would have
to deactivate/delete your account.
SHOPEE OLX
~ # of phone taps ~ # of phone taps
(including text (including text
typed) typed)
Time needed to Time needed to
finish the task finish the task
Tester’s comments while performing the task Tester’s comments while performing the task

Answer the post-task questionnaire after performing task 4.

3
 Part Three

Post-testing
Please answer the post-test questionnaire below.
Table 2 Post-test questionnaire
SUBJECT 1 SUBJECT 2
What are the two things about the appdesign that you really liked?

What are the two things about the app design that you didn’t like?

Place an X in the corresponding box.

For Shopee tester
Strongly Disagree Neutral Agree Strongly
Disagree Agree
Easy to use app
Contents in the homepage
make me want to explore the
app
Easy to find basic menus/
functions
Well-organized app

For OLX tester

Strongly Disagree Neutral Agree Strongly
Disagree Agree
Easy to use app
Contents in the homepage
make me want to explore the
app
Easy to find basic menus/
functions
Well-organized app

4
 Part Four
Recommendations
Please list down at least three specific recommendations to improve the assigned website.
SHOPEE OLX