Frets on Fire Usability Test Purpose The purpose of this test is to determine if the novice computer user can

effectively make use of Frets on Fire game. This test should also determine how perceptive and easy to learn the interface of the game. Test Objective 1. Can a first time user of the Frets on Fire game application identify commands and understand its interface? 2. Can the first time user complete the two songs of different levels of difficulty? 3. Is the game interesting for the participants whose skills are in the intermediate level? User Profile 1. Male or female 2. 15-25 years old 3. Knows how to play guitar (Intermediate level) 4. No prior experienced in using Frets on Fire 5. Should be able to read and understand English instructions Methodology The test will be given to one subject at a time. The subject will be provided with a workstation containing the Frets on Fire game application. A manual shall also be provided; other than that no other materials and software is needed to complete the test. The group has the following roles during the test process. 1 Test Monitor 1 Timer 2 Data Logger 1 Observer Test Process 1. Screening Possible participants will be asked to fill out a form to determine if the qualification of the participant fits the user profile. 2. Orientation The participant will be briefed using an orientation script describing the test and the basic tools and features of the game application. 3. Gathering of background information The group will ask the subject to elaborate his answers in the screening form when necessary. 4. Testing and data collection The test subjects shall be given printout manuals detailing the steps from opening the application until finishing each of the tasks. By following the direction indicated in the manual, the participants shall be able to finish two songs of different levels of difficulty. 5. Post Testing

The participant shall answer a post-test questionnaire to gather qualitative data regarding his/her experience in playing Frets on Fire game application. 6. Debriefing To note down the participants experience, suggestions, recommendations, and to elaborate on his answers base on the posttest. Reporting of results Their score will be summarized, analyzed, and reported. From the qualitative and quantitative data gathered, analysis, recommendations, and suggestions for improvement will be made based on the results of the test.

Frets on Fire Screening Questionnaire Name: Age: Gender: Email Address: Do you play guitar? (Check one) () Yes () No Rate yourself () Beginner () Intermediate () Advance Highest Educational Attainment ( ( ( ( ) ) ) ) Grade School High School College Graduate Degree

Please check which game applications you have used: ( ) Guitar Hero ( ) JamLegend ( ) Super Crazy Guitar Maniac List other computer game applications you use: ______________________________________________________________________________________ ______________________________________________________________________________________ ______________________________________________________________________________________ __________________________________________________________________________ Have you ever used Frets on Fire before? ______ Hobbies:

______________________________________________________________________________________ ______________________________________________________________________________________ ______________________________________________________________________________________ __________________________________________________________________________

Frets on Fire Orientation Hello! My name is _________________________ and these are my teammates, ________________________. We have asked you to participate in this test to help us evaluate the effectiveness and efficiency of Frets on Fire game application to novice computer user such as yourself. Frets on Fire, abbreviated FoF is a free, open source music video game. The players use the keyboard to play along with markers which appear on screen, with the aim to score points, achieve a high point multiplier and complete a song. These tasks involve step-by-step instructions on how to play Frets and Fire. Knowing that you have no experience in using this application, wed like you to try it out and learn the basic tools through the help of a manual we will provide. You have your own workstation with the Frets on Fire game application installed in it. We have to observe you as you follow the instructions on the manual and how you go about in the game to complete them. Feel free to express your frustrations and reactions in any way possible as long as you do not destroy the test materials. From time to time, please tell us which part and what instructions are you following. For help or clarification, just raise your hand and I or the test monitor assigned shall approach you.

Ill give a brief explanation on the Frets on Fire environment. This is the Frets on Fire environment. First you will see a menu of options of whether youd like to start the game or take the tutorial first. When you choose to play the game, you get to choose what fret board image you like. After choosing the image, a list of songs will appear but we will just let you choose a particular song with the corresponding guitar mode and level of difficulty.

The first song would be on a medium mode. In playing the game in this level, use the keys F1 for the first string, F2 for the second, F3 for the third and F4 for the fourth string. When keying-in the keys for the strings, the ENTER key must be pressed simultaneously. After the first song, another song of a hard level of difficulty will be played, there would be five strings to manipulate and the key F5 will be the key for the fifth string. Do you have any questions at this point? A more detailed explanation is shown on the manual that we will provide. Please feel free to ask questions concerning the Frets on Fire game application. If you dont have any questions, let me first ask some questions before we proceed.

Frets on Fire Background Information Questionnaire

Test Subject No.: _____ Test ______________________________________

Subject

Name:

How long have you started playing guitar? What motivated you to learn play the guitar?

What do you think is your level of expertise? How often do you play the guitar?

Have you played any guitar game application before? If yes, what are those games?

Have you ever observed other people playing Frets on Fire before? Do you find it interesting?

Frets on Fire Test Document

1. Open the FRETS ON FIRE game application. 2. Select PLAY GAME from the options. 3. Choose a fret board image from the choices. And start the game. 4. Choose SWEET CHILD OF MINE from the list of songs. Next, select GUITAR mode from the options given. Then, choose the MEDIUM level of difficulty which manipulates four strings. 5. Start to play the game. 6. After completing the first song, click the Enter tab to proceed to the next page where you have to enter your name for the game to record your score. 7. Click QUIT TO MAIN MENU option. 8. Choose the second song, CANON ROCK from the song list which is already in a hard level of difficulty. 9. Start to play the game. 10.After completing the second song, click the Enter tab to proceed to the next page where you have to enter your name for the game to record your score. 11.Click QUIT TO MAIN MENU to leave the current page. 12.In the main menu, CLICK QUIT to close the Frets on Fire game application.

Frets on Fire Post-test I found the layout/interface of the game Clear Strongly Agree Neutral Agree Organize Strongly Agree Neutral Agree Understanda Strongly Agree Neutral ble Agree Easy Strongly Agree Neutral Agree I found the control keys and buttons Clear Strongly Agree Agree Organize Strongly Agree Agree Understanda Strongly Agree ble Agree Easy Strongly Agree Agree I found the navigation of the Clear Strongly Agree Organize Strongly Agree Understanda Strongly ble Agree Easy Strongly Agree I found the manual Clear Strongly Agree Organize Strongly Agree Understanda Strongly ble Agree Easy Strongly Agree software Agree Agree Agree Agree Disagree Disagree Disagree Disagree Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree

Neutral Neutral Neutral Neutral

Disagree Disagree Disagree Disagree

Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree

Neutral Neutral Neutral Neutral

Disagree Disagree Disagree Disagree

Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree

Agree Agree Agree Agree

Neutral Neutral Neutral Neutral

Disagree Disagree Disagree Disagree

Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree

I found the Visual Effects and Graphics to be Clear Strongly Agree Neutral Agree Organize Strongly Agree Neutral Agree Understanda Strongly Agree Neutral ble Agree Easy Strongly Agree Neutral Agree I found the Audio Effects Clear Strongly Agree Organize Strongly Agree Understanda Strongly ble Agree Easy Strongly Agree

Disagree Disagree Disagree Disagree

Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree

Agree Agree Agree Agree

Neutral Neutral Neutral Neutral

Disagree Disagree Disagree Disagree

Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree

Overall, I found the game to be Clear Strongly Agree Agree Organize Strongly Agree Agree Understanda Strongly Agree ble Agree Easy Strongly Agree Agree

Neutral Neutral Neutral Neutral

Disagree Disagree Disagree Disagree

Strongly Disagree Strongly Disagree Strongly Disagree Strongly Disagree

Frets on Fire Debriefing Questions Test Subject No.: _____ Test ______________________________________ How did you find the instructions? Subject Name:

How did you find the tasks?

What do you think of the game?

Do you think a first time user of Frets on Fire can easily understand the game?

As a whole, did you find it difficult to play?

Are you willing to play the game again?