Test Administration Manual for Field Investigators Census Based Assessment Studies for Haryana State

Grades 3 and 5 March 2014

The Department of School Education Government of Haryana

In collaboration with National Council of Educational Research and Training, New Delhi

Background What is the purpose of the Haryana State Achievement Survey? The Government of Haryana has decided to carry out a regular assessment of its students' learning levels, in order to measure the 'health' of the education system, identify factors which affect performance and particular areas or student groups which require special attention, and to better guide policy making in the area of education, such as policies related to curriculum, teacher training, and pedagogy. The survey is envisioned to be carried out every year, for classes 3, 5 and 8 in the areas of numeracy and literacy (Maths and languages Hindi and English) on a census basis, meaning all students studying in Government schools in Haryana in these classes will be assessed each year. The assessment will NOT be used in any way for determining the rank of a student, deciding on promotions, or any punitive actions for schools, teachers or students. Details of testing for March 2014 Which classes will undergo the assessment? In the last week of March, 2014 the survey will be carried out for classes 3 and 5 only, on a census basis meaning, all students in classes 3 and 5 in Haryana Government schools will undergo this assessment. Cycle 1 March, 2014 Grades 3 and 5 Which subjects will be tested? For the students of both classes, the assessment will be on Hindi English Maths Besides these three subjects, there will also be 3 questionnaires, which include questions about the students, teachers and the school, in order to better understand the various factors which affect student learning. These questionnaires are Pupil Questionnaire (PQ) Teacher Questionnaire (TQ) School Questionnaire (SQ)

In addition, there is a set of Field Notes (FN), one document each for classes 3 and 5, which is to be filled by the Field Investigator (FI). Detailed instructions on filling the questionnaires and field notes will follow in subsequent sections. When will the tests be conducted? The tests will be conducted on a total of four days from March 25 to March 28. The first 2 days will be for the assessment of class 5, and the next 2 days will be for the assessment of class 3. Hindi and Maths will be tested on day 1 for both the classes (i.e. 25th March for Class 5 and 27th March for Class 3). The English assessment and the filling of questionnaires and

Field Notes will be conducted on day two for both the classes (i.e. 26th March for Class 5 and 28th March for Class 3). The timetable is given below: Class/ Grade Date Time 10:00 11:00 11:00 11:30 March 25 (Tuesday) 12:45 13:45 13:45 15:15 5 8:30 9:00 10:00 11:30 March 26 (Wednesday) 11:30 12:00 12:45 13:45 13:45 15:15 10:00 11:00 11:00 11:30 March 27 (Thursday) 12:45 13:45 13:45 15:15 3 8:30 9:00 10:00 11:30 March 28 (Friday) 11:30 12:00 12:45 13:45 13:45 15:15 30 min 90 min 30 min 60 min 90 minutes 3 1 2 30 min 90 min 30 min 60 min 90 minutes 60 min 30 min 60 min 90 minutes 2 3 1 2 Duration 60 min 30 min 60 min 90 minutes 2 Session 1 Subject Hindi FN for session 1 (Hindi assessment) Maths FN for session 2 (Maths assessment) Correction of open ended questions for Hindi by FIs SQ, TQ English FN for session 1 (English assessment) PQ Correction of open ended questions by FIs 1 Hindi FN for session 1 (Hindi assessment) Maths FN for session 2 (Maths assessment) Correction of open ended questions for English by FIs SQ, TQ English FN for session 1 (English assessment) PQ Correction of open ended questions by FIs

What is the role of the Field Investigator? Each school will be allotted a team of 2 Field Investigators. The two FIs will conduct the test together for that school. For high enrolment (more than 60) more than one FI teams may be allotted to one school. As the Field Investigator, you have the primary responsibility for ensuring that tests are administered fairly and correctly, complying with the all aspects of the test instructions. The following is a summary of activities to be undertaken by Field Investigators:

Time FI training (2 day training to be conducted between March 10-23) Conducted jointly by DIET Principals, BEEOs and Master Trainers under the guidance of SCERT

1 day prior to the assessment

Activity Familiarize yourself with Questionnaire items The test forms number of forms, number of items in each form and the testing time Writing the practice questions on the blackboard, explaining the way the questions have to be solved Directions to be given to the students to solve the questions Marking of the constructed response items o Visit the school to check its location, inform the school HT about arrangements to be made for the day of the test Ensuring that all students are present on the days of the assessment with the required stationery (pencil, eraser, hardboard) Ensuring that a suitable room with tables and chairs is available for the assessment administration, preferably where students will not be disturbed Ensuring that there is spare stationery (pencils, erasers) for the students Ensuring that student lists of the respective classes are available for each session for taking attendance in the Field Notes o o o o o o One FI to collect the test papers and spare empty envelopes from respective block office, and reach the school by 8:45 Other FI to reach the school by 8:00, meet the HT, the class teacher and then go to the class to check the seating arrangement Build a rapport with the students Ensure that the class teacher is not in the class when the FI is interacting with the students Day 1 Collect the attendance register from the class teacher Set up the room and material Open the seal of the test papers for the first test, 1 hour before the start time of the assessment Carry out the pre-test activities like introductions, taking attendance, distributing papers and getting the first sheet of the test paper (e.g. school name, district name etc) filled Day 2 Collect the attendance register from the class teacher Fill the TQ and SQ with the help of HT and class teacher Set up the room and material Open the seal of the test papers for session 1, 30 minutes before the start time of the assessment Carry out the pre-test activities like introductions, taking attendance, distributing papers and getting the first sheet of the test paper (e.g. school name, district name etc) filled Conduct the assessment for the first session (day 1 - Hindi, day 2 - English) Keep the completed papers for the first test session in an envelope Fill the Field Notes for the first test session using the filled test papers, attendance register etc On day 1, carry out the pre-test activities, like introductions, taking attendance, distributing papers and getting the first sheet of the test paper (e.g. school name, district name etc) filled, for the second test session (Maths) Keep the papers for the second test session back in an envelope Fill the Field Notes for session 2 using the filled question paper, attendance register etc Day 2 fill the Pupil Questionnaire After the test, spend about 90 minutes correcting the open ended questions in the language test for the day Seal all the solved papers (subject wise), unused papers (subject wise), and field notes + questionnaires in separate envelopes One FI to submit the subject papers for the day at the respective block office

On the day of the assessment

o o o o o o o o o o

Day 1 of the assessment March 25th 2014 (A) After entering the classroom for session 1 1. Introductory instructions to students (5 minutes - 9:00 9:10)

Introduce yourselves to the students the way a teacher normally does Say:

"Good morning students. Our names are <

&

>.

We are here to conduct an activity with you. We hope that you enjoy doing it with us. We will be giving you certain instructions. Please listen to them carefully and perform accordingly"

Ensure that the students are seated properly and comfortably Say: We will now hand out the booklets. Please do not open the booklets until we say so. "

2. Opening the packets, distribution of booklets Distribute the booklets to the children

(15 minutes - 9:10 9:25)

The two FI should divide the children into two groups.

3. FIs should go to each individual child and get all the details on page 1 of the test booklet filled (refer to appendix for district and block codes) (30 minutes - 9:25 9:55) 4. Assessment instructions (9:55 am)

Say the instructions given below in approximately 2 minutes: "This paper contains questions in Hindi." Please answer the questions on the test paper itself Try to answer the questions in one hour Try to answer ALL the questions There is only ONE answer for each question Choose the best answer and encircle the number of your answer

"This is how you will mark your answer" Use the blackboard to show an example as given in the test paper in approximately 3 minutes At 10: 00, say "You may now start with the questions"

Begin the test and follow the instructions for all the questions, as elaborated in the test booklet

Read the instructions for the first set of questions, as detailed in the booklet Read the instructions for the next set of questions only when the majority of the class have finished attempting the previous ones

5. Start collecting the test papers one hour after the test was started. However, if a child is still answering questions, allow him to complete. Say "Students, if you are done, please put down your pencils and close the test booklet. We will come and collect the test booklet from you. Please enjoy your mid-day meal" 6. General instructions: o o o o o Students should preferably not leave the session unless absolutely necessary In case a booklet is defective it should be collected back and the student should be given a new one Any Field Monitors, if present for monitoring, should also not be allowed to speak to the students or make announcements No teacher from the school should be allowed to enter the class while the test is ongoing Walk around the class and check that students are circling one answer only. If needed, help out students who did not understand how to mark the correct answer, individually

(B) Between session 1 and session 2 7. Count all the collected test papers. It should match with the total number of students present 8. Fill up the Field Notes for the first session 9. Count all the collected test papers + unused papers, and make sure their numbers are the same as the number of test papers written on the packet 10. Put the unused papers in one packet and the papers collected from the students in a separate packet 11. You will be correcting the open-ended questions in the language test in the afternoon, so do not seal the packet at this point 12. Allow the students a break from 11:00 11:45, ideally for a mid-day-meal 13. At 11:45, ensure the children take their seats again, for the second test (C) After entering the classroom for session 2 14. From 11:45 12:45 carry out the pre-test activities as detailed for session 1 o Introductory remarks 11:45 11:55 o Opening the packet and distribution of booklets 11:55 12:10 o Filling up the first page of the question paper for all students 12:10 12:40 o Assessment instructions 12:40 12:45 Say the instructions given below in approximately 2 minutes:

"This paper contains questions in Mathematics." Please answer the questions on the test paper itself Try to answer the questions in one hour Try to answer ALL the questions There is only ONE answer for each question Choose the best answer and encircle the number of your answer This is how you will mark your answer

Use the blackboard to show an example as given in the test paper in approximately 3 minutes

15. Ask the students to open the test papers at 12:45 16. For the mathematics paper, you will need to read aloud every question as well as the options in the stipulated time to the children 17. Begin the test and follow the instructions for all the questions, as elaborated in the test booklet 18. Read the instructions for the next question only when the majority of the class have finished attempting the previous one 19. Follow the instructions as given in the test booklet strictly 20. Start collecting the test papers one hour after the test was started. However, if a child is still answering questions, allow him to complete. (D) After session 2 21. Count all the collected test papers. It should match with the total number of students present 22. Fill up the Field Notes for the second session 23. Count all the collected test papers + unused papers, and make sure their numbers are the same as the number of test papers written on the packet 24. Put the unused papers in one packet and the papers collected from the students in a separate packet 25. Checking of open-ended questions o The language paper Hindi has a section on open-ended questions in which students write their answer on the question paper itself o Check the open-ended questions as detailed in the test booklet and write the marks next to the questions, on the paper itself 26. Once the checking of open ended questions is complete, seal the papers in the packets provided 27. One FI (of the two FIs for a school) should take all the sealed test papers to the respective block office and submit them after singing by 5:30 pm on the day of the test 28. The FIs should keep the questionnaires and the field notes with themselves, to be brought to the school the next day

Day 2 of the assessment (March 26th, 2014) 1. On day 2, one FI should go to the block office to collect the English test papers, and should reach the school by 8:45 2. The second FI should reach the school by 8:00 with the questionnaires and field notes (A) Session 1 School Questionnaire and Teacher Questionnaire Filling up the School Questionnaire (SQ) and Teacher Questionnaire (TQ) 8:30 9:00 1. School Questionnaire o The second FI should fill the Teacher Questionnaire (TQ) and the School Questionnaire (SQ) o For filling the school questionnaire, the FI should sit with the school HT/In-charge and ask the questions in the SQ o The answers should be filled in by the FI on the SQ, as per the answers provided by the HT 2. Teacher questionnaire o For filling the TQ, the FI should sit with the teachers who teach class 5 (Maths, Hindi, English) in the school and ask the questions given in the TQ o If there is one teacher teaching all subjects, only one TQ needs to be filled o If there are different teachers teaching the three subjects, then three TQs need to be filled o The answers should be filled in by the FI on the TQ, as per the answers provided by the teacher 3. At 9:00, the two FIs should reach the classroom for assessment (English) (B) After entering the classroom for session 2 (English) 4. Introductory instructions to students (5 minutes - 9:00 9:10)

Introduce yourselves to the students the way a teacher normally does Say:

"Good morning students. Our names are <

&

>.

We are here to conduct an activity with you. We hope that you enjoy doing it with us. We will be giving you certain instructions. Please listen to them carefully and perform accordingly"

Ensure that the students are seated properly and comfortably Say: We will now hand out the booklets. Please do not open the booklets until we say so. " (15 minutes - 9:10 9:25)

5. Opening the packets, distribution of booklets Distribute the booklets to the children

The two FI should divide the children into two groups.

6. FIs should go to each individual child and get all the details on page 1 of the test booklet filled (refer to appendix for district and block codes) (30 minutes - 9:25 9:55)

7. Assessment instructions

(9:55 am)

Say the instructions given below in approximately 2 minutes: "This paper contains questions in English." Please answer the questions on the test paper itself Try to answer the questions in one hour and thirty minutes Try to answer ALL the questions There is only ONE answer for each question Choose the best answer and encircle the number of your answer

"This is how you will mark your answer" Use the blackboard to show an example as given in the test paper in approximately 3 minutes At 10:00, say "You may now start with the questions"

Begin the test and follow the instructions for all the questions, as elaborated in the test booklet Read the instructions for the first set of questions, as detailed in the booklet Read the instructions for the next set of questions only when the majority of the class have finished attempting the previous ones

8. Start collecting the test papers one hour and thirty minutes after the test was started. However, if a child is still answering questions, allow him to complete. Say "Students, if you are done, please put down your pencils and close the test booklet. We will come and collect the test booklet from you. Please enjoy your mid-day meal"

9. General instructions: o o o o o Students should preferably not leave the session unless absolutely necessary In case a booklet is defective it should be collected back and the student should be given a new one Any Field Monitors, if present for monitoring, should also not be allowed to speak to the students or make announcements No teacher from the school should be allowed to enter the class while the test is ongoing Walk around the class and check that students are circling one answer only. If needed, help out students who did not understand how to mark the correct answer, individually.

(C) Between session 2 and session 3 10. Count all the collected test papers. It should match with the total number of students present 11. Fill up the Field Notes for the second session 12. Count all the collected test papers + unused papers, and make sure their numbers are the same as the number of test papers written on the packet 13. Put the unused papers in one packet and the papers collected from the students in a separate packet 14. You will be correcting the open-ended questions in the language test in the afternoon, so do not seal the packet at this point 15. Allow the students a break from 11:30 12:45, ideally for a mid-day-meal (D) Session 3 Pupil Questionnaire 16. Pupil Questionnaire (PQ) o o o o o o Both the FIs will spend this session filling the Pupil Questionnaire The FIs should divide the students between themselves for filling up the PQ One PQ has space for filling the data of 20 students For this questionnaire, some fields will be obtained directly from the school records These fields should be filled first by the FI, for all the students present in the school that day For the remaining fields, the FI should call the students one by one to the teacher's desk, and fill in the answers given by the students in the PQ

17. Checking of open-ended questions o The language paper English has a section on open-ended questions in which students write their answer on the question paper itself o Check the open-ended questions as detailed in the test booklet and write the marks next to the questions, on the paper itself

18. Once the checking of open ended questions is complete, seal the papers in the packets provided 19. One FI (of the two FIs for a school) should take all the sealed test papers and questionnaire and field notes to the respective block office and submit them after singing by 5:30 pm on the day of the test Days 3 and 4 of assessment (March 27th 28th, 2014) Days 3 and 4 of the assessment would be carried out in exactly the same format as days 1 and 2, only with students of class 3 instead of class 5

Checklist for Field Investigators (FI)

Activity to be performed 1 day prior to the assessment Visit the school Familiarize with the location of the school Ensuring the school HT is aware of the test and its purpose, and conveying to them the provisions / preparations which will need to be made for the test Ensuring presence of the students on the days of the assessment with the required stationery (pencil, eraser, hardboard) Ensuring infrastructural facilities like availability of chairs, tables etc for administration Ensuring spare stationery (pencils, erasers) for the students for the test Ensuring that student lists of the respective classes are available for each session for taking attendance in the Field Notes

I.

On the day of the assessment Collection of papers for that day and the questionnaires, from the respective block office from 7:00 8:00 am, after signing for them and reach the school by 8:45 am Reaching of the other FI to the school by 8:00 am to make required arrangements o II o o o o o o English booklets Mathematics booklets PQ SQ TQ Field Notes Correcting the open ended questions in both the language assessment papers Sealing of all the solved papers (subject wise), unused papers (subject wise), and field notes + questionnaires in separate envelopes Submitting the subject papers for the day at the respective block office Go to the school HT and greet him Collect the student list for the class being tested from the school HT Go to the class where the assessment will be conducted

After conducting the assessment, collecting the filled in: Hindi booklets

APPENDIX DISTRICT AND BLOCK CODES

DISTRICT NAME PANCHKULA PANCHKULA PANCHKULA PANCHKULA AMBALA AMBALA AMBALA AMBALA AMBALA AMBALA YAMUNANAGAR YAMUNANAGAR YAMUNANAGAR YAMUNANAGAR YAMUNANAGAR YAMUNANAGAR KURUKSHETRA KURUKSHETRA KURUKSHETRA KURUKSHETRA KURUKSHETRA KAITHAL KAITHAL KAITHAL KAITHAL KAITHAL KAITHAL KARNAL KARNAL KARNAL KARNAL KARNAL KARNAL PANIPAT PANIPAT PANIPAT PANIPAT PANIPAT SONIPAT SONIPAT SONIPAT SONIPAT BLOCK NAME PINJORE BARWALA MORNI RAIPUR RANI AMBALA 1 AMBALA-II SAHA BARARA NARAINGARH SHAHZADPUR BILASPUR RADAUR JAGADHRI CHHACHHRAULI MUSTAFABAD SADHAURA SHAHBAD PEHOWA THANESAR BABAIN LADWA GUHLA KAITHAL KALAYAT PUNDRI RAJOUND SIWAN GHARAUNDA NISSING NILOKHERI KARNAL INDRI ASSANDH PANIPAT ISRANA SAMALKHA MADLAUDA BAPOLI SONEPAT RAI GANAUR KHARKHODA DISTRICT CODE 01 01 01 01 02 02 02 02 02 02 03 03 03 03 03 03 04 04 04 04 04 05 05 05 05 05 05 06 06 06 06 06 06 07 07 07 07 07 08 08 08 08 BLOCK CODE 01 02 03 04 01 02 03 04 05 06 01 02 03 04 05 06 01 02 03 04 05 01 02 03 04 05 06 01 02 03 04 05 06 01 03 04 05 06 01 02 03 04

SONIPAT SONIPAT SONIPAT JIND JIND JIND JIND JIND JIND JIND FATEHABAD FATEHABAD FATEHABAD FATEHABAD FATEHABAD FATEHABAD SIRSA SIRSA SIRSA SIRSA SIRSA SIRSA SIRSA HISAR HISAR HISAR HISAR HISAR HISAR HISAR HISAR HISAR BHIWANI BHIWANI BHIWANI BHIWANI BHIWANI BHIWANI BHIWANI BHIWANI BHIWANI BHIWANI ROHTAK ROHTAK ROHTAK ROHTAK

GOHANA MUNDLANA KATHURA JIND JULANA SAFIDON PILLUKHERA ALEWA UCHANA NARWANA FATEHABAD BHUNA BHATTU RATIA TOHANA JAKHAL BARAGUDHA DABWALI ELLENABAD NATHUSARI CHOPTA ODHAN RANIA SIRSA ADAMPUR AGROHA BARWALA HANSI-I HANSI-II HISAR-I HISAR-II NARNAUND UKLANA BADHRA BAUND KALAN BAWANI KHERA BEHAL BHIWANI DADRI KAIRU LOHARU SIWANI TOSHAM KALANAUR LAKHAN MAJRA MEHAM ROHTAK

08 08 08 09 09 09 09 09 09 09 10 10 10 10 10 10 11 11 11 11 11 11 11 12 12 12 12 12 12 12 12 12 13 13 13 13 13 13 13 13 13 13 14 14 14 14

05 06 07 01 02 03 04 05 06 07 01 02 03 04 05 07 01 02 03 04 05 06 07 01 02 03 04 05 06 07 08 09 01 02 03 04 05 06 07 08 09 10 01 02 03 04

ROHTAK JHAJJAR JHAJJAR JHAJJAR JHAJJAR JHAJJAR MAHENDRAGARH MAHENDRAGARH MAHENDRAGARH MAHENDRAGARH MAHENDRAGARH REWARI REWARI REWARI REWARI REWARI GURGAON GURGAON GURGAON GURGAON FARIDABAD FARIDABAD MEWAT MEWAT MEWAT MEWAT MEWAT PALWAL PALWAL PALWAL PALWAL

SAMPLA JHAJJAR BAHADURGARH SALHAWAS BERI MATANHAIL ATELI MOHINDERGARH NARNAUL NANGAL CHOUDHARY KANINA BAWAL JATUSANA KHOL NAHAR REWARI GURGAON PATAUDI SOHNA F.NAGAR BALLABGARH FARIDABAD PUNHANA F.P JHIRKA NAGINA NUH TAURU HASANPUR HATHIN PALWAL HODAL

14 15 15 15 15 15 16 16 16 16 16 17 17 17 17 17 18 18 18 18 19 19 20 20 20 20 20 21 21 21 21

05 01 02 04 05 06 01 03 04 05 07 01 02 03 04 05 01 02 03 04 01 16 01 02 04 05 06 02 03 10 17