Академический Документы
Профессиональный Документы
Культура Документы
www.britishcouncil.in
Issue 2: Assessing learning (1) 1
Produced by:
British Council
L&T Chambers First Floor
16 Camac Street
Kolkata 700017
India
www.britishcouncil.in
Issue 2: Overview
Assessing learning (1) 4
Issue 2: Overview
All three papers in this issue of Explorations: Professor Kirti Kapur has 28 years of experience
Teaching and Learning English in India investigate in ELT. At NCERT, she is involved in curriculum
the professional practice of assessing learners. design, development of textual materials and
This professional practice includes designing teacher training. She has undertaken research
tasks to measure learners’ progress and applying on multilingualism, cultural aspects of language
assessment criteria in appropriate ways. It also learning and making ELT learner centric.
includes developing skills in analysing learners’
errors and providing constructive feedback. Kuheli Mukherjee is a senior teacher of ESL
Through this professional practice, teachers can at Sakhawat Memorial Government Girls’ High
use assessment effectively to monitor learning School, Kolkata and has twenty years’ experience
and use data from assessments to inform in teaching, training, curriculum designing and
teaching. developing materials.
Jayati Chatterjee and Dhriti Sundar Gupta Kalyan Chattopadhyay is Associate Professor
investigate current ways of testing learner and Director, ELC, Bankim Sardar College, Vice-
language skills at secondary school level. They President, AsiaCALL, and ex-Coordinator, IATEFL
examine test candidates’ views and performance YLTSIG. He regularly speaks and publishes on
and recommend both formative and summative language skills development and technology-
testing. Kirti Kapur also researches current assisted language learning.
practice, finding that approaches are inconsistent
and proposing the design and use of standardised About the English Language Teaching
rubrics. Kuheli Mukherjee and Kalyan Research Partnerships (ELTReP) Award
Chattopadhyay investigate how secondary programme
school teachers can give feedback on the writing
India has a long tradition of educational research
performance of their learners and suggest more
but the results of this have not always reached
focused and consistent feedback to help learners
the wider world. Through a range of programmes,
to gain greater writing competence in English.
British Council India places considerable emphasis
on encouraging and supporting inquiry. A key
About the authors
strand of that work between 2012 and 2016 has
Jayati Chatterjee is Assistant Professor of been the English Language Teaching Research
Linguistics at the English and Foreign Languages Partnerships (ELTReP) Award programme. The
University, Shillong Campus, Meghalaya, India. programme aimed to facilitate high quality,
innovative research to benefit the learning and
Dhriti Sundar Gupta is Assistant Professor at teaching of English in India and to improve the
Rajiv Gandhi University, Arunachal Pradesh, India. access of ELT policy makers, professionals from
4 Explorations: Teaching and Learning English in India © British Council India 2017
India and the United Kingdom and the global Acknowledgements
ELT community to that research. All writers
British Council India would like to acknowledge
contributing to the eleven issues of Explorations:
the support of Dr Richard Smith of Warwick
Teaching and Learning English in India were
University and Professor Rama Mathew of Delhi
selected and supported in their research by the
University throughout the ELTReP programme
ELTReP Award programme.
and, in particular, the help and encouragement
provided to the writers contributing to this
All three papers in this issue have been written
volume. The writers would like to acknowledge all
by practitioners in the field, whether teachers,
professionals, learners and other participants who
lecturers, educational department personnel
have helped them to undertake and present their
or other roles that involve day-to-day contact
research.
with the teaching and learning of English. The
researchers, many of whom will be seeing their
All the papers in this issue were edited by
work published for the first time, have designed
Professor Brian Tomlinson in collaboration with
and implemented their studies and present results
the writers themselves. We would like to extend
which in each case are innovative and thought-
our sincere thanks to Professor Tomlinson.
provoking. Each paper reflects the creativity,
detailed awareness of context and practical
The opinions expressed in the papers in this issue
suggestions of a wide range of writers, from
are those of the individual authors and do not
different backgrounds and working in different
necessarily represent or reflect the views of the
situations.
British Council.
6 Explorations: Teaching and Learning English in India © British Council India 2017
The following are the research questions which matches with their response to the class 12 tests
this study has addressed. being a confidence and proficiency booster.
1. To what extent does the testing practice of This view indirectly confirms the positivity of the
+2 level measure the development of LSRW test impact. However, only 50 per cent of the
Skills in ESL learners across educational respondents from Board D and 60 per cent from
boards? Board B strongly agree with the statement and
this percentage of agreement is lower than the
2. To what extent do the views of test takers
range of agreement (75 to 85 per cent) offered
ensure the predictive validity of the tests in
by respondents from other boards. The difference
English at the +2 level?
signals some gap in the learners’ understanding of
the non-immediate test objectives. Twenty to 30
3. Research methods per cent of the total respondents do not consider
The present study is a combination of qualitative the class 12 tests as a confidence and proficiency
and quantitative research. The data is collected booster and their response calls for an analysis of
through a survey method. the test design with necessary modifications.
Sampling: Six examination boards are selected According to the survey, 65 to 70 percent of
from the north, south, east and west of India the respondents show their confidence in the
for the study. To maintain confidentiality, the six test design. They feel the test can bring out the
boards are named as Board A, B, C, D, E and F. degree of their flexibility in using LSRW. However,
Thirty testees who have successfully passed only 45 to 50 per cent of test-takers from Board
the higher secondary examination from each E and Board A recognise a proportional link
board have been selected for the study. The between their score in the class 12 test and their
respondents have completed a questionnaire and flexibility in using English contextually. Although
have taken a proficiency test. the testees find that the test is an authentic
representative of their language (English) skills
Instruments: Primarily, two instruments are in general, they are not sure if their test-scores
developed for the investigation: a structured (class 12) indicate their flexibility in using LSRW
questionnaire for the testees and a test paper in English separately. Ten to 40 per cent of them,
modelled on a globally accepted general consequently, remain undecided. A sizeable
proficiency test module. The purpose of this section (20 per cent) do not agree that either the
questionnaire is to find out the general opinion class 12 test (English) can judge their acquired
of the testees and the teachers on the core language skills or the test can be a confidence-
English test of the class 12 board examination and booster in using the language. Such responses
thereby investigate the impact of these testing could be converted to more positive ones by
practices on Indian ESL learners. exposing them at school to frequent mock tests
with special focus on language use.
4. Findings
Nearly 60 to 90 per cent of the testees
This section will summarise and comment on
emphatically accept the fact that the test they
the testees’ responses to the questions on the
have taken at the class 12 (Board Examination)
questionnaire. Survey findings can be found in
is a test of their ability to communicate with
Appendix 1.
native speakers. The response is in tune with
their acceptance of the test being a true mode
In response to the question whether the English
of exhibiting their skills. However, 10 to 35 per
language test of the Class 12 board examination
cent of the test-takers do not perceive the
was a fair and accurate test of their English
correlation. One may note that while 45 per
language skills, 70 to 90 per cent of testees
cent of the respondents of Board D and Board F
across the boards appear satisfied with the
agree with the statement, 55 per cent of them
ability of the test to evaluate the testees’ total
are either undecided or disagree with it. A large
and sub-skills of the English language. It largely
8 Explorations: Teaching and Learning English in India © British Council India 2017
of memory. The response contradicts their view component of the educational system and the
that the test is able to acquaint them with their test-format is stereotypical. Twenty to 35 per
strengths and weaknesses in using the language. cent of respondents do not receive any guidance
The testees seem to be confused between their from the test as regards the improvement of their
strengths and weaknesses as regards their ability learning. Once again the larger impact of the test
to use the English language and their strong and is missing.
weak memory of the classroom learning inputs.
However, a noticeable section of ten to 45 per More than half of the respondents do not feel that
cent disagrees with the statement, suggesting the test and assessment generate nervousness
that the items should be tested contextually. One because they seem to be clear about the
may argue that most of the testees may have test objectives. Moreover, their preparedness
attended classes regularly and have sufficient has made them familiar with the test pattern.
practice in the parallel, mock-format of the However, 20 to 55 per cent of the testees feel
application-based version in the board test paper. nervous while taking the tests and receiving the
The format may have been imprinted in their assessments, which may indicate their lack of
memory. Consequently, they feel that the class confidence rather than any intrinsic shortcomings
12 test and assessment measure the retention of in the test. One may note that from Board E, 55
their learning. per cent feel nervous as regards the test and
assessment in English and 45 per cent disagree
As a post-test effect, 65 to 95 per cent do not with the statement. In Board F the response is
lose interest in English, proving the success of the equally divided (50 per cent each). The testees
test designer. Only five to 35 per cent claim to of these two boards need to be given more mock
have lost interest, probably as a consequence of tests at the school level to combat the fear of
their poor score. Their response reinforces their tests in English. The test papers need to include
discomfort with the test-items, selected from a test items well distributed in the scale of easy-
domain outside the prescribed syllabus. moderate-difficult.
Sixty to 85 per cent of respondents do not In response to the question regarding the
consider the test as a realistic placement test test of different skills and sub-skills and the
but 15 to 45 per cent of the respondents do. adequate marks allotment, more than 75 per
Though the majority is benefited by the test, cent of testees claim their listening skill is often
a sizable section does not appear to receive tested and adequately assessed. It indirectly
any rewarding effects from the test, which may proves the presence of trained teachers who are
require a deliberation on how to motivate the formally taught how to test the listening skills of
learners through tests. Seventy-five per cent of the learners of English. The response appears
testees from Board D find the test a mere ritual, supportive of the presence of an infrastructure
suggesting that Board D needs to make efforts for testing listening skills in schools. Fifteen to
to redesign the tests and make the testees clear 25 per cent of testees however disagree with the
about its objectives beyond mere scoring for statement, which indirectly implies unsatisfactory
higher placement. testing and assessment of their listening skill. It
could be due to inadequate infrastructure and
Sixty-five to 100 per cent agree that the test untrained teachers in some institutions/schools. In
is able to identify those areas of the test- this context, one may note that while 45 per cent
takers’ learning which call for improvement. of testees from Board C are happy with the test
The response seemingly refutes a part of the of their listening skills, 55 per cent find that this
previous response. Some test-takers benefited skill is neither adequately tested nor assessed.
by the test as they feel that the test scores can This response calls for a deliberation on the
make them recognise their aptitude in language distribution of marks of the skills being tested by
learning. However, these testees consider these the board examination English test paper.
tests as rituals because testing is a mandatory More than 70 per cent of test-takers accept
10 Explorations: Teaching and Learning English in India © British Council India 2017
board examination. Since a sizeable section of In an urban set up the test-takers often have to
the respondents feel that their respective board communicate in English and face a test of their
examination can be considered equivalent to skill, and gradually improve their performance.
IELTS/TOEFL, they do not require any pan-Indian The difference between the scores in listening
common proficiency test. However, 73.3 per and speaking tests may indicate they are able
cent of the population do not find any match listeners but they are hesitant speakers. Moreover,
between the respective board examinations and the listening comprehension test in the sample
IELTS/TOEFL. They seem to be more critical of proficiency test paper is comparatively more
the selection of test items and test design and guided than the speaking production test, where
the test purpose of the two proficiency tests to answer the questions the testees require a
concerned. perfect combination of facts, structural knowledge
of the language, good pronunciation and self-
In Figure 1, the testees from the low to high confidence. However, the positive result of the
achievers group have been placed according test matches their responses regarding the test
to their scores in English in the class 12 board and assessment of the speaking skill through oral
examination. However, their class 12 board production.
examination score does not explain the cause of
the variation visible in their performance in the There is a moderate performance in the written
skill-based proficiency test. The performance production and reading comprehension test.
in the listening skill test is mostly uniform and Developing their writing skill is the most difficult
the score in the listening comprehension test is task and the test-takers do not seem to be very
comparatively higher than the scores in the tests comfortable in combining content with vocabulary
of other skills across the testees. It appears that and structures of English fluently and accurately.
the listening comprehension test and assessment The testees mostly follow the rote method in
done in the class have benefited them in learning preparing selected topics and textual answers.
the skill. It matches their response to Q1 in the Most of them rarely offer genuine free response
learners’ questionnaire. to a topic. Outside the classroom, their reading
and writing skills may be tested infrequently
The score in the oral production test shows the as compared to the tests of their speaking and
next best performance of the testees. All the listening skills, which are required frequently to
groups have done reasonably well and show communicate with others in a cosmopolitan urban
proficiency in speaking. The test-takers’ good area.
performance on the oral test is not surprising.
12 Explorations: Teaching and Learning English in India © British Council India 2017
Appendix: Survey results
Q1. The English language test at class 10/12 was a fair and accurate test of my English language skills
(total and sub-skills).
Q2.The test score was directly proportional to the degree of my flexibility in using English.
Q3. The test boosted my confidence level or proficiency in using the language in non-exam/outside
school contexts.
Q4. The test identifies my ability to communicate with native speakers of English.
Q5. The test identifies and ensures the usability of my command over English in your prospective
specialised stream/professional domain.
Q6. The difficulty level of the test items matched the teaching input in my English classes at school/
college.
Q7a. The class 10/12 test and Assessment in English showed what I know about the language.
Q7b. The class 10/12 test and Assessment in English acquainted me with my strengths and weaknesses
in using the language.
Q7c. The class 10/12 test and Assessment in English showed my acquaintance with the syllabus.
Q7d. The class 10/12 test and Assessment in English measured my learning retention.
Q7e. The class 1012 test and Assessment in English made me lose interest in English.
Q7f. The class 10/12 test and Assessment in English appeared to be a ‘ritual’ of the curriculum.
Q7g. The class 10/12 test and Assessment in English provided me with information about which area to
improve or learn better.
Q7h. The class 10/12 test and Assessment in English made me feel nervous.
Q8a. The following are often tested or assessed and adequate marks are allotted to each of them:
listening comprehension.
Q8b. The following are often tested or assessed and adequate marks are allotted to each of them:
reading comprehension.
Q8c. The following are often tested or assessed and adequate marks are allotted to each of them: oral
production.
Q8d. The following are often tested or assessed and adequate marks are allotted to each of them: written
production.
Q8f. The following are often tested or assessed and adequate marks are allotted for them: pronunciation.
Q8g. The following are often tested or assessed and adequate marks are allotted for them: grammar.
Q9. Are you familiar with the names of any of the following tests? IELTS-TOEFL?
Q10. What is the purpose of these tests? (Tick the appropriate box)
Q11.Do you think the English language test at Class 10/12 can be considered equivalent to /IELTS/
TOEFL?
Q12. Do you think that there is requirement for a pan-India English language proficiency test?
14 Explorations: Teaching and Learning English in India © British Council India 2017
2
Assessment practices in ELT: an exploratory
study of the need for and design of a
standardised framework in India
Kirti Kapur
16 Explorations: Teaching and Learning English in India © British Council India 2017
While there are several research findings ignored. Research insights on enumerating and
informing us about the role and importance of addressing these gaps in teaching, learning and
formative and summative assessment in teaching- assessment practices can help make assessment
learning e.g. Puppin (2007); Nicol and Macfarlane- more consistent and meaningful in the Indian
Dick (2006); NCLRC (2004), it is important to study context. Popham (2009) calls assessment literacy
ongoing practices so as to identify gaps from ‘a sine qua non for today’s competent educator’
stated and curricular aims. In Becoming Critical: (Popham:11).
Education, Knowledge and Action Research Carr
and Kemmis (1986) explain action research as 2. Objectives of the study
improvement of ‘…practice, the understanding of
practice and the situation in which the practice
•• To document assessment techniques being
takes place’ (Carr and Kemmis: 162). This is
practised in ELT classrooms in government
the very schema that has been applied to the
run elementary schools (English and Hindi
following study on assessment practices in the
medium) in NCR, India.
English language classroom.
•• To document assessment techniques being
Language assessment from a structuralist practised in ELT classrooms in private
approach is a fairly easy task, since it aims at elementary schools in NCR, India.
testing correct use of grammar and lexical •• To undertake a comparative study of
structures. From the constructivist perspective, the outcomes of assessment techniques
the comfort of teaching and assessing objective practised in ELT classrooms in government
and homogeneous linguistic contents is replaced run and private schools.
by a wider spectrum of language teaching and
•• To identify the contextual variations in
assessing possibilities, whose key elements
recording and reporting of student progress
are collaboration, negotiation, needs, diversity
and its impact on learners.
and critiquing. Here, the primary purpose of
assessment is to improve children’s learning •• To correlate learning levels and
and to help them progress, leading to their effectiveness of assessment techniques
overall development. Information about their being adopted in ELT classrooms.
learning gathered through assessment during •• To identify strategies that can be adopted
teaching-learning helps teachers determine in English language classrooms to promote
children’s strengths and learning gaps. The data integration of assessment with teaching
generated further serves as a guide in adapting methods i.e. formative assessment.
the curriculum and teaching-learning approaches/
methods suited to learners’ needs: ‘assessment is The research is based on my first-hand
an integral component of a coherent educational experience with teachers and learners.
experience’ (James et al, 2000: 1). Assessment techniques at the elementary level in
ELT classrooms of both government and private
The online teaching resources of Carnegie Mellon schools in NCR are exam oriented. Formative
states: ‘…assessments, learning objectives, and assessment techniques are not being practised in
instructional strategies [should] be aligned… ELT classrooms in the NCR. Assessment processes
Assessments should reveal how well students are not used to identify learning levels of learners
have learned what we want them to learn while with an aim to modify teaching inputs. Recording
instruction ensures that they learn it’ (Section: and reporting are regarded as impediments to
teaching). However, the present system of the teaching learning process. It is strongly felt
assessment in schools across India is exam- that there is a need to invest in teacher-training
based and focuses only on testing reading programmes to encourage a standardised
comprehension and writing tasks. Listening and approach to assessment.
speaking are neglected and their assessment is
18 Explorations: Teaching and Learning English in India © British Council India 2017
3. Findings is clearly no mechanism to connect assessment
with the process of learning. Teachers do not
In terms of general examination characteristics,
link assessment to achievement of curricular
it was found that both government and privately
goals, identifying levels of learners or creating
run schools largely follow paper-and-pencil
appropriate learning situations. As a result,
testing methods for assessment. Marks-based
learners and their parents are not able to
assessment predominates and assessment for
use this reporting format in a constructive
learning is not being practised. While privately
manner. At the end of phase 1, it was strongly
run schools do adopt activity-based learning
identified that assessment literacy should
methods in some areas, in the government
become a mandatory component of teacher and
schools the focus is largely on rote learning.
educational stakeholder training. ‘After dividing
Further, formative assessment techniques are
educators’ measurement-related concerns into
not being practised in their true spirit. The multi-
either classroom assessments or accountability
ability approach to designing activities (i.e. using
assessments, it is argued that educators’
a variety of activities for learners at different
inadequate knowledge in either of these arenas
levels) is missing. Listening and speaking skills are
can cripple the quality of education’ (Popham,
given less attention than reading and writing. In
2009: 4).
government schools there was little to no focus
on listening skills and in privately owned schools
In phase 2, parents too were interviewed and,
there were some instances of assessing listening
even though socio-economic contexts and
but only basic comprehension was tested.
educational levels varied, parents did feel that
Further, speaking skills are not being assessed
grades and marks did not indicate the degree of
summatively in government schools whereas
real world application of the skills acquired. While
private schools did conduct activities involving
better informed parents were able to distinguish
narration of stories, debates, roleplay and event
that grading and scores are not the be all and
description. Across the board it was found
end all of learning a language, for several others,
that there is a stark absence of any common
marks were the only parameter through which
assessment criteria or rubric being used while
they reviewed progress of their ward or the
assessing learners. Such assessment techniques
effectiveness of teachers. The top-down approach
and tools as observation, projects, portfolios, oral
of assessment has clearly been naturalised. At
test, group work, pair work, etc are practised in
the same time, there was realisation that knowing
privately run schools but are largely missing in
what the child has learnt and where she/he faced
government schools. Self-assessment is not a
difficulty helps teachers as well because parents
priority in either type of school.
can take care of those aspects. Attributes such
as willingness to cooperate and take group
Teachers face immense pressure to finish
responsibility, sensitivity towards others, interests,
transacting the syllabus by a due date and
etc manifest in group and pair work. When shared
assessments are considered end of term
with both the learner and the parents, information
milestones as opposed to processes that lead
about them could become an effective means for
to insights, reflection and feedback for self-
growth and learning.
development during the process of teaching and
learning. Recording and reporting are mechanical
After the introduction of rubrics, teachers
activities rather than tools for creating learning
generally agreed that this would make assessment
situations that bridge gaps. Feedback is in the
processes easy and transparent but were
form of marks or monosyllabic right/wrong
reluctant to use them. Most teachers felt that it
comments. Percentages of tests across a time
would increase their workload and that the school
frame are combined and so a kind of cumulative
system is not as yet ready for such aspects.
reporting takes place. In case of grades generic
Unfortunately, finishing the syllabus and achieving
and frequently repeated remarks accompanied
learning outcomes seemed to be two distinct
the letters A,B,C etc. It was observed that there
activities for them. A few teachers from private
20 Explorations: Teaching and Learning English in India © British Council India 2017
need of the hour. Teachers and teacher educators to be used for further research across different
must develop ‘…an acute awareness of what we states in the country. Findings can also be shared
teach, how we teach, and why we teach’ (Moore in national and international conferences and
and Whitfield, 2008: 587). In terms of outreach shared with teachers and teacher educators in
the reference framework resulting from this study, workshops via teleconferencing, webinars and
including the research design, has the potential online forums.
22 Explorations: Teaching and Learning English in India © British Council India 2017
Appendix
24 Explorations: Teaching and Learning English in India © British Council India 2017
3
Teacher written feedback on ESL learners’
writing in vernacular medium schools in West
Bengal: an exploratory study
Teacher written feedback on young learners’ writing research. However, with the exception
writing at the school level has remained an of a few (Farneaux, Paran, Fairfax, 2007; Lee,
unexplored area compared to teacher-written 2008), most of these studies investigate teacher
feedback on students’ writing at the tertiary written feedback at the tertiary level (Ferris, Liu,
level. In this study we investigated how far Sinha, Senna, 2013; Bitchener and Knoch, 2010;
ESL teachers’ written feedback practices in Bitchener, 2008; Truscott, 1996; Saito, 1994;
vernacular secondary schools in West Bengal Ferris, 1993). Scant attention has been paid to
corroborated their beliefs and concepts about written feedback on young learners’ writing.
appropriate feedback in the second language Research from India also has focused mostly on
writing classroom. Data was collected from written feedback at the tertiary level (Dheram,
questionnaires for teachers (n=52) and students 1995; Barik, 2011). Little is known about how
(n=60), interviews with practising teachers teachers in state-run vernacular schools in India
(n=6) and samples of teacher written feedback. in general and in the state of West Bengal in
Teachers spoke of how they provided feedback particular give written feedback on ESL learners’
while coping with the constraints of time, syllabus (14-16 years) writing and how learners respond to
and large class size. Student data reveal students’ their practices. We as teachers and researchers
expectations from their teachers’ written working in the school contexts in West Bengal
feedback and their response to such feedback. became interested in exploring these issues
Our findings suggest certain mismatches between in depth, and hence we applied for an ELTReP
teachers’ beliefs and their feedback practices, research grant to investigate these areas.
and what would be the most appropriate feedback
practice in similar contexts to help learners 1.2. Previous research
develop their writing skill.
1.2.1. Trends in research on feedback
1. Background description Written feedback refers to teachers’ written
comments (whether marginal or exhaustive) as
well as error identification on students’ written
1.1. Context
work provided to help students improve their
The importance of teacher-written feedback writing (Saito, 1994). Both ‘supportive and
on students’ writing in the process approach corrective’ feedback scaffold students’ language
is a much-debated and explored area in ESL development (Mahboob and Devrim, 2013:102).
26 Explorations: Teaching and Learning English in India © British Council India 2017
1.2.4. Role of students in shaping feedback 3. Research methods
Students’ response to teacher-written feedback
3.1. Procedure
is found to be context-driven and culturally
mediated. Hence, teachers in different contexts A survey mode of research (Brown and Rogers,
also respond to students’ writing differently. In 2002) including interviews and questionnaires
some contexts students expect teachers to notice was used because mixed methods research using
and comment on their errors (Ferris et al., 2000; both quantitative and qualitative data provided a
Hedgcock and Lefkowitz, 1994) to help them stronger understanding of the research problem
improve language accuracy. In such contexts than either of the methods alone (Creswell, 2014).
good writing would be error free and teachers Using convergent mixed method design, we would
would be expected to correct all errors (Diab, ‘first report quantitative statistical results and then
2006). In some other contexts teacher feedback discuss the qualitative findings that either confirm
was interpreted as denial of students’ voice and or disconfirm statistical results’ (Creswell ibid:
imposition of teachers’ requirements to produce 273). So triangulation was another key reason
texts. While research evidence from multi-draft for interviewing teachers who responded to the
classrooms revealed students making effort to questionnaire.
redraft incorporating feedback points to improve
writing (Diab, 2005), in other contexts students 3.1.1. Quantitative data
paid less attention to redrafting. Teachers’ beliefs The questionnaire was developed and piloted with
also played an important role in shaping their five teachers. After incorporating the required
practice as teachers constructed their own changes, it was administered to 82 teachers.
theories of effective teaching (Lee, 2009). Fifty-two responses were received. Another
questionnaire was developed and translated in
This study attempted to investigate how teachers Bengali to obtain student responses regarding the
are dealing with these issues while giving feedback practice of their teachers. Sixty students
feedback to student writing in the West Bengali responded to this questionnaire.
school context and how students perceive
feedback. 3.1.2. Qualitative data
At the piloting stage 15 practising teachers
2. Statement of topic and research took part in semi-structured interviews (Cohen,
questions Manion and Morrison, 2007). Since not all the
interviews yielded useful data to address our
Initially the study was entitled: ‘The effect of
research questions, six interviews were selected
teacher written feedback on ESL learners’ (14-
on the basis of data useful for our study. Samples
16 years) writing skill development in state run
of written feedback were collected from student
vernacular schools of West Bengal’. However it
copies. The interviews were recorded, transcribed
was changed into ‘Teacher written feedback on
and later codified according to the main issues.
ESL learners’ (14-16 years) writing in vernacular
The samples of written feedback were analysed
medium schools in West Bengal: an exploratory
to investigate how far teachers’ practice
study’ in keeping with the focus of our study.
corroborated their beliefs and concepts about
appropriate feedback.
The research questions guiding the study were:
•• What are the teachers’ latest practices of
3.2. Participants
giving feedback to young learners’ writing?
Fifty-two teachers of ESL and 60 students of class
•• What are their beliefs and assumptions
9 from state run vernacular medium schools in
behind such practices?
Kolkata and neighbouring districts of Hooghly,
•• How do learners perceive and respond to North 24 Parganas, South 24 Parganas, and
such practices? Howrah participated in the study.
4. Findings
‘they cannot express themselves in writing in
Almost all the teacher respondents taught in large their own language, so I have to discuss with them
classes with more than 60 students. The time directly what is their fault, what is their mistake’.
devoted for writing instruction varied from six
hours a week to only once a week. Ariful preferred writing conference or one-to-one
talk, as it gave individual attention. However, Atari
4.1. Current feedback practices never used writing conference as many of her
students lacked the basic vocabulary to carry on
4.1.1. Frequency of giving feedback conversation without her help. Face-to-face talk in
All teacher respondents gave comments on class was less challenging for her students.
students’ writing. However, 38.5 per cent of them
claimed to always give feedback. Only 14 per Teachers often used face-to-face talk in class in
cent of respondents admitted providing feedback addition to written comments as Sulogna said:
sometimes. Teacher interviewees said that
they always gave feedback to student writings. ... when I am distributing their copies I call each
However, the students’ response revealed that of them... especially the girls who have made
most of their teachers only sometimes gave more mistakes ... so I just call them and show
feedback. them that this is something that I do not want to
see repeated in the next writing, so you must be
4.1.2. Type of feedback provided conscious of what you are doing ...
(IntS/July’15)
a. Written as well as oral feedback
More than 90 per cent of respondents claimed The students’ responses revealed that the most
to give feedback on their students’ writing both frequently used mode of feedback by their
orally and in writing. None of our respondents teachers was oral feedback in class although only
provided feedback electronically. The 35 per cent of student respondents expressed a
interviewees also used written and oral feedback preference for oral feedback.
simultaneously on students’ writing. Teachers,
claiming to use written comments all the time, b. Direct feedback with explanation
gave varied reasons for using oral feedback Eighty per cent of our respondents gave feedback
simultaneously. Nandana said: to provide correction with explanation while 57
per cent also used hints about mistakes. Only four
Mostly, I give them written feedback ... but ... there per cent gave feedback without explanation. Nine
are many cases when they fail to understand what I out of 51 participants gave feedback with multiple
have written ... So I talk to them personally, or I talk options for revision. Although the quantitative
in class. data showed that most of the participants
(IntN/July’15) practised leaving hints for students to identify
errors the interview data revealed a contrary
Oral feedback in class was considered effective practice. All six interviewees considered that their
especially in large classes as Sulogna said: students needed direct pointing out of errors.
28 Explorations: Teaching and Learning English in India © British Council India 2017
Sulogna said, ‘There are just a handful of students Sulogna said:
who can pick up the hints, but most of the
students need detailed descriptions’. The rationale In class 9 standard the focus is on the format. The
for using direct feedback basically concerned one format carries marks for them since they will go
issue – the language proficiency of students. and sit for a board exam. Next is whether they have
dealt with all of the points that have been given in
Addressing the same issue Atari said that most the question because this increases their number
of her students’ errors had grammatical issues of marks. The next thing is the construction of
and merely mentioning an error type might not the sentences. Maybe they have written some
help students correct them. She mentioned the extra points and whether they are relevant to the
error type on the blackboard, and usually wrote passage or not. And also grammatical mistakes
the correct sentence directly in students’ copies. and spelling mistakes ... Those are the general lines
Atari repeatedly mentioned her students’ lack of that I deal with.
proficiency in English as the cause for explicit (IntS/July’15)
feedback. According to Monish, ‘They cannot
understand the hints ….because they are first Students showed a preference for comments on
generation learners’. Dharani echoed Monish’s content and organisation of writing.
view when he said:
4.1.3. Varying feedback techniques
…my students…they are coming from very The participating teachers practised varied
backward families and they are first generation feedback techniques. Highlighting or underlining
learners, so hints they can’t follow. I give in writing errors was the commonest practice followed by
in their writing skill copies and I tell them face to pointing out grammatical issues. Thirty-five per
face. cent of the respondents used marginal comments
(IntD/July’15) while 43 per cent directly corrected student
errors. Very few participating teachers used
Around 25 per cent of teacher participants conferencing as a method of feedback while 36
corrected students’ errors directly while the rest per cent asked for clarification from students as a
did it quite often. Only one out of 50 teachers method of feedback. Sulogna said:
said that she directly corrected student errors
only once in a while. The interview data revealed I make comments. I mark very distinctly the
varied practice in this issue. Seventy per cent of portions where they have made spelling mistakes,
the participants addressed some issues and 30 grammatical mistakes. They know by symbol that
per cent claimed to address all issues in students’ this is a spelling mistake, and this underline is a
writing. With the exception of very few, student grammatical mistake. I also make comments that
respondents also showed preference for direct this portion is irrelevant. This is extra. Do not add
feedback with an explicit rationale. Only one this, or you have exceeded the number of words....
student preferred implicit feedback without a (IntS/July’15)
rationale.
The students’ response about the type of
c. Generic versus specific feedback feedback received from teachers corroborated
The majority of the respondents to our what the teachers said. It seemed that teachers
questionnaire used general comments like ‘try to focused on correcting errors though their
improve’, ‘very good’, ‘take care of grammar and approaches varied.
spelling’ or ‘you can write better’ while 26 per
cent claimed to use specific comments like ‘this is 4.1.4. Following up on feedback
not the right expression here’. The interview data Most of the teacher respondents asked their
however showed teachers giving more specific students to revise their drafts. However 21 out of
comments regarding errors or other aspects of 38 respondents said that their students submit
writing like content, organisation and lexis. only one draft; 13 teachers received two drafts
Normally, they do not submit more than one draft. ... I should give feedback to my students because
Those who are overly enthusiastic, they submit ... they won’t know their faults. To rectify their faults..
I try my best so that they submit more than one to correct that mistake so that next time for the
draft ... exam purpose for their use, for their learning
(IntN/July’15) purpose, they will learn it correctly.
(IntD/July’15)
Sulogna however, seemed more successful when
she said: Nandana’s rationale was, ‘so that they can correct
their mistakes and give me a better writing next
Yes, they immediately write a second draft and time’. Monish however believed that he gave
give it back to me ... [Do all of them do that?] No, feedback to ‘encourage them and to make them
not all. There are always some girls who are either interested’. Teachers’ belief about error correction
lazy or not interested. Apart from that most will as the purpose of feedback is also reflected
redo it and give it to me ... in their belief about what constituted effective
(IntS/July’15) feedback for their writing students.
4.2. Beliefs underlying feedback practices There are different types of persons in the class...
some are very extrovert, some are very outspoken.
For each group we have to deal with differently.
4.2.1. Purpose
There are some girls that never respond in the
More than 80 per cent of responding teachers class. I have to call them, make them stand up,
believed in giving feedback to provide corrections bring them to my desk. There are some girls that I
30 Explorations: Teaching and Learning English in India © British Council India 2017
know will not submit their writing properly. I have 4.2.3. Impact of teachers’ feedback
to be alert to make sure that they submit their Quantitative data found the majority of the
work. teacher respondents believing that their
(IntS/July’15) feedback helped students to improve their writing
technique, ability to reflect on their writing and
Asked why he used different techniques with self-evaluation. The interview data however
different students Dharani said: showed teachers expressing doubts about the
impact of their feedback in improving students’
Average students, they are in the same category, writing. Expressing this doubt Dharani said that in
but one, two students I find that if I can give them spite of several reminders about their errors ‘after
more impact they are capable of taking that. a few days they forget and do the same mistake
(IntD/July’15) again’. He believed that students’ reluctance
to focus on developing writing was the reason
Expressing the same belief Atari said: behind this situation. Nandana, Monish and Ariful
also failed to have the desired impact on student
I have to select my feedback according to the level writing because students did not pay heed to the
of the students. Their level means their mental feedback even though it addressed the learners’
level, their maturity level, their emotional level, need. However, when asked whether teacher
their psychological level— all these levels are in my training on how to provide effective feedback
mind when I give feedback to the students. might help him Monish said, ‘No’ even though he
(IntA/July’15) was not happy with the impact of his feedback.
Other teachers also informed that existing in-
A mismatch was detected between teachers’ service training said nothing about feedback on
belief about ‘identifying all errors’ as appropriate writing.
feedback and their real practice. Although
quantitative data showed teachers’ belief in 4.3. Teachers’ belief versus students’ per-
indirect feedback to enable students to identify ception of feedback
errors the interviewees believed direct feedback Contrary to the questionnaire respondents’ belief
to be more fruitful. Sulogna, the only teacher in students’ preference for written comments over
using hints said: oral feedback, the teachers interviewed firmly
believed that their students preferred oral modes
Because I have been working with them for a long of feedback. The student respondents’ preference
time….they know that if I have made a circle that concurred with the interviewees’ belief. The
is a spelling mistake. Sometimes if I have made a students’ responses revealed that their teachers
question mark also it means I cannot understand used face-to-face talk most in writing classes.
this portion. Atari believed, ‘face-to-face talk is more effective
(IntS/July’15) because they also can follow my body language,
my gestures’. Dharani said:
Notably she also needed to explain her codes
orally again sometimes. The other interviewees’ I give them face-to-face feedback ... the
belief about the poor language level of students corrections that I think will be more fruitful to them
acting as a deterrent to the use of hints resulted because they do not open their copies when they
in exhaustive use of direct feedback and go back to see what the teacher has written ...
‘reformulation’ at times. However Atari’s practice (IntD/July’15)
of crossing out learners’ wrong sentences to write
the right structure on the board corroborated 28 Most of the teacher respondents believed that
per cent respondents’ belief in ‘crossing out or students preferred feedback on grammatical
rewriting student text’ as appropriate feedback. issues. However, 69 per cent felt that students
also preferred feedback on content. Forty-two per
32 Explorations: Teaching and Learning English in India © British Council India 2017
writing skill. Teachers’ comments at times were out of school somehow did not care to revise
not always focused and provided no scaffolding and redraft. Case studies on teacher cognition
for students to improve their writing. Hence the and formulation of feedback might enlighten us
training of teachers in formulating appropriate further about the issue.
feedback is the need of the hour. Teachers might
be introduced to approaches in which only the Students’ perception of teacher written
revised draft is given a mark. Students would feedback
be given marks for the degree of improvement Our study showed clear evidence of students’
between the first draft and subsequent drafts; preference for readymade feedback. The
the prevailing continuous comprehensive pivotal role of context (Lee, 2008) was evident
evaluation would provide the opportunity to when students contradicted the view that their
teachers to introduce such a revision phase in the teachers always gave feedback. Most of the
instructional cycle. student participants’ preference for feedback on
grammatical errors might point to a socio-cultural
Teachers’ beliefs and assumptions behind context where lack of accuracy stigmatised a
feedback practices student. Written work, however rich in content
There seemed to be a mismatch between and organisation, might not be assessed as good
teachers’ belief and teachers’ practice so far if there were grammatical errors. Secondly, the
as feedback was concerned. Responses to the participating students seemed to expect feedback
questionnaire showed belief in the efficacy of that would be too directive (Hyland and Hyland,
indirect feedback but teachers’ practice told a 2006). Teachers’ feedback also rarely provided
different tale. Moreover, though they believed that options. The situation might be explained with
their feedback suited their learners’ needs none reference to the conventional classroom set ups
of the participants expressed satisfaction with the in West Bengal where learner centred teaching
impact of their feedback on developing student has just been initiated.
writing. Teachers believed that their feedback
attempted to enable students to improve their 6. Conclusion
writing in general. However their practice always The study, though small scale, has several
emphasised correcting errors. Teachers believed implications for similar contexts. It suggested
in encouraging individuality and creativity. that teachers should be consistent in providing
However, their practice of oral feedback in class written feedback that was clear, focused and
had little scope for translating their belief into applicable and did not just consist of vague
practice. Teachers’ complacency about their own comments or praise (Linderman, 2001). Next,
feedback approaches brought out two facts – lack selective error correction along with comments
of professional awareness and lack of faith in on content, organisation and language might
existing training to help them improve. be the most effective approach keeping in view
the contextual demand for error-free writing.
Teachers’ assumptions about what students Third, writing lessons should be planned in a
expected from their feedback, however, was way that would have a built-in cycle of revision
found to be true as students’ responses revealed and redraft. Fourth, sufficient time needs to be
their preference for direct corrective feedback. allotted for writing instruction so that teachers
Contextual factors such as the number of are not constrained by time. Last but not least,
students, their socio-economic background, appropriate in-service training has to be arranged
and student motivation for improving writing to enable teachers to make effective use of
have influenced the shaping of our teachers’ feedback to improve students’ writings. Further
beliefs. A number of participants mentioned that research involving case studies on the impact of
motivated students aspiring for higher education teacher written feedback in similar contexts would
or professional careers tended to submit revised be useful to reveal how teachers could provide
drafts whereas students just aiming to pass the most effective feedback in such contexts.
Barik, NK (2011) The Effects of Teachers’ Feedback Ferris, D (2006) ‘Does error feedback help
on ESL Writing at the Higher Secondary Level. student writers? New evidence on the short- and
Hyderabad. EFLU. long-term effects of written error correction’ in
Hyland K and Hyland F (eds) Feedback in Second
Bitchener, J and Knoch, U (2009) The value of a
Language Writing: Contexts and Issues. Cambridge:
focused approach to written corrective feedback.
Cambridge University Press.
English Language Teaching Journal 63 (3): 204-
211. Ferris, D and Roberts, B (2001) Error feedback in
L2 writing classes: How explicit does it need to
Bitchener, J (2008) Evidence in support of written
be? Journal of Second Language Writing 10: 161-
corrective feedback. Journal of Second Language
184.
Writing 17: 102-118.
Furneaux, C, Paran, A and Fairfax, B (2007)
Bitchener, J and Knoch, U (2008) The value of
Teacher stance as reflected in feedback on
written corrective feedback for migrant and
student writing: an empirical study of secondary
international students. Language Teaching
school teachers in five countries. IRAL 45: 69-94.
Research 12: 409 - 431.
Hyland, K and Hyland, F (2006) ‘Contexts and
Bitchener, J, Young, S and Cameron, D (2005) The
issues in feedback on L2 writing: An introduction’.
effect of different types of corrective feedback on
In K Hyland and F Hyland (eds). Feedback in
ESL student writing. Journal of Second Language
Second Language Writing: Contexts and Issues,
Writing 14: 191-205.
Cambridge: Cambridge University Press.
Brown, JD and Rodgers, TS (2002) Doing Second
Hyland, K and Hyland, F (2006) Feedback on
Language Research. Oxford: OUP.
second language students’ writing. Language
Cohen, L, Manion, L, Morrison, K (2007) Research Teaching 39 (2): 83-101.
Methods in Education. London: Routledge.
Hyland, F (1998) The impact of teacher written
Creswell, JW (2014) Research Design: qualitative, feedback on individual writers. Journal of Second
quantitative and mix methods approaches. New Language Writing 7(3): 255-286.
Delhi: Sage Publication.
Lee, I (2005) Error correction in the L2 writing
Diab, RL (2006) Error correction and feedback in classroom: what do students think? TESL Canada
the EFL writing classroom: comparing instructors Journal 22(2): 1-16.
and student preferences. English Teaching Forum
Lee, I (2008) Understanding teachers’ written
3:2-14.
feedback practices in Hong Kong secondary
Diab, RL (2005) EFL University Students’ classrooms. Journal of Second Language Writing
Preferences for Error Correction and Teacher 17: 69-85.
Feedback on Writing. TESL Reporter 38 (1): 27-51.
Lee, I (2009) Ten mismatches between teachers’
Dheram, PK (1995) Feedback as a two bullock beliefs and written feedback practice. English
cart: a case study of teaching writing. English Language Teaching Journal 63 (1): 13-22.
Language Teaching Journal 49 (2): 160-168.
34 Explorations: Teaching and Learning English in India © British Council India 2017
Mahboob, A and Devrim, D.Y. (2013) Supporting Sugita, Y (2006) The impact of teachers’ comment
independent construction online: feedback in the types on students’ revision. English Language
slate project. Linguistics and the Human Sciences Teaching Journal 60 (1): 34-41.
7:101-123.
Truscott, J (1999) The case for ‘the case for
Myles, J (2002) Second language writing and grammar correction in L2 writing classes’: A
research: The writing process and error analysis in response to Ferris. Journal of Second Language
student text. TESL-EJ 6 (2) Available at: http://tesl- Writing 8: 112-122.
ej.org/ej22/a1.html
Truscott, J (1996) The case against grammar
Saito, H (1994) Teachers’ practices and students’ correction in L2 writing classes. Language
preferences for feedback on second language Learning 46 (2): 327-369.
writing: A case study of adult ESL learners. TESL
Canada Journal 11 (2): 46-67.
The British Council is the United Kingdom’s international organisation for cultural
relations and educational opportunities.
www.britishcouncil.in/englishpartnerships
36 Explorations: Teaching and Learning English in India © British Council India 2017