Linking TOEFL iBT Scores to IELTS Scores

A Research Report

ETS December 17, 2010

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Abstract
TOEFLtestscoreshavebeenwidelyacceptedasevidenceofnonnativeEnglishspeakersproficiencyinthe useofEnglish.TheTOEFLtestmeasurestesttakersabilitytocommunicateinEnglishmediumcollegesand universities. TheTOEFLiBTtestmeasuresacandidatesabilitytocombinelistening,reading,speakingandwritingskills withauthenticandinnovativeintegratedtasks,makingitthemostcomprehensiveEnglishlanguage proficiencytest.Acceptedbyover7,500scoreusersinmorethan130countries,theTOEFLtestisthemost widelyrecognizedEnglishlanguagetestintheworld. Recently,ETSconductedscorecomparisonresearchbetweentheTOEFLtestandanalternativetest,IELTS (InternationalEnglishLanguageTestingSystem).Fortheresearch,ETSobtainedasampleof1,153students whohadbothIELTSandTOEFLscores.Usingequipercentilelinking,thecorrespondingTOEFLscorethat wouldpassthesamepercentageoftesttakersforeachIELTSscoreswasobtained.Thescorecomparison resultsforeachsection(Listening,Speaking,Reading,andWriting)andthetotaltestshowedthatmostofthe studentsscoredinthemiddletomidhighscorerangesonbothtests.Limitationsoftheresearchand suggestionsforfutureresearcharealsodiscussed.

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

LinkingTOEFLiBTScorestoIELTSScores
Introduction
TOEFLtestscoreshavebeenwidelyacceptedbyeducationalandotherinstitutionsthroughouttheworldas evidenceofnonnativeEnglishspeakersproficiencyinEnglishlanguageuse,andtheTOEFLtesthasreceived verypositivefeedbackfromscoreusersandinstructorsintheEnglishasaSecondLanguage(ESL)community. Therearemanyoccasionswhenscoresfromdifferenttestsorevenfromdifferentversionsofthesametest needtobelinkedfordecisionmakingorotherpurposes.Forexample,thescoresontheSATIandACT tests,twowellknowncollegeadmissionstestsintheUnitedStates,havebeenlinkedtoeachothertohelp universityadmissionsofficesusethescorestoevaluateapplicants.Aresearchstudywascarriedoutbyboth ETSandACTresearchstafftodevelopascorecomparisontableforthispurpose(Pommerich,Hanson,Harris, &Sconing,2000.)Anotherexampleisthat,whentheTOEFLiBTtest,wasdevelopedtobetakenviathe Internetandtoreplacethecomputeradaptivetest(cBT)version,astudywasconductedtolinkTOEFLiBT scorestoTOEFLcBTscores(Wang,Eignor,&Enright,2007.) Recently,ETSconductedscorecomparisonresearchbetweentheTOEFLtestandanalternativetest,IELTS (InternationalEnglishLanguageTestingSystem).AsabestpracticerequiredbytheGuidelinesforPracticeby theInternationalLanguageTestingAssociation(ILTA,2007),theStandardsforEducationalandPsychological Testing(AERA,APA,NCME,1999),andtheETSstandards(ETS,2002,p.45,),appropriatepsychometric proceduresshouldalwaysbeusedtolinkscoresfromtwodifferentassessmentsifthescoresaretobe compared.Tocomplywiththisstandard,ETSpsychometricstaffconductedaresearchstudytoexploreand establishempiricalrelationshipsbetweenthescoresonthetwotests.Thisresearchwasdesignedandcarried outtoanswerthefollowingtworesearchquestions: 1. WhatTOEFLiBTsectionscoresarecomparabletoIELTSsectionscores? 2. WhatTOEFLiBTtotalscoresarecomparabletoIELTStotalscores?
2

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

FindingthecorrespondingTOEFLiBTscoresforeachoftheIELTSscoreswasaccomplishedbywhatisknown asscorelinkingorscorecomparison(calledscorecomparisonhereafterinthisreport)inthefieldof educationalmeasurement. Inthisreport,thesamplesandtheanalyseswillbedescribedintheMethodsection.ThesectionforResults willpresentscorecomparisonsforthefourskillsectionsandthetotalscores.Thisisfollowedbythe Discussionsectionthatconsiderstheinterpretationoftheresultsandtheirimplicationsintermsofthe generalizationofthefindingsfromthisstudy,evaluatesthelimitationsoftheresearch,andmakes suggestionsforfutureresearch.

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Method
DataCollection Inordertoacquireempiricalevidenceforlinkingthescoresonthetwotests,scoreswereobtainedfrom studentswhohadtakenbothtests(Pommerich,2007).Thedatacollectioneffortforthisresearchstartedin 2008andcontinuedinto2009.Thefirstbatchofdata,obtainedin2008,contained217studentswho submittedtoETScopiesoftheirTOEFLandIELTSscorereports.Inordertoincreasethesamplesizeandthe stabilityoftheresults,ETSthencontactedalargenumberoftesttakersviaemailandencouragedthe participantstosubmittheirlatestscoresonbothteststoETS.Over1,000studentsrespondedandreported theirscoresonthetwoteststoETS.Thetwobatchesofdatawerethencombinedforthestudy. Beforeanyanalysesstarted,thefirsttaskwastocleanthedata,whichinvolvedremovingunusablerecords. Recordsthathadmissingscoresononeormoresectionsorthathadinvalidscoreswereremovedfrom subsequentanalyses.Forexample,onereportedIELTSscoreof4.7wasidentifiedasaninvalidscoreandwas eliminatedfromtheanalysisdataset1.Afterthisdatacleaningprocedure,1,153recordswereretainedfor theanalysesdescribedinthenextsection.Closeto1,000recordsincludedtheparticipantscountryof testinginformation,includingabout70countriesfromaroundtheworld.ThelargestgroupwasfromChina includingHongKong(41%),followedbyUSA(6%),andJapan(5%).Theotherswereallbelow4%. DataAnalysis Tounderstandthestatisticalcharacteristicsofthescoresonthetwotestsfromthefinalsampleof1,153 studentsandtoestablishtherelationshipsbetweenthescoresonthetwotests,thefollowingtypesof analysiswereconducted.ThefindingsfromtheanalysesarepresentedintheResultssection. 1.Descriptivestatisticswerecomputedtoevaluatesuchinformationastheaveragescoresoneachtestat boththesectionandthetotalscorelevel,andhowmuchvariation(standarddeviation)wasobservedinthe scores.Thecorrelationbetweenthescoresonthetwotestswasalsocomputedtoseetowhatextentthe scoresonthetwotestswererelatedtoeachother.
1

IELTSscoreshave9bandsinonehalfincrements(e.g.,3,3.5,4,4.5...)
4

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

2.Linkingscoresisbasicallyatransformationfromascoreononescaletoascoreontheotherscale (Holland,2007)andcanbeaccomplishedinavarietyofwaysdependingonthenatureofthedataandthe purposeofthelinking(Kolen&Brennan,1995;Holland&Dorans,2006).Tofindthecorrespondence betweentheTOEFLiBTandIELTStestsforeachsectionandforthetotalscore,ETSpsychometricstaff conductedextensiveanalysesbetweenMarchandAugust2009usingavarietyofstatisticalmethods includingregressionbasedprediction,conditionalprobabilitybasedscorematching,andequipercentile linking.Inreviewingtheresultsandinconsiderationofthepurposeofthisresearch,wedeemeditmost appropriatetousetheequipercentilelinkingmethod.Thisapproachhasbeenusedextensivelyinavarietyof settings(e.g.thelinkingoftheSATtestwiththeACTtest)andallowedustoidentifythecorresponding TOEFLiBTscoreswhichwouldrestrict/passasimilarpercentageofthestudentsinthesampleaswouldthe IELTSscores.Giventheneedforbothteststoscreenoutapplicantsinacomparablemanner,webelievethis tobethemostdefensibleandstraightforwardapproach.

Results
DescriptiveStatisticsoftheSample TOEFLiBTscoresrangefrom0to30foreachsectionand0to120forthetotaltest;thetotaltestscoreisthe sumofthefoursections.IELTSreportsbothsectionandtotalscoresona9bandscaleinonehalf(0.5)band increments;thetotaltestscoreistheaverageofthefoursections.Thisgeneralinformationaboutthe differentscorescalesofthetwotestscanhelpputthescoresoftheresearchsampleinperspective.For example,becauseofthecompactIELTSscorescales,IELTSscaleswillshowmuchsmallerscorevariation (standarddeviationvaluesinTable1)thantheTOEFLiBTscales.Also,forsomeIELTSscoresinTables3to7, thecorrespondingTOEFLiBTscoreswillshowscorerangesduetothelargerTOEFLscales. Table1givesthesamplesize,themeanscores,andthescorevariations(standarddeviation,scorerange)of thetwotests.OnIELTS,theReadingandListeningmeanscoreswereboth6.8,andtheSpeakingandWriting meanswere6.3and6.1,respectively.Thetotaltestmeanscorewas6.6.OntheTOEFLiBTscale,theReading andListeningmeanscoreswerebothcloseto21andtheSpeakingandWritingmeanscoreswere20and 21.6,respectively.Thetotalmeanscorewas83.6. Toevaluatetheoverallperformanceofthestudentsinthisresearchsample,the2009testperformance informationonthetwotestswasobtainedfromtherespectivewebsitesandispresentedinthecolumnfor 2009populationmeaninTable1.

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Generallyspeaking,thestudentsinthissample,asagroup,scoredhigheronbothteststhantheirrespective populationsdidin2009.Inotherwords,thissampleappearedtobemoreablethanthegeneralpopulations ofIELTSandTOEFLiBTtesttakers,respectively.Thiscouldbetheoutcomeofselfselectionofthe participantsinthatstudentshavinghighertestscoresmighthavebeenmorewillingtoreporttheirscores thanthosehavinglowerscores.Asaresult,therewereveryfewlowscoresinthedatabutrelativelymore scoresatthemiddletomidhighlevels.Ourlevelofconfidenceintheresultsforthelowscorelevelswould thenberelativelylowerthanthatforthemiddletomidhighlevels.

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Table1.MeansandStandardDeviations Test IELTSTotal IELTSListening IELTSSpeaking IELTSReading IELTSWriting TOEFLTotal 1,153 N 1,153 1,153 1,153 1,153 1,153 Standard Mean Deviation 6.6 6.8 6.3 6.8 6.1 83.6 20.9 20.0 21.2 21.6 20.3 7.6 3.8 7.8 4.6 23119 130 530 130 530 0.8 1.1 0.9 1.1 0.8 Score Range 3.59 2.59 1.59 2.59 29 79 19.4 19.7 19.9 20.5 2009 Population Mean* 5.8 6 5.7 5.8 5.4

TOEFLListening 1,153 TOEFLSpeaking 1,153 TOEFLReading 1,153 TOEFLWriting 1,153

*The2009populationmeanscoresbasedontheinformationprovidedattheTOEFLandIELTSwebsites. Table2liststhecorrelationcoefficientsbetweenthescoresfromthesamemeasuresaswellasthescores fromthetotaltests.Acorrelationcoefficientindicatestheextenttowhichthescoresonthetwotestsare relatedtoeachother.Acorrelationcoefficientgoesfrom0fornorelationatallto1foraperfectrelation. Thecorrelationbetweentotalscoreswillalwaysbehigherthanthatbetweensectionscoresbecausetotal scorescontainallthesectionscoreinformationandaremorereliable.Asexpected,thetotaltestscore correlationis0.73,higherthananysectionscorecorrelation,whichvariesfrom0.44forWritingto0.68for Reading.Generallyspeaking,forthescorestobelinked,moderatelyhighcorrelations(around0.7)wouldbe verydesirable,butmoderatecorrelations(around0.5to0.6)arenotatypical.

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Table2.CorrelationsbetweenIELTSandTOEFLiBTSectionandTotalScores Score IELTSListening&TOEFLListening IELTSSpeaking&TOEFLSpeaking IELTSReading&TOEFLReading IELTSWriting&TOEFLWriting IELTSTotal&TOEFLTotal Thenextsectionsprovidetheequipercentilelinkingresultsforeachofthesectionsandthetotalscore.The resultsarepresentedintabularform.Whilewewereabletoobtaincorrespondingscoresforthetwotestsat eachoftheIELTSscorebands,thenumberofcasesperscorebandvaried,withgenerallyveryfewcasesin theverylowestandhighestscorebands.Ingeneral,assamplesizesincrease,resultsbecomemorestable andreliable.Consequently,inthisstudy,wehavemoreconfidenceintheresultswheretherearerelatively largercasecounts(i.e.,5%ofthesample)perscorebandandwerecommendcautionininterpretingthe resultswherethecasecountsarerelativelysmall.Wehavenoted,byshadingtheareaoftherangeofscores onthetables,wheresamplesizesperscorebandaregreaterthan5%ofthetotal. ListeningSectionScoreComparisonResults Table3presentstheequipercentilelinkingmethodbasedscorecomparisonresultsonthetwoListening sections.TheshadedareainTable3indicatesthatmoststudentshadscoresfrom5.5to8.5onIELTSand7to 29onTOEFLiBTtest,withveryfewstudents(lessthan5%orso)attheotherscorelevels.Aswasmentioned earlier,duetothelargerscaleofTOEFLscoresthanIELTSscores,someIELTSListeningscoresarefoundto correspondtoarangeofTOEFLscoresinsteadofasingleTOEFLscore.Forexample,anIELTSListeningscore of5.5wouldcorrespondtoTOEFLiBTListeningscoresof7to11.Insummary,thetabulatedresultsindicate thatanIELTSListeningscoreof6.0wouldcorrespondtoTOEFLListeningscoresof12to19;anIELTSListening scoreof6.5wouldcorrespondtoTOEFLListeningscoresof20to23;anIELTSListeningscoreof7.0would correspondtoTOEFLListeningscoresof24to26;andsoforth.Inallcases,theIELTSscoresandtheir correspondingTOEFLscores(orscoreintervals)wouldpasssimilarpercentagesoftesttakers. Table3.ListeningSectionScoreComparisons
8

Correlation 0.63 0.57 0.68 0.44 0.73

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

IELTSScore 9 8.5 8 7.5 7 6.5 6 5.5 5 4.5 <=4

TOEFL Score 30 29 28 27 2426 2023 1219 711 4 6 3 0 2

SpeakingSectionScoreComparisonResults Table4presentsthescorecomparisonresultsfortheSpeakingsections.Theinformationcanbeinterpreted inthesamewayasdescribedaboveforListening.AsshownbytheshadedareainTable4,mostscoreswere withintherangeof5.0to8.0ontheIELTStestand14to27ontheTOEFLiBTtest.Again,anumberofIELTS scorescorrespondtoTOEFLscorerangesinsteadofsinglescoresduetoscaledifferencesbetweenthetwo tests.Forexample,thetableshowsthatanIELTSscoreof5.0wouldcorrespondtoTOEFLSpeakingscoresof 14to15;anIELTSSpeakingscoreof5.5wouldcorrespondtoTOEFLSpeakingscoresof16to17;anIELTS Speakingscoreof6.0wouldcorrespondtoTOEFLSpeakingscoresof18to19;anIELTSSpeakingscoreof6.5 wouldcorrespondtoTOEFLSpeakingscoreof20to22;andsoforth.Inallcases,theIELTSscoresandtheir correspondingTOEFLscores(orscoreintervals)wouldpasssimilarpercentagesoftesttakers.
9

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Table4.SpeakingSectionScoreComparisons IELTSScore 9.0 8.5 8.0 7.5 7.0 6.5 6.0 5.5 5.0 4.5 <=4

TOEFLScore 30 2829 2627 2425 23 2022 1819 1617 1415 1213 011

ReadingSectionScoreComparisonResults Table5presentsthescorecomparisonresultsfortheReadingsections.Theinformationcanbeinterpretedin thesamewayasdescribedaboveforListeningandSpeaking.AsshownbytheshadedareainTable5,most scoreswerewithintherangeof5to8.5ontheIELTStestand4to29ontheTOEFLiBTtest.Thetableshows thatanIELTSReadingscoreof5.0wouldcorrespondtoTOEFLReadingscoresof4to7;anIELTSReading scoreof5.5wouldcorrespondtoTOEFLReadingscoresof8to12;anIELTSReadingscoreof6.0would correspondtoTOEFLReadingscoresof13to18;anIELTSReadingscoreof6.5wouldcorrespondtoTOEFL Readingscoresof19to23;anIELTSReadingscoreof7.0wouldcorrespondtoTOEFLReadingscoresof24to 26;andsoforth.NotethataTOEFLReadingscoreof29wouldcorrespondtobothIELTSReadingscoresof8 and8.5.ThisoccurredbecausewewantedallIELTSbandscorepointstoberepresentedinthetable.Since thehighestTOEFLiBTscore(30)hastomaptothehighestIELTSbandscore(9)andpercentiledatasuggest thatanTOEFLiBTscoreof29mapstoanIELTSbandscoreof8,thenithastobethecasethatanTOEFLiBT scoreof29alsomapsto8.5,i.e.,thereisnoTOEFLiBTscorepointbetween29and30tomaptotheIELTS bandscoreof8.5.Inallcases,theIELTSscoresandtheircorrespondingTOEFLscores(orscoreintervals) wouldpasssimilarpercentagesoftesttakers.
10

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Table5.ReadingSectionScoreComparisons IELTSScore TOEFLScore 9 8.5 8 7.5 7 6.5 6 5.5 5 4.5 <=4 WritingSectionScoreComparisonResults Table6presentsthescorecomparisonresultsfortheWritingsections.Theinformationcanbeinterpretedin thesamewayasdescribedaboveforListening,ReadingandSpeaking.AsshownbytheshadedareainTable 6,mostscoreswerewithintherangeof5to7onIELTSand14to28ontheTOEFLiBTtest.Thetableshows thatanIELTSWritingscoreof5.0wouldcorrespondtoTOEFLWritingscoresof14to17;anIELTSWriting score5.5wouldcorrespondtoTOEFLWritingscoresof18to20;anIELTSWritingscoreof6.0would correspondtoTOEFLWritingscoresof21to23;anIELTSWritingscoreof6.5wouldcorrespondtoTOEFL Writingscoresof24to26;andsoforth.Inallcases,theIELTSscoresandtheircorrespondingTOEFLscores (orscoreintervals)wouldpasssimilarpercentagesoftesttakers. 30 29 29 2728 2426 1923 1318 812 4 7 3 0 2

11

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Table6.WritingSectionScoreComparisons IELTSScore 9.0 8.5 8.0 7.5 7.0 6.5 6.0 5.5 5.0 4.5 <=4.0 TOEFLScore 30 30 30 29 2728 2426 2123 1820 1417 1213 011

12

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

TotalScoreComparisonResults Table7presentsthecomparisonresultsforthetotalscoresonthetwotests.Thecomparisonoftotalscores canbeinterpretedinthesamewayasdescribedaboveforthesectionscores.Asshownbytheshadedarea Table7,mostscoreswerewithintherangeof5.5and7.5ontheIELTStestand46and109onTOEFLiBTtest. Lessthan5%oftesttakersateachscoreorscoreintervalreceivedscoresoutsideofthisrange.Becauseof themuchlargerTOEFLtotalscorescale(0to120)thanIELTS(0to9),theTOEFLscorerangecorrespondingto anIELTSscoretendstobeverybroad.Forexample,anIELTSscoreof5.5wouldcorrespondtoTOEFLscores of46to59;anIELTSscoreof6.0wouldcorrespondtoTOEFLscoresof60to78;anIELTSscoreof6.5would correspondtoTOEFLscoresof79to93;anIELTSscoreof7.0wouldcorrespondtoTOEFLscoresof94to101; andsoforth.Inallcases,theIELTSscoresandtheircorrespondingTOEFLscores(orscoreintervals)would passsimilarpercentagesoftesttakers. Table7.TotalScoreComparisons IELTSScore 9 8.5 8 7.5 7 6.5 6 5.5 5 4.5 0 4 TOEFLScore 118120 115117 110114 102109 94101 7993 6078 4659 3545 3234 031

13

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Discussion
Tobetterunderstandthescorecomparisonresultsonboththesectionandthetotaltestlevels,itis importanttoevaluatetheresultsinthecontextofthecharacteristicsofthetests,theresearchsample employed,theintendeduseoftheresults,andthelimitationsofthestudy.Itisalsoworthwhiletothink aboutwhatfurtherresearchcanbeconductedinthefuturetoenhancethequalityofthescorecomparisons. EvaluationoftheScoreComparisonResultsandLimitations Therearetwoconsiderationsregardingtheinterpretationoftheresults.Thefirstisthecharacteristicsofthe twotests.ItisrecognizedthattheTOEFLandIELTStests,whiletheyhavethesamenumberofsections measuringsimilarskillsandunderlyingconstructs,werebuiltfromdifferentframeworksanddifferenttest blueprints.Forexample,theTOEFLiBTtestisthelatestversionoftheTOEFLtestandisbuiltonthe frameworkofcommunicativecompetencybasedoncurrentsecondlanguageacquisitiontheoryandpractice. TheTOEFLiBTtestcontainsnumerousinnovativetasktypesthatcanonlybepresentedonacomputerbased testandtapintoawiderarrayofEnglishproficiencyskillsthanapaperbasedtest.Asaresult,TOEFLiBT scoresdonotmeanexactlythesamethingasIELTSscores,andmoderatecorrelations2betweenthescores, asseeninTable2,canbeexpected.Aspreviouslynoted,forthescorestobelinked,moderatelyhigh correlations(around0.7)wouldbeverydesirable,butmoderatecorrelations(around0.5to0.6)arenot atypical. Thesecondconsiderationisthesample.Asinmanyotherstudiesofthisnature,aselfselectedgroupof participantsvolunteeredtoreporttheirIELTSandTOEFLscorestoETS,whichwouldlimitgeneralizingthe resultstosamplesthatdiffersignificantlyfromthisresearchsample.Inparticular,thenumbersof participantswithrelativelylowandveryhighscoresweresmall.Futuresamplesthatincludemorecaseswith lowerandhigherscoreswouldberecommendedifanunderstandingofthemappingofscoresatthesescore levelsisdesired.Whilethepresentcasecountsaresufficienttoevaluatethemappinginthemiddleofthe scorescales,cautionshouldbeexercisedwhencomparingthelowerandhigherscores.Asdescribed previously,thetablesincludeshadingtoindicatethosescorelevelswherewehaverelativelymore confidenceinthescorecomparability.
2

Correlationcanbeusedasanindexthatisusedinevaluatingthepotentialforlinkingthescoresfromdifferenttests thatareintendedtomeasuresimilarconstructsbutareconstructedaccordingtodifferentframeworks.
14

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

FutureResearch Thescorecomparisonresultsfromthisresearchweregroundedintheempiricalinformationthatwas obtainedfromthestudentswhotookbothIELTSandTOEFLiBTtests,andwerebasedonanappropriate psychometricprocedurethatusedscoresfromthetwoteststoestablishtherelationshipsbetweenthetwo setsofscores.Asinanyotherscorecomparisonresearch,thecurrentresearchandthefindingsforthescore comparisonbetweentheIELTSandTOEFLiBTtestswillbenefitfrommoreresearchinthefuture,especially fromfutureresearchstudiesbasedonmorecontrolledsamplesintermsofsamplesize,sampleselection, datacollection,andstudentbackgroundinformationsuchasnationality,nativelanguage,yearsoflearning English,etc.Withalargerandbettercontrolledsample,thedatacollectionqualitywillbeimprovedanda sufficientnumberofstudentsacrossallscoreswillbeprovidedtoenhancethescorecomparisonresults.

15

 LinkingTOEFLiBTScorestoIELTSScoresAResearchReport

Reference
AmericanEducationalResearchAssociation,AmericanPsychologicalAssociation,&NationalCouncilon MeasurementinEducation.(1999).Standardsforeducationalandpsychologicaltesting.Washington,DC: AmericanEducationalResearchAssociation. ETS.(2002).ETSStandardsforqualityandfairness.Princeton,NJ:ETS. Holland,P.W.(2007).Aframeworkandhistoryforscorelinking.InN.J.Dorans,M.Pommerich,&P.W. Holland(Eds.),Linkingandaligningscoresandscales(pp.530).NewYork,NY:Springer. Holland,P.W.,&N.J.(2006).Linkingandequating.InR.L.Brennan(Ed.),Educationalmeasurement(4the ed.,pp.187220).Westport,CT:PraegerPublishers. InternationalLanguageTestingAssociation.(June2007).ILTAGuidelineforPractice.RetrievedMay12,2010 fromhttp://www.iltaonline.com/index.php?option=com_content&view=article&id=122&Itemid=133 Kolen,M.J.,&Brennan,R.L.(1995).Testequatingmethodsandpractices.NewYork,NY:Springer. Pommerich,M.,Hanson,B.A.,Harris,D.J.,&Sconing,J.A.(2000).Issuesincreatingandreporting concordanceresultsbasedonequipercentilemethods(ACTResearchRep.No.20001).IowaCity,IA:ACT. Pommerich,M.(2007).Concordance:TheGood,theBad,andtheUgly.InN.J.Dorans,M.Pommerich,&P. W.Holland(Eds.),Linkingandaligningscoresandscales(pp.199216).NewYork,NY:Springer. Wang,L.,Eignor,D.R.,&Enright,M.K.(2008).AFinalAnalysis.InC.A.Chapelle,M.K.Enright,&J.Jamieson (Eds.),BuildingaValidityArgumentforanewTestofEnglishasaForeignLanguage(pp.259318).NewYork, NY:Routledge.
Copyright 2010 by Educational Testing Service. All rights reserved. The ETS logo, LISTENING. LEARNING. LEADING. and TOEFL are registered trademarks of Educational Testing Service (ETS). TOEFL iBT is a trademark of ETS. IELTS is a registered trademark jointly owned by the British Council, IDP Education PTY Ltd, and University of Cambridge Local Examinations Syndicate.

16