(IIHFWLYHQHVV RI 5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH 3URGXFWV )LQGLQJV IURP WKH )LUVW 6WXGHQW &RKRUW

5HSRUW WR &RQJUHVV

(IIHFWLYHQHVV RI 5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH 3URGXFWV )LQGLQJV IURP WKH )LUVW 6WXGHQW &RKRUW
5HSRUW WR &RQJUHVV 0DUFK 

0DUN '\QDUVNL 5REHUWR $JRGLQL 6KHLOD +HDYLVLGH 7LPRWK\ 1RYDN 1DQF\ &DUH\ /DULVVD &DPSX]DQR 0DWKHPDWLFD 3ROLF\ 5HVHDUFK ,QF %DUEDUD 0HDQV 5REHUW 0XUSK\ :LOOLDP 3HQXHO +DO -DYLW] 'HERUDK (PHU\ :LOORZ 6XVVH[ 65, ,QWHUQDWLRQDO

1&((  86 'HSDUWPHQW RI (GXFDWLRQ

U. S. Department of Education 0DUJDUHW 6SHOOLQJV 6HFUHWDU\ ,QVWLWXWH RI (GXFDWLRQ 6FLHQFHV *URYHU - :KLWHKXUVW 'LUHFWRU 1DWLRQDO &HQWHU IRU (GXFDWLRQ (YDOXDWLRQ DQG 5HJLRQDO $VVLVWDQFH 3KRHEH &RWWLQJKDP &RPPLVVLRQHU 0DUFK  7KLV UHSRUW LV LQ WKH SXEOLF GRPDLQ $XWKRUL]DWLRQ WR UHSURGXFH LW LQ ZKROH RU LQ SDUW LV JUDQWHG :KLOH SHUPLVVLRQ WR UHSULQW WKLV SXEOLFDWLRQ LV QRW QHFHVVDU\ WKH FLWDWLRQ VKRXOG EH '\QDUVNL 0DUN 5REHUWR $JRGLQL 6KHLOD +HDYLVLGH 7LPRWK\ 1RYDN 1DQF\ &DUH\ /DULVVD &DPSX]DQR %DUEDUD 0HDQV 5REHUW 0XUSK\ :LOOLDP 3HQXHO +DO -DYLW] 'HERUDK (PHU\ DQG :LOORZ 6XVVH[ (IIHFWLYHQHVV RI 5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH 3URGXFWV )LQGLQJV IURP WKH )LUVW 6WXGHQW &RKRUW :DVKLQJWRQ '& 86 'HSDUWPHQW RI (GXFDWLRQ ,QVWLWXWH RI (GXFDWLRQ 6FLHQFHV  3UHSDUHG XQGHU &RQWUDFW 1R ('&2 ZLWK 0DWKHPDWLFD 3ROLF\ 5HVHDUFK ,QF 7R RUGHU FRSLHV RI WKLV UHSRUW :ULWH WR (' 3XEV (GXFDWLRQ 3XEOLFDWLRQV &HQWHU 86 'HSDUWPHQW RI (GXFDWLRQ 32 %R[  -HVVXS 0'  &DOO LQ \RXU UHTXHVW WROO IUHH WR ('3XEV ,I  VHUYLFH LV QRW \HW DYDLODEOH LQ \RXU DUHD FDOO  86$/($51 7KRVH ZKR XVH D WHOHFRPPXQLFDWLRQV GHYLFH IRU WKH GHDI 7'' RU D WHOHW\SHZULWHU 77< VKRXOG FDOO  )D[ \RXU UHTXHVW WR  2UGHU RQOLQH DW ZZZHGSXEVRUJ 7KLV UHSRUW DOVR LV DYDLODEOH RQ WKH 'HSDUWPHQWV :HE VLWH DW KWWSZZZHGJRYLHV 8SRQ UHTXHVW WKLV UHSRUW LV DYDLODEOH LQ DOWHUQDWH IRUPDWV VXFK DV %UDLOOH ODUJH SULQW RU FRPSXWHU GLVNHWWH )RU PRUH LQIRUPDWLRQ SOHDVH FRQWDFW WKH 'HSDUWPHQW
V $OWHUQDWH )RUPDW &HQWHU DW  RU 

$FNQRZOHGJPHQWV

7KLV VWXG\ UHSUHVHQWV D FROODERUDWLYH HIIRUW RI PDQ\ VFKRRO GLVWULFWV VFKRROV WHDFKHUV UHVHDUFKHUV GDWD FROOHFWLRQ H[SHUWV SXEOLVKHUV DQG GHYHORSHUV DQG VWDII RI WKH ,QVWLWXWH RI (GXFDWLRQ 6FLHQFHV :H DSSUHFLDWH WKH ZLOOLQJQHVV RI WKH VFKRRO GLVWULFWV VFKRROV DQG WHDFKHUV WR YROXQWHHU IRU WKH VWXG\ XVH WKH SURGXFWV DQG UHVSRQG WR PDQ\ UHTXHVWV IRU GDWD SHUVSHFWLYHV LQVLJKWV DQG DFFHVV WR FODVVURRPV :H WKDQN $XGUH\ 3HQGOHWRQ SURMHFW RIILFHU 5LFN\ 7DNDL DQG 3KRHEH &RWWLQJKDP DW WKH ,QVWLWXWH RI (GXFDWLRQ 6FLHQFHV IRU WKHLU VXSSRUW DQG JXLGDQFH WKURXJKRXW WKH VWXG\ :H DOVR WKDQN -RKQ %DLOH\ 6XVDQ 3DWULFN DQG 7LPRWK\ 0DJQHU RI WKH 86 'HSDUWPHQW RI (GXFDWLRQV 2IILFH RI (GXFDWLRQ 7HFKQRORJ\ IRU WKHLU VXSSRUW DQG VXJJHVWLRQV WKURXJKRXW WKH VWXG\ :H EHQHILWHG IURP WKH LQVLJKWV DQG FRPPHQWV RI WKH HYDOXDWLRQV WHFKQLFDO ZRUNLQJ JURXS &KULV /RQLJDQ 6WHYHQ 5RVV 7RP &RRN -HUH %URSK\ 0LFKDHO .DPLO *DU\ 3KLOOLSV 'RXJ &OHPHQWV DQG -RKQ &RRQH\ :H WKDQN &KULVWRSKHU 6DQIRUG DQG )UDQFHV %HUJODQG IRU FRRUGLQDWLQJ WKH FODVVURRP REVHUYDWLRQV DQG PRQLWRULQJ WKH FROOHFWLRQ DQG SURFHVVLQJ RI WKH LQWHUYLHZ DQG REVHUYDWLRQ GDWD $P\ +DIWHU IRU WKH VXSSRUW WR WKH VWDII FRQGXFWLQJ REVHUYDWLRQV $P\ /HZLV IRU GHVLJQ DQG SURGXFWLRQ RI LQVWUXPHQWDWLRQ IRU WKH REVHUYDWLRQV DQG 3DXO +X IRU DQDO\]LQJ DQG GRFXPHQWLQJ WKH REVHUYDWLRQDO GDWD 0HOLVVD 7KRPDV ZDV D NH\ FRQWULEXWRU WR WKH GHYHORSPHQW RI WKH VXUYH\ LQVWUXPHQWV DQG KHOSHG GLUHFW WKH WHVWLQJ DQG GDWD FROOHFWLRQ HIIRUW .ULVWLQD 4XDUWDQD 7RP %DUWRQ 9DOHULH :LOOLDPV 0HOLVVD 'XJJHU 7LPRWK\ %UXXUVHPD DQG /HRQDUG %URZQ DVVLVWHG LQ PDQDJLQJ WKH GDWD FROOHFWLRQ DQG 0DULDQQH 6WHYHQVRQ )UDQFHQH %DUERXU 6XVDQ *ROGHQ 6HDVRQ %HGHOO%R\OH DQG 6KHOE\ 3ROODFN DOVR KHOSHG FROOHFW DQG PDQDJH WKH GDWD :H WKDQN 1DNLV (YJHQLRX 6FRWW 5HLG 0DUN %HDUGVOH\ 5RQDOG 3DODQFD DQG 5RODQG 6FXUDWR IRU LQIRUPDWLRQ V\VWHPV VXSSRUW 'RQ -DQJ DQG $PDQJ 6XNDVLK IRU VWDWLVWLFDO VXSSRUW DQG 7LP 1RYDN &DURO 5D]DILQGUDNDWR DQG $OH[ %RJLQ IRU SURJUDPPLQJ WKH HVWLPDWLRQ PRGHOV :H DSSUHFLDWH WKH H[SHUW VNLOOV RI -LOO 0LOOHU DQG %LOO *DUUHWW WR IRUPDW DQG SURGXFH WKH UHSRUW 7KH $XWKRUV

&RQWHQWV

&KDSWHU

3DJH ([HFXWLYH 6XPPDU\[LLL

,QWURGXFWLRQ   $ % & ' ( ) 5HVHDUFK RQ WKH (IIHFWLYHQHVV RI 5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH  'HVLJQ RI WKH 1DWLRQDO 6WXG\   5HFUXLWLQJ 'LVWULFWV DQG 6FKRROV IRU WKH 6WXG\   5HFUXLWLQJ DQG $VVLJQLQJ 7HDFKHUV  &ROOHFWLQJ &ODVVURRP DQG 6WXGHQW 'DWD   /RRNLQJ $KHDG 

,,

(IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV  $ ,PSOHPHQWDWLRQ $QDO\VLV  % (IIHFWV RQ 5HDGLQJ 7HVW 6FRUHV  & &RQFOXVLRQV  

,,,

(IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV  $ ,PSOHPHQWDWLRQ $QDO\VLV  % (IIHFWV RQ 5HDGLQJ 7HVW 6FRUHV  & &RQFOXVLRQV  

,9

(IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV  $ ,PSOHPHQWDWLRQ $QDO\VLV  % (IIHFWV RQ 0DWK 7HVW 6FRUHV  & &RQFOXVLRQV  

(IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV  $ ,PSOHPHQWDWLRQ $QDO\VLV  % (IIHFWV RQ $OJHEUD 7HVW 6FRUHV   & &RQFOXVLRQV   5HIHUHQFHV  $SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV  $SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV 

7DEOHV

7DEOH , , , , ,, ,, ,, ,, ,, ,, ,, ,, ,, ,,, ,,, ,,, ,,,

3DJH 1XPEHU RI 6WXG\ 'LVWULFWV 6FKRROV 7HDFKHUV DQG 6WXGHQWV E\ *UDGH /HYHO 6SULQJ    &KDUDFWHULVWLFV RI 'LVWULFWV LQ WKH 6WXG\   &KDUDFWHULVWLFV RI 6FKRROV LQ WKH 6WXG\  )HDWXUHV RI 7HVWV 8VHG LQ WKH 6WXG\   ,QVWUXFWLRQDO )HDWXUHV RI )LUVW *UDGH 5HDGLQJ 3URGXFWV   7HDFKHU5HSRUWHG 8VH RI 6WXG\ 3URGXFWV DQG 2WKHU 5HDGLQJ 6RIWZDUH 3URGXFWV )LUVW *UDGH   'DLO\ DQG $QQXDO 8VDJH )URP 3URGXFW 5HFRUGV  $FWLYLWLHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )LUVW *UDGH   &KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )LUVW *UDGH   6SULQJ 5HDGLQJ 7HVW 6FRUH 'LIIHUHQFHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )LUVW *UDGH   (IIHFW RQ 3HUFHQW RI 6WXGHQWV LQ /RZHVW 7KLUG RI 5HDGLQJ 7HVW 6FRUH  ,QWHUDFWLRQV %HWZHHQ 0RGHUDWLQJ 9DULDEOHV DQG (IIHFWV 6$7 5HDGLQJ 7HVW )LUVW *UDGH  ,QWHUDFWLRQV %HWZHHQ 0RGHUDWLQJ 9DULDEOHV DQG (IIHFWV 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ )LUVW *UDGH   ,QVWUXFWLRQDO )HDWXUHV RI )RXUWK *UDGH 5HDGLQJ 3URGXFWV  7HDFKHU5HSRUWHG 8VH RI 6WXG\ 3URGXFWV DQG 2WKHU 5HDGLQJ 6RIWZDUH 3URGXFWV )RXUWK *UDGH   'DLO\ DQG $QQXDO 8VDJH )URP 3URGXFW 5HFRUGV  $FWLYLWLHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )RXUWK *UDGH  

viii

,,, ,,, ,,, ,,, ,9 ,9 ,9 ,9 ,9 ,9 ,9 ,9 9 9 9 9 9 9 9

&KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )RXUWK *UDGH   6SULQJ 5HDGLQJ 7HVW 6FRUH 'LIIHUHQFHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )RXUWK *UDGH   (IIHFW RQ 3HUFHQW RI 6WXGHQWV LQ /RZHVW 7KLUG RI 5HDGLQJ 7HVW 6FRUHV   ,QWHUDFWLRQV %HWZHHQ 0RGHUDWLQJ 9DULDEOHV DQG (IIHFWV 6$7 5HDGLQJ 7HVW )RXUWK *UDGH  ,QVWUXFWLRQDO )HDWXUHV RI 6L[WK *UDGH 0DWKHPDWLFV 3URGXFWV   7HDFKHU5HSRUWHG 8VH RI 6WXG\ 3URGXFWV DQG 2WKHU 0DWKHPDWLFV 3URGXFWV 6L[WK *UDGH   'DLO\ DQG $QQXDO 8VDJH )URP 3URGXFW 5HFRUGV  $FWLYLWLHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 6L[WK *UDGH   &KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 6L[WK *UDGH  6SULQJ 0DWK 7HVW 6FRUH 'LIIHUHQFHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 6L[WK *UDGH  (IIHFW RQ 3HUFHQW RI 6WXGHQWV LQ /RZHVW 7KLUG RI 0DWK 7HVW 6FRUHV   ,QWHUDFWLRQV %HWZHHQ 0RGHUDWLQJ 9DULDEOHV DQG (IIHFWV 6$7 0DWK 7HVW 6L[WK *UDGH  ,QVWUXFWLRQDO )HDWXUHV RI $OJHEUD 3URGXFWV   7HDFKHU5HSRUWHG 8VH RI 6WXG\ 3URGXFWV DQG 2WKHU 0DWK 6RIWZDUH   'DLO\ DQG $QQXDO 8VDJH   $FWLYLWLHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV  &KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV  (76 $OJHEUD )LQDO ([DP 6FRUH 'LIIHUHQFHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV  ,QWHUDFWLRQV %HWZHHQ 0RGHUDWLQJ 9DULDEOHV DQG (IIHFWV (76 $OJHEUD 7HVW 

7DEOHV

)LJXUHV

)LJXUH ,, ,, ,, ,,, ,,, ,,, ,9 ,9 ,9 9 9 9

3DJH 'LIIHUHQFH LQ $QQXDO 7HDFKHU5HSRUWHG +RXUV RI 5HDGLQJ 7HFKQRORJ\ 3URGXFW 8VH %HWZHHQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )LUVW *UDGH  6FKRRO/HYHO (IIHFW 6L]HV E\ 'LVWULFW )LUVW *UDGH 6$7 5HDGLQJ 6FRUH   6FKRRO/HYHO (IIHFW 6L]HV E\ 3URGXFW )LUVW *UDGH 6$7 5HDGLQJ 6FRUH   'LIIHUHQFH LQ $QQXDO 7HDFKHU5HSRUWHG +RXUV RI 5HDGLQJ 7HFKQRORJ\ 3URGXFW 8VH %HWZHHQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )RXUWK *UDGH  6FKRRO/HYHO (IIHFW 6L]HV E\ 'LVWULFW )RXUWK *UDGH 6$7 5HDGLQJ 6FRUH   6FKRRO/HYHO (IIHFW 6L]HV E\ 3URGXFW )RXUWK *UDGH 6$7 5HDGLQJ 6FRUH   'LIIHUHQFH LQ $QQXDO 7HDFKHU5HSRUWHG +RXUV RI 0DWK 7HFKQRORJ\ 3URGXFW 8VH %HWZHHQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 6L[WK *UDGH   6FKRRO/HYHO (IIHFW 6L]HV E\ 'LVWULFW 6L[WK *UDGH 6$7 0DWK 6FRUH   6FKRRO/HYHO (IIHFW 6L]HV E\ 3URGXFW 6L[WK *UDGH 6$7 0DWK 6FRUH   'LIIHUHQFH LQ $QQXDO 7HDFKHU5HSRUWHG +RXUV RI 0DWK 7HFKQRORJ\ 3URGXFW 8VH %HWZHHQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV $OJHEUD   6FKRRO/HYHO (IIHFW 6L]HV E\ 'LVWULFW $OJHEUD (76 )LQDO ([DP   6FKRRO/HYHO (IIHFW 6L]HV E\ 3URGXFW $OJHEUD (76 )LQDO ([DP  

([KLELWV

([KLELW ,,

3DJH +RZ 3URGXFW )HDWXUHV :HUH $VVHVVHG 

([HFXWLYH 6XPPDU\ (IIHFWLYHQHVV RI 5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH 3URGXFWV )LQGLQJV IURP WKH )LUVW 6WXGHQW &RKRUW

LWK FRPSXWHUV QRZ FRPPRQSODFH LQ $PHULFDQ FODVVURRPV DQG GLVWULFWV IDFLQJ VXEVWDQWLDO FRVWV RI KDUGZDUH DQG VRIWZDUH FRQFHUQV QDWXUDOO\ DULVH DERXW WKH FRQWULEXWLRQ RI WKLV WHFKQRORJ\ WR VWXGHQWV OHDUQLQJ 7KH 1R &KLOG /HIW %HKLQG $FW 3/  VHFWLRQ  FDOOHG IRU WKH 86 'HSDUWPHQW RI (GXFDWLRQ (' WR FRQGXFW D QDWLRQDO VWXG\ RI WKH HIIHFWLYHQHVV RI HGXFDWLRQDO WHFKQRORJ\ 7KLV OHJLVODWLRQ DOVR FDOOHG IRU WKH VWXG\ WR XVH VFLHQWLILFDOO\ EDVHG UHVHDUFK PHWKRGV DQG FRQWURO JURXSV RU FRQWURO FRQGLWLRQV DQG WR IRFXV RQ WKH LPSDFW RI WHFKQRORJ\ RQ VWXGHQW DFDGHPLF DFKLHYHPHQW ,Q  (' FRQWUDFWHG ZLWK 0DWKHPDWLFD 3ROLF\ 5HVHDUFK ,QF 035 DQG 65, ,QWHUQDWLRQDO WR FRQGXFW WKH VWXG\ 7KH WHDP ZRUNHG ZLWK (' WR VHOHFW WHFKQRORJ\ SURGXFWV UHFUXLW VFKRRO GLVWULFWV VFKRROV DQG WHDFKHUV WHVW VWXGHQWV REVHUYH FODVVURRPV DQG DQDO\]H WKH GDWD 7KH VWXG\ XVHG DQ H[SHULPHQWDO GHVLJQ WR DVVHVV WKH HIIHFWV RI WHFKQRORJ\ SURGXFWV ZLWK YROXQWHHULQJ WHDFKHUV UDQGRPO\ DVVLJQHG WR XVH RU QRW XVH VHOHFWHG SURGXFWV 7KH PDLQ ILQGLQJV RI WKH VWXG\ DUH  7HVW 6FRUHV :HUH 1RW 6LJQLILFDQWO\ +LJKHU LQ &ODVVURRPV 8VLQJ 6HOHFWHG 5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH 3URGXFWV 7HVW VFRUHV LQ WUHDWPHQW FODVVURRPV WKDW ZHUH UDQGRPO\ DVVLJQHG WR XVH SURGXFWV GLG QRW GLIIHU IURP WHVW VFRUHV LQ FRQWURO FODVVURRPV E\ VWDWLVWLFDOO\ VLJQLILFDQW PDUJLQV  (IIHFWV :HUH &RUUHODWHG :LWK 6RPH &ODVVURRP DQG 6FKRRO &KDUDFWHULVWLFV )RU UHDGLQJ SURGXFWV HIIHFWV RQ RYHUDOO WHVW VFRUHV ZHUH FRUUHODWHG ZLWK WKH VWXGHQW WHDFKHU UDWLR LQ ILUVW JUDGH FODVVURRPV DQG ZLWK WKH DPRXQW RI WLPH WKDW SURGXFWV ZHUH XVHG LQ IRXUWK JUDGH FODVVURRPV )RU PDWK SURGXFWV HIIHFWV ZHUH XQFRUUHODWHG ZLWK FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV

xiv

6WXG\ 'HVLJQ ,QWHUYHQWLRQ 6L[WHHQ SURGXFWV ZHUH VHOHFWHG E\ (' EDVHG RQ SXEOLF VXEPLVVLRQV DQG UDWLQJV E\ WKH VWXG\ WHDP DQG H[SHUW UHYLHZ SDQHOV 3URGXFWV ZHUH JURXSHG LQWR IRXU DUHDV ILUVW JUDGH UHDGLQJ IRXUWK JUDGH UHDGLQJ VL[WK JUDGH PDWK DQG DOJHEUD 3DUWLFLSDQWV 7KLUW\WKUHH GLVWULFWV  VFKRROV DQG  WHDFKHUV SDUWLFLSDWHG LQ WKH VWXG\ ,Q ILUVW JUDGH  GLVWULFWV  VFKRROV DQG  WHDFKHUV SDUWLFLSDWHG ,Q IRXUWK JUDGH  GLVWULFWV  VFKRROV DQG  WHDFKHUV SDUWLFLSDWHG ,Q VL[WK JUDGH  GLVWULFWV  VFKRROV DQG  WHDFKHUV SDUWLFLSDWHG DQG IRU DOJHEUD  GLVWULFWV  VFKRROV DQG  WHDFKHUV SDUWLFLSDWHG 'LVWULFWV DQG VFKRROV FRXOG SDUWLFLSDWH LQ WKH VWXG\ DW PRUH WKDQ RQH JUDGH OHYHO DQG VRPH GLG 'LVWULFWV ZHUH UHFUXLWHG RQ WKH EDVLV WKDW WKH\ GLG QRW DOUHDG\ XVH WHFKQRORJ\ SURGXFWV WKDW ZHUH VLPLODU WR VWXG\ SURGXFWV LQ SDUWLFLSDWLQJ VFKRROV 5HVHDUFK 'HVLJQ :LWKLQ HDFK VFKRRO WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG WR EH DEOH WR XVH WKH VWXG\ SURGXFW WKH WUHDWPHQW JURXS RU QRW WKH FRQWURO JURXS &RQWURO JURXS WHDFKHUV ZHUH DEOH WR XVH RWKHU WHFKQRORJ\ SURGXFWV WKDW PD\ KDYH EHHQ LQ WKHLU FODVVURRPV 7KH VWXG\ DGPLQLVWHUHG WHVWV WR VWXGHQWV LQ ERWK W\SHV RI FODVVURRPV QHDU WKH EHJLQQLQJ DQG HQG RI WKH VFKRRO \HDU 7KH VWXG\ DOVR REVHUYHG WUHDWPHQW DQG FRQWURO FODVVURRPV WKUHH WLPHV GXULQJ WKH VFKRRO \HDU DQG FROOHFWHG GDWD IURP WHDFKHU TXHVWLRQQDLUHV DQG LQWHUYLHZV VWXGHQW UHFRUGV DQG SURGXFW UHFRUGV %HFDXVH VWXGHQWV ZHUH FOXVWHUHG LQ FODVVURRPV DQG FODVVURRPV ZHUH FOXVWHUHG LQ VFKRROV HIIHFWV ZHUH HVWLPDWHG XVLQJ KLHUDUFKLFDO OLQHDU PRGHOV 2XWFRPHV $QDO\]HG 6WXGHQW WHVW VFRUHV FODVVURRP DFWLYLWLHV DQG UROHV RI WHDFKHUV DQG VWXGHQWV

(GXFDWLRQDO WHFKQRORJ\ LV XVHG IRU ZRUG SURFHVVLQJ SUHVHQWDWLRQ VSUHDGVKHHWV GDWDEDVHV LQWHUQHW VHDUFK GLVWDQFH HGXFDWLRQ YLUWXDO VFKRROV LQWHUDFWLRQV ZLWK VLPXODWLRQV DQG PRGHOV DQG FROODERUDWLRQ RYHU ORFDO DQG JOREDO QHWZRUNV 7HFKQRORJ\ DOVR LV XVHG DV DVVLVWLYH GHYLFHV IRU VWXGHQWV ZLWK GLVDELOLWLHV DQG WR WHDFK FRQFHSWV RU VNLOOV WKDW DUH GLIILFXOW RU LPSRVVLEOH WR FRQYH\ ZLWKRXW WHFKQRORJ\ 7KLV VWXG\ LV VSHFLILFDOO\ IRFXVHG RQ ZKHWKHU VWXGHQWV KDG KLJKHU UHDGLQJ RU PDWK WHVW VFRUHV ZKHQ WHDFKHUV KDG DFFHVV WR VHOHFWHG VRIWZDUH SURGXFWV GHVLJQHG WR VXSSRUW OHDUQLQJ LQ UHDGLQJ RU PDWKHPDWLFV ,W ZDV QRW GHVLJQHG WR DVVHVV WKH HIIHFWLYHQHVV RI HGXFDWLRQDO WHFKQRORJ\ DFURVV LWV HQWLUH VSHFWUXP RI XVHV DQG WKH VWXG\V ILQGLQJV GR QRW VXSSRUW FRQFOXVLRQV DERXW WHFKQRORJ\V HIIHFWLYHQHVV EH\RQG WKH VWXG\V FRQWH[W VXFK DV LQ RWKHU VXEMHFW DUHDV 7KLV UHSRUW LV WKH ILUVW RI WZR IURP WKH VWXG\ :KHWKHU UHDGLQJ DQG PDWKHPDWLFV VRIWZDUH LV PRUH HIIHFWLYH ZKHQ WHDFKHUV KDYH PRUH H[SHULHQFH XVLQJ LW LV EHLQJ H[DPLQHG ZLWK D VHFRQG \HDU RI GDWD 7KH VHFRQG \HDU LQYROYHV WHDFKHUV ZKR ZHUH LQ WKH ILUVW GDWD FROOHFWLRQ WKRVH ZKR DUH WHDFKLQJ LQ WKH VDPH VFKRRO DQG DW WKH VDPH JUDGH OHYHO RU VXEMHFW DUHD DQG D VHFRQG FRKRUW RI VWXGHQWV 7KH VHFRQG UHSRUW ZLOO SUHVHQW HIIHFWV IRU LQGLYLGXDO SURGXFWV 7KH FXUUHQW UHSRUW ZLOO SUHVHQW HIIHFWV IRU JURXSV RI SURGXFWV 6HOHFWLQJ 7HFKQRORJ\ 3URGXFWV IRU WKH 6WXG\ 7KH VWXG\ ZDV EDVHG RQ WKH YROXQWDU\ SDUWLFLSDWLRQ RI WHFKQRORJ\ SURGXFW GHYHORSHUV GLVWULFWV DQG VFKRROV DQG WHDFKHUV 7KHLU FKDUDFWHULVWLFV SURYLGH DQ LPSRUWDQW SDUW RI WKH VWXG\V VWUXFWXUH DQG FRQWH[W IRU LQWHUSUHWLQJ LWV ILQGLQJV

([HFXWLYH 6XPPDU\

xv

%HIRUH SURGXFWV FRXOG EH VHOHFWHG GHFLVLRQV ZHUH QHHGHG DERXW WKH VWXG\V IRFXV 7KH OHJLVODWLRQ PDQGDWLQJ WKH VWXG\ SURYLGHG JHQHUDO JXLGHOLQHV EXW GLG QRW GHVFULEH VSHFLILFDOO\ KRZ WKH VWXG\ ZDV WR EH LPSOHPHQWHG $ GHVLJQ WHDP FRQVLVWLQJ RI 86 'HSDUWPHQW RI (GXFDWLRQ VWDII UHVHDUFKHUV IURP 035 DQG LWV SDUWQHUV DQG UHVHDUFKHUV DQG HGXFDWLRQDO WHFKQRORJ\ H[SHUWV UHFRPPHQGHG WKDW WKH VWXG\ IRFXV DWWHQWLRQ RQ WHFKQRORJ\ SURGXFWV WKDW VXSSRUW UHDGLQJ RU PDWK LQVWUXFWLRQ LQ ORZLQFRPH VFKRROV VHUYLQJ WKH . JUDGHV XVH DQ H[SHULPHQWDO GHVLJQ WR HQVXUH WKDW PHDVXUHG DFKLHYHPHQW JDLQV FRXOG EH DWWULEXWHG WR SURGXFWV DQG EDVH WKH DQDO\VLV RI VWXGHQW DFDGHPLF DFKLHYHPHQW RQ D FRPPRQO\ XVHG VWDQGDUGL]HG WHVW

7KH WHDP DOVR LGHQWLILHG FRQGLWLRQV DQG SUDFWLFHV ZKRVH UHODWLRQVKLSV WR HIIHFWLYHQHVV FRXOG EH VWXGLHG DQG UHFRPPHQGHG D SXEOLF SURFHVV LQ ZKLFK GHYHORSHUV RI WHFKQRORJ\ SURGXFWV ZRXOG EH LQYLWHG WR SURYLGH LQIRUPDWLRQ WKDW D SDQHO ZRXOG FRQVLGHU LQ LWV VHOHFWLRQ RI SURGXFWV IRU WKH VWXG\ $ GHVLJQ UHSRUW SURYLGHG GLVFXVVLRQ DQG UDWLRQDOHV IRU WKH UHFRPPHQGDWLRQV $ WRWDO RI  VXEPLVVLRQV ZHUH UHFHLYHG LQ UHVSRQVH WR D SXEOLF LQYLWDWLRQ PDGH E\ (' DQG 035 LQ 6HSWHPEHU  $ WHDP UDWHG WKH VXEPLVVLRQV RQ HYLGHQFH RI HIIHFWLYHQHVV EDVHG RQ SUHYLRXV UHVHDUFK FRQGXFWHG E\ WKH FRPSDQLHV RU E\ RWKHU SDUWLHV ZKHWKHU SURGXFWV FRXOG RSHUDWH RQ D VFDOH WKDW ZDV VXLWDEOH IRU D QDWLRQDO VWXG\ DQG ZKHWKHU FRPSDQLHV KDG WKH FDSDFLW\ WR SURYLGH WUDLQLQJ WR VFKRROV DQG WHDFKHUV RQ WKH XVH RI WKHLU SURGXFWV $ OLVW RI FDQGLGDWH SURGXFWV ZDV WKHQ UHYLHZHG E\ WZR H[WHUQDO SDQHOV RQH HDFK IRU UHDGLQJ DQG PDWK (' VHOHFWHG  SURGXFWV IRU WKH VWXG\ IURP DPRQJ WKH UHFRPPHQGDWLRQV PDGH E\ WKH SDQHOV DQG DQQRXQFHG WKH FKRLFHV LQ -DQXDU\  (' DOVR LGHQWLILHG IRXU JUDGH OHYHOV IRU WKH VWXG\ GHFLGLQJ WR VWXG\ UHDGLQJ SURGXFWV LQ ILUVW DQG IRXUWK JUDGHV DQG PDWK SURGXFWV LQ VL[WK JUDGH DQG LQ DOJHEUD FODVVHV W\SLFDOO\ FRPSRVHG RI QLQWK JUDGHUV 7ZHOYH RI WKH  SURGXFWV KDYH HLWKHU UHFHLYHG RU EHHQ QRPLQDWHG WR UHFHLYH DZDUGV VRPH DV UHFHQWO\ DV  IURP WUDGH DVVRFLDWLRQV PHGLD SDUHQWV DQG WHDFKHUV 7KH VWXG\ GLG QRW GHWHUPLQH WKH QXPEHU RI VFKRROV WHDFKHUV DQG VWXGHQWV DOUHDG\ XVLQJ WKH VHOHFWHG SURGXFWV 7KH YROXQWDU\ DVSHFW RI FRPSDQ\ SDUWLFLSDWLRQ LQ WKH VWXG\ PHDQW WKDW SURGXFWV ZHUH QRW D UHSUHVHQWDWLYH VDPSOLQJ RI UHDGLQJ DQG PDWK WHFKQRORJ\ XVHG LQ VFKRROV 1RW DOO SURGXFWV ZHUH VXEPLWWHG IRU FRQVLGHUDWLRQ E\ WKH VWXG\ DQG PRVW SURGXFWV WKDW ZHUH VXEPLWWHG ZHUH QRW VHOHFWHG $OVR SURGXFWV WKDW ZHUH VHOHFWHG ZHUH DEOH WR SURYLGH DW OHDVW VRPH HYLGHQFH RI HIIHFWLYHQHVV IURP SUHYLRXV UHVHDUFK (' UHFRJQL]HG WKDW VHOHFWLQJ RVWHQVLEO\ PRUH HIIHFWLYH SURGXFWV FRXOG WLOW WKH VWXG\ WRZDUG ILQGLQJ KLJKHU OHYHOV RI HIIHFWLYHQHVV EXW WKH WLOW ZDV YLHZHG DV D UHDVRQDEOH WUDGHRII WR DYRLG LQYHVWLQJ WKH VWXG\V UHVRXUFHV LQ SURGXFWV WKDW KDG OLWWOH RU QR HYLGHQFH RI HIIHFWLYHQHVV 7KH VWXG\ ZDV GHVLJQHG WR UHSRUW UHVXOWV IRU JURXSV RI SURGXFWV UDWKHU WKDQ IRU LQGLYLGXDO SURGXFWV &RQJUHVV DVNHG ZKHWKHU WHFKQRORJ\ ZDV HIIHFWLYH DQG QRW KRZ WKH HIIHFWLYHQHVV RI LQGLYLGXDO SURGXFWV FRPSDUHG )XUWKHU D VWXG\ GHVLJQHG WR GHWHUPLQH WKH ([HFXWLYH 6XPPDU\

xvi

HIIHFWLYHQHVV RI JURXSV RI SURGXFWV UHTXLUHG IHZHU FODVVURRPV DQG VFKRROV WR DFKLHYH D WDUJHW OHYHO RI VWDWLVWLFDO SUHFLVLRQ DQG WKXV KDG ORZHU FRVWV WKDQ D VWXG\ GHVLJQHG WR GHWHUPLQH WKH HIIHFWLYHQHVV RI LQGLYLGXDO SURGXFWV DW WKH VDPH OHYHO RI SUHFLVLRQ 'HYHORSHUV RI VRIWZDUH SURGXFWV YROXQWHHUHG WR SDUWLFLSDWH LQ WKH VWXG\ ZLWK WKH XQGHUVWDQGLQJ WKDW WKH UHVXOWV ZRXOG EH UHSRUWHG RQO\ IRU JURXSV RI SURGXFWV 'XULQJ WKH FRXUVH RI LPSOHPHQWLQJ WKH VWXG\ YDULRXV SDUWLHV H[SUHVVHG DQ LQWHUHVW LQ NQRZLQJ UHVXOWV IRU LQGLYLGXDO SURGXFWV 7R DFFRPPRGDWH WKDW LQWHUHVW WKH GHVLJQ RI WKH VWXG\ ZDV PRGLILHG LQ LWV VHFRQG \HDU RI GDWD FROOHFWLRQ $W WKH VDPH WLPH SURGXFW GHYHORSHUV ZHUH DVNHG WR FRQVHQW WR KDYLQJ LQGLYLGXDO UHVXOWV DERXW WKHLU SURGXFWV UHSRUWHG LQ WKH VHFRQG \HDU RI GDWD FROOHFWLRQ $ UHSRUW RI WKH UHVXOWV IURP WKH VHFRQG \HDU LV IRUWKFRPLQJ 5HFUXLWLQJ 'LVWULFWV DQG 6FKRROV IRU WKH 6WXG\ $IWHU SURGXFWV ZHUH VHOHFWHG WKH VWXG\ WHDP EHJDQ UHFUXLWLQJ VFKRRO GLVWULFWV WR SDUWLFLSDWH 7KH WHDP IRFXVHG RQ VFKRRO GLVWULFWV WKDW KDG ORZ VWXGHQW DFKLHYHPHQW DQG ODUJH SURSRUWLRQV RI VWXGHQWV LQ SRYHUW\ EXW WKHVH ZHUH JHQHUDO JXLGHOLQHV UDWKHU WKDQ VWULFW HOLJLELOLW\ FULWHULD 7KH VWXG\ VRXJKW GLVWULFWV DQG VFKRROV WKDW GLG QRW DOUHDG\ XVH SURGXFWV OLNH WKRVH LQ WKH VWXG\ VR WKDW WKHUH ZRXOG EH D FRQWUDVW EHWZHHQ WKH XVH RI WHFKQRORJ\ LQ WUHDWPHQW DQG FRQWURO FODVVURRPV 3URGXFW YHQGRUV VXJJHVWHG PDQ\ RI WKH GLVWULFWV WKDW XOWLPDWHO\ SDUWLFLSDWHG LQ WKH VWXG\ 2WKHUV KDG SUHYLRXVO\ SDUWLFLSDWHG LQ VWXGLHV ZLWK 035 RU OHDUQHG RI WKH VWXG\ IURP QHZV DUWLFOHV DQG FRQWDFWHG 035 WR H[SUHVV LQWHUHVW ,QWHUHVWHG GLVWULFWV LGHQWLILHG VFKRROV IRU WKH VWXG\ WKDW IHOO ZLWKLQ WKH JXLGHOLQHV *HQHUDOO\ VFKRROV ZHUH LGHQWLILHG E\ VHQLRU GLVWULFW VWDII EDVHG RQ EURDG FRQVLGHUDWLRQV VXFK DV ZKHWKHU VFKRROV KDG DGHTXDWH WHFKQRORJ\ LQIUDVWUXFWXUH DQG ZKHWKHU VFKRROV ZHUH SDUWLFLSDWLQJ LQ RWKHU LQLWLDWLYHV %\ 6HSWHPEHU  WKH VWXG\ KDG UHFUXLWHG  GLVWULFWV DQG  VFKRROV WR SDUWLFLSDWH )LYH GLVWULFWV HOHFWHG WR LPSOHPHQW SURGXFWV LQ WZR RU PRUH JUDGH OHYHOV DQG RQH GLVWULFW GHFLGHG WR LPSOHPHQW D SURGXFW LQ DOO IRXU JUDGH OHYHOV UHVXOWLQJ LQ  FRPELQDWLRQV RI GLVWULFWV DQG SURGXFW LPSOHPHQWDWLRQV 'LVWULFWV DQG VFKRROV LQ WKH VWXG\ KDG KLJKHUWKDQDYHUDJH SRYHUW\ OHYHOV DQG PLQRULW\ VWXGHQW SRSXODWLRQV VHH 7DEOH  7R LPSOHPHQW WKH H[SHULPHQWDO GHVLJQ WKH VWXG\ WHDP UDQGRPO\ DVVLJQHG YROXQWHHULQJ WHDFKHUV LQ SDUWLFLSDWLQJ VFKRROV WR XVH SURGXFWV WKH WUHDWPHQW JURXS RU QRW WKH FRQWURO JURXS %HFDXVH RI WKH H[SHULPHQWDO GHVLJQ WHDFKHUV LQ WKH WUHDWPHQW DQG FRQWURO JURXSV ZHUH H[SHFWHG WR EH HTXLYDOHQW RQ DYHUDJH H[FHSW WKDW RQH JURXS LV XVLQJ RQH RI WKH VWXG\V WHFKQRORJ\ SURGXFWV $VSHFWV RI WHDFKLQJ WKDW DUH GLIILFXOW RU LPSRVVLEOH WR REVHUYH VXFK DV D WHDFKHUV DELOLW\ WR PRWLYDWH VWXGHQWV WR OHDUQ DUH FRQWUROOHG E\ WKH H[SHULPHQWDO GHVLJQ EHFDXVH WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG DQG WKHUHIRUH VKRXOG EH WKH VDPH LQ ERWK JURXSV RQ DYHUDJH 7KH VWXG\ DOVR XVHG VWDWLVWLFDO PHWKRGV WR DGMXVW IRU UHPDLQLQJ GLIIHUHQFHV LQ PHDVXUHG FKDUDFWHULVWLFV RI VFKRROV WHDFKHUV DQG VWXGHQWV ZKLFK DULVH EHFDXVH RI VDPSOLQJ YDULDELOLW\

([HFXWLYH 6XPPDU\

xvii

7DEOH  6DPSOH 6L]H RI WKH (YDOXDWLRQ RI WKH (IIHFWLYHQHVV RI 5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH 3URGXFWV 6XEMHFW DQG *UDGH /HYHO 5HDGLQJ *UDGH  5HDGLQJ *UDGH  0DWK *UDGH  0DWK $OJHEUD 7RWDO 8QGXSOLFDWHG 7RWDOF
D

1XPEHU RI 'LVWULFWV      

1XPEHU RI 6FKRROV      

1XPEHU RI 7HDFKHUVD      

1XPEHU RI 6WXGHQWVE      QD

7KH QXPEHU RI WHDFKHUV LQFOXGHV WKH WUHDWPHQW DQG FRQWURO WHDFKHUV 7KH QXPEHU UHSUHVHQWV VWXGHQWV LQ WKH DQDO\VLV VDPSOH ZKR ZHUH WHVWHG LQ IDOO  DQG LQ VSULQJ  7KH WRWDO QXPEHU RI VWXGHQWV ZKR ZHUH WHVWHG DW HLWKHU SRLQW LQ WLPH LV ODUJHU EHFDXVH VRPH VWXGHQWV WHVWHG LQ WKH IDOO PRYHG RXW RI WKHLU VFKRRO GLVWULFW E\ WKH WLPH RI WKH VSULQJ WHVW DQG VRPH VWXGHQWV WHVWHG LQ WKH VSULQJ KDG PRYHG LQWR VWXG\ FODVVURRPV DIWHU WKH IDOO WHVW 7KH WRWDO QXPEHU RI VWXGHQWV WHVWHG ZDV  LQ WKH IDOO DQG  LQ WKH VSULQJ

%HFDXVH QLQH GLVWULFWV DQG HLJKW VFKRROV DUH SLORWLQJ PRUH WKDQ RQH SURGXFW IRU WKH VWXG\ WKH XQGXSOLFDWHG WRWDO JLYHV WKH QXPEHU RI XQLTXH GLVWULFWV DQG VFKRROV LQ WKH VWXG\ QRW DSSOLFDEOH

QD

7KH H[SHULPHQWDO GHVLJQ SURYLGHV D EDVLV IRU XQGHUVWDQGLQJ ZKHWKHU VRIWZDUH SURGXFWV LPSURYH DFKLHYHPHQW 7HDFKHUV LQ WKH WUHDWPHQW JURXS ZHUH WR LPSOHPHQW D GHVLJQDWHG SURGXFW DV SDUW RI WKHLU UHDGLQJ RU PDWK LQVWUXFWLRQ 7HDFKHUV LQ WKH FRQWURO JURXS ZHUH WR WHDFK UHDGLQJ RU PDWK DV WKH\ ZRXOG KDYH QRUPDOO\ SRVVLEO\ XVLQJ WHFKQRORJ\ SURGXFWV DOUHDG\ DYDLODEOH WR WKHP %HFDXVH WKH RQO\ GLIIHUHQFH RQ DYHUDJH EHWZHHQ JURXSV LV ZKHWKHU WHDFKHUV ZHUH DVVLJQHG WR XVH VWXG\ SURGXFWV WHVWVFRUH GLIIHUHQFHV FRXOG EH DWWULEXWHG WR EHLQJ DVVLJQHG WR XVH D SURGXFW DIWHU DOORZLQJ IRU VDPSOLQJ YDULDELOLW\ %HFDXVH WKH VWXG\ LPSOHPHQWHG SURGXFWV LQ UHDO VFKRROV DQG ZLWK WHDFKHUV ZKR KDG QRW XVHG WKH SURGXFWV WKH ILQGLQJV SURYLGH D VHQVH RI SURGXFW HIIHFWLYHQHVV XQGHU UHDOZRUOG FRQGLWLRQV RI XVH :KLOH WKH VWXG\ ZRUNHG WR HQVXUH WKDW WHDFKHUV UHFHLYHG DSSURSULDWH WUDLQLQJ RQ XVLQJ SURGXFWV DQG WKDW WHFKQRORJ\ LQIUDVWUXFWXUHV ZHUH DGHTXDWH YHQGRUV UDWKHU WKDQ WKH VWXG\ WHDP ZHUH UHVSRQVLEOH IRU SURYLGLQJ WHFKQLFDO DVVLVWDQFH DQG IRU ZRUNLQJ ZLWK VFKRROV DQG WHDFKHUV WR HQFRXUDJH WKHP WR XVH SURGXFWV PRUH RU XVH WKHP GLIIHUHQWO\ 7HDFKHUV FRXOG GHFLGH WR VWRS XVLQJ SURGXFWV LI WKH\ EHOLHYHG SURGXFWV ZHUH LQHIIHFWLYH RU GLIILFXOW WR XVH RU FRXOG XVH SURGXFWV LQ ZD\V WKDW YHQGRUV PD\ QRW KDYH LQWHQGHG %HFDXVH RI WKLV IHDWXUH RI WKH VWXG\ WKH UHVXOWV UHODWH WR FRQGLWLRQV RI XVH WKDW VFKRROV DQG GLVWULFWV ZRXOG IDFH LI WKH\ ZHUH SXUFKDVLQJ SURGXFWV RQ WKHLU RZQ &ROOHFWLQJ $FKLHYHPHQW DQG ,PSOHPHQWDWLRQ 'DWD 7KH VWXG\V DQDO\VHV UHO\ PRVWO\ RQ GDWD IURP VWXGHQW WHVW VFRUHV FODVVURRP REVHUYDWLRQV DQG WHDFKHU TXHVWLRQQDLUHV DQG LQWHUYLHZV 7KH VWXG\ DOVR FROOHFWHG VWXGHQW GDWD LWHPV IURP VFKRRO GLVWULFW UHFRUGV DQG LQFRUSRUDWHG GDWD DERXW GLVWULFWV DQG VFKRROV IURP WKH 1DWLRQDO &HQWHU IRU (GXFDWLRQ 6WDWLVWLFV &RPPRQ &RUH RI 'DWD 7R PHDVXUH HIIHFWV WKH WHDP DGPLQLVWHUHG D VWXGHQW WHVW LQ WKH IDOO DQG VSULQJ RI WKH  VFKRRO \HDU 7KH WHDP XVHG WKH 6WDQIRUG $FKLHYHPHQW 7HVW YHUVLRQ  UHDGLQJ EDWWHU\ IRU ILUVW JUDGHUV WKH 6WDQIRUG $FKLHYHPHQW 7HVW 6$7 UHDGLQJ EDWWHU\ IRU IRXUWK ([HFXWLYH 6XPPDU\

xviii

JUDGHUV DQG WKH 6$7 PDWK EDWWHU\ IRU VL[WK JUDGHUV 7KHVH WHVWV ZHUH DGPLQLVWHUHG LQ IDOO  DQG VSULQJ  7KH WHDP DOVR XVHG WKH 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 72:5( D VKRUW DQG UHOLDEOH RQHRQRQH WHVW RI UHDGLQJ DELOLW\ IRU ILUVW JUDGHUV WR DXJPHQW PHDVXUHV RI UHDGLQJ VNLOOV SURYLGHG E\ WKH 6$7 7RUJHVHQ HW DO  7R PHDVXUH DOJHEUD DFKLHYHPHQW WKH VWXG\ VHOHFWHG (GXFDWLRQDO 7HVWLQJ 6HUYLFHV (76 (QGRI&RXUVH $OJHEUD $VVHVVPHQW  %HFDXVH EDVHOLQH PHDVXUHV RI DOJHEUD NQRZOHGJH ZHUH QRW DYDLODEOH RU ZHUH FRQVLGHUHG XQVDWLVIDFWRU\ WKH VWXG\ ZRUNHG ZLWK (76 WR VHSDUDWH LWV DVVHVVPHQW ZKLFK HVVHQWLDOO\ LV D ILQDO H[DP LQWR WZR FRPSRQHQWV WKDW KDG HTXDO OHYHOV RI GLIILFXOW\ 7KH VWXG\ UDQGRPO\ VHOHFWHG FODVVURRPV HLWKHU WR WDNH SDUW $ LQ WKH IDOO DQG SDUW % LQ WKH VSULQJ RU WR WDNH % LQ WKH IDOO DQG $ LQ WKH VSULQJ 6SOLWWLQJ WKH WHVW LQ WKLV ZD\ PHDQW WKDW WKH IXOO WHVW ZDV DGPLQLVWHUHG LQ ERWK WKH IDOO DQG WKH VSULQJ EXW HDFK VWXGHQW WRRN RQO\ KDOI RI WKH WHVW DW HDFK SRLQW 7KH WHDP DOVR FROOHFWHG VFRUHV RQ GLVWULFW DFKLHYHPHQW WHVWV LI WKHVH GDWD ZHUH DYDLODEOH 7KH VWXG\V DGPLQLVWUDWLRQ RI LWV RZQ WHVW SURYLGHG D FRQVLVWHQW PHDVXUH RI DFKLHYHPHQW DFURVV YDULHG GLVWULFWV DQG VFKRROV EXW H[DPLQLQJ ILQGLQJV EDVHG RQ GLVWULFW WHVWV SURYLGHG D XVHIXO FKHFN RQ WKH UREXVWQHVV RI WKH ILQGLQJV &ODVVURRP REVHUYDWLRQV ZHUH WKH VWXG\V SULPDU\ EDVLV IRU DVVHVVLQJ SURGXFW LPSOHPHQWDWLRQ $Q REVHUYDWLRQ SURWRFRO ZDV GHYHORSHG LQ VSULQJ  DQG YLGHRWDSHV RI FODVVURRPV XVLQJ SURGXFWV ZHUH JDWKHUHG DQG ODWHU XVHG IRU REVHUYHU WUDLQLQJ 7KH REVHUYDWLRQ SURWRFRO ZDV GHVLJQHG WR JDWKHU VLPLODU LQIRUPDWLRQ LQ ERWK WUHDWPHQW DQG FRQWURO FODVVURRPV DQG DFURVV WKH GLIIHUHQW JUDGH OHYHOV DQG VXEMHFW DUHDV LQ WKH VWXG\ ,Q DGGLWLRQ WKH SURWRFRO ZDV GHVLJQHG WR IRFXV RQ HOHPHQWV RI LQVWUXFWLRQ DQG LPSOHPHQWDWLRQ WKDW FRXOG EH REVHUYHG UHOLDEO\ (DFK FODVVURRP ZDV YLVLWHG WKUHH WLPHV GXULQJ WKH VFKRRO \HDU DQG REVHUYHUV XVHG WKH SURWRFRO IRU HDFK REVHUYDWLRQ ZKLFK ODVWHG DERXW  KRXU 2EVHUYDWLRQV ZHUH FRPSOHPHQWHG E\ D WHDFKHU LQWHUYLHZ WKDW JDWKHUHG LQIRUPDWLRQ DERXW LPSOHPHQWDWLRQ LVVXHV %DFNJURXQG LQIRUPDWLRQ DERXW WHDFKHUV ZDV DOVR JDWKHUHG IURP D TXHVWLRQQDLUH WKDW WHDFKHUV FRPSOHWHG LQ 1RYHPEHU DQG 'HFHPEHU  6XPPDU\ RI 6WXG\ )LQGLQJV 7KH IRXU JUDGH OHYHOV HVVHQWLDOO\ FRPSULVH VXEVWXGLHV ZLWKLQ WKH RYHUDOO VWXG\ DQG ILQGLQJV DUH UHSRUWHG VHSDUDWHO\ IRU HDFK 7KH VWXG\V GDWD FROOHFWLRQ DSSURDFK ZDV WKH VDPH IRU WKH IRXU VXEVWXGLHV 7KH LPSOHPHQWDWLRQ DQDO\VLV IRFXVHG RQ KRZ SURGXFWV ZHUH XVHG LQ FODVVURRPV WKHLU H[WHQW RI XVDJH LVVXHV WKDW UHVXOWHG IURP WKHLU XVH DQG KRZ WKHLU XVH DIIHFWHG FODVVURRP DFWLYLWLHV 7KUHH LPSOHPHQWDWLRQ ILQGLQJV HPHUJHG FRQVLVWHQWO\ DFURVV WKH IRXU VXEVWXGLHV  1HDUO\ $OO 7HDFKHUV 5HFHLYHG 7UDLQLQJ DQG %HOLHYHG WKH 7UDLQLQJ 3UHSDUHG 7KHP WR 8VH WKH 3URGXFWV 9HQGRUV WUDLQHG WHDFKHUV LQ VXPPHU DQG HDUO\ IDOO RI  RQ XVLQJ SURGXFWV 1HDUO\ DOO WHDFKHUV DWWHQGHG WUDLQLQJV  SHUFHQW WR  SHUFHQW GHSHQGLQJ RQ WKH JUDGH OHYHO $W WKH HQG RI WUDLQLQJV PRVW WHDFKHUV UHSRUWHG WKDW WKH\ ZHUH FRQILGHQW WKDW WKH\ ZHUH SUHSDUHG WR XVH WKH SURGXFWV ZLWK WKHLU FODVVHV *HQHUDOO\ WHDFKHUV UHSRUWHG D ORZHU GHJUHH RI FRQILGHQFH LQ ZKDW WKH\ KDG OHDUQHG DIWHU WKH\ EHJDQ XVLQJ SURGXFWV LQ WKH FODVVURRP ([HFXWLYH 6XPPDU\

xix

 7HFKQLFDO 'LIILFXOWLHV 8VLQJ 3URGXFWV 0RVWO\ :HUH 0LQRU 0LQRU WHFKQLFDO GLIILFXOWLHV LQ XVLQJ SURGXFWV VXFK DV LVVXHV ZLWK VWXGHQWV ORJJLQJ LQ FRPSXWHUV ORFNLQJ XS RU KDUGZDUH SUREOHPV VXFK DV KHDGSKRQHV QRW ZRUNLQJ ZHUH IDLUO\ FRPPRQ 0RVW RI WKH WHFKQLFDO GLIILFXOWLHV ZHUH HDVLO\ FRUUHFWHG RU ZRUNHG DURXQG :KHQ DVNHG ZKHWKHU WKH\ ZRXOG XVH WKH SURGXFWV DJDLQ QHDUO\ DOO WHDFKHUV LQGLFDWHG WKDW WKH\ ZRXOG  :KHQ 3URGXFWV :HUH %HLQJ 8VHG 6WXGHQWV :HUH 0RUH /LNHO\ WR (QJDJH LQ ,QGLYLGXDO 3UDFWLFH DQG 7HDFKHUV :HUH 0RUH /LNHO\ WR )DFLOLWDWH 6WXGHQW /HDUQLQJ 5DWKHU 7KDQ /HFWXUH 'DWD IURP FODVVURRP REVHUYDWLRQV LQGLFDWHG WKDW FRPSDUHG WR VWXGHQWV LQ FRQWURO FODVVURRPV ZKHUH WKH VDPH VXEMHFW ZDV WDXJKW ZLWKRXW XVLQJ WKH VHOHFWHG SURGXFWV VWXGHQWV XVLQJ SURGXFWV ZHUH PRUH OLNHO\ WR EH REVHUYHG ZRUNLQJ ZLWK DFDGHPLF FRQWHQW RQ WKHLU RZQ DQG OHVV OLNHO\ WR EH OLVWHQLQJ WR D OHFWXUH RU SDUWLFLSDWLQJ LQ TXHVWLRQDQGDQVZHU VHVVLRQV 7UHDWPHQW WHDFKHUV ZHUH PRUH OLNHO\ WKDQ FRQWURO WHDFKHUV WR EH REVHUYHG ZRUNLQJ ZLWK LQGLYLGXDO VWXGHQWV WR IDFLOLWDWH WKHLU OHDUQLQJ VXFK DV E\ SRLQWLQJ RXW NH\ LGHDV RU JLYLQJ KLQWV RU VXJJHVWLRQV RQ WDFNOLQJ WKH WDVN VWXGHQWV ZHUH ZRUNLQJ RQ UDWKHU WKDQ OHDGLQJ ZKROHFODVV DFWLYLWLHV &RPSDULQJ VWXGHQW WHVW VFRUHV IRU WUHDWPHQW WHDFKHUV XVLQJ VWXG\ SURGXFWV DQG FRQWURO WHDFKHUV QRW XVLQJ VWXG\ SURGXFWV LV WKH VWXG\V PHDVXUH RI SURGXFW HIIHFWLYHQHVV (IIHFWV RQ WHVW VFRUHV ZHUH HVWLPDWHG XVLQJ D VWDWLVWLFDO PRGHO WKDW DFFRXQWV IRU FRUUHODWLRQV RI VWXGHQWV ZLWKLQ FODVVURRPV DQG FODVVURRPV ZLWKLQ VFKRROV 7KH UREXVWQHVV RI WKH UHVXOWV ZDV DVVHVVHG E\ H[DPLQLQJ ILQGLQJV XVLQJ GLIIHUHQW PHWKRGV RI HVWLPDWLRQ DQG XVLQJ GLVWULFW WHVW VFRUHV DV RXWFRPHV DQG WKH SDWWHUQV RI ILQGLQJV ZHUH VLPLODU (IIHFWV RI )LUVW *UDGH 7HFKQRORJ\ 3URGXFWV 7KH ILUVW JUDGH VWXG\ ZDV EDVHG RQ ILYH UHDGLQJ VRIWZDUH SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ  GLVWULFWV DQG  VFKRROV 7KH VDPSOH LQFOXGHG  WHDFKHUV DQG  VWXGHQWV 7KH ILYH SURGXFWV ZHUH 'HVWLQDWLRQ 5HDGLQJ SXEOLVKHG E\ 5LYHUGHHS WKH :DWHUIRUG (DUO\ 5HDGLQJ 3URJUDP SXEOLVKHG E\ 3HDUVRQ 'LJLWDO /HDUQLQJ +HDGVSURXW SXEOLVKHG E\ +HDGVSURXW 3ODWR )RFXV SXEOLVKHG E\ 3ODWR DQG WKH $FDGHP\ RI 5HDGLQJ SXEOLVKHG E\ $XWRVNLOO 3URGXFWV SURYLGHG LQVWUXFWLRQ DQG GHPRQVWUDWLRQ LQ WXWRULDO PRGXOHV DOORZHG VWXGHQWV WR DSSO\ VNLOOV LQ SUDFWLFH PRGXOHV DQG WHVWHG VWXGHQWV RQ WKHLU DELOLW\ WR DSSO\ VNLOOV LQ DVVHVVPHQW PRGXOHV 7KH WXWRULDOSUDFWLFHDVVHVVPHQW PRGXODU VWUXFWXUH ZDV FRPPRQ IRU SURGXFWV DW RWKHU JUDGH OHYHOV DV ZHOO 7KHLU IRFXV ZDV RQ LPSURYLQJ VNLOOV LQ OHWWHU UHFRJQLWLRQ SKRQHPLF DZDUHQHVV ZRUG UHFRJQLWLRQ DQG ZRUG DWWDFN YRFDEXODU\ EXLOGLQJ DQG WH[W FRPSUHKHQVLRQ 7KH VWXG\ HVWLPDWHG WKH DYHUDJH OLFHQVLQJ IHHV IRU WKH SURGXFWV WR EH DERXW  D VWXGHQW IRU WKH VFKRRO \HDU ZLWK D UDQJH RI  WR  $FFRUGLQJ WR UHFRUGV PDLQWDLQHG E\ SURGXFW VRIWZDUH XVDJH E\ LQGLYLGXDO VWXGHQWV DYHUDJHG DOPRVW  KRXUV D \HDU ZKLFK WKH VWXG\ HVWLPDWHG WR EH DERXW  SHUFHQW RI UHDGLQJ LQVWUXFWLRQDO WLPH 6RPH FRQWURO JURXS WHDFKHUV XVHG WHFKQRORJ\EDVHG UHDGLQJ SURGXFWV WKDW ZHUH QRW LQ WKH VWXG\ 7KHVH SURGXFWV JHQHUDOO\ DOORZHG VWXGHQWV WR SUDFWLFH ([HFXWLYH 6XPPDU\

xx

YDULRXV VNLOOV 6RIWZDUHEDVHG UHFRUGV RI VWXGHQW XVDJH RI WKHVH RWKHU SURGXFWV ZHUH QRW FROOHFWHG EXW FRQWURO WHDFKHUV UHSRUWHG XVLQJ WKHP DERXW D ILIWK DV PXFK DV WUHDWPHQW WHDFKHUV UHSRUWHG XVLQJ VWXG\ SURGXFWV )LUVW JUDGH UHDGLQJ SURGXFWV GLG QRW DIIHFW WHVW VFRUHV E\ DPRXQWV WKDW ZHUH VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR )LJXUH  VKRZV REVHUYHG VFRUH GLIIHUHQFHV RQ WKH 6$7 UHDGLQJ WHVW DQG )LJXUH  VKRZV REVHUYHG VFRUH GLIIHUHQFHV RQ WKH 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 7KH GLIIHUHQFHV DUH VKRZQ LQ HIIHFW VL]H XQLWV ZKLFK DOORZ WKH VWXG\ WR FRPSDUH UHVXOWV IRU WHVWV ZKRVH VFRUHV DUH UHSRUWHG LQ GLIIHUHQW XQLWV 7KH VWXG\V SDUWLFXODU PHDVXUH RI HIIHFW VL]H LV WKH VFRUH GLIIHUHQFH GLYLGHG E\ WKH VWDQGDUG GHYLDWLRQ RI WKH FRQWURO JURXS WHVWVFRUH (IIHFW VL]HV DUH FRQVLVWHQW IRU WKH WZR WHVWV DQG WKHLU VXEWHVWV LQ WKH UDQJH RI  WR  7KHVH HIIHFW VL]HV DUH HTXLYDOHQW WR LQFUHDVHV LQ VWXGHQW SHUFHQWLOH UDQNV RI DERXW  WR  SRLQWV 1RQH LV VWDWLVWLFDOO\ VLJQLILFDQW
)LJXUH (IIHFWVRI)LUVW*UDGH5HDGLQJ3URGXFWVRQ6$75HDGLQJ6FRUH  (IIHFW 6L]H    

2YHUDOO6FRUH 6RXQGVDQG/HWWHUV

:RUG5HDGLQJ 6HQWHQFH5HDGLQJ

6$75HDGLQJ7HVW

1RWH1RQHRIWKHHIIHFWVLVVLJQLILFDQWO\GLIIHUHQWIURP]HURDWWKHOHYHO

)LJXUH (IIHFWVRI)LUVW*UDGH5HDGLQJ3URGXFWVRQ7HVWRI:RUG5HDGLQJ(IILFLHQF\ 6FRUH   (IIHFW 6L]H  

2YHUDOO6FRUH

3KRQHPLF'HFRGLQJ 6LJKW:RUG(IILFLHQF\ (IILFLHQF\ 7HVWRI:RUG5HDGLQJ(IILFLHQF\

1RWH1RQHRIWKHHIIHFWVLVVLJQLILFDQWO\GLIIHUHQWIURP]HURDWWKHOHYHO

([HFXWLYH 6XPPDU\

xxi

/DUJH GLIIHUHQFHV LQ HIIHFWV ZHUH REVHUYHG EHWZHHQ VFKRROV %HFDXVH RQO\ D IHZ WHDFKHUV LPSOHPHQWHG SURGXFWV LQ HDFK VFKRRO VDPSOLQJ YDULDQFH WKH DVVLJQPHQW RI WHDFKHUV WR WUHDWPHQW DQG FRQWURO JURXSV FDQ H[SODLQ PXFK RI WKH REVHUYHG GLIIHUHQFHV EXW WKH VWXG\ DOVR LQYHVWLJDWHG ZKHWKHU WKH GLIIHUHQFHV ZHUH FRUUHODWHG ZLWK VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV 5HODWLRQVKLSV EHWZHHQ VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV DQG VFRUH GLIIHUHQFHV FDQQRW EH LQWHUSUHWHG DV FDXVDO EHFDXVH GLVWULFWV DQG VFKRROV YROXQWHHUHG WR SDUWLFLSDWH LQ WKH VWXG\ DQG WR LPSOHPHQW SDUWLFXODU SURGXFWV 7KHLU FKDUDFWHULVWLFV PDQ\ RI ZKLFK WKH VWXG\ GLG QRW REVHUYH PD\ LQIOXHQFH REVHUYHG HIIHFWV )RU ILUVW JUDGH HIIHFWV ZHUH ODUJHU ZKHQ VFKRROV KDG VPDOOHU VWXGHQWWHDFKHU UDWLRV D PHDVXUH RI FODVV VL]H 2WKHU FKDUDFWHULVWLFV LQFOXGLQJ WHDFKHU H[SHULHQFH DQG HGXFDWLRQ VFKRRO UDFLDOHWKQLF FRPSRVLWLRQ DQG WKH DPRXQW RI WLPH WKDW SURGXFWV ZHUH XVHG GXULQJ WKH VFKRRO \HDU ZHUH QRW FRUUHODWHG ZLWK HIIHFWV (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 3URGXFWV 7KH IRXUWK JUDGH VWXG\ LQFOXGHG IRXU UHDGLQJ SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ QLQH GLVWULFWV DQG  VFKRROV 7KH VDPSOH LQFOXGHG  WHDFKHUV DQG  VWXGHQWV 7KH IRXU SURGXFWV ZHUH /HDSIURJ SXEOLVKHG E\ /HDSWUDFN 5HDG  SXEOLVKHG E\ 6FKRODVWLF $FDGHP\ RI 5HDGLQJ SXEOLVKHG E\ $XWRVNLOO DQG .QRZOHGJH%R[ SXEOLVKHG E\ 3HDUVRQ 'LJLWDO /HDUQLQJ 7KUHH RI WKH IRXU SURGXFWV SURYLGHG WXWRULDOV SUDFWLFH DQG DVVHVVPHQW JHDUHG WR VSHFLILF UHDGLQJ VNLOOV RQH DV D FRUH UHDGLQJ FXUULFXOXP DQG WZR DV VXSSOHPHQWV WR WKH FRUH FXUULFXOXP 7KH IRXUWK SURGXFW RIIHUHG WHDFKHUV DFFHVV WR KXQGUHGV RI GLJLWDO UHVRXUFHV VXFK DV WH[W SDVVDJHV YLGHR FOLSV LPDJHV LQWHUQHW VLWHV DQG VRIWZDUH PRGXOHV IURP ZKLFK WHDFKHUV FRXOG FKRRVH WR VXSSOHPHQW WKHLU UHDGLQJ FXUULFXOXP 7KH VWXG\ HVWLPDWHG WKH DYHUDJH OLFHQVLQJ IHHV IRU WKH SURGXFWV WR EH DERXW  D VWXGHQW IRU WKH VFKRRO \HDU ZLWK D UDQJH RI  WR  $QQXDO XVDJH E\ VWXGHQWV IRU WKH WZR IRXUWK JUDGH SURGXFWV WKDW FROOHFWHG WKLV PHDVXUH LQ WKHLU GDWDEDVHV ZDV  KRXUV IRU RQH SURGXFW DQG  IRU WKH RWKHU $VVXPLQJ D W\SLFDO UHDGLQJ LQVWUXFWLRQ SHULRG ZDV  PLQXWHV VWXGHQWV XVHG SURGXFWV IRU OHVV WKDQ  SHUFHQW RI UHDGLQJ LQVWUXFWLRQDO WLPH WKLV HVWLPDWH UHIHUV WR WKH FRPSXWHUEDVHG FRPSRQHQW RI SURGXFWV 7UHDWPHQW WHDFKHUV DOVR UHSRUWHG VFKHGXOLQJ  KRXUV RI XVH RI RWKHU SURGXFWV GXULQJ WKH VFKRRO \HDU DQG FRQWURO WHDFKHUV UHSRUWHG VFKHGXOLQJ  KRXUV RI XVH RI RWKHU SURGXFWV 7UHDWPHQW WHDFKHUV DOVR UHSRUWHG VSHQGLQJ  KRXU PRUH D ZHHN WHDFKLQJ UHDGLQJ WKDQ FRQWURO WHDFKHUV WKH LQFUHDVH ZDV VWDWLVWLFDOO\ VLJQLILFDQW )RXUWK JUDGH UHDGLQJ SURGXFWV GLG QRW DIIHFW WHVW VFRUHV E\ DPRXQWV WKDW ZHUH VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR )LJXUH  VKRZV PHDVXUHG HIIHFW VL]HV IRU WKH 6$7 UHDGLQJ WHVW LQ HIIHFW VL]H XQLWV 0RVW VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV ZHUH QRW FRUUHODWHG ZLWK HIIHFWV EXW HIIHFWV ZHUH ODUJHU ZKHQ WHDFKHUV UHSRUWHG KLJKHU OHYHOV RI SURGXFW XVH $V QRWHG DERYH WKHVH UHODWLRQVKLSV GR QRW KDYH D FDXVDO LQWHUSUHWDWLRQ

([HFXWLYH 6XPPDU\

xxii

)LJXUH (IIHFWVRI)RXUWK*UDGH5HDGLQJ3URGXFWVRQ6$75HDGLQJ6FRUH    

X

(IIHFW 6L]H

2YHUDOO6FRUH

9RFDEXODU\

6$75HDGLQJ7HVW

:RUG6WXG\6NLOOV

&RPSUHKHQVLRQ

1RWH1RQHRIWKHHIIHFWVLVVLJQLILFDQWO\GLIIHUHQWIURP]HURDWWKHOHYHO ;(VWLPDWHLVWRRVPDOOWRVKRZ

(IIHFWV RI 6L[WK *UDGH 0DWK 3URGXFWV 7KH VL[WK JUDGH VWXG\ LQFOXGHG WKUHH SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ  GLVWULFWV DQG  VFKRROV 7KH VDPSOH LQFOXGHG  WHDFKHUV DQG  VWXGHQWV 7KH WKUHH SURGXFWV ZHUH /DUVRQ 3UH$OJHEUD SXEOLVKHG E\ +RXJKWRQ0LIIOLQ $FKLHYH 1RZ SXEOLVKHG E\ 3ODWR DQG L/HDUQ 0DWK SXEOLVKHG E\ L/HDUQ 3URGXFWV SURYLGHG WXWRULDO DQG SUDFWLFH RSSRUWXQLWLHV DQG DVVHVVHG VWXGHQW VNLOOV 7RSLFV FRYHUHG LQFOXGH RSHUDWLRQV ZLWK IUDFWLRQV GHFLPDOV DQG SHUFHQWV SODQH DQG FRRUGLQDWH JHRPHWU\ UDWLRV UDWHV DQG SURSRUWLRQV RSHUDWLRQV ZLWK ZKROH QXPEHUV DQG LQWHJHUV SUREDELOLW\ DQG GDWD DQDO\VLV DQG PHDVXUHPHQW 7ZR SURGXFWV ZHUH VXSSOHPHQWV WR WKH PDWK FXUULFXOXP DQG RQH ZDV LQWHQGHG DV D FRUH FXUULFXOXP 7KH VWXG\ HVWLPDWHG WKH DYHUDJH OLFHQVLQJ IHHV IRU WKH SURGXFWV WR EH DERXW  D VWXGHQW IRU WKH VFKRRO \HDU ZLWK D UDQJH RI  WR  6WXGHQW XVDJH ZDV DERXW  KRXUV D \HDU RU DERXW  SHUFHQW RI PDWK LQVWUXFWLRQDO WLPH DFFRUGLQJ WR GDWD IURP SURGXFW UHFRUGV DYDLODEOH IRU WZR RI WKH WKUHH SURGXFWV ,Q FRQWURO FODVVURRPV WHDFKHUV UHSRUWHG DERXW  KRXUV RI XVH RI RWKHU WHFKQRORJ\ SURGXFWV ZKLFK ZDV PXFK OHVV WKDQ WKH  KRXUV RI VWXG\ SURGXFW XVDJH UHSRUWHG E\ WUHDWPHQW WHDFKHUV 6L[WK JUDGH PDWK SURGXFWV GLG QRW DIIHFW WHVW VFRUHV E\ DPRXQWV WKDW ZHUH VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR VHH )LJXUH  $V ZLWK RWKHU SURGXFWV WKH VWXG\ REVHUYHG ODUJH HIIHFWV EHWZHHQ VFKRROV +RZHYHU VWDWLVWLFDO WHVWV LQGLFDWHG WKDW WKH VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV PHDVXUHG LQ WKH VWXG\ ZHUH QRW UHODWHG WR WKH GLIIHUHQFHV LQ WHVW VFRUHV

([HFXWLYH 6XPPDU\

xxiii

)LJXUH (IIHFWVRI6L[WK*UDGH0DWK3URGXFWVRQ6$70DWK6FRUH  (IIHFW 6L]H   

2YHUDOO6FRUH

3URFHGXUHV 6$70DWK7HVW

3UREOHP6ROYLQJ

1RWH1RQHRIWKHHIIHFWVLVVLJQLILFDQWO\GLIIHUHQWIURP]HURDWWKHOHYHO

(IIHFWV RI $OJHEUD 3URGXFWV 7KH DOJHEUD VWXG\ LQFOXGHG WKUHH SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ  GLVWULFWV DQG  VFKRROV 7KH VDPSOH LQFOXGHG  FODVVURRPV DQG  VWXGHQWV 7KH WKUHH SURGXFWV ZHUH &RJQLWLYH 7XWRU $OJHEUD SXEOLVKHG E\ &DUQHJLH /HDUQLQJ 3ODWR $OJHEUD SXEOLVKHG E\ 3ODWR DQG /DUVRQ $OJHEUD SXEOLVKHG E\ +RXJKWRQ0LIIOLQ 3URGXFWV FRYHUHG D FRQYHQWLRQDO UDQJH RI DOJHEUD WRSLFV 7KH\ LQFOXGHG IXQFWLRQV OLQHDU HTXDWLRQV DQG LQHTXDOLWLHV TXDGUDWLF HTXDWLRQV OLQHDU H[SUHVVLRQV SRO\QRPLDOV DQG VR RQ 2QH SURGXFW FRQVWLWXWHG D IXOO FXUULFXOXP DQG WKH PDMRULW\ RI LWV DFWLYLWLHV ZHUH FDUULHG RXW LQ RIIOLQH FODVV SHULRGV 7KH RWKHU WZR ZHUH VXSSOHPHQWV WR WKH UHJXODU FXUULFXOXP 7KH VWXG\ HVWLPDWHG WKH DYHUDJH OLFHQVLQJ IHHV IRU WKH SURGXFWV WR EH DERXW  D VWXGHQW IRU WKH VFKRRO \HDU ZLWK D UDQJH RI  WR  3URGXFW UHFRUGV VKRZHG WKDW VWXGHQW XVDJH ZDV  KRXUV IRU WKH RYHUDOO VDPSOH HTXLYDOHQW WR DERXW  SHUFHQW RI PDWK LQVWUXFWLRQDO WLPH 8VDJH DYHUDJHG  WR  KRXUV GHSHQGLQJ RQ WKH SURGXFW $OJHEUD SURGXFWV GLG QRW DIIHFW WHVW VFRUHV E\ DPRXQWV WKDW ZHUH VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR VHH )LJXUH  $V ZLWK SURGXFWV LQ WKH RWKHU JUDGH OHYHOV WKH VWXG\ REVHUYHG ODUJH GLIIHUHQFHV LQ HIIHFWV EHWZHHQ VFKRROV EXW VWDWLVWLFDO WHVWV LQGLFDWHG WKDW WKH VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV PHDVXUHG LQ WKH VWXG\ ZHUH QRW UHODWHG WR WKHVH GLIIHUHQFHV
)LJXUH (IIHFWVRI$OJHEUD3URGXFWVRQ(76$OJHEUD([DP   (IIHFW  6L]H   

2YHUDOO

&RQFHSWV

3URFHVVHV

6NLOOV

1RWH1RQHRIWKHHIIHFWVLVVLJQLILFDQWO\GLIIHUHQWIURP]HURDWWKHOHYHO

([HFXWLYH 6XPPDU\

xxiv

6XPPDU\ &RQJUHVV SRVHG TXHVWLRQV DERXW WKH HIIHFWLYHQHVV RI HGXFDWLRQDO WHFKQRORJ\ DQG KRZ HIIHFWLYHQHVV LV UHODWHG WR FRQGLWLRQV DQG SUDFWLFHV 7KH VWXG\ LGHQWLILHG UHDGLQJ DQG PDWKHPDWLFV VRIWZDUH SURGXFWV EDVHG RQ SULRU HYLGHQFH RI HIIHFWLYHQHVV DQG RWKHU FULWHULD DQG UHFUXLWHG GLVWULFWV VFKRROV DQG WHDFKHUV WR LPSOHPHQW WKH SURGXFWV 2Q DYHUDJH DIWHU RQH \HDU SURGXFWV GLG QRW LQFUHDVH RU GHFUHDVH WHVW VFRUHV E\ DPRXQWV WKDW ZHUH VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR )RU ILUVW DQG IRXUWK JUDGH UHDGLQJ SURGXFWV WKH VWXG\ IRXQG VHYHUDO VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV WKDW ZHUH FRUUHODWHG ZLWK HIIHFWLYHQHVV LQFOXGLQJ VWXGHQWWHDFKHU UDWLRV IRU ILUVW JUDGH DQG WKH DPRXQW RI WLPH SURGXFWV ZHUH XVHG IRU IRXUWK JUDGH 7KH VWXG\ GLG QRW ILQG FKDUDFWHULVWLFV UHODWHG WR HIIHFWLYHQHVV IRU VL[WK JUDGH PDWK RU DOJHEUD 7KH VWXG\ DOVR IRXQG WKDW SURGXFWV FDXVHG WHDFKHUV WR EH OHVV OLNHO\ WR OHFWXUH DQG PRUH OLNHO\ WR IDFLOLWDWH ZKLOH VWXGHQWV XVLQJ UHDGLQJ RU PDWKHPDWLFV VRIWZDUH SURGXFWV ZHUH PRUH OLNHO\ WR EH ZRUNLQJ RQ WKHLU RZQ 7KH UHVXOWV UHSRUWHG KHUH DUH EDVHG RQ VFKRROV DQG WHDFKHUV ZKR ZHUH QRW XVLQJ WKH SURGXFWV LQ WKH SUHYLRXV VFKRRO \HDU :KHWKHU SURGXFWV DUH PRUH HIIHFWLYH ZKHQ WHDFKHUV KDYH PRUH H[SHULHQFH XVLQJ WKHP LV EHLQJ H[DPLQHG ZLWK D VHFRQG \HDU RI GDWD 7KH VWXG\ ZLOO LQYROYH WHDFKHUV ZKR ZHUH LQ WKH ILUVW GDWD FROOHFWLRQ WKRVH ZKR DUH WHDFKLQJ LQ WKH VDPH VFKRRO DQG DW WKH VDPH JUDGH OHYHO RU VXEMHFW DUHD DQG D QHZ JURXS RI VWXGHQWV 7KH VHFRQG\HDU VWXG\ ZLOO DOVR UHSRUW UHVXOWV VHSDUDWHO\ IRU WKH YDULRXV SURGXFWV

([HFXWLYH 6XPPDU\

&KDSWHU , ,QWURGXFWLRQ

Q WKH 1R &KLOG /HIW %HKLQG $FW RI  &RQJUHVV FDOOHG IRU D ULJRURXV VWXG\ RI WKH HIIHFWLYHQHVV RI HGXFDWLRQDO WHFKQRORJ\ IRU LPSURYLQJ VWXGHQW DFDGHPLF DFKLHYHPHQW 7KH FDOO IRU WKH VWXG\ ZDV FRQVLVWHQW ZLWK WKH JURZLQJ XVH RI FRPSXWHUV LQ FODVVURRPV GHPDQGV IRU DFFRXQWDELOLW\ LQ SXEOLF VSHQGLQJ DQG WKH $FWV HPSKDVLV RQ XVLQJ ULJRURXV UHVHDUFK PHWKRGV WR VWXG\ HIIHFWLYHQHVV 7KLV UHSRUW SUHVHQWV ILQGLQJV IURP WKH VWXG\V ILUVW \HDU RI SURGXFW LPSOHPHQWDWLRQ DQG GDWD FROOHFWLRQ ZKLFK FRUUHVSRQGHG WR WKH  VFKRRO \HDU $ 5HVHDUFK RQ WKH (IIHFWLYHQHVV RI 5HDGLQJ DQG 0DWKHPDWLFV 6RIWZDUH 8VH RI VRIWZDUH WR KHOS WHDFK UHDGLQJ DQG PDWKHPDWLFV VNLOOV LV FRPPRQ LQ $PHULFDQ VFKRROV ,Q WKH ODWH QLQHWLHV  SHUFHQW RI HOHPHQWDU\ VFKRRO WHDFKHUV UHSRUWHG XVLQJ VRIWZDUH SURGXFWV GHVLJQHG WR WHDFK (QJOLVK DQG ODQJXDJH DUWV VNLOOV 6LPLODUO\  SHUFHQW RI HOHPHQWDU\ VFKRRO WHDFKHUV  SHUFHQW RI PLGGOH VFKRRO WHDFKHUV DQG  SHUFHQW RI KLJK VFKRRO WHDFKHUV UHSRUWHG XVLQJ SURGXFWV GHVLJQHG WR WHDFK PDWK VNLOOV $QGHUVRQ DQG 5RQQNYLVW  2YHU WKH SDVW WZR GHFDGHV QXPHURXV VWXGLHV FRPSDULQJ FRPSXWHUEDVHG DQG FRQYHQWLRQDO LQVWUXFWLRQ LQ UHDGLQJ DQG PDWKHPDWLFV KDYH EHHQ FRQGXFWHG %RWK TXDOLWDWLYH UHVHDUFK V\QWKHVHV 6FKDFWHU  6LYLQ.DFKDOD  DQG IRUPDO PHWDDQDO\VHV RI WKHVH VWXGLHV %ORN HW DO  .XOLN DQG .XOLN  .XOLN  .XOLN  0XUSK\ HW DO  3HDUVRQ HW DO  :D[PDQ HW DO  IRXQG WKDW FRPSXWHUDVVLVWHG LQVWUXFWLRQ LQ UHDGLQJ DQG PDWKHPDWLFV JHQHUDOO\ KDG D SRVLWLYH HIIHFW .XOLNV  PHWDDQDO\VLV IRU H[DPSOH IRXQG D SRVLWLYH HIIHFW RQ ILQDO H[DPLQDWLRQ VFRUHV WKH HIIHFW VL]HWKH HIIHFW DV D SURSRUWLRQ RI WKH VWDQGDUG GHYLDWLRQ RI H[DPLQDWLRQ VFRUHVZDV  0XUSK\ HW DO  H[DPLQHG D ZLGH UDQJH RI UHVHDUFK VWXGLHV IURP WKH SXEOLVKHG OLWHUDWXUH DQG IURP VRIWZDUH YHQGRUV 2I WKH  H[SHULPHQWDO RU TXDVLH[SHULPHQWDO VWXGLHV FRQGXFWHG EHWZHHQ  DQG  WKDW PHW WKH FULWHULD IRU LQFOXVLRQ  VWXGLHV PHW PLQLPXP PHWKRGRORJLFDO UHTXLUHPHQWV IRU LQFOXVLRQ LQ WKH V\QWKHVLV )RU WKHVH VWXGLHV UHVHDUFKHUV HVWLPDWHG DQ DYHUDJH HIIHFW VL]H RI  IRU UHDGLQJ DQG  IRU PDWKHPDWLFV

2 'HVSLWH WKH IDLUO\ VL]DEOH QXPEHU RI VWXGLHV DQG JHQHUDOO\ SRVLWLYH ILQGLQJV PHWD DQDO\VWV KDYH QRWHG WKDW PDQ\ VWXGLHV FRQWDLQHG ZHDNQHVVHV RU GHVLJQ IODZV 0XUSK\ HW DO  3HDUVRQ HW DO  2I WKH WHFKQRORJ\ VWXGLHV UHYLHZHG E\ :D[PDQ HW DO  IRU H[DPSOH KDOI KDG VDPSOH VL]HV RI IHZHU WKDQ  VWXGHQWV 0DQ\ VWXGLHV KDG QR FRQWURO JURXSV RU HTXLYDOHQW FRPSDULVRQ JURXSV OHDGLQJ WR TXHVWLRQDEOH YDOLGLW\ IRU FODLPV RI HIIHFWV 6WXGLHV ZLWK VWURQJHU UHVHDUFK GHVLJQV VKRZHG VPDOOHU HIIHFWV 3HDUVRQ HW DO  6HYHUDO UHFHQW H[SHULPHQWDO VWXGLHV H[DPLQHG SURGXFW HIIHFWLYHQHVV DQG UHDFKHG GLIIHUHQW FRQFOXVLRQV 5RXVH DQG .UXHJHU  HYDOXDWHG WKH HIIHFWLYHQHVV RI )DVW )RU:RUG D VRIWZDUH DSSOLFDWLRQ EDVHG RQ D VHW RI H[HUFLVHV WKDW QHXURVFLHQWLVWV KDG IRXQG WR SURGXFH GUDPDWLF UHDGLQJ JDLQV IRU VRPH FKLOGUHQ 0HU]HQLFK HW DO  7DOODO HW DO  5RXVH DQG .UXHJHU IRXQG D VPDOO SRVLWLYH HIIHFW IRU )DVW )RU:RUG RQ D FRPSXWHUEDVHG PHDVXUH RI ODQJXDJH VNLOOV EXW QR HIIHFW RQ UHDGLQJ DFKLHYHPHQW PHDVXUHG XVLQJ D VWDQGDUGL]HG WHVW ,Q FRQWUDVWLQJ WKHLU ILQGLQJV ZLWK SUHYLRXVO\ UHSRUWHG ILQGLQJV 5RXVH DQG .UXHJHU QRWHG SUREOHPV LQ WKH GHVLJQ RI D VWXG\ E\ UHVHDUFKHUV DIILOLDWHG ZLWK WKH FRPSDQ\ WKDW GLVWULEXWHV )DVW )RU:RUG ,Q WKDW VWXG\ VWXGHQWV ZHUH DVVLJQHG UDQGRPO\ WR WKH WUHDWPHQW JURXS RU D FRQWURO JURXS 0LOOHU HW DO  EXW VWXGHQWV ZKR GLG QRW FRPSOHWH WKH WUHDWPHQW EDVHG RQ D GHILQLWLRQ RI FRPSOHWLRQ SURYLGHG E\ WKH SURGXFW YHQGRU ZHUH GURSSHG IURP WKH VDPSOH WKHUHE\ LQYDOLGDWLQJ LWV H[SHULPHQWDO GHVLJQ ,Q FRQWUDVW D UDQGRPL]HG ILHOG WULDO RI $OJHEUD &RJQLWLYH 7XWRU UHSRUWHG SRVLWLYH UHVXOWV 0RUJDQ DQG 5LWWHU  ,Q WKH VWXG\ HLJKW MXQLRU KLJK WHDFKHUV WDXJKW VRPH RI WKHLU FODVVHV XVLQJ WKH &RJQLWLYH 7XWRU DQG VRPH XVLQJ WKHLU WUDGLWLRQDO WH[WERRN 6WXGHQWV LQ WKH &RJQLWLYH 7XWRU FODVVHV VFRUHG KLJKHU RQ DQ HQGRIFRXUVH DOJHEUD WHVW GHYHORSHG E\ (GXFDWLRQDO 7HVWLQJ 6HUYLFH DQG DOVR UHFHLYHG KLJKHU FRXUVH JUDGHV 6LPLODUO\ 1XQQHU\ HW DO  IRXQG SRVLWLYH HIIHFWV IRU $FFHOHUDWHG 5HDGHU D VRIWZDUH SURGXFW WKDW UHFRPPHQGV UHDGLQJ PDWHULDO DW D OHYHO DSSURSULDWH IRU WKH LQGLYLGXDO VWXGHQW DQG SURYLGHV FRPSXWHUEDVHG TXL]]HV WHVWLQJ VWXGHQW FRPSUHKHQVLRQ RI WKH UHFRPPHQGHG PDWHULDOV 7KH VWXG\ UDQGRPO\ DVVLJQHG  WHDFKHUV IURP QLQH HOHPHQWDU\ VFKRROV LQ D ODUJH XUEDQ GLVWULFW WR XVH WKH SURGXFW RU WR D FRQWURO FRQGLWLRQ 7KXV ZKLOH D SUHSRQGHUDQFH RI UHVHDUFK RQ WKH HIIHFWLYHQHVV RI UHDGLQJ DQG PDWK VRIWZDUH VXJJHVWV SRVLWLYH HIIHFWV PDQ\ VWXGLHV KDYH EHHQ VPDOO PHWKRGRORJLFDOO\ IODZHG RU VSRQVRUHG E\ DQ RUJDQL]DWLRQ ZLWK DQ LQWHUHVW LQ WKH RXWFRPH 0RUH UHFHQW VWXGLHV XVLQJ ULJRURXV GHVLJQV KDYH \LHOGHG PL[HG ILQGLQJV $JDLQVW WKLV EDFNGURS D ODUJHVFDOH VWXG\ RI HGXFDWLRQDO WHFKQRORJ\ SURGXFWV FDQ SURYLGH XVHIXO LQIRUPDWLRQ DERXW WKHLU HIIHFWLYHQHVV % 'HVLJQ RI WKH 1DWLRQDO 6WXG\ ,Q IDOO  WKH 86 'HSDUWPHQW RI (GXFDWLRQ (' EHJDQ ZRUNLQJ ZLWK 0DWKHPDWLFD 3ROLF\ 5HVHDUFK ,QF 035 DQG LWV SDUWQHUV WR GHVLJQ WKH QDWLRQDO VWXG\ FDOOHG IRU E\ &RQJUHVV .H\ UHFRPPHQGDWLRQV IURP WKH GHVLJQ HIIRUW ZHUH WR IRFXV WKH QDWLRQDO VWXG\ RQ JUDGHV . LQ VFKRROV WKDW VHUYHG ODUJH SHUFHQWDJHV RI VWXGHQWV LQ SRYHUW\ WR IRFXV RQ WKH UHDGLQJ DQG PDWK VXEMHFW DUHDV DQG WR XVH VWDQGDUGL]HG WHVW VFRUHV WR PHDVXUH HIIHFWLYHQHVV $JRGLQL HW DO  7KH GHVLJQ HIIRUW DOVR UHFRPPHQGHG WKDW D SXEOLF VXEPLVVLRQV SURFHVV , ,QWURGXFWLRQ

3 EH XVHG WR VHOHFW WKH WHFKQRORJ\ SURGXFWV LQFOXGHG LQ WKH HYDOXDWLRQ 7KH VWXG\V PDLQ IHDWXUHV DUH VXPPDUL]HG LQ WKH DFFRPSDQ\LQJ ER[ 7KH OHJLVODWLRQ FDOOHG IRU WKH VWXG\ WR KDYH FRQWURO JURXSV RU FRQWURO FRQGLWLRQV ZKLFK FRQVLVWHQW ZLWK FXUUHQW SUDFWLFH ZDV LQWHUSUHWHG WR PHDQ WKDW WKH VWXG\ VKRXOG XVH DQ H[SHULPHQWDO GHVLJQ 7KH VWXG\ XVHG D GHVLJQ LQ ZKLFK WHDFKHUV ZKR ZHUH QRW XVLQJ RQH RI WKH VWXG\V WHFKQRORJ\ SURGXFWV YROXQWHHUHG WR SDUWLFLSDWH LQ WKH VWXG\ :LWKLQ HDFK VFKRRO WKHVH WHDFKHUV ZHUH WKHQ UDQGRPO\ DVVLJQHG WR HLWKHU D WUHDWPHQW JURXS WKDW KDG DFFHVV WR WKH DVVLJQHG SURGXFW RU WR D FRQWURO JURXS WKDW XVHG WKHLU FRQYHQWLRQDO WHDFKLQJ DSSURDFKHV 7KH H[SHULPHQWDO GHVLJQ ZDV WKH EDVLV IRU DQVZHULQJ WKH VWXG\V PDLQ TXHVWLRQ 'R VWXGHQWV DFKLHYH PRUH ZKHQ WHDFKHUV DUH DEOH WR XVH WKH VHOHFWHG WHFKQRORJ\ SURGXFWV WKDQ ZKHQ WKH\ GR QRW" %HFDXVH WKH RQO\ GLIIHUHQFH RQ DYHUDJH EHWZHHQ JURXSV LV ZKHWKHU WHDFKHUV ZHUH DVVLJQHG WR XVH SURGXFWV VHOHFWHG IRU WKH VWXG\ VFRUH GLIIHUHQFHV FRXOG EH DWWULEXWHG DV HIIHFWV RI WKH SURGXFWV DIWHU DFFRXQWLQJ IRU VDPSOLQJ YDULDELOLW\ 6FRUH GLIIHUHQFHV FRXOG EH DIIHFWHG E\ ZKHWKHU FRQWURO JURXS WHDFKHUV XVHG RWKHU WHFKQRORJ\ SURGXFWV WKDW ZHUH QRW DPRQJ WKRVH VHOHFWHG IRU WKH VWXG\ DQ LVVXH WKDW ZDV UHFRJQL]HG LQ WKH GHVLJQ DQG ZLOO EH DGGUHVVHG LQ WKH DQDO\VLV 7KH VWXG\V PDLQ TXHVWLRQ LV HTXLYDOHQW WR WKH TXHVWLRQ IDFHG E\ VFKRRO GLVWULFWV ZDQWLQJ WR UDLVH VWXGHQW WHVW VFRUHV DQG FRQVLGHULQJ LQYHVWLQJ LQ D WHFKQRORJ\ SURGXFW WR GR VR 'RHV SXUFKDVLQJ WKH SURGXFW OHDG WR KLJKHU VFRUHV" 7KH VWXG\ WHVWHG ZKHWKHU VWXGHQWV LQ FODVVURRPV RI WUHDWPHQW JURXS WHDFKHUV ZKR ZHUH DEOH WR XVH SURGXFWV VHOHFWHG WR EH LQ WKH VWXG\ SHUIRUPHG EHWWHU RU ZRUVH WKDQ VWXGHQWV LQ FODVVURRPV RI FRQWURO JURXS WHDFKHUV ZKR ZHUH QRW DEOH WR XVH WKRVH SDUWLFXODU SURGXFWV EXW PD\ KDYH XVHG RWKHU SURGXFWV ,Q

6WXG\ 'HVLJQ ,QWHUYHQWLRQ 6L[WHHQ SURGXFWV ZHUH VHOHFWHG E\ (' EDVHG RQ SXEOLF VXEPLVVLRQV DQG UDWLQJV E\ WKH VWXG\ WHDP DQG H[SHUW UHYLHZ SDQHOV 3URGXFWV ZHUH JURXSHG LQWR IRXU DUHDV ILUVW JUDGH UHDGLQJ IRXUWK JUDGH UHDGLQJ VL[WK JUDGH PDWK DQG DOJHEUD 3DUWLFLSDQWV 7KLUW\WKUHH GLVWULFWV  VFKRROV DQG  WHDFKHUV SDUWLFLSDWHG LQ WKH VWXG\ ,Q ILUVW JUDGH  GLVWULFWV  VFKRROV DQG  WHDFKHUV SDUWLFLSDWHG ,Q IRXUWK JUDGH  GLVWULFWV  VFKRROV DQG  WHDFKHUV SDUWLFLSDWHG ,Q VL[WK JUDGH  GLVWULFWV  VFKRROV DQG  WHDFKHUV YROXQWHHUHG DQG IRU DOJHEUD  GLVWULFWV  VFKRROV DQG  WHDFKHUV SDUWLFLSDWHG 'LVWULFWV DQG VFKRROV FRXOG SDUWLFLSDWH LQ WKH VWXG\ DW PRUH WKDQ RQH JUDGH OHYHO DQG VRPH GLG 'LVWULFWV ZHUH UHFUXLWHG RQ WKH EDVLV WKDW WKH\ GLG QRW DOUHDG\ XVH WHFKQRORJ\ SURGXFWV WKDW ZHUH VLPLODU WR VWXG\ SURGXFWV LQ SDUWLFLSDWLQJ VFKRROV 5HVHDUFK 'HVLJQ :LWKLQ HDFK VFKRRO WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG WR EH DEOH WR XVH WKH VWXG\ SURGXFW WKH WUHDWPHQW JURXS RU QRW WKH FRQWURO JURXS &RQWURO JURXS WHDFKHUV ZHUH DEOH WR XVH RWKHU WHFKQRORJ\ SURGXFWV WKDW PD\ KDYH EHHQ LQ WKHLU FODVVURRPV 7KH VWXG\ DGPLQLVWHUHG WHVWV WR VWXGHQWV LQ ERWK W\SHV RI FODVVURRPV QHDU WKH EHJLQQLQJ DQG HQG RI WKH VFKRRO \HDU 7KH VWXG\ DOVR REVHUYHG WUHDWPHQW DQG FRQWURO FODVVURRPV WKUHH WLPHV GXULQJ WKH VFKRRO \HDU DQG FROOHFWHG GDWD IURP WHDFKHU TXHVWLRQQDLUHV DQG LQWHUYLHZV VWXGHQW UHFRUGV DQG SURGXFW UHFRUGV 2XWFRPHV $QDO\]HG 6WXGHQW WHVW VFRUHV FODVVURRP DFWLYLWLHV DQG UROHV RI WHDFKHUV DQG VWXGHQWV

, ,QWURGXFWLRQ

4 DGRSWLQJ WKLV DSSURDFK WKH QDWLRQDO VWXG\V GHVLJQ HVVHQWLDOO\ LV VLPLODU WR WKH GHVLJQV RI PDQ\ VWXGLHV RI SURGXFW HIIHFWLYHQHVV FLWHG DERYH 7KH VWXG\ WHVWV ZKHWKHU VHOHFWHG UHDGLQJ DQG PDWKHPDWLFV SURGXFWV DUH HIIHFWLYH ZKHQ GLVWULFWV YROXQWHHU WR SDUWLFLSDWH DQG VFKRROV DQG WHDFKHUV YROXQWHHU WR LPSOHPHQW SURGXFWV 7KH YROXQWDU\ DVSHFW RI WKH VWXG\ DQG WKH IDFW WKDW GLVWULFWV DQG VFKRROV ZHUH SDUWLFLSDWLQJ LQ D VWXG\ PD\ LQWURGXFH D GLIIHUHQFH EHWZHHQ PHDVXUHG HIIHFWLYHQHVV UHSRUWHG E\ WKH VWXG\ HIIHFWLYHQHVV LQ DFWXDO XVH DQG HIIHFWLYHQHVV UHSRUWHG E\ RWKHU VWXGLHV )RU H[DPSOH HIIHFWLYHQHVV DV PHDVXUHG E\ WKLV VWXG\ PLJKW EH KLJKHU WKDQ HIIHFWLYHQHVV LQ DFWXDO XVH EHFDXVH VFKRROV DQG WHDFKHUV YROXQWHHUHG IRU WKH VWXG\ DQG WKH VWXG\ DOVR SXUFKDVHG VRIWZDUH DQG KDUGZDUH IRU FODVVURRPV DQG VFKRROV ZKHQ XSJUDGHV ZHUH QHHGHG IRU SURGXFWV WR RSHUDWH ,Q DFWXDO XVH SURGXFWV PLJKW EH SODFHG LQ FODVVURRPV RI WHDFKHUV ZKR GR QRW ZDQW WR XVH WKHP DQG PD\ QRW XVH WKHP HIIHFWLYHO\ ZKLFK SUHVXPDEO\ ZRXOG LPSO\ ORZHU OHYHOV RI HIIHFWLYHQHVV (IIHFWLYHQHVV DV PHDVXUHG E\ WKH VWXG\ PLJKW EH ORZHU WKDQ HIIHFWLYHQHVV UHSRUWHG E\ RWKHU VWXGLHV EHFDXVH SURGXFWV ZHUH LPSOHPHQWHG E\ WHDFKHUV ZKR KDG QRW XVHG WKHVH SURGXFWV EHIRUH $V ODWHU FKDSWHUV QRWH VRPH VFKRROV DQG FODVVURRPV HQFRXQWHUHG YDULRXV GLIILFXOWLHV LQ VWDUWLQJ WR XVH RU FRQWLQXLQJ WR XVH SURGXFWV 7HDFKHUV FRXOG VWRS XVLQJ SURGXFWV RU UHGXFH WKHLU XVH LI WHDFKHUV EHOLHYHG SURGXFWV ZHUH LQHIIHFWLYH RU GLIILFXOW WR XVH RU WKH\ FRXOG XVH SURGXFWV LQ ZD\V WKDW YHQGRUV PD\ QRW KDYH LQWHQGHG RU SUHGLFWHG 7HDFKHUV LQ FRQWURO FODVVURRPV GLG QRW KDYH DFFHVV WR SURGXFWV LQ WKH VWXG\ EXW FRXOG XVH FRPSXWHUV LQ RWKHU ZD\V VXFK DV IRU ZHE EURZVLQJ IRU RIILFHUHODWHG IXQFWLRQV DQG WR RSHUDWH RWKHU SURGXFWV /DWHU FKDSWHUV DQDO\]H WKH H[WHQW WR ZKLFK WKH\ GLG VR (IIHFWLYHQHVV DV PHDVXUHG E\ WKH VWXG\ PLJKW EH ORZHU WKDQ ZKDW KDV EHHQ UHSRUWHG E\ RWKHU VWXGLHV EHFDXVH WKLV VWXG\ XVHG DQ H[SHULPHQWDO GHVLJQ %HFDXVH WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG DV SDUW RI WKH H[SHULPHQW IDFWRUV WKDW PD\ KDYH SUHGLVSRVHG WHDFKHUV WR XVH SURGXFWV PRUH HIIHFWLYHO\ DQG WKDW FRQIRXQG DFWXDO HIIHFWLYHQHVV ZLWK WHDFKHU FKDUDFWHULVWLFV DUH FRQWUROOHG E\ WKH H[SHULPHQWDO GHVLJQ 6HOHFWLQJ 3URGXFWV IRU WKH (YDOXDWLRQ ,Q IDOO  GHYHORSHUV DQG YHQGRUV RI HGXFDWLRQDO WHFKQRORJ\ SURGXFWV UHVSRQGHG WR D SXEOLF LQYLWDWLRQ DQG VXEPLWWHG SURGXFWV IRU SRVVLEOH LQFOXVLRQ LQ WKH QDWLRQDO VWXG\ 035 VWDII VHOHFWHG  RI WKH  VXEPLVVLRQV IRU IXUWKHU UHYLHZ E\ WZR SDQHOV RI RXWVLGH H[SHUWV RQH IRU UHDGLQJ SURGXFWV DQG RQH IRU PDWK SURGXFWV 7KH WKUHH PDLQ FULWHULD RI WKH UHYLHZV ZHUH ZKHWKHU WKH SURGXFW KDG HYLGHQFH RI HIIHFWLYHQHVV DQG UHODWHG WR WKLV WKH YDOLGLW\ RI WKH HYLGHQFH ZKHWKHU WKH SURGXFW ZDV DEOH WR RSHUDWH RQ D QDWLRQDO VFDOH DQG ZKHWKHU SURGXFW GHYHORSHUV FRXOG WUDLQ DQ DGHTXDWH QXPEHU RI WHDFKHUV IRU WKH QDWLRQDO VWXG\V
$QRWKHU SRVVLEOH WHVW RI WHFKQRORJ\V HIIHFWLYHQHVV ZRXOG EH WR LQWURGXFH FRPSXWHUV WKH KDUGZDUH SDUW RI HGXFDWLRQDO WHFKQRORJ\ LQ FODVVURRPV DQG DVVHVV ZKHWKHU WHVW VFRUHV RU RWKHU PHDVXUHV RI VWXGHQW OHDUQLQJ LQFUHDVH $QVZHULQJ WKLV TXHVWLRQ ZRXOG KDYH UHTXLUHG IRFXVLQJ WKH VWXG\ RQ WKH VPDOO QXPEHU RI VFKRROV DQG FODVVURRPV WKDW KDG QRW \HW LQWURGXFHG FRPSXWHUV ZKLFK ZRXOG UHGXFH WKH VWXG\V UHOHYDQFH WR WKH PXFK ODUJHU QXPEHU RI VFKRROV WKDW DOUHDG\ XVHG FRPSXWHUV
1

, ,QWURGXFWLRQ

5 VDPSOH VL]HV 7KH SDQHOV GLG QRW UHYLHZ DQG FRPSDUH WKH LQVWUXFWLRQDO IHDWXUHV RI WKH SURGXFWV 035 LQIRUPHG WKH SDQHO PHPEHUV WKDW WKH\ ZHUH QRW OLPLWHG WR 035V OLVW RI  SURGXFWV EXW FRXOG UHYLHZ DQ\ RI WKH  VXEPLVVLRQV ,Q -DQXDU\  (' FRQVLGHUHG WKH SDQHOV UHFRPPHQGDWLRQV DQG VHOHFWHG  SURGXFWV IRU WKH VWXG\ ,Q VHOHFWLQJ SURGXFWV (' JURXSHG WKHP LQWR IRXU DUHDV  HDUO\ UHDGLQJ ILUVW JUDGH  UHDGLQJ FRPSUHKHQVLRQ IRXUWK JUDGH  SUHDOJHEUD VL[WK JUDGH DQG  DOJHEUD QLQWK JUDGH 7KH SURGXFWV UDQJHG ZLGHO\ LQ WKHLU LQVWUXFWLRQDO DSSURDFKHV DQG KRZ ORQJ WKH\ KDG EHHQ LQ XVH ,Q JHQHUDO KRZHYHU WKH FULWHULD ZHLJKWHG WKH VHOHFWLRQ WRZDUG SURGXFWV WKDW KDG HYLGHQFH RI HIIHFWLYHQHVV IURP SUHYLRXV UHVHDUFK RU IRU QHZHU SURGXFWV HYLGHQFH WKDW WKHLU GHVLJQV ZHUH EDVHG RQ DSSURDFKHV IRXQG WR EH HIIHFWLYH E\ UHVHDUFK 7ZHOYH RI WKH  SURGXFWV KDG UHFHLYHG DZDUGV RU EHHQ QRPLQDWHG IRU DZDUGV VRPH DV UHFHQWO\ DV  E\ WUDGH DVVRFLDWLRQV PHGLD WHDFKHUV RU SDUHQWV 7KH VWXG\ GLG QRW GHWHUPLQH WKH WRWDO QXPEHU RI VFKRROV WHDFKHUV DQG VWXGHQWV FXUUHQWO\ XVLQJ WKH SURGXFWV ,Q WKH VXEPLVVLRQ SURFHVV (' LQIRUPHG GHYHORSHUV WKDW WKH VWXG\ ZRXOG IRFXV RQ WKH DYHUDJH HIIHFWLYHQHVV RI UHDGLQJ DQG PDWKHPDWLFV VRIWZDUH SURGXFWV UDWKHU WKDQ RQ WKH HIIHFWLYHQHVV RI LQGLYLGXDO SURGXFWV 7KH LQWHQW ZDV WR PHDVXUH ZKHWKHU WHFKQRORJ\ DV UHSUHVHQWHG E\ WKH VHOHFWHG UHDGLQJ DQG PDWKHPDWLFV VRIWZDUH SURGXFWV LPSURYHG DFDGHPLF DFKLHYHPHQW UDWKHU WKDQ KRZ LQGLYLGXDO SURGXFWV LQFUHDVHG DFKLHYHPHQW 7KH PDLQ ILQGLQJV IURP WKH QDWLRQDO VWXG\ ZHUH WR EH EDVHG RQ WKH FRPELQHG SURGXFW UHVXOWV DW HDFK RI WKH IRXU JUDGH OHYHOV 7KH YROXQWDU\ DVSHFW RI FRPSDQ\ SDUWLFLSDWLRQ LQ WKH VWXG\ PHDQW WKDW SURGXFWV PD\ QRW EH D UHSUHVHQWDWLYH VDPSOLQJ RI UHDGLQJ DQG PDWK WHFKQRORJ\ SURGXFWV WKDW VFKRROV FRXOG SXUFKDVH RU XVH 1RW DOO SURGXFWV ZHUH VXEPLWWHG IRU SRWHQWLDO LQFOXVLRQ LQ WKH VWXG\ DQG PRVW SURGXFWV WKDW ZHUH VXEPLWWHG ZHUH QRW VHOHFWHG 3URGXFWV WKDW ZHUH VHOHFWHG PD\ KDYH EHHQ PRUH HIIHFWLYH WKDQ WKH DYHUDJH SURGXFW EHFDXVH VHOHFWHG SURGXFWV ZHUH DEOH WR SURYLGH DW OHDVW VRPH HYLGHQFH RI HIIHFWLYHQHVV IURP SUHYLRXV UHVHDUFK RU D SURRI RI FRQFHSW (' UHFRJQL]HG WKDW VHOHFWLQJ RVWHQVLEO\ PRUH HIIHFWLYH SURGXFWV SRVVLEO\ WLOWHG WKH VWXG\ WRZDUG ILQGLQJ KLJKHU OHYHOV RI HIIHFWLYHQHVV EXW WKH WLOW ZDV YLHZHG DV D UHDVRQDEOH WUDGHRII WR DYRLG LQYHVWLQJ WKH VWXG\V UHVRXUFHV LQ SURGXFWV WKDW KDG OLWWOH RU QR HYLGHQFH RI HIIHFWLYHQHVV & 5HFUXLWLQJ 'LVWULFWV DQG 6FKRROV IRU WKH 6WXG\ 6DPSOH VL]H WDUJHWV ZHUH VHW VR WKDW WKH VWXG\ FRXOG GHWHFW DQ HIIHFW VL]H RQ WHVW VFRUHV RI DW OHDVW  DW HDFK RI LWV IRXU JUDGH OHYHOV $JRGLQL HW DO  7KLV WDUJHW HIIHFW VL]H ZDV D EDODQFH EHWZHHQ WKH GHVLUH IRU LQWHUYHQWLRQV WR VXEVWDQWLDOO\ FORVH DFKLHYHPHQW JDSV DQG WKH UHDOLW\ WKDW IHZ ODUJHVFDOH HGXFDWLRQ HYDOXDWLRQV KDYH IRXQG HIIHFWV ODUJHU WKDQ WKH

$OWKRXJK PDQ\ VWXGHQWV WDNH DOJHEUD LQ WKHLU ILUVW \HDU RI KLJK VFKRRO GLVWULFWV LQFUHDVLQJO\ DUH PRYLQJ WR KDYH VWXGHQWV WDNH DOJHEUD LQ HLJKWK JUDGH 6WXGHQWV LQ XSSHU \HDUV RI KLJK VFKRRO DOVR FDQ WDNH DOJHEUD

, ,QWURGXFWLRQ

6 WDUJHW 7KH WHDP HVWLPDWHG WKDW WKH VWXG\ QHHGHG WR LQFOXGH DERXW  VFKRROV 7KHVH VFKRROV LW ZDV HVWLPDWHG ZRXOG \LHOG  FODVVURRPV  LQ HDFK JUDGH OHYHO $VVXPLQJ D WHDFKHU KDG DQ DYHUDJH RI  VWXGHQWV WKH VDPSOH VL]H WDUJHW ZDV  LQ HDFK JUDGH OHYHO 7R EH FRQVLVWHQW ZLWK WKH 1R &KLOG /HIW %HKLQG OHJLVODWLRQ DQG WR VXSSRUW RWKHU VWXG\ REMHFWLYHV WKH VWXG\ XVHG WKUHH FULWHULD WR LGHQWLI\ SRWHQWLDO GLVWULFWV DQG VFKRROV  JHRJUDSKLFDO GLYHUVLW\  KLJK SRYHUW\ UDWHV DQG  HQRXJK WHDFKHUV YROXQWHHULQJ IRU WKH VWXG\ $V D JHQHUDO JXLGHOLQH WKH VWXG\ ZDQWHG JHRJUDSKLFDOO\ GLYHUVH GLVWULFWV 7KH VWXG\ DOVR ZDQWHG GLVWULFWV WKDW KDG VL[ RU PRUH VFKRROV UHFHLYLQJ 7LWOH , IXQGV DQG ZLWKLQ GLVWULFWV VFKRROV WKDW KDG KLJK SRYHUW\ UDWHV 'LVFUHWLRQ ZDV H[HUFLVHG IRU VPDOO GLVWULFWV ZKLFK PD\ KDYH KDG IHZHU WKDQ VL[ VFKRROV 7KH SRYHUW\ UDWH RI D VFKRRO ZDV QRW WKH RQO\ IDFWRU FRQVLGHUHG EHFDXVH VRPH VFKRROV ZLWK KLJK SRYHUW\ UDWHV PD\ KDYH EHHQ LQDSSURSULDWH IRU RWKHU UHDVRQV VXFK DV D ODFN RI WHFKQRORJ\ LQIUDVWUXFWXUH RU D ODFN RI LQWHUHVW LQ SDUWLFLSDWLQJ LQ WKH VWXG\ 6FKRROV DOVR QHHGHG WR KDYH DW OHDVW WZR YROXQWHHULQJ WHDFKHUV DW WKH DSSURSULDWH JUDGH RU VXEMHFW VR WKDW UDQGRP DVVLJQPHQW RI WHDFKHUV ZLWKLQ HDFK VFKRRO FRXOG EH LPSOHPHQWHG ,Q )HEUXDU\  WKH VWXG\ VWDII EHJDQ FRQWDFWLQJ VFKRRO GLVWULFWV WR OHDUQ ZKHWKHU WKH\ ZHUH LQWHUHVWHG LQ SDUWLFLSDWLQJ LQ WKH VWXG\ DQG PHW WKH VWXG\ FULWHULD 'HYHORSHUV QRPLQDWHG DERXW  SHUFHQW RI WKH DOPRVW  GLVWULFWV WKDW WKH VWXG\ WHDP FRQWDFWHG 2WKHU QRPLQDWLRQV FDPH IURP SUHYLRXV FRQWDFWV ZLWK WKH VWXG\ WHDP DQG IURP VHOIQRPLQDWLRQV E\ GLVWULFWV DQG VFKRROV WKDW KDG OHDUQHG DERXW WKH VWXG\ IURP DUWLFOHV LQ WKH PHGLD 6WXG\ VWDII YLVLWHG PRVW RI WKH GLVWULFWV WKDW H[SUHVVHG LQWHUHVW LQ SDUWLFLSDWLQJ LQ WKH VWXG\ WR GHVFULEH LW DQG WR DQVZHU TXHVWLRQV ,Q LQWHUHVWHG GLVWULFWV DGPLQLVWUDWRUV ZRUNHG ZLWKLQ WKH GLVWULFW WR LGHQWLI\ VFKRROV VXLWDEOH IRU WKH VWXG\ $V QRWHG DERYH WKH VWXG\ FRQVLGHUHG VFKRROV WR EH PRUH GHVLUDEOH IRU WKH VWXG\ LI WKHLU WHDFKHUV ZHUH QRW DOUHDG\ XVLQJ WKH UHDGLQJ DQG PDWKHPDWLFV VRIWZDUH SURGXFWV LQ WKH VWXG\ RU FORVH VXEVWLWXWHV IRU WKHP &ODVVURRPV LQ ZKLFK WKHUH ZHUH ORZLQWHQVLW\ FRPSXWHU XVHV VXFK DV ZRUG SURFHVVLQJ RU ZHE EURZVLQJ ZHUH PRUH GHVLUDEOH EHFDXVH WKH LQWURGXFWLRQ RI D VWXG\ SURGXFW ZRXOG LQFUHDVH WKH LQWHQVLW\ RI WHFKQRORJ\ EHLQJ XVHG IRU LQVWUXFWLRQ /DWHU FKDSWHUV UHSRUW PXFK ORZHU UDWHV RI FRPSXWHU XVH LQ WKH FRQWURO JURXS WKDQ WKH WUHDWPHQW JURXS FRQVLVWHQW ZLWK WKLV DSSURDFK IRU LGHQWLI\LQJ DSSURSULDWH VFKRROV 7KRXJK VFKRROV WKDW SDUWLFLSDWHG LQ WKH VWXG\ ZHUH QRW XVLQJ WKH SURGXFWV VHOHFWHG IRU WKH VWXG\ WHDFKHUV WKDW SDUWLFLSDWHG LQ WKH VWXG\ PD\ KDYH XVHG SURGXFWV LQ WKH SDVW RU DW VRPH RWKHU VFKRRO 7KH VWXG\ GLG QRW JDWKHU GDWD DERXW WKH IUHTXHQF\ RI WHDFKHUV ZLWK SUHYLRXV H[SHULHQFHV XVLQJ SURGXFWV 7KH VWXG\ DVVXPHG WKDW GLVWULFWV ZRXOG LPSOHPHQW RQO\ RQH SURGXFW EXW DERXW D WKLUG HOHFWHG WR LPSOHPHQW PRUH WKDQ RQH %HFDXVH WKH IRXU JUDGH OHYHOV HVVHQWLDOO\ IRUP VHSDUDWH VXEVWXGLHV KDYLQJ WKH VDPH GLVWULFW LPSOHPHQW PRUH WKDQ RQH SURGXFW GLG QRW FDXVH D SUREOHP IRU WKH VWXG\ DQG LW FUHDWHG VRPH FRVW HIILFLHQFLHV EHFDXVH GDWD FROOHFWLRQ ZDV PRUH
7KH WDUJHW HIIHFW VL]H LV FRQVLVWHQW ZLWK WKH VWXGLHV QRWHG DERYH $ UHSRUW IURP WKH 3UHVLGHQWV &RPPLWWHH RI $GYLVRUV RQ 6FLHQFH DQG 7HFKQRORJ\ REVHUYHG WKDW DQ HIIHFW VL]H RI  ZDV DW WKH ORZHU HQG RI WKH UDQJH RI HIIHFWV UHSRUWHG E\ IRXU PHWDDQDO\VHV RI WHFKQRORJ\ VWXGLHV 3&$67 
3

, ,QWURGXFWLRQ

7 FOXVWHUHG 7KH WHDP HQFRXUDJHG GLVWULFWV WKDW ZDQWHG WR LPSOHPHQW PRUH WKDQ RQH SURGXFW WR LPSOHPHQW D VHFRQG RU WKLUG SURGXFW LQ D GLIIHUHQW JUDGH OHYHO VR WKDW RQH GLVWULFW ZRXOG QRW SURYLGH D GLVSURSRUWLRQDWHO\ ODUJH VKDUH RI WKH GDWD IRU DQ\ RQH JUDGH OHYHO ,Q WKH HQG RQH GLVWULFW LPSOHPHQWHG D SURGXFW LQ DOO IRXU JUDGH OHYHOV DQG DQRWKHU LPSOHPHQWHG D SURGXFW LQ WKUHH JUDGH OHYHOV 2QH GLVWULFW LPSOHPHQWHG WZR SURGXFWV LQ WKH IRXUWK JUDGH OHYHO %\ -XQH  QHDUO\ DOO GLVWULFWV KDG EHHQ LGHQWLILHG IRU WKH VWXG\ $JUHHPHQWV WR SDUWLFLSDWH ZHUH UHDFKHG E\ 6HSWHPEHU  $ WRWDO RI  GLVWULFWV DQG  VFKRROV DJUHHG WR SDUWLFLSDWH 7DEOH , 7KH  GLVWULFWV DUH LQ  VWDWHV LQFOXGLQJ WKH SRSXORXV VWDWHV RI &DOLIRUQLD )ORULGD *HRUJLD ,OOLQRLV 1HZ -HUVH\ DQG 7H[DV 2QH GLVWULFW ZLWK WKUHH VFKRROV ODWHU GURSSHG RXW RI WKH VWXG\ EHFDXVH WHFKQLFDO SUREOHPV SUHYHQWHG WKH SURGXFW WKH GLVWULFW ZDV DWWHPSWLQJ WR LPSOHPHQW IURP IXQFWLRQLQJ DQG RQH VFKRRO LQ DQRWKHU GLVWULFW GURSSHG RXW 7KH WDUJHW QXPEHU RI VFKRROV DQG FODVVURRPV ZDV H[FHHGHG IRU JUDGHV  DQG  EXW LW ZDV QRW UHDFKHG IRU JUDGH  DQG DOJHEUD %HFDXVH VHFRQGDU\ VFKRROV KDYH PDQ\ FODVV VHFWLRQV WKH QXPEHU RI VWXGHQWV LQ WKH VWXG\ ZDV FORVHU WR WKH WDUJHW VDPSOH VL]H 7KH WDUJHW VWXGHQW VDPSOH VL]H ZDV H[FHHGHG LQ JUDGH  $W WKH DFWXDO VDPSOH VL]HV PLQLPXP GHWHFWDEOH HIIHFW VL]HV ZHUH    DQG  LQ WKH IRXU JUDGH OHYHOV UHVSHFWLYHO\ 7DEOH , VKRZV WKDW WKH VWXG\V HPSKDVLV RQ KLJKSRYHUW\ VFKRROV UHVXOWHG LQ GLVWULFWV KDYLQJ D KLJKHU SHUFHQWDJH RI VWXGHQWV HOLJLEOH IRU IUHH RU UHGXFHGSULFH OXQFK WKDQ WKH DYHUDJH GLVWULFW )UHH DQG UHGXFHGSULFH OXQFK UDWHV ZHUH  SHUFHQW IRU VFKRROV LQ WKH UHDGLQJ VXEVWXGLHV DQG  SHUFHQW IRU WKH PDWK VXEVWXGLHV FRPSDUHG WR  SHUFHQW QDWLRQZLGH 7KH VWXG\ GLVWULFWV DOVR ZHUH PRUH OLNHO\ WR EH LQ XUEDQ ORFDWLRQV  SHUFHQW RI GLVWULFWV LQ WKH VWXG\ FRPSDUHG WR DERXW  SHUFHQW RI GLVWULFWV QDWLRQZLGH DQG ZHUH ODUJHU WKDQ WKH DYHUDJH GLVWULFW LQ VHYHUDO PHDVXUHV IRU H[DPSOH GLVWULFWV LQ WKH UHDGLQJ VXEVWXGLHV KDG DERXW  VFKRROV DQG LQ WKH PDWK VXEVWXGLHV DERXW  VFKRROV FRPSDUHG WR DERXW  VFKRROV LQ WKH DYHUDJH GLVWULFW 6LPLODUO\ WKH SDUWLFXODU VFKRROV UHFUXLWHG IRU WKH VWXG\ ZHUH PRUH OLNHO\ WR EH 7LWOH , VFKRROV DQG LQ XUEDQ DUHDV 7DEOH , &RQVLVWHQW ZLWK WKH KLJK SHUFHQWDJH RI XUEDQ VFKRROV VWXG\ VFKRROV KDG ODUJHU HQUROOPHQWV DQG ODUJHU PLQRULW\ VWXGHQW SRSXODWLRQV WKDQ WKH DYHUDJH VFKRRO 6FKRROV LPSOHPHQWLQJ UHDGLQJ SURGXFWV ZHUH VLPLODU WR VFKRROV LPSOHPHQWLQJ PDWK SURGXFWV EXW JHQHUDOO\ KDG IHZHU VWXGHQWV PRVW ZHUH HOHPHQWDU\ VFKRROV ZKHUHDV QHDUO\ DOO VFKRROV LPSOHPHQWLQJ PDWK SURGXFWV ZHUH PLGGOH RU KLJK VFKRROV 6FKRROV LQ WKH IRXUWK JUDGH VWXG\ ZHUH PRUH KLJKO\ XUEDQL]HG DQG KDG ODUJHU PLQRULW\ VWXGHQW SRSXODWLRQV WKDQ VFKRROV LQ WKH VWXG\V RWKHU JUDGH OHYHOV
0LQLPXP GHWHFWDEOH HIIHFW VL]HV GHSHQG RQ WKH GLVWULEXWLRQ RI WKH YDULDQFH RI WHVW VFRUHV EHWZHHQ VWXGHQWV FODVVURRPV DQG VFKRROV DIWHU DFFRXQWLQJ IRU REVHUYHG VWXGHQW FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV 7KH PLQLPXP GHWHFWDEOH HIIHFW VL]HV QRWHG LQ WKH WH[W DUH EDVHG RQ HVWLPDWHV RI VWXGHQW FODVVURRP DQG VFKRRO UHVLGXDO YDULDQFHV SUHVHQWHG LQ $SSHQGL[ 7DEOH % 'HWHFWDEOH HIIHFW VL]HV DOVR GHSHQG RQ WKH QXPEHU RI WHDFKHUV DVVLJQHG WR WUHDWPHQW VWDWXV 7KH GHWHFWDEOH HIIHFW VL]HV DUH EDVHG RQ WKH DFWXDO WUHDWPHQW DVVLJQPHQW UDWHV RI  SHUFHQW LQ WKH ILUVW JUDGH  SHUFHQW LQ WKH IRXUWK JUDGH  SHUFHQW LQ WKH VL[WK JUDGH DQG  SHUFHQW LQ DOJHEUD 7KH QH[W VHFWLRQ GHVFULEHV ZK\ WKH WUHDWPHQW DVVLJQPHQW UDWH GLIIHUHG EHWZHHQ JUDGH OHYHOV
4
7KH VWXG\ LQFOXGHV WZR YHU\ ODUJH GLVWULFWV 7KLV IDFW FRQWULEXWHV VLJQLILFDQWO\ WR WKHVH FKDUDFWHULVWLFV EHFDXVH WKH WZR GLVWULFWV FRQWDLQ PDQ\ KLJKSRYHUW\ VFKRROV

, ,QWURGXFWLRQ

8
7DEOH , 1XPEHU RI 6WXG\ 'LVWULFWV 6FKRROV 7HDFKHUV DQG 6WXGHQWV E\ *UDGH /HYHO 6SULQJ  6XEMHFW DQG *UDGH /HYHO 5HDGLQJ *UDGH  5HDGLQJ *UDGH  0DWK *UDGH  0DWK $OJHEUD 7RWDO 8QGXSOLFDWHG 7RWDOE
D

1XPEHU RI 'LVWULFWV      

1XPEHU RI 6FKRROV      

1XPEHU RI 7HDFKHUVD      QD

1XPEHU RI 6WXGHQWVF      QD

7KH QXPEHU RI WHDFKHUV LQFOXGHV WUHDWPHQW DQG FRQWURO WHDFKHUV 7KH XQGXSOLFDWHG WRWDO JLYHV WKH QXPEHU RI XQLTXH GLVWULFWV DQG VFKRROV LQ WKH VWXG\ 1LQH GLVWULFWV DQG HLJKW VFKRROV SLORWHG PRUH WKDQ RQH SURGXFW IRU WKH VWXG\

7KH QXPEHU UHSUHVHQWV VWXGHQWV LQ WKH DQDO\VLV VDPSOH WHVWHG LQ ERWK IDOO  DQG VSULQJ  7KH WRWDO QXPEHU RI VWXGHQWV LQ WKH VWXG\ LV ODUJHU EHFDXVH VRPH VWXGHQWV WHVWHG LQ WKH IDOO PRYHG RXW RI WKHLU VFKRRO GLVWULFW E\ WKH WLPH RI WKH VSULQJ WHVW DQG VRPH VWXGHQWV WHVWHG LQ WKH VSULQJ KDG PRYHG LQWR VWXG\ FODVVURRPV DIWHU WKH IDOO WHVW 7KH WRWDO QXPEHU RI VWXGHQWV WHVWHG ZDV  LQ WKH IDOO DQG  LQ WKH VSULQJ QRW DSSOLFDEOH

QD

7DEOH , &KDUDFWHULVWLFV RI 'LVWULFWV LQ WKH 6WXG\ &KDUDFWHULVWLFVD 1XPEHU RI 7LWOH , VFKRROVE 'LVWULFW ORFDWLRQ SHUFHQWDJH 8UEDQ 8UEDQ IULQJH 7RZQ 5XUDO DUHD 1XPEHU RI VFKRROV SHU GLVWULFW 1XPEHU RI IXOOWLPH WHDFKHUV SHU GLVWULFW 1XPEHU RI VWXGHQWV SHU GLVWULFW 3HUFHQWDJH RI VWXGHQWV HOLJLEOH IRU IUHH RU UHGXFHGSULFH OXQFKF 1XPEHU RI 'LVWULFWV
6RXUFH 1RWH
D

$YHUDJH 86 'LVWULFW          

'LVWULFWV LQ WKH 5HDGLQJ 6WXG\          

'LVWULFWV LQ WKH 0DWK 6WXG\          

6WXG\ WDEXODWLRQV E\ 035 IURP WKH  &RPPRQ &RUH RI 'DWD )RXU GLVWULFWV DUH LQ ERWK WKH UHDGLQJ DQG PDWK VXEVWXGLHV

'DWD LQFOXGH GLVWULFWV ZLWK RQH RU PRUH UHJXODU VFKRROV 'DWD PLVVLQJ IRU  SHUFHQW RI VWXG\ GLVWULFWV DQG  SHUFHQW RI GLVWULFWV QDWLRQZLGH

'DWD PLVVLQJ IRU  SHUFHQW RI VWXG\ GLVWULFWV DQG  SHUFHQW RI GLVWULFWV QDWLRQZLGH

, ,QWURGXFWLRQ

9
7DEOH , &KDUDFWHULVWLFV RI 6FKRROV LQ WKH 6WXG\ $YHUDJH 86 6FKRRO 6FKRROV LQ )LUVW *UDGH 6WXG\ 6FKRROV LQ )RXUWK *UDGH 6WXG\ 6FKRROV LQ 6L[WK *UDGH 6WXG\ 6FKRROV LQ $OJHEUD 6WXG\

&KDUDFWHULVWLFVD 6FKRRO ORFDWLRQ SHUFHQWDJH 8UEDQ 8UEDQ IULQJH 7RZQ 5XUDO DUHD 6WXGHQWV SHU WHDFKHU 1XPEHU RI VWXGHQWV SHU VFKRRO 3HUFHQWDJH UHFHLYLQJ 7LWOH , 3HUFHQWDJH RI VWXGHQWV HOLJLEOH IRU IUHH RU UHGXFHGSULFH OXQFK 6WXGHQW UDFHHWKQLFLW\ SHUFHQWDJH :KLWH %ODFN +LVSDQLF $VLDQ 1DWLYH $PHULFDQ 1XPEHU RI 6FKRROVE
6RXUFH
D

    


       

       

       

       

 

    


    


    


    


    


6WXG\ WDEXODWLRQV E\ 035 IURP WKH  &RPPRQ &RUH RI 'DWD &&'

'DWD LQFOXGH UHJXODU VFKRROV RQO\ &&' GDWD DUH PLVVLQJ IRU  VWXG\ VFKRROV

' 5HFUXLWLQJ DQG $VVLJQLQJ 7HDFKHUV 7HDFKHUV LQ SDUWLFLSDWLQJ VFKRROV ZHUH DVNHG WR YROXQWHHU E\ VLJQLQJ D FRQVHQW IRUP LQGLFDWLQJ WKH\ XQGHUVWRRG WKDW WKH\ ZRXOG EH SDUW RI D UHVHDUFK VWXG\ DQG ZRXOG LPSOHPHQW WKH SURGXFW LI VHOHFWHG ,Q HOLJLEOH VFKRROV WKRVH ZLWK WZR RU PRUH YROXQWHHULQJ WHDFKHUV WKH VWXG\ UDQGRPO\ DVVLJQHG WHDFKHUV WR WKH SURGXFW IRU WKDW VFKRRO )LJXUH $ LQ $SSHQGL[ $ VKRZV WKH IORZ RI WHDFKHUV LQWR WKH WUHDWPHQW DQG FRQWURO JURXSV 7KH VWXG\ UDQGRPO\ DVVLJQHG  WHDFKHUV DQG ODWHU GURSSHG  WHDFKHUV IURP WKH VWXG\ 7KH PRVW FRPPRQ UHDVRQV IRU GURSSLQJ WHDFKHUV ZHUH WKDW WHDFKHUV ZKR KDG EHHQ UDQGRPO\ DVVLJQHG ZHUH ODWHU DVVLJQHG WR WHDFK D GLIIHUHQW JUDGH OHYHO RU VXEMHFW PRYHG WR D GLIIHUHQW VFKRRO UHWLUHG RU OHIW WHDFKLQJ , ,QWURGXFWLRQ

10 :KHWKHU H[FOXGHG WHDFKHUV ZHUH UHSODFHG GHSHQGHG RQ ZKHWKHU D VFKRRO FRXOG LGHQWLI\ D QHZ WHDFKHU IRU WKH VWXG\ ,I LW GLG WKH VWXG\ HLWKHU FRQGXFWHG UDQGRP DVVLJQPHQW DJDLQ LI RQO\ RQH WHDFKHU ZDV LQ WKH WUHDWPHQW JURXS RU FRQWURO JURXS RU DVVLJQHG WKH DGGLWLRQDO WHDFKHU ZLWK D  SHUFHQW SUREDELOLW\ WR XVH WKH SURGXFW 6FKRROV ZHUH GURSSHG IURP WKH VWXG\ LI WKH\ KDG RQH WHDFKHU LQ HLWKHU WKH WUHDWPHQW JURXS RU WKH FRQWURO JURXS ORVW D WHDFKHU DQG FRXOG QRW UHSODFH WKDW WHDFKHU 7KH ZHLJKWLQJ WRZDUG WKH WUHDWPHQW JURXS XOWLPDWHO\ UHVXOWHG LQ  SHUFHQW RI VWXG\ WHDFKHUV EHLQJ LQ WKH WUHDWPHQW JURXS ( &ROOHFWLQJ &ODVVURRP DQG 6WXGHQW 'DWD $ UHYLHZ RI WKH UHVHDUFK OLWHUDWXUH RQ WKH LPSOHPHQWDWLRQ RI FODVVURRPEDVHG LQVWUXFWLRQDO WHFKQRORJLHV DQG GHVFULSWLRQV RI UHFRPPHQGHG LPSOHPHQWDWLRQ SUDFWLFHV SURYLGHG E\ VRIWZDUH YHQGRUV ZHUH XVHG WR LGHQWLI\ WKH FRQGLWLRQV DQG SUDFWLFHV WR EH PHDVXUHG $JRGLQL HW DO  5HOHYDQW OLWHUDWXUH RQ WKH LPSOHPHQWDWLRQ GLPHQVLRQV RQ ZKLFK GDWD ZHUH FROOHFWHG LV VXPPDUL]HG EULHIO\ EHORZ IROORZHG E\ D EULHI GLVFXVVLRQ RI GDWD FROOHFWLRQ PHWKRGV $SSHQGL[ $ SURYLGHV GHWDLOV DERXW WKH GDWD FROOHFWLRQ PHWKRGV 5HVHDUFK (YLGHQFH RQ ,PSRUWDQW ,PSOHPHQWDWLRQ 'LPHQVLRQV 7HDFKHU 7UDLQLQJ DQG $FWLRQV 8VLQJ WHFKQRORJ\ SURGXFWV LQ FODVVURRPV SODFHV GHPDQGV RQ WHDFKHUV WLPH DQG VNLOOV 7HDFKHUV PXVW SUHSDUH WKH SURGXFW IRU VWXGHQW XVH PRQLWRU DQG KHOS VWXGHQWV DV WKH\ XVH WKH SURGXFW PDLQWDLQ WKH WHFKQRORJ\ DQG PRQLWRU VWXGHQW SURJUHVV RQ LW 6LQFH WKH V REVHUYHUV KDYH UHSRUWHG WKDW W\SLFDOO\ RQO\ D PLQRULW\ RI WHDFKHUV UHFHLYHV DGHTXDWH WUDLQLQJ WR PDQDJH VWXGHQW XVH RI WHFKQRORJ\ LQ WKHLU FODVVURRPV .HUU  86 &RQJUHVV 2IILFH RI 7HFKQRORJ\ $VVHVVPHQW  5HFHQW VHOI UHSRUWV IURP WHDFKHUV DUH FRQVLVWHQW ZLWK WKHVH ILQGLQJV ,Q D UHFHQW VXUYH\  SHUFHQW RI WHDFKHUV VDLG WKDW WKH\ KDG D PHGLXP RU KLJK QHHG IRU SURIHVVLRQDO GHYHORSPHQW RQ KRZ WR PDQDJH FODVVURRP DFWLYLWLHV WKDW LQWHJUDWH WHFKQRORJ\ $GHOPDQ HW DO  $PRXQW RI 6RIWZDUH 8VH 7UDFNLQJ XVDJH ZDV LPSRUWDQW IRU WKH VWXG\ EHFDXVH UHVHDUFK KDV IRXQG WKDW WKH DYHUDJH FODVVURRP GRHV QRW XVH SURGXFWV IRU WKH DPRXQW RI WLPH YHQGRUV UHFRPPHQG 9DQ'XVHQ DQG :RUWKHQ  DWWULEXWHG VPDOO LPSDFWV RI LQWHJUDWHG OHDUQLQJ V\VWHPV WR WKH IDFW WKDW WKH V\VWHPV ZHUH QRW XVHG IRU HQRXJK WLPH $ UHFHQW HYDOXDWLRQ RI WKH :DWHUIRUG (DUO\ 5HDGLQJ VRIWZDUH LQ WKH /RV $QJHOHV 8QLILHG 6FKRRO 'LVWULFW IRXQG WKDW ILUVW JUDGHUV VSHQW RQO\  SHUFHQW RI WKH DPRXQW RI WLPH ZLWK WKH VRIWZDUH WKDW :DWHUIRUG UHFRPPHQGHG +DQVHQ HW DO  /RFXV DQG *URXSLQJ IRU 3URGXFW 8VH ,VVXHV RI OLPLWHG WHDFKHU DQG VWXGHQW DFFHVV WR ZRUNLQJ FRPSXWHUV DUH RIWHQ FLWHG DV EDUULHUV WR WKH LQWHJUDWLRQ RI WHFKQRORJ\ %HFNHU HW DO  (UWPHU  /HJJHWW DQG 3HUVLFKLWWH  0HDQV DQG 2OVRQ  6HYHUDO VWXGLHV KDYH UHSRUWHG WKDW EDUULHUV WR DFFHVVLQJ WHFKQRORJ\ DUH D VRXUFH RI WHDFKHU PLVJLYLQJV DERXW XVLQJ FRPSXWHUV IRU LQVWUXFWLRQ $GHOPDQ HW DO  &XEDQ  6KHLQJROG DQG +DGOH\  DQG WHDFKHUV FLWH WKH LQFRQYHQLHQFH RI VFKHGXOLQJ DQG PRYLQJ VWXGHQWV WR D FRPSXWHU ODE DV UHDVRQV IRU VSHQGLQJ OHVV WLPH RQ WHFKQRORJ\GHSHQGHQW FXUULFXOD $GHOPDQ HW DO  0RUHRYHU D VWXG\ RI D VWDWHZLGH LPSOHPHQWDWLRQ RI EDVLF VNLOOV VRIWZDUH IRXQG ODUJHU DFKLHYHPHQW JDLQV IRU PDWK DQG UHDGLQJ VRIWZDUH LQ VFKRROV ZKHUH WKH VRIWZDUH ZDV XVHG LQ UHJXODU FODVVURRPV UDWKHU WKDQ LQ FRPSXWHU ODEV 0DQQ HW DO  , ,QWURGXFWLRQ

11 7HFKQLFDO 'LIILFXOWLHV DQG 7HDFKHU 6XSSRUW &RPSXWHU KDUGZDUH FDQ EH XQUHOLDEOH FRPSXWHU QHWZRUNV XQVWDEOH DQG WHFKQLFDO VXSSRUW LQDGHTXDWH WR NHHS DOO PDFKLQHV UXQQLQJ SURSHUO\ &XEDQ  &XOS HW DO  $V D UHVXOW RQ D JLYHQ GD\ WHDFKHUV DQG VWXGHQWV PD\ ILQG WKHPVHOYHV ZLWKRXW HQRXJK ZRUNLQJ FRPSXWHUV DQG SHULSKHUDOV VXFK DV SULQWHUV WR HIIHFWLYHO\ XVH WKH SURGXFW 7KH W\SH DQG IUHTXHQF\ RI WHFKQLFDO GLIILFXOWLHV DQG RWKHU DFFHVV SUREOHPV ZHUH WUDFNHG IRU HDFK FODVVURRP $FFHVV ZDV H[SHFWHG WR EH OHVV RI DQ LVVXH IRU WKH VWXG\ EHFDXVH LW SURYLGHG UHVRXUFHV WR HQVXUH WKDW HQRXJK ZRUNLQJ FRPSXWHUV ZHUH DYDLODEOH 5HVHDUFK DOVR KDV VXJJHVWHG WKDW WHDFKHUV QHHG RQJRLQJ WHFKQLFDO DQG SHGDJRJLFDO VXSSRUW WR XVH WHFKQRORJ\ ZHOO $GHOPDQ HW DO  0LOOV DQG 5DJDQ  7KH IUHTXHQF\ RI WHFKQRORJ\ XVH KDV EHHQ QRWHG WR EH DVVRFLDWHG PRUH ZLWK TXDOLW\ RI VXSSRUW IRU LQWHJUDWLQJ WHFKQRORJ\ ZLWK FXUULFXOXP WKDQ ZLWK WKH SHUFHLYHG TXDOLW\ RI WHFKQLFDO WURXEOHVKRRWLQJ DQG PDLQWHQDQFH VXSSRUW %RWK RI WKHVH W\SHV RI VXSSRUW DQG WHDFKHUV VDWLVIDFWLRQ ZLWK WKHP ZHUH PHDVXUHG LQ WKH SUHVHQW VWXG\ 3URGXFWV 5ROH LQ ,QVWUXFWLRQ 3URGXFWV FDQ EH WKH FRUH FXUULFXOXP SURYLGH XQLWV WKDW UHSODFH VRPH XQLWV RI WKH FRUH FXUULFXOXP VXSSOHPHQW LQVWUXFWLRQ RU SURYLGH RSSRUWXQLWLHV WR SUDFWLFH EH\RQG WKRVH SURYLGHG E\ FRUH FXUULFXOXP PDWHULDOV 7HDFKHUV NQRZOHGJH RI WKH VXEMHFW DUHD DQG WKH H[WHQW WR ZKLFK WKH\ YLHZ WKH SURGXFW WR EH DOLJQHG ZLWK WKH FXUULFXOXP PD\ LQIOXHQFH WKH H[WHQW WR ZKLFK WKH\ VXFFHVVIXOO\ LQWHJUDWH WHFKQRORJ\ LQ WKHLU FODVVURRPV (UWPHU  5HVHDUFKHUV KDYH QRWHG WKDW WHDFKHUV GR QRW XVH WHFKQRORJ\ ZKHQ WKH\ WKLQN LW LV QRW FRQQHFWHG WR WKH FXUULFXOXP 6DUDPD HW DO  4XHVWLRQV DERXW ZKHWKHU SURGXFWV ZHUH PDSSHG WR VWDQGDUGV ZHUH LQFOXGHG LQ WKH LPSOHPHQWDWLRQ GDWD FROOHFWLRQ 6WXGHQW DQG 7HDFKHU 5ROHV 2QH RI WKH DUJXPHQWV PDGH IRU XVLQJ WHFKQRORJ\ LQ FODVVURRPV LV WKDW LW VKLIWV VWXGHQW DQG WHDFKHU UROHV LQ ZD\V WKDW OHDG WR PRUH OHDUQLQJ )RU H[DPSOH ZKHQ VWXGHQWV DUH ZRUNLQJ ZLWK VRIWZDUH HYHU\ VWXGHQW FDQ FRQVWUXFW D UHVSRQVH WR D TXHVWLRQ UDWKHU WKDQ MXVW WKH VWXGHQW FDOOHG RQ E\ WKH WHDFKHU 6WXGLHV RI FODVVURRP LQWHUDFWLRQV KDYH IRXQG WKDW LQ FODVVHV XVLQJ WHFKQRORJ\ LQGLYLGXDO VWXGHQWV PDNH PDQ\ PRUH UHVSRQVHV 6FKRILHOG DQG 9HUEDQ  :RUWKHQ HW DO  DQG WKH WHDFKHU VKLIWV RXW RI WKH UROH DV OHFWXUHU DQG PD\ GR PRUH FRDFKLQJ RI LQGLYLGXDOV RU VPDOO JURXSV +HQULTXH] DQG 5LFRQVFHQWH  6ZDQ DQG 0LWUDQL  6WXGHQWV DOVR PD\ EH PRUH OLNHO\ WR EH RQ WDVN :D[PDQ DQG +XDQJ  8VH RI 6WXGHQW 3HUIRUPDQFH 5HSRUWV 7KH SURGXFWV SURYLGH LQGLYLGXDO VWXGHQW DQG FODVVURRP UHSRUWV RI SHUIRUPDQFH 0DQ\ FRPSDQLHV LQGLFDWHG WKDW WHDFKHUV VKRXOG UHYLHZ WKHVH UHSRUWV UHJXODUO\ WR HQVXUH WKDW VWXGHQWV DUH SURJUHVVLQJ DQG WR PDNH DGMXVWPHQWV DV QHHGHG 5HVHDUFK RQ IRUPDWLYH DVVHVVPHQW UHYLHZHG E\ %ODFN DQG :LOLDP  VXJJHVWV WKDW WHDFKHUV XVH RI LQIRUPDWLRQ IURP PLGFRXUVH DVVHVVPHQWV FDQ LQFUHDVH OHDUQLQJ JDLQV 'DWD &ROOHFWLRQ 0HWKRGV 7KH VWXG\V GDWD IDOO LQWR WZR EURDG FDWHJRULHV  GDWD UHODWHG WR SURGXFW LPSOHPHQWDWLRQ DQG FODVVURRP FKDUDFWHULVWLFV LQFOXGLQJ SURGXFW XVDJH DQG WHDFKHU FKDUDFWHULVWLFV DQG  GDWD UHODWHG WR VWXGHQW FKDUDFWHULVWLFV LQ SDUWLFXODU DFKLHYHPHQW EXW DOVR DYHUDJH FKDUDFWHULVWLFV RI VWXGHQWV DWWHQGLQJ WKH VWXG\V VFKRROV ,Q WKH ILUVW FDWHJRU\ WKH VWXG\ REVHUYHG FODVVURRPV LQWHUYLHZHG WHDFKHUV DQG DGPLQLVWHUHG D TXHVWLRQQDLUH WR WHDFKHUV ,Q WKH VHFRQG FDWHJRU\ WKH VWXG\ DGPLQLVWHUHG DFKLHYHPHQW WHVWV FROOHFWHG UHFRUGV , ,QWURGXFWLRQ

12 IRU LQGLYLGXDO VWXGHQWV DQG PHUJHG GDWD IURP SXEOLF VRXUFHV DERXW VWXGHQW FKDUDFWHULVWLFV RI VFKRROV  ,PSOHPHQWDWLRQ DQG &ODVVURRP 'DWD

&ODVVURRP 2EVHUYDWLRQV $ WHPSODWH RI D FODVVURRP REVHUYDWLRQ SURWRFRO ZDV GHYHORSHG IRU XVH LQ REVHUYDWLRQV RI ERWK WUHDWPHQW DQG FRQWURO FODVVURRPV DFURVV DOO JUDGH OHYHOV 7KH VWUXFWXUH RI WKH SURWRFRO GUHZ RQ HOHPHQWV RI H[LVWLQJ REVHUYDWLRQ LQVWUXPHQWV IRXQG WR EH UHOLDEOH LQ WKH ILHOG *RRG DQG %URSK\  7KH FRQWHQW RI WKH SURWRFRO ZDV EDVHG RQ UHVHDUFK OLWHUDWXUH RQ IDFWRUV DVVRFLDWHG ZLWK XVLQJ WHFKQRORJ\ VRPH RI ZKLFK LV FLWHG DERYH DV ZHOO DV RQ LPSOHPHQWDWLRQ PRGHOV IRU HDFK SURGXFW ZKLFK WKH VWXG\ ZRUNHG ZLWK SURGXFW YHQGRUV WR GHYHORS 7KH REVHUYDWLRQ SURWRFRO KDG WKUHH VHFWLRQVRQH HDFK IRU VWXGHQW DFWLYLWLHV WHFKQRORJ\ XVH DQG JHQHUDO REVHUYDWLRQV 2EVHUYHUV FROOHFWHG GDWD DW ILYH SRLQWV GXULQJ D PLQXWH SHULRG 7KH\ FRPSOHWHG D VHFWLRQ RQ VWXGHQW DFWLYLWLHV HYHU\  PLQXWHV UHFRUGLQJ WKH QXPEHU RI DFWLYLWLHV WDNLQJ SODFH WKH W\SH RI DFWLYLWLHV WKH WHDFKHUV UROH WKH SHUFHQW RI VWXGHQWV ZKR ZHUH RIIWDVN DQG WKH QXPEHU RI VWXGHQWV XVLQJ SURGXFWV 7KH\ FRPSOHWHG D VHFWLRQ RQ SURGXFW XVH HYHU\  PLQXWHV FKDUDFWHUL]LQJ DFWLYLWLHV VXFK DV WHDFKHUV UROHV LQ PRWLYDWLQJ DQG KHOSLQJ VWXGHQWV ZKR ZHUH KDYLQJ WHFKQLFDO GLIILFXOWLHV ZLWK WKH SURGXFWV 7KH\ DOVR UHFRUGHG WKH WRWDO DPRXQW RI WLPH VWXGHQWV XVHG SURGXFWV LI XVHG WKH ORFDWLRQ RI WKH REVHUYDWLRQ ZKHWKHU RWKHU SURGXFWV ZHUH XVHG SURGXFWV WKDW ZHUH QRW WKH IRFXV RI WKH VWXG\ DQG KRZ SURGXFWV PD\ KDYH EHHQ XVHG LQ ZD\V WKDW GLIIHUHG IURP WKH SURGXFWV LPSOHPHQWDWLRQ PRGHO 2EVHUYHUV ZHUH H[SHULHQFHG UHVHDUFKHUV DQG D PDMRULW\ KDG H[SHULHQFH FRQGXFWLQJ REVHUYDWLRQV RI FODVVURRP LQVWUXFWLRQ 3ULRU WR REVHUYDWLRQV REVHUYHUV ZHUH WUDLQHG WR XVH WKH SURWRFRO UHOLDEO\ E\ ZDWFKLQJ YLGHRWDSHV RI FODVVURRPV XVLQJ SURGXFWV LQ WKH VWXG\ $SSHQGL[ $ SURYLGHV DGGLWLRQDO GHWDLOV RQ WKH GHYHORSPHQW RI WKH SURWRFRO DQG WKH WUDLQLQJ RI REVHUYHUV 2EVHUYHUV FRQGXFWHG REVHUYDWLRQV LQ 2FWREHU DQG 1RYHPEHU  LQ 'HFHPEHU DQG -DQXDU\  DQG LQ 0DUFK DQG $SULO  7KH\ FRPSOHWHG  SHUFHQW RI VFKHGXOHG FODVVURRP REVHUYDWLRQV 7HDFKHU ,QWHUYLHZV 7HDFKHUV ZHUH LQWHUYLHZHG DIWHU REVHUYDWLRQV WR JDWKHU GDWD DERXW SURGXFW XVH LQ WUHDWPHQW FODVVURRPV DQG WKH XVH RI VRIWZDUH LQ FRQWURO FODVVURRPV 7KH LQWHUYLHZ LQFOXGHG TXHVWLRQV DERXW FXUULFXOXP DQG LQVWUXFWLRQ DFFHVV DQG IUHTXHQF\ RI XVH ZKHWKHU VWXGHQWV XVHG SURGXFWV DW KRPH DQG VWXGHQWJURXSLQJ VWUDWHJLHV ,W DOVR LQFOXGHG TXHVWLRQV DERXW KRZ WHDFKHUV PDQDJHG LQVWUXFWLRQ ZLWK WKH SURGXFW H[SHULHQFHV ZLWK WHFKQLFDO SUREOHPV DQG WKH W\SHV RI LQIRUPDWLRQ WHFKQRORJ\ DQG YHQGRU VXSSRUWV DYDLODEOH DQG DFFHVVHG ,QWHUYLHZHUV FODVVURRP REVHUYHUV VHOHFWHG D UHVSRQVH FDWHJRU\ WKDW EHVW PDWFKHG WKH WHDFKHU UHVSRQVH RU LI D UHVSRQVH ZDV GLIILFXOW WR FRGH WKH\ UHDG WKH UHVSRQVH RSWLRQV WR WHDFKHUV ZKR VHOHFWHG WKH PRVW DSSURSULDWH RQH $SSHQGL[ $ SURYLGHV DGGLWLRQDO GHWDLOV UHJDUGLQJ WKH GHYHORSPHQW RI WKH LQWHUYLHZ DQG WKH WUDLQLQJ RI ILHOG VWDII RQ LWV XVH 2EVHUYHUV LQWHUYLHZHG DOO WHDFKHUV DIWHU WKH ILUVW DQG WKLUG REVHUYDWLRQV DQG LQ VRPH FDVHV EHIRUH WKH REVHUYDWLRQ WR ILW ZLWK WHDFKHU DYDLODELOLW\ )RU WKH VHFRQG REVHUYDWLRQ WUHDWPHQW WHDFKHUV ZHUH LQWHUYLHZHG RQ WRSLFV UHODWHG WR SURGXFW XVH , ,QWURGXFWLRQ

13 7HDFKHU 6XUYH\ $ TXHVWLRQQDLUH DGPLQLVWHUHG WR DOO WHDFKHUV FRPSOHPHQWHG WKH REVHUYDWLRQV DQG LQWHUYLHZV %DVHG RQ TXHVWLRQQDLUHV GHYHORSHG E\ WKH 1DWLRQDO &HQWHU IRU (GXFDWLRQ 6WDWLVWLFV DQG RWKHU VWXGLHV RI HGXFDWLRQDO WHFKQRORJ\ WKH TXHVWLRQQDLUH JDWKHUHG GDWD DERXW WHDFKHU GHPRJUDSKLF DQG HGXFDWLRQDO EDFNJURXQG WHDFKLQJ FUHGHQWLDOV H[SHULHQFHV XVLQJ WHFKQRORJ\ DQG LQVWUXFWLRQDO SUDFWLFHV 7HDFKHUV DOVR SURYLGHG LQIRUPDWLRQ RQ SURIHVVLRQDO GHYHORSPHQW DFWLYLWLHV DQG WKHLU ILUVW IHZ PRQWKV RI H[SHULHQFH XVLQJ WKH SURGXFWV LQFOXGLQJ WKH DYDLODELOLW\ RI WHFKQLFDO VXSSRUW DQG WKHLU DVVHVVPHQWV RI WKH SURGXFW 7KH VWXG\ PDLOHG WKH PLQXWH TXHVWLRQQDLUH WR WHDFKHUV DW WKHLU VFKRROV LQ ODWH 1RYHPEHU DQG UHFHLYHG UHVSRQVHV IURP  SHUFHQW RI WHDFKHUV  6WXGHQW 'DWD

6WXGHQW $FKLHYHPHQW )RU ILUVW IRXUWK DQG VL[WK JUDGHUV WKH VWXG\ DGPLQLVWHUHG WKH VKRUW YHUVLRQ RI WKH 6WDQIRUG $FKLHYHPHQW 7HVW YHUVLRQ  FRPPRQO\ UHIHUUHG WR DV WKH 6$7 )RU ILUVW DQG IRXUWK JUDGHUV WKH VWXG\ XVHG WKH UHDGLQJ SRUWLRQ DQG IRU VL[WK JUDGHUV WKH WHDP XVHG WKH PDWK SRUWLRQ )RU ILUVW JUDGHUV WKH VWXG\ VXSSOHPHQWHG WKH JURXSDGPLQLVWHUHG 6$7 ZLWK WKH 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 72:5( D VKRUW RQH RQRQH WHVW FRQVLGHUHG WR EH D UHOLDEOH DQG YDOLG PHDVXUH RI HDUO\ UHDGLQJ DELOLW\ )RU DOJHEUD WKH VWXG\ XVHG (GXFDWLRQDO 7HVWLQJ 6HUYLFHV (76 (QGRI&RXUVH $OJHEUD $VVHVVPHQW ZKLFK HVVHQWLDOO\ LV D ILQDO H[DP %HFDXVH EDVHOLQH DVVHVVPHQWV RI DOJHEUD VNLOOV ZHUH QRW DYDLODEOH WKH VWXG\ ZRUNHG ZLWK (76 WR VSOLW WKH WHVW LQWR WZR HTXLYDOHQW SDUWV WKDW KDYH WKH VDPH OHYHO RI GLIILFXOW\RQH DGPLQLVWHUHG DW WKH EHJLQQLQJ RI WKH FRXUVH DQG WKH RWKHU DW WKH HQG RI WKH FRXUVH &ODVVURRPV ZHUH UDQGRPO\ VHOHFWHG WR WDNH HLWKHU SDUW $ LQ WKH IDOO DQG SDUW % LQ WKH VSULQJ RU WR WDNH SDUW % LQ WKH IDOO DQG SDUW $ LQ WKH VSULQJ %HFDXVH PRVW VWXGHQWV ZHUH WDNLQJ DOJHEUD LQ D IXOO\HDU FRXUVH WKH WHVWV WLPLQJ FRUUHVSRQGHG URXJKO\ WR WKH EHJLQQLQJ DQG HQG RI WKH VFKRRO \HDU $ IHZ VFKRROV WDXJKW DOJHEUD LQ D RQHVHPHVWHU FRXUVH LQ ZKLFK FDVH WKH WHVW ZDV DGPLQLVWHUHG DW WKH EHJLQQLQJ DQG HQG RI WKH VHPHVWHU 7DEOH , SURYLGHV LQIRUPDWLRQ DERXW DVSHFWV RI WKH WHVWV LQFOXGLQJ WKHLU UHOLDELOLW\ DQG QRUPLQJ SRSXODWLRQV WKH (76 WHVW LV XQQRUPHG EXW RWKHU WHVWV KDYH QDWLRQDO QRUPV 7KH LQLWLDO WHVW ZDV DGPLQLVWHUHG LQ IDOO  DW HDFK JUDGH OHYHO 6WXG\ VWDII W\SLFDOO\ DGPLQLVWHUHG WHVWV LQ VWXGHQWV UHJXODU FODVVURRPV PRVWO\ GXULQJ 2FWREHU DQG 1RYHPEHU  VRPH WHVWLQJ RFFXUUHG LQ 'HFHPEHU 7HVWV ZHUH DGPLQLVWHUHG DJDLQ EHJLQQLQJ LQ ODWH VSULQJ  DV FORVH WR WKH HQG RI WKH VFKRRO \HDU DV SRVVLEOH WR HQVXUH PD[LPXP H[SRVXUH WR WKH SURGXFWV 7HVWV W\SLFDOO\ ODVWHG WKH OHQJWK RI D FODVV SHULRG WKRXJK LQ VRPH VFKRROV WKH ILUVW JUDGH WHVW ZDV DGPLQLVWHUHG LQ WZR GD\V EHFDXVH RI LWV OHQJWK DQG WKH DJH RI WKH VWXGHQWV
)RU ILUVW JUDGHUV LQ WKH IDOO WKH WHVW ZDV WKH 6WDQIRUG (DUO\ 6FKRRO $FKLHYHPHQW 7HVW 6(6$7 %HFDXVH WKH WK YHUVLRQ ZDV QRW DYDLODEOH DW WKH WLPH WKH VWXG\ ZDV SXUFKDVLQJ WHVWV LQ VXPPHU  WKH WK YHUVLRQ ZDV VXEVWLWXWHG
 7KH 6$7 QLQWK JUDGH WHVW ZDV FRQVLGHUHG EXW XOWLPDWHO\ QRW DGRSWHG EHFDXVH WKH (76 WHVW IRFXVHV VSHFLILFDOO\ RQ DOJHEUD ZKHUHDV WKH 6$7 LQFOXGHV RWKHU PDWK WRSLF DUHDV VXFK DV JHRPHWU\ DQG VWDWLVWLFV $OJHEUD FRXUVHV DOVR LQFOXGH VWXGHQWV DW KLJKHU DQG ORZHU JUDGH OHYHOV ZKLFK ZRXOG KDYH UHTXLUHG DGPLQLVWHULQJ GLIIHUHQW YHUVLRQV RI WKH 6$7 WR VWXGHQWV LQ GLIIHUHQW JUDGH OHYHOV 7KH VWXG\ WHDP DVVXPHG WKDW VNLOOV LQ WKHVH RWKHU DUHDV ZRXOG QRW DOLJQ ZLWK WHFKQRORJ\ SURGXFWV WKDW IRFXVHG RQO\ RQ DOJHEUD

, ,QWURGXFWLRQ

14

7DEOH , )HDWXUHV RI 7HVWV 8VHG LQ WKH 6WXG\

, ,QWURGXFWLRQ
6WDQIRUG $FKLHYHPHQW 7HVW 7HQWK (GLWLRQ 6$7 $EEUHYLDWHG %DWWHU\ &RPPHUFLDOO\ DYDLODEOH XVHG E\ ODUJH QXPEHU RI VWDWHV DQG VFKRRO GLVWULFWV 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 72:5( &RPPHUFLDOO\ DYDLODEOH &RQWDLQV WZR VXEWHVWV 7KH 6LJKW :RUG (IILFLHQF\ 6:( VXEWHVW DVVHVVHV WKH QXPEHU RI UHDO SULQWHG ZRUGV WKDW FDQ EH DFFXUDWHO\ LGHQWLILHG ZLWKLQ  VHFRQGV DQG WKH 3KRQHWLF 'HFRGLQJ (IILFLHQF\ 3'( VXEWHVW PHDVXUHV WKH QXPEHU RI SURQRXQFHDEOH SULQWHG QRQZRUGV WKDW FDQ EH DFFXUDWHO\ GHFRGHG ZLWKLQ  VHFRQGV 1DWLRQDO QRUPV EDVHG RQ D VDPSOH RI  VWXGHQWV LQ  VWDWHV LQ IDOO  DQG VSULQJ  7KH DYHUDJH VWXGHQW LQ WKH QRUP VDPSOH KDV D VWDQGDUG VFRUH RI  DQG WKH VWDQGDUG GHYLDWLRQ RI VWDQGDUG VFRUHV LV  $YHUDJH DOWHUQDWH IRUPV UHOLDELOLW\ FRHIILFLHQWV H[FHHG  7HVWUHWHVW FRHIILFLHQWV UDQJH IURP  WR  1RW QDWLRQDOO\ QRUPHG 1DWLRQDO QRUPV EDVHG RQ VDPSOHV RI  VWXGHQWV LQ VSULQJ  DQG VDPSOHV RI  LQ IDOO  7KH DYHUDJH VWXGHQW LQ WKH QRUP VDPSOH KDV D QRUPDOFXUYHHTXLYDOHQW VFRUH RI  DQG WKH VWDQGDUG GHYLDWLRQ RI QRUPDOFXUYHHTXLYDOHQW VFRUHV LV  ,QWHUQDO FRQVLVWHQF\ .5 FRHIILFLHQWV DUH V WR V IRU IXOO PXOWLSOHFKRLFH EDWWHU\ WHVW DQG VXEWHVWV (YLGHQFH RI FRQWHQW FULWHULRQUHODWHG DQG FRQVWUXFW YDOLGLW\

*HQHUDO ,QIRUPDWLRQ

6WDQIRUG $FKLHYHPHQW 7HVW 1LQWK (GLWLRQ 6$7 $EEUHYLDWHG %DWWHU\ &RPPHUFLDOO\ DYDLODEOH XVHG E\ ODUJH QXPEHU RI VWDWHV DQG VFKRRO GLVWULFWV

(GXFDWLRQDO 7HVWLQJ 6HUYLFH (QGRI &RXUVH $OJHEUD $VVHVVPHQW &XVWRPL]HG )XOO IRUP LV FRPPHUFLDOO\ DYDLODEOH 7HVW LV EDVHG RQ DOJHEUD VWDQGDUGV RI WKH 1DWLRQDO &RXQFLO RI 7HDFKHUV RI 0DWKHPDWLFV )RU WKH VWXG\ (76 VHSDUDWHG WKH WHVW LWHPV LQWR WZR EDODQFHG KDOYHV ZLWK HTXDO OHYHOV RI GLIILFXOW\ VXFK WKDW RQH FRXOG EH DGPLQLVWHUHG LQ WKH IDOO DQG WKH RWKHU LQ WKH VSULQJ

1RUP 6DPSOH

1DWLRQDO QRUPV EDVHG RQ VDPSOHV RI  VWXGHQWV LQ VSULQJ  DQG  LQ WKH IDOO

5HOLDELOLW\ DQG 9DOLGLW\

7KH DYHUDJH VWXGHQW LQ WKH QRUP VDPSOH KDV D QRUPDOFXUYH HTXLYDOHQW VFRUH RI  DQG WKH VWDQGDUG GHYLDWLRQ RI QRUPDOFXUYH HTXLYDOHQW VFRUHV LV  ,QWHUQDO FRQVLVWHQF\ .5 FRHIILFLHQWV UDQJHG IURP V WR V IRU PRVW WHVWV DQG VXEWHVWV (YLGHQFH RI FRQWHQW FULWHULRQ UHODWHG DQG FRQVWUXFW YDOLGLW\

,Q  LQIRUPDWLRQ IURP  WHVW WDNHUV LQGLFDWHG D PHDQ VFRUH RI  TXHVWLRQV FRUUHFW RXW RI  ZLWK UHOLDELOLW\ RI  DQG D VWDQGDUG HUURU RI PHDVXUHPHQW RI  7KH WZR IRUPV IURP ZKLFK WKH KDOYHV RI WKH WHVW XVHG LQ WKH VWXG\ ZHUH WDNHQ KDG VLPLODU UHOLDELOLW\ FKDUDFWHULVWLFV

6RXUFH %XURV ,QVWLWXWH RI 0HQWDO 0HDVXUHPHQW 8QLYHUVLW\ RI 1HEUDVND/LQFROQ /LQFROQ 1(  %XURV 7HVW 5HYLHZV 2QOLQH +DUFRXUW (GXFDWLRQDO 0HDVXUHPHQW  7RUJHVHQ HW DO  7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 72:5( ([DPLQHU
V 0DQXDO 3UR (G $XVWLQ 7; ,QIRUPDWLRQ DERXW WKH (76 DOJHEUD WHVW ZDV SURYLGHG LQ WKH DGPLQLVWUDWRUV PDQXDO SURYLGHG E\ (76 DQG JHQHUDO LQIRUPDWLRQ DERXW WKH WHVW FDQ EH IRXQG DW ZZZHWVRUJ

15 2YHUDOO  SHUFHQW RI VWXGHQWV RQ IDOO FODVV URVWHUV FRPSOHWHG WKH IDOO WHVW  SHUFHQW RI VWXGHQWV RQ VSULQJ FODVV URVWHUV FRPSOHWHG WKH VSULQJ WHVW DQG  SHUFHQW RI VWXGHQWV ZKR FRPSOHWHG WKH IDOO WHVW DOVR FRPSOHWHG WKH VSULQJ WHVW 5HVSRQVH UDWHV GHSHQGHG RQ WKH JUDGH OHYHO ZLWK WKH KLJKHVW WHVWLQJ UDWHV IRU ILUVW JUDGH DERYH  SHUFHQW DQG WKH ORZHVW WHVWLQJ UDWHV IRU DOJHEUD DERXW  SHUFHQW 5HVSRQVH UDWH GLIIHUHQWLDOV IRU WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH QHJOLJLEOH XVXDOO\ RQH RU WZR SHUFHQWDJH SRLQWV $SSHQGL[ 7DEOH $ SURYLGHV GHWDLOV DERXW VWXGHQW VDPSOH VL]HV DQG UHVSRQVH UDWHV 7HFKQRORJ\V HIIHFW RQ VWXGHQW DFKLHYHPHQW LV UHSRUWHG LQ HIIHFW VL]H XQLWV $Q HIIHFW VL]H ZDV FDOFXODWHG DV WKH GLIIHUHQFH LQ DYHUDJH WHVW VFRUHV EHWZHHQ WKH WUHDWPHQW DQG FRQWURO JURXSV GLYLGHG E\ WKH VWDQGDUG GHYLDWLRQ RI WKH FRQWURO JURXSV WHVW VFRUH 7KLV PHWULF DOORZV WKH VWXG\ WR FRPSDUH UHVXOWV IRU WHVWV ZKRVH VFRUHV DUH UHSRUWHG LQ GLIIHUHQW XQLWV )RU H[DPSOH DQ HIIHFW VL]H RI  RU RQH VWDQGDUG GHYLDWLRQ LV HTXLYDOHQW WR  QRUPDO FXUYH HTXLYDOHQWV 1&(V RQ WKH 6$7 WHVW DQG  SRLQWV RQ WKH 72:5( $Q HIIHFW VL]H RI  LV HTXLYDOHQW WR LQFUHDVLQJ D VWXGHQW DW WKH WK SHUFHQWLOH WR WKH WK SHUFHQWLOH 6FKRRO 5HFRUGV 6WXGHQW GDWD ZHUH JDWKHUHG IURP VFKRRO UHFRUGV VWDUWLQJ DW WKH HQG RI WKH VSULQJ VHPHVWHU DQG FRQWLQXLQJ WKURXJK WKH VXPPHU DQG HDUO\ IDOO 'DWD LWHPV LQFOXGHG DJH DQG UDFH VWDQGDUGL]HG WHVW VFRUHV IRU WKH SUHYLRXV DQG FXUUHQW DFDGHPLF \HDUV DQG ZKHWKHU VWXGHQWV KDG DQ LQGLYLGXDOL]HG HGXFDWLRQ SODQ ZHUH OLPLWHG (QJOLVK SURILFLHQW RU ZHUH HOLJLEOH IRU WKH IUHH OXQFK SURJUDP 6FKRRO UHFRUGV GDWD ZHUH UHDVRQDEO\ FRPSOHWH IRU VWXGHQW DJH DQG JHQGHU +RZHYHU GLVWULFWV W\SLFDOO\ GLG QRW SURYLGH DOO LWHPV DQG JDSV RFFXUUHG IRU WHVW VFRUHV DQG IRU SDUWLFLSDWLRQ LQ WKH IUHH OXQFK VSHFLDO HGXFDWLRQ DQG (QJOLVK ODQJXDJH OHDUQLQJ SURJUDPV LQ SDUWLFXODU 2IWHQ LI GDWD LWHPV ZHUH PLVVLQJ WKH\ ZHUH PLVVLQJ IRU DOO VWXGHQWV LQ D VFKRRO %HFDXVH WKH VWXG\V HVWLPDWLRQ DSSURDFK GLVFXVVHG LQ $SSHQGL[ % UHOLHG RQ DW OHDVW VRPH VWXGHQW GDWD EHLQJ DYDLODEOH IRU HDFK FODVVURRP WKH JDSV LQ UHFRUGV GDWD OHG WR WKH GHFLVLRQ WR XVH DJJUHJDWH VFKRROOHYHO GDWD IRU LWHPV WKDW ZHUH DYDLODEOH LQ WKH &RPPRQ &RUH RI 'DWD &&' ) /RRNLQJ $KHDG 7KH UHSRUWV FKDSWHU VWUXFWXUH IROORZV WKH VWXG\V JUDGHOHYHO VWUXFWXUH 7R DYRLG UHSHDWLQJ WKH VDPH LQIRUPDWLRQ DERXW WKH VWXG\V PHWKRGV DQG DSSURDFK GHWDLOV RQ WKHVH DUH SUHVHQWHG LQ WKH QH[W FKDSWHU RQ WKH ILUVW JUDGH VWXG\ DQG ODWHU FKDSWHUV IRFXV PRVWO\ RQ WKH ILQGLQJV 5HDGHUV DUH HQFRXUDJHG WR UHDG WKH VHFRQG FKDSWHU WR IDPLOLDUL]H WKHPVHOYHV ZLWK GHWDLOV DERXW WKH PHWKRGV $SSHQGL[HV $ DQG % UHSRUW RQ WKH VWXG\V GDWD FROOHFWLRQ DSSURDFK DQG LWV UHVSRQVH UDWHV IRU WKH YDULRXV W\SHV RI GDWD LW FROOHFWHG PHWKRGV LW XVHG WR HVWLPDWH HIIHFWLYHQHVV DQG ILQGLQJV IURP DQDO\VHV XVLQJ DOWHUQDWLYH HVWLPDWRUV DQG RWKHU WHVWV $SSHQGL[ % DOVR SUHVHQWV

7KH &RPPRQ &RUH RI 'DWD &&' DQQXDOO\ FROOHFWV ILVFDO DQG QRQILVFDO GDWD DERXW DOO SXEOLF VFKRROV SXEOLF VFKRRO GLVWULFWV DQG VWDWH HGXFDWLRQ DJHQFLHV LQ WKH 8QLWHG 6WDWHV ,QIRUPDWLRQ DERXW LW FDQ EH IRXQG DW KWWSQFHVHGJRYFFG 7KH LQIRUPDWLRQ XVHG LQ WKH VWXG\ ZDV UHSRUWHG E\ WKH &&' IRU WKH  VFKRRO \HDU
8

, ,QWURGXFWLRQ

16 WKH IXOO VHW RI HVWLPDWHV IURP WKH PDLQ SURGXFWHIIHFWLYHQHVV PRGHOV IRU UHDGHUV ZKR ZDQW WR H[DPLQH WKH GHWDLOHG UHVXOWV 7KH UHSRUW EDVHG RQ D VHFRQG \HDU RI GDWD ZLOO IRFXV RQ ZKHWKHU DQ DGGLWLRQDO \HDU RI H[SHULHQFH XVLQJ UHDGLQJ DQG PDWKHPDWLFV VRIWZDUH SURGXFWV LV DVVRFLDWHG ZLWK JUHDWHU HIIHFWLYHQHVV )LQGLQJV ZLOO DOVR EH UHSRUWHG IRU LQGLYLGXDO SURGXFWV

, ,QWURGXFWLRQ

&KDSWHU ,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

KLV FKDSWHU SUHVHQWV ILQGLQJV RQ WKH LPSOHPHQWDWLRQ RI ILUVW JUDGH UHDGLQJ VRIWZDUH SURGXFWV HIIHFWV RQ VWXGHQW WHVW VFRUHV DQG WKH UHODWLRQVKLSV EHWZHHQ HIIHFWV DQG FRQGLWLRQV DQG SUDFWLFHV UHODWHG WR SURGXFW XVH 7KH ILUVW JUDGH VWXG\ LQFOXGHG ILYH UHDGLQJ VRIWZDUH SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ  GLVWULFWV DQG  VFKRROV 7KH VDPSOH LQFOXGHG  WHDFKHUV DQG  VWXGHQWV 7KH ILYH SURGXFWV ZHUH 'HVWLQDWLRQ 5HDGLQJ SXEOLVKHG E\ 5LYHUGHHS WKH :DWHUIRUG (DUO\ 5HDGLQJ 3URJUDP SXEOLVKHG E\ 3HDUVRQ 'LJLWDO /HDUQLQJ +HDGVSURXW SXEOLVKHG E\ +HDGVSURXW 3ODWR )RFXV SXEOLVKHG E\ 3ODWR DQG WKH $FDGHP\ RI 5HDGLQJ SXEOLVKHG E\ $XWRVNLOO (IIHFWV ZHUH HVWLPDWHG XVLQJ D KLHUDUFKLFDO OLQHDU PRGHO +/0 LQ ZKLFK VWXGHQWV ZHUH QHVWHG LQ FODVVURRPV DQG VFKRROV %HFDXVH RI WKH VWXG\V H[SHULPHQWDO GHVLJQ WHVW VFRUH GLIIHUHQFHV EHWZHHQ FODVVURRPV XVLQJ SURGXFWV DQG FODVVURRPV QRW XVLQJ SURGXFWV FDQ EH DWWULEXWHG WR WKH SURGXFWV DIWHU DOORZLQJ IRU VDPSOLQJ YDULDELOLW\ 7KH DQDO\VLV UHOLHG RQ WHVWV DGPLQLVWHUHG WR VWXGHQWV LQ IDOO DQG VSULQJ DV ZHOO DV RQ GDWD IURP VWXGHQW UHFRUGV WHDFKHU TXHVWLRQQDLUHV DQG WKH &RPPRQ &RUH RI 'DWD IRU VFKRRO FKDUDFWHULVWLFV 7KH KLHUDUFKLFDO OLQHDU PRGHO DOVR ZDV XVHG WR H[DPLQH FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV FRUUHODWHG ZLWK HIIHFWV 7KH VWXG\V GHVLJQ GRHV QRW VXSSRUW FDXVDO VWDWHPHQWV WKDW WKHVH FKDUDFWHULVWLFV GHWHUPLQH HIIHFWV 'LVWULFWV DQG VFKRROV ZHUH QRW UDQGRPO\ DVVLJQHG WR XVH SDUWLFXODU SURGXFWV ,QVWHDG WKH\ VHOHFWHG SURGXFWV WKH\ EHOLHYHG ZHUH VXLWDEOH IRU WKHLU QHHGV 7KH XQFRQWUROOHG VHOHFWLRQ FRXOG DFFRXQW IRU WKH PHDVXUHG FRUUHODWLRQV +RZHYHU H[DPLQLQJ WKH FRUUHODWLRQV LV XVHIXO DV DQ LQGLFDWLRQ RI ZKHWKHU HIIHFWLYHQHVV PLJKW YDU\ ZLWK FRQGLWLRQV DQG SUDFWLFHV HYHQ LI WKH SDUWLFXODU PHFKDQLVPV SURGXFLQJ WKH YDULDWLRQ FDQQRW EH HVWDEOLVKHG $ ,PSOHPHQWDWLRQ $QDO\VLV 7KH PDLQ TXHVWLRQV DGGUHVVHG LQ WKH LPSOHPHQWDWLRQ DQDO\VLV ZHUH  :KDW GR SURGXFWV GR"  +RZ PXFK ZHUH SURGXFWV XVHG DQG KRZ GLG WHDFKHUV XVH WKHP" DQG  +RZ GLG SURGXFWV DIIHFW FODVVURRP DFWLYLWLHV RU UROHV" 7R DQVZHU WKHVH TXHVWLRQV WKH VWXG\ FROOHFWHG GDWD LQ VL[ DUHDV IHDWXUHV RI WKH SURGXFWV LQ WKH VWXG\ WHDFKHU WUDLQLQJ DQG

18 VXSSRUW RQ XVLQJ SURGXFWV WKH GXUDWLRQ H[WHQW DQG ORFDWLRQ RI SURGXFW XVH WHFKQLFDO GLIILFXOWLHV LQ XVLQJ SURGXFWV UROH RI SURGXFWV LQ WKH FXUULFXOXP DQG WKH HIIHFWV WKDW SURGXFW XVH KDG RQ FODVVURRP DFWLYLWLHV 7KH ILUVW WKUHH DUHDV UHODWH WR SURGXFWV DV FRPSXWHUEDVHG WRROV DQG WKH IRXUWK DQG ILIWK UHODWH WR SURGXFWV DV LQVWUXFWLRQDO VXSSRUWV 7KH VL[WK DUHD UHODWHV WR KRZ SURGXFWV PD\ KDYH FKDQJHG ZKDW WHDFKHUV DQG VWXGHQWV ZHUH GRLQJ LQ FODVVURRPV DQG KRZ WKH\ ZHUH LQWHUDFWLQJ 3URGXFW )HDWXUHV 8QGHUVWDQGLQJ WKH FKDUDFWHULVWLFV RI WKH UHDGLQJ VRIWZDUH SURGXFWV LV XVHIXO DV D FRQWH[W IRU WKH ILQGLQJV 7KH ILYH UHDGLQJ SURGXFWV LQ WKH ILUVW JUDGH VWXG\ DOO SURYLGH WXWRULDOV DQG SUDFWLFH LQ HDUO\ UHDGLQJ VNLOOV 6NLOOV FRYHUHG E\ WKH VRIWZDUH LQFOXGH OHWWHU UHFRJQLWLRQ SKRQHPLF DZDUHQHVV ZRUGUHFRJQLWLRQ DQG ZRUGDWWDFN VNLOOV YRFDEXODU\ EXLOGLQJ DQG WH[W FRPSUHKHQVLRQ 0RVW RI WKH SURGXFWV SURYLGH VWXGHQWV ZLWK RSSRUWXQLWLHV WR UHDG GLIIHUHQW NLQGV RI WH[W LQFOXGLQJ LQIRUPDWLRQDO WH[W ILFWLRQ DQG SRHWU\ 7KH VWXG\ HVWLPDWHG WKH DYHUDJH OLFHQVLQJ IHHV IRU WKH SURGXFWV WR EH DERXW  D VWXGHQW IRU WKH VFKRRO \HDU ZLWK D UDQJH RI  WR  6WXG\ VWDII DVVHVVHG SURGXFW IHDWXUHV UHODWHG WR ILYH EURDG DUHDV RI LQVWUXFWLRQDO GHVLJQ WKDW DUH FRPPRQO\ XVHG LQ WKH ILHOG  WXWRULDO RSSRUWXQLWLHV  SUDFWLFH RSSRUWXQLWLHV  LQGLYLGXDOL]DWLRQ  IHHGEDFN WR WHDFKHUV DQG  IHHGEDFN WR VWXGHQWV 7KHVH FDWHJRULHV DOVR DUH FRQVLVWHQW ZLWK YHQGRU VWDWHPHQWV DERXW WKHLU SURGXFWV VXFK DV WKDW WKH SURGXFW VXSSRUWV LQGLYLGXDOL]DWLRQ RI OHDUQLQJ RU SURYLGHV VWXGHQWV ZLWK SUDFWLFH RSSRUWXQLWLHV WR VXSSOHPHQW LQVWUXFWLRQ 3URGXFW IHDWXUHV ZHUH DVVHVVHG EDVHG RQ D FRGLQJ JXLGH GHYHORSHG E\ WKH VWXG\ WHDP 7ZR FRGHUV LQGHSHQGHQWO\ UHYLHZHG SURGXFWV DQG FDWHJRULHV IRU ZKLFK LQWHUFRGHU DJUHHPHQW ZDV  SHUFHQW RU JUHDWHU ZHUH UHWDLQHG )RU UDWLQJV RQ ZKLFK LQLWLDO FRGHUV GLVDJUHHG D WKLUG FRGHU UHYLHZHG WKH SURGXFW DQG PDGH D GHWHUPLQDWLRQ 2QO\ FRPSXWHUEDVHG LQVWUXFWLRQDO FRPSRQHQWV ZHUH DVVHVVHG 6RPH SURGXFWV LQFOXGHG WH[W FRPSRQHQWV WKDW ZHUH QRW DVVHVVHG :LWKLQ WKH FDWHJRULHV RI WKH ILYH PDLQ IHDWXUHV WKH VWXG\ WHDP DVVHVVHG PRUH GHWDLOHG DVSHFWV RI SURGXFW GHVLJQ )RU LQGLYLGXDOL]DWLRQ DQG IRU VWXGHQW IHHGEDFN SURGXFWV ZHUH DVVHVVHG IRU WKHLU IHDWXUHV ZLWKLQ WKUHH PRGHV WXWRULDO SUDFWLFH RU DVVHVVPHQW ,Q WXWRULDO PRGH VWXGHQWV DUH EHLQJ LQVWUXFWHG RQ D VNLOO RU FRQFHSW WKDW LV GHILQHG H[SODLQHG RU GHPRQVWUDWHG E\ WKH SURGXFW ,Q SUDFWLFH PRGH VWXGHQWV DQVZHU TXHVWLRQV RU VROYH SUREOHPV LQ D VNLOO DUHD IRU ZKLFK WKH\ UHFHLYHG LQVWUXFWLRQ HLWKHU RII RU RQ WKH FRPSXWHU ,Q DVVHVVPHQW PRGH VWXGHQWV DQVZHU TXHVWLRQV RU VROYH SUREOHPV RQ LQVWUXFWLRQ WKH\ KDYH UHFHLYHG DQG SURGXFWV WDOO\ UHVSRQVHV WR DVVHVV SHUIRUPDQFH RU PDVWHU\ RI WKH FRQWHQW RU VNLOO )XUWKHU ZLWKLQ LQGLYLGXDOL]DWLRQ SURGXFWV FRXOG VHTXHQFH PRGXOHV DXWRPDWLFDOO\ RU DOORZ WHDFKHUV RU VWXGHQWV WR VHOHFW PRGXOHV WR FUHDWH D OHDUQLQJ SDWK WKURXJK WKH SURGXFW IRU HDFK RI WKH WKUHH PRGHV 7KH WKUHH W\SHV RI LQGLYLGXDOL]DWLRQ DQG WKH WKUHH PRGHV LQWHUDFW WR FUHDWH QLQH SRVVLEOH FDWHJRULHV 6LPLODUO\ IRU WKH RSSRUWXQLWLHV IHDWXUH SURGXFWV FRXOG SURYLGH GLIIHUHQW OHYHOV RI RSSRUWXQLWLHV LQ WZR PRGHV WXWRULDO DQG SUDFWLFH OHDGLQJ WR WZR FDWHJRULHV )RU WHDFKHU IHHGEDFN WKH WHDP DVVHVVHG ZKHWKHU WKH IHHGEDFN ZDV DERXW VWXGHQW PDVWHU\ VWXGHQW OHDUQLQJ SDWKV RU FODVVURRP SHUIRUPDQFH )RU VWXGHQW IHHGEDFN WKH WHDP ,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

19 DVVHVVHG ZKHWKHU IHHGEDFN ZDV LPPHGLDWH PDVWHU\ DQG GLDJQRVWLF DQG ZKHWKHU LW RFFXUUHG LQ SUDFWLFH DQG DVVHVVPHQW PRGHV )HHGEDFN RIWHQ LV FLWHG DV DQ LPSRUWDQW DVSHFW RI LQVWUXFWLRQ %DQJHUW'URZQV HW DO  %ODFN DQG :LOLDP  %XWOHU  &URRNV  .OXJHU DQG GH1LVL  DQG OHDUQLQJ WKHRULVWV KDYH VWUHVVHG WKH LPSRUWDQFH RI GLDJQRVWLF IHHGEDFN WKDW JRHV EH\RQG ZKHWKHU VWXGHQWV JRW DQVZHUV ULJKW %UDQVIRUG HW DO  7DEOH ,, VXPPDUL]HV DVVHVVPHQWV RI WKH LQVWUXFWLRQDO IHDWXUHV RI WKH ILYH SURGXFWV $OO SURYLGHG IRU LQGLYLGXDOL]HG LQVWUXFWLRQ WKH FDSDELOLW\ WR VHW LQGLYLGXDO VWXGHQW OHDUQLQJ SDWKV GHSHQGLQJ RQ D VWXGHQWV VNLOO OHYHO KDG QXPHURXV WXWRULDO FRPSRQHQWV DQG SUDFWLFH RSSRUWXQLWLHV DQG SURYLGHG IHHGEDFN WR VWXGHQWV GXULQJ SUDFWLFH 6RPH SURGXFWV DOVR SURYLGHG IHHGEDFN GXULQJ DVVHVVPHQW DFWLYLWLHV $OO SURYLGHG UHSRUWV WR WHDFKHUV IRU WKH RYHUDOO FODVV DQG IRU HDFK VWXGHQW VHSDUDWHO\ IRU WKH GLIIHUHQW SURGXFW PRGXOHV 2QH SURGXFW DOVR SURYLGHG UHSRUWV RI VWXGHQW UHVSRQVHV WR LQGLYLGXDO TXHVWLRQV 7KUHH SURGXFWV SURYLGHG UHFRPPHQGDWLRQV DERXW PRGXOHV WR ZKLFK LQGLYLGXDO VWXGHQWV VKRXOG SURJUHVV EDVHG RQ WKHLU SHUIRUPDQFH

([KLELW ,, +RZ 3URGXFW )HDWXUHV :HUH $VVHVVHG 3URGXFW IHDWXUHV ZHUH DVVHVVHG EDVHG RQ D FRGLQJ JXLGH GHYHORSHG E\ WKH VWXG\ WHDP 7ZR FRGHUV LQGHSHQGHQWO\ UHYLHZHG SURGXFWV DQG FDWHJRULHV ZHUH LQFOXGHG LI LQWHUFRGHU DJUHHPHQW ZDV  SHUFHQW RU JUHDWHU )RU UDWLQJV RQ ZKLFK LQLWLDO FRGHUV GLVDJUHHG D WKLUG FRGHU UHYLHZHG WKH SURGXFW DQG PDGH D GHWHUPLQDWLRQ ,QWHUFRGHU UHOLDELOLW\ ZDV UHDFKHG IRU ILYH LQVWUXFWLRQDO IHDWXUHV   7XWRULDO 2SSRUWXQLWLHV $FWLYLWLHV LQ ZKLFK VWXGHQWV UHFHLYH LQVWUXFWLRQ LQ D VNLOO RU FRQFHSW 3UDFWLFH 2SSRUWXQLWLHV $FWLYLWLHV LQ ZKLFK VWXGHQWV SUDFWLFH DQVZHULQJ TXHVWLRQV RU VROYLQJ SUREOHPV LQ D VNLOO DUHD IRU ZKLFK WKH\ KDG UHFHLYHG VRPH LQVWUXFWLRQ HLWKHU RQ RU RII WKH FRPSXWHU ,QGLYLGXDOL]DWLRQ 7KH GHJUHH WR ZKLFK WKH SURGXFW DOORZV IRU LQGLYLGXDO OHDUQLQJ SDWKV WR EH VSHFLILHG DXWRPDWLFDOO\ RU E\ WKH WHDFKHU RU VWXGHQW )HHGEDFN WR 7HDFKHUV ,QIRUPDWLRQ WHDFKHUV UHFHLYH IURP WKH SURGXFW DERXW VWXGHQW PDVWHU\ RI FRQFHSWV RU VNLOOV )HHGEDFN WR 6WXGHQWV ,QIRUPDWLRQ VWXGHQWV UHFHLYH IURP WKH SURGXFW DERXW WKHLU OHYHO RI XQGHUVWDQGLQJ RU PDVWHU\ RI D FRQFHSW RU VNLOO GXULQJ WXWRULDOV SUDFWLFH RU DVVHVVPHQWV

  

2QO\ FRPSXWHUEDVHG LQVWUXFWLRQDO FRPSRQHQWV ZHUH DVVHVVHG VRPH SURGXFWV KDG QRQFRPSXWHUEDVHG FRPSRQHQWV WKDW ZHUH QRW DVVHVVHG

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

7DEOH,,,QVWUXFWLRQDO)HDWXUHVRI)LUVW*UDGH5HDGLQJ3URGXFWV

20

,QGLYLGXDOL]DWLRQD )HHGEDFNWR7HDFKHUV 6WXGHQW,QSXW 7 3 $ 6WXGHQW 0DVWHU\ 3 $ 3 /HDUQLQJ 3DWKV &ODVVURRP 3HUIRUPDQFH $ ,PPHGLDWH 0DVWHU\ )HHGEDFNWR6WXGHQWVE $XWRPDWLF 7 3 $ 7 3 $ 7HDFKHU,QSXW

'LDJQRVWLF 3 $

3URGXFW 0DQ\ 0DQ\ 0DQ\ 0DQ\ 0DQ\

7XWRULDO 2SSRUWXQLWLHV

3UDFWLFH 2SSRUWXQLWLHV

0DQ\

$ %

0DQ\

9 9 9 9 9 9 9 9 9

&

0DQ\

'

0DQ\

0DQ\

6RXUFH6WDIIUHYLHZ

9 9 9 9 9

9 9 9 9 9 9 9 9 9 9 9 9

9 9 9 9 9

9 9 9 9 9 9 9 9

9 9 9 9 9

9 9 9 9 9

9 9

9 9 9 9

7 7XWRULDOPRGH3 3UDFWLFHPRGH$ $VVHVVPHQWPRGH

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

,PPHGLDWHIHHGEDFN/HDUQHUWROGZKHWKHUUHVSRQVHLVFRUUHFWLPPHGLDWHO\DIWHUFRPSOHWLQJPRGXOH'LDJQRVWLFIHHGEDFN/HDUQHUUHFHLYHVKLQWVRURWKHULQIRUPDWLRQFRQFHUQLQJWKHSUREDEOH VRXUFHRIHUURU0DVWHU\IHHGEDFN/HDUQHULQIRUPHGRIWKHQXPEHUFRUUHFWDQGZKHWKHUDVNLOORUFRQFHSWKDVEHHQDFTXLUHGPDVWHUHGDIWHUFRPSOHWLQJDVHTXHQFHRILWHPV/HDUQHUFDQUHWXUQ WRPLVVHGLWHPV

21 7HDFKHU 7UDLQLQJ DQG 6XSSRUW 3URGXFW YHQGRUV WUDLQHG WHDFKHUV ZKR ZRXOG EH LPSOHPHQWLQJ WKH SURGXFWV RQ KRZ WR XVH WKHP 7UDLQLQJ JHQHUDOO\ WRRN SODFH LQ WKH KRVW GLVWULFWV DQG VRPHWLPHV WKH KRVW VFKRROV GXULQJ VXPPHU RU HDUO\ IDOO RI  7UDLQLQJ WRSLFV LQFOXGHG FODVVURRP PDQDJHPHQW FXUULFXOXP DQG VWDQGDUGV DOLJQPHQW DQG JHQHUDOO\ WHDFKHUV KDG RSSRUWXQLWLHV WR SUDFWLFH XVLQJ WKH SURGXFWV 1HDUO\ DOO WHDFKHUV  SHUFHQW DWWHQGHG WKH LQLWLDO WUDLQLQJ DFFRUGLQJ WR DWWHQGDQFH ORJV 2Q DYHUDJH YHQGRUV SURYLGHG DERXW RQH GD\ RI WUDLQLQJ  KRXUV YDU\LQJ IURP  WR  KRXUV DFURVV SURGXFWV 9HQGRUV DOVR SURYLGHG VXSSRUW GXULQJ WKH VFKRRO \HDU 0RGHV IRU RQJRLQJ VXSSRUW LQFOXGHG HPDLO RU WHOHSKRQH KHOS GHVNV  SHUFHQW RI WHDFKHUV UHSRUWHG UHFHLYLQJ WKLV NLQG RI KHOS SURGXFW UHSUHVHQWDWLYHV YLVLWLQJ WHDFKHUV  SHUFHQW DQG DGGLWLRQDO WUDLQLQJ DW VFKRROV  SHUFHQW 7KH QHHG IRU VXFK DGGLWLRQDO VXSSRUW LV VXJJHVWHG E\ WKH ILQGLQJ WKDW E\ WKH WLPH RI WKH ILUVW FODVVURRP REVHUYDWLRQ JHQHUDOO\ DERXW PLGIDOO ZKHQ PRVW WHDFKHUV KDG EHJXQ WR XVH SURGXFWV WKH SURSRUWLRQ RI WHDFKHUV LQGLFDWLQJ WKDW WKH LQLWLDO WUDLQLQJ KDG DGHTXDWHO\ SUHSDUHG WKHP KDG GHFOLQHG IURP  SHUFHQW DW WKH HQG RI WKH LQLWLDO WUDLQLQJ WR  SHUFHQW ,Q DGGLWLRQ WR HQVXULQJ WKDW WHDFKHUV UHFHLYHG WUDLQLQJ WKH VWXG\ WHDP ZRUNHG ZLWK GLVWULFWV WR LGHQWLI\ KDUGZDUH DQG VRIWZDUH QHHGV VXFK DV FRPSXWHUV KHDGSKRQHV PHPRU\ DQG RSHUDWLQJ V\VWHP XSJUDGHV DQG WKH VWXG\ SXUFKDVHG WKH XSJUDGHV DV QHHGHG &RPPRQ XSJUDGHV LQFOXGHG GHVNWRS DQG ODSWRS FRPSXWHUV VHUYHUV PHPRU\ DQG KHDGSKRQHV 7KH VWXG\ GLG QRW XSJUDGH QHWZRUNLQJ LQIUDVWUXFWXUHV WKRXJK VRPH SXUFKDVHV RI VHUYHUV HQDEOHG SURGXFWV WR RSHUDWH PRUH VPRRWKO\ RQ ORFDO QHWZRUNV $V QRWHG LQ WKH SUHYLRXV FKDSWHU SURYLGLQJ KDUGZDUH DQG VRIWZDUH XSJUDGHV PD\ KDYH FRQWULEXWHG WR KLJKHU OHYHOV RI PHDVXUHG HIIHFWLYHQHVV LI GLVWULFWV QRUPDOO\ ZRXOG QRW KDYH EHHQ DEOH WR SXUFKDVH WKH XSJUDGHV 7KH VWXG\ GLG QRW SURYLGH VRIWZDUH RU KDUGZDUH VXSSRUW IRU FRQWURO JURXS WHDFKHUV 6WXG\ REVHUYHUV QRWHG WKDW ILUVW JUDGH WUHDWPHQW WHDFKHUV DYHUDJHG DERXW VL[ FRPSXWHUV SHU FODVVURRP FODVVHV KDG DYHUDJH DWWHQGDQFH RI  VWXGHQWV :KHQ SURGXFWV ZHUH XVHG LQ VFKRRO ODEV WKHUH ZDV W\SLFDOO\ EXW QRW DOZD\V D FRPSXWHU IRU HYHU\ VWXGHQW :LWK WKH DGGLWLRQDO WHFKQRORJ\ SURYLGHG E\ WKH VWXG\ LQ SULQFLSOH WKH QXPEHU RI RSHUDEOH FRPSXWHUV DSSHDUHG DGHTXDWH IRU VWXGHQWV WR UHDFK UHFRPPHQGHG OHYHOV RI SURGXFW XVH 'XUDWLRQ DQG ([WHQW RI 3URGXFW 8VH $OO WUHDWPHQW WHDFKHUV XVHG WKH DVVLJQHG SURGXFW WR VRPH GHJUHH DQG VRPH SURGXFWV ZHUH XVHG KHDYLO\ GXULQJ WKH VFKRRO \HDU 5HVHDUFKHUV DVNHG WHDFKHUV +RZ RIWHQ KRZ PDQ\ VHVVLRQV SHU ZHHN DQG IRU KRZ PDQ\ PLQXWHV SHU ZHHN GRHV D W\SLFDO VWXGHQW XVH WKH SURGXFW" 7DEOH ,, VKRZV WKH KRXUV WKDW VWXGHQWV ZHUH H[SRVHG WR VWXG\ SURGXFWV LQ WUHDWPHQW FODVVURRPV RU WR WKH PRVW IUHTXHQWO\ XVHG RWKHU WHFKQRORJ\EDVHG UHDGLQJ SURGXFW LQ ERWK WUHDWPHQW DQG FRQWURO FODVVURRPV EDVHG RQ WHDFKHU UHSRUWV

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

22
7DEOH ,, 7HDFKHU5HSRUWHG 8VH RI 6WXG\ 3URGXFWV DQG 2WKHU 5HDGLQJ 6RIWZDUH 3URGXFWV )LUVW *UDGH 6WXG\ 3URGXFWV 7UHDWPHQW *URXS 3HUFHQW RI WHDFKHUV XVLQJ D SURGXFW 0LQXWHV RI ZHHNO\ XVH +RXUV RI DQQXDO XVH 6DPSOH VL]H

2WKHU 5HDGLQJ 3URGXFWV SYDOXHD  QD QD 7UHDWPHQW *URXS     &RQWURO *URXS     SYDOXHD   

&RQWURO *URXS      

   

6RXUFHV &ODVVURRP REVHUYDWLRQV WHDFKHU LQWHUYLHZV

D

7HVWV RI GLIIHUHQFH ZHUH FRQGXFWHG XVLQJ WZROHYHO KLHUDUFKLFDO PRGHOV ZLWK D WHDFKHU OHYHO DQG D VFKRRO OHYHO ZLWK WKH WUHDWPHQW HIIHFW DW OHYHO RQH DQG EHWZHHQVFKRRO YDULDQFH DW OHYHO WZR 7KH SYDOXH LV WKH VPDOOHVW OHYHO RI VLJQLILFDQFH DW ZKLFK WKH QXOO K\SRWKHVLV WKDW WKH GLIIHUHQFH LV ]HUR FDQ EH UHMHFWHG QRW DSSOLFDEOH

  6DPSOH LV WRR VPDOO WR FRPSXWH PHDQV QD

&RQWURO DQG WUHDWPHQW WHDFKHUV FRXOG XVH SURGXFWV RWKHU WKDQ WKRVH LQ WKH VWXG\ DQG 7DEOH ,, VKRZV WKH H[WHQW WR ZKLFK WKH\ GLG $ERXW  SHUFHQW RI FRQWURO WHDFKHUV UHSRUWHG XVLQJ VRPH RWKHU SURGXFW SRVVLEO\ PRUH WKDQ RQH DQG DYHUDJH XVH IRU WKH FRQWURO JURXS DV D ZKROH LQFOXGLQJ WHDFKHUV ZKR GLG QRW XVH SURGXFWV ZDV  KRXUV D \HDU 7KH PRVW FRPPRQO\ XVHG RWKHU SURGXFWV ZHUH UHDGLQJ SUDFWLFH RU DVVHVVPHQW SURGXFWV RQH ZDV D SURGXFW DYDLODEOH RQ WKH :HE DW QR FRVW ,Q FRQWUDVW  SHUFHQW RI WUHDWPHQW WHDFKHUV UHSRUWHG XVLQJ D SURGXFW RWKHU WKDQ WKH RQH LQ WKH VWXG\ DQG DYHUDJH XVH IRU DOO WUHDWPHQW WHDFKHUV ZDV DERXW  KRXUV D \HDU 7KH VXP RI XVH RI ERWK W\SHV RI SURGXFWV SURGXFWV LQ WKH VWXG\ DQG SURGXFWV QRW LQ WKH VWXG\ ZDV  KRXUV D \HDU IRU WUHDWPHQW WHDFKHUV YHUVXV  KRXUV D \HDU IRU FRQWURO WHDFKHUV 7KH GLIIHUHQFH LQ SURGXFW XVH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHUV YDULHG E\ GLVWULFW DQG VFKRRO )LJXUH ,, 6RPH VFKRROV KDG GLIIHUHQFHV RI  KRXUV RU IHZHU ZKHUHDV RWKHUV KDG GLIIHUHQFHV RI  KRXUV RU PRUH 1R VFKRROV KDG QHJDWLYH GLIIHUHQFHV ZKLFK ZRXOG DULVH LI FRQWURO WHDFKHUV XVHG RWKHU SURGXFWV PRUH WKDQ WUHDWPHQW WHDFKHUV XVHG WKH VWXG\ SURGXFW DQG RWKHU SURGXFWV WKRXJK RQH VFKRRO KDG D GLIIHUHQFH WKDW ZDV FORVH WR ]HUR 8VDJH GLIIHUHQFHV DOVR DUH HYLGHQW EHWZHHQ GLVWULFWV )RU H[DPSOH WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHU WHFKQRORJ\ XVDJH ZDV UHODWLYHO\ ODUJH LQ GLVWULFW  FRPSDUHG WR GLVWULFWV  DQG  &RUUHODWLRQV EHWZHHQ XVDJH DQG SURGXFW HIIHFWV ZLOO EH H[DPLQHG ODWHU LQ WKH FKDSWHU 'DWD IURP SURGXFW UHFRUGV RQ VWXGHQW XVDJH DOVR SURYLGHG LQIRUPDWLRQ DERXW SURGXFW XVH )RXU RI WKH ILYH ILUVW JUDGH SURGXFWV LQFOXGHG GDWDEDVHV WKDW WUDFNHG WKH WLPH ZKHQ VWXGHQWV ZHUH ORJJHG RQ VRPH SURGXFWV WUDFNHG XVDJH PRUH FORVHO\ JDWKHULQJ GDWD RQ HYHU\ UHVSRQVH DQG NH\VWURNH $QDO\VLV RI WKHVH GDWD LQGLFDWHG WKDW ZKHQ VWXGHQWV XVHG SURGXFWV WKHLU XVDJH DYHUDJHG DERXW  PLQXWHV D GD\ DQG  KRXUV D \HDU 7DEOH ,, 8VDJH YDULHG

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

23

)LJXUH,, 'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI5HDGLQJ7HFKQRORJ\3URGXFW8VH%HWZHHQ 7UHDWPHQWDQG&RQWURO&ODVVURRPV )LUVW*UDGH

    +RXUV  
1

9 3 3 8 8 8 8 7 9 9 9 9 9 10 10 10 11 11 12 13 14 14 14 14 7 6 5 5 6 6

4 2 2 2

13 13

14

  6FKRROV*URXSHGE\'LVWULFW

1XPEHUVLQGLFDWHGLVWULFWVDQGHDFKSRLQWUHSUHVHQWVDVFKRRO

6RXUFH7HDFKHU,QWHYLHZV

7DEOH ,, 'DLO\ DQG $QQXDO 8VDJH )URP 3URGXFW 5HFRUGV 3URGXFW $ 7RWDO GD\V XVHG GXULQJ VFKRRO \HDU 0LQXWHV RI GDLO\ XVH ZKHQ XVHG +RXUV RI DQQXDO XVH    3URGXFW %    3URGXFW &    3URGXFW '    2YHUDOO   

6RXUFH 3URGXFW GDWD RQ XVDJH 2QH SURGXFW GLG QRW FROOHFW LQIRUPDWLRQ RQ VWXGHQW XVDJH 2YHUDOO XVDJH LV SURGXFW XVDJH ZHLJKWHG E\ VWXGHQW VDPSOH VL]HV

DFURVV SURGXFWV IURP  PLQXWHV D GD\ WR  PLQXWHV DQG DQQXDO XVDJH YDULHG IURP  KRXUV WR  KRXUV )RU D W\SLFDO GD\ VFKRRO \HDU DYHUDJH GDLO\ XVDJH LV DERXW  PLQXWHV IRU DOO SURGXFWV FRPELQHG $VVXPLQJ WKDW UHDGLQJ LV WDXJKW LQ D PLQXWH EORFN SURGXFWV ZHUH XVHG IRU DERXW  SHUFHQW RI WRWDO UHDGLQJ LQVWUXFWLRQ WLPH 8QOLNH SURGXFW UHSRUWV RI XVDJH WHDFKHU UHSRUWV RI XVDJH DUH DYDLODEOH IRU DOO SURGXFWV DQG FRPSOHWHQHVV LV D XVHIXO IHDWXUH IRU ODWHU DQDO\VHV 7HDFKHU UHSRUWV DERXW XVDJH DUH PRUH LQFOXVLYH WKDQ SURGXFW XVDJH ZKLFK LV DFWXDO VWXGHQW ORJJHGLQ WLPH 7KH\ FDQ GLIIHU EHFDXVH RI VWXGHQW DEVHQWHHLVP FRPSXWHU RU QHWZRUN SUREOHPV DQG VWXGHQWV ZRUNLQJ WRJHWKHU
0XOWLSO\LQJ WRWDO GD\V RI XVDJH  E\ PLQXWHV XVHG  \LHOGV  PLQXWHV RI DQQXDO XVH ZKLFK LV GLYLGHG E\  WR DUULYH DW DYHUDJH XVH RI  PLQXWHV SHU DFWXDO VFKRRO GD\

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

24 XQGHU D VLQJOH ORJLQ +RZHYHU FRUUHODWLRQV EHWZHHQ WKH WZR PHDVXUHV ZHUH KLJK FRUUHODWLRQ FRHIILFLHQWV ZHUH  DQG  IRU ZHHNO\ DQG DQQXDO XVDJH DQG WKH KLJK FRUUHODWLRQV SURYLGH D EDVLV IRU XVLQJ WHDFKHU UHSRUWV RI XVDJH LQ WKH HIIHFWLYHQHVV DQDO\VLV ODWHU LQ WKH FKDSWHU 7KH OHYHOV RI XVDJH IRXQG KHUH UHODWH WR WHDFKHUV XVLQJ SURGXFWV IRU WKH ILUVW WLPH DQG ZLWKLQ D QDWLRQDO VWXG\ %RWK ILUVWWLPH XVDJH DQG WKH SUHVHQFH RI WKH VWXG\ FRXOG KDYH DIIHFWHG XVDJH FRPSDUHG WR W\SLFDO OHYHOV RI XVDJH :KHWKHU WHDFKHUV XVH SURGXFWV PRUH DV WKH\ DUH PRUH H[SHULHQFHG LV EHLQJ H[DPLQHG LQ WKH VHFRQG \HDU RI WKH VWXG\ +RZ WKH VWXG\ LWVHOI DIIHFWHG XVDJH LV QRW NQRZQ 7KH VWXG\ PD\ KDYH LQFUHDVHG XVDJH EHFDXVH LW SXUFKDVHG KDUGZDUH DQG VRIWZDUH XSJUDGHV ZLWKRXW QHHGLQJ WR JR WKURXJK GLVWULFW SURFXUHPHQW SURFHVVHV 7HDFKHUV UHFHLYHG KRQRUDULD IRU DWWHQGLQJ WUDLQLQJ RQ KRZ WR XVH SURGXFWV DQG QHDUO\ DOO WHDFKHUV DWWHQGHG WUDLQLQJ $OVR WKH VWXG\ WHDP SURYLGHG IHHGEDFN WR GHYHORSHUV DERXW DQ\ SUREOHPV RU LVVXHV HQFRXQWHUHG ZLWK WKH SURGXFW GXULQJ FODVVURRP YLVLWV LI WHDFKHUV DVNHG WKHP GR VR 2Q WKH RWKHU KDQG GLVWULFWV GLG QRW LQYHVW WKHLU RZQ UHVRXUFHV LQ SXUFKDVLQJ SURGXFWV DQG WUDLQLQJ WHDFKHUV ZKLFK FRXOG KDYH UHGXFHG XVDJH EHFDXVH GLVWULFWV GLG QRW KDYH D VWDNH LQ WKH SURGXFWV 7HFKQLFDO 'LIILFXOWLHV 6WXG\ REVHUYHUV QRWHG WHFKQLFDO SUREOHPV GXULQJ FODVVURRP REVHUYDWLRQV LQ DERXW  SHUFHQW RI WKH WLPH VHJPHQWV WKH\ REVHUYHG DQ REVHUYDWLRQ FRQVLVWHG RI IRXU WR ILYH WLPH VHJPHQWV ZLWKLQ D FODVV SHULRG 0RVW SUREOHPV ODVWHG RQO\ D VKRUW WLPH DQG DIIHFWHG RQO\ D IHZ VWXGHQWV &RPPRQ SUREOHPV LQYROYHG ORJJLQJ RQ WR SURGXFWV FRPSXWHUV IUHH]LQJ DQG QHHGLQJ WR EH UHERRWHG DQG WURXEOH ZLWK SHULSKHUDO KDUGZDUH VXFK DV KHDGSKRQHV 6DWLVIDFWLRQ ZLWK 3URGXFWV 1HDUO\ DOO WHDFKHUV  SHUFHQW VDLG WKH\ ZRXOG XVH WKH SURGXFW LQ WKH QH[W VFKRRO \HDU LI JLYHQ WKH FKRLFH :KHQ DVNHG ZKDW WKH\ ZRXOG FKDQJH  SHUFHQW VDLG WKH\ ZRXOG IRFXV RQ FODVVURRP PDQDJHPHQW LVVXHV UHODWHG WR SURGXFW XVH  SHUFHQW VDLG WKH\ ZRXOG QRW FKDQJH DQ\WKLQJ  SHUFHQW VDLG WKH\ ZRXOG VWDUW XVLQJ SURGXFWV HDUOLHU LQ WKH VFKRRO \HDU DQG  SHUFHQW VDLG WKH\ ZRXOG PRQLWRU VWXGHQW SURJUHVV PRUH FORVHO\ 5ROH RI 3URGXFWV DQG 7LPH DQG 3ODFH RI 8VH 5HDGLQJ VRIWZDUH SURGXFWV JHQHUDOO\ IXQFWLRQHG DV VXSSOHPHQWV WR WKH UHDGLQJ FXUULFXOXP )RXU SURGXFWV ZHUH H[SUHVVO\ GHVLJQHG DV VXSSOHPHQWV DQG  SHUFHQW RI WUHDWPHQW WHDFKHUV LQGLFDWHG WKH\ XVHG SURGXFWV DV VXSSOHPHQWV 2QH SURGXFW FRXOG EH XVHG DV HLWKHU D VXSSOHPHQW WR D UHDGLQJ SURJUDP RU DV D FRUH UHDGLQJ SURJUDP WKRXJK DOO WUHDWPHQW WHDFKHUV XVHG LW DV D VXSSOHPHQW 7HDFKHUV YDULHG LQ KRZ WKH\ VFKHGXOHG SURGXFW XVH -XVW RYHU D WKLUG  SHUFHQW VFKHGXOHG SURGXFW XVH H[FOXVLYHO\ GXULQJ UHJXODU FODVV WLPH  SHUFHQW VFKHGXOHG XVH GXULQJ RWKHU WLPHV VXFK DV EHIRUH VFKRRO OXQFKWLPH RU WLPH XVXDOO\ VHW DVLGH IRU VFLHQFH RU VRFLDO VFLHQFH DQG WKH ODUJHVW JURXS SHUFHQWVFKHGXOHG XVH ERWK GXULQJ FODVV WLPH ,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

25 DQG DW RWKHU WLPHV 0RVW WHDFKHUV  SHUFHQW XVHG SURGXFWV LQ UHJXODU FODVVURRPV DQG  SHUFHQW RI WHDFKHUV XVHG SURGXFWV LQ D FRPSXWHU ODE 9HQGRUV VWUHVVHG WKH LPSRUWDQFH RI WHDFKHUV EHLQJ SUHVHQW WR RIIHU DVVLVWDQFH RU NHHS VWXGHQWV RQ WDVN UDWKHU WKDQ UHO\LQJ RQ ODE PRQLWRUV RU SDUDSURIHVVLRQDOV 1HDUO\ DOO ILUVW JUDGH WUHDWPHQW WHDFKHUV  SHUFHQW UHSRUWHG EHLQJ SUHVHQW ZKHQ WKHLU VWXGHQWV XVHG SURGXFWV 9HQGRUV DOVR VWUHVVHG WKH LPSRUWDQFH RI UHYLHZLQJ SURGXFW UHSRUWV RQ VWXGHQW SHUIRUPDQFH  SHUFHQW RI WHDFKHUV UHSRUWHG UHYLHZLQJ UHSRUWV WZR WR WKUHH WLPHV D PRQWK RU PRUH IUHTXHQWO\ DQG  SHUFHQW UHSRUWHG UHYLHZLQJ SHUIRUPDQFH UHSRUWV RQFH D ZHHN RU PRUH ,PSDFW RQ &ODVVURRP $FWLYLWLHV 3UHYLRXV VWXGLHV KDYH UHSRUWHG WKDW WHFKQRORJ\ FDQ FKDQJH WKH UROH RI WHDFKHUV +RQH\ DQG +HQULTXH]  /LQQ DQG +VL  6DQGKROW] HW DO  7KLV UROH FKDQJH LV VRPHWLPHV YLHZHG DV WKH GHVLUHG RXWFRPH ZLWK WHDFKHUV HQFRXUDJHG QRW WR VSHQG WLPH GLVSHQVLQJ LQIRUPDWLRQ WKH VDJH RQ WKH VWDJH EXW LQVWHDG WR DFW DV D IDFLOLWDWRU WKH JXLGH RQ WKH VLGH KHOSLQJ VWXGHQWV RU VPDOO JURXSV ZKR DUH HQJDJHG LQ WKHLU RZQ OHDUQLQJ WDVNV %HFDXVH WKH VDPH REVHUYDWLRQ SURWRFRO ZDV XVHG IRU WUHDWPHQW DQG FRQWURO FODVVURRPV WKH VWXG\ FRXOG FRQWUDVW FODVVURRP DFWLYLWLHV WR DVVHVV ZKHWKHU SURGXFWV DIIHFWHG WKH DFWLYLWLHV 'XULQJ REVHUYDWLRQ LQWHUYDOV WHDFKHUV ZHUH FODVVLILHG DV OHDGHUV IDFLOLWDWRUV PRQLWRUV VFDQQLQJ WKH FODVV WR GHWHFW DQ\ EHKDYLRUDO LVVXHV RU RWKHUZLVH HQJDJHG 7DEOH ,, VKRZV WKDW GXULQJ REVHUYDWLRQ LQWHUYDOV WKH WLPH SHULRGV GXULQJ ZKLFK REVHUYHUV QRWHG WHDFKHU UROHV  SHUFHQW RI REVHUYDWLRQV LQ WUHDWPHQW FODVVURRPV FRGHG WKH WHDFKHUV UROH DV IDFLOLWDWLQJ FRPSDUHG WR  SHUFHQW RI FRQWURO FODVVURRP REVHUYDWLRQV S   3URGXFWV DOVR FKDQJHG WKH W\SLFDO DFWLYLW\ LQ ZKLFK VWXGHQWV ZHUH HQJDJHG 6WXGHQWV ZHUH PRUH OLNHO\ WR EH HQJDJHG LQ LQGLYLGXDO ZRUN GXULQJ WUHDWPHQW FODVVURRP REVHUYDWLRQV WKDQ GXULQJ FRQWURO FODVVURRP REVHUYDWLRQV S   6WXGHQWV LQ FRQWURO FODVVHV ZHUH PRUH OLNHO\ WR EH OLVWHQLQJ WR D WHDFKHU RU SDUWLFLSDWLQJ LQ D TXHVWLRQ DQG DQVZHU VHVVLRQ GLUHFWHG E\ WKH WHDFKHU

7KH REVHUYDWLRQ SURWRFRO FDOOHG IRU REVHUYHUV WR REVHUYH SHULRGV GXULQJ ZKLFK WUHDWPHQW WHDFKHUV ZHUH XVLQJ UHDGLQJ SURGXFWV 7R WKH H[WHQW SRVVLEOH FRQWURO FODVVURRPV ZHUH REVHUYHG GXULQJ WKH VDPH WLPH SHULRG WKDW WUHDWPHQW WHDFKHUV ZHUH XVLQJ SURGXFWV )RU H[DPSOH LI WUHDWPHQW WHDFKHUV LQ D SDUWLFXODU VFKRRO XVHG WKH SURGXFW GXULQJ WKH ODVW KDOI RI WKH UHDGLQJ SHULRG REVHUYHUV DWWHPSWHG WR REVHUYH FRQWURO FODVVURRPV GXULQJ WKH ODVW KDOI RI WKH UHDGLQJ SHULRG ,I REVHUYHUV KDG REVHUYHG FODVVURRPV DW UDQGRP WLPHV UDWKHU WKDQ ZKHQ SURGXFWV ZHUH XVHG WKH GLIIHUHQFHV VKRZQ LQ WKH WDEOH PD\ KDYH EHHQ VPDOOHU EHFDXVH SURGXFWV ZRXOG QRW EH LQ XVH GXULQJ VRPH RI WKH REVHUYDWLRQV
10

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

26 3UHYLRXV VWXGLHV KDYH REVHUYHG WKDW VWXGHQWV PD\ EH PRUH DFDGHPLFDOO\ IRFXVHG ZKHQ ZRUNLQJ RQ FRPSXWHUV -R\QHU  6ZDQ HW DO  7DEOH ,, VKRZV WKDW WKH SURSRUWLRQ RI WUHDWPHQW DQG FRQWURO FODVVURRP REVHUYDWLRQV LQ ZKLFK PRUH WKDQ  SHUFHQW RI VWXGHQWV ZHUH RQ WDVN ZDV KLJK RYHUDOO DQG DERXW WKH VDPH  SHUFHQW RI WUHDWPHQW FODVVURRPV DQG  SHUFHQW RI FRQWURO FODVVURRPV
7DEOH ,, $FWLYLWLHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )LUVW *UDGH 3HUFHQWDJH RI 2EVHUYDWLRQ ,QWHUYDOV 7UHDWPHQW &ODVVURRPV 7HDFKHU 5ROH 3HUFHQWE /HDGHU )DFLOLWDWRU 0RQLWRUREVHUYHU :RUNLQJ RQ RWKHU WDVNV 2WKHU ,QVWUXFWLRQDO $FWLYLW\ 3HUFHQWE ,QGLYLGXDO ZRUN /HFWXUH 4XHVWLRQ DQG DQVZHU 5HYLHZ RI VWXGHQW ZRUN 2WKHU 6WXGHQW 2Q7DVN %HKDYLRU 3HUFHQW 3HUFHQW RI WLPH LQWHUYDOV ZLWK PRUH WKDQ  SHUFHQW RI VWXGHQWV RQ WDVN 6DPSOH 6L]H 1XPEHU RI FODVVURRPV 1XPEHU RI REVHUYDWLRQV           &RQWURO &ODVVURRPV           SYDOXHD     !     !

  

  

!

6RXUFH &ODVVURRP REVHUYDWLRQV DW PLQXWHV   DQG  IRU HDFK FODVV
D

7HVWV RI GLIIHUHQFH ZHUH FRQGXFWHG XVLQJ WZROHYHO KLHUDUFKLFDO PRGHOV ZLWK D WHDFKHU OHYHO DQG D VFKRRO OHYHO ZLWK WKH WUHDWPHQW HIIHFW DW OHYHO RQH DQG EHWZHHQVFKRRO YDULDQFH DW OHYHO WZR 7KH SYDOXH LV WKH VPDOOHVW OHYHO RI VLJQLILFDQFH DW ZKLFK WKH QXOO K\SRWKHVLV WKDW WKH GLIIHUHQFH LV ]HUR FDQ EH UHMHFWHG ,I WKH SYDOXH LV OHVV WKDQ  WKH GLIIHUHQFH LV VLJQLILFDQW DW WKH  SHUFHQW OHYHO ,I WKH SYDOXH LV OHVV WKDQ  WKH GLIIHUHQFH LV VLJQLILFDQW DW WKH  SHUFHQW OHYHO DQG VR RQ 2EVHUYHUV FRGHG DOO WKDW DSSO\ 1XPEHUV FDQ DGG WR PRUH WKDQ  SHUFHQW

$QRWKHU DVSHFW RI LQVWUXFWLRQ LV WKH DPRXQW RI WLPH DOORWWHG IRU UHDGLQJ LQVWUXFWLRQ ZKLFK LV ZLWKLQ WKH FRQWURO RI WHDFKHUV WR VRPH GHJUHH DQG FRXOG EH LQIOXHQFHG E\ WKH XVH RI VWXG\ SURGXFWV 7KH VWXG\ DVNHG WUHDWPHQW DQG FRQWURO WHDFKHUV WR HVWLPDWH KRZ PXFK WLPH
2EVHUYHUV HVWLPDWHG WKH SURSRUWLRQ RI VWXGHQWV ZKR ZHUH GRLQJ VRPHWKLQJ RWKHU WKDQ WKH DVVLJQHG DFDGHPLF WDVN GXULQJ D RQHPLQXWH VHJPHQW XVLQJ FDWHJRULHV VXFK DV ZDONLQJ DURXQG WKH FODVVURRP IRU UHDVRQV XQUHODWHG WR WKH WDVN WDONLQJ ZLWK RWKHU VWXGHQWV RQ WRSLFV XQUHODWHG WR WKH WDVN WDONLQJ ZLWK RWKHU VWXGHQWV ZKLOH WKH WHDFKHU ZDV DGGUHVVLQJ WKH ZKROH FODVV VLWWLQJ DW WKH FRPSXWHU IRU ORQJ SHULRGV ZLWK QR LQWHUDFWLRQV ZLWK NH\ERDUG RU PRXVH RU VOHHSLQJ RU KDYLQJ WKHLU KHDGV RQ WKHLU GHVNV

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

27 WKH\ VSHQW RQ UHDGLQJ LQVWUXFWLRQ 7UHDWPHQW WHDFKHUV UHSRUWHG VSHQGLQJ DQ DYHUDJH RI  KRXUV D ZHHN FRPSDUHG WR  KRXUV RQ DYHUDJH IRU FRQWURO WHDFKHUV 7KH GLIIHUHQFH RI  KRXUV ZDV QRW VWDWLVWLFDOO\ VLJQLILFDQW S  % (IIHFWV RQ 5HDGLQJ 7HVW 6FRUHV $ FHQWUDO TXHVWLRQ IRU WKH VWXG\ LV ZKHWKHU SURGXFWV UHVXOWHG LQ KLJKHU WHVW VFRUHV (IIHFWV RQ WHVW VFRUHV ZHUH HVWLPDWHG XVLQJ D PRGHO WKDW DFFRXQWHG IRU WKH QHVWLQJ RI VWXGHQWV LQ FODVVURRPV DQG FODVVURRPV LQ VFKRROV 7KH HVWLPDWHV VKRZ WKDW HIIHFWV RQ WHVW VFRUHV JHQHUDOO\ ZHUH QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR DQG WKDW PRVW WHDFKHU DQG VFKRRO FKDUDFWHULVWLFV ZHUH XQFRUUHODWHG ZLWK HIIHFWV 'LIIHUHQW HVWLPDWLRQ DSSURDFKHV \LHOGHG VLPLODU HVWLPDWHV ,Q WZR GLVWULFWV IRU ZKLFK GLVWULFW WHVW VFRUHV ZHUH DYDLODEOH XVH RI GLVWULFW WHVW VFRUHV UDWKHU WKDQ WKH VWXG\DGPLQLVWHUHG WHVW DV WKH PHDVXUH RI DFKLHYHPHQW \LHOGHG VLPLODU UHVXOWV $SSHQGL[ % SURYLGHV GHWDLOV RI WKH UREXVWQHVV DQDO\VLV &KDUDFWHULVWLFV RI 7UHDWPHQW DQG &RQWURO 7HDFKHUV DQG 6WXGHQWV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 7KH VWXG\ UDQGRPO\ DVVLJQHG WHDFKHUV WR WUHDWPHQW DQG FRQWURO JURXSV :KHWKHU UDQGRP DVVLJQPHQW DFKLHYHG LWV REMHFWLYH FDQ EH DVVHVVHG E\ H[DPLQLQJ EDVHOLQH FKDUDFWHULVWLFV RI WHDFKHUV LQ WKH WZR JURXSV 7DEOH ,, VKRZV WHDFKHU FKDUDFWHULVWLFV DQG SYDOXHV RI WHVWV RI HTXLYDOHQFH $IWHU DFFRXQWLQJ IRU PXOWLSOH FRPSDULVRQV QRQH RI WKH WHDFKHU GLIIHUHQFHV LV VWDWLVWLFDOO\ VLJQLILFDQW +RZHYHU DOO WKH FKDUDFWHULVWLFV DUH HQWHUHG LQWR PRGHOV WR DGMXVW IRU UHPDLQLQJ GLIIHUHQFHV 7KH VWXG\ GLG QRW UDQGRPO\ DVVLJQ VWXGHQWV WR WHDFKHUV EXW 7DEOH ,, VKRZV WKDW VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH VLPLODU RQ IDOO WHVW VFRUHV DJH DQG JHQGHU $IWHU DFFRXQWLQJ IRU PXOWLSOH FRPSDULVRQV QRQH RI WKH GLIIHUHQFHV LV VLJQLILFDQW 6WDQGDUG VFRUHV IRU WKH 72:5( WHVW ZKLFK DYHUDJHG DERXW  SODFH VWXGHQWV LQ DERXW WKH WK SHUFHQWLOH QDWLRQDOO\ KLJKHU WKDQ WKHLU SHUIRUPDQFH RQ WKH 6(6$7 ZKHUH WKH DYHUDJH VWXGHQWV ZHUH DW DERXW WKH WK SHUFHQWLOH 7KH VLPSOH FRUUHODWLRQ EHWZHHQ VFRUHV ZDV DERXW  7KHVH GLIIHUHQFHV PD\ DULVH EHFDXVH RI GLIIHUHQFHV LQ ZKDW LV EHLQJ WHVWHG GLIIHUHQFHV LQ KRZ WKH WHVW LV FRQGXFWHG WKH 72:5( LV RQH RQ RQH DQG WKH 6(6$7 LV DGPLQLVWHUHG LQ JURXSV RU GLIIHUHQFHV LQ WKH QRUP VDPSOHV RQ ZKLFK WKH SHUFHQWLOHV DUH EDVHG

7KH IDOO WHVW ZDV DGPLQLVWHUHG DIWHU WKH VFKRRO \HDU ZDV XQGHUZD\ DQG LQ SULQFLSOH VFRUHV FRXOG KDYH EHHQ DIIHFWHG E\ WKH XVH RI SURGXFWV 7KH IDFW WKDW WKH DYHUDJH WUHDWPHQW JURXS VFRUH ZDV QRW VWDWLVWLFDOO\ GLIIHUHQW IURP WKH DYHUDJH FRQWURO JURXS VFRUH VXJJHVWV WKDW WKH XVH RI SURGXFWV GLG QRW KDYH PXFK LI DQ\ HIIHFW RQ IDOO VFRUHV
12

$ UHFHQW VWXG\ WKDW H[DPLQHG LQWHUYHQWLRQV IRU VWUXJJOLQJ UHDGHUV DGPLQLVWHUHG D YDULHW\ RI UHDGLQJ WHVWV DQG DOVR IRXQG WKDW VWXGHQW SHUFHQWLOH UDQNLQJV YDULHG GHSHQGLQJ RQ WKH WHVW 6HH KWWSZZZPDWKHPDWLFD PSUFRPSXEOLFDWLRQV3')V&75*H[HFSGI
13

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

28
7DEOH ,, &KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )LUVW *UDGH 7UHDWPHQW &ODVVURRPV 7HDFKHU &KDUDFWHULVWLFV 7HDFKLQJ H[SHULHQFH \HDUV +DV D PDVWHUV GHJUHH SHUFHQW 6FKRRO KDV FRPSXWHU VSHFLDOLVW SHUFHQW 5HFHLYHG SURIHVVLRQDO GHYHORSPHQW RQ XVLQJ WHFKQRORJ\ ODVW \HDU SHUFHQW )HPDOH SHUFHQW 7HDFKHU 6DPSOH 6L]H 6WXGHQW &KDUDFWHULVWLFV )HPDOH SHUFHQW $JH DV RI 2FWREHU  \HDUV 8QDGMXVWHG VFRUH RQ IDOO 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ VWDQGDUG VFRUH 8QDGMXVWHG VFRUH RQ IDOO 6$7 5HDGLQJ 7HVW 1&( 6WXGHQW 6DPSOH 6L]H
6RXUFHV

&RQWURO &ODVVURRPV           

SYDOXH RI WKH 'LIIHUHQFHD     

          

   

7HDFKHU TXHVWLRQQDLUH VWXGHQW UHFRUGV DQG WHVWV DGPLQLVWHUHG E\ VWXG\ VWDII

1RWH 0XOWLSOHFRPSDULVRQV WHVWLQJ XVHG WKH %HQMDPLQL+RFKEHUJ SURFHGXUH ZLWK VHSDUDWH WHVWV IRU ILYH WHDFKHU FKDUDFWHULVWLFV DQG IRXU VWXGHQW FKDUDFWHULVWLFV
D

7HVWV RI WUHDWPHQW DQG FRQWURO GLIIHUHQFHV ZHUH FRQGXFWHG XVLQJ D WZROHYHO KLHUDUFKLFDO PRGHO ZLWK FODVVURRP WUHDWPHQW VWDWXV DV D IL[HG HIIHFW DQG VFKRRO DV D UDQGRP HIIHFW IRU WHDFKHUV DQG FODVVURRPV DQG VFKRROV DV UDQGRP HIIHFWV IRU VWXGHQWV 7KH SYDOXH RI WKH GLIIHUHQFH VKRZQ LQ WKH WDEOH LV WKH SYDOXH RI WKH HVWLPDWHG WUHDWPHQW FRHIILFLHQW

(IIHFWV :HUH 1RW 6WDWLVWLFDOO\ 'LIIHUHQW IURP =HUR (IIHFWV ZHUH HVWLPDWHG XVLQJ D WKUHHOHYHO KLHUDUFKLFDO OLQHDU PRGHO 7KH PDLQ RXWFRPH DW WKH ILUVW OHYHO LV WKH VSULQJ WHVW VFRUH ZKLFK LV UHODWHG WR VWXGHQW FKDUDFWHULVWLFV DJH JHQGHU DQG WKH IDOO VFRUH 7KH VHFRQG OHYHO LV D PRGHO RI D FODVVURRPV DYHUDJH WHVW VFRUH DV D IXQFWLRQ RI FODVVURRP FKDUDFWHULVWLFV PRVW LPSRUWDQWO\ D WUHDWPHQW LQGLFDWRU RI ZKHWKHU D FODVVURRP ZDV UDQGRPO\ DVVLJQHG WR XVH D SURGXFW 7KH WKLUG OHYHO LV D PRGHO RI WKH VFKRROV DYHUDJH WHVW VFRUH DV D IXQFWLRQ RI VFKRRO FKDUDFWHULVWLFV VXFK DV SURSRUWLRQ RI VWXGHQWV UHFHLYLQJ IUHH RU UHGXFHGSULFH OXQFK UDFH DQG HWKQLF FRPSRVLWLRQ DQG WKH SURSRUWLRQ RI VWXGHQWV UHFHLYLQJ VSHFLDO HGXFDWLRQ VHUYLFHV 7KHVH VFKRRO FKDUDFWHULVWLFV DOVR DUH VWXGHQW FKDUDFWHULVWLFV EXW QHDUO\ FRPSOHWH GDWD IURP WKH &RPPRQ &RUH RI 'DWD ZHUH DYDLODEOH IRU WKHVH LWHPV ZKHUHDV WKH VWXG\V HIIRUWV WR FROOHFW WKH VDPH LWHPV IURP VFKRRO UHFRUGV IRU LQGLYLGXDO VWXGHQWV UHVXOWHG LQ JDSV DQG PLVVLQJ GDWD

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

29 7DEOH ,, VKRZV VFRUH GLIIHUHQFHV IRU WKH RYHUDOO 6$7 UHDGLQJ WHVW DQG LWV WKUHH VXEWHVWV DQG IRU WKH RYHUDOO 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ DQG LWV WZR VXEWHVWV 1RQH RI WKH GLIIHUHQFHV LV VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR (IIHFW VL]HV DUH LQ WKH UDQJH RI  WR 
Table II.6. Spring Reading Test Score Differences in Treatment and Control Classrooms, First Grade. 7UHDWPHQW &ODVVURRP $YHUDJH 6FRUH 6WDQIRUG $FKLHYHPHQW 7HVW 1LQWK (GLWLRQ 1&( 2YHUDOO VFRUH 6XEWHVW VFRUHV 6RXQGV DQG OHWWHUV :RUG UHDGLQJ 6HQWHQFH UHDGLQJ 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 6WDQGDUG 6FRUH 2YHUDOO VFRUH 6XEWHVW VFRUHV 3KRQHPLF GHFRGLQJ HIILFLHQF\ 6LJKW ZRUG HIILFLHQF\
1RWH

&RQWURO &ODVVURRP $YHUDJH 6FRUH

'LIIHUHQFH

(IIHFW 6L]H

SYDOXH

   

   

   

   

   

  

  

  

  

  

6HH $SSHQGL[ % IRU GHWDLOV RI WKH HVWLPDWLRQ PRGHO 9DULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU KH RU VKH KDG D PDVWHUV GHJUHH VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ SHUFHQW HOLJLEOH IRU IUHH OXQFK DQG VWXGHQW FODVVURRP DQG VFKRRO UDQGRP HIIHFWV 7KH WUHDWPHQW FODVVURRP DYHUDJH VFRUH UHSRUWHG LQ WKH WDEOH LV WKH FRQWURO FODVVURRP DYHUDJH VFRUH SOXV WKH WUHDWPHQW HIIHFW ,W GLIIHUV IURP WKH XQDGMXVWHG WUHDWPHQW FODVVURRP VFRUH

7KH VWXG\ H[DPLQHG ZKHWKHU SURGXFWV UHGXFHG WKH SURSRUWLRQ RI VWXGHQWV ZKR ZHUH ORZ VFRUHUV RQ WKH 6$7 E\ FUHDWLQJ DQ LQGLFDWRU RI ZKHWKHU D VWXGHQW IHOO LQ WKH ORZHU WKLUG RI VFRUHV DQG HVWLPDWLQJ D WKUHHOHYHO PRGHO ZLWK WKDW LQGLFDWRU DV WKH RXWFRPH :KHWKHU WKH VWXGHQW ZDV EHORZ WKH UG SHUFHQWLOH RQ WKH SUHWHVW ZDV XVHG DV D FRYDULDWH DORQJ ZLWK WKH

7KH PDLQ PRGHO HVWLPDWHG D VLQJOH HIIHFW IRU DOO ILYH SURGXFWV E\ LQFOXGLQJ DQ LQGLFDWRU WKDW D VWXGHQW ZDV LQ D WUHDWPHQW FODVVURRP UHJDUGOHVV RI WKH SURGXFW XVHG LQ WKH FODVVURRP 7KLV DSSURDFK HVVHQWLDOO\ DYHUDJHV LQGLYLGXDO SURGXFW HIIHFWV ZLWK ZHLJKWV WKDW DUH SURSRUWLRQDO WR WKH QXPEHU RI FODVVURRPV WKDW SURGXFWV KDYH LQ WKH VWXG\ 3URGXFWV ZLWK PRUH FODVVURRPV FRQWULEXWH PRUH WR WKH HVWLPDWHG HIIHFW
14

(IIHFW VL]HV DUH FDOFXODWHG E\ GLYLGLQJ WKH VFRUH GLIIHUHQFH VKRZQ LQ WKH WDEOH E\ WKH VWDQGDUG GHYLDWLRQ RI WKH GLVWULEXWLRQ RI VSULQJ WHVW VFRUHV IRU WKH IXOO FRQWURO JURXS 6HH $SSHQGL[ 7DEOH $D IRU VWDQGDUG GHYLDWLRQV.
15

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

30 VDPH VHW RI YDULDEOHV XVHG IRU WKH VFRUH PRGHO DERYH 7KH UHVXOWV LQGLFDWHG WKDW SURGXFWV GLG QRW KDYH D VWDWLVWLFDOO\ VLJQLILFDQW HIIHFW RQ ZKHWKHU VWXGHQWV ZHUH ORZ VFRUHUV 7DEOH ,,
7DEOH ,, (IIHFW RQ 3HUFHQW RI 6WXGHQWV LQ /RZHVW 7KLUG RI 5HDGLQJ 7HVW 6FRUH 7UHDWPHQW &ODVVURRP 3HUFHQWDJH 3HUFHQW RI VWXGHQWV EHORZ UG SHUFHQWLOH RI VSULQJ UHDGLQJ WHVW
1RWH

&RQWURO &ODVVURRP 3HUFHQWDJH 

'LIIHUHQFH 

(IIHFW 6L]H 

SYDOXH 



2WKHU YDULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU KH RU VKH KDG D PDVWHUV GHJUHH VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ SHUFHQW HOLJLEOH IRU IUHH OXQFK DQG VWXGHQW FODVVURRP DQG VFKRRO UDQGRP HIIHFWV 7KH WUHDWPHQW FODVVURRP SHUFHQWDJH UHSRUWHG LQ WKH WDEOH LV WKH FRQWURO FODVVURRP SHUFHQWDJH SOXV WKH WUHDWPHQW HIIHFW ,W GLIIHUV IURP WKH XQDGMXVWHG WUHDWPHQW SHUFHQWDJH 7KH HIIHFW VL]H LV FDOFXODWHG XVLQJ WKH &R[ ,QGH[ WKH ORJ RGGV UDWLR GLYLGHG E\ 

)LJXUHV ,, DQG ,, GHSLFW WKH YDULDWLRQ RI VFKRRO HIIHFW VL]HV IRU GLVWULFWV DQG SURGXFWV )RU H[DPSOH LQ GLVWULFW  HIIHFW VL]HV UDQJHG IURP DOPRVW  WR QHDUO\  DFURVV WKH VL[ VFKRROV LQ WKH GLVWULFW $Q DQDO\VLV RI YDULDQFH LQGLFDWHV WKDW  SHUFHQW RI WKH YDULDELOLW\ RI WKH HIIHFW VL]H LV ZLWKLQ GLVWULFWV DQG  SHUFHQW LV EHWZHHQ GLVWULFWV &ODVVURRP DQG 6FKRRO 0RGHUDWRUV &ODVVURRP DQG VFKRRO FKDUDFWHULVWLFV PD\ KHOS H[SODLQ WKH YDULDELOLW\ RI HIIHFWV REVHUYHG LQ )LJXUH ,, 7KH PRGHUDWLQJ HIIHFW RI WKHVH FKDUDFWHULVWLFV ZDV LQYHVWLJDWHG E\ LQWHUDFWLQJ WKH WUHDWPHQW LQGLFDWRU ZLWK FODVVURRP FKDUDFWHULVWLFV DW WKH VHFRQG OHYHO DQG DGGLQJ DQ HTXDWLRQ WR WKH PRGHOV WKLUG OHYHO WKDW VSHFLILHG WKH WUHDWPHQW HIIHFW DV D IXQFWLRQ RI VFKRRO FKDUDFWHULVWLFV 7KH DPRXQW RI WLPH WHDFKHUV UHSRUWHG XVLQJ VWXG\ SURGXFWV VKRZQ LQ 7DEOH ,, DOVR ZDV LQFOXGHG LQ WKH PRGHO DV ZDV WKH DPRXQW RI WLPH WHDFKHUV UHSRUWHG XVLQJ RWKHU SURGXFWV 2WKHU LPSOHPHQWDWLRQ IDFWRUV LQFOXGHG LQ WKH PRGHO ZHUH  ZKHWKHU D WHDFKHU KDG DGHTXDWH WLPH WR SUHSDUH IRU SURGXFW XVH  ZKHWKHU WKH WHDFKHU LQGLFDWHG

7ZROHYHO PRGHOV DOVR ZHUH HVWLPDWHG IRU VWXGHQWV LQ HDFK TXDUWLOH EDVHG RQ WKH IDOO VFRUH WR DVVHVV SURGXFW HIIHFWV DFURVV WKH DFKLHYHPHQW GLVWULEXWLRQ (VWLPDWHG HIIHFW DQG SYDOXHV IRU WKH IRXU TXDUWLOHV ZHUH       DQG  


6FKRRO HIIHFWV ZHUH HVWLPDWHG XVLQJ D UHJUHVVLRQ PRGHO LQ ZKLFK WHVW VFRUHV DUH UHJUHVVHG RQ VWXGHQW DQG WHDFKHU FKDUDFWHULVWLFV DQG WKH WUHDWPHQW LQGLFDWRU LV LQWHUDFWHG ZLWK DQ LQGLFDWRU IRU HDFK VFKRRO 6WDQGDUG HUURUV ZHUH DGMXVWHG IRU FODVVURRP FOXVWHULQJ (IIHFW VL]HV IRU VFKRROV DUH FDOFXODWHG E\ GLYLGLQJ WKH VFRUH GLIIHUHQFH IRU HDFK VFKRRO E\ WKH VWDQGDUG GHYLDWLRQ RI WKH GLVWULEXWLRQ RI FRQWURO JURXS WHVW VFRUHV $Q DOWHUQDWH HIIHFW VL]H ZDV FDOFXODWHG E\ GLYLGLQJ WKH VFRUH GLIIHUHQFH IRU HDFK VFKRRO E\ WKH VWDQGDUG GHYLDWLRQ RI WKH GLVWULEXWLRQ RI FRQWURO JURXS WHVW VFRUHV IRU VWXGHQWV LQ WKDW VFKRRO 7KH DOWHUQDWH HIIHFW VL]HV VKRZ WKH VDPH SDWWHUQ EHWZHHQ VFKRROV EXW DUH PRUH YDULDEOH
17

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

31
)LJXUH,, 6FKRRO/HYHO(IIHFW6L]HVE\'LVWULFW )LUVW*UDGH6$75HDGLQJ6FRUH

        

(IIHFW6L]H

8 2 4 1 2 2 2 3 3 5 5 6 8 5 8 6 6 7 7 8

9 9 9 9 9 9 10 14 14 14 14 14 14

11 11 12

13 13 13

10 10

1XPEHUVLQGLFDWHGLVWULFWVDQGHDFKSRLQWUHSUHVHQWVDVFKRRO

)LJXUH,, 6FKRRO/HYHO(IIHFW6L]HVE\3URGXFW )LUVW*UDGH6$75HDGLQJ6FRUH

        

(IIHFW6L]H

E E A A A A A A A A A C C B B B B B C C C C C D D D D E E E E E E E E E E

/HWWHUVLQGLFDWHSURGXFWVDQGHDFKSRLQWUHSUHVHQWVDVFKRRO

1RWH 6WDWLVWLFDO VLJQLILFDQFH RI DYHUDJH HIIHFW VL]HV FDQQRW EH LQIHUUHG IURP WKH ILJXUH EHFDXVH VWXGHQW DQG WHDFKHU VDPSOH VL]HV GLIIHU EHWZHHQ VFKRROV

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

32 WKDW VWXGHQWV KDG SUREOHPV DFFHVVLQJ WKH SURGXFWV DQG  ZKHWKHU WKH WHDFKHU LQGLFDWHG WKDW WKH VFKRRO KDV D FRPSXWHU VSHFLDOLVW 7KH WKUHH PHDVXUHV ZHUH EDVHG RQ WHDFKHU UHSRUWV 7DEOH ,, VKRZV HVWLPDWHV RI WKH UHODWLRQVKLSV RI FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ZLWK SURGXFW HIIHFWV IRU WKH RYHUDOO 6$7 VFRUH DQG WKUHH VXEWHVW VFRUHV 7DEOH ,, VKRZV HVWLPDWHV IRU WKH 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 7KH WDEOHV SUHVHQW RQO\ WKH PRGHUDWRU HVWLPDWHV DQG QRW HVWLPDWHV IRU DOO YDULDEOHV LQ WKH PRGHO 3RVLWLYH FRHIILFLHQWV LQGLFDWH WKDW D FKDUDFWHULVWLF LV DVVRFLDWHG ZLWK ODUJHU WHVW VFRUH GLIIHUHQFHV EHWZHHQ WUHDWPHQW DQG FRQWURO FODVVURRPV 6WDWLVWLFDO WHVWV LQGLFDWH WKDW WKH IXOO VHW RI FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ZDV QRW FRUUHODWHG ZLWK SURGXFW HIIHFWV IRU WKH RYHUDOO 6$7 VFRUH 5HVXOWV RI VHSDUDWH WHVWV RI FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV DV GLVWLQFW VXEVHWV DUH DOVR VKRZQ DQG LQGLFDWH VLPLODU UHVXOWV $IWHU DGMXVWLQJ IRU PXOWLSOH FRPSDULVRQV RQO\ WKH VWXGHQWWHDFKHU UDWLR LV VWDWLVWLFDOO\ VLJQLILFDQW 7LPH XVLQJ VWXG\ SURGXFWV ZDV QRW UHODWHG WR HIIHFWV )RU 6$7 VXEWHVWV VWDWLVWLFDO WHVWV LQGLFDWH WKDW VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV ZHUH FRUUHODWHG ZLWK HIIHFWV IRU WKH VRXQGV DQG OHWWHUV DQG ZRUG UHDGLQJ VXEWHVWV )RU WKH ZRUG UHDGLQJ VXEWHVW WKH VWXGHQWWHDFKHU UDWLR DQG WKH SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ ZHUH LQGLYLGXDOO\ VLJQLILFDQW DIWHU DGMXVWLQJ IRU PXOWLSOH FRPSDULVRQV )RU WKH 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ QR FODVVURRP RU VFKRRO FKDUDFWHULVWLFV ZHUH FRUUHODWHG ZLWK HIIHFWV %HFDXVH WKH UHVHDUFK GHVLJQ GLG QRW UDQGRPO\ DVVLJQ SURGXFWV WR VFKRROV ZLWK GLIIHUHQW FKDUDFWHULVWLFV IDFWRUV WKDW OHG VFKRROV WR FKRRVH SDUWLFXODU SURGXFWV DQG WR KDYH SDUWLFXODU H[SHULHQFHV ZLWK WKH SURGXFWV FRXOG H[SODLQ WKH REVHUYHG FRUUHODWLRQV )RU H[DPSOH HIIHFWV ZHUH ODUJHU ZKHQ FODVVHV KDG IHZHU VWXGHQWV VPDOOHU VWXGHQWWHDFKHU UDWLRV EXW VFKRROV ZLWK VPDOOHU FODVVHV PD\ KDYH RWKHU FKDUDFWHULVWLFV VXFK DV WKHLU ORFDWLRQ KRXVHKROG LQFRPH RU DFFHVV WR WHFKQRORJ\ LQ KRPHVFKDUDFWHULVWLFV QRW PHDVXUHG LQ WKH VWXG\ WKDW PD\ EH UHODWHG WR SURGXFW HIIHFWLYHQHVV 7KH LQDELOLW\ WR UXOH RXW WKHVH DOWHUQDWLYH H[SODQDWLRQV IRU WKH REVHUYHG FRUUHODWLRQV LV D UHDVRQ WR EH FDXWLRXV LQ LQWHUSUHWLQJ WKHP & &RQFOXVLRQV 7KLV VWXG\ H[SHULPHQWDOO\ WHVWHG WKH HIIHFWV RI VHOHFWHG UHDGLQJ WHFKQRORJ\ SURGXFWV LQ ILUVW JUDGH FODVVURRPV WKDW YROXQWHHUHG WR SDUWLFLSDWH 6FKRROV SDUWLFLSDWLQJ LQ WKH VWXG\ ZHUH PRUH OLNHO\ WKDQ DYHUDJH WR EH LQ XUEDQ DUHDV DQG KDG KLJKHUWKDQDYHUDJH OHYHOV RI SRYHUW\ DQG VWXGHQWV ZKR ZHUH %ODFN RU +LVSDQLF .H\ ILQGLQJV DUH WKH IROORZLQJ  7HDFKHUV :HUH 7UDLQHG RQ WKH 3URGXFWV DQG 8VHG 7KHP 1HDUO\ DOO WUHDWPHQW WHDFKHUV  SHUFHQW UHFHLYHG WUDLQLQJ IURP WKH YHQGRU RQ KRZ WR XVH WKH SURGXFW DQG DOO RI WKHP LPSOHPHQWHG WKH SURGXFW WR VRPH GHJUHH 3URGXFWV ZHUH XVHG IRU DERXW  SHUFHQW RI WRWDO UHDGLQJ LQVWUXFWLRQ WLPH  (IIHFWV RQ 7HVW 6FRUHV :HUH 1RW 6WDWLVWLFDOO\ 'LIIHUHQW IURP =HUR 2YHUDOO UHDGLQJ VFRUHV IRU VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH  DQG  UHVSHFWLYHO\ LQ QRUPDOFXUYHHTXLYDOHQW XQLWV 7KH GLIIHUHQFH ZDV QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR ,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

33  0RVW 6FKRRO DQG &ODVVURRP &KDUDFWHULVWLFV :HUH 8QFRUUHODWHG :LWK (IIHFWV &ODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ZHUH QRW FRUUHODWHG ZLWK SURGXFW HIIHFWV IRU WKH RYHUDOO 6$7 VFRUH 7KH RQH H[FHSWLRQ ZDV WKH VWXGHQWWHDFKHU UDWLR )RU WKH VRXQGV DQG OHWWHUV DQG ZRUG UHDGLQJ VXEWHVWV FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ZHUH FRUUHODWHG ZLWK SURGXFW HIIHFWV 7KH VWXGHQWWHDFKHU UDWLR DQG WKH SHUFHQW RI VSHFLDO HGXFDWLRQ VWXGHQWV ZHUH LQGLYLGXDOO\ VLJQLILFDQW IDFWRUV 7LPH RI VWXG\ SURGXFW XVDJH GLG QRW KDYH D VWDWLVWLFDOO\ VLJQLILFDQW FRUUHODWLRQ ZLWK HIIHFWV IRU WKH RYHUDOO VFRUH RU VXEWHVW VFRUHV 1R VFKRRO RU FODVVURRP FKDUDFWHULVWLFV ZHUH FRUUHODWHG ZLWK HIIHFWV IRU WKH 7HVW RI :RUG 5HDGLQJ (IILFLHQF\

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

7DEOH,,,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV6$75HDGLQJ7HVW)LUVW*UDGH
6RXQGVDQG/HWWHUV6XEWHVW6FRUH 7RWDO6FRUH1&( VWDQGDUG FRHIILFLHQW VWDQGDUG VWDQGDUG VWDQGDUG 1&( 1&( 6FRUH1&( :RUG5HDGLQJ6XEWHVW6FRUH 6HQWHQFH5HDGLQJ6XEWHVW

                                                 

HUURU

&ODVVURRP,QWHUDFWLRQ9DULDEOHV
SYDOXH

FRHIILFLHQW

HUURU

SYDOXH

FRHIILFLHQW

HUURU

SYDOXH

FRHIILFLHQW

HUURU

SYDOXH
         

<HDUVRIWHDFKLQJH[SHULHQFH

7HDFKHULVIHPDOH

7HDFKHUKDVPDVWHUVGHJUHH

$QQXDOKRXUVRIVWXG\SURGXFWXVHLQKXQGUHGV

6WXGHQWVKDGSUREOHPVJHWWLQJDFFHVVWRSURGXFW

                          

7HDFKHUKDGDGHTXDWHWLPHWRSUHSDUHWRXVH         

SURGXFW

7HDFKHULQGLFDWHVVFKRROKDVFRPSXWHUVSHFLDOLVW

3URGXFWLVXVHGLQFODVVURRP

7HDFKHUSDUWLFLSDWHGODVW\HDULQWHFKQRORJ\

6FKRRO,QWHUDFWLRQ9DULDEOHV
                                                     

SURIHVVLRQDOGHYHORSPHQW

















     



     



     



     



     

3HUFHQWHOLJLEOHIRUIUHHOXQFK

6WXGHQWWHDFKHUUDWLR

6FKRROLVLQXUEDQDUHD

3HUFHQW$IULFDQ$PHULFDQVWXGHQWV

3HUFHQW+LVSDQLFVWXGHQWV

3HUFHQWVSHFLDOHGXFDWLRQVWXGHQWV

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

SYDOXH SYDOXH


  

SYDOXH
  


  

SYDOXH

&KL6TXDUHG7HVWV

&ODVVURRPDQGVFKRROYDULDEOHV

&ODVVURRPYDULDEOHV

6FKRROYDULDEOHV

S! S! S!

6RXUFH

$XWKRUFDOFXODWLRQV2WKHUYDULDEOHVLQWKHPRGHOLQFOXGHVWXGHQWSUHWHVWVFRUHDJHDQGJHQGHUWHDFKHUH[SHULHQFHHGXFDWLRQDQGJHQGHUDQGVFKRROUDFHHWKQLFFRPSRVLWLRQSHUFHQWIUHHOXQFK

XUEDQDUHDSHUFHQWVSHFLDOHGXFDWLRQDQGWLPHXVLQJRWKHUWHFKQRORJ\SURGXFWV

6LJQLILFDQWO\ GLIIHUHQW IURP ]HUR EDVHG RQ WKH %HQMDPLQL+RFKEHUJ FRUUHFWLRQ IRU PXOWLSOH FRPSDULVRQV ZLWK IDOVH GLVFRYHU\ UDWH RI  VHH %HQMDPLQL DQG +RFKEHUJ  7KH PXOWLSOH FRPSDULVRQV

FRUUHFWLRQLVFRPSXWHGVHSDUDWHO\IRUWKHRYHUDOOWHVWVFRUHDQGHDFKVXEWHVWVFRUHDQGIRUWKHFODVVURRPDQGVFKRROGRPDLQV

34 _________________________________________________________________

6WDWLVWLFDOO\VLJQLILFDQWDWWKHOHYHORIVLJQLILFDQFH

7DEOH,,,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV7HVWRI:RUG5HDGLQJ(IILFLHQF\)LUVW*UDGH
7RWDO6FRUH 6WDQGDUG6FRUH 6WDQGDUG6FRUH 3KRQHPLF'HFRGLQJ(IILFLHQF\ 6LJKW:RUG(IILFLHQF\ 6WDQGDUG6FRUH

VWDQGDUG FRHIILFLHQW HUURU VWDQGDUG VWDQGDUG

&ODVVURRP,QWHUDFWLRQ9DULDEOHV
SYDOXH
FRHIILFLHQW HUURU FRHIILFLHQW

SYDOXH

HUURU

SYDOXH

                                                       

       

       

<HDUVRIWHDFKLQJH[SHULHQFH

7HDFKHULVIHPDOH

7HDFKHUKDVPDVWHUVGHJUHH

$QQXDOKRXUVRIVWXG\SURGXFWXVHLQKXQGUHGV

6WXGHQWVKDGSUREOHPVJHWWLQJDFFHVVWRSURGXFW

7HDFKHUKDGDGHTXDWHWLPHWRSUHSDUHWRXVHSURGXFW

7HDFKHULQGLFDWHVVFKRROKDVFRPSXWHUVSHFLDOLVW

3URGXFWLVXVHGLQFODVVURRP

    

7HDFKHUSDUWLFLSDWHGODVW\HDULQWHFKQRORJ\SURIHVVLRQDO    

GHYHORSPHQW

6FKRRO,QWHUDFWLRQ9DULDEOHV
                       

     

     

     

     

     

3HUFHQWHOLJLEOHIRUIUHHOXQFK

6WXGHQWWHDFKHUUDWLR

6FKRROLVLQXUEDQDUHD

3HUFHQW$IULFDQ$PHULFDQVWXGHQWV

3HUFHQW+LVSDQLFVWXGHQWV

3HUFHQWVSHFLDOHGXFDWLRQVWXGHQWV

SYDOXH
  


   

SYDOXH


   

SYDOXH

&KLVTXDUHG7HVWV

&ODVVURRPDQGVFKRROYDULDEOHV

S!


&ODVVURRPYDULDEOHV

S! S!

S! S!

6FKRROYDULDEOHV

S!

6RXUFH

$XWKRU FDOFXODWLRQV 2WKHU YDULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW SUHWHVW VFRUH DJH DQG JHQGHU WHDFKHU H[SHULHQFH JHQGHU DQG HGXFDWLRQ DQG VFKRRO UDFHHWKQLFLW\ FRPSRVLWLRQ SHUFHQW RI

VWXGHQWVHOLJLEOHIRUIUHHOXQFKSHUFHQWSDUWLFLSDWLQJLQVSHFLDOHGXFDWLRQDQGSHUFHQWOLPLWHG(QJOLVKSURILFLHQW

1RHVWLPDWHVDUHVLJQLILFDQWO\GLIIHUHQWIURP]HUREDVHGRQWKH%HQMDPLQL+RFKEHUJFRUUHFWLRQIRUPXOWLSOHFRPSDULVRQVZLWKIDOVHGLVFRYHU\UDWHRIVHH%HQMDPLQLDQG+RFKEHUJ7KHPXOWLSOH

FRPSDULVRQVFRUUHFWLRQLVFRPSXWHGVHSDUDWHO\IRUWKHFODVVURRPDQGVFKRROGRPDLQV

,, (IIHFWV RI )LUVW *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

6WDWLVWLFDOO\VLJQLILFDQWDWWKHOHYHORIVLJQLILFDQFH

35

&KDSWHU ,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

KLV FKDSWHU SUHVHQWV ILQGLQJV RQ WKH LPSOHPHQWDWLRQ RI IRXUWK JUDGH UHDGLQJ VRIWZDUH SURGXFWV DQG WKHLU HIIHFWV RQ VWXGHQW WHVW VFRUHV DQG H[DPLQHV WKH UHODWLRQVKLSV EHWZHHQ WKH HIIHFWV DQG VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV 7KH VWUXFWXUH RI WKLV FKDSWHU IROORZV WKDW RI WKH SUHYLRXV RQH 7KH WHFKQRORJ\ SURGXFWV IRU WKH IRXUWK JUDGH VXEVWXG\ IRFXV PRUH RQ UHDGLQJ FRPSUHKHQVLRQ WKDQ RQ OHDUQLQJ WR GHFRGH WH[W EXW WKH VWXG\V GHVLJQ GDWD FROOHFWLRQ DSSURDFK DQG DQDO\VLV DSSURDFK ZHUH WKH VDPH 0RWLYDWLRQ IRU YDULRXV DQDO\VHV DQG PHWKRGRORJLFDO GLVFXVVLRQV DUH QRW UHSHDWHG DQG WKH UHDGHU LV UHIHUUHG WR WKH SUHYLRXV FKDSWHU IRU WKHVH GLVFXVVLRQV 7KH IRXUWK JUDGH VWXG\ LQFOXGHG IRXU UHDGLQJ SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ QLQH GLVWULFWV DQG  VFKRROV 7KH VDPSOH LQFOXGHG  WHDFKHUV DQG  VWXGHQWV 7KH IRXU SURGXFWV ZHUH /HDSIURJ SXEOLVKHG E\ /HDSWUDFN 5HDG  SXEOLVKHG E\ 6FKRODVWLF $FDGHP\ RI 5HDGLQJ SXEOLVKHG E\ $XWRVNLOO DQG .QRZOHGJHER[ SXEOLVKHG E\ 3HDUVRQ 'LJLWDO /HDUQLQJ $ ,PSOHPHQWDWLRQ $QDO\VLV 7KH LPSOHPHQWDWLRQ DQDO\VLV IRFXVHG RQ WKH VDPH VL[ DUHDV DV WKH ILUVW JUDGH VWXG\ IHDWXUHV RI WKH SURGXFWV LQ WKH VWXG\ WHDFKHU WUDLQLQJ DQG VXSSRUW WR XVH SURGXFWV WKH GXUDWLRQ H[WHQW DQG ORFDWLRQ RI SURGXFW XVH WHFKQLFDO GLIILFXOWLHV LQ XVLQJ WKHP UROH RI SURGXFWV LQ WKH FXUULFXOXP DQG WKH HIIHFWV WKDW SURGXFW XVH KDG RQ FODVVURRP DFWLYLWLHV 7KH DQDO\VLV ZDV EDVHG RQ GDWD JDWKHUHG IURP WKUHH REVHUYDWLRQV RI FODVVURRPV DQG LQWHUYLHZV ZLWK WHDFKHUV DV ZHOO DV IURP UHFRUGV FROOHFWHG IURP WKH SURGXFWV WKHPVHOYHV 3URGXFW )HDWXUHV 7KUHH RI WKH JUDGH  VWXG\ SURGXFWV SURYLGHG SUDFWLFH DQG DVVHVVPHQW JHDUHG WR VSHFLILF UHDGLQJ VNLOOV 6NLOOV FRYHUHG E\ WKHVH WKUHH SURGXFWV LQFOXGH DVSHFWV RI UHDGLQJ FRPSUHKHQVLRQ IRU H[DPSOH LGHQWLI\LQJ PDLQ LGHDV DQG DQDO\]LQJ VHWWLQJV SORWV DQG FKDUDFWHUV RI VWRULHV YRFDEXODU\ DQG OLWHUDU\ DQDO\VLV 7KH IRXUWK SURGXFW ZDV D VHUYHU EDVHG FROOHFWLRQ RI KXQGUHGV RI UHVRXUFHV WH[W SDVVDJHV YLGHR FOLSV LPDJHV LQWHUQHW VLWHV

38 VRIWZDUH PRGXOHV DQG VR RQ IURP ZKLFK WHDFKHUV FRXOG FKRRVH UHVRXUFHV FXVWRPL]HG WR WKHLU ORFDO FXUULFXOXP 7KH VWXG\ HVWLPDWHG WKH DYHUDJH OLFHQVLQJ IHHV IRU WKH SURGXFWV WR EH DERXW  D VWXGHQW IRU WKH VFKRRO \HDU ZLWK D UDQJH RI  WR  7KH WKUHH SURGXFWV ZHUH UDWHG RQ WKH ILYH IHDWXUHV GHVFULEHG LQ WKH SUHYLRXV FKDSWHU WXWRULDO RSSRUWXQLWLHV SUDFWLFH RSSRUWXQLWLHV LQGLYLGXDOL]DWLRQ IHHGEDFN WR WHDFKHUV DQG IHHGEDFN WR VWXGHQWV 7KH QDWXUH RI WKH IRXUWK SURGXFW PDGH LW LQFRPSDWLEOH ZLWK WKLV SURGXFW DVVHVVPHQW SURFHVV 7DEOH ,,, VXPPDUL]HV LQVWUXFWLRQDO IHDWXUHV IRU WKH WKUHH IRXUWK JUDGH SURGXFWV WKDW ZHUH DVVHVVHG 7KH WKUHH SURGXFWV UHFHLYHG VLPLODU UDWLQJV IRU PRVW DVSHFWV RI WKHLU LQVWUXFWLRQDO IHDWXUHV 7KH\ DOO SURYLGH LQGLYLGXDOL]HG LQVWUXFWLRQ E\ VHWWLQJ VWXGHQW OHDUQLQJ SDWKV DFFRUGLQJ WR VWXGHQW VNLOO OHYHOV 2QH SURGXFW DOVR DOORZV WHDFKHUV WR VSHFLI\ ZKLFK WXWRULDO XQLWV VWXGHQWV ZRXOG UHFHLYH $OO WKUHH SURGXFWV SURYLGH DPSOH RSSRUWXQLWLHV IRU SUDFWLFLQJ UHDGLQJ VNLOOV DQG SURYLGH LPPHGLDWH IHHGEDFN WR VWXGHQWV ZKHQ LQ SUDFWLFH PRGH 7ZR SURGXFWV JLYH IHHGEDFN WR VWXGHQWV RQ PDVWHU\ ZKHQ XVHG LQ DVVHVVPHQW PRGH $OO WKUHH SURGXFWV JLYH IHHGEDFN WR WHDFKHUV DERXW VWXGHQW SHUIRUPDQFH 7HDFKHU 7UDLQLQJ DQG 6XSSRUW 3URGXFW YHQGRUV WUDLQHG WHDFKHUV WR XVH SURGXFWV GXULQJ VXPPHU DQG HDUO\ IDOO RI  7UDLQLQJV W\SLFDOO\ ZHUH LQ WKH KRVW GLVWULFW DQG VRPHWLPHV LQ WKH KRVW VFKRROV 7KH LQLWLDO WUDLQLQJ DYHUDJHG DOPRVW  KRXUV YDU\LQJ IURP  KRXUV WR  KRXUV GHSHQGLQJ RQ WKH SURGXFW 7RSLFV LQFOXGHG FODVVURRP PDQDJHPHQW DQG DOLJQPHQW ZLWK VWDQGDUGV DQG ZLWK WKH ORFDO FXUULFXOXP WKH WUDLQLQJV DOVR JDYH WHDFKHUV WKH RSSRUWXQLW\ WR SUDFWLFH XVLQJ WKH SURGXFWV 1HDUO\ DOO WHDFKHUV  SHUFHQW DWWHQGHG WKH LQLWLDO WUDLQLQJ DFFRUGLQJ WR DWWHQGDQFH ORJV ,Q DGGLWLRQ WHDFKHUV UHFHLYHG RWKHU IRUPV RI VXSSRUW DIWHU LQLWLDO WUDLQLQJ 2Q D TXHVWLRQQDLUH FRPSOHWHG DW WKH HQG RI LQLWLDO WUDLQLQJ  SHUFHQW RI WHDFKHUV VDLG WKH\ ZHUH FRQILGHQW WKH\ FRXOG XVH WKH SURGXFW $W WKH WLPH RI WKH ILUVW FODVVURRP REVHUYDWLRQ KRZHYHU ZKHQ PRVW WHDFKHUV KDG EHJXQ WR XVH SURGXFWV  SHUFHQW WROG LQWHUYLHZHUV WKDW WKH LQLWLDO WUDLQLQJ KDG DGHTXDWHO\ SUHSDUHG WKHP WR XVH WKH SURGXFW 2QJRLQJ VXSSRUW ZDV GHOLYHUHG WKURXJK YDULRXV PRGHV 3URGXFW UHSUHVHQWDWLYHV YLVLWHG WHDFKHUV  SHUFHQW RI WHDFKHUV UHSRUWHG EHLQJ YLVLWHG E\ D UHSUHVHQWDWLYH WHDFKHUV UHFHLYHG VXSSRUW WKURXJK HPDLO RU WHOHSKRQH KHOS GHVNV  SHUFHQW RI WHDFKHUV DQG DGGLWLRQDO WUDLQLQJ ZDV SURYLGHG DW VFKRROV  SHUFHQW RI WHDFKHUV 7KH VWXG\ WHDP ZRUNHG ZLWK GLVWULFWV WR LGHQWLI\ KDUGZDUH DQG VRIWZDUH QHHGV VXFK DV FRPSXWHUV KHDGSKRQHV PHPRU\ DQG RSHUDWLQJ V\VWHP XSJUDGHV 8OWLPDWHO\ WKH QXPEHU RI RSHUDWLRQDO FRPSXWHUV VXSSRUWHG DOPRVW D RQHWRRQH UDWLR RI VWXGHQWV WR FRPSXWHUV 6WXG\ REVHUYHUV QRWHG WKDW WUHDWPHQW WHDFKHUV DYHUDJHG DOPRVW  FRPSXWHUV LQ WKHLU URRPV VHUYLQJ DQ DYHUDJH RI DERXW  IRXUWK JUDGHUV

2QH RI WKH SURGXFWV LQ WKH IRXUWK JUDGH VWXG\ ZKLFK ZDV WKH ODUJHVW LQ WHUPV RI WKH QXPEHU RI WHDFKHUV LPSOHPHQWLQJ LW SURYLGHG SRUWDEOH XQLWV IRU HDFK VWXGHQW 7KHVH XQLWV ZHUH QRW FRPSXWHUV LQ WKH XVXDO VHQVH EXW DUH FRXQWHG DV VXFK IRU RXU SXUSRVHV KHUH EHFDXVH WKH\ HQDEOHG VWXGHQWV WR XVH WKH VRIWZDUH
18

,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

7DEOH,,,,QVWUXFWLRQDO)HDWXUHVRI)RXUWK*UDGH5HDGLQJ3URGXFWV
,QGLYLGXDOL]DWLRQD )HHGEDFNWR7HDFKHUV 6WXGHQW,QSXW 7 3 $ 6WXGHQW 0DVWHU\ 3 $ 3 /HDUQLQJ 3DWKV &ODVVURRP 3HUIRUPDQFH ,PPHGLDWH 0DVWHU\ $ $XWRPDWLF 7 3 $ 7 3 $ 7HDFKHU,QSXW )HHGEDFNWR6WXGHQWVE 'LDJQRVWLF 3 $

3URGXFW 0DQ\ 0DQ\ 0DQ\

7XWRULDO 2SSRUWXQLWLHV

3UDFWLFH 2SSRUWXQLWLHV

$$

6RPH

%%

6RPH

9 9 9 9

&&

0DQ\

6RXUFH6WDIIUHYLHZ

9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9

9 9 9

9 9 9

9 9 9

9 9 9

,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

E,PPHGLDWHIHHGEDFN/HDUQHUWROGZKHWKHUUHVSRQVHLVFRUUHFWLPPHGLDWHO\DIWHUFRPSOHWLQJPRGXOH'LDJQRVWLFIHHGEDFN/HDUQHUUHFHLYHVKLQWVRURWKHULQIRUPDWLRQFRQFHUQLQJWKHSUREDEOH VRXUFHRIHUURU0DVWHU\IHHGEDFN/HDUQHULQIRUPHGRIWKHQXPEHUFRUUHFWDQGZKHWKHUDVNLOORUFRQFHSWKDVEHHQDFTXLUHG

7 7XWRULDOPRGH3 3UDFWLFHPRGH$ $VVHVVPHQWPRGH

39

40 3URGXFW 8VH 7UHDWPHQW WHDFKHUV XVHG WHFKQRORJ\ SURGXFWV PRUH WKDQ FRQWURO WHDFKHUV 7HDFKHUV UHSRUWHG XVLQJ VWXG\ SURGXFWV DERXW  WR  KRXUV D ZHHN $OO WUHDWPHQW WHDFKHUV XVHG WKHLU DVVLJQHG VWXG\ SURGXFW DQG UHSRUWHG DERXW  PLQXWHV RI ZHHNO\ XVH RU DERXW  KRXUV RI DQQXDO XVH VHH 7DEOH ,,, $ERXW  SHUFHQW RI WUHDWPHQW WHDFKHUV DOVR XVHG RWKHU SURGXFWV JHQHUDOO\ DW ORZHU OHYHOV DERXW  PLQXWHV RI ZHHNO\ XVH DQG  KRXUV RI DQQXDO XVH WKDQ WKHLU XVH RI VWXG\ SURGXFWV 1RQH RI WKH FRQWURO JURXS WHDFKHUV XVHG D VWXG\ SURGXFW EXW DERXW KDOI UHSRUWHG WKDW WKH\ XVHG DQRWKHU SURGXFW WKHLU XVDJH RI SURGXFWV ZDV ORZHU FRPSDUHG WR WUHDWPHQW WHDFKHUV DERXW  PLQXWHV RI ZHHNO\ XVH DQG  KRXUV RI DQQXDO XVH 7KH PRVW FRPPRQO\ XVHG RWKHU UHDGLQJ SURGXFWV ZHUH UHDGLQJ DVVHVVPHQW SURGXFWV DQG D SURGXFW WKDW RIIHUHG VXSSOHPHQWDO UHDGLQJ LQVWUXFWLRQ DORQJ ZLWK D WRRO IRU FUHDWLQJ UHDGLQJ DVVHVVPHQWV
7DEOH ,,, 7HDFKHU5HSRUWHG 8VH RI 6WXG\ 3URGXFWV DQG 2WKHU 5HDGLQJ 6RIWZDUH 3URGXFWV )RXUWK *UDGH 6WXG\ 3URGXFWV 7UHDWPHQW *URXS 3HUFHQW RI WHDFKHUV XVLQJ D SURGXFW 0LQXWHV RI ZHHNO\ XVH +RXUV RI DQQXDO XVH 6DPSOH VL]H

2WKHU 5HDGLQJ 3URGXFWV 7UHDWPHQW *URXS     &RQWURO *URXS     S YDOXHD   

&RQWURO *URXS  QD QD 

   

6RXUFH &ODVVURRP REVHUYDWLRQV DQG WHDFKHU LQWHUYLHZV

D

7HVWV RI GLIIHUHQFHV ZHUH GRQH XVLQJ WZROHYHO KLHUDUFKLFDO PRGHOV FODVVURRP DQG VFKRROV ZLWK WUHDWPHQW DVVLJQPHQW DW OHYHO RQH DQG EHWZHHQVFKRRO YDULDQFH DW OHYHO WZR QD QRW DSSOLFDEOH

7KH GLIIHUHQFH LQ SURGXFW XVH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHUV YDULHG E\ GLVWULFW DQG VFKRRO )LJXUH ,,, 7KH GLIIHUHQFH DYHUDJHG DERXW  KRXUV ZLWK VRPH VFKRROV KDYLQJ GLIIHUHQFHV RI  KRXUV RU OHVV DQG RWKHUV KDYLQJ GLIIHUHQFHV RI  KRXUV 2QH VFKRRO KDG D GLIIHUHQFH WKDW ZDV VOLJKWO\ QHJDWLYH ZKLFK RFFXUV ZKHQ FRQWURO WHDFKHUV XVHG RWKHU SURGXFWV PRUH WKDQ WUHDWPHQW WHDFKHUV XVHG WKH VWXG\ SURGXFW LQ DGGLWLRQ WR RWKHU SURGXFWV 8VDJH GLIIHUHQFHV DUH DOVR HYLGHQW EHWZHHQ GLVWULFWV )RU H[DPSOH WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHU SURGXFW XVH ZDV UHODWLYHO\ ODUJH LQ GLVWULFW  FRPSDUHG WR GLVWULFW  7KUHH RI WKH IRXU SURGXFWV LQFOXGHG GDWDEDVHV WKDW SURYLGHG VRPH GDWD RQ XVDJH DQG WZR SURGXFWV WUDFNHG XVDJH FORVHO\ 2Q GD\V VWXGHQWV XVHG VRIWZDUH WKHLU XVDJH ZDV  WR  PLQXWHV IRU WKH WZR SURGXFWV WKDW WUDFNHG XVDJH DW WKLV OHYHO RI GHWDLO VHH 7DEOH ,,, $QQXDO XVH YDULHG IURP  WR  KRXUV )RU D W\SLFDO GD\ VFKRRO \HDU DYHUDJH GDLO\ XVDJH ZDV DERXW  PLQXWHV IRU RQH SURGXFW DQG  PLQXWHV IRU WKH RWKHU SURGXFW WKDW KDG DGHTXDWH ,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

41
)LJXUH ,,, 'LIIHUHQFH LQ $QQXDO 7HDFKHU5HSRUWHG +RXUV RI 5HDGLQJ 7HFKQRORJ\ 3URGXFW 8VH %HWZHHQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )RXUWK *UDGH





1 1 1 1 1 2

4 4 2 3 3 3

+RXUV



5 5 5 5 5 5 5

10 10 6 6 6 6 6 7 8 8 8 8 8 8 8 8 8 10 10 9 10 10





6FKRROV *URXSHG E\ 'LVWULFW 1XPEHUV LQGLFDWH GLVWULFWV DQG HDFK SRLQW UHSUHVHQWV D VFKRRO

6RXUFH 7HDFKHU ,QWHUYLHZV

7DEOH ,,, 'DLO\ DQG $QQXDO 8VDJH )URP 3URGXFW 5HFRUGV 3URGXFW $ 7RWDO GD\V XVHG GXULQJ VFKRRO \HDU 0LQXWHV RI GDLO\ XVH ZKHQ XVHG +RXUV RI DQQXDO XVH
6RXUFH QD

3URGXFW %   

3URGXFW & QD QD 

3URGXFW ' QD QD QD

  

3URGXFW GDWD RQ XVDJH 2QH SURGXFW GLG QRW \LHOG XVDEOH GDWD 2QH SURGXFW GLG QRW FROOHFW WRWDO GD\V XVHG RU PLQXWHV RI GDLO\ XVH

QRW DYDLODEOH RU XVDEOH

GDWD RQ XVH $VVXPLQJ WKDW UHDGLQJ LV WDXJKW LQ D PLQXWH EORFN WKH WZR SURGXFWV ZHUH XVHG OHVV WKDQ  SHUFHQW RI UHDGLQJ LQVWUXFWLRQ WLPH 7KLV HVWLPDWH UHIHUV RQO\ WR WLPH VWXGHQWV VSHQW RQ FRPSXWHUV DQG QRW WR RWKHU WLPH UHODWHG WR SURGXFWV WKDW VWXGHQWV PD\ KDYH VSHQW
$V QRWHG LQ WKH SUHYLRXV FKDSWHU WKH VWXG\ LWVHOI PD\ KDYH LQFUHDVHG XVDJH EHFDXVH LW SXUFKDVHG KDUGZDUH DQG VRIWZDUH XSJUDGHV GLUHFWO\ ZKLFK DOORZHG LW QRW WR JR WKURXJK GLVWULFW SURFXUHPHQW SURFHVVHV

,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

42 5ROH RI 3URGXFWV LQ WKH &XUULFXOXP DQG 7LPH DQG 3ODFH RI 8VH 7KUHH SURGXFWV ZHUH XVHG DV VXSSOHPHQWV WR WKH UHDGLQJ FXUULFXOXP DQG D IRXUWK ZDV D FRPSOHWH UHDGLQJ FXUULFXOXP WKDW LQFOXGHG DFWLYLWLHV QRW LQYROYLQJ FRPSXWHUV 6HYHQW\ SHUFHQW RI WUHDWPHQW WHDFKHUV LQGLFDWHG WKDW WKH\ XVHG WKH SURGXFW DV D VXSSOHPHQW DQG  SHUFHQW VDLG WKH\ XVHG LW DV WKHLU FRUH UHDGLQJ FXUULFXOXP $OO  WHDFKHUV XVLQJ WKH SURGXFW GHVLJQHG WR EH D FRUH FXUULFXOXP UHSRUWHG XVLQJ LW DV WKHLU FRUH FXUULFXOXP 7HDFKHUV YDULHG LQ KRZ WKH\ VFKHGXOHG SURGXFW XVH 0RVW WHDFKHUV  SHUFHQW XVHG SURGXFWV H[FOXVLYHO\ GXULQJ UHJXODU FODVV WLPH $ERXW D TXDUWHU XVHG SURGXFWV GXULQJ RWKHU WLPHV VXFK DV EHIRUH VFKRRO OXQFKWLPH RU WLPH XVXDOO\ VHW DVLGH IRU VFLHQFH RU VRFLDO VFLHQFH DQG  SHUFHQW XVHG LW GXULQJ FODVV WLPH DQG DW RWKHU WLPHV 3URGXFWV ZHUH XVHG LQ UHJXODU FODVVURRPV  SHUFHQW RI WHDFKHUV RU LQ FRPSXWHU ODEV  SHUFHQW &RQVLVWHQW ZLWK YHQGRU UHFRPPHQGDWLRQV QHDUO\ DOO WHDFKHUV  SHUFHQW UHSRUWHG EHLQJ SUHVHQW ZKHQ WKHLU VWXGHQWV XVHG SURGXFWV DQG QHDUO\ DOO WHDFKHUV  SHUFHQW UHSRUWHG UHYLHZLQJ UHSRUWV WZR WR WKUHH WLPHV D PRQWK RU PRUH IUHTXHQWO\ 7HFKQLFDO 'LIILFXOWLHV 6WXG\ REVHUYHUV UHSRUWHG VHHLQJ WHFKQLFDO SUREOHPV DIIHFWLQJ VWXGHQW XVH RI SURGXFWV LQ DERXW D WKLUG  SHUFHQW RI WKH WLPH VHJPHQWV WKH\ REVHUYHG HDFK REVHUYDWLRQ FRQVLVWHG RI IRXU WR ILYH WLPH VHJPHQWV 0RVW WHFKQLFDO SUREOHPV ZHUH EULHI DQG DIIHFWHG IHZ VWXGHQWV WKH PRVW FRPPRQ EHLQJ SUREOHPV ORJJLQJ RQ WR SURGXFWV KDYLQJ FRPSXWHUV IUHH]H DQG QHHG UHERRWLQJ DQG LVVXHV ZLWK SHULSKHUDOV VXFK DV KHDGSKRQHV 6DWLVIDFWLRQ :LWK 3URGXFWV 1HDUO\ DOO WHDFKHUV  SHUFHQW VDLG WKH\ ZRXOG XVH WKH SURGXFW LQ WKH QH[W VFKRRO \HDU LI JLYHQ WKH FKRLFH :KHQ DVNHG ZKDW WKH\ ZRXOG FKDQJH LQ D VHFRQG \HDU RI LPSOHPHQWDWLRQ  SHUFHQW VDLG WKH\ ZRXOG QRW FKDQJH DQ\WKLQJ  SHUFHQW VDLG WKH\ ZRXOG VWDUW XVLQJ SURGXFWV HDUOLHU LQ WKH VFKRRO \HDU DQG  SHUFHQW VDLG WKDW WKH\ ZRXOG ZRUN RQ FODVVURRP PDQDJHPHQW LVVXHV UHODWHG WR SURGXFW XVH (IIHFWV RQ &ODVVURRP $FWLYLWLHV &ODVVURRP REVHUYDWLRQ GDWD VKRZ GLIIHUHQFHV LQ FODVVURRP DFWLYLWLHV ZKHQ SURGXFWV ZHUH XVHG VHH 7DEOH ,,, 7UHDWPHQW WHDFKHUV ZHUH PXFK PRUH OLNHO\ WKDQ FRQWURO (continued)

SDLG WHDFKHUV KRQRUDULD IRU DWWHQGLQJ WUDLQLQJ RQ XVLQJ SURGXFWV DQG UHOD\HG LQIRUPDWLRQ WR SURGXFW GHYHORSHUV DERXW LVVXHV ZLWK XVLQJ SURGXFWV WKDW WKH WHDP REVHUYHG GXULQJ FODVVURRP YLVLWV 7KH REVHUYDWLRQ SURWRFRO FDOOHG IRU REVHUYHUV WR REVHUYH UHDGLQJ SHULRGV GXULQJ ZKLFK WUHDWPHQW WHDFKHUV ZHUH XVLQJ SURGXFWV ,I REVHUYHUV KDG REVHUYHG FODVVURRPV DW UDQGRP WLPHV WKH GLIIHUHQFHV VKRZQ LQ WKH WDEOH PD\ KDYH EHHQ VPDOOHU EHFDXVH SURGXFWV ZRXOG QRW EH LQ XVH GXULQJ VRPH RI WKH REVHUYDWLRQV


,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

43
7DEOH ,,, $FWLYLWLHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )RXUWK *UDGH 3HUFHQWDJH RI 2EVHUYDWLRQ ,QWHUYDOV 7UHDWPHQW &ODVVURRPV 7HDFKHU 5ROH 3HUFHQWE /HDGHU )DFLOLWDWRU 0RQLWRUREVHUYHU :RUNLQJ RQ RWKHU WDVNV 2WKHU ,QVWUXFWLRQDO $FWLYLW\ 3HUFHQWE ,QGLYLGXDO SUDFWLFH /HFWXUH 4XHVWLRQ DQG DQVZHU 5HYLHZ RI VWXGHQW ZRUN 2WKHU 6WXGHQW 2Q7DVN %HKDYLRU 3HUFHQW 3HUFHQW RI WLPH LQWHUYDOV ZLWK PRUH WKDQ  SHUFHQW RI VWXGHQWV RQ WDVN 6DPSOH 6L]H 1XPEHU RI FODVVURRPV 1XPEHU RI REVHUYDWLRQV           &RQWURO &ODVVURRPV           SYDOXHD          

  

  



6RXUFH &ODVVURRP REVHUYDWLRQV DW PLQXWHV   DQG  IRU HDFK FODVV
D

7HVWV RI GLIIHUHQFHV ZHUH FRQGXFWHG XVLQJ WZROHYHO KLHUDUFKLFDO PRGHOV ZLWK WHDFKHUV WUHDWPHQW VWDWXV DW OHYHO RQH DQG D VFKRRO UDQGRP HIIHFW DW OHYHO WZR 7KH SYDOXH LV WKH VPDOOHVW OHYHO RI VLJQLILFDQFH DW ZKLFK WKH QXOO K\SRWKHVLV WKDW WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW FODVV VHVVLRQV DQG FRQWURO FODVV VHVVLRQV HTXDOV ]HUR FDQ EH UHMHFWHG FRGHG DOO WKDW DSSO\ 3HUFHQWDJHV FDQ VXP WR PRUH WKDQ  SHUFHQW

E2EVHUYHUV

WHDFKHUV WR DFW DV IDFLOLWDWRUV DQG OHVV OLNHO\ WKDQ FRQWURO WHDFKHUV WR EH OHDGHUV 7UHDWPHQW FODVVURRP VWXGHQWV ZHUH PRUH OLNHO\ WKDQ FRQWURO FODVVURRP VWXGHQWV WR EH HQJDJHG LQ LQGLYLGXDO SUDFWLFH S   3DUWLFLSDWLRQ LQ LQGLYLGXDO SUDFWLFH DOVR ZDV WKH PRVW IUHTXHQWO\ REVHUYHG DFWLYLW\ LQ FRQWURO FODVVURRPV ZLWK SDUWLFLSDWLQJ LQ TXHVWLRQDQGDQVZHU VHVVLRQV GLUHFWHG E\ WKH WHDFKHU DQG OLVWHQLQJ WR D OHFWXUH EHLQJ WKH QH[W PRVW FRPPRQ VWXGHQW DFWLYLWLHV &ODVVURRP REVHUYHUV QRWHG WKH SURSRUWLRQ RI VWXGHQWV ZKR ZHUH RQ WDVN HQJDJHG LQ WKH DVVLJQHG DFDGHPLF WDVN GXULQJ REVHUYDWLRQ VHJPHQWV ,Q WUHDWPHQW FODVVURRPV PRUH WKDQ  SHUFHQW RI VWXGHQWV ZHUH RQ WDVN LQ  SHUFHQW RI REVHUYHG VHJPHQWV ,Q FRQWURO FODVVURRPV PRUH WKDQ  SHUFHQW RI VWXGHQWV ZHUH RQ WDVN LQ  SHUFHQW RI REVHUYHG VHJPHQWV 7KH GLIIHUHQFH ZDV QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR S !  :KHWKHU SURGXFW XVH ZDV VXSSOHPHQWLQJ RU UHSODFLQJ QRUPDO UHDGLQJ DFWLYLWLHV ZDV DVVHVVHG E\ DVNLQJ WHDFKHUV KRZ PXFK WLPH WKH\ VSHQW RQ UHDGLQJ LQVWUXFWLRQ 7UHDWPHQW WHDFKHUV UHSRUWHG VSHQGLQJ DERXW  KRXU PRUH RQ UHDGLQJ LQVWUXFWLRQ  KRXUV D ZHHN FRPSDUHG WR  KRXUV IRU FRQWURO WHDFKHUV DQG WKH GLIIHUHQFH ZDV VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR S   7KLV HYLGHQFH WKDW UHDGLQJ LQVWUXFWLRQDO WLPH LQFUHDVHG ZLWK SURGXFW XVH VKRXOG EH NHSW LQ PLQG LQ LQWHUSUHWLQJ WKH ILQGLQJV ,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

44 % (IIHFWV RQ 5HDGLQJ 7HVW 6FRUHV (IIHFWV RQ WHVW VFRUHV ZHUH HVWLPDWHG XVLQJ D PRGHO WKDW DFFRXQWHG IRU WKH QHVWLQJ RI VWXGHQWV LQ FODVVURRPV DQG FODVVURRPV LQ VFKRROV 7KH HVWLPDWHV VKRZ WKDW HIIHFWV RQ WHVW VFRUHV JHQHUDOO\ ZHUH QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR )XUWKHU DQDO\VLV IRXQG WKDW PRVW WHDFKHU DQG VFKRRO FKDUDFWHULVWLFV ZHUH XQFRUUHODWHG ZLWK HIIHFWV EXW UHSRUWHG WLPH WKDW SURGXFWV ZHUH XVHG ZDV FRUUHODWHG ZLWK HIIHFWV 7UHDWPHQW DQG &RQWURO *URXS &KDUDFWHULVWLFV IRU 7HDFKHUV DQG 6WXGHQWV :KHWKHU UDQGRP DVVLJQPHQW DFKLHYHG LWV REMHFWLYH RI FUHDWLQJ HTXLYDOHQW WUHDWPHQW DQG FRQWURO JURXSV ZDV DVVHVVHG E\ H[DPLQLQJ FKDUDFWHULVWLFV RI WHDFKHUV DQG VWXGHQWV LQ WKH WZR JURXSV 7DEOH ,,, VKRZV WHDFKHU DQG VWXGHQW FKDUDFWHULVWLFV DQG UHVXOWV RI VWDWLVWLFDO WHVWV RI HTXLYDOHQFH 1RQH RI WKH GLIIHUHQFHV RI WHDFKHU DQG VWXGHQW FKDUDFWHULVWLFV LV VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR 1RQHWKHOHVV WKH FKDUDFWHULVWLFV ZHUH HQWHUHG DV FRYDULDWHV WR DGMXVW IRU WKHVH GLIIHUHQFHV (IIHFWV :HUH 1RW 6WDWLVWLFDOO\ 'LIIHUHQW )URP =HUR $V ZLWK ILUVW JUDGH SURGXFWV HIIHFWV ZHUH HVWLPDWHG ZLWK D WKUHHOHYHO KLHUDUFKLFDO OLQHDU PRGHO 7KH ILUVW OHYHO LQFOXGHG VWXGHQW FKDUDFWHULVWLFV DJH JHQGHU DQG SUHWHVW VFRUH 7KH VHFRQG OHYHO LQFOXGHG FODVVURRP FKDUDFWHULVWLFV PRVW LPSRUWDQWO\ WKH WUHDWPHQW LQGLFDWRU RI
7DEOH ,,, &KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )RXUWK *UDGH 7UHDWPHQW &ODVVURRPV 7HDFKHU &KDUDFWHULVWLFV <HDUV RI H[SHULHQFH SHUFHQW +DV D PDVWHUV GHJUHH SHUFHQW 6FKRRO KDV FRPSXWHU VSHFLDOLVW SHUFHQW 5HFHLYHG SURIHVVLRQDO GHYHORSPHQW RQ XVLQJ WHFKQRORJ\ ODVW \HDU SHUFHQW )HPDOH SHUFHQW 7HDFKHU 6DPSOH 6L]H 6WXGHQW &KDUDFWHULVWLFV )HPDOH SHUFHQW $JH DV RI 2FWREHU  \HDUV 8QDGMXVWHG VFRUH RQ IDOO 6$7 5HDGLQJ 7HVW 1&( 6DPSOH 6L]H                             &RQWURO &ODVVURRPV SYDOXHD

6RXUFH 7HDFKHU TXHVWLRQQDLUH VWXGHQW UHFRUGV DQG WHVWV DGPLQLVWHUHG E\ VWXG\ VWDII
D7HVWV

RI WUHDWPHQW DQG FRQWURO GLIIHUHQFHV ZHUH FRQGXFWHG XVLQJ D WZROHYHO KLHUDUFKLFDO PRGHO ZLWK FODVVURRP WUHDWPHQW VWDWXV DV D IL[HG HIIHFW DQG VFKRRO DV D UDQGRP HIIHFW IRU WHDFKHUV DQG FODVVURRPV DQG VFKRROV DV UDQGRP HIIHFWV IRU VWXGHQWV 7KH SYDOXH RI WKH GLIIHUHQFH LV WKH SYDOXH RI WKH HVWLPDWHG WUHDWPHQW FRHIILFLHQW

,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

45 ZKHWKHU D FODVVURRP ZDV DVVLJQHG WR XVH D SURGXFW WKH WKLUG OHYHO LQFOXGHG VFKRRO FKDUDFWHULVWLFV VXFK DV SURSRUWLRQ RI VWXGHQWV UHFHLYLQJ IUHH RU UHGXFHGSULFH OXQFK UDFH DQG HWKQLF FRPSRVLWLRQ DQG WKH SURSRUWLRQ WKDW UHFHLYHG VSHFLDO HGXFDWLRQ VHUYLFHV 7DEOH ,,, VKRZV WKH DYHUDJH VFRUH GLIIHUHQFHV IRU WKH 6$7 UHDGLQJ WHVW DQG LWV WKUHH VXEWHVWV 1RQH RI WKH GLIIHUHQFHV LV VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR DQG HIIHFW VL]HV DUH VPDOO $GGLWLRQDO DQDO\VHV DOVR IRXQG WKDW SURGXFWV GLG QRW DIIHFW ZKHWKHU VWXGHQWV ZHUH ORZ VFRUHUV 7DEOH ,,, )LJXUHV ,,, DQG ,,, GHSLFW WKH YDULDWLRQ LQ VFKRRO HIIHFW VL]HV E\ GLVWULFW DQG E\ SURGXFW 0RVW RI WKH YDULDELOLW\ RI WKH VFRUH GLIIHUHQFH LV EHWZHHQ GLVWULFWV  SHUFHQW RI WKH YDULDQFH RI VFKRRO HIIHFWV LV ZLWKLQ GLVWULFWV DQG  SHUFHQW LV EHWZHHQ GLVWULFWV +RZHYHU WKH ILJXUH VKRZV WKDW GLIIHUHQFHV YDU\ EHWZHHQ VFKRROV HYHQ ZLWKLQ WKH VDPH GLVWULFW )RU H[DPSOH LQ GLVWULFW  HIIHFW VL]HV UDQJHG EHWZHHQ  DQG 

7DEOH ,,, 6SULQJ 5HDGLQJ 7HVW 6FRUH 'LIIHUHQFHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV )RXUWK *UDGH 7UHDWPHQW &ODVVURRP $YHUDJH 6FRUH 1&(     &RQWURO &ODVVURRP $YHUDJH 6FRUH 1&(    

6WDQIRUG $FKLHYHPHQW 7HQWK (GLWLRQ 2YHUDOO VFRUH 6XEWHVW VFRUHV 9RFDEXODU\ :RUG VWXG\ VNLOOV &RPSUHKHQVLRQ
1RWH

7HVW

'LIIHUHQFH    

(IIHFW 6L]H    

SYDOXH    

6HH $SSHQGL[ % IRU GHWDLOV RI WKH HVWLPDWLRQ PRGHO 9DULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU KH RU VKH KDG D PDVWHUV GHJUHH VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ SHUFHQW HOLJLEOH IRU IUHH OXQFK DQG SHUFHQW OLPLWHG (QJOLVK SURILFLHQW DQG VWXGHQW FODVVURRP DQG VFKRRO UDQGRP HIIHFWV 7KH WUHDWPHQW FODVVURRP DYHUDJH VFRUH UHSRUWHG LQ WKH WDEOH LV WKH FRQWURO FODVVURRP DYHUDJH VFRUH SOXV WKH WUHDWPHQW HIIHFW ,W GLIIHUV IURP WKH XQDGMXVWHG WUHDWPHQW FODVVURRP VFRUH (IIHFW VL]HV DUH EDVHG RQ WKH VWDQGDUG GHYLDWLRQ RI WKH FRQWURO JURXS IRU WKH VSULQJ WHVW

7ZROHYHO PRGHOV DOVR ZHUH HVWLPDWHG IRU VWXGHQWV LQ HDFK TXDUWLOH EDVHG RQ WKH IDOO VFRUH WR DVVHVV SURGXFW HIIHFWV DFURVV WKH VFRUH GLVWULEXWLRQ (VWLPDWHG HIIHFWV LQ 1&( XQLWV DQG SYDOXHV IRU WKH IRXU TXDUWLOHV ZHUH       DQG   1RQH DUH VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR 7R HQVXUH SURGXFWV FDQQRW EH LGHQWLILHG OHWWHUV XVHG WR LGHQWLI\ SURGXFWV KHUH GR QRW FRUUHVSRQG WR OHWWHUV XVHG HDUOLHU LQ WKH FKDSWHU

,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

46

7DEOH ,,, (IIHFW RQ 3HUFHQW RI 6WXGHQWV LQ /RZHVW 7KLUG RI 5HDGLQJ 7HVW 6FRUHV 7UHDWPHQW &ODVVURRP 3HUFHQWDJH 3HUFHQW RI VWXGHQWV EHORZ UG SHUFHQWLOH RI VSULQJ UHDGLQJ WHVW
1RWH

&RQWURO &ODVVURRP 3HUFHQWDJH 

'LIIHUHQFH 

(IIHFW 6L]H 

SYDOXH 



2WKHU YDULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU KH RU VKH KDG D PDVWHUV GHJUHH VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ SHUFHQW HOLJLEOH IRU IUHH OXQFK DQG VWXGHQW FODVVURRP DQG VFKRRO UDQGRP HIIHFWV 7KH WUHDWPHQW FODVVURRP SHUFHQWDJH UHSRUWHG LQ WKH WDEOH LV WKH FRQWURO FODVVURRP SHUFHQWDJH SOXV WKH WUHDWPHQW HIIHFW ,W GLIIHUV IURP WKH XQDGMXVWHG WUHDWPHQW SHUFHQWDJH 7KH HIIHFW VL]H LV FDOFXODWHG XVLQJ WKH &R[ LQGH[ WKH ORJ RGGV UDWLR GLYLGHG E\ 

)LJXUH ,,, 6FKRRO/HYHO (IIHFWV E\ 'LVWULFW )RXUWK *UDGH 6$7 5HDGLQJ 6FRUH          1XPEHUV UHSUHVHQW GLVWULFWV DQG HDFK SRLQW LV D VFKRRO                                      (IIHFW 6L]H

,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

47
)LJXUH,,, 6FKRRO/HYHO(IIHFWVE\3URGXFW )RXUWK*UDGH6$75HDGLQJ6FRUH          /HWWHUVUHSUHVHQWSURGXFWVDQGHDFKSRLQWLVDVFKRRO
1RWH 6WDWLVWLFDO VLJQLILFDQFH RI DYHUDJH HIIHFW VL]HV FDQQRW EH LQIHUUHG IURP WKH ILJXUH EHFDXVH VWXGHQW DQG WHDFKHU VDPSOH VL]HV GLIIHU EHWZHHQ VFKRROV
$ $ $ $ $  $ $ $ % & & & & & & & & & & & & & & ' ' ' ' ' ' '

(IIHFW6L]H

% %

&ODVVURRP DQG 6FKRRO 0RGHUDWRUV :KHWKHU FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV PRGHUDWH HIIHFWV ZDV LQYHVWLJDWHG E\ LQWHUDFWLQJ WKH WUHDWPHQW HIIHFW ZLWK FODVVURRP FKDUDFWHULVWLFV DW WKH VHFRQG OHYHO RI WKH PRGHO DQG E\ HVWLPDWLQJ D PRGHO RI WKH WUHDWPHQW HIIHFW DV D IXQFWLRQ RI VFKRRO FKDUDFWHULVWLFV LQ WKH WKLUG OHYHO 6FKRRO FKDUDFWHULVWLFV LQFOXGHG UDFH DQG HWKQLFLW\ DQG WKH SHUFHQW RI VWXGHQWV TXDOLILHG IRU IUHH OXQFKHV 3URGXFW XVDJH ERWK VWXG\ SURGXFWV DQG RWKHU SURGXFWV DOVR ZDV HQWHUHG 7DEOH ,,, VKRZV HVWLPDWHV RI PRGHUDWRU HIIHFWV ZLWK SRVLWLYH FRHIILFLHQWV LQGLFDWLQJ WKDW D FKDUDFWHULVWLF LV SRVLWLYHO\ FRUUHODWHG ZLWK HIIHFWV DQG D QHJDWLYH FRHIILFLHQW LQGLFDWLQJ WKH RSSRVLWH )RU WKH RYHUDOO UHDGLQJ VFRUH VWDWLVWLFDO WHVWV LQGLFDWH WKDW FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV DUH MRLQWO\ UHODWHG WR HIIHFWV EXW RQO\ FODVVURRP FKDUDFWHULVWLFV DUH UHODWHG WR HIIHFWV LQ VHSDUDWH WHVWV VFKRRO FKDUDFWHULVWLFV ZHUH QRW VWDWLVWLFDOO\ VLJQLILFDQW RQ WKHLU RZQ 7KH DPRXQW RI VWXG\ SURGXFW XVDJH ZDV D VWDWLVWLFDOO\ VLJQLILFDQW FKDUDFWHULVWLF WKDW PRGHUDWHG HIIHFWV 7KH HVWLPDWHV LQGLFDWH WKDW WKH SURGXFW HIIHFW VL]H ZRXOG EH ODUJHU E\  LI SURGXFW XVDJH ZHUH ODUJHU E\ D VWDQGDUG GHYLDWLRQ DERXW  KRXUV D \HDU )RU YRFDEXODU\ QR FKDUDFWHULVWLFV PRGHUDWHG HIIHFWV )RU ZRUG UHDGLQJ WKH DPRXQW RI VWXG\ SURGXFW XVH WHDFKHU H[SHULHQFH ZKHWKHU WHDFKHUV UHFHLYHG WHFKQRORJ\ SURIHVVLRQDO GHYHORSPHQW LQ WKH SUHYLRXV \HDU DQG WKH SHUFHQW RI VWXGHQWV ZKR ZHUH %ODFN PRGHUDWHG HIIHFWV 7KH DPRXQW RI XVH ZDV SRVLWLYHO\ FRUUHODWHG ZLWK HIIHFWV DQG RWKHU FKDUDFWHULVWLFV ZHUH QHJDWLYHO\ FRUUHODWHG ZLWK HIIHFWV 7KHVH PRGHUDWRU UHODWLRQVKLSV QHHG WR EH LQWHUSUHWHG FDUHIXOO\ $V QRWHG LQ WKH SUHYLRXV FKDSWHU SURGXFW XVDJH PD\ EH UHODWHG WR GHFLVLRQV E\ WHDFKHUV DQG VFKRROV DIWHU GDWD FROOHFWLRQ EHJDQ DQG SRVVLEO\ DIWHU WHDFKHUV DQG VFKRROV KDG LQLWLDO LQGLFDWLRQV RI ZKHWKHU WKH SURGXFW DSSHDUHG WR EH HIIHFWLYH ,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

48 & &RQFOXVLRQV 7KLV VWXG\ H[SHULPHQWDOO\ WHVWHG WKH HIIHFWV RI VHOHFW UHDGLQJ WHFKQRORJ\ SURGXFWV LQ IRXUWK JUDGH FODVVURRPV WKDW YROXQWHHUHG WR SDUWLFLSDWH $OWKRXJK QRW D QDWLRQDOO\ UHSUHVHQWDWLYH VDPSOH WKH VFKRROV SDUWLFLSDWLQJ LQ WKH VWXG\ ZHUH PRUH OLNHO\ WKDQ DYHUDJH WR EH LQ XUEDQ DUHDV DQG KDG KLJKHUWKDQDYHUDJH OHYHOV RI SRYHUW\ DQG VWXGHQWV ZKR ZHUH $IULFDQ $PHULFDQ RU +LVSDQLF .H\ ILQGLQJV DUH WKH IROORZLQJ  7HDFKHUV :HUH 7UDLQHG DQG 8VHG 3URGXFWV 1HDUO\ DOO WUHDWPHQW WHDFKHUV  SHUFHQW SDUWLFLSDWHG LQ WKH LQLWLDO WUDLQLQJ IURP WKH YHQGRU RQ XVLQJ WKH SURGXFW DQG DOO LPSOHPHQWHG WKH DVVLJQHG VRIWZDUH DW OHDVW WR VRPH H[WHQW 8VDJH UHFRUGHG E\ WKUHH RI WKH SURGXFWV ZDV OHVV WKDQ  SHUFHQW RI UHDGLQJ LQVWUXFWLRQ WLPH  'LIIHUHQFHV LQ 7HVW 6FRUHV :HUH 1RW 6WDWLVWLFDOO\ 'LIIHUHQW )URP =HUR 2YHUDOO UHDGLQJ VFRUHV IRU VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH  DQG  UHVSHFWLYHO\ LQ QRUPDOFXUYHHTXLYDOHQW XQLWV 7KH GLIIHUHQFH ZDV QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR  6RPH &ODVVURRP DQG 6FKRRO &KDUDFWHULVWLFV :HUH &RUUHODWHG :LWK 3URGXFW (IIHFWV )RU WKH RYHUDOO VFRUH D VLJQLILFDQW FRUUHODWLRQ ZDV IRXQG EHWZHHQ SURGXFW HIIHFWV DQG SURGXFW XVDJH )RU ZRUG UHDGLQJ VFRUHV VLJQLILFDQW FRUUHODWLRQV ZHUH IRXQG EHWZHHQ SURGXFW HIIHFWV DQG VHYHUDO FKDUDFWHULVWLFV LQFOXGLQJ SURGXFW XVDJH 7KH SRVVLELOLW\ WKDW RWKHU IDFWRUV DUH UHODWHG WR WKHVH FKDUDFWHULVWLFV ZDUUDQWV FDXWLRQ LQ LQWHUSUHWLQJ WKH FRUUHODWLRQV

,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH 3URGXFWV

7DEOH,,,,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV6$75HDGLQJ7HVW)RXUWK*UDGH
7RWDO6FRUH1&( VWDQGDUG FRHIILFLHQW HUURU SYDOXH       
S

              
S

              


9RFDEXODU\1&( :RUG6WXG\6NLOOV1&( &RPSUHKHQVLRQ1&( VWDQGDUG VWDQGDUG VWDQGDUG FRHIILFLHQW HUURU SYDOXH FRHIILFLHQW SYDOXH FRHIILFLHQW HUURU SYDOXH HUURU               


&ODVVURRP,QWHUDFWLRQ9DULDEOHV
               YDOXH         ! YDOXH


                  
S

<HDUVRIWHDFKLQJH[SHULHQFH 7HDFKHULVIHPDOH 7HDFKHUKDVPDVWHUVGHJUHH 7LPHRIVWXG\SURGXFWXVHLQKXQGUHGV 3UREOHPVJHWWLQJDFFHVVWRSURGXFW $GHTXDWHWLPHWRSUHSDUHWRXVHSURGXFW 6FKRROKDVDFRPSXWHUVSHFLDOLVW 3URGXFWLVXVHGLQFODVVURRP 3DUWLFLSDWHGODVW\HDULQWHFKQRORJ\ SURIHVVLRQDOGHYHORSPHQW          YDOXH             

       

       

       

       

       

       

              


              
S

YDOXH      !

6FKRRO,QWHUDFWLRQ9DULDEOHV

3HUFHQWHOLJLEOHIRUIUHHOXQFK 6WXGHQWWHDFKHUUDWLR 6FKRROLVLQXUEDQDUHD 3HUFHQWRI$IULFDQ$PHULFDQVWXGHQWV 3HUFHQWRI+LVSDQLFVWXGHQWV 3HUFHQWVSHFLDOHGXFDWLRQVWXGHQWV

  

&KL6TXDUHG7HVWV

&ODVVURRPDQGVFKRROYDULDEOHV &ODVVURRPYDULDEOHV 6FKRROYDULDEOHV

,,, (IIHFWV RI )RXUWK *UDGH 5HDGLQJ 6RIWZDUH

6RXUFH$XWKRUFDOFXODWLRQV2WKHUYDULDEOHVLQWKHPRGHOLQFOXGHVWXGHQWSUHWHVWVFRUHDJHDQGJHQGHUWHDFKHUH[SHULHQFHHGXFDWLRQDQGJHQGHUDQGVFKRROUDFHHWKQLFFRPSRVLWLRQSHUFHQWIUHH OXQFKXUEDQDUHDSHUFHQWVSHFLDOHGXFDWLRQDQGWLPHXVLQJRWKHUWHFKQRORJ\SURGXFWV 6LJQLILFDQWO\GLIIHUHQWIURP]HUREDVHGRQWKH%HQMDPLQL+RFKEHUJFRUUHFWLRQIRUPXOWLSOHFRPSDULVRQVZLWKIDOVHGLVFRYHU\UDWHRI7KHPXOWLSOHFRPSDULVRQVFRUUHFWLRQLVFRPSXWHGVHSDUDWHO\ IRUFODVVURRPDQGVFKRROFKDUDFWHULVWLFV

6WDWLVWLFDOO\VLJQLILFDQWDWWKHOHYHORIVLJQLILFDQFH

49

&KDSWHU ,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

KLV FKDSWHU SUHVHQWV LPSOHPHQWDWLRQ ILQGLQJV IRU VL[WK JUDGH PDWK WHFKQRORJ\ SURGXFWV DQG HVWLPDWHV RI WKHLU HIIHFWV DQG WKH UHODWLRQVKLSV EHWZHHQ HIIHFWV DQG VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV 7KH WHFKQRORJ\ SURGXFWV LQ WKH VL[WK JUDGH VXEVWXG\ IRFXVHG RQ PDWK DQG SUHDOJHEUD LQVWUXFWLRQ 7KH VWXG\V GHVLJQ GDWD FROOHFWLRQ DSSURDFK DQG DQDO\VLV DSSURDFK ZHUH WKH VDPH DV IRU UHDGLQJ SURGXFWV 7KH VL[WK JUDGH VWXG\ LQFOXGHG WKUHH SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ  GLVWULFWV DQG  VFKRROV 7KH VDPSOH LQFOXGHG  WHDFKHUV DQG  VWXGHQWV 7KH WKUHH SURGXFWV ZHUH /DUVRQ 3UH $OJHEUD SXEOLVKHG E\ +RXJKWRQ0LIIOLQ $FKLHYH 1RZ SXEOLVKHG E\ 3ODWR DQG L/HDUQ 0DWK SXEOLVKHG E\ L/HDUQ $ ,PSOHPHQWDWLRQ $QDO\VLV $V QRWHG LQ SUHYLRXV FKDSWHUV WKH PDLQ TXHVWLRQV LQ WKH LPSOHPHQWDWLRQ DQDO\VLV UHODWHG WR SURGXFW IHDWXUHV XVH LQ FODVVURRPV DQG HIIHFWV RQ WHDFKHU DQG VWXGHQW DFWLYLWLHV LQ FODVVURRPV &ODVVURRP XVH KDG PXOWLSOH DVSHFWV WKDW ZHUH LQYHVWLJDWHG WHDFKHU WUDLQLQJ DQG VXSSRUW LQ XVLQJ SURGXFWV WKH GXUDWLRQ H[WHQW DQG ORFDWLRQ RI SURGXFW XVH WHFKQLFDO GLIILFXOWLHV LQ XVLQJ SURGXFWV DQG UROH RI SURGXFWV LQ WKH FXUULFXOXP 3URGXFW )HDWXUHV 7KH WKUHH SURGXFWV VHOHFWHG IRU WKH VWXG\ DUH VLPLODU WR RWKHU SURGXFWV WKDW VFKRROV XVH IRU PDWK LQVWUXFWLRQ LQ VL[WK JUDGH WKRXJK WKH\ GR QRW UHSUHVHQW D VWDWLVWLFDO VDPSOH RI DOO DYDLODEOH WHFKQRORJ\ LQ VL[WK JUDGH PDWK LQVWUXFWLRQ $OO WKUHH SURGXFWV LQ WKH VL[WK JUDGH VWXG\ SURYLGH WXWRULDO SUDFWLFH DQG DVVHVVPHQW RSSRUWXQLWLHV LQ PDWKHPDWLFV 6NLOOV FRYHUHG LQFOXGH RSHUDWLRQV ZLWK IUDFWLRQV GHFLPDOV DQG SHUFHQWV SODQH DQG FRRUGLQDWH JHRPHWU\ UDWLRV UDWHV DQG SURSRUWLRQV RSHUDWLRQV ZLWK ZKROH QXPEHUV DQG LQWHJHUV SUREDELOLW\ DQG GDWD DQDO\VLV DQG PHDVXUHPHQW (DFK SURGXFW SURYLGHV VWXGHQWV ZLWK RSSRUWXQLWLHV WR DSSO\ VNLOOV WKURXJK VROYLQJ SUDFWLFH SUREOHPV KRZHYHU WKH\ YDU\ LQ WKH OHYHO RI WXWRULDO DVVLVWDQFH 9HQGRUV UHFRPPHQGHG WKDW SURGXFWV EH XVHG EHWZHHQ  DQG  PLQXWHV D ZHHN 7KH VWXG\ HVWLPDWHG WKH DYHUDJH OLFHQVLQJ IHHV IRU WKH SURGXFWV WR EH DERXW  D VWXGHQW IRU WKH VFKRRO \HDU ZLWK D UDQJH RI  WR 

52 0DQ\ LQVWUXFWLRQDO IHDWXUHV RI WKH WKUHH SURGXFWV DUH VLPLODU VHH 7DEOH ,9 7ZR SURGXFWV FRQWDLQ PDQ\ WXWRULDO PRGXOHV WKH RWKHU SURYLGHV RQO\ D IHZ WXWRULDO PRGXOHV $OO WKUHH SURYLGH DPSOH RSSRUWXQLWLHV WR SUDFWLFH VNLOOV DQG JLYH VWXGHQWV LPPHGLDWH DQG GLDJQRVWLF IHHGEDFN ZKHQ LQ SUDFWLFH PRGH 7KH\ DOO SURYLGH IRU LQGLYLGXDOL]DWLRQ RI LQVWUXFWLRQ DXWRPDWLFDOO\ VHWWLQJ LQGLYLGXDO VWXGHQW OHDUQLQJ SDWKV GHSHQGLQJ RQ D VWXGHQWV VNLOO OHYHO 7ZR SURGXFWV DOORZ WHDFKHUV WR VSHFLI\ PDQXDOO\ ZKLFK WXWRULDO XQLWV VWXGHQWV VKRXOG UHFHLYH DQG OHW VWXGHQWV LQGLFDWH VNLOOV WKH\ ZRXOG OLNH WR SUDFWLFH $OO WKUHH SURYLGH WHDFKHUV ZLWK IHHGEDFN RQ DYHUDJH LQGLYLGXDO VWXGHQW DQG FODVV SHUIRUPDQFH DQG RQH SURYLGHV IHHGEDFN DW WKH OHYHO RI LQGLYLGXDO TXHVWLRQV 1RQH RI WKH SURGXFWV SURYLGHV IHHGEDFN WR VWXGHQWV LQ DVVHVVPHQW PRGH 7HDFKHU 7UDLQLQJ DQG 6XSSRUW 9HQGRU WUDLQLQJ VHVVLRQV JHQHUDOO\ WRRN SODFH LQ KRVW GLVWULFWV DQG VRPHWLPHV KRVW VFKRROV GXULQJ VXPPHU RU HDUO\ IDOO RI  7KH LQLWLDO WUDLQLQJ ODVWHG DERXW  KRXUV DQG YDULHG E\ SURGXFW IURP  KRXUV WR DERXW  KRXUV 7UDLQLQJ WRSLFV LQFOXGHG FODVVURRP PDQDJHPHQW DQG DOLJQPHQW ZLWK VWDQGDUGV DQG WKH ORFDO FXUULFXOXP DQG WUDLQLQJ VHVVLRQV LQFOXGHG RSSRUWXQLWLHV WR SUDFWLFH ZLWK WKH WHFKQRORJ\ 1HDUO\ DOO WHDFKHUV  SHUFHQW DWWHQGHG WKH LQLWLDO WUDLQLQJ DFFRUGLQJ WR DWWHQGDQFH ORJV 2Q D TXHVWLRQQDLUH FRPSOHWHG DW WKH HQG RI LQLWLDO WUDLQLQJ  SHUFHQW RI WHDFKHUV VDLG WKH\ ZHUH FRQILGHQW WKH\ FRXOG XVH WKH SURGXFW $W WKH WLPH RI WKH ILUVW FODVVURRP REVHUYDWLRQ ZKHQ PRVW WHDFKHUV KDG EHJXQ WR XVH SURGXFWV WKH SURSRUWLRQ RI WHDFKHUV ZKR WKRXJKW WKH LQLWLDO WUDLQLQJ KDG DGHTXDWHO\ SUHSDUHG WKHP WR XVH WKH SURGXFW KDG IDOOHQ IURP  SHUFHQW WR  SHUFHQW 9HQGRUV GHOLYHUHG RQJRLQJ VXSSRUW LQ VHYHUDO PRGHV 3URGXFW UHSUHVHQWDWLYHV YLVLWHG WHDFKHUV  SHUFHQW RI WHDFKHUV UHSRUWHG UHFHLYLQJ WKLV NLQG RI KHOS YHQGRUV DOVR SURYLGHG VXSSRUW WKURXJK HPDLO RU WHOHSKRQH KHOS GHVNV  SHUFHQW DQG DGGLWLRQDO WUDLQLQJ DW VFKRROV  SHUFHQW 7KH VWXG\ WHDP ZRUNHG ZLWK GLVWULFWV WR LGHQWLI\ KDUGZDUH DQG VRIWZDUH QHHGV VXFK DV FRPSXWHUV KHDGSKRQHV PHPRU\ DQG RSHUDWLQJ V\VWHP XSJUDGHV LW DOVR SXUFKDVHG D VHW RI PRELOH ODSWRS FDUWV IRU RQH GLVWULFW ZKHUH DFFHVV WR VFKRRO FRPSXWHU ODEV ZDV WRR FRQVWUDLQHG WR VXSSRUW DGHTXDWH VWXGHQW XVH 6WXG\ REVHUYHUV QRWHG WKDW WUHDWPHQW WHDFKHUV DYHUDJHG DOPRVW  FRPSXWHUV LQ WKHLU URRPV WR VHUYH DQ DYHUDJH FODVV VL]H RI DERXW  VL[WK JUDGHUV LQFOXGLQJ WKH PRELOH ODEV SXUFKDVHG E\ WKH VWXG\ 'XUDWLRQ DQG ([WHQW RI 3URGXFW 8VH 1HDUO\ DOO WHDFKHUV LPSOHPHQWHG SURGXFWV WR VRPH GHJUHH DQG UHSRUWHG XVLQJ SURGXFWV IRU DQ DYHUDJH RI  ZHHNV DQG DOPRVW  KRXUV D ZHHN 7DEOH ,9 VKRZV WKH KRXUV WKDW VWXGHQWV XVHG VWXG\ SURGXFWV DFFRUGLQJ WR WUHDWPHQW WHDFKHUV 7HDFKHUV DOVR XVHG RWKHU SURGXFWV LQ DGGLWLRQ WR VWXG\ SURGXFWV SHUFHQW RI FRQWURO WHDFKHUV DQG  SHUFHQW RI WUHDWPHQW WHDFKHUV XVHG FRPSXWHUEDVHG PDWK SURGXFWV RWKHU WKDQ WKRVH LQ WKH VWXG\ 8VH RI RWKHU SURGXFWV ZDV OHVV WKDQ DQ KRXU D \HDU LQ WUHDWPHQW FODVVHV DQG OHVV WKDQ  KRXUV D \HDU LQ FRQWURO FODVVHV VHH 7DEOH ,9 1RQH RI WKH FRQWURO WHDFKHUV XVHG D VWXG\ SURGXFW

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

7DEOH,9,QVWUXFWLRQDO)HDWXUHVRI6L[WK*UDGH0DWKHPDWLFV3URGXFWV
,QGLYLGXDOL]DWLRQD )HHGEDFNWR7HDFKHUV 6WXGHQW,QSXW 7 3 $ 6WXGHQW 0DVWHU\ 3 $ /HDUQLQJ 3DWKV &ODVVURRP 3HUIRUPDQFH 3 ,PPHGLDWH 0DVWHU\ $ $XWRPDWLF 7 3 $ 7 3 $ 7HDFKHU,QSXW )HHGEDFNWR6WXGHQWVE 'LDJQRVWLF 3 $

3URGXFW 0DQ\ 0DQ\ 0DQ\

7XWRULDO 2SSRUWXQLWLHV

3UDFWLFH 2SSRUWXQLWLHV

)HZ

$ %

0DQ\

9 9 9 9 9

&

0DQ\

6RXUFH6WDIIUHYLHZ

9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9

9 9 9

9 9 9

9 9

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

E,PPHGLDWHIHHGEDFN/HDUQHUWROGZKHWKHUUHVSRQVHLVFRUUHFWLPPHGLDWHO\DIWHUFRPSOHWLQJPRGXOH'LDJQRVWLFIHHGEDFN/HDUQHUUHFHLYHVKLQWVRURWKHULQIRUPDWLRQFRQFHUQLQJWKHSUREDEOH VRXUFHRIHUURU0DVWHU\IHHGEDFN/HDUQHULQIRUPHGRIWKHQXPEHUFRUUHFWDQGZKHWKHUDVNLOORUFRQFHSWKDVEHHQDFTXLUHGPDVWHUHG

7 7XWRULDOPRGH3 3UDFWLFHPRGH$ $VVHVVPHQWPRGH

53

54
7DEOH ,9 7HDFKHU5HSRUWHG 8VH RI 6WXG\ 3URGXFWV DQG 2WKHU 0DWKHPDWLFV 3URGXFWV 6L[WK *UDGH 6WXG\ 3URGXFWV 7UHDWPHQW *URXS 3HUFHQW RI WHDFKHUV XVLQJ D SURGXFW 0LQXWHV RI ZHHNO\ XVH +RXUV RI DQQXDO XVH 6DPSOH VL]H

2WKHU 0DWKHPDWLFV 3URGXFWV S YDOXHD QD QD QD 7UHDWPHQW *URXS     &RQWURO *URXS     S YDOXHD   

&RQWURO *URXS  QD QD 

   

6RXUFHV &ODVVURRP REVHUYDWLRQV DQG WHDFKHU LQWHUYLHZV

D

7HVWV RI GLIIHUHQFH ZHUH FRQGXFWHG XVLQJ D WZROHYHO KLHUDUFKLFDO PRGHO FODVVURRPV DQG VFKRROV ZLWK WKH WUHDWPHQW HIIHFW DW OHYHO RQH DQG EHWZHHQVFKRRO YDULDQFH DW OHYHO WZR QD QRW DSSOLFDEOH

7DEOH ,9 'DLO\ DQG $QQXDO 8VDJH )URP 3URGXFW 5HFRUGV 3URGXFW $ 3URGXFW % 3URGXFW & 7RWDO GD\V XVHG GXULQJ VFKRRO \HDU 0LQXWHV RI GDLO\ XVH ZKHQ XVHG +RXUV RI DQQXDO XVH       QD QD QD

6RXUFH 3URGXFW UHFRUGV 2QH SURGXFW GLG QRW PDLQWDLQ GDWD RQ VWXGHQW XVDJH QD QRW DYDLODEOH RU XVDEOH

7KH GLIIHUHQFH LQ SURGXFW XVH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHUV YDULHG E\ GLVWULFW DQG VFKRRO )LJXUH ,9 DQG DYHUDJHG DERXW  KRXUV ZLWK D VWDQGDUG GHYLDWLRQ EHWZHHQ VFKRROV RI DERXW  KRXUV 1R VFKRROV KDG D QHJDWLYH GLIIHUHQFH DQG VRPH KDG KLJK OHYHOV RI GLIIHUHQFHV LQ XVDJH PRUH WKDQ  KRXUV D \HDU 8VDJH GLIIHUHQFHV DOVR DUH HYLGHQW EHWZHHQ GLVWULFWV )RU H[DPSOH WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHU WHFKQRORJ\ XVDJH ZDV UHODWLYHO\ ODUJH LQ GLVWULFW  FRPSDUHG WR GLVWULFW  7ZR SURGXFWV PDLQWDLQHG GHWDLOHG UHFRUGV RQ VWXGHQW XVDJH RQ D ZHHNO\ DQG DQQXDO EDVLV 7KH WKLUG SURGXFW GLG QRW PDLQWDLQ UHFRUGV RQ VWXGHQW XVH 'DWD IRU RQH SURGXFW VKRZHG  GD\V RI XVH ZLWK DQ DYHUDJH RI  PLQXWHV SHU XVH IRU DQ DYHUDJH RI  KRXUV RI VWXGHQW XVH IRU WKH VFKRRO \HDU 7KH RWKHU VKRZHG  GD\V RI XVH  PLQXWHV D GD\ DQG  KRXUV IRU WKH VFKRRO \HDU 7KH SURGXFW ZLWK ORZHU XVDJH KDG D PXFK ODUJHU VKDUH RI WKH VWXGHQW VDPSOH KRZHYHUPRUH WKDQ  WLPHV ODUJHU WKDQ WKH RWKHU SURGXFWDQG WKHUHIRUH

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

55

)LJXUH,9 'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI0DWK7HFKQRORJ\3URGXFW8VH%HWZHHQ 7UHDWPHQWDQG&RQWURO&ODVVURRPV 6L[WK*UDGH    +RXUV      
1 1 1 1 4 4 4 4 3 8 8 8 8 8 8 9 9 10

6 6 6 6

7 7

6FKRROV*URXSHGE\'LVWULFW 1XPEHUVUHSUHVHQWGLVWULFWVDQGHDFKSRLQWLVDVFKRRO
6RXUFH 7HDFKHU ,QWHUYLHZV

FRQWULEXWHG PRUH WR RYHUDOO XVDJH HVWLPDWHG WR EH DERXW  KRXUV D \HDU $VVXPLQJ PDWK LQVWUXFWLRQDO SHULRGV ZHUH  PLQXWHV LQ D GD\ VFKRRO \HDU RQ DYHUDJH SURGXFWV ZHUH XVHG IRU DERXW  SHUFHQW RI PDWK LQVWUXFWLRQDO WLPH 5ROH RI 3URGXFWV LQ WKH &XUULFXOXP DQG 7LPH DQG 3ODFH RI 8VH 7ZR SURGXFWV ZHUH GHVLJQHG DV VXSSOHPHQWV WR WKH FRUH PDWKHPDWLFV FXUULFXOXP DQG RQH ZDV GHVLJQHG WR IXQFWLRQ HLWKHU DV WKH FRUH FXUULFXOXP RU DV D VRXUFH RI VXSSOHPHQWDU\ LQVWUXFWLRQ :KHQ WUHDWPHQW WHDFKHUV ZHUH DVNHG KRZ WKH\ XVHG SURGXFWV LQ WKHLU WHDFKLQJ  SHUFHQW VDLG WKH\ XVHG WKH SURGXFW DV D VXSSOHPHQW DQG  SHUFHQW VDLG WKH\ XVHG LW DV WKHLU FRUH FXUULFXOXP

7KH WZR W\SHV RI XVDJH GDWDVFKHGXOHG XVH DFFRUGLQJ WR WHDFKHUV DQG DFWXDO XVH DFFRUGLQJ WR SURGXFW UHFRUGVUHODWH WR GLIIHUHQW FRQFHSWV RI XVDJH EXW ZHUH KLJKO\ FRUUHODWHG U  IRU ZHHNO\ XVH DQG U  IRU DQQXDO XVH

$V QRWHG LQ SUHYLRXV FKDSWHUV WKH VWXG\ PD\ KDYH LQFUHDVHG XVDJH IURP W\SLFDO OHYHOV RI ILUVWWLPH XVHUV EHFDXVH LW SXUFKDVHG KDUGZDUH DQG VRIWZDUH XSJUDGHV ZLWKRXW JRLQJ WKURXJK GLVWULFW SURFXUHPHQW SURFHVVHV SDLG WHDFKHUV KRQRUDULD IRU DWWHQGLQJ WUDLQLQJ RQ XVLQJ SURGXFWV DQG UHOD\HG LQIRUPDWLRQ WR SURGXFW GHYHORSHUV DERXW LVVXHV ZLWK XVLQJ SURGXFWV WKDW WKH WHDP REVHUYHG GXULQJ FODVVURRP YLVLWV


,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

56 0RVW WHDFKHUV  SHUFHQW VFKHGXOHG WKH SURGXFW WR EH XVHG GXULQJ WKHLU UHJXODU FODVV WLPH VORW 2I WKH UHPDLQGHU  SHUFHQW VDLG VWXGHQWV XVHG WKH VRIWZDUH GXULQJ RWKHU WLPHV VXFK DV EHIRUH VFKRRO RU GXULQJ OXQFK DQG  SHUFHQW VDLG WKHLU VWXGHQWV XVHG WKH SURGXFW GXULQJ FODVV WLPH DQG DW RWKHU WLPHV 3URGXFWV ZHUH XVHG LQ WKH UHJXODU FODVVURRPV DQG LQ FRPSXWHU ODEV ZLWK DERXW HTXDO IUHTXHQF\  SHUFHQW LQ FODVVURRPV DQG  SHUFHQW LQ ODEV &RQVLVWHQW ZLWK YHQGRU UHFRPPHQGDWLRQV QHDUO\ DOO WHDFKHUV  SHUFHQW UHSRUWHG EHLQJ SUHVHQW ZKHQ WKHLU VWXGHQWV XVHG SURGXFWV $ WRWDO RI  SHUFHQW UHSRUWHG UHYLHZLQJ DVVHVVPHQW UHSRUWV WZR WR WKUHH WLPHV D PRQWK RU PRUH DQG  SHUFHQW UHSRUWHG UHYLHZLQJ DVVHVVPHQW UHSRUWV RQFH D ZHHN RU PRUH 7HFKQLFDO 'LIILFXOWLHV 6WXG\ REVHUYHUV UHSRUWHG WHFKQLFDO SUREOHPV WKDW DIIHFWHG DW OHDVW RQH VWXGHQW LQ DERXW D TXDUWHU  SHUFHQW RI WKH WLPH VHJPHQWV WKH\ REVHUYHG HDFK REVHUYDWLRQ FRQVLVWHG RI IRXU WR ILYH WLPH VHJPHQWV 0RVW WHFKQLFDO SUREOHPV VXFK DV SUREOHPV ORJJLQJ RQ WR SURGXFWV RU KDYLQJ FRPSXWHUV IUHH]H DQG QHHG UHERRWLQJ ZHUH EULHI DQG DIIHFWHG RQO\ D IHZ VWXGHQWV 6DWLVIDFWLRQ ZLWK 3URGXFWV 1HDUO\ DOO WHDFKHUV  SHUFHQW VDLG WKH\ ZRXOG XVH WKH SURGXFW LQ WKH QH[W VFKRRO \HDU LI WKH\ KDG WKH RSSRUWXQLW\ :KHQ DVNHG ZKDW WKH\ ZRXOG FKDQJH LQ WKH VHFRQG \HDU  SHUFHQW VDLG WKH\ ZRXOG QRW FKDQJH DQ\WKLQJ DQG  SHUFHQW VDLG WKDW WKH\ ZRXOG VSHQG PRUH WLPH EHFRPLQJ IDPLOLDU ZLWK WKH VRIWZDUH QR RWKHU UHVSRQVH FDWHJRU\ LQFOXGHG PRUH WKDQ  SHUFHQW RI WHDFKHUV ,PSDFW RQ &ODVVURRP $FWLYLWLHV 7DEOH ,9 VKRZV WKDW WUHDWPHQW WHDFKHUV ZHUH REVHUYHG EHLQJ IDFLOLWDWRUV GXULQJ D ODUJHU SURSRUWLRQ RI WLPH VHJPHQWV WKDQ FRQWURO WHDFKHUV SHUFHQW FRPSDUHG WR  SHUFHQW S   6WXGHQWV LQ WUHDWPHQW FODVVURRPV ZHUH DOVR PRUH OLNHO\ WR EH HQJDJHG LQ LQGLYLGXDO ZRUN WKDQ VWXGHQWV LQ FRQWURO FODVVURRPV SHUFHQW FRPSDUHG WR  SHUFHQW S   /LVWHQLQJ WR D OHFWXUH ZDV WKH PRVW IUHTXHQWO\ REVHUYHG VWXGHQW DFWLYLW\ LQ FRQWURO FODVVURRPV

7KH GLIIHUHQFHV ZHUH HVWLPDWHG XVLQJ D WZROHYHO KLHUDUFKLFDO OLQHDU PRGHO ZLWK WHDFKHUV LQ WKH ILUVW OHYHO DQG VFKRROV LQ WKH VHFRQG OHYHO

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

57
7DEOH ,9 $FWLYLWLHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 6L[WK *UDGH 3HUFHQWDJH RI 2EVHUYDWLRQV 7UHDWPHQW &ODVVURRPV 7HDFKHU 5ROH 3HUFHQWE /HDGHU )DFLOLWDWRU 0RQLWRUREVHUYHU :RUNLQJ RQ RWKHU WDVNV 2WKHU ,QVWUXFWLRQDO $FWLYLW\ 3HUFHQWE ,QGLYLGXDO ZRUN /HFWXUH 4XHVWLRQ DQG DQVZHU 5HYLHZ RI VWXGHQW ZRUN 2WKHU 6WXGHQW 2Q7DVN %HKDYLRU 3HUFHQW 3HUFHQW RI LQWHUYDOV ZLWK PRUH WKDQ  SHUFHQW RI VWXGHQWV RQ WDVN 6DPSOH 6L]H 1XPEHU RI FODVVURRPV 1XPEHU RI REVHUYDWLRQ LQWHUYDOV           &RQWURO &ODVVURRPV          

SYDOXHD          

  

  



6RXUFH &ODVVURRP REVHUYDWLRQ LQWHUYDOV DW PLQXWHV   DQG  IRU HDFK FODVV
D

7HVWV RI GLIIHUHQFHV ZHUH FRQGXFWHG XVLQJ WZROHYHO KLHUDUFKLFDO PRGHOV ZLWK WHDFKHUV WUHDWPHQW VWDWXV DW OHYHO RQH DQG D VFKRRO UDQGRP HIIHFW DW OHYHO WZR 7KH SYDOXH LV WKH VPDOOHVW OHYHO RI VLJQLILFDQFH DW ZKLFK WKH QXOO K\SRWKHVLV WKDW WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW FODVV VHVVLRQV DQG FRQWURO FODVV VHVVLRQV HTXDOV ]HUR FDQ EH UHMHFWHG FRGHG DOO WKDW DSSO\ 3HUFHQWDJHV FDQ DGG WR PRUH WKDQ 

E2EVHUYHUV

% (IIHFWV RQ 0DWK 7HVW 6FRUHV (IIHFWV RQ WHVW VFRUHV ZHUH HVWLPDWHG XVLQJ D PRGHO WKDW DFFRXQWHG IRU WKH QHVWLQJ RI VWXGHQWV LQ FODVVURRPV DQG FODVVURRPV LQ VFKRROV 7KH HVWLPDWHV VKRZ WKDW HIIHFWV RQ WHVW VFRUHV JHQHUDOO\ ZHUH QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR DQG PRVW WHDFKHU DQG VFKRRO FKDUDFWHULVWLFV ZHUH XQFRUUHODWHG ZLWK HIIHFWV 7UHDWPHQW DQG &RQWURO *URXS &KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV 7HDFKHUV DQG VWXGHQWV JHQHUDOO\ ZHUH VLPLODU LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZLWK WZR H[FHSWLRQV 7DEOH ,9 $IWHU DGMXVWLQJ IRU PXOWLSOH FRPSDULVRQV QR WHDFKHU RU VWXGHQW FKDUDFWHULVWLFV ZHUH VWDWLVWLFDOO\ GLIIHUHQW

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

58
7DEOH ,9 &KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 6L[WK *UDGH 7UHDWPHQW &ODVVURRPV 7HDFKHU &KDUDFWHULVWLFV <HDUV RI H[SHULHQFH \HDUV +DV D PDVWHUV GHJUHH SHUFHQW 6FKRRO KDV FRPSXWHU VSHFLDOLVW SHUFHQW 5HFHLYHG SURIHVVLRQDO GHYHORSPHQW RQ XVLQJ WHFKQRORJ\ ODVW \HDU SHUFHQW )HPDOH SHUFHQW 7HDFKHU 6DPSOH 6L]H )HPDOH SHUFHQW $JH DV RI 2FWREHU  \HDUV 8QDGMXVWHG VFRUH RQ IDOO 6$7 PDWK WHVW 1&( 6WXGHQW 6DPSOH 6L]H       6WXGHQW &KDUDFWHULVWLFV                       &RQWURO &ODVVURRPV

SYDOXHD

6RXUFHV 7HDFKHU TXHVWLRQQDLUHV VWXGHQW UHFRUGV DQG WHVWV DGPLQLVWHUHG E\ VWXG\ VWDII
D7HVWV

RI WUHDWPHQW DQG FRQWURO GLIIHUHQFHV ZHUH FRQGXFWHG XVLQJ D WZROHYHO KLHUDUFKLFDO PRGHO ZLWK FODVVURRP WUHDWPHQW VWDWXV DV D IL[HG HIIHFW DQG VFKRRO DV D UDQGRP HIIHFW IRU WHDFKHUV DQG FODVVURRPV DQG VFKRROV DV UDQGRP HIIHFWV IRU VWXGHQWV 7KH SYDOXH RI WKH GLIIHUHQFH LV WKH SYDOXH RI WKH HVWLPDWHG WUHDWPHQW FRHIILFLHQW

(IIHFWV :HUH 1RW 6WDWLVWLFDOO\ 'LIIHUHQW )URP =HUR 7DEOH ,9 VKRZV VFRUH GLIIHUHQFHV IRU WKH RYHUDOO 6$7 PDWK WHVW DQG LWV WZR VXEWHVWV IURP WKH KLHUDUFKLFDO OLQHDU PRGHO (IIHFW VL]HV DUH VLPLODU DERXW  SHUFHQW WR  SHUFHQW 1RQH ZHUH VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR $Q DQDO\VLV RI ZKHWKHU SURGXFWV UHGXFHG WKH SURSRUWLRQ RI VWXGHQWV ZKR VFRUHG LQ WKH ORZHU WKLUG RQ WKH 6$7 EHORZ WKH UG SHUFHQWLOH IRXQG WKDW SURGXFWV GLG QRW KDYH DQ HIIHFW 7DEOH ,9 )LJXUHV ,9 DQG ,9 GHSLFW WKH YDULDWLRQ LQ VFKRRO HIIHFW VL]HV E\ GLVWULFW DQG E\ SURGXFW )RU H[DPSOH LQ GLVWULFW  HIIHFW VL]HV LQ WKH ILYH VFKRROV UDQJHG IURP DOPRVW  WR  $Q DQDO\VLV RI YDULDQFH RI WKH VFKRRO HIIHFW VL]H LQGLFDWHV WKDW  SHUFHQW RI LWV YDULDQFH LV EHWZHHQ GLVWULFWV DQG  SHUFHQW LV ZLWKLQ GLVWULFWV

7ZROHYHO PRGHOV DOVR ZHUH HVWLPDWHG IRU VWXGHQWV LQ HDFK TXDUWLOH EDVHG RQ WKH IDOO VFRUH (VWLPDWHG HIIHFWV DQG SYDOXHV IRU WKH IRXU TXDUWLOHV ZHUH       DQG  


6FKRRO HIIHFWV ZHUH HVWLPDWHG XVLQJ D UHJUHVVLRQ PRGHO LQ ZKLFK WHVW VFRUHV DUH UHJUHVVHG RQ VWXGHQW DQG WHDFKHU FKDUDFWHULVWLFV DQG WKH WUHDWPHQW LQGLFDWRU LV LQWHUDFWHG ZLWK DQ LQGLFDWRU IRU HDFK VFKRRO 6WDQGDUG HUURUV ZHUH DGMXVWHG IRU FODVVURRP FOXVWHULQJ
27

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

59

7DEOH ,9 6SULQJ 0DWK 7HVW 6FRUH 'LIIHUHQFHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 6L[WK *UDGH 7UHDWPHQW &ODVVURRP $YHUDJH 6FRUH 1&(    &RQWURO &ODVVURRP $YHUDJH 6FRUH 1&(   

6WDQIRUG $FKLHYHPHQW 7HQWK (GLWLRQ 2YHUDOO VFRUH 6XEWHVW VFRUHV 3URFHGXUHV 3UREOHP VROYLQJ
6RXUFH

7HVW

'LIIHUHQFH   

(IIHFW 6L]H   

SYDOXH   

$XWKRU FDOFXODWLRQV VHH $SSHQGL[ % IRU GHWDLOV RI WKH HVWLPDWLRQ PRGHO 9DULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU KH RU VKH KDG D PDVWHUV GHJUHH VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ DQG SHUFHQW HOLJLEOH IRU IUHH OXQFK DQG VWXGHQW FODVVURRP DQG VFKRRO UDQGRP HIIHFWV 7KH WUHDWPHQW FODVVURRP DYHUDJH VFRUH UHSRUWHG LQ WKH WDEOH LV WKH FRQWURO FODVVURRP DYHUDJH VFRUH SOXV WKH WUHDWPHQW HIIHFW ,W GLIIHUV IURP WKH XQDGMXVWHG WUHDWPHQW FODVVURRP VFRUH (IIHFW VL]HV DUH EDVHG RQ WKH VWDQGDUG GHYLDWLRQ RI WKH FRQWURO JURXS IRU WKH VSULQJ WHVW

7DEOH ,9 (IIHFW RQ 3HUFHQW RI 6WXGHQWV LQ /RZHVW 7KLUG RI 0DWK 7HVW 6FRUHV 7UHDWPHQW &ODVVURRP 3HUFHQWDJH 3HUFHQW RI VWXGHQWV EHORZ UG SHUFHQWLOH RI VSULQJ PDWK WHVW 1RWH  &RQWURO &ODVVURRP 3HUFHQWDJH  (IIHFW 6L]H 

'LIIHUHQFH 

SYDOXH 

2WKHU YDULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU KH RU VKH KDG D PDVWHUV GHJUHH VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ SHUFHQW HOLJLEOH IRU IUHH OXQFK DQG VWXGHQW FODVVURRP DQG VFKRRO UDQGRP HIIHFWV 7KH WUHDWPHQW FODVVURRP SHUFHQWDJH UHSRUWHG LQ WKH WDEOH LV WKH FRQWURO FODVVURRP SHUFHQWDJH SOXV WKH WUHDWPHQW HIIHFW ,W GLIIHUV IURP WKH XQDGMXVWHG WUHDWPHQW SHUFHQWDJH 7KH HIIHFW VL]H LV FDOFXODWHG XVLQJ WKH &R[ LQGH[ WKH ORJ RGGV UDWLR GLYLGHG E\ 

&ODVVURRP DQG 6FKRRO 0RGHUDWRUV 7DEOH ,9 VKRZV HVWLPDWHV RI WKH UHODWLRQVKLS EHWZHHQ FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV DQG SURGXFW HIIHFWV ZLWK SRVLWLYH FRHIILFLHQWV LQGLFDWLQJ WKDW D FKDUDFWHULVWLF LV SRVLWLYHO\ FRUUHODWHG ZLWK HIIHFWV DQG D QHJDWLYH FRHIILFLHQW LQGLFDWLQJ WKH RSSRVLWH $V D JURXS FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ZHUH QRW VWDWLVWLFDOO\ VLJQLILFDQWO\ UHODWHG WR HIIHFWLYHQHVV DQG QHLWKHU VFKRRO QRU FODVVURRP FKDUDFWHULVWLFV ZHUH UHODWHG WR HIIHFWV LQ VHSDUDWH WHVWV 7KH DPRXQW RI WLPH VWXG\ SURGXFWV ZHUH XVHG ZDV QRW FRUUHODWHG ZLWK SURGXFW HIIHFWV

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

60

)LJXUH ,9 6FKRRO/HYHO (IIHFW 6L]HV E\ 'LVWULFW 6L[WK *UDGH 6$7 0DWK 6FRUH          1XPEHUV UHSUHVHQW GLVWULFWV DQG HDFK SRLQW LV D VFKRRO      (IIHFW 6L]H                      





(IIHFW 6L]H

)LJXUH ,9 6FKRRO/HYHO (IIHFW 6L]HV E\ 3URGXFW 6L[WK *UDGH 6$7 0DWK 6FRUH





B B A A A A B B B B B B B B B C B C C









A A A A A A A





/HWWHUV UHSUHVHQW SURGXFWV DQG HDFK SRLQW LV D VFKRRO

1RWH 6WDWLVWLFDO VLJQLILFDQFH RI DYHUDJH HIIHFW VL]HV FDQQRW EH LQIHUUHG IURP WKH ILJXUH EHFDXVH VWXGHQW DQG WHDFKHU VDPSOH VL]HV GLIIHU EHWZHHQ VFKRROV

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

7DEOH,9,QWHUDFWLRQV%HWZHHQ0RGHUDWLQJ9DULDEOHVDQG(IIHFWV6$70DWK7HVW6L[WK*UDGH
7RWDO6FRUH1&( FRHIILFLHQW             

SYDOXH

3URFHGXUHV1&(
SYDOXH

3UREOHP6ROYLQJ1&(
SYDOXH

VWDQGDUGHUURU             

SYDOXH

                                            


FRHIILFLHQW                    

VWDQGDUGHUURU

FRHIILFLHQW

VWDQGDUGHUURU

SYDOXH

            
SYDOXH

&ODVVURRP,QWHUDFWLRQ9DULDEOHV
            

<HDUVRIWHDFKLQJH[SHULHQFH 6WXG\SURGXFWXVHUHSRUWHGE\WHDFKHU 2WKHUSURGXFWXVHUHSRUWHGE\WHDFKHU 6WXGHQWVKDGSUREOHPVJHWWLQJDFFHVVWRSURGXFW 7HDFKHUKDGDGHTXDWHWLPHWRSUHSDUHWRXVH SURGXFW 7HDFKHULQGLFDWHVVFKRROKDVDFRPSXWHU VSHFLDOLVW 3URGXFWLVXVHGLQFODVVURRP

6FKRRO,QWHUDFWLRQ9DULDEOHV

3HUFHQWHOLJLEOHIRUIUHHOXQFK 6WXGHQWWHDFKHUUDWLR 6FKRROLVLQXUEDQDUHD 3HUFHQWRI$IULFDQ$PHULFDQVWXGHQWV 3HUFHQWRI+LVSDQLFVWXGHQWV 3HUFHQWVSHFLDOHGXFDWLRQVWXGHQWV

&ODVVURRPDQGVFKRROYDULDEOHV       &ODVVURRPYDULDEOHV       6FKRROYDULDEOHV       6RXUFH $XWKRUFDOFXODWLRQVVHH$SSHQGL[%IRUGHWDLOVRIWKHHVWLPDWLRQPRGHO9DULDEOHVLQWKHPRGHOLQFOXGHVWXGHQWDJHJHQGHUDQGWKHSUHWHVWVFRUHVWHDFKHUJHQGHUH[SHULHQFHDQGZKHWKHUKHRUVKHKDGDPDVWHUVGHJUHH VFKRROUDFHDQGHWKQLFLW\SHUFHQWRIVWXGHQWVLQVSHFLDOHGXFDWLRQDQGSHUFHQWHOLJLEOHIRUIUHHOXQFKWLPHRIXVHRIRWKHUWHFKQRORJ\SURGXFWVDQGVWXGHQWFODVVURRPDQGVFKRROUDQGRPHIIHFWV 1RFKDUDFWHULVWLFVDUHVLJQLILFDQWO\GLIIHUHQWIURP]HUREDVHGRQWKH%HQMDPLQL+RFKEHUJFRUUHFWLRQIRUPXOWLSOHFRPSDULVRQVZLWKIDOVHGLVFRYHU\UDWHRI7KHPXOWLSOHFRPSDULVRQVFRUUHFWLRQLVFRPSXWHGVHSDUDWHO\IRUFODVVURRP DQGVFKRROFKDUDFWHULVWLFV 1RFKLVTXDUHGWHVWVDUHVWDWLVWLFDOO\VLJQLILFDQWDWWKHOHYHORIVLJQLILFDQFH

&KL6TXDUHG7HVWV

61

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

 & &RQFOXVLRQV 7KLV VWXG\ H[SHULPHQWDOO\ WHVWHG WKH HIIHFWV RI WKUHH PDWK VRIWZDUH SURGXFWV LQ VL[WK JUDGH FODVVURRPV WKDW YROXQWHHUHG WR SDUWLFLSDWH 7KH VFKRROV SDUWLFLSDWLQJ LQ WKH VWXG\ ZHUH PRUH OLNHO\ WR EH LQ XUEDQ DUHDV DQG KDG KLJKHUWKDQDYHUDJH OHYHOV RI SRYHUW\ DQG ODUJHU SHUFHQWDJHV RI PLQRULW\ VWXGHQWV WKDQ 86 SXEOLF VFKRROV DV D ZKROH .H\ ILQGLQJV LQFOXGH  7HDFKHUV :HUH 7UDLQHG DQG 8VHG 3URGXFWV 1HDUO\ DOO WUHDWPHQW WHDFKHUV  SHUFHQW UHFHLYHG WUDLQLQJ IURP WKH YHQGRU LQ XVLQJ WKH SURGXFW DQG DOO LPSOHPHQWHG WKH DVVLJQHG SURGXFW WR VRPH H[WHQW 2YHUDOO XVDJH ZDV HVWLPDWHG DW DERXW  SHUFHQW RI PDWK LQVWUXFWLRQDO WLPH  (IIHFWV RQ 7HVW 6FRUHV :HUH 1RW 6WDWLVWLFDOO\ 'LIIHUHQW )URP =HUR 2YHUDOO PDWK VFRUHV IRU VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH  DQG  UHVSHFWLYHO\ LQ QRUPDOFXUYHHTXLYDOHQW XQLWV 7KH GLIIHUHQFH ZDV QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR  6FKRRO DQG &ODVVURRP &KDUDFWHULVWLFV :HUH 1RW 5HODWHG WR 3URGXFW (IIHFWV 7LPH RI SURGXFW XVH DQG RWKHU VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV ZHUH XQFRUUHODWHG ZLWK SURGXFW HIIHFWV

,9 (IIHFWV RI 6L[WK *UDGH 0DWK 6RIWZDUH 3URGXFWV

&KDSWHU 9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV

KLV FKDSWHU GHVFULEHV WKH LPSOHPHQWDWLRQ RI DOJHEUD WHFKQRORJ\ SURGXFWV DQG SUHVHQWV HVWLPDWHV RI WKHLU HIIHFWV DQG RI UHODWLRQVKLSV EHWZHHQ HIIHFWV DQG FRQGLWLRQV DQG SUDFWLFHV LQ SDUWLFLSDWLQJ FODVVURRPV DQG VFKRROV 0DQ\ IHDWXUHV RI WKH VWXG\V GHVLJQ GDWD FROOHFWLRQ DSSURDFK DQG DQDO\VLV DSSURDFK ZHUH WKH VDPH DV IRU WKH UHDGLQJ DQG VL[WK JUDGH PDWK SURGXFWV VXEVWXGLHV +RZHYHU WKH DOJHEUD VWXG\ XVHG WKH HQGRIFRXUVH DOJHEUD H[DP GHVLJQHG E\ (GXFDWLRQDO 7HVWLQJ 6HUYLFH (76 DV LWV IDOO DQG VSULQJ PHDVXUH RI DFKLHYHPHQW 7KH HQGRIFRXUVH H[DP KDV WKH EHQHILW RI GLUHFWO\ IRFXVLQJ RQ WKH VXEMHFW PDWWHU DQG KDV EHHQ XVHG LQ VHYHUDO RWKHU VWXGLHV RI DOJHEUD WHFKQRORJ\ SURGXFWV 7KH DOJHEUD VWXG\ LQFOXGHG WKUHH VRIWZDUH SURGXFWV WKDW ZHUH LPSOHPHQWHG LQ  VFKRROV ZLWKLQ  GLVWULFWV 7KH VDPSOH LQFOXGHG  WHDFKHUV DQG  VWXGHQWV 7KH WKUHH SURGXFWV ZHUH &RJQLWLYH 7XWRU $OJHEUD SXEOLVKHG E\ &DUQHJLH /HDUQLQJ 3ODWR $OJHEUD SXEOLVKHG E\ 3ODWR DQG /DUVRQ $OJHEUD SXEOLVKHG E\ +RXJKWRQ0LIIOLQ $ ,PSOHPHQWDWLRQ $QDO\VLV 7KH LPSOHPHQWDWLRQ DQDO\VLV IRFXVHG RQ VL[ DUHDV IHDWXUHV RI WKH SURGXFWV LQ WKH VWXG\ WHDFKHU WUDLQLQJ DQG VXSSRUW RQ XVLQJ SURGXFWV WKH GXUDWLRQ H[WHQW DQG ORFDWLRQ RI SURGXFW XVH WHFKQLFDO GLIILFXOWLHV LQ XVLQJ WKH SURGXFWV WKHLU UROH LQ WKH FXUULFXOXP DQG WKH HIIHFWV WKDW SURGXFW XVH KDG RQ FODVVURRP DFWLYLWLHV 3URGXFW )HDWXUHV 7KH SURGXFWV LQ WKH DOJHEUD VXEVWXG\ DOO SURYLGH WXWRULDO SUDFWLFH DQG DVVHVVPHQW RSSRUWXQLWLHV LQ DOJHEUD 7RSLFV LQFOXGH FRPPRQ RQHV LQ DOJHEUD IXQFWLRQV OLQHDU HTXDWLRQV DQG LQHTXDOLWLHV TXDGUDWLF HTXDWLRQV OLQHDU H[SUHVVLRQV SRO\QRPLDOV V\VWHPV RI HTXDWLRQV DQG LQHTXDOLWLHV DQG GDWD DQDO\VLV 3URGXFWV SURYLGH VWXGHQWV ZLWK RSSRUWXQLWLHV IRU H[DPSOH WR ZULWH VROYH DQG JUDSK HTXDWLRQV DQG LQHTXDOLWLHV VROYH V\VWHPV RI HTXDWLRQV DQG LQHTXDOLWLHV IDFWRU SRO\QRPLDOV DQG DQDO\]H DQG PDNH SUHGLFWLRQV IURP GDWD 7KH VWXG\ HVWLPDWHG WKH DYHUDJH OLFHQVLQJ IHHV IRU WKH SURGXFWV WR EH DERXW  D VWXGHQW IRU WKH VFKRRO \HDU ZLWK D UDQJH RI  WR 

64 7KH SURGXFWV ZHUH UDWHG DV VLPLODU RQ PDQ\ DVSHFWV RI WKHLU LQVWUXFWLRQDO GHVLJQ 7DEOH 9 7KH\ DOO LQGLYLGXDOL]H LQVWUXFWLRQ DXWRPDWLFDOO\ VHWWLQJ LQGLYLGXDO VWXGHQW OHDUQLQJ SDWKV GHSHQGLQJ RQ D VWXGHQWV SDUWLFXODU VNLOO OHYHO DQG DOVR OHWWLQJ WHDFKHUV RU VWXGHQWV PDQXDOO\ VHOHFW VNLOOV WR SUDFWLFH 7ZR SURGXFWV LQFOXGH PDQ\ WXWRULDO PRGXOHV WKH RWKHU KDV IHZHU WXWRULDOV DQG SURYLGHV DGGLWLRQDO WXWRULDO RSSRUWXQLWLHV LQ SULQW PDWHULDOV LQWHQGHG WR EH XVHG ZLWK WKH FRPSXWHUEDVHG FRPSRQHQW $OO WKUHH SURGXFWV SURYLGH DPSOH RSSRUWXQLWLHV IRU SUDFWLFLQJ DOJHEUD VNLOOV DQG JLYH LPPHGLDWH GLDJQRVWLF IHHGEDFN ZKHQ XVHG LQ SUDFWLFH PRGH $OVR WKH\ DOO JLYH WHDFKHUV IHHGEDFN RQ LQGLYLGXDO VWXGHQW DQG FODVV SHUIRUPDQFH IRU JURXSV RI LWHPV DQG RQH JLYHV WHDFKHUV UHFRPPHQGDWLRQV IRU LQGLYLGXDOL]LQJ VWXGHQWV OHDUQLQJ SDWKV EDVHG RQ VWXGHQW VFRUHV RQ DVVHVVPHQWV 7HDFKHU 7UDLQLQJ DQG 6XSSRUW 7UHDWPHQW WHDFKHUV ZHUH WUDLQHG LQ WKHLU KRVW GLVWULFWV RU VFKRROV GXULQJ VXPPHU RU HDUO\ IDOO RI  7KH LQLWLDO WUDLQLQJ SURYLGHG E\ WKH WKUHH DOJHEUD SURGXFW YHQGRUV ODVWHG DERXW  KRXUV YDU\LQJ IURP  WR  KRXUV 7RSLFV LQFOXGHG FODVVURRP PDQDJHPHQW DQG DOLJQPHQW ZLWK VWDQGDUGV DQG WKH ORFDO FXUULFXOXP 7HDFKHUV ZHUH DOVR DEOH WR SUDFWLFH XVLQJ WKH SURGXFW 1HDUO\ DOO WHDFKHUV  SHUFHQW DWWHQGHG WKH LQLWLDO WUDLQLQJ DFFRUGLQJ WR DWWHQGDQFH ORJV 2Q D TXHVWLRQQDLUH FRPSOHWHG DW WKH HQG RI LQLWLDO WUDLQLQJ  SHUFHQW RI WHDFKHUV VDLG WKH\ ZHUH FRQILGHQW WKH\ ZHUH SUHSDUHG WR XVH WKH SURGXFW ZLWK WKHLU VWXGHQWV %\ WKH WLPH RI WKH ILUVW FODVVURRP REVHUYDWLRQ WKH SURSRUWLRQ RI WHDFKHUV ZKR EHOLHYHG WKH LQLWLDO WUDLQLQJ KDG DGHTXDWHO\ SUHSDUHG WKHP WR XVH WKH SURGXFW KDG GURSSHG IURP  SHUFHQW WR  SHUFHQW 2QJRLQJ VXSSRUW ZDV SURYLGHG E\ YHQGRUV LQ YDULRXV PRGHV 6RPH KDG FRPSDQ\ UHSUHVHQWDWLYHV YLVLW WHDFKHUV  SHUFHQW RI WHDFKHUV UHSRUWHG UHFHLYLQJ WKLV NLQG RI VXSSRUW VXSSRUWHG HPDLO RU WHOHSKRQH KHOS GHVNV  SHUFHQW RI WHDFKHUV VDLG WKH\ ZHUH DZDUH RI RU XVHG WKLV NLQG RI VXSSRUW DQG SURYLGHG DGGLWLRQDO WUDLQLQJ DW VFKRROV ZKLFK  SHUFHQW RI WHDFKHUV UHSRUWHG UHFHLYLQJ 7KH VWXG\ WHDP SXUFKDVHG VRPH KDUGZDUH DQG VRIWZDUH XSJUDGHV LQ KRVW VFKRROV EXW WR D OHVVHU H[WHQW WKDQ LQ RWKHU JUDGH OHYHOV 6WXG\ REVHUYHUV QRWHG WKDW WUHDWPHQW WHDFKHUV DYHUDJHG DERXW  FRPSXWHUV LQ WKH URRPV ZKHWKHU LQ ODEV RU UHJXODU FODVVURRPV ZKHUH SURGXFWV ZHUH EHLQJ XVHG 'XUDWLRQ DQG ([WHQW RI 3URGXFW 8VH $OO WUHDWPHQW WHDFKHUV LPSOHPHQWHG WKH SURGXFWV WR VRPH GHJUHH VHH 7DEOH 9 7UHDWPHQW WHDFKHUV UHSRUWHG WKDW WKH\ XVHG VWXG\ SURGXFWV IRU DERXW  ZHHNV GXULQJ WKH VFKRRO \HDU IRU DOPRVW  PLQXWHV D ZHHN WRWDOLQJ  KRXUV IRU WKLV SHULRG 2QO\  SHUFHQW RI WUHDWPHQW WHDFKHUV DQG  SHUFHQW RI FRQWURO WHDFKHUV UHSRUWHG XVLQJ PDWK SURGXFWV EHVLGHV WKRVH LQ WKH VWXG\ 2Q DYHUDJH XVH RI RWKHU PDWK VRIWZDUH SURGXFWV ZDV DERXW  KRXUV D \HDU IRU FRQWURO WHDFKHUV DQG  KRXUV IRU WUHDWPHQW WHDFKHUV 7DEOH 9 7KH PRVW FRPPRQO\ XVHG SURGXFWV ZHUH RQOLQH VWXG\ PDWHULDOV WR VXSSOHPHQW D FRPPHUFLDO WH[WERRN DQG D ZHEVLWH GHYHORSHG E\ D VWDWH GHSDUWPHQW RI HGXFDWLRQ WKDW SURYLGHG VWXG\ SUREOHPV IRU VWXGHQWV WR SUHSDUH IRU WKH VWDWH WHVWV 1RQH RI WKH FRQWURO WHDFKHUV XVHG D VWXG\ SURGXFW

9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV

7DEOH9,QVWUXFWLRQDO)HDWXUHVRI$OJHEUD3URGXFWV
,QGLYLGXDOL]DWLRQD )HHGEDFNWR7HDFKHUV 6WXGHQW,QSXW 7 3 $ 6WXGHQW 0DVWHU\ 3 $ 3 /HDUQLQJ 3DWKV &ODVVURRP 3HUIRUPDQFH ,PPHGLDWH 0DVWHU\ $ $XWRPDWLF 7 3 $ 7 3 $ 7HDFKHU,QSXW )HHGEDFNWR6WXGHQWVE 'LDJQRVWLF 3 $

3URGXFW 0DQ\ 0DQ\ 0DQ\

7XWRULDO 2SSRUWXQLWLHV

3UDFWLFH 2SSRUWXQLWLHV

)HZ

9 9 9 9

9 9

$ %

0DQ\

&

0DQ\

6RXUFH6WDIIUHYLHZ

9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9

9 9 9

9 9 9

9 9

7 7XWRULDOPRGH3 3UDFWLFHPRGH$ $VVHVVPHQWPRGH

,PPHGLDWHIHHGEDFN/HDUQHUWROGZKHWKHUUHVSRQVHLVFRUUHFWLPPHGLDWHO\DIWHUFRPSOHWLQJPRGXOH'LDJQRVWLFIHHGEDFN/HDUQHUUHFHLYHVKLQWVRURWKHULQIRUPDWLRQFRQFHUQLQJWKHSUREDEOH VRXUFHRIHUURU0DVWHU\IHHGEDFN/HDUQHULQIRUPHGRIWKHQXPEHUFRUUHFWDQGZKHWKHUDVNLOORUFRQFHSWKDVEHHQDFTXLUHG

9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV

65


7DEOH 9 7HDFKHU5HSRUWHG 8VH RI 6WXG\ 3URGXFWV DQG 2WKHU 0DWK 6RIWZDUH $OJHEUD 6WXG\ 3URGXFWV 7UHDWPHQW *URXS 3HUFHQW RI WHDFKHUV XVLQJ D SURGXFW 0LQXWHV RI ZHHNO\ XVH +RXUV RI DQQXDO XVH 6DPSOH VL]H

2WKHU 0DWKHPDWLFV 3URGXFWV 7UHDWPHQW *URXS     &RQWURO *URXS     SYDOXHD   

&RQWURO *URXS    

   

6RXUFHV &ODVVURRP REVHUYDWLRQV DQG WHDFKHU LQWHUYLHZV

D

7HVWV RI PHDQ GLIIHUHQFH ZHUH GRQH ZLWKLQ WZROHYHO KLHUDUFKLFDO PRGHOV ZLWK WKH HIIHFW RI WUHDWPHQW DVVLJQPHQW DW OHYHO RQH DQG EHWZHHQVFKRRO YDULDQFH DW OHYHO WZR

6WDWLVWLFDOO\ GLIIHUHQW DW WKH  OHYHO

7DEOH 9 'DLO\ DQG $QQXDO 8VDJH 3URGXFW $ 7RWDO GD\V XVHG GXULQJ VFKRRO \HDU 0LQXWHV RI GDLO\ XVH ZKHQ XVHG +RXUV RI DQQXDO XVH
6RXUFH

3URGXFW %   

3URGXFW &   

2YHUDOO   

  

3URGXFW UHFRUGV 2YHUDOO HVWLPDWHV DUH EDVHG RQ SURGXFW HVWLPDWHV ZHLJKWHG E\ VWXGHQW VDPSOH VL]HV

7KH GLIIHUHQFH LQ SURGXFW XVH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHUV YDULHG E\ GLVWULFW DQG VFKRRO )LJXUH 9 7KH GLIIHUHQFH DYHUDJHG DERXW  KRXUV ZLWK D VWDQGDUG GHYLDWLRQ EHWZHHQ VFKRROV RI DERXW  KRXUV 1R VFKRROV KDG D QHJDWLYH GLIIHUHQFH DQG VRPH KDG KLJK OHYHOV RI XVDJH PRUH WKDQ  KRXUV D \HDU 8VDJH GLIIHUHQFHV DUH DOVR HYLGHQW EHWZHHQ GLVWULFWV )RU H[DPSOH WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW DQG FRQWURO WHDFKHU WHFKQRORJ\ XVDJH ZDV UHODWLYHO\ ODUJH LQ GLVWULFW  FRPSDUHG WR GLVWULFW  $FFRUGLQJ WR SURGXFW UHFRUGV DFWXDO VWXGHQW XVDJH UDQJHG IURP  WR DOPRVW  KRXUV VHH 7DEOH 9 2YHUDOO XVDJH DYHUDJHG  KRXUV IRU WKH VFKRRO \HDU ZKLFK LV DERXW
$YHUDJH UHSRUWHG SURGXFW XVDJH DFFRUGLQJ WR WHDFKHUV  KRXUV D \HDU ZDV ODUJHU WKDQ DYHUDJH XVDJH IURP SURGXFW UHFRUGV  KRXUV DQG WHDFKHUUHSRUWHG XVDJH DQG XVDJH DFFRUGLQJ WR SURGXFW UHFRUGV ZHUH PRGHUDWHO\ FRUUHODWHG U  IRU DQQXDO XVH 7KH GHJUHH RI FRUUHODWLRQ VXJJHVWV WKDW WHDFKHUUHSRUWHG XVDJH LV RQO\ D URXJK LQGLFDWRU RI DFWXDO XVDJH


9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV


)LJXUH9 'LIIHUHQFHLQ$QQXDO7HDFKHU5HSRUWHG+RXUVRI0DWK7HFKQRORJ\3URGXFW8VH %HWZHHQ7UHDWPHQWDQG&RQWURO&ODVVURRPV $OJHEUD
 

2


1
+RXUV

10
    

1 1 3 3

7 7

8 9

10 10 10

6 6 4
6FKRROV*URXSHGE\'LVWULFW 1XPEHUVUHSUHVHQWGLVWULFWVDQGHDFKSRLQWLVDVFKRRO

6RXUFH 7HDFKHU ,QWHUYLHZV

 SHUFHQW RI PDWK LQVWUXFWLRQDO WLPH DVVXPLQJ D PLQXWH FODVV SHULRG DQG D GD\ VFKRRO \HDU 5ROH RI 3URGXFWV LQ WKH &XUULFXOXP DQG 7LPH DQG 3ODFH RI 8VH 7ZR SURGXFWV ZHUH LQWHQGHG WR VXSSOHPHQW WKH FRUH FXUULFXOXP DQG WKH WKLUG ZDV LQWHQGHG WR EH WKH FRUH DOJHEUD FXUULFXOXP :KHQ WUHDWPHQW WHDFKHUV ZHUH DVNHG DERXW WKH UROH RI SURGXFWV LQ WKHLU DOJHEUD FXUULFXOXP  SHUFHQW LQGLFDWHG WKH\ XVHG WKH SURGXFW DV D VXSSOHPHQW DQG  SHUFHQW VDLG WKH\ XVHG WKH SURGXFW DV WKHLU FRUH FXUULFXOXP )RU WHDFKHUV XVLQJ WKH SURGXFW WKDW ZDV LQWHQGHG WR EH D FRUH FXUULFXOXP  SHUFHQW VDLG WKH\ XVHG LW DV VXFK

2YHUDOO XVDJH LV ZHLJKWHG E\ VWXGHQW VDPSOH VL]H IRU HDFK SURGXFW 7KH XVDJH HVWLPDWH LQFOXGHV RQO\ WLPH XVLQJ FRPSXWHUV DQG GRHV QRW LQFOXGH WKH QRQFRPSXWHUEDVHG FODVV DFWLYLWLHV WKDW ZHUH D PDMRU SDUW RI WKH LPSOHPHQWDWLRQ PRGHO IRU RQH RI WKH SURGXFWV


9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV

 7HDFKHUV YDULHG LQ KRZ WKH\ VFKHGXOHG SURGXFW XVH 0RVW WHDFKHUV  SHUFHQW XVHG SURGXFWV RQO\ GXULQJ UHJXODU FODVV WLPH DQG WKH RWKHU  SHUFHQW XVHG LW ERWK GXULQJ FODVV WLPH DQG DW RWKHU WLPHV 3URGXFWV ZHUH XVHG LQ FRPSXWHU ODEV E\  SHUFHQW RI WHDFKHUV DQG  SHUFHQW RI WHDFKHUV XVHG SURGXFWV LQ UHJXODU FODVVURRPV &RQVLVWHQW ZLWK YHQGRU UHFRPPHQGDWLRQV QHDUO\ DOO WUHDWPHQW WHDFKHUV  SHUFHQW UHSRUWHG EHLQJ SUHVHQW ZKHQ WKHLU VWXGHQWV XVHG SURGXFWV DQG  SHUFHQW UHSRUWHG UHYLHZLQJ VWXGHQW UHSRUWV WZR WR WKUHH WLPHV D PRQWK RU PRUH IUHTXHQWO\ 7HFKQLFDO 'LIILFXOWLHV 6WXG\ REVHUYHUV UHSRUWHG WHFKQLFDO SUREOHPV WKDW DIIHFWHG DW OHDVW RQH VWXGHQW LQ  SHUFHQW RI WKH WLPH VHJPHQWV WKH\ REVHUYHG (DFK REVHUYDWLRQ LQFOXGHG IRXU WR ILYH WLPH VHJPHQWV 0RVW WHFKQLFDO SUREOHPVVXFK DV SUREOHPV ORJJLQJ RQ WR SURGXFWV RU KDYLQJ FRPSXWHUV IUHH]H DQG QHHG UHERRWLQJZHUH EULHI DQG DIIHFWHG RQO\ D IHZ VWXGHQWV 6DWLVIDFWLRQ :LWK 3URGXFWV 1HDUO\ DOO WUHDWPHQW WHDFKHUV  SHUFHQW VDLG WKH\ ZRXOG XVH WKH SURGXFW LQ WKH QH[W VFKRRO \HDU LI JLYHQ WKH FKRLFH :KHQ DVNHG ZKDW WKH\ ZRXOG FKDQJH LQ D VHFRQG \HDU RI LPSOHPHQWDWLRQ  SHUFHQW VDLG WKH\ ZRXOG DWWHQG PRUH FORVHO\ WR DOLJQPHQW RI WKH VRIWZDUH ZLWK WKH FRUH FXUULFXOXP DQG DFFRXQWDELOLW\ V\VWHP  SHUFHQW VDLG WKH\ ZRXOG VWDUW XVLQJ WKH SURGXFW VRRQHU RU XVH LW PRUH RIWHQ ,PSDFW RQ &ODVVURRP $FWLYLWLHV 'XULQJ REVHUYDWLRQ LQWHUYDOV WKH WLPH SHULRGV GXULQJ ZKLFK REVHUYHUV QRWHG WHDFKHU UROHV WUHDWPHQW WHDFKHUV ZHUH REVHUYHG DFWLQJ DV IDFLOLWDWRUV LQ D ODUJHU SURSRUWLRQ RI LQWHUYDOV WKDQ FRQWURO WHDFKHUV  SHUFHQW FRPSDUHG WR  SHUFHQW S   7DEOH 9 6WXGHQWV ZHUH DOVR PRUH OLNHO\ WR EH HQJDJHG LQ LQGLYLGXDO SUDFWLFH  SHUFHQW FRPSDUHG WR  SHUFHQW S   ,Q FRQWURO FODVVURRPV VWXGHQWV ZHUH PRUH OLNHO\ WR EH OLVWHQLQJ WR D WHDFKHUV OHFWXUH SDUWLFLSDWLQJ LQ TXHVWLRQDQGDQVZHU VHVVLRQV DQG UHYLHZLQJ WKHLU ZRUN ZLWK WHDFKHUV 6WXGHQWV ZHUH PRUH OLNHO\ WR EH RQ WDVN ZKHQ XVLQJ SURGXFWV  SHUFHQW FRPSDUHG WR  SHUFHQW S   % (IIHFWV RQ $OJHEUD 7HVW 6FRUHV (IIHFWV RQ WHVW VFRUHV ZHUH HVWLPDWHG XVLQJ D PRGHO WKDW DFFRXQWHG IRU WKH QHVWLQJ RI VWXGHQWV LQ FODVVURRPV DQG FODVVURRPV LQ VFKRROV 7KH HVWLPDWHV VKRZ WKDW HIIHFWV RQ WHVW VFRUHV JHQHUDOO\ ZHUH QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR DQG PRVW WHDFKHU DQG VFKRRO FKDUDFWHULVWLFV ZHUH XQFRUUHODWHG ZLWK HIIHFWV

7KH GLIIHUHQFHV ZHUH HVWLPDWHG XVLQJ D WZROHYHO KLHUDUFKLFDO OLQHDU PRGHO ZLWK WHDFKHUV LQ WKH ILUVW OHYHO DQG VFKRROV LQ WKH VHFRQG OHYHO

9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV


7DEOH 9 $FWLYLWLHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 7UHDWPHQW &ODVVURRPV 7HDFKHU 5ROH 3HUFHQWE /HDGHU )DFLOLWDWRU 0RQLWRUREVHUYHU :RUNLQJ RQ RWKHU WDVNV 2WKHU ,QVWUXFWLRQDO $FWLYLW\ 3HUFHQWE ,QGLYLGXDO SUDFWLFH /HFWXUH 4XHVWLRQ DQG DQVZHU 5HYLHZ RI VWXGHQW ZRUN 2WKHU 6WXGHQW 2Q7DVN %HKDYLRU 3HUFHQW 0RUH WKDQ  SHUFHQW RI VWXGHQWV RQ WDVN 6DPSOH 6L]H 1XPEHU RI FODVVURRPV 1XPEHU RI REVHUYDWLRQ LQWHUYDOV              &RQWURO &ODVVURRPV              SYDOXHD           

6RXUFH &ODVVURRP REVHUYDWLRQ LQWHUYDOV DW PLQXWHV   DQG  IRU HDFK FODVV
D

7HVWV RI PHDQ GLIIHUHQFH FRQGXFWHG ZLWKLQ IRXUOHYHO KLHUDUFKLFDO PRGHOV ZLWK WKH HIIHFW RI WUHDWPHQW DVVLJQPHQW PRGHOHG DW OHYHO RQH DQG EHWZHHQVFKRRO YDULDQFH PRGHOHG DW OHYHO WZR FRGHG DOO WKDW DSSO\

E2EVHUYHUV

7UHDWPHQW DQG &RQWURO *URXS &KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV 7HDFKHU DQG VWXGHQW FKDUDFWHULVWLFV ZHUH VLPLODU 7DEOH 9 IRU WUHDWPHQW DQG FRQWURO FRQGLWLRQV 7KH DYHUDJH VFRUH RQ WKH (76 DOJHEUD H[DP ZDV  SHUFHQW FRUUHFW IRU VWXGHQWV LQ WUHDWPHQW FODVVURRPV DQG  SHUFHQW FRUUHFW LQ FRQWURO FODVVURRPV 5DQGRP JXHVVLQJ ZRXOG \LHOG D VFRUH RI  SHUFHQW RQ DYHUDJH TXHVWLRQV KDG IRXU UHVSRQVH FDWHJRULHV +RZHYHU VWXGHQWV ZHUH LQ WKH HDUO\ VWDJHV RI DOJHEUD LQVWUXFWLRQ DQG ZHUH WDNLQJ D ILQDO H[DP LQ DOJHEUD

7KH (76 DOJHEUD H[DP FRQVLVWV RI WZR TXHVWLRQ WHVWV FRPELQHG LQ D TXHVWLRQ WHVW )RU SXUSRVHV RI WKH VWXG\ (76 VHSDUDWHG WKH WHVW LQWR LWV WZR FRPSRQHQWV DQG WKH VWXG\ WHDP UDQGRPO\ DVVLJQHG VFKRROV WR WDNH RQH RI WKH FRPSRQHQWV DV WKH IDOO WHVW DQG WKH RWKHU DV WKH VSULQJ WHVW KDOI WKH VFKRROV WRRN WKH WHVW LQ WKH SDWWHUQ $% DQG WKH RWKHU KDOI WRRN WKH WHVW LQ WKH SDWWHUQ %$ 6WDWLVWLFDO WHVWV VKRZ VRPH GLIIHUHQFHV LQ DYHUDJH VFRUHV RQ WKH WZR FRPSRQHQWV +RZHYHU WKHVH GLIIHUHQFHV EHWZHHQ WKH WZR KDOYHV RI WKH WHVW GR QRW DIIHFW PHDVXUHG HIIHFWV EHFDXVH WKH VDPH GLIIHUHQFH LV SUHVHQW IRU ERWK WUHDWPHQW DQG FRQWURO FODVVURRPV

9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV

 (IIHFWV :HUH 1RW 6WDWLVWLFDOO\ 'LIIHUHQW )URP =HUR 7DEOH 9 VKRZV DYHUDJH VFRUH GLIIHUHQFHV RQ WKH (76 DOJHEUD H[DP VFRUH DQG LWV WKUHH VXEWHVW VFRUHV FRQFHSWV SURFHVVHV DQG VNLOOV IURP WKH KLHUDUFKLFDO OLQHDU PRGHO 1RQH RI WKH GLIIHUHQFHV LV VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR )LJXUHV 9 DQG 9 GHSLFW WKH YDULDWLRQ RI VFKRRO HIIHFW VL]HV E\ GLVWULFW DQG E\ SURGXFW :LWKLQ GLVWULFWV HIIHFW VL]HV UDQJHG ZLGHO\ )RU H[DPSOH LQ GLVWULFW  HIIHFW VL]HV LQ WKH IRXU VFKRROV UDQJHG IURP DERXW  WR 

7DEOH 9 &KDUDFWHULVWLFV RI 7HDFKHUV DQG 6WXGHQWV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 7UHDWPHQW &ODVVURRPV 7HDFKHU &KDUDFWHULVWLFV <HDUV RI H[SHULHQFH \HDUV +DV D PDVWHUV GHJUHH SHUFHQW 6FKRRO KDV FRPSXWHU VSHFLDOLVW SHUFHQW 5HFHLYHG SURIHVVLRQDO GHYHORSPHQW RQ XVLQJ WHFKQRORJ\ ODVW \HDU SHUFHQW )HPDOH SHUFHQW 7HDFKHU 6DPSOH 6L]H 6WXGHQW &KDUDFWHULVWLFV )HPDOH SHUFHQW $JH DV RI 2FWREHU  \HDUV 8QDGMXVWHG RYHUDOO VFRUH RQ IDOO (76 DOJHEUD H[DPE 6DPSOH 6L]H                             &RQWURO &ODVVURRPV SYDOXHD

6RXUFHV 7HDFKHU TXHVWLRQQDLUHV VWXGHQW UHFRUGV DQG WHVWV DGPLQLVWHUHG E\ VWXG\ VWDII
D7HVWV

RI WUHDWPHQW DQG FRQWURO GLIIHUHQFHV ZHUH FRQGXFWHG XVLQJ D WZROHYHO KLHUDUFKLFDO PRGHO ZLWK FODVVURRP WUHDWPHQW VWDWXV DV D IL[HG HIIHFW DQG VFKRRO DV D UDQGRP HIIHFW IRU WHDFKHUV DQG FODVVURRPV DQG VFKRROV DV UDQGRP HIIHFWV IRU VWXGHQWV 7KH SYDOXH RI WKH GLIIHUHQFH LV WKH SYDOXH RI WKH HVWLPDWHG WUHDWPHQW FRHIILFLHQW (76 WHVW VFRUH LV WKH SHUFHQW RI TXHVWLRQV DQVZHUHG FRUUHFWO\

E7KH

6FKRRO HIIHFWV ZHUH HVWLPDWHG XVLQJ D UHJUHVVLRQ PRGHO LQ ZKLFK WHVW VFRUHV DUH UHJUHVVHG RQ VWXGHQW DQG WHDFKHU FKDUDFWHULVWLFV DQG WKH WUHDWPHQW LQGLFDWRU LV LQWHUDFWHG ZLWK DQ LQGLFDWRU IRU HDFK VFKRRO 6WDQGDUG HUURUV ZHUH DGMXVWHG IRU FODVVURRP FOXVWHULQJ
32

9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV


7DEOH 9 (76 $OJHEUD )LQDO ([DP 6FRUH 'LIIHUHQFHV LQ 7UHDWPHQW DQG &RQWURO &ODVVURRPV 7UHDWPHQW &ODVVURRP $YHUDJH 6FRUHD (76 (QGRI&RXUVH $OJHEUD ([DP 2YHUDOO VFRUH 6XEWHVW VFRUHV &RQFHSWV 3URFHVVHV 6NLOOV
6RXUFH

&RQWURO &ODVVURRP $YHUDJH 6FRUHD

'LIIHUHQFH

(IIHFW 6L]H

SYDOXH

   

   

   

   

   

$XWKRU FDOFXODWLRQV VHH $SSHQGL[ % IRU GHWDLOV RI WKH HVWLPDWLRQ PRGHO 9DULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG SUHWHVW VFRUH WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU KH RU VKH KDG D PDVWHUV GHJUHH VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ DQG SHUFHQW HOLJLEOH IRU IUHH OXQFK DQG VWXGHQW FODVVURRP DQG VFKRRO UDQGRP HIIHFWV 7KH WUHDWPHQW FODVVURRP DYHUDJH VFRUH UHSRUWHG LQ WKH WDEOH LV WKH FRQWURO FODVVURRP DYHUDJH VFRUH SOXV WKH WUHDWPHQW HIIHFW ,W GLIIHUV IURP WKH XQDGMXVWHG WUHDWPHQW FODVVURRP VFRUH

D7KH

(76 WHVW VFRUH LV WKH SHUFHQW RI TXHVWLRQV DQVZHUHG FRUUHFWO\ (IIHFW VL]HV DUH FDOFXODWHG XVLQJ WKH FRQWURO JURXS VWDQGDUG GHYLDWLRQV RQ WKH VSULQJ WHVW

1RWH

7KH VSULQJ ILQDO H[DP VFRUHV IRU VWXGHQWV LQ WKH WUHDWPHQW DQG FRQWURO JURXSV EHIRUH PRGHOEDVHG DGMXVWPHQW DYHUDJHG  SHUFHQW IRU WUHDWPHQW FODVVURRPV DQG  SHUFHQW IRU FRQWURO FODVVURRPV )DOO VFRUHV DYHUDJHG DERXW  SHUFHQW IRU ERWK JURXSV LQGLFDWLQJ WKDW DIWHU D VFKRRO \HDU RI DOJHEUD LQVWUXFWLRQ WKH DYHUDJH VWXGHQW LQ WKH VWXG\ ZDV DEOH WR DQVZHU DQ DGGLWLRQDO RQH RU WZR TXHVWLRQV FRUUHFWO\ HDFK TXHVWLRQ ZDV ZRUWK IRXU SRLQWV ,Q  LQIRUPDWLRQ IURP (76 LQGLFDWHV WKDW WHVW WDNHUV DYHUDJHG  SHUFHQW FRUUHFW KRZHYHU 7HVW WDNHUV LQ WKH VWXG\ ZHUH ZLWKLQ D UHDVRQDEOH UDQJH RI WKH DYHUDJH DIWHU DFFRXQWLQJ IRU SRYHUW\ OHYHOV DQG XUEDQLFLW\ RI VFKRROV LQ WKH VWXG\ (YDOXDWLRQV LQ GLVWULFWV ZLWK FKDUDFWHULVWLFV VLPLODU WR GLVWULFWV LQ WKLV VWXG\ KDYH IRXQG FRPSDUDEOH VSULQJ (76 H[DP VFRUHV 6KQH\GHUPDQ  0RUJDQ DQG 5LWWHU  :KHWKHU JDLQV ZHUH VPDOO LQ WKHVH VWXGLHV LV QRW NQRZQ EHFDXVH WKHVH VWXGLHV GLG QRW DGPLQLVWHU WKH WHVW LQ WKH IDOO DQG VSULQJ +RZHYHU WKH VLPLODULW\ RI WKH DYHUDJH VSULQJ VFRUH LQ SUHYLRXV VWXGLHV ZLWK VFRUHV KHUH VXJJHVWV WKDW VFRUHV LQ WKLV VWXG\ DUH QRW DQ DEHUUDWLRQ $QRWKHU ZD\ WR H[DPLQH ZKHWKHU WKH (76 WHVW IXQFWLRQHG SURSHUO\ LV WR ORRN DW VFRUH GLIIHUHQFHV RQ GLVWULFW DVVHVVPHQWV ,Q WZR GLVWULFWV ZKHUH WKH VWXG\ ZDV DEOH WR JDWKHU GLVWULFW WHVW VFRUH GDWD IURP VFKRRO UHFRUGV DQ DQDO\VLV RI WKH GLVWULFW VFRUHV \LHOGHG VLPLODU GLUHFWLRQV RI VFRUH GLIIHUHQFHV DQG HIIHFW VL]HV ZHUH VLPLODU VHH $SSHQGL[ 7DEOH % 7KH VLPLODULWLHV SURYLGH VXSSRUW IRU WKH (76 DOJHEUD WHVW DV D UHDVRQDEOH LQGLFDWLRQ RI DOJHEUD SURGXFW HIIHFWLYHQHVV

9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV



)LJXUH9 6FKRRO/HYHO(IIHFW6L]HVE\'LVWULFW $OJHEUD(76)LQDO([DP

     

(IIHFW6L]H
6 1 3 3 5 1 7 1 4 6 2 8 9 10 10 6 9 10

 1XPEHUVUHSUHVHQWGLVWULFWVDQGHDFKSRLQWLVDVFKRRO

)LJXUH9 6FKRRO/HYHO(IIHFW6L]HVE\3URGXFW $OJHEUD(76)LQDO([DP (IIHFW6L]H

        

$ $ $ $ $ $ $

% % % % % % % % % %
/HWWHUVUHSUHVHQWSURGXFWVDQGHDFKSRLQWLVDVFKRRO

&

& &

1RWH 6WDWLVWLFDO VLJQLILFDQFH RI DYHUDJH HIIHFW VL]HV FDQQRW EH LQIHUUHG IURP WKH ILJXUH EHFDXVH VWXGHQW DQG WHDFKHU VDPSOH VL]HV GLIIHU EHWZHHQ VFKRROV

9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV

 &ODVVURRP DQG 6FKRRO 0RGHUDWRUV :KHWKHU VFRUH GLIIHUHQFHV ZHUH UHODWHG WR VFKRRO DQG FODVVURRP FKDUDFWHULVWLFV ZDV LQYHVWLJDWHG XVLQJ WKH VDPH DSSURDFK DV LQ SUHYLRXV FKDSWHUV 7KH VPDOOHU QXPEHU RI VFKRROV SDUWLFLSDWLQJ LQ WKH DOJHEUD VWXG\ FRPSDUHG WR WKH RWKHU WKUHH VWXGLHV OLPLWHG WKH QXPEHU RI YDULDEOHV WKDW FRXOG EH LQFOXGHG LQ WKH PRGHO &KDUDFWHULVWLFV LQFOXGHG ZHUH WKRVH WKDW ZHUH UHODWHG WR HIIHFWLYHQHVV LQ WKH UHDGLQJ VWXGLHV WHDFKHU H[SHULHQFH ZKHWKHU WHDFKHUV KDG DGHTXDWH SUHSDUDWLRQ WLPH WLPH RI SURGXFW XVDJH DQG ZKHWKHU VWXG\ SURGXFWV ZHUH XVHG LQ FODVVURRPV 7ZR VFKRRO FKDUDFWHULVWLFVWKH SURSRUWLRQ RI VWXGHQWV HOLJLEOH IRU IUHH OXQFK DQG WKH VWXGHQWWHDFKHU UDWLRZHUH DOVR LQFOXGHG 7KH UHVXOWV DSSHDU LQ 7DEOH 9 DQG WKH VWDWLVWLFDO WHVWV DW WKH ERWWRP RI WKH WDEOH LQGLFDWH WKDW FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ZHUH XQFRUUHODWHG ZLWK SURGXFW HIIHFWV 6WXG\ SURGXFW XVDJH KDG D QHJDWLYH FRUUHODWLRQ ZLWK SURGXFW HIIHFWV EXW ZDV QRW VWDWLVWLFDOO\ VLJQLILFDQW DIWHU DGMXVWLQJ IRU PXOWLSOH FRPSDULVRQV & &RQFOXVLRQV 7KLV VWXG\ H[SHULPHQWDOO\ WHVWHG WKH HIIHFWV RI VHOHFW PDWK WHFKQRORJ\ SURGXFWV LQ DOJHEUD FODVVURRPV WKDW YROXQWHHUHG WR SDUWLFLSDWH .H\ ILQGLQJV LQFOXGH WKH IROORZLQJ  7HDFKHUV :HUH 7UDLQHG DQG 8VHG 3URGXFWV 1HDUO\ DOO WUHDWPHQW WHDFKHUV  SHUFHQW UHFHLYHG WUDLQLQJ IURP WKH YHQGRU RQ XVLQJ WKH SURGXFW DQG DOO LPSOHPHQWHG WKH SURGXFW WR VRPH GHJUHH  (IIHFWV RQ 7HVW 6FRUHV :HUH 1RW 6WDWLVWLFDOO\ 'LIIHUHQW )URP =HUR 2YHUDOO PDWK VFRUHV IRU VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV ZHUH  SHUFHQW FRUUHFW DQG  SHUFHQW FRUUHFW UHVSHFWLYHO\ 7KH GLIIHUHQFH ZDV QRW VWDWLVWLFDOO\ GLIIHUHQW IURP ]HUR  &ODVVURRP DQG 6FKRRO &KDUDFWHULVWLFV :HUH 8QFRUUHODWHG :LWK 3URGXFW (IIHFWV 7KH DOJHEUD VWXG\ LQFOXGHG IHZHU VFKRROV ZKLFK OLPLWHG WKH DELOLW\ WR HVWLPDWH PRGHUDWRU HIIHFWV 1RQH RI WKH FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV LQFOXGHG LQ WKH PRGHO ZDV VWDWLVWLFDOO\ VLJQLILFDQW

9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV


7DEOH 9 ,QWHUDFWLRQV %HWZHHQ 0RGHUDWLQJ 9DULDEOHV DQG (IIHFWV (76 $OJHEUD 7HVW &RHIILFLHQW &ODVVURRP ,QWHUDFWLRQ 9DULDEOHV <HDUV RI WHDFKLQJ H[SHULHQFH 6WXG\ SURGXFW XVH UHSRUWHG E\ WHDFKHUV 2WKHU SURGXFW XVH UHSRUWHG E\ WHDFKHUV 6WXGHQWV KDG SUREOHPV JHWWLQJ DFFHVV WR SURGXFW 7HDFKHU KDG DGHTXDWH WLPH WR SUHSDUH WR XVH SURGXFW 7HDFKHU LQGLFDWHV VFKRRO KDV D FRPSXWHU VSHFLDOLVW 3URGXFW LV XVHG LQ FODVVURRP 6FKRRO ,QWHUDFWLRQ 9DULDEOHV 3HUFHQW HOLJLEOH IRU IUHH OXQFK 6WXGHQWWHDFKHU UDWLR      &KL6TXDUHG 7HVWV &ODVVURRP DQG VFKRRO YDULDEOHV &ODVVURRP YDULDEOHV 6FKRRO YDULDEOHV 6RXUFH    !  !   SYDOXH        6WDQGDUG (UURU        SYDOXH       

$XWKRU FDOFXODWLRQV VHH $SSHQGL[ % IRU GHWDLOV RI WKH HVWLPDWLRQ PRGHO 9DULDEOHV LQ WKH PRGHO LQFOXGH VWXGHQW DJH JHQGHU DQG WKH SUHWHVW VFRUHV WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU KH RU VKH KDG D PDVWHUV GHJUHH VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ DQG SHUFHQW HOLJLEOH IRU IUHH OXQFK WLPH RI XVH RI RWKHU WHFKQRORJ\ SURGXFWV DQG VWXGHQW FODVVURRP DQG VFKRRO UDQGRP HIIHFWV

1R FKDUDFWHULVWLFV DUH VLJQLILFDQWO\ GLIIHUHQW IURP ]HUR EDVHG RQ WKH %HQMDPLQL+RFKEHUJ FRUUHFWLRQ IRU PXOWLSOH FRPSDULVRQV ZLWK IDOVH GLVFRYHU\ UDWH RI  7KH PXOWLSOHFRPSDULVRQV FRUUHFWLRQ LV FRPSXWHG VHSDUDWHO\ IRU FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV 1R &KLVTXDUHG WHVW LV VWDWLVWLFDOO\ VLJQLILFDQW DW WKH  OHYHO

9 (IIHFWV RI $OJHEUD 6RIWZDUH 3URGXFWV

5HIHUHQFHV

$GHOPDQ 1 0% 'RQQHOO\ 7 'RYH - 7LIIDQ\0RUDOHV $ :D\QH DQG $ =XFNHU 3URIHVVLRQDO 'HYHORSPHQW DQG 7HDFKHUV 8VHV RI 7HFKQRORJ\ 6XEWDVN  (YDOXDWLRQ RI .H\ )DFWRUV ,PSDFWLQJ WKH (IIHFWLYH 8VH RI 7HFKQRORJ\ LQ 6FKRROV 5HSRUW WR WKH 86 'HSDUWPHQW RI (GXFDWLRQ 65, 3URMHFW 3 $UOLQJWRQ 9$ 65, ,QWHUQDWLRQDO  $JRGLQL 5 0 '\QDUVNL % 0HDQV 5 0XUSK\ DQG / 5RVHQEHUJ 5HYLVHG 'HVLJQ IRU WKH (YDOXDWLRQ RI WKH (IIHFWLYHQHVV RI (GXFDWLRQDO 7HFKQRORJ\ ,QWHUYHQWLRQV 5HSRUW SUHSDUHG IRU ,QVWLWXWH RI (GXFDWLRQ 6FLHQFHV 86 'HSDUWPHQW RI (GXFDWLRQ 3ULQFHWRQ 1- 0DWKHPDWLFD 3ROLF\ 5HVHDUFK ,QF 6HSWHPEHU  $JRGLQL 5 0 '\QDUVNL 0 +RQH\ DQG ' /HYLQ 7KH (IIHFWLYHQHVV RI (GXFDWLRQDO 7HFKQRORJ\ ,VVXHV DQG 5HFRPPHQGDWLRQV IRU WKH 1DWLRQDO 6WXG\ 5HSRUW SUHSDUHG IRU ,QVWLWXWH RI (GXFDWLRQ 6FLHQFHV 86 'HSDUWPHQW RI (GXFDWLRQ 3ULQFHWRQ 1- 0DWKHPDWLFD 3ROLF\ 5HVHDUFK ,QF 0D\  $QGHUVRQ 5( DQG $ 5RQQNYLVW 7KH 3UHVHQFH RI &RPSXWHUV LQ $PHULFDQ 6FKRROV 5HSRUW  7HDFKLQJ /HDUQLQJ DQG &RPSXWLQJ  1DWLRQDO 6XUYH\ ,UYLQH &$ &HQWHU IRU 5HVHDUFK RQ ,QIRUPDWLRQ 7HFKQRORJ\ DQG 2UJDQL]DWLRQV  %DQJHUW'URZQV 5 & .XOLN - .XOLN DQG 0 0RUJDQ 7KH ,QVWUXFWLRQDO (IIHFW RI )HHGEDFN LQ 7HVW/LNH (YHQWV 5HYLHZ RI (GXFDWLRQDO 5HVHDUFK YRO  QR  VXPPHU  SS  %HFNHU +- &RPSXWHU%DVHG ,QWHJUDWHG /HDUQLQJ 6\VWHPV LQ WKH (OHPHQWDU\ DQG 0LGGOH *UDGHV $ &ULWLFDO 5HYLHZ DQG 6\QWKHVLV RI (YDOXDWLRQ 5HSRUWV -RXUQDO RI (GXFDWLRQDO &RPSXWLQJ 5HVHDUFK YRO  QR   SS  %HFNHU +- - 5DYLW] DQG < :RQJ 7HDFKHU DQG 7HDFKHU'LUHFWHG 6WXGHQW 8VH RI &RPSXWHUV DQG 6RIWZDUH 7HFKQLFDO 5HSRUW  7HDFKLQJ /HDUQLQJ DQG &RPSXWDWLRQ  1DWLRQDO 6XUYH\ ,UYLQH &$ 8QLYHUVLW\ RI &DOLIRUQLD DW ,UYLQH  %HQMDPLQL < DQG +RFKEHUJ <  &RQWUROOLQJ WKH )DOVH 'LVFRYHU\ 5DWH $ 3UDFWLFDO DQG 3RZHUIXO $SSURDFK WR 0XOWLSOH 7HVWLQJ - 5R\ 6WDW 6RF %  

76 %ODFN 3 DQG ' :LOLDP $VVHVVPHQW DQG &ODVVURRP /HDUQLQJ $VVHVVPHQW LQ (GXFDWLRQ YRO  QR   SS  %ORN + 5 2RVWGDP 0( 2WWHU DQG 0 2YHUPDDW &RPSXWHU$VVLVWHG ,QVWUXFWLRQ LQ 6XSSRUW RI %HJLQQLQJ 5HDGLQJ ,QVWUXFWLRQ $ 5HYLHZ 5HYLHZ RI (GXFDWLRQDO 5HVHDUFK YRO   SS  %OXPHQIHOG 3 % )LVKPDQ - .UDMFLN 5: 0DU[ DQG ( 6RORZD\ &UHDWLQJ 8VDEOH ,QQRYDWLRQV LQ 6\VWHPLF 5HIRUP 6FDOLQJ 8S 7HFKQRORJ\(PEHGGHG 3URMHFW%DVHG 6FLHQFH LQ 8UEDQ 6FKRROV (GXFDWLRQDO 3V\FKRORJLVW YRO  QR   SS  %UDQVIRUG -' $/ %URZQ DQG 55 &RFNLQJ +RZ 3HRSOH /HDUQ %UDLQ 0LQG DQG ([SHULHQFH :DVKLQJWRQ '& 1DWLRQDO $FDGHP\ 3UHVV  %XURV ,QVWLWXWH RI 0HQWDO 0HDVXUHPHQWV 7HVW 5HYLHZV 2QOLQH /LQFROQ 1( 8QLYHUVLW\ RI 1HEUDVND/LQFROQ  %XWOHU 5 7DVN,QYROYLQJ DQG (JR,QYROYLQJ 3URSHUWLHV RI (YDOXDWLRQ (IIHFWV RI 'LIIHUHQW &RQGLWLRQV RQ 0RWLYDWLRQDO 3HUFHSWLRQV ,QWHUHVW DQG 3HUIRUPDQFH -RXUQDO RI (GXFDWLRQDO 3V\FKRORJ\ YRO  QR   SS  &RKHQ '. DQG '/ %DOO ,QVWUXFWLRQ &DSDFLW\ DQG ,PSURYHPHQW &35( 5HVHDUFK 5HSRUW 1R 55 3KLODGHOSKLD 3$ 8QLYHUVLW\ RI 3HQQV\OYDQLD &RQVRUWLXP IRU 3ROLF\ 5HVHDUFK LQ (GXFDWLRQ  &URRNV 7- 7KH ,PSDFW RI &ODVVURRP (YDOXDWLRQ 3UDFWLFHV RQ 6WXGHQWV 5HYLHZ RI (GXFDWLRQDO 5HVHDUFK YRO  QR  ZLQWHU  SS  &XEDQ / 2YHUVROG DQG 8QGHUXVHG &RPSXWHUV LQ WKH &ODVVURRP &DPEULGJH 0$ +DUYDUG 8QLYHUVLW\ 3UHVV  &XEDQ / 6R 0XFK +LJK7HFK 0RQH\ ,QYHVWHG 6R /LWWOH 8VH DQG &KDQJH LQ 3UDFWLFH +RZ &RPH" 5HSRUW WR WKH &&662 6WDWH (GXFDWLRQDO 7HFKQRORJ\ /HDGHUVKLS &RQIHUHQFH  3UHSDULQJ 7HDFKHUV WR 0HHW WKH &KDOOHQJH RI 1HZ 6WDQGDUGV ZLWK 1HZ 7HFKQRORJLHV :DVKLQJWRQ '& &RXQFLO RI &KLHI 6WDWH 6FKRRO 2IILFHUV  &XOS .0 0 +RQH\ DQG ( 0DQGLQDFK $ 5HWURVSHFWLYH RQ 7ZHQW\ <HDUV RI (GXFDWLRQ 7HFKQRORJ\ 3ROLF\ :DVKLQJWRQ '& 86 'HSDUWPHQW RI (GXFDWLRQ 2IILFH RI (GXFDWLRQDO 7HFKQRORJ\  $FFHVVHG $XJXVW   DW >ZZZQDWLRQDOHGWHFKSODQRUJ SDUWLFLSDWH\HDUVSGI@ (GXFDWLRQDO 7HVWLQJ 6HUYLFH (QGRI&RXUVH $OJHEUD $VVHVVPHQW $GPLQLVWUDWRUV 0DQXDO 3ULQFHWRQ 1- (76  (UWPHU 3$ $GGUHVVLQJ )LUVW DQG 6HFRQG2UGHU %DUULHUV WR &KDQJH 6WUDWHJLHV IRU 7HFKQRORJ\ ,QWHJUDWLRQ (GXFDWLRQDO 7HFKQRORJ\ 5HVHDUFK DQG 'HYHORSPHQW YRO  QR   SS  *RRG 7/ DQG - %URSK\ /RRNLQJ LQ &ODVVURRPV %RVWRQ 0$ $OO\Q DQG %DFRQ  5HIHUHQFHV

77 +DQVHQ (( // /ORVD DQG - 6OD\WRQ (YDOXDWLRQ RI WKH :DWHUIRUG (DUO\ 5HDGLQJ 3URJUDP DV D 6XSSOHPHQWDU\ 3URJUDP LQ WKH /RV $QJHOHV 8QLILHG 6FKRRO 'LVWULFW  3ODQQLQJ $VVHVVPHQW DQG 5HVHDUFK 'LYLVLRQ 3XEOLFDWLRQ 1R  /RV $QJHOHV /RV $QJHOHV 8QLILHG 6FKRRO 'LVWULFW 3URJUDP (YDOXDWLRQ DQG 5HVHDUFK %UDQFK  +HQULTXH] $ DQG 0 5LFRQVFHQWH 5KRGH ,VODQG 7HDFKHUV DQG 7HFKQRORJ\ ,QLWLDWLYH 3URJUDP (YDOXDWLRQ )LQDO 5HSRUW 1HZ <RUN (GXFDWLRQ 'HYHORSPHQW &RUSRUDWLRQ &HQWHU IRU &KLOGUHQ DQG 7HFKQRORJ\  +RQH\ 0 DQG $ +HQULTXH] 8QLRQ &LW\ ,QWHUDFWLYH 0XOWLPHGLD (GXFDWLRQ 7ULDO   6XPPDU\ 5HSRUW 1HZ <RUN &HQWHU IRU &KLOGUHQ DQG 7HFKQRORJ\ (GXFDWLRQ 'HYHORSPHQW &HQWHU  $FFHVVHG 0DUFK   DW >ZZZHGFRUJ&&7 SXEOLFDWLRQVBUHSRUWBVXPPDU\DVS"QXP3XE,G @ -R\QHU $ $ )RRWKROG IRU +DQGKHOGV $PHULFDQ 6FKRRO %RDUG -RXUQDO 6SHFLDO 5HSRUW 6HSWHPEHU  $FFHVVHG 2FWREHU   DW >ZZZDVEMFRPVSHFLDOUHSRUWV 6SHFLDO5HSRUWV6KWPO@ .HUU 67 7HFKQRORJ\ DQG WKH )XWXUH RI 6FKRROLQJ ,Q WK <HDUERRN RI WKH 1DWLRQDO 6RFLHW\ IRU WKH 6WXG\ RI (GXFDWLRQ 3DUW ,, HGLWHG E\ 67 .HUU &KLFDJR 8QLYHUVLW\ RI &KLFDJR 3UHVV  .OXJHU $1 DQG $ 'H1LVL 7KH (IIHFWV RI )HHGEDFN ,QWHUYHQWLRQV RQ 3HUIRUPDQFH $ +LVWRULFDO 5HYLHZ D 0HWD$QDO\VLV DQG D 3UHOLPLQDU\ )HHGEDFN ,QWHUYHQWLRQ 7KHRU\ 3V\FKRORJLFDO %XOOHWLQ YRO  QR   SS  .XOLN && DQG -$ .XOLN (IIHFWLYHQHVV RI &RPSXWHU%DVHG ,QVWUXFWLRQ $Q 8SGDWHG $QDO\VLV &RPSXWHUV LQ +XPDQ %HKDYLRU YRO   SS  .XOLN -$ (IIHFWV RI 8VLQJ ,QVWUXFWLRQDO 7HFKQRORJ\ LQ (OHPHQWDU\ DQG 6HFRQGDU\ 6FKRROV :KDW &RQWUROOHG (YDOXDWLRQ 6WXGLHV 6D\ $UOLQJWRQ 9$ 65, ,QWHUQDWLRQDO  .XOLN -$ 0HWDDQDO\WLF 6WXGLHV RI )LQGLQJV RQ &RPSXWHU%DVHG ,QVWUXFWLRQ ,Q 7HFKQRORJ\ $VVHVVPHQW LQ (GXFDWLRQ DQG 7UDLQLQJ HGLWHG E\ (/ %DNHU DQG +) 21HLO -U +LOOVGDOH 1- /DZUHQFH (UOEDXP  SS  /HJJHWW :3 DQG .$ 3HUVLFKLWWH %ORRG 6ZHDW DQG 7HDUV  <HDUV RI 7HFKQRORJ\ ,PSOHPHQWDWLRQ 2EVWDFOHV 7HFK7UHQGV YRO  QR   SS  /LQQ 0& DQG 6 +VL &RPSXWHUV 7HDFKHUV 3HHUV 6FLHQFH /HDUQLQJ 3DUWQHUV 0DKZDK 1- (UOEDXP  0DQQ ' & 6KDNHVKDIW - %HFNHU DQG 5 .RWWNDPS :HVW 9LUJLQLD 6WRU\ $FKLHYHPHQW *DLQV IURP D 6WDWHZLGH &RPSUHKHQVLYH ,QVWUXFWLRQDO 7HFKQRORJ\ 3URJUDP 6DQWD 0RQLFD &$ 0LONHQ ([FKDQJH RQ (GXFDWLRQDO 7HFKQRORJ\  0HDQV % DQG . 2OVRQ 7HFKQRORJ\ DQG (GXFDWLRQ 5HIRUP 7HFKQLFDO 5HVHDUFK 5HSRUW 0HQOR 3DUN &$ 65, ,QWHUQDWLRQDO  5HIHUHQFHV

78 0H]HUQLFK 00 :0 -HQNLQV 3 -RKQVWRQ & 6FKUHLQHU 6/ 0LOOHU DQG 3 7DOODO 7HPSRUDO 3URFHVVLQJ 'HILFLWV RI /DQJXDJH/HDUQLQJ ,PSDLUHG $PHOLRUDWHG E\ 7UDLQLQJ 6FLHQFH YRO  QR   SS  0LOOHU 6 1 /LQQ 3 7DOODO 0 0HU]HQLFK DQG : -HQNLQV 6SHHFK DQG /DQJXDJH 7KHUDS\ 5HHGXFDWLRQ 2UWKRSKRQLTXH )HGHUDWLRQ 1DWLRQDOH GHV 2UWKRSKRQLVWHV 6SHFLDO ,VVXHV /D &RQVFLHQFH 3KRQRORJLTXH YRO  0DUFK  SS  0LOOV 6& DQG 7- 5DJDQ $ 7RRO IRU $QDO\]LQJ ,PSOHPHQWDWLRQ )LGHOLW\ RI DQ ,QWHJUDWHG /HDUQLQJ 6\VWHP ,/6 (GXFDWLRQDO 7HFKQRORJ\ 5HVHDUFK 'HYHORSPHQW YRO   SS  0RUJDQ 3 DQG 6 5LWWHU $Q ([SHULPHQWDO 6WXG\ RI WKH (IIHFWV RI &RJQLWLYH 7XWRU $OJHEUD , RQ 6WXGHQW .QRZOHGJH DQG $WWLWXGH 3LWWVEXUJK 3$ &DUQHJLH /HDUQLQJ ,QF 0D\   0XUSK\ 5 : 3HQXHO % 0HDQV & .RUEDN DQG $ :KDOH\ ('(6. $ 5HYLHZ RI 5HFHQW (YLGHQFH RQ WKH (IIHFWLYHQHVV RI 'LVFUHWH (GXFDWLRQDO 6RIWZDUH 0HQOR 3DUN &$ 65, ,QWHUQDWLRQDO  1XQQHU\ -$ 60 5RVV DQG $ 0F'RQDOG $ 5DQGRPL]HG ([SHULPHQWDO (YDOXDWLRQ RI WKH ,PSDFW RI $FFHOHUDWHG 5HDGHU5HDGLQJ 5HQDLVVDQFH ,PSOHPHQWDWLRQ RQ 5HDGLQJ $FKLHYHPHQW LQ *UDGHV  WR  -RXUQDO RI (GXFDWLRQ IRU 6WXGHQWV 3ODFHG DW 5LVN YRO  QR   SS  3HDUVRQ 3' 5( )HUGLJ 5/ %ORPH\HU -U DQG - 0RUDQ 7KH (IIHFWV RI 7HFKQRORJ\ RQ 5HDGLQJ 3HUIRUPDQFH LQ WKH 0LGGOH6FKRRO *UDGHV $ 0HWDDQDO\VLV ZLWK 5HFRPPHQGDWLRQV IRU 3ROLF\ 1DSHUYLOOH ,/ /HDUQLQJ 3RLQW $VVRFLDWHV  3UHVLGHQWV &RPPLWWHH RI $GYLVRUV RQ 6FLHQFH DQG 7HFKQRORJ\ >3&$67@ 3DQHO RQ (GXFDWLRQDO 7HFKQRORJ\ 5HSRUW WR WKH 3UHVLGHQW RQ WKH 8VH RI 7HFKQRORJ\ WR 6WUHQJWKHQ . (GXFDWLRQ LQ WKH 8QLWHG 6WDWHV 0DUFK  $FFHVVHG 0DUFK   DW >ZZZRVWSJRY3&$67NHGKWPO@ 5RXVH &( DQG $% .UXHJHU 3XWWLQJ &RPSXWHUL]HG ,QVWUXFWLRQ WR WKH 7HVW $ 5DQGRPL]HG (YDOXDWLRQ RI D 6FLHQWLILFDOO\%DVHG 5HDGLQJ 3URJUDP (FRQRPLFV RI (GXFDWLRQ 5HYLHZ YRO  QR   SS  6DQGKROW] -+ & 5LQJVWDII DQG ' 'Z\HU 7HDFKLQJ :LWK 7HFKQRORJ\ &UHDWLQJ 6WXGHQW&HQWHUHG &ODVVURRPV 1HZ <RUN 7HDFKHUV &ROOHJH 3UHVV  6DUDPD - '+ &OHPHQWV DQG -- +HQU\ 1HWZRUN RI ,QIOXHQFHV LQ DQ ,PSOHPHQWDWLRQ RI D 0DWKHPDWLFV &XUULFXOXP ,QQRYDWLRQ ,QWHUQDWLRQDO -RXUQDO RI &RPSXWHUV IRU 0DWKHPDWLFDO /HDUQLQJ YRO  QR   SS  6FKDFWHU - 7KH ,PSDFW RI (GXFDWLRQDO 7HFKQRORJ\ RQ 6WXGHQW $FKLHYHPHQW :KDW WKH 0RVW &XUUHQW 5HVHDUFK +DV WR 6D\ 6DQWD 0RQLFD &$ 0LONHQ ([FKDQJH RQ (GXFDWLRQ 7HFKQRORJ\  5HIHUHQFHV

79 6FKRILHOG -: DQG ' 9HUEDQ &RPSXWHU 8VDJH LQ 7HDFKLQJ 0DWKHPDWLFV ,VVXHV :KLFK 1HHG $QVZHUV ,Q (IIHFWLYH 0DWKHPDWLFV 7HDFKLQJ YRO , HGLWHG E\ '$ *URXZV DQG 7- &RRQH\ +LOOVGDOH 1- (UOEDXP  SS  6KHLQJROG . DQG 0 +DGOH\ $FFRPSOLVKHG 7HDFKHUV ,QWHJUDWLQJ &RPSXWHUV LQWR &ODVVURRP 3UDFWLFH 1HZ <RUN &HQWHU IRU 7HFKQRORJ\ LQ (GXFDWLRQ %DQN 6WUHHW &ROOHJH RI (GXFDWLRQ  6KQH\GHUPDQ $ (YDOXDWLRQ RI WKH &RJQLWLYH 7XWRU $OJHEUD , 3URJUDP 0LDPL'DGH &RXQW\ 3XEOLF 6FKRROV 2IILFH RI (YDOXDWLRQ DQG 5HVHDUFK 6HSWHPEHU  6LYLQ.DFKDOD - 5HSRUW RQ WKH (IIHFWLYHQHVV RI 7HFKQRORJ\ LQ 6FKRROV  :DVKLQJWRQ '& 6RIWZDUH 3XEOLVKHUV $VVRFLDWLRQ  6ZDQ . DQG 0 0LWUDQL 7KH &KDQJLQJ 1DWXUH RI 7HDFKLQJ DQG /HDUQLQJ LQ &RPSXWHU %DVHG &ODVVURRPV -RXUQDO RI 5HVHDUFK RQ &RPSXWLQJ LQ (GXFDWLRQ YRO   SS  6ZDQ . 0 YDQ W +RRIW $ .UDWFRVNL DQG ' 8QJHU 8VHV DQG (IIHFWV RI 0RELOH &RPSXWLQJ 'HYLFHV LQ . &ODVVURRPV -RXUQDO RI 5HVHDUFK RQ 7HFKQRORJ\ LQ (GXFDWLRQ YRO  QR   SS  7DOODO 3 6/ 0LOOHU * %HGL * %\PD ; :DQJ 66 1DJDUDMDQ & 6FKUHLQHU :0 -HQNLQV DQG 00 0H]HQLFK /DQJXDJH &RPSUHKHQVLRQ LQ /DQJXDJH/HDUQLQJ ,PSDLUHG &KLOGUHQ ,PSURYHG ZLWK $FRXVWLFDOO\ 0RGLILHG 6SHHFK 6FLHQFH YRO  QR   SS  7RUJHVHQ - 5 :DJQHU DQG & 5DVKRWWH 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ ([DPLQHUV 0DQXDO $XVWLQ 7; 3UR(G ,QF  86 &RQJUHVV 2IILFH RI 7HFKQRORJ\ $VVHVVPHQW 7HDFKHUV DQG 7HFKQRORJ\ 0DNLQJ WKH &RQQHFWLRQ 27$+(5 :DVKLQJWRQ '& 86 *RYHUQPHQW 3ULQWLQJ 2IILFH  9DQ'XVHQ /0 DQG %5 :RUWKHQ 7KH ,PSDFW RI ,QWHJUDWHG /HDUQLQJ 6\VWHPV ,PSOHPHQWDWLRQ RQ 6WXGHQW 2XWFRPHV ,PSOLFDWLRQV IRU 5HVHDUFK DQG (YDOXDWLRQ ,QWHUQDWLRQDO -RXUQDO RI (GXFDWLRQDO 5HVHDUFK YRO   SS  :D[PDQ +& DQG 6/ +XDQJ 'LIIHUHQFHV E\ /HYHO RI 7HFKQRORJ\ 8VH RQ 6WXGHQWV 0RWLYDWLRQ $Q[LHW\ DQG &ODVVURRP /HDUQLQJ (QYLURQPHQW LQ 0DWKHPDWLFV -RXUQDO RI (GXFDWLRQDO 7HFKQRORJ\ 6\VWHPV YRO  QR   SS  :D[PDQ +& 0) /LQ DQG *0 0LFKNR $ 0HWDDQDO\VLV RI WKH (IIHFWLYHQHVV RI 7HDFKLQJ DQG /HDUQLQJ ZLWK 7HFKQRORJ\ RQ 6WXGHQW 2XWFRPHV 1DSHUYLOOH ,/ /HDUQLQJ 3RLQW $VVRFLDWHV  :RUWKHQ %5 /0 9DQ 'XVHQ DQG 3- 6DLORU $ &RPSDUDWLYH 6WXG\ RI WKH ,PSDFW RI ,QWHJUDWHG /HDUQLQJ 6\VWHPV RQ 6WXGHQWV 7LPHRQ7DVN ,QWHUQDWLRQDO -RXUQDO RI (GXFDWLRQDO 5HVHDUFK YRO   SS 

5HIHUHQFHV

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

7KH VWXG\V GDWD FROOHFWLRQ EHJDQ ZKHQ WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG ZKLFK JHQHUDWHG WKH LQLWLDO OLVWLQJ RI WHDFKHUV DQG XOWLPDWHO\ WKH OLVWLQJ RI VWXGHQWV WR WHVW DQG FODVVURRPV WR REVHUYH 1RW DOO VWXGHQWV LQ WHDFKHU FODVVURRPV ZHUH WHVWHG 7KH WZR FULWHULD IRU WHVWLQJ VWXGHQWV LQ WKH IDOO ZHUH WKDW SDUHQWDO FRQVHQW ZDV UHFHLYHG DQG WKDW VWXGHQWV GLG QRW KDYH EDUULHUV WR WHVWLQJ GLVDELOLW\ RU ODQJXDJH LVVXHV 7KH VSULQJ WHVW LQFOXGHG VWXGHQWV ZKR KDG EHHQ WHVWHG LQ WKH IDOO DV ZHOO DV VWXGHQWV ZKR KDG HQWHUHG VWXG\ FODVVURRPV DIWHU WKH IDOO WHVW ZDV DGPLQLVWHUHG 7KH VWXG\ DWWHPSWHG WR FROOHFW UHFRUGV IRU DOO VWXGHQWV LQ WKH VSULQJ WHVWLQJ VDPSOH $ 7HDFKHU 6DPSOH 7KH VWXG\ UHFUXLWHG  VFKRROV LQ  VFKRRO GLVWULFWV 2QH GLVWULFW GURSSHG RXW EHIRUH WKH VWDUW RI WKH VFKRRO \HDU DIWHU WHDFKHU UDQGRP DVVLJQPHQW KDG EHHQ FRQGXFWHG DQG DQRWKHU GLVWULFW GURSSHG RXW DIWHU WKH IDOO WHVW KDG EHHQ FRQGXFWHG EHFDXVH WKH WHFKQRORJ\ SURGXFW GLG QRW ZRUN FRUUHFWO\ )LJXUH $ VKRZV WKH IORZ RI WHDFKHUV LQWR WKH VWXG\ 2I WKH  WHDFKHU FRQVHQW IRUPV UHFHLYHG ILYH WHDFKHUV ZHUH H[FOXGHG EHIRUH UDQGRP DVVLJQPHQW EHFDXVH WKHLU VFKRROV KDG QRW UHFUXLWHG DQ DGHTXDWH QXPEHU RI WHDFKHUV D PLQLPXP RI WZR WHDFKHUV LQ HDFK JUDGH ZDV QHHGHG IRU UDQGRP DVVLJQPHQW 7KH UHPDLQLQJ  WHDFKHUV ZHUH UDQGRPO\ DVVLJQHG 2GGV RI DVVLJQPHQW WR XVH D SURGXFW YDULHG GHSHQGLQJ RQ KRZ PDQ\ WHDFKHUV LQ D VFKRRO FRQVHQWHG ,Q VFKRROV ZLWK DQ HYHQ QXPEHU RI WHDFKHUV WKH RGGV ZHUH  ,Q VFKRROV ZLWK DQ RGG QXPEHU RI WHDFKHUV FRQVHQWLQJ WKH RGGV IDYRUHG WKH WUHDWPHQW JURXS E\ RQH WZR WR RQH LI WKUHH WHDFKHUV FRQVHQWHG WKUHH WR WZR LI ILYH WHDFKHUV FRQVHQWHG DQG IRXU WR WKUHH LI VHYHQ WHDFKHUV FRQVHQWHG IHZ VFKRROV KDG PRUH WKDQ VHYHQ WHDFKHUV FRQVHQWLQJ

KLV DSSHQGL[ GHVFULEHV WKH VWXG\V DSSURDFK IRU GDWD FROOHFWLRQ DQG FODVVURRP REVHUYDWLRQV ,W DOVR SURYLGHV PRUH GHWDLO DERXW UHVSRQVH UDWHV DQG LVVXHV ZLWK VRPH RI WKH GDWD

82 $IWHU LQLWLDO UDQGRP DVVLJQPHQW KDG EHHQ FRQGXFWHG  WHDFKHUV ZHUH H[FOXGHG IURP WKH VWXG\ IRU YDULRXV UHDVRQV ZKLFK LV VKRZQ LQ )LJXUH $ 7KH PRVW FRPPRQ UHDVRQ DSSO\LQJ WR  WHDFKHUV ZDV WKDW WHDFKHUV UHFHLYHG QHZ WHDFKLQJ DVVLJQPHQWV RU OHIW WKHLU VFKRROV IRU RWKHU SRVLWLRQV $QRWKHU  WHDFKHUV ZHUH H[FOXGHG EHFDXVH WKHLU GLVWULFWV GHFLGHG QRW WR SDUWLFLSDWH $WWULWLRQ DOVR VRPHWLPHV UHVXOWHG LQ IHZHU WKDQ WZR VDPSOHG WHDFKHUV LQ D VFKRRO DQG WKHVH VFKRROV ZHUH GURSSHG  WHDFKHUV )RXU WHDFKHUV GHFOLQHG WR SDUWLFLSDWH DIWHU UDQGRP DVVLJQPHQW ZDV FRQGXFWHG WKUHH LQ WKH WUHDWPHQW JURXS DQG RQH LQ WKH FRQWURO JURXS $V WKH ILJXUH VKRZV WUHDWPHQW DQG FRQWURO VWDWXV KDG UHODWLYHO\ OLWWOH HIIHFW RQ WHDFKHUV EHLQJ H[FOXGHG IURP WKH VWXG\ 7DEOH $ VKRZV ILQDO FRXQWV RI WHDFKHUV LQ WKH VDPSOH E\ JUDGH OHYHO DQG DVVLJQPHQW VWDWXV
)LJXUH $ )ORZ RI 7HDFKHUV 7KURXJK 6WXG\

1XPEHU RI 7HDFKHUV 5DQGRPL]HG Q 

$OORFDWHG WR 7UHDWPHQW *URXS Q 

$OORFDWHG WR &RQWURO *URXS Q 

3DUWLFLSDWHG LQ 6WXG\ Q

  

3DUWLFLSDWHG LQ 6WXG\ Q

  

'LG 1RW 3DUWLFLSDWH LQ 6WXG\ Q 1RW WHDFKLQJ JUDGH RU VXEMHFW Q 'LVWULFW GURSSHG Q  6FKRRO GURSSHG Q  5HIXVHG Q  0RYHG Q 

'LG 1RW 3DUWLFLSDWH LQ 6WXG\ Q 1RW WHDFKLQJ JUDGH RU VXEMHFW Q 'LVWULFW GURSSHG Q  6FKRRO GURSSHG Q  5HIXVHG Q  0RYHG Q 

7DEOH $ 1XPEHU RI 7HDFKHUV 3DUWLFLSDWLQJ E\ *UDGH /HYHO DQG 5DQGRP $VVLJQPHQW 6WDWXV  6FKRRO <HDU 1XPEHU RI 7HDFKHUV 7RWDO *UDGH  UHDGLQJ *UDGH  UHDGLQJ *UDGH  PDWKHPDWLFV $OJHEUD  7RWDO      7UHDWPHQW      &RQWURO     

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

83 % 7HDFKHU 6XUYH\ ,Q 1RYHPEHU  WHDFKHU TXHVWLRQQDLUHV ZHUH PDLOHG WR VFKRROV DQG D VHFRQG PDLOLQJ ZDV VHQW LQ 'HFHPEHU WR WHDFKHUV DW WKHLU KRPH DGGUHVVHV $GGLWLRQDO SURPSWV WR FRPSOHWH WKH TXHVWLRQQDLUH LQFOXGHG HPDLOV DQG WHOHSKRQH PHVVDJHV DGGLWLRQDO PDLOLQJV DV QHHGHG DQG WHOHSKRQH LQWHUYLHZV WKURXJK 0DUFK  8OWLPDWHO\  SHUFHQW RI WHDFKHUV FRPSOHWHG D TXHVWLRQQDLUH &RPSOHWLRQ UDWHV UDQJHG IURP  SHUFHQW RI IRXUWK JUDGH WHDFKHUV WR  SHUFHQW RI ILUVW JUDGH WHDFKHUV 7DEOH $
7DEOH $ 7RWDO 1XPEHU RI 7HDFKHUV LQ WKH 6WXG\ DQG WKH 1XPEHU DQG 3HUFHQW &RPSOHWLQJ WKH 7HDFKHU 6XUYH\  6FKRRO <HDU 7HDFKHUV 1XPEHU &RPSOHWLQJ 6XUYH\     

7RWDO *UDGH  UHDGLQJ *UDGH  UHDGLQJ *UDGH  PDWKHPDWLFV $OJHEUD 

7RWDO     

3HUFHQW     

& 6WXGHQW 'DWD &ROOHFWLRQ 6WXGHQWV ZHUH WHVWHG DV HDUO\ RU ODWH DV ZDV IHDVLEOH LQ WKH VFKRRO \HDU 5HDGLQJ DFKLHYHPHQW WHVWV ZHUH DGPLQLVWHUHG LQ JUDGHV  DQG  DQG PDWK WHVWV LQ JUDGH  DQG LQ DOJHEUD 'DWD IURP VWXGHQWV VFKRRO UHFRUGV ZHUH DOVR FROOHFWHG 2EWDLQLQJ &ODVV /LVWV DQG 3DUHQW &RQVHQW $W WKH EHJLQQLQJ RI WKH VFKRRO \HDU FODVV OLVWV IRU HDFK WHDFKHU LQ WKH VWXG\ ZHUH REWDLQHG IURP VFKRROV DQG ZHUH WKH EDVLV IRU OHWWHUV WR SDUHQWV UHTXHVWLQJ FRQVHQW 7KH OHWWHU H[SODLQHG WKH SXUSRVH RI WKH VWXG\ DQG GHVFULEHG DOO GDWD FROOHFWLRQ DFWLYLWLHV LQYROYLQJ VWXGHQWV /HWWHUV ZKLFK ZHUH WUDQVODWHG DQG DYDLODEOH LQ HLJKW ODQJXDJHV ZHUH VHQW WR WKH SDUHQWV YLD PDLO RU ZHUH VHQW KRPH ZLWK VWXGHQWV GHSHQGLQJ XSRQ WKH SUHIHUHQFH RI WKH VFKRRO $ EURFKXUH ZLWK DQVZHUV WR IUHTXHQWO\ DVNHG TXHVWLRQV ZDV DOVR LQFOXGHG LQ WKH SDUHQW SHUPLVVLRQ SDFNHWV DORQJ ZLWK D WROOIUHH QXPEHU IRU SDUHQWV ZKR KDG DGGLWLRQDO TXHVWLRQV 2I WKH  VWXGHQWV RQ WHDFKHUV IDOO RU VSULQJ VHPHVWHU FODVVURRP OLVWV  VWXGHQWV DWWHQGHG VFKRROV UHTXLULQJ DFWLYH FRQVHQW DQG  VWXGHQWV DWWHQGHG VFKRROV UHTXLULQJ SDVVLYH FRQVHQW 7DEOH $ 3DUHQW FRQVHQW ZDV REWDLQHG IRU  SHUFHQW RI VWXGHQWV  SHUFHQW LQ DFWLYH FRQVHQW GLVWULFWV DQG  SHUFHQW LQ SDVVLYH FRQVHQW GLVWULFWV 7UHDWPHQW VWDWXV PD\ KDYH KDG VRPH HIIHFW RQ FRQVHQW UDWHV &RQVHQW ZDV REWDLQHG IRU  SHUFHQW RI VWXGHQWV LQ WUHDWPHQW FODVVURRPV DQG  SHUFHQW RI VWXGHQWV LQ FRQWURO FODVVURRPV 7DEOH $ 7KH GLIIHUHQFH DURVH IURP FRQWURO FODVVURRPV IRU ZKLFK DFWLYH FRQVHQW ZDV QHHGHG ,Q WUHDWPHQW $SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

84
7DEOH $ 1XPEHU DQG 3HUFHQW RI (OLJLEOH 6WXGHQWV E\ 7\SH RI &RQVHQW  6FKRRO <HDU $OO 6WXGHQWV :LWK &RQVHQW 7RWDO  1XPEHU  3HUFHQW  7RWDO  6WXGHQWV LQ 3DVVLYH &RQVHQW 6LWHV :LWK &RQVHQW 1XPEHU  3HUFHQW  7RWDO  6WXGHQWV LQ $FWLYH &RQVHQW 6LWHV :LWK &RQVHQW 1XPEHU  3HUFHQW 

7DEOH $ (OLJLEOH 6WXGHQWV LQ 6WXG\ &ODVVURRPV ZLWK 3DUHQWDO &RQVHQW WR 3DUWLFLSDWH LQ WKH 6WXG\  6FKRRO <HDU $OO (OLJLEOH 6WXGHQWV :LWK &RQVHQW 7HFKQRORJ\ &OXVWHU 7RWDO *UDGH  HDUO\ UHDGLQJ *UDGH  UHDGLQJ *UDGH  PDWKHPDWLFV $OJHEUD  $OO      1XPEHU 3HUFHQW      $OO      7UHDWPHQW 6WXGHQWV :LWK &RQVHQW 1XPEHU      3HUFHQW      $OO      &RQWURO 6WXGHQWV :LWK &RQVHQW 1XPEHU      3HUFHQW     

    

FODVVURRPV  SHUFHQW RI SDUHQWV JDYH FRQVHQW DQG LQ FRQWURO FODVVURRPV  SHUFHQW RI SDUHQWV JDYH FRQVHQW 6WXGHQW 6DPSOH 7KH VWXG\ UHFHLYHG SDUHQW FRQVHQW IRU  VWXGHQWV 7DEOH $ VKRZV VWXGHQWV E\ FODVVURRP DVVLJQPHQW VWDWXV ZLWK  SHUFHQW RI VWXGHQWV LQ WUHDWPHQW FODVVURRPV DQG  SHUFHQW LQ FRQWURO FODVVURRPV 7KHVH SURSRUWLRQV PDWFK FORVHO\ WKH DOORFDWLRQV RI WHDFKHUV VKRZQ LQ 7DEOH $

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

85
7DEOH $ 1XPEHU DQG 3HUFHQW RI (OLJLEOH 6WXGHQW 6DPSOH E\ $VVLJQPHQW *URXS DQG *UDGH  6FKRRO <HDU (OLJLEOH 6WXGHQW 6DPSOH $OO 7RWDO *UDGH  UHDGLQJ *UDGH  UHDGLQJ *UDGH  PDWKHPDWLFV $OJHEUD      

,Q 7UHDWPHQW &ODVVURRPV 1XPEHU      3HUFHQW     

,Q &RQWURO &ODVVURRPV 1XPEHU      3HUFHQW     

6WXGHQW 7HVWV 6WXGHQW WHVWV ZHUH DGPLQLVWHUHG GXULQJ UHJXODU FODVV SHULRGV LQ WKH IDOO DQG VSULQJ ,Q DGGLWLRQ WKH 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 72:5( DQ LQGLYLGXDO DVVHVVPHQW RI UHDGLQJ IOXHQF\ ZDV DGPLQLVWHUHG WR ILUVW JUDGHUV LQ WKH IDOO DQG VSULQJ DW DERXW WKH VDPH WLPH DV WKH 6$7 ZDV DGPLQLVWHUHG )LJXUH $ OLVWV WKH WHVW DQG VXEWHVWV WKDW WKH VWXG\ DGPLQLVWHUHG 7KH VWXG\ WHVWHG  VWXGHQWV LQ IDOO  7DEOH $ 7KH WRWDO UHSUHVHQWV DERXW  SHUFHQW RI VWXGHQWV ZKR ZHUH RQ FODVV URVWHUV DW WKDW WLPH ZKR GLG QRW KDYH GLVDELOLWLHV RU ODQJXDJH SUREOHPV SUHFOXGLQJ WHVWLQJ DQG ZKRVH SDUHQWV KDG JLYHQ FRQVHQW 5HVSRQVH UDWHV UDQJHG IURP  SHUFHQW LQ DOJHEUD FODVVURRPV WR  SHUFHQW LQ VL[WK JUDGH FODVVURRPV

)LJXUH $ $FKLHYHPHQW 7HVWV $GPLQLVWHUHG E\ WKH 6WXG\ *UDGH  )DOO  7HVW 6WDQIRUG (DUO\ 6FKRRO $FKLHYHPHQW 7HVW 6(6$7  )RUP 6 )RXUWK (GLWLRQ 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 6WDQIRUG $FKLHYHPHQW 7HVW $EEUHYLDWHG %DWWHU\ 3ULPDU\  7HQWK (GLWLRQ 6WDQIRUG $FKLHYHPHQW 7HVW $EEUHYLDWHG %DWWHU\ ,QWHUPHGLDWH  7HQWK (GLWLRQ (GXFDWLRQDO 7HVWLQJ 6HUYLFHV (QGRI&RXUVH $OJHEUD 7HVW 6SULQJ  7HVW 6WDQIRUG $FKLHYHPHQW 7HVW $EEUHYLDWHG 3ULPDU\  1LQWK (GLWLRQ )RUP 6 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 6WDQIRUG $FKLHYHPHQW 7HVW $EEUHYLDWHG %DWWHU\ ,QWHUPHGLDWH  7HQWK (GLWLRQ 6WDQIRUG $FKLHYHPHQW 7HVW $EEUHYLDWHG %DWWHU\ ,QWHUPHGLDWH  7HQWK (GLWLRQ (GXFDWLRQDO 7HVWLQJ 6HUYLFHV (QGRI&RXUVH $OJHEUD 7HVW

*UDGH 

*UDGH 

$OJHEUD 

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

86
7DEOH $ 1XPEHU RI 6WXGHQWV DQG 3HUFHQW 7HVWHG LQ )DOO DQG 6SULQJ  6FKRRO <HDU 7HVWHG (OLJLEOH 6WXGHQWV ,Q 7UHDWPHQW &ODVVURRPV 7HVWHG (OLJLEOH 6WXGHQWV ,Q &RQWURO &ODVVURRPV

(OLJLEOH 6WXGHQWV ,Q 7UHDWPHQW &ODVVURRPV )LUVW *UDGH 6(6$7 )DOO 6SULQJ )LUVW *UDGH 72:5( )DOO 6SULQJ )RXUWK *UDGH 6$7 )DOO 6SULQJ 6L[WK *UDGH 6$7 )DOO 6SULQJ (76 $OJHEUD 7HVW )DOO 6SULQJ 7RWDO )DOO 6SULQJ

(OLJLEOH 6WXGHQWV ,Q &RQWURO &ODVVURRPV

5HVSRQVH 5DWH 7UHDWPHQW &ODVVURRPV

5HVSRQVH 5DWH &RQWURO &ODVVURRPV

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

   

   

   

   

   

   

7KH VSULQJ WHVW ZDV DGPLQLVWHUHG DERXW  WR  ZHHNV EHIRUH WKH ODVW GD\ RI WKH VFKRRO \HDU $W IROORZXS  VWXGHQWV ZHUH WHVWHG 7KH UHVSRQVH UDWH RI  SHUFHQW UDQJHG IURP  SHUFHQW LQ DOJHEUD WR  SHUFHQW LQ ILUVW DQG VL[WK JUDGHV IRU VWDQGDUGL]HG WHVWV 1LQHW\ILYH SHUFHQW RI HOLJLEOH ILUVW JUDGHUV WRRN WKH 72:5( LQ WKH VSULQJ 6WXGHQWV ZKR ZHUH WHVWHG LQ ERWK IDOO  DQG LQ VSULQJ  DUH WKH EDVLV RI WKH HVWLPDWHV SUHVHQWHG LQ WKH PDLQ UHSRUW VHH 7DEOH $ (LJKW\ILYH SHUFHQW RI HOLJLEOH VWXGHQWV ZKR ZHUH HQUROOHG DQG KDG SDUHQW FRQVHQW WRRN ERWK WKH IDOO DQG VSULQJ WHVW UDQJLQJ IURP  SHUFHQW IRU ILUVW JUDGHUV WR  SHUFHQW IRU DOJHEUD VWXGHQWV

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

87

7DEOH $ 1XPEHU RI 6WXGHQWV 7HVWHG ,Q %RWK )DOO DQG 6SULQJ 1XPEHU $OO )LUVW *UDGH 6$7 )LUVW *UDGH 72:5( )RXUWK *UDGH 6$7 6L[WK *UDGH 6$7 $OJHEUD (76       3HUFHQW      

,PSXWLQJ 0LVVLQJ 'DWD 6RPH GDWD ZHUH PLVVLQJ EHFDXVH VWXGHQWV GLG QRW WDNH DOO WHVWV RU VXEWHVWV VWXGHQWV GLG QRW WDNH WKH 72:5( DIWHU WDNLQJ WKH 6(6$7 RU YLFH YHUVD RU VFKRRO GLVWULFWV GLG QRW SURYLGH UHFRUGV 7KH ODUJHVW QXPEHU RI PLVVLQJ WHVWV DQG VXEWHVWV RFFXUUHG LQ ILUVW JUDGH ,Q VRPH GLVWULFWV WKH ILUVW JUDGH WHVW ZDV DGPLQLVWHUHG RQ WZR DGMRLQLQJ GD\V EHFDXVH RI LWV OHQJWK DQG VWXGHQWV EHLQJ DEVHQW RQ HLWKHU GD\ DIIHFWHG ZKHWKHU VRPH SDUWV RI WKH WHVW ZHUH PLVVLQJ &RPSRQHQWV RI WKH WHVW VFRUHV DQG VWXGHQW DJH DQG JHQGHU ZHUH LPSXWHG XVLQJ WKH 0DUNRY &KDLQ 0RQWH &DUOR 0&0& PHWKRG LQ 6$6  7KH LPSXWDWLRQ ZDV GRQH ILYH WLPHV VHSDUDWHO\ IRU VWXGHQWV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV 7KH PHWKRG ZDV WHVWHG E\ PDNLQJ VXEWHVW VFRUHV IRU UDQGRP VDPSOHV RI VWXGHQWV PLVVLQJ DQG H[DPLQLQJ FRUUHODWLRQV EHWZHHQ LPSXWHG VFRUHV DQG DFWXDO VFRUHV 7KH FRUUHODWLRQV ZHUH KLJK LQ WKH UDQJH RI  SHUFHQW WR  SHUFHQW IRU GLIIHUHQW VDPSOHV LQGLFDWLQJ WKDW WKH 0&0& PHWKRG ZDV LPSXWLQJ VFRUHV WKDW ZHUH FORVH WR WKH DFWXDO VFRUHV 7KH +/0 HVWLPDWLRQ DQG RWKHU VWDWLVWLFDO SURFHGXUHV XVHG WKH ILYH LPSXWHG GDWD VHWV DQG FDOFXODWHG YDULDQFHV RI WKH HVWLPDWHV WKDW LQFRUSRUDWHG WKH DGGHG YDULDQFH IURP WKH LPSXWDWLRQ 7KH LQFUHDVH LQ YDULDQFHV DVVRFLDWHG ZLWK WKH LPSXWDWLRQ UDQJHG IURP OHVV WKDQ  SHUFHQW IRU PDQ\ LWHPV WR  SHUFHQW IRU DJH RI ILUVW JUDGH VWXGHQWV 7KHUH ZHUH IHZHU PLVVLQJ GDWD LWHPV LQ IRXUWK DQG VL[WK JUDGHV DQG WKH FRUUHVSRQGLQJ LQFUHDVHV LQ YDULDQFHV IURP LPSXWDWLRQ ZHUH VPDOOHU 1R PLVVLQJ GDWD ZHUH LPSXWHG IRU DOJHEUD 6FKRRO 5HFRUGV 7KH VWXG\ FROOHFWHG VWXGHQW UHFRUGV GDWD IURP ILOHV SUHSDUHG E\ GLVWULFWV RU E\ DEVWUDFWLQJ GDWD IURP SDSHU ILOHV 5HFRUGV GDWD FROOHFWLRQ EHJDQ LQ ODWH VSULQJ  7KH GDWD LWHPV RQ WKH UHFRUGV IRUP LQFOXGHG DWWHQGDQFH OLPLWHG (QJOLVK SURILFLHQF\ VH[ DJH HOLJLELOLW\ IRU IUHH RU UHGXFHGSULFH OXQFK SURJUDP GLVDELOLWLHV VSHFLDO HGXFDWLRQ SODQV RU VHUYLFHV JUDGH SURPRWLRQ DQG UHWHQWLRQ JUDGHV DQG VWDQGDUGL]HG WHVW VFRUHV DGPLQLVWHUHG GXULQJ WKH  DQG  VFKRRO \HDUV 7KH VWXG\ REWDLQHG GDWD IURP VWXGHQW UHFRUGV IRU  SHUFHQW RI VWXGHQWV ZKR ZHUH HOLJLEOH IRU WKH IDOO RU VSULQJ WHVWLQJ QRW VKRZQ LQ WDEOHV 5HVSRQVH UDWHV UDQJHG IURP  SHUFHQW IRU ILUVW JUDGHUV WR  SHUFHQW IRU VL[WK JUDGHUV $SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

88 &ODVVURRP 2EVHUYDWLRQV 7KH VWXG\ WHDP XVHG LPSOHPHQWDWLRQ PRGHOV SUHYLRXV UHVHDUFK DQG RWKHU LQVWUXPHQWV WR GHVLJQ D FODVVURRP REVHUYDWLRQ SURWRFRO 7KH GUDIW ZDV WHVWHG ZLWK VHOHFWHG SURGXFWV LQ VSULQJ  DQG YLGHRWDSHG H[DPSOHV RI SURGXFW XVH ZHUH JDWKHUHG DQG ODWHU XVHG GXULQJ WUDLQLQJ RI REVHUYHUV 7R HQVXUH WKH YDOLGLW\ DQG UHOLDELOLW\ RI WKH REVHUYDWLRQ SURWRFRO D FRGLQJ JXLGH ZDV GHYHORSHG DORQJ ZLWK VXSSOHPHQWDU\ PDWHULDOV WR KHOS RULHQW UHVHDUFKHUV WR WKH SURGXFWV GXULQJ WUDLQLQJ 7KH JXLGH LQFOXGHG GHILQLWLRQV DQG H[DPSOHV RI HDFK FRGH DQG DOVR VSHFLILHG ZKHQ REVHUYDWLRQV ZHUH WR EH PDGH 7KH WUDLQLQJ IRFXVHG RQ SUHSDULQJ REVHUYHUV WR FRGH UHVSRQVHV DFFXUDWHO\ DQG UHOLDEO\ 'LUHFW LQVWUXFWLRQ LQ WKH XVH RI WKH SURWRFROV ZDV SURYLGHG DQG DQFKRUHG ZLWK YLGHR H[DPSOHV 2EVHUYHUV ZDWFKHG DQ DQFKRU YLGHR RI D UHDO FODVVURRP XVLQJ VRIWZDUH DQG GLVFXVVHG KRZ WKH\ ZRXOG FRGH WKH LQWHUDFWLRQ GHSLFWHG LQ WKH YLGHR $GGLWLRQDO YLGHRWDSH VHJPHQWV IXQFWLRQHG DV UHOLDELOLW\ WHVWV IRU REVHUYHUV 2EVHUYHUV ZLWK DJUHHPHQW VFRUHV RI OHVV WKDQ  SHUFHQW ZLWK H[SHUW FRGHUV ZHUH H[FOXGHG IURP WKH REVHUYHU SRRO 7KUHH WUDLQHHV ZHUH H[FOXGHG RQ WKLV EDVLV 2EVHUYDWLRQ RI FODVVURRPV RFFXUUHG DW WKUHH SRLQWV GXULQJ WKH VFKRRO \HDU DQG IRFXVHG RQ D FODVV SHULRG GXULQJ ZKLFK SURGXFWV ZHUH EHLQJ XVHG WUHDWPHQW FODVVURRPV RU WKH HTXLYDOHQW FODVV SHULRG FRQWURO FODVVURRPV 7KH REVHUYDWLRQ SURWRFRO FDOOHG IRU REVHUYDWLRQDO GDWD WR EH UHFRUGHG DW ILYH SRLQWV GXULQJ D PLQXWH SHULRG 7KH SURWRFRO KDG WKUHH VHFWLRQV VWXGHQW DFWLYLWLHV SURGXFW XVH DQG JHQHUDO REVHUYDWLRQV 2EVHUYHUV UHFRUGHG WKH QXPEHU RI VWXGHQW DFWLYLWLHV WDNLQJ SODFH WKH W\SH RI DFWLYLW\ WKH WHDFKHUV UROH WKH SHUFHQW RI VWXGHQWV ZKR ZHUH RII WDVN DQG WKH QXPEHU RI VWXGHQWV XVLQJ WKH SURGXFW 2EVHUYHUV FRGHG GDWD DERXW SURGXFW XVH IRU D PLQXWH SHULRG LQFOXGLQJ WHDFKHU UROHV LQ PRWLYDWLQJ DQG KHOSLQJ VWXGHQWV ZKR ZHUH XVLQJ SURGXFWV DQG ZKHWKHU WHDFKHUV RU VWXGHQWV KDG WHFKQLFDO GLIILFXOWLHV ZLWK KDUGZDUH RU VRIWZDUH 7KH JHQHUDO REVHUYDWLRQ VHFWLRQ FRYHUHG WKH HQWLUH FODVV SHULRG DQG REVHUYHUV UHFRUGHG LQIRUPDWLRQ DERXW WKH DPRXQW RI WLPH VWXGHQWV XVHG WKH SURGXFW LI LW ZDV XVHG ZKHUH WKH SURGXFW ZDV XVHG DQG ZKHWKHU RWKHU SURGXFWV ZHUH XVHG 7R DVVHVV UHOLDELOLW\ RI WKH REVHUYDWLRQ SURWRFRO LQ WKH ILHOG LQ D VDPSOH RI GLVWULFWV ZKHUH WKHUH ZHUH WZR RU PRUH REVHUYHUV UHVHDUFKHUV FRQGXFWHG DW OHDVW RQH UHOLDELOLW\ REVHUYDWLRQ ZLWK WZR REVHUYHUV FRGLQJ WKH VDPH WLPH VHJPHQW LQ WKH VDPH FODVVURRP $ WRWDO RI  UHOLDELOLW\ REVHUYDWLRQV ZHUH FRPSOHWHG DFURVV WKH WKUHH VLWH YLVLWV 7KH REVHUYDWLRQ FRGHV IURP WKH REVHUYHU SDLUV ZHUH WKHQ XVHG WR DVVHVV DJUHHPHQW UDWHV 7KH RYHUDOO DJUHHPHQW UDWH SHUIHFW DJUHHPHQW DFURVV REVHUYDWLRQ YDULDEOHV ZDV  SHUFHQW 7KH WHDFKHU LQWHUYLHZ SURWRFROV ZHUH GHVLJQHG WR JDWKHU LQGHSWK GDWD RQ SURGXFW LPSOHPHQWDWLRQ DQG FRQWH[WV RI XVH 7KH FRUH HOHPHQWV LQFOXGHG WLPH VSHQW RQ FXUULFXOXP DQG LQVWUXFWLRQ DFFHVV DQG IUHTXHQF\ RI XVH XVH DV WKH FRUH FXUULFXOXP RU DV D VXSSOHPHQW IUHTXHQF\ DQG GXUDWLRQ RI XVH JURXSLQJ VWUDWHJLHV IRU WKH SURGXFW PDQDJLQJ LQVWUXFWLRQ ZLWK WHFKQRORJ\ FRXUVHZDUH WHDFKHU WUDLQLQJ DQG VXSSRUW DQG VDWLVIDFWLRQ ZLWK WKH XVH RI WKH VRIWZDUH 6HSDUDWH SURWRFROV ZHUH GHYHORSHG IRU PDWK DQG UHDGLQJ IRU WUHDWPHQW DQG FRQWURO FRQGLWLRQV DQG IRU HDFK VFKRRO YLVLW DQG WLPH RI \HDU 7KH FRQWHQW RI WKH LQWHUYLHZV ZDV GHULYHG IURP WKH VWXG\V FRQFHSWXDO IUDPHZRUN EDVHG RQ SULRU UHVHDUFK LQ WKH DUHD RI WHFKQRORJ\ LPSOHPHQWDWLRQ DQG IURP YHQGRU LPSOHPHQWDWLRQ PRGHOV 7KH FRQFHSWXDO $SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

89 IUDPHZRUN XVHG WKH PRGHO RI LQVWUXFWLRQ GHYHORSHG E\ &RKHQ DQG %DOO  HODERUDWLQJ WKDW PRGHO ZLWK LPSOHPHQWDWLRQ LVVXHV IURP WKH HGXFDWLRQDO WHFKQRORJ\ OLWHUDWXUH VXFK DV RQJRLQJ VXSSRUWV IRU WHDFKHU XVH RI WHFKQRORJ\ ORFDWLRQ DQG DPRXQW RI WHFKQRORJ\ XVH FODVVURRP PDQDJHPHQW DQG WHFKQRORJ\ GLIILFXOWLHV H[SHULHQFHG 7KH YHQGRU LPSOHPHQWDWLRQ PRGHOV ZHUH REWDLQHG WKURXJK UHYLHZ RI YHQGRU OLWHUDWXUH DQG IURP LQIRUPDWLRQ SURYLGHG LQ YHQGRU SUHVHQWDWLRQV WR WKH UHVHDUFK WHDP VXSSOHPHQWHG ZLWK IROORZXS TXHVWLRQV DV QHHGHG WR REWDLQ D IXOO VHW RI LPSOHPHQWDWLRQ UHFRPPHQGDWLRQV IRU HYHU\ SURGXFW ,Q WKH LQWHUYLHZ SURWRFRO HDFK TXHVWLRQ LWHP ZDV IROORZHG E\ D OLVW RI SRVVLEOH WHDFKHU UHVSRQVHV )RU VRPH LWHPV DQ RWKHU FDWHJRU\ ZDV LQFOXGHG ZLWK VSDFH WR UHFRUG UHVSRQVHV WKDW ZHUH QRW RQH RI WKH UHVSRQVH RSWLRQV $IWHU HDFK UHVSRQVH LQWHUYLHZHUV ZHUH LQVWUXFWHG WR FRGH WKH UHVSRQVH WKDW EHVW PDWFKHG WKH WHDFKHUV UHVSRQVH ,Q WKH HYHQW WKDW DQ LQWHUYLHZHU ZDV QRW FOHDU KRZ D UHVSRQVH VKRXOG EH FRGHG LQWHUYLHZHUV ZHUH LQVWUXFWHG WR DVN WKH WHDFKHU ZKLFK RI WKH UHVSRQVH FDWHJRULHV EHVW ILW WKH WHDFKHUV H[SHULHQFH 6HSDUDWH SURWRFROV ZHUH GHYHORSHG IRU PDWK DQG UHDGLQJ IRU WUHDWPHQW DQG FRQWURO FRQGLWLRQV DQG IRU HDFK VFKRRO YLVLW DQG WLPH RI \HDU 7KH GXUDWLRQ RI WKH LQWHUYLHZ ZDV W\SLFDOO\  PLQXWHV IRU WUHDWPHQW WHDFKHUV DQG  PLQXWHV IRU FRQWURO WHDFKHUV GHSHQGLQJ RQ ZKHWKHU WKH FRQWURO WHDFKHU ZDV XVLQJ D VRIWZDUH SURGXFW 'UDIW LQWHUYLHZ SURWRFROV ZHUH SLORWHG LQ VSULQJ  ZLWK IRXU GLIIHUHQW WHDFKHUV DQG REVHUYHUV ZHUH WUDLQHG XVLQJ WKH SURWRFROV LQ VXPPHU  3URFHVVLQJ RI 2EVHUYDWLRQ DQG ,QWHUYLHZ 'DWD 0RQLWRULQJ DQG SURFHVVLQJ RI REVHUYDWLRQ GDWD ZHUH VXSSRUWHG E\ D ZHEEDVHG GDWD FROOHFWLRQ PRQLWRULQJ V\VWHP DQG DQ HOHFWURQLF VFDQQLQJ V\VWHP IRU GDWD HQWU\ 2EVHUYDWLRQ DQG LQWHUYLHZ IRUPV KDG D SUHSULQWHG ODEHO ZLWK DQ LGHQWLILFDWLRQ EDU FRGH WKDW LGHQWLILHG WKH VLWH YLVLWRU W\SH RI IRUP VFKRRO FODVVURRP DQG SODFH LQ WKH GDWD FROOHFWLRQ VHTXHQFH ILUVW VHFRQG RU WKLUG YLVLW )RUPV ZHUH LQVSHFWHG IRU FRPSOHWHQHVV DQG FOHDQHG WR HQVXUH DFFXUDWH UHDGLQJ E\ WKH HOHFWURQLF VFDQQHU $IWHU IRUPV KDG SDVVHG WKH LQLWLDO TXDOLW\ FRQWURO FKHFN WKH\ ZHUH VFDQQHG LQWR WKH PRQLWRULQJ V\VWHP 'DWD HQWU\ IRU WKH IRUPV DQG FRGHG UHVSRQVH LWHPV IRU WHDFKHU LQWHUYLHZV ZDV SHUIRUPHG XVLQJ DQ HOHFWURQLF VFDQQLQJ DQG DUFKLYLQJ V\VWHP )RUPV WKDW KDG EHHQ FOHDQHG DQG DSSURYHG IRU VFDQQLQJ ZHUH VFDQQHG LQWR WKH HOHFWURQLF VFDQQLQJ V\VWHP DQG GDWD UHFRUGV ZHUH IRUPDWWHG IRU LPSRUWLQJ WR DQ DQDO\VLV ILOH 7R YHULI\ WKDW WKH HUURU UDWH RI WKH VFDQQLQJ SURFHVV ZDV OHVV WKDQ  SHUFHQW HDFK ZHHN GXULQJ WKH GDWD FROOHFWLRQ ZLQGRZV  SHUFHQW RI IRUPV ZHUH UDQGRPO\ VHOHFWHG DQG  SHUFHQW YHULILHG E\ FRPSDULQJ HQWHUHG YDOXHV ZLWK WKH RULJLQDO KDUGFRS\ IRUPV 2EVHUYDWLRQ DQG ,QWHUYLHZ &RQVWUXFWV 2QH LWHP ZDV FRQVWUXFWHG IURP WKH REVHUYDWLRQ GDWD DQG WZR ZHUH FRQVWUXFWHG IURP WHDFKHU LQWHUYLHZ GDWD IRU DQDO\VLV SXUSRVHV 7KH /RFDWLRQ RI 8VH YDULDEOH ZDV FRGHG DV  IRU XVH LQ D UHJXODU FODVVURRP DQG  IRU XVH LQ D ODE OLEUDU\ RU RWKHU VLWH 7KH 'LIILFXOWLHV ZLWK $FFHVV WR 3URGXFW YDULDEOH ZDV FUHDWHG WR PHDVXUH WKH H[WHQW WR ZKLFK WHDFKHUV H[SHULHQFHG GLIILFXOWLHV JDLQLQJ DFFHVV WR WKH SURGXFW RU ILQGLQJ HQRXJK WLPH IRU VWXGHQWV WR XVH LW DV SODQQHG EHFDXVH RI WHFKQLFDO SUREOHPV ZLWK WKH VFKRRO QHWZRUN VWXGHQWV EHLQJ SXOOHG RXW RI FODVV WR UHFHLYH VSHFLDO VHUYLFHV VFKHGXOLQJ FRQIOLFWV ZLWK XVH RI FRPSXWHU ODE $SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

90 RU RWKHU UHDVRQV 7HDFKHUV ZHUH DVNHG ZKHWKHU WKH\ H[SHULHQFHG GLIILFXOWLHV JHWWLQJ VWXGHQWV HQRXJK WLPH RU DFFHVV RQ WKH DVVLJQHG SURGXFW 5HVSRQVHV ZHUH FRGHG DV \HV RU QR DQG WHDFKHUV ZHUH DOVR DVNHG WR GHVFULEH WKH QDWXUH RI WKH GLIILFXOW\ 7KH VFDOH XVHG DYHUDJHG UHVSRQVHV IURP WKH ILUVW WZR YLVLWV UHVXOWLQJ LQ D VFDOH ZLWK D UDQJH IURP  QR GLIILFXOWLHV H[SHULHQFHG SULRU WR HLWKHU YLVLW WR  GLIILFXOWLHV H[SHULHQFHG SULRU WR HDFK YLVLW ZKLFK ZHUH PXOWLSOLHG E\  WR PDNH WKH YDOXH DQDORJRXV WR D SHUFHQWDJH 7KH $GHTXDF\ RI 6XSSRUWHG 7LPH YDULDEOH ZDV FUHDWHG IURP DQ LQWHUYLHZ LWHP DERXW ZKHWKHU WHDFKHUV IHOW WKHUH ZDV HQRXJK VXSSRUWHG RU SDLG WLPH WR SUHSDUH WR XVH WKH SURGXFW  VXSSRUWHG WLPH QRW HQRXJK WR  VXSSRUWHG WLPH ZDV DGHTXDWH 7KH TXHVWLRQV ZHUH DVNHG GXULQJ WKH WKLUG YLVLW DIWHU WHDFKHUV DOUHDG\ KDG RSSRUWXQLWLHV WR DVVHVV KRZ PXFK WLPH WKH\ QHHGHG WR SUHSDUH WR XVH SURGXFWV 'HVFULSWLYH 'DWD 7DEOHV $DG VKRZ PHDQV DQG VWDQGDUG GHYLDWLRQV IRU DOO GDWD LWHPV XVHG LQ WKH HVWLPDWLRQ PRGHOV %RWK IDOO DQG VSULQJ RYHUDOO VFRUHV DQG VXEWHVW VFRUHV DUH LQFOXGHG VWDQGDUG GHYLDWLRQV RI WKH FRQWURO JURXS VSULQJ WHVW VFRUH DUH WKH EDVLV RI HIIHFW VL]H FDOFXODWLRQV LQ WKH WH[W 6RPH GDWD LWHPV DUH GHILQHG IRU RQO\ WUHDWPHQW FODVVURRPV DQG VFKRRO FKDUDFWHULVWLFV DUH WKH VDPH IRU WUHDWPHQW DQG FRQWURO FODVVURRPV

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

91
7$%/( $D 'HVFULSWLYH 6WDWLVWLFV RI 9DULDEOHV 8VHG LQ (VWLPDWLQJ (IIHFWV )LUVW *UDGH 0HDQV DQG 6WDQGDUG 'HYLDWLRQV 'HVFULSWLYH 6WXGHQWV )HPDOH SHUFHQW $JH DV RI 2FWREHU  \HDUV )DOO VFRUH RQ 6WDQIRUG (DUO\ 6FKRRO $FKLHYHPHQW 7HVW 1&( 6RXQGV DQG OHWWHUV 6HQWHQFH UHDGLQJ :RUG UHDGLQJ 7RWDO 6SULQJ VFRUH RQ 6WDQIRUG $FKLHYHPHQW 7HVW 1&( 6RXQGV DQG OHWWHUV 6HQWHQFH UHDGLQJ :RUG UHDGLQJ 7RWDO )DOO VFRUH RQ 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 3KRQHPLF GHFRGLQJ 6LJKW ZRUG 7RWDO ZRUG UHDGLQJ                                                     7UHDWPHQW *URXS &RQWURO *URXS

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

92
7DEOH $D 'HVFULSWLYH 6SULQJ VFRUH RQ 7HVW RI :RUG 5HDGLQJ (IILFLHQF\ 3KRQHPLF GHFRGLQJ HIILFLHQF\ 6LJKW ZRUG HIILFLHQF\ 7RWDO ZRUG UHDGLQJ HIILFLHQF\ 7HDFKHUV )HPDOH SHUFHQW 7HDFKLQJ H[SHULHQFH \HDUV 0DVWHUV GHJUHH SHUFHQW 7LPH VSHQW XVLQJ RWKHU SURGXFWV KRXUV D \HDU 7LPH VSHQW XVLQJ VWXG\ SURGXFWV KRXUV D \HDU 6WXG\ SURGXFW XVHG LQ WKH FODVVURRP SHUFHQW $FFHVV SUREOHPV VFDOH IURP  WR  $GHTXDWH DPRXQW RI SUHSDUDWLRQ VXSSRUW WLPH SHUFHQW 6FKRRO KDV RQVLWH FRPSXWHU VSHFLDOLVW SHUFHQW 3DUWLFLSDWHG LQ WHFKQRORJ\ SURIHVVLRQDO GHYHORSPHQW ODVW VFKRRO \HDU SHUFHQW 6FKRROV 6WXGHQWV UHFHLYLQJ IUHHUHGXFHGSULFH OXQFK SHUFHQW 6WXGHQWWHDFKHU UDWLR %ODFN VWXGHQWV SHUFHQW                                    QD QD QD QD QD QD             7UHDWPHQW *URXS &RQWURO *URXS

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

93
7DEOH $D 'HVFULSWLYH +LVSDQLF VWXGHQWV SHUFHQW +DV ,(3 SHUFHQW ,Q XUEDQ DUHD SHUFHQW      

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

94
7DEOH $E 'HVFULSWLYH 6WDWLVWLFV RI 9DULDEOHV 8VHG LQ (VWLPDWLQJ (IIHFWV )RXUWK *UDGH 0HDQV DQG 6WDQGDUG 'HYLDWLRQV 'HVFULSWLYH 6WXGHQWV )HPDOH SHUFHQW $JH DV RI 2FWREHU  \HDUV )DOO VFRUH RQ 6WDQIRUG $FKLHYHPHQW 7HVW 1&( 5HDGLQJ FRPSUHKHQVLRQ 5HDGLQJ YRFDEXODU\ :RUN VWXG\ VNLOOV 7RWDO 6SULQJ VFRUH RQ 6WDQIRUG $FKLHYHPHQW 7HVW 1&( 5HDGLQJ FRPSUHKHQVLRQ 5HDGLQJ YRFDEXODU\ :RUN VWXG\ VNLOOV 7RWDO 7HDFKHUV )HPDOH SHUFHQW 7HDFKLQJ H[SHULHQFH \HDUV 0DVWHUV GHJUHH SHUFHQW 7LPH VSHQW XVLQJ RWKHU SURGXFWV KRXUV D \HDU                                                         7UHDWPHQW *URXS &RQWURO *URXS

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

95
7DEOH $E 'HVFULSWLYH 7LPH XVLQJ VWXG\ SURGXFWV KRXUV D \HDU 6WXG\ SURGXFW XVHG LQ WKH FODVVURRP SHUFHQW $FFHVV SUREOHPV VFDOH IURP  WR  $GHTXDWH DPRXQW RI SUHSDUDWLRQ VXSSRUW WLPH SHUFHQW 6FKRRO KDV RQVLWH FRPSXWHU VSHFLDOLVW SHUFHQW 3DUWLFLSDWHG LQ WHFKQRORJ\ SURIHVVLRQDO GHYHORSPHQW ODVW VFKRRO \HDU SHUFHQW 6FKRROV 6WXGHQWV UHFHLYLQJ IUHHUHGXFHGSULFH OXQFK SHUFHQW 6WXGHQWWHDFKHU UDWLR %ODFN VWXGHQWV SHUFHQW +LVSDQLF VWXGHQWV SHUFHQW +DV ,(3 SHUFHQW ,Q XUEDQ DUHD SHUFHQW             7UHDWPHQW *URXS             &RQWURO *URXS QD QD QD QD QD QD

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

96
7$%/( $F 'HVFULSWLYH 6WDWLVWLFV RI 9DULDEOHV 8VHG LQ (VWLPDWLQJ (IIHFWV 6L[WK *UDGH 0HDQV DQG 6WDQGDUG 'HYLDWLRQV 'HVFULSWLYH 6WXGHQWV )HPDOH SHUFHQW $JH DV RI 2FWREHU  \HDUV )DOO VFRUH RQ 6WDQIRUG $FKLHYHPHQW 7HVW 1&( 3URFHGXUHV 3UREOHP VROYLQJ 7RWDO 6SULQJ VFRUH RQ 6WDQIRUG $FKLHYHPHQW 7HVW 1&( 3URFHGXUHV 3UREOHP VROYLQJ 7RWDO 7HDFKHUV )HPDOH SHUFHQW 7HDFKLQJ H[SHULHQFH \HDUV 0DVWHUV GHJUHH SHUFHQW 7LPH VSHQW XVLQJ RWKHU SURGXFWV KRXUV D \HDU 7LPH VSHQW XVLQJ VWXG\ SURGXFWV KRXUV D \HDU 6WXG\ SURGXFW XVHG LQ WKH FODVVURRP SHUFHQW                     QD QD                                 7UHDWPHQW *URXS &RQWURO *URXS

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

97
7DEOH $F 'HVFULSWLYH $FFHVV SUREOHPV VFDOH IURP  WR  $GHTXDWH DPRXQW RI SUHSDUDWLRQ VXSSRUW WLPH SHUFHQW 6FKRRO KDV RQVLWH FRPSXWHU VSHFLDOLVW SHUFHQW 3DUWLFLSDWHG LQ WHFKQRORJ\ SURIHVVLRQDO GHYHORSPHQW ODVW VFKRRO \HDU SHUFHQW 6FKRROV 6WXGHQWV UHFHLYLQJ IUHHUHGXFHGSULFH OXQFK SHUFHQW 6WXGHQWWHDFKHU UDWLR %ODFN VWXGHQWV SHUFHQW +LVSDQLF VWXGHQWV SHUFHQW +DV ,(3 SHUFHQW ,Q XUEDQ DUHD SHUFHQW             7UHDWPHQW *URXS         &RQWURO *URXS QD QD QD QD

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

98
7$%/( $G 'HVFULSWLYH 6WDWLVWLFV RI 9DULDEOHV 8VHG LQ (VWLPDWLQJ (IIHFWV $OJHEUD 0HDQV DQG 6WDQGDUG 'HYLDWLRQV 'HVFULSWLYH 6WXGHQWV )HPDOH SHUFHQW $JH DV RI 2FWREHU  \HDUV )DOO VFRUH RQ (76 $OJHEUD 7HVW SHUFHQW FRUUHFW 7RWDO &RQFHSWV 3URFHVVHV 6NLOOV 6SULQJ VFRUH RQ (76 $OJHEUD 7HVW SHUFHQW FRUUHFW 7RWDO &RQFHSWV 3URFHVVHV         7HDFKHUV )HPDOH SHUFHQW 7HDFKLQJ H[SHULHQFH \HDUV 0DVWHUV GHJUHH SHUFHQW 7LPH VSHQW XVLQJ RWKHU SURGXFWV KRXUV D \HDU                                                 7UHDWPHQW *URXS &RQWURO *URXS

6NLOOV

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

99
7DEOH $G 'HVFULSWLYH 7LPH VSHQW XVLQJ VWXG\ SURGXFWV KRXUV D \HDU 6WXG\ SURGXFW XVHG LQ WKH FODVVURRP SHUFHQW $FFHVV SUREOHPV VFDOH IURP  WR  $GHTXDWH DPRXQW RI SUHSDUDWLRQ VXSSRUW WLPH SHUFHQW 6FKRRO KDV RQVLWH FRPSXWHU VSHFLDOLVW SHUFHQW 3DUWLFLSDWHG LQ WHFKQRORJ\ SURIHVVLRQDO GHYHORSPHQW ODVW VFKRRO \HDU SHUFHQW 6FKRROV 6WXGHQWV UHFHLYLQJ IUHHUHGXFHGSULFH OXQFK SHUFHQW 6WXGHQWWHDFKHU UDWLR %ODFN VWXGHQWV SHUFHQW +LVSDQLF VWXGHQWV SHUFHQW +DV ,(3 SHUFHQW ,Q XUEDQ DUHD SHUFHQW             7UHDWPHQW *URXS             &RQWURO *URXS QD QD QD QD QD QD

$SSHQGL[ $ 'DWD &ROOHFWLRQ $SSURDFK DQG 5HVSRQVH 5DWHV

$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV

$ (VWLPDWLQJ 3URGXFW (IIHFWV )RU WKH VWXG\ YROXQWHHULQJ WHDFKHUV LQ HDFK VFKRRO ZHUH UDQGRPO\ DVVLJQHG HLWKHU WR LPSOHPHQW D VRIWZDUH SURGXFW WUHDWPHQW WHDFKHUV RU QRW WR LPSOHPHQW LW FRQWURO WHDFKHUV 5DQGRP DVVLJQPHQW RI WHDFKHUV PHDQV WKDW WKH SURGXFWV HIIHFW RQ VWXGHQW DFKLHYHPHQW FDQ EH HVWLPDWHG E\ FRPSDULQJ DFKLHYHPHQW RI WUHDWPHQW DQG FRQWURO FODVVURRPV 7KH QHVWHG VWUXFWXUH RI WKH VDPSOH ZDV DFNQRZOHGJHG E\ HVWLPDWLQJ HIIHFWV XVLQJ KLHUDUFKLFDO OLQHDU PRGHOV 2WKHU DQDO\VHV DOVR XVHG KLHUDUFKLFDO PRGHOV ZKHQ WKH GDWD ZHUH FOXVWHUHG E\ FODVVURRP RU VFKRRO $ 7KUHH/HYHO +LHUDUFKLFDO /LQHDU 0RGHO IRU (VWLPDWLQJ 0DLQ (IIHFWV 7KH VLPSOHVW HVWLPDWRU RI SURGXFW HIIHFWV LV WKH GLIIHUHQFH RI WKH DYHUDJH VSULQJ WHVW VFRUHV LQ WUHDWPHQW DQG FRQWURO FODVVURRPV 7KH H[SHULPHQWDO GHVLJQ HQVXUHV WKDW WKH SUHVHQFH RI WKH SURGXFW LQ WUHDWPHQW FODVVURRPV LV WKH RQO\ GLIIHUHQFH LQ WKH WZR W\SHV RI FODVVURRPV RQ DYHUDJH DQG WKHUHIRUH DFKLHYHPHQW GLIIHUHQFHV FDQ EH DWWULEXWHG WR WKH HIIHFWV RI WKH SURGXFW +RZHYHU WKH VLPSOH HVWLPDWRU LV EDVHG RQ WKH QXPEHU RI FODVVURRPV LQ WKH VWXG\ ZKLFK OLPLWV LWV VWDWLVWLFDO SRZHU IRU H[SORULQJ UHODWLRQVKLSV EHWZHHQ SURGXFW HIIHFWV DQG PRGHUDWLQJ YDULDEOHV $ PRGHO EDVHG RQ WKH QXPEHU RI VWXGHQWV DOORZV WKH VWXG\ WR LQFUHDVH LWV VWDWLVWLFDO SRZHU DQG HVWLPDWH UHODWLRQVKLSV RI HIIHFWV DQG PRGHUDWLQJ YDULDEOHV PRUH SUHFLVHO\ 7KH VLPSOH WKUHHOHYHO KLHUDUFKLFDO OLQHDU PRGHO XVHG IRU HVWLPDWLQJ WKH PDLQ HIIHFWV KDV VWXGHQW FODVVURRP DQG VFKRRO FRPSRQHQWV $ 6WXGHQW $ &ODVVURRP $ 6FKRRO
Yijk = 0 jk + X ijk + ijk 

0 jk = 0 k + 1T jk + W jk + j 

0 k = 0 + 1 Z k + k 

 ZKHUH < LV WKH VWXGHQWV VSULQJ WHVW VFRUH ; LV D VHW RI EDVHOLQH VWXGHQW FKDUDFWHULVWLFV 7 LV DQ LQGLFDWRU RI ZKHWKHU WKH FODVVURRP LV DVVLJQHG WR WKH WUHDWPHQW JURXS : LV D VHW RI WHDFKHU FKDUDFWHULVWLFV DQG = LV D VHW RI VFKRRO FKDUDFWHULVWLFV 7KH PRVW LPSRUWDQW VWXGHQW FKDUDFWHULVWLF LQ WKH VHW ; LV OLNHO\ WR EH WKH IDOO WHVW VFRUH EHFDXVH VWXGLHV RIWHQ ILQG WKDW LQLWLDO DFKLHYHPHQW H[SODLQV PXFK RI WKH YDULDWLRQ LQ ODWHU DFKLHYHPHQW 1RWH WKH FDVFDGLQJ UHODWLRQVKLSV RI WKH FRHIILFLHQWV ZLWK WKH LQWHUFHSW RI WKH VWXGHQW HTXDWLRQ EHLQJ PRGHOHG DV D IXQFWLRQ RI FODVVURRP FKDUDFWHULVWLFV DQG WKH LQWHUFHSW RI WKH FODVVURRP HTXDWLRQ PRGHOHG DV D IXQFWLRQ RI VFKRRO FKDUDFWHULVWLFV 6XEVWLWXWLQJ HTXDWLRQV $ LQWR $ DQG WKH FRPELQHG HTXDWLRQ LQWR $ \LHOGV D PL[HG PRGHO RI VWXGHQW DFKLHYHPHQW WHUPHG WKH PDLQ HIIHFWV PRGHO $ 0DLQ (IIHFWV Yijk = 0 + 1T jk + 1Z k + X ijk + W jk + ijk  ZKHUH WKH FRPELQHG HUURU WHUP LV GHILQHG DV

ijk = k + j + ijk 
7KH PL[HG PRGHO VKRZV WKDW LQGLYLGXDO VWXGHQW DFKLHYHPHQW LV WKH VXP RI DYHUDJH DFKLHYHPHQW RI VWXGHQWV LQ FRQWURO FODVVURRPV D SURGXFW HIIHFW IRU VWXGHQWV LQ FODVVURRPV XVLQJ D SURGXFW VWXGHQW FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV DQG DQ HUURU WHUP ZLWK VWXGHQW FODVVURRP DQG VFKRRO FRPSRQHQWV (TXDWLRQ $ ZDV HVWLPDWHG ZLWK WKH SDFNDJH +/0  7KH SDFNDJH XVHG IXOO LQIRUPDWLRQ PD[LPXP OLNHOLKRRG WHFKQLTXHV DQG DOVR HVWLPDWHG UREXVW +XEHU:KLWH VWDQGDUG HUURUV ZKLFK DUH UHSRUWHG LQ WKH WH[W $V D FKHFN DQ LQLWLDO VHW RI PRGHOV ZDV HVWLPDWHG ZLWK 6$6 3URF 0L[HG 68'$$1 DQG 6WDWD DQG UHVXOWV ZHUH QHDUO\ LGHQWLFDO 5HVXOWV IRU D IXOO PDLQ HIIHFWV PRGHO DUH VKRZQ LQ 7DEOH % 7KH WDEOH LQGLFDWHV WKH FRPSOHWH VHW RI HVWLPDWHV IRU DOO FRHIILFLHQWV LQ WKH PRGHO OLVWHG E\ OHYHO VWXGHQW FODVVURRP VFKRRO ,W DOVR VKRZV WKH UHVLGXDO YDULDQFHV DW WKH WKUHH OHYHOV DW WKH ERWWRP RI WKH WDEOH 3RVLWLYH FRHIILFLHQWV LQGLFDWH D YDULDEOH LV FRUUHODWHG ZLWK DQ LQFUHDVH LQ WKH VSULQJ WHVW VFRUH DQG QHJDWLYH FRHIILFLHQWV LQGLFDWH D YDULDEOH LV FRUUHODWHG ZLWK D GHFUHDVH 7KH XQLWV RI WKH FRHIILFLHQW DUH WKH VDPH DV WKH XQLWV RI WKH WHVW VFRUHV QRUPDO FXUYH HTXLYDOHQWV IRU ILUVW IRXUWK DQG VL[WK JUDGHV DQG SHUFHQW FRUUHFW IRU DOJHEUD 7KH UHVXOWV DUH FRQYHQWLRQDO LQ VHYHUDO UHVSHFWV 2QH LV WKDW WKH IDOO VFRUH LV D VWURQJ SUHGLFWRU RI WKH VSULQJ VFRUH $QRWKHU LV WKDW KDYLQJ D ODUJHU SHUFHQWDJH RI PLQRULW\ VWXGHQWV ZDV FRUUHODWHG ZLWK KDYLQJ ORZHU VFRUHV 2WKHU ILQGLQJV YDU\ GHSHQGLQJ RQ JUDGH OHYHO $ VLJQLILFDQW DPRXQW RI WHVW VFRUH YDULDQFH LV UHODWHG WR FODVVURRPV DQG VFKRROV )RU H[DPSOH IRU ILUVW JUDGH  SHUFHQW RI WKH UHVLGXDO YDULDQFH RI VFRUHV WKH DPRXQW RI YDULDQFH

$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV


7DEOH % 0DLQ (IIHFWV +LHUDUFKLFDO /LQHDU 0RGHO (VWLPDWHV 2XWFRPH LV 6SULQJ 7HVW 6FRUH ZLWK 6WDQGDUG (UURUV LQ 3DUHQWKHVHV
9DULDEOH1DPH
D )LUVW*UDGH

)RXUWK*UDGH

6L[WK*UDGH

$OJHEUD

6WXGHQW/HYHO
,QWHUFHSW

 

 

 

 

6WXGHQWLVIHPDOH

 

 

 

 

6WXGHQWDJH

 

 

 

 

D )DOOWHVWVFRUHV

       

     

   

 

&ODVVURRP/HYHO
7UHDWPHQWFODVVURRP

 

 

 

 

7HDFKHULVIHPDOH

 

 

 

 

<HDUVRIWHDFKLQJH[SHULHQFH

 

 

 

 

7HDFKHUKDVDPDVWHUVGHJUHH

 

 

 

 

6FKRRO/HYHO
6WXGHQWVHOLJLEOHIRUIUHHOXQFKSHUFHQW

 

 

 

 

6WXGHQWWHDFKHUUDWLR

 

 

 

 

3HUFHQWRI%ODFNVWXGHQWV

 

 

 

 

3HUFHQWRI+LVSDQLFVWXGHQWV

 

 

 

 

6WXGHQWVLQVSHFLDOHGXFDWLRQSHUFHQW

 

 

 

 

6FKRROLVLQXUEDQDUHD

 

 

 

 

5HVLGXDO9DULDQFH 6WXGHQWOHYHO 7HDFKHUOHYHO 6FKRROOHYHO

D

  

  

  

  

)RU IDOO WHVW VFRUH VXEWHVW VFRUHV DUH HQWHUHG VHSDUDWHO\ )RU ILUVW JUDGH WKH IRXU IDOO VFRUHV DUH WKH WKUHH 6(6$7 VXEVFRUHV VRXQGV DQG

OHWWHUVZRUGUHDGLQJDQGVHQWHQFHUHDGLQJDQGWKHWRWDOIDOO72:5(VFRUH)RUIRXUWKJUDGHWKHWKUHHVXEVFRUHVDUHHQWHUHGYRFDEXODU\ ZRUG VWXG\ VNLOOV DQG FRPSUHKHQVLRQ )RU VL[WK JUDGH WKH WZR VXEVFRUHV DUH HQWHUHG SURFHGXUHV DQG SUREOHPVROYLQJ )RU DOJHEUD WKH WRWDOIDOOVFRUHLVHQWHUHG

$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV

 DIWHU DGMXVWLQJ IRU FRYDULDWHV RFFXUV DW WKH FODVVURRP OHYHO DQG  SHUFHQW RFFXUV DW WKH VFKRRO OHYHO 7KH UHPDLQLQJ  SHUFHQW RI VFRUH YDULDQFH RFFXUV DW WKH VWXGHQW OHYHO $W RWKHU JUDGH OHYHOV FODVVURRP DQG VFKRRO YDULDQFHV DOVR DUH FRQVLGHUDEOH ZLWK FODVVURRP YDULDQFH WKH ODUJHU RI WKH WZR 7KH WUHDWPHQW HIIHFWV UHSRUWHG LQ WKH WH[W UHIHU WR WKH HVWLPDWHG FRHIILFLHQWV RI WKH WUHDWPHQW FODVVURRP LQGLFDWRU YDULDEOH DW WKH WHDFKHU OHYHO )RU H[DPSOH WKH HVWLPDWH RI  IRU WKH WUHDWPHQW HIIHFW LQ WKH FROXPQ IRU ILUVW JUDGH LV WKH VDPH DV LV VKRZQ LQ 7DEOH ,, DV WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW DQG FRQWURO JURXS DYHUDJH VFRUHV 7KH SYDOXH VKRZQ LQ 7DEOH ,, LV WKH SYDOXH RI WKH HVWLPDWHG WUHDWPHQW FRHIILFLHQW % (VWLPDWLQJ 0RGHUDWLQJ 5HODWLRQVKLSV 7KH KLHUDUFKLFDO PRGHO VXSSRUWV HVWLPDWLQJ UHODWLRQVKLSV EHWZHHQ RYHUDOO SURGXFW HIIHFWV DQG FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV ,Q WKH PDLQHIIHFWV PRGHO DERYH FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV DUH SUHGLFWRUV RI VWXGHQW DFKLHYHPHQW 6RPH RU DOO RI WKHVH FKDUDFWHULVWLFV DOVR PD\ PRGHUDWH SURGXFW HIIHFWV 7R DOORZ IRU PRGHUDWLQJ YDULDEOHV WKH PRGHO LV PRGLILHG E\ DGGLQJ LQWHUDFWLRQV EHWZHHQ WKH WUHDWPHQW LQGLFDWRU DQG FODVVURRP FKDUDFWHULVWLFV WR HTXDWLRQ $ $ &ODVVURRP ,QWHUDFWLRQV

ojk = 0 k + 1k T jk + 2 k T jk jk + W jk + jk 

7KH SURGXFW HIIHFW LQ HTXDWLRQ $ DOVR KDV EHHQ PRGLILHG E\ DGGLQJ D VFKRRO VXEVFULSW WR LWV HVWLPDWRU 7KH VHW RI YDULDEOHV LQGLFDWHG E\ FDQ LQFOXGH WKH YDULDEOHV LQ WKH VHW : EXW DOVR FDQ LQFOXGH RWKHU FODVVURRP YDULDEOHV VXFK DV LPSOHPHQWDWLRQ YDULDEOHV 7KH VFKRRO VXEVFULSW LV DGGHG WR VXSSRUW WKH VHFRQG PRGLILFDWLRQ RI DGGLQJ DQ HTXDWLRQ WKDW DOORZV VFKRRO FKDUDFWHULVWLFV WR PRGHUDWH WKH SURGXFW HIIHFW $ 6FKRRO ,QWHUDFWLRQV

1k = 0 + 1Z k + k 

&RPELQLQJ WKH HTXDWLRQV DQG FROOHFWLQJ WHUPV \LHOGV D PL[HGPRGHO HVWLPDWLQJ HTXDWLRQ LQ ZKLFK WKH SURGXFW HIIHFW LV UHODWHG WR FODVVURRP DQG VFKRRO FRQGLWLRQV $ 0L[HG 0RGHO ZLWK ,QWHUDFWLRQV@
Yijk = 0 + [ 0 + 1Z k + 2W jk ]T jk + [1Z k + W jk + X ijk ] + ijk 

ZKHUH WKH HUURU WHUP KDV WKH VWUXFWXUH

ijk = k T jk + jk + ijk 

7KH HVWLPDWRUV VWUXFWXUH LQ $ KDV WZR FRPSRQHQWV VKRZQ LQ VTXDUH EUDFNHWV 7KH ILUVW LV WKH SURGXFW HIIHFW ZKLFK LV UHODWHG WR VFKRRO FKDUDFWHULVWLFV = DQG FODVVURRP FKDUDFWHULVWLFV : 7KH VHFRQG LV WKH HIIHFW RI VWXGHQW FODVVURRP DQG VFKRRO FKDUDFWHULVWLFV $SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV

 6WDWLVWLFDOO\ VLJQLILFDQW HVWLPDWHV RI WKH VHW RI FRHIILFLHQWV UHSUHVHQWHG E\  DQG HYLGHQFH RI PRGHUDWLQJ UHODWLRQVKLSV EHWZHHQ FKDUDFWHULVWLFV DQG WKH SURGXFW HIIHFW


DUH

7KH PL[HG PRGHO ZLWK LQWHUDFWLRQV LV RQH RI PDQ\ NLQGV RI LQWHUDFWLRQ PRGHOV ,Q SULQFLSOH DOO ORZHUOHYHO FRHIILFLHQWV LQ KLHUDUFKLFDO OLQHDU PRGHOV FDQ EH PRGHOHG DV IXQFWLRQV RI IDFWRUV DW KLJKHU OHYHOV +RZHYHU WKH FRPSOH[LW\ RI WKH UHVXOWLQJ HVWLPDWHV PDNHV LQWHUSUHWDWLRQ GLIILFXOW DQG VLPSOLI\LQJ DVVXPSWLRQV DUH QHHGHG WR UHGXFH FRPSOH[LW\ DQG PDNH LQWHUSUHWDWLRQV FOHDUHU ,Q SDUWLFXODU WKH VWXG\ PDGH WZR VLPSOLI\LQJ DVVXPSWLRQV 2QH LV WKDW VWXGHQW FKDUDFWHULVWLFV DIIHFW DFKLHYHPHQW GLUHFWO\ WKHVH UHODWLRQVKLSV DUH UHSUHVHQWHG E\ WKH FRHIILFLHQWV LQ WKH PRGHO EXW WKDW WKHVH FRHIILFLHQWV GR QRW LQWHUDFW ZLWK FODVVURRP FKDUDFWHULVWLFV 6WDWHG DQRWKHU ZD\ FODVVURRP FKDUDFWHULVWLFV DIIHFW DOO VWXGHQWV LQ WKH FODVV VLPLODUO\ 7KH SUDFWLFDO LPSOLFDWLRQ RI WKH DVVXPSWLRQ LV WKDW WKH PRGHO GRHV QRW DOORZ IRU H[DPSOH WKDW DFKLHYHPHQW RI PDOH VWXGHQWV PD\ GHSHQG RQ WKH JHQGHU RI WKH WHDFKHU RU WKDW ORZDFKLHYLQJ VWXGHQWV IDUH EHWWHU ZLWK WHDFKHUV ZKR KDYH PRUH H[SHULHQFH 7KH VHFRQG VLPSOLI\LQJ DVVXPSWLRQ LV WKDW WKH PDJQLWXGH RI WKH LQWHUDFWLRQV EHWZHHQ WKH SURGXFW HIIHFW DQG FODVVURRP FKDUDFWHULVWLFV LV QRW UHODWHG WR VFKRRO FKDUDFWHULVWLFV WKHUH DUH QR KLJKHUOHYHO HTXDWLRQV IRU WKH 2 FRHIILFLHQWV 7KH SUDFWLFDO LPSOLFDWLRQ RI WKH DVVXPSWLRQ LV WKDW WKH SURGXFW HIIHFW PD\ EH UHODWHG WR ZKHWKHU D FODVVURRP KDV KLJK RU ORZ DYHUDJH VWXGHQW DFKLHYHPHQW IRU H[DPSOH EXW WKH PDJQLWXGH RI WKH UHODWLRQVKLS LV QRW LQ WXUQ UHODWHG WR VFKRRO FKDUDFWHULVWLFV VXFK DV SRYHUW\ OHYHO $ XVHIXO IHDWXUH RI WKH LQWHUDFWLRQ PRGHO $ LV WKDW LW HVWLPDWHV PRGHUDWLQJ UHODWLRQVKLSV IRU HDFK FKDUDFWHULVWLF WKDW RIWHQ LV XVHG WR FUHDWH VXEJURXSV ZKLOH DGMXVWLQJ IRU PRGHUDWLQJ UHODWLRQVKLSV ZLWK RWKHU FKDUDFWHULVWLFV )RU H[DPSOH WKH PRGHUDWLQJ HIIHFW RI VFKRRO SRYHUW\ LV HVWLPDWHG DIWHU DGMXVWLQJ IRU WKH PRGHUDWLQJ HIIHFW RI WKH VFKRROV UDFLDO DQG HWKQLF FRPSRVLWLRQ RI VWXGHQWV 7KH HVWLPDWHV FDQ EH XQGHUVWRRG DV WKH HIIHFW RI HDFK FKDUDFWHULVWLF KROGLQJ RWKHU FKDUDFWHULVWLFV FRQVWDQW +RZHYHU WKH PRGHOV DELOLW\ WR HVWLPDWH WKHVH UHODWLRQVKLSV GHSHQGV RQ WKH GHJUHH RI YDULDELOLW\ LQ WKH GDWD ,I WKH GDWD LQFOXGH RQO\ VFKRROV WKDW DUH ERWK KLJKSRYHUW\ DQG ZLWK PDQ\ PLQRULW\ VWXGHQWV LQ RWKHU ZRUGV LI WKH WZR FKDUDFWHULVWLFV DUH KLJKO\ FRUUHODWHG WKH PRGHO PD\ EH XQDEOH WR VHSDUDWH WKH FKDUDFWHULVWLFV DQG WKH UHVXOW PD\ EH VWDWLVWLFDOO\ LQVLJQLILFDQW FRHIILFLHQWV IRU SRYHUW\ DQG IRU PLQRULW\ UHSUHVHQWDWLRQ 3DUWLFXODUO\ IRU WKH VL[WK JUDGH DQG DOJHEUD VWXGLHV ZKLFK KDYH IHZHU VFKRROV WKDQ WKH ILUVW JUDGH DQG IRXUWK JUDGH UHDGLQJ VWXGLHV WKH DPRXQW RI YDULDWLRQ LQ WKH GDWD LV D FRQVWUDLQW RQ HVWLPDWLQJ PRGHUDWLQJ UHODWLRQVKLSV 7DEOH % VKRZV HVWLPDWHV IURP WKH IXOO PRGHO IRU WKH RYHUDOO VFRUH 7KH IXOO VHW RI HVWLPDWHV VKRZQ LQ WKH WH[W LQFOXGHV PRGHUDWLQJ UHODWLRQVKLSV ZLWK VXEWHVW VFRUHV DV WKH RXWFRPH EXW WKH VWUXFWXUH RI WKH PRGHOV LV WKH VDPH 7KH IXOO LQWHUDFWLRQV PRGHO KDV PDQ\ SDUDPHWHUV PRUH WKDQ  DQG WKH WZR HTXDWLRQV DW WKH WKLUG OHYHO DGG WR LWV FRPSOH[LW\ 7KH WDEOH VKRZV WKH HVWLPDWHG FRHIILFLHQWV LQ ILYH JURXSLQJV WKUHH DUH HVWLPDWHV FRUUHVSRQGLQJ WR WKH PDLQ PRGHO VKRZQ LQ 7DEOH % DQG WZR DUH HVWLPDWHV FRUUHVSRQGLQJ WR WKH PRGHUDWLQJ YDULDEOHV RQH DW WKH FODVVURRP OHYHO DQG RQH DW WKH VFKRRO OHYHO 1RW DOO $SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV

 PRGHUDWLQJ YDULDEOHV FRXOG EH LQFOXGHG IRU WKH PDWK JUDGH OHYHOV 7KH PRGHOV SURYHG WR EH QXPHULFDOO\ XQVWDEOH ZKHQ WKH IXOO VHW RI YDULDEOHV ZDV HQWHUHG SUREDEO\ EHFDXVH WKHUH ZHUH UHODWLYHO\ IHZ VFKRROV DQG QRW HQRXJK YDULDELOLW\ LQ WKH GDWD WR HVWLPDWH WKH ODUJH QXPEHU RI PRGHUDWRUV 7KH WKLUG JURXS RI FRHIILFLHQWV ODEHOHG &ODVVURRP OHYHO LQWHUDFWLRQV ZLWK WUHDWPHQW FRUUHVSRQGV WR WKH VHW RI YDULDEOHV LQ HTXDWLRQ $  DERYH 7KH VHW RI WHDFKHU FKDUDFWHULVWLFV : LV DXJPHQWHG E\ D VHW RI LPSOHPHQWDWLRQ PHDVXUHV LQFOXGLQJ WKH DPRXQW RI WLPH SURGXFWV ZHUH XVHG ZKHWKHU WHDFKHUV KDG SUREOHPV JDLQLQJ DFFHVV WR FRPSXWHUV DQG ZKHWKHU FODVVHV KDG WHFKQLFDO GLIILFXOWLHV GXULQJ REVHUYDWLRQV 3RVLWLYH VLJQV RI WKH HVWLPDWHG FRHIILFLHQWV LQGLFDWH WKDW WKH SURGXFW HIIHFW ZDV ODUJHU ZKHQ WKH YDULDEOH KDG D ODUJHU YDOXH KROGLQJ RWKHU YDULDEOHV FRQVWDQW )RU H[DPSOH WKH SRVLWLYH FRHIILFLHQW IRU <HDUV RI 7HDFKLQJ ([SHULHQFH LQ WKH ILUVW FROXPQ PHDQV SURGXFW HIIHFWV ZHUH ODUJHU LQ ILUVW JUDGH WUHDWPHQW FODVVURRPV ZKHQ WHDFKHUV KDG PRUH \HDUV RI H[SHULHQFH 7KH ILIWK JURXS RI FRHIILFLHQWV ODEHOHG 6FKRRO OHYHO WUHDWPHQW HTXDWLRQ UHIHUV WR HTXDWLRQ $ DERYH 7KH VDPH VFKRRO YDULDEOHV HQWHUHG LQ WKH PDLQ PRGHO DUH HQWHUHG LQ WKLV HTXDWLRQ LI WKH HVWLPDWLRQ VXSSRUWV WKH IXOO VHW )RU WKH DOJHEUD VWXG\ WKH PRGHO ZDV QXPHULFDOO\ XQVWDEOH ZKHQ WKH IXOO VHW RI VFKRRO YDULDEOHV ZDV LQFOXGHG DQG RQO\ WZR YDULDEOHV ZHUH LQFOXGHG ' $VVHVVLQJ 5REXVWQHVV 7KH H[SHULPHQWDO GHVLJQ DQG WKH ORQJLWXGLQDO GDWD VWUXFWXUH VXSSRUW VHYHUDO LPSDFW HVWLPDWRUV 7KLV VHFWLRQ FRPSDUHV LPSDFW HVWLPDWRUV UDQJLQJ IURP VLPSOH RQHV WR WKH FRPSOH[ HVWLPDWRU SUHVHQWHG LQ WKH WH[W 'DWD IURP VRPH VFKRRO GLVWULFWV DOVR LQFOXGHG LQIRUPDWLRQ IURP GLVWULFW WHVWV :KHQ WKH VWXG\ ZDV DEOH WR GHWHUPLQH WKH WHVW SURSHUWLHV LW FDOFXODWHG HVWLPDWHV RI SURGXFW HIIHFWV EDVHG RQ WKHVH WHVWV 1RW DOO GLVWULFWV SURYLGHG WHVW

$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV


7DEOH%(VWLPDWHVRI0RGHUDWLQJ5HODWLRQVKLSV)URP+LHUDUFKLFDO/LQHDU0RGHO2XWFRPHLV6SULQJ7HVW 6FRUHZLWKVWDQGDUGHUURUV 9DULDEOH1DPH )LUVW*UDGH )RXUWK*UDGH 6L[WK*UDGH $OJHEUD 6WXGHQW/HYHO 6WXGHQWLVIHPDOH 6WXGHQWDJH )DOOWHVWVFRUHV &ODVVURRP/HYHO 7HDFKHULVIHPDOH <HDUVRIWHDFKLQJH[SHULHQFH 7HDFKHUKDVDPDVWHUVGHJUHH $QQXDOKRXUVRIRWKHUSURGXFWXVH KXQGUHGV &ODVVURRP/HYHO,QWHUDFWLRQVZLWK7UHDWPHQW $QQXDOKRXUVRIVWXG\SURGXFWXVH KXQGUHGV /RFDWLRQRISURGXFWXVH :KHWKHUWHDFKHUKDGDFFHVV 3UREOHPV :KHWKHUWHDFKHUKDGDGHTXDWHWLPH WRSUHSDUHWRXVHSURGXFW :KHWKHUVFKRROKDVDFRPSXWHU 6SHFLDOLVW <HDUVRIWHDFKLQJH[SHULHQFH
D

                   

                  

                 

                

:KHWKHUWHDFKHUKDGSURIHVVLRQDO GHYHORSPHQWODVW\HDURQWHFKQRORJ\ 7HDFKHULVIHPDOH 7HDFKHUKDVDPDVWHUVGHJUHH

                 

                 

              

              

$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV



7DEOH%

FRQWLQXHG

)LUVW*UDGH                            

9DULDEOH1DPH

)RXUWK*UDGH                            

6L[WK*UDGH                            

$OJHEUD                           

6FKRRO/HYHO ,QWHUFHSW 3HUFHQWRIVWXGHQWVHOLJLEOHIRUIUHHOXQFK 6WXGHQWWHDFKHUUDWLR 3HUFHQWRI%ODFNVWXGHQWV 3HUFHQWRI+LVSDQLFVWXGHQWV 3HUFHQWRIVWXGHQWVLQVSHFLDOHGXFDWLRQ 6FKRROLVLQXUEDQDUHD 6FKRRO/HYHO7UHDWPHQW(TXDWLRQ ,QWHUFHSW 3HUFHQWRIVWXGHQWVHOLJLEOHIRUIUHHOXQFK 6WXGHQWWHDFKHUUDWLR 3HUFHQWRI%ODFNVWXGHQWV 3HUFHQWRI+LVSDQLFVWXGHQWV 3HUFHQWRIVWXGHQWVLQVSHFLDOHGXFDWLRQ 6FKRROLVLQXUEDQDUHD 9DULDQFH&KDUDFWHULVWLFV 6WXGHQWOHYHO 7HDFKHUOHYHO 6FKRROOHYHO

  

  

  

)RU IDOO WHVW VFRUH VXEWHVW VFRUHV DUH HQWHUHG VHSDUDWHO\ )RU ILUVW JUDGH WKH IRXU IDOO VFRUHV DUH WKH WKUHH 6(6$7 VXEVFRUHVVRXQGVDQGOHWWHUVZRUGUHDGLQJDQGVHQWHQFHUHDGLQJDQGWKHWRWDOIDOO72:5(VFRUH)RUIRXUWKJUDGH WKHWKUHHVXEVFRUHVDUHHQWHUHGYRFDEXODU\ZRUGVWXG\VNLOOVDQGFRPSUHKHQVLRQ)RUVL[WKJUDGHWKHWZRVXEVFRUHV DUHHQWHUHGSURFHGXUHVDQGSUREOHPVROYLQJ)RUDOJHEUDWKHWRWDOIDOOVFRUHLVHQWHUHG

$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV

 VFRUH GDWD WKDW FRXOG VXSSRUW VHSDUDWH HVWLPDWHV HVSHFLDOO\ IRU ILUVW JUDGHUV WHVWLQJ ILUVW JUDGHUV LV UHODWLYHO\ XQFRPPRQ DQG KLJK VFKRRO VWXGHQWV GLVWULFWV WHVWLQJ GHSHQGV RQ VWXGHQW JUDGH OHYHOV 2WKHU (VWLPDWRUV 7DEOH % VKRZV HVWLPDWHV IRU RYHUDOO VFRUHV LQ WKH IRXU JUDGH OHYHOV IRU IRXU HVWLPDWRUV DQG WKH VWXG\V PDLQ HVWLPDWRU SUHVHQWHG LQ WKH WH[W 7KH ILUVW HVWLPDWRU WHUPHG WKH QDwYH GLIIHUHQFH LV WKH DYHUDJH VSULQJ VFRUH IRU VWXGHQWV LQ WUHDWPHQW FODVVURRPV PLQXV WKH DYHUDJH VSULQJ VFRUH IRU VWXGHQWV LQ FRQWURO FODVVURRPV 7KH HVWLPDWRU LV VWUDLJKWIRUZDUG WR FDOFXODWH DQG KDV DQ LQWXLWLYH LQWHUSUHWDWLRQ +RZHYHU LW GRHV QRW FRUUHFWO\ HVWLPDWH YDULDQFHV ZKHQ VWXGHQWV DUH QHVWHG LQ FODVVURRPV
7DEOH % $OWHUQDWLYH (VWLPDWRUV RI 3URGXFW (IIHFWV RQ 2YHUDOO 7HVW 6FRUH 6WDQGDUG (UURUV RI WKH (VWLPDWHG (IIHFWV LQ 3DUHQWKHVHV )LUVW *UDGH 6$7 5HDGLQJ 6FRUH 1&( (VWLPDWRU  1DwYH GLIIHUHQFH RI VWXGHQW DYHUDJH VFRUHV  'LIIHUHQFH RI FODVVURRP DYHUDJH VFRUHV                                         )RXUWK *UDGH 6$7 5HDGLQJ 6FRUH 1&( 6L[WK *UDGH 6$7 0DWK 6FRUH 1&(

$OJHEUD (76 $OJHEUD ([DP 3HUFHQW &RUUHFW

 'LIIHUHQFH RI FODVVURRP GLIIHUHQFHV

 5HSHDWHG FURVV VHFWLRQ +/0

 3DQHO +/0 UHSRUWHG LQ WH[W

6RXUFH $XWKRU FDOFXODWLRQV 2WKHU YDULDEOHV LQ WKH +/0 PRGHOV LQFOXGH VWXGHQW DJH JHQGHU DQG SUHWHVW VFRUHV IRU WKH SDQHO WHDFKHU JHQGHU H[SHULHQFH DQG ZKHWKHU WKH\ KDG D PDVWHUV GHJUHH FODVVURRP DYHUDJH SUHWHVW VFRUH IRU WKH FURVV VHFWLRQ VFKRRO UDFH DQG HWKQLFLW\ SHUFHQW RI VWXGHQWV LQ VSHFLDO HGXFDWLRQ DQG SHUFHQW HOLJLEOH IRU IUHH OXQFK DQG VWXGHQW FODVVURRP DQG VFKRRO UDQGRP HIIHFWV

$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV

 7KH VHFRQG HVWLPDWRU LV WKH GLIIHUHQFH EHWZHHQ WUHDWPHQW DQG FRQWURO FODVVURRPV RQ WKH VSULQJ WHVW VFRUH ZLWK VFRUH GLIIHUHQFHV ILUVW FDOFXODWHG IRU HDFK VFKRRO DQG WKH UHVXOWLQJ VFKRRO GLIIHUHQFHV WKHQ DYHUDJHG 7KH VWDQGDUG HUURU RI WKH DYHUDJH VFKRRO GLIIHUHQFH LV WKH HVWLPDWRU RI VDPSOLQJ YDULDQFH 7KH WKLUG HVWLPDWRU LV WKH SUHYLRXV HVWLPDWRU DGMXVWHG IRU WKH DYHUDJH FODVVURRP VFRUH RQ WKH IDOO WHVW 7KLV GLIIHUHQFHV RI GLIIHUHQFHV HVWLPDWRU DOORZV VWXGHQW PRELOLW\ WR UHODWH WR SURGXFW HIIHFWV ,Q SULQFLSOH IRU VFKRROV ZLWK KLJK PRELOLW\ WKH DYHUDJH VWXGHQW VKRXOG KDYH OHVV H[SRVXUH WR WKH SURGXFW EHFDXVH VRPH ZLOO QRW KDYH DWWHQGHG IRU WKH ZKROH \HDU 3RWHQWLDO SURGXFW HIIHFWV WKHUHE\ ZRXOG EH DWWHQXDWHG 7KH IRXUWK HVWLPDWRU LV IURP DQ +/0 LQ ZKLFK VSULQJ WHVW VFRUHV DUH D IXQFWLRQ RI IDOO WHVW VFRUHV DQG RWKHU FRYDULDWHV 7KH IDOO WHVW VFRUH LV HQWHUHG LQ WKH VHFRQG OHYHO DV WKH DYHUDJH IDOO VFRUH IRU WKH FODVVURRP LQ ZKLFK WKH VWXGHQW ZDV ORFDWHG LQ WKH VSULQJ %HFDXVH WKH PRGHO XVHV VWXGHQW WHVW VFRUHV LQ WKH VSULQJ DV WKH RXWFRPH EXW FODVVURRP DYHUDJH VFRUHV LQ WKH IDOO DV WKH EDVHOLQH LW GRHV QRW DVVXPH WKH VDPH VWXGHQWV DUH WHVWHG LQ WKH IDOO DQG VSULQJ DV GRHV WKH +/0 HVWLPDWRU LQ WKH WH[W 7KLV UHSHDWHG FURVV VHFWLRQV HVWLPDWRU LV D YDULDQW RI WKH GLIIHUHQFHV RI GLIIHUHQFHV HVWLPDWRU 7DEOH % VKRZV WKDW WKH HVWLPDWRU XVHG GRHV QRW DIIHFW WKH GLUHFWLRQ RI WKH PDLQ ILQGLQJV 5HJDUGOHVV RI WKH HVWLPDWRU SURGXFW HIIHFWV DUH VWDWLVWLFDOO\ LQVLJQLILFDQW DQG WKH SRLQW HVWLPDWHV DUH VPDOO 7KH PDJQLWXGHV RI WKH HVWLPDWHG HIIHFWV GLIIHU KRZHYHU ZLWK WKH GLIIHUHQFH RI FODVVURRP DYHUDJH SRVWWHVW VFRUHV JHQHUDOO\ EHLQJ WKH VPDOOHVW DQG WKH GLIIHUHQFH RI FODVVURRP GLIIHUHQFHV WKH SRVWWHVW PLQXV WKH SUHWHVW WKH ODUJHVW 7KH UHODWLRQVKLS RI WKH UHSHDWHG FURVV VHFWLRQ +/0 HVWLPDWRU DQG WKH +/0 HVWLPDWRU XVHG LQ WKH WH[W WKH SDQHO HVWLPDWRU GLG QRW DOZD\V KDYH WKH H[SHFWHG GLUHFWLRQ 7KH +/0 HVWLPDWRU LQ WKH WH[W LV EDVHG RQ VWXGHQWV ZKR FRPSOHWHG D IDOO WHVW DQG D VSULQJ WHVW WKH FURVV VHFWLRQ +/0 LV EDVHG RQ WKH ODUJHU JURXS RI VWXGHQWV ZKR FRPSOHWHG D VSULQJ WHVW %HFDXVH WKH FURVVVHFWLRQ VDPSOH LV OLNHO\ WR KDYH ORZHU DYHUDJH SURGXFW XVH HVWLPDWHV ZHUH H[SHFWHG WR EH VPDOOHU WKDQ WKH SDQHO HVWLPDWH WR WKH H[WHQW WKDW WKH SURGXFW XVH PDWWHUHG +RZHYHU IRU WKH ILUVW DQG IRXUWK JUDGH UHDGLQJ VWXGLHV DQG WKH DOJHEUD VWXG\ WKH FURVV VHFWLRQ HVWLPDWHV DSSHDU WR EH ODUJHU WKDQ WKH SDQHO HVWLPDWHV WKRXJK GLIIHUHQFHV ZHUH QRW WHVWHG IRU VWDWLVWLFDO VLJQLILFDQFH ,W LV GLIILFXOW WR GUDZ DQ\ FRQFOXVLRQV IURP VPDOO GLIIHUHQFHV EHWZHHQ VWDWLVWLFDOO\ LQVLJQLILFDQW HVWLPDWHV KRZHYHU 'LVWULFW 7HVWV DV WKH 2XWFRPH $QRWKHU DSSURDFK IRU DVVHVVLQJ UREXVWQHVV LV WR HVWLPDWH HIIHFWV XVLQJ GLVWULFW WHVWV WKDW WKH VWXG\ FROOHFWHG IURP UHFRUGV DQG FRPSDUH WKH UHVXOWV WR WKRVH XVLQJ WKH VWXG\V WHVWV 'LVWULFW WHVWV LW FRXOG EH DUJXHG PD\ EH PRUH VDOLHQW WR VFKRROV DQG WHDFKHUV WKDQ WKH VWXG\V WHVWV ZKLFK KDYH QR DFFRXQWDELOLW\ GLPHQVLRQ 'LVWULFW WHVWV DOVR DUH DGPLQLVWHUHG DV D IXOO EDWWHU\ DQG PD\ PHDVXUH UHDGLQJ RU PDWK PRUH UHOLDEO\ WKDQ WKH VKRUWHU WHVW XVHG E\ WKH VWXG\

$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV

 7ZR LPSRUWDQW FDYHDWV IRU WKLV FRPSDULVRQ UHODWH WR WHVW DYDLODELOLW\ DQG PRGHOLQJ VWUDWHJLHV 'LVWULFW WHVWV ZHUH QRW DYDLODEOH LQ DOO GLVWULFWV DQG LQ SDUWLFXODU ZHUH QRW DYDLODEOH IRU PDQ\ ILUVW JUDGHUV DQG KLJK VFKRRO VWXGHQWV EHFDXVH VWDQGDUGL]HG WHVWLQJ LV OHVV FRPPRQ LQ WKHVH JUDGHV $OVR FRQVHFXWLYH \HDU WHVWV DUH QRW DOZD\V DYDLODEOH WR DGMXVW IRU SUHWHVW OHYHOV DQG WHVWV WKHPVHOYHV VRPHWLPHV GLIIHU LQ FRQVHFXWLYH \HDUV 8VLQJ GLVWULFW WHVWV DOVR UHTXLUHG D GLIIHUHQW HVWLPDWLRQ DSSURDFK EHFDXVH UHVXOWV IRU HDFK GLVWULFW KDG WR EH HVWLPDWHG VHSDUDWHO\ +HUH D WZROHYHO KLHUDUFKLFDO PRGHO LV XVHG EHFDXVH WKH QXPEHU RI VFKRROV LQ DQ\ RQH GLVWULFW ZDV WRR VPDOO WR VXSSRUW D WKUHHOHYHO PRGHO 7DEOH % VKRZV WKH UHVXOWV RI WKH FRPSDULVRQ H[HUFLVH (VWLPDWHG HIIHFWV ZHUH FRQYHUWHG WR HIIHFW VL]HV XVLQJ WKH VWDQGDUG GHYLDWLRQ RI WKH FRQWURO JURXS VSULQJ WHVW VFRUH DQG WKH HIIHFW VL]HV ZHUH FRPSDUHG WR WKH VWXG\V UHVXOWV )RU  GLVWULFWV WKH VWXG\ ZDV DEOH WR REWDLQ D GLVWULFW WHVW WKDW VXSSRUWHG DQ HVWLPDWH RI SURGXFW HIIHFW VL]HV %HFDXVH VDPSOH VL]HV DUH VPDOOHU WKDQ WKH VWXG\V RYHUDOO VDPSOH VL]H LQ WKH JUDGH OHYHOV WKH IRFXV KHUH PRVWO\ LV RQ HIIHFW VL]HV UDWKHU WKDQ RQ VWDWLVWLFDO VLJQLILFDQFH 7KH UHVXOWV KDYH WKH VDPH VLJQ LQ  RI  GLVWULFWV 5HVXOWV LQ WKH IRXU GLVWULFWV WKDW GLIIHUHG LQ VLJQ VKRZHG D ODUJHU HIIHFW VL]H RQ WKH GLVWULFW WHVW LQ WZR GLVWULFWV DQG VPDOOHU HIIHFW VL]H LQ WZR GLVWULFWV )RU VRPH GLVWULFWV WKH HIIHFW VL]H LV ODUJHU IRU WKH VWXG\ WHVW DQG IRU VRPH GLVWULFWV LW LV ODUJHU IRU WKH GLVWULFW WHVW 2YHUDOO WKH VLPSOH DYHUDJH RI HIIHFW VL]HV XVLQJ GLVWULFW WHVWV LV  DQG WKH VLPSOH DYHUDJH RI HIIHFW VL]HV XVLQJ WKH VWXG\V WHVW LV VOLJKWO\ ODUJHU  7KH ILQGLQJV LQ 7DEOH % VXSSRUW WKH UREXVWQHVV RI WKH VWXG\V ILQGLQJV EDVHG RQ LWV WHVW 7KRXJK QRW FRQFOXVLYH HYLGHQFH EHFDXVH GLVWULFW WHVWV DUH DYDLODEOH IRU OHVV WKDQ KDOI WKH GLVWULFWV LQ WKH VWXG\ XVLQJ GLVWULFW WHVWV GR QRW \LHOG TXDOLWDWLYHO\ GLIIHUHQW ILQGLQJV DERXW SURGXFW HIIHFWV

$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV


7DEOH % &RPSDULVRQ RI (IIHFW 6L]HV %DVHG RQ 'LVWULFW 7HVWV DQG WKH 6WXG\ 7HVW

*UDGH )LUVW *UDGH $ % )RXUWK *UDGH & ' ( ) * + 6L[WK *UDGH , . / $OJHEUD 0 1

2XWFRPH 'LVWULFW 7HVW

2XWFRPH 6WXG\ 7HVW

             

             

$YHUDJH RI 0HDVXUHG (IIHFW 6L]HV





$SSHQGL[ % (VWLPDWLQJ (IIHFWV DQG $VVHVVLQJ 5REXVWQHVV