,EEE 4th International Conference on Knowledge-Based Engineering and Innovation (KBEI)

Dec. 22QG, 2017

,ran University of Science and Technology) – Tehran, Iran
I

$Q2YHUYLHZRQ([WUDFWLYH7H[W6XPPDUL]DWLRQ
6KRKUHK5DG5DKLPL $OL7RRIDQ]DGHK0R]KGHKL
'HSDUWPHQWRI&RPSXWHU(QJLQHHULQJ )DFXOW\RI&RPSXWHU(QJLQHHULQJ4D]YLQ%UDQFK
0DUOLN+LJKHU(GXFDWLRQ,QVWLWXWH ,VODPLF$]DG8QLYHUVLW\
1RZVKDKUH,UDQ 4D]YLQ,UDQ
6KRKUHKUDGUDKLPL#JPDLOFRP 0R]KGHKL#TLDXDFLU

0RKDPDG$EGRODKL
,UDQLDQ$FDGHPLF&HQWHUIRU(GXFDWLRQ&XOWXUHDQG5HVHDUFK$&(&5
0DVKKDG,UDQ
0DEGRODKL#\DKRRRP

Abstract² With the increasing of online information and
recourse texts, text summarization has become an essential and
more favorite domain to preserve and show the main purpose of
textual information. It is very difficult for human beings to
summarize manually large documents of text. Text
summarization is the process of automatically creating and
condensing form of a given document and preserving its
information content source into a shorter version with overall
meaning. Nowadays text summarization is one of the most
favorite research areas in natural language processing and could
attracted more attention of NLP researchers. There are also
much more close relationships between text mining and text
summarization. According to difference requirements summary
with respect to input text, established summarization systems
should be created and classified based on the type of input text.
In this study, at first, the topic of text mining and its relationship
with text summarization are considered. Then a review has been
done on some of the summarization approaches and their
important parameters for extracting predominant sentences,
identified the main stages of the summarizing process, and the
most significant extraction criteria are presented. Finally, the
most fundamental proposed evaluation methods are considered.
VXPPDUL]DWLRQ ILHOG DQG WKHUH LV D ODUJH JDS WR DFKLHYH DQ
HIILFLHQW V\VWHP WKDW FDQ DFWV OLNH D KXPDQ DJHQW 3UREOHPV
RXWOLQHG LQ WKH 3HUVLDQ ODQJXDJH DUH IDU PRUH WKDQ RWKHU
ODQJXDJHV 7KH FRPSOH[LW\ RI ODQJXDJH DQG ODFN RI SUHFLVLRQ
WRROV DUH FXUUHQW SUREOHPV IDFLQJ WKH 3HUVLDQ ODQJXDJH
SURFHVVLQJ7KHUHIRUHWKHUHYLHZRIRSHUDWLRQVDQGSURFHGXUHV
SHUIRUPHG RQ RWKHU ODQJXDJHV FRQVLGHULQJ WKH VHPDQWLF ILHOG
DQG XVH WKH VHPDQWLF UHODWLRQVKLS XVLQJ WRROV VXFK DV JUDSK
WKHRU\ VWDWLVWLFDO PHWKRGV IX]]\ ORJLF DQG GDWD PLQLQJ
WHFKQLTXHV FDQ PDNH D VLJQLILFDQW FRQWULEXWLRQ WR 3HUVLDQ
ODQJXDJHSURFHVVLQJ
$WH[WPDGHXSRIFRPSRQHQWVVXFKDVZRUGVSKUDVHVDQG
VHQWHQFHV FRQQHFWHG FRPSOHWHO\ DQG PHDQLQJIXOO\ WRJHWKHU
2QH RI WKH PDLQ DUHDV RI QDWXUDO ODQJXDJH SURFHVVLQJ LV WH[W
PLQLQJ ZKLFK PHDQV GLVFRYHU DQG H[WUDFW QHZ LQIRUPDWLRQ
IURPWKHGRFXPHQWV7H[WPLQLQJLVDQDO\VLVWKHGRFXPHQWVWR
H[WUDFW YDOXDEOH KLGGHQ SDWWHUQV IURP WKH WH[W ,W LV DOVR
LQYROYHV WKH GHWHFWLRQ RI WKH FRQQHFWLRQ EHWZHHQ ZRUGV DQG
VHQWHQFHVFODVVLI\ DQG VXPPDUL]H WH[WV7KH PDLQSURSRVH LQ
WKLVUHVHDUFKLVDQRYHUYLHZRQWH[WVXPPDUL]DWLRQ
0RUHWKDQKDOIDFHQWXU\SDVVHGVLQFHWKHILUVWUHVHDUFKRQ
Keywords— Text summarization; Text mining; Fuzzy text
summarization; Statistical text summarization; Text clustering.
, ,1752'8&7,21
:LWK DQ LQFUHDVLQJ DPRXQW RI GDWD DYDLODEOH RQ WKH ZHE
ULVLQJ RI QHZV ZHEVLWHV SXEOLFDWLRQ RI YDULRXV HOHFWURQLF
ERRNV DQG D VLJQLILFDQW JURZWK LQ WKH QXPEHU RI SXEOLVKHG
DUWLFOHVLQGLIIHUHQWILHOGVRIVWXG\RQHRIWKHPDLQFKDOOHQJHV
IRU UHVHDUFKHUV RI VW FHQWXU\ KDV EHHQ WKDW RI DFFHVVLQJ
DFFXUDWH DQG UHOLDEOH GDWD 7KH ZLGHVSUHDG YROXPH RI
LQIRUPDWLRQ DYDLODEOH RQ RQH KDQG DQG WLPH OLPLWDWLRQ RQ WKH
RWKHU KDV GLUHFWHG WKH UHVHDUFKHUV WR WKH LQWHUHVWLQJ DUHD RI
VXPPDUL]LQJ WH[WV DQG SRZHUIXO V\VWHP WR VXPPDUL]H
GRFXPHQWV *LYHQ WKDW PXFK UHVHDUFKHV SDSHU KDV EHHQ GRQH
RQ WKH VXPPDUL]DWLRQ VXEMHFW DQG PDQ\ DUWLFOHV KDYH EHHQ
WKH DXWRPDWLF WH[W VXPPDUL]DWLRQ  6WXG\LQJ RQ WH[W
VXPPDUL]DWLRQ V\VWHPV HPHUJHG LQ ெV ZKLFK IRFXVHG RQ
WKHVRPHEDVLFIHDWXUHVRIWKHWH[WVXFKDVWKHSRVLWLRQRIWKH
VHQWHQFHV LQ WKH WH[W GXH WR ODFN RI SRZHUIXO FRPSXWHUV DQG
RWKHUSUREOHPVLQQDWXUDOODQJXDJHSURFHVVLQJ6LQFHWKHQDORW
RIPHWKRGVZLWKSRZHUIXOWRROVZHUHSUHVHQWHGWRVLPXODWHWH[W
SURFHVVLQJVXFKDVKXPDQEUDLQ
,, $5(9,(:2)7(;70,1,1*$1',765(/$7,216+,3:,7+
$7(;76800$5,=$7,21
$ VLJQLILFDQW SRUWLRQ RI DYDLODEOH LQIRUPDWLRQ LV VWRUHG LQ
WH[WGDWD7H[WGDWDEDVHVDUHJURZLQJUDSLGO\GXHWRLQFUHDVLQJ
WKHDPRXQWRILQIRUPDWLRQLQHOHFWURQLFIRUP7RGD\ PRVWRI
WKH GDWD DYDLODEOH LQ WKH LQGXVWU\ EXVLQHVV DQG RWKHU
SXEOLVKHG DERXW LW %XW WKHUH LV VWLOO D ORW RI ZHDNQHVV LQ RUJDQL]DWLRQVDUHVWRUHGLQWKHIRUPRIWH[WGDWDEDVH

‹,(((
0054
 7H[W PLQLQJ LV D UHVHDUFK ILHOG WKDW KDV HPHUJHG IURP WKH
FRPELQDWLRQ RI VHYHUDO RWKHU UHVHDUFK DUHDV VXFK DV GDWD
PLQLQJQDWXUDOODQJXDJHSURFHVVLQJDQGLQIRUPDWLRQUHWULHYDO
%XW WKHUH DUH VRPH GLIIHUHQFHV EHWZHHQ GDWD PLQLQJ DQG WH[W
PLQLQJ
'DWD PLQLQJ RIWHQ GHDOV ZLWK VWUXFWXUHG GDWD EXW WH[W
PLQLQJLQYROYHGZLWKXQVWUXFWXUHGRUVHPLVWUXFWXUHGGDWD2Q
WKH RWKHU KDQG HYHQ LI WKHUH LV VWLOO VRPH FRQVWUXFWLRQ LQ WKH
WH[W WKHUH LV DQRWKHU UHDVRQ WKDW WH[W PLQLQJ LV PXFK PRUH
GLIILFXOWWKDQGDWDPLQLQJ8QOLNHRWKHUGDWDVXFKDVQXPHULFDO
GDWD WKHUH DUH VRPH VHPDQWLF FRQFHSWV LQ WH[W DQG LW FDQ EH
GLIILFXOW WR PRGHO WKHP ZLWK WUDGLWLRQDO NQRZOHGJH VWUXFWXUHV
)RU H[DPSOH WKHUH DUH VRPH GLIILFXOWLHV VXFK DV ZRUGV ZLWK
VDPH PHDQLQJ DQG GLIIHUHQW GLFWDWLRQ DQG GLIIHUHQW PHDQLQJ
ZLWKVDPHGLFWDWLRQ
A. Text mining applications
7KHUHLVDZLGHGHILQLWLRQRIWH[WPLQLQJ$VDUHVXOWWKHUH
DUH GLIIHUHQW WKHRULHV DERXW LWV DSSOLFDWLRQV 7H[W PLQLQJ LV D
QHZILHOGLQ1/3EXWLWVVRIWZDUHDQDO\]HVKDYHEHHQDYDLODEOH
VLQFHODWH$PRQJWKHPRVWFRPPRQDSSOLFDWLRQVRIWH[W
PLQLQJ FDQ EH QRWHG WR WKH VHDUFK HQJLQHV7KH\ FDQ ILQGWKH
PRVW UHOHYDQW GRFXPHQWV ZKHWKHU WKH XVHU W\SHV D PLVVSHOOHG
ZRUGRUSKUDVH6RPHRWKHUDSSOLFDWLRQVRIWH[WPLQLQJWKDWFDQ
EHPHQWLRQHGDUH
Spam identification: $QDO\]LQJ WKH WLWOH DQG FRQWHQW RI
HPDLOWRGHWHUPLQHZKHWKHULWLVVSDP
Supervision:0RQLWRULQJWKHEHKDYLRURIDSHUVRQRUJURXS
RISHRSOH7KHUHDUHVRPHVRIWZDUHWKDWFDQGHWHFWDQGFRQWURO
SHRSOH EHKDYLRU IURP WHOHSKRQH LQWHUQHW DQG RWKHU
FRPPXQLFDWLRQGHYLFHV
Aliases identification
Case Folding: $W WKLV VWDJH DOO ZRUGV ZLWK ELJ DQG VPDOO
OHWWHUV FDPH LQ D XQLIRUP $OVR DOZD\V WU\ WR FRQYHUWHG
XSSHUFDVHOHWWHUWRORZHUFDVH
Stemming: 7KLV VWDJH LW URRW H[WUDFWLRQ RI ZRUGV ZLWKRXW
FRQVLGHULQJ GLIIHUHQW VFHQDULRV VXFK DV VLQJXODU RU SOXUDO WKH
WLPH DQG DOO SUHIL[ DQG VXIIL[ 7KLV UHTXLUHV NQRZOHGJH RI D
SDUWLFXODU ODQJXDJH DQG PDQ\ DOJRULWKPV KDYH EHHQ SURSRVHG
IRU HDFK ODQJXDJH ([DPSOHV RI WKHVH W\SHV RI ZRUGV LQ WKH
(QJOLVK ODQJXDJH FDQ EH FRPSUHVVHG DQG FRPSUHVVLRQ WKDW
FRQYHUWWRFRPSUHVV
Stop Words: 6RPH IUHTXHQW ZRUGV ZLWKRXW FRQFHSW
([DPSOHVRIWKHVHW\SHVRIZRUGVLQWKH(QJOLVKODQJXDJHVXFK
DVGRGRHVZLOODQGVRRQ
N-grams:1JUDPVDUHDVXEVHWRI1ZRUGVFRPHWRJHWKHU
7KH\VKRXOGEHSURWHFWHGEXWLWLVEHWWHUWRFRPHLQWKHIRUPRI
XQLIRUP
Tokenization: 7RNHQL]DWLRQ LV D GLYLGLQJ WKH WH[W WR
VPDOOHU XQLWV ZKLFK DUH RIWHQ ZRUGV %XW LQ VRPH FDVHV LW LV
GLIILFXOWWRGHILQHWKHZRUGDQGLWVVFRSH$ZRUGDVDXQLWRI
WH[WKDVWKHIROORZLQJSURSHUWLHV
x (DFK VHW RI FRQWLQXRXV FKDUDFWHUV LV DOZD\V D
ZRUG7KHVHFKDUDFWHUVFDQHYHQILJXUHDVZHOO
x 5DQJH RI D ZRUG FDQ EH D ZKLWHVSDFH FKDUDFWHU
V\PEROVRUHQGRIWKHOLQH
x 6RPHWLPHVZKLWHVSDFHFKDUDFWHUVDQGSXQFWXDWLRQ
LVQRWUDQJHZRUGRUWRNHQ
,Q ODQJXDJHV VXFK DV (QJOLVK DQG 3HUVLDQ WKDW ZRUGV
VHSDUDWHGZLWKZKLWHVSDFHGHILQLQJWKHERXQGDU\ZRUGVLVQRW
DOZD\V DQ HDV\ WDVN )RU H[DPSOH DFURQ\PV WKDW KDV SRLQW
ZRUGVLQK\SHUWH[WOLQNVDQGWKHZRUGVWKDWDUHVHSDUDWHGZLWK
V\PEROLFFKDUDFWHUVDQGZRUGV ZLWKVSDFHFKDUDFWHUOLNH1HZ
Concepts relationship: 2FFXUUHQFH RI VRPH ZRUGV
GHSHQGHQWRQVRPHRWKHUZRUGV
Search and Retrieval
Classification and clustering data
Text summarization
7KHUH DUH VRPH ELJ SUREOHPV LQ WH[W PLQLQJ $ ELJJHVW
SUREOHP LV WKDW DQ\ GRFXPHQW LV D YHU\ ODUJH VHWRI ZRUGV ,I
DQ\ ZRUG LV DVVXPHG DQ HOHPHQW RI D YHFWRU DQG FRQVLGHUV
GLIIHUHQWSUHVHQFHVFHQDULRVLQWKHWH[WWKHQ ZH ZLOOILQGWKDW
ZHDUHGHDOLQJZLWKD13+DUGSUREOHPZLWKKLJKGLPHQVLRQDO
DUHD :RUG UHGXFWLRQ LV RQH RI WKH SUHSURFHVVLQJ RSHUDWLRQV
WKDWOHDGWRUHGXFHWKHGLPHQVLRQRIWKHSUREOHP3UHSURFHVVLQJ
DQG ZRUG UHGXFWLRQ VKRXOG EH VR HIILFLHQW DQG SRZHUIXO
EHFDXVH HOLPLQDWLQJ ZRUGV PD\ EH OHDG WR VRPH WH[W QRLVHV
VXFKDVJUDPPDWLFDOHUURU$SDUWIURPUHGXFLQJWKHVL]HRIWKH
WH[WSURFHVVLQJFRQVLVWVRIVRPHRWKHUVWHSVDVIROORZV
0055
<RUN
2QH RI WKH LPSRUWDQW IXQFWLRQV RI WKH WH[W PLQLQJ LV WH[W
FOXVWHULQJ 7KH PDLQ DLP RI WH[W FOXVWHULQJ LV WR SODFH WKH
VLPLODUVHQWHQFHVLQVDPHFOXVWHUV7KHQXPEHURIFOXVWHUVFDQ
EH GHWHUPLQHG E\ WKH XVHU RU DXWRPDWLFDOO\ E\ WKH SURJUDP
7KH ILUVW VWHS RI WH[W FOXVWHULQJ LV GLYLGLQJ WKH WH[W WR LWV
FRPSRQHQWDQGVHSDUDWHGWKHVHQWHQFHV
B. Text mining and text summarization
,WLVREYLRXVO\ WKDWLWFDQQRWEH VHSDUDWHG WH[W PLQLQJ DQG
WH[WVXPPDUL]DWLRQ6HYHUDOVWXGLHVKDYHEHHQFRQGXFWHGLQWKH
ILHOGRIWH[WPLQLQJDQGWH[WVXPPDUL]DWLRQ$OORIWKHPVKRZ
WKDW WKH WH[W VXPPDUL]DWLRQ LV DOVR NLQG RI PLQLQJ DQG
H[SORULQJWRILQGWKHLPSRUWDQWSDUWVRIDGRFXPHQW7KHPDLQ
SUREOHPVIDFLQJWRWH[WSURFHVVLQJDQGVXPPDUL]LQJDUHODFNRI
TXDOLILHG OLQJXLVW H[SHUW ZRUN ZLWK SURJUDPPHUV JUDPPDU
EDVHG RI OLQJXLVWLF WKHRULHV DQG WKH ODFN RI UHDVRQLQJ DQG
WKLQNLQJZRUGSURFHVVRUVPDFKLQHV
 7KH ILUVW SUREOHP FDQ EH RYHUFRPH ZLWK HPSOR\LQJ
OLQJXLVWLF H[SHUW 7KH VHFRQG SUREOHP DFFRUGLQJ WR WKH
VHPDQWLFV FDQ EH UHVROYHG E\ UHYLVLQJ WKH ODQJXDJH WKHRULHV
%XW LW LV GLIILFXOW WR FUHDWH PDFKLQHV ZLWK UHDVRQLQJ DQG
WKLQNLQJSRZHU
2Q WKH RWKHU KDQG GHDOLQJ ZLWK KLJK YROXPH GDWD RQ
LQWHUQHW HVSHFLDOO\ ZKHQ WKH JRDO XQGHUVWDQGV WKH PDLQ
FRQFHSWRIGRFXPHQWVXVLQJ PDFKLQHVLQVWHDGRIKXPDQVFDQ
EHHDVLHUIDVWHUDQGPRUHUHDVRQDEOH
$W WKH EHJLQQLQJ FRQVLGHU WKH GLIIHUHQW YLHZV RQ WKH
DXWRPDWLF WH[W VXPPDUL]DWLRQ DQG WKH VXPPDULHV FUHDWHG E\
WKH PDQ 7KHUH DUH WKUHH PDLQ YLHZV WKDW DUH QR GLIIHUHQFHV
EHWZHHQ KXPDQ DQG PDFKLQH VXPPDU\ SUHIHUHQFH RI KXPDQ
VXPPDU\ RQ PDFKLQH VXPPDU\ DQG SUHIHUHQFH RI PDFKLQH
VXPPDU\RQKXPDQVXPPDU\
7KH WKHRU\ RI WKH VXSHULRULW\ RI SURFHVVLQJ DQG
VXPPDUL]LQJ PDQ EHOLHYHV WKDW KXPDQ PLQG PRUH SRZHUIXO
WKDQPDFKLQHSURFHVVRU'HFLVLRQPDNLQJSRZHUDQGFKRLFHRI
FXUUHQWPDFKLQHVDUHOHVVWKDQKXPDQPLQG7KHWKHRU\RIWKH
VXSHULRULW\ RI PDFKLQH SURFHVVLQJ DQG VXPPDUL]LQJ EHOLHYHV
WKDW LQ WKH QHDU IXWXUH FRPSXWHUV FDQ SURFHVV WKH OLQJXLVWLF
LQIRUPDWLRQ ZLWK PRUH VSHHG DQG DFFXUDF\ WKDQ KXPDQ 7KH
UHDVRQIRUWKLVFODLPLVWKHPRUHTXLFNO\RSHUDWLRQRIPDWKDQG
PDFKLQHU\FRPSXWLQJWKDQDKXPDQ
7KHUH DUH WKUHH PDMRU DGYDQWDJHV RI DXWRPDWLF JHQHUDWLRQ
RI VXPPDU\ E\ WKH PDFKLQHV 7KH DGYDQWDJHV DUH VXPPDU\
VL]H LV FRQWUROODEOH LWV FRQWHQW LV SUHGLFWDEOH DQG LW FDQ EH
GHWHUPLQHGWKDWDQ\SDUWRIWKHVXPPDU\UHODWHGWRZKLFKSDUW
RIWKHRULJLQDOWH[W
,,, ',))(5(17&5,7(5,$,17+(7(;76800$5,=$7,21
6<67(06'(6,*1,1*
7KHUHDUHYDULRXVDSSURDFKHVWRWH[WVXPPDUL]DWLRQVRPH
RI ZKLFK KDYH EHHQ H[WDQW IRU DERXW  \HDUV 7H[W
V
VXPPDUL]DWLRQDSSURDFKHVFDQEHFDWHJRUL]HGLQGLIIHUHQWZD\V
DFFRUGLQJ WR WKH YDULRXV PHDVXUHV DQG IHDWXUHV )RU H[DPSOH
DFFRUGLQJWR+RY\DQG/LQ>@WKHPHDVXUHVDQGIHDWXUHVDUH
UHODWHGWRLQSXWRXWSXWSXUSRVHDQGUHVXOWLQGLIIHUHQWW\SHVRI
VXPPDU\ ,Q WKH IROORZLQJ YDULRXV PHWKRGV KDYH EHHQ
WRXVHWH[WSKUDVHV(DFKDEVWUDFWLYHVXPPDUL]DWLRQFRQVLVWVRI
FRPSUHKHQVLRQ SDUW WR LQWHUSUHW WKH WH[W DQG ILQG WKH QHZ
FRQFHSWVDQGSURGXFWLRQSDUWWRJHQHUDWHQHZVKRUWHUWH[WZLWK
PRVWLPSRUWDQWLQIRUPDWLRQIURPWKHRULJLQDOGRFXPHQW,QWKLV
PHWKRG VHQWHQFHV FRXOG EH RPLWWHG RU FKDQJHG RU HYHQ QHZ
VHQWHQFHV FRXOG EH JHQHUDWHG ,W VKRXOG EH QRWHG WKDW WKLV
PHWKRG LV YHU\ FRPSOLFDWHG DQG HYHQ PRUH FRPSOLFDWHG WKDQ
PDFKLQHWUDQVODWLRQ
B. Summarization based on details
7H[W 6XPPDUL]DWLRQ PHWKRGV DOVR FDQ EH FODVVLILHG LQWR
DQRWKHU FODVVHV QDPHG ,QGLFDWLYH DQG ,QIRUPDWLYH
VXPPDUL]DWLRQ,QLQGLFDWLYHVXPPDU\WKHPDLQLGHDRIWKHWH[W
LV SUHVHQWHG DQG LW LV XVXDOO\ DERXW  WR  SHUFHQW RI WKH
RULJLQDOWH[W7KLVNLQGRIDEVWUDFWLRQLVXVHGWRHQFRXUDJHWKH
UHDGHUWRUHDGWKHRULJLQDOWH[W)RUH[DPSOHDEULHIVXPPDU\RI
DPRYLHRUDVWRU\LQWKHFRQWH[WRILWVDGYHUWLVLQJZKLFKRQO\
OHDGV WR IXUWKHU TXHVWLRQV DQG HQFRXUDJH WKH UHDGHUV WR ZDWFK
WKHILOPDQGUHDGWKHVWRU\,QIRUPDWLYHVXPPDU\FRQVLVWRIWKH
PDLQDEVWUDFWLRQDQGWKHLPSRUWDQWLVVXHVRIWKHWH[W7KLVNLQG
RIVXPPDU\LVEHWZHHQDQGSHUFHQWRIWKHRULJLQDOWH[W
DQGFRQWDLQVDOOWKHPDLQSRLQWVRIWKHWH[W
C. Summarization based on contents
$QRWKHUFODVVLILFDWLRQLQWH[WVXPPDUL]DWLRQLVFRQWHQWEDVH
FODVVHV 7KLV W\SH RI FODVVLILFDWLRQ FDQ EH GLYLGHG LQWR WZR
FDWHJRULHV *HQHULF DQG 4XHU\%DVHG *HQHULF VXPPDUL]DWLRQ
LV QRW GHSHQGHG RQ WRSLF RI WH[W DQG LW LV DVVXPHG WKDW WKH
UHDGHU GRHV QRW KDYH DQ\ EDVLF NQRZOHGJH DERXW WKH WH[W
*HQHULFVXPPDU\FRQWDLQVDOODVSHFWVDQGLPSRUWDQWLVVXHVRI
PDLQ WH[W DQG UHDGHUV DUH DEOH WR DFKLHYH D WKRURXJK
XQGHUVWDQGLQJ RI WKH VXEMHFW ZLWKRXW SULRU NQRZOHGJH RI WKH
WH[W
%XWLQ4XHU\%DVHGVXPPDU\LWLVDVVXPHGWKDWWKHUHDGHU
KDV D JHQHUDO NQRZOHGJH DERXW WKH WRSLF DQG MXVW ORRNLQJ IRU
VSHFLILFLQIRUPDWLRQLQWKHWH[W,QWKLVFDVHEDVHGRQWKHXVHU
TXHVWLRQ D UHODWHG VXPPDU\ LV FUHDWHG 0RVW RI WKHVH
VXPPDUL]DWLRQV\VWHPVDUHH[WUDFWLYH
D. Summarization based on limitation
FRQVLGHUHGLQJHQHUDOFODVVLILFDWLRQ
A. Summarization based on output summary
7H[W 6XPPDUL]DWLRQ PHWKRGV FDQ EH FODVVLILHG LQWR
H[WUDFWLYH DQG DEVWUDFWLYH VXPPDUL]DWLRQ $Q H[WUDFWLYH
VXPPDUL]DWLRQ PHWKRG FRQVLVWV RI VHOHFWLQJ LPSRUWDQW
VHQWHQFHV RU SDUDJUDSKV IURP WKH RULJLQDO WH[W DQG JDWKHULQJ
WKHPLQWRVKRUWHUWH[W7KHLPSRUWDQFHRIVHQWHQFHVLVGHFLGHG
EDVHG RQ VRPH VWDWLVWLFDO DQG OLQJXLVWLF IHDWXUHV RI VHQWHQFHV
H[WUDFW DQG SODFHG LQ WKH RXWSXW WH[W ,Q WKLV SDSHU WKH PRUH
HPSKDVLVLVRQH[WUDFWLRQWHFKQLTXHV
$QDEVWUDFWLYHVXPPDUL]DWLRQDWWHPSWVWRH[WUDFWWKHPDLQ
FRQFHSWRIWKHWH[WLQFOHDUQDWXUDOODQJXDJHZLWKRXWQHFHVVLW\
0056
7KHUHLVDQRWKHUFDWHJRU\EDVHGRQWKHOLPLWDWLRQVRILQSXW
WH[W7KHPHQWLRQHGJURXSKDVWKUHHFDWHJRULHVWKDWZKLFKDUH
,QGHSHQGHQW'RPDLQGHSHQGHQWDQG*HQUHVSHFLILF
,QGHSHQGHQW VXPPDUL]DWLRQ LV VRPHWKLQJ OLNH JHQHULF
VXPPDU\ DFFHSWHG HYHU\ WH[W RI HDFK ILHOG DQG JHQHUDWH D
JHQHUDOVXPPDU\UHJDUGOHVVRIWKHWH[WVFRSHRUW\SH
'RPDLQ GHSHQGHQW VXPPDUL]DWLRQ DFFHSWV WH[WV ZLWK
VSHFLILF ILHOG RI OLWHUDWXUH DQG W\SH 7KHUH DUH PDQ\ VSHFLILF
WH[W SDWWHUQV VXFK DV 1HZV VFLHQFH WH[W ILFWLRQ VSRUWV
*HQHUDWHG VXPPDU\ RI GRPDLQ GHSHQGHQW V\VWHPV DUH
DFFRUGLQJWRWKHLQSXWWH[WW\SH*HQUHVSHFLILFVXPPDUL]DWLRQ
LVWU\LQJWRVXPPDU\PXFKPRUHVSHFLDOL]HGILHOG7KLVJURXS
FDQ EH DEVWUDFW VSHFLILF OLWHUDWXUH VXFK DV VSRUWV QHZV WH[WV
UHODWHGWRWKHILHOGRIJHRJUDSK\SROLWLFDO1HZVDQGHWF
E. Summarization based on the number of input texts
$XWRPDWLFVXPPDUL]DWLRQV\VWHPVFDQEHGLYLGHGRWKHUWZR
WKHPDUHLQWHQGHGDVWKHILQDOZHLJKWRIHDFKVHQWHQFH)LQDOO\
VHQWHQFHVZLWKWKHPD[LPXPZHLJKWEDVHGRQFRPSUHVVLRQUDWH
DUHH[WUDFWHGDQGE\RUGHULQJSUHVHQFHLQPDLQWH[WWUDQVIHUUHG
WRWKHVXPPDU\*LYHQWKDWVRPHPHQWLRQHGSDUDPHWHUVUHGXFH
WKH LPSRUWDQFH RI D VHQWHQFH WKHLU YDOXH LV FDOFXODWHG DV D
PDLQ FDWHJRULHV EDVHG RQ WKHLU LQSXW WH[W 7KH PHQWLRQHG
FDWHJRULHV DUH 6LQJOH GRFXPHQW DQG 0XOWL GRFXPHQW
VXPPDUL]DWLRQ 7KH LQSXW RI VLQJOHGRFXPHQW VXPPDUL]DWLRQ
V\VWHPV LV RQO\ RQH WH[W EXW PXOWLGRFXPHQW VXPPDUL]DWLRQ
ZKLFKLVYHU\SRSXODUWKHVHGD\VLVWKHLPSURYHPHQWRIVLQJOH
 LGI
GRFXPHQW VXPPDUL]DWLRQ WR FROOHFWLRQV RI UHODWHG GRFXPHQWV
7KH PDLQ SURSRVH RI PXOWLGRFXPHQW VXPPDUL]DWLRQ LV
VXPPDUL]LQJ WH[WV DQG UHPRYLQJ UHGXQGDQF\ DQG FRQVLGHULQJ
WKH VLPLODULWLHV DQG GLIIHUHQFHV LQ WKH LQIRUPDWLRQ FRQWHQW RI
GLIIHUHQW GRFXPHQWV 0XOWL GRFXPHQW WH[W VXPPDUL]DWLRQ
DFFHSWVPXOWLSOHGRFXPHQWVZLWKFRPPRQVFRSHLQDGLIIHUHQW
SHUVSHFWLYHDQGFORVHO\WLHGWRDQVZHULQJV\VWHPVDQGVHDUFK
QHJDWLYH  6RPH RI 7KH SDUDPHWHUV DQG IHDWXUHV DUH
GHVFULEHGEHORZ
A. Content keyword feature
.H\ZRUGV DUH RIWHQ QRXQ DQG GHWHUPLQHG E\ WI
FULWHULD6HQWHQFHVFRQWDLQLQJNH\ZRUGVKDYHPRUHFKDQFHVWR
H[SRVXUH LQ VXPPDUL]HG RXWSXW 2WKHU PHWKRGV KDYH EHHQ
SURSRVHGIRUH[WUDFWLQJNH\ZRUGV6RPHRIWKHVHPHWKRGVDUH
ZRUG DQDO\VLV RI PRUSKRORJLFDO VWDWHPHQWV H[WUDFWLRQ DQG
VFRULQJ WKHP DQG QRXQ SKUDVHV H[WUDFWLRQ FOXVWHULQJ DQG
UDQNLQJWKHP:RUGPRUSKRORJLFDODQDO\VLVSOD\VDQLPSRUWDQW
UROH LQ QDWXUDO ODQJXDJH SURFHVVLQJ DQG KHOSV WR UHVROYH WKH
EDVHG VXPPDUL]DWLRQ  7KHUH DUH WZR PDMRU DSSURDFKHV WR
VXPPDUL]H PXOWLSOH GRFXPHQWV 7KH ILUVW DSSURDFK XVHV WKH
XVXDO PHWKRGV RI VLQJOH GRFXPHQW VXPPDUL]DWLRQ DQG
VXPPDUL]HVHDFKGRFXPHQWVHSDUDWHO\7KHQFRPELQLQJDOORI
WKH VXPPDULHV WRJHWKHU DQG WULHG WR UHPRYH UHGXQGDQF\ E\
RYHUODSVLPLODUVHQWHQFHVWRSURGXFHWKHILQDOVXPPDU\7KHUH
DUH VRPH SURSRVHG PHWKRGV WRR ZKLFK EHKDYH FUHDWHG VLQJOH
VXPPDUL]H DV LQSXWV DQG WKHQ PHUJH WKHP WR FUHDWH PDLQ
DPELJXLW\ LQ WKH ZRUGV 7KH PHQWLRQHG FULWHULD VWXG\ RI URRW
ZRUGVSUHIL[HVDQGVXIIL[HVDWWDFKHGWRDZRUG
B. Similarity of sentence and title of document
6LPLODULW\RIVHQWHQFHDQGWLWOHRIGRFXPHQWLVWKHQXPEHU
RI FRPPRQ ZRUGV EHWZHHQ WLWOH DQG VHQWHQFH  6HQWHQFHV
LQFOXGLQJWLWOHZRUGVKDYHKLJKLPSRUWDQFHDQGPRUHFKDQFHWR
SODFHLQRXWSXWVXPPDU\,QPRVWRIWKHSURSRVHGPHWKRGVWKH
VXPPDU\ FULWHULDLVFDOFXODWHGDV(T
7KH VHFRQG DSSURDFK LV VSHFLILFDOO\ GHVLJQHG IRU PXOWLSOH
GRFXPHQWV ,Q WKH PHQWLRQHG DSSURDFKHV DOO GRFXPHQWV ;L _6Lŀ7_    
DVVXPHV DV RQH GRFXPHQW DQG DOO WKH LPSRUWDQW VHQWHQFHVDUH
H[WUDFWHG IURP DOO RI WKH GRFXPHQWV WRJHWKHU XVLQJ PHWKRGV
OLNH JUDSKV RU FOXVWHULQJ 7KLV DSSURDFK LV PRUH FKDOOHQJLQJ
LQWHOOLJHQW DQG FRPSOLFDWHG $Q H[DPSOH RI WKH VHFRQG
DSSURDFK LV WKH 6800216 V\VWHP ZKLFK H[WUDFWV DQG
FRPELQHV LQIRUPDWLRQ IURP PXOWLSOH VRXUFHV DQG SDVVHV WKHP
WR D ODQJXDJH JHQHUDWLRQ FRPSRQHQW DQG SURGXFHV WKH ILQDO
VXPPDU\ ,Q JHQHUDO WKH FRPSOH[LW\ RI D VLQJOH GRFXPHQW
,Q(TWKHQXPHUDWRULVWKHQXPEHURIVLPLODUVHQWHQFH
DQG WLWOH ZRUGV DQG WKH GHQRPLQDWRU LV WKH VTXDUH URRW RI WKH
SURGXFWRIWKHWLWOHOHQJWKDQGVHQWHQFHOHQJWK
C. Sentence location in the document
7KLV PHDVXUH LV EDVHG RQ WKH DVVXPSWLRQ WKDW VHQWHQFHV
RFFXUULQJLQLQLWLDODQGHQGSRVLWLRQRIERWKWH[WDQGLQGLYLGXDO
SDUDJUDSKVKDYHDKLJKHUSUREDELOLW\RIEHLQJUHOHYDQWWRPDLQ
PRGHOLVIDUOHVVWKDQPXOWLGRFXPHQWPRGHOV
F. Summarization based on language acceptance
$WH[WVXPPDUL]DWLRQV\VWHPDOVRFDQEHGLYLGHGWRPRQR
ODQJXDJH DQG PXOWLODQJXDJH 0RQR ODQJXDJH VXPPDUL]DWLRQ
RQO\DFFHSWVGRFXPHQWVLQDVSHFLILFODQJXDJHVXFKDV(QJOLVK
3HUVLDQ %XW D PXOWLODQJXDJH VXPPDUL]DWLRQ DGRSWHG E\
WRSLFRIWKHGRFXPHQW
7KH H[SHULPHQWDO UHVXOWV VKRZHG WKDW WKH EHVW FRUUHODWLRQ
EHWZHHQWKHDXWRPDWLFDQGKXPDQPDGHH[WUDFWVZDVDFKLHYHG
XVLQJ ILUVW DQG HQG VHQWHQFHV LQ VXPPDUL]HG RXWSXW %XW WKH
ILUVW VHQWHQFHLV PRUHLPSRUWDQW WKDQ ODVWRQH%\ UHDGLQJ WKH
ILUVW VHQWHQFH RI HYHU\ SDUDJUDSK FDQ EH XQGHUVWDQG LWV PDLQ
WRSLF 7KH (T  LV XVHG WR FDOFXODWH WKH LPSRUWDWLRQ UDWH RI
GLIIHUHQWODQJXDJHVDQGFDQEHDEOHWRVXPPDUL]HWKHP
VHQWHQFHORFDWLRQ
36L 
36L&
ORJ
36L&±

36L&
ORJ±
36L&
,9 6,0,/$5,7<0($685(62)(;75$&7,9( ;L 36L0D[M Q36L  
6800$5,=$7,21
$V PHQWLRQHG HDUOLHU H[WUDFWLYH VXPPDU\ LV XVLQJ PDLQ 36L LV HIIHFWLYH YDOXH RI WKH UHODWLYH SRVLWLRQ RI WKH LWK
WH[W VHQWHQFHV WR FUDWH VXPPDU\ 7KLV PHDQV WKDW PRUH VHQWHQFHWKDWFDOFXODWHGEDVHGRQHQWURS\7KH&LVDFRQVWDQW
LPSRUWDQWVHQWHQFHVDUHIRXQGDQGWUDQVIHUUHGWRWKHVXPPDU\ YDOXHEHWZHHQ]HURDQGRQHDQG;LLVDVHQWHQFHORFDWLRQYDOXH
7RGHWHUPLQHWKHLPSRUWDQWVHQWHQFHVVRPHSDUDPHWHUVVKRXOG
EHFRQVLGHUHG$IWHUGHWHUPLQLQJWKHSDUDPHWHUVYDOXHVXPRI

0057
D. Important words and phrases I. The continuity and similarity of a sentence with other
7KHUH DUH VRPH ZRUGV DQG SKUDVHV WKDW LQFUHDVH WKH sentences
VHQWHQFH LPSRUWDQFH 1XPEHUV LQFOXGLQJ GDWH WLPH SULFH )RU HDFK VHQWHQFH LQ WKH WH[W UHVHPEODQFH ZLWK RWKHU
SHUFHQWDJH DQG ZHLJKW DQG SURSHU QDPHV LQFOXGLQJ SHUVRQ VHQWHQFHVDUHFRQVLGHUHGDQGVHQWHQFHZLWKPRUHUHVHPEODQFH
SODFH DQG WLPH KDYH VSHFLILF LPSRUWDQW LQIRUPDWLRQ DQG KDVKLJKVFRUH7KHSURFHVVLVUHSHDWHGIRUDOOVHQWHQFHVRIWH[W
GHWHUPLQLQJWKHLULPSRUWDQFHGHSHQGVWRWH[WVW\SH7KHVFRUH DQG VHQWHQFHV ZLWK KLJKHU VFRUHV DUH PRUH OLNHO\ WR KDYH D
UDWH RI D VHQWHQFH UHJDUG WR WKH LPSRUWDQW ZRUGV DQG SKUDVHV SUHVHQFH LQ VXPPDU\ 7KH VLPLODULW\ RI WZR VHQWHQFHV LV
DUHREWDLQHGDFFRUGLQJWRWKH(TE\GLYLGLQJWKHQXPEHURI VLPLODULW\EHWZHHQFRQWDLQHGZRUGVVHQWHQFHOHQJWKDQGRWKHU
WKHVHZRUGVRQWKHWRWDOZRUGVLQVHQWHQFH FULWHULDPHQWLRQHGEHIRUH
;L _6LPS__6L_ 
E. Capitalized words and acronyms
&DSLWDOL]HGZRUGVRUDFURQ\PVDUHKDYLQJVSHFLDOFRQFHSWV
7KH ZRUGV ZLWK FDSLWDO OHWWHUV DUH LQ WKH /DWLQ DOSKDEHW
ODQJXDJHVDQGWKHUHDUHQRVXFKZRUGVLQ3HUVLDQ%XWWKHUHDUH
DFURQ\PVLQDOOODQJXDJHVDQGLQ3HUVLDQODQJXDJHFDQEHXVHG
WKHPWRGHWHUPLQHWKHVLJQLILFDQFHRIDVHQWHQFH
F. Cue-Phrase
&XH3KUDVHVDUHVRPHSKUDVHVOLNH³ILQDOO\´³DVUHVXOW´³LQ
WKLV SDSHU´ 6WDWHPHQWV FRQWDLQLQJ WKHVH ZRUGV FHUWDLQO\
LQFOXGLQJ LPSRUWDQW WRSLF DQG PXVW EH SUHVHUYHG 7KHUH DUH
VRPHZRUGVWKDWOHDGWRLQFUHDVHWKHLPSRUWDQFHRIDQRXQDQG
J. The similarity of a sentence with a paragraph topic
sentence
,Q WKLV VHFWLRQ WKH VLPLODULW\ RI HDFK VHQWHQFH ZLWK
SDUDJUDSK WRSLF VHQWHQFH LV FRQVLGHUHG 8VXDOO\ WKH WRSLF
VHQWHQFH LQ HDFK SDUDJUDSK LV D ILUVW VHQWHQFH LQ SDUDJUDSK
6LPLODULW\PHDVXUHVLQWKLVVHFWLRQDUHWKHVDPHFULWHULDOLNHLQ
WKHSUHYLRXVVHFWLRQV
K. Specific terms
6SHFLILFWHUPVDQGSKUDVHVLQWH[WDUHPDUNHGE\V\PSWRPV
VXFKDV!!HWF5HYLHZRIWKHOLWHUDWXUHVXPPDUL]HGE\
WKH KXPDQ VKRZV WKDW WKH VHQWHQFHV FRQWDLQLQJ WKHVH SKUDVHV
DUHRIPRUHLPSRUWDQW6HQWHQFHVZLWKVSHFLILFWHUPVVFRUHVDV
LWVVHQWHQFH)RUH[DPSOHWKHZRUGVOLNH'U0UDQG0LVV (T
7KHUH DUH VRPH RWKHU ZRUGV SODFHG DW WKH EHJLQQLQJ RI D ;L _6LS__6L_    
VHQWHQFH7KHVH ZRUGV OHDG WR GHFUHDVH WKHLPSRUWDQFH RIWKH 6LSLVWKHQXPEHURIVSHFLILFWHUPVLQWKHVHQWHQFH6LOHQJWK
VHQWHQFH 7KH PHQWLRQHG VHQWHQFHV DUH FRPH WR FRPSOHWH WKH RI VHQWHQFH DQG ;L VFRULQJ UDWH RI WKH VHQWHQFH EDVHG RQ
PHDQLQJ RI SUHYLRXV VHQWHQFH DQG FDQ EH LJQRUH LW 6RPH PHQWLRQHGFULWHULD
H[DPSOHRIWKHPDUH³EHFDXVH´³IRUH[DPSOH´³WKHUHIRUH´DQG
³WKXV´ 7KH ZHLJKW RI VWDWHPHQWV FRQWDLQLQJ WKHVH ZRUGV LQ L. The length of sentences
ERWKSRVLWLYHDQGQHJDWLYHIRUPFDOFXODWHGDV(T
6HQWHQFH OHQJWK LV DQ LPSRUWDQW FULWHULRQ LQ WH[W
;L _6L__6SL__6QL_
_6L_  VXPPDUL]DWLRQ7KHEHVWVHQWHQFHVIRUVXPPDU\RXWSXWDUHWKH
RQHVZLWKDYHUDJHOHQJWK6HQWHQFHVFRQWDLQLQJOHVVWKDQDSUH
GHILQHGQXPEHURIZRUGVDUHQRWLQFOXGHGLQWKHDEVWUDFW%XW
,QWKH(T6LLVWKHQXPEHURIZRUGVLQVHQWHQFHVL6SL VRPHWLPHVWKHHIIHFWVRISUHYLRXVPHDVXUHVLQFUHDVHVWKHVKRUW
LVWKHQXPEHURISRVLWLYH&XH3KUDVHVDQG6QLLVWKHQXPEHURI VHQWHQFH LPSRUWDQFH DQG FDQQRW EH DEVROXWHO\ HOLPLQDWHG LW
QHJDWLYH&XH3KUDVHV 7KH (T  LV GHWHUPLQHG DQG UDWHG WKH HIIHFW RI VHQWHQFH
OHQJWK  7KH VHQWHQFHV RXWRIWKUHVKROG ZLWK QHJDWLYH UDWH LV
G. Specific words DOVRFRQVLGHUHG
6SHFLILFZRUGVDUHFHUWDLQZRUGVWKDWKDYHVSHFLDOPHDQLQJ
;L 56L
/RJ56L±±56L
/RJ±56L
DQG PD\ YDU\ E\ NH\ZRUG LQ WKH WH[W 7KHVH ZRUGV FDQ EH
VFLHQWLILF LVVXHV VXFK DV PDWKHPDWLFV SV\FKRORJ\  7KH\ 56L _6L_0D[M Q_6L_  
LQFUHDVHWKHLPSRUWDQFHRIVHQWHQFH
H. Sentences containing words with different fonts and font
effects
6RPH RI WKH ZRUGV WKDW DUH LPSRUWDQW RU VSHFLILF LVVXHV
FKDUJHGZLWKFDSLWDOOHWWHUVVWDUWHGRUEROGLWDOLFRUXQGHUOLQHG
7KH\KDYHDKLJKHUFKDQFHRIH[SRVXUHVHQWHQFHVLQWKHRXWSXW
0058
,Q WKH (T  6L LV VHQWHQFH OHQJWK DQG 0D[M Q_6L_ LV
PD[LPXPVHQWHQFHOHQJWKLQWKHGRFXPHQW
M. Pronouns
6HQWHQFHVZLWKSURQRXQVKDYHOHVVLPSRUWDQFHWKDQWKHRQH
ZLWK QRXQV 3URQRXQV UHIHU WR QRXQV WKDW GHVFULEHG LQ WKH
SUHYLRXVVHQWHQFHV7KHSRVLWLRQRIWKHSURQRXQLQWKHVHQWHQFH
LVDOVRLPSRUWDQW)RUH[DPSOHDVHQWHQFHZLWKSURQRXQDWWKH
EHJLQQLQJ LV OHVV LPSRUWDQW VHQWHQFH %XW LI WKH SURQRXQ LV
SODFHG DW WKH PLGGOH DQG HQG RI D VHQWHQFH LW LVD OLWWOH PRUH DQGYRFDEXODU\VLPXOWDQHRXVO\,WXVHVDOJHEUDLFVLQJXODUYDOXH
LPSRUWDQW VHQWHQFH 7KH VFRUH RI VHQWHQFH LQFOXGLQJ SURQRXQ GHFRPSRVLWLRQ 69' PHWKRG WR GHWHUPLQH WKH UHODWLRQVKLS
FDOFXODWHGDV(T EHWZHHQVHQWHQFHVDQGZRUGV$GGLWLRQWREHLQJDEOHWRPRGHO
WKH UHODWLRQVKLS EHWZHHQ ZRUGV DQG VHQWHQFH 69' DOVR FDQ
;L %3L_63L__6L_    UHGXFHWKHQRLVHVDQGOHDGWRLPSURYHWKHDFFXUDF\
,Q (T  WKH _ 6SL _ LV WKH QXPEHU RI SURQRXQV LQ
VHQWHQFHV 6L LV WKH VHQWHQFH OHQJWK DQG %3L LV D FRQVWDQW
SDUDPHWHU,IWKHSURQRXQORFDWLRQLVLQWKHILUVWWKUHHZRUGLQ
WKHVHQWHQFH%3L RWKHUZLVH%3L 
9 ',))(5(17$3352$&+(6727(;76800$5,=$7,21
$OWKRXJK VXPPDULHV FUHDWHG E\ KXPDQ DUH RIWHQ
DEVWUDFWLYH EXW WKH PRVW VXFFHVVIXO PDFKLQH VXPPDU\ DUH
H[WUDFWLYH %HFDXVH RI WKH VHPDQWLF DPELJXLW\ LQ QDWXUDO
ODQJXDJHSURFHVVLQJDJRRGH[WUDFWLYHVXPPDU\LVPXFKEHWWHU
UHVXOWWKDQDEVWUDFWLYHVXPPDUL]DWLRQ,QIDFWLWLVIDUDZD\WR
FUHDWH DQ LGHDO DXWRPDWLF DEVWUDFWLYH VXPPDUL]DWLRQ PHWKRG
7KHILUVWDXWRPDWLFWH[WVXPPDUL]DWLRQDQGWKHPRVWLPSRUWDQW
QHZ SURSRVHG PHWKRGV DUH H[WUDFWLYH V\VWHPV WKDW H[WUDFW
LPSRUWDQW VHQWHQFHV EDVHG RQ KHXULVWLF IHDWXUHV VXFK DV
VHQWHQFHSRVLWLRQVLQWKHWH[WWKHIUHTXHQF\RIZRUGVLQLWDQG
6XPPDUL]DWLRQDOJRULWKPEDVHGRQ/6$PHWKRGFRQVLVWVRI
WKUHHVWHSVFUHDWHWKHLQSXWPDWUL[DSSOLHGWKH69'PHWKRGRQ
WKHFUHDWHGPDWUL[DQGVHQWHQFHH[WUDFWLRQ
/6$DOVRKDVVRPHOLPLWDWLRQV7KHPRVWLPSRUWDQWRIWKHP
DUHDVIROORZV
x 7KH DOJRULWKP GRHV QRW XVH WKH LQIRUPDWLRQ DERXW WKH
ZRUGV DUUDQJHPHQW LQ VHQWHQFHV JUDPPDU DQG
PRUSKRORJ\ UHODWLRQVKLS +RZHYHU WKLV LQIRUPDWLRQ
FDQEHXVHIXOWREHWWHUXQGHUVWDQGZRUGVDQGVHQWHQFHV
x 7KH DOJRULWKP GRHV QRW XVH DQ\ ZRUG NQRZOHGJH DQG
ZRUGGDWDEDVH
x %\ LQFUHDVLQJ WKH QXPEHU RI GLIIHUHQW ZRUGV DQG
KHWHURJHQHRXV GDWD WKH SHUIRUPDQFH RI WKH DOJRULWKP
JUHDWO\ UHGXFHG 3HUIRUPDQFH UHGXFWLRQ LV GXH WR WKH
VRPHLPSRUWDQWNH\ZRUGVUHODWHGWRWH[W7RFUHDWHD
V\VWHP ZLWK KLJKTXDOLW\ GXH WR D GLIIHUHQW W\SH RI ODQJXDJH
DQG WH[W LQSXW YDULRXV PHWKRGV DQG DOJRULWKPV LQ PDFKLQH
OHDUQLQJDQGQDWXUDOODQJXDJHSURFHVVLQJLVSURSRVHG0RVWRI
H[WUDFWLYH VXPPDU\ PHWKRGV DUH HPSKDVLV RQ NH\ VHQWHQFHV
7KH GLIIHUHQFHV EHWZHHQ PHWKRGV DUH WKH GLIIHUHQW DOJRULWKP
XVHGWRGHWHFWLGHQWLI\H[WUDFWDQGWKHZD\WRSXWVHQWHQFHVLQ
WKHVXPPDU\,QWKHIROORZLQJWKHPRVWLPSRUWDQWDSSURDFKHV
ZLOOEHGLVFXVVHG
WLPHDQGPHPRU\FRPSOH[LW\RIWKH69'PHWKRG
B. Lexical Chain based approaches
/H[LFDO FKDLQ SURGXFHV D SUHVHQWDWLRQ RI WH[W FRQWLJXRXV
VWUXFWXUHV%DVLFDOO\LWXVHVWKHZRUGQHWGDWDEDVHWRGHWHUPLQH
WKHFRQQHFWLRQEHWZHHQWKHWHUPVDQGWKHQFUHDWHVDFRQWLQXXP
EHWZHHQWKHVHWHUPV7KHILUVWFRPSXWDWLRQDOPRGHORIOH[LFDO
FKDLQVZDVSUHVHQWHGE\0RULVDQG+LUVWLQDQGWKHILUVW
XVH RI OH[LFDO FKDLQV LQ WH[W VXPPDUL]DWLRQ ZDV SURSRVHG E\
A. Statistical approaches
8VLQJ VWDWLVWLFDO PHWKRGV WR VXPPDUL]H WKH WH[W LV DQ
HIIHFWLYH DSSURDFK WKDW KDV EHHQ XVHG LQ PDQ\ DUWLFOHV ,Q
VWDWLVWLFDOPHWKRGVWKHLPSRUWDQWVHQWHQFHVDUHVHOHFWHGEDVHG
RQ ZRUG IUHTXHQF\ LQGLFDWRU SKUDVHV DQG RWKHU IHDWXUHV
UHJDUGOHVV RI WKH PHDQLQJ RI WKH ZRUGV WKDW PHQWLRQHG LQ
SUHYLRXVVHFWLRQV
7KHUH DUH VHYHUDO PHWKRGV WR GHWHUPLQH WKH NH\ VHQWHQFHV
%DU]LOD\DQG(OKDGDG
7KH VFRUHV WKDW FRQVLGHUHG IRU WHUPV DUH DFFRUGLQJ WR WKH
W\SH DQG QXPEHU RI WKH UHODWLRQVKLS RI FKDLQV VHW 7KH ILQDO
VXPPDU\ LV LQFOXGHG VHQWHQFHV ZLWK VWURQJHVW FKDLQ
FRQQHFWLRQ /H[LFDO FKDLQV FDQ EH FRPSXWHG WKH VHPDQWLFDOO\
UHODWLRQ RI ZRUGV ,W FDQV DOVR LGHQWLI\ WKH V\QRQ\PV DQG
K\SRQ\PVWRSODFHWKHPLQDJURXSLQWRWKHVDPHOH[LFDOFKDLQ
/H[LFDO FKDLQ DOVR XVHG IRU LQIRUPDWLRQ UHWULHYDO DQG
JUDPPDWLFDOHUURUFRUUHFWLRQV
VXFK DV 7KH 7LWOH 0HWKRG  7KH /RFDWLRQ 0HWKRG  7KHUHDUHWZRGUDZEDFNVLQOH[LFDOFKDLQDSSURDFKHV7KH
7KH $JJUHJDWLRQ 6LPLODULW\ 0HWKRG  7KH )UHTXHQF\ ILUVWRQHLVDPELJXLW\LQWKHZRUGFKDLQ,IVRPHRIZRUGVKDYH
0HWKRG  7) %DVHG 4XHU\ 0HWKRG  DQG /DWHQW VHPDQWLFDPELJXLW\WKHFUHDWHGFKDLQDOVRZLOOKDYHVHPDQWLF
6HPDQWLF $QDO\VLV  %XW WKH PRVW FRPPRQ PHWKRGV DUH DPELJXLW\ 7KH VHFRQG GUDZEDFN LV WKH UHODWLRQ RI FUHDWHG
&ODVVLILHU %D\HVLDQ %D\HVLDQ &ODVVLILHU DQG FRPPXQLFDWLRQ FKDLQWRPDLQWRSLF$OOFKDLQVDUHQRWUHODWHGWRWKHPDLQWRSLF
FRQFHSW UHODWLRQV DSSURDFKHV 2QH RI WKH PRVW IDPRXV
VWDWLVWLFDOPHWKRGVWRVXPPDUL]HWKHWH[WLV/6$PHWKRG C. Graph based approach
/6$ LV DQ DOJHEUDLFVWDWLVWLFDO PHWKRG WKDW H[WUDFWV KLGGHQ
VWUXFWXUHVPHDQLQJRIZRUGVDQGVHQWHQFHV7KLVDSSURDFK
LVDQXQVXSHUYLVHGPHWKRGWKDWH[WUDFWVWH[WVWUXFWXUHVMXVWE\
LQIRUPDWLRQ RIWKH ZRUGV LQ VHQWHQFH ZLWKRXW WKH QHHGRI DQ\
RWKHUNQRZOHGJH7KHLGHDLQ/69LVZRUGVWKDWWKH\DUHVKDUHG
EHWZHHQ GLIIHUHQW VHQWHQFHV DUH WKH UHDVRQ RI PHDQLQJ
GHSHQGHQFH/6$DOVREHDEOHWRVKRZWKH PHDQLQJRI ZRUGV
0059
*UDSK EDVHG DSSURDFK SURYLGHV WH[W VXPPDUL]DWLRQ
PHWKRGV XVLQJ JUDSK WKHRULHV $IWHU FRPPRQ SUHSURFHVVLQJ
VWHSV VXFK DV VWHPPLQJ DQG VWRS ZRUG UHPRYDO VHQWHQFHV LQ
WKH GRFXPHQWV DUH UHSUHVHQWHG DV QRGHV LQ D GLUHFWHG JUDSK
6HQWHQFHV DUH FRQQHFWHG WR HDFK RWKHU E\ HGJHV DFFRUGLQJ WR
VHQWHQFH 7KH EDVLF LGHD RI JUDSKEDVHG DSSURDFKHV LV
VRPHWKLQJ OLNH YRWLQJ $V UHVXOW ZKHQ DQ HGJH FRQQHFWHG D
QRGHWRRWKHUQRGHLWPHDQVWKDWYRWHVWRLWDQGZKDWHYHUWKH PHWKRG ODUJHVW FOXVWHU LV FRQVLGHUHG DV PDLQ WRSLF LQSXW WH[W
LQSXWGHJUHHRI D QRGH LV KLJK LW KDVD KLJKHUSULRULW\ ,QWKH VL]HKDVDGLUHFWLPSDFWRQGHWHUPLQLQJWKHQXPEHURIFOXVWHUV
PHQWLRQHG PHWKRG WKHUH LV DOVR YRWLQJ VFRUH ,I D QRGH KDV )RUH[DPSOHDELJ.OHDGWRVPDOOFOXVWHUVDQGDVUHVXOWVPDOO
JUHDWHURXWSXWGHJUHHLWVLPSRUWDQFHLQFUHDVHV7KHLPSRUWDQFH DQG GLVSHUVH VXPPDU\ ZLWK YHU\ ORZ FRUUHODWLRQ DQG VPDOO .
GHJUHH RI HDFK QRGH LV FDOFXODWHG E\ 69D DV (T IRU DOO OHDG WR ELJ DQG GHQVH FOXVWHUV DQG DV UHVXOW ORZ FRPSUHVVLRQ
QRGHV LQ D JUDSK UHFXUVLYHO\ 7KH SURFHVV FRQWLQXHV XQWLO WH[W
FRYHUDJHDQGQRFKDQJHLQ69D
1,0HJKDQD 06%HZRRUSURSRVHGDQRWKHUWHFKQLTXHWR
69D ±GG
  FUHDWH D TXHU\ EDVHG VXPPDUL]DWLRQ V\VWHP XVLQJ FOXVWHULQJ
PHWKRGV7KH\XVHG([SHFWDWLRQ0D[LPL]DWLRQ&OXVWHULQJ
,QWKH(T9LVQRGHV(LVHGJHVLQ9DLVWKHQXPEHU (0 DOJRULWKP DQG LPSOHPHQWDWLRQ PHWKRGRORJ\ LV GLYLGHG
RI 9D LQSXW HGJHVRXW9D LV WKH QXPEHU RI 9DRXWSXW HGJHV LQWRWZRVHFWLRQV7KH(0DOJRULWKPKDVEHHQLPSOHPHQWHGLQ
DQGGLVDQLQSXWSDUDPHWHUEHWZHHQ]HURDQGRQH69DLV9D WKHILUVWSDUWDQGTXHU\EDVHGVXPPDUL]DWLRQLVGRQHLQVHFRQG
VFRUHDQG69ELV9EVFRUH7KHDOJRULWKPFDQDOVREHDSSOLHG SDUW7KHSURSRVHGPHWKRGKDVEHHQXVHGWKH:RUGQHW
RQ DQ XQGLUHFWHG JUDSK EXW WKH RXWSXW VXPPDU\ LV PRUH
GLIIHUHQWZLWKFRPSOH[LW\RIWLPH
A. Fuzzy logic based approaches
$Q HIIHFWLYH JUDSK EDVHG VXPPDU\ SURSRVHG DOJRULWKP LV
7H[W 5DQN DOJRULWKP  ,W XVHV DQ XQVXSHUYLVHG PHWKRG WR )X]]\ ORJLF EDVHG DSSURDFKHV FRQVLGHU HDFK FKDUDFWHULVWLF
H[WUDFWNH\ZRUGVDQGVHQWHQFHVZLWKVFRULQJWRQRGHVEDVHGRQ RIDWH[WDVWKHLQSXWRIIX]]\V\VWHP7KHVHPHWKRGVRQO\XVHG
SUHYLRXVPHQWLRQHGVLPLODULW\PHDVXUHV7KHDOJRULWKPLV
VWDUWHG ZLWK DQ RSWLRQDO QRGH YDOXHV DQG UHFXUVLYHO\ UHSHDWHG
XQWLO FRYHUDJH WR SUHGHILQHG WKUHVKROG 7KH RSWLRQDO QRGHV
YDOXHKDVQRHIIHFWRQWKHILQDOVFRUHV
IX]]\ORJLFWRGHWHFWDQGH[WUDFWWKHLPSRUWDQWVHQWHQFHV)X]]\
WH[WVXPPDUL]DWLRQPHWKRGVDUHGLIIHUEDVHGRQGLIIHUHQFHVLQ
H[WUDFWLQJ IHDWXUHV IX]]\ UXOHV OLQJXLVWLF YDULDEOHV
PHPEHUVKLS IXQFWLRQV IX]]LILFDWLRQ DQG GHIX]]LILFDWLRQ
PHWKRGV 6RPH FKDQJHV LQ QXPHULFDO YDOXHV OHDG WR SURGXFH
D. Cluster based approaches EHWWHU OLQJXLVWLF YDULDEOHV  ) .\RRPDUVL + .KRVUDYL
6RPHDXWRPDWLFVXPPDUL]DWLRQV\VWHPVDUHXVHGFOXVWHUVWR
SURGXFH VLJQLILFDQW VXPPDULHV ,Q WKLV DSSURDFK GLIIHUHQW
FOXVWHULQJ DOJRULWKPV DUH DSSOLHG IRU GLYLGLQJ WKH WH[W LQWR
WRNHQVVXFKDVZRUGVSKUDVHVVHQWHQFHVDQGHYHQSDUDJUDSKV
&OXVWHUEDVHGDSSURDFKLVDQH[WUDFWLYHVXPPDUL]DWLRQDQGWKH
PRVW VLPLODU VHQWHQFHV DUH EDVHG RQ PHQWLRQHG VLPLODULW\
PHDVXUHV DUH SODFHG LQ WKH FOXVWHUV 7KH ELJJHVW FOXVWHU LV
VHOHFWHG DV PDLQ WRSLF DQG LWV VHQWHQFHV DUH H[WUDFWHG DQG
SODFHG LQ VXPPDU\ RXWSXW (XFOLGHDQ GLVWDQFH &DUWHVLDQ
VLPLODULW\FRVLQHDQGVRPHRWKHUVLPLODULW\PHDVXUHVDUHXVHG
SURSRVHGDPHWKRGWKDWVXPPDUL]HVWKHWH[WLQWZRVWDJHV
7KH ILUVW VWDJH LV SUHSURFHVVLQJ DQG WKH VHFRQG VWDJH LV
SHUIRUPLQJ IX]]\ DQDO\VLV RQ WH[W 7KH IHDWXUHV WKDW WKH\
H[WUDFWHG DUH WKH QXPEHU RI FRPPRQ ZRUGV LQFOXGLQJ WKH
VHQWHQFH DQG WLWOH WKH QXPEHU RI ZRUGV LQ VHQWHQFH WKH
VLPLODULW\ RI D VHQWHQFH ZLWK D SDUDJUDSK WRSLF VHQWHQFH DQG
VLPLODULW\RIVHQWHQFHDQGILUVWVHQWHQFHLQSDUDJUDSK
9, ,17(*5$7,216,0,/$567$7(0(176,1(;75$&7,9(
6800$5,=$7,21
IRUGHILQLQJWKHVLPLODULW\DQGGLVVLPLODULW\RIFOXVWHUV
5HGXQGDQF\LQDVHULHVRIVHQWHQFHVLQWH[WVHVSHFLDOO\RQ
$ $JUDZDO  8 *XSWD  SURSRVHG .PHDQV WKHZHELVRQHRIWKHSUREOHPVLQQDWXUDOODQJXDJHSURFHVVLQJ
FOXVWHULQJ DOJRULWKP WR SODFH LPSRUWDQW VHQWHQFHV ZLWKLQ DQGRQWKHRWKHUKDQGFUHDWHVDQHZUHVHDUFKRSSRUWXQLWLHVLQ
FOXVWHUV DQG FKRVH WKH ELJJHVW FOXVWHU DV PDLQ WRSLF7KH WH[W VXPPDUL]DWLRQ DUHD 7KHUH DUH PDQ\ VHQWHQFHV ZLWK
GRFXPHQWV DUH UHSUHVHQWHG XVLQJ WHUP IUHTXHQF\LQYHUVH VLPLODU PHDQLQJ DQG FRQFHSW LQ HYHU\ GRFXPHQW %HFDXVH RI
GRFXPHQWIUHTXHQF\7),'),QWKHFRQWH[WWHUPIUHTXHQF\ GHWHUPLQLQJ WKH QXPEHU RI VHQWHQFHV LQ WKH VXPPDU\ E\ WKH
7)LVWKHDYHUDJHQXPEHURIRFFXUUHQFHE\GRFXPHQWLQWKH
FOXVWHU7KHWRSLF LVUHSUHVHQWHGE\ ZRUGVRI ZKLFK WKH YDOXH
7),')LVKLJKHULQWKHFOXVWHU7KHVHOHFWLRQRIWKHLPSRUWDQW
VHQWHQFHVLVEDVHGRQWKHVLPLODULW\PHDVXUHVRIWKHVHQWHQFHV
ZLWKWKHWRSLFRIFOXVWHU
7ZR RSWLPL]DWLRQ LGHDV DUH SURSRVHG LQ WKHLU DOJRULWKP
XVHUVWDWHPHQWVZLWKDVLPLODUFRQFHSWDUHSODFHGLQVXPPDU\
7KHUHDUHDOVRVRPHRWKHULPSRUWDQWFRQFHSWVLQWKHPDLQWH[W
DQGGXHWRWKHOLPLWDWLRQQXPEHURIVHQWHQFHVLQVXPPDU\WKH\
GRQRWVHOHFWDQGH[WUDFW6RPDQ\VHQWHQFHVZLWKRQHFRQFHSW
SODFHGLQVXPPDU\DQGPDQ\RWKHULPSRUWDQWSDUWVDUHLJQRUHG
7KH SUREOHP LV PRUH FRPPRQ LQ PXOWL GRFXPHQW
7KH ILUVW RQH LV D PHWKRG WR FDOFXODWH VHQWHQFH VFRUH DQG WKH VXPPDUL]DWLRQ6LPLODUFRQFHSWVHQWHQFHVDUHDOVRFUHDWHG
VHFRQGRQHLVDZD\WRJHWWKHRSWLPDOQXPEHURIFOXVWHUV7R WKHDPELJXLW\LQTXHVWLRQDQVZHULQJV\VWHPV
FDOFXODWLQJ VHQWHQFH VFRUH WKH DOJRULWKP XVHV 7),') DQG WKH 7KHUH DUH VRPH SURSRVHG PHWKRGV WR FRPELQH VLPLODU
VHQWHQFHOHQJWK; VHQWHQFHV WR H[WUDFW PXFK PRUH LPSRUWDQW VHQWHQFHV IURP WKH
PDLQ WH[W 2QH RI WKH PRVW LPSRUWDQW VHQWHQFH IXVLRQV LV
6FRUH[    
GHSHQGHQF\ WUHHV .DWMD )LOLSSRYD LV SURSRVHG D GLUHFWHG
2QH RI WKH PRVW LPSRUWDQW LVVXHV LQ NPHDQV FOXVWHULQJ LV DF\FOLF JUDSK '$* WR VHQWHQFH IXVLRQ  &OXVWHULQJ
GHWHUPLQLQJWKHRSWLPDOQXPEHURIFOXVWHUV*LYHQWKDWLQWKLV

0060
DSSURDFKHV DUH DOVR FDQ EH XVHG IRU FRPELQLQJ VLPLODU
VHQWHQFHV,QWKHVHDSSURDFKHVVPDOOFOXVWHUVDUHFRQVLGHUHGWR
SODFH YHU\ VLPLODU VHQWHQFHV DQG WKHQ HDFK FOXVWHU FDQ EH
FRPELQHGWRRQHVHQWHQFH
9,, $66(660(17$1'(9$/8$7,212)6800$5,=,1*
0(7+2'6
'XHWRH[WHQVLYHDXWRPDWLFVXPPDUL]DWLRQPHWKRGVDVVHVV
WKHDFFXUDF\RIFUHDWHGPHWKRGVLVLPSRUWDQW,WFDQEHVDLGWKDW
WKH SURFHVV RI HYDOXDWLRQ LV PXFK PRUH GLIILFXOW WKDQ
VXPPDUL]LQJ WKH WH[W ,Q PRVW FDVHV WKHUH LV QRW DQ LGHDO
VXPPDUL]HRIDGRFXPHQW7KHPDLQSUREOHPLQVXPPDUL]LQJ
DVVHVVPHQWLVXVLQJH[WHQVLYHFULWHULDDQGDEVHQFHRIDVWDQGDUG
PHWKRGIRUHYDOXDWLRQ6XFKSUREOHPVDUHUDUHLQRWKHUQDWXUDO
ODQJXDJHSURFHVVLQJFDVHV
0RVW RI WKH GHYHORSHG PHWKRGV DUH XVHG WZR DSSURDFKHV
IRUHYDOXDWLRQ7KHILUVWDSSURDFKLVWRMXGJHE\KXPDQDQGWKH
VHFRQGDSSURDFKLVFRPSDUHGWRUHIHUHQFHVXPPDU\
,QWKHILUVWDSSURDFKVXPPDU\JHQHUDWHGE\PDFKLQHFDQEH
FRPSDUH ZLWK WKH VDPH VXPPDU\ JHQHUDWHG E\ D PDQ 7KH
SUREOHPZLWKWKLVDSSURDFKLVWKHGLIIHUHQWSHUVRQDOWDVWHVDQG
RSLQLRQV 7R UHGXFH WKH LPSDFW RI WKH HIIHFWV DXWRPDWH
VXPPDU\FRPSDUHVZLWKPRUHWKDQRQHVXPPDU\JHQHUDWHGE\
KXPDQVDQGLWLVWLPHFRQVXPLQJ
,Q VHFRQG DSSURDFK WKHUH LV PRUH WKDQ RQH RULJLQDO WH[W
ZLWKWKHLUVXPPDU\LQDGDWDVHW7KHRULJLQDOGRFXPHQWDQGLWV
RSWLPL]HG VXPPDU\ LV D JRRG EDVH IRU HYDOXDWH WKH SURSRVHG
VXPPDUL]DWLRQDOJRULWKP
2QHRIWKHPRVWIDPRXVHYDOXDWLRQPHWKRGVLV528*(1
7KHPHQWLRQHYDOXDWLRQPHWKRGFRPSDUHVDXWRPDWHJHQHUDWHG
FRXQW1JUDP LV DOVR WKH QXPEHU RI 1JUDPV LQ KXPDQ
VXPPDU\
9,,, &21&/86,216
7H[W VXPPDUL]DWLRQ LV RQH RI WKH PRVW H[FLWLQJ UHVHDUFK
DUHDV LQ QDWXUDO ODQJXDJH SURFHVVLQJ ,W LV DQ RSHQ UHVHDUFK
DUHDV DQG D ORW RI UHVHDUFKHV DUH KDYLQJ EHHQ GRQH DERXW LW
7H[WVXPPDUL]DWLRQFDQEHFODVVLILHGLQWRGLIIHUHQWJURXSVDQG
DSSURDFKHVDQGWKHPRVWQRWDEO\RIWKHPVWXGLHGLQWKLVSDSHU
,Q WKLV VWXG\ DW ILUVW WKH WRSLF RI WH[W PLQLQJ DQG LWV
UHODWLRQVKLSZLWKWH[WVXPPDUL]DWLRQDUHFRQVLGHUHG,PSRUWDQW
GHVLJQLQJFULWHULDLQWH[WVXPPDUL]DWLRQV\VWHPVDUHSUHVHQWHG
'LIIHUHQW DSSURDFKHV IRU VXPPDUL]DWLRQ DQG LPSRUWDQW
SDUDPHWHUV QHHGHG WRUDWH LPSRUWDQW VHQWHQFHV DUH LQWURGXFHG
)LQDOO\LPSRUWDQWHYDOXDWLRQDSSURDFKHVDUHLQWURGXFHG
5()(5(1&(6
>@ +/XKQ³7KHDXWRPDWLFFUHDWLRQRIOLWHUDWXUHDEVWUDFWLRQ´,%0-RXUQDO
RIUHVHDUFKDQGGHYHORSPHQW9ROSS
>@ 9 *XSWD *6 /HKDO ³$ 6XUYH\ RI 7H[W 0LQLQJ 7HFKQLTXHV DQG
$SSOLFDWLRQV´ -RXUQDO RI (PHUJLQJ 7HFKQRORJLHV LQ :HE ,QWHOOLJHQFH
9ROQR
>@ *2 0DNEXOH , &LFHNOL ) 1XU $OSDVODQ ³7H[W 6XPPDUL]DWLRQ RI
7XUNLVK 7H[WV XVLQJ /DWHQW 6HPDQWLF $QDO\VLV´ UG ,QWHUQDWLRQDO
&RQIHUHQFHRQ&RPSXWDWLRQDO/LQJXLVWLFVSS±
>@ ( +RY\ & /LQ ´$XWRPDWHG 7H[W 6XPPDUL]DWLRQ DQG WKH
6800$5,67 6\VWHP ,Q $GYDQFHV LQ $XWRPDWLF 7H[W
6XPPDUL]DWLRQ´0,73UHVVSS
>@ 6 *KRODPUH]D]DGHK 0 $PLQL % *KRODP]DGHK ³$ &RPSUHKHQVLYH
6XUYH\RQ7H[W6XPPDUL]DWLRQ6\VWHPV´,(((
>@ 7 +LUDR < 6DVDNL + ,VR]DNL ³$Q H[WULQVLF HYDOXDWLRQ IRU TXHVWLRQ
ELDVHG WH[W VXPPDUL]DWLRQ RQ TD WDVNV´ ,Q 3URFHHGLQJV RI 1$$&/
VXPPDU\ ZLWK VXPPDULHV JHQHUDWHG E\ WKH KXPDQ   ZRUNVKRSRQ$XWRPDWLFVXPPDUL]DWLRQ
528*(1XVHVWKUHHHYDOXDWLRQFULWHULD3UHFLVLRQS5HFDOO >@ -9 *ROGVWHLQ - 0LWWDO - &DUERQHOO  0 .DQWURZLW]W ³0XOWL
5 DQG)PHDVXUHDQGWKH\DUHFDOFXODWHGDV(T GRFXPHQW VXPPDUL]DWLRQ E\ VHQWHQFH H[WUDFWLRQ´ ,Q 3URF RI WKH
$1/31$$&/:RUNVKRSRQ$XWRPDWLF6XPPDUL]DWLRQ
3 _VXPBUHIŀVXPBFDQG__VXPBFDQG_ >@ *20DNEXOH³7H[W6XPPDUL]DWLRQXVLQJ/DWHQW6HPDQWLF$QDO\VLV´
5 _VXPBUHIŀVXPBFDQG__VXPBUHI_ 06WKHVLV0LGGOH(DVW7HFKQLFDO8QLYHUVLW\
) 3535   >@ 9 *XSWD * /HKDO ³$ 6XUYH\ RI 7H[W 6XPPDUL]DWLRQ ([WUDFWLYH
7HFKQLTXHV´ -RXUQDO RI HPHUJLQJ WHFKQRORJLHV LQ ZHE LQWHOOLJHQFH
92/12
,Q WKH (T  VXPBUHIGHWHUPLQHV VXPPDU\ H[WUDFWHGE\ >@ +(GPXQGVRQ³1HZ0HWKRGVLQ$XWRPDWLF([WUDFWLQJ´-RXUQDORIWKH
H[SHUWV DQG VXPBFDQG GHWHUPLQHV VXPPDU\ H[WUDFWHG E\ $VVRFLDWLRQIRU&RPSXWLQJ0DFKLQHU\9RO33
V\VWHP >@ . <RXQJNRRQJ 6 -XQJ\XQ ³$Q (IIHFWLYH 6HQWHQFH ([WUDFWLRQ
7HFKQLTXH8VLQJ&RQWH[WXDO,QIRUPDWLRQDQG6WDWLVWLFDO$SSURDFKHVIRU
$QRWKHU HYDOXDWLRQ FULWHULRQ PHQWLRQHG LQ 528*(1 LV 7H[W6XPPDUL]DWLRQ´3DWWHUQ5HFRJQLWLRQ/HWWHUV
FDOFXODWHGE\WKH(T7KHPHDVXUHFRPSDUHVQXPEHURI1
JUDPVLQPDFKLQHVXPPDU\DQGKXPDQVXPPDU\
528*(1  
 $QQXDO0HHWLQJRIWKH$&/SS
>@ 0:DVVRQ³8VLQJOHDGLQJWH[WIRUQHZVVXPPDULHV(YDOXDWLRQUHVXOWV
DQG LPSOLFDWLRQV IRU FRPPHUFLDO VXPPDUL]DWLRQ DSSOLFDWLRQV´ LQ 3URF
WK ,QWHUQDWLRQDO &RQIHUHQFH RQ &RPSXWDWLRQDO /LQJXLVWLFV DQG WK

FRXQWBPDWFK1JUDP >@ : DOVDQLH ³7RZDUGV DQ LQIUDVWUXFWXUH IRU $UDELF WH[W VXPPDUL]DWLRQ
XVLQJUKHWRULFDOVWUXFWXUHWKHRU\´067KHVLV´'HSDUWPHQWRIFRPSXWHU

FRXQW1JUDP  VFLHQFH.LQJ6DXGXQLYHUVLW\5L\DGK.LQJGRPRI6DXGL$UDELD
>@ * 6DOWRQ ³$XWRPDWLF 7H[W 3URFHVVLQJ 7KH 7UDQVIRUPDWLRQ $QDO\VLV
,QWKH(T1LVWKHQXPEHURI1JUDPVFRXQWBPDWFK DQG5HWULHYDORI,QIRUPDWLRQE\&RPSXWHU´$GGLVRQ:HVOH\3XEOLVKLQJ
1JUDP LV PD[LPXP QXPEHU RI 1JUDPV ZKLFK DUH LQ &RPSDQ\
PDFKLQH VXPPDU\ DQG KXPDQ VXPPDU\ VLPXOWDQHRXVO\

0061
>@ - %HOOHJDUGD ³([SORLWLQJ ODWHQW VHPDQWLF LQIRUPDWLRQ LQ VWDWLVWLFDO >@ ) .\RRPDUVL + NKRVUDYL ( (VODPL 0 'DYRXGL ³([WUDFWLRQEDVHG
ODQJXDJH PRGHOLQJ´ LQ 3URF  ,((( 9RO  1R  SS  7H[W 6XPPDUL]DWLRQ XVLQJ )X]]\ $QDO\VLV´ ,UDQLDQ -RXUQDO RI )X]]\
 6\VWHPV9RO1RSS
>@ 1 $ODPL 0 0HNQDVVL 1 5DLV ³$XWRPDWLF 7H[WV 6XPPDUL]DWLRQ >@ 0 3RXUYDOL $ $EDGHK 0RKDPPDG ³$XWRPDWHG WH[W VXPPDUL]DWLRQ
&XUUHQW6WDWHRIWKH$UW´-RXUQDORI$VLDQ6FLHQWLILF5HVHDUFK9RO
SS
>@ 5 %DU]LOD\ 0 (OKDGDG ³8VLQJ /H[LFDO &KDLQV IRU 7H[W
6XPPDUL]DWLRQ´WKH0,73UHVVSS
>@ 5 0LKDOFHD ³*UDSKEDVHG UDQNLQJ DOJRULWKPV IRU VHQWHQFH H[WUDFWLRQ
DSSOLHG WR WH[W VXPPDUL]DWLRQ´ LQ 3URFHHGLQJV RI WKH $&/  RQ
,QWHUDFWLYHSRVWHUDQGGHPRQVWUDWLRQVHVVLRQV
>@ $ $JUDZDO 8 *XSWD ³([WUDFWLRQ EDVHG DSSURDFK IRU WH[W
VXPPDUL]DWLRQ XVLQJ NPHDQV FOXVWHULQJ´ ,QWHUQDWLRQDO -RXUQDO RI
6FLHQWLILFDQG5HVHDUFK3XEOLFDWLRQV9RO,VVXH
>@ 1, 0HJKDQD 06 %HZRRU 06 6+ 3DWLO ³7H[W 6XPPDUL]DWLRQ
XVLQJ ([SHFWDWLRQ 0D[LPL]DWLRQ &OXVWHULQJ $OJRULWKP´ ,QWHUQDWLRQDO
EDVH RQ OH[LFDO FKDLQ DQG JUDSK XVLQJ RI ZRUG QHW DQG :LNLSHGLD
NQRZOHGJH EDVH´ ,-&6, ,QWHUQDWLRQDO -RXUQDO RI &RPSXWHU 6FLHQFH
,VVXHV1RYRO
>@ +6KDNHUL6*KRODPUH]D]DGHK0$PLQL6DOHKL)*KDGDP\DUL³$
1HZ *UDSK%DVHG $OJRULWKP IRU 3HUVLDQ 7H[W 6XPPDUL]DWLRQ´
&RPSXWHU 6FLHQFH DQG &RQYHUJHQFH /HFWXUH 1RWHV LQ (OHFWULFDO
(QJLQHHULQJ
>@ 5 'UDJRPLU - %XG]LNRZVND ³&HQWURLGEDVHG VXPPDUL]DWLRQ RI
PXOWLSOH GRFXPHQWV 6HQWHQFH H[WUDFWLRQ XWLOLW\EDVHG HYDOXDWLRQ DQG
XVHUVWXGLHV´,Q3URFHHGLQJVRIWKH$1/31$$&/:RUNVKRSRQ
$XWRPDWLF6XPPDUL]DWLRQSS±
>@ . )LOLSSRYD 0 6WUXEH ´ 6HQWHQFH )XVLRQ YLD 'HSHQGHQF\ *UDSK
-RXUQDO RI (QJLQHHULQJ 5HVHDUFK DQG $SSOLFDWLRQV ,-(5$ 9RO  &RPSUHVVLRQ´ LQ 3URFHHGLQJV RI WKH  &RQIHUHQFH RQ (PSLULFDO
,VVXHSS 0HWKRGVLQ1DWXUDO/DQJXDJH3URFHVVLQJSS±
>@ /6XDQPDOL06DOHP%6DOLP16DOLP³6HQWHQFH)HDWXUHV)XVLRQ
IRU7H[WVXPPDUL]DWLRQXVLQJ)X]]\/RJLF,(((SS

0062