Академический Документы
Профессиональный Документы
Культура Документы
1 PROBLEM DEFINITION
Project aims at recognizing spoken words and represents the words using American standard sign language via a robotic arm and also on the computer using visual basic. The application uses MATLAB to achieve it. Our idea behind this project is to help the dea and the dumb recognize the words spoken more e icientl!.
Our irst task was to ind out the wa! or recognizing speech. There are man! methods available or speech recognition. 'peech recognition can be done using "idden Markov Models .sing $eural $etworks /!namic Time )arping /igital 'ignal Processing Mel %re-uenc! (epstrum
)e inall! choose the method o mel re-uenc! trans ormation. The most widel! used eature in speech recognition is mel re-uenc! coe icients# which are mainl! ocused to model vocal tract while e1tracting eature coe icients rom the speech# mel re-uenc! cestrum coe icients appl! mel scale to power spectrum o speech in order to imitate human hearing mechanism. %ilters are used to emphasize some o the re-uenc! contents like ear does which is also called perceptual weighting. More ilter banks process the spectrum below 2 k"z since the speech signal contains most o its use ul in ormation such as irst ormant in lower re-uencies.
&t is the most well documented and most widel! used language in the world. American 'ign Language 4A'L5 is a comple1 visual+spatial language that is used b! the /ea communit! in the .nited 'tates and ,nglish+speaking parts o (anada &t is a linguisticall! complete# natural language. &t is the native language o man! /ea men and women# as well as some hearing children born into /ea amilies. A'L shares no
grammatical similarities to ,nglish and should not be considered in an! wa! to be a broken# mimed# or gestural orm o ,nglish. American standard sign language was demonstrated around 2678 in .nited 'tates and man! other countries# to provide education or the people who have problem in speaking and hearing the words 4the de and the dumb5. A+'+'+L enables the dumb and dea to speak with their hands which represent their tongue.
2. Literal Sur e!
2.1 SURVE" OF SIGN LANGUAGE
9arious s!stems were proposed or the automatic recognition o sign language /on Pearson in his approach :9isual (ommunication '!stems or the /ea ; presented a two wa! communication approach# where he proposed the practicalit! o switched television or both dea +to+hearing and dea to+dea communication. &n his approach# attention is given to the
re-uirements o picture communication s!stems# which enable the dea to communicate over distances using telephone lines. This section discusses some research done on translating other te1t and spoken languages to 'ign language. (o1 et. al# <2= presented a s!stem that translates the ,nglish speech to the British 'ign Language 4B'L5 using a speciall! developed avatar. "owever# the s!stem is constrained or post o ice operations. The s!stem uses a phrase lookup approach due to the highl! constraint in the Macintosh operating s!stem. The authors divided the task into three di erent problems* Automatic speech to te1t conversion 2. Automatic translation o arbitrar! ,nglish te1t into suitable representation o &ndian sign language. >. /ispla! o this representation as a se-uence o sign using computer graphics techni-ues /eveloped s!stem achieved accurac! o identi ication o the signed phrases o ?2@ or complete phrases A 72@ or sign units. "owever# the eedback o dea users and post o ice clerks were ver! encouraging or urther development. A group o >2 researchers at /ePaul .niversit! participated in developing an automated American sign Language '!nthesizer. 'uszczanska. et. <>= developed a s!stem to translate te1ts written in Polish Language into Polish 'ign Language. The! used Avatar as well with a dictionar! o ?88 signs. 'carlatos. ,t.al. introduced a s!stem to translate speech into video clip o the American 'ign Language 4A'L5. The s!stem displa!s the A'L clips along with the written words. The! used a built+in speech recognition engine in the Macintosh operating s!stem. This added a limitation as this engine can onl! recognize words rom a pre+de ined set.
The! plan to e1tend the s!stem to recognize more words and later or phrases. 'an+'egundo# and others# developed a s!stem to translate speech into 'panish 'ign Language. Their s!stem is made up o our modules* speech recognizer# semantic Anal!sis # gesture se-uence generation and gesture pla!ing. %or the speech recognizer# the! used modules developed b! &BM. %or the semantic anal!sis the! used modules developed b! the .niversit! o (olorado. %or gesture se-uence generation the! used the semantic concepts associated to several 'panish 'ign
Language gestures. %or gesture animation the! developed an animated character and a strateg! or reducing the , ort in gesture generation . The strateg! consists o making the s!stem generate automaticall! all agent positions necessar! or the gesture animation Towards the development o automated speech recognition or vocall! disabled people a s!stem called :Bolta! "aath; <B= is developed to recognize :Pakistan 'ign Language;4P'L5 at 'ir '!ed universit! o engineering and Technolog!. The Bolta! "aath project aims to produce sound matching the accent and pronunciation o the people rom the sign s!mbol passed. A wearing /ata Clove or vocall! disabled is designed# to trans orm the signed s!mbols to audible speech signals using gesture recognition. The! use the movements o the hand and ingers with sensors to inter ace with the computer.
2.2 PURPOSE
To represent the American 'tandard 'ign Language this can be understood b! the dea and the dumb. De#i$% &et'()(l($! /esign o the paper is based on the principle o Dspeech recognition3 where the speech is converted to the te1t and passes the command as isolated words to hardware which represent the signs. Fi%)i%$ To provide a so tware package to convert the speech signal# into the sign language.
S(*ial *au#e To bridge the communication and e1pression gap between the normal people who cannot understand the sign language# and the dea and dumb who cannot understand the normal speech.
3. COMPONENT SELECTION
3.1 Mi*r(*(%tr(ller Ba#i*#
6
)hat are microcontrollers and what are the! used orE As all other good things# this power ul component is basicall! ver! simple and is obtained b! uniting tested and high+ -ualit! :ingredients; 4components5 as per ollowing receipt* 2. The simplest computer3s processor is used as a :brain; o the uture s!stem. >. /epending on the taste o the producer# it is added* a bit o memor!# a ew AF/ converters# timers# inputFoutput lines etc. G. &t is all placed in one o standard packages. B. 'imple so tware that will be able to control it all and about which ever!one will be able to learn has been developed.
Mi*r(*(%tr(ller Sele*ti(%
A microcontroller is basicall! selected depending upon 2. Availabilit! o component. >. Availabilit! o development tools G. Present market trend ARM+ ,LPC213-. The LP(>2G7 microcontrollers are based on a G> bit AHMI with real+time emulation and embedded trace support that combines the microcontroller with J2> kB o embedded high speed %lash memor!. /ue to their tin! size and low power consumption# these microcontrollers are ideal or applications where miniaturization is a ke! re-uirement# such as access control and point+o +sale.
Table G.2 /B+6 (onnector Pin Out DB/0 C(%%e*t(r Pi% Out Pi% 1 Si$%al Na&e 1 2 3 3 4 5 + 0 (/ HL/ TL/ /TH C$/ /'H HT' (T' H& Si$%al De#*ri2ti(% (arrier /etect Heceive /ata Transmit /ata /ata Terminal Head! 'ignal Cround F (ommon /ata 'et Head! He-uest To 'end (lear To 'end Hing &ndicator
T6D7 Transmit /ataK the data sent rom the /ata Terminal and received b! the /ata 'et. R6D7 Heceive /ataK the data sent rom the /ata 'et and received b! the /ata Terminal. DTR7 /ata Terminal Head!K .sed b! the /ata Terminal to signal to the /ata 'et that it is read! or operation# active high. DSR7 /ata 'et Head!K .sed b! the /ata 'et to signal to the /ata Terminal that it is read! or operation and read! to receive data# active high. RTS7 He-uest To 'endK .sed b! the /ata Terminal to signal the /ata 'et that it ma! begin sending data. The /ata 'et will not send out data without this signal# active high. CTS7 (lear To 'endK .sed b! the /ata 'et to signal the /ata Terminal that it ma! begin sending data. The /ata Terminal will not send out data without this signal# active high.
CD7 (arrier /etectK .sed b! the /ata 'et to indicate to the /ata Terminal that the /ata set has detected a carrier 4o another device5. RI7 Hing &ndicatorK .sed b! the /ata 'et to indicate to the /ata Terminal that a ringing condition has been detected. GND7 CroundK The common return or all signals on the inter ace.
%ig G.> L(/ A model described here is or its low price and great possibilities most re-uentl! used in practice. &t is based on the "/BBI78 microcontroller 4"itachi5 and can displa! messages in two lines with 2? characters each. &t displa!s all letters o alphabet# Creek letters# punctuation marks# mathematical s!mbols etc. &n addition# it is possible to displa! s!mbols that user makes up on its own. Automatic shi ting message on displa! 4shi t le t and right5# appearance o the pointer# backlight etc. are considered as use ul characteristics.
10
11
12
13
%or doing so we have used the method o M%(( coe icients. )e have used M%(( because it resembles the human ear in man! wa!s.
The output o the human ear is linear above 2 k"z and so is the output o M%(( and the output is logarithmic above 2 k"z or the human ear as well as M%((. 'o it resembles the human auditor! eatures.
3.3.2 Mel/Fre8ue%*! Tra%#<(r&ati(% According to ps!choph!sical scientists# "uman hearing perception o re-uenc! contents is not linear. &t is linear up+to 2888 "z and logarithmic over 2888 "z. This logic can be implemented b! using this ormula# Mel+ re-uenc! M>J6JNlog 42Olinear re-uenc!FI885 Mel re-uenc! cepstral coe icients ,ach region on the basilar membrane acts as a ilter bank. There are more receptors or re-uencies rom 8+2Phz and the number decrease rapidl! thereon. Mel ilter banks are used to simulate this
14
15
4. FUTURE SCOPE
B! American 'tandard 'ign Language with speech recognition #it is possible to speak directl! with a robot without an! ph!sical engagement to communicate with the dumb and dea easil!. &t is easil! possible to make a so tware package to automaticall! install in video and movie services with the help o set top bo1 and record the speech words and at the time o testing 4pla!ing the movie5 represent the sign language b! animated hand at the corner o screen.
16
5. REFERENCES
<2= (o1 et. al.#Automated Speech Recognition Approach to Continuous cue-Symbols Generation, &nternational Qournal o Power (ontrol 'ignal and (omputation 4&QP('(5 9ol. > $o. 2# March 266>. <>= '. %urui#Speaker independent isolated word recognition using dynamic features of speech spectrum# &,,, Transactions on Acoustic# 'peech# 'ignal Processing# 9ol. GB# $o. 2# pp. J>+J6# %ebruar! 267?. <G= Mahdi 'haneh# and Azizollah Taheri# oice Command Recognition System !ased on "#CC and $ Algorithms# )orld Academ! o 'cience# ,ngineering and Technolog!. <B= Andrew 'loss# :AHM user guide;# Person Publication. <J= Haj Pamal# :,mbedded s!stems; McCraw+"ill# 'econd ,dition. <?= http*FFen.www.)ikipedia.orgF wikiFAmericanR'ignRLanguage. <I= http*FFwww.alldatasheet.comFview.jspE'earchwordMLP(>2G7.
17