MIT/GEN/F-05/R0

MANIPAL INSTITUTE OF TECHNOLOGY

(A constituent Institute of Manipal University Manipal!
Manipal "arnata#a 5$% &0'
DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING
COURSE PLAN
Department : Electronics and Commnication En!ineerin!
S"#ect : SOFT COMPUTING TEC$NI%UES& ECE '()
Semester * "ranc+ : ,II ECE
Name o- t+e -aclt. : T/0/Padma S+ri
No o- contact +ors12ee3 : '
Assi!nment portion
Assi!nment no/ Topics
4 L4 5 L46
( L47 8 L9(
9 L99 8 L':
Test portion
Test no/ Topics
4 L4 8 L(4
( L(( 8 L'(
S"mitted ".: T/0/Padma S+ri
;COORDINATOR<
;Si!natre o- t+e -aclt.<
Date: ='5=:5(=4'
Appro>ed ".:
;Si!natre o- $OD<
Date: ='5=:5(=4'
o- 9 4
MIT/GEN/F-05/R0
Course Objectives
At the end of this course, the student will be able to:
CO4: E?plain t+e "asic neral net2or3 arc+itectres in sper>ised and
nsper>ised learnin! modes and discss t+e "asic concepts o- statistical
learnin! t+eor./
CO(: Desi!n linear neral net2or3 classi-iers sin! al!orit+ms li3e error "ac3
propa!ation -or sper>ised learnin! and compare 2it+ t+eir statistical
conterparts sc+ as @a.esian classi-ier/
CO9: Discss t+e learnin! isses related to on line trainin! o- neral net2or3s
sc+ as learnin! rate& cross >alidation& dimensionalit. redction and
annealin!/
CO': Anal.Ae and compare t+e per-ormance o- 0ernel "ased sper>ised
learnin! met+ods sc+ as Spport >ector Mac+ines& Radial @asis Fnctions
and nsper>ised learnin! met+ods li3e sel-5or!aniAin! maps/
CO): Desi!n d.namic associati>e memories and appl. d.namic net2or3s -or
optimiAation pro"lems/
CO6: Desi!n simple -AA. rle "ased s.stems -or -nction appro?imation/
CO7: E?plain t+e application o- so-t comptin! tec+niBes -or mlti o"#ecti>e
optimiAation pro"lems/
Lectre no/ Topic to "e co>ered
4 Introdction: Model o- neron& -eed"ac3& Net2or3 arc+itectres&
0no2led!e representation
( Fndamental Learnin! processes& Learnin! Tas3s
9 Rosen"lattCs perceptron: Introdction& Perceptron&
' TUTORIAL
) T+e perceptron con>er!ence t+eorem
6 Relation "et2een t+e perceptron and @a.es classi-ier -or a Gassian
en>ironment
7 T+e "atc+ perceptron al!orit+m
: TUTORIAL
D Mltila.er perceptrons : @atc+ learnin! and online learnin!&
4= EOR pro"lem& T+e "ac3 propa!ation al!orit+m
44 T+e +essian and its role in online learnin!/
4( TUTORIAL
49 Optimal annealin! and adapti>e control o- t+e learnin! rate
4' GeneraliAation&
4) Cross >alidation Applications
46 TUTORIAL
47 0ernel met+ods/
4: Radial "asis -nction ;R@F< net2or3s
4D 3 means clsterin!
(= TUTORIAL
(4 $."rid learnin! procedre -or R@F net2or3s
(( Spport >ector mac+ines
(9 Principal component anal.sis
(' TUTORIAL
() Sel-5or!aniAin! maps
(6 Applications
(7 D.namical s.stems&
o- 9 (
MIT/GEN/F-05/R0
(: TUTORIAL
(D Discrete time and !radient t.pe $op-ield net2or3s&
9= Applications in optimiAation pro"lems&
94 @asic concepts o- recrrent ato associati>e and +eteroassociati>e
memories
9( TUTORIAL
99 stora!e and retrie>al al!orit+ms
9' Ener!. -nction redction/
9) applications
96 TUTORIAL
97 FAA. Lo!ic: Introdction5@loc3 dia!ram representation o- t+e di--erent
t.pes o- -AA. s.stems
9: concept o- mem"ers+ip -nctions
9D @rie- comparison o- classical sets and -AA. sets&
'= TUTORIAL
'4 @asic operation on -AA. sets& composition o- -AA. relations
'( Pro#ection and c.lindrical e?tension& e?tension principle/
'9 Lin!istic >aria"les& -AA. IF5T$EN rles5-AA. propositions
Implications/
'' TUTORIAL
') FAA. lo!ic and Appro?imate reasonin!& FAA. rle "ase& strctre o-
-AA. rle "ase and properties o- set o- rles/ FAA. in-erence en!ine
'6 FAAi-iers& De-AAi-iers& Desi!n o- FAA. rle "ased s.stems
'7 Introdction to Nero -AA. s.stems 2it+ GA optimiAation
': TUTORIAL
REFERENCES:
4 SIMON $AF0IN& GNEURAL NETHOR0S AND LEARNING
MAC$INESI& T$IRD EDITION, PHI EDITION PRIVATE LIMITED,
NEW DELHI, (==D
( JACE0 M KURADA& GINTRODUCTION TO ARTIFICIAL NEURAL
SFSTEMSI& JAICO PUBLICATION. (==6
9 LI EIN HANG& GINTRODUCTION TO FUKKF SFSTEMS AND
CONTROLI& PRENTICE HALL PUBLICATION, 4DD7
' TIMOT$F J ROSS& GFUKKF LOGIC HIT$ ENGINEERING
APPLICATIONSI& INTL. EDITION, MCGRAW HILL PUBLICATION& (==:
) S$I,ANANDAM * DEEPA& GPRINCIPLES OF SOFT
COMPUTINGI& WILEY INDIA EDITION, (==D
6 JANG J S R& SUN C T& MIKUTANI E& GNEURO5FUKKF * SOFT
COMPUTINGI& PHI &4DD7

EVALUATION PLAN:
ASSIGNMENT: 4= MAR0S
SESSIONAL: '= MAR0S ;( SESSIONAL& (= MAR0S EAC$<
END SEMESTER EEAM: )= MAR0S
o- 9 9