Вы находитесь на странице: 1из 177

( )

..

PDF created with pdfFactory trial version www.pdffactory.com

2002

621.398
84
621.398.724(072)

:
., -. . .., ., -. . ..
-
..
:
. .: , 2002. 176 .
ISBN 5-7046-0832-9
, ,
, ,
.

TRAJAN,

(
).
,
.

ISBN 5-7046-0832-9

, 2002
2

PDF created with pdfFactory trial version www.pdffactory.com

.....

1.
....
1.1. ...
1.2. .....
1.2.1. ..
1.2.2. ..
1.2.3. ........
1.2.4. .
1.2.5. ........
1.2.6. ......
1.2.7. .......
1.2.8. ...
1.2.9. .
1.2.10. ....
1.3. ...........
1.4. ........
1.4.1. ....
1.4.2. ....
1.4.3. ..
1.4.4. .
1.4.5. ..
1.4.6. .
1.5. ...
1.5.1. ..
1.5.2. ..
1.5.3.
....
1.5.4. ,

..........................
1.5.5.
.
1.5.6.
1.5.7. .
1.6. .....
3

PDF created with pdfFactory trial version www.pdffactory.com

10
10
12
12
12
13
13
14
14
15
15
15
15
16
18
18
20
21
25
25
28
29
30
34
41
43
43
45
45
45

2.
.
2.1. .....
2.1.1. .
2.1.2. .
2.1.3. ..
2.2. ..
2.2.1. ....
2.2.2. ...
2.3. .....
2.4. .....
2.4.1. ..
2.4.2. ..
2.4.3. ....
2.5. ..
2.5.1. ..
2.5.2. .
2.5.3. .
2.5.4. ....
2.5.5. ....
2.6. ART- ...
2.6.1. ..
2.6.2. ART-1 ..
2.6.3. ...
2.6.4. ...
2.6.5. ....
2.6.6. ....
2.6.7. ART- ..

47
47
47
48
49
50
51
52
52
58
58
58
62
64
64
66
68
73
74
76
76
76
77
81
81
86
86

3.
..
3.1. .....
3.2. TRAJAN ....
3.2.1. ....
3.2.2. ..
3.2.3. ....
3.2.4. ....
3.2.5. .
3.2.6. ...
3.2.7. ..
3.2.8. ..

88
88
88
88
89
89
89
89
89
89
90

PDF created with pdfFactory trial version www.pdffactory.com

3.2.9. ..
3.3. TRAJAN ...
3.3.1.
3.3.2. ....
3.3.3. ..
3.3.4. ....
3.3.5. ....
3.3.6. ....
3.3.7. .

90
90
90
91
91
91
92
92
93

4. .....
4.1. ....
4.2. .....
4.3. ....
4.4. .....
4.4.1. ....
4.4.2. , ....
4.4.3. Analog Devices .
4.4.4. Texas Instruments Inc. .
4.4.5. Motorola ...
4.4.6. , ....

95
95
95
97
112
112
112
116
118
127
128

5. ...
5.1. .
5.2. , .
5.2.1. ,
...
5.2.2. ,

....
5.3. , ......

131
131
131

6. ...
6.1. 1.
....
6.2. 2.
......
6.3. 3. .....
6.4. 4. ..
6.5. 5. .....

PDF created with pdfFactory trial version www.pdffactory.com

132
143
148
151
151
154
157
159
162

...

166

....

167

..
.
NeuroMatrix NM6403 ..........
NeuroMatrixR NM6404 .......
16 Siemens .....
.
ADP6701PCI
TMS320C6701
DSP60V6
...
ISA- ZISC 036 IBM
PCI- ZISC 036 IBM ....
Synapse 2 Siemens .
......

168
168
172
172
172
173

PDF created with pdfFactory trial version www.pdffactory.com

173
173
174
174
174
175


-
-






(RAM)

(ROM)


(DSP) (Digital Signal Processor)





(, CPU) ( , Cental
Processor Unit)
ART (Adaptive Resonance Theory
)
CIL Chip-in-Loop ( )
CPLD (Complex Programmable Logic
Device)
CPS (Connection per Second)
CUPS (Connection Update per
Second)
DARAM
EPROM
FPU , (Floating-point Unit)
INNTS Intel Neural Network Training System ( )
I/O - (Input/Output)
MFLOPS (Million Floating-Point
Operation per Second)
MIMD (MultipleInstruction and Multiple-Data)
MIPS (Million Instruction per Second)
MMAC
SBSRAM
SDRAM

SHARC (Super Harvard ARChitecture,


Analog Devices)
SIMD
(Single-Instruction and Multiple-Data)
SNNS Stuttgart Neural Network Simulator ( . , )
7

PDF created with pdfFactory trial version www.pdffactory.com



.
1940- . ,
, ,
1943 ., , ,
,
.
. ,
1949 . ,
,
. , ,
[6].
1958 . . ,
[7], -1.

,

, ,
, .
, 1950- 1960-. ,
1968 1985 .
1985-1986 .
,

[3].
,
, .
( 1992 .) [8].
, ,

.
,
, ,
[9].

.
,
50 , ,
.
,
.
8

PDF created with pdfFactory trial version www.pdffactory.com




, , -,
.
,


.
, ,
,
. ,
, -,
,
, [8, 9].
, ,
,
.

PDF created with pdfFactory trial version www.pdffactory.com

1.

1.1.

, ,
(..
).
,
,
.

. 1.1. ,

10

PDF created with pdfFactory trial version www.pdffactory.com

1.1.




( )

(Cash-flow)




-



11

PDF created with pdfFactory trial version www.pdffactory.com


. ,
,
. [8].
,
(. 1.1):
;
;
;
;
;
;
.

1.2.

. 1.1. , ,

.

[14].
1.2.1.




. : -,
, . .
, -,
.
,

.
1.2.2.



.
-
Windows (
) 36 ,
.
,

12

PDF created with pdfFactory trial version www.pdffactory.com

(1000 , 24 , 6 ),
6 .

, 6 ;
.
NeuroWindows,
.
19 .
1.2.3.



.
,
, , ,

.

(
Neural
Innovation
Ltd.),
,
, ,
, , , ..

.
1.2.4.



, .
,
, ,
.
,
,
.
( IBM Consulting),
,
.

,
.

(, , 5 ,
). ,
:

13

PDF created with pdfFactory trial version www.pdffactory.com

,
.
( GoalAssist Corp.)
NeuroShell
Classifier ( Ward Systems Group).
,
,
4 .

NeuroShell Predictor ( Ward Systems Group),
.

4,0 %.
1.2.5.




. ,
,
,

.
,
.

( Neural Technologies)
,
,
,
,
. ,
, ,
.
1.2.6.


Claim Fraud Analyser ( Neural
Innovation Ltd.)
,
. ,
, ,
.

, .
,
14

PDF created with pdfFactory trial version www.pdffactory.com

1.2.7.


Falcon ( HNC),

,

. , 260
16 ,
.
( ITC),
VISA, 1995 .
100 .
1.2.8.


(
) "
" ( ),
, ,
.
,
- 2000 ,
.
200
,
.
1.2.9.


,
730
. ( 2,5
, ITC) ,
38,0% ,
14,0 %.
1.2.10.
,
, , ,
, , .. ,
.
, -,
.
15

PDF created with pdfFactory trial version www.pdffactory.com

,
.
( Attrasoft)

, , 13
. ().
. ()

.
,

.

1.3.
,
,
,
.
(
AT&T Bell Laboratories) . , .

,
. :
, , ,
.
9000 ,
, .
1988 . . 1.2
() ,
().
, ,
, ,
. , ,
95,0%,
.
,
,
, .. ,
,
.
,
.
16

PDF created with pdfFactory trial version www.pdffactory.com

. 1.2. , .
() ()

17

PDF created with pdfFactory trial version www.pdffactory.com

()
16 16 . 1988 .
, ,

, .
1988-1990 .
, 5 5 7 7 ,
180 .

, .
,
167693 .
0,14 %
,
, 5,0 %
. ,

.

1.4.
1.4.1.
, .
,
,
.

() .

,
.
,
,
.

, ,
.
, , ,
, , , , , ,
.
,
.
18

PDF created with pdfFactory trial version www.pdffactory.com

:
, ,
,
.

,
, .
,
: , -
. ,
,
.

. ,


( 90,0 %).
-

, .. , .

:
,
;

;
,
,
;
,
, ,
, ,
, ,
..
, ,
: -
,
. , ,
.
.

:

19

PDF created with pdfFactory trial version www.pdffactory.com

;
.
, -,
, ,
.
, -
.
:
1.
. ,
, (
), ( 5 15)
.
2.
,
.
3. .
,
, .
,

( ),
, , .
,

, .
1.4.2.

(. 1.3):
.
-
.
, , ,
(
) .
, .

,
.
( )
, , .

20

PDF created with pdfFactory trial version www.pdffactory.com

. 1.3.



.
,
.
, .
,
.

,
.
, ,
,
.
1.4.3.

(. 1.4).
, ,
,
, , , ,
.

Figaro Co. Ltd. ( 1 TGS 109; 2
3 TGS 822; 4 TGS 813; 5 TGS 821; 6 TGS 824;
7 TGS 825; 8 TGS 842; 9 TGS 880),
( 10 NH-02)
( 11 12 5KD-5).

21

PDF created with pdfFactory trial version www.pdffactory.com


,
.

(..
), , ,
.
,
, , ,
.

( ) ,
( ). ,

.

(. 1.4).

: 11 6 6,
(. 1.5)
ART-.

. 1.4.

22

PDF created with pdfFactory trial version www.pdffactory.com

. 1.5. ,

1.2. ,

1

11 (. ); 6 (. ); 11 (. )

0,10

0,90

1369
ART-

0,98

0,80

23

PDF created with pdfFactory trial version www.pdffactory.com

1.3.

67

28

75

, %

ART-

96,4

96,4

22

100,0

100,0

64

14

100,0

100,0

93

28

92,9

100,0

0,0

66,7

106

25

100,0

96,0

74

27

100,0

92,6

66

21

81,0

95,2

68

26

92,3

76,9

10

0,0

0,0

92,9

93,4

619

2
196

,
,
.

: , ,
, .
, .
,
ART-,
. 1.2.

. ,
,
.
,
, .
24

PDF created with pdfFactory trial version www.pdffactory.com


, .

.
( ) 89,7 %
98,2 % ,
. . 1.3
.

,
(. 1.6 1.7),
,

( 90,0 %).
(. 1.6),


.
, ,
, , . 1.7 c, d, e ,
.
1.4.4.

,
. ,

,
.

(,

) 40
.
-

. , ,
, , ,

.

;
; ;
, , ;
;
.
25

PDF created with pdfFactory trial version www.pdffactory.com

. 1.6.

26

PDF created with pdfFactory trial version www.pdffactory.com

. 1.7.

27

PDF created with pdfFactory trial version www.pdffactory.com

1.4.5.

,
.

, ,
..
, , ,
.
,
.


. ().
,
.

,
.
,
.
, ,
. ,

,
.
1.4.6.

.

, .

, ,
; ; ,
; ;
; ;

()

;
..


, ( , ) .
28

PDF created with pdfFactory trial version www.pdffactory.com



. ,

. ,
, ,
, ,
..

1.5.

.

, .

, ,
.
,
.

, , ,
.
,
. ,
, , ,
, .
, , ,

. ,
,
.
, ,
.
:

,
, .

, , .
,
29

PDF created with pdfFactory trial version www.pdffactory.com


(
. . 1.5.4).
1.
.

,
. ,
,
.
2. .
, :
, ,
. ,
,
,
.
3.
. ,
,
.
.
, ,
,
.
4.

.

"" , ,
.
1.5.1.


, ( )
.
[T(n+1), T(n+f)], T(n)
, f .
,
,
(, , ..).
,
(. 1.8).
30

PDF created with pdfFactory trial version www.pdffactory.com

. 1.8. ,

.
, , .
,
, () .
( ), . .
,
.

, , , .
, , ,
, .

.
.

, .

31

PDF created with pdfFactory trial version www.pdffactory.com

( ).
, ,
.
.
Wi Wo n m
. s
,
. Wi n
, Wo m.
( )
Wi Wo
.. .
1.1.

:
(. 1.4.)
( k = 16).
1.4.
1

10

11

12

13

14

15

16

100

94

90

96

91

94

95

99

95

98

100

97

99

98

96

98

:
.
:

.
:
1. :
( ) n = 4;
m = 1;
() s = 1.
32

PDF created with pdfFactory trial version www.pdffactory.com

2.
() (. 1.5).

Wi Wo (s = 1).
, ,
P.

, ,
.
1.5. ,

100

94

90

96

91

94

90

96

91

94

90

96

91

94

95

96

91

94

95

99

91

94

95

99

95

..

,
. 1.4 . 1.5.
,
99, 98, 96, 98 (. . 1.4), (k+1)-
, , 95.

.
.
.

( , ,
).
33

PDF created with pdfFactory trial version www.pdffactory.com

(k+1)- ,
. 1.4, 95, 95, 96
, (k+2)-
98, 96, 98, 96.
.

.
(
), k+1, k+2 ..
k+2, k+3, k+4
..
(k+2)-
98, 96, 98, 95,
. .
1.5.2.

.

:
,
( ),
.
:
;
;
;
;
.
,
1984 - 1989 .
,
( )
-.
- 1987
Stockwatch Alert Terminal (SWAT) II
.
,
, ,
. Mellon
Bank () Neural-Works
Professional II/Plus 5,0 Neural-Ware (, )
34

PDF created with pdfFactory trial version www.pdffactory.com

,
,
,
.

,
(UCL).
TBS Bank Technology
UCL Henley.
, Chemical Bank,
Citibank, JP Morgan .


.

:
, , , , , , ,

.
,
. ,

. 1992
(.
, ).
25,0 50,0 ,
25,0 % .

. , Hill
Samuel Investment Management

.

57,0 %.
TSB General Insurance (. , )

.
.


35

PDF created with pdfFactory trial version www.pdffactory.com



.

: ,
, .
,
, ,
.
,
;
. ( )
, ,
( ),
,
.
( )
-
, , ,
- , .

(
).
, . ,
(
).
,


. ,
,

.

.
1.
( ,
, );
2.
(
,
,

36

PDF created with pdfFactory trial version www.pdffactory.com

: ,
);
3.
;
4.
,
(
).

.
,

. 34 .
,

.
(
,
).
, , 34 .


.

, ,

. ,
,
. , Bank of New York,
100
. , 90,0 %
.
( )

.
( )
,
- .
, , ,
,
( ) .
37

PDF created with pdfFactory trial version www.pdffactory.com

, .
, ,

(Reuters, Dow Jones Telerate, Bloomberg, Tenfore).

, - ,

.
, ,
- ,
510
,
. ,

.
,
. ,
16:00
- -
,
17:30 .
:
: ,

;
;
;

.
,
,
.

( Alela Corp.),
Dow Jones, S&P500 Merval.

, ,
, 80,0 %.
, ,
( Mitsubishi).

, 33 , ,
, ..
38

PDF created with pdfFactory trial version www.pdffactory.com


, .
,
, 19,0 %.



,
.


. ,
.
-

.

:
.
:


( , - )

;
,
,
, ; ,
,
;


.

,
.



,
.

39

PDF created with pdfFactory trial version www.pdffactory.com


,
, ..
. ,
, ,
.
:
;

.


.
. ,
,
:
- REUTERS;
;
.
.
200

.
,
, , , .

, .


, ,
, , ,
, .



.
,

-
. ,
,
40

PDF created with pdfFactory trial version www.pdffactory.com

.
,
. ,

.
, ,
,
, . , ,

.
, ,

.
1.5.3.



Sun SPARCstation LX Logica
Chemical Bank.
( 1993 ). -
1 1992 1 1993 ,
: ,
, , , .

55,0 % , ,
23,0 % .



(UKB/USD).

.
UKB/USD.

.
.
:
;
;
;
41

PDF created with pdfFactory trial version www.pdffactory.com

;
.
UKB/USD
.
,

.
DM/USD
SUR/USD UKB/USD.
UKB/USD 15.06.93 26.06.95 842 (
Porto-Franco).
(
).
:
1. .

() .
,
:
sKt = (Kt+1 - Kt)/Kt .

(1.1)

2.
.

,


,
.
1500
, . ,
,
,
.
3. .
4,0-5,0 %
. ,
80,0 %.
4. .
,
, () .

42

PDF created with pdfFactory trial version www.pdffactory.com

1.5.4. ,

1. , ,
( ).
,
. ,
,
- ,
..


50 100 .
:
. ,

.
.
2.

.
,
,

. ,


. , 1,0
, ,
.

,
.
3.
, , ,
,
,
.
1.5.5.


1990 .
43

PDF created with pdfFactory trial version www.pdffactory.com

Brain Maker alifornia Scientific Software.



:

;

;
, ,
, .
,

:
1.

,


.

.
2.


.
7 14 . ,
, ,
,
,

. .

, ,

.
3.
,
,
,
,
.
, (
) .

44

PDF created with pdfFactory trial version www.pdffactory.com

,
.
4.
.
, ,
.

,
.
1.5.6.
(
ZSolutions) ,
.
15 , ,
.
,
.


.
1.5.7. [9]


( Aspen Technology NeuralWare Inc., 1997 .).
,
.
, NeuroShell
( DuPont).
, Urals
,
. ,
:

.

45

PDF created with pdfFactory trial version www.pdffactory.com

1.6.
,
[8].
1.

. ,
. ,
:
,
. ,
, .
2. ,
.
,
.
3. ,
, , ,
.
4.
,
. ,
,

.
5. , ,
,
,


, .
,

.
6.
, .
,
, , .
7.
,
.
8.
,
,
.
46

PDF created with pdfFactory trial version www.pdffactory.com

2.

2.1.
2.1.1.
,
.
.
, ,

.

. 2.1. ( )

(Cell) (Nucleus),
(. 2.1) (Dendrites),
(Carries signals in), (Axon),
47

PDF created with pdfFactory trial version www.pdffactory.com

(Carries signals away).



(Synapses), .
,
, ( )
.
2.1.2.
( )
.
,
, .

, .
, ,
(), ,

.
2.2.

. 2.2.

yj , j;
sk ;
fk ; yk

48

PDF created with pdfFactory trial version www.pdffactory.com


wi,
.

:
n

s = xi wi ,

(2.1)

i=1

x , w .
2.1.3.
, ..
y = f(s) .

(2.2)

f(s) ,
.
,
, . 2.3.

a)

b)

t
c)

. 2.3.
) ; b) ; c)


(s- ) , . 2.3 .

f ( x) =

1
1 + e - ax

(2.3)

49

PDF created with pdfFactory trial version www.pdffactory.com

a ,
a=0 0,5;
a
T x=0.
,
[0,1].
,
:
f ( x ) = a f ( x) (1 - f ( x)) .

(2.4)

,
, .
,
, ,
, ,
.

.
,
, , , [6, 7, 8].

,
.

,
,
.
,
,
(. 2.4).
, ,
.

2.2.
, , . . ,
, .
, ,
,
w.
, ,
,
50

PDF created with pdfFactory trial version www.pdffactory.com

.
: ,
. ,

.

: .

. 2.4.

2.2.1.
,
,
.
,
, .
.
.
,
, ()
,
, .
,
,
.

51

PDF created with pdfFactory trial version www.pdffactory.com

2.2.2.
,

.
,
.

,
, .
,
?
. (. 2.4)
, ,
,
.
.
,
, . .
.
, ,
.
,
,
.
,
, .
.
, .

2.3.

,
,
.
.
,
,
, ,
.

.
52

PDF created with pdfFactory trial version www.pdffactory.com



E (w) =

1
( y (n) - d j , p ) 2 ,
2 j, p j, p

(2.5)

y (jn, )p j n
p- ; djp
() .

, .
, :
Dwij( n) = -h

E
.
wij

(2.6)

wij , i-
n1 j- n, h ,
0 < h < 1.
[8],
E
E dy j s j
=
,
wij y j ds j wij

(2.7)

yj, j, sj
, . . .
dyj/dsj
, ,
.

. ,
,
.
dy
= 1 - s2 .
ds

yi

(n-1)

(2.8)

sj/wij

.
(2.7) [8]:

53

PDF created with pdfFactory trial version www.pdffactory.com

E dy k ( n +1)
E dy k s k
E
=
=
w jk
,
y j
k y k ds k y j
k y k ds k

(2.9)

k n+1.

d (jn) =

E dy j

.
y j ds j

(2.10)

dj(n) n
dk(n+1) n+1.

dy j
d (jn) = d (kn+1) w (jkn+1)
.
k
ds j

(2.11)


d l(n) = ( yl(n ) - d l )

dyl
.
ds l

(2.12)

(2.6) :
Dwij(n) = -h d (jn) y i( n-1) .

(2.13)

,

, (2.13)
:
Dwij(n) (t ) = -h (m Dwij(n ) (t - 1) + (1 - m) d (jn) y i(n -1) ) ,

(2.14)

m , t .
,
:
1.
,
,
m

s (jn ) = y i( n -1) wij( n ) ,

(2.15)

i =0

54

PDF created with pdfFactory trial version www.pdffactory.com

m n1
+1, ; yi(n-1)=xij(n) i-
j n
yj(n) = f(sj(n)), f ;
yq(0)=Iq,

(2.16)
(2.17)

Iq q- .
2. d(n) (2.12),
(2.13) (2.14) Dw(n) n.
3. (2.11) (2.13) ( (2.12) (2.14))
d(n) Dw(n) , n=N1,...1.
4.
wij(n ) (t ) = wij(n ) (t - 1) + Dwij(n ) (t ) .

(2.18)

5. , 1.
.
1
, ,
, (. 2.5).

(n-1)
yi
(2.13) .
[8],
[0;1]
[0,5;+0,5],
, :

f ( x ) = -0,5 +

1
1 + e - ax

(2.19)

,
, (
). ,
Cd
Nw/Ny < Cd < Nw/Ny log(Nw/Ny) ,
.

(2.20)

Nw , Ny

55

PDF created with pdfFactory trial version www.pdffactory.com

. 2.5.

,
.
-, Nx Nh
Nx+Nh > Ny.
-, Nw/Ny > 1000.

, ,
56

PDF created with pdfFactory trial version www.pdffactory.com

(2.19), . ,
,
,
Nx .
, , ,
, ,
. , ,
, ,
.
,
.
() , ,
.
1 0 .
4 .
, , ,
.

, , ,

, ,
, (
) .
.
. -,
,


.
(2.11) (2.12)
. -,
, ,
. ,
.
, . .
, ,
,
. ,
.
, h 1, ,
, 0,1, .
,
, , h
57

PDF created with pdfFactory trial version www.pdffactory.com

,
.
,
, .

2.4.
2.4.1.

(Kohonens Self-Organizing Maps)
,
[12]. ,
, ,
(Backpropagation).
,
( ) ( ).
: , .
.
(
),
.
,

,

(
).
2.4.2.
. 2.6 ,
.
.
()
.

.
.
.
(. 2.6):
____
T
Wj = (wj1, wj2, , wjn) , j = 1, m
(2.21)
j- ,

58

PDF created with pdfFactory trial version www.pdffactory.com

. 2.6.

X = (x1, x2, , xn)T

(2.22)

.
( ) Xc
Wj .
(,
). ,
d (X, Wc) X,
, Wc ,
. ,
X, , -.

n-

n
R m- ( ).
,
() (Unsupervised
Learning).
(Cluster) .

().
:
?
59

PDF created with pdfFactory trial version www.pdffactory.com

, , n
, m .
X (2.22)
Wj (2.21) j-
( ).
"" c Wc,
X:
||X Wc|| = min ||X Wj||

(2.23)

index,
:
c = index min ||X Wj||.

(2.24)

X Wj = xi wij = netj = zj
T

(2.25)

i=1

"" .

-,
,
-.
-,
,
. ,
, .
:
____
wj(t+1) = wj(t) + h(t) dcj(t) [x(t) wj(t)],
j=1,m
(2.26)
wj(t) t- ,
dcj(t) (neighborhood
Kernel) h(t) .
h(t)

0 < h(t) < 1,


. .
.
60

PDF created with pdfFactory trial version www.pdffactory.com

, (2.26)
Wj
X Wj.

(. 2.7). . 2.6
. X
W5 c=5.
:
X. W4
W6. (). W3 W7
, .
1, 2, 8 9 c=5,
, X.

. 2.7.

( ).
i j :

61

PDF created with pdfFactory trial version www.pdffactory.com

_________________
z = (ki1kj1)2 + (ki2kj2)2 ,

(2.27)

ki1 ki2 x y i; kj1 kj2


j. :
-z2

dGauss(z) = e

(2.28)
2

dmexican-hat (z) = (1z ) e

-z2

(2.29)

cos (zp/2), z < 1


dcos (z) =
0.

(2.30)

, Wj
X .
h, d,
-.
2.4.3.

, . [a, b]
( ). ,
x (. 2.8).

x2

xk

x3

x1

. 2.8.

x1
. x1 : [a, b]
2 [a, x1] [x1, b]. x
a b:
dx/dt = h (bx)/2 + h(ax)/2 = h((a+b)/2x) .
62

PDF created with pdfFactory trial version www.pdffactory.com

(2.31)

x x1
Dx1 = h ((a+b)/2 x1) .

(2.32)

yi = xi (a+b)/2, (2.32)
:
Dx1 = h y1 .

(2.33)

x2
:
x2 = x1 + Dx1 = (a+b)/2 + y1 hy1 = (a+b)/2 + y1(1h) .

(2.34)

x3:
x3 = (a+b)/2 + y1(1h)2

(2.35)

:
xk = (a+b)/2 + y1(1h)k-1.

(2.36)

h [0, 1] xk (a+b)/2.
,
() ( ),
m x1, x2, , xm. ,

0 < x1 < x2 < < xm < b


[a, b].
(. 2.9):

x1

x2

x3

xm1

xm

b
(bq)/m

(bq)/m

(bq)/m

(bq)/m

. 2.9.
63

PDF created with pdfFactory trial version www.pdffactory.com

xi = a + (2i1) (bq)/2m,

i = 1, 2, , m .

(2.37)

, (2.37) xi, i = 1, 2, , m
,
dxi/dt = 0 .

(2.38)

m x m
,
[a, b] x [c, d], . . 2 .

.
.
,

[a, b]:
a < w11 < w12 < < w1m < b .

(2.39)

:
c < w21 < w22 < < w2m < d .

(2.40)

2.5.
2.5.1.
80-
.
(Feedforward Networks FF Nets),
(Feedback Networks).
[12]:
1. : n , .
() wij, :
"i, j N : i j : $1 wij

N N = {1, 2, , n}.
2. : ni nj
:
64

PDF created with pdfFactory trial version www.pdffactory.com

wij = wji ;

wii = 0 .

(2.41)

3. : {0,1}
{-1,1}. 0
1, 1, 1. .
() 1 1
,
.
.
,
.

O 1 1,

O = f(WO T) ,

(2.42)

in1

in2

in3

in4

w41

w42

w43

w34

w31

w32

w23

w24

w21

w12

w13

w14

out1

out2

out3

out4

. 2.10. , 4

65

PDF created with pdfFactory trial version www.pdffactory.com


. Recall-
.
,
. [12].
.
,
.
, .
,
() .
,
.
. . 2.10
.
2.5.2.
Xs s- , xsi i-
Xs.
[12].
1.
k -1
x x ,i j
wij = s = 0 si sj
,

,i = j
0

(2.43)

k .
2.
oi(0) = xi ,

1 i n ,

(2.44)

oi(0) i- () .
3. :
Repeat
n -1

oi (t + 1) = f h wij o j (t )
i =0

Until " 1 i n : oi (t + 1) = oi (t ) ,

(2.45)

66

PDF created with pdfFactory trial version www.pdffactory.com

oi(t) i- t.
(2.44), (2.45) :
O(t+1) = f(WO(t)) ,

t=1,2, ;

(2.46)

O(0) = X(0) ,

(2.47)

X , W , f -
.
j- :
z j = net j = wij oi .

(2.48)


1 , z j > 0
o j = f ( zi ) =
- 1 , z j 0

(2.49)

, ,
, , ..
. n-
X = (x1, , xn)T, :
xi x j , i j
wij =
, i = j
0

(2.50)

, W
Ti = 0, i=1, 2, , n, .

( (( x )x )) = (x ) = X

f(WX) = ( f wij x j ) = ( f xi x j x j ) = f

2
j

wij
(, 1/n).

,
(,
).

67

PDF created with pdfFactory trial version www.pdffactory.com

2.1.

:
+1

-1

-1

+1

() : X = (1,-1,-1,1)T.
4 ().
(2.50)
0 -1 -1 1

1 - 1
-1 0
W=
.
-1 1
0 - 1

1 -1 -1 0


X = f(WX).
:
1

-1

,
, .
2.5.3.

().
X1, , XK , :
Xj = (xj1, , xjn)T,

j = 1, 2, , k,

xji (j = 1, 2, , k; i = 1, 2, , n) i- j- .
(2.50) Ws s

68

PDF created with pdfFactory trial version www.pdffactory.com

(2.51)

x si x sj , s = 1, k , i j
wijs =
0 , s = 1, k , i = j

(2.52)

:
W = (W1+ +Wk)/n ,

(2.53)

n (,
).
(.. k ),
(2.52) k , ,
. k , (2.53)
k . k
.
k
n .
k , n (), ,
, .. j
s

x ji xsi

(2.54)

. (2.53)
p @ 0,99
:
k 0,15n

(n ) .

(2.55)

2.2.

(n = 1000).

150 (, ).
.
1. :
.
,
.
2. :
(2.43) (2.48).
69

PDF created with pdfFactory trial version www.pdffactory.com

3. :

,
, ..
oj(t+1) = oj(t) ,

j = 1, 2, , n

(2.56)

(2.56),
:
O = f(WO) ,

(2.57)

O .
, n ,
O .
2n ( n- ).

.
:

. .
(Cohen) (Grossberg) (1983)
,
.
, W = (wij)
, :

1) wij = wji
2) wii = 0

i j ;
i .

(2.58)

, ,
. ,
, .

E ( ),
.

( )
:
=-

1
wij xi x j + xiTi ,
2 i j i
i

(2.59)

70

PDF created with pdfFactory trial version www.pdffactory.com

xi i- , Ti i- .
, , E.
E ,
()
(), , .
:
, .
(2.43) (2.48)
.
,
E,
.
.
X=(x1, x2, , xn)T
E (2.59).

xiTi
i

, xi
Ti. ,
. (2.59) ,
:
=-

1
wij xi x j .
2 i j i

(2.60)

k s.
E (2.60)
:
=-

1
1
wij' xi x j - wijs x si x sj ,

2 i j i
2 i j i

(2.61)

wsij wij, s- ,
wij wij,
, , xsi i- s- .
s
(2.59):

71

PDF created with pdfFactory trial version www.pdffactory.com

1
wijs xsi xsj .
2 i j i

s = -

wijs xsi xsj

(2.62)

Es

(2.63)

i j i

xsi {-1, 1}, (xsi)2


. ,
wsij (2.63):

wijs xsi xsj = ( xsi ) 2 ( xsj ) 2


i j i

(2.64)

i j i

wsij = xsixsj
E (2.60)

wijs = xsi x sj .

(2.65)

s- ,
. k , ,

wij = wijs = xsi x sj .


s

(2.66)

2.3.

, 1 (. 2.11):

. 2.11.
72

PDF created with pdfFactory trial version www.pdffactory.com

:
0 1 1

W = 1 0 1 .
1 1 0


(sign) .
X=(1,-1,1)T.
.
(2.43) (2.48) :
O(1) = f(WX) = (-1,1,-1)T ;
O(2) = f(WO(1)) = (-1,-1,-1)T ;
O(3) = f(WO(2)) = (-1,-1,-1)T .
O(3)=O(2), 3- , ..
3- .

. , - ,
, X=(x1, , xn)T, xi i-
1, , xi=1, .

. . 2.12
, , . 2.12

().
.
2.5.4.
,
.
, ,
l :
f ( z j = net j ) = 1

(1 + e

- lz j

(2.67)

l ,
.
73

PDF created with pdfFactory trial version www.pdffactory.com

. 2.12.
,
()


:
:
W : wij = wji i j;
: wii = 0 i.

2.5.5.

(Traveling Salesman Problem, TSP).
,
, .
NP .

. .
.
74

PDF created with pdfFactory trial version www.pdffactory.com

,
. (x, i) 1 ,
x i- .
. 2.1 , A, B, C, D, E
: D B E A C.
n

n!
,
2n

.
.

2.1.
( )

x i, x
, i- , .. oxi ,
x i- .
E
:
,

;

.
, ,
:

75

PDF created with pdfFactory trial version www.pdffactory.com


A
B
C
E = o xi o xj + o yi o xi + o xi - n +

2 x i ji
2 x i y x
2 x i

D
+ dist xy o xi o y , i +1 + o y , i -1
2 x i y

(2.68)

:
,
;
,
;
,
n , :
;
. ,
x, i- ,
distxy y i+1
y i1.

wxi, yi, wxi, yi xi yj.

2.6. ART-
2.6.1.
ART (Adaptive Resonance Theory)
, (
) 1987-1991 . [12].
,
, . ,
,
(Backpropagation), ,

,
( , unsupervised learning).

. ,
() ,
. .

.
-.
ART , :
76

PDF created with pdfFactory trial version www.pdffactory.com

()
(). ART- :
ART-1: ,
1 0;
ART-2: ART-1- ;
ART-2a: ART-2-,
;
ART-3:
( ) ART-2;
ARTMAP: ART- (, ART-1 ART-2);
FuzzyART: , (Fuzzy
Logik) ART .
2.6.2. ART-1
ART- .
ART-1-
. ,

(, ) ,
.
.
, ()
.
(,
) .
.
. 2.13 ART-1-:
(Comparison Layer);
(Recognition Layer);
;
() Reset.
, Wij Wji
: i ()
F1, j () F2.
2.6.3.
(Comparison Layer)
( ).
I (Input) S,
(Bottom-up Matrix).
(Gain) g1 1.
V
(, ) ,
77

PDF created with pdfFactory trial version www.pdffactory.com

S. ( )
S [12]:
(2.69)

1, I i vi I i g1 vi g1 = 1
,
si =
0,

:
i- S 1, , ,
1;
g1 ( );
i- Ii I;
i- vi V (
).
2 3.

. 2.13. ART-1-
78

PDF created with pdfFactory trial version www.pdffactory.com

2.4.
, g1

(g1=0):
I=

V=

:
S=

2.5.
, g1 1

(g1=1):
I=

V=

:
S=

S ,
: V = (0, 0, , 0).
2.6.
, V

(g1=1):
I=

V=

79

PDF created with pdfFactory trial version www.pdffactory.com

:
S=

. . S :
S = I.
. 2.14 ART-1-
.

.
,
() .
, j-
I S, :

t j max

= max k t k = SWk = s i w ik
i =1
,

(2.70)

SWk S Wk.
j ,
Wj = (w1j, w2j,, wmj)
S. U
:

1, _ t j = SW j = max
uj =
0, _ _ ,

(2.71)

.. uj = 1,
Wj=(w1j, w2j, , wmj) S=(s1, s2, , sm) .
2.6.4.
ART-1- :
Wij (Bottom-up Matrix)
;
Wji (Top-down Matrix)

Wij (Bottom-up Matrix).
80

PDF created with pdfFactory trial version www.pdffactory.com

. 2.14. ART-1-

ART-1- (Gain) g1
g2. ,
.
g1 1,
I 1
1:
81

PDF created with pdfFactory trial version www.pdffactory.com

g 1 = ( I 1 I 2 ... I m ) (u1 u 2 ... u m ) .

(2.72)

g2 ; g2=1, ,
, 1:
g 2 = ( I 1 I 2 ... I m ) .

(2.73)

() reset 1 ( Reset ),
I S (
).
2.6.5.
ART-1-
.
1. :
(Bottom-up Matrix Top-down Matrix),
.
2. (Recognition): I
S, I,
.
3. (Comparison): V
I S.
V S .
4. (Search):
.
5. (Training):
.
.
. i = 1, 2, , m
, j = 1, 2, , n . wij
W (Bottom-up Matrix)

wij <

L
L -1+ m

(2.74)

i j , m
I, L (L > 1,
L=2). wij
.
82

PDF created with pdfFactory trial version www.pdffactory.com

(Top-down matrix) W
: wji=1 j
.
(, Vigilance) p 0
1 ( p [0;1] ) .
p ( 0)
. p=1
() ()
.
. ()
: I = (0, 0,, 0).
g2=0. .
V (Top-down Vector).
I
() : g1=1 g2=1.
2 3 ,
Ii=1. S,
I. j
Wj S:
tj = netj = Wj S .

Wj S. j
()
(), .
(2.55) , j- U (
Top-down ) 1.
.
. j
,
, (1).
wji Top-down.
. i
vi, wji (1 0):
vi =

u j w ji

j Re cog

= w Ji .

(2.75)

83

PDF created with pdfFactory trial version www.pdffactory.com

I j-
1, (2.72) g1=0,
1.
S.
V I.
V I ,
S 0, . . S = V I = WJ I.
2.7. ART-1-
, V

: U, . . (j=3):
U=

(Top-down Matrix) W
1

:
V3 =

(Similarity)
I S Reset-:
sim =

S
I

Wj I
I

(2.76)

p .

84

PDF created with pdfFactory trial version www.pdffactory.com

Reset ,
S

< p . 0 1:

=1 , =0
.
: p
; p
(). p
0,7 0,95: p [0,7; 0,95]
2.8.
I S Reset- (sim = 1)

:
Wj=

I=

3
3

: sim = = 1 .

2.9.
I S Reset- (sim = 0,75)

:
Wj=

I=

: sim =

3
= 0,75 .
4


( ) sim > p, I .
Reset, .
. () Reset (..
I S) U
85

PDF created with pdfFactory trial version www.pdffactory.com

( U={0,0,...,0}),
() . S
I: S=I, ,
I. -
, ,
,
Reset. ,
, .
Bottom-up ,
I.
. ART-
(): (Slow Training)
(Fast Training).

,
. (
)
, .
()
,
.
.
()
. Bottom-up :
wiJ =

Ls i
m

(2.77)

L - 1 + sk
k =1

L (L > 1, L=2), si i-
, j -
wij ( i- ) Bottom-up W
wij i- j-
.
Top-down
:
w ji (t + 1) = si w ji (t )

(2.78)

.. Top-down
, S.
86

PDF created with pdfFactory trial version www.pdffactory.com

2.6.6.
ART-1. i ART-1-
F2. i F1
- S.
Reset . S
T, J
F2. F2 U,
V V,
J.
V
, S.
Reset, J F2
, .
i.
, Reset
F2 .
2.6.7. ART-
ART-2, ART-2a, ART-3, ARTMAP
FUZZY-ART.
ART-2 ART-2a. ART-1-:
, . ART-2a-
ART-2. ART2a- .
, (
) ART-2 ART-2a .
() ART-2a-
ART-2-.
ART-3-.
. :
.
ARTMAP. (
, Supervised and Unsupervised
Training). ART-.
FUZZY-ART- ( ART-).
ART-1- (Fuzzy Logic).
:
;
(Reset-);
.
ART-1-
, .
87

PDF created with pdfFactory trial version www.pdffactory.com

ART-1-

-.

88

PDF created with pdfFactory trial version www.pdffactory.com

3.

3.1.

(Neural Network Simulators).
-
,
,
.

, ,
.


( ).
.
. .1
.

3.2. TRAJAN
TRAJAN TRAJAN Software Co.
() [1, 11, 18]
Windows
.


.

TRAJAN [18].
3.2.1.
TRAJAN
:
;
;
;
;

.
89

PDF created with pdfFactory trial version www.pdffactory.com


,

.
,
,
TRAJAN, , .
3.2.2.


.
() .
TRAJAN ,
,
.
3.2.3.
TRAJAN ,
(. 2).
Delta-Bar-Delta.
3.2.4.
TRAJAN ,
(2.5).


,
.
3.2.5.
TRAJAN ,
.
3.2.6.
TRAJAN
.
,
.
3.2.7.

,
90

PDF created with pdfFactory trial version www.pdffactory.com

.
.
3.2.8.

.

,
.

,
.

.

.

(Datasheets), ..
Windows.
, ,
.
3.2.9.
TRAJAN 128 , ,
,
.
TRAJAN .
, ,
.
,
.

3.3. TRAJAN
3.3.1.
TRAJAN Network
Creating ( ), File/New/Network
[1, 18].

Network Creating :
;
.
91

PDF created with pdfFactory trial version www.pdffactory.com

3.3.2.
TRAJAN
.
.
3.3.3.
,
TRAJAN 128 128
,
,
,
.
,
Network Creating.
.
,
.
, , TRAJAN

, .
. ,
.
TRAJAN ,
(. 2.5).

3.3.4.


. ,
( ),
,

(. 3.3.3).
,
.

, ,
.
TRAJAN ( )
Pattern Set Creating,
File/New/Pattem.

92

PDF created with pdfFactory trial version www.pdffactory.com


,
.
.
,
, . 3.3.3.

TRAJAN ,
.
,
.

.

File/Save/Network. TRAJAN ,
.

File/Save/Pattern. TRAJAN
,
( ).
3.3.5.
(: Edit/Network, :
Network Editor)
:
;
;
;
;
.
()
,
.
3.3.6.

TRAJAN

.
TRAJAN
.
,
, ,
93

PDF created with pdfFactory trial version www.pdffactory.com


. ( ),
. ,
, .


.

:
1. Statistics/Training Graph,
Training error Graph;
2. Train/Backprop, Back
Propagation;
3. ,
;
4. Train Back
Propagation.
, ;
5.
( Train) ,
.

, .
,
, , ,
.
Training Error Graph
, ,
,
Pattern Error.
3.3.7.
, .
.


,
, .
Run/Single Pattern,


.
94

PDF created with pdfFactory trial version www.pdffactory.com

,


, ,
, :
1.
. ,
.
, ,
, .
5.
2. (
3). ,

,
.

95

PDF created with pdfFactory trial version www.pdffactory.com

4.
4.1.
,
.
,
(. 4.1):
;
(ASIC);
(mC);
(GPP);
(FPGA,
);
();
.

( ).
RISC-,
,
, , .
,
,

(,
..).
, T414, T800, T9000,
, ,
[2].

4.2.
(
), ,
, , .
,
():
MMAC ;
CUPS (Connections Update per Second)
( );
CPS (Connections per Second) (
) ( );

96

PDF created with pdfFactory trial version www.pdffactory.com

()

(FPGA, )

(GPP)

(ASIC)

(C)

. 4.1. ,

CPSPW = CPS/Nw, Nw ;
CPPS :
CPPS = CPS Bw Bs,

(4.1)

Bw, Bs , .

, ,
,
, (

97

PDF created with pdfFactory trial version www.pdffactory.com

)
-.

4.3.
-


.


.

:
,
(. 4.2);

-
( );

(
)
();

(..
).

.
(
),
(. 4.1) [10, 13].

,
[2]:
Naval Lab MIT Lab,
, , ,
.
,
, . .
,
,

.
..
,

.
98

PDF created with pdfFactory trial version www.pdffactory.com

. 4.2.

, . ..

: ,
,

,
.


. ..
-
.

:

( );

; ;
;

;
( , , -
..) [13].
99

PDF created with pdfFactory trial version www.pdffactory.com

4.1.

* **

48

400

Nx16

MIMD, N

MA16

Siemens

NNP (Neural
Networks
Processor)

Accurate
Automation

NAPS-1064

Adaptive
Solutions

16

128

64

100 NAP Chip

HNC

32

512

4
.

NeuroMatrix
NM6403, .
50

64 (
), 32
RISC

4096 .

24


TMS320C4x

NeuroMatrix
NM6404, .
133

64 (
),
32 RISC-

4096 .

48


TMS320C4x

32
64

496
1024

16

4096 .

CLNN 32 CLNN 64 Bellcore


NC 3001

NeuriGam

ZISC 036 (Zero


Instruction Set
Computer)

IBM

64-

ETANN 80170NW

Intel

64

MD-1220

Micro Dev.

Micro
MT 19003 - Neural
Circuit
Instruction Set
Engineering
Processor
(MCE)

108 ./
32
2 x 108 ./
32
20 ,
36

64
6480

16

64 .

16-
;
35-

5-16 (
)

RISC-
c 7

1024 256-

NI 1000

Nestor

NLX420
(NLX 110, 230)

Adaptive
Logic

16

16

OBL Chip

Oxford
Computer

16

16

100

PDF created with pdfFactory trial version www.pdffactory.com

16

4.1
1

L-Neuro 1.0
L-Neuro 2.3

Philips

16
16

Pram-256 Chip

UCLi Ltd.

SAND

Datafactory

ACC

1536

16
26

60
(1216)

8 (
)

256
33

16

16

16

64

70

4096

200 MCPS

Neuro Classifier

,
DESY

ANNA

AT&T

16256

WSC (Wafer Scale


Integration)

Hitachi

SASLM2

Mitsubishi

2 (
)

4096
(64x64) 50

TOTEM

Kent (Uni.,
UK),
di Trento
(Italy)

16 (
)

64
30

Neuron 3120,
Neuron 3150

Echelon
()

6 ()
1 ., 2 1010 ./
1
-


256-16

64
576

8 (
)

* ;
** ,
8


. 4.2 [13].

[10].

101

PDF created with pdfFactory trial version www.pdffactory.com

NeuroMatrix NM6403
NeuroMatrix NM6403 ( , )
, .
: 32- RISC- 64-
,


,
TMS320C4x,
[15].

4.2. *

CPS

CPSPW

CPPS

CUPS

NLX420

32-16, 8 bit mode

10M

20K

640M

100 NAP

4 chips, 2 M wts, 16 bit mantissa

250M

125

256G

64M

WSI (Hitachi)

576 neuron Hopfield

138M

3.7

10G

N64000 (Inova)

64-64-1, 8 bit mode

871M

128K

56G

220M

MA16

1 chip, 25 MHz

400M

15M

103G

ZISC036

64 8 bit element inp. Vector

MT19003

4-4-1-, 32 MHz

32M

32M

6.8G

MD1220

8-8

9M

1M

142M

NI 1000

256 5 bit element inp. Vector

40 000 vec in sec.

L-neuro-1

1-chip, 8 bit mode

26M

26K

1.6G

32M

NM6403

8 bit mode, 50 MHz

1200M

150M

77G

. .1 .
:
102

PDF created with pdfFactory trial version www.pdffactory.com

50 (20
);
0,5 ;
256BGA;
2,7 3,6 ;
50 MHz 1,3 .
RISC-:
5- 32- ;
32- 64- (
);
, 16 ;
64- SRAM/DRAM ;
32- .
32- ;
32- ;
;
/,
- TMS320C4x.
:
164- ;
, 64- ,
1 64 ;
-, -
;
;
32 64- .
:
50 MIPS;
200 MOPS 32- .
:
50 50000 MMAC.
I/O :
64-
800 /;
I/O 20 / .
:
Zi = f(Yi) = f (Ui+(XjWij)) ,

(i = 1, .. , M; j = 1, .., N) ,

(4.2)

Zi i-ro , Xj j- , Ui
i-ro , Wij j- 1-
103

PDF created with pdfFactory trial version www.pdffactory.com

, Yi i- , f
, N ,
.
Zi, Xi, Ui Wij
.
:
()
( 1 64 ), ,

;
(24
8 );
V-
;

;
( 64 )
: 4 SRAM 16 DRAM;
/,
TMS320C4x
;

, ,
.
:
100000;
10 10,5 0,7 ;
3 ;
720 MCPS
30 ; 8640 MCPS.
,
(),
- .
. .1 .
[15].
NeuroMatrixR NM6404
NeuroMatrixR NM6404
- RISC-. :
32- RISC- 64-
.
NM6404 NM6403.

104

PDF created with pdfFactory trial version www.pdffactory.com

TMS320C4x,

.
[15]:
133 (8
);
0,25 ;
PQFP256;
2,5 ; 3,3 ; 5 ;
1,0 ;
: 40...+80 C.
RISC-:
5- 32- ;
32- 64- (
);
2 ;
;
16 ;
64-
SDRAM/SRAM/DRAM/Flash ;

;
;
64 ;
32- ;
;
/,
TMS320C4x; JTAG- ;
;
:
1 64- ;
, 64- ,
1 64 ;
- - ; 16
;
.
:
133 MIPS;
399 MOPS 32- .
133 38000 MMAC.
I/O :
64-
2128 /;
I/O 20 / .
105

PDF created with pdfFactory trial version www.pdffactory.com

. .2 .
NNP Accurate Automation Corp.
,
. 16-
.
9 .
. NNP .

,
, ,
. ISA, VME.
140 MCPS 1,4 GCPS
10- .
16 Siemens
(1 ), 610 .
400
.
Synapse 1 Synapse 2 Synapse 3 (
Tiga Technologies).

. 4.2. 16
106

PDF created with pdfFactory trial version www.pdffactory.com

16
,
:
;
/;
;
( L1 L2);
( ,
).
,
(. 4.2). 16 ,
50 . /
8 108 /.
UNIX/XWIND C++.
++
OSF/Motif,

. . 1995 16
.
. .3 .
MD1220 MicroDevices
8 16- .
16- .

7,2 . 9 MCPS.
L-Neuro Philips
.
L-Neuro 1.0 L-Neuro 2.3. 12 ,
,
, 4-,
,
..

. 1
1024 8- 512 16- .

. 64
26 MCPS
(32 MCUPS).

107

PDF created with pdfFactory trial version www.pdffactory.com

NLX-420 NeuroLogix
16 32 , 16 .
300 MCPS.
.
ETANN 80170NX INTEL
ETANN 80170NX 64 , 16
64 (
). 64 .
.

.
, .
:

Vrefo;
[-2,5, 2,5];

1,5 , ;
6 ,
1,3 109 /.

INNTS.
DynaMind.
,
. ,

, ,
.
CIL Training,
,
.
ETANN 5 6 .
ETANN ,
.
:
( 5
5 );
1 18 (
ETANN 5 ).

108

PDF created with pdfFactory trial version www.pdffactory.com

CLNN32/CLNN64 Bellcore
CLNN32 32 496
. CLNN64 1024
. CLNN32/CLNN64
,
. ,
/ 5 .

Mean Field.
(32 ),
. CLNN32
CLNN64
.
108 / (
CLNN64 ). CLNN32 , 105 32 / 32 ( 50
) /.
1 . (
) MF 10 20 .
ETANN CLNN32 :
( C1L
);
,
" " ;
/ ,
,
;
.
ANNA AT&T

ANNA. , (
() ).
:
4096 ;
256;
6
64 64
2,1 GCPS.
NeuroClassifier
NeuroClassifier
DESY.
109

PDF created with pdfFactory trial version www.pdffactory.com

(70 , 4 /),
. 5 ,
20 , NeuroClassifier
.
SAND/1 Datafactory
Datafactory ( INCO)
SAND/1 (Simple Applicable Neural Device). SAND/1
- ,
.
200 MCPS ( ).
16- 40- .

. .
N64000 Inova
. 80
, 64 , 16
, 4 32 .
16 32- .
100 NAP Hecht-Nielson Computers
32-
. 150 MFLOPS,
512 .
MT19003 Micro Circuit Engineering
.
RISC- , 16

32-
.
.
13 . 50 MCPS.
NEURON Echelon
-
. -
.
ANSI/EIA
709.1-1999 [2].
NEURON : NEURON 3120
NEURON 3150 (. 4.3).
:
110

PDF created with pdfFactory trial version www.pdffactory.com

2 ,
512 (EEPROM), .

. 4.3. NEURON 3150 Echelon


: Applications
CPU, Network CPU.
, .

111

PDF created with pdfFactory trial version www.pdffactory.com

ZISC036 IBM
ZISC036 (Zero Instructions Set Computer)
- , ..

.
.
(. 4.4).

. 4.4. ZISC IBM

ZISC036:
36 ;
();
1 64 ;
5V;
112

PDF created with pdfFactory trial version www.pdffactory.com

1 W 16 MHz;
0 20 MHz;
CMOS-;
3,5 ,
0,5 .
IBM ISA
PCI , ZISC-.

4.4.
4.4.1.


.
, - ,
,
.
,

[10].

, ,
.

10 20 ,

, , .

,
ISA, PCI .

.

,


,
( )
.
4.4.2. ,
, ,
.
113

PDF created with pdfFactory trial version www.pdffactory.com

,

.

, ,
- .
,
-
, Texas Instruments Inc., Analog Devices, Motorola
,
, -,
. ,
Texas Instruments Inc. 1998
- 1,2 ,
.

,
.
, ,
Analog Devices Texas Instruments Inc. ,
(
, ..).
, ,
(
, ), Texas
Instruments Inc. [16, 17],
. Motorola

16- 24- .

,
,

,
, ,
..
,

TMS320C4x ( Texas
Instruments Inc.) ADSP2106x ( Analog Devices),
(
. 4.3).

114

PDF created with pdfFactory trial version www.pdffactory.com


. 4.4.

4.3. ADSP21061 TMS320C40

TMS320C40/
TMS320C44

ADSP21061

20,0

33,0

150,0

60,0

, $

49

176 (C44 99)

- , MFLOPS/$

3,1

0,34 (C44 0,6)

0,37

0,97

32

12

32

1 (Fixed Length)

, /

300

60

, 32-

32K

2K

1024

64

,
MFLOPS


1024 ,

115

PDF created with pdfFactory trial version www.pdffactory.com

4.4.

Intel
Pentium
MMX,
200

Texas
Instruments
TMS320C40,
50

""
NM6403,
40

21

6,8

68


(256 , 32 .), ()

200

464 (11588)

102 (4070)

-
(21 , 5 ),

2,58

2,80

0,45

Intel
Pentium
II,
300

(
384 288 ), /.

,
.
,

RISC-,

,
,

, ( ).

,
.

, MAC (c = a x b + c)

A B, ..
),
, .
,
.
.
,
,
.

R,RR,
. .
116

PDF created with pdfFactory trial version www.pdffactory.com

,
:
,
.
-
.
:
;
( );
.

.

.
, ,

.
, .
,
:
;
.

.
:
( ), (
). ,
.

. ,

, .
-.
,
. -
,
.

SHARC
( Analog Devices).
.
. , ,
32- 32-
117

PDF created with pdfFactory trial version www.pdffactory.com

, , 64 ,
128 .
.
.
, :
;
;
,
.

.
4.4.3. Analog Devices

.

:
.
5 8 .
,

.
Analog Devices . ,
32- ADSP-21020
30 MFLOPS ,
ADSP-21065L 198
MFLOPS, 6,6 .
,
, ADSP2116x 100 600 MFLOPS.
ADSP-2116x :
.
.
, 1/x, 1/R(x),
, ,
/ .
() () ().
()
, ,
,
( ,
/). 48-
118

PDF created with pdfFactory trial version www.pdffactory.com

.

.
32-
, 32- (
) 40-
.

. 32-
80 .
.
- ,
- .

. ,

.

.
,
,
.

,
. 32 (16 16
), 10 , ,

.
-
.
ADSP-210xx -
. - : ,
.
(DAG1 DAG2)
() ,
-,
.
,
,
. DAG 16 16 ,
32 .

119

PDF created with pdfFactory trial version www.pdffactory.com

4.4.4. Texas Instruments Inc.


Texas Instruments Inc.
[17].

, ,
,
.
1998 2000 . Texas Instruments Inc.
-,
, ,

(GO DSP, TARTAN, AMATI, Spectron Microsystems).
1998 Texas Instruments Inc.
50% ( 1997 45%). ,
Texas Instruments Inc.
- .
2001 Burr-Brown.
Texas Instruments Inc.
. 1999
TimeLine
0,18 .
Texas Instruments Inc.
(. 4.5) [16, 17]: TMS320C1x, TMS320C2x,
TMS320C2xx, TMS320C5x TMS320C62x.
TMS320C3x, TMS320C4x TMS320C67x.

4.5. TMS320 Texas Instruments Inc.

120

PDF created with pdfFactory trial version www.pdffactory.com

TMS320C8x
,
.
TMS3202000, TMS3205000 TMS3206000,
,
,
" / /
".
TMS3202000
;
.

TMS320C20x TMS320C24x
.

TMS3205000

.
TMS320C54xx ( 200 MIPS)
( 32 mA/MIPS).
0,18
5 $ 100 MIPS.

-
TMS320C6000

64
1


2002 .

64x
6414

6416
6415

62x

6203
6201

6202
6701

6204
6211
6711

67x

6205

6712

. 4.6. TMS320C6000

121

PDF created with pdfFactory trial version www.pdffactory.com

TMS3206000

,
, . , TMS320C62x

1600 MIPS
TMS320C67x 1
GFLOPS, .
TMS3206000 [16, 17]
, ,
.
(. 4.6).

VelociTI,
VLIW (Very Long Instruction Word
),
.
,
, ,
8000 MIPS 3 GFLOPS
.


, .

TMS320C6000 (. 4.5):
TMS320C62x
1200 2400 MIPS;

4.5. TMS320C6000

TMS320C6000

MIPS/
MFLOPS

MMAC
(16-
)

MMAC
(8-
)

TMS320C62x

150-300

1200-2400 MIPS

300-600

300-600

TMS320C64x

400-600

3200-4800 MIPS

1600-2400

3200-4800

TMS320C67x

100-225

600-1350 MFLOPS

200-550

200-550

122

PDF created with pdfFactory trial version www.pdffactory.com

TMS320C64x
3200 4800 MIPS.
(. 4.5)
(TMS320C6414),

(TMS320C6415)

(TMS320C6416) ;
TMS320C67x
600 1350 MFLOPS.

TMS320C6000 . 4.6.
TMS320C6000
,
.

.
TMS320C67
TMS32062,
, ,

.
, ,
.

, . ,
,

.
4.6.

TMS320C6000


(FFT)


(Digital Filtering)

,
N = 1024, Radix 4

c ,
M = 100 (64 TMS320C67x)

TMS320C62x

13228

66,0

6410

23,0

TMS320C64x

6002

12,0

1019

2,0

TMS320C67x

18055

108,3

2216

13,3

123

PDF created with pdfFactory trial version www.pdffactory.com

,
, .

- ,
TMS3206000.

,
Code Explorer
Code Composer Studio [16, 17].
Texas Instruments Inc. :

(. 4.5).
,
TMS320C10, TMS320C20, TMS320C50.
TMS320C30, TMS320C40, TMS320C80,

, ,
TMS320C6x ,
.
TMS320
" "
( , ).
Texas Instruments

,
( ,
).
TMS320C80
, 2
, ,
MIMD-.
RISC,
RISC- 32-

(ADSP0-ADSP-3),
64 ,
.

-.
124

PDF created with pdfFactory trial version www.pdffactory.com

TMS320C80
2 RISC- .
TMS320C80
10
. TMS320C80
2,4 / 1,8 / .
TMS320C80
, ,

RISC-. TMS320C80

, .

.
,

.
TMS320C8:
40 50 ;
2 ;
32- ADSP-;
32- RISC-
;
50 SRAM ( TMS320C82 44 );
64-

64-, 32-, 16- 8-


;
64- SRAM, DRAM, SDRAM, VRAM;
4 ;
;
4 ;
;
3,3 ;
4000000 ;
0,5/0,6 -;
305- PGA.
TMS320C8
()
RISC-
. RISC-
/ ,
125

PDF created with pdfFactory trial version www.pdffactory.com

,
.

(Floating-Point
Unit)

, .
100 MFLOPS
50 . FPU ,
.
(Scoreboard)
.
:
, 31 32- ;
(Barrel Rotator);
;
;
;
;
4 ;
;
;
-.
ADSP- TMS320C8
ADSP- TMS320C80
, (
).

, . ADSP
, -
(, -) .
ADSP
500 .
ADSP 32- ,
64 . , 12
.
ADSP :
3- ;
44 (10 - , 6 - , 8 , 20 - );
32- 3- ;
;
;
32- ;
126

PDF created with pdfFactory trial version www.pdffactory.com

;

.

( ),

,
(DRAM, VRAM,
SRAM)
8 64.
,
,
400 /c.

2- 3- .
TMS320C4

TMS320C4.

.
TMS320C4x TMS320C3x,

.
TMS320C4x - . :
;
- ;
32- ;
;
;
.
32-
40-
, (25 ),

(, ).
32-
40- ,
.

.
1 32.
(Address Generation 0 Address Generation 1)
127

PDF created with pdfFactory trial version www.pdffactory.com


. ,
-, - .

32 .
,
. ;

,
.
, , , ,
, .

32- 40-
. ,
.
32- .
.
4 32- .
RAM0
RAM1, 4 , ROM,
.
128 32-
,
. TMS320C40

.
, .
4.4.5. Motorola
Motorola ,
, .
16- 24- DSP560xx,
DSP561xx, DSP563xx, DSP566xx, DSP568xx
DSP960xx. 24- Motorola
: DSP560xx DSP563xx. ,
,
DSP560xx.
:
24-

;

128

PDF created with pdfFactory trial version www.pdffactory.com

16-
;
,
.
Motorola
,
16- 24-

,
,

, , ,
, ,
, .

Motorola .
4.4.6. ,

( )
( ).

, ,
.
,
Xilinx ALTERA. -
,
.
ALTERA
.
. 4.7.
Xilinx :
FPGA Field Programmable Gate Array;
CPLD Complex Programmable Logic Device.
,
,
.

129

PDF created with pdfFactory trial version www.pdffactory.com

4.7. ALTERA

MAX 7000E(S)

MAX 9000

FLEX 8000A

FLEX 10K

600-5000

6000-12000

2500-16000

10000-100000

6-24

36-164

60-216

68-208

59-406

Xilinx:
4
;
300 ;
0,18 ;

: ,
, .
.;
;
;
;
Xilinx.
Xilinx
:
1. SRAM ( FPGA)
"" ,
. :
Spartan, Virtex, XC3000, XC4000, XC5200.
2. FLASH ( CPLD)
FLASH -
.
XC9500.
3. EEPROM ( CPLD)
EEPROM -
.
CoolRunner.
130

PDF created with pdfFactory trial version www.pdffactory.com

4.8.

(CLB)

1 XC4005E/XL

XILINX

196 (14x14)

2 XC4013XLA

XILINX

576 (24x24)

18

3 XC4020XLA

XILINX

784 (28x28)

24

4 XC4044XLA

XILINX

1600 (40x40)

50

5 XC4062XLA

XILINX

2304 (42x42)

72

6 XC4085XL

XILINX

3136 (56x56)

97

7 XC40250XV

XILINX

8000

200

8 EPF10K2

ALTERA

144

9 EPF10K50E

ALTERA

360

11

10 EPF10K100E

ALTERA

624

19

11 EPF10K250E

ALTERA

1520

50

12 M4LV-96/48

AMD

966

13 M4LV-192/96

AMD

192

14 M5LV-256

AMD

256

15 M5LV-512

AMD

512

16


. ,
60100% ,
,
.
. 4.8.

,
.
131

PDF created with pdfFactory trial version www.pdffactory.com

5.
5.1.
,

(),

,

,
.

,
SISD-, SIMD- MISD- (Intel,
AMD, Sparc, Alpha, Power PC .)
( )
.
,
.
(Texas Instruments
Inc., Analog Devices, Motorola), ()
() ().
, ,
, ,
- .
, (
), ,
.
Host-
[4].

5.2. ,

, -

.

- , ,
,
.
,
- (

132

PDF created with pdfFactory trial version www.pdffactory.com

)
.

. ,
,
. ,

.

.

: " "
"" [15], ,
AUTEX Ltd. L-Card Ltd.
Analog Devices,
ScanTI-Rus [16]
Texas Instruments Inc.
5.2.1. ,

,
,
.
,
,


(.5.1).
ISA, PCI, VME.
:
,
,
,
/ ( ,
TTL ),
,
(),
,
.


,
- .
133

PDF created with pdfFactory trial version www.pdffactory.com

. 5.1. ,
()



, .
ADSP21060
TMS320C44, ADSP2106
TMS320C67. ,
,
(,
Synapse 3).


ADSP2106x, TMS320C4x,8x, DSP96002 .

ADSP2106x . 5.2.
,

( ).

.

, Host-
134

PDF created with pdfFactory trial version www.pdffactory.com

/.
JTAG-. , ,

ADSP2106x,

. 12 ; 3

.

, .
.

. 5.2. ADSP2106x
135

PDF created with pdfFactory trial version www.pdffactory.com

/ /
, :
TTL , , ,
,
, ,
, FIFO.

. 5.3. TMS320C4x

Host-
.
,
..

, ,
136

PDF created with pdfFactory trial version www.pdffactory.com

.
TMS320C4x
. 5.3. ,
,
,
.
.
32-
TMS320C40

30 /c .
,
560
/c.
, , , ..
TMS320C40
120 /.

.
, ,
DMA , Xilinx.
(
)
2-4 ( Xilinx) ,
,
Master Serial Peripherial.


.
Slave Serial,
,
.
(,
XC2018-84pin-50MHz, XC3020-68pin-50MHz).

,

.
( 5 100 ).
, , ,
-

137

PDF created with pdfFactory trial version www.pdffactory.com

.
.

,
,
( ) . .. .

,
().
VME
10 Altera.

VME.
(host-)
. 33 .

5.1. *

Pentium100,

PentiumII333,

Ultra
SPARC, c

44 3)

0,65

0,11

0,76

0,02

1,97

0,49

0,75

0,001

0,51

0,13

1,31

0,004


3232 4)

43,78

7,14

58,89

0,142


3232

0,120

0,028

0,146

0,032

8,61

0,60

12,31

0,011

* - :
Pentium-100 100 , 16 ;
Pentium-333 350 , 128 ;
UltraSPARC 200 , 64 ;
33 .

138

PDF created with pdfFactory trial version www.pdffactory.com


, ,
,
,
(. 5.1).
(. 5.4):
;
(1 - 6);
( E-bus);
( VME);
( 0, 1);
/ ( ).

. 5.4.

139

PDF created with pdfFactory trial version www.pdffactory.com


RISC-.

.

, ,
. ,
.
,
,
( MaxPlus)
.
, 8
0,5 , 4
512 8- .


.
,
,

E-bus -.


/ HOTLink
CYPRESS.
,
FIFO . VME

.
RISC- ( )

(
),
SIMD- ( ).
,


.

, .


0
255, ,
.
140

PDF created with pdfFactory trial version www.pdffactory.com

, .

.
,
,
,
. ,

.
. .4. .



. :
;

;

.

,
,
,
.


TMS320C80, TMS320C6 Texas
Instruments.
Neuro-Turbo Fujitsu
Motorola
Neuro-Turbo Fujitsu.
24-
86220 ( : 30 ,
150 , 25 2 (), 64
4 (), 1,2 ).
0 1,
16 ,
24- .


.

141

PDF created with pdfFactory trial version www.pdffactory.com

. 5.5. Neuro-Turbo Fujitsu

Neuro-Turbo (. 5.5) ,
().
( 2 )
( 64 4 )
. ,
,
.
,
.
142

PDF created with pdfFactory trial version www.pdffactory.com

.

,
. ,
, ,


.
Host-
.
Host- .

. ,
MIMD.
24 MFLOPS.

Fujitsu 86232
4 ,
, 1000 .
, (
( )).
:
;
;
.


. ,
TMS320C4x -
(, , ..)


.
ADP6701PCI

,
, , ,
, .
ADP6701PCI
MS320C6701
1 GFLOPS. .
.5 .
143

PDF created with pdfFactory trial version www.pdffactory.com


1024 109 .
:
64 K 32;
64 16;
64 32;
16 .
,
.
DSP60V6
DSP60V6 -
,
ADSP-21060/62 SHARC (. .6 ).
SHARC ,
ADM,
. ADP60V5
6U. , ,
VME. ADSP-21060/62
VME / J2/P2 (X2).
,
.

ADSP2106x Analog Devices 120 MFLOPS
. 1 48
c 16 32
. VME
FLASH 4 8 .
VME
6 .
M1
1 TMS320C40 Texas
Instruments, .
[15].
:
ISA-;
TMS320C40 50 ;
100 MIPS, 200 MFLOPS, 1100 MOPS;
SRAM 5 ( 1 + 1 );
20 ;
DRAM 32 ;
8 ( 20 /).
144

PDF created with pdfFactory trial version www.pdffactory.com

M2
2
TMS320C40 Texas Instruments Inc.
.
,
VME-bus,
.
VME-bus IEEE
1014 (6U).
2 :
VME-bus ;
Master/Slave ;
TMS320C40 50 ;
2 SRAM ;
64 DRAM ;
Flash-EPROM 0,5 ;
JTAG-;
RS-232-.
300 MFLOPS.
5.2.2. ,


.
.
4.01 (NM1)
4.01 (NM1)
[15]
, . (. 5.6)
NeuroMatrixR NM6403
,
PCI . :
NM6403;
2 8 (SRAM);
64 (EDO DRAM);
COM- 20 / .
:
1,9 ;
320 .

145

PDF created with pdfFactory trial version www.pdffactory.com

PCI ( 2-1)
132 /.
4.02 NM6403,
40 11,500
1 64 .
PCI,
,
PCI.
, TMS320C4x.

.

. 5.6. 4.01

146

PDF created with pdfFactory trial version www.pdffactory.com

CNAPS/PC-128 Adaptive Solutions


CNAPS/PC 1995
,
.
Pentium (
) .

,
.
2,27
/,
.
:
486/ 50 MHz 750 . . /;
Pentium / 90 MHz 1980 . . /.
CNAPS/PC

PC
( ISA PCI). 2 4 , 64 128 .
, 512 -
SIMM 4 ( 36 ).
ZISC/ISA IBM
ZISC/ISA

IBM
PC
.
16 ZISC036 576 .
,
Master, Slave. ISA-
.7 .
ZISC/PCI IBM

PCI ( . .8 ).
:
33 MHz;
165000 ;
1,7,13 19 ZISC036.
Synapse Siemens
Siemens Nixdorf Informationssysteme (SNI)
Siemens
Synapse 1 (. .
5.3), 1994 .
Synapse 2 Synapse 3.
147

PDF created with pdfFactory trial version www.pdffactory.com

, Siemens ,
(
Tiga Technologies).
Siemens ,
, , .


, .
Synapse,
,
.
.
Synapse 2 Siemens
Synapse 2 : 16 (40 ),
TMS320C50 (55 ),
TMS320C50 (55 ), (Y-Memory), (WMemory). Synapse 2
. 5.7, .9 .

. 5.7. Synapse 2

Synapse 3 Siemens
Synapse 3
16. Synapse 3
148

PDF created with pdfFactory trial version www.pdffactory.com

2,4 /.
UNIX/XWIND C++.
++
OSF/Motif,
.

Synapse 2 Synapse 3, Pentium-200
. 5.8.

. 5.8.

5.3. ,
-

, ,
,
,
. ,
.
,
- [10]:
Synapse 1 Siemens;
149

PDF created with pdfFactory trial version www.pdffactory.com

,
"
"

80 MFLOPS
(80 1015 ), ,
, ;
().
Synapse 1 Siemens
Synapse N110
Sun Sparcstation 5 1
, ,
, ,
, ..
Synapse 1 VME.
Synapse 1
: , ,
:
16
3,2 (16 16
) (48 ) ;
128 ;
Motorola MC68040;
Motorola MC68040;

667
398 680 .
,
Synapse 1,
,
.

64000000,
.

.. (. .5 ).

[10]:

-1;
- ;

(-2);
150

PDF created with pdfFactory trial version www.pdffactory.com


(-3 -4);
(-5);
-5,
;

-2

-1
.

. 5.9.

. 5.9
.
(S) .

,
-
.

151

PDF created with pdfFactory trial version www.pdffactory.com

6.

, ,
TRAJAN Trajan
Software Co. ()
(. . .1 ).


-
( ) -7
.

.
,
,
.
TRAJAN.

6.1. 1


TRAJAN
[1].

1. ( 2: . 2.1
2.3 3).
2. ,
.
. 6.1.
3. .
4. 1 4.

Trajan Network
Creating ( ), File/New/Network
.
, Network Creating
, .
152

PDF created with pdfFactory trial version www.pdffactory.com


TRAJAN
. ,
,

, .

6.1.
1


,
TRAJAN:
1.

: 128 128 ,

, ,
.
2.
, :
,
(2-2-1).

, Network Creating.
.

,
.
,
TRAJAN
, .
153

PDF created with pdfFactory trial version www.pdffactory.com

. ,
. TRAJAN
,
.


,
,
. (
TRAJAN ),
. ,
, .


.
:
Training Error Graph,
Statistics/Training Graph;
Back Propagation,
Training/Backprop;
,
;
Train
() Back Propagation.


Training Error Graph;
Back Propagation
, Train.

, , .
, ,
, ,
.
Training Error Graph
,
.
TRAJAN Pattern Error.

,
.

154

PDF created with pdfFactory trial version www.pdffactory.com

,

, ,
.
Run/Single Pattern,


.
,


,
, . :
1.
. ,
.
, , ,
.
5.
2. ( 3).

,
.

, ,
,

. ,
.
,

.

6.2. 2

, ,
[1].

155

PDF created with pdfFactory trial version www.pdffactory.com

1. ( 2: . 2.1
2.3 3).
2. ,

.
3. .
4. 5 8.


().
, ,
.
,
, .

, . ,
, .

,
1 0 . ,
,
.
,
0 1,
.
,
, :
0,95 , ( )
, 0,05 .
TRAJAN

Run Single Pattern (
) Run One-off Pattern (
).
TRAJAN
:
,
() ;
,
;

156

PDF created with pdfFactory trial version www.pdffactory.com

,
, () .

Run Statistic/Classification,
Statistic/Classification.
, .
:
, .
:
Total () .
Correct ()
.
Wrong ()
( ).
Unknown () ,
.
,
( )
.
.

,
,
.

. ,
,
.
, ()
, ,
() .
0 15. ,
,
. ,


,
.
. 0, ,
1 . ,

.
157

PDF created with pdfFactory trial version www.pdffactory.com

6.2.

0001

0010

1000

0010

0100

0001

0011

0110

1001

0100

1000

0010

0101

1010

1010

0110

1100

0011

0111

1110

1011

1000

0001

0100

1001

0011

1100


,
.

(. 6.2). ,

0000, 1111, 1010, 0101,
( )
.
(
) ,
( ).
. 6.2,
, .

6.3. 3


, [1].
158

PDF created with pdfFactory trial version www.pdffactory.com


1. (. 1.3).
2. ,
.
3. .


,

. , TRAJAN
9,
3 3.

3 3 X, Y, L, I
(. .
6.3).

6.3. , Y, I L
X

. 6.3
9.
, X
101010101

. ,

,
.
159

PDF created with pdfFactory trial version www.pdffactory.com

,
:
(), ..
;
(), ..
.
.

, ,
,
.
,
:
00

Y 01

I 10

L 11

, :
0001

Y 0010

I 0100

L 1000

, ( )
, ,
.

,
( ,
3 3 ).
, I
010010010


010110010

: ,
.

6.4. 4


,
[11].

160

PDF created with pdfFactory trial version www.pdffactory.com

1. (. 1: . 1.4;
. 2: . 2.1 2.3; . 3: . 3.2).
2.
(. 6.4), ,
.
3. ,

.
4. ,
( ),
(. 6.5).
5.
.
6. ,
.
7. . 3, 4, 6
,
, ,
.
8. . 3, 4, 6.
9. .

( )
.
.
1.
(. 6.1).
2.
. :
1.
, .

.

.
3. :
,
, . 6.4;
11;
6;
()
4.
161

PDF created with pdfFactory trial version www.pdffactory.com

. 6.1.

6.4.

,

{1; 0,05; 0,1; 0,3; 0,07; 0,08; 0,2; 0,05; 0,2; 0,6; 0,8}


{0, 0, 0, 0, 0, 1}

6.5.
,

{1; 0,05; 0,1; 0,3; 0,07; 0,08; 0,2; 0,05; 0,2; 0,6; 0,8}

{0,8; 0,4; 0,7; 0,6; 0,1; 0,5; 1,0; 0,75; 0,5; 0,7; 0,8}

{0,9; 0,2; 0,4; 0,5; 0,1; 0,7; 0,6; 0,5; 0,5; 0,7; 0,8}

{0,85; 0,7; 0,8; 0,65; 0,1; 0,4; 1,0; 0,7; 0,4; 0,6; 0,7}

{0,9; 0,3; 0,3; 0,4; 0,04; 0,1; 0,5; 0,3; 0,2; 0,7; 0,8}

{0,95; 0,18; 0,21; 0,3; 0,05; 0,1; 0,3; 0,2; 0,2; 0,5; 0,7}

162

PDF created with pdfFactory trial version www.pdffactory.com

4. ,
, . 6.5:

, , ,
(. 6.4).

,
() .

.
(. . .1 ),
. ,
,
,
.

1.
.
2.

?
3.

6.5. 5


, ,
[11].

1. (. 1: . 1.5;
. 2: . 2.1 2.3 . 3).
2. ,

.
3.
.
163

PDF created with pdfFactory trial version www.pdffactory.com

6.5. 0 10,
-

,
Random(10) -

1 10

11 20

21 30

31 40

41 50

51 60

61 70

71 80

81 90

91 100


,
,
.
() ,
0 9
0 99.

(MathCAD, Matlab .),
(Delphi, C Builder .)
. 6.5 6.6.
, -

,
.

164

PDF created with pdfFactory trial version www.pdffactory.com

6.6. 0 100,
-

,
Random(100) -

1 10

86

20

27

67

31

16

37

42

11 20

47

84

29

91

36

77

32

21 30

69

84

71

30

16

32

46

24

82

27

31 40

48

14

87

28

77

97

49

88

82

41 50

14

14

50

59

77

65

77

70

51 60

55

20

68

59

95

64

99

24

67

29

61 70

77

49

88

50

57

95

68

33

71 80

70

98

77

74

19

14

91

78

58

86

81 90

68

28

62

28

87

16

27

54

96

91 100

17

15

26

17

57

49

28

15

60

73


.
(. 1.5.1).
1.
.
2.
( N).
3. ()

.
4.
,

.


.
165

PDF created with pdfFactory trial version www.pdffactory.com

N+1 ,
, N
, (N+1)- .
,
..
, , 100 ,
100N1 .

,
3 ,
100 ,
. , , 3
, ,
.
, ,

. ,
[5].

,
, ,
.
,
,
,
, ,
. (. .1.5).

166

PDF created with pdfFactory trial version www.pdffactory.com


1.
2.
3.
4.

?
.
.
,
, ?
5.
, .
6. .
7. ?
8. , ,
?
9. a (, -,
)?
10. ?
11. ?
12.
?
13. , ?
14. ?
15. .
?
16. .
?
17.
.
?
18. .
19.
.
,
(Backpropagation).
20. ART1-?
21. ART-?
22.
?
23. ?
24.
.

167

PDF created with pdfFactory trial version www.pdffactory.com


1. .., .., ..


. .: , 1999 .
2. .. (80-
90- ) // . 1. 2000. . 68-82.
3. ., . . : , 1996. 276 .
4. .. : / . ... : ,
1995. 131 .
5. .., .., ..
,
. IV .-. .
. .: , 2001. . 114-118.
6. ., . . .: , 1971.
7. . . . .: , 1965.
8. . . .: , 1992.
9. - . : , ,
// . 4. 1998.
10. .., .., .., ..
: . .: -
, 2000. 64 .
11. Alekseev A., Krug P., Shahidur R. The Neural Networks. Teaching
Edition. Moscow. Publishing House of MPEI. 2000. 64 pp.
12. SNNS. User Manual. (http://www.informatik.uni-stutgart.de/ipvr/bv/
projekte/snns)
13. http://neurnews.iu4.bmstu.ru
14. http://neuronets.chat.ru
15. http://www.module.ru
16. http://www.scanti.ru
17. http://www.ti.com
18. http://www.trajan-software.demon.co.uk
19. http://www.basegroup.ru/tasks/forecast.htm

168

PDF created with pdfFactory trial version www.pdffactory.com

.1.

Win 95,
98,
NT 4.0

:
, ,
, ,
,
.
: ,
, ,

GUI
Ms Windows

----

Matlab Neural
Network Toolbox
3.0

MathWorks,

http://www.mathworks.com

SNNS



(IPVR)

Unix

,
, ART1, ART2,
, ,
,

GUI
X-Windows

Win 3.x,
9x, NT

,
,
, ,

GUI
MS Windows

http://www.informatik.unistutgart.de/ipvr/bv/projekte/snns/announce.
html

Trajan

Trajan Software Ltd.,

http://www.trajan-software.demon.co.uk/
commerce.htm

169

PDF created with pdfFactory trial version www.pdffactory.com

ANSI


.
MS Windows

X-Windows.


C++

620$

. .1
1

2
Artificial Intelligence
Group,
(
)

Delta

http://wwwinf.enst.fr/~milc/dnns/dnns.us.html

IIC, ()

X-Sim

HP-UX
Sun OS
4.1

,
, ,
,

GUI
X-Windows

Unix
Linux

,
,



Unix,
GUI
X-Windows

,
, ,

Internet

Java


Java- -

,
, ,
, ,

,
,

450$

Visual Basic,
++ Delphi

http://www.iic.uam.es/xsim/Welcome.html

Brain Wave

http://www2.psy.uq.edu.au/~brainwav/

VieNet2

www.ai.univie.ac.at/oefai/nn/tool.html

NeuroWindows

http://www.neuroproject.ru/

DOS
Win
Unix
Linux

Win

170

PDF created with pdfFactory trial version www.pdffactory.com

. .1
1

Aspirin/
MIGRAINES

Mitre Corp.

Unix

Atree

. ,

Dos,
Unix

GUI
X-Windows


Unix
,
DOS

,
( ),
LVQ2 -

GUI
X-Windows

68,75 $




1 CUPS

alnl@cs.ualberta.ca

Cnaps

Adaptive Solutions Inc.

SunOS

ICSIM


, ,
,

Unix

Shell,
GUI
X-Windows

Neural
Shell

SPANN,

,
,

Unix

, ,
,
,
,
-

, GUI
XWindows
SUNTOOLS

Unix

GUI XWindows

ftp://ftp.quanta.eng.ohio-state.edu/

Neuron

171

PDF created with pdfFactory trial version www.pdffactory.com

. .1
1

Sankom

Unix

SOMPAK

SOM,

,

Xerion

Shell

Unix,
DOS

Unix

,

, ,
,
,
,

GUI
X-Windows

DOS,
UNIX

------

ftp://ftp.cs.toronto.edu/pub/xerion

NETS

COSMIC,
,

service@cossack.cosmic.uga.edu

172

PDF created with pdfFactory trial version www.pdffactory.com

. .1. NeuroMatrix NM6403

. .2. NeuroMatrixR NM6404

. .3. 16 Siemens

173

PDF created with pdfFactory trial version www.pdffactory.com

. .4.

. .5. ADP6701PCI
TMS320C6701

. .6. DSP60V6
174

PDF created with pdfFactory trial version www.pdffactory.com

. .7. ISA- ZISC 036 IBM

. .8. PCI- ZISC 036 IBM

. .9. Synapse 2 Siemens

175

PDF created with pdfFactory trial version www.pdffactory.com

. .10.

176

PDF created with pdfFactory trial version www.pdffactory.com

P.G. Krug
The Neural Networks and The Neural Computers. Moscow: Publishing
House of MPEI. 2002 176 pp.
ISBN 5-7046-0832-9
The basics of the Neural Networks, popular solving problems, applications,
simulation software products, and also the modern neural processors and neural
computers are considered.
The book contains the practical course, which based on Trajan simulator.
The book reflects the experience of teaching foreign students in Neural
Networks in English at the Moscow Power Engineering Institute (Technical
University).
For students dealing with Computer Sciences.





,

..
020528 05.06.97 .
2002 (I), .
10.08.02.
. . 11,0
100

6084/16
. 15
33 .

, 111250 , , . 14
,
117415, , . , . 39
177

PDF created with pdfFactory trial version www.pdffactory.com