, .

5538
, . 5538


1.
2.
3.
4.

05.10.2006

 ?


(, , )
() .

05.10.2006

 ()

05.10.2006



(unsupervised classification)
,

.
(supervised classification)

.

05.10.2006

 ?

:
(Data mining);
;
.
.

.

05.10.2006


() x
.
d- :
x = (x1, , xd).
() xi
x.
d
x.

05.10.2006


()
X = {x1, , xn}
. i- X
xi = (xi,1, , xi,d). X

n x d.

X.
d(xi, xj) xi xj

( -)
.
05.10.2006



:
N k ;
N .


:
K

nj

e X , L xi c j
2

j 1 i 1

05.10.2006


1.
2.
3.
4.

05.10.2006

10


1.
2.
3.
4.

05.10.2006

11


1. , :

(, );
(,
, ).
2. ,
.
3.
.

05.10.2006

12


:
, ;
.

,
,

( ,
):
1
d
2

2
d 2 xi , x j xi ,k x j ,k xi x j
2
k 1

05.10.2006

13


1.
2.
3.
4.

05.10.2006

14

k-Means ( k-)

05.10.2006

15

 ()

05.10.2006

16


- -



(online)

05.10.2006

17



(),
.
,
-:
Single-link

;
Complete-link

.
05.10.2006

18

Single-link ()

05.10.2006

19


Single-link Complete-link

05.10.2006

20



-:

05.10.2006

21

k-Means
1. k ,

( k n , k
).
2.
.
3.
.
4.
, 2.
05.10.2006

22

k-Means ()

:

2;

.


.
05.10.2006

23


(1978),
:
{

,
,

, ;
;
}
05.10.2006

24


()
.


xi
uik
k
.
F1 = {(1,0.9), (2,0.8), (3,0.7), (4,0.6), (5,0.55), (6,0.2), (7,0.2), (8,0.0), (9,0.0)}
F2 = {(1,0.0), (2,0.0), (3,0.0), (4,0.1), (5,0.15), (6,0.4), (7,0.35), (8,1.0), (9,0.9)}
05.10.2006

25


1. n
k
U n x k
( u ik 0,1 )
2. U,
(,
N

E 2 X , U u ik xi c k

i 1 k 1

c k u ik xi
i 1

).

.
3. U , 2.
05.10.2006

26


()

.

.


( 1 ) .


k-Means.
05.10.2006

27


1.
.
(~ 1 / e2).
2.
, :
;
()
;

.
3. 2 .
05.10.2006

28




,

.
,
.


,

.
05.10.2006

29


,
.
1. P0
EP0.
(T0 > Tf).
2. P1 P0. EP0 > EP1,
P1, P1, ,
.
.
3. - : T0 = c * T0, c < 1.
T0 > Tf 2, .
05.10.2006

30

 ?

.

,
-- .

- (-) ,
.

05.10.2006

31

 ?
()
k-Means
, ,
.

,
.

,
k-Means,

.
05.10.2006

32



:


(
)
:
(

)
(
)
05.10.2006

33



k-Means
.

, :

;
(on-line)
(, leader,
);
.
05.10.2006

34

 ()

05.10.2006

35

 Leader ()

05.10.2006

36



:

;


;


.
05.10.2006

37


1.
2.
3.
4.

05.10.2006

38


(Data mining)

05.10.2006

39

 (Data mining)
:
k
;


(http://www.nigma.ru,
http://www.vivisimo.com, );
.


.
05.10.2006

40

http://www.nigma.ru ()

05.10.2006

41

(OCR .):
1.
;
2. ;
3.

.
:
;
.
05.10.2006

42

 ()

05.10.2006

43


( )
LCC (Library of Congress Classification):
QA76 QA76.8 CS.
LCC:
;

.
:

;
.
05.10.2006

44






( ->
-> ->
).
.

.
05.10.2006

45

05.10.2006

46