. .

. .
. .
. .

071900
654700

-
-
2007

 681.3.06(075.8)
32.973.26-018.273
26
26

, . .

: Data Mining, Visual Mining, Text Mining,

OLAP / . . , . . , . . ,
. . . 2- ., . . .: -,
2007. 384 .: . + CD-ROM
ISBN 5-94157-991-8
, , " : OLAP Data Mining". : , , (OLAP),
(Data Mining), (Visual Mining)
(Text Mining) .
: , . .
-, Data Mining, Xelopes,
.

:

.
.

681.3.06(075.8)
32.973.26-018.273

02429 24.07.00. 14.11.06.

70 1001/16. . . . . 30,96.
1500 .
"-", 194354, -, . , 5.
-
77.99.02.953..006421.11.04 11.11.2004 .
.

" ""
199034, -, 9 , 12

ISBN 5-94157-991-8

. ., . ., . .,
. ., 2007
, "-", 2007

........................................................................................... 1
Data Mining .......................................................... 3
1. ......................................... 5
1.1. ............................................................ 5
1.2. ...................................................................................... 8
1.3. OLTP- .................... 13
................................................................................................................................ 18

2. ............................................................................ 19
2.1. ................................................................................... 19
2.2. .......................................................................................................... 26
2.3. ........................................................................................................... 31
2.4. ................................................................... 37
................................................................................................................................ 37

3. OLAP- .................................................................................... 40
3.1. ..................................................................................... 40
3.2. OLAP- ........................................................................................ 44
3.3. .......................................................... 45
3.3.1. ...................................................................................... 45
3.3.2. ........................................................................... 46
3.3.3. FASMI ............................................................................................................. 48
3.4. OLAP- ......................................................................................... 49
3.4.1. MOLAP .................................................................................................................... 50
3.4.2. ROLAP ..................................................................................................................... 53
3.4.3. HOLAP ..................................................................................................................... 56
................................................................................................................................ 57

IV

4. ................................................ 58
4.1. Data Mining .................................................................................. 58
4.2. Data Mining ...................................................................................................... 59
4.2.1. Data Mining ........................................................................ 59
4.2.2. ...................................................................... 61
4.2.3. .................................................................. 63
4.2.4. ............................................................................................. 65
4.3. Data Mining ..................................................................... 67
4.3.1. - ............................................................................................. 67
4.3.2. ................................................................................................................... 67
4.3.3. ................................................................................................. 68
4.3.4. ............................................................................... 68
4.3.5. ................................................................................................................. 69
4.3.6. ...................................................................................................... 70
4.3.7. .................................................................................................... 71
4.3.8. .................................................................................. 71
4.4. Data Mining .................................................................................................... 71
4.4.1. ..................................................................................... 71
4.4.2. ............................................................................................ 72
4.5. Data Mining .................................................................................................... 74
4.5.1. ...................................................................................................... 74
4.5.2. ...................................................................................................... 74
4.5.3. ....................................................................................... 77
4.5.4. ...................................................................................................... 79
4.6. .................................................................................... 80
4.6.1. ........................................................................................ 80
4.6.2. ............................................................................... 82
4.7. Data Mining .................................................................................................. 84
................................................................................................................................ 89

5. ............................................................. 91
5.1. ....................................................................................................... 91
5.2. ........................................................................................ 92
5.2.1. ......................................................................................... 92
5.2.2. .................................................................................................... 93
5.2.3. ...................................................................................... 94
5.3. ............................................................. 95
5.3.1. 1- ............................................................................ 95
5.3.2. Naive Bayes .................................................................................................. 97
5.4. ................................................................... 100
5.4.1. " " ........................................................................ 100
ID3 .................................................................................................. 103
C4.5 ................................................................................................. 106
5.4.2. .............................................................................................. 108

5.5. ...................................................... 113

5.5.1. ............................................................................................................. 113
5.5.2. . ........................................... 115
5.5.3. ............................................................................................. 116
5.5.4. Support Vector Machines (SVM)........................................................................... 116
5.6. ........................................................................ 120
5.6.1. ................................................................................................ 120
5.6.2. ..................................................... 120
.............................................................................................................................. 122

6. ........................................................ 124
6.1. ..................................................................................................... 124
6.1.1. .......................................................................... 124
6.1.2. ....................................................................................... 127
6.1.3. ..................................... 130
6.2. ...................................................................................... 132
6.3. ................................................................................................................. 136
6.3.1. Apriori................................................................................................... 136
6.3.2. Apriori ....................................................................... 141
.............................................................................................................................. 142

7. ................................................................................... 143
7.1. ........................................................................... 143
7.1.1. .......................................................................... 145
7.1.2. , ,
........................................................................................................ 147
7.2. ...................................................................................... 149
7.3. .......................................................................... 151
7.3.1. ................................................................................. 151
7.3.2. ................................................................................... 152
.......................................................................... 152
................................................................................. 154
7.3.3. ............................................................................... 155
k-means (Hard-c-means).................................................................. 156
Fuzzy -Means................................................................................ 160
-....................................................... 163
7.4. ........................................................................ 168
7.4.1. .................................. 168
7.4.2.
........................................................................................................ 168
....................................................................................... 169
.................................................................................. 170
.............................................................................................. 170
7.4.3. .................................................................... 171
.............................................................................................................................. 173

VI

8. Visual Mining ............................. 175

8.1. .............................................................. 175
8.2. ...................................................... 177
8.3. ............................................................................................... 182
8.3.1. ......................................................... 182
8.3.2. ............................................................................................ 186
8.3.3. , ............................................................. 188
8.3.4. ......................................................................................... 190
.............................................................................................................................. 192

9. Text Mining .......................... 194

9.1. .............................................................................................. 194
9.1.1. ......................................................................................... 194
9.1.2. .................................................................... 196
9.1.3. Text Mining ............................................................................................... 197
9.2. ................................................................ 198
9.2.1. ............................... 198
9.2.2. .................................................................................. 201
9.2.3. ................................................................ 204
9.3. ................................................................... 206
9.3.1. .......................................................... 206
9.3.2. ............................................... 208
9.4. ...................................................... 209
9.4.1. ............................................................... 209
9.4.2. ................................................ 211
9.4.3. ......................................................... 212
9.5. ................................................................................. 213
9.5.1. .................................................................. 213
9.5.2. ............................................... 216
9.6. ............................................................... 219
9.6.1. Oracle Oracle Text ........................................................................... 219
9.6.2. IBM Intelligent Miner for Text.................................................... 220
9.6.3. SAS Institute Text Miner .................................................................. 221
9.6.4. TextAnalyst ...................................... 222
............................................................................................................................. 223

10. Data Mining ................................................................. 224

10.1. ................................................................................................ 224
10.2. CWM ........................................................................................................ 224
10.2.1. CWM ............................................................................. 224
10.2.2. CWM .................................................................................. 226
10.2.3. Data Mining ............................................................................................... 229
10.3. CRISP ....................................................................................................... 233
10.3.1. CRISP .............................................................................. 233

VII

10.3.2. CRISP .............................................................................. 233

10.3.3. CRISP ....................................................................... 235
10.4. PMML ...................................................................................................... 240
10.5. Data Mining ............................................................................... 248
10.5.1. SQL/MM.............................................................................................. 248
10.5.2. OLE DB Data Mining................................................................... 250
10.5.3. JDMAPI ............................................................................................... 252
.............................................................................................................................. 252

11. Xelopes......................................................................... 255

11.1. ........................................................................................ 255
11.2. Model .................................................................................................... 258
11.2.1. Xelopes ............................................................................... 258
11.2.2. Model......................................................................................... 260
11.2.3. ................................................................................... 261
11.3. Settings .................................................................................................. 262
11.3.1. Settings........................................................................................ 262
11.3.2. Settings ...................................................................................... 264
11.4. Attribute................................................................................................. 264
11.4.1. Attribute ...................................................................................... 264
11.4.2. ................................................................................... 265
11.5. Algorithms ............................................................................................. 266
11.5.1. ............................................................................................... 266
11.5.2. MiningAlgorithm ....................................................................................... 267
11.5.3. MiningAlgorithm ................................................................ 268
11.5.4. .................................................................................... 270
11.5.5. ........................................................................................................... 270
11.6. DataAccess ............................................................................................ 270
11.6.1. ............................................................................................... 271
11.6.2. MiningInputStream.................................................................................... 272
11.6.3. Mining- .................................................................................... 272
11.6.4. , MiningInputStream............................................ 272
11.7. Transformation ...................................................................................... 273
11.8. Xelopes ...................................................... 275
11.8.1. ............................................................................................... 275
11.8.2. .............................................. 278
11.8.3. ......................................................................... 280
11.8.4. ........................................................................ 282
.............................................................................................................................. 285

12. .................................................. 287

12.1. ................................................................................. 287
12.1.1. .............................................................................................. 287
12.1.2. ................................................................... 288
12.1.3. ............................................................................ 291
12.1.4. JADE .................................................................. 291

VIII

12.2. ..................................... 293

12.2.1. .................................................. 293
12.2.2. - .............................................................................................. 293
12.2.3. .................................................... 295
12.3. ............................................................ 297
12.3.1. .............................................................. 297
12.3.2. ................................................... 298
12.3.3. ............................... 301
12.3.4. ........ 304
12.3.5.
................................................................................................... 307
.............................................................................................................................. 308

1. ...................................................... 311
1.1. .......................................... 311
1.2. .................................................................................................. 315
1.3. .................................................................................... 317
1.4. ............................................................................... 318
1.5. ..... 324
1.6. ........................................................................... 331

2.
......................................................................................................... 337
2.1. ... 337
2.2. .................................... 342
2.2.1. ...................................................................... 342
2.2.2. ........ 343
2.2.3. ............... 345
2.3. ........................................................... 348
2.4. , .............. 349
2.5. ............................................................................ 352
2.5.1. .............................................................................................. 352
2.5.2. ............................................................................................. 354
.................................................................... 354
.................................................................... 355
................................................................ 356
2.5.3. ........................................................................ 356
2.6.
....................................................................................................... 357

3. - .......................... 364
......................................................................................................... 368
.................................................................................... 372

,
. , , ,
.
, , ,
, , ,
, , .
,
, ,
.
:
, .
. . , . 7.4 . . .
, . ,
,
. ,
, "
". , ,
.

, .

, , ,
.
:
- Data Mining
;
. Prudsys

Data Mining

2002 ,
Berkeley, (5 000 000 000 000 000 000) . ,
23 . , , , . 2003 France Telecom (DSS system)
30 000 , a Alexa Internet Archive 500 000 .
, (Knowledge Discovery in Data workshop), 1989 ,
(1 000 000) . KDD-2003
(1 = 1 000 , 1 = 1 000 ).
- .
-
Data Mining.
Data Mining ( Knowledge Discovery In Data
) , . Data Mining
,
, .
Data Mining 1989
2003
. Data ining
: , , e, , ; , -

Data Mining

, , . . Data Mining
, - Google (search engines) .
, ,
, , , ,
. . Data Mining
(link analysis),
, , .
Data
Mining. 1970- 2- , , .
, OLAP, Data Mining.

Data Mining . Data Mining, , .
Data Mining.
Xelopes Prudsys, Data Mining.
, .
,
Data Mining .
-, KDnuggets
, ,
2004

1.1.


.
, (. 1.1), , , . .
. ,
, , ,
.
, ,
,
. ,
. , , ().

(DSS, Decision Support System).
,
. , :
;
;
.

. 1.1.

, , , , ,
.
, , -.

, .

,
. ,
.
.

.
, , . .
. , -
. , (, ,
. .) , -

. ,
, ,
. , ,
,
. , .
""
:
-

.
;

- -

, . -
;

,
, / ( ).

,
(. 1.2).

(-OLTP)

( /

(, SQL)

(OLAP)

(Data Mining)

. 1.2.

.
. , OLTP (On-

line transaction processing), ()

.
().

. :

- SQL (Structured Query Language);

.
OLAP (On-line analytical processing),
;
. Data Mining (" ").

1.2.
, . ().
!
, , .

.
,
, .
- ,
. , , , 60- .
.
.
.

( )
Information Management System (IMS) IBM.
1968 .
,
.
Data Base Task Group (DBTG)
Conference on Data Systems Languages (CODASYL).
DBTG 1971 .
, , . Integrated Database Management System (IDMS) Cullinet Software, Inc.
. "" "relatio" .

.
. , 1970 .
12 :
1. .
. , . , , , . , , .
,
.
2. . ,
( ( 2, 3)).
, . . , , .
, . . ,
.
3. NULL .
, NULL.
0.

10

4. . :
.
, . : (, ), ,
. , . .
.
5. .
.
SQL.
6. .
, .
(View).
.
( ,
).
7. . , . .
SQL.
8.
. , ,
( ,
.).
9.
. , ,
(
). , .
10. .
.
:

;
, .

11

- , , , . .
, , . : . , .
11. . ,
.
12. .
,
. ,
. .
, .
, () . .
, .

(). , , ,
. :
1- , , ,

( );

2- , 1- ,

( );
3- , 2- ,
( ) . .
,
. ,
, , .
,
BLOB

12

(Binary Large OBjects). , . , ,

.
- . . . , ,
, , , .

, ( ) . .
!
,
.
.

, , , . , , ,
. , ,
, ,
.
(ROLLBACK). , , (COMMIT).

. , , ( ),
. ,
, ,
, .
. ,

13

. .
.
,
.

.
OLTP-,
.
OLTP- , , , .
.

.
, , (, Executive Information Systems). , , ,
, - ,
. , , , . , .

1.3.
OLTP-
OLTP- .
, ,
, . , OLTP-,
. , OLTP . . 1.1.

14

1.1

OLTP-

()

, 100 %

, OLTP
.

15

. OLTP-

, , , .
, , (, . .).

, , . .
, , , ,
, . .
. OLTP-, , , ( ).
" "
.

.
. OLTP-,

, . - .

(, , , ). . . , ,
( ).

. , -

OLTP-, . , .
.
, , .
, . ( ) .

16

. OLTP- -

. , , . , . ,
, . OLTP .
, . ,
,
(, ).

. , -

, OLTP - . , OLTP ,
. OLTP
(, ). , , .

. OLTP- -

.
,
(, , . .). ,
.

. OLTP-, ,

, . , ( ) , . .
. , OLTP,

.
. .

, OLTP-, , -

17

.
.

.
, ,
. . , . . ,
, . . ,
. . 1.3
Oracle, ,
OLTP, . 1.4 .
CPU%

CPU%

100

100

80

80

60

60

40

40

20

20

7:00 9:00 11:00 13:00 15:00 17:00

. 1.3.
OLTP

7:00 9:00 11:00 13:00 15:00 17:00

. 1.4.

. OLTP- -

, . . . , . . ,
.

OLTP- , ,
. , .
OLTP
.

18

, , .
: ,

. : - , - .

, -

-
. , - , (OLAP). Data Mining.

: , -

. . .

, .
, -.

, ,

()
, .

, -

(OLTP-). , - .

OLTP-

- .
OLTP .

OLTP-

. OLTP-
.

2.1.
OLTP , ,
. 1.1, , ().
. ,
, 1988 ., . . . 1992 .
. " " ("Building the Data Warehouse", second edition
QED Publishing Group, 1996).
,
. ,
OLTP- .
( , , . .) , , , , ( ).
() .
.
!
-, , , , .

20

.
. .

, (, , , . .). , ,
. , .
,
(,
-, , ).

.

. , , -

.
, ,
, -.
,
.

.
.
. , ,
.

. ,
, ,
. , , . , , .
, , .

. , .
(. 2.1).

21

. , ,
, 1 %!
.
.
,
.
, , , ,
, . , ,
.
. , .
( ), .

. 2.1.

, .
()
. ,

. (. 2.2). :
, ;
, .