Вы находитесь на странице: 1из 9

, ,

A. A. Novosyolov
PARAMETRIZATION OF MODELS OF CONTROLLED SYSTEMS
The paper describes application of orthogonal series method for construction of controlled systems models under
non-parametric uncertainty. A key element of the method is draw of orthogonal expansion length based on observations, in other words, defining parametric structure of the model. The method is demonstrated for estimation of distribution density and regression function. Directions for generalizing onto multi-dimensional case are also presented.
Keywords: distribution density, regression function, orthogonal series, non-parametric estimate.
. ., 2010

004.932.2
. . , . . , . .

*

; . .
: , , .

[1].
, .
,
()
[2; 3], .

[4; 5].
, , - . ,
. ,
.
[68],

.
,

, . .

[9].


,
[10; 11]. MeanSC (
[12])
h.

. ,
, .
. ,
k- , N ,
X {x (i ) ( x1(i ) , ..., xk(i ) ) R k , i 1, N }, x (ji ) i- j- ( j 1, k ).

* ( 09-0712087-_).

56

. .

,
f ( x) x.
, x0 R k x10 x0 mh ( x0 ), x10

x (i ) k-
x, f ( x), x x1 , , xk R k - . f ( x) x R k
fN ( x),
1
fN ( x)
Nh k

x02 x10 mh ( x10 ) . . x0 ,


mh ( x0 ) 0, .
[14], ()
f ( x). , x0 x0 ,
x0 , , x0 .
X :
xi x j ,

x x (i )
,
h

i 1

h ; ( x) (), [10; 13].


, ,
,

, , .
,
.
[17; 18]
, .

MeanSC ( [12]),

,
. mh ( x) f ( x)

( x) ck || x || ,

ck 0; :[0; ) R
, :

(t ) 0; (t1 ) (t2 ), t1 t2 ;

(t )dt .
0

, , [13]:
2
1 1
V (k 2)(1 x ), x 1,
E 2 k

0,
,
Vk k- ;
N ( x) (2) k / 2 e

- .
MeanSC.
.
(
0 K 1, K
,
256), . , , .
MeanSC h, , T .
1. x R k
fN ( x).

|| x||2
2

-
,
f ( x ) f ( x)
([14])
2
c N x xi
fN ( x) k k
;

Nh i 1 h

x xi 2

( x xi ) h .
i 1

(t ) (t ) d (t ) / dt , ,
(t ) t [0; )
.
, [15; 16]
f ( x) f ( x) 2ck

N
Nh k 2

x xi
h

xi
mh ( x)

i 1


i 1

.
N

x
2

x xi

x R k x ,
, x, x . a , -

57

, ,

, a.
2. , x ( fN ( x ) ), -


.
5. x X
S ,

. X
2.
6.
. P,

Q( x ) X ,

x . x X ,
x0:
f ( x ) . 0 .
N

3. C X ,
, :
1) x C Q( x ) ;

Q( x1 ) Q( x2 ) ( 3), , ,
,
Q( x1 ) Q( x2 ). -

x1 Q ( x1 ) x2 Q ( x2 ),
,

P x1 , , x1 x1 , x2 x2 , , x2 . x1 , x2
, x1 x2 .
,
x P x1 ; x2 .

2) x1 , x2 , Q( x1 ), Q( x2 )
P R k , x1
fN ( x)
x2 ,
T .
min fN ( x1 ), fN ( x2 )

T 1 , .
, MeanSC
.
1. . [0; K 1]1 [0; K 1]k
2h (h ).
(
)
X.
2. X. x
x X. ( )
.
3. ()
S .
, X,
,
.
S.
4. s S s
fN ( x), s.

Z s | s S , f ( s ) .
0

h.
, ,
, , x.
.
. , MeanSC, h. [68],
.
. , [7]
, . , ( ) .
; L , MeanSC
h.

.
(),
(
), {G (1) , , G (l ) , , G ( L ) }, G (l ) l- -

S s0 s, , si
sS

, M (l ) .

si 1 mh ( si 1 ), , s , ,

58

. .

H ( l )


.
a b :

H (l ) H i , j (l ) N N , l- , :

0, ,
H a ,b ()
1, ,

0, ,
H i , j (l )
1, ,

L

1 L
H H i , j , H i , j H i , j (l ),
L l 1

a, b X , a b.
a b .
PU (U (a ) U (b)) . ,
M 2

i, j 1, , N . H i , j -

PU 1 (U ( a ) 1 | a ) (U (b) 1 | b) (U ( a )

i, j 1, , N , i j.

xi x j -

2 | a ) (U (b) 2 | b) 1

. , . ,
.
,
,

[9].
, . .

, . ,

Td .
,
, .


.
,
( ) U ,

M 2 . p( x | U r ) f r ( x), r 1, , M .
. ,
,

Pr (U r ),
r 1, , M ,

r 1

p() f r () Pr , a, b.
r 1

,
a b
Per (),
H a ,b () 0,
PU ,
Per ()
1 PU , H a ,b () 1.
,
Per () (1 H a ,b ()) PU H a ,b ()(1 PU )
PU (1 2 PU )H a ,b ().

: (). , H a ,b (()) H a ,b (),


Per (()) Per ().
L- 1 , , L
H (1 ), , H ( L ). , ,
L . ()

1 L
1
0, H (l ) ,
H ( H (1 ), , H ( L ))
L l 1
2
1, .


[6].
1.
() :

Pr 1.

f r ( a ) f r (b) Pr2
,
p ( a ) p (b)

r 1

f r ( x) x.
.
X M . , , . . ,

Per () PU (1 2 PU ) PH ,
Var Per () (1 2 PU ) 2 PH (1 PH ),

PH ( H () 1).
59

, ,

. ,

C++

EMeanSC h {h1 , , hL }, , T , Td . h1 , , hL

Per (1 , , L ) ,
, , a b. 1 , , L .

.
2. :
1 ,,L Per (1 , , L ) PU (1 2 PU ) PH , L ,

; ;
T , Td
.
. 1 2
. 3
. 4 .
5 Td

Var1 , , L Per (1 , , L ) (1 2 PU ) 2 PH , L (1 PH , L ),
L
1 L
1
PH , L H (l ) CLl PHl (1 PH ) L l ,
2
L l 1
L
l
1

2

.
1. ,
400 , (. 1),
(. 1, ). PRTools (PRTools: the
Matlab
Toolbox
for
Pattern
Recognition

http://www.prtools.org). , , . 1, . 2 , 200 .
2. (. 2), 200 , 100
(. 2, ). ,
. . 2, MeanSC . ,
. , , ,
(. 2, ).

.
. , Per () 1/ 2, . . , ,
. 1 ,
: PH 1/ 2 PU 1/ 2;
PH 1/ 2 PU 1/ 2. , , .
3. Per () 1/ 2
PH 1/ 2 PU 1/ 2,
, 1 PU ,

.

,
.

220

220

200

200

180

180

160

160

140

140

120

120

100

100

80

80

60

60

40

40

20

20

20

40

60

80

100

120

140

160

180

200

220

240

20

40

60

80

100

120

140

160

. 1. , 400 :
; EMeanSC
h {10; 10,5; 11; 11,5; 12; 12,5}, 0 , T 4, Td = 0,99 (2 )

60

180

200

220

240

. .
220

220

200

200

180

180

160

160

140

140

120

120

100

100

80

80

60

60

40

40

20

20
20

40

60

80

100

120

140

160

180

200

220

20

40

60

80

100

220

220

220

200

200

200

180

180

180

160

160

160

140

140

140

120

120

120

100

100

100

80

80

80

60

60

60

40

40

40

20

20

20

40

60

80

100

120

140

160

180

200

120

140

160

180

200

220

220

20
20

40

60

80

100

120

140

160

180

200

220

20

40

60

80

100

120

140

160

180

200

220

. 2. , 200 :
; MeanSC (12, 14 12 )
h {8; 8, 5; 9}, 0, T 5, 5; EMeanSC
h {8; 8, 5; 9}, 0, T 5, 5, Td 0, 999 (2 )

3. , 3 000 (. 3), 3 (. 3, ).
, ,
( ) (. 3, ).
(. 3, ) .
4.
( 500 450),
ALOS/ANVIR-2 17 2007 . (. 4). 5552'14.8'' 5555'2.13'' 8350'45.41'' 8354'51.6''
. . 4, .
. 2,4 ( 2 ). 18 . (. 4, ).
5. (. 5, ) 510 604 .
R G B. -

. ,
EMeanSC,
,
Td , . 5, .

, .
, .
.
EMeanSC,
. , .
,
,
.

61

, ,
250

250

200

200

150

150

100

100

50

50

50

100

150

200

250

50

100

150

250

250

250

200

200

200

150

150

150

100

100

100

50

50

50

50

100

150

250

0
0

200

200

250

50

100

150

200

250

50

100

150

200

. 3. , 3 000 :
; 3 5 (19, 8 5 , h {10; 15; 20} );
EMeanSC h {5; 10; 15; 20; 25}, 0, T 2, 5, Td 0, 75 (3 )

. 4. :
ALOS; EMeanSC h {5; 10; 15}, 0, T 1, 3, Td 0, 5.
6 : 1 ; 2 - ; 3
; 4 - ; 5

62

250

. .

. 5. :

; , , EMeanSC h {5; 7; 9}, 0,


T 1, 5, Td 0, 4 (18 ), 0,6 (12 ) 0,95 (6 )

6. . .
//
. 2010. . 15. 1. . 4052.
7. Strehl A., Ghosh J. Clustering ensembles a
knowledge reuse framework for combining multiple partitions // The Journal of Machine Learning Research. 2002.
Vol. 38. P. 583617.
8. Hong Y., Kwong S. To combine steady-state
genetic algorithm and ensemble learning for data clustering // Pattern Recognition Letters. 2008. Vol. 29(9).
P. 14161423.
9. Jain A. K. Data clustering: 50 years beyond Kmeans // Pattern Recognition Letters. 2010. Vol. 31, Is. 8.
P. 651666.
10. Parzen E. On the estimation of a probability density function and the mode // The Annals of Mathematical
Statistics. 1962. Vol. 33. P. 10651076.
11. Rosenblatt M. Remarks on some nonparametric
estimates of a density function // The Annals of Mathematical Statistics. 1956. Vol. 27. P. 832837.
12. . ., . . -


1. ., . . . : , 2006. . 812.
2. Dey V., Zhang Y., Zhong M. A review on image
segmentation techniques with remote sensing perspective
// ISPRS TC VII Symposium 100 Years ISPRS, Vienna.
Austria. July 57 2010. IAPRS. Vol. XXXVIII. Part 7A.
P. 3142.
3. Rekik A., Zribi M., Hamida A., Benjelloun1 M.
Review of satellite image segmentation for an optimal fusion system based on the edge and region approaches //
IJCSNS International Journal of Computer Science and
Network 242 Security. 2007. Vol. 7. 10. P. 242250.
4. Jain A. K., Duin R. P. W., Mao J. Statistical Pattern
Recognition: A Review // IEEE Transactions on Pattern
Analysis and Machine Intelligence. 2000. Vol. 22. 1.
P. 437.
5. Clausi D. A. K-means Iterative Fisher (KIF) unsupervised clustering algorithm applied to image texture
segmentation // Pattern Recognition. 2002. Vol. 35. 9.
P. 19591972.

63

, ,

grid- // . 2006. . 42. 2. . 9099.


13. . .
// . 1969. . 14. 1. . 156160.
14. Comaniciu D., Meer P. Mean shift: A Robust Approach toward Feature Space Analysis // IEEE Transactions on Pattern Analysis Machine Intelligence. 2002.
Vol. 24. 5. P. 603619.
15. Fukunaga K., Hosteeler L. D. The estimation of
the gradient of a density function, with applications in

patter recognition // IEEE Trasactions on Informational


Theory. 1975. Vol. 21. P. 3240.
16. Cheng Y. Mean shift, mode seeking, and clustering // IEEE Tans. Pattern Analysis and Machine Intelligence. 1995. Vol. 17. P. 790799.
17. Comaniciu D., Meer P. Distribution Free Decomposition of Multivariate Data // Pattern Analysis and Applications. 1999. Vol. 2. P. 2230.
18. Freedman D., Kisilev P. Fast Mean Shift by Compact Density Representation // IEEE Conference on Computer Vision and Pattern Recognition. 2009. P. 18181825.

I. A. Pestunov, V. B. Berikov, Yu. N. Sinyavskiy


ALGORITHM FOR MULTISPECTRAL IMAGE SEGMENTATION BASED
ON ENSEMBLE OF NONPARAMETRIC CLUSTERING ALGORITHMS
The method for constructing an ensemble of nonparametric clustering algorithms is proposed. Its theoretical substantiation is resulted. Results of the model data and real images confirm the efficiency of the proposed method.
Keywords: multispectral image segmentation, nonparametric clustering algorithms, ensemble approach.
. ., . ., . ., 2010

519.24
. .

, ,
. .
: , , , , , , .
: .

[1].
, .
.
,

, .
, , .
. . [1]
: , ,
6 :
;


;
,
;
, ,
;

;
, .
-: .
,

[1]. ,

64

Оценить