Indexing of Multimedia Database

90.10.26



. ) (DBMS
.
.
. query .

. -
shot based Motion based TV-tree R-tree ...-
.


.....................................................................................................................................
3 ...........................................................................................................................................
4 ...........................................................................................
6 .......................................................................................................................
6 ..................................................................................................................
11 ........................................................................................................................ R-Tree
18 ................................................................................
27 .................................................................................................................
28 .......................................................................................................
30 ...................................................................................................................
31 .................................................................................................... Motion-based
35 .................................................................... shot-based
36 ......................................................... ........shot

38................................................................................................................................
38....................... ......................................................... ..........................................................

 .1
. )(DBMS

.
. -
.
) ( .
: ) (
) ( .

[1].
web
. .
] .[8
.
query
.
.
query
[2].

.
query [8].

 .2
.
.
. navigate browse -
query .
text-based :
.
.
.
.
. "
"
. .
.
.
.
content-based
[1].


-
. .
: visual browsing

 .
[2].

.3

a the of
. stop word .
stop word .
. Stemming
retrieval
retrieving retrieved retrieve
retrieve .

: school work learning study
reading
study [1].

.4

.
.
. .
.

 DBMS .
.
. query .
/ .
.
.
:
: -
query . Boolean.
query .
. -

.
.
.
man child woman query human being
.
.
.

shape texture .
:shape shape
. shape .

 shape
:
.1 shape ) (
.
Shape .2 .
shape.
shape Counter- base .Region-base
counter-base .
Region-base
shape shape
. shape CBIR :
.1 )(FD
.2 )(GD

:
.
.
3 .
RGB . m .
n bin ) .(n=m
16 4096 bin .
) H(M ) (h1,h2,,hj,,hn hj

 M bin j .
.
query .
.
.
d I,H :

=)d(I,H

il hl bin L I H.
3 pixel 8*8 8 c1 c8
.
8 8 7 c1
c4 9 c5 c8. 2
c1 c2 10 c3 c8.
:
)H1=(8,8,8,8,8,8,8,8
)H2=(7,7,7,7,9,9,9,9
)H3=(2,2,10,10,10,10,10,10
:

d(H1,H2)=1+1+1+1+1+1+1+1=8
d(H1,H3)=6+6+2+2+2+2+2+2=24
d(H2,H3)=5+5+3+3+1+1+1+1=20

 .
: texture
.
.
. texture -
:
:Coarseness .1 texture
texture coarseness . coarseness
. .
:Contrast .2 .
.a .
.b

.c
.d
:Directionality .3 -
. shape . texture

.
:Line likeness .4 shape texture .
shape .
:Regularity .5 .
texture . shape .

 : Roughness .6 rough texture smooth

. coarseness contrast .
6 texture .
texture QBIC contrast coarseness directionality
. [1] .

.
.4.1 R-Tree
R-tree R*-tree R+-tree
. R-tree
) ( .
2 .
.

.1

) R-tree :R-tree (R R+-

tree ) tree( .

.
R-tree ) (
) (

-
)(


. )
( )(
. R+-tree R-Tree
. 1 2 R-tree
R-tree . ) (
.
. R-tree

.

.
.
:
.
. R-tree
.

)(a

)(b
.1 R-tree

.2 :
.
(MBR) .
.
) MBR (

MBR
. )( MBR
.
.
.
.
.
)(
.
.


.
.
.
MBR
. MBR

.
.
.
.3 :
)( K .
.

. K
.
R-tree
.
.

.
) (
. ) (R-tree
.

 .
) (.
.4 )( :R-tree R-tree
. R-tree
.
R-tree .
R-tree .

.
r-12 1 R6 R5 R4 R3 R2 R1
R1 R2 .
R-tree
.
.
R-tree

R-tree .
R-tree :VAMsplit R-tree R+tree R-tree .5 R-tree
.


R-tree
.
R-tree R-tree R+-tree .

R-tree .
.1 R+-tree .
.2 .
.3 .
. R-tree

1 2 . R-tree
1 R1 R2 R7 ) r11 (
r12 r11 R5 R7 .
R-tree

.
r12
R2 .
R-tree R-tree

) (
.

S-tree .6 :SS+-tree R+- R*-

R-tree R-tree . R-tree
.
)SS-tree( SS+-Tree R-tree .
)( SS-Tree .
SS-Tree )(
.

ss+-tree . ss-tree .

 SS+-tree
.
SS SS+-tree ] 18 [20 .
) TV-tree .4.1.1 (
TV-tree R-tree .
. )

.
.
.
TV-tree
. TV-tree
.


.
.
.
TV-tree
[4].

 .4.2

.
.

query

.

. .
query .
query
. query

.

.
.


.


query . .


.
.

.


.


.

.
.

 query
.

.
.4.2.1 :
query .
:
.1 .
.
.

.
.2




... .

.

 .

.

:
.1 .
.2 .

.
SCM

.
.
.
.

.


.
-

object .

object -
.
.


.

.
KLT . PGA
KLT
.

 . .
KLT
.

.
PDF object
. .
object .

.
.

.4.2.2 Photo Book


.
.
.
40
.
.


.
.
.
.
.

2 3 .

 .a
.
3 .

. 3b-e
.
3c
.
"
" .3d :
. 3e
.
.
4 .

eigenface
.
. 5
eigenface .

.
.
%99 [3].

 .5
.
.

.
.
query .
query "
audio audio " query
.
content-based audio retrieval .
content-based audio retrieval :
Audio .1 audio music speech .
.2 audio .
speech speech speech
.
Query .3 audio .
.4 audio query
.
.5.1

:
.1
.2 sample-based

 effect sound:
sound effect
. MIDI
MPEG-4 .
audio sound
.
sound .
.
.
query
.

.
sample-based music

sample-based music .
.a :
query model
.
.b :
[1].

 .6
. ) (
play .
[1].

. shot
[7].
browsing-searching-navigating viewing.
Navigating Navigation .

Searching . query . browsing

. viewing
[5].
:
: Metadata- Based
.
: Text-Based :information retroviral) IR
. IR query
query ( .
: Audio-Based speech audio IR
.
: Content-Based .
.
.
shot-based video indexing.

 :
[1].

.6.1 Motion-Base
.
.
.
:
.6.1.1 : Feature-Based -
.
MPEG7
.
.6.1.2 : Trajectory-Based
.
.6.1.3 : Image-Based
. image-based
) (MAM . :
) :(MAM
. image-based
. MAM

MAM .
MAM .

optical .
.
-
.
.

. .
. .
.
MAM grid .
.
.
) X ( t
,t0,t1,t2,,tk .
:
(i, j) A

)X (t) = v (i, j, t

)V x (i, j, t
= )V (i, j, t

(i, j) A
)V y (i, j, t

) V x (i, j, t ) V y (i, j, t x y
(i , j) grid grid A .
) X(t :

))f(v(i, j, t

= )M(i , j

)) f(v(i, j, t ) grid(i , j grid A

. M
measure1 : Agrid 6
.

MAM image-based
MAM . MAM
.
MAM . MAM
MAM .
MAM
MAM .
. MAM
. MAM 6 -
.

.6 MAM

 MAM .
MAM . -
. MAM
MAM.

MAM .
MAM
. MAM .
MAM region-based . MAM
MAM
. MAM
. region-based .MAM
MAM 7 .

.7 MAM

.
MAM MAM -

 . MAM -
MAM region-based [6].
.6.2 shot-based video indexing and retrieval
.

.
shot.
shot :
.
.
/ ... .
.

Shot-based video indexing and retrieval :

 .1 shot )
(
.2 ) shot
shot( . .
.3 query video shot shot )
2
(.
shot shot
query . shot
) (r frame . query r frame .
.6.3 video shot

.
shot . shot .
texture shape color
query -
.
. query
shot .
:
.

[7].

 shot .
shot .
r frame . r frame
shot r frame shot .
r frame :
.1 r frame .shot
shot .
.2 r frame shot
r frame shot .
. shot .
.3 shot sub shot . r frame sub shot

.
sub shot .
.
r frame shot .
r frame :
.1 r frame
track zoom
.
.
.2
.

 r frame
.
.3 .
r frame .
.
. back ground
for ground back

ground .
[1].

.7

.
query .


.

.8

[1] Mais M. Fatayer, Multimedia Databases and Content-Based Retrieval, Department of

Computer Science.
IEEE

Databases,

Multimedia

of

Indexing

Content-Based

Wu,

Jian-Kang

][2

TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, VOL. , NO. ,

NOVEMBER/DECEMBER .

[3]

Alex

Pentland,

Content-based

indexing

of

images

and

video,

TheMedia

Laboratory,Massachusetts Institute ofTechnology, Ames Street, Cambridge, MA,USA.

[4] Guojun Lu , Techniques and Data Structures for Efficient Multimedia Retrieval Based on
Similarity, IEEE TRANSACTIONS ON MULTIMEDIA, VOL. , NO. , SEPTEMBER
[5] Oya Kalipsiz, Multimedia Databases, Yildiz Technical University, Computer Science
Department, EEE.

[6] Wei Zeng, Wen Gao, Debin Zhao, VIDEO INDEXING BY MOTION ACTIVITY MAPS,
Department of Computer Science and Engineering, Hdin Institute of Technology, Hahim, China
*Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China.
[7] Hyun Sung Chang Member IEEE, Sanghoon Sull Member IEEE, Sang Uk Lee Senior
Member IEEE , Efficient Video Indexing Scheme for Content-Based Retrieval, IEEE
TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. ,
NO. , DECEMBER .
[8] Partha Kr. Mukherjee, Mita Nasipuri, D.K Basu and M.Kundu, Indexing and Searching in
Multimedia Database Management System, INDIAN INSTITUTE OFTECHNOLOOY.
KHARAGPUR . DECEMBER -..
[] Kasturi Chatterjee and Shu-Ching Chen Florida International University, Affinity Hybrid
Tree: An Indexing Technique for Content-Based Image Retrieval in Multimedia Databases,
Distributed Multimedia Information System Laboratory School of Computing and Information
Sciences Miami, FL , USA.
[] John R. Smith, Milind Naphade, Apostol (Paul) Natsev, MILTIMEDIA

SEMANTIC INDEXING USING MODEL VECTORS, IBM T.J. Watson Research

Center Saw Mill River Road Hawthorne, NY USA.