Академический Документы
Профессиональный Документы
Культура Документы
#.amle/
Digital Image Processing 0
#stimating motion +ield
1. #atchin" of 0locks.
6. #atchin" of o01ects. !nterpretation nee$e$. 3 sparse
motion fiel$.
3. #atchin" of interest points. 3 0it $enser motion fiel$. 3
more $ifficult interpretation. Pro0lems +ith repetitive
structures.
. /ptic flo+4 a $ifferential techni(ue matchin" intensities
on a pi-ellevel4 e-plorin" spatial an$ time variations.
!$eall'4 a $ense motion fiel$. Pro0lems for te-tureless
parts of ima"es $ue to aperture pro0lem )to 0e
e-plaine$*.
Digital Image Processing
"egmentation in 1ideo2
sequences
7ack"roun$ 2u0traction
feature.0ase$ metho$s
ima"e noise4
illumination chan"es4
non.ri"i$ motion4
...
8on.sta0le 0ack"roun$
...
Digital Image Processing 1%
;lock matc3ing met3od
9enerall'4 optical
flo+ correspon$s to
the motion fiel$4 0ut
not al+a's.
,
_
t x t
t
I
t
x
x
I
x
v
t
x
t
I
I
v
{
0
) (
t
x f
7ecause no chan"e in 0ri"htness +ith time
Digital Image Processing 2-
v
x
I
(patial derivative (patial derivative
Temporal derivative Temporal derivative
t
I
&racking in t3e 1D case/
x
) , ( t x I
) 1 , ( + t x I
p
t
x
x
I
I
p x
t
t
I
I
x
t
I
I
v
)ss&mptions' )ss&mptions'
5
*rightness constanc% *rightness constanc%
5
(mall motion (mall motion
Digital Image Processing 20
&racking in t3e 1D case/
x
) , ( t x I
) 1 , ( + t x I
p
x
I
t
I
Temporal derivative at + Temporal derivative at +
nd nd
iteration iteration
Iterating helps refining the velocit% vector Iterating helps refining the velocit% vector
Can keep the same estimate for spatial derivative Can keep the same estimate for spatial derivative
x
t
previous
I
I
v v
Converges in abo&t , iterations Converges in abo&t , iterations
Digital Image Processing 3=
>rom 1D to 2D tracking
The Math is ver% similar' The Math is ver% similar'
v
x
) , ( t x I
) 1 , ( + t x I
1
v
2
v
3
v
4
v
x
y
) 1 , , ( + t y x I
) , , ( t y x I
x
t
I
I
v
b G v
1
1
]
1
p y y x
y x x
I I I
I I I
G
around window
2
2
1
]
1
p t y
t x
I I
I I
b
around window
Digital Image Processing 31
?$& in P'ramids
Pro0lem:
+e +ant a lar"e +in$o+ to catch lar"e motions4
0ut a lar"e +in$o+ too oft en 0reaks the coherent
motion assumptionC
To circumvent this pro0lem4 +e can track first over
lar"er spatial scales usin" an ima"e p'rami$ an$
then refine the initial motion velocit' assumptions
0' +orkin" our +a' $o+n the levels of the ima"e
p'rami$ until +e arrive at the ra+ ima"e pi-els.
Digital Image Processing 32
?$& in P'ramids
,irst solve optical flo+ at the top la'er an$
then to use the resultin" motion estimates as the
startin" point for the ne-t la'er $o+n.
?e continue "oin" $o+n the p'rami$ in this manner
until +e reach the lo+est level.
Thus +e minimize the violations of our motion
assumptions an$ so can track faster an$ lon"er
motions.
image I
image J
Gaussian pyramid of image I
t-1
Gaussian pyramid of image I
image I image I
t-1
!oarse2to2+ine o(tical +lo6
estimation
run iterative D.E
run iterative D.E
+arp F upsample
.
.
.
Digital Image Processing 3%
#dge
;
lar"e "ra$ients4 all the same
; lar"e
1
4 small
6
G ,rom Ehurram =assan.2hafi(ue C3PH1H Computer Vision 6II3
Digital Image Processing 3)
$o6 te.ture region
;
"ra$ients have small ma"nitu$e
; small
1
4 small
6
G ,rom Ehurram =assan.2hafi(ue C3PH1H Computer Vision 6II3
Digital Image Processing 3*
@ig3 te.tured region
;
"ra$ients are $ifferent4 lar"e ma"nitu$es
; lar"e
1
4 lar"e
6
G ,rom Ehurram =assan.2hafi(ue C3PH1H Computer Vision 6II3
Digital Image Processing 3,
$ocal +eatures +or tracking
=arrisMs $efinition:
&6o criteria/
dvantages /
Disadvantages/
3n initial +in$o+ is
place$ over a t+o.
$imensional arra' of
$ata points an$ is
successivel'
recentere$ over the
mo$e )or local peak*
of its $ata $istri0ution
until conver"ence
!om(uter 1ision 2 >all 2==1Digital
Image Processing %,
Mean2s3i+t algorit3m
9ra$ient metho$
The mo$el
locates the cars
in each 0inar'
feature ima"e
usin" the 7lo0
3nal'sis 0lock.
The mo$el uses an optical flo+ estimation techni(ue to
estimate the motion vectors in each frame of the vi$eo
se(uence.
7' threshol$in" an$ performin" morpholo"ical closin" on the
motion vectors4 the mo$el pro$uces 0inar' feature ima"es.
Digital Image Processing )3
!3ange2based blob tracking
3l"orithm
"'stem
Digital Image Processing )*
Model o+ s'stem
Model o+ s'stem
Digital Image Processing ),
&racking +ormulated using t3e
@idden Markov model B@MMC