Академический Документы
Профессиональный Документы
Культура Документы
Bingwei He*
School of Mechanical Engineering and Automation, Fuzhou University, Fuzhou, P.R. China
Email: bingwei_he@hotmail.com
AbstractThe objective of stereo rectification is to make the
corresponding epipolar lines of image pairs be parallel to
the horizontal direction, so that the efficiency of stereo
matching is improved as the corresponding points stay in
the same horizontal lines of both images. In this papera
simple and convenient rectification method of calibrated
image pairs based on geometric transformation is proposed,
which can avoid the complicated calculation of many
previous algorithms such as based on epipolar lines, based
on fundamental matrix or directly depend on corresponding
points. This method is divided into two steps including
coordinate system transformation and re-projection of
image points. Firstly, we establish two virtual cameras with
parallel optical axis by coordinate system transformation
based on the pose relationship of the two cameras from
calibration result. Secondly, we re-project the points of the
original image onto new image planes of the virtual cameras
through geometrical method, and then realized the stereo
rectification. Experiments of real stereo image pairs show
that the proposed method is able to realize the rectification
of stereo image pairs accurately and efficiently.
Index termsstereo rectification, coordinate transformation,
calibrated cameras, epipolar line
I. INTRODUCTION
Stereo matching is an important part of stereo vision,
the purpose of which is that searching the corresponding
feature points of stereo image pairs taken from two
different views of a same scene by cameras. Since there
are epipolar geometry constraints in stereo image pairs,
the corresponding points matching is implemented along
the corresponding epipolar lines. While the corresponding
epipolar lines of stereo image pairs lay on the same
horizontal or vertical lines, the searching space will be
reduced from 2-dimension to 1-dimension. And then the
complex computation of epipolar line from lots of
corresponding points can be avoided, that improves the
searching efficiency greatly. However, it is very difficult
to ensure the epipolar lines lay on the same horizontal or
*Corresponding author at: School of Mechanical Engineering and
Automation, Fuzhou University, Fuzhou 350108, P.R.China.
E-mail address: bingwei_he@hotmail.com (B.W. He)
18
Camera model
Pinhole model is a common camera model (Fig.1), the
image position of an arbitrary point in 3D world is
approximately described by pinhole model. Let the world
point be Pw(x, y, z) and image point be pp (u, v), the image
point pp in the image coordinate system pI(xI, yI) and in
the camera coordinate system pc(xc, yc, zc) is obtained
according to geometry.
x I = (u u 0 ) k u
y I = (v v 0 ) k v
(1)
xc = f (u u0 ) / f u
y c = f ( v v0 ) / f v
z = f
c
(2)
FR = [ L RR
f ul
K L = 0
0
0
f vl
0
TR ]
(3)
u0l
v0l
1
(4)
f ur
K R = 0
0
0
f vr
0
u0 r
v0 r
1
(5)
19
B.
a) parallel-type
b) convergent-type
c) general-type
Figure 2. The configuration of stereo vision system
20
FL = R ( z , ) R ( y, )
(6)
Where:
cos
R( y, ) = 0
sin
0 sin
1
0
0 cos
cos
R ( z , ) = sin
0
sin
(7)
0
0
1
cos
0
(8)
t3
t1 + t 2 + t 3
2
sin =
(9)
2
t2
t1 + t 2
2
(10)
2
1
L
FL = F
L
= R ( y, ) R ( z, )
1
cos cos
= sin
sin cos
cos sin
cos
sin sin
sin
0
cos
(11)
FR = L FL L RR
(13)
(12)
(14)
ycr = f r (vr v0 r ) / f vr
z = f
r
cr
PcR = R FR PcR
(15)
(16)
(17)
y nl = f n ycl z cl
z = f
n
nl
(18)
vl = k nv y nl + v0 l = f nv ycl z cl + v0
(19)
x cr y cr z cr
(19)
= arcsin
(20)
vr = f nv ycr z cr + v0
(21)
intrinsic
parameters
IV. EXPERIMENTS
The proposed algorithm is tested with image pairs
taken by a stereo vision system which is composed of two
AVT Marlin F-080C cameras with 1024768 resolution.
The pose relationship of these two cameras is unknown,
also the focal length and principal points of them is
uncertain, so the extrinsic and intrinsic parameters of this
stereo vision system are calculated using the calibration
method which proposed by zhengyou Zhang[14] before
rectification, and then the proposed algorithm is
implemented after distortion correction.
Table 1 shows the intrinsic and extrinsic parameters of
cameras which obtained from calibration. From LTR we
can get and .
378.77 2 + 15.512
(22)
= 2.345
fu
fv
s
u0
v0
(23)
left camera
right camera
3472.60
3466.08
3470.35
3465.03
0
0
583.95
633.76
447.05
514.444
0.9443 0.0285 - 0.3279
L
RR = - 0.0270 0.9996 0.0093
0.3280
0
0.9447
15.51
= 9.693
extrinsic parameters
(24)
(25)
CAMERAS
= f n y cr z cr
y nr
z = f
n
nr
64.75
= arcsin
TABLE I.
21
fnu
3472.60
3472.60
fnv
3470.35
3470.35
s
0
0
u0
583.95
583.95
v0
447.05
447.05
22
TABLE III.
a) Before rectification
b) After rectification
Figure 7. Pair of chess board images before and after rectification
Left
image
Right
image
Vertical
disparity
Left
image
Right
image
Vertical
disparity
193.701
184.647
218.365
184.647
-24.664
-26.540
186.376
183.908
186.449
184.003
-0.073
-0.095
251.931
276.836
-24.905
246.551
246.577
-0.026
247.569
274.702
-27.133
245.656
245.662
-0.006
311.045
301.224
374.354
365.674
437.04
421.139
493.130
544.617
336.991
334.224
398.336
397.281
459.207
459.230
520.632
584.41
-25.946
-33.000
-23.982
-31.607
-22.1672
-38.091
-27.502
-39.794
307.345
305.947
368.868
367.878
430.432
429.355
491.899
553.727
307.302
305.912
368.866
367.975
430.398
429.288
491.858
553.802
0.043
0.035
0.002
-0.097
0.034
0.067
0.041
-0.075
611.569
645.644
-34.075
616.310
616.234
0.076
a) Before rectification
b) After rectification
a) Before rectification
23
b) After rectification
a) Before rectification
b) After rectification
a) Before rectification
b) After rectification
V. CONCLUSIONS
An algorithm of stereo rectification based on calibrated
cameras with coordinate system transformation is
presented in the paper. After getting the intrinsic and
extrinsic parameters of cameras from calibration, we can
combine the invariance of cameras optical centers with
coordinate system transformation to establish a virtual
parallel-type stereo vision system at first, and then
re-project all the original image points of left and right
cameras to the new image plane of each virtual camera by
geometry, finally finish the whole process of the
rectification. This algorithm avoids the complex
computation of epipolar lines or fundamental matrix, also
omit the matching process of large corresponding points
in uncalibrated cameras rectification, and it is more
simple and intuitive than previous algorithm. At last,
various experiments have been carried out and the results
show the proposed algorithm is effective and feasible.
Copyright 2011 MECS
ACKNOWLEDGEMENT
The work described in this paper was supported in part
by a grant from Program for New Century Excellent
Talents in Fujian Province University (Project no.
XSJRC2007-07).
REFERENCES
[1] N Ayache, C Hansen, Rectification of image for binocular
and trinocular stereovision, In proceedings of 9th
International Conference on Pattern Recognition, pp.11-16,
1988.
[2] A Fusiello, E Trucco, A Verri, A compact algorithm for
rectification of stereo pairs, Machine Vision and
Applications, vol. 12, pp.1622, July 2000.
[3] R Hartley. Theory and practice of projective
rectification, International Journal of Computer Vision,
vol. 35, NO.2, pp.115127, Nov 1999.
24