Академический Документы
Профессиональный Документы
Культура Документы
net/publication/224127494
CITATIONS READS
241 922
2 authors:
Some of the authors of this publication are also working on these related projects:
High dimensional seismic interpolation using data-driven tight frame View project
All content following this page was uploaded by Jianwei Ma on 21 July 2014.
M
©DIGITAL VISION
ultiresolution methods are
deeply related to image pro-
cessing, biological and com-
puter vision, and scientific
computing. The curvelet trans-
form is a multiscale directional transform that
allows an almost optimal nonadaptive sparse rep-
resentation of objects with edges. It has generated
increasing interest in the community of applied
mathematics and signal processing over the
years. In this article, we present a review on the
curvelet transform, including its history begin-
ning from wavelets, its logical relationship to
other multiresolution multidirectional methods
like contourlets and shearlets, its basic theory and
discrete algorithm. Further, we consider recent
applications in image/video processing, seismic
exploration, fluid mechanics, simulation of partial
different equations, and compressed sensing.
INTRODUCTION
Most natural images/signals exhibit line-like
edges, i.e., discontinuities across curves (so-called
line or curve singularities). Although applications
of wavelets have become increasingly popular in
scientific and engineering fields, traditional wave-
lets perform well only at representing point sin-
gularities since they ignore the geometric
properties of structures and do not exploit the
regularity of edges. Therefore, wavelet-based com-
pression, denoising, or structure extraction
become computationally inefficient for geometric
features with line and surface singularities. In
fluid mechanics, discrete wavelet thresholding
often leads to oscillations along edges of the
coherent eddies and, consequently, to the deterio-
ration of the vortex tube structures, which in turn
|
is satisfied. Then only two “neighbored” translates of V 2N in the
|
sum overlap. Such windows V N can be simply constructed as
2p-periodizations of a scaled window V 1 Nv/2p 2 , where V is
given in “Window Functions.”
In this way we approach the goal to get a set of curvelet
functions with compact support in frequency domain on wedg-
es, where in the circular ring that corresponds to the scale 2 2j
the sum of the squared rotated curvelet functions depends only
on W 1 2 2jr 2 , i.e., it follows that
Nj 21 N 21
3j/4 ^ 2pl 2 j
|2 2pl
a ` 2 fj, 0, 0 ar, v 2 N b ` 5 |W 1 2 r 2 | a V Nj av 2 N b
2j 2
[FIG3] Tiling of the frequency domain into wedges for l50 j l50 j
curvelet construction.
5 |W 1 2 2jr 2 |2 . (4)
where we use suitable window functions W and | V Nj, and where a
rotation of f^ j, 0, 0 corresponds to the translation of a 2p-periodic Together with (3), that means that using the rotations of
|
window function V Nj. The index Nj indicates the number of wedges the dilated basic curvelets f^ j, 0, 0, we are able to guarantee an
in the circular ring at scale 2 2j (see Figure 3). To construct a (dilat- admissibility condition similar to (1) for the 1-D wavelet frame.
ed) basic curvelet with compact support near a “basic wedge” (see Remember that the translates of fj, 0, 0 have no influence here,
e.g., the gray wedge in Figure 3 for j 5 0), the two windows W and since translates in space domain correspond to phase shifts in
|
V Nj need to have compact support. The idea is to take W 1 r 2 sim- frequency domain that do not change the support of the
ilarly as in the 1-D case, to cover the interval 1 0, ` 2 with dilated Fourier transformed curvelets. The basic curvelet f^ j, 0, 0, 0 is
|
curvelets, and to take V Nj such that a covering in each circular illustrated in Figure 4.
|
ring is ensured by translations of V Nj. Here, we have r [ 3 0, ` 2 , There is a last point we have to attend to, namely the “hole”
therefore we cannot take the complete Meyer wavelet to deter- that arises in the frequency plane around zero, since the rota-
mine W, but only the part that is supported in 3 1/2, 2 4 (see tions of the dilated basic curvelets work only in the scales 2 2j
Figure 2). Then the admissibility condition (1) yields for j 5 0, 1, 2, c. Taking now all scaled and rotated curvelet
` elements together with Nj J 4 # 2<j/2= we find for the scales 2 2j,
a |W 1 2 r 2 | 5 1
2j 2
(3) j 5 0, 1, c with (3) and (4)
j5 2`
` Nj 21 `
for r [ 1 0, ` 2 . For an explicit construction of W , see “Window 3j/4 ^ 2pl 2
a a `2 fj,0,0 ar, v 2 N b ` 5 a |W 1 2 r 2 | ,
2j 2
Functions.” j50 l50 j j50
Further, for the tiling of a circular ring into N wedges,
where N is an arbitrary positive integer, we need a 2p-periodic and this sum is only for r . 1 equal to one. For a complete
|
nonnegative window V N with support inside 3 22p/N, 2p/N 4 covering of the frequency plane, we therefore need to define a
such that low-pass element
2
1.5
1
1
0.8
0.6 0.5
0.4 0
0.2 –0.5
0 –1
2
1 2 –1.5
0 1.5
–1 1
0.5 –2
–2 0 0 0.5 1 1.5 2
(a) (b)
[FIG4] Basic curvelet f^ 0,0,0 in the (a) frequency domain and (b) its support.
`
2) If the number of wedges increases like 1/scale (i.e., like 2j),
f^ 21 1 j 2 J W0 1 |j| 2 with W 02 1 r 2 2 J 1 2 a W 1 2 2jr 2 2 (5)
j50 then we obtain tight frames of ridgelets.
3) If the number of wedges increases like "1/scale (i.e., like
that is supported on the unit circle, and where we do not con- 2j/2 ), the curvelet frame is obtained. This special anisotropic
sider any rotation. scaling law yields the typical curvelet elements whose proper-
ties are considered next.
HOW MANY WEDGES SHOULD
BE TAKEN IN ONE CIRCULAR RING? WHAT PROPERTIES DO THE CURVELET
As we have seen already in Figure 3 and postulated in the last ELEMENTS HAVE?
subsection, for the curvelet construction, there are Nj 5 4 # 2<j/2= To obtain the complete curvelet family, we need to consider the
angles (or wedges) chosen in the circular ring (with radius rotations and the translations of the dilated basic curvelets fj,0,0.
2 j21/2 # r # 2 j11/2 ) corresponding to the 2 2j th scale, see [11]. We choose
But looking at the above idea to ensure the admissibility condi- ■ an equidistant sequence of rotation angles u j, l,
tion for a tight frame, one is almost free to choose the number
pl 2 2<j/2=
of wedges/angles in each scale. Principally, the construction u j, l: 5 with l 5 0, 1, c, Nj 2 1
2
works for all ratios of angles and scales. In fact this is an impor-
j,l j,l
tant point, where curvelets differ from other constructions. ■ the positions b k 5 bk1,k2 J Ru21
j, l
11 k1 /2j 2 1 k2 /2j/2 22 T with
1) If we take the number of wedges in a fixed way, independent k1, k2 [ Z, and where Ru denotes the rotation matrix with
of the scale, we essentially obtain steerable wavelets. angle u.
Remark
ξ2
The concept “essential support” of a function f with good decay
properties is used in literature without rigorous definition but
32 with the following intuitive meaning: the essential support is a
finite region that contains the most important features of the
function. Outside this support, the graph of f consists mainly of
16 asymptotic tails that can be neglected in certain considerations.
[FIG6] Maximal supports of f^ 2,k,0 and f^ 2,k,5 (dark grey); of f 5 a 8 f, fj,k,l 9 fj,k, l, (7)
f^ 3,k,3 f^ 3,k,6 and f^ 3,k,13 (light grey); and of f^ 4,k,0 and f^ 4,k,11 (grey). j,k,l
The translation index k [ Z2 does not influence the support of
the curvelet elements. and the Parseval identity
j,k,l
holds. For a proof, we refer to [11]. The terms cj,k,l 1 f 2 J 8f, fj,k,l 9
are called curvelet coefficients. In particular, we obtain by
Plancherel’s Theorem for j $ 0
with the window function W as in the section “How to Transfer Observe that the angles u j, l, which range between 2 p/4
This Idea to the Curvelet Construction” and with a nonnegative and p/4, are not equispaced here, while the slopes are.
window V with compact support in 3 22/3, 2/3 4 ; see “Window Now, let the curvelet-like functions be given by
Functions.” This adapted scaled basic curvelet f |^
j,0,0 in Figure 8 is
| 1x2 J f | |j, l
the Cartesian equivalent to f^ j, 0, 0 in (2) (see Figure 4). f j, k, l j, 0, 0 1 Suj, l 1 x 2 b k 2 2 ,
T
(9)
2
1.5
1
1
0.8
0.6 0.5
0.4 0
0.2 –0.5
0 –1
2
1 2 –1.5
0 1.5
–1 1
0.5 –2
–2 0 0 0.5 1 1.5 2
(a) (b)
[FIG8] (a) Basic curvelet f|^0,0,0 and (b) its support adapted to the Cartesian arrays in frequency domain.
1 0
Su 5 a b, for all j in the eastern cone K 5 5 j 5 1 j1, j2 2 T: j1 . 0, j2
2 tanu 1
[ 3 2 j1, j1 46 , where we have taken also the two corner elements
in the sum. Similarly, this assertion is true for the rotated func-
| 1 k1 2 2j, k2 2 2: j/2; 2 5: Su2T
and where b kj,l J Su2T kj denotes the tions in the other three cones.
position of f|j,k,l in space domain. Let us have a closer look at
j, l j, l
|^ 1 j 2 e i8kj, j9dj
5 3 2 f^ 1 Suj, lj 2 f (10)
j,0,0
|^ j,k,l is compactly supported on sheared trapezoids. R
Hence, f
Let us for example examine f |^ . For j 5 4, we consider the with kj 5 1 k12 2j, k22 2: j/2; 2 T, 1 k1, k2 2 T [ Z2.
4,k,l
angles tanu 4, l 5 l/4, l 5 2 3, c, 3. The support of f |^
j,k,0 is The forward and the inverse fast discrete curvelet trans-
symmetric with respect to the j1 axis, and for j 5 4 we have form as presented in [7] have a computational cost of
O 1 N 2log N 2 for an 1 N 3 N 2 image, see e.g., CurveLab (http://
|^ 1 j1 1
supp f 4, k ,0 5 e 1 j1, j2 2 : 8 # j1 # 32, 2 #
T
# f. curvelab.org) with a collection of MATLAB and C++ programs.
6 j2 6
The redundancy of that curvelet transform implementation is
The supports of f |^
4,k,l with l 5 23, c, 3 in the eastern cone about 2.8 when wavelets are chosen at the finest scale, and 7.2
are now sheared versions of this trapezoid (see Figure 9). otherwise (see e.g., [7]); see the “Forward Algorithm,” which
The set of curvelets f | in (9) needs to be completed by sym- uses formula (10).
j,k,l
metry and by rotation by 6p/2 radians to obtain the whole family. For the inverse curvelet transform, one applies the algorithm
Moreover, as we can also see in Figure 9, we need suitable “corner in each step in reversed order. Observe that in the second step, a
elements” connecting the four cones (north, west, south, and suitable approximation scheme has to be applied in the forward
east). In [7], it is suggested to take a corner element as the sum of transform and in the inverse transform.
two half-part sheared curvelet functions of neighboring cones as
indicated in Figure 9 (on the left). THREE-DIMENSIONAL CURVELET TRANSFORM
Finally, the coarse curvelet elements for low frequencies are For three-dimensional (3-D) data, a generalization to 3-D multi-
needed, and we take here scale geometric methods is of great interest. So far, only a few
papers have been concerned with applications of the 3-D
| |
f 21,k,0 1 x 2 J f 21 1 x 2 k 2 , k [ Z2 ,
8 8 l = −1 and the 2-D FFT of length N gives us the samples f^ 12pn1, 2pn2 2,
n1, n2 5 2 N/2, c, 1N/2 22 1.
l=0
−4 8 16 32 ξ1 −4 8 16 32 ξ1 2) Compute f^ 1Suj, lj2 by interpolation.
l=1 Fix the scales to be considered, say j0 # j # J. The support of f |^
j,0,0 is con-
tained in the rectangle Rj 5 32j21, 2j11 4 3 3 2 2:j/2;, 2:j/2; 4. For each pair 1j, l2
−16 l = 2 −16 ^
compute now f 12pn1, 2pn2 2 2pn1tanu j, l 2 for 2p1n1, n2 2 [ Rj.
l=3 |
3) Compute the product f^1S j 2 f^ 1j 2.
uj, l j,0,0
For each pair 1j, l2 compute the product
|^ 12pn , 2pn 2.
f^12pn1, 2pn2 2 2pn1tanu j,I 2 f j,0,0 1 2
50 50 50
50 50 50
[FIG10] Image denoising: (a) noisy image, (b) wavelet denoising, (c) TV-diffusion denoising, (d) contourlet denoising, (e) curvelet
denoising, and (f) TV-combined curvelet denoising.
set from a carbonate environment. Comparisons of wavelets, con- transform to obtain the final depth migrated image. Currently,
tourlets, curvelets, and their combination for denoising of ran- they concentrate on a ray-based type of prestack depth-migration
dom noise have been also investigated in [58]. Douma and de (i.e., common-offset Kirchhoff depth migration) with respect to
Hoop [25] presented a leading-order seismic imaging by curve- heterogeneous velocity models. It turns out that curvelets are
lets. They show that using curvelets as building blocks of seismic almost invariant under the migration operations. The final objec-
data, the Kirchhoff diffraction stack can (to leading order in angu- tive is to be able to derive a formulation and build an efficient
lar frequency, horizontal wave number, and migrated location) be algorithm for the full waveform inversion in the curvelet domain.
rewritten as a map migration of coordinates of the curvelets in In addition, curvelet-based primary-multiple separation [35],
the data, combined with an amplitude correction. This map extrapolation [41], and seismic data recovery [34], [33], [65]
migration uses the local slopes provided by the curvelet decompo- have been also proposed by Herrmann et al.
sition of the data. Chauris and Nguyen [16] considered seismic
demigration/migration in the curvelet domain. The migration TURBULENCE ANALYSIS IN FLUID MECHANICS
consists of three steps: decomposition of the input seismic data Turbulence has been a source of fascination for centuries
(e.g., common offset sections) using the curvelet transform; inde- because most fluid flows occurring in nature, as well as in engi-
pendent migration of the curvelet coefficients; and inverse curvelet neering applications, are turbulent. Fluid turbulence is a para-
digm of multiscale phenomena, where the
coherent structures evolve in an incoher-
ent random background. Turbulence is
difficult to approximate and analyze
mathematically or to calculate numeri-
cally because of its range of spatial and
temporal scales. The geometrical repre-
sentation of flow structures might seem
(a) (b) (c) to be restricted to a well-defined set of
curves along which the data are singular.
[FIG11] Comparison of seismic denoising: (a) original data, (b) wavelet denoising, and As a consequence, the efficient compres-
(c) curvelet denoising. sion of a flow field with minimum loss of
10 10 20 20
20 20 40 40
30 30 60 60
80 80
40 40
100 100
50 50 120 120
60 60 140 140
70 70 160 160
10 20 30 40 50 60 70 10 20 30 40 50 60 70
20
40
60
80
0
0
0
0
20
40
60
80
0
0
0
0
10
12
14
16
10
12
14
16
10 10 20 20
20 20 40 40
30 30 60 60
80 80
40 40
100 100
50 50 120 120
60 60 140 140
70 70 160 160
10 20 30 40 50 60 70 10 20 30 40 50 60 70
20
40
60
80
0
0
0
0
20
40
60
80
0
0
0
0
10
12
14
16
10
12
14
16
[FIG14] Curvelet coefficients of an instant wave field at the coarsest curvelet detail scale. (a)–(h) denotes eight different directional
subbands in this curvelet scale.
min |c 7 1 l7c 7 .
7y 2 A
c l2 l1
|T 1 y 2 A
cp11 5 St 1 cp 1 A |c 2 2 , (c) (d)
p
50 35
30
until 7cp11 2 cp 7 , e, for a given error e. 45
Here the (soft) threshold function St, 25
40
given by 20
35 15
x 2 t, x $ t, 10
St 1 x 2 5 • x 1 t, x # 2 t, 30
5
0, |x| , t, 25 0
0 5 10 15 20 25 30 35 40 0 5 10 15 20 25 30 35 40
is taken component wisely, i.e., for a se- (e) (f)
quence a 5 1 am 2 we have St 1 a 2 5 1 St am 2 .
Figure 15 shows an example of com- [FIG15] Compressed sensing in Fourier domain for medical imaging: (a) original MRI
image, (b) pseudorandom Fourier sampling, (c) recovery by zero-filling reconstruction, (d)
pressed sensing with 25% Fourier mea- recovery by ICT, (e) SNR (in dB) of the recovered image versus the number of iterations
surements. Here the operator A is for the ICT, and (f) recovery error versus the number of iterations for the ICT.
AUTHORS
Jianwei Ma (jma@tsinghua.edu.cn) received the Ph.D. degree
in solid mechanics from Tsinghua University in 2002. He has
been a visiting scholar, postdoctoral research fellow, and guest
professor with the University of Cambridge, the University of
Oxford, the University of Huddersfield, the University of
(a) (b)
Grenoble (INRIA), and the University of Duisburg-Essen. He
SNR = 53.13 dB
was an assistant professor and is now an associate professor
with the School of Aerospace as well as a research director
with the Institute of Seismic Exploration, Tsinghua University.
From June to August 2006, he was a visiting professor at the
Swiss Federal Institute of Technology (EPFL). In 2007, he was
a visiting professor at Florida State University and the
University of Colorado at Boulder. In 2008 and 2009, he was
an invited professor at INRIA-Grenoble and Ecole des Mines
de Paris. His research interests include wavelets, curvelets,
(c) (d) image processing, compressed sensing, remote sensing, and
seismic exploration. He is an editor of International Journal
[FIG16] Compressed sensing in remote sensing: (a) recovery by Artificial Intelligence.
iterative wavelet thresholding, (b) recovery error by the wavelet Gerlind Plonka (gerlind.plonka@uni-due.de) received the
method, (c) recovery by ICT, and (d) recovery error by the
curvelet method. Diploma degree in mathematics from the University of Rostock,
Germany, in 1990, and the Ph.D. degree in mathematics as well
as the Habilitation degree from the University of Rostock, in
Figure 16 shows an example for the curvelet-based com- 1993 and 1996, respectively. Since 1998, she has been an associ-
pressed sensing in remote sensing [44], [46]. It can be seen ate professor for applied analysis at the University of Duisburg-
that the curvelet method is superior to the wavelet method Essen. Her current research interests include wavelet and frame
to recover the edges. theory, Fourier analysis, nonlinear diffusion, and applications in
signal and image processing.
FUTURE WORK
The multiresolution geometric analysis technique with REFERENCES
[1] F. Andersson, M. de Hoop, H. Smith, and G. Uhlmann, “A multi-scale approach
curvelets as basis functions is verified as being effective in to hyperbolic evolution equations with limited smoothness,” Commun. Partial Dif-
many fields. However, there are some challenging prob- fer. Equ., vol. 33, no. 6, pp. 988–1017, 2008.
lems for future work. [2] I. Bermejo-Moreno and D. Pullin, “On the non-local geometry of turbulence,”
J. Fluid Mech., vol. 603, pp. 101–135, 2008.
1) The computational cost of the curvelet transform is higher [3] J. Bobin, J. Starck J. Fadili, Y. Moudden, and D. Donoho, “Morphological com-
than that of wavelets, especially in terms of 3-D problems. ponent analysis: An adaptive thresholding strategy,” IEEE Trans. Image Process-
ing, vol. 16, no. 11, pp. 2675–2681, 2007.
However, the theory and application of the 3-D curvelets are [4] E. Candès, “Harmonic analysis of neural networks,” Appl. Comput. Harmon.
burgeoning areas of research, and it is possible that more effi- Anal., vol. 6, no. 2, pp. 197–218, 1999.
cient curvelet-like transforms will be developed in the near [5] E. Candès and L. Demanet, “Curvelets and Fourier integral operators,” C. R.
Math. Acad. Sci. Paris, vol. 336, no. 5, pp. 395–398, 2003.
future. Currently, a fast message passing interface-based paral-
[6] E. Candès and L. Demanet, “The curvelet representation of wave propagators
lel implementation can somewhat reduce the cost [68]. How is optimally sparse,” Commun. Pure Appl. Math., vol. 58, no. 11, pp. 1472–1528,
2005.
to build a fast orthogonal curvelet transform is still open.
[7] E. Candès, L. Demanet, D. Donoho, and L. Ying, “Fast discrete curvelet trans-
2) The issue of how to explore suitable thresholding func- forms,” Multiscale Model. Simul., vol. 5, no. 3, pp. 861–899, 2006.
tions that incorporate and exploit the special characteris- [8] E. Candès and D. Donoho, “Ridgelets: A key to higher-dimensional intermit-
tency?,” Philos. Trans. R. Soc. London A, Math. Phys. Eng. Sci., vol. 357, no. 1760,
tics of the curvelet transform is very important for pp. 2495–2509, 1999.
curvelet applications involving edge detection, denoising, [9] E. Candès and D. Donoho, “Curvelets—A surprisingly effective nonadaptive
and numerical simulation. representation for objects with edges,” in Curves and Surface Fitting: Saint-Malo
1999, A. Cohen, C. Rabut, and L. Schumaker, Eds. Nashville: Vanderbilt Univ.
Press, 2000, pp. 105–120.
ACKNOWLEDGMENTS [10] E. Candès and D. Donoho, “Continuous curvelet transform. I. Resolution of the
wavefront set,” Appl. Comput. Harmon. Anal., vol. 19, no. 2, pp. 162–197, 2005.
Jianwei Ma was supported by the NSFC under grants
[11] E. Candès and D. Donoho, “Continuous curvelet transform. II. Discretization
(40704019), CACS Innovation Fund (20094030085), TBRF and frames,” Appl. Comput. Harmon. Anal., vol. 19, no. 2, pp. 198–222, 2005.