Академический Документы
Профессиональный Документы
Культура Документы
Abstract—Multilooking is a critical task in interferometric for single amplitude or intensity images, respectively [9]–[11];
synthetic aperture radar (SAR) imaging. While there are many a comprehensive survey of the methods published during the
algorithms designed for SAR image pairs and also some first 1980s and 1990s can be found in [12]. Via the application to
approaches for multi-temporal satellite data stacks, no method
suitable to airborne single-pass stacks that typically contain just multi-temporal imagery [13], the general idea of these filters
a small number of multi-baseline acquisitions has been proposed was gradually extended to interferometric SAR data, now aim-
yet. This paper presents an adaptive procedure to determine re- ing at an unbiased estimation of phase and coherence [14]–
gions of homogeneous backscattering in heterogeneous scenes such [17]. Based on the newly introduced idea of nonlocal image
as urban areas. Based on these regions, the complex covariance denoising [18], [19], finally, a sophisticated nonlocal filter for
matrices can be estimated for all pixels in the stack. This step en-
ables the retrieval of all relevant information of the multi-baseline interferometric SAR image pairs, NL-InSAR, was proposed
InSAR data set, e.g., despeckled intensity images, interferometric by Deledalle et al. [20]. The core idea of this approach is
phase observations, and related coherence maps. The denoising that no discrete neighborhood of homogeneous pixels has to
efficiency of the proposed method is evaluated and compared to be detected; instead, all pixels are used for the simultane-
different algorithms. Furthermore, the detail preservation is ana- ous estimation of intensity, coherence, and phase by applying
lyzed in order to prove the validity of the homogeneity assumption.
weights with respect to statistical similarity. Although NL-
Index Terms—Adaptive filtering, despeckling, multi-baseline, InSAR provides very promising results, it cannot be used for
multilooking, synthetic aperture radar (SAR), SAR interferome- InSAR stacks containing more than two single-look complex
try (InSAR), urban areas.
(SLC) SAR images as the derivation of the algorithm is based
on bivariate data sets. Furthermore, due to its nonlocal nature,
I. I NTRODUCTION
no distinct determination of homogeneous neighborhoods is
0196-2892 © 2013 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
306 IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, VOL. 52, NO. 1, JANUARY 2014
filtered version of the first PC is then used to declare homoge- mately Rayleigh-distributed amplitude images [31]. Afterward,
neous pixels using just a simple thresholding. we put all the amplitude values of the stack into a 2-D data
The principle goal of this paper is, finally, the estimation matrix X = [x1 . . . xN ]T with xi being the pixel values of
of the complex covariance matrix of all pixels in the stack as image i put into a row vector. This means that the rows of
unbiased as possible. Note that, usually, the local phase fringe X describe the images of the stack as variables, whereas the
frequency has to be eliminated for a fully unbiased estimate columns denote the logarithmic amplitude values as observa-
of the covariance matrix [26]–[28]. Since we put the focus on tions of these variables. After mean centering of the data set,
the capability to determine homogeneous neighborhoods, we i.e., subtraction of the row means, the data covariance matrix is
consider a renunciation of the defringing operation a valid ap- estimated by
proximation for small patch sizes and a relatively large ambigu- 1
ity height (see Section IV-A). Nevertheless, we further analyze K= XXT . (1)
P −1
the covariance information by extracting despeckled intensity
images and the longest baseline interferograms (as the longest P denotes the number of pixels in one image, and K quantifies
baseline provides the most details) in order to validate the the correlations between all possible pairs of observed ampli-
adaptivity of the approach. By detailed evaluation of the derived tudes. Since we want to reduce any redundancies, i.e., exploit
products with respect to existing filtering methods, we show the redundant observations in order to remove noise, we seek a
feasibility of the determination of homogeneous backscattering transformation of the data such that the covariances between
neighborhoods, which can be also used for purposes other than separate measurements become zero.
multilooking as described earlier. Therefore, K is decomposed by eigenvalue decomposition,
In Section II, the proposed method will be explained; in i.e.,
Section III, a short recap of complex covariance matrix esti- K = EDET (2)
mation for InSAR stacks will be given. Section IV will contain
experiments and their results based on real airborne data which where E is a matrix containing the eigenvectors of K and D
will be discussed in Section V. is a diagonal matrix containing the related eigenvalues. The
transformation matrix we are looking for is then simply defined
II. P RINCIPAL C OMPONENT A NALYSIS -BASED by A = ET , if the eigenvectors contained in E are ordered with
T HRESHOLDING respect to their related eigenvalues (from the largest eigenvalue
to the smallest one).
In this section, we propose a thresholding-based proce- Finally, we are able to project our stack of amplitude images
dure carried out on the first principal component of the onto its PCs using
stack of logarithmic amplitude images of the data set. The
principal component analysis is applied in order to get a X̃ = AX. (3)
more reliable indicator of backscattering homogeneity as
X̃ then consists of N rows and P columns where each row
would be possible from one raw amplitude image alone (see
represents one PC of the data set. Since we assume that the first
Section II-A). After the PCA, as described in Section II-B,
PC (PC1) contains most relevant signal information, while the
a TV-norm-based denoising algorithm [29] is used in order
other PCs contain only noise (cf., Fig. 1), we just keep PC1, i.e.,
to receive a more reliable indicator of backscattering energy
the first row of X̃, as input to the neighborhood homogeneity
on which, then, a sliding window is moved across. Within
test. Exemplary relations between the first PC and the following
the sliding window, a thresholding is applied that yields the
ones for stacks of different size can be found in Fig. 2. It can
pixels of the window that are considered to show homogeneous
be seen that a distinction between signal and noise information
backscattering.
is, of course, not possible with one image alone, whereas the
relative share of signal energy contained in the first PC becomes
A. Principal Component Analysis of the InSAR Stack
less for larger stacks until, at some point, convergence will
Principal component analysis is a well-known mathematical be reached. Note that the relationship between the single PCs
method that uses an orthogonal transformation in order to depends on the overall noise level.
convert a data set into a set of linearly uncorrelated variables,
called principal components [30]. The idea is to identify linear B. TV Denoising
combinations of the original variables that contain most of the
After the data have been projected onto the first PC, a TV-
information present in the data. This is based on the assumption
norm-based image denoising algorithm is used to receive an
that useful information is proportional to the variance of the
even more reliable indicator of the backscattering character-
data. Since the number of PCs is less than or equal to the
istics of the scene [29]. The algorithm combines the split
number of original variables, the method is often employed for
Bregman method for L1-norm regularization problems [32]
dimension reduction.
with the Rudin–Osher–Fatemi problem [33], which basically
Considering a stack of N coregistered SAR amplitude im-
consists of estimating a denoised image u as the solution of the
ages, we propose a transformation of the stack onto its PCs.
minimization
In order to ensure that the Gaussian assumption that it is a
prerequisite for a correct application of PCA is met at least λ
min uTV + (f (x) − u(x))2 dx (4)
approximately, we apply the decadic logarithm to the approxi- 2
SCHMITT AND STILLA: ADAPTIVE MULTILOOKING OF AIRBORNE SINGLE-PASS MULTI-BASELINE InSAR STACKS 307
C. Detail Preservation
Next to the filtering efficiency over homogeneous patches,
the capability to preserve fine details, e.g., edges or strong
point scatterers, is a critical feature for every adaptive filter.
In Fig. 8, a comparison of detail preservation for the different
filtering approaches is shown using a zoom onto the facade of
the main building in the scene. This cutout provides both an
edge between ground and facade and a row of strong scatterers
on the facade. It can easily be seen that the boxcar filter blurs
the edge as well as the point scatterers, while all sophisticated
algorithms are able to preserve scene details to a certain extent.
DespecKS is probably the best detail-preserving method to the
cost of less efficient filtering in the cases where only a low
number of images are available. Our PCA-based thresholding
approach yields results quite similar to NL-InSAR, although
NL-InSAR seems to be slightly better on balance if the facade
parts showing a weaker scattering and the few dark spots that
have not been properly filtered by PCA-based thresholding are
considered.
V. D ISCUSSION
From inspection of the qualitative and quantitative experi-
mental results shown in Section IV-B and C, it can be seen that
Fig. 6. (Left) Intensity images. (Right) Interferometric phase maps for longest
available baseline. (From top to bottom) Single-look data, boxcar mean filter the PCA-based thresholding approach proposed in this paper
(11 × 11; four images), DespecKS (11 × 11; four images), NL-InSAR provides a filtering efficiency comparable to both the classical
(21 × 21; two images), and PCA-based thresholding (11 × 11; four images). boxcar and the more sophisticated NL-InSAR algorithm. Both
The rectangles indicate the zoom area that is shown in Fig. 8.
methods are known for very high denoising efficiency; more-
over, it is well known that the boxcar filter can be considered
left part of the test scene. From these measures, SSI and SMPI optimal in the case of homogeneous areas. DespecKS, however,
have been deduced. It can clearly be observed that all filters is not as efficient as the competitors, which is supposed to be
that were used in the experiments led to a certain decrease in caused by the low number of samples (four per pixel in the
the STDs of intensity as well as phase. A closer look taken at MEMPHIS case), while at least eight would be needed for a
SSI and SMPI reveals that both PCA-based thresholding and significant goodness-of-fit test.
NL-InSAR provide results that are comparable to the efficiency Comparing the results with respect to detail preservation,
of the boxcar filter. Only DespecKS was not able to reduce the we see that—as expected—the boxcar filter destroys strong
variance of the intensity image significantly, which is certainly scatterers and blurs lines and edges. In contrast to this, all other
caused by the fact that the number of available samples for the filters are able to keep single-point scatterers and even enhance
Kolmogorov–Smirnov test was too low. edges and other linear structures.
SCHMITT AND STILLA: ADAPTIVE MULTILOOKING OF AIRBORNE SINGLE-PASS MULTI-BASELINE InSAR STACKS 311
VI. C ONCLUSION
In this paper, an adaptive multilooking approach for airborne
single-pass multi-baseline InSAR data stacks has been pro-
posed. Its core ideas are the following: 1) the utilization of the
TV-filtered version of the first PC of the logarithmic amplitude
data stack as indicator for backscattering homogeneity and
2) a simple thresholding within a predefined search window for
the determination of pixel similarity. Due to these two features,
the method is both fast and efficient when applied to the esti-
mation of complex covariance matrices of InSAR data stacks.
Both filtering efficiency and detail preservation capability have
been evaluated in comparison to well-established multilooking
algorithms.
ACKNOWLEDGMENT
The authors would like to thank H. Essen and T. Brehm of
the Fraunhofer Institute for High Frequency Physics and Radar
Techniques as well as E. Meier and C. Magnard of Remote
Sensing Laboratories, University of Zurich for providing the
MEMPHIS test data.
R EFERENCES
[1] R. Bamler and P. Hartl, “Synthetic aperture radar interferometry,” Inverse
Probl., vol. 14, no. 4, pp. R1–R54, Aug. 1998.
[2] R. Touzi, A. Lopes, J. Bruniquel, and P. Vachon, “Unbiased estimation
Fig. 8. Detail preservation capabilities shown exemplarily at a building of the coherence from multi-look SAR data,” in Proc. IEEE Int. Geosci.
facade containing an edge and a row of strong point scatterers. The left Remote Sens. Symp., 1996, vol. 1, pp. 662–664.
column contains filtered intensities; the right column contains multilooked [3] U. Stilla, U. Soergel, and U. Thoennessen, “Potential and limits of InSAR
phase differences. From top to bottom, single-look data and then the results of data for building reconstruction in built-up areas,” ISPRS J. Photogramm.
boxcar mean filter (11 × 11; four images), DespecKS (11 × 11; four images), Remote Sens., vol. 58, no. 1/2, pp. 113–123, Jun. 2003.
NL-InSAR (21 × 21; two images), and PCA-based thresholding (11 × 11; four [4] U. Stilla and U. Soergel, “Reconstruction of buildings in SAR imagery of
images) are shown. urban areas,” in Urban Remote Sensing. New York, NY, USA: Taylor &
Francis, 2006, pp. 47–67.
In summary, both the PCA-based thresholding approach [5] A. R. Brenner and L. Roessing, “Radar imaging of urban areas by means
of very high-resolution SAR and interferometric SAR,” IEEE Trans.
proposed in this paper and NL-InSAR provide very satisfying Geosci. Remote Sens., vol. 46, no. 10, pp. 2971–2982, Oct. 2008.
results considering filtering efficiency and detail preservation. [6] U. Soergel, Ed., Radar Remote Sensing of Urban Areas. New York, NY,
As it has been noted before already, NL-InSAR, however, is USA: Springer Science+Business Media, 2010.
[7] M. Schmitt, C. Magnard, T. Brehm, and U. Stilla, “Towards airborne
not designed for the determination of distinct homogeneous single pass decimeter resolution SAR interferometry over urban areas,”
neighborhoods, nor for the estimation of the whole complex in Photogrammetric Image Analysis, vol. 6952, U. Stilla, F. Rottensteiner,
covariance matrices of multi-baseline InSAR stacks with more H. Mayer, B. Jutzi, and M. Butenuth, Eds. Berlin, Germany: Springer-
Verlag, 2011, ser. Lecture Notes in Computer Science, pp. 197–208.
than two SLC acquisitions. Although DespecKS is a statisti- [8] U. Stilla, P. Gamba, C. Juergens, and D. Maktav, Eds., JURSE 2011-Joint
cally sound approach leading to convincing results for multi- Urban Remote Sensing Event. Munich, Germany, April 11–13, 2011.
312 IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, VOL. 52, NO. 1, JANUARY 2014
[9] J.-S. Lee, “Digital image enhancement and noise filtering by use of local [32] T. Goldstein and S. Osher, “The split Bregman method for L1-regularized
statistics,” IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-2, no. 2, problems,” SIAM J. Imag. Sci., vol. 2, no. 2, pp. 323–343, Apr. 2009.
pp. 165–168, Mar. 1980. [33] L. I. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise
[10] V. S. Frost, J. A. Stiles, K. Shanmugan, and J. C. Holtzman, “A model for removal algorithms,” Phys. D, Nonl. Phenom., vol. 60, no. 1–4, pp. 259–
radar images and its application to adaptive digital filtering of multiplica- 268, Nov. 1992.
tive noise,” IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-4, no. 2, [34] O. Batu and M. Cetin, “Parameter selection in sparsity-driven SAR imag-
pp. 157–166, Mar. 1982. ing,” IEEE Trans. Aerosp. Electron. Syst., vol. 47, no. 4, pp. 3040–3050,
[11] D. T. Kuan, A. A. Sawchuk, T. C. Strand, and P. Chavel, “Adaptive Oct. 2011.
noise smoothing filter for images with signal-dependent noise,” IEEE [35] F. De Zan, “Optimizing SAR interferometry for decorrelating scatterers,”
Trans. Pattern Anal. Mach. Intell., vol. PAMI-7, no. 2, pp. 165–177, Ph.D. dissertation, Politecnico di Milano, Milan, Italy, 2008.
Mar. 1985. [36] H. Schimpf, H. Essen, S. Boehmsdorff, and T. Brehm, “MEMPHIS—A
[12] R. Touzi, “A review of speckle filtering in the context of estimation fully polarimetric experimental radar,” in Proc. IEEE Int. Geosci. Remote
theory,” IEEE Trans. Geosci. Remote Sens., vol. 40, no. 11, pp. 2392– Sens. Symp., 2002, pp. 1714–1716.
2404, Nov. 2002. [37] C. Magnard, T. Brehm, H. Essen, and E. Meier, “High resolution
[13] M. Ciuc, P. Bolon, E. Trouve, V. Buzuloiu, and J. Rudant, “Adaptive- MEMPHIS SAR data processing and applications,” in PIERS Proc., 2012,
neighborhood speckle removal in multi-temporal synthetic aperture radar pp. 328–332.
images,” Appl. Opt., vol. 40, no. 32, pp. 5954–5966, Nov. 2001. [38] A. Shamsoddini and J. Trinder, “Image texture preservation in speckle
[14] J.-S. Lee, K. Papathanassiou, T. Ainsworth, M. Grunes, and A. Reigber, noise suppression,” in Proc. Int. Arch. Photogramm., Remote Sens. Spatial
“A new technique for noise filtering of SAR interferometric phase im- Inf. Sci., 2010, vol. 38(7A), pp. 239–244.
ages,” IEEE Trans. Geosci. Remote Sens., vol. 36, no. 5, pp. 1456–1465,
Sep. 1998.
[15] M. Ciuc, E. Trouve, P. Bolon, and V. Buzuloiu, “Amplitude-driven co-
herence filtering in complex interferograms,” in Proc. IEEE Int. Geosci.
Remote Sens. Symp., 2002, pp. 3453–3455.
[16] G. Vasile, E. Trouv, M. Ciuc, and V. Buzuloiu, “General adaptive-
neighborhood technique for improving synthetic aperture radar interfer-
Michael Schmitt (S’08) was born in Munich,
ometric coherence estimation,” J. Opt. Soc. Amer. A, Opt, Image Sci., Vis.,
Germany, in 1984. He received the Dipl.-Ing. (Univ.)
vol. 21, no. 8, pp. 1455–1464, Aug. 2004.
degree in Geodesy and Geoinformation from the
[17] G. Vasile, E. Trouve, J.-S. Lee, and V. Buzuloiu, “Intensity-driven
Technische Universitaet Muenchen (TUM), Munich,
adaptive-neighborhood technique for polarimetric and interferometric
Germany, in 2009.
SAR parameters estimation,” IEEE Trans. Geosci. Remote Sens., vol. 44,
He is currently working toward the PhD degree
no. 6, pp. 1609–1621, Jun. 2006.
in airborne SAR interferometry using multi-baseline
[18] X. Yang and D. Clausi, “Structure-preserving speckle reduction of SAR
and multi-aspect millimeter wave data at the De-
images using nonlocal means filters,” in Proc. 16th IEEE Int. Conf. Image
partment of Photogrammetry and Remote Sensing,
Process., 2009, pp. 2985–2988.
TUM, where he has been a full-time research as-
[19] A. Buades, B. Coll, and J.-M. Morel, “A non-local algorithm for im-
sistant since May 2009. In addition to SAR inter-
age denoising,” in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern
ferometry, his main interests are (statistical) signal processing and parameter
Recognit., 2005, pp. 60–65.
estimation theory for imaging science problems.
[20] C.-A. Deledalle, L. Denis, and F. Tupin, “NL-InSAR: Nonlocal interfer-
ogram estimation,” IEEE Trans. Geosci. Remote Sens., vol. 49, no. 4,
pp. 1441–1452, Apr. 2011.
[21] E. Aguilera, M. Nannini, and A. Reigber, “Multisignal compressed sens-
ing for polarimetric SAR tomography,” IEEE Geosci. Remote Sens. Lett.,
vol. 9, no. 5, pp. 871–875, Sep. 2012.
[22] M. Schmitt and U. Stilla, “Compressive sensing based layover separation
in airborne single-pass multi-baseline InSAR data,” IEEE Geosci. Remote Uwe Stilla (M’04–SM’09) was born in Cologne,
Sens. Lett., vol. 10, no. 2, pp. 313–317, Mar. 2013. Germany, in 1957. He received a diploma
[23] A. Ferretti, A. Fumagalli, F. Novali, C. Prati, F. Rocca, and A. Rucci, (Dipl.-Ing.) in electrical engineering from
“A new algorithm for processing interferometric data-stacks: SqueeSAR,” Gesamthochschule Paderborn, Paderborn, Germany,
IEEE Trans. Geosci. Remote Sens., vol. 49, no. 9, pp. 3460–3470, in 1980 and a diploma (Dipl.-Ing.) in biomedical
Sep. 2011. engineering and the Ph.D. degree in engineering,
[24] A. Parizzi and R. Brcic, “Adaptive InSAR stack multilooking exploiting with work in the field of pattern recognition, from
amplitude statistics: A comparison between different techniques and prac- the University of Karlsruhe, Karlsruhe, Germany, in
tical results,” IEEE Geosci. Remote Sens. Lett., vol. 8, no. 3, pp. 441–445, 1987 and 1993, respectively.
May 2011. From 1990 to 2004, he was with the Institute of
[25] M. Stephens, “Use of the Kolmogorov–Smirnov, Cramer–Von Mises and Optronics and Pattern Recognition (FGAN-FOM), a
related statistics without extensive tables,” J. Roy. Stat. Soc. Ser. B, German research establishment for defense-related studies. Since 2004, he has
Methodol., vol. 32, no. 1, pp. 115–122, 1970. been with Technische Universitaet Muenchen, Munich, Germany, where he
[26] G. Vasile, E. Trouve, I. Petillot, P. Bolon, J.-M. Nicolas, M. Gay, has been a Professor and the Head of the Department of Photogrammetry and
J. Chanussot, T. Landes, P. Grussenmeyer, V. Buzuloiu, I. Hajnsek, Remote Sensing and is currently the Director of the Institute of Photogramme-
C. Andres, M. Keller, and R. Horn, “High-resolution SAR interferometry: try and Cartography. He is the Vice Dean of the Faculty of Civil Engineering
Estimation of local frequencies in the context of alpine glaciers,” IEEE and Surveying and the Dean of Student Affairs of the bachelor’s and master’s
Trans. Geosci. Remote Sens., vol. 46, no. 4, pp. 1079–1090, Apr. 2008. program “Geodesy and Geoinformation,” the international master’s programs
[27] Z. Suo, Z. Li, and Z. Bao, “A new strategy to estimate local fringe fre- “Earth Oriented Space Science and Technology (ESPACE)” and “Cartography.”
quencies for InSAR phase noise reduction,” IEEE Geosci. Remote Sens. Dr. Stilla is the Chair of the ISPRS working group III/VII “Pattern Analysis
Lett., vol. 7, no. 4, pp. 771–775, Oct. 2010. in Remote Sensing,” a Principal Investigator of the International Graduate
[28] Y. Wang, X. X. Zhu, and R. Bamler, “Retrieval of phase history parame- School of Science and Engineering, the Vice President of the German Society
ters from distributed scatterers in urban areas using very high resolution of Photogrammetry, Remote Sensing and Geoinformation (DGPF), a Member
SAR data,” ISPRS J. Photogramm. Remote Sens., vol. 73, pp. 89–99, of the Scientific Board of German Commission of Geodesy (DGK), and a
Sep. 2012. Member of Commission for Geodesy and Glaciology (KEG) of the Bavarian
[29] P. Getreuer, Rudin-Osher-Fatemi Total Variation Denoising Using Split Academy of Science and Humanities. He has been the Organizer and Chair
Bregman. Cachan, France: Image Processing On Line, 2012. of the conferences “Photogrammetric Image Analysis (PIA),” “City Models,
[30] J. Shlens, A Tutorial on Principal Component Analysis, Center for Neural Roads and Traffic (CMRT),” “GRSS/ISPRS Joint Urban Remote Sensing Event
Science, New York University, Tutorial, 2009. [Online]. Available: http:// (JURSE 2011),” “Earth Observation and Global Changes (EOGC 2011),” and
www.snl.salk.edu/~shlens/pca.pdf the “IEEE-GRSS Remote Sensing Summer School (RSSS12).” His research
[31] G. Gao, “Statistical modeling of SAR images: A survey,” Sensors, vol. 10, focuses on image analysis in the field of photogrammetry and remote sensing.
no. 1, pp. 775–795, Jan. 2010. He published more than 300 contributions.