Remote Sensing Science November 2013, Volume 1, Issue 3, PP.

41-46

Comparison of Different LiDAR and Hypespectral Data Fusion Strategies Using SVM and ABNet
Pengyu Hao1,2, Zheng Niu1
1. The State Key Laboratory of Remote Sensing Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China 2. University of Chinese Academy of Science, Beijing 100049, China
Email:

niuz@irsa.ac.cn

Abstract
The objective of this paper is to compare two LiDAR data and hyperspectral data fusion strategies, Band Extension and Hierarchical Classification using two newly proposed classification algorithms SVM and ABNet, and tests the sensitivity of different classification method to sample size. The result showed that the fusion data increased the SVM classification accuracy by 10%, but did not improve the ABNet result apparently. And the hierarchical classification strategy performed better than band extension strategy. In addition, the sensitivity test indicated that both hyperspectral solely and fusion data applying ABNet algorithms were more robust when training samples contain more than 60% of original size. Keywords: Hyperspectral; LiDAR; Fusion; SVM; ABNet; Remote Sensing

1. INTRODUCTION
Hyperspectral remote sensing image has a large number of spectral bands, which is sufficient to identify the characteristics on the nature and properties of different surface materials, especially the low albedo surface materials (Weng et al., 2008), on the ground (Du et al., 2010). And the great amount of bands readily permits the exclusion from bands with low signal-to-noise ratios or atmospheric effects (Weng, 2012). Recently, a range of urban studies have employed hyperspectral image identify urban surface features based on different reflection and absorption characteristics (Weng et al., 2008; Heiden et al., 2007). But the urban are composed of a variety of features which are made of similar material, for example, the road and roof (Weng, 2012). Then, a drawback of urban features extraction solely using spectral information of hyperspectral image is the difficulty of discerning different features by material. Some studies utilize feature information, for example, extended attribute, to improve the classification accuracy (Im et al., 2012a; Kamandar and Ghassemian, 2013; Pedergnana et al., 2012). And currently, LiDAR data have been increasingly used in many geospatial applications due to its high data resolution, short processing time and solely focus on geometry rather than radiometry for feature extraction (Weng, 2012; Meng et al., 2010; Lee et al., 2008; Meng et al., 2012), as well as the potential for elevation deriving at high resolution (Chaplot et al., 2006; Anderson et al., 2006). And some researchers have combined LiDAR data with optical remote sensing data in urban features extraction and mapping. Pedergnana et al. (2012) conducted a classification of the features extracted with extended attribute profiles (EAPs) computed on both optical and LiDAR images, the result indicated that EAPs can be effectively applied to the fusion of spectral and elevation data. Germaine and Hung (2011) designed a knowledge based expert system with LiDAR data to estimate impervious surfaces, and their result indicated that LiDAR data improved the accuracy of impervious surface measurement and showed the potential to identify significant planimetric features such as buildings and trees. Im et al. (2012b) utilized a hierarchical classification method with LiDAR data to detect impervious surface. The objectives of this study are: (1) compare the two strategies of LiDAR data and hyperspectral data fusion, 1) Band
- 41 http://www.ivypub.org/RSS/

Extension, making LiDAR elevation data a feature band and 2) Hierarchical Classification, dividing ground and non-ground using LiDAR. (2) Evaluate the performance of two newly proposed classification algorithms, Support Vector Machines (SVM) (Mountrakis et al., 2011) and Antibody Network (ABNet) (Zhong and Zhang, 2012; Zhong et al., 2007; Zhong et al., 2006; Zhong et al., 2011). And (3) examine the sensitivity of SVM and ABNet to sample size for urban mapping. The result of hyperspectral data and LiDAR data fusion methods were compared to urban classification using hyperspectral data only.

2.

STUDY AREA AND DATA

The study area is located over the University of Houston campus and the neighboring urban area. A 5km1km site were selected for the data fusion experiment. The experiment data set were provided by 2013 IEEE GRSS Data Fusion Contest. The data set contained a hyperspectral image, a LiDAR derived DSM and a series of ground samples. The hyperspectral CASI imagery consists of 144 spectral bands in the 380 nm to 1050 nm region and had been calibrated to at-sensor spectral radiance units. The corresponding co-registered DSM consisted of elevation in meters above sea level (per the Geoid 2012A model). Both images were at the same spatial resolution (2.5m). The data was acquired by the NSF-funded Center for Airborne Laser Mapping (NCALM). Hyperspectral data was acquired on June 23, 2012 between the times 17:37:10 to 17:39:50 UTC, average height of the sensor above ground was 5500 feet. And LiDAR data was acquired on June 22, 2012, between the time14:37:55 to 15:38:10 UTC, average height of the sensor above ground was 2000 feet. We utilized principal component (PC) transformation to reduce the dimension of hyperspectral data, and selected first 10 PCs which contain more than 99.995% total variance of the full dimensionality data for the following classification. The sample data contained a total of 600 random samples in experiment site. The land cover point of each point was assigned to one of the 15 classes, and the sample size of each class was showed in Table 1. We used half of the samples as training samples and the other half as reference.
TABLE 1 SAMPLE INFORMATION
Class Healthy grass Stressed grass Synthetic grass Trees Soil Sample Size 190 190 192 188 186 Class Water Residential Commercial area Road Highway Sample Size 182 196 191 193 191 Class Railway Parking Lot without car Parking Lot with car Tennis Court Running Track Sample Size 181 192 184 181 187

3. METHOD
3.1. Method overview
We utilized two data fusion strategies (Band Extension and Hierarchical classification) and two classifiers (SVM and ABNet) to conduct the classification. Together with the reference classification using hyperspectral data solely, we had 6 classification methods, SVM, ABNet, Band Extension SVM (ESVM), Band Extension ABNet (EABNet), Hierarchical SVM (HiSVM) and Hierarchical ABNet (HiABNet) in total. Then, we changed the sample size to examine the sensitivity of each method to the number of training data.
Hyperspectral data

LiDAR data

SVM Different size sample AIN

Band extension SVM

Hierarchical SVM Accuracy Assessment

Band extension AIN

Hierarchical AIN

FIG. 1 PROCESS FLOW OF THE STUDY

- 42 http://www.ivypub.org/RSS/

3.2. Different data fusion strategy

Two data fusion strategies, band extension and hierarchical, were utilized in this research. For the former strategy, we added the DSM band derived from LiDAR to the hyperspectral data, and the fusion data had 11 bands in total. Then, we used SVM and ABNet to conduct the fusion data. For the latter strategy, we divided the classes in urban to two groups, non-ground and ground applying SVM algorithms. The non-ground group contained tree, building and commercial area, and the others classes were belong to ground group. Then, we applied SVM and ABNet to classify each group.

3.3. SVM and ABNet

SVM is a newly proposed classification method and its performance seems well-suited for remote sensing applications (Mountrakis et al., 2011). The simplest SVMs are linear binary classifiers which find the hyperplane with the maximum margin. However, for inseparable problem, kernel function was introduced to transform the nonlinear correlations into a higher (Euclidean or the Hilbert) space, and make it linear separable. Then, one-against-one and one-against-others methods were applied to solve the multi-class problem (Mountrakis et al., 2011). For the implementation of the training and modelling procedure, we employed the libSVM (Chang and Lin, 2011). The regression model in this research was the epsilon SVR with a radial basis function (RBF) as a kernel type. Best SVM parameters of g and C were selected by genetic algorithm. The SVM parameters used in this research were showed in Table 2.
TABLE 2 THE PARAMETERS OF SVM MODELS
data input Hyperspectral Hyperspectral+LiDAR (for ESVM) ground Hyperspectral (for HiSVM) non-ground Hyperspectral (for HiSVM) parameters C 12.32 62.29 67.33 91.60 g 21.22 30.70 37.01 53.42

ABNet is proposed based on the immune network theory. The artificial antibody population (AB), which constructing ABNet model is a set of antibodies, and each antibody have two attributes: central vector and recognizing radius. In training process, antibodies were trained by the sample points (antigens, AG) following preselection, cloning, mutation and adaptive calculation of antibody center vector and recognizing radius process for each class. In preselection, an antigen which is closest to the center of AG population is selected as agp. Then, in cloning, agp is copied to obtain a clone set CA, CA = {ca1,, can}, n is the number of the training samples for each class. In mutation, CA can be mutated with the probability of mutation assigned, generating a population MU of matured clones. And in calculating center vector and recognizing radius process, every matured clone mui is known as a candidate artificial antibody, center vector is the vector of mui and recognizing radius can be calculated using (1)-(3) ( * * ) + + (1) ( ) ( )

where , and represent the center vector, the recognizing radius and the number of antigens represent the inner product of recognized of a given candidate artificial antibody mui, and . Therefore, the candidate artificial antibody with maximum value of m becomes a new artificial antibody. In this process, ABNet can adaptively build up the classifier without relying on user-defined parameters. And after ABNet construction, all antigens are recognized. In classification process, the image pixels (AG) were recognized by appropriate antibodies. The background theory and detailed algorithm can be referenced in relevant materials by Zhong and Zhang (2012). We conducted the ABNet algorithm using IDL.

3.4. Sensitivity analysis to different sample size

Many studies have investigated the sensitivity of classifiers and find some classifiers are robust with a limited amount
- 43 http://www.ivypub.org/RSS/

of training samples, but some are sensitive to change of training sample size (Im et al., 2012c). In this paper, nine different sample size 10%, 20%, 30%, 40%, 50%, 60%, 70%, 80% and 90% of the original training sample size were utilized to evaluate the sensitivity of different method to sample size.

4. RESULT AND DISCUSSION

The overall accuracy and Kappa coefficient of the six classifications were reported in Table 3. The ABNet method outperformed SVM, especially in the solely hyperspectral classification, the accuracy increased up to 11%. Then, the fusion of LiDAR and hyperspectral images was more efficient for SVM, as the classification accuracy for both ESVM and HiSVM were more than 5% higher than SVM. But, HABNet and HiABNet did not increase the classification accuracy apparently. Because the misclassification of SVM was mainly due to the similar spectral of manual features, for example, Commercial area, Parking lot without car and Parking lot with car. Then, the fusion image imported height information, and increased the classification accuracy. As for ABNet, every antibody can recognize a range of antigens within its radius, so that the addition of height information did not work so well as SVM. Fig. 2 was the urban mapping applying HiABNet with the highest accuracy in our experiment. The shadowed area generated by cloud in the right of the image was labeled as unclassified because of the lack of training samples located in the shadow, which indicated that ABNet was extremely affected by the representativeness of training samples. For different fusion strategies, hierarchical method performed better than band extension method because the number of classes reduced in different groups. However, the hierarchical method was also affected by the ground and non-ground dividing accuracy.
TABLE 3 COMPARISON OF CLASSIFICATION ACCURACY
Class Healthy grass Stressed grass Tree Soil Water Residential Commercial area Road Highway Railway Parking lot without car Parking lot with car Tennis court Running track Synthetic grass OA(%) Kappa
OA: Overall accuracy

SVM 91.92% 97.89% 92.71% 100.00% 90.11% 71.43% 25.26% 45.83% 60.00% 45.56% 14.58% 35.87% 98.89% 100.00% 96.88% 71.10% 0.69

ESVM 94.95% 97.89% 94.79% 100.00% 90.11% 83.67% 89.47% 80.21% 4.21% 67.78% 8.33% 46.74% 98.89% 100.00% 96.88% 76.89% 0.75

HiSVM 95.96% 98.95% 91.67% 100.00% 87.91% 67.35% 80.00% 34.38% 65.26% 68.89% 40.63% 52.17% 97.78% 100.00% 97.92% 78.52% 0.77

ABNet 90.91% 96.84% 96.88% 91.40% 98.90% 71.43% 83.16% 61.46% 69.47% 67.78% 59.38% 96.67% 98.92% 95.83% 54.35% 82.19% 0.81

EABNet 91.92% 96.84% 97.92% 91.40% 98.90% 76.53% 84.21% 62.50% 66.32% 68.89% 53.13% 94.44% 100.00% 93.75% 40.22% 81.13% 0.80

HiABNet 96.97% 98.95% 89.58% 98.92% 96.70% 69.39% 92.63% 61.46% 65.26% 75.56% 51.04% 57.61% 96.67% 100.00% 92.71% 82.83% 0.82

FIG.2 HIABNET URBAN MAPPING

- 44 http://www.ivypub.org/RSS/

FIG. 3 SENSITIVITY TEST

5. CONCLUSION
In this paper, we compared two hyperspectral image and LiDAR image fusion strategies (Band Extension and Hierarchical Classification) applying two newly proposed classification algorithms (SVM and ABNet). In addition, we also tested the sensitivity of different classification method to training sample size. The result demonstrated that the import of LiDAR data increased the classification accuracy by more than 10% for SVM, and the hierarchical strategy performed better than band extension strategy. Using SVM on hyperspectral data was apparently affected by small training sample size (less than 30% original size), and the classification accuracy of SVM on fusion image have a linear relationship to sample size. For ABNet, the import of LiDAR data did not improve the classification accuracy. What is more, the result of different sample size showed that ABNet was robust with large sample size which is large than 60% of original size. In this paper, we only tested two data fusion strategies, and we will try some other data fusion strategies, such as LiDAR feature extraction, extended attribute profiles, in the future studies.

6. ACKNOWLEDGEMENT
The authors would like to thank the Hyperspectral Image Analysis group and the NSF Funded Center for Airborne Laser Mapping (NCALM) at the University of Houston for providing the data sets used in this study, and the IEEE GRSS Data Fusion Technical Committee for organizing the 2013 Data Fusion Contest. The work was supported by National Natural Science Foundation of China (41371358, 41301390).

REFERENCES
[1] [2] [3] [4] Weng, Qihao, Hu, Xuefei and Lu, Dengsheng "Extracting impervious surfaces from medium spatial resolution multispectral and hyperspectral imagery: a comparison". International Journal of Remote Sensing, 29. (2008): 3209-3232 Du, Peijun, Xia, Junshi, Cao, Wen and Wang, Xiaoling Extraction of urban impervious surface from hyperspectral remote sensing image. IEEE Computer Society, City, 2010 Weng, Qihao "Remote sensing of impervious surfaces in the urban areas: Requirements, methods, and trends". Remote Sensing of Environment, 117. (2012): 34-49 Heiden, Uta, Segl, Karl, Roessner, Sigrid and Kaufmann, Hermann "Determination of robust spectral features for identification - 45 http://www.ivypub.org/RSS/

of urban surface materials in hyperspectral remote sensing data". Remote Sensing of Environment, 111. (2007): 537-552 [5] [6] [7] Im, Jungho, Lu, Zhenyu, Rhee, Jinyoung and Jensen, John R. "Fusion of feature selection and optimized immune networks for hyperspectral image classification of urban landscapes". Geocarto International, 27. (2012a): 373-393 Kamandar, Mehdi and Ghassemian, Hassan "Linear Feature Extraction for Hyperspectral Images Based on Information Theoretic Learning". Ieee Geoscience and Remote Sensing Letters, 10. (2013): 702-706 Pedergnana, Mattia, Marpu, Prashanth Reddy, Mura, Mauro Dalla, Benediktsson, Jon Atli and Bruzzone, Lorenzo "Classification of Remote Sensing Optical and LiDAR Data Using Extended Attribute Profiles". Ieee Journal of Selected Topics in Signal Processing, 6. (2012): 856-865 [8] [9] Meng, Xuelian, Currit, Nate and Zhao, Kaiguang "Ground Filtering Algorithms for Airborne LiDAR Data: A Review of Critical Issues". Remote Sensing, 2. (2010): 833-860 Lee, Dong Hyuk, Lee, Kyoung Mu and Lee, Sang Uk "Fusion of lidar and imagery for reliable building extraction". Photogrammetric Engineering and Remote Sensing, 74. (2008): 215-225 [10] Meng, Xuelian, Currit, Nate, Wang, Le and Yang, Xiaojun "Detect Residential Buildings from Lidar and Aerial Photographs through Object-Oriented Land-Use Classification". Photogrammetric Engineering and Remote Sensing, 78. (2012): 35-44 [11] Chaplot, Vincent, Darboux, Frederic, Bourennane, Hocine, Leguedois, Sophie, Silvera, Norbert and Phachomphon, Konngkeo "Accuracy of interpolation techniques for the derivation of digital elevation models in relation to landform types and data density". Geomorphology, 77. (2006): 126-141 [12] Anderson, E. S., Thompson, J. A., Crouse, D. A. and Austin, R. E. "Horizontal resolution and data density effects on remotely sensed LIDAR-based DEM". Geoderma, 132. (2006): 406-415 [13] Germaine, Kreh A. and Hung, Ming-Chih "Delineation of Impervious Surface from Multispectral Imagery and Lidar Incorporating Knowledge Based Expert System Rules". Photogrammetric Engineering and Remote Sensing, 77. (2011): 75-85 [14] Im, J., Lu, Z. Y., Rhee, J. and Quackenbush, L. J. "Impervious surface quantification using a synthesis of artificial immune networks and decision/regression trees from multi-sensor data". Remote Sensing of Environment, 117. (2012b): 102-113 [15] Mountrakis, Giorgos, Im, Jungho and Ogole, Caesar "Support vector machines in remote sensing: A review". ISPRS Journal of Photogrammetry and Remote Sensing, 66. (2011): 247-259 [16] Zhong, Yanfei and Zhang, Liangpei "An Adaptive Artificial Immune Network for Supervised Classification of Multi-/Hyperspectral Remote Sensing Imagery". IEEE Transactions on Geoscience and Remote Sensing, 50. (2012): 894-909 [17] Zhong, Y. F., Zhang, L. P., Gong, J. Y. and Li, P. X. "A supervised artificial immune classifier for remote-sensing imagery". Ieee Transactions on Geoscience and Remote Sensing, 45. (2007): 3957-3966 [18] Zhong, Y. F., Zhang, L. P., Huang, B. and Li, P. X. "An unsupervised artificial immune classifier for multi/hyperspectral remote sensing imagery". Ieee Transactions on Geoscience and Remote Sensing, 44. (2006): 420-431 [19] Zhong, Y. F., Zhang, L. P. and Gong, W. "Unsupervised remote sensing image classification using an artificial immune network". International Journal of Remote Sensing, 32. (2011): 5461-5483 [20] 2013 IEEE GRSS Data Fusion Contest, Online: http://www.grss-ieee.org/community/technical-committees/data-fusion/" [21] Chang, C. C. and Lin, C. J. "LIBSVM: A Library for Support Vector Machines". Acm Transactions on Intelligent Systems and Technology, 2. (2011) [22] Im, Jungho, Lu, Zhenyu, Rhee, Jinyoung and Quackenbush, Lindi J. "Impervious surface quantification using a synthesis of artificial immune networks and decision/regression trees from multi-sensor data". Remote Sensing of Environment, 117. (2012c): 102-113

AUTHORS
Pengyu Hao received the B.S. degree in Cartography and Geography Information System from Beijing Forestry University, Beijing, China, in 2012. He is currently pursuing the Ph.D. degree in the State Key Laboratory of Remote Sensing Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Science, Beijing. Zheng Niu received the Ph.D. degree in cartology and geographical information systems from the Chinese Academy of Science (CAS), Beijing, in 1996. He is currently a Senior Scientist with the Institute of Remote Sensing and Digital Earth, CAS. His research interests are global-change remote sensing.

- 46 http://www.ivypub.org/RSS/