Precision in Building Extraction: Comparing Shallow and Deep Models using LiDAR Data (2309.12027v1)
Abstract: Building segmentation is essential in infrastructure development, population management, and geological observations. This article targets shallow models due to their interpretable nature to assess the presence of LiDAR data for supervised segmentation. The benchmark data used in this article are published in NORA MapAI competition for deep learning model. Shallow models are compared with deep learning models based on Intersection over Union (IoU) and Boundary Intersection over Union (BIoU). In the proposed work, boundary masks from the original mask are generated to improve the BIoU score, which relates to building shapes' borderline. The influence of LiDAR data is tested by training the model with only aerial images in task 1 and a combination of aerial and LiDAR data in task 2 and then compared. shallow models outperform deep learning models in IoU by 8% using aerial images (task 1) only and 2% in combined aerial images and LiDAR data (task 2). In contrast, deep learning models show better performance on BIoU scores. Boundary masks improve BIoU scores by 4% in both tasks. Light Gradient-Boosting Machine (LightGBM) performs better than RF and Extreme Gradient Boosting (XGBoost).
- C. Grecea, A. Bala, and S. Herban, “Cadastral requirements for urban administration, key component for an efficient town planning,” Journal of Environmental Protection and Ecology, vol. 14, no. 1, pp. 363–371, 2013.
- J. Fu, J. Liu, H. Tian, Y. Li, Y. Bao, Z. Fang, and H. Lu, “Dual attention network for scene segmentation,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 3146–3154.
- S. Xu, X. Pan, E. Li, B. Wu, S. Bu, W. Dong, S. Xiang, and X. Zhang, “Automatic building rooftop extraction from aerial images via hierarchical rgb-d priors,” IEEE Transactions on Geoscience and Remote Sensing, vol. 56, no. 12, pp. 7369–7387, 2018.
- Y. Xie, A. Weng, and Q. Weng, “Population estimation of urban residential communities using remotely sensed morphologic data,” IEEE Geoscience and Remote Sensing Letters, vol. 12, no. 5, pp. 1111–1115, 2015.
- S. Cao, Q. Weng, M. Du, B. Li, R. Zhong, and Y. Mo, “Multi-scale three-dimensional detection of urban buildings using aerial lidar data,” GIScience & Remote Sensing, vol. 57, no. 8, pp. 1125–1143, 2020.
- M. M. Rathore, A. Ahmad, A. Paul, and S. Rho, “Urban planning and building smart cities based on the internet of things using big data analytics,” Computer networks, vol. 101, pp. 63–80, 2016.
- F. Rottensteiner, “Automatic generation of high-quality building models from lidar data,” IEEE Computer Graphics and Applications, vol. 23, no. 6, pp. 42–50, 2003.
- P. Liu, X. Liu, M. Liu, Q. Shi, J. Yang, X. Xu, and Y. Zhang, “Building footprint extraction from high-resolution images via spatial residual inception convolutional neural network,” Remote Sensing, vol. 11, no. 7, p. 830, 2019.
- T. Blaschke, “Object based image analysis for remote sensing,” ISPRS journal of photogrammetry and remote sensing, vol. 65, no. 1, pp. 2–16, 2010.
- Q. Hu, L. Zhen, Y. Mao, X. Zhou, and G. Zhou, “Automated building extraction using satellite remote sensing imagery,” Automation in Construction, vol. 123, p. 103509, 2021.
- L. Deng, Y.-n. Yan, Y. He, Z.-h. Mao, and J. Yu, “An improved building detection approach using l-band polsar two-dimensional time-frequency decomposition over oriented built-up areas,” GIScience & Remote Sensing, vol. 56, no. 1, pp. 1–21, 2019.
- J. Huang, X. Zhang, Q. Xin, Y. Sun, and P. Zhang, “Automatic building extraction from high-resolution aerial images and lidar data using gated residual refinement network,” ISPRS journal of photogrammetry and remote sensing, vol. 151, pp. 91–105, 2019.
- W. Sun, P. Bocchini, and B. D. Davison, “Applications of artificial intelligence for disaster management,” Natural Hazards, vol. 103, no. 3, pp. 2631–2689, 2020.
- A. D. Schlosser, G. Szabó, L. Bertalan, Z. Varga, P. Enyedi, and S. Szabó, “Building extraction using orthophotos and dense point cloud derived from visual band aerial imagery based on machine learning and segmentation,” Remote Sensing, vol. 12, no. 15, p. 2397, 2020.
- X. Huang, Y. Cao, and J. Li, “An automatic change detection method for monitoring newly constructed building areas using time-series multi-view high-resolution optical satellite images,” Remote Sensing of Environment, vol. 244, p. 111802, 2020.
- C. Liu, X. Huang, Z. Zhu, H. Chen, X. Tang, and J. Gong, “Automatic extraction of built-up area from zy3 multi-view satellite imagery: Analysis of 45 global cities,” Remote Sensing of Environment, vol. 226, pp. 51–73, 2019.
- Y. Dong, L. Zhang, X. Cui, H. Ai, and B. Xu, “Extraction of buildings from multiple-view aerial images using a feature-level-fusion strategy,” Remote Sensing, vol. 10, no. 12, p. 1947, 2018.
- M. Cote and P. Saeedi, “Automatic rooftop extraction in nadir aerial imagery of suburban regions using corners and variational level set evolution,” IEEE transactions on geoscience and remote sensing, vol. 51, no. 1, pp. 313–328, 2012.
- Y. Zha, J. Gao, and S. Ni, “Use of normalized difference built-up index in automatically mapping urban areas from tm imagery,” International journal of remote sensing, vol. 24, no. 3, pp. 583–594, 2003.
- T. Zhang, X. Huang, D. Wen, and J. Li, “Urban building density estimation from high-resolution imagery using multiple features and support vector regression,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 10, no. 7, pp. 3265–3280, 2017.
- Z. Sun, H. Fang, M. Deng, A. Chen, P. Yue, and L. Di, “Regular shape similarity index: A novel index for accurate extraction of regular objects from remote sensing images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 7, pp. 3737–3748, 2015.
- X. Huang and L. Zhang, “A multidirectional and multiscale morphological index for automatic building extraction from multispectral geoeye-1 imagery,” 2011.
- N. Kanwal, R. Amundsen, H. Hardardottir, E. A. Janssen, and K. Engan, “Detection and localization of melanoma skin cancer in histopathological whole slide images,” arXiv preprint arXiv:2302.03014, 2023.
- Z. Shao, P. Tang, Z. Wang, N. Saleem, S. Yam, and C. Sommai, “Brrnet: A fully convolutional neural network for automatic building extraction from high-resolution remote sensing images,” Remote Sensing, vol. 12, no. 6, p. 1050, 2020.
- K. Zhang, J. Yan, and S.-C. Chen, “Automatic construction of building footprints from airborne lidar data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 44, no. 9, pp. 2523–2533, 2006.
- J. Niemeyer, F. Rottensteiner, and U. Soergel, “Contextual classification of lidar data and building object detection in urban areas,” ISPRS journal of photogrammetry and remote sensing, vol. 87, pp. 152–165, 2014.
- K. Khoshelham, C. Nardinocchi, E. Frontoni, A. Mancini, and P. Zingaretti, “Performance evaluation of automated approaches to building detection in multi-source aerial data,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 65, no. 1, pp. 123–133, 2010.
- S. Jyhne, M. Goodwin, P.-A. Andersen, I. Oveland, A. S. Nossum, K. Ø. Ormseth, M. Ørstavik, and A. C. Flatman, “Mapai: Precision in buildingsegmentation,” 2022.
- Y.-J. Cho, “Weighted intersection over union (wiou): A new evaluation metric for image segmentation,” arXiv preprint arXiv:2107.09858, 2021.
- B. Cheng, R. Girshick, P. Dollár, A. C. Berg, and A. Kirillov, “Boundary iou: Improving object-centric image segmentation evaluation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 15 334–15 342.
- L. Breiman, “Random forests,” Machine learning, vol. 45, pp. 5–32, 2001.
- L. Ma, Y. Liu, X. Zhang, Y. Ye, G. Yin, and B. A. Johnson, “Deep learning in remote sensing applications: A meta-analysis and review,” ISPRS journal of photogrammetry and remote sensing, vol. 152, pp. 166–177, 2019.
- M. Maimaitijiang, V. Sagan, P. Sidike, S. Hartling, F. Esposito, and F. B. Fritschi, “Soybean yield prediction from uav using multimodal data fusion and deep learning,” Remote sensing of environment, vol. 237, p. 111599, 2020.
- N. Zhang, R. S. P. Rao, F. Salvato, J. F. Havelund, I. M. Møller, J. J. Thelen, and D. Xu, “Mu-loc: a machine-learning method for predicting mitochondrially localized proteins in plants,” Frontiers in Plant Science, vol. 9, p. 634, 2018.
- Y. Cai, K. Guan, J. Peng, S. Wang, C. Seifert, B. Wardlow, and Z. Li, “A high-performance and in-season classification system of field-level crop types using time-series landsat data and a machine learning approach,” Remote sensing of environment, vol. 210, pp. 35–47, 2018.
- T. Habib, J. Inglada, G. Mercier, and J. Chanussot, “Support vector reduction in svm algorithm for abrupt change detection in remote sensing,” IEEE Geoscience and Remote Sensing Letters, vol. 6, no. 3, pp. 606–610, 2009.
- N. Mboga, C. Persello, J. R. Bergado, and A. Stein, “Detection of informal settlements from vhr images using convolutional neural networks,” Remote sensing, vol. 9, no. 11, p. 1106, 2017.
- T. M. Khoshgoftaar, J. Van Hulse, and A. Napolitano, “Comparing boosting and bagging techniques with noisy and imbalanced data,” IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, vol. 41, no. 3, pp. 552–568, 2010.
- G. Ke, Q. Meng, T. Finley, T. Wang, W. Chen, W. Ma, Q. Ye, and T.-Y. Liu, “Lightgbm: A highly efficient gradient boosting decision tree,” Advances in neural information processing systems, vol. 30, 2017.
- L. M. Hodne and E. H. Furdal, “Team fundator: Weighted unet ensembles with enhanced datasets,” Nordic Machine Intelligence, vol. 2, no. 3, 2022.
- S. Kaliyugarasan and A. S. Lundervold, “Lab-net: Lidar and aerial image-based building segmentation using u-nets,” Nordic Machine Intelligence, vol. 2, no. 3, 2022.
- L. Li, T. Zhang, S. Oehmcke, F. Gieseke, and C. Igel, “Buildseg buildseg: A general framework for the segmentation of buildings,” Nordic Machine Intelligence, vol. 2, no. 3, 2022.