Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Change detection needs change information: improving deep 3D point cloud change detection (2304.12639v2)

Published 25 Apr 2023 in cs.CV

Abstract: Change detection is an important task that rapidly identifies modified areas, particularly when multi-temporal data are concerned. In landscapes with a complex geometry (e.g., urban environment), vertical information is a very useful source of knowledge that highlights changes and classifies them into different categories. In this study, we focus on change segmentation using raw three-dimensional (3D) point clouds (PCs) directly to avoid any information loss due to the rasterization processes. While deep learning has recently proven its effectiveness for this particular task by encoding the information through Siamese networks, we investigate herein the idea of also using change information in the early steps of deep networks. To do this, we first propose to provide a Siamese KPConv state-of-the-art (SoTA) network with hand-crafted features, especially a change-related one, which improves the mean of the Intersection over Union (IoU) over the classes of change by 4.70%. Considering that a major improvement is obtained due to the change-related feature, we then propose three new architectures to address 3D PC change segmentation: OneConvFusion, Triplet KPConv, and Encoder Fusion SiamKPConv. All these networks consider the change information in the early steps and outperform the SoTA methods. In particular, Encoder Fusion SiamKPConv overtakes the SoTA approaches by more than 5% of the mean of the IoU over the classes of change, emphasizing the value of having the network focus on change information for the change detection task. The code is available at https://github.com/IdeGelis/torch-points3d-SiamKPConvVariants.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (50)
  1. N. Champion, D. Boldo, M. Pierrot-Deseilligny, and G. Stamon, “2d building change detection from high resolution satelliteimagery: A two-step hierarchical method based on 3d invariant primitives,” Pattern Recognition Letters, vol. 31, no. 10, pp. 1138–1147, 2010.
  2. J. Sublime and E. Kalinicheva, “Automatic post-disaster damage mapping using deep-learning techniques for change detection: Case study of the tohoku tsunami,” Remote Sensing, vol. 11, no. 9, p. 1123, 2019.
  3. V. Zahs, K. Anders, J. Kohns, A. Stark, and B. Höfle, “Classification of structural building damage grades from multi-temporal photogrammetric point clouds using a machine learning model trained on virtual laser scanning data,” arXiv preprint arXiv:2302.12591, 2023.
  4. I. Sandric, B. Mihai, I. Savulescu, B. Suditu, and Z. Chitu, “Change detection analysis for urban development in bucharest-romania, using high resolution satellite imagery,” in 2007 Urban Remote Sensing Joint Event.   IEEE, 2007, pp. 1–8.
  5. J. Feranec, G. Hazeu, S. Christensen, and G. Jaffrain, “Corine land cover change detection in europe (case studies of the netherlands and slovakia),” Land use policy, vol. 24, no. 1, pp. 234–247, 2007.
  6. P. Letortu, S. Costa, O. Maquaire, C. Delacourt, E. Augereau, R. Davidson, S. Suanez, and J. Nabucet, “Retreat rates, modalities and agents responsible for erosion along the coastal chalk cliffs of Upper Normandy: The contribution of terrestrial laser scanning,” Geomorphology, vol. 245, pp. 3–14, Sep. 2015.
  7. A. R. Enríquez, M. Marcos, A. Falqués, and D. Roelvink, “Assessing beach and dune erosion and vulnerability under sea level rise: a case study in the mediterranean sea,” Frontiers in Marine Science, vol. 6, p. 4, 2019.
  8. I. de Gélis, Z. Bessin, P. Letortu, M. Jaud, C. Delacourt, S. Costa, O. Maquaire, R. Davidson, T. Corpetti, and S. Lefèvre, “Cliff change detection using siamese kpconv deep network on 3d point clouds,” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. V-3-2022, pp. 649–656, 2022.
  9. R. Hock, “Glacier melt: a review of processes and their modelling,” Progress in physical geography, vol. 29, no. 3, pp. 362–391, 2005.
  10. B. D. Malamud, D. L. Turcotte, F. Guzzetti, and P. Reichenbach, “Landslide inventories and their statistical properties,” Earth Surface Processes and Landforms, vol. 29, no. 6, pp. 687–711, 2004.
  11. U. Stilla and Y. Xu, “Change detection of urban objects using 3d point clouds: A review,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 197, pp. 228–255, 2023.
  12. W. Xiao, H. Cao, M. Tang, Z. Zhang, and N. Chen, “3d urban object change detection from aerial and terrestrial point clouds: A review,” International Journal of Applied Earth Observation and Geoinformation, vol. 118, p. 103258, 2023.
  13. R. Qin, J. Tian, and P. Reinartz, “3D change detection – approaches and applications,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 122, pp. 41–56, 2016.
  14. H. Murakami, K. Nakagawa, H. Hasegawa, T. Shibata, and E. Iwanami, “Change detection of buildings using an airborne laser scanner,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 54, no. 2-3, pp. 148–152, 1999.
  15. C. Stal, F. Tack, P. De Maeyer, A. De Wulf, and R. Goossens, “Airborne photogrammetry and lidar for dsm extraction and 3d change detection over an urban area–a comparative study,” International Journal of Remote Sensing, vol. 34, no. 4, pp. 1087–1110, 2013.
  16. Z. Zhang, G. Vosselman, M. Gerke, D. Tuia, and M. Y. Yang, “Change detection between multimodal remote sensing data using siamese cnn,” arXiv preprint arXiv:1807.09562, 2018.
  17. Z. Zhang, G. Vosselman, M. Gerke, C. Persello, D. Tuia, and M. Yang, “Detecting building changes between airborne laser scanning and photogrammetric data,” Remote sensing, vol. 11, no. 20, p. 2417, 2019.
  18. T. G. Bernard, D. Lague, and P. Steer, “Beyond 2d landslide inventories and their rollover: synoptic 3d inventories and volume from repeat lidar data,” Earth Surface Dynamics, vol. 9, no. 4, pp. 1013–1044, 2021.
  19. I. de Gélis, S. Lefèvre, and T. Corpetti, “Siamese kpconv: 3d multiple change detection from raw point clouds using deep learning,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 197, pp. 274–291, 2023.
  20. R. C. Daudt, B. Le Saux, and A. Boulch, “Fully convolutional siamese networks for change detection,” in 2018 25th IEEE International Conference on Image Processing (ICIP).   IEEE, 2018, pp. 4063–4067.
  21. H. Thomas, C. R. Qi, J.-E. Deschaud, B. Marcotegui, F. Goulette, and L. J. Guibas, “Kpconv: Flexible and deformable convolution for point clouds,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 6411–6420.
  22. D. Girardeau-Montaut, M. Roux, R. Marc, and G. Thibault, “Change detection on points cloud data acquired with a ground laser scanner,” International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 36, no. part 3, p. W19, 2005.
  23. D. Lague, N. Brodu, and J. Leroux, “Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the rangitikei canyon (NZ),” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 82, pp. 10–26, 2013.
  24. T. Tran, C. Ressl, and N. Pfeifer, “Integrated change detection and classification in urban areas based on airborne laser scanning point clouds,” Sensors, vol. 18, no. 2, p. 448, 2018.
  25. T. Ku, S. Galanakis, B. Boom, R. C. Veltkamp, D. Bangera, S. Gangisetty, N. Stagakis, G. Arvanitis, and K. Moustakas, “Shrec 2021: 3d point cloud change detection for street scenes,” Computers & Graphics, vol. 99, pp. 192–200, 2021.
  26. Y. Wang, Y. Sun, Z. Liu, S. E. Sarma, M. M. Bronstein, and J. M. Solomon, “Dynamic graph cnn for learning on point clouds,” ACM Transactions On Graphics (TOG), vol. 38, no. 5, pp. 1–12, 2019.
  27. Y. Zhan, K. Fu, M. Yan, X. Sun, H. Wang, and X. Qiu, “Change detection based on deep siamese convolutional network for optical aerial images,” IEEE Geoscience and Remote Sensing Letters, vol. 14, no. 10, pp. 1845–1849, 2017.
  28. S. Lefèvre, D. Tuia, J. D. Wegner, T. Produit, and A. S. Nassar, “Toward seamless multiview scene analysis from satellite to street level,” Proceedings of the IEEE, vol. 105, no. 10, pp. 1884–1899, 2017.
  29. H. He, M. Chen, T. Chen, and D. Li, “Matching of remote sensing images with complex background variations via siamese convolutional neural network,” Remote Sensing, vol. 10, no. 2, p. 355, 2018.
  30. W. Shi, M. Zhang, R. Zhang, S. Chen, and Z. Zhan, “Change detection based on artificial intelligence: State-of-the-art and challenges,” Remote Sensing, vol. 12, no. 10, p. 1688, 2020.
  31. H. Chen, C. Wu, B. Du, and L. Zhang, “Deep siamese multi-scale convolutional network for change detection in multi-temporal vhr images,” in 2019 10th International Workshop on the Analysis of Multitemporal Remote Sensing Images (MultiTemp).   IEEE, 2019, pp. 1–4.
  32. M. Zhang and W. Shi, “A feature difference convolutional neural network-based change detection method,” IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 10, pp. 7232–7246, 2020.
  33. X. Zheng, D. Guan, B. Li, Z. Chen, and L. Pan, “Global and local graph-based difference image enhancement for change detection,” Remote Sensing, vol. 15, no. 5, p. 1194, 2023.
  34. L. Song, M. Xia, J. Jin, M. Qian, and Y. Zhang, “Suacdnet: Attentional change detection network based on siamese u-shaped structure,” International Journal of Applied Earth Observation and Geoinformation, vol. 105, p. 102597, 2021.
  35. K. Jiang, W. Zhang, J. Liu, F. Liu, and L. Xiao, “Joint variation learning of fusion and difference features for change detection in remote sensing images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–18, 2022.
  36. H. Yin, L. Weng, Y. Li, M. Xia, K. Hu, H. Lin, and M. Qian, “Attention-guided siamese networks for change detection in high resolution remote sensing images,” International Journal of Applied Earth Observation and Geoinformation, vol. 117, p. 103206, 2023. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1569843223000286
  37. X. Peng, R. Zhong, Z. Li, and Q. Li, “Optical remote sensing image change detection based on attention mechanism and image difference,” IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 9, pp. 7296–7307, 2020.
  38. H. Jiang, X. Hu, K. Li, J. Zhang, J. Gong, and M. Zhang, “Pga-siamnet: Pyramid feature-based attention-guided siamese network for remote sensing orthoimagery building change detection,” Remote Sensing, vol. 12, no. 3, p. 484, 2020.
  39. P. Chen, L. Guo, X. Zhang, K. Qin, W. Ma, and L. Jiao, “Attention-guided siamese fusion network for change detection of remote sensing images,” Remote Sensing, vol. 13, no. 22, p. 4597, 2021.
  40. J. Chen, J. Fan, M. Zhang, Y. Zhou, and C. Shen, “Msf-net: A multiscale supervised fusion network for building change detection in high-resolution remote sensing images,” IEEE Access, vol. 10, pp. 30 925–30 938, 2022.
  41. I. de Gélis, S. Lefèvre, and T. Corpetti, “Change detection in urban point clouds: An experimental comparison with simulated 3d datasets,” Remote Sensing, vol. 13, no. 13, 2021.
  42. L. Nanni, S. Ghidoni, and S. Brahnam, “Handcrafted vs. non-handcrafted features for computer vision classification,” Pattern Recognition, vol. 71, pp. 158–172, 2017.
  43. R. Nijhawan, J. Das, and B. Raman, “A hybrid of deep learning and hand-crafted features based approach for snow cover mapping,” International journal of remote sensing, vol. 40, no. 2, pp. 759–773, 2019.
  44. P.-H. Hsu and Z.-Y. Zhuang, “Incorporating handcrafted features into deep learning for point cloud classification,” Remote Sensing, vol. 12, no. 22, p. 3713, 2020.
  45. C. R. Qi, H. Su, K. Mo, and L. J. Guibas, “Pointnet: Deep learning on point sets for 3d classification and segmentation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 652–660.
  46. C. R. Qi, L. Yi, H. Su, and L. J. Guibas, “Pointnet++: Deep hierarchical feature learning on point sets in a metric space,” Advances in neural information processing systems, vol. 30, 2017.
  47. T. Chaton, N. Chaulet, S. Horache, and L. Landrieu, “Torch-points3d: A modular multi-task frameworkfor reproducible deep learning on 3d point clouds,” arXiv preprint arXiv:2010.04642, 2020.
  48. W. Diestel, “Arbaro—tree generation for povray,” 2003.
  49. S. Fang, K. Li, J. Shao, and Z. Li, “Snunet-cd: A densely connected siamese network for change detection of vhr images,” IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1–5, 2021.
  50. M.-H. Guo, J.-X. Cai, Z.-N. Liu, T.-J. Mu, R. R. Martin, and S.-M. Hu, “Pct: Point cloud transformer,” Computational Visual Media, vol. 7, pp. 187–199, 2021.
Citations (6)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now