A Strong Baseline for Point Cloud Registration via Direct Superpoints Matching (2307.01362v4)
Abstract: Deep neural networks endow the downsampled superpoints with highly discriminative feature representations. Previous dominant point cloud registration approaches match these feature representations as the first step, e.g., using the Sinkhorn algorithm. A RANSAC-like method is then usually adopted as a post-processing refinement to filter the outliers. Other dominant method is to directly predict the superpoint matchings using learned MLP layers. Both of them have drawbacks: RANSAC-based methods are computationally intensive and prediction-based methods suffer from outputing non-existing points in the point cloud. In this paper, we propose a straightforward and effective baseline to find correspondences of superpoints in a global matching manner. We employ the normalized matching scores as weights for each correspondence, allowing us to reject the outliers and further weigh the rest inliers when fitting the transformation matrix without relying on the cumbersome RANSAC. Moreover, the entire model can be trained in an end-to-end fashion, leading to better accuracy. Our simple yet effective baseline shows comparable or even better results than state-of-the-art methods on three datasets including ModelNet, 3DMatch, and KITTI. We do not advocate our approach to be \emph{the} solution for point cloud registration but use the results to emphasize the role of matching strategy for point cloud registration. The code and models are available at https://github.com/neu-vi/Superpoints_Registration.
- Spinnet: Learning a general surface descriptor for 3d point cloud registration. In CVPR, 2021.
- Pointnetlk: Robust & efficient point cloud registration using pointnet. In CVPR, 2019.
- Pointdsc: Robust point cloud registration using deep spatial consistency. In CVPR, 2021.
- D3feat: Joint learning of dense detection and description of 3d local features. In CVPR, 2020.
- Method for registration of 3-d shapes. In Sensor fusion IV: control paradigms and data structures, 1992.
- Sparse iterative closest point. In Computer graphics forum, 2013.
- Dsac-differentiable ransac for camera localization. In CVPR, 2017.
- Pcam: Product of cross-attention matrices for rigid registration of point clouds. In ICCV, 2021.
- The trimmed iterative closest point algorithm. In ICPR, 2002.
- Deep global registration. In CVPR, 2020.
- Fully convolutional geometric features. In CVPR, 2019.
- Ppf-foldnet: Unsupervised learning of rotation invariant 3d local descriptors. In ECCV, 2018.
- Ppfnet: Global context aware local features for robust 3d point matching. In CVPR, 2018.
- Jean-Emmanuel Deschaud. IMLS-SLAM: scan-to-model matching based on 3d data. In ICRA, 2018.
- Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 1981.
- Are we ready for autonomous driving? the kitti vision benchmark suite. In Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
- Learning multiview 3d point cloud registration. In CVPR, 2020.
- The perfect match: 3d point cloud matching with smoothed densities. In CVPR, 2019.
- Alignnet-3d: Fast point cloud registration of partially observed objects. In 3DV, 2019.
- Deep residual learning for image recognition. In CVPR, 2016.
- Predator: Registration of 3d point clouds with low overlap. In CVPR, 2021.
- Kinectfusion: real-time dynamic 3d surface reconstruction and interaction. In SIGGRAPH, 2011.
- Wolfgang Kabsch. A solution for the best rotation to relate two sets of vectors. Acta Crystallographica Section A: Crystal Physics, Diffraction, Theoretical and General Crystallography, 1976.
- Learning compact geometric features. In ICCV, 2017.
- Deep hough voting for robust global registration. In ICCV, 2021.
- Usip: Unsupervised stable interest point detection from 3d point clouds. ICCV, 2019.
- A unified bev model for joint learning of 3d local features and overlap estimation, 2023.
- Deep learning for lidar point clouds in autonomous driving: A review. IEEE Transactions on Neural Networks and Learning Systems, 2021.
- Tony Lindeberg. Scale Invariant Feature Transform, volume 7. 05 2012.
- Efficient global point cloud registration by matching rotation invariant features through translation search. In ECCV, 2018.
- Decoupled weight decay regularization. In ICLR, 2019.
- L3-net: Towards learning based lidar localization for autonomous driving. In CVPR, 2019.
- Overlap-guided coarse-to-fine correspondence prediction for point cloud registration. In ICME, 2022.
- Representation learning with contrastive predictive coding. arXiv, 2018.
- 3dregnet: A deep neural network for 3d point registration. In CVPR, 2020.
- Pytorch: An imperative style, high-performance deep learning library. NeurIPS, 2019.
- Pointnet: Deep learning on point sets for 3d classification and segmentation. In CVPR, 2017.
- Pointnet++: Deep hierarchical feature learning on point sets in a metric space. In NeurIPS, 2017.
- Geometric transformer for fast and robust point cloud registration. In CVPR, 2022.
- Szymon Rusinkiewicz. A symmetric objective function for icp. ACM Transactions on Graphics (TOG), 2019.
- Efficient variants of the icp algorithm. In Proceedings third international conference on 3-D digital imaging and modeling, 2001.
- Fast point feature histograms (fpfh) for 3d registration. In ICRA, 2009.
- Generalized-icp. In Robotics: science and systems, 2009.
- Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain. In (IROS), 2018.
- Concerning nonnegative matrices and doubly stochastic matrices. Pacific Journal of Mathematics, 1967.
- Loftr: Detector-free local feature matching with transformers. In CVPR, 2021.
- Kpconv: Flexible and deformable convolution for point clouds. In ICCV, 2019.
- Unique signatures of histograms for local surface description. In ECCV, 2010.
- Disk: Learning local features with policy gradient. arXiv preprint arXiv:2006.13566, 2020.
- S. Umeyama. Least-squares estimation of transformation parameters between two point patterns. TPAMI, 1991.
- Attention is all you need. In NeurIPS, 2017.
- You only hypothesize once: Point cloud registration with rotation-equivariant descriptors. In ACM MM, 2022.
- Generalized differentiable ransac, 2023.
- 3d shapenets: A deep representation for volumetric shapes. In CVPR, 2015.
- Omnet: Learning overlapping mask for partial-to-partial point cloud registration. In ICCV, 2021.
- Gmflow: Learning optical flow via global matching. In CVPR, 2022.
- 3dfeat-net: Weakly supervised local 3d features for point cloud registration. In ECCV, 2018.
- Rpm-net: Robust point matching using learned features. In CVPR, 2020.
- Regtr: End-to-end point cloud correspondences with transformers. In CVPR, 2022.
- Learning to find good correspondences. In CVPR, 2018.
- Cofinet: Reliable coarse-to-fine correspondences for robust pointcloud registration. NeurIPS, 2021.
- Deepgmr: Learning latent gaussian mixture models for registration. In ECCV, 2020.
- 3dmatch: Learning local geometric descriptors from rgb-d reconstructions. In CVPR, 2017.