Robust partial-to-partial point cloud registration in a full range

Registration of 3D objects from point clouds is a challenging task due to sparse and noisy measurements, incomplete observations, and large transformations. In this work, we propose the Graph Matching Consensus Network (GMCNet) to estimate faithful correspondences for full-range Partial-to-Partial p...

Full description

Saved in:
Bibliographic Details
Main Authors: Pan, Liang, Cai, Zhongang, Liu, Ziwei
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2024
Subjects:
Online Access:https://hdl.handle.net/10356/177987
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:Registration of 3D objects from point clouds is a challenging task due to sparse and noisy measurements, incomplete observations, and large transformations. In this work, we propose the Graph Matching Consensus Network (GMCNet) to estimate faithful correspondences for full-range Partial-to-Partial point cloud Registration (PPR) in object-level registration scenarios. To encode robust point descriptors, we employ a novel Transformation-robust Point Transformer (TPT) module to adaptively aggregate local features with respect to the structural relations, taking advantage of both handcrafted rotation-invariant (RI) features and noise-resilient spatial coordinates. Based on the synergy of hierarchical graph networks and graphical modeling, we propose the Hierarchical Graphical Modeling (HGM) architecture to encode robust descriptors comprising of i) a unary term learned from RI features, and ii) multiple smoothness terms encoded from neighboring point relations at different scales through our TPT modules. Extensive experiments show that GMCNet outperforms previous state-of-the-art methods for PPR.