Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Learning Canonical Embeddings for Unsupervised Shape Correspondence With Locally Linear Transformations

Journal Article · · IEEE Transactions on Pattern Analysis and Machine Intelligence
We present a new approach to unsupervised shape correspondence learning between pairs of point clouds. We make the first attempt to adapt the classical locally linear embedding algorithm (LLE)-originally designed for nonlinear dimensionality reduction-for shape correspondence. The key idea is to find dense correspondences between shapes by first obtaining high-dimensional neighborhood-preserving embeddings of low-dimensional point clouds and subsequently aligning the source and target embeddings using locally linear transformations. We demonstrate that learning the embedding using a new LLE-inspired point cloud reconstruction objective results in accurate shape correspondences. More specifically, the approach comprises an end-to-end learnable framework of extracting high-dimensional neighborhood-preserving embeddings, estimating locally linear transformations in the embedding space, and reconstructing shapes via divergence measure-based alignment of probability density functions built over reconstructed and target shapes. Our approach enforces embeddings of shapes in correspondence to lie in the same universal/canonical embedding space, which eventually helps regularize the learning process and leads to a simple nearest neighbors approach between shape embeddings for finding reliable correspondences. Comprehensive experiments show that the new method makes noticeable improvements over state-of-the-art approaches on standard shape correspondence benchmark datasets covering both human and nonhuman shapes.
Research Organization:
National Renewable Energy Laboratory (NREL), Golden, CO (United States)
Sponsoring Organization:
National Science Foundation (NSF)
DOE Contract Number:
AC36-08GO28308
OSTI ID:
2377643
Report Number(s):
NREL/JA-2C00-90362; MainId:92140; UUID:85332e4e-c964-4433-99e3-3c8045b51e8e; MainAdminId:72941
Journal Information:
IEEE Transactions on Pattern Analysis and Machine Intelligence, Journal Name: IEEE Transactions on Pattern Analysis and Machine Intelligence Journal Issue: 12 Vol. 45
Country of Publication:
United States
Language:
English

References (64)

Self-Supervised Robust Scene Flow Estimation via the Alignment of Probability Density Functions journal June 2022
Partial Functional Correspondence journal February 2016
A Concise and Provably Informative Multi‐Scale Signature Based on Heat Diffusion journal July 2009
CorrNet3D: Unsupervised End-to-end Learning of Dense Correspondence for 3D Point Clouds conference June 2021
3DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variations conference October 2021
Point Set Registration: Coherent Point Drift journal December 2010
3D Menagerie: Modeling the 3D Shape and Pose of Animals conference July 2017
Deformation transfer for triangle meshes journal August 2004
Functional maps journal July 2012
BEHAVE: Dataset and Method for Tracking Human Object Interactions conference June 2022
A new point matching algorithm for non-rigid registration journal February 2003
Fast Point Feature Histograms (FPFH) for 3D registration conference May 2009
Learning Spectral Descriptors for Deformable Shape Correspondence journal January 2014
Deep orientation-aware functional maps: Tackling symmetry issues in Shape Matching conference June 2022
Unsupervised Learning of Dense Shape Correspondence conference June 2019
Shape matching and object recognition using shape contexts journal April 2002
Shape from Phase: An Integrated Level Set and Probability Density Shape Representation conference August 2014
Deep Functional Maps: Structured Prediction for Dense Shape Correspondence conference October 2017
Smooth Shells: Multi-Scale Shape Registration With Functional Maps conference June 2020
Using spin images for efficient object recognition in cluttered 3D scenes journal May 1999
Sparse points matching by combining 3D mesh saliency with statistical descriptors journal April 2008
Multi‐scale Feature Extraction on Point‐Sampled Surfaces journal September 2003
SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels conference June 2018
Symmetry aware embedding for shape correspondence journal November 2016
Spectral correspondence for point pattern matching journal January 2003
Dense Non-rigid Shape Correspondence Using Random Forests conference June 2014
A unified framework for alignment and correspondence journal October 2003
Robust registration of 2D and 3D point sets journal December 2003
An adaptive-focus statistical shape model for segmentation and shape modeling of 3-D brain structures journal April 2001
DPC: Unsupervised Deep Point Correspondence via Cross and Self Construction conference December 2021
Method for registration of 3-D shapes conference April 1992
Fast Sinkhorn Filters: Using Matrix Scaling for Non-Rigid Shape Correspondence with Functional Maps conference June 2021
Unsupervised Deep Learning for Structured Shape Matching conference October 2019
A Gromov-Hausdorff Framework with Diffusion Geometry for Topologically-Robust Non-rigid Shape Matching journal October 2009
KPConv: Flexible and Deformable Convolution for Point Clouds conference October 2019
Robust Point Set Registration Using Gaussian Mixture Models journal August 2011
NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go conference June 2021
Dynamic Graph CNN for Learning on Point Clouds journal October 2019
Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs conference July 2017
Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondence conference June 2020
Robust locally linear embedding using penalty functions conference July 2011
A survey of content based 3D shape retrieval methods journal December 2007
Unsupervised Dense Deformation Embedding Network for Template-Free Shape Correspondence conference October 2021
Robust Estimation of Nonrigid Transformation for Point Set Registration conference June 2013
Cyclic Functional Mapping: Self-supervised Correspondence Between Non-isometric Deformable Shapes book January 2020
Robust $L_{2}E$ Estimation of Transformation for Non-Rigid Registration journal March 2015
Embedding Riemannian manifolds by their heat kernel journal July 1994
Smpl journal November 2015
Convergence Properties of the Softassign Quadratic Assignment Algorithm journal August 1999
A robust point matching algorithm for non-rigid registration using the Cauchy-Schwarz divergence conference September 2011
Deep Residual Learning for Image Recognition conference June 2016
Möbius voting for surface correspondence journal July 2009
3D-CODED: 3D Correspondences by Deep Deformation book January 2018
Functional correspondence by matrix completion conference June 2015
Nonlinear Dimensionality Reduction by Locally Linear Embedding journal December 2000
Shape google journal January 2011
Feature-based similarity search in 3D object databases journal December 2005
Matching with Shape Contexts book January 2006
The softassign Procrustes matching algorithm book January 1997
The wave kernel signature: A quantum mechanical approach to shape analysis conference November 2011
ZoomOut journal November 2019
The Cauchy–Schwarz divergence and Parzen windowing: Connections to graph theory and Mercer kernels journal September 2006
Geodesic Convolutional Neural Networks on Riemannian Manifolds conference December 2015
Effective Rotation-Invariant Point CNN with Spherical Harmonics Kernels conference September 2019