TokenMatch: 3D Mesh Correspondence Transformer with Curvature-Guided Tokenisation· TokenMatch:曲率引导标记化的3D网格匹配Transformer
While data-driven 3D shape correspondence estimation has recently seen substantial progress, robust matching under partial observations and strong non-isometric deformations remains challenging. Existing learning-based approaches often rely on hand-crafted descriptors or template-based representations, whereas recent generative models over functional maps suffer from high inference cost, limited interpretability, and poor generalisation to partial shapes. In response to these limitations, this paper introduces TokenMatch, a new transformer-based unified model for estimating 3D shape correspondences. Our feed-forward approach trained exclusively on BeCoS, a challenging non-isometric partial-to-partial shape-matching dataset, can generalise to matching full shapes without retraining or fine-tuning. TokenMatch uses self- and cross-attention mechanisms to efficiently learn patch-level and point-level relations as well as dense correspondences between shape pairs. Our core insight is that meshes can be adaptively tokenised into patches using shape curvature guidance, enabling effective learning of shape-specific geometric descriptors for correspondence estimation. We evaluate TokenMatch on standard benchmarks for partial and full shape matching, including CP2P, PSMAL, BeCoS, FAUST, SCAPE, and SHREC'19. Our method achieves consistently high performance, in most cases outperforming existing methods for partial and full shape matching in the mean geodesic error and intersection-over-union metrics, while also running faster at sub-second inference speeds.
提出TokenMatch,通过曲率引导标记化解决3D网格匹配问题。
- 核心方法
- 使用Transformer模型,结合自注意力和交叉注意力机制,通过曲率引导将3D形状标记化为补丁,学习局部和点级别的关系及密集对应。
- 适合谁读
- 研究者、工程师
- 要解决的问题
- 当前基于学习的方法在非等距部分观察下的3D形状匹配上表现不佳,且成本高、解释性差、泛化能力弱。
- 关键实验
- 在CP2P、PSMAL、BeCoS、FAUST、SCAPE 和 SHREC'19等数据集上进行了评估,显示了在地测误差和交并比指标上的优势。
- 主要贡献
- 在多个标准基准测试中展现出了高性能,尤其在部分到部分和完整形状匹配中优于现有方法,同时推理速度快。
- 意义与局限
- 提高了3D形状匹配的鲁棒性和效率,但在某些复杂变形下的表现仍需验证。