Multi-level Partition of Unity on Differentiable Moving Particles
We introduce a differentiable moving particle representation based on the multi-level partition of unity (MPU) to represent dynamic implicit geometries. At the core of our representation are two groups of particles, named feature particles and sample particles, which can move in space and produce dynamic surfaces according to external velocity fields or optimization gradients. These two particle groups iteratively guide and correct each other by alternating their roles as inputs and outputs. Each feature particle carries a set of coefficients for a local quadratic patch. These particle patches are assembled with partition-of-unity weights to derive a continuous implicit global shape. Each sampling particle carries its position and orientation, serving as dense surface samples for optimization tasks. Based on these moving particles, we develop a fully differentiable framework to infer and evolve highly detailed implicit geometries, enhanced by a multi-level background grid for particle adaptivity, across different inverse tasks. We demonstrated the efficacy of our representation through various benchmark comparisons with state-of-the-art neural representations, achieving lower memory consumption, fewer training iterations, and orders of magnitude higher accuracy in handling topologically complex objects and dynamic tracking tasks.
Authors
- Yuqing Zhou (ORCID: https://orcid.org/0000-0002-1812-068X)
- Hiroki Kobayashi (ORCID: https://orcid.org/0000-0003-3597-1328)
- Atsushi Kawamoto (ORCID: https://orcid.org/0000-0002-9335-1269)
- Tsuyoshi Nomura (ORCID: https://orcid.org/0000-0002-7055-6675)
- Bo Zhu (ORCID: https://orcid.org/0000-0002-1392-0928)
- Taiyuan Zhang (ORCID: https://orcid.org/0000-0002-7395-5372)
- Jinjin He (ORCID: https://orcid.org/0009-0000-4319-1191)
Institutions
- Dartmouth College (US)
- Georgia Institute of Technology (US)
- Toyota Central Research and Development Laboratories (Japan) (JP)
- Toyota Research Institute
Publication Details
- Journal
- ACM Transactions on Graphics
- Published
- 2024-11-19
- DOI
- https://doi.org/10.1145/3687989
- Citations
- 1
- Primary Topic
- 3D Shape Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.37
Funders
- Office of International Science and Engineering
- Division of Electrical, Communications and Cyber Systems