PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM
Recent advances in 3D content generation have amplified demand for dynamic models that are both visually realistic and physically consistent. However, state-of-the-art video diffusion models frequently produce implausible results such as momentum violations and object interpenetrations. Existing physics-aware approaches often rely on task-specific fine-tuning or supervised data, which limits their scalability and applicability. To address the challenge, we present PhyMAGIC, a training-free framework that generates physically consistent motion from a single image. PhyMAGIC integrates a pre-trained image-to-video diffusion model, confidence-guided reasoning via LLMs, and a differentiable physics simulator to produce 3D assets ready for downstream physical simulation without fine-tuning or manual supervision. By iteratively refining motion prompts using LLM-derived confidence scores and leveraging simulation feedback, PhyMAGIC steers generation toward physically consistent dynamics. Comprehensive experiments demonstrate that PhyMAGIC outperforms state-of-the-art video generators and physics-aware baselines, enhancing physical property inference and motion-text alignment while maintaining visual fidelity.
Institutions
- University of Nevada, Reno (US)
- Zhejiang University of Science and Technology (CN)
- Zhejiang University of Technology (CN)
- Zhejiang University (CN)
Publication Details
- Journal
- ArXiv.org
- Published
- 2025-05-22
- Primary Topic
- Research Data Management Practices
- Type
- article
- Field-Weighted Citation Impact
- 0.00