Boosting 3D object generation through PBR materials

Normal BoostingFig. 1.Overview.Given a single image, the existing image-to-3D generative models always synthesize 3D meshes with flawed geometry and RGB textures only.Our method not only boosts existing approaches with PBR materials, empowering relighting under various lighting conditions, but also boosts the object's normal maps, capturing more intricate details and better aligning with the given image.Notably, we fine-tune Stable Diffusion to estimate the albedo map from the single-view RGB image and lift it to multi-view albedo maps for a complete albedo UV.