Multi-Step Instruction-Guided Editing for Neural Radiance Fields: Enhancing User Control in 3D Scene Manipulation

Multi-Step Instruction-Guided Editing is a novel approach for 3D scene editing that allows users to edit a Neural Radiance Field (NeRF) iteratively by providing sequential instructions. Current methods, like single-step instruction models, struggle with maintaining 3D consistency when performing complex, multi-layered edits, often leading to inconsistencies across viewpoints. These existing approaches do not provide the capability to modify or change the preceding edits which makes it difficult to make intricate changes to a scene. In this paper, we introduce Multi-StepNeRF, a sequential pipeline that allows users to issue multiple text commands, each building upon the last while ensuring 3D consistency throughout. The pipeline allows, for example, to first add an object, then change its type, and later edit its properties. Intermediate NeRF models are saved at various steps along the pipeline to offer more flexibility and undo unwanted changes. We show that this method allows complicated transformations of large scenes with high precision and without breaking the consistency, which makes it possible to provide the user with an interface for realistic 3D environment editing.