RCareGen: An Interface for Scene and Task Generation in RCareWorld
This late-breaking report presents RCareGen, a graphical interface that integrates natural language commands with RCare World, a physics simulator for robotic caregiving scenarios. RCareGen has three core modules: (1) a front-end web interface, (2) an LLM-based code generator, and (3) the RCareWorld simulation backend. The front-end web interface enables novice users to input natural language, which is translated into Python code by an LLM-based code generator. This generated code interacts with RCareWorld APIs to run the simulation backend, facilitating scene setup, modifications, simple movements, and human-robot interaction tasks. Additionally, the system supports iterative feedback, allowing users to refine scenes and tasks interactively. By simplifying simulation setup and enhancing task diversity, RCareGen introduces a novel interface that democratizes robot simulation and programming across diverse domains.
Authors
- Ruolin Ye
- Tapomayukh Bhattacharjee (ORCID: https://orcid.org/0000-0001-9457-5726)
- Pooyan Fazli
- Hasti Seifi (ORCID: https://orcid.org/0000-0001-6437-0463)
- Shuaixing Chen
- Saurabh Dingwani
Institutions
- Shanghai Jiao Tong University (CN)
- Cornell University (US)
- Arizona State University (US)
Publication Details
- Published
- 2025-03-04
- DOI
- https://doi.org/10.1109/hri61500.2025.10973913
- Primary Topic
- Parallel Computing and Optimization Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00