From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Training
Large Language Models used in ChatGPT have traditionally been trained to learn a refusal boundary: depending on the user’s intent, the model is taught to either fully comply or out-right refuse. While this is a strong mitigation for explicitly malicious prompts, focusing safety training on refusals can lead to brittleness for prompts with obscured user intent. Binary refusal boundaries are especially ill-suited for dual-use cases (such as biology or cybersecurity), where a user request can be answered safely at a high level, but in some cases can lead to malicious uplift if sufficiently detailed or actionable. As an alternative, we propose safe-completions: a safety-training approach that centers on the safety of the assistant’s output, rather than a bi-nary classification of the user’s intent. Safe-completions seek to maximize helpfulness within the safety policy’s constraints. We incorporated this approach into GPT-5 and find that across both production comparisons and internally controlled experiments, safe-completion training improves safety (especially on dual-use prompts), reduces the severity of residual safety failures, and substantially increases model helpfulness.
Authors
- Alex Beutel (ORCID: https://orcid.org/0000-0002-5917-2849)
- Yuan Yuan (ORCID: https://orcid.org/0000-0001-6681-5710)
- Saachi Jain
- T. Sriskandarajah
- Anna-Luisa Brakman
- Alec Helyar
- Andrea Vallone
Institutions
- OpenAI (United States) (US)
- University of California, Davis (US)
Publication Details
- Journal
- SuperIntelligence - Robotics - Safety & Alignment
- Published
- 2025-09-23
- DOI
- https://doi.org/10.70777/si.v2i6.15625
- Primary Topic
- Safety Systems Engineering in Autonomy
- Type
- article
- Field-Weighted Citation Impact
- 0.00