From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Training

Large Language Models used in ChatGPT have traditionally been trained to learn a refusal boundary: depending on the user’s intent, the model is taught to either fully comply or out-right refuse. While this is a strong mitigation for explicitly malicious prompts, focusing safety training on refusals can lead to brittleness for prompts with obscured user intent. Binary refusal boundaries are especially ill-suited for dual-use cases (such as biology or cybersecurity), where a user request can be answered safely at a high level, but in some cases can lead to malicious uplift if sufficiently detailed or actionable. As an alternative, we propose safe-completions: a safety-training approach that centers on the safety of the assistant’s output, rather than a bi-nary classification of the user’s intent. Safe-completions seek to maximize helpfulness within the safety policy’s constraints. We incorporated this approach into GPT-5 and find that across both production comparisons and internally controlled experiments, safe-completion training improves safety (especially on dual-use prompts), reduces the severity of residual safety failures, and substantially increases model helpfulness.

Authors

Institutions

Publication Details

Journal
SuperIntelligence - Robotics - Safety & Alignment
Published
2025-09-23
DOI
https://doi.org/10.70777/si.v2i6.15625
Primary Topic
Safety Systems Engineering in Autonomy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Training

Alex Beutel, Yuan Yuan, Saachi Jain, T. Sriskandarajah et al.
SuperIntelligence - Robotics - Safety & Alignment
Safety Systems Engineering in Autonomy
article

From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Training

Alex Beutel, Yuan Yuan, Saachi Jain, T. Sriskandarajah, Anna-Luisa Brakman, Alec Helyar, Andrea Vallone
article en

Abstract

Large Language Models used in ChatGPT have traditionally been trained to learn a refusal boundary: depending on the user’s intent, the model is taught to either fully comply or out-right refuse. While this is a strong mitigation for explicitly malicious prompts, focusing safety training on refusals can lead to brittleness for prompts with obscured user intent. Binary refusal boundaries are especially ill-suited for dual-use cases (such as biology or cybersecurity), where a user request can be answered safely at a high level, but in some cases can lead to malicious uplift if sufficiently detailed or actionable. As an alternative, we propose safe-completions: a safety-training approach that centers on the safety of the assistant’s output, rather than a bi-nary classification of the user’s intent. Safe-completions seek to maximize helpfulness within the safety policy’s constraints. We incorporated this approach into GPT-5 and find that across both production comparisons and internally controlled experiments, safe-completion training improves safety (especially on dual-use prompts), reduces the severity of residual safety failures, and substantially increases model helpfulness.

SuperIntelligence - Robotics - Safety & AlignmentVol. 2(6)
OpenAI (United States) (US), University of California, Davis (US)
Openalex Percentile: Top 68%
Safety Systems Engineering in Autonomy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Training — Alex Beutel, Yuan Yuan, et al. · SuperIntelligence - Robotics - Safety & Alignment (2025) | TGRS Research Map | TGRS