TriSAIL: A Source-Sensitive Audit Protocol for Symmetric and Asymmetric Transfer in Hidden-State Safety Probes

Hidden-state probes are widely used to study safety-related behavior in language and multimodal models, yet their results can change with the data sources, behavior labels, extracted layer, and probe family. We introduce TriSAIL, an evaluation protocol that records these choices and tests how they affect the resulting claim. TriSAIL uses three response-derived states—benign, non-refusal jailbreak, and borderline/refusal—and assigns train, validation, and test data by source. We extract hidden states from the final input position in the first generation forward pass, before a generated token is returned. The operating layer is selected using validation data only. We evaluate the protocol on five text-only LLMs and six MLLMs with logistic, kNN, and SVM probes. The LLM results vary substantially across held-out attack families, probe families, and source assignments. The MLLM probes achieve high label separability, while source-ID decoding, prediction–source association, and residualization tests show strong source alignment in the same representations. Because the main MLLM matrix couples sources and labels, these results describe source-sensitive separability. Source-transfer conclusions use source-held-out columns; mixed accuracy is a descriptive overall summary. TriSAIL reports these results with probe sensitivity and source diagnostics so that each score is interpreted under the conditions that produced it.

Authors

Institutions

Publication Details

Journal
Symmetry
Published
2026-09-30
DOI
https://doi.org/10.3390/sym18101644
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

TriSAIL: A Source-Sensitive Audit Protocol for Symmetric and Asymmetric Transfer in Hidden-State Safety Probes

Z. Merrick Li, Guorui Chen, Yifan Xia, Xinliang Ma
Symmetry
Topic Modeling
article

TriSAIL: A Source-Sensitive Audit Protocol for Symmetric and Asymmetric Transfer in Hidden-State Safety Probes

Z. Merrick Li, Guorui Chen, Yifan Xia, Xinliang Ma
article en

Abstract

Hidden-state probes are widely used to study safety-related behavior in language and multimodal models, yet their results can change with the data sources, behavior labels, extracted layer, and probe family. We introduce TriSAIL, an evaluation protocol that records these choices and tests how they affect the resulting claim. TriSAIL uses three response-derived states—benign, non-refusal jailbreak, and borderline/refusal—and assigns train, validation, and test data by source. We extract hidden states from the final input position in the first generation forward pass, before a generated token is returned. The operating layer is selected using validation data only. We evaluate the protocol on five text-only LLMs and six MLLMs with logistic, kNN, and SVM probes. The LLM results vary substantially across held-out attack families, probe families, and source assignments. The MLLM probes achieve high label separability, while source-ID decoding, prediction–source association, and residualization tests show strong source alignment in the same representations. Because the main MLLM matrix couples sources and labels, these results describe source-sensitive separability. Source-transfer conclusions use source-held-out columns; mixed accuracy is a descriptive overall summary. TriSAIL reports these results with probe sensitivity and source diagnostics so that each score is interpreted under the conditions that produced it.

SymmetryVol. 18(10)
Wuhan University (CN)
Peace, Justice and strong institutions
Openalex Percentile: Top 9%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

TriSAIL: A Source-Sensitive Audit Protocol for Symmetric and Asymmetric Transfer in Hidden-State Safety Probes — Z. Merrick Li, Guorui Chen, et al. · Symmetry (2026) | TGRS Research Map | TGRS