Neuron Activation Modulation for Text Style Transfer: Guiding Large Language Models

Text style transfer (TST) aims to flexibly adjust the style of text while preserving its core content.Although large language models (LLMs) excel in TST tasks, they often encounter unidirectionality issues in style transfer due to imbalanced training data and their tendency to generate safer responses.These challenges present a significant obstacle in achieving effective style transfer.To address this issue, we propose a novel method for text style transfer based on neuron activation modulation (NAM-TST).This approach identifies neurons related to style through gradient-based activation difference analysis and calculates the activation differences between the source and target styles.During text generation, we use the activation difference to align the activation values of stylerelated neurons with those of the target style to guide the model in performing the transfer.This strategy enables the model to generate text that satisfies specific style requirements, effectively mitigating the unidirectional issue inherent in LLMs during style transfer.Experiments on benchmark datasets demonstrate that NAM-TST significantly enhances style transfer quality while preserving content consistency.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.403
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Neuron Activation Modulation for Text Style Transfer: Guiding Large Language Models

Yifan Tang, Chun‐Yan Kong, Ru Zhang, Jianyi Liu
Topic Modeling
article

Neuron Activation Modulation for Text Style Transfer: Guiding Large Language Models

Yifan Tang, Chun‐Yan Kong, Ru Zhang, Jianyi Liu
article en

Abstract

Text style transfer (TST) aims to flexibly adjust the style of text while preserving its core content.Although large language models (LLMs) excel in TST tasks, they often encounter unidirectionality issues in style transfer due to imbalanced training data and their tendency to generate safer responses.These challenges present a significant obstacle in achieving effective style transfer.To address this issue, we propose a novel method for text style transfer based on neuron activation modulation (NAM-TST).This approach identifies neurons related to style through gradient-based activation difference analysis and calculates the activation differences between the source and target styles.During text generation, we use the activation difference to align the activation values of stylerelated neurons with those of the target style to guide the model in performing the transfer.This strategy enables the model to generate text that satisfies specific style requirements, effectively mitigating the unidirectional issue inherent in LLMs during style transfer.Experiments on benchmark datasets demonstrate that NAM-TST significantly enhances style transfer quality while preserving content consistency.

Beijing University of Posts and Telecommunications (CN)
National Natural Science Foundation of China
Quality Education
Openalex Percentile: Top 90%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.