An Enhanced Semantic Binding Method Based on Balanced Attention Maps

Attention mechanisms in text-to-image models improve interpretability but suffer from cross-prompt bias causing semantic misalignment and quality degradation. We propose Balanced Attention Maps (BAM), a training-free method that dynamically adjusts attention maps during inference using linguistic structures in prompts, enhancing semantic alignment and visual coherence. Validated through experiments with three leading models across major benchmarks, BAM outperforms existing methods in both quantitative metrics (Inception Score, CLIP Score) and human evaluations (semantic consistency, visual naturalness). Results confirm BAM's superiority in maintaining generation fidelity while addressing cross-prompt bias through attention recalibration, without requiring retraining.

Authors

Institutions

Publication Details

Published
2025-06-06
DOI
https://doi.org/10.1109/dlcv65218.2025.11088859
Primary Topic
Advanced Computing and Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Enhanced Semantic Binding Method Based on Balanced Attention Maps

Qihai Zhang, Huanzhe Li
Advanced Computing and Algorithms
article

An Enhanced Semantic Binding Method Based on Balanced Attention Maps

Qihai Zhang, Huanzhe Li
article en

Abstract

Attention mechanisms in text-to-image models improve interpretability but suffer from cross-prompt bias causing semantic misalignment and quality degradation. We propose Balanced Attention Maps (BAM), a training-free method that dynamically adjusts attention maps during inference using linguistic structures in prompts, enhancing semantic alignment and visual coherence. Validated through experiments with three leading models across major benchmarks, BAM outperforms existing methods in both quantitative metrics (Inception Score, CLIP Score) and human evaluations (semantic consistency, visual naturalness). Results confirm BAM's superiority in maintaining generation fidelity while addressing cross-prompt bias through attention recalibration, without requiring retraining.

Hebei GEO University (CN)
Reduced inequalities
Openalex Percentile: Top 73%
Advanced Computing and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.