IST-OAM:Image Style Transfer via Optimized Self-Attention Mechanism

In recent years, style transfer has found increasingly broad applications in daily life, particularly in the domain of photography image style transfer. However, current methods face limitations in handling local and global information in photography style images due to their inherent structural constraints. This often leads to issues such as content loss and erroneous transformations between unrelated content. To address these critical issues, this paper proposes the IST-OAM style transfer model based on the self-attention mechanism of the Transformer model. By integrating image segmentation channels with transfer branches and defining enhanced style loss, the model strengthens structural constraints on images during the transfer process, ensuring that the image structure is preserved and not lost or disrupted. This approach aims to achieve more accurate results in style transfer. The proposed method is evaluated using various scenes from photography images. Experimental results demonstrate that the IST-OAM model outperforms other methods both visually and in quantitative metrics.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/itnec60942.2024.10733239
Primary Topic
Machine Learning and ELM
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

IST-OAM:Image Style Transfer via Optimized Self-Attention Mechanism

Mengshi Li, Ning Jia, Nan Yin
Machine Learning and ELM
article

IST-OAM:Image Style Transfer via Optimized Self-Attention Mechanism

Mengshi Li, Ning Jia, Nan Yin
article en

Abstract

In recent years, style transfer has found increasingly broad applications in daily life, particularly in the domain of photography image style transfer. However, current methods face limitations in handling local and global information in photography style images due to their inherent structural constraints. This often leads to issues such as content loss and erroneous transformations between unrelated content. To address these critical issues, this paper proposes the IST-OAM style transfer model based on the self-attention mechanism of the Transformer model. By integrating image segmentation channels with transfer branches and defining enhanced style loss, the model strengthens structural constraints on images during the transfer process, ensuring that the image structure is preserved and not lost or disrupted. This approach aims to achieve more accurate results in style transfer. The proposed method is evaluated using various scenes from photography images. Experimental results demonstrate that the IST-OAM model outperforms other methods both visually and in quantitative metrics.

China State Shipbuilding (China) (CN)
Openalex Percentile: Top 83%
Machine Learning and ELM
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

IST-OAM:Image Style Transfer via Optimized Self-Attention Mechanism — Mengshi Li, Ning Jia, et al. · (2024) | TGRS Research Map | TGRS