Understanding Adversarial Attacks on Discrete Generative AI

Data attribution methods have been commonly used on generative AI as a way to evaluate the usefulness of data samples. In the future, it may be used to compensate copyright holders for their data. However, these methods have proven to be susceptible to adversarial attacks through various optimization processes. We seek to show that these adversarial attacks can not only be successful, but also understandable to the general public. In particular, we target discrete generative AI in the symbolic music domain, as music has various patterns such as chords and arpeggios that can be easily identified. By highlighting these vulnerabilities, the knowledge can be leveraged to understand other adversarial attacks in different fields, such as text generation and image generation. Our work underscores the need for more robust data attribution methods for the use of generative AI. We attempt various heuristic methods to alter a data sample, including copying influential pieces to another one. We show that simple heuristic methods can also be used to generate adversarial data samples to data attribution.

Publication Details

Journal
DigitalCommons-IMSA (Illinois Mathematics and Science Academy)
Published
2025-04-17
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Understanding Adversarial Attacks on Discrete Generative AI

DigitalCommons-IMSA (Illinois Mathematics and Science Academy)
Adversarial Robustness in Machine Learning
article

Understanding Adversarial Attacks on Discrete Generative AI

article en

Abstract

Data attribution methods have been commonly used on generative AI as a way to evaluate the usefulness of data samples. In the future, it may be used to compensate copyright holders for their data. However, these methods have proven to be susceptible to adversarial attacks through various optimization processes. We seek to show that these adversarial attacks can not only be successful, but also understandable to the general public. In particular, we target discrete generative AI in the symbolic music domain, as music has various patterns such as chords and arpeggios that can be easily identified. By highlighting these vulnerabilities, the knowledge can be leveraged to understand other adversarial attacks in different fields, such as text generation and image generation. Our work underscores the need for more robust data attribution methods for the use of generative AI. We attempt various heuristic methods to alter a data sample, including copying influential pieces to another one. We show that simple heuristic methods can also be used to generate adversarial data samples to data attribution.

DigitalCommons-IMSA (Illinois Mathematics and Science Academy)
Peace, Justice and strong institutions
Openalex Percentile: Top 72%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.