A Couch Potato is not a Potato on a Couch: Prompting Strategies, Image Generation, and Compositionality Prediction for Noun Compounds

We explore the role of the visual modality and of vision transformers in predicting the compositionality of English noun compounds.Crucially, we contribute a framework to address the challenge of obtaining adequate images that represent non-compositional compounds (such as couch potato), making it relevant for any image-based approach targeting figurative language.Our method uses prompting strategies and diffusion models to generate images.Comparing and combining our approach with a stateof-the-art text-based approach reveals complementary contributions regarding features as well as degrees of abstractness in compounds.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.561
Primary Topic
Phonetics and Phonology Research
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Couch Potato is not a Potato on a Couch: Prompting Strategies, Image Generation, and Compositionality Prediction for Noun Compounds

Sinan Kurtyigit, Sabine Schulte im Walde, Carina Silberer, Diego Frassinelli
Phonetics and Phonology Research
article

A Couch Potato is not a Potato on a Couch: Prompting Strategies, Image Generation, and Compositionality Prediction for Noun Compounds

Sinan Kurtyigit, Sabine Schulte im Walde, Carina Silberer, Diego Frassinelli
article en

Abstract

We explore the role of the visual modality and of vision transformers in predicting the compositionality of English noun compounds.Crucially, we contribute a framework to address the challenge of obtaining adequate images that represent non-compositional compounds (such as couch potato), making it relevant for any image-based approach targeting figurative language.Our method uses prompting strategies and diffusion models to generate images.Comparing and combining our approach with a stateof-the-art text-based approach reveals complementary contributions regarding features as well as degrees of abstractness in compounds.

Deutsche Forschungsgemeinschaft
Zero hunger
Openalex Percentile: Top 80%
Phonetics and Phonology Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.