Do LLMs Brainstorm Better with Knowledge Graphs?

In AI-assisted product ideation, a knowledge graph is an attractive way to represent the solution space for LLM-powered combinatorial search, yet few studies ask how the form of the graph given to the model affects what it produces, and at what cost. We test this on a microwave oven described as a graph (123 nodes, 246 edges) linking user needs to functions, parts and technologies. For each of 13 needs, Claude Haiku got the whole graph, the slice relevant to that need, a random slice of the same size, or no graph, at four effort levels; Claude Sonnet scored the 2,892 ideas blind, and we counted top ideas (roughly the best 12%) per 100k tokens. A follow-up asked Haiku, Opus and Fable for 50 ideas per call on one need at medium effort (6,091 ideas). The full graph never paid off. It yielded about 3 top ideas per 100k tokens at every effort, against 8.8 for the slice at medium effort; at high effort, the only one at which all four conditions ran, the slice yielded 5.9 and no graph 6.4. In the follow-up, on a need chosen to match this ordering, the full graph was the least efficient for every model, clearly so for Haiku and Fable; for the stronger models it added cost without lowering the share of good ideas. The slice was the best way to give the graph but no better than no graph. The planned comparison of whole idea sets favoured the full graph (partly reflecting length); the yield measure was defined after seeing the results and is exploratory. Stronger models found 2 to 2.5 times as many top ideas per token, yet Haiku found 10 to 40 times more per dollar, an advantage that reverses when people, not an automated judge, screen the ideas. Thinking longer raised quality, not efficiency. An informal reading of all first-study ideas by one author, without a p

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-27
DOI
https://doi.org/10.5281/zenodo.23703403
Primary Topic
Design Education and Practice
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Do LLMs Brainstorm Better with Knowledge Graphs?

Jose Oriol Lopez Berengueres, Ildefons Magrans, Muitakan Almubdi
2 links
Zenodo (CERN European Organization for Nuclear Research)
Design Education and Practice
article

Do LLMs Brainstorm Better with Knowledge Graphs?

Jose Oriol Lopez Berengueres, Ildefons Magrans, Muitakan Almubdi
article en

Abstract

In AI-assisted product ideation, a knowledge graph is an attractive way to represent the solution space for LLM-powered combinatorial search, yet few studies ask how the form of the graph given to the model affects what it produces, and at what cost. We test this on a microwave oven described as a graph (123 nodes, 246 edges) linking user needs to functions, parts and technologies. For each of 13 needs, Claude Haiku got the whole graph, the slice relevant to that need, a random slice of the same size, or no graph, at four effort levels; Claude Sonnet scored the 2,892 ideas blind, and we counted top ideas (roughly the best 12%) per 100k tokens. A follow-up asked Haiku, Opus and Fable for 50 ideas per call on one need at medium effort (6,091 ideas). The full graph never paid off. It yielded about 3 top ideas per 100k tokens at every effort, against 8.8 for the slice at medium effort; at high effort, the only one at which all four conditions ran, the slice yielded 5.9 and no graph 6.4. In the follow-up, on a need chosen to match this ordering, the full graph was the least efficient for every model, clearly so for Haiku and Fable; for the stronger models it added cost without lowering the share of good ideas. The slice was the best way to give the graph but no better than no graph. The planned comparison of whole idea sets favoured the full graph (partly reflecting length); the yield measure was defined after seeing the results and is exploratory. Stronger models found 2 to 2.5 times as many top ideas per token, yet Haiku found 10 to 40 times more per dollar, an advantage that reverses when people, not an automated judge, screen the ideas. Thinking longer raised quality, not efficiency. An informal reading of all first-study ideas by one author, without a p

Zenodo (CERN European Organization for Nuclear Research)
KTH Royal Institute of Technology (SE)
Openalex Percentile: Top 23%
Design Education and Practice
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Do LLMs Brainstorm Better with Knowledge Graphs? — Jose Oriol Lopez Berengueres, Ildefons Magrans, et al. · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS