Out-of-the-box LLMs are not ready for conservation decision making

Our paper on how the careful design of LLMs is crucial for expert-level evidence retrieval has been published today in PLOS One and is available fully open access! In a nutshell, we tested 10 LLMs with six different retrieval strategies on their ability to answer questions related to conservation, benchmarked against the Conservation Evidence database that has been hand-assembled by experts over the last two decades.

Authors

Publication Details

Journal
Front Matter
Published
2025-05-16
DOI
https://doi.org/10.59350/azg4y-hg145
Primary Topic
Conservation Techniques and Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Out-of-the-box LLMs are not ready for conservation decision making

Anil Madhavapeddy
Front Matter
Conservation Techniques and Studies
article

Out-of-the-box LLMs are not ready for conservation decision making

Anil Madhavapeddy
article en

Abstract

Our paper on how the careful design of LLMs is crucial for expert-level evidence retrieval has been published today in PLOS One and is available fully open access! In a nutshell, we tested 10 LLMs with six different retrieval strategies on their ability to answer questions related to conservation, benchmarked against the Conservation Evidence database that has been hand-assembled by experts over the last two decades.

Front Matter
Openalex Percentile: Top 65%
Conservation Techniques and Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Out-of-the-box LLMs are not ready for conservation decision making — Anil Madhavapeddy · Front Matter (2025) | TGRS Research Map | TGRS