UZH_Pandas at SimpleText2024: Multi-Prompt Minimum Bayes Risk with Diverse Prompts

This paper serves as a summary of further experiments of the paper "SimpleText Best of Labs in CLEF-2023: Scien-tific Text Simplification Using Multi-Prompt Minimum Bayes Risk Decoding" [1], adapted to the SimpleText2024 Shared Task 3.1 dataset. We observe how candidate simplifications generated by the off-the-shelf Llama3 perform differently depending on the prompt, and whether Minimum Bayes Risk (MBR) re-ranking is beneficial with underperforming candidates. Finally, on a small sample, we investigate the agreement of simplification candidate re-rankings between MBR and a human annotator.

Publication Details

Journal
Zurich Open Repository and Archive (University of Zurich)
Published
2024-09-12
DOI
https://doi.org/10.5167/uzh-271151
Primary Topic
Cell Adhesion Molecules Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

UZH_Pandas at SimpleText2024: Multi-Prompt Minimum Bayes Risk with Diverse Prompts

Zurich Open Repository and Archive (University of Zurich)
Cell Adhesion Molecules Research
article

UZH_Pandas at SimpleText2024: Multi-Prompt Minimum Bayes Risk with Diverse Prompts

article en

Abstract

This paper serves as a summary of further experiments of the paper "SimpleText Best of Labs in CLEF-2023: Scien-tific Text Simplification Using Multi-Prompt Minimum Bayes Risk Decoding" [1], adapted to the SimpleText2024 Shared Task 3.1 dataset. We observe how candidate simplifications generated by the off-the-shelf Llama3 perform differently depending on the prompt, and whether Minimum Bayes Risk (MBR) re-ranking is beneficial with underperforming candidates. Finally, on a small sample, we investigate the agreement of simplification candidate re-rankings between MBR and a human annotator.

Zurich Open Repository and Archive (University of Zurich)
Openalex Percentile: Top 58%
Cell Adhesion Molecules Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

UZH_Pandas at SimpleText2024: Multi-Prompt Minimum Bayes Risk with Diverse Prompts · Zurich Open Repository and Archive (University of Zurich) (2024) | TGRS Research Map | TGRS