Enhancing Tool Learning in Large Language Models with Hierarchical Error Checklists

Large language models (LLMs) have significantly advanced natural language processing, particularly through the integration of external tools and APIs.However, their effectiveness is frequently hampered by parameter misfilling during tool (function) calling.In this paper, we propose the Hierarchical Tool Error Checklist (HiTEC) framework to systematically diagnose and mitigate tool-calling errors without relying on extensive real-world interactions.HiTEC introduces a two-tiered approach: a global error checklist that identifies common, cross-tool issues, and a local error checklist that targets tool-specific and contextual failures.Building on this structure, we propose two deployments: HiTEC-In Context Learning (HiTEC-ICL) and HiTEC-Kahneman-Tversky Optimization (HiTEC-KTO).HiTEC-ICL embeds the global checklist in the initial prompts and leverages a two-round conversational interaction to dynamically refine parameter handling, while HiTEC-KTO generates high-quality negative examples to drive fine-tuning via preference-based optimization.Extensive experiments conducted on five public datasets show that our framework improves parameter-filling accuracy by up to 42% compared to baseline methods. Incorrect CallingExamples

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.841
Citations
1
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Tool Learning in Large Language Models with Hierarchical Error Checklists

Xiaofang Zhou, Shuchang Tao, Liuyi Yao, Yaliang Li et al.
1 citations
Natural Language Processing Techniques
2.48
article

Enhancing Tool Learning in Large Language Models with Hierarchical Error Checklists

Xiaofang Zhou, Shuchang Tao, Liuyi Yao, Yaliang Li, Yue Cui, Weijie Shi, Bolin Ding
article en
1 citations

Abstract

Large language models (LLMs) have significantly advanced natural language processing, particularly through the integration of external tools and APIs.However, their effectiveness is frequently hampered by parameter misfilling during tool (function) calling.In this paper, we propose the Hierarchical Tool Error Checklist (HiTEC) framework to systematically diagnose and mitigate tool-calling errors without relying on extensive real-world interactions.HiTEC introduces a two-tiered approach: a global error checklist that identifies common, cross-tool issues, and a local error checklist that targets tool-specific and contextual failures.Building on this structure, we propose two deployments: HiTEC-In Context Learning (HiTEC-ICL) and HiTEC-Kahneman-Tversky Optimization (HiTEC-KTO).HiTEC-ICL embeds the global checklist in the initial prompts and leverages a two-round conversational interaction to dynamically refine parameter handling, while HiTEC-KTO generates high-quality negative examples to drive fine-tuning via preference-based optimization.Extensive experiments conducted on five public datasets show that our framework improves parameter-filling accuracy by up to 42% compared to baseline methods. Incorrect CallingExamples

Quality Education
Openalex Percentile: Top 9%
Natural Language Processing Techniques
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.