From Awareness to Adaptability: Enhancing Tool Utilization for Scientific Reasoning

As large language models (LLMs) are increasingly applied to complex scientific problemsolving, their effectiveness is often limited by unconscious or failed tool usage.To address this issue, we introduce the Tool-Awareness Training (TAT) method, designed to enhance scientific reasoning.This approach leverages both forward and backward data generation strategies to strengthen the model's conscious and selective tool utilization in multi-step reasoning tasks.Our method unfolds in three stages: (1) developing tool-knowledge through backward tooluse data generation (2) enhancing tool-awareness in multi-step reasoning by utilizing forward reasoning data, and (3) improving domain adaptability through largescale domain-specific data for multi-task learning.These three stages progressively establish the foundation for tool learning and scientific reasoning, effectively integrating both, enabling the model to tackle multi-domain scientific tasks while optimizing tool usage.Our experimental results demonstrate that TAT significantly enhances LLM performance in mathematical and scientific reasoning tasks, particularly by improving the model's tool utilization capabilities, including proactivity and execution success rates.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.461
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

From Awareness to Adaptability: Enhancing Tool Utilization for Scientific Reasoning

Jun‐Tao Li, Wanfu Wang, Wenjing Xie, Min Zhang et al.
Intelligent Tutoring Systems and Adaptive Learning
article

From Awareness to Adaptability: Enhancing Tool Utilization for Scientific Reasoning

Jun‐Tao Li, Wanfu Wang, Wenjing Xie, Min Zhang, Xiaobo Liang, Qiaoming Zhu, Kehai Chen
article en

Abstract

As large language models (LLMs) are increasingly applied to complex scientific problemsolving, their effectiveness is often limited by unconscious or failed tool usage.To address this issue, we introduce the Tool-Awareness Training (TAT) method, designed to enhance scientific reasoning.This approach leverages both forward and backward data generation strategies to strengthen the model's conscious and selective tool utilization in multi-step reasoning tasks.Our method unfolds in three stages: (1) developing tool-knowledge through backward tooluse data generation (2) enhancing tool-awareness in multi-step reasoning by utilizing forward reasoning data, and (3) improving domain adaptability through largescale domain-specific data for multi-task learning.These three stages progressively establish the foundation for tool learning and scientific reasoning, effectively integrating both, enabling the model to tackle multi-domain scientific tasks while optimizing tool usage.Our experimental results demonstrate that TAT significantly enhances LLM performance in mathematical and scientific reasoning tasks, particularly by improving the model's tool utilization capabilities, including proactivity and execution success rates.

National Science Foundation, National Natural Science Foundation of China, Government of Jiangsu Province, Natural Science Foundation of Jiangsu Province
Openalex Percentile: Top 90%
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.