NL2STL: Transformation from Logic Natural Language to Signal Temporal Logics using Llama2

Signal Temporal Logic (STL) is a formal language used for specifying and reasoning about the temporal properties of signals in a system. It provides a framework for expressing complex temporal behaviors and requirements in a concise and expressive manner. However, the main limitation of the current use of STL languages for describing machine tasks is that the construction of STL languages is still stuck on manual generation. Therefore, in this paper, we build a model for transforming logic natural language to STL formulas with a substantial increase in accuracy and inference speed, compared to the previous translation approach. Firstly, we pre-train a large language model (llama2) for logical ability, then we archive unsupervised learning with randomly generated STL language as a dataset and instruction fine-tuning on NL-STL pairs. Finally, we achieve an excellent result comparing to the work before.

Authors

Institutions

Publication Details

Published
2024-08-08
DOI
https://doi.org/10.1109/cis-ram61939.2024.10672997
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

NL2STL: Transformation from Logic Natural Language to Signal Temporal Logics using Llama2

Zhongyao Chen, Bochen Xu, Tianci Zhang, Xinkai Liang et al.
Semantic Web and Ontologies
article

NL2STL: Transformation from Logic Natural Language to Signal Temporal Logics using Llama2

Zhongyao Chen, Bochen Xu, Tianci Zhang, Xinkai Liang, Xu Cao, Yuchen Mao
article en

Abstract

Signal Temporal Logic (STL) is a formal language used for specifying and reasoning about the temporal properties of signals in a system. It provides a framework for expressing complex temporal behaviors and requirements in a concise and expressive manner. However, the main limitation of the current use of STL languages for describing machine tasks is that the construction of STL languages is still stuck on manual generation. Therefore, in this paper, we build a model for transforming logic natural language to STL formulas with a substantial increase in accuracy and inference speed, compared to the previous translation approach. Firstly, we pre-train a large language model (llama2) for logical ability, then we archive unsupervised learning with randomly generated STL language as a dataset and instruction fine-tuning on NL-STL pairs. Finally, we achieve an excellent result comparing to the work before.

Beijing Institute of Technology (CN)
Openalex Percentile: Top 86%
Semantic Web and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.