AMGPT: A large language model for contextual querying in additive manufacturing

Generalized large language models (LLMs) such as GPT-4 may not provide specific answers to queries formulated by materials science researchers. These models may produce a high-level outline but lack the capacity to return detailed instructions on manufacturing and material properties of novel alloys. We introduce “AMGPT”, a specialized LLM text generator designed for metal AM queries. The goal of AMGPT is to assist researchers and users in navigating a curated corpus of literature. Instead of training from scratch, we employ a pre-trained Llama2-7B model from Hugging Face in a Retrieval-Augmented Generation (RAG) setup, utilizing it to dynamically incorporate information from ∼ 50 AM papers and textbooks in PDF format. Mathpix is used to convert these PDF documents into TeX format, facilitating their integration into the RAG pipeline managed by LlamaIndex. A query retrieval function has also been added, enabling the system to fetch relevant literature from Elsevier journals based on the context of the query. Expert evaluations of this project highlight that specific embeddings from the RAG setup accelerate response times and maintain coherence in the generated text. • Developed a RAG setup using an LLM for additive manufacturing queries. • LLM-RAG system outperforms GPT-4 with better domain knowledge and specificity. • Evaluated LLM-RAG using parameters like sampling temperature and top_k similarity. • Built a chat interface with Streamlit, enabling chat history and memory for LLM-RAG.

Authors

Institutions

Publication Details

Journal
Additive Manufacturing Letters
Published
2024-08-23
DOI
https://doi.org/10.1016/j.addlet.2024.100232
Citations
22
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
7.64

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AMGPT: A large language model for contextual querying in additive manufacturing

Francis Ogoke, Amir Barati Farimani, Jonathan Chan, Olabode Ajenifujah et al.
22 citations
Additive Manufacturing Letters
Semantic Web and Ontologies
7.64
article

AMGPT: A large language model for contextual querying in additive manufacturing

Francis Ogoke, Amir Barati Farimani, Jonathan Chan, Olabode Ajenifujah, Achuth Chandrasekhar
article en
22 citations

Abstract

Generalized large language models (LLMs) such as GPT-4 may not provide specific answers to queries formulated by materials science researchers. These models may produce a high-level outline but lack the capacity to return detailed instructions on manufacturing and material properties of novel alloys. We introduce “AMGPT”, a specialized LLM text generator designed for metal AM queries. The goal of AMGPT is to assist researchers and users in navigating a curated corpus of literature. Instead of training from scratch, we employ a pre-trained Llama2-7B model from Hugging Face in a Retrieval-Augmented Generation (RAG) setup, utilizing it to dynamically incorporate information from ∼ 50 AM papers and textbooks in PDF format. Mathpix is used to convert these PDF documents into TeX format, facilitating their integration into the RAG pipeline managed by LlamaIndex. A query retrieval function has also been added, enabling the system to fetch relevant literature from Elsevier journals based on the context of the query. Expert evaluations of this project highlight that specific embeddings from the RAG setup accelerate response times and maintain coherence in the generated text. • Developed a RAG setup using an LLM for additive manufacturing queries. • LLM-RAG system outperforms GPT-4 with better domain knowledge and specificity. • Evaluated LLM-RAG using parameters like sampling temperature and top_k similarity. • Built a chat interface with Streamlit, enabling chat history and memory for LLM-RAG.

Additive Manufacturing LettersVol. 11
Carnegie Mellon University (US)
Carnegie Mellon University, Army Research Laboratory
Openalex Percentile: Top 2%
Semantic Web and Ontologies
7.64
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.