ChatGMP: A case of AI chatbots in chemical engineering education towards the automation of repetitive tasks

Artificial Intelligence (AI) is rapidly and consistently becoming more integrated in various aspects of our lives. One of the areas where these systems are increasingly used is education. In fact, it is both being incorporated into specific curricula, allowing students the possibility to acquire skills within this field, and more recently AI has been used as a tool to facilitate the teaching and learning process. However, an increased demand and availability of these tools do not imply a successful switch from traditional to AI-supported learning.In this work, ChatGMP, a chatbot leveraging a Large Language Model (LLM) able to conduct an interview exercise in a Master's Degree course taught at the Technical University of Denmark (DTU), is introduced. The exercise consists in a student interview of a fictitious company, represented by the teachers or ChatGMP, regarding its Good Manufacturing Practices (GMP). The aim is for the students to ask sensible and well-reasoned questions to acquire the necessary documentation to make an exhaustive report indicating whether the company is a potential fit for business. To evaluate the initiative, we compare the performance of ChatGMP to the one of the physical teachers of the course, as well as the perception of the students towards it. The results show no significant difference in the information provided by the teachers and the model, enabling the students to achieve similar learning. The students that interacted with ChatGMP are satisfied with the initiative and would likely recommend future students to perform the audit with the digital tool. This initial experiment and its positive results lay the foundation for opening the discussion on how to use LLMs in education, the opportunities they could provide, as well as their limitations and drawbacks.

Authors

Institutions

Publication Details

Journal
Computers and Education Artificial Intelligence
Published
2024-12-30
DOI
https://doi.org/10.1016/j.caeai.2024.100354
Citations
13
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
5.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ChatGMP: A case of AI chatbots in chemical engineering education towards the automation of repetitive tasks

Julian Kager, Krist V. Gernaey, Ulrich Krühne, Carina L. Gargalo et al.
13 citations
Computers and Education Artificial Intelligence
Online Learning and Analytics
5.35
article

ChatGMP: A case of AI chatbots in chemical engineering education towards the automation of repetitive tasks

Julian Kager, Krist V. Gernaey, Ulrich Krühne, Carina L. Gargalo, Fiammetta Caccavale, Steen Larsen
article en
13 citations

Abstract

Artificial Intelligence (AI) is rapidly and consistently becoming more integrated in various aspects of our lives. One of the areas where these systems are increasingly used is education. In fact, it is both being incorporated into specific curricula, allowing students the possibility to acquire skills within this field, and more recently AI has been used as a tool to facilitate the teaching and learning process. However, an increased demand and availability of these tools do not imply a successful switch from traditional to AI-supported learning.In this work, ChatGMP, a chatbot leveraging a Large Language Model (LLM) able to conduct an interview exercise in a Master's Degree course taught at the Technical University of Denmark (DTU), is introduced. The exercise consists in a student interview of a fictitious company, represented by the teachers or ChatGMP, regarding its Good Manufacturing Practices (GMP). The aim is for the students to ask sensible and well-reasoned questions to acquire the necessary documentation to make an exhaustive report indicating whether the company is a potential fit for business. To evaluate the initiative, we compare the performance of ChatGMP to the one of the physical teachers of the course, as well as the perception of the students towards it. The results show no significant difference in the information provided by the teachers and the model, enabling the students to achieve similar learning. The students that interacted with ChatGMP are satisfied with the initiative and would likely recommend future students to perform the audit with the digital tool. This initial experiment and its positive results lay the foundation for opening the discussion on how to use LLMs in education, the opportunities they could provide, as well as their limitations and drawbacks.

Computers and Education Artificial IntelligenceVol. 8
Technical University of Denmark (DK)
Novo Nordisk Fonden
Openalex Percentile: Top 4%
Online Learning and Analytics
5.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.