Comparing large language model artificial intelligence tools in aid of electrical engineering

Conversational AI (artificial intelligence) systems have broken into the digital technology sphere at the end of 2022. Many scientists, engineers, and authors have begun using them despite a lack of evidence for their applicability. Research has been conducted in several fields, including electrical engineering, on the applicability of generative AI in many fields, such as chemical engineering, programming, medicine, and even electrical engineering. Most, although not all, of the existing research focuses on applying specific AI models. This case study compares several generative AI models (ChatGPT, Bard, Bing AI, Copilot) through tasks in electrical engineering design. We qualitatively evaluated the AI responses to the questions. We have found that although AI tools are applicable and perform similarly well in general questions, their use is highly questionable in more specific cases, for example, in circuit design. Lastly, AIs perform equally unacceptably in tasks that require specific data, such as literature reviews. We conclude that the bots should be used sparingly with strict supervision and professional knowledge.

Authors

Institutions

Publication Details

Published
2024-10-16
DOI
https://doi.org/10.1109/siitme63973.2024.10814860
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparing large language model artificial intelligence tools in aid of electrical engineering

Attila Géczy, Zoltán Tafferner
1 citations
Topic Modeling
0.35
article

Comparing large language model artificial intelligence tools in aid of electrical engineering

Attila Géczy, Zoltán Tafferner
article en
1 citations

Abstract

Conversational AI (artificial intelligence) systems have broken into the digital technology sphere at the end of 2022. Many scientists, engineers, and authors have begun using them despite a lack of evidence for their applicability. Research has been conducted in several fields, including electrical engineering, on the applicability of generative AI in many fields, such as chemical engineering, programming, medicine, and even electrical engineering. Most, although not all, of the existing research focuses on applying specific AI models. This case study compares several generative AI models (ChatGPT, Bard, Bing AI, Copilot) through tasks in electrical engineering design. We qualitatively evaluated the AI responses to the questions. We have found that although AI tools are applicable and perform similarly well in general questions, their use is highly questionable in more specific cases, for example, in circuit design. Lastly, AIs perform equally unacceptably in tasks that require specific data, such as literature reviews. We conclude that the bots should be used sparingly with strict supervision and professional knowledge.

Budapest University of Technology and Economics (HU)
Openalex Percentile: Top 30%
Topic Modeling
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.