DeepSeek vs. ChatGPT vs. Claude: A comparative study for scientific computing and scientific machine learning tasks

• Recently developed LLMs (DeepSeek, ChatGPT, and Claude) and reasoning-optimized models are compared in solving scientific computing and machine learning problems. • Challenging problems in numerical methods, physics-informed machine learning, and operator learning are designed and tested. • Reasoning and hybrid-reasoning models perform better than non-reasoning models. • LLMs still face challenges in solving scientific problems correctly without human intervention. Large language models (LLMs) have emerged as powerful tools for addressing a wide range of problems, including those in scientific computing, particularly in solving partial differential equations (PDEs). However, different models exhibit distinct strengths and preferences, resulting in varying levels of performance. In this paper, we compare the capabilities of the most advanced LLMs—DeepSeek, ChatGPT, and Claude—along with their reasoning-optimized versions in addressing computational challenges. Specifically, we evaluate their proficiency in solving traditional numerical problems in scientific computing as well as leveraging scientific machine learning techniques for PDE-based problems. We designed all our experiments so that a nontrivial decision is required, e.g, defining the proper space of input functions for neural operator learning. Our findings show that reasoning and hybrid-reasoning models consistently and significantly outperform non-reasoning ones in solving challenging problems, with ChatGPT o3-mini-high generally offering the fastest reasoning speed.

Authors

Institutions

Publication Details

Journal
Theoretical and Applied Mechanics Letters
Published
2025-03-20
DOI
https://doi.org/10.1016/j.taml.2025.100583
Citations
36
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
47.65
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DeepSeek vs. ChatGPT vs. Claude: A comparative study for scientific computing and scientific machine learning tasks

George Em Karniadakis, Zhiwei Gao, Qiming Jiang
36 citations
Theoretical and Applied Mechanics Letters
Model Reduction and Neural Networks
47.65
article

DeepSeek vs. ChatGPT vs. Claude: A comparative study for scientific computing and scientific machine learning tasks

George Em Karniadakis, Zhiwei Gao, Qiming Jiang
article en
36 citations

Abstract

• Recently developed LLMs (DeepSeek, ChatGPT, and Claude) and reasoning-optimized models are compared in solving scientific computing and machine learning problems. • Challenging problems in numerical methods, physics-informed machine learning, and operator learning are designed and tested. • Reasoning and hybrid-reasoning models perform better than non-reasoning models. • LLMs still face challenges in solving scientific problems correctly without human intervention. Large language models (LLMs) have emerged as powerful tools for addressing a wide range of problems, including those in scientific computing, particularly in solving partial differential equations (PDEs). However, different models exhibit distinct strengths and preferences, resulting in varying levels of performance. In this paper, we compare the capabilities of the most advanced LLMs—DeepSeek, ChatGPT, and Claude—along with their reasoning-optimized versions in addressing computational challenges. Specifically, we evaluate their proficiency in solving traditional numerical problems in scientific computing as well as leveraging scientific machine learning techniques for PDE-based problems. We designed all our experiments so that a nontrivial decision is required, e.g, defining the proper space of input functions for neural operator learning. Our findings show that reasoning and hybrid-reasoning models consistently and significantly outperform non-reasoning ones in solving challenging problems, with ChatGPT o3-mini-high generally offering the fastest reasoning speed.

Theoretical and Applied Mechanics LettersVol. 15(3)
Brown University (US)
Openalex Percentile: Top 0%
Model Reduction and Neural Networks
47.65
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.