Integrating AI and Human Feedback to Optimize Interdisciplinary Proposal Writing in Science Graduate Students

Although the research on AI-assisted learning rapidly accelerates, there is still a notable gap in investigation into AI-generated content (AIGC) tool use in interdisciplinary academic writing. The present study addresses this gap by investigating the preference of AIGC use by science master’s students in writing interdisciplinary research proposals, and relationship between the use of AIGC tools and their writing abilities was assessed. Through a mixed-methods approach, we collected two iterations of research proposals from 33 students across diverse disciplines, along with their reflections on ChatGPT use. Faculty from both substantiation-track and teaching-track backgrounds were invited to evaluate the proposals and provide individual feedback. Quantitative topic modeling was used to identify theme patterns and areas where AI feedback contributed to improvements.The results showed a strong correlation between AIGC tool usage and higher writing scores, with students reporting that AI significantly enhanced the clarity, coherence, and technical accuracy of their proposals. However, findings also underscore that AI tools are less capable of handling deeper reasoning of niche and the methodological development required for writing in interdisciplinary contexts. Therefore, a balanced approach is necessary, where AI assists in technical aspects and human guidance focuses on advanced reasoning and structuring ideas.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1109/icet62460.2024.10868044
Citations
1
Primary Topic
Engineering Education and Technology
Type
article
Field-Weighted Citation Impact
0.78

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating AI and Human Feedback to Optimize Interdisciplinary Proposal Writing in Science Graduate Students

Lan Luo, Liu Jun, Qingqing Xing
1 citations
Engineering Education and Technology
0.78
article

Integrating AI and Human Feedback to Optimize Interdisciplinary Proposal Writing in Science Graduate Students

Lan Luo, Liu Jun, Qingqing Xing
article en
1 citations

Abstract

Although the research on AI-assisted learning rapidly accelerates, there is still a notable gap in investigation into AI-generated content (AIGC) tool use in interdisciplinary academic writing. The present study addresses this gap by investigating the preference of AIGC use by science master’s students in writing interdisciplinary research proposals, and relationship between the use of AIGC tools and their writing abilities was assessed. Through a mixed-methods approach, we collected two iterations of research proposals from 33 students across diverse disciplines, along with their reflections on ChatGPT use. Faculty from both substantiation-track and teaching-track backgrounds were invited to evaluate the proposals and provide individual feedback. Quantitative topic modeling was used to identify theme patterns and areas where AI feedback contributed to improvements.The results showed a strong correlation between AIGC tool usage and higher writing scores, with students reporting that AI significantly enhanced the clarity, coherence, and technical accuracy of their proposals. However, findings also underscore that AI tools are less capable of handling deeper reasoning of niche and the methodological development required for writing in interdisciplinary contexts. Therefore, a balanced approach is necessary, where AI assists in technical aspects and human guidance focuses on advanced reasoning and structuring ideas.

Hong Kong University of Science and Technology (HK), University of Hong Kong (HK)
Hong Kong University of Science and Technology
Quality Education
Openalex Percentile: Top 17%
Engineering Education and Technology
0.78
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.