Work-In-Progress: Using AI Tools for Supplemental Learning in a Lean Concepts Class

In this innovative practice Work-In-Progress paper, Generative AI tools were used in a supplemental assignment in a Lean Concepts class. Students were directed to create a summary of a specific topic covered only partially in the regular class material. Students assigned to the same topic then formed four- or five-student groups and reflected on the effectiveness of the AI tools. The accuracy, consistency and usefulness of the AI-created material was considered. Students also reflected on their own learning from the exercise and their possible future use of AI tools. The results, from 78 students, showed that seven different generative AI tools, with a wide range of prompts, gave similar answers. The answers were judged to be useful and accurate; only two instances of the AI being widely off-topic were seen. The answers were rather vague and general; even when prompted for different topics, the AI results had much text in common. All student groups agreed that human interpretation would be needed before the AI-generated material could be used either for presentation or work. They felt the exercise would make it more likely that they will use generative AI tools in the future. The exercise demonstrates both the usefulness and limitations of AI tools for supplemental learning in technical classes. The exercise was easy to run and could be replicated in any introductory or survey class.