This work-in-progress paper describes the expanded implementation of an ongoing research and development project implementing an Artificial Intelligence (AI) agent in a mechanical engineering experimentation course. These interactive agents are becoming increasingly integrated into educational environments to enhance learning outcomes and aid instructors in assisting students. This study examines the implementation of a custom AI conversational agent developed to support undergraduate engineering students learning through experimental coursework while alleviating teaching assistant workload. The conversational agent provides course-specific explanations, troubleshooting assistance, and methodological guidance.
The conversational agent is strategically embedded within structured assignments to promote divergent thinking, characterized by exploration of multiple solution pathways and deep conceptual understanding. Chat log analysis and student feedback are used to assess the conversational agent's effectiveness in fostering divergent thinking and to identify areas for refinement in both the human-computer interaction and assignment design. Student adoption rates have indicated aspects of successful implementation during the 2024-2025 academic year
During Fall 2025, we are scaling implementation to additional lab sections while introducing two design revisions: (1) transitioning from broad, course-wide access to case-specific use cases, and (2) shifting from open-ended questions to Socratic dialogue. Socratic dialogue is integrated to progressively reveal case study clues and use rhetorical prompting to guide the student to connect system symptoms to error roots. This redesign allowed students to learn about problems in real time as they interact with the conversational agent.
The paper will contribute a transferable design pattern for course-grounded LLM assistants, i.e., retrieval-first with Socratic scaffolds, guardrails, and user analytics, early usage and learning indicators from a multi-section rollout, and an evaluation blueprint that other instructors can adopt when deploying AI support in laboratory settings. This ongoing work contributes to understanding how structured AI integration in engineering education can support higher-order thinking skills while maintaining pedagogical objectives.
http://orcid.org/https://0000-0001-7905-421X
Worcester Polytechnic Institute
[biography]
The full paper will be available to logged in and registered conference attendees once the conference starts on June 21, 2026, and to all visitors after the conference ends on June 24, 2026