2026 ASEE Annual Conference & Exposition

Evaluating a ChatGPT-Based Hyponatremia Teaching Module for Internal Medicine Residents: A Pilot Study

Presented at Generative AI in BME Courses

Generative artificial intelligence (GenAI) is increasingly used in medical education to enhance engagement and simplify complex topics. Nephrology, often perceived as challenging by trainees, may particularly benefit from such innovations. This pilot study evaluated whether a ChatGPT-based interactive hyponatremia learning module, enhanced with Retrieval-Augmented Generation (RAG) using content from Pocket Nephrology, could support internal medicine resident education. Residents were randomized 2:1 to intervention (module + quiz) or control (quiz only, open-resource). Of 28 participants (19 intervention, 9 control), mean quiz scores were similar (7.47 ±1.90 vs. 7.44 ± 1.94; p = 0.97). However, intervention group confidence increased from 2.67 ±1.23 to 3.50 ± 0.80 on a 5-point scale. Usability ratings were high for clarity and appropriateness. Expert review of 14 transcripts found most outputs accurate, though occasional errors persisted despite RAG. A ChatGPT-based, RAG-enhanced module was feasible, well-received, and improved resident confidence, though it did not significantly increase short-term quiz performance. Integration of GenAI in nephrology education shows promise but requires expert oversight.

Authors
  1. Dr. Christelle El Khoury Lebanese American University [biography]
  2. Dr. Toni Sabbouh MD, FASN University of Pennsylvania [biography]
  3. Dr. Christine Palazzolo DO University of Pennsylvania [biography]
  4. Dr. Sola Aoun Bahous Lebanese American University [biography]
Download paper (364 KB)

Are you a researcher? Would you like to cite this paper? Visit the ASEE document repository at peer.asee.org for more tools and easy citations.