2024 ASEE Annual Conference & Exposition

The Impact of Extended Reality-based Digital Approaches to Support STEM Learning for Autistic Students

Presented at Computing and Information Technology Division (CIT) Technical Session 5

This paper discusses the design of 3D Virtual Learning Environments (VLEs) to help autistic school students learn Science and Engineering concepts. The design and development of these VLEs involved an interdisciplinary team of Educators from engineering, computer science, psychology and education.  The design of these immersive learning environments was based on human centered computing principles (HCC). HCC attributes such as affordance, visual density and cognitive load were taken into consideration during the design process. The VLEs were created for middle and high school students to introduce them to specific science and engineering topics including density, robotics, assembly and manufacturing. The design of these alignments was a complex process and was based on the creation of a information centric process model which provided a structured Foundation to design and build these 3D learning environments. Such information models were created using the engineering Enterprise Modeling Language (eEML). The learning environments were created using various interfaces and immersion levels; these included haptic based interfaces, fully immersive 3D Virtual Reality (VR) environments and Mixed Reality (MR) based environments. These VLEs introduced students to density and robotics using engineering examples; assembly sequence and path-planning concepts introduced using the context of NASA's moon mission. Assessment activities also compared effectiveness of virtual reality versus mixed reality-based learning environments.  Another key aspect of the learning approaches involved introducing positive reinforcers whose impact on student learning was assessed. Other Assessment activities focused on cutting the impact of different kinds of learning levels of immersion on student engagement as well. The results of the assessment activities demonstrated the positive impact of such 3D based learning approaches on student learning and engagement. 

Authors

Dr. J Cecil Oklahoma State University [biography]

Dr. J Cecil directs the Center for Cyber-Physical Systems in the department of computer science at Oklahoma State University.

His research interest deal with modeling simulation and exchange of information which has led to the creation of interdisciplinary approaches and frameworks including the creation of cyber-physical approaches to support distributed Manufacturing to the design of human centered Computing approaches involving extended reality technologies to support immersive training and learning in medicine, advanced Manufacturing engineering and space systems.

He is a pioneer in the creation of virtual and mixed reality based cyber learning approaches to support STEM and Engineering learning at both K-12 and University levels. He directs the long-running Soaring Eagle program which targets underrepresented and minority students and encourages them towards STEM programs and careers. For his work in mentoring under-represented students, he was awarded the presidential PAESMEM award by the White House. He has published more than 150 refereed conference and journal papers. Apart from his research in cyber-learning involving 3D VR/MR environments, he is also active in the design of HCI based frameworks and environments to support distributed engineering collaboration in advanced manufacturing, robots, rehabilitation engineering, healthcare and space systems.
Avinash Gupta University of Illinois at Urbana-Champaign [biography]

Dr. Avinash Gupta is a Specialized Teaching Assistant Professor in the Department of Industrial and Enterprise Systems Engineering at the University of Illinois Urbana-Champaign. He is also a faculty affiliate in the Jump Simulation Center, CI-MED. He teaches software and hardware engineering courses in the Masters in Health Technology program. He completed his Ph.D. in Computer Science under the supervision of Professor J. Cecil from Oklahoma State University in the Fall of 2021. He has a Master’s Degree in Product Design and Manufacturing and Bachelor’s Degree in Industrial Engineering. His research focuses on the creation of human extended reality interaction (HXRI)-based environments in healthcare. He serves as a Co-Principal Investigator in a multi-university NIH grant for the Center for Research and Education on Aging and Technology Enhancement (CREATE). The grant involving Weill Cornell Medicine, Florida State University, and UIUC focuses on understanding how virtual reality technology can be used to foster cognitive and social engagement among aging adults. Dr. Gupta is also working as a Principal Investigator on two internal grants funded by Jump Arches – Illinois in which he is investigating the role of Virtual Reality and Artificial Intelligence in nurse education and the role of Mixed Reality in neonatal training. He has published his work focusing on Human Extended Reality Interaction (HXRI) in leading journals such as IEEE Systems and IJCARS. He has also showcased his research at prominent conferences such as IEEE SeGAH, IEEE VR, and IEEE SMC, among other

Download paper (2.21 MB)

Are you a researcher? Would you like to cite this paper? Visit the ASEE document repository at peer.asee.org for more tools and easy citations.

» Download paper

« View session

For those interested in:

Pre-College