Spatial visualization, the ability to mentally rotate and manipulate 2D and 3D objects, is a critical skill for engineering and STEM majors. While the use of digital sketching tools, such as Spatial Vis, can help students develop spatial visualization skills, some students still show limited learning gains. Because these tools record detailed clickstream and performance data, they provide an opportunity to provide targeted support based on each student’s behavior. This paper explores how assignment modifications and semi-automated personalized emails based on the clickstream data can impact student outcomes and motivation in a first-year engineering graphics course.
The following study was conducted with 286 students enrolled in a first-year Structural Engineering graphics course at UCSD. These students were divided into a control group (n = 137) and an intervention group (n = 135). The intervention group received an assignment set with additional questions and semi-personalized email messages encouraging persistence. Both the control and intervention assignment sets were selected so that students spent a similar amount of time completing them based on expected completion rates. Student outcomes were measured using clickstream data from the Spatial Vis software, pre- and post-spatial visualization tests (PSVT:R), and post-survey data on student engagement and motivation.
Results showed greater mean PSVT:R gains in the intervention group (25%) than in the control group (16%), although this difference was not statistically significant. Additionally, survey results showed that personalized emails improved student motivation and engagement. Specifically, 40% of students rated the emails as moderately improving their motivation, while 35% said emails greatly improved it. Finally, assignment difficulty, a metric derived from the number of hints, peeks, and attempts on an assignment, showed that intervention students experienced a decrease in overall assignment difficulty. These results showed that persistence was higher in the intervention group, meaning that students persisted through the assignment without relying as much on hints and peeks. Overall, the study shows that emails based on data from a digital platform and a modified assignment set can increase student motivation and decrease assignment difficulty. Additional research is needed to determine whether the results in this study are statistically significant and whether they are due more to the semi-personalized emails or more to the assignment scaffolding.
The full paper will be available to logged in and registered conference attendees once the conference starts on June 21, 2026, and to all visitors after the conference ends on June 24, 2026