Many introductory computer science and engineering students excessively struggle with course content, leading to reduced self-efficacy, learning outcomes, and retention in the major. Since engineering concepts build upon earlier material, developing a strong foundation with earlier material is key to reducing excessive struggle with later material. Research shows that enabling a student to assess their progress in the learning material is a way to improve study habits, as well as improve self-efficacy. In this study, an online exam system delivered a self-assessment quiz as the last section of each chapter used in the course's online textbook on the zyBooks platform. A student could take the self-assessment quiz anytime and as many times as desired; the student could see their overall score after submitting a quiz attempt. Students received a few course points for attempting each self-assessment quiz. This pilot study is based on an introductory computer science (CS) course offered during Fall 2024 with approximately 124 students total and 17 self-assessment quizzes. Each quiz contained question types common in CS exams: Multiple choice (5-8 per quiz) and parameterized code writing questions (2-3 per quiz) with immediate auto-grading. The code writing questions were randomized per exam attempt, enabling a different challenge for repeat attempts. The goal of the pilot was to measure the impact on students' study habits, self-efficacy, and learning outcomes. Students completed a 25-item survey regarding knowledge of course content and self-efficacy, at the start and end of the course. At the end of each chapter, students were offered the self-assessment quiz, followed by a brief survey on the insights the student gained about their understanding of the material, and impact on study habits and self-efficacy. This paper presents exploratory analyses examining students' self-assessment quiz usage patterns through the course, quantifying students' engagement with the self-assessment quizzes, and gathering insights into whether students found the self-assessment quizzes helpful, enjoyable, and worthy of inclusion in the course.
The full paper will be available to logged in and registered conference attendees once the conference starts on June 22, 2025, and to all visitors after the conference ends on June 25, 2025