A mechanics diagnostic exam has been administered to junior and senior civil engineering students at the U.S. Military Academy at West Point since 2018, to test the fundamental mechanics concepts critical to upper-level civil engineering courses. A previous study revealed a student’s ability to correctly identify and classify engineering problems as crucial to success on mechanics problems. If a student did not properly classify the mechanics problem asked on the diagnostic exam, the student would tend to make major conceptual errors. However, for students who correctly classified the mechanics problem, it was difficult to determine if incorrect solutions were attributable to math errors or conceptual misunderstandings. For this study, students were asked to solve a truss analysis problem similar to the one on the mechanics diagnostic exam, while an instructor observed the students’ problem-solving process at a chalkboard. After completion of the problem, each student participated in an interactive reflection session. Using a consistent assessment format, instructors were able to identify student hesitations and conflicts while solving the problem and determine whether they were a result of conceptual or non-conceptual errors. Following the assessment, the researchers asked each study participant questions to prompt reflection on why certain errors were made. This paper summarizes the assessment and reflection procedure used, a small sample of students’ performance on a traditional paper-based assessment compared to the interview assessment, and the reasons for errors. Recommendations for future research and improving course delivery to prevent misconceptions are provided.
Are you a researcher? Would you like to cite this paper? Visit the ASEE document repository at peer.asee.org for more tools and easy citations.