Science, technology, engineering and mathematics (STEM) outreach programs introduce children and youth to STEM topics, often with the long-term goal of bringing more members of under-represented groups (as defined for a particular region) into STEM post-secondary education and careers. For example, there are many outreach programs exclusively open to girls, women and/or other minority genders. A diversity of approaches are employed to assess outreach program effectiveness. Studies range from short-term deductive measures of belonging and identity (Hughes, Nzekwe, & Molyneaux, 2013), to qualitative, inductive case studies (Wang, Schrock, Andrews, & Clark, 2023; Wade-Jaimes, Cohen, & Calandra, 2022), to longitudinal research following students to determine STEM major enrollment (Henríquez Fernández et al, 2021). Furthermore, there are a variety of factors that can be explored or controlled for, such as whether a participant’s parental figure works in STEM (Zhou, 2020), making it challenging to design a study that accounts for such complexity. Evaluation methodologies are important to consider because the research methods, time horizons, and concepts of interest can magnify certain aspects of STEM identity, experience, and outcomes while erasing others. Each methodological approach shapes research findings in unique ways, making it essential that both scholars and outreach programs have a map of methodological strengths, limitations, and suitability for different programs contexts and goals.
This systematic review will map the methodological frameworks utilized to evaluate the effectiveness of STEM outreach programs that target the inclusion of underrepresented youth. Our work builds upon systematic reviews published in other fields, such as healthcare (Jenkins, Nardo, & Salehi, 2022), which have highlighted the challenges that outreach programs encounter when attempting to design for, evaluate, and analyze the aim of supporting under-represented students in pursuing specific fields of study.
Systematic and transparent procedures for the identification and inclusion of research studies will be followed. Initial data for this review were gathered by searching terms related to the intersecting concepts of STEM, outreach, children/youth, underrepresented or marginalized identities, and evaluation. STEM outreach programs targeting STEM representation based on gender, Indigeneity, race, ethnicity, sexuality, (im)migration, socioeconomic status, and the intersections of these social locations will be included in the review (Banka, d’Entremont, & Lyon, 2023).
Through this systematic review, we intend to enable both education researchers and outreach programs to understand the range of evaluation methodologies that exist to meet the shared goal of increasing representation of under-represented groups in STEM.
Are you a researcher? Would you like to cite this paper? Visit the ASEE document repository at peer.asee.org for more tools and easy citations.