Overview

Background

A total of 47 mentoring programs were added to the Model Programs Guide by the NMRC between January 2014 and January 2022. Programs were rated Effective (n = 3; 6%), Promising (n = 27; 57%) or No Effects (n = 17; 37%). Upon completion of each program’s review, an informational profile was added to CrimeSolutions.gov and program insights were added to the NMRC website. Drawing on those documents, as well as program reviewers’ scoring instruments, this report provides an overview of the programs added and their evaluations as well as key themes from program insights.

Findings

Program and Evaluation Characteristics.  Roughly half of the programs reviewed received the highest score from at least one reviewer in the degree to which their conceptual framework (59%) was supported by research, and the strength of their program theory (46%). About a third of programs (36%) included non-mentoring components, such as a curriculum delivered by non-mentor adults or mental health services.

Programs mostly took place in the U.S (n = 42; 87%), in urban and/or suburban areas (n = 31, 82%). About half took place in schools (n = 25, 53%) and the other half took place in other community settings (n = 22, 46%). About half of the programs used a one-to-one model of mentoring (n = 24, 51%), while others used either an exclusively group format (n = 8, 17%) or combined group/one-to-one format (n = 10; 21%). While most programs used adult mentors, 17% (n = 8) used peer mentors. Programs typically were delivered to both male and female youth, other than 3 programs that were girl-specific, and served diverse racial groups.

Studies constituting the evidence base for the mentoring programs reviewed were published between 2002 and 2021, and only 5 (11%) programs were evaluated across multiple studies. While 72% of programs (n = 34) had a randomized controlled trial in their evidence base, only about half of the programs (n = 24) had a study that was considered a high quality RCT (i.e., Randomized Controlled Trial) as defined by CrimeSolutions.

Program details (e.g., activities involved) were described thoroughly as judged by reviewers. There was some inconsistency, however, in the degree to which the data and information required to assess whether programs were implemented in alignment with their descriptions were collected as part of evaluations. When such information was available, most programs (74%, n = 29) were rated as having satisfactory adherence, meaning the core components or services were for the most part delivered as intended.

The majority of evaluations (n = 29; 62%) targeted at least one academic- or career-related outcome (e.g., failure or dropout risk), about half targeted a SEL- or mental health-related outcome (n = 25; 53%), and less than half (40%; n = 19%) had at least one justice-related outcome (e.g., arrests/offending).

Significance testing was used to see if programs rated Effective or Promising differed from those rated No Effects on selected program study characteristics. The most noteworthy finding is that programs rated Effective or Promising were less likely to have been evaluated in a high-quality RCT. Other characteristics, including conceptual framework, program theory, program components other than mentoring, program setting, mentoring format (i.e., one-to-one versus group and combined group/one-to-one), mentor age, mentee age, mentee gender, mentee race, number of studies per program, and type of outcomes evaluated (i.e., academic, mental health/SEL, justice related) were not associated with evidence ratings.

Thematic Analysis of Program Insights. Five broad themes were identified across the “Program Insights for Practitioners” documents:

1. Ensuring Alignment Across Program Goals, Design, Implementation, and Evaluation
2. Connections Between Mentoring Intervention and Mentees’ Home, Parents, and Larger Environment
3. Engaging Others (i.e., peers, teachers, etc.) as a Web of Mentoring Support
4. Tailoring Mentor Recruitment, Selection, Preparation, and Support to Effectively Serve Youth
5. Optimizing the Role of Mentoring Within the Context of Programs with Multiple Components

Implications for Research and Practice

Findings highlight the importance of periodically analyzing trends and patterns in mentoring programs undergoing evaluation and the findings of such studies. Rather than point to a single template for program effectiveness, findings support the potential effectiveness of a variety of models and approaches. Our analysis also suggests areas in need of increased coverage, such as mentoring for rural youth and male-specific mentoring, a need for increased use of rigorous RCTs, and the importance of developing strong and deliberate program designs that are intentionally linked to program needs, resources, and  desired behavioral outcomes.

To download the full PDF report, click here.