Community Program Evaluations
Baltimore Integration Partnership
Evaluation Dates: 2015 – 2017
The Baltimore Integration Partnership (BIP) is a collaborative partnership of anchor institutions, funders, nonprofits and public organizations focused on establishing economic inclusion as the business culture of norm in the Baltimore region. The goals of the BIP are to 1) connect local, small and minority-owned businesses to anchor procurement opportunities in Baltimore and the region, 2) encourage and leverage anchor real estate investment for the intentional benefit of the broader community and small businesses, and 3) insure equitable opportunities and connect low income residents to jobs within anchors and anchor-supporting businesses. www.baltimorepartnership.org
Funded by the Annie E. Casey Foundation, the Center on Network Science and The Evaluation Center have worked collaboratively to conduct an organizational network analysis of the BIP. The two-year project identified how economic inclusion (EI) for local and minority businesses and low-income residents is enhanced by the BIP network, where gaps exist in the work, and areas where the BIP can strengthen the work.
The evaluation design included three phases:
• Phase 1. Anchor Activities & Feedback
• Phase 2. Community Perspective on Needs and Feedback
• Phase 3. Connectivity of the System (including anchors, Community, BIP)
Data collection for phases 1 and 2, included 110 interviews with anchor members, vendors, small business agencies, workforce development agencies and residents seeking employment. Phase 3 included a Social Network Analysis using the PARTNER (Program to Analyze, Record, and Track Networks to Enhance Relationships – www.partnertool.net) tool to identify relationships among the organizations that are members of the BIP and develop recommendations based on the findings.
In June 2017, all interviewees were invited to attend a forum at the Eubie Blake Cultural Center in Baltimore where we presented findings from phases 1 and 2. The intent was to foster dialogue among Baltimore community members, highlighting the need for community driven approaches.
Denver Supportive Housing Social Impact Bond Initiative
Evaluation Dates: 2015 – 2019
The City of Denver, like many other communities around the country, faces limited resources to invest in existing preventive programs for the chronically homeless and individuals who struggle from mental health and substance abuse challenges. Denver has developed a Social Impact Bond initiative to ensure the City is paying for the most effective services, “Paying for Success,” and shifting its spending from short-term band-aids to long-term, sustainable solutions.
The supportive housing initiative targets chronically homeless individuals who also struggle with mental health and substance abuse challenges. Through local and national partner organizations, the initiative will serve at least 250 chronically homeless individuals over the next five years using Social Impact Bond financing in combination with existing housing and Medicaid resources.
The Evaluation Center is conducting the process study for the five-year independent evaluation of the SIB, headed by the Urban Institute. Key process-related information, including the housing and referral pipeline, will inform implementation and midcourse corrections needed to keep the initiative on track to achieve long-term outcomes. The process information will also help interpret the results of the impact evaluation based on documentation of the program model and participant engagement.
For more information about the SIB, a summary and fact sheet can be found here:
- Factsheet – http://www.csh.org/wp-content/uploads/2011/12/Denver-SIB-FactSheet.pdf
- Summary – https://www.denvergov.org/content/dam/denvergov/Portals/344/documents/Denver_SIB_Summary.pdf
The KIDS COUNT Grantee Network
Evaluation Dates: 2016-2018
KIDS COUNT, a project funded by the Annie E. Casey Foundation (AECF), is the leading source for credible, nonpartisan data on child and family well-being in the United States. The Annie E. Casey Foundation launched the KIDS COUNT initiative in 1990 to bring national attention to the issues facing children and families regarding economic well-being, education, health, and family and community.
The KIDS COUNT Grantee Network (KCGN) is a network of state-based child advocacy, nonprofit, and research organizations with leadership from the Annie E. Casey Foundation. In total, there are grantees in each of the 50 states, as well as, Puerto Rico, the U.S. Virgin Islands, and the District of Columbia.
Beginning in 2016, AECF partnered with the University of Colorado’s Center on Network Science, working collaboratively with the Evaluation Center, to conduct an organizational network evaluation of the KIDS COUNT Grantee Network to assess: (1) how, when and why grantees access/ leverage resources; (2) how grantees connect throughout the network; and (3) the opportunities and challenges of being part of the KIDS COUNT network.
Social Network Analysis was used to examine the relationships within the KCGN, the utilization of resources in the network, and the impact that a network model has on affecting positive policy changes that will improve child and family well-being.
Strategic Performance Framework – Partnerships for Success
Evaluation Dates: 2014 – 2019
The Evaluation Center is currently working with the Colorado Department of Human Services Office of Behavioral Health to evaluate the Substance Abuse and Mental Health Services Administration (SAMHSA) Strategic Prevention Framework – Partnerships for Success (SPF-PFS) grant. The primary goal of the grant is to reduce the use of marijuana and alcohol among youth ages 12 – 20 and reduce the misuse and abuse of prescription drugs among youth ages 12 – 25.
The federal grant provides funding to support six Colorado counties in their efforts to implement primary prevention strategies. The grant also supports state level initiatives such as the forming of a state epidemiology outcomes workgroup.
The Evaluation Center supports the SPF-PFS program by facilitating the cross-site evaluation for all Colorado sub-grantees, providing evaluation expertise to the state level initiatives, and providing training and technical assistance to sub-grantees around the use of data and evaluation methodologies.
Community Coalition Study for Strategic Performance Framework – Partnerships for Success
Evaluation Dates: 2014 – 2019
In addition to the cross-site evaluation of the SPF – PFS grant, The Evaluation Center is currently conducting a study of the six community health coalitions that implement the primary prevention strategies. The purpose of the study is to increase understanding of the factors and processes that contribute to the successful development, functioning, and sustainability of these coalitions and ways in which any barriers were overcome. Results of the study will be shared with local communities for use in ongoing improvement of the coalitions’ effectiveness and with the larger field of community substance abuse prevention.
State Tobacco Education and Prevention Partnership
Evaluation Dates: 2015 – 2018
The Evaluation Center has partnered with the Colorado School of Public Health Community Epidemiology & Program Evaluation Group (CEPEG) to evaluate the Colorado Department of Public Health & Environment State Tobacco Education and Prevention Partnership (STEPP). The Evaluation Center and CEPEG will collaborate with STEPP staff and grantees in designing and implementing evaluation of tobacco control program activities conducted with Amendment 35 grant funding during FY2016-2018. STEPP grantees are employing a variety of evidence-based interventions designed to prevent and reduce tobacco use among Colorado residents.
The Evaluation Center will provide technical assistance and training to STEPP grantees to support the development and implementation of the grantees’ local evaluation plans in addition to conducting two micro evaluations, one focused on hospital/clinic health systems change and the second focused on community level programs, policies and systems changes that prevent youth tobacco use and promote cessation.
For more information on STEPP, please see the Colorado Department of Public Health & Environment website: www.colorado.gov/pacific/cdphe/A35-tobacco
For more information on our partner, CEPEG, visit their website: www.ucdenver.edu/academics/colleges/PublicHealth/community/CEPEG/Pages/CEPEG.aspx
Previous Evaluation Projects