A new methodology gives nonprofits a better way to measure the long-term impact of their programs.
Nonprofits have long struggled to accurately measure the long-term results of their efforts. Yet a deep understanding of long-term impact is becoming increasingly important for donors, government agencies, and social-sector organizations.
Recently, SOS Children’s Villages—a leading international NGO focused on children who are at risk of losing, or who have already lost, parental care—partnered with BCG to develop a highly effective approach for assessing impact. The new approach comprehensively measures the long-term effects of the efforts by SOS Children’s Villages, and it provides valuable insight into how the organization can improve. Much of this methodology is applicable to other organizations in the social sector.
The new assessment methodology evaluates two elements of the impact achieved by SOS Children’s Villages: the nonfinancial (or all-around) impact on individual program participants and the community, and the financial impact on society, or social return on investment (SROI).
To determine the long-term impact of programs on individual participants, the approach gleans information from external researchers' interviews with former participants of those programs. It supplements this information with qualitative research conducted through focus group discussions with former child participants and their caregivers.
The outcomes of the participants are then assessed along eight dimensions:
The impact-assessment methodology used by SOS Children’s Villages has given the organization a powerful lens through which to view and understand the long-term effects of its programs. Although the methodology features some elements specifically tailored to SOS Children’s Villages, its core principles are broadly applicable to other organizations across the social sector.
Each program's long-term financial impact on society is gauged by SROI, a comparison of the program's total costs with its total benefits to society. SROI is calculated using directly quantifiable elements:
The SROI calculation is supplemented by a number of sensitivity tests to ensure that the picture that emerges is realistic.