Nonprofit evaluation should be purposeful, feasible and sustainable. Here's why - Generocity Philly


Aug. 16, 2017 12:30 pm

Nonprofit evaluation should be purposeful, feasible and sustainable. Here’s why

ImpactED founder Claire Robertson-Kraft shares lessons from the inaugural Social Impact Collaborative.

Social Impact Collaborative members.

(Courtesy photo)

This is a guest post by Claire Robertson-Kraft.
Over the last decade, I’ve worked with dozens of nonprofits in Philadelphia. Through these experiences, I’ve witnessed firsthand the deep passion nonprofit leaders bring to their work. But I’ve also seen how challenging it can be for these leaders to communicate about their impact with the broader community.

Nonprofit leaders may have a good feeling about a training program they’re running or about how stakeholders are benefiting from their services, but often lack the data to support their intuitions. Unfortunately, organizations don’t typically have the necessary capacity and expertise to use data to improve their effectiveness and share their story.

The demand on nonprofits to empirically demonstrate their impact is greater than ever before, as providing evidence is increasingly becoming a prerequisite for receiving funding. But evaluation efforts should be about more than reporting results to foundations; they should be about informing strategic decisions. In the words of the great Yogi Berra, “If you don’t know where you’re going, how are you going to know when you get there?”

So, how do organizations maximize their impact by combining their passion with strategic use of data?

We launched the Social Impact Collaborative to help organizations answer this question. We believe in empowering leaders with the information, skills and tools they need to accelerate social change.

(Courtesy photo)

The Social Impact Collaborative is a year-long program run by ImpactED at the Fels Institute of Government that offers training and support to nonprofit organizations that want to use data to inform their work.

From our Partners

In our pilot year, with support from the William Penn Foundation,* we trained 10 nonprofits selected from over 50 applicants in the region. These nonprofits ranged from community-based organizations like the Norris Square Community Alliance to established cultural institutions like the Barnes Foundation to citywide organizations like the Philadelphia Parks Alliance and the Bicycle Coalition. See a full list of participants here.

While organizations varied considerably, they had quite similar experiences when it came to collecting and using data. Below are a few lessons we learned about building nonprofit evaluation capacity and how we’d advise others looking to engage in similar work.

First, evaluation should be purposeful.

There’s a lot of talk about data collection and analysis methods: What is the best way to get a strong response rate? How do we isolate the impact of a program? While these questions are important, unless — and until — organizations have developed a clearly articulated strategy, the answers won’t mean much.

Too often, organizations are collecting data simply because it’s required for a funder or government entity. While this may be unavoidable, organizations should also track the indicators that matter most to their stakeholders. This requires prioritizing quality over quantity by asking questions, such as: Which indicators say something of central importance about the outcomes you care most about? Which indicators give you the information you need to make strategic decisions?

Here are some tips and tools for identifying indicators.

Second, evaluation should be feasible.

Determining which methods to use can be overwhelming, and sometimes leaders feel like they’re drowning in data trying to make it useful. Organizations should take their planning down to the operational level by considering questions such as: Is quality data available on a timely basis? If not, can you develop ways to collect it that are not burdensome to staff?

No one method is more feasible than others. It depends on the time you have available, the physical, financial, and human resources at your disposal, and what type of access you have to certain types of data and stakeholders. As you begin to collect data, you should track which indicators are most useful for your organization and refine — and focus — your efforts over time.

Here are some tips and tools for planning for data collection.

And finally, evaluation should be sustainable.

Perhaps most importantly, transforming data into knowledge requires building a data-informed culture. Ultimately, the end goal isn’t about being bound by your data but being informed by it. In fact, it’s not actually about the data; it’s about generating knowledge that informs organizational learning. Building this type of culture requires organizational leaders to be unafraid of what the data say and provide a safe space for staff to admit when things don’t go as intended and then the authority to explore why.

Before launching an evaluation effort, organizations should consider the following questions: Who might be internal champions of data and knowledge generation within your organization? What systems and structures do you have that currently support staff learning?

Here are some tips and tools for building a data-informed culture.

(Courtesy photo)

Without question, building evaluation capacity is challenging work, but it can be equally rewarding. Over the last year, we’ve watched the 10 organizations we’ve worked with in the Social Impact Collaborative explore pivotal questions about their mission and future direction, learn new — and in some cases, surprising — information about the stakeholders they work with, and wrestle with how to align data use with their many organizational priorities.

To hear about the progress that the first Social Impact Collaborative cohort has made, come to our final showcase on Thursday, Sept. 28. And for more tips and tools on building evaluation capacity, follow us at @impactedphl.

Register here

*The Social Impact Collaborative is funded by the William Penn Foundation, but the opinions expressed in this guest post are those of the author and do not necessarily reflect the views of the William Penn Foundation.


From our Partners

Nonprofit AF: It’s time to expand our perspectives and conversations in fundraising

TikTok is a unique blend of social media platforms — here’s why kids love it

One of the keys to the Philadelphia Worker Relief Fund’s success was accessibility


Generocity Philly

Inscripción Doble en Congreso: Lo que trae el futuro

Philadelphia PA

Philadelphia Parks and Recreation

Urban Forestry Community Organizer

Apply Now
Philadelphia, PA

University City Science Center

Grants Manager

Apply Now

Today’s state budget blues will bring tomorrow’s nonprofit woes

UPenn faculty calls on board of trustees to reverse their position on PILOTs at meeting tomorrow

At Philly Tech Week, the example of a global nonprofit leveraging tech and human connection to eradicate poverty


Generocity Philly

Dual Enrollment at Congreso: Where does it go from here?

Southeastern Pennsylvania

Planned Parenthood Southeastern PA

Gender Affirming Care Services Coordinator

Apply Now
Harrisburg, PA

Public Health Management Corporation

Regional Manager, Healthcare and Emergency Management (NW and Central Pa.)

Apply Now
Philadelphia, PA

United Way of Greater Philadelphia & Southern New Jersey

Senior Analyst – Data Science

Apply Now

Sign-up for daily news updates from Generocity