What would impact look like?
Impact should be defined by local communities
There was a general consensus in the groups that impact, and success, should be defined by communities themselves – rather than being defined by funders or having prescribed objectives from the start.
Funders and charities can’t necessarily know what impact looks like. Local people should decide on the outcomes they want and participate in the impact monitoring process. However, organisations can play a helpful role in helping communities describe, define and measure impact. It’s also important to create an environment for people in communities to feel safe and empowered to be able to speak openly about their experiences and share feedback with organisations.
Impact is hard to measure
There were some conversations around the challenges of measuring impact, especially in the short-term as it may take decades to become visible. When embarking on long-term projects, we may not see change or impact in the short-term but that doesn’t mean progress isn’t being made. To counter this, we can break down long-term goals into short-term milestones to see that the work is headed in the right direction and keep everyone motivated.
Sometimes impact will be a subtle shift in feelings or behaviours within the community – and this can be difficult to measure. In addition, different communities will have their own priorities and ways of defining success or measuring impact so there cannot be a one-size-fits-all approach.
It can be hard for organisations on the ground, who are involved in the detail, to see the bigger picture – impact evaluation requires constant zooming in and out.
Flexibility is needed
Some expressed that there needs to be more trust and belief in them from funders. They felt that funders were too focused on numbers, and putting pressure on them to ‘jump through hoops’ to showcase impact without understanding the local context.
There was discussion around the challenges of data gathering which can often be burdensome to communities (and costly for charities) and steps need to be taken to ensure it is not extractive. Funders need to be flexible in how they understand change in communities and measure impact.
It was suggested that it could be helpful for charities to develop longer-term relationships with funders and develop approaches together that allow for flexibility and adaptation as things change.
In discussions around tools to measure impact, there was an agreement that there needs to be a mix of qualitative and quantitative measures, and short-term and long-term evaluation, but ultimately it can be difficult to move away from familiar approaches. Flexibility is key – try using a range of tools, stay open minded and adapt as things change. Try to understand why certain approaches work in a certain area or with a particular group, so that learning can be transferred to other areas.
Diversity is key
There was also discussion about ensuring that diverse voices are heard – the more people that are involved in the work, the better the outcomes will be for communities. The six places the Foundation is currently working in are demographically less diverse than other places in England and Wales. There is an ongoing challenge to reach the diverse communities that exist in these places, especially when they’re not as visible. It’s a problem if certain groups are not included as impact and true change will be limited.