The ECHF Outcome Maps were developed in workshops with forum members and staff and refined in discussion with Development Worker Grace Mackenzie, Strategic Development Manager Stephanie-Anne, Current ECHF Chair Iain Stewart and EHSCP Funder Suzanne Lowden. The project was used as a pilot for the Outnav tool and led into the collective ECHF work and COVID-19 response.
The work shown in this report has been carried out using the Matter of Focus approach. Theâ¯Matter of Focusâ¯approach is a theory-based approach to outcome monitoring and evaluation, learning and improvement that builds on contribution analysis. In using the approach, we have gone through a logical and structured process of:
Developing a theory of change for our project informed by an understanding of the context in which we operate.
Agreeing two outcome maps that show how we think our activities contribute to outcomes, and what needs to be in place to make this happen.
Identifying clear change mechanisms by which our project or programme works, these are shown in our pathways.
Developing a plan to gather data to understand whether or not we are making the progress towards outcomes we hope. This includes integrating current data and information we collect, as well as capturing data specifically for this purpose.
Systematically reviewing this data against each of the stepping stones for each pathway in the outcome map.
Summarising key findings against each of the stepping stones to tell our contribution story.
Provide and co-ordinate tailored support, information and training
Champion and raise awareness about health inequalities and the role of the Forum in addressing this
Capture and represent forum member priorities for addressing health inequalities
Participate in and influence strategic planning at city wide and national levels
Forum members
Strategic planning partners
Funders
Strategic influencers
Everybody
The forum is credible, accessible and worthwhile
Collective and one to one support from forum members and staff
Increased knowledge, confidence and skills to effectively manage their organisations
Strategic insights and confidence to advocate for their organisation and the communities they care about
Effective service delivery models, practical tools and best practice examples to inform their response to health inequalities
Increased awareness of and insight into the unique contribution of member organisations in addressing health inequalities
Increased awareness of the risks of not acting now to address health inequalities
Members form strong and enduring partnerships
Plan for the future and take action to improve their effectiveness
Advocate for and play their part in addressing health inequalities
People across the system work together and play their part in addressing health inequalities
Funders and strategic planning partners continue to fund and support member organisations in their work to address health inequalities
Member organisations are stronger, more resilient and more sustainable
Member organisations are better equipped to meet community needs
People have more opportunities to access support to live healthier lives
People experience better health and wellbeing
There is more appropriate and efficient use of resources across the health and social care system
Great Progress |
Some Progress |
Low Progress |
|
---|---|---|---|
High Confidence | |||
Some Confidence | |||
Low Confidence |
This image shows a high-level summary of how well the project is progressing and how confident the team is in the evidence. The key shows how the colour coding works.
See the standards against which progress and evidence have been assessed.
Each year the ECHF coordinate a minimum of 8 Forum Meetings. Agenda items from members tend to lean to one of two main themes: funding (in all forms) and evaluation. In 2020 the focus was somewhat different due to COVID-19 pressures.
The National Agenda (of community action) is covered by CHEX regularly. Members regularly showcase their organisation and services to encourage collaboration.
In addition we invitee a number of guest speakers to talk about topics to support members such as: Voluntary Sector Forums, Social Prescribing, Third Sector Volunteering Strategy, ASH Scotland's Charter for a Smoke Free Scotland, Cancer Support Scotland.
Within 2020 there were nine leadership development opportunists with an average attendance of 17 members. These were organised as per members needs from the Annual Survey and ongoing dialogue.
Topics over the past year included:
In previous years the opportunities have covered:
Since late 2019 there was a shift change in the training strategy where we shifted to leadership development' of the members themselves; rather than their staff teams.
Moving into 2021 we are focusing on digital training, due to the ongoing nature of third sector work seemingly for the foreseeable adopting a somewhat blended approach between 'real life' and 'online life'.
Further, we also provided subsidised coaching to the group, ran two rounds of Action Learning sets and designed and delivered a bespoke leadership event. This was in conjunction with a high profile local organisational development consultancy specialising in health inequality and community work.
In our annual survey we asked the following question:
"The Forum aims to provide relevant, co-ordinated tailored training, support and information to your organisation."
Some of the things our members say about us:
Forum members are a mix of charities, SCIOs and social enterprises. The forum membership has increased year on year since 2017. Membership currently totals 41 organisations, which is a 33% increase since 2019/20. They vary in size and by location across Edinburgh. Whilst the exact work they do varies, all members work using a community development approach to address health inequalities. Some areas where work may happen are: healthy eating, social isolation, mental health, digital inclusion and building community capacity.
To promote good engagement - both with members and with key stakeholders in the communities - the forum made a move to rotating the meeting venue. Average meeting attendance has steadily increased; from 14 in 2017 to 16 in 2018 and 20 in 2020. During 2020 we made a move to online meetings which may also have contributed to the increased numbers.
A regular newsletter is sent out. During 2020 this was read on average by 80% of members. This is a high uptake by comparison to the wider sector. Additionally, the new website (launched in late 2018) allows us feature articles worthy of sharing to the wider network and allows both us, and our members, to raise their profile and work. During 2020 there were 1928 unique visits which is an increase of 40% on the previous year.
In terms of social media, twitter is our most active channel. Follower growth rose 46% to 400 in 2020. This is likely to do with the increase engagement on the channel since there was an increase of tweet volume by 36%. Facebook has been a less popular channel but could pick up with more resource should that be helpful to the membership.
Each year the annual survey highlights which areas the membership feel that we do well and would like us to focus on for the coming year. In 2020 our top three were:
Peer Support, Professional Development, Championing a Community Development Approach, Strategic Influencing and Evaluation also rate highly.
The lowest three which potentially requiring some attention from the board are;
Here is a snippet of feedback from one of our newer members:
"I wanted to 'Thank You' for all your help and support this year especially. Little groups like us with just one member of staff ie. me, really needed the support and you guys were truly a Godsend"
Members engagement continues to rise which is evident by increasing numbers at meetings, an increase in collaborative work with each other, the number of requests and informal feedback the team receives and continued participation in our annual survey.
Here is what some of our members say:
"The Forum has provided support to us as an organisation in so many ways: communication; information; evaluation and grant applications not to mention peer support. I think the network and help provided is invaluable - particularly for a small organisation such as ours."
"I feel the Forum is the most beneficial meeting that I attend thoughout the year."
"ECHF is an essential service for all managers of projects addressing health inequalities, particularly helpful for new managers."
Keeping in touch with the membership is vital in linking members together for various reasons, including sharing of resources. Often organisations are busy with service delivery and not able to look at the wider network. The forum team quickly made the decision to rotate the venues for meetings since this would provide members to connect and share work and this has proved successful with an increase in meeting attendance and 74% of members wishing this to continue. 87% of members reported that they felt (strongly or somewhat) that they received collective support from the forum and forum staff. This is reflected in qualitative feedback also:
The day to day work within 2020 changed somewhat with the pressures of COVID. However the ECHF team organised drop in sessions as well as securing some rapid funding to distribute to members. The team keep track of meeting attendance and set up dedicated opportunities to catch up with those who have not made it along in a while or are disengaging.
As part of our Annual Survey we ask the members directly: 'Do you feel that the forum give you increased knowledge, confidence and skills to effectively manage your organisation?'
We receive informal feedback often after a meeting or event which we collate. One such example is here:
Here is a further snapshot of what our members say:
"Thank You for all that you provide. I think the forum is proactive and thinks of unique, sustainable solutions to issues that exist across a lot of its members"
"Thank you for training and support my organisation and I received this year. It was exactly what we required."
"You are doing a really great job keeping us all informed and linked in."
"I think you are doing a great job - excellent training programme, well run meetings and an obvious commitment to doing the best you can to support organisations in the Forum. "
"I really appreciate the information you send us which keeps me up to date."
"Just a quick note to thank you for arranging the training yesterday - it was excellent! Seems a really good idea to provide training as a partnership approach. Also wanted to say your leaflet looks great - so informative and colourful!"
"Thanks for all the information. It was clear and concise and easy to read. Really didn’t take long and very informative."
Meetings are held regularly and agenda items are set by the current landscape and member priorities, to remain pertinent and relevant.
Prior to 2017 much of the agenda could be fairly insular, focussed on the work of the members themselves. Whilst this is certainly interesting, it was not the best use of time and expertise in the room and so there has been a shift to talking at a more strategic level.
Agenda priorities over 17/18 included the new locality structure, GP link workers and the changing grants landscape. The latter in particular led to more discussion and work around how organisations business plan, strategise and evaluate.
Into 18/19 the focus on grants continued and we invested a lot of time into evaluation and in particular a collective evaluation framework. Other relevant topics during this year included settled status, funding streams, community planning. winter pressures and the restructuring of public health.
19/20 took us largely into COVID territory and the ECHF was a reliable communication channel at a frenetic time. Over this year the focus was on PPE, carers, emergency food provision, HR, the furlough scheme and to carry out a collective COVID response evaluation.
We asked the members how they felt about the following statement:
"The Forum gives strategic insights and confidence to help me advocate for my organisation / communities I care about"
What members say:
Over the past year, many of our member organisations had to collaborate in order to respond to COVID. 87% agree that "strong and enduring partnerships can be formed within the network." 67% feel strongly that this is the case which is compared with 35% the previous year.
When we asked what organisations had done differently as a result of the forum; here were some replies:
We asked our members how they felt about the following statement:
"The ECHF can help me to plan for the future and take action to improve my effectiveness"
We also asked our members how they felt about the following:
"I feel that the ECHF gives me increased knowledge, confidence and skills to effectively manage my organisation"
We hosted bespoke leadership development opportunities again in 2020. Focussing heavily on leading culture and managing change, they aimed to provide a forward thinking toolkit to leaders. Some example feedback can be seen on the informal post it notes captured between two sessions:
When asked directly if the leadership development provided tools for the future, the answer was overwhelmingly 'yes':
Some more general member feedback over the year included:
For the first time in our annual survey, all of our members surveyed believe that we 'understand and champion health inequalities' with 67% believing strongly that this was the case. 93% agree that we have a clear voice at a strategic level and have confidence in us to represent them.
We asked our members if they thought that 'the ECHF could help them to advocate for and play their part in addressing health inequalities'. 67% responded 'Yes' that they feel strongly about this and 27% felt that this was somewhat the case.
The collective work in response to the COVID pandemic is a great example of how the forum can advocate at a strategic level. This work has been highly regarded and has gained traction with local and national peers and strategic influencers in terms of health inequality work going forward.
During our annual survey 80% felt that member organisations are stronger, more resilient and more sustainable as a result of being a member. All of our members agree that the ECHF provides a mechanism to share resources and work more efficiently.
Some comments included:
Since 2018 we have been building up skills in outcome evaluation within the membership. In 2021 we will continue to support this framework to record and celebrate the impact of their work in a meaningful way.
Now we have seen the approach filter out to member organisation we can see the link between a strong collaborative approach on 'service users' more clearly. The collective contribution of forum members outcome map paints a picture of the breath of services across the city. The methodology is now being considered by strategic stakeholders as a new approach to evaluation which gives confidence that we are ahead of the curve in using this method.
Some things the members say about OutNav provision through ECHF:
"We are now using Outnav to demonstrate the work of our project - works really well"
"Trying out new evaluation techniques. Able to provide new resources for local people."
"For me it's more that I feel confident that I am not going to miss out on the things that are on the horizon - the introduction of tools like outnav have been beneficial"
"We have completely revamped our evaluation and my thinking around it in the organisation due to our engagement in OutNav with the forum"
Data collected here forms part of the wider HI evaluation piece of work and includes case studies from the communities themselves.
What follows is a small snapshot of some comments from member service users:
Once again, data collected here forms part of the wider HI evaluation piece of work and includes case studies from the communities themselves; not the ECHF. What follows is a very small snapshot of some recent comments from member service users on how they are experiencing better health and wellbeing.
"I feel more connected to my community"
"Just started weaning my 6 months old and have put much more focus on veggies. When it comes time to introduce grains I will be using a wider variety. I will also be introducing my older boys to different family meals. Really enjoyed cooking session."
"Was Great Cooking with my daughter at Nursery and was a really great workshop as my daughter tried new foods."
“I was really needing some form of community when I approached the organisation looking for a group to go to that could connect people like me who were coming out later in life. I was encouraged to start my own group, and a great deal of effort and hard work went into helping me pull it off. LGBT Health is an amazing resource, and I feel so blessed to have had their help in all the stages of my coming out, and the support in helping me get the New Beginnings group started.
"I am so happy, I know I can make my own money and not just be dependent on my husband to provide for me and my kids."
"I like the westernized lentil soup because it is easy and healthy for my family"
"I feel less isolated"
"I don't know what I'd done without you being there, thank you" - a woman after her difficult family relationships had ended.
"Thank you - I didn't know where else to turn, I just needed the space to talk" - a male on not being able to access an emergency GP app
"You’re easy to talk to - I've never spoke about these things before not even my doctor" - a woman as she reflects on her past life's difficulties
“I like this project. I feel more involved my community”
"I am more able to participate in community activities"
"I find the project very useful due to that helps me to make new friendships, and speak with people who otherwise I wouldn't be speaking and meeting."
‘The main point is that I met a lot of wonderful people here. It helps me building my ‘family’ here.’
‘I love this group and meeting people.’
This table lists the sources of evidence and success criteria that we have referred to whilst developing the analysis presented in this report.
What we do
Stepping Stone
Source
Provide and co-ordinate tailored support, information and training
ECHF Summary Stats
Informal member feedback
Meeting Evaluation
Member Survey 18/19, 19/20
Member Visits
Team reflections
Success Criteria
Description of number and nature of support / information/ training activities
Percentage of survey respondents who say the support we provide is very good or excellent
Summary of what people say about the support you provide
Who with
Stepping Stone
Source
Forum members
ECHF Summary Stats
Success Criteria
Engagement level of forum members
Number and type of social media contacts
Number and types of forum members
Number of people reading newsletters
How they feel
Stepping Stone
Source
The forum is credible, accessible and worthwhile
Informal member feedback
Member Survey 17-18
Member Survey 18/19, 19/20
Member Survey 19-20
Success Criteria
Summary of survey responses
What members say about the forum
What they learn and gain
Stepping Stone
Source
Collective and one to one support from forum members and staff
ECHF Summary Stats
Member Survey 18/19, 19/20
Member Visits
Success Criteria
% of respondents who say that being part of the forum brings them support
Member Visits
Number of Meetings and Member Visits
Increased knowledge, confidence and skills to effectively manage their organisations
Informal member feedback
Meeting Evaluation
Member Survey 18/19, 19/20
Member Visits
Team reflections
Success Criteria
% of forum members who report that the forum increases their knowledge, confidence and skills
Description of changes in knowledge, confidence and skills reported by members
Strategic insights and confidence to advocate for their organisation and the communities they care about
ECHF Summary Stats
Informal member feedback
Meeting Evaluation
Member Survey 18/19, 19/20
Member Visits
Team reflections
Success Criteria
Member views on strategic insights and confidence to advocate for their organisation and communities
Relevant Agenda Items
Survey Question: The forum gives me strategic insights and confidence to help me advocate for my org
What they do differently
Stepping Stone
Source
Members form strong and enduring partnerships
Informal member feedback
Meeting Evaluation
Member Survey 18/19, 19/20
Member Visits
Team reflections
Success Criteria
% of member organisations who report forming stronger and more enduring partnerships
Collaboration Infograph
Description of what partners are doing differently
Member Views
Plan for the future and take action to improve their effectiveness
Informal member feedback
Meeting Evaluation
Member Survey 18/19, 19/20
Member Visits
Team reflections
Success Criteria
Member views on how they plan for the future and improve effectiveness
Survey Q: The ECHF can help me to plan for the future and take action to improve my effectiveness
Advocate for and play their part in addressing health inequalities
Blog Posts
Informal member feedback
Meeting Evaluation
Member Survey 18/19, 19/20
Member Visits
Team reflections
Success Criteria
Member views on how they advocate for and play their part in addressing health inequalities
Survey Q: ECHF can help me to advocate for and play my part in addressing health inequalities
What difference does this make?
Stepping Stone
Source
Member organisations are stronger, more resilient and more sustainable
Informal member feedback
Meeting Evaluation
Member Survey 17-18
Member Survey 18/19, 19/20
Member Visits
Team reflections
Success Criteria
Information from forum members on what they are doing differently as a result of the ECHF
Views of Forum members on the difference our input has made
Member organisations are better equipped to meet community needs
Blog Posts
Informal member feedback
Meeting Evaluation
Member Case Studies
Member Visits
Success Criteria
Member views on their ability to meet community need
People have more opportunities to access support to live healthier lives
Blog Posts
Member Case Studies
Member Visits
Success Criteria
Member views on their community having more support opoortunities
People experience better health and wellbeing
Blog Posts
Informal member feedback
Member Case Studies
Member Visits
Success Criteria
Member views on the work they do and how they improve better health & wellbeing in their communities
Great progress
Some progress
Low progress
High confidence
Most of these criteria apply
Some confidence
Some of these criteria apply
And / or
Low confidence
Few of the above criteria apply AND / OR