Blog / Latest News Archives - Page 7 of 9

Resilient Sydney

December 6, 2019/in Blog / Latest News /by Nathan Delbridge

Clear Horizon’s Sustainable Futures team are working with the Resilient Sydney Office to develop an M&E Framework for the five-year Resilient Sydney Strategy.

The Strategy aims to strengthen Sydney’s capacity to prepare for, respond to and recover from disaster, whilst ensuring all of Sydney’s communities can access opportunities to thrive. The Strategy aims to effect change across the systems of the city to achieve these objectives, and is being delivered through collaborative initiatives, underpinned by a collective impact model for systemic change.

With the Strategy’s focus on systemic change, collaboration and collective impact, the Sustainable Futures team have been developing an M&E Framework informed in part by the Place-based Evaluation Framework (Dart, 2018) This will ensure the Strategy’s M&E will work with the phased nature of systems change, and across the different scales of change. In addition, to align with the collective impact model used, the Framework distinguishes between the work and outcomes of the backbone organisation (i.e. the Resilient Sydney Office) and those of the broader partnership.

Working with the Resilient Sydney Office on this M&E Framework has been a really exciting opportunity for our team for a number of reasons. The first is the clear alignment in the passion and vision of our team for driving real and positive change. The second is that the complexity that the Strategy is dealing with demands that we continue to innovate, test and refine our M&E approaches, to ensure they remain useful and fit-for-purpose, and can meaningfully engage with the complexity of evaluating influence on systems change. We are thoroughly enjoying the challenges this project has thrown at us and are excited to see where it goes next!

Reflections on transferring to the international evaluation space

December 3, 2019/in Blog / Latest News /by Kaisha Crupi

Kaisha Crupi is a consultant at Clear Horizon and has recently made the move from the domestic Sustainable Futures team into Clear Horizon International. Below is a reflection piece from Kaisha, discussing her learnings and observations in her new role.

Before joining Clear Horizon 18 months ago, I had only a small taste of the international working world. However, since I made the full transition into ‘Clear Horizon International’, affectionately known as CHI (pronounced chai), I feel as if I have jumped into the deep end with each team member supporting me to learn how to swim, and to swim fast. I also feel that the rest of the organisation is on the sideline cheering me on. Below are my reflections and learnings from the last few months of being part of the CHI team.

Working in the international space is tricky

When I was in the domestic team I was exposed to many different industries, types of work and ways of working and met so many people who are passionate about their work through workshops, interviews and product development. Now starting to work in the international space, I am learning about things outside my home country, and in countries that I am working in (and not necessarily living in). Trying to understand different cultural customs, to work around language barriers, across different time zones and to understand different political systems and social contexts is proving to be quite tricky. I am learning a lot more, am asking a lot of questions and reading wider than my easily accessible news. I am also being kind to myself – I know that I am not expected to know everything and am not putting pressure on myself to do so, especially in a short amount of time!

The work is the same, but different

When I first joined the CHI team, I thought this would be great to learn a whole new skill set and challenge myself even further by learning something different and working in a different way. To my surprise, my first task when I joined the team was to conduct a document review against the monitoring and key evaluation questions for an upcoming workshop, which is something that I had finished doing for a domestic project a week earlier to feed into a report! The questions were similar and the way to go about it was the same. The only thing (which was quite a big thing, mind) was that the language and jargon was different, and instead of talking about an area or region, the project was focusing on a whole country! My biggest challenge in joining the team so far is getting used to all the acronyms in reports and discussions with my peers and our clients. I am slowly getting there; though someone should quiz me in the early stages of next year.

Understanding complex challenges

By going to a destination for an international holiday versus going for work, you learn about a country in a very different way. There is the saying that you should not discuss politics when you are in polite company – this is very different in the international working space, particularly when working in design, monitoring and evaluation. You learn about a country’s context on a more granular level, ask the difficult political questions and try to understand the country as much as you can, as fast as you can, especially whilst in-country. I have been exposed to the complex ways of working, what the client deals with and small spot fires they must put out on a day-to-day basis (which are quite different than in the domestic space). These issues also do not have quick-fix solutions. There is at time a feeling of helplessness – now that you know about this information, what are you going to do with it? I believe that doing design, monitoring and evaluation work helps with this, as knowledge is power and can be a communication tool to change someone’s life for the better.

I feel very fortunate to have landed where I am today. Not many people can say that they have ended up with their dream job, especially in such a great values-driven organisation in a very niche area. I have a great team of people supporting me and putting up with my insurmountable amount of questions and reflections, whilst also looking back fondly at my time in the domestic team, where I was able to build my strong foundational knowledge and be supported in every direction. I am looking forward to continuing to swim out toward the horizon and reflecting on the successes and challenges that are happening in such a complex world.

2019 Changefest: Evaluation Tools session

November 29, 2019/in Blog / Latest News /by Ellise Barkley

Evaluation Tools session, with Monique Perusco (Jesuit Social Services and Working Together in Willmot), Skye Trudgett and Ellise Barkley (Clear Horizon)

Our session started with a contextual summary of the work and characteristics of ‘Together in Willmot’, a collaborative social change effort in Mt Druitt involving The Hive, Jesuit Social Services, service providers, schools and many other partners. Clear Horizon is working with Together in Willmot as an evaluation partner. Our shared approach to learning and evaluation responds to the challenges of evaluating systems change and place-based approaches, and is tailored to the phase, pace and strengths of the collaboration. We introduced the process for evaluation we are undertaking, which has involved training in Most Significant Change Technique and local data collection which will feed into building a theory of change and then an evaluation plan. We are planning next year to do co-evaluation focused on the efforts and outcomes to date.

During the session we looked at examples of some Most Significant Change stories so far collected as part of this work.

Most Significant Change (MSC) technique was developed by Jess Dart and Rick Davies. Together Jess (Clear Horizon’s founder and CEO) and Rick authored the User Guide in 2005, and MSC is now applied to innumerable contexts worldwide. MSC story based method that can be used for participatory monitoring and evaluation. The process follows a simple interview structure that can generate a one page change story. It is participatory because many stakeholders are involved both in deciding the sorts of change to be recorded, and in analysing the data. MSC uses stories as a form of data collection. Stories are collected from those most directly involved, such as project participants and field staff. Stories are usually collected by asking a simple question such as ‘during the past year, what in your opinion, has the been the most significant change for participants as a result of this program? Stories are then collected, and stakeholders sit together to analyse the stories, at this time, participants are asked to select the story that represents the most significant change for them. The process of selecting the most significant story allows for dialogue from project stakeholders about what is most important. This dialogue is then used as evaluation data to create knowledge about the project and what it is achieving.

We also covered concepts and tools for evaluating systems change and place-based approaches from the Place-based Evaluation Framework and Place-based Evaluation Toolkit, which was commissioned by Commonwealth and Queensland governments last year and is a leading guide for evaluation in this context. We introduced the generic theory of change for place-based approaches and ‘the concept cube’ that shows the multiple dimensions of evaluation in this context. Clear Horizon worked with TACSI and CSIA to lead the co-design of the framework and have been working with government, community, philanthropy and non-government partners to test, apply and progress these learning, measurement and evaluation approaches.

AES Conference 2019 – for a first-time attendee & emerging Evaluator

October 24, 2019/in Blog / Latest News /by Elliott Tester

By now I’ve had a few weeks to reflect on my first Australian Evaluation Society conference, where I was exposed to an amazing variety of evolving and inspiring ideas from within the Australasian evaluation community.

On the first day I found myself inspired by Dr Tracey Westerman, who raised the dubiousness of using or adapting Western-focused data collection tools in a First Nations context. For me, this highlighted the necessity of remaining reflective and adaptive in our approach, as well as tailoring every evaluation’s approach and methods to the context, preferably in partnership with community. This in turn made me reflect on the work of one of my Clear Horizon colleagues, Skye Trudgett, a proud Aboriginal woman who is passionately pursuing Indigenous Data Sovereignty and is leading a program to build First Nations young women’s evaluation capacity in remote Australia.

Following Dr Tracey Westerman’s plenary, I attended a Systems Evaluation Theory Application presentation by Lewis Atkinson, Brian Keogh and Ralph Renger, which helped frame my thinking regarding complexity. I found myself identifying with the concept of cascading success or failure as a neat way to consider the upstream challenges which produce a downstream issue. I could see the concept’s similarity to framing challenges through approaches such as the Problem Tree and found it a resonating concept in which to couch my thinking on casual pathways.

My third and final reflection was on the space for emerging evaluators. The conference provided a valuable sounding board for ideas and challenges facing those new to the profession and was highlighted on the final day by Eunice Sotelo and Francesca Demetriou, who are conducting research on these experiences. I found myself identifying closely with the key findings, and introspectively, the session highlighted a need to establish a community of support and practice for emerging evaluators. Personally, I will be seeking to develop an informal network, but I believe that an AES-associated group would be invaluable in attracting, retaining and developing those new to the space. Young people are not only the future (inevitably), but have the potential to bring new ideas, perspectives and approaches to evaluation. I feel that this potential influx of creativity and vigour should be encouraged and enhanced through more formal arrangements.

As Kailash Satyarthi is credited as saying, ‘No segment in the society can match the power, idealism, enthusiasm and courage of the young people’, or in this context, young (not necessarily age-specific) evaluators.

Big promises and digital staff

October 4, 2019/in Blog / Latest News /by Jenny Riley

Reflections on the first Digital Transformation Summit by Jen Riley, CIO at Clear Horizon

I arrived 2 hours late to the Digital Transformation Summit in Canberra because something had gone wrong with Microsoft which caused havoc with aviation booking systems. The incident was a salient reminder of how dependent we are on technology. The embracing of digital transformation is well underway in our Federal and State Governments according to all the t-shirts, slogans and senior government bureaucrats that used the inaugural summit to demonstrate how well government is embracing the 4^th industrial revolution.

The message was hopeful. We will digitalise. We will automate. We will be client-centred and provide a more personalised intuitive experience for citizens. Citizens will be able to self-serve and have the same seamless experience we have learnt to expect from the business sector, and if you live in Queensland, this will be delivered by the first digital staff member ‘Russell’. Government representatives were quick to add though that this did not mean everything would be delivered online rather restricted to that which can be automated and available through chat bots and the like will be made available to those with the capability and capacity to access digital options. Those with more complex cases or people without the capability or capacity to access information/services through the online medium would be able to access a person this multimodal or omnichannel approach has proven successful for the banks and Telcos.

What about those experiencing vulnerability? Will they be left behind? Renée Leon, Secretary of the Department of Human Services, cited the example of remote Aboriginal communities being one of the biggest users of Department of Human Services online services who would normally have to drive 100s of kilometres to process Medicare claims.

But the single biggest question from the (mostly government) audience was in relation to how to deal with resistance from staff/management experiencing digital transformation, indicating that the change management within government is not smooth sailing. Ron Gauci, CEO of the Australian Information Industry Association challenged the term resistance and argued what most people found was more likened to intimidation and reluctance – who wants to be shown up as a luddite? Half of the workforce is digitally savvy, they had the internet at school, learnt about programming, the other half (i.e. everyone over 40, myself included) did not grow up in a tech environment, we all remember posting letters, using index cards (they had a use before Agile) in libraries and handwriting essays. The massive upskilling required was a key theme throughout the day and the Digital Transformation Agency capability building projects are to be applauded. But as Renee Leon pointed out, citizen expectations of technology and the speed of technological change is far surpassing the capability of non-technical people in government.

Dr Julia Powles, Associate Professor of Law and Technology, University of Western Australia, warned of the ‘shiny object syndrome’ and ‘deferential’ treatment of technologies such as Artificial Intelligence (AI), Machine Learning (ML) and data analytics. She also cautioned the audience to be weary of vendors over selling and under delivering. There are a lot of white horses and unicorns running around offering all sorts of magical solutions that will solve all our needs and automate everything – when has a digital solution resulted in less work, someone, somewhere, is doing a lot tagging and scraping. Powles also reminded us of the diversity of human experience and the real danger of that being flattened with pattern recognition and aggregated user mapping experiences.

The session on AI and ML was a little underwhelming but showcased the variety of AI applications such as predictive modelling on who wasn’t going to pay their land tax, Olli the South Australian Autonomous Car and the application of Machine Learning in the Human Rights Commission record processing. Olli was fun looked a bit like a large toaster and I loved that it was addressing the first mile/last mile issue of public transport and supporting the elderly and disabled to get out of the home more. It still is really early days for the AI, ML world and there were lots of questions about ethics, who makes the decisions about the algorithms, how will these opaque decision-making processes be accountable, with few answers coming at the moment.

An interesting panel was on data sharing – an incredibly vexed issue for government. Government is committed to the privacy of individual data and grappling with the issue of informed consent and they want to share and consolidate data to make better policy decisions for the common good. Currently, all data requests between and within departments are considered on a case by case basis. Philip Gould, Assistant Secretary, Office of the National Data Commissioner expressed that releasing data is not a check box activity but rather, a subjective assessment about the implications of sharing and joining data. Data has immense value, but it’s a high stakes game – it’s not just the ‘insurance company’ worry, it’s items such as the location of endangered species.

What I did love about yesterday was walking the walls of ‘life events’, where GovX have mapped citizens experience with government services across the life events of ‘birth of a child’ to ‘finding a job’ and dealing with the death of a loved one. The voice of community has been amplified on real pain points:

– Lack of proactive engagement.

– Inconsistent and inaccessible content.

– No single source of truth across government.

– Not meeting service delivery expectations.

This is exciting. Digital systems are fallible, as anyone on a plane experienced yesterday. However, an obsession with people’s genuine challenges with services and elevating their experience as central to addressing those challenges, is the true transformation.

AES International Evaluation conference Day 2!

September 18, 2019/in Blog / Latest News /by Carina Calzoni

It’s been an amazing AES conference so far – lots of interesting topics and great conversations. Like Jess, the highlight for me so far has been the key note speaker from day one, Dr Tracey Westerman – an Aboriginal woman from the Pilbara in WA. She has been a trail blazer in Aboriginal mental health. The key take away message for me was that measurement matters – but even more importantly, the right measures matter. She described that in many cases of Aboriginal youth suicide, there was been no prior mental health assessment. But when assessment tools are used, they are western based and not culturally appropriate. This can lead to misdiagnosis. For over 20 years, Tracey has argued that it is not appropriate to ‘modify’ existing measures because of their inherent racism. The only way is to develop new tools from the ground up. Tracey has developed seven tools specifically for Aboriginal youth mental health with not a lot of funding – no easy feat. It was a truly inspiring presentation from an amazingly passionate and optimistic woman who really cares about her people.

A highlights from day 2 was a panel of designers and evaluators from Australia and New Zealand: Jess Dart, Kate McKegg, Adian Field, Jenny Riley and Jacqueline (Jax) Wechsler, who explored how we might move out of the traditional box of program evaluation, to make a bigger difference. They discussed the role of evaluators in supporting people to move beyond measuring to think though whether we are doing the right things and whether we are really making a difference across complex systems. Questions were covered such as where can evaluators add value in a co-design process, does evaluation get in the way and slow things down, do evaluators need new skills to help analyse and make sense of big data? Jenny reminded us that evaluators are learners and we are curious, and that we need to get on board with the digital revolution.

One really interesting concurrent session I attended was on the use of Rubrics by Julian King, Kate McKegg, Judy Oakden and Adrian Field. They presented the basics of rubric and then described how rubrics can be a tool for democratising evaluative reasoning, stakeholder engagement and communicating of results. They presented two very different examples– one in a developmental evaluation and the other was using rubrics to evaluate the value for money of an agricultural funding program. I found the second example particularly interesting having experienced the challenges of answering the value for money question. Using a rubric in this way is great for balancing the multiple dimensions of value from different perspectives.

Another memorable moment was at an ignite session (which is a really short presentation). Damien Sweeny and Dave Green from Clear Horizon did a great job at presenting a rather convincing argument for placing more emphasis on monitoring over evaluation – Big M vs small e as they call it. And they cheekily suggested changing the name of the AES to AMeS. An interesting thought.

The day finished with a second keynote speaker, Gary VanLandingham, from the Askey School of Public Administration and Policy. He reminded us of the vast amount of evaluative information available through ‘What Works’ warehouses. They are a good place to start when starting an evaluation, but there are warnings. The main caution for me is that they privilege certain types of data over others, and they don’t include what doesn’t work or things not measured using experimental approach (such as randomised control trials, and quasi-experimental methods).

The day was topped off by a short ferry ride to Luna Park where we had a lovely conference dinner overlooking the opera house. Sydney is a very beautiful city and a great setting for a wonderful conference.

Now for day three….

Have you visited our booth at the conference?

AES International Evaluation Conference Day 1!

September 17, 2019/in Blog / Latest News /by Jess Dart

Dr Tracey Westerman, proud Aboriginal woman, had me totally gripped throughout her keynote presentation on Day 1 at the AES International Evaluation Conference. She began with the statistic that Australia has the highest rate of child suicide in the word. But she cautioned us to be optimistic and focus also on the positive outcomes that are occurring, such as the six young Aboriginal people graduating from medicine in WA this year alone. She stressed that education is the most powerful solution in the world and described how in one generation her family ‘closed the gap’ – she gained a doctorate despite living very remotely, with a family background of very limited formal education.

She walked us through the importance of developing assessment tools that are culturally sensitive and to avoid confusing causes with risk factors. It seems many tools in existence today are culture-blind and can lead to stereotyping and actual discrimination. She has developed a whole range of specific assessment tools that are culturally sensitive, including an assessment tool for work-based culture. She made the case that there hasn’t been the right sort of research with Aboriginal people, that the causes are different, and need to be assessed in culturally sensitive ways.

She’s working on ‘building an army’ of Indigenous psychologists across the country to address child suicide and influence child protection. She ended with the note that there is nothing that can’t be achieved by Aboriginal people if they believe in themselves.

After this I had the privilege of moderating a panel about the client-consultant relationship, a topic dear to my heart and my business! The panel was from the Victorian Department of Education and training (DEET), as well as consultants from Melbourne Uni and Deloitte Access Economics. DEET have set up a ‘state of the art’ supplier panel with over 30 suppliers on it, and are working to deepen the partnership between evaluation suppliers and commissioners, as well as embedding a culture of evaluation. They were generous in sharing their challenges, including lots of tricky moments around data sharing and IP.

Just before lunch I had the pleasure of indulging in a session of evaluation theory led by Brad Astbury and Andrew Hawkins from (ARTD). The explored the seven great thinkers of evaluation, who laid the foundations of our seven-decade-long journey of building our theoretical foundations. So lovely to wallow in theory, I remember savouring that learning when studying for my PhD. Their conversation was framed around Foundations of Program Evaluation by Shadish, Cook and Leviton (1991) – it was my evaluation textbook back then and good to see it’s still valued!

It was a busy day for me, and I also convened a fun panel on digital disruption. We had a great spread of panellists, with a designer from Paper Giant, Ruben Stanton; a data scientist, Kristi Mansfield; a social procurement expert, Chris Newman; as well as our very own Chief Innovation Officer, Jenny Riley. We explored the trends, the opportunities and the scary stuff that might come with the fourth industrial revolution – yes, the robots are here! I saw a few people jump in their seats when Jen described how Survey Monkey stores data overseas and is not bound by the same data security regulations. We also looked into the amazing opportunities for evaluators to be the sensemakers of Big Data. When the firehose of data hits you in the face, maybe the evaluators will be there to bring you calmly back to the most important questions. We also explored the opportunities for evaluators to get involved in evaluating new technology and innovation, and to help consider how ready the system is to receive these innovations. I didn’t want it to end!

The day was topped off with a keynote from David Fetterman on empowerment evaluation. Empowerment evaluation is now 26 years old! David explained how empowerment evaluation is a self-evaluation approach designed to help people help themselves. It felt familiar!

Progress 2019

August 22, 2019/in Blog / Latest News /by Kaisha Crupi

Progress 2019 was held over 2 days in June to address the pressing social and environmental issues the world is currently facing. The conference is a biennial event at which progressive thinkers and change makers in the social and environmental space come together to discuss current issues. Over 1500 attendees from Australia and around the world attended the event at Melbourne Town Hall. Headline speakers included Anat Shenker-Osorio, Ellie Mae O’Hagan, Bruce Pascoe, Kumi Naidoo, Owen Jones and Behrouz Boochani. The two-day program was emceed by Yassmin Abdel-Magied.

Kaisha Crupi and Shani Rajendra represented Clear Horizon at Progress 2019 in a bid to understand how Clear Horizon can better engage in this space. Their key learnings are as follows:

We work in complex and messy systems that are tricky to navigate

We found that intersectionality was a common thread throughout this year’s conference. The key speakers noted that Australia cannot achieve true social change unless social change includes all Australians, especially the interests of First Nations people. Panels such as the “First Nations Justice” and “First Nations Land Justice highlighted the significant gaps in current social change movements. Similarly, “A Very Human Climate Crisis” panel reinforced that Australia cannot achieve true social change unless it is coupled with environmental change. Progress 2019 drove home the message that our everyday challenges in the social and environmental change space are complex and multi-faceted in nature. It was an important reminder that we all need to work collaboratively across different initiatives to tackle such complex issues.

The discussion on intersectionality tied well with the other discussions in the conference around embedding a greater understanding of complex systems in which we operate into progressive practice. In his keynote address, Kumi Naidoo, the Secretary-General of Amnesty International, referenced the role of systems change. The three requirements where the world needs to push the boundaries include system re-design, system innovation and system transformation. With these requirements, we will be in a better position to achieve social and environmental change. Kumi’s sentiments were also echoed by Lyn Morgain, Chief Executive at CoHealth who stated that:

“We need to acknowledge that transformation is iterative, dynamic and murky.”

For us working at Clear Horizon, the discussion of intersectionality and systems thinking was really exciting for us as this is how we like to work. Clear Horizon prefers to work with organisations who are already working across multi-faceted issues, particularly where social and environmental justice intersect. This also includes systems-thinking projects and organisations.

Working in complexity is best done through strong partnerships

Each panel discussion at Progress reinforced the importance of partnerships in trying to achieve social and environmental change. At the “Philanthropists & Changemakers: Effective Partnerships to Win Systemic Change” conversation, the panellists discussed that although developing relationships and partnerships are challenging, true partnership is rewarding once it is fully developed. It was noted that the key element is to come to an agreed understanding, in order to build trust. This includes the fact that building trust takes time and that understanding what everyone wants to achieve from the partnership (both as individuals and as together) takes careful research and negotiation. We learnt that all organisations can benefit from developing strong partnerships with like-minded organisations and working together to achieve a common goal.

From this discussion, it reinforced how lucky we are to work in a space which already has already existing partnerships, which have formed over the years and are now incredibly strong. Clear Horizon has long-standing relationships with several organisations. We have found that by working in increasingly complex environments, the need to have a wide range of strong partnerships helps have more of a social and environmental impact, rather than if we were going at it alone.

We need to make space for marginalised voices

We were reminded throughout the conference about the importance of creating a space for people from underrepresented groups in the social and environmental change space. Speakers at Progress highlighted the often used and sometimes tokenistic “let them speak” approach to inclusion which is used a lot in current practice. Instead, change makers should be looking towards organisations who are providing a supportive platform and tools in which people from underrepresented groups can choose to use when speaking for themselves. Phillip Winzer from Seed said that the question that organisations should be asking themselves is:

“What can we do to support Aboriginal and Torres Strait Islander people to implement the solutions they want?”

This question made us reflect on how organisations currently work, both at Clear Horizon and other organisations we work with. We also thought about current Clear Horizon strategies in how to recruit people from underrepresented communities as well as how we work with these communities. This includes people who advising us on how to better create spaces for people to feel welcome and accepted.

Progress taught us that no matter how progressive or values-driven organisations are, to achieve social and environmental change, they need to be proactive in involving underrepresented groups. As Kumi Naidoo said in his keynote address:

“If progressive organisations do not internalise fully the challenges we face, then we are part of the problem.”

We need to think about how we communicate

Progress also showed us that social and environmental sectors need to think about how they connect with wider audiences. This includes talking using more accessible and plain language so everyone can understand. This includes not speaking in jargon, providing image descriptions for people with a visual impairment, or communicating with drawings and cartoons rather than text. Anat Shenker-Osorio, Founder and Principal of ASO Communications did a presentation on communication in campaigning which highlighted the need for strengths-based communication that avoids “othering”. This was a quite important learning for organisations who are trying to use alternative voices in the spaces that they work in.

From our Clear Horizon perspective, we understood that we can further develop our practices. This includes how to communicate in our workshops with people with a disability (through digital storytelling or verbal visual descriptions), not using our evaluation and design (and sometimes sector-specific) jargon as well as having clear messaging and metrics of success.

Conclusion

Progress 2019 was a thought-provoking two-days. A major learning for us was how Clear Horizon could include more diverse voices in our spaces. This could be done through more meaningful partnerships and working on having jargon free, accessible communication. We felt that as a values-based, mission-driven organisation, the benefit for Clear Horizon in continuing to engage with progressive movements such as Progress is a must-need. We also realised that our current work in systems thinking, monitoring and evaluation, and design provide us with a useful toolkit to contribute to the social and environmental justice space. We hope to work with more organisations striving for this in the future.

Human Development Monitoring and Evaluation Services contract for 2019-2023

July 30, 2019/in Blog / Latest News /by Damien Sweeney

Clear Horizon in partnership with Adam Smith International has been awarded by the Australian Government’s Department of Foreign Affairs and Trade the Papua New Guinea – Human Development Monitoring and Evaluation Services contract for 2019-2023. We are really excited to be working with the HDMES team to be based in Port Moresby, along with ASI, DFAT, the Government of Papua New Guinea, and the partners across the health and education sectors.

Health and education are central to PNG’s sustainable development. The health system struggles to meet the needs of it growing population, while the country’s education system lacks sufficient funding, well trained teachers and administrators, and the planning and management necessary to effectively utilise its limited resources. Australia, as the largest donor to PNG, aims to make a positive contribution to the health and education systems. Between 2015 and 2018, $264.4m was specifically allocated to education and $276.9m to health investments. In health, this focuses on workforce planning, communicable diseases, family planning, sexual and reproductive health, and maternal and child health. While, in education, Australia’s objective is to support teachers to improve the quality of teaching and learning, improve primary school infrastructure, and reduce the barriers that prevent children attending and staying at school for a quality education.

Through HDMES, Adam Smith International in collaboration with Clear Horizon will provide external, independent M&E Services to DFAT and GoPNG regarding health and education investments at the program and portfolio levels. Support will include developing portfolio level strategies, performance assessment frameworks and annual reports; advising on baselines and M&E frameworks for programs; quality assuring design, monitoring and evaluation deliverables; and conducting independent evaluations of DFAT investments.

Logan Together Progress Report released

June 5, 2019/in Blog / Latest News /by Ellise Barkley

Last week the Queensland Government released the Progress Report and ‘Statement of Achievement’ that Clear Horizon producedfor Logan Together. Logan Together is one of Australia’s largest and most well-known collective impact initiatives,involving over 100 partners working together to improve the well being of children (0-8 years) in Logan, Queensland.

The Progress Report provides a comprehensive assessment of Logan Together’s progress since inception, identifies recommendations for areas to strengthen, and celebrates the stories of success so far. For more about the background and commissioning of the Report click here.

What did the results show?

The findings evidenced that the Logan Together collective is making sound and positive progress towards the longer-term goals of their ‘Roadmap’ via a collective impact approach. The collective had clearly contributed to community level and systemic changes, and the backbone team had played a catalyst and enabling role. Of importance, there was evidence of small-scale impact for families and children and early instances of change.

Outcomes for families and children include improved engagement of certain at-risk cohorts, such as women not accessing maternity services or families with young children experiencing tenancy difficulties and instability; improved parental awareness of childhood development needs and milestones in targeted communities; early instances of improvement in kindy enrolment for small cohorts; and changes resulting from increased reach of services.

Systems level changes include an increased cross-sector collaboration and breaking down of silos, integrated approaches to strategic delivery, innovating new services and models, changes in practice,shifts in mindset and attitudes, and early changes in resource flows. Logan Together also contributed to outcomes ‘beyond place’ through their advocacy and policy reform efforts.

In some cases, changes have been achieved that would not otherwise have happened and in other examples Logan Together has advanced the progress of outcomes being achieved. Logan Together has also made good progress in developing frameworks for shared measurement and learning, and is starting to generate a body of evidence around their collective work.

The progress study is one example of the measurement, evaluation and learning work that Clear Horizon is doing with backbone organisations and a diverse range of collectives.

It was linked to the work Clear Horizon led for developing the Place-based Evaluation Framework, a national framework for evaluating PBAs (pending release).Like the progress study, the framework was commissioned by the Commonwealth and Queensland Governments, and partnered by Logan Together.

If you want to read more about the methods we used, including outcomes harvesting,see our case study.

Well done Logan Together, and thank you for the opportunity to work with you and your partners on your monitoring, evaluation and learning journey.