Complexity and Evaluation - finding our way together
Arrival tea & coffee available
Welcome to Country
Across Day 1, we will be working with Skye Bullen & Liz Skelton in the role of provocateur.
Skye & Liz will be bringing a ‘balcony’ perspective, making observations on the cultural and adaptive leadership work being raised. They will facilitate participants engagement with the conference content from these different perspectives:
Liz Skelton will provide observations & interpretations on the sessions from the lens of adaptive leadership, asking what leadership questions are raised
Skye Bullen will provide observations & interpretations on the sessions through the lens of Indigenous evaluation practice, asking what cultural perspectives need to be considered
The vision of East Kimberly Empowered Communities is for enduring and effective Aboriginal-led reform, which transfers power and responsibility to Aboriginal people and creates opportunity for the social, cultural and economic development of our children and families. In this session, Des Hill, Chairperson of East Kimberly Empowered Communities will share how this systems change work has unfolded over time. Christy Hawker, the backbone leader, will share the role of data, learning and evaluation along the way.
Convenor: Nan Wehipeihana
Co-evaluation is a type of participatory evaluation that involves putting partners and community at the centre of the evaluation process. It is a natural partner to co-design and is well suited to evaluating initiatives that have been designed by or together with community and for partnership settings.
Co-evaluation draws on several established and tested methods of participatory evaluation, including Collaborative Outcomes Reporting and Most Significant Change technique, but also offers a few new twists to adapt it for systems change endeavours. In particular, it includes some framing around evaluating each other in a partnership setting.
In this session you’ll learn what co-evaluation is and the 5 key implementation steps by unpacking a case study from GROW with Kerry Farrance. Growing Regional Opportunities for Work (GROW) is a long term regional collective impact initiative that aims to tackle place based disadvantage using an economic development approach. In partnership with local business, government and community organisations, our region collectively commits to job creation through local social procurement, and linking jobs to disadvantaged job seekers.
An interactive and immersive 2 hour session that has four learning stations:
1.Complexity 101 and systems change (Kerry) - explores what complex challenges are, why they are different to other types of challenges, and why we need a systems change approach to address them.
2. Foundations to evaluating systems system (Zazie) - explores some of the implications for evaluation and provide some basic principles and emerging tools that are helping us to evaluate systems change endeavours.
3.Developmental Evaluation (DE) (Kate) - unpacks DE as an evaluation approach that assists social innovators develop social change initiatives in complex or uncertain environments. Learn how DE facilitates real-time feedback to innovators to help them rapidly adapt.
4.Participatory evaluation (Jess) - unpacks how citizens and stakeholders can be central the process evaluation, across a spectrum from modest involvement to stakeholders being involved in all phases of evaluation.
Principles Focused evaluation: Many social innovators working on complex issues are driven by principles, as much as theories of change and plans. Principles (a) reflect deeply held values and beliefs about what should be done for ethical reasons as well as (b) guidance on how to make progress. This workshop explores the foundational concepts and practices of Principle-Focused evaluation, the latest contribution from evaluation pioneer Michael Quinn Patton
Snapshot presentations on learning options for Day 2.
• Principle based evaluation (Mark)
• Contribution analysis package (Mark)
• Developing high quality lessons learned (Mark)
• Strategic learning: intelligent failure learning loop (Mark)
• Developmental evaluation (Kate)
• Unlocking creativity for systems change evaluation (Kate)
• Critical heuristics (Kate)
• Managing evaluation in complexity (Kate)
• How to evaluate place-based approaches (Jess)
• Participatory evaluation parties (Jess)
• Most significant learning tool (Jess)
• Theory of change for systems change efforts (Zazie)
• Different ways to scale change (Fiona)
• Ways of working together (Nan)
• Role of big data in systems change (Linda)
• Case study on using collaboration health tool (Jack, CSI)
The debate between qualitative and quantitative approaches can and does polarise people and evaluations. This panel will debate this polarisation and make the case for the use of ‘mixed methods’ in the evaluation of complex change initiatives.