Conference Program

Complexity and Evaluation - finding our way together

Download Program

Wednesday 10 Apr, 2019
8:00AM
Registration

Arrival tea & coffee available

9:00AM
Plenary:Welcome to Country

Welcome to Country

9:15AM
Plenary - Welcome to the conference and building the conference community

Across Day 1, we will be working with Skye Bullen & Liz Skelton in the role of provocateur.

Skye & Liz will be bringing a ‘balcony’ perspective, making observations on the cultural and adaptive leadership work being raised. They will facilitate participants engagement with the conference content from these different perspectives:

Liz Skelton will provide observations & interpretations on the sessions from the lens of adaptive leadership, asking what leadership questions are raised

Skye Bullen will provide observations & interpretations on the sessions through the lens of Indigenous evaluation practice, asking what cultural perspectives need to be considered

Speakers:Kerry Graham, Dr Jessica Dart, Kate McKegg, Nan Wehipeihana

9:30AM
Plenary Panel: Systems change and the role of evaluation

• What is systems change and why is it needed?
• Why is it different to the traditional ways of doing social change?
• What is the role of evaluation?

Convenor: Kerry Graham

Panellist:Mark Cabaj, Kate McKegg, Zazie Tolmer

10:30AM
Morning Tea
10:50AM
Plenary case study:Systems change from an Indigenous perspective

The vision of East Kimberly Empowered Communities is for enduring and effective Aboriginal-led reform, which transfers power and responsibility to Aboriginal people and creates opportunity for the social, cultural and economic development of our children and families. In this session, Des Hill, Chairperson of East Kimberly Empowered Communities will share how this systems change work has unfolded over time. Christy Hawker, the backbone leader, will share the role of data, learning and evaluation along the way.

Convenor: Nan Wehipeihana

Facilitators::Desmond Hill, Christy Hawker

11:40AM
Plenary case study: Co-evaluation

Co-evaluation is a type of participatory evaluation that involves putting partners and community at the centre of the evaluation process. It is a natural partner to co-design and is well suited to evaluating initiatives that have been designed by or together with community and for partnership settings.

Co-evaluation draws on several established and tested methods of participatory evaluation, including Collaborative Outcomes Reporting and Most Significant Change technique, but also offers a few new twists to adapt it for systems change endeavours. In particular, it includes some framing around evaluating each other in a partnership setting.

In this session you’ll learn what co-evaluation is and the 5 key implementation steps by unpacking a case study from GROW with Kerry Farrance. Growing Regional Opportunities for Work (GROW) is a long term regional collective impact initiative that aims to tackle place based disadvantage using an economic development approach. In partnership with local business, government and community organisations, our region collectively commits to job creation through local social procurement, and linking jobs to disadvantaged job seekers.

Presenters:Dr Jessica Dart, Kerry Farrance

12:30PM
Lunch
1:15PM
Breakout Sessions
Foundations

An interactive and immersive 2 hour session that has four learning stations:

1.Complexity 101 and systems change (Kerry) - explores what complex challenges are, why they are different to other types of challenges, and why we need a systems change approach to address them.

2. Foundations to evaluating systems system (Zazie) - explores some of the implications for evaluation and provide some basic principles and emerging tools that are helping us to evaluate systems change endeavours.

3.Developmental Evaluation (DE) (Kate) - unpacks DE as an evaluation approach that assists social innovators develop social change initiatives in complex or uncertain environments. Learn how DE facilitates real-time feedback to innovators to help them rapidly adapt.

4.Participatory evaluation (Jess) - unpacks how citizens and stakeholders can be central the process evaluation, across a spectrum from modest involvement to stakeholders being involved in all phases of evaluation.

Presenters:Kerry Graham, Dr Jessica Dart, Kate McKegg, Zazie Tolmer

Practice 1

Principles Focused evaluation: Many social innovators working on complex issues are driven by principles, as much as theories of change and plans. Principles (a) reflect deeply held values and beliefs about what should be done for ethical reasons as well as (b) guidance on how to make progress. This workshop explores the foundational concepts and practices of Principle-Focused evaluation, the latest contribution from evaluation pioneer Michael Quinn Patton

Presenter:Mark Cabaj

Practice 2

Indigenous Evaluation approaches: Black & White. Indigenous & Ally. Working together on a transformative personal and professional evaluation agenda. Bring your readiness to dive deep; & challenge thinking & systems.

Presenter:Nan Wehipeihana, Skye Bullen

3:15PM
Afternoon Tea
3:35PM
A learning buffet


Snapshot presentations on learning options for Day 2.
• Principle based evaluation (Mark)
• Contribution analysis package (Mark)
• Developing high quality lessons learned (Mark)
• Strategic learning: intelligent failure learning loop (Mark)
• Developmental evaluation (Kate)
• Unlocking creativity for systems change evaluation (Kate)
• Critical heuristics (Kate)
• Managing evaluation in complexity (Kate)
• How to evaluate place-based approaches (Jess)
• Participatory evaluation parties (Jess)
• Most significant learning tool (Jess)
• Theory of change for systems change efforts (Zazie)
• Different ways to scale change (Fiona)
• Ways of working together (Nan)
• Role of big data in systems change (Linda)
• Case study on using collaboration health tool (Jack, CSI)

Mark Cabaj, Dr Jessica Dart, Kate McKegg, Zazie Tolmer, Nan Wehipeihana, Jack Noone , Fiona McKenzie, Linda O'Brien

4:35PM
Close for Day 1

From their role as provocateurs, Skye & Liz will facilitate a lively dialogue on the cultural and leadership questions and narrative emerging across the day.

Liz Skelton, Skye Bullen

5:15PM to 7:30PM
Conference cocktail event
Thursday 11 Apr, 2019
8:15AM
Arrival Tea and Coffee
9:00AM
Plenary - Welcome, reflection and framing Day 2

Speakers:Kerry Graham, Dr Jessica Dart, Kate McKegg, Nan Wehipeihana

9:15AM
Plenary Panel: The tyranny of metrics

The debate between qualitative and quantitative approaches can and does polarise people and evaluations. This panel will debate this polarisation and make the case for the use of ‘mixed methods’ in the evaluation of complex change initiatives.

Panellist:Mark Cabaj, Dr Jessica Dart, Kate McKegg, Jack Noone

10:15AM
Morning Tea
10:45AM
Breakout Sessions
From participant learning priorities
From participant learning priorities
From participant learning priorities
11:45AM
Breakout Sessions
From participant learning priorities
From participant learning priorities
From participant learning priorities
12:45PM
Lunch
1:30PM
Breakout Sessions

Case consultation –theatres
Three participants will bring their ‘case’ of evaluating systems change and seek ‘live’ advice from conference speakers and participants through a structured case clinic process.

Kerry Graham, Liz Skelton, Fiona McKenzie

2:30PM
Group reflections from case consultation

Facilitator:Kerry Graham

3:00PM
Closing: What does the future hold?

To be convened by Liz Gillies

Mark Cabaj, Liz Skelton, Fiona McKenzie, Linda O'Brien

4:15PM to 4:40PM
Conference close with thanks
Back to the Top