Generated by All in One SEO v4.9.6.2, this is an llms.txt file, used by LLMs to index the site. # ARTD ## Sitemaps - [XML Sitemap](https://www.artd.com.au/sitemap.xml): Contains all public & indexable URLs for this website. ## Posts - [Our Blog](https://www.artd.com.au/resources/our-blog/) - Read the latest | Monitoring and Evaluation Methods and Practice · Public Policy Analysis· Service Design and Co-Design · Aboriginal-led Evaluation. - [Mind the Gap, the Evaluation Metro Map](https://www.artd.com.au/news/mind-the-gap-the-evaluation-metro-map/) - ARTD’s Lunchtime Learning is a weekly time for our staff to come together to share and learn. A recent addition to our Lunchtime Learning sessions is the ARTD Journal Club, where our team reviews academic articles together and discusses what they mean for our practice as evaluators. We’re excited to share these lessons with you through our new blog series, - [Koobara Kindy gets ready for NAIDOC](https://www.artd.com.au/news/koobara-kindy-gets-ready-for-naidoc/) - Cover image: Uncle Syl, Joseph Armstrong and Paula outside the Kindy playground at Koobara. This year for NAIDOC Week, ARTD Senior Manager Paula Shaw and Aboriginal Associate Uncle Syl visited Koobara Kindergarten and Pre-prep in Meanjin, where they met with CEO Joseph Armstrong to learn more about the organisation’s history and preparations for this year’s - [QETMAD with First Nations Considerations](https://www.artd.com.au/news/qetmad-with-first-nations-considerations-national-reconciliation-week/) - Image Credit: Emma Walke National Reconciliation Week is an important time for Australians to unite and consider their shared responsibility to build a country that genuinely values and takes meaningful steps to acknowledge First Nations ways of being and doing. For Reconciliation Week, we would like to share this blog from ARTD Partner and Chief Evaluator, Andrew Hawkins, featuring - [World Environment Day: A Global Call to Climate Action](https://www.artd.com.au/news/world-environment-day-a-global-call-to-climate-action/) - This year’s theme for World Environment Day is A Global Call to Climate Action. Climate action is not just about reducing carbon emissions and supporting economies, industries and communities to transition to net zero. It also encompasses adapting human and non-human systems to withstand the impacts of climate change, improving the ways we respond to, - [Link-up’s Sorry Day Breakfast](https://www.artd.com.au/news/link-ups-sorry-day-breakfast/) - Senior Manager Paula Shaw attended Link-Up’s Sorry Day breakfast last week. This event is held each year on the Friday before Sorry Day (May 26th), to acknowledge and remember the experiences and impacts of policies of removing Aboriginal children from their families – for the individuals who were taken, their families and their communities. The Link-Up event is held - [The Stakes of Simplicity: Evaluations in the DFV Prevention Space](https://www.artd.com.au/news/the-stakes-of-simplicity-evaluations-in-the-domestic-and-family-violence-prevention-space/) - May is Domestic and Family Violence (DFV) Prevention Month, a time dedicated to raising awareness about the impact of domestic and family violence, as well as support for victims and prevention strategies. Throughout the month, Abel and I read Kate Fitz-Gibbon's Our National Shame, prompting reflections on our evaluations in this sector, how difficult measuring change in complex social systems can be, and why it’s so important to get this right. Fitz-Gibbon’s central argument is - [Multicultural perspectives in disaster management programs and evaluations](https://www.artd.com.au/news/exploring-multicultural-perspectives-in-disaster-management-programs-and-evaluations/) - Kate and Lou from team Karrikin, which focusses on projects in disaster management, public health and the environment, attended a Harmony Week webinar on multicultural perspectives on disaster resilience in March. Hosted by Australian Institute for Disaster Resilience (AIDR), the webinar featured a range of speakers from the University of Adelaide, the Ethnic Communities Council of Victoria, and the Red Cross. Speakers shared lessons from their work with multicultural communities - [Meet our people – Natalie Janzen](https://www.artd.com.au/news/meet-our-people-natalie-janzen/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? My first career was in biological research. While I enjoyed the lab and was fortunate to work on some exciting and high-impact projects, I always knew my time in research was limited. In - [Communicating with Multicultural Audiences](https://www.artd.com.au/news/communicating-with-multicultural-audiences-reflections-from-the-ethnolink-summit/) - Late last month, Sally, Leah, Greta, Isabela and Llewelyn attended the 2026 Ethnolink Summit in Sydney – Australia's largest event on multicultural communications. The summit brought together a diverse range of speakers from government, to not-for-profits, community organisations and industry experts who design and deliver communications for multicultural audiences. A key theme was moving beyond translation alone and using plain English in communications. - [Insights from Recent Projects #1](https://www.artd.com.au/news/insights-from-recent-projects/) - At ARTD, we've been making a more conscious effort to share what we learn in our evaluations between our teams. Each project brings something new to our collective knowledge and evaluation toolkit, insights that may not make it into a formal report, but which shape how we work together and influence our approach to the next project! Each week we are posting reflections from one of our consulting teams with - [Bridging the Gap: How My Health Background is Guiding Me as a New Evaluator](https://www.artd.com.au/news/bridging-the-gap-how-my-health-background-is-guiding-me-as-a-new-evaluator/) - This year’s World Health Day theme, ‘Together for health. Stand with science’, feels particularly relevant as the world battles with widespread illnesses, environmental issues and growing burdens of endemic and non-communicable diseases. As health challenges become more complex in today’s world, we need to collaborate and utilise the insights of science and evidence now more than ever. This year’s theme resonates with me deeply and intersects with my own journey from - [Insights from recent projects #3](https://www.artd.com.au/news/insights-from-recent-projects-3/) - We’re wrapping up our Insights from Recent Projects blog series with this final instalment. If you missed them, give our first and second reflections a read! Stakeholder engagement with Team Diaspora Our team has had several projects that have challenged us to think creatively about how we engage with stakeholders. We learned that adapting our - [Insights from recent projects #2](https://www.artd.com.au/news/insights-from-recent-projects-2/) - We're posting reflections from our consulting teams with takeaways we hope other evaluators will find useful. This is the second in our Insights from Recent Projects blog series. Read the first blog here. Process tracing in evaluation design with Team Karrikin Using thinking from process tracing in evaluation design We began drawing on thinking from process tracing to - [Meet our people – Naomi Agius](https://www.artd.com.au/news/meet-our-people-naomi-agius/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? My journey started when I was deciding what I wanted to do at uni. My mum did some work in behaviour change, and I've always been interested in people, policy and why we do things a certain way. That led - [When I grow up, I want to be an evaluator](https://www.artd.com.au/news/when-i-grow-up-i-want-to-be-an-evaluator/) - “When I grow up, I want to be an evaluator.” – No one, ever. Evaluation isn’t exactly a childhood dream job. Not many children know what evaluation is, and in fact, most adults don’t either. Anyone who works in the field knows the difficulty of trying to explain what we do to those who spend little time thinking about government programs. And yet despite this underground, niche - [Give To Gain: International Women's Day 2026](https://www.artd.com.au/news/give-to-gain-international-womens-day-2026/) - This year’s International Women’s Day theme, ‘Give to Gain’, highlights that supporting women through resources, knowledge and time, creates new opportunities and builds stronger communities. Supporting women also means challenging stereotypes, calling out discrimination, questioning bias, and celebrating women’s achievements. This theme is especially relevant to our work in evaluation. Making space for women’s voices - [The Independent Evaluation of Australia’s Disability Strategy](https://www.artd.com.au/news/the-independent-evaluation-of-australias-disability-strategy/) - Download an accessible Word version of this page. ARTD is delighted to announce that we will be conducting the Independent Evaluation of Australia’s Disability Strategy. Australia’s Disability Strategy 2021–2031 (the Strategy) is the national disability policy framework agreed by all levels of government. It recognises the role all governments play in removing barriers and improving - [What does it mean to take a systems perspective in policy and program evaluation?](https://www.artd.com.au/news/what-does-it-mean-to-take-a-systems-perspective-in-policy-and-program-evaluation/) - While this question isn’t new, it remains unsettled for many in our field. ARTD Partner and Chief Evaluator, Andrew Hawkins, revisited this topic through an Australian Evaluation Society (AES) Special Interest Group. He has since written a provocation, in the form of an answer, offering 13 questions or actions to work through; a strawman minimal - [ARTD Book Club Yarn Up: Reflecting on Terra Nullius by Claire G. Coleman](https://www.artd.com.au/news/artd-book-club-yarn-up-reflecting-on-terra-nullius-by-claire-g-coleman/) - At ARTD, we are never shy about picking up a book or two! Our desire to strengthen our cultural understanding has led us to read more widely and thoughtfully, particularly since participating in cultural capability training. Late last year, a group of staff gathered for the second meeting of our Book Club Yarn Up to discuss Claire G. Coleman’s Terra Nullius. Claire Coleman is a Noongar woman, born in Western Australia and - [Turning the Tide Together: Reflections From the 2025 Stop Domestic Violence Conference](https://www.artd.com.au/news/turning-the-tide-together-reflections-from-the-2025-stop-domestic-violence-conference/) - Late last year, Stephanie Quail and Natalie Martino attended the 2025 STOP Domestic Violence Conference on Yugambeh Country on the Gold Coast. The theme, ‘Turning the Tide: Supporting Survivors and Shaping Change’ reflected the urgency and momentum for collective action and long-term, systemic change. The conference brought together a range of voices - researchers, practitioners, - [Co-design creatively boosts access to primary health services for Aboriginal families](https://www.artd.com.au/news/co-design-creatively-boosts-access-to-primary-health-services-for-aboriginal-families/) - How do you make Victoria’s Maternal and Child primary health services more accessible and culturally appropriate for Aboriginal families? That’s the question ARTD, the Victorian Government and Aboriginal people have been grappling with in an innovative co-design project aimed at understanding the barriers that prevent Aboriginal families from using the universal primary health services. As - [Automation set to transform the government service landscape – 2017 IPAA Conference](https://www.artd.com.au/news/automation-set-to-transform-the-government-service-landscape-2017-ipaa-conference/) - A new round of digital transformation and automation is about to transform the government workforce and the way government delivers services. The 2017 IPAA conference – of which ARTD was a key sponsor – emphasised the need for the government sector to think creatively about how digital technologies will work for staff and clients. ARTD - [aes17 International Evaluation Conference](https://www.artd.com.au/news/aes17-international-evaluation-conference/) - ARTD is looking forward to discussing how to make evaluation a more useful and effective governance tool with other members of the Australian Evaluation Society (AES) next week at the aes17 International Conference in Canberra. ARTD is again a sponsor of the event, which runs next week 4-6 September at the National Convention Centre. This - [Lessons on Disaster Resilience – ARTD’S Reflections from Australian Disaster Resilience Conference 2024](https://www.artd.com.au/news/lessons-on-disaster-resilience-artds-reflections-from-australian-disaster-resilience-conference-2024/) - Over two days in September 2024, Kate, Amanda, Sue and Ellen attended the 2024 Australian Disaster Resilience Conference in Eora (Sydney). The theme of the conference was ‘Maintaining momentum: driving systemic change to create a more resilient future’. The conference brought together a diverse range of attendees and speakers – from disaster practitioners and academics - [Comparing apples and oranges using rubrics](https://www.artd.com.au/news/comparing-apples-and-oranges-using-rubrics/) - Gerard provides insights on using rubrics in evaluation, with a real world example from an evaluation of the National Disaster Resilience Program. - [ARTD’s Independent Review of Special Religious Education (SRE) and Special Education in Ethics (SEE) in NSW has been released](https://www.artd.com.au/news/artds-independent-review-of-special-religious-education-sre-and-special-education-in-ethics-see-in-nsw-has-been-released/) - In 2014, the NSW Department of Education commissioned an independent review of the implementation of SRE and SEE classes in NSW Government schools ‘to examine the implementation of SRE and SEE and report on the performance of the Department, schools and providers’. The Review was commissioned in response to Recommendation 14 of the Legislative Council - [Devil in the detail: Why ethics processes for evaluation must be revisited](https://www.artd.com.au/news/devil-in-the-detail-why-ethics-processes-for-evaluation-must-be-revisited/) - Formal ethics approval processes designed to protect study participants are often causing their own unintended harms in the context of program evaluation. This is the somewhat controversial message, Principal Consultants Sue Leahy and Jade Maloney, gave to a full Australasian Evaluation Society (NSW) forum, hot on the heels of their presentation at last year’s AES - [Capturing outcomes with Caretakers Cottage](https://www.artd.com.au/news/capturing-outcomes-with-caretakers-cottage/) - Through the Expert Advice Exchange (EAX), ARTD have worked witrih Caretakers Cottage to capture the outcomes of their transitional accommodation service, Options Youth Housing. The EAX, an initiative of the NSW Government’s Office of Social Impact Investment, connects non-government organisations and social enterprises with leading legal and professional services firms, financial institutions and other companies - [NDIS Quality and Safeguards Framework released](https://www.artd.com.au/news/ndis-quality-and-safeguards-framework-released/) - The Framework sets out a nationally consistent approach to quality and safeguards for the NDIS to be introduced in 2018–19. This is needed to ensure that capability is built in the new market-based system, the rights of people with disability are upheld, the benefits of the NDIS are realised, and that people have access to - [Broadening your evidence cost-effectively](https://www.artd.com.au/news/broadening-your-evidence-cost-effectively/) - ARTD Director, Andrew Hawkins, is speaking at the Strengthening Evidence-Based Policy Improving program outcomes and success conference in Canberra on 21 March 2017. He joins other thought leaders in policy, research and evaluation to discuss how sound evidence can be used to improve policy. Andrew’s presentation will draw implications from the academic research to meet - [Getting serious about LEGO](https://www.artd.com.au/news/getting-serious-about-lego/) - Ever left a workshop feeling like you didn’t get a chance to contribute and you wouldn’t remember if someone asked you what it was all about the next day? Bored with lectures, post-it notes and role plays? At ARTD we’re serious about creative facilitation and policy co-design. So we’re using the LEGO Serious Play method, - [Top tips for inclusive community development](https://www.artd.com.au/news/top-tips-for-inclusive-community-development/) - To support access and inclusion, Ability Links NSW works with people with disability, their families and carers, as well as with organisations and other community members, on local community development projects. To celebrate the success of these projects and share their learnings about what works and what doesn’t, we worked with Linkers to develop the - [Energy Efficiency evaluation published](https://www.artd.com.au/news/energy-efficiency-evaluation-published/) - Our 2015 report on measuring energy savings from NSW Office of Environment and Heritage (OEH) 2007-13 energy efficiency programs has been published on their revamped website. The report was part of a four-year evaluation support project, and follows from the 2012 report. The new report syntheses savings from activities undertaken in 2013 and 2014 to - [Survey findings on local government climate change adaptation published](https://www.artd.com.au/news/survey-findings-on-local-government-climate-change-adaptation-published/) - Local Government NSW and the NSW Office of Environment and Heritage (OEH) have published the results from ARTD’s survey of councils’ progress and needs in adapting to climate change. The online survey, conducted in June 2015, received 186 responses covering 74 per cent of all NSW councils. Local Government NSW presented the findings at the - [Ticket to Work for young people with disability](https://www.artd.com.au/news/ticket-to-work-for-young-people-with-disability/) - Andrew Hawkins (ARTD) will present results from the Ticket To Work evaluation at the Disability at Work conference with Michelle Wakefield the Ticket To Work program manager from National Disability Services (NDS). Ticket to Work is a national program that aims to improve the transition to employment of young people with disability. The study aimed - [Evaluation of the Resilient Families Service](https://www.artd.com.au/news/evaluation-of-the-resilient-families-service/) - In November 2013, ARTD was engaged by NSW Treasury to evaluate Resilient Families, an intensive support service delivered to families in greater Sydney by The Benevolent Society as part of the NSW Government’s Social Benefit Bond scheme. The purpose of the evaluation is to assess the implementation and outcomes of the service over its first - [Youth Frontiers evaluation released](https://www.artd.com.au/news/youth-frontiers-evaluation-released/) - The findings of our evaluation of Youth Frontiers—a NSW-wide mentoring program—have been released by the Youth Participation & Strategy Unit in the NSW Department of Family and Community Services (FACS). Overall, the evaluation found the program had an impressive reach across NSW and was achieving positive developmental outcomes for young people. However, it is not - [Building capacity for evaluation starts with democratising it](https://www.artd.com.au/news/building-capacity-for-evaluation-starts-with-democratising-it/) - Evaluation needs to build capacity for “evaluative thinking” beyond its professional and academic borders and to communicate better. These were the key take outs from the 2017 Australasian Evaluation Society (AES) International Evaluation Conference for South Australian members. Tension exists between the desire to ‘professionalise’ evaluation and the need to encourage managers to understand and - [Co-design as the reimagining, repositioning and redistribution of expertise](https://www.artd.com.au/news/co-design-as-the-reimagining-repositioning-and-redistribution-of-expertise/) - The idea that there might be a crisis of expertise in policymaking – a questioning of the role and legitimacy of expertise – is challenging for a public policy consultant. But, for an evaluator, it’s a given that evaluative evidence is only one piece in the policymaking puzzle. We might want it to have more - [Growing specialist disability accommodation](https://www.artd.com.au/news/growing-specialist-disability-accommodation/) - Ever considered establishing or investing in specialist disability accommodation, but not known where to begin? In 2017, ARTD worked with Frankston Peninsula Carers (FPC) to develop a series of resources offering practical advice on how community members can form an association and partner with housing and support providers and investors and funders, including local government, - [Outcome Mapping: unpacking the black box between outputs and impacts](https://www.artd.com.au/news/outcome-mapping-unpacking-the-black-box-between-outputs-and-impacts/) - My recent internship at the International Institute for Democracy and Electoral Assistance (International IDEA) in Stockholm raised a number of important questions for me about how to monitor and evaluate international development programs. Trying to demonstrate a program’s ‘impact’ can often feel overwhelming, given that development goals are long-term and complex processes dependent on a - [Using Evaluation Theory to Inform Practice](https://www.artd.com.au/news/923/) - Evaluation is a young discipline, especially when compared to other fields of inquiry like sociology, economics and psychology. Even so, there exists a rich intellectual history and vibrant body of theoretical knowledge that continues to grow and evolve. When I was invited to deliver a workshop on ‘Theories of Evaluation’ for the Australasian Evaluation Society - [New frontiers for BI: beyond scaling](https://www.artd.com.au/news/new-frontiers-for-bi-beyond-scaling/) - For those catching the train in Sydney, you may have noticed some new billboards on your morning commute: “9 out of 10 train customers pay their fares”. Fare evasion on Sydney’s public transport network is costed at about an $84 million loss per year. This ad, designed by the Behavioural Insights Unit (Department of Premier - [Evaluation: a mirror for social change](https://www.artd.com.au/news/evaluation-a-mirror-for-social-change/) - What role can and should evaluators play in reducing the inequalities that perpetuate social disadvantage? The 2018 Evaluation for Change: Change for Evaluation ANZEA conference held in Auckland from 16–18 July was focused on tackling this question and asked attendees to consider what changes they could make in their practice to contribute to societal improvement. - [Building the bigger picture: using the SDGs in evaluation](https://www.artd.com.au/news/building-the-bigger-picture-using-the-sdgs-in-evaluation/) - When evaluating, should we be focusing solely on the program or should we endeavour to consider its entire ecosystem? At the Australasian Evaluation Society NSW event last month, Michael Reid, Managing Director at The Keyline Group, looked at how we can use the United Nation’s Sustainable Development Goals (the ‘SDGs’) as a framework for taking - [Want to make your community more inclusive? Learn from Ability Links.](https://www.artd.com.au/news/want-to-make-your-community-more-inclusive-learn-from-ability-links/) - We know that about one in five Australians have a disability. While most people with disability are no longer ‘shut in’—hidden away in large institutions—many are still ‘shut out’ of buildings, homes, schools, employment, businesses, sports and community groups.[1] People with disability can face barriers to being included in their communities, gaining employment, and accessing - [Assessing citizen engagement](https://www.artd.com.au/news/assessing-citizen-engagement/) - We know that citizen engagement is at the heart of a strong democracy. It enables governments to deliver policies and programs that respond to citizens’ needs and helps to build trust in government systems and processes. So, it’s important that we understand how well governments are conducting engagement activities. It’s not enough to know that - [Program design: what's the logic?](https://www.artd.com.au/news/program-design-whats-the-logic/) - The Evidence Based Policy Summit in Canberra last week brought together staff from federal and state government departments to discuss strategies for strengthening data collection and using evidence to improve policy, programs and practice. At the summit I ran a workshop on using evaluative thinking for program design. This is an approach that builds on - [Top tips for evaluating community development](https://www.artd.com.au/news/top-tips-for-evaluating-community-development/) - Monitoring and evaluation support effective community development. Being ‘evaluation-minded’ will help you to assess your progress, understand whether you’ve achieved what you set out to achieve, and continue to learn and improve. However, from our experience working with community organisations, we know that the terminologies and technicalities of monitoring and evaluation can feel overwhelming. Community - [How do you build trust in evidence in an era of public scepticism?](https://www.artd.com.au/news/how-do-you-build-trust-in-evidence-in-an-era-of-public-scepticism/) - The worrying decline in trust of public institutions – in Australia and across other western nations - has been a topic of much recent discussion. In a time where evidence and expertise are treated with increasing public scepticism, what then, is the role of evidence-based insights? The 2018 AMSRS Social and Government Data, Evidence, Insights - [Using developmental evaluation to support inclusion](https://www.artd.com.au/news/using-developmental-evaluation-to-support-inclusion/) - Increasingly, we’re working with non-government organisations to develop and refine initiatives that that support people with disability and increase community inclusion. At the start, it isn’t always clear what these initiatives will look like, how they’ll be delivered, or even what outcomes they’ll aim to achieve. As with most community development, they take a co-design - [Strengthening evaluation through a community of practice](https://www.artd.com.au/news/strengthening-evaluation-through-a-community-of-practice/) - Evaluation can be a tough gig. While everyone talks evidence-based policy, no-one really wants to hear that the policy or program they designed or have been working hard to implement is not delivering what they’d hoped. Kicking off the one-year anniversary of the Department of Finance, Services and Innovation’s (DFSI) Evaluation Community of Practice, Secretary - [Growing the evidence base through evaluation](https://www.artd.com.au/news/growing-the-evidence-base-through-evaluation/) - At a recent Australian Research Alliance for Children and Youth (ARACY) event there was much discussion about growing the evidence base for a sector that encompasses many diverse and complex programs. Government departments and other organisations are increasingly attempting to consolidate evidence for public policies and programs to make it easier to understand their effectiveness - [The many ways we can un-box evaluation](https://www.artd.com.au/news/the-many-ways-we-can-un-box-evaluation/) - To outsiders, evaluation can seem like a mystery and something to fear. While evaluators see its potential to inform better public policy, the evidence says evaluation does not always live up to it’s potential. This is part of why our theme for this year’s Australian Evaluation Society Conference in Sydney is ‘Evaluation Un-boxed’. I shared - [TFM: working with, not for](https://www.artd.com.au/news/tfm-working-with-not-for/) - The 2019 Their Futures Matter Conference, held in Sydney on 11 February, was an important reminder of the need to work with, not for, communities, when building evidence of outcomes. Their Futures Matter (TFM), a landmark, whole-of-government reform designed to improve outcomes for vulnerable children and families in NSW, is committed to using evidence and - [How can evaluators #BalanceforBetter?](https://www.artd.com.au/news/how-can-evaluators-balanceforbetter/) - This year's International Women's Day challenged us to think about what we can do to #BalanceforBetter. As our staff celebrated today, we started to think about what we can do as evaluators to support a more balanced world. Have you heard of feminist evaluation? It draws on feminist theory and isn’t so much an approach - [3 things I learnt as an Aboriginal intern](https://www.artd.com.au/news/3-things-i-learnt-as-an-aboriginal-intern/) - I am a proud Booroobergonal woman of the Darug nation. My mother, too, is a Booroobergonal woman and my father is Croatian. A little over a year ago, at 19 years old, I started a 6-month internship at ARTD Consultants. During this time, I was exposed to the world of evaluation and public policy and - [Applied ethics in program evaluation](https://www.artd.com.au/news/applied-ethics-in-program-evaluation/) - As evaluators, ethics is key when considering if, when and how and we will conduct our projects. Ethical decisions shape the validity and reliability of the evaluations produced. We also know that clients of government social policies and programs are often vulnerable community members, and so its paramount that evaluators of these programs engage sensitively - [Safer Pathway evaluation released](https://www.artd.com.au/news/safer-pathway-evaluation-released/) - ARTD’s evaluation of Safer Pathway found the program is delivering a consistent, effective and timely response to victims across NSW. Safer Pathway is a key initiative under the NSW Domestic and Family Violence Blueprint for Reform 2016–2021, led by Women NSW and delivered by the Department of Justice. Rather than an individual service or program, - [What National Reconciliation Week means to me](https://www.artd.com.au/news/what-national-reconciliation-week-means-to-me/) - Before proceeding, I would like to acknowledge and pay my respect to the past, present and emerging Traditional Custodians and Elders of Australia’s Aboriginal and Torres Strait Islander population. This week, across Australia, we celebrated National Reconciliation Week. A week where all Australians are encouraged to take a look at our shared history and explore - [Elevating lived experience in evaluation](https://www.artd.com.au/news/elevating-lived-experience-in-evaluation/) - With the rise of co-design, co-production and co-delivery, lived experience is being increasingly valued in policy and program design and delivery. - [Making monitoring and evaluation work for NGOs](https://www.artd.com.au/news/making-monitoring-and-evaluation-work-for-ngos/) - With governments increasingly contracting NGOs to deliver services, there has been a corresponding expectation that NGOs monitor and evaluate their services and report on the outcomes they have achieved. With the myriad of competing conceptual approaches to evaluation and difficult-to-decipher jargon, not to mention limited time and resources, this can be challenging for NGOs with - [Future Directions evaluation](https://www.artd.com.au/news/future-directions-evaluation/) - ARTD is leading an evaluation of NSW Family and Community Services’ Future Directions initiatives, in collaboration with Taylor Fry and Social Ventures Australia. Future Directions is the NSW Government’s new vision for social housing over the next 10 years. It’s an innovative, holistic approach to making real change in social housing. It recognises that people - [Reflections of an accidental evaluator](https://www.artd.com.au/news/reflections-of-an-accidental-evaluator/) - We're currently looking for a research assistant to join our growing Queensland evaluation practice. This has been a wonderful opportunity to reflect on what it means to be an evaluator. As evaluators, we find that people we bump into socially don't know what evaluation is. (I'm sure most of us are experts at tackling that - [Evaluation topics that keep us up at night](https://www.artd.com.au/news/evaluation-topics-that-keep-us-up-at-night/) - Photo by Adam Griffith on Unsplash With evaluation being diverse, complex and evolving, there are many topics that keep us up at night. This seems to be the case whether we’re commissioning an evaluation, conducting an evaluation or having our program evaluated. NSW AES members met to discuss these topics in a mini unconference session - [Evaluation topics that keep us up at night (the sequel)](https://www.artd.com.au/news/evaluation-topics-that-keep-us-up-at-night-the-sequel/) - The best horror movies always get sequels! The Australian Evaluation Society’s goosebump raising ‘Evaluation topics that keep you up at night’ open-space interactive session, first attended by Ken in 2019, recently returned for a second haunting! Lia and Ken got front row seats at the 2021 sequel, facilitated by Kath Vaughan-Davies of K2 Strategies and - [Part 7: Our top 10 hacks for evaluation writing](https://www.artd.com.au/news/part-7-our-top-10-hacks-for-evaluation-writing/) - Starting a fresh evaluation report can be daunting. We need to synthesise large amounts of data, navigate social and political climates, and balance (sometimes) divergent values and interests. While there are some common report structures, there is no magic recipe for reporting. On top of this, emotional stress outside of work, perfectionism, and pressure to - [Join us for workshops #aes19SYD](https://www.artd.com.au/news/join-us-for-workshops-aes19syd/) - August 2019 #aes19SYD is all about un-boxing evaluation so it can fulfil it’s potential. Five of our senior staff are delivering workshops to un-box evaluation theory, unlock your capacity to collect quality survey data and assess impact, then present what you’ve found in a way that captures the attention of your audience. Check out the - [Celebrating ARTD’s 30th birthday with Michael Brooks](https://www.artd.com.au/news/celebrating-artds-30th-birthday-with-michael-brooks/) - ARTD turns 30! Holly interviewed one of ARTD's founding partners, Michael Brooks to get insight into ARTD's 30 year history. - [ARTD awarded the 2019 Indigenous Evaluation Award for Excellence](https://www.artd.com.au/news/artd-awarded-the-2019-indigenous-evaluation-award-for-excellence/) - At this year’s international evaluation conference, #aes19SYD, ARTD were honoured to be awarded the 2019 Indigenous Evaluation Award for Excellence. - [Empowerment Evaluation by David Fetterman – 2019 AES Conference Post-Workshop](https://www.artd.com.au/news/empowerment-evaluation-by-david-fetterman-2019-aes-conference-post-workshop/) - As emerging evaluators, we are constantly looking to explore and learn about concepts and theories of evaluation. In the lead up to the Australia Evaluation Society (AES) International Evaluation Conference, we had particularly been exposed to certain principles associated with ‘Empowerment Evaluation’ such as capacity building and inclusion in our project work. This triggered our - [Wrangling with power dynamics](https://www.artd.com.au/news/wrangling-with-power-dynamics/) - As designers and evaluators, we need the capacity to understand power dynamics and competing perspectives on what is of value and whose values count. - [Including all: Using arts-based research methods](https://www.artd.com.au/news/including-all-using-arts-based-research-methods/) - Using arts-based research approaches can provide a way for people of all abilities to participation in evaluation. - [Our highlights from the AES19 Conference](https://www.artd.com.au/news/our-highlights-from-the-aes19-conference/) - From cultural understanding and engaging with vulnerable populations, to rubrics, these are our highlights from AES Conference 2019. - [Reducing domestic and family violence: the power of stats and stories](https://www.artd.com.au/news/reducing-domestic-and-family-violence-the-power-of-stats-and-stories/) - When evaluating DFV programs, we give voice to people with lived experience, recognise intersectional disadvantage, and critically assess the evidence to make informed recommendations. - [Open Doors to Renting Reform report published](https://www.artd.com.au/news/open-doors-to-renting-reform-report-has-been-published/) - In 2018, the Queensland community shared their ideas about how to improve renting through the Open Doors for Renting Reform Consultation. We worked with the Queensland Department of Housing and Public Works to analyse all the information they had collected during the public consultation. The reform process was driven by a need to modernise Queensland's - [Our new Aboriginal design](https://www.artd.com.au/news/our-new-aboriginal-design/) - Last year, ARTD updated its branding to better reflect our business vision and values. The final piece of our rebrand, was to engage Emma Walke, an Aboriginal artist and researcher, to design a new report cover. Emma is a Bundjalung woman who lives in Bagotville, Northern NSW. Her mother’s people are from Ballina/ Cabbage Tree - [Collaborating to build evidence of program effectiveness](https://www.artd.com.au/news/collaborating-to-build-evidence-of-program-effectiveness/) - Helen Keller is quoted as saying that “Alone we can do so little; together we can do so much.” When it comes to evaluation consulting, never a truer word was spoken. Getting collaboration right is something we pride ourselves on, to the extent that it’s one of our organisational values. How we collaborate looks different - [Reconciliation Week 2020](https://www.artd.com.au/news/reconciliation-week-2020/) - The design of the cover image, created by Aboriginal artist Emma Walke, shows a story of connection to country and people representing the breadth of work ARTD do with Aboriginal communities across Australia. The colours are representative of the land, and the lines in between representative of the water that connects us all. Today is - [Building trust through empowerment evaluation](https://www.artd.com.au/news/building-trust-through-empowerment-evaluation/) - Dr David Fetterman provides us with insights into Empowerment Evaluation and its benefits in the 'new normal'. - [Take 3 for the Environment](https://www.artd.com.au/news/take-3-for-the-environment/) - As part of our company’s efforts to improve the health of the environment and reduce our impact on it wherever we can, we recently completed a pro-bono project for Take 3, an Australian non-profit organisation that promotes healthy and clean oceans and waterways. The idea of Take 3 is a simple one: every time you - [The art of interviewing](https://www.artd.com.au/news/the-art-of-interviewing/) - An interview – one person asks a question, the other responds, then you move onto the next question. Seems simple, right? Well, when it’s done well, this is how interviewing does appear, but anyone who’s ever interviewed before will know that a lot more goes into interviewing than meets the eye. We learned just how - [Changing how we do change](https://www.artd.com.au/news/changing-how-we-do-change/) - “We need to change how we do change.” Kieran Flanagan As I am cycling with a group of friends recently in Sydney on an unusually warm winter’s morning, standard protocol dictates that it is again time to roll turns within the group. I find myself having the same conversation for the umpteenth time with fellow cyclists - [Reflecting on the 2020 Research Society Virtual Conference](https://www.artd.com.au/news/reflecting-on-the-2020-research-society-virtual-conference/) - Recently some ARTD staff attended sessions from The Research Society’s virtual conference, organised under the theme Facing 2030. Presenters shared their insights on where they thought the research industry was heading over the course of the next decade. Our team reflected on this idea and considered how it might impact our work as program and - [How government is being reimagined](https://www.artd.com.au/news/how-government-is-being-reimagined/) - Jade explores recurring themes from the 'Reimagining Government' webinar series on power shifts in government, scale, systems thinking and co-design. - [Enhancing Evaluative Thinking and Reasoning](https://www.artd.com.au/news/enhancing-evaluative-thinking-and-reasoning/) - What steps can we take to ensure evaluation recommendations are well-informed, feasible and accepted? - [New Code & Strategy ensuring excellence in monitoring and evaluation](https://www.artd.com.au/news/new-code-strategy-ensuring-excellence-in-monitoring-and-evaluation/) - Newly released: AIATSIS Code of Ethics for Aboriginal and Torres Strait Islander Research and the Productivity Commission's Indigenous Evaluation Strategy. - [On Listening and Learning](https://www.artd.com.au/news/on-listening-and-learning/) - This NAIDOC Week we are collectively reflecting on and learning about the survival, history, living culture and achievements of Aboriginal and Torres Strait Islander peoples. This week our teams have been invited to reflect on our connections to the Aboriginal lands on which we work, and on the excellence in evaluation practice being showcased by - [On Gadigal and Darug lands](https://www.artd.com.au/news/on-gadigal-and-darug-lands/) - This NAIDOC Week we are collectively reflecting on and learning about the survival, history, living culture and achievements of Aboriginal and Torres Strait Islander peoples. This week our teams have been invited to reflect on our connections to the Aboriginal lands on which we work, and on the excellence in evaluation practice being showcased by - [Q&A with Artist and Aboriginal Associate Emma Walke](https://www.artd.com.au/news/qa-with-artist-and-aboriginal-associate-emma-walke/) - Image Credit: Emma Walke As part of preparing our Reconciliation Action Plan, ARTD commissioned Bundjalung woman, Academic, potter and artist Emma Walke to design an artwork. Emma also designed the artwork we use for our Aboriginal sector reports, which you will have seen used on our other blogs in NAIDOC Week. Her work on the - [Q&A with our Director, Aboriginal Partnerships and Projects](https://www.artd.com.au/news/qa-with-our-director-aboriginal-partnerships-and-projects/) - Celebrating the work of our Aboriginal Partnerships and Projects Portfolio, the communities we partner with in co-design and Aboriginal excellence in evaluation. - [Program vs Systems Evaluation: Cardiac Care Case Study Article](https://www.artd.com.au/news/program-vs-systems-evaluation-cardiac-care-case-study-article/) - Partner Andrew Hawkins has co-authored a new journal article in The Canadian Journal of Program Evaluation on the application of systems thinking concepts to evaluate systems. The article uses a case illustration of the Cardiac Care System in the US to help teach practitioners the difference between a systems vs program approach to evaluation, and - [Reflections on power sharing and systems change in the non-profit and philanthropic sectors](https://www.artd.com.au/news/reflections-on-power-sharing-and-systems-change-in-the-non-profit-and-philanthropic-sectors/) - The power dynamic between nonprofits and philanthropists is changing for the better, and systems thinking is helping! - [THE COST BENEFIT ANALYSIS APPROACH TO ECONOMIC EVALUATIONS: BENEFITS AND BARRIERS](https://www.artd.com.au/news/the-cost-benefit-analysis-approach-to-economic-evaluations-benefits-and-barriers/) - Moya, Ken and Natasha's takeaways on Cost Benefit Analysis from an Australian Evaluation Society interactive online session on Economic Evaluation. - [On Data Sovereignty](https://www.artd.com.au/news/on-data-sovereignty/) - What are the principles of data sovereignty adopted by First Nations communities in Australia and New Zealand, and why are they essential? - [Promoting the use of Digital Technologies in Evaluations](https://www.artd.com.au/news/promoting-the-use-of-digital-technologies-in-evaluations/) - The value of digital has certainly been hammered home during the global pandemic. We look at reasons to integrate digital into evaluations. - [On Australia's National Education Evidence Body](https://www.artd.com.au/news/on-australias-national-education-evidence-body/) - How do educators know that their chosen teaching approach works? How do they choose one approach over another? How do they know what approach will be best to serve the needs of their students? The answer should be: evidence. A new national education evidence body called the Australian Education Research Organisation (AERO) will launch later - [Happy #EarthDay from our sustainable office](https://www.artd.com.au/news/happy-earthday-from-our-sustainable-office/) - What does our work have to do with banana skins, coffee grounds and happy plants? For Earth Day 2021 (@EarthDay and #EarthDay2021 on Twitter) we we wanted to give you an update on a few office inhabitants you probably won’t meet if you come into our Sydney Office, but who are doing a lot of - [Connecting Evaluation and Indigenous Knowledges for Country with Practical Action - session with Associate Professor Megan Williams](https://www.artd.com.au/news/connecting-evaluation-and-indigenous-knowledges-for-country-with-practical-action-session-with-associate-professor-megan-williams/) - Kate and Ken recently attended an interactive Australian Evaluation Society session with accomplished academic, poet and Wirajuri woman, Associate Professor Megan Williams on Connecting Evaluation and Indigenous Knowledges for Country with Practical Action. Associate Professor Megan Williams is the author of the Indigenous evaluation framework Ngaa-bin-ya, which was published in the Evaluation Journal of Australasia - [Principles and Practices for Partnerships with Aboriginal and Torres Strait Islander Organisations](https://www.artd.com.au/news/principles-and-practices-for-partnerships-with-aboriginal-and-torres-strait-islander-organisations/) - Holly, Nat and Tash share their reflections on meaningful partnerships from AIFS' webinar on Advancing partnerships with Aboriginal and Torres Strait Islander organisations. - [Leveraging the power of surveys to save the sea](https://www.artd.com.au/news/leveraging-the-power-of-surveys-to-save-the-sea/) - According to a report by the Ellen Macarthur Foundation[1],“by 2050 there will be more plastic in the ocean than fish.” Take 3 for the Sea exists to tackle the behaviours that are drowning our planet in plastic. Through 2021, ARTD has been supporting Take 3 to develop The First Wave survey, designed to understand the - [Hubs, spokes and networks in government evaluation approaches](https://www.artd.com.au/news/hubs-spokes-and-networks-in-government-evaluation-approaches/) - Kate and Ken recently attended an AES panel discussion on Whole of Government Evaluation Approaches, with representatives from NSW, VIC, NT, QLD and ACT. It was interesting to hear the differences and similarities in approaches taken by states and territories towards evaluating government programs and policies. While most were taking a Whole of Government approach - [Creating culturally safe evaluation and research spaces](https://www.artd.com.au/news/creating-culturally-safe-evaluation-and-research-spaces/) - Learnings on working with and researching in Aboriginal communities, and community governance models. - [On Time - are evaluators concerned with the past, the present or the future?](https://www.artd.com.au/news/on-time-are-evaluators-concerned-with-the-past-the-present-or-the-future/) - Is evaluation concerned with the past, the future or the present? How might we better draw on these to find 'what makes this a good idea, here and now'? - [Listen up evaluators!](https://www.artd.com.au/news/evaluative-listening/) - We talk a lot in our work about the power of evaluative thinking, and much of our work is about listening. But while we put the two together intuitively, we perhaps talk less about the power of ‘evaluative listening’ as a critical skill of an evaluator, and the value that skillset brings to the design - [Empathy: The soft skill needed to harden our evaluation practice](https://www.artd.com.au/news/empathy-the-soft-skill-needed-to-harden-our-evaluation-practice/) - The most fundamental interpersonal skill evaluators need is empathy - but what is it, and are there tools and methods to help you develop your empathy muscles? - [Evaluation in the Commonwealth - new guidance and toolkit](https://www.artd.com.au/news/evaluation-in-the-commonwealth-new-guidance-and-toolkit/) - December brings many gifts – one of these is the new Commonwealth Evaluation Policy and Toolkit, which provides a range of useful information and resources to inform evaluation planning, conduct and use across Commonwealth agencies. The gift wrapping is that they are also user-friendly. These new guidance materials provide a principles-based approach that recognises the - [2021: a reflection on lessons learnt](https://www.artd.com.au/news/2021-a-reflection-on-lessons-learnt/) - In some ways, 2021 has felt never ending. In others, it has gone past in the blink of an eye. For our final blog of 2021, we asked our ARTD team to reflect on what has shaped our evaluation thinking and practice most this year. Jade This year has reminded me how important it is - [Get Up, Stand Up, Show up](https://www.artd.com.au/news/get-up-stand-up-show-up/) - This year’s NAIDOC Week theme is ‘Get Up! Stand Up! Show Up!’ On this day of survival, we reflect on what it means to us to show up in our work with Aboriginal and Torres Strait Islander communities and organisations. ‘Showing up’ means to be present for other people. “When we talk about showing up, - [Transparency and Taking the Time: respectfully bringing lived experience into program design and evaluation](https://www.artd.com.au/news/transparency-and-taking-the-time-respectfully-bringing-lived-experience-into-program-design-and-evaluation/) - There are so many benefits to working alongside people with lived experience when designing and evaluating projects. Working with people with lived experience prompts us to think about things differently: often, people ask us questions about things that we, as evaluation practitioners, may no longer question. And, working with peer researchers challenges us to think - [Reconciliation Week – moving from safe to brave](https://www.artd.com.au/news/reconciliation-week-moving-from-safe-to-brave/) - “We need new conversations that don’t get lost in rhetoric, good intentions and feel-good statements. We need the very conver­sations we often don’t dare to have and are too fearful to start. We often talk about what black or white Australia want from each other, but rarely do we talk about how we work together - [NAIDOC WEEK – A DEEP DIVE INTO HISTORY](https://www.artd.com.au/news/naidoc-week-a-deep-dive-into-history/) - What’s the meaning of NAIDOC? We celebrate NAIDOC week each year during the first week of July (Sunday to Sunday). NAIDOC stands for National Aborigines and Islanders Day Observance Committee and the week’s purpose is to recognise and celebrate Aboriginal and Torres Strait Islander communities, culture, history, and achievements. Where does NAIDOC Week come from? - [Having the difficult conversations](https://www.artd.com.au/news/having-the-difficult-conversations/) - R U OK? day and World Suicide Prevention Day this month serve as reminders to have the necessary – though challenging – conversations about the mental health concerns and suicidality with which many people wrestle every day of the calendar. One very clear metaphor which communicates the conditions (very often structural) which create extreme psychological - [Systems thinking for more effective disaster management](https://www.artd.com.au/news/systems-thinking-for-more-effective-disaster-management/) - I attended an excellent IPAA Queensland session in September on 'Rethinking Crises and Achieving Resilience in a post-COVID world' with a panel comprised of Alistair Dawson (Inspector-General of Emergency Management), Professor Cheryl Desha (Queensland Disaster Management Research Alliance, Griffith University), Collin Sivalingum (State Emergency Services Manager, Red Cross) and Dr Anne Tiernan (Constellation Impact Advisory, - [On Leading Change and Impactful Evaluations](https://www.artd.com.au/news/on-leading-change-and-impactful-evaluations/) - Liana Downey recently spoke to our team about her experiences driving change and impact in roles as a consultant, as well as in government as the Deputy Secretary, Strategy and Delivery for NSW Department of Education, and Expert Advisor to the Department of Prime Minister and Cabinet. Her session was instructive for us, and we’re - [UNIVERSAL DESIGN IN MARKET AND SOCIAL RESEARCH – WITH GERARD ATKINSON](https://www.artd.com.au/news/universal-design-in-market-and-social-research-with-gerard-atkinson/) - ARTD Director Gerard Atkinson is presenting later this month at the Human Insights Conference in Melbourne, held by The Research Society. We caught up to chat about topic of universal design in market and social research. What are you looking forward to about the conference? The conference is the premier gathering of the market and - [Native hibiscus, rodeo romance and solid rock for Reconciliation Week](https://www.artd.com.au/news/native-hibiscus-rodeo-romance-and-solid-rock-for-reconciliation-week/) - Our colleague Paula Shaw works from Jagera and Turrbal country in Meanjin, Brisbane, and has been busy connecting, commemorating and celebrating this Sorry Day and Reconciliation Week. I got to two quite different events in Brisbane this year for Reconciliation Week. The first was a National Sorry Day commemoration on the site of a former - [Fit for purpose evaluation #1 - the big questions](https://www.artd.com.au/news/fit-for-purpose-evaluation/) - The concept of ‘fit-for-purpose’ evaluation has been around for a long time, I remember publishing guidance with Patricia Rogers on this concept back in 2015, but it is having a moment again. A few months ago, I was asked to present to a policy roundtable: Advancing policy and program evaluation in Australian Government, by the Academy - [Celebrating International Day of Persons with Disabilities 2025 ](https://www.artd.com.au/news/celebrating-international-day-of-persons-with-disabilities-2025/) - In 1992, the United Nations General Assembly (GA) marked 3 December as the International Day of Disabled Persons (IDPwD). (1) This day is an opportunity to reflect on how we can create a more inclusive and equitable society for the 5.5 million Australians living with disability. (2) The 2025 theme, ‘fostering disability-inclusive societies for advancing social progress,’ challenges - [2025 Reflections](https://www.artd.com.au/news/2025-reflections/) - As we reach the end of another year, the familiar pairing of celebration and reflection is very much in the air. This season brings an extra sense of gratitude, and at ARTD, we find ourselves: reflecting on our impact and celebrating our shared progress (preferably with a good pudding or two). It’s been a year - [Research and evidence informed decision-making: lessons from the Queensland Disaster Management Research Forum](https://www.artd.com.au/news/research-and-evidence-informed-decision-making-lessons-from-the-queensland-disaster-management-research-forum/) - I always gain so much when I have the opportunity to take some time out and learn from practitioners. Last week’s Queensland Disaster Management Research Forum, held by the Office of the Inspector-General of Emergency Management (IGEM) in Brisbane was no different. Given our team’s focus on evaluations in the disaster recovery and resilience, environmental - [Learnings from working with co-researchers with intellectual disability](https://www.artd.com.au/news/learnings-from-working-with-co-researchers-with-intellectual-disability/) - In the disability sector, the philosophy of ‘nothing about us without us’ has gathered steady momentum. As evaluators, we need to evolve our methodologies to identify more participatory ways of working and ensure our approaches recognise the expertise of people with disability. Working alongside people with disability as co-researchers to design and deliver evaluations helps - [Seeing the Forest for the Trees: Are we evaluators?](https://www.artd.com.au/news/seeing-the-forest-for-the-trees-are-we-evaluators/) - Are we evaluators? We’ve been asking ourselves this question a lot over the past year. So, Naomi and I (Sophie) headed to our first Australian Evaluation Society (AES) Conference in Canberra (Ngunnawal and Ngambri Country) to find out more. We come from completely different worlds: Naomi’s background is in social and political science and international - [AES Conference - Day 2, 'the inspirening'](https://www.artd.com.au/news/aes-conference-day-2-the-inspirening/) - Several of our staff are at the AES Conference this week. Whether you’re attending and want an overview of sessions you couldn’t get to, or you weren’t able to make it and are having FOMO, we’ve got you with our daily recaps. Sarah Schofield - the view from the booth This is my sixth year - [Meet our people - Greta Westermann](https://www.artd.com.au/news/meet-our-people-greta-westermann/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? I think similar to most of my colleagues I did not dream of a career as an evaluator but rather stumbled into it. I started my working career as a theatre nurse in - [AES Conference Day 3 - of foxes, hedgehogs and owls](https://www.artd.com.au/news/aes-day-3/) - Who wanted to be an evaluator ever since they were a kid? Not too many of us, going by the show of (zero) hands at today’s Ignite presentation, Am I an Evaluator Yet?, from ARTD’s own Leah Carroll and Simon Alaba. But today I learned there's a children’s book about evaluation, Eva the Evaluator* (featured - [Day 1 at AES25 in Canberra](https://www.artd.com.au/news/day-1-at-aes25-in-canberra/) - Several of our staff are at the AES Conference this week. Whether you’re attending and want an overview of sessions you couldn’t get to, or you weren’t able to make it and are having FOMO, we’ve got you with our daily recaps. The first thing I probably should say is I might be an AES - [Fit for purpose evaluation #3 - Propositional evaluation as a structure for a rigorous developmental approach](https://www.artd.com.au/news/fit-for-purpose-evaluation-3-propositional-evaluation-as-a-structure-for-a-rigorous-developmental-approach/) - In choosing a fit for purpose evaluation one of the most important considerations is whether the evaluation should be developmental, formative or summative. This decision will often be driven by the stage of development of a policy or program in terms of what can usefully be known about it. This should depend largely on its - [Fit for purpose evaluation #2 - the lens determines what you can see](https://www.artd.com.au/news/fit-for-purpose-evaluation-2-the-lens-determines-what-you-can-see/) - This is the second in the Fit for Purpose Evaluation blog series. Read the first blog here. When we look at the world with the naked eye we do so through a lens. Not just physical, but also metaphorical. Much ink has been spilled on different philosophies and social science theories that can explain the - [Reflections from the State of Emergency panel at the All about Women Festival](https://www.artd.com.au/news/reflections-from-the-state-of-emergency-panel-at-the-all-about-women-festival/) - This International Women’s Day, Natalie Martino and Stephanie Quail took some time out of their weekend to listen to Zahara Al Hilaly, Rosie Batty, Kylie Cripps, Jess Hill and July Inman Grant (and moderator Jamila Rizvi) discuss Australia’s domestic and family violence crisis at the State of Emergency panel at the All About Women Festival. - [Introducing a National Evaluation Framework for evaluation of mental health and suicide prevention initiatives](https://www.artd.com.au/news/introducing-a-national-evaluation-framework-for-evaluation-of-mental-health-and-suicide-prevention-initiatives/) - Evaluation can be an important tool in working together towards a better mental health and suicide prevention system and better outcomes. Good quality evaluations provide program managers, staff and funders with evidence to inform decisions about quality improvement and funding, and inform service users about the quality of programs and services. Evaluation also has the potential - [Meet our people - Sophie Henness](https://www.artd.com.au/news/meet-our-people-sophie-henness/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? I was in the last year of my degree in data science and psychological science when I spoke to an ARTD member at a university networking event. I was inspired by their passion - [The kids steal the show: NAIDOC's 50th year celebrations](https://www.artd.com.au/news/the-kids-steal-the-show-naidocs-50th-year-celebrations/) - Last Thursday Koobara Kindergarten, on Brisbane’s Northside, hosted their annual NAIDOC Community Fun Day event. The event brings together the local Aboriginal and Torres Strait Islander community members and many of the organisations they run and services they utilise for a day of family-focussed fun. ARTD’s Associate Uncle Syl Johns has been attending the event - [Unpacking the value of Collaboration](https://www.artd.com.au/news/unpacking-the-value-of-collaboration/) - ARTD Consultant Fergus Bailey continues his blog series unpacking ARTD’s values. In this instalment, he focuses on how our team were able to focus on improving our collaboration skills during our recent staff retreat. Maybe I’m hard to please, but I have never been fully satisfied by a definition of collaboration. It’s entirely possible I - [Lessons Learned: Online Focus Groups with Young People](https://www.artd.com.au/news/lessons-learned-online-focus-groups-with-young-people/) - We recently facilitated online focus groups with an unusual and challenging set up for an evaluation of a youth program. While we the evaluators joined the videoconference from our laptops individually, the participants – a group of children and young people who knew each other – were physically present in the same room together. In - [Meet our people – Erin Seeto](https://www.artd.com.au/news/meet-our-people-erin-seeto/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? My path to evaluation is anything but traditional. I started my career as a graphic designer, then transitioned to public health, where I was first introduced to this field. Through my previous role, - [New article - two-steps to manage the risk of program failure](https://www.artd.com.au/news/new-article-two-steps-to-manage-the-risk-of-program-failure/) - If you've been reading ARTD's posts for a while, you may have already heard about our Chief Evaluator Andrew Hawkins' Propositional Evaluation approach. In this article (EJA online early access), Andrew and collaborator Scott Bayley take a deep dive into Propositional Evaluation. Propositional Evaluation "emphasises the creation of ‘sound’ programs through logical validity and empirical - [Meet our people – Maia Grange](https://www.artd.com.au/news/meet-our-people-maia-grange/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? I initially chose to study psychology because I wanted a career helping people. However, I quickly realised that being a psychologist wasn’t the right fit for me. It was during my honours year - [A reflection (and thematic analysis) of AES2024](https://www.artd.com.au/news/a-reflection-and-thematic-analysis-of-aes2024/) - For this year’s Australian Evaluation Society International Evaluation Conference held last week in Melbourne, a truckload of us from ARTD (or, in Victorian parlance, about an AFL side’s worth) made our way down to Melbourne to run workshops, give talks, speak on panels, moderate sessions, connect with the evaluation community and, of course, soak up - [Children and young people affected by disasters – lessons on impacts and recovery ](https://www.artd.com.au/news/children-and-young-people-affected-by-disasters-lessons-on-impacts-and-recovery/) - Australia is experiencing more natural disasters, more frequently. As evaluators, we’re working on an increasing number of programs in disaster preparedness, recovery, and resilience. To build my knowledge about ‘what works’ I attended a fantastic webinar held early in 2024 by the Australian Institute of Family Studies called ‘Supporting family and child mental health in - [Lessons learnt evaluating grant programs](https://www.artd.com.au/news/lessons-learnt-evaluating-grant-programs/) - Many different types of programs are delivered through grants – from regional development through local infrastructure to bushfire responses. The intention is to select appropriate local organisations to deliver tailored responses to support outcomes in their local communities. When it comes to evaluating grants, funders generally want to understand: the appropriateness of the design efficiency - [Getting your icebreaker right](https://www.artd.com.au/news/getting-your-icebreaker-right/) - What’s your favourite icebreaker? You may not be able to remember ones that have worked well – that’s because the best icebreakers don’t stand out like a sore thumb. They just feel like a conversation between new friends, or like collaboration. Getting icebreakers right is important when facilitating any sort of session, but even more - [Meet our people - Ellen Wong](https://www.artd.com.au/news/meet-our-people-ellen-wong/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? I had recently completed my Honours year in Environmental Studies and discovered I had a real passion for qualitative research. In my first year after graduating, I began working as a casual academic - [How I ate an elephant - evaluating system change in bite size chunks](https://www.artd.com.au/news/how-i-ate-an-elephant-evaluating-system-change-in-bite-size-chunks/) - Systems change has been described as 'counter-structural' and 'counter-cultural' – to which it might be added that evaluation may be counter-intuitive. Mental models for evaluation need to adjust to what can be learned about the value of interventions into complex systems - or how to evaluate like you are eating an elephant. Evaluation often focuses - [You and me and NAIDOC](https://www.artd.com.au/news/you-and-me-and-naidoc/) - Aunty Julie Smith, Aboriginal Associate of ARTD shared some of her thoughts about NAIDOC with one of ARTD’s Senior Managers Paula Shaw, who is based in Brisbane. Julie and Paula have worked together on a range of projects such as an evaluation of the Women’s Bail Support program and the Queensland Crime and Corruption Committee’s - [Meet our people – Leah Carroll](https://www.artd.com.au/news/meet-our-people-leah-carroll/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? My journey to evaluation was not clear-cut. If you had asked me two years ago what evaluation was, I wouldn’t have been able to give you an exact answer. At that time, I - [Learning and applying evaluation theory - the highs and lows in the first year doing evaluation](https://www.artd.com.au/news/learning-and-applying-evaluation-theory-the-highs-and-lows-in-the-first-year-doing-evaluation/) - It is not always necessary to have a thorough knowledge of every theory in a particular field in order to be able to work in it. But I have often found that getting to grips with at least some theory – the underpinning assumptions, frameworks created, limitations that exist as well as general gaps in - [Getting the Balance Right for Qualitative Data Collection](https://www.artd.com.au/news/getting-the-balance-right-for-qualitative-data-collection/) - The last sweet days of summer are stretching out long in the orchard, and you are, once again, Simon’s fruit grower, inspecting your harvest. You have a barn overflowing with all the fruits you gathered using your chosen sampling method. What does this bounty tell you about the orchard? Or, in other words, data collection - [Engaging Children and Young People](https://www.artd.com.au/news/engaging-children-and-young-people/) - Involving children and young people in evaluation involves careful thought and consideration. When working with diverse groups of people who face barriers to participating in evaluation activities, including children and young people, there are particular ethical considerations. Research designs involving children and young people must account for ethical considerations such as their capacity to understand - [Unpacking the value of creativity](https://www.artd.com.au/news/unpacking-the-value-of-creativity/) - Our business is values driven. But it’s one thing for our values to be on our website, and quite another for us to live them out. In this blog, Fergus Bailey continues his series unpacking our values, this time focusing on creativity. There is always more in the world we don’t understand than that which - [Organisational Evaluation of Beyond Blue](https://www.artd.com.au/news/organisational-evaluation-of-beyond-blue/) - Beyond Blue is one of Australia’s most well-known, trusted, and visited mental health organisations. Every three years, Beyond Blue engages an external evaluation team to conduct an independent evaluation of the organisation. In 2021, ARTD was engaged to design and deliver the fifth independent evaluation of Beyond Blue. The evaluation covered Beyond Blue’s external facing - [Our First Year at ARTD](https://www.artd.com.au/news/our-first-year-at-artd-3/) - Like many evaluators, we all brought different backgrounds and skills to the table when we started. But after a year, we've learned a lot about ourselves, our abilities, and the sectors we work in. We've enjoyed the journey of growth, collaborating with supportive colleagues and contributing to projects from start to finish. As we mark - [Sampling with purpose: 7 approaches for qualitative research](https://www.artd.com.au/news/sampling-with-purpose-7-approaches-for-qualitative-research/) - Imagine yourself as a fruit grower. It’s been a great season, and your trees are abundant with apples, peaches, and plums. One day you decide to pick some fruit to make homemade jam. With so many fruits to choose from, how do you decide which fruits to use? This question is essentially one about sampling. - [7 tips: Neuroinclusive hiring practices for neuroinclusive workplaces](https://www.artd.com.au/news/7-tips-neuroinclusive-hiring-practices-for-neuroinclusive-workplaces/) - ARTD is an advocate for developing neuroinclusive workplaces, both through our work with organisations such as Amaze and in our own approach to workplace development. This is important because 1 in 3 Autistic people that are in the labour force are unemployed (compared with 1 in 6 people with disability, and 1 in 30 Australians - [Unpacking the Value of Commitment](https://www.artd.com.au/news/unpacking-the-value-of-commitment/) - Our business is values driven. But it’s one thing for our values to be on our website, and quite another for us to live them out. In this blog, Fergus Bailey unpacks the value of commitment. Our whole of company meetings are an opportunity for us to build a shared understanding of our values. At - [Meet our people - Kate Sunners](https://www.artd.com.au/news/meet-our-people-kate-sunners/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? Meandering! After a degree in creative writing I worked in publishing and independent bookstores for a time, then in marketing and communications in the health industry before heading back to Uni to do a - [International Women's Day - Count Her In: Invest in Women. Accelerate Progress](https://www.artd.com.au/news/international-womens-day-2024/) - This year’s International Women’s Day, the United Nations has set the theme: Count Her In: Invest in Women. Accelerate Progress. It centres on women’s economic empowerment as a means for creating a gender equal world. However, the More Voices, More Representation campaign, in partnership with SSI, surveyed 202 women, trans, gender diverse and non-binary people - [Decoding Connections: Social Network Analysis for Evaluation](https://www.artd.com.au/news/decoding-connections-social-network-analysis-for-evaluation/) - Measuring and visualising the number of connections a person has, and the strength of those relationships is an incredibly useful means of understanding systems, processes, and the impact of programs on relationships and networks. In this blog we provide a brief overview of what social network analysis (SNA is), when and how to use it. - [ARTD’s reflections from the STOP Domestic Violence Conference 2023](https://www.artd.com.au/news/artds-reflections-from-the-stop-domestic-violence-conference-2023/) - In November 2023, Rachel, Stephanie, Sally and Theebana went to the 2023 STOP Domestic Violence Conference in Hobart. The theme of the 2023 conference was ‘the generation that ends Domestic Violence: it’s everyone’s responsibility’. The conference brought together a diverse range of speakers – from practitioners, to policymakers, as well as people with lived experience - [Reflections from the Australian Institute of Management course, ‘Fast Thinking – Confident Speaking’](https://www.artd.com.au/news/reflections-from-the-australian-institute-of-management-course-fast-thinking-confident-speaking/) - We support our staff to do professional development that aligns with their interests and professional goals. Last week, our consultant Greta attended a one-day course, ‘Fast Thinking – Confident Speaking’ by the Australian Institute of Management, and shares some of her reflections. While I unfortunately did not leave the course with a magic pill - [Meet our People - Keely Mitchell](https://www.artd.com.au/news/meet-our-people-keely-mitchell/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? After working in advertising (media buying) for a couple of years, I decided to change careers and find a job that had that focused making the world a better place. Talking to a - [Accolades for Uncle Syl Johns](https://www.artd.com.au/news/accolades-for-uncle-syl-johns/) - Last night I had the privilege of attending the 2024 Lord Mayor’s Australia Day Awards ceremony as the guest of ARTD Associate, and my friend, Uncle Syl Johns. The Awards recognised outstanding contributions to the Brisbane community primarily through volunteering. Syl was the very deserved recipient of an Australia Day Achievement Award having dedicated more - [EMBEDDING ABORIGINAL KNOWLEDGE AND PRACTICE IN WATER GOVERNANCE AND POLICY](https://www.artd.com.au/news/embedding-aboriginal-knowledge-and-practice-in-water-governance-and-policy/) - “To Aboriginal peoples, water is life. On a dry continent like Australia, fresh water is of the utmost importance. The water in rivers sustains important plants on riverbanks, and sustains wetlands where fish and turtles breed. Aboriginal peoples in the past used water from rivers for all their water needs—drinking, fishing, and washing. As well - [Wins of the Year](https://www.artd.com.au/news/wins-of-the-year/) - This year, in the two teams I’ve worked in, we’ve asked our team members in our weekly meetings what their wins or high points were from the week before. This helps us get to know what each of our team members likes most about their work and what motivates them, and it also provides a - [Meet our People - Fergus Bailey](https://www.artd.com.au/news/meet-our-people-fergus-bailey/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation/ARTD? I have had a very diverse range of work experiences, from fashion to bartending to music to tutoring. So when I finished up my Philosophy degree, I really wasn’t sure what I wanted - [On Meanjin & Maiwar](https://www.artd.com.au/news/on-meanjin-maiwar/) - This NAIDOC Week we are collectively reflecting on and learning about the survival, history, living culture and achievements of Aboriginal and Torres Strait Islander peoples. This week our teams have been invited to reflect on our connections to the Aboriginal lands on which we work, and on the excellence in evaluation practice being showcased by - [Evaluation vs Research: what's the difference and why does it matter?](https://www.artd.com.au/news/evaluation-vs-research-whats-the-difference-and-why-does-it-matter/) - It’s not always easy to draw a line between research and evaluation. The difference between them is a long-running debate with few clear answers. Some say evaluation is a subset of research; some say vice versa. Others see them as entirely separate things, or are unaware of a difference: In my fieldwork as an evaluator, - [Everyone has a role to play- we can play that role better together](https://www.artd.com.au/news/everyone-has-a-role-to-play-we-can-play-that-role-better-together/) - Ahead of World Suicide Prevention Day on 10 September, we sat down with our Senior Manager Sharon Marra-Brown to hear her perspectives on the theme this year ‘Everyone Has a Role to Play’. Sharon has been leading our team’s work on various evaluations of suicide prevention and postvention programs. The amazing thing about the work - [JOIN US AT AES23 BRISBANE!](https://www.artd.com.au/news/join-us-at-aes23-brisbane/) - We’re excited to see a fantastic array of interesting evaluation topics in the AES23 Conference program, and are pleased to see several of our colleagues on the bill for workshop and conference sessions! We're keen to catch up with everyone, whether it's at one of the below workshops or sessions, or playing fun games at - [AES Panel: the role of evaluation in the APS reform agenda](https://www.artd.com.au/news/aes-panel-the-role-of-evaluation-in-the-aps-reform-agenda/) - The recent elevation of evaluation in the national dialogue - through the announcement of an Australian Centre for Evaluation in Treasury presents an important opportunity for evaluation. At the very least, we evaluators may get fewer blank looks when asked what we do at dinners and events. But it also has the potential to enhance - [Responding to complexity in evaluation](https://www.artd.com.au/news/responding-to-complexity-in-evaluation/) - Good public policy responds to complexity: it attempts to understand the context into which the policy will be implemented and ultimately, achieve outcomes. That’s not an easy thing to do. In a recent webinar, I shared three practical tools for designing and evaluating strategic responses to complex issues, and in complex environments namely: systems thinking, - [EVALUATION MATURITY MODELS TO HELP BUILD AN EVALUATION CULTURE AND CAPABILITY](https://www.artd.com.au/news/evaluation-maturity-models-to-help-build-an-evaluation-culture-and-capability/) - As an organisation with a vision for a more thoughtful world, in which citizens and decision-makers use evaluative tools to design and refine action for the public good, we're optimistic about the potential of having an Evaluator General. It is great to see the Evaluator General’s proposed focus on building an evaluation culture and evaluation - [Evaluator Lessons and Challenges – with Sharon](https://www.artd.com.au/news/evaluator-lessons-and-challenges-with-sharon/) - How do you explain evaluation? I always manage to have jobs that are impossible to explain when someone casually asks you what you do at lunch. Sometimes I think I should just make up a profession but I imagine that could lead to even more awkwardness. Generally, I tell people that I work with government - [Evaluator Lessons and Challenges - with Jade](https://www.artd.com.au/news/evaluator-lessons-and-challenges-with-jade/) - How do you describe evaluation? It depends who I'm talking to – how much they know, their attitude to and experience of evaluation. I like Scriven's definition - "the systematic process to determine merit, worth, value, or significance" of a thing (whether that be an organisation, policy or program). I might translate this to helping - [Evaluator Challenges and Lessons - with Emily](https://www.artd.com.au/news/evaluator-challenges-and-lessons-with-emily/) - How do you explain evaluation? I say that I help governments make good decisions about where they’re placing their effort. And then I give an example, using something I know the person is interested in or will understand because of the work they do. The problem with this strategy is that people variously think I’m - [Evaluation Failures – learning the lessons so we don’t repeat them](https://www.artd.com.au/news/evaluation-failures-learning-the-lessons-so-we-dont-repeat-them/) - Learning from humanity’s collected and often repeated mistakes is at the heart of evaluation, and I’ve found evaluators more willing than most to open up about the things they didn’t do well, or they wished they’d done better in hindsight. In a recent chat, Ralph Renger shared some of his own valuable lessons about applying - [Impact news: evaluation leads to improvements to domestic violence risk assessment tools](https://www.artd.com.au/news/impact-news-evaluation-leads-to-improvements-to-domestic-violence-risk-assessment-tools/) - ARTD's evaluation of Safer Pathways report referenced in the NSW Domestic Violence Death Review Team Report 2019-2021, and recommendations progressed. - [Reflections on 2022 - Emily Yorkston](https://www.artd.com.au/news/reflections-on-2022-emily-yorkston/) - As the year draws to a close, our ARTD team have been reflecting on what we’ve learnt and achieved. In this blog, Emily Yorkston writes about ARTD’s evaluation of the Southport Specialist Domestic and Family Violence Court Justice Response, which concluded in mid-2022. In the afternoon of 19 February 2020, I sat in the glass - [Systems Evaluation Theory bookchat with Ralph Renger](https://www.artd.com.au/news/systems-evaluation-theory-bookchat-with-ralph-renger/) - Ralph Renger is a leader in the field of systems evaluation, and a household name for evaluators. He’s recently published System Evaluation Theory – A Blueprint for Practitioners Evaluating Complex Interventions (just in time for Christmas gifting to your best evaluator buddy). The book provides a simple three-step framework for applying systems evaluation theory in - [What's it like to be an intern at ARTD?](https://www.artd.com.au/news/whats-it-like-to-be-an-intern-at-artd/) - Eoghan Flanagan was an intern at ARTD from July to November 2022. Whilst juggling the final undergraduate year of his BA in International Relations, and a role in IT in radiology, Eoghan has been a great support to our project teams as well as our operations teams. In this blog he tells us a bit - [Queensland Housing Legislation Amendment Act amongst Australia's best new legislation of 2022: underpinned by evidence collected by ARTD](https://www.artd.com.au/news/queensland-housing-legislation-amendment-act-amongst-australias-best-new-legislation-of-2022-underpinned-by-evidence-collected-by-artd/) - Consultation that counts Each year, the Evidence Based Policy Research Project ranks state and federal legislation against the Wiltshire Criteria for evidence based and consultative public policy. In this year’s review, the Queensland Housing Legislation Amendment Act scored 10 (out of a possible 10), making it one of the year’s best examples of a good - [Evaluation for place based community-led programs](https://www.artd.com.au/news/evaluation-for-place-based-community-led-programs/) - Several sessions at this year’s Australian Evaluation Society conference drew together reflections from funders, community organisations and evaluators collaborating to deliver community-led change initiatives. Many of these initiatives adopt developmental approaches, creating space for communities to co-create the solutions that respond to their local contexts. We’ve written about approaches to developmental evaluation here. In this - [WORKING WITH LIVED EXPERIENCE RESEARCHERS: A PRACTICAL FRAMEWORK](https://www.artd.com.au/news/working-with-lived-experience-researchers-a-practical-framework/) - At AES22, ARTD Consultants’ Jade Maloney, Sharon Marra-Brown, Alexandra Lorigan and Holly Kovak presented on a panel with peer researchers, Kirsty Rosie and Rosie Dale, on the practicalities of working with lived and living experience (LLE) researchers. Subscribe to our newsletter for access to the framework, our reflections, and to read a peer researcher's perspective - [How evaluation knowledge and skills can enhance disability inclusion action planning](https://www.artd.com.au/news/how-evaluation-knowledge-and-skills-can-enhance-disability-inclusion-action-planning/) - The Disability Discrimination Act 1992 (Cth) encourages organisations to develop plans to eliminate discrimination against people with disability, address structural discrimination and promote the rights of people with disability. Each jurisdiction legislates differently to require organisations to develop a Disability Inclusion Action Plan (DIAP or DAP) but given 1 in 6 Australians experience disability[1], it’s likely - [Meet our People - Mitchell Rice-Brading](https://www.artd.com.au/news/meet-our-people-mitchell-rice-brading/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I hadn’t heard of evaluation before starting at ARTD! I studied Psychology with a desire to help people and one day a lecturer spoke about how there are opportunities beyond 1-on-1 - [Announcing: A new Aboriginal-led company and ARTD partnership!](https://www.artd.com.au/news/announcing-a-new-aboriginal-led-company-and-artd-partnership/) - It’s with great excitement that we share with you the news that Simon Jordan, our Director of Aboriginal Projects and Partnerships is launching Nama Jalu Consulting as an Aboriginal-led social enterprise, through which he will continue his work with and for Aboriginal communities and organisations. Simon will be joined by Holly Kovac and Kieran Sobels, - [Amaze Change Your Reactions Campaign Awarded](https://www.artd.com.au/news/amaze-change-your-reactions-campaign-awarded/) - It was great to see Amaze’s #ChangeYourReactions education campaign recognised as joint winners of the Victorian Disability Award, in the category of Excellence in Creating Inclusive Communities. “Change Your Reactions was created to promote greater understanding of Autistic people, and time and time again we have heard the positive responses to it from Autistic people - [What can evaluators and policy makers learn from 'Wreck This Picture Book'?](https://www.artd.com.au/news/what-can-evaluators-and-policy-makers-learn-from-wreck-this-picture-book/) - In a past life, I was a children’s book buyer for an independent bookstore. One of my favourite things in life is reading picture books to kids, and some of the best ones I’ve found are the ones that subvert the rules of story or genre, surprising the reader and inviting them to reconsider their - [See you at AES22!](https://www.artd.com.au/news/see-you-at-aes22/) - We have a large contingent of ARTD folk attending the upcoming 2022 AES Conference in Adelaide, with preparations well underway for a bunch of workshops and sessions, as well as some crafty and interactive games at our ARTD booth in the exhibition space. We checked in with our presenters ahead of Adelaide to see what - [Meet our people - Jade Maloney](https://www.artd.com.au/news/meet-our-people-jade-maloney/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? As an undergrad I studied international studies and communications (journalism). But while I loved asking people questions, journalism wasn’t for me. I wanted to do more than capture people’s stories. So - [Meet our people - Natalie Martino](https://www.artd.com.au/news/meet-our-people-natalie-martino/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I studied a Bachelor of Social Science and a Bachelor of Laws at Macquarie University, so I got a taste of evaluation from my social science degree. After completing the College - [Meet our people - Andrew Hawkins](https://www.artd.com.au/news/meet-our-people-andrew-hawkins/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I have been fascinated by the concept of an ideal society since I was 16 and read Thomas More’s Utopia. The introduction referred to Plato’s Republic. This blew my mind. I - [Impact News: Evaluation of the Southport Specialist Domestic Violence Court Justice Response](https://www.artd.com.au/news/impact-news-evaluation-of-the-southport-specialist-domestic-violence-court-justice-response/) - Since 2019, ARTD has been working with the Department of Justice and Attorney–General to evaluate the Southport Specialist Domestic and Family Violence Court Justice Response (SSDFVCJR). SSDFVCJR was established as a coordinated, respectful, and fair court-based justice response to domestic and family violence (DFV) that prioritises victim safety, holds perpetrators accountable and promotes innovation and - [Meet our people - Gerard Atkinson](https://www.artd.com.au/news/meet-our-people-gerard-atkinson/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I’m not sure there’s a standard path into evaluation, but looking back I have been doing work that had evaluative components for a long time – one of my first jobs - [From recovery to resilience: how can evaluation support community resilience building?](https://www.artd.com.au/news/from-recovery-to-resilience-how-can-evaluation-support-community-resilience-building/) - As Australian communities are increasingly impacted by extreme weather events and natural disasters, the government and community sectors supporting preparedness and recovery need more accurate information on what works for whom with resilience building efforts at the individual, household, organisational, community, and societal levels. Context, context, context As Covid has continuously reminded us, everything in - [Trauma-informed interviewing - tips and reminders](https://www.artd.com.au/news/trauma-informed-interviewing-tips-and-reminders/) - Many of our recent projects have involved interviews with people around traumatic and distressing subjects. From projects in palliative care and suicide prevention, to working with Aboriginal and Torres Strait Islander people who experience the inter-generational impacts of colonialism and systemic racism, it is essential that our interviewers and focus group facilitators take a trauma-informed - [Everything you ever wanted to know about Qualitative Comparative Analysis (QCA) but were too afraid to ask](https://www.artd.com.au/news/everything-you-ever-wanted-to-know-about-qualitative-comparative-analysis-qca-but-were-too-afraid-to-ask/) - While a fuzzy-set may sound like something you’d hear at a punk show, and a crisp-set might get your mouth watering, these are in fact, just two of the terms from the jargon filled world of Qualitative Comparative Analysis (QCA). While there are few QCA practitioners in Australia (but with an active community in Europe - [Meet our people - Brad Astbury](https://www.artd.com.au/news/meet-our-people-brad-astbury/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I was introduced to the field of evaluation in the early 2000s while working as a researcher and lecturer in the criminal justice department at RMIT University. Through this role I - [Meet our people - Ken Fullerton](https://www.artd.com.au/news/meet-our-people-ken-fullerton/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? After returning to Australia having studied abroad (Germany) and having worked as a consultant in International Development on projects in South Africa, Tanzania and Uganda, I was keen to continue trying - [Meet our People - Paula Shaw](https://www.artd.com.au/news/meet-our-staff-paula-shaw/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? My path to evaluation was a bit of a winding road. Fresh from Uni, I fluked a role in social impact assessment (which I see as maybe a sibling to evaluation) - [Facilitation and moderating a focus group](https://www.artd.com.au/news/facilitation-and-moderating-a-focus-group/) - Focus groups are structured conversations to explore people’s attitudes and key concerns. People interact differently in groups than one-on-one, so managing group dynamics is a key part of a focus group moderator’s role. This requires the moderator to be well prepared and practiced in a number of soft skills. We've developed a tip sheet that - [Meet our People - Jack Rutherford](https://www.artd.com.au/news/meet-our-people-jack/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I had just finished my honours degree, which, while challenging and ultimately satisfying, solidified the idea that I didn’t want to be an academic. I was also doing conservation fieldwork in - [Meet our People - Sally Evans](https://www.artd.com.au/news/meet-our-people-sally-evans/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I started at ARTD in 2020 as a Research Assistant as an Economics graduate with no specific evaluation experience. ARTD was my first professional job, so in addition to learning about - [Timescale in program design and iteration](https://www.artd.com.au/news/timescale-in-program-design-and-iteration/) - In our previous blog, on scale, we asked ‘Is bigger always better?’ (spoiler alert: it depends!). In this blog we consider the implications of time scales. Our work asks us to conceptually move between the past, present and future. We help program planners and decision makers to identify the current state and map our way - [Meet our People - Sharon Marra-Brown](https://www.artd.com.au/news/meet-our-people-sharon-marra-brown/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I first learned about evaluation theory during my Masters degree, and we actually travelled to Tonga to complete an evaluation of an aid project over there. It was an amazing experience, - [On Scale: Is Bigger always Better?](https://www.artd.com.au/news/on-scale-is-bigger-always-better/) - When you have a successful pilot program, it’s commonly accepted that the next step is scaling it up. But is a larger scale always best? What are the assumptions? Scale plays such an enormous role in the success or failure of so many elements of public life: the structuring of organisations (government, businesses, schools, NGOs - [Reflecting on 2021: Managing risk and collaboratively coding qualitative data](https://www.artd.com.au/news/reflecting-on-2021-managing-risk-and-collaboratively-coding-qualitative-data/) - As we settle into the new year, we are adjusting back into earlier mornings and busier schedules (with, of course, plenty of coffee). As we plan for the year ahead, we are also taking time to reflect on the year that passed and what we can learn and take with us into our new work. - [Meet our People - Solina Sok](https://www.artd.com.au/news/meetsolina/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I first joined ARTD as an intern – I was in my final year of studying a Bachelor of Social Work at university and had a list of organisations to choose - [Meet our People - Emily Yorkston](https://www.artd.com.au/news/meet-our-people-emily-yorkston/) - Find out more about our staff, their roles, and what their day to day looks like! Meet Emily Yorkston, Partner at ARTD and learn about her journey into evaluation. - [Meet Our People - Alexandra Lorigan](https://www.artd.com.au/news/meet-our-people-alexandra-lorigan/) - Find out more about our staff, their roles, and what their day to day looks like! What was your path into evaluation and ARTD? I had just finished my Bachelor degree in Economics/ Arts and while the subject matter interested me, I didn’t necessarily want to pursue a career in Economics or Development Studies. I’d - [Getting the evaluation deliverable you want: ‘Paint Done’ and give gold star feedback](https://www.artd.com.au/news/getting-the-evaluation-deliverable-you-want-paint-done-and-give-gold-star-feedback/) - Brene Brown (all hail) has two phrases which we think provide a perfect framework to help you get the evaluation deliverable of your dreams: ‘Paint done for me’ and ‘Clear is Kind’ (more on these at Do Good Better). Baking clarity into an evaluation from the beginning requires conversations between the evaluation commissioner, and evaluator/s - [Coproduction in public policy – lessons from the Queensland Housing Strategy Research and Evaluation Program](https://www.artd.com.au/news/coproduction-in-public-policy-lessons-from-the-queensland-housing-strategy-research-and-evaluation-program/) - Learnings in coproduction of knowledge in public policy from ISSR and ARTD’s work on the Research and Evaluation Program of the Queensland Housing Strategy. - [Excel Tips for Data Wrangling: Lookups](https://www.artd.com.au/news/excel-tips-for-data-wrangling-lookups/) - Excel is a great tool, but what do you do if you need to find and a return a value in your dataset? That’s where lookup functions come in. There are a variety of ways to search for, and then return, a value to the cell you’re working in. The simplest of these are: VLOOKUP—a - [Excel Tips for Data Wrangling: Multiple Criteria Lookups in Excel](https://www.artd.com.au/news/excel-tips-for-data-wrangling-multiple-criteria-lookups-in-excel/) - In our second blog on Excel Tool Tips we look at using INDEX(Match) and XLOOKUP to return a value which meets the constraints of a search with multiple criteria. - [Riding the rubric wave](https://www.artd.com.au/news/riding-the-rubric-wave/) - The interest in rubrics is justified. Rubrics are an excellent tool for conducting and communicating the results of evaluation, and one of the few tools for making explicit evaluative judgments. - [Synthesising mixed data to reach defensible evaluative conclusions](https://www.artd.com.au/news/synthesising-mixed-data-to-reach-defensible-evaluative-conclusions/) - As evaluators, we try our best to make sense of different types of data to establish evaluative conclusions about program effectiveness. However, when measuring a program’s impact, this can be challenging if your qualitative and quantitative data sources are telling differing stories. This raises the question about how to make judgments about a program’s impact - [Bringing evidence together with Stolen Generation survivors' voices for an Award-Winning Practice Framework](https://www.artd.com.au/news/bringing-evidence-together-with-stolen-generation-survivors-voices-for-an-award-winning-practice-framework/) - ARTD and Kinchela Boys Home Aboriginal Corporation (KBHAC) have received the Australian Evaluation Society’s Awards for Excellence in Evaluation in the Enhancing the Social Good category for their work together on KBHAC’s Practice Framework. The Enhancing Social Good Award recognises exemplary evaluation work that has substantially enhanced the social good and is particularly focused on - [Evaluation Governance: Working with an advisory group to add value](https://www.artd.com.au/news/evaluation-governance-working-with-an-advisory-group-to-add-value/) - Evaluators are often hired because of their knowledge of evaluation theory, design and program implementation. Or some fall into the role because of their content area knowledge accumulated in another career. Very few of us have the technical expertise or lived experience to plan and implement evaluations in every complex social policy area. So, it - [Critical Foundations of Survey Design](https://www.artd.com.au/news/critical-foundations-of-survey-design/) - Surveys are a much used tool for gathering quantitative and qualitative evaluation data. On the surface, a survey is simply a list of questions. Easy! Just write down what you want to know about someone’s perceptions, knowledge, attitudes or behaviours, and press send. Yes, and no. Surveys are only valid, reliable and useful when underpinned - [Thoughts on Michael Quinn Patton’s Criteria for Evaluating Transformation](https://www.artd.com.au/news/thoughts-on-michael-quinn-pattons-criteria-for-evaluating-transformation/) - Some takeaways from Michael Quinn Patton's recent article. - [Speaking honour at the Young Indigenous Women's STEM Academy](https://www.artd.com.au/news/speaking-honour-at-the-young-indigenous-womens-stem-academy/) - ARTD Analyst Holly Kovac was recently invited to speak at a Young Indigenous Women’s STEM Academy (YIWSA) National Assembly online. Holly is part of the ARTD team evaluating the Indigenous Girls STEM Academy, delivered by CSIRO in partnership with Career Trackers and the National Indigenous Australians Agency. YIWSA, the Student Initiative component of the Indigenous - [Let's Get Digital](https://www.artd.com.au/news/lets-get-digital/) - Earlier this year Ken attended the Evaluation Learning Sprint webinar on Digital Evaluation with Dr Samantha Abbato, Director of Visual Insights People. It covered the benefits and challenges of using digital film and other moving elements for everything from data collection to reporting. It sounded so appealing that Kate recently attended the two-day ‘Making it - [More than a Word. Reconciliation takes action.](https://www.artd.com.au/news/more-than-a-word-reconciliation-takes-action/) - Reconciliation Week is a time to reflect on what we can contribute to achieving reconciliation in Australia. This year’s theme encourages action, and emerges from Reconciliation Australia’s State of Reconciliation Report, which notes that ‘we need to move more of our effort from focussing on the preconditions for reconciliation, to focussing more on substantive change.’ - [Intro Guide to Evaluation for Associations, Peak Bodies and Membership Organisations](https://www.artd.com.au/news/intro-guide-to-evaluation-for-associations-peak-bodies-and-membership-organisations/) - Evaluation is an essential tool for understanding the impact your association or peak body is creating. It helps you capture and elevate the needs, concerns and voices of your members; and guides your strategic response to them. But evaluation can be tricky. There are a range of conceptual approaches to evaluation, each of which has - [Taking a Breather](https://www.artd.com.au/news/taking-a-breather/) - There is nothing quite like an ice-cold shower to take your breath away. Now, try submerging yourself in a tub full to the brim with ice for two whole minutes. BUSY-NESS AS USUAL It is safe to say that it is a very busy, albeit exciting, time at ARTD. We have lots of new and - [Together in March](https://www.artd.com.au/news/together-in-march/) - It’s been almost one year since we were all together in our Sydney office. So, at our recent gathering, the excitement was palpable! We’ve missed the laughter, cross-pollination of ideas and camaraderie of being in the same place together. This year, our strategy day focussed on our culture, critical thinking and developing the human skills - [What does it mean when we talk about mixed methods?](https://www.artd.com.au/news/what-does-it-mean-when-we-talk-about-mixed-methods/) - 'Mixed methods evaluation’ is a term that gets thrown around a lot, but what is it, and what kinds of questions can it help us answer? - [Cross Cultural Communication](https://www.artd.com.au/news/cross-cultural-communication/) - Key takeaways from an online session with Fiona Peterson, CEO of The Healing Foundation and Megan Davis, Pro Vice-Chancellor Indigenous and Professor of Law, UNSW. - [Human Services Strategy Setting and Commissioning for Outcomes with Michael Brooks](https://www.artd.com.au/news/human-services-strategy-setting-and-commissioning-for-outcomes-with-michael-brooks/) - Partner Michael Brooks caught up at the end of 2020 with our Communications Officer Kate Sunners to discuss the emerging trends he's seen in human services sector strategy setting and commissioning for outcomes, during the pandemic period. In line with the NSW Government’s Commissioning and Contestability Policy, it is now contracted providers’ responsibility to design - [Continuously improving and capturing the value of NDIS Information, Linkages and Capacity Building Projects](https://www.artd.com.au/news/continuously-improving-and-capturing-the-value-of-ndis-information-linkages-and-capacity-building-projects/) - We've prepared a resource full of our learnings on co-design and co-evaluation of NDIS ILC projects, choosing the right evaluation approach, meaningful data collection and making sense of data. - [On Truth Telling](https://www.artd.com.au/news/on-truth-telling/) - Each year, Reconciliation Australia releases its State of Reconciliation Report. Evidence in this year’s report suggests Australia’s reconciliation movement is at a tipping point. Karen Mundine, Chief Executive Officer of Reconciliation Australia notes that ‘we need to move more of our effort from focussing on the preconditions for reconciliation, to focussing more on substantive change.’ - [Flexibility, Expansive Thinking and Speed](https://www.artd.com.au/news/flexibility-expansive-thinking-and-speed/) - What a year! While many of us are ready to see the back of 2020, there have also been upsides to the year. We’ve seen governments adapt rapidly, communities come together to care for each other, and organisations collaborate to deliver innovative products and services. It has been a privilege for our teams to work - [The power of partnerships: How ARTD, the University of Queensland and the Department of Housing and Public Works are evaluating the Queensland Housing Strategy](https://www.artd.com.au/news/the-power-of-partnerships-how-artd-the-university-of-queensland-and-the-department-of-housing-and-public-works-are-evaluating-the-queensland-housing-strategy/) - In 2019, The University of Queensland’s Institute of Social Science Research (ISSR) and ARTD Consultants were engaged by Queensland’s Department of Housing and Public Works (DHPW) to evaluate their ten-year Queensland Housing Strategy. We’ve worked collaboratively with our ISSR and DHPW colleagues to develop a monitoring and evaluation framework for the Strategy, and to assess - [Masterminding an evaluation approach](https://www.artd.com.au/news/masterminding-an-evaluation-approach/) - Conducting a program or policy evaluation is not always a straightforward process. But bringing stakeholders together to discuss and reflect on the best approaches to tackling evaluation challenges can really help. This is what happened on Thursday 28 June, when evaluators, non-evaluators and other industry stakeholders attended the latest AES Learning Lab in Sydney, focused - [Amplifying social impact](https://www.artd.com.au/news/amplifying-social-impact/) - How can organisations improve their evidence-based decision making and, ultimately, their social impact? This was the key focus question in the latest AES professional learning seminar held in Sydney on 21 March. Lena Etuk of the Centre for Social Impact (CSI) – a collaboration between UNSW, The University of Western Australia and Swinburne University of - [How can NGOs do evaluation on a shoestring?](https://www.artd.com.au/news/how-can-ngos-do-evaluation-on-a-shoestring/) - We know there are a range of challenges that NGOs can face when it comes to evaluation. With limited time and resources, NGOs are often left conducting evaluation ‘on a shoestring’. A recent AES seminar in Sydney explored strategies and tips for conducting lean evaluations. The session was well attended by NGOs, academics, consultants and - [Don’t train and hope: Lessons from delivering and evaluating training programs](https://www.artd.com.au/news/dont-train-and-hope-lessons-from-delivering-and-evaluating-training-programs/) - I’m a big believer in the potential of training programs. I’m part of a company that provides everyone with a personal training budget and company-wide training days, has lunchtime learning every Wednesday, and supports Australian Evaluation Society programs. Training is part of the lifelong journey that is evaluation. But I get it when my colleague, - [How can we harness systems thinking?](https://www.artd.com.au/news/how-can-we-harness-systems-thinking/) - Like co-design and nudging, systems thinking is certainly one of the buzz words of our time. At the recent Australian Evaluation Society Conference, Michael Quinn Patton challenged evaluators to move beyond programs to systems, think globally, track interconnections, crack silos and understand interdependence; while Social Design Sydney’s September event centred on how systems thinking can - [2019: A year in review](https://www.artd.com.au/news/2019-a-year-in-review/) - 2019 was a big year – turning thirty (ARTD I mean, not me.) ARTD had none of the existential angst that I felt in the lead up to that milestone, as if – overnight – life as I knew it would change irrevocably. In reality, it was more of a slow burn – letting go - [Our vision for a more thoughtful world](https://www.artd.com.au/news/our-vision-for-a-more-thoughtful-world/) - As we’ve reflected on our identity as a business, and the values we bring to our work, we realised our vision needed to adapt. I've been thinking about “vision” differently since reading Simon Sinek’s The Infinite Game. He talks about having a “just cause” that is: for something – affirmative and optimistic inclusive – open - [How can evaluation support (not thwart) community development?](https://www.artd.com.au/news/how-can-evaluation-support-not-thwart-community-development/) - As evaluators, it’s tough to hear the criticisms levelled at evaluation by community development theorists and practitioners. But, listening to their their perspective, we can see how certain approaches to evaluation – coupled with certain expectations from funders – could thwart rather than support community development initiatives. What’s the problem? Traditional formative and summative evaluation - [Want to get under the hood of how a policy or program really generates outcomes?](https://www.artd.com.au/news/want-to-get-under-the-hood-of-how-a-policy-or-program-really-generates-outcomes/) - At ARTD, we’ve long seen the value of applying a realist lens to evaluation. We understand the causal power of programs lies in the mechanisms they fire in certain contexts and that different things work for different people. We think that a realist lens has huge potential to help policy makers better select appropriate approaches - [Knowing for whom and how is as important as knowing what you’re achieving](https://www.artd.com.au/news/knowing-for-whom-and-how-is-as-important-as-knowing-what-youre-achieving/) - Settlement Services International (SSI) is one of the largest providers of Ability Links – a NSW Government-funded initiative that empowers people with disability, their families and carers to work towards their goals by building on their strengths and connecting with their local communities, and supporting local community and mainstream organisations to become more inclusive. SSI - [Part 5: Tell stories](https://www.artd.com.au/news/part-5-tell-stories/) - In a household with two little kids, we’re pretty into stories right now. My favourite children’s books are the ones with a grabby plot, a few jokes pitched squarely to the parents, and which offer an opportunity for conversation long after the final page has been turned. We’ve had some important conversations recently after reading, - [Part 2: Know your evaluation audience/s](https://www.artd.com.au/news/part-2-know-your-evaluation-audience-s/) - For evaluation to live up to its potential to improve outcomes and ensure effective targeting of limited resources, evaluation communications must cut through. The first step is to know your audience or audiences (as you will often have more than one). Knowing audience will inform the engagement channels you use, how you frame your message - [Business as unusual](https://www.artd.com.au/news/business-as-unusual/) - Over the Easter break, I spent a lot of my time stacking and unstacking the dishwasher and doing seemingly endless loads of washing. I am enormously grateful to have access to both these appliances, especially given my daughters’ current obsession with changing their clothes every time they walk past their room. Of course, the kids - [On Narrm](https://www.artd.com.au/news/on-narrm/) - Womindjeka / Wominjeka means ‘welcome’ in the language groups of the Boon Wurrung and Woi Wurrung (Wurundjeri) peoples of the Kulin Nation and in today’s blog we hear some reflections from the Victorian team and how Narrm has made them feel welcome. - [Reflecting on Aboriginal Led Evaluation](https://www.artd.com.au/news/reflecting-on-aboriginal-led-evaluation/) - Image Credit: Emma Walke This NAIDOC Week we are collectively reflecting on and learning about the survival, history, living culture and achievements of Aboriginal and Torres Strait Islander peoples. This week our teams have been invited to reflect on our connections to the Aboriginal lands on which we work, and on the excellence in - [How might we... do systemic social change?](https://www.artd.com.au/news/how-might-we-do-systemic-social-change/) - Insights from Social Design Sydney’s 'How might we...support systemic social change?' workshop: changemaking and impact in a VUCA world. - [Bringing a cultural lens to ‘evidence’](https://www.artd.com.au/news/bringing-a-cultural-lens-to-evidence/) - The increasing demand for evidence-based policies and programs Increasingly, governments committed to ‘evidence-based’ policy making are asking funded organisations to demonstrate the outcomes of their work. The landmark Their Futures Matter (TFM) reform is a prime example of this, promising that evidence, monitoring and evaluation will drive continuous improvement across all areas of service delivery - [What we’re taking forward from #aes19SYD](https://www.artd.com.au/news/what-were-taking-forward-from-aes19syd/) - At last week’s Australian Evaluation Society International Evaluation Conference, we looked at what’s inside the box of evaluation and what’s beyond it, who holds the box and how we stack up. The aim was to un-box evaluation – to open it up to the communities we work with and ourselves to community knowledge – to - [Business as unusual: making inclusive choices](https://www.artd.com.au/news/business-as-unusual-making-inclusive-choices/) - In our fourth Business as Unusual online discussion, we were joined by a panel of people with lived experience of working in inclusion. Here's what we learned. - [Business as Unusual – Assessing Engagement to Ensure it is Purposeful](https://www.artd.com.au/news/business-as-unusual-assessing-engagement-to-ensure-it-is-purposeful/) - Tools and frameworks to help evaluators and policy makers engage purposefully with stakeholders. - [Carving out space for reflection](https://www.artd.com.au/news/carving-out-space-for-reflection/) - “Daring leaders work to make sure people can be themselves and feel a sense of belonging.” - Brene Brown After a challenging few months of reacting to and reconfiguring our work for the Covid-19 environment, I was grateful to take a few days out in later July to attend the (virtual) Women and Leadership Australia - [More and more curious: What does curiosity mean for us?](https://www.artd.com.au/news/more-and-more-curious-what-does-curiosity-mean-for-us/) - When we value curiosity, it allows us to move beyond confirming what we already know, to finding new evidence or new patterns. - [Mandela Day 2020 and what it means to me and my work at ARTD](https://www.artd.com.au/news/mandela-day-2020-and-what-it-means-to-me-and-my-work-at-artd/) - Celebrated on July 18 each year, Nelson Mandela International Day – or Mandela Day – was officially declared by the United Nations in 2009 and occurs on the former South African President’s birthday. Rather than being a public holiday, the day celebrates Mandela’s life, values, struggles and dedication towards achieving social justice. The Day also - [R U OK Day](https://www.artd.com.au/news/r-u-ok-day/) - This year has been emotional and challenging in many ways. And while we’ve adapted to what life has thrown at us both professionally and personally, we believe it’s important to acknowledge it has impacted us and those around us. R U OK? Day is a national day of action that reminds us all that every - [Celebrating International Youth Day 2020](https://www.artd.com.au/news/celebrating-international-youth-day-2020/) - Since 1999, when the United Nations General Assembly endorsed the recommendation made by the World Conference of Ministers Responsible for Youth, International Youth Day (@inter_youth day) has been celebrated on 12 August each year. This year’s IYD theme is ‘Youth Engagement for Global Action’ which seeks to highlight the ways in which engaging young people - [The Power of Partnerships](https://www.artd.com.au/news/the-power-of-partnerships/) - ARTD Director Emily Verstege reflects on the necessity of partnering to evaluate complex solutions to wicked social problems. - [The Australian Evaluation Society’s FestEVAL: Four unique and compelling provocations](https://www.artd.com.au/news/the-australian-evaluation-societys-festeval-four-unique-and-compelling-provocations/) - Reflection on four very different—yet equally compelling—provocations given in the FestEVAL opening address. - [VISUAL FACILITATION: A GUIDE TO DRAWING OUT YOUR THOUGHTS](https://www.artd.com.au/news/visual-facilitation-a-guide-to-drawing-out-your-thoughts/) - What is visual notetaking and how can it help with facilitating for evaluation and knowledge translation? - [Co-evaluating Talkin’ Together](https://www.artd.com.au/news/co-evaluating-talkin-together/) - The National Disability Insurance Scheme (NDIS) is transforming the way people with disability access supports. To make the most of the NDIS, people with disability need a good understanding of their consumer rights. Building on the learnings from an initial consumer awareness initiative, Fair Trading partnered with people with disability – with Being, Community Disability - [Where to next for behavioural insights?](https://www.artd.com.au/news/where-to-next-for-behavioural-insights/) - Behavioural insights have risen rapidly on the agenda of governments around Australia and the world. This year, there are just over 200 nudge units across the world. Now that “nudge” units have been integrated into the machinery of government, behavioural economists are setting their sights on new frontiers. The buzz at Behavioural Exchange 2018, held - [INTERN TO MANAGER: WHAT I LEARNT AT ARTD](https://www.artd.com.au/news/intern-to-manager-what-i-learnt-at-artd/) - It is with very mixed emotions that I write this blog. It marks my final blog for ARTD, at least for a little while, as I set off on a new path at the Workplace Gender Equality Agency next week. From data entry intern at 18 years old to evaluation Manager, my eight years here - [Our First Year at ARTD](https://www.artd.com.au/news/our-first-year-at-artd-2/) - ARTD’s Analysts and Research Assistants support senior staff across multiple evaluations. Read about Jess, Tom and Thaher’s first year working in evaluation. - [Ancient wisdom and systems evaluation](https://www.artd.com.au/news/ancient-wisdom-and-systems-evaluation/) - As I sit down to reflect on this Mabo day I am listening to my most played Spotify song of 2019 – My Island Home by the Warumpi band. Spotify serves up an eclectic mix of songs that provides me with a window into my heart and reason to contemplate my soul. It gives me - [Celebrating World Environment Day 2020](https://www.artd.com.au/news/celebrating-world-environment-day-2020/) - On Friday 5 June 2020, many people and countries around the world will recognise and celebrate World Environment Day (#WorldEnvironmentDay). Established in 1974, World Environment Day ‘is the most renowned day for environmental action’ and encourages governments, businesses, celebrities, and citizens to focus their efforts on a pressing environmental issue. This year’s World Environment Day - [Sensemaking Under Pressure](https://www.artd.com.au/news/1570/) - Sensemaking Under Pressure We have all been challenged to rethink the way we work; at the organisational, team, program and evaluation level. More than ever, we are observing the interconnectedness of our decision-making: choices we make in one aspect of a program or an evaluation, have widespread consequences. As systems expert, Donella Meadows, notes: “Systems - [On context](https://www.artd.com.au/news/on-context/) - One of the most important considerations in determining a useful approach to any evaluation is the importance of context to the success of the initiative. Context is the battleground on which rival orientations to evaluation must and do engage. The old, the middle-aged and the new traditions of experimental, realist and systems approaches to evaluation - [Each for Equal](https://www.artd.com.au/news/each-for-equal/) - In acknowledgement of International Women’s Day, we asked members of our team to reflect on what the theme #EachForEqual means to them. Drawing together their contributions into this blog post, I noted with a tinge of sadness that all of us feel that, despite the gains, the world is not yet an equal place for - [Sensemaking through uncertainty](https://www.artd.com.au/news/sensemaking-through-uncertainty/) - Life can only be understood backwards, but it must be lived forward [Soren Kierkegaard] We may only be able to see life’s full picture through the rear-view mirror, but we need to use information we have in the moment to make sense of things as they’re occurring. This helps us move from reaction, through reflection - [Evaluative thinking under pressure](https://www.artd.com.au/news/evaluative-thinking-under-pressure/) - Over the past few months, we’ve observed how hard it is to make decisions under the cloud of uncertainty. As evaluators, we’re used to exploring context and drawing on the available data to make good decisions, faster. But we’ve realised that, in a crisis or other rapid change, a traditional approach to evaluation isn’t practical. - [Go placidly amid the noise](https://www.artd.com.au/news/go-placidly-amid-the-noise/) - Go placidly amid the noise and haste and remember what peace there may be in silence. - Max Ehrmann Noise and haste! Is there a more apt description of the world right now? The last few weeks have seen radical changes in our way of life, in how we work and operate in our home - [Evaluating in uncertain times](https://www.artd.com.au/news/evaluating-in-uncertain-times/) - It’s obvious that we’re living and working in a challenging time. We used to talk about working in the context of complexity, uncertainty and rapid change. Right now, we’re living in a world in which the rules are changing daily—and sometimes hourly—and many of us are confronting uncertainties about our health, working lives and livelihoods, - [Rethinking our methods for the cultural context](https://www.artd.com.au/news/rethinking-our-methods-for-the-cultural-context/) - While there is an image of evaluation as “objective”, evaluation – and evaluation tools – come from a particular world view. At the first NSW Australian Evaluation Society session of the year, Kathryn Dinh, of Lotus evaluation, challenged us to think about how we could modify existing evaluation tools to respond to different cultural, political - [Making the numbers count](https://www.artd.com.au/news/making-the-numbers-count/) - Service providers are generating and collecting more data than ever before, and analysis of this data has become a standard feature of many evaluations. While these data sets are an important source of information for evaluation, they are not always in the most appropriate format. When evaluation teams and evaluation commissioners are not sufficiently prepared - [Our first year at ARTD](https://www.artd.com.au/news/our-first-year-at-artd/) - A lot can happen in a year, especially in a new job. For the four of us—Amber, Jack, Lia and Pravin—our first year at ARTD meant a whole lot of growing. Like many evaluators, we came to evaluation with very different skills and backgrounds. But after a year in the field, we’ve learnt a lot - [Part 1: The communications challenge: how can evaluation cut through?](https://www.artd.com.au/news/part-1-the-communications-challenge-how-can-evaluation-cut-through/) - Evaluation is about assessing the ‘merit, worth or value’ of something (in our context, this is usually a policy, an intervention or program) to inform decision-making. The significant amount of expenditure on evaluation, particularly by government, has been justified by the potential for use of evaluations to improve outcomes and ensure effective targeting of limited - [How program logic can work for NGOs](https://www.artd.com.au/news/how-program-logic-can-work-for-ngos/) - It might sound academic but program logic is a very practical tool to help strengthen your program design and show how it works. This is important for NGOs competing for government funding as they are increasingly being asked to set out the evidence base for their programs and a plan for evaluation. On a wet - [#BeTheChange2017 for dementia](https://www.artd.com.au/news/bethechange2017-for-dementia/) - There are more than 410,000 Australians living with dementia; about 26,000 of whom have younger onset dementia (a diagnosis under the age of 65). By 2025, this is expected to increase to over 530,000. Dementia is the second leading cause of death in Australia and the greatest cause of disability in older Australians. This is - [Uncovering the value of youth peer support](https://www.artd.com.au/news/uncovering-the-value-of-youth-peer-support/) - ARTD has been working closely with Youth Insearch to better articulate the theories of change that underpin their activities and conduct rigorous outcome measurement. Youth Insearch runs an early intervention program of counselling, support, mentoring and empowerment for at risk young people aged 14-20 delivered through weekend workshops, support groups, peer support, leadership and individual - [Capitalising on the (public) good of evaluation](https://www.artd.com.au/news/capitalising-on-the-public-good-of-evaluation/) - It’s been about two months since the Australasian Evaluation Society (AES) International Evaluation Conference in Canberra. I thought I’d share some of the things that have stuck in my mind since – the ideas that have had a lasting resonance, not necessarily what leapt out to me at the time. But first, let me set - [Evaluation for the public good or as a public good?](https://www.artd.com.au/news/evaluation-for-the-public-good-or-as-a-public-good/) - We’ve been thinking a lot about how evaluation can support the public good since Sandra Mathison kick-started the Australasian Evaluation Society (AES) International Evaluation Conference in Canberra by telling us that evaluation is not delivering on this promise because it is constrained by dominant ideologies, is a service for those with resources, and works in - [Top tips for questionnaire design](https://www.artd.com.au/news/top-tips-for-questionnaire-design/) - As government increasingly focuses on outcomes measurement, customer-centred service delivery, stakeholder engagement and contestable markets, organisations are increasingly seeking feedback through questionnaires. These days, with the plethora of online platforms, it’s easy enough for anyone to knock up a questionnaire and put it in the field. But without getting the basics right, you won’t get - [A balanced approach to valuing in evaluation](https://www.artd.com.au/news/a-balanced-approach-to-valuing-in-evaluation/) - Evaluation and research use some similar methods, but they have different purposes. According to Schwandt., “evaluation is the act of judging the value, merit, worth or significance of things” (Evaluation Foundations Revisited, Cultivating a life of mind for practice, 2016). However, evaluation is a contested field; even the statement that evaluation is all about making - [Interested in evaluation in complex social systems?](https://www.artd.com.au/news/interested-in-evaluation-in-complex-social-systems/) - Check out Director Andrew Hawkins' latest article ‘Realist evaluation and randomised controlled trials for testing program theory in complex social systems’ in Evaluation. Realist approaches to scientific evaluation tend to be strong on theory and explanation, but lack adequate tests or means of validating theory. Randomised controlled trials (RCT) are often seen as the gold - [Sharing failures strengthens evaluation](https://www.artd.com.au/news/sharing-failures-strengthens-evaluation/) - We all like to share success stories, but the fact is that we can learn just as much – and sometimes more – from talking about when things don’t go as planned. This was the subject of the Australasian Evaluation Society NSW event on Wednesday May 30, “Learning from evaluation failures”. The event was run - [How can we measure empowerment?](https://www.artd.com.au/news/how-can-we-measure-empowerment/) - Empowerment has emerged as another buzz word. While it is often paid lip service, what does empowerment really mean? And how do we know if we’re achieving it? Empowerment is a complex concept. It is both a process and an outcome that can be seen at the individual, organisational and structural levels, enabling positive growth - [Part 3: Make it a process not just a product](https://www.artd.com.au/news/part-3-make-it-a-process-not-just-a-product/) - Have you ever spent all day in the kitchen cooking a meal, only to find yourself not particularly hungry when you sit down to eat? Often, we’re so focused on creating a Masterchef moment at the end, that we miss the enjoyment of shopping for and preparing a meal to be shared with loved ones. - [Part 4: Structure it](https://www.artd.com.au/news/part-4-structure-it/) - Making evaluation a process not just a product can enhance the likelihood of your findings being used. But at some point, you’re also going to have to deliver the product – the report. By this point, particularly in a large-scale, long-term and/or mixed-methods evaluation, you’ll have a lot of data. It can be hard to - [Part 6: Cut the clutter](https://www.artd.com.au/news/part-6-cut-the-clutter/) - We all know what it’s like to download a document and feel immediately daunted by the endless number of text-cluttered pages. We quickly search for an abstract, executive summary, or conclusions chapter; any way possible to ingest the most meaningful information in the shortest amount of time. As writers (and evaluators), we want to respect - [Join us to un-box evaluation #aes19SYD](https://www.artd.com.au/news/join-us-to-un-box-evaluation-aes19syd/) - #aes19SYD is all about un-boxing evaluation so it can fulfil it’s potential. Not sure what this means? Don’t fret. Our staff – along with colleagues in the field – have put together a number of presentations – ranging from 5-minute ignite sessions through 30-minute short papers to 1-hour interactive sessions – to un-box the conference - [Stories of Lived Experience launch](https://www.artd.com.au/news/stories-of-lived-experience-launch/) - Our evaluation report on Weave Youth & Community Services was launched at a community celebration in Waterloo on Tuesday 30 August 2016. The evaluation was part of a larger Stories of Lived Experience project, which also included photographic portraits and a short documentary to capture the faces and stories of Weave’s clients and community. The - [Reflections on a year of evaluation for design and development](https://www.artd.com.au/news/reflections-on-a-year-of-evaluation-for-design-and-development/) - While ARTD has a 29-year history in evaluation, more and more of our work is in policy and program design and development. A trend toward increasing evaluator involvement in design was also evident in my research with Australasian Evaluation Society (AES) members. So what have I learned from my time in design in the social - [Learnings from the virtual American Evaluation Association Conference](https://www.artd.com.au/news/learnings-from-the-virtual-american-evaluation-association-conference/) - There were plenty of interesting views in the virtual stream of the 2017 American Evaluation Association Conference. The Presidential Strand sessions focused on turning learning into action, and finding solutions to challenges, to create greater good for society. Continuing the Dialog Evaluation’s Call to Action, 21st Century Perspectives in Addressing Race. Nicole Bowman: Evaluators need - [Making realist evaluations useful for government](https://www.artd.com.au/news/making-realist-evaluations-useful-for-government/) - What is it about an intervention that generates change? What conditions are required for it to be effective? How can we get more of the intended and less of the unintended outcomes? If you have ever wanted to know the answer to these questions, you should be thinking about realist evaluation. Realism brings a sophisticated - [Is your program logic logical?](https://www.artd.com.au/news/is-your-program-logic-logical/) - The term program logic implies the model you develop is logical. But is it? Often the links between outputs, short-, medium- and long-term outcomes in a program logic model look more like a wish list than something that would logically follow from program activities. We need to put the logic back into program logic so - [Weave wins mental health award](https://www.artd.com.au/news/weave-wins-mental-health-award/) - Last night, Weave Youth and Community Services won the Aboriginal Social and Emotional Wellbeing Award at the Mental Health Matters Awards for its project Stories of Lived Experience. This included a photography exhibition, a documentary and an evaluation. In 2015, ARTD developed the qualitative evaluation. We spoke with four generations of families and over 50 - [Brick walls or byways to evaluation use](https://www.artd.com.au/news/brick-walls-or-byways-to-evaluation-use/) - Last week we looked at how Australasian Evaluation Society members have successfully overcome some of the obstacles they have encountered to use. This week we look at main brick walls my research with Australasian Evaluation Society identified to evaluation use, and some byways around them. Politics: Unsurprisingly, given the intertwining of politics and policy, ‘politics - [Overcoming obstacles to evaluation use](https://www.artd.com.au/news/overcoming-obstacles-to-evaluation-use/) - An evaluator might weep at the plethora of literature that shows their work going unused. But my recent research with Australasian Evaluation Society members shows evaluators have had success in overcoming at least some of the obstacles they have encountered to use. Disinterest in, or more active resistance to, evaluation: Some evaluators I interviewed had - [Sue Leahy joins AES Board](https://www.artd.com.au/news/sue-leahy-joins-aes-board/) - Our Managing Principal Consultant, Sue Leahy, has joined the ranks of the Australasian Evaluation Society (AES) Board. Sue is looking forward to working with other Board members to strengthen the role of evaluation in Australasia and shape an AES that continues to meet the needs of its members for professional growth and networking. It’s an - [Congratulations Lex Ellinson – AES Emerging New Talent!](https://www.artd.com.au/news/congratulations-lex-ellinson-aes-emerging-new-talent/) - Senior Consultant, Alexandra (Lex) Ellinson, was awarded the Emerging New Talent at the Australasian Evaluation Society International Evaluation Conference. The Awards Committee praised the scale of what she has achieved in just four years as well as her commitment to the profession. Lex has designed and managed large-scale long-term evaluations of youth policy and social - [Increasing access and inclusion in Fairfield](https://www.artd.com.au/news/increasing-access-and-inclusion-in-fairfield/) - On Monday 7 August, Fairfield City Council launched their disability inclusion action plan. The plan details what Council will do to encourage positive community attitudes and behaviours towards people with disability, make it easier to get around the community, support access to meaningful employment opportunities and improve access to Council information, services and facilities. The - [Planning with people with disability](https://www.artd.com.au/news/planning-with-people-with-disability/) - Want to get the voice of people with disability in policy planning or program evaluation, but unsure how to go about it? In NSW, government agencies and local councils need to develop disability inclusion action plans (DIAPs) with people with disability. More broadly, as policy co-design catches on, government agencies need to make sure consultation - [Building capacity for evaluative thinking](https://www.artd.com.au/news/building-capacity-for-evaluative-thinking/) - I reckon the right time to make resolutions isn't amidst the buzz of New Year's Eve, but when the fireworks are a dim echo. So here goes. This year, I'm committing to championing and building capacity for evaluative thinking. If we're to believe the hype that we're living in a post truth world, this may - [Beyond programs? Is principles-focused evaluation what you’re looking for?](https://www.artd.com.au/news/beyond-programs-is-principles-focused-evaluation-what-youre-looking-for/) - For several years now, I’ve been getting more and more involved in service design, review and reconceptualization to respond to evolutions in the evidence base and the systems within which services operate. And, when I am designing an evaluation framework and strategy or conducting an evaluation, I tend not to be looking at programs, but - [Putting logic back into program logic](https://www.artd.com.au/news/putting-logic-back-into-program-logic/) - Are the programs logics that you see actually logical? On Wednesday 11 April 2018, ARTD Partner Andrew Hawkins, delivered a free seminar in Sydney organised by the Australasian Evaluation Society (AES), which was attended by approximately 50 people. Hawkins first briefly introduced his subject. His generalist definition of a program logic is “A one-page diagram - [Agile evaluation, can there be such a thing?](https://www.artd.com.au/news/agile-evaluation-can-there-be-such-a-thing/) - ‘Agile’ has emerged as one of the latest buzzwords in Government Departments. But what does it mean to be agile, and can we do more agile evaluation? On Wednesday 2 May, Florent Gomez from the NSW Department of Finance and ARTD Partner Jade Maloney delivered a free lunchtime seminar in Sydney organised by the Australasian - [How can governments harness citizen input in decision-making?](https://www.artd.com.au/news/how-can-governments-harness-citizen-input-in-decision-making/) - Engage2’s panel discussion in Sydney this week left us asking important questions about how governments can use new tools to better engage and listen to citizens, and importantly, how we can measure the impact of public engagement activities on government decision-making. The Vivid Ideas event, Democracy is being Disrupted: Governing in the 21st Century, brought - [Ten tips for building evaluative thinking into team planning](https://www.artd.com.au/news/ten-tips-for-building-evaluative-thinking-into-team-planning/) - When it comes to strategic team planning, a neutral, external voice can help teams to navigate the process of identifying goals for the year to come and allocating resources effectively. We’ve found that integrating evaluative thinking can strengthen the process – by developing and reviewing program logics to inform planning activities. This approach can be - [Inclusive education is better for everyone](https://www.artd.com.au/news/inclusive-education-is-better-for-everyone/) - The right of students with disability to education and to develop to their full potential is established in the United Nations Convention on the Rights of Persons with Disabilities 2006, and reinforced through legislation. There is also plenty of evidence that inclusive education supports positve outcomes not only for students with disability but all students. - [Ten tips for presenting like a pro](https://www.artd.com.au/news/ten-tips-for-presenting-like-a-pro/) - At ARTD, we use a weekly professional development and training program to learn about the latest developments in evaluation, share insights from recent work, and build our core skills. As part of our preparations for the AES 2018 International Evaluation Conference, taking place on 17-21 September in Launceston, Tasmania, I ran a training session with - [AES18 Day 1: How can we transform evaluation?](https://www.artd.com.au/news/aes18-day-1-how-can-we-transform-evaluation/) - What does the future hold for evaluation and how can we scale up the value of our field to deliver global results? Does evaluation need to transform to evaluate transformations? With the AES 2018 International Conference (AES18) kicking off this morning in Launceston, Michael Quinn Patton’s keynote set the tone for an engaging three days - [Transforming evaluation: what we’re taking from #aes18LST](https://www.artd.com.au/news/transforming-evaluation-what-were-taking-from-aes18lst/) - This year’s Australasian Evaluation Society (AES) international conference challenged us to transform evaluation practice to address complex social and environmental issues in a changing world and to ensure cultural safety and respect in our work with Indigenous communities. The crowd was lively – with a lot of newcomers to the AES (though just how many - [Celebrating 2018!](https://www.artd.com.au/news/celebrating-2018/) - It’s that time of year to celebrate, eat too much prawn toast and pudding, and – when you’re a bunch of evaluators – to reflect on where we’ve been, where we’re going and what we can do better next year. Its been a year of change at ARTD, with growing teams in NSW, Victoria and - [The future of evaluation is within](https://www.artd.com.au/news/the-future-of-evaluation-is-within/) - When my friends and family ask me what my job is, I say something along the lines of, “I work at a public policy consulting firm. We mostly evaluate government policies and programs, and we gather our data mostly through surveys and interviews.” Knowing that I majored in biology, they tend to follow this by - [Reducing our waste with Bin Trim](https://www.artd.com.au/news/reducing-our-waste-with-bin-trim/) - Waste reduction is an important part of our commitment to be an environmentally sustainable business. We believe that it is not only good for people and the planet, but also saves costs and highlights our intention to act rather than just talk about sustainability issues. According to the NSW Environment Protection Authority (EPA), about 70% - [A personal journey toward evaluation](https://www.artd.com.au/news/a-personal-journey-toward-evaluation/) - It was never going to be easy coming back to Sydney after so many years. I was 42, newly separated from a marriage and leaving behind those I loved and a home I thought I would retire in someday. The Riverina region was my home and was a place that held cultural ties to my - [Evaluation and the Common Elements Approach](https://www.artd.com.au/news/evaluation-and-the-common-elements-approach/) - With evaluation becoming more integrated into the way projects and programs are undertaken, it can seem that there is a lot of evidence being generated about what specific programs and techniques work. However, this specific evidence is often not combined to understand what works more broadly. The ‘common elements approach’ attempts to rectify this. At - [Vale Tracey](https://www.artd.com.au/news/vale-tracey/) - It is with great sadness that ARTD reflects on the passing of our close friend and colleague, Tracey Whetnall. Tracey was integral to ARTD from the early days. Our Partner, Chris Milne, met her many moons ago at Tranby Aboriginal College in Glebe. Tracey had a scholarship from the Department of Defence and was studying - [QPR: Market research and evaluation](https://www.artd.com.au/news/qpr-market-research-and-evaluation/) - I want you to imagine a quiet Saturday morning in Canberra 18 years ago. You’re getting stuck into your second cup of tea, and getting stuck on 25-down in the crossword (celebrated Russian poet, seven letters). The answer is on the tip of your pen and then… *knock, knock* At the door is a well-dressed - [Certification for Visualisation](https://www.artd.com.au/news/certification-for-visualisation/) - My biggest passion as a researcher and evaluator is the communication of stories, whether that’s through data visualisation or through the art of impactful presentation. The work we do has the most value when it can enable positive change, and powerful communication supports this. On the data visualisation side, I have worked with graphs and ## Pages - [Home](https://www.artd.com.au/) - [Australian Disability Strategy Evaluation](https://www.artd.com.au/clients/australian-disability-strategy-evaluation/) - [Our People](https://www.artd.com.au/people/) - Partners and Directors Senior Managers & Managers Senior Consultants & Consultants Analysts Business Support - [Published Work](https://www.artd.com.au/resources/published-reports/) - ARTD provides clients with credible, clear and strategic reports to inform decisions about policy and programs. We also present and workshop findings with key stakeholders. Commissioned reports are owned by our clients and in many cases are confidential. Links to publicly available reports are provided below. - [Watch and Listen](https://www.artd.com.au/watchandlisten/) - Webinars Learn about key topics in policy and evaluation with ARTD's webinars. Fit for Purpose Evaluation to Reduce the Risk of Program Failure Andrew Hawkins (19 May 2026) Enhancing multi-sector engagement - insights from the evaluation of the Thriving Queensland Kids Partnership Kate Sunners and Andrew Hawkins (ARTD), Kamila Davidson and Michael Hogan (TQKP), Rahema - [Sectors](https://www.artd.com.au/services/sectors-we-work-in/) - [Aboriginal Associates](https://www.artd.com.au/people/aboriginal-associates/) - ARTD Staff recognise the diversity of Australian Aboriginal and Torres Strait Islander peoples of this nation. We acknowledge their unceded sovereignty and continued custodianship of the lands in which we conduct our business and the waterways that supports life. We pay our respects to ancestors and Elders, past and present. Our head office sits on - [Our Services](https://www.artd.com.au/services/) - Strategy and Evidence to Inform Program and Policy Decisions | Service Model Design, Co-design and Delivery Strategies | Monitoring and Evaluation. - [Our Clients](https://www.artd.com.au/clients/) - Our core business is working with government agencies and non-government organisations. See some of the recent clients we've worked with. - [Our Story](https://www.artd.com.au/story/) - Our story ARTD is a leading public policy consulting firm. Our core business is working with government agencies and non-government organisations to make evidence-informed policy decisions; co-design service models and delivery strategies; plan for, track and evaluate outcomes; and continuously improve performance. We are an Australian-owned firm. From a small team of three, established in - [Resources](https://www.artd.com.au/resources/) - We are passionate about what we do. Read our journal articles, newsletters and blog posts for the latest in public policy and evaluation. - [Journal Articles](https://www.artd.com.au/resources/journal-articles/) - ARTD is at the forefront of evaluation theory in practice, and curiosity as one of our core values. We encourage all of our staff to publish articles in journals, such as the Evaluation Journal of Australasia. Links to articles in academic journals are provided below. - [Our History](https://www.artd.com.au/story/our-history/) - Our history ARTD founding directors, Chris Milne and David Morrissey, met when they worked together at Tranby College in Glebe in the early 1980s. Tranby was an Aboriginal-run adult educational organisation with a strong sense of political activism and deeply involved with the land rights movement around Australia. Chris was running various courses and set - [Associates](https://www.artd.com.au/people/associates/) - We work with a diverse network of trusted associates, whose work complements our core expertise. We draw on their content area expertise to ensure our evaluation and strategic advice is grounded in contemporary practice. Gerard Atkinson Gerard is a highly experienced evaluator and organisational leader, with over fifteen years’ experience designing and delivering evaluation strategies, - [Conference Presentations](https://www.artd.com.au/resources/conference-presentations/) - A selection of ARTD's conference presentations on a range of topics including evaluation, ethics, program logics, survey design and evaluation capacity building. - [Work With Us](https://www.artd.com.au/people/work-with-us/) - Why join ARTD? Our people are passionate about collaborating with citizens, nonprofits and the public sector to co-design and review policies and programs, and we apply our strong critical thinking and problem-solving skills to this challenge. We come from diverse backgrounds and professional sectors – from government and research, to non-profit and business – and - [Newsletters](https://www.artd.com.au/resources/newsletters/) - As evaluators, reflecting on our work, the policy and evaluation environments and our practice is what we do! We share our reflections in our regular newsletters. Catch up on past issues below, or subscribe to get updates to your inbox. 2024 Evaluation: the Christmas Movie Edition (Criteria Collection) December 2024 2023 The marathon, not - [Our Board](https://www.artd.com.au/people/our-board/) - [Our Values](https://www.artd.com.au/story/our-values/) - Our vision is a more thoughtful world, in which citizens and decision-makers use evaluative tools to design and refine action for the public good. - [Investing in Social Impact](https://www.artd.com.au/story/investing-in-social-impact/) - We’re committed to supporting the non-government sector to maximise their social impact. We recognise that non-government organisations generally have more limited resources for consultancy projects, but make important contributions to the public good, and our work in design and evaluation can support them to strengthen their impact. This is why we offer discounts to non-government - [Reconciliation Action Plan](https://www.artd.com.au/story/reconciliation-action-plan/) - ARTD staff recognise the diversity of Aboriginal and Torres Strait Islander peoples of Australia and acknowledge their unceded sovereignty. We pay our respects to Elders past and present and respect their continued custodianship of the many lands upon which we conduct our business and the waterways that support life. We acknowledge the past injustices, untold - [Privacy Policy](https://www.artd.com.au/privacy-policy/) - ARTD Consultants Privacy and Data Security Policy ARTD Consultants is committed to the Australian Privacy Principles (APPs) and this policy outlines our ongoing obligations to you in respect of how we manage your Personal Information. In this Privacy Policy, ‘ARTD Consultants’, ‘ARTD’, ‘we’, ‘our’ and ‘us’ refers to ARTD Consultants Pty Ltd. We have - [Our Partnerships](https://www.artd.com.au/people/our-partnerships/) - We value diversity in perspectives and believe that two heads are always better than one. We have developed a network of longstanding associates and partnerships with other organisations that bring the right expertise and valuable connections to our work and support meaningful engagement with diverse communities. We are always looking to build new relationships with - [Contact](https://www.artd.com.au/contact/) - Why ARTD? With 30 years in the industry and more than 1600 successful project deliveries, we are one of the most respected and enduring firms in our field. ## Team - [Natalie Martino](https://www.artd.com.au/team-members/natalie-martino/) - [Tuli Keidar](https://www.artd.com.au/team-members/tuli-keidar/) - [Simon Alaba](https://www.artd.com.au/team-members/simon-alaba/) - [Naomi Agius](https://www.artd.com.au/team-members/naomi-agius/) - [Natalie Janzen](https://www.artd.com.au/team-members/natalie-janzen/) - [Isabela Millani](https://www.artd.com.au/team-members/isabela-millani/) - [Hannah Rathbone](https://www.artd.com.au/team-members/hannah-rathbone/) - [Louise Repcik](https://www.artd.com.au/team-members/louise-repcik/) - [Andrew Hawkins](https://www.artd.com.au/team-members/andrew-hawkins/) - [Chloe Markulic](https://www.artd.com.au/team-members/chloe-markulic/) - [Sarah Schofield](https://www.artd.com.au/team-members/sarah-schofield/) - [Matilda Ralph](https://www.artd.com.au/team-members/matilda-ralph/) - [Jade Maloney](https://www.artd.com.au/team-members/jade-maloney/) - [Eleanor Kerdo](https://www.artd.com.au/team-members/eleanor-kerdo/) - [Abel Scopelliti](https://www.artd.com.au/team-members/abel-scopelliti/) - [Jack Rutherford](https://www.artd.com.au/team-members/jack-rutherford/) - [Annemarie Woltmann](https://www.artd.com.au/team-members/annemarie-woltmann/) - [Imogen Williams](https://www.artd.com.au/team-members/imogen-williams/) - [Fergus Bailey](https://www.artd.com.au/team-members/fergus-bailey/) - [Stephanie Quail](https://www.artd.com.au/team-members/stephanie-quail/) - [Aiden Green](https://www.artd.com.au/team-members/aiden-green/) - [Llewellyn Lloyd](https://www.artd.com.au/team-members/llewellyn-lloyd/) - [Ellen Wong](https://www.artd.com.au/team-members/ellen-wong/) - [Sachin Burns](https://www.artd.com.au/team-members/sachin-burns/) - [Rachel Aston](https://www.artd.com.au/team-members/rachel-aston/) - [Maia Grange](https://www.artd.com.au/team-members/maia-grange/) - [Layal Hanna](https://www.artd.com.au/team-members/layal-hanna/) - [Tracee Kresin](https://www.artd.com.au/team-members/tracee-kresin/) - [Sally Evans](https://www.artd.com.au/team-members/sally-evans/) - [Sharon Marra-Brown](https://www.artd.com.au/team-members/sharon-marra-brown/) - [Paula Shaw](https://www.artd.com.au/team-members/paula-shaw/) - [Mitchell Rice-Brading](https://www.artd.com.au/team-members/mitchell-rice-brading/) - [Amanda Taylor-Short](https://www.artd.com.au/team-members/amanda-taylor-short/) - [Alexandra Lorigan](https://www.artd.com.au/team-members/alexandra-lorigan/) - [Sue Bertram](https://www.artd.com.au/team-members/sue-bertram/) - [Sophie Henness](https://www.artd.com.au/team-members/sophie-henness/) - [Jenevieve Liem](https://www.artd.com.au/team-members/jenevieve-liem/) - [Greta Westermann](https://www.artd.com.au/team-members/greta-westerman/) - [Moya Johansson](https://www.artd.com.au/team-members/moya-johansson/) - [Rae Fry](https://www.artd.com.au/team-members/rae-fry/) - [KATE SUNNERS](https://www.artd.com.au/team-members/kate-sunners/) - [Leah Carroll](https://www.artd.com.au/team-members/leah-carroll/) - [Ashleigh Morse](https://www.artd.com.au/team-members/ashleigh-morse/) - [Lia Oliver](https://www.artd.com.au/team-members/lia-oliver/) - [Theebana Tharmakumar](https://www.artd.com.au/team-members/theebana-tharmakumar/) - [Emily Habgood](https://www.artd.com.au/team-members/emily-habgood/) - [Janet Kidson](https://www.artd.com.au/team-members/janet-kidson/) - [Keely Mitchell](https://www.artd.com.au/team-members/keely-mitchell/) - [Gerard Atkinson](https://www.artd.com.au/team-members/gerard-atkinsons/) - [Erin Seeto](https://www.artd.com.au/team-members/erin-seeto/) - [Kate Williams](https://www.artd.com.au/team-members/kate-williams/) - [Patricia Rose](https://www.artd.com.au/team-members/patricia-rose/) - [Kathleen De Rooy](https://www.artd.com.au/team-members/kathleen-de-rooy/) - [Georgia Clift](https://www.artd.com.au/team-members/georgia-clift/) - [Kerry Hart](https://www.artd.com.au/team-members/kerry-hart/) - [Steve Yeong](https://www.artd.com.au/team-members/steve-yeong/) - [Kris Iyer](https://www.artd.com.au/team-members/kris-iyer/) - [Rebecca Wilkinson](https://www.artd.com.au/team-members/rebecca-wilkinson/) - [Anna Chevalier](https://www.artd.com.au/team-members/anna-chevalier/) - [Elizabeth Luland](https://www.artd.com.au/team-members/elizabeth-luland/) - [Kate Woods](https://www.artd.com.au/team-members/kate-woods/) - [David Watling](https://www.artd.com.au/team-members/david-watling/) - [Raeginn Quadrio](https://www.artd.com.au/team-members/raeginn-quadrio/) - [Solina Sok](https://www.artd.com.au/team-members/solina-sok/) - [Kieran Sobels](https://www.artd.com.au/team-members/kieran-sobels/) - [Jessica Nimmo](https://www.artd.com.au/team-members/jessica-nimmo/) - [Holly Kovac](https://www.artd.com.au/team-members/holly-kovac/) - [Robert Wishart](https://www.artd.com.au/team-members/robert-wishart/) - [Pravin Siriwardena](https://www.artd.com.au/team-members/pravin-siriwardena/) - [Bianca Jarrett](https://www.artd.com.au/team-members/bianca-jarrett/) - [Ken Fullerton](https://www.artd.com.au/team-members/ken-fullerton/) - [Christina Klassen](https://www.artd.com.au/team-members/christina-klassen/) - [Thaher Gaiyasudeen](https://www.artd.com.au/team-members/thaher-gaiyasudeen/) - [Brad Astbury](https://www.artd.com.au/team-members/brad-astbury/) - [Thomas Gillings](https://www.artd.com.au/team-members/thomas-gillings/) - [Don Bemrose](https://www.artd.com.au/team-members/don-bemrose/) - [Michael Brooks](https://www.artd.com.au/team-members/michael-brooks/) - [Ally Tanner](https://www.artd.com.au/team-members/ally-tanner/) - [Klas Johansson](https://www.artd.com.au/team-members/klas-johansson/) - [Wendy Hodge](https://www.artd.com.au/team-members/wendy-hodge/) - [Chris Milne](https://www.artd.com.au/team-members/chris-milne/) - [Amber Provenzano](https://www.artd.com.au/team-members/amber-provenzano/) - [Fiona Christian](https://www.artd.com.au/team-members/fiona-christian/) - [Marita Merlene](https://www.artd.com.au/team-members/marita-merlene/) - [Jasper Odgers](https://www.artd.com.au/team-members/jasper-odgers/) ## Our Projects - [Evaluation of the Indigenous Girls’ STEM Academy - Mid-Term Outcomes Report ](https://www.artd.com.au/our-projects/evaluation-of-the-indigenous-girls-stem-academy-mid-term-outcomes-report/) - [Process and Outcomes Evaluation of the Drive for Life Program](https://www.artd.com.au/our-projects/process-and-outcomes-evaluation-of-the-drive-for-life-program/) - [Indicator and Outcome Bank](https://www.artd.com.au/our-projects/indicator-and-outcome-bank/) - [Australian Trusted Trader 10-year monitoring and evaluation strategy](https://www.artd.com.au/our-projects/australian-trusted-trader-10-year-monitoring-and-evaluation-strategy/) - [Intellectual Disability Health Service](https://www.artd.com.au/our-projects/intellectual-disability-health-service/) - [How to evaluate a strategy: NSW Housing 2041 M&E Framework](https://www.artd.com.au/our-projects/how-to-evaluate-a-strategy-nsw-housing-2041-me-framework/) - [Evaluation of the Remand Domestic Violence Intervention](https://www.artd.com.au/our-projects/evaluation-of-the-remand-domestic-violence-intervention/) - [Future Directions](https://www.artd.com.au/our-projects/future-directions/) - [The Growing Careers Project Implementation Review](https://www.artd.com.au/our-projects/the-growing-careers-project-implementation-review/) - [Autism Information and Support Service](https://www.artd.com.au/our-projects/amaze/) - [Towards Zero Suicides](https://www.artd.com.au/our-projects/towards-zero-suicides/) - [Process and Outcome Evaluation of the Improved Energy Efficiency Standards Program](https://www.artd.com.au/our-projects/process-and-outcome-evaluation-of-the-improved-energy-efficiency-standards-program/) - [Sylvan Review Data Collection](https://www.artd.com.au/our-projects/sylvan-review-data-collection/) - [Aboriginal evidence building partnership: pilot](https://www.artd.com.au/our-projects/aboriginal-evidence-building-partnership-pilot/) - [Evaluation of evidence based models](https://www.artd.com.au/our-projects/evaluation-of-evidence-based-models/) - [Litter Prevention Program Evaluation](https://www.artd.com.au/our-projects/litter-prevention-program-evaluation/) - [Your Service, Your Rights Evaluation](https://www.artd.com.au/our-projects/your-service-your-rights-evaluation/) - [National Sepsis Program Extension 2023-2025: Coordination of Care and Post-Sepsis Support Model of Care Framework and Business Case](https://www.artd.com.au/our-projects/national-sepsis-program-extension-2023-2025-coordination-of-care-and-post-sepsis-support-model-of-care-framework-and-business-case/) - [Evaluation of the Mental Health, Wellbeing and Resilience Grants](https://www.artd.com.au/our-projects/evaluation-of-the-mental-health-wellbeing-and-resilience-grants/) - [Rapid Mid-Term Evaluation of the Sharing and Enabling Environmental Data Program](https://www.artd.com.au/our-projects/rapid-mid-term-evaluation-of-the-sharing-and-enabling-environmental-data-program/) - [Families Capacity Building Project Evaluation](https://www.artd.com.au/our-projects/families-capacity-building-project-evaluation/) - [Trans and Gender Diverse in Community Health Initiative](https://www.artd.com.au/our-projects/trans-and-gender-diverse-in-community-health-initiative/) - [Climate Change Adaptation Strategy MERI framework](https://www.artd.com.au/our-projects/climate-change-adaptation-strategy-meri-framework/) - [COVID Intensive Learning Support Program evaluation support](https://www.artd.com.au/our-projects/covid-intensive-learning-support-program-evaluation-support/) - [NSW Suicide Prevention Framework](https://www.artd.com.au/our-projects/nsw-suicide-prevention-framework/) - [Consultation on NDIS Quality and Safeguards](https://www.artd.com.au/our-projects/department-of-social-services-dss/) - [Ability Links NSW Community Development Resource Package](https://www.artd.com.au/our-projects/st-vincent-de-paul-society-nsw-for-ability-links-nsw/) - [Development and evaluation of the Dementia-Friendly Communities Program](https://www.artd.com.au/our-projects/dementia-australia/) - [Social Impact Evaluation of Financial Counselling in Tenancy Organisations](https://www.artd.com.au/our-projects/social-impact-evaluation-of-financial-counselling-in-tenancy-organisations/) - [Evaluation of the NSW Service Plan for People with Eating Disorders](https://www.artd.com.au/our-projects/evaluation-of-the-nsw-service-plan-for-people-with-eating-disorders/) - [Final Review of the National Partnership Agreement on Implementing Water Reform in the Murray-Darling Basin](https://www.artd.com.au/our-projects/final-review-of-the-national-partnership-agreement-on-implementing-water-reform-in-the-murray-darling-basin/) - [Evaluation of NSW EPA’s Bin Trim Program Round 3](https://www.artd.com.au/our-projects/evaluation-of-nsw-epas-bin-trim-program-round-3/) - [Program logic, monitoring and evaluation plan for the NSW Health Safety and Quality Essentials Pathway](https://www.artd.com.au/our-projects/program-logic-monitoring-and-evaluation-plan-for-the-nsw-health-safety-and-quality-essentials-pathway/) - [Snapshot evaluation of NSW Health Management Development Programs](https://www.artd.com.au/our-projects/snapshot-evaluation-of-nsw-health-management-development-programs/) - [Review of District HETI Relationship Model](https://www.artd.com.au/our-projects/review-of-district-heti-relationship-model/) - [Resilient Families](https://www.artd.com.au/our-projects/resilient-families/) - [Operational Review and Monitoring and Evaluation Framework design for NSW drink and drug driving reforms](https://www.artd.com.au/our-projects/operational-review-and-monitoring-and-evaluation-framework-design-for-nsw-drink-and-drug-driving-reforms/) - [Review of special religious and ethics education in NSW](https://www.artd.com.au/our-projects/review-of-special-religious-and-ethics-education-in-nsw/) - [Open Doors Rental Reform analysis](https://www.artd.com.au/our-projects/open-doors-rental-reform-analysis/) - [Evaluation of the Northern Australia Biosecurity Strategy](https://www.artd.com.au/our-projects/evaluation-of-the-northern-australia-biosecurity-strategy/) - [Evaluation of the Environmental Water Management Program](https://www.artd.com.au/our-projects/evaluation-of-the-environmental-water-management-program/) - [Strong Minds Program Evaluation](https://www.artd.com.au/our-projects/strong-minds-program-evaluation/) - [MEL Framework for First National Plan for Mental Health for Emergency Services Workers](https://www.artd.com.au/our-projects/national-recovery-and-resilience-agency/) - [Safer Pathway Evaluation](https://www.artd.com.au/our-projects/safer-pathway-evaluation/) ## Authors - [Abel Scopelliti](https://www.artd.com.au/authors/abel-scopelliti/) - [Louise Repcik](https://www.artd.com.au/authors/louise-repcik/) - [Leah Carroll](https://www.artd.com.au/authors/leah-carroll/) - [Isabela Millani](https://www.artd.com.au/authors/isabela-millani/) - [Llewellyn Lloyd](https://www.artd.com.au/authors/llewellyn-lloyd/) - [Jenevieve Liem](https://www.artd.com.au/authors/jenevieve-liem/) - [Lia Oliver](https://www.artd.com.au/authors/lia-oliver/) - [Jack Rutherford](https://www.artd.com.au/authors/jack-rutherford/) - [Fergus Bailey](https://www.artd.com.au/authors/fergus-bailey/) - [Simon Alaba](https://www.artd.com.au/authors/simon-alaba/) - [Eleanor Kerdo](https://www.artd.com.au/authors/eleanor-kerdo/) - [Naomi Agius](https://www.artd.com.au/authors/naomi-agius/) - [Stephanie Quail](https://www.artd.com.au/authors/stephanie-quail/) - [Chloe Markulic](https://www.artd.com.au/authors/chloe-markulic/) - [Sarah Schofield](https://www.artd.com.au/authors/sarah-schofield/) - [Sophie Henness](https://www.artd.com.au/authors/sophie-henness/) - [Maia Grange](https://www.artd.com.au/authors/maia-grange/) - [Tuli Keidar](https://www.artd.com.au/authors/tuli-keidar/) - [Aunty Julie Smith](https://www.artd.com.au/authors/aunty-julie-smith/) - [Amanda Taylor-Short](https://www.artd.com.au/authors/amanda-taylor-short/) - [Ellen Wong](https://www.artd.com.au/authors/ellen-wong/) - [Kathleen De Rooy](https://www.artd.com.au/authors/kathleen-de-rooy/) - [Keely Mitchell](https://www.artd.com.au/authors/keely-mitchell/) - [Theebana Tharmakumar](https://www.artd.com.au/authors/theebana-tharmakumar/) - [Elizabeth Luland](https://www.artd.com.au/authors/elizabeth-luland/) - [Greta Westermann](https://www.artd.com.au/authors/greta-westermann/) - [Rae Fry](https://www.artd.com.au/authors/rae-fry/) - [Kate Sunners](https://www.artd.com.au/authors/kate-sunners/) - [Mitchell Rice-Brading](https://www.artd.com.au/authors/mitchell-rice-brading/) - [Emily Yorkston](https://www.artd.com.au/authors/emily-yorkston/) - [Kerry Hart](https://www.artd.com.au/authors/kerry-hart/) - [Paula Shaw](https://www.artd.com.au/authors/paula-shaw/) - [Sharon Marra-Brown](https://www.artd.com.au/authors/sharon-marra-brown/) - [Solina Sok](https://www.artd.com.au/authors/solina-sok/) - [Sally Evans](https://www.artd.com.au/authors/sally/) - [Natalie Martino](https://www.artd.com.au/authors/natalie-martino/) - [Simon Jordan](https://www.artd.com.au/authors/simon-jordan/) - [Natasha McDonald](https://www.artd.com.au/authors/natasha-mcdonald/) - [Don Bemrose](https://www.artd.com.au/authors/don-bemrose/) - [Sue Bertram](https://www.artd.com.au/authors/sue-bertram/) - [Moya Johansson](https://www.artd.com.au/authors/moya-johansson/) - [Fiona Christian](https://www.artd.com.au/authors/fiona-christian/) - [Pravin Siriwardena](https://www.artd.com.au/authors/pravin-siriwardena/) - [Amber Provenzano](https://www.artd.com.au/authors/amber-provenzano/) - [Jasper Odgers](https://www.artd.com.au/authors/jasper-odgers/) - [Andrew Hawkins](https://www.artd.com.au/authors/andrew-hankins/) - [Brad Astbury](https://www.artd.com.au/authors/brad-astbury/) - [Rachel Aston](https://www.artd.com.au/authors/rachel-aston/) - [Jack Cassidy](https://www.artd.com.au/authors/jack-cassidy/) - [Imogen Williams](https://www.artd.com.au/authors/imogen-williams/) - [David Wakelin](https://www.artd.com.au/authors/david-wakelin/) - [Scott Williams](https://www.artd.com.au/authors/scott-williams/) - [Georgia Marett](https://www.artd.com.au/authors/georgia-marett/) - [Jade Maloney](https://www.artd.com.au/authors/jade-maloney/) - [ARTD Team](https://www.artd.com.au/authors/artd-team/) - [Gerard Atkinson](https://www.artd.com.au/authors/gerard-atkinson/) - [Ruby Leahy Gatfield](https://www.artd.com.au/authors/ruby-leahy-gatfield/) - [Ken Fullerton](https://www.artd.com.au/authors/ken-fullerton/) - [Alexandra Lorigan](https://www.artd.com.au/authors/alexandra-lorigan/) ## Staff Templates - [ARTD Staff Template](https://www.artd.com.au/cpt_staff_lst/quick-start-a/) - [Quick Start A 97](https://www.artd.com.au/cpt_staff_lst/quick-start-a-97/) ## Categories - [News](https://www.artd.com.au/category/news/) ## Tags - [evaluation](https://www.artd.com.au/tag/evaluation/) - [power](https://www.artd.com.au/tag/power/) - [disruption](https://www.artd.com.au/tag/disruption/) - [privilege](https://www.artd.com.au/tag/privilege/) - [Domestic and family violence](https://www.artd.com.au/tag/domestic-and-family-violence/) - [DFV](https://www.artd.com.au/tag/dfv/) - [Conference](https://www.artd.com.au/tag/conference/) - [Methods](https://www.artd.com.au/tag/methods/) - [rubrics](https://www.artd.com.au/tag/rubrics/) - [early career evaluators](https://www.artd.com.au/tag/early-career-evaluators/) - [professional development](https://www.artd.com.au/tag/professional-development/) - [data](https://www.artd.com.au/tag/data/) - [administrative data](https://www.artd.com.au/tag/administrative-data/) - [quantitative analysis](https://www.artd.com.au/tag/quantitative-analysis/) - [success](https://www.artd.com.au/tag/success/) - [theory](https://www.artd.com.au/tag/theory/) - [realist](https://www.artd.com.au/tag/realist/) - [systems](https://www.artd.com.au/tag/systems/) - [experimental](https://www.artd.com.au/tag/experimental/) - [context](https://www.artd.com.au/tag/context/) - [reflection](https://www.artd.com.au/tag/reflection/) - [vision](https://www.artd.com.au/tag/vision/) - [housing](https://www.artd.com.au/tag/housing/) - [reform](https://www.artd.com.au/tag/reform/) - [publication](https://www.artd.com.au/tag/publication/) - [#diversity](https://www.artd.com.au/tag/diversity/) - [#inclusion](https://www.artd.com.au/tag/inclusion/) - [#worldview](https://www.artd.com.au/tag/worldview/) - [#inclusive](https://www.artd.com.au/tag/inclusive/) - [#publicpolicy](https://www.artd.com.au/tag/publicpolicy/) - [eachforequal](https://www.artd.com.au/tag/eachforequal/) - [iwd](https://www.artd.com.au/tag/iwd/) - [iwd20](https://www.artd.com.au/tag/iwd20/) - [iwd2020](https://www.artd.com.au/tag/iwd2020/) - [women](https://www.artd.com.au/tag/women/) - [equal](https://www.artd.com.au/tag/equal/) - [equality](https://www.artd.com.au/tag/equality/) - [Aboriginal](https://www.artd.com.au/tag/aboriginal/) - [#grateful](https://www.artd.com.au/tag/grateful/) - [WFH](https://www.artd.com.au/tag/wfh/) - [stayhome](https://www.artd.com.au/tag/stayhome/) - [community](https://www.artd.com.au/tag/community/) - [COVID-19](https://www.artd.com.au/tag/covid-19/) - [change](https://www.artd.com.au/tag/change/) - [innovation](https://www.artd.com.au/tag/innovation/) - [sensemaking](https://www.artd.com.au/tag/sensemaking/) - [business as unusual](https://www.artd.com.au/tag/business-as-unusual/) - [empowerment](https://www.artd.com.au/tag/empowerment/) - [webinar](https://www.artd.com.au/tag/webinar/) - [Reconciliation](https://www.artd.com.au/tag/reconciliation/) - [National Reconciliation Week](https://www.artd.com.au/tag/national-reconciliation-week/) - [environment](https://www.artd.com.au/tag/environment/) - [sustainability](https://www.artd.com.au/tag/sustainability/) - [biodiversity](https://www.artd.com.au/tag/biodiversity/) - [engagement](https://www.artd.com.au/tag/engagement/) - [social justice](https://www.artd.com.au/tag/social-justice/) - [curiosity](https://www.artd.com.au/tag/curiosity/) - [resilience](https://www.artd.com.au/tag/resilience/) - [skills](https://www.artd.com.au/tag/skills/) - [interview](https://www.artd.com.au/tag/interview/) - [#qualitative](https://www.artd.com.au/tag/qualitative/) - [#narrativeinquiry](https://www.artd.com.au/tag/narrativeinquiry/) - [behavioural economics](https://www.artd.com.au/tag/behavioural-economics/) - [evaluation design](https://www.artd.com.au/tag/evaluation-design/) - [31DaysOfYOUth](https://www.artd.com.au/tag/31daysofyouth/) - [demographics](https://www.artd.com.au/tag/demographics/) - [Celebration](https://www.artd.com.au/tag/celebration/) - [Workplace Culture](https://www.artd.com.au/tag/workplace-culture/) - [Case Study](https://www.artd.com.au/tag/case-study/) - [Nonprofit](https://www.artd.com.au/tag/nonprofit/) - [Evaluation Methods](https://www.artd.com.au/tag/evaluation-methods/) - [co-design](https://www.artd.com.au/tag/co-design/) - [Government](https://www.artd.com.au/tag/government/) - [Ethics](https://www.artd.com.au/tag/ethics/) - [Visualisation](https://www.artd.com.au/tag/visualisation/) - [Professional Learning](https://www.artd.com.au/tag/professional-learning/) - [Public Policy](https://www.artd.com.au/tag/public-policy/) - [Evalaution Methods](https://www.artd.com.au/tag/evalaution-methods/) - [Indigenous](https://www.artd.com.au/tag/indigenous/) - [Award](https://www.artd.com.au/tag/award/) - [Health](https://www.artd.com.au/tag/health/) - [Systems Thinking; Evaluation Methods; Health; Theory](https://www.artd.com.au/tag/systems-thinking-evaluation-methods-health-theory/) - [Strategy](https://www.artd.com.au/tag/strategy/) - [Systems Thinking](https://www.artd.com.au/tag/systems-thinking/) - [Analytics](https://www.artd.com.au/tag/analytics/) - [Disability](https://www.artd.com.au/tag/disability/) - [Mixed Methods](https://www.artd.com.au/tag/mixed-methods/) - [Associations](https://www.artd.com.au/tag/associations/) - [Systems thinking; evaluation methods; evaluation theory](https://www.artd.com.au/tag/systems-thinking-evaluation-methods-evaluation-theory/) - [Governance](https://www.artd.com.au/tag/governance/) - [Evaluation theory](https://www.artd.com.au/tag/evaluation-theory/) - [logic](https://www.artd.com.au/tag/logic/) - [Reflection; Evaluation skills](https://www.artd.com.au/tag/reflection-evaluation-skills/) - [Surveys](https://www.artd.com.au/tag/surveys/) - [Partnerships](https://www.artd.com.au/tag/partnerships/) - [Coproduction](https://www.artd.com.au/tag/coproduction/) - [Design thinking](https://www.artd.com.au/tag/design-thinking/) - [Evaluation skills](https://www.artd.com.au/tag/evaluation-skills/) - [Staff Profile](https://www.artd.com.au/tag/staff-profile/) - [Safety](https://www.artd.com.au/tag/safety/) - [Disaster Resilience](https://www.artd.com.au/tag/disaster-resilience/) - [Facilitation](https://www.artd.com.au/tag/facilitation/) - [focus groups](https://www.artd.com.au/tag/focus-groups/) - [lived experience](https://www.artd.com.au/tag/lived-experience/) - [methodology](https://www.artd.com.au/tag/methodology/) - [quantitative](https://www.artd.com.au/tag/quantitative/) - [qualitative methods](https://www.artd.com.au/tag/qualitative-methods/) - [Domestic Violence](https://www.artd.com.au/tag/domestic-violence/) - [Criminal Justice](https://www.artd.com.au/tag/criminal-justice/) - [policy](https://www.artd.com.au/tag/policy/) - [Client news](https://www.artd.com.au/tag/client-news/) - [campaign evaluation](https://www.artd.com.au/tag/campaign-evaluation/) - [lived experience researcher](https://www.artd.com.au/tag/lived-experience-researcher/) - [mental health](https://www.artd.com.au/tag/mental-health/) - [suicide prevention](https://www.artd.com.au/tag/suicide-prevention/) - [peer research](https://www.artd.com.au/tag/peer-research/) - [Internship](https://www.artd.com.au/tag/internship/) - [Systems evaluation](https://www.artd.com.au/tag/systems-evaluation/) - [Impact](https://www.artd.com.au/tag/impact/) - [Reflections](https://www.artd.com.au/tag/reflections/) - [Australian Centre for Evaluation](https://www.artd.com.au/tag/australian-centre-for-evaluation/) - [APS](https://www.artd.com.au/tag/aps/) - [Maturity Models](https://www.artd.com.au/tag/maturity-models/) - [Evaluation capacity building](https://www.artd.com.au/tag/evaluation-capacity-building/) - [AES Conference](https://www.artd.com.au/tag/aes-conference/) - [Universal Design](https://www.artd.com.au/tag/universal-design/) - [Inclusive Design](https://www.artd.com.au/tag/inclusive-design/) - [Peer researchers](https://www.artd.com.au/tag/peer-researchers/) - [Water Management](https://www.artd.com.au/tag/water-management/) - [Environmental Management](https://www.artd.com.au/tag/environmental-management/) - [Government strategy](https://www.artd.com.au/tag/government-strategy/) - [Aboriginal Associate](https://www.artd.com.au/tag/aboriginal-associate/) - [public speaking](https://www.artd.com.au/tag/public-speaking/) - [presenting](https://www.artd.com.au/tag/presenting/) - [neurodivergent](https://www.artd.com.au/tag/neurodivergent/) - [neuroinclusive](https://www.artd.com.au/tag/neuroinclusive/) - [workplaces](https://www.artd.com.au/tag/workplaces/) - [recruitment](https://www.artd.com.au/tag/recruitment/) - [purposeful sampling](https://www.artd.com.au/tag/purposeful-sampling/) - [Contribution analysis](https://www.artd.com.au/tag/contribution-analysis/) - [Organisational evaluation](https://www.artd.com.au/tag/organisational-evaluation/) - [data collection](https://www.artd.com.au/tag/data-collection/) - [ARTD values](https://www.artd.com.au/tag/artd-values/) - [creativity](https://www.artd.com.au/tag/creativity/) - [NAIDOC Week](https://www.artd.com.au/tag/naidoc-week/) - [systems change](https://www.artd.com.au/tag/systems-change/) - [Grants](https://www.artd.com.au/tag/grants/) - [Thematic analysis](https://www.artd.com.au/tag/thematic-analysis/) - [risk management](https://www.artd.com.au/tag/risk-management/) - [program design](https://www.artd.com.au/tag/program-design/) - [Children and young people; focus groups](https://www.artd.com.au/tag/children-and-young-people-focus-groups/) - [evaluation approach](https://www.artd.com.au/tag/evaluation-approach/) - [Evaluation approaches](https://www.artd.com.au/tag/evaluation-approaches/) - [iwd2026](https://www.artd.com.au/tag/iwd2026/) - [stakeholder](https://www.artd.com.au/tag/stakeholder/) - [healthcare](https://www.artd.com.au/tag/healthcare/) - [World Health Day](https://www.artd.com.au/tag/world-health-day/) - [Communication](https://www.artd.com.au/tag/communication/) - [World Environment Day](https://www.artd.com.au/tag/world-environment-day/) ## Categories - [Partners and Directors](https://www.artd.com.au/team-category/partners-and-directors/) - [Senior Managers & Managers](https://www.artd.com.au/team-category/senior-managers-managers/) - [Senior Consultants & Consultants](https://www.artd.com.au/team-category/senior-consultants-consultants/) - [Analyst](https://www.artd.com.au/team-category/analyst/) - [Administration](https://www.artd.com.au/team-category/administration/) - [Board member](https://www.artd.com.au/team-category/boardmember/) - [Business Support](https://www.artd.com.au/team-category/business-support/) - [Specialist Consultants](https://www.artd.com.au/team-category/specialist-consultants/) ## Service Types - [Evaluation](https://www.artd.com.au/project-service-type/evaluation/) - [Organisational monitoring and impact frameworks](https://www.artd.com.au/project-service-type/organisational-frameworks/) - [Monitoring and evaluation frameworks](https://www.artd.com.au/project-service-type/me-frameworks/) - [Capacity building](https://www.artd.com.au/project-service-type/capacity-building/) - [Service and codesign](https://www.artd.com.au/project-service-type/design/) - [Implementation support](https://www.artd.com.au/project-service-type/development/) ## Sectors - [Environment](https://www.artd.com.au/project-sector/environment/) - [Communities and Justice](https://www.artd.com.au/project-sector/communities-and-justice/) - [Disability](https://www.artd.com.au/project-sector/disability/) - [Health and Ageing](https://www.artd.com.au/project-sector/health-and-ageing/) - [Mental Health and Suicide Prevention](https://www.artd.com.au/project-sector/mental-health-and-suicide-prevention/) - [Community, Wellbeing and Resilience](https://www.artd.com.au/project-sector/community-wellbeing-and-resilience/) - [Transport, Infrastructure and Regional Development](https://www.artd.com.au/project-sector/transport-infrastructure-regional-development/) - [Education and Training](https://www.artd.com.au/project-sector/education-and-training/) - [Housing and Homelessness](https://www.artd.com.au/project-sector/housing-and-homelessness/) - [First Nations](https://www.artd.com.au/project-sector/first-nations/) - [Industry and Innovation](https://www.artd.com.au/project-sector/industry-and-innovation/) - [Legislation and Regulation](https://www.artd.com.au/project-sector/legislation-regulation/) - [Employment](https://www.artd.com.au/project-sector/employment/) - [Disaster Management](https://www.artd.com.au/project-sector/disaster-management/)