Office of Development Effectiveness: praised, then abolished

IEC Chair Jim Adams speaking at a Devpolicy-ODE Aid Evaluation Forum, April 2016 (Devpolicy)
IEC Chair Jim Adams speaking at a Devpolicy-ODE Aid Evaluation Forum, April 2016 (Devpolicy)

The creation of the Office of Development Effectiveness was announced in Foreign Minister Alexander Downer’s 2006 Aid White Paper. It symbolised the hope and mood of the time: more aid, better aid. Its job was, and remained, to lead on evaluation within the Australian aid program – to assess the effectiveness of Australian-funded aid projects and to make recommendations for their improvement.

The 2011 Aid Effectiveness Review analysed ODE’s performance and recommended it continue under the auspices of an Independent Evaluation Committee. This, it would argue, would give ODE a more balanced governance framework, with internal management as before, but now with external quality oversight as well. That recommendation was accepted, and IEC was established in 2012, with Jim Adams, former World Bank Vice President, at its head.

Many thought ODE would not survive the takeover of AusAID by the Department of Foreign Affairs and Trade. But it did. Indeed, it seemed to thrive. The Department of Foreign Affairs and Trade Secretary Frances Adamson embraced it, saying as recently as last year: “The Office of Development Effectiveness within DFAT produces robust evaluations which contribute not only to the effectiveness of the Australian aid program but to global knowledge on a range of important development issues.”

As Foreign Minister, Julie Bishop was also a fan, saying “ODE’s work plays an intrinsic role in DFAT’s efforts to identify what is working and what is not, and to build on successful aid approaches.”

ODE began to win recognition externally as well. Two of its evaluations won Australasian Evaluation Society Awards. Inspired by DFAT’s IEC, the National Indigenous Australians Agency set up its own Indigenous Evaluation Committee. A good account of the ODE-IEC success story is available in this ODE-IEC presentation to the 2017 Australasian Evaluation Association.

But then, after the Coalition’s surprise election win of 2019, ODE and IEC fell out of favour. The development policy review process announced by the government in late 2019 foreshadowed a desire to make the aid program more flexible, and to streamline performance measurement. The new performance framework and COVID-19 response strategy released at the end of May didn’t mention ODE once. Its demise was finally admitted at a parliamentary hearing last week.

There hasn’t been an official announcement of IEC’s abolition, but clearly it too has been axed. Jim Adams resigned from the committee in 2019 and wasn’t replaced. Professor Wendy Jarvie, another founding member, wasn’t replaced either when she stood down earlier this year after eight years. That left only one external member, Stephen Creese (formerly Managing Director of Rio Tinto Australia and Julie Bishop’s appointee), not enough for a quorum. IEC’s last meeting was last year.

ODE is being replaced by an evaluation unit that will be led by a director – rather than the more senior branch head who led ODE – and will have only about half the number of staff. It will focus on project evaluations, rather than larger, thematic evaluations.

What is one to make of this? From one point of view, we are back at pre-2006 arrangements in AusAID, when the evaluation function had a much lower profile. Aid wasn’t terrible then. It won’t suddenly become terrible now.

That said, it is certainly an embarrassing decision for the government, in both process and substance. No official announcement has been made, and no justification provided for the abolition of either ODE or IEC. How to explain the sudden irrelevance of the previous Minister’s and current Secretary’s positive assessments of ODE? There is a lot of material on the DFAT website that will need to be removed. In 2017, ten years of ODE’s existence was worth celebrating. Another three years on, clearly not. The Thodey public service review, released by the Prime Minister less than a year ago, is full of the importance of evaluation. So much for that.

It is not only an embarrassing decision, but the wrong one, as well. It might save a bit of money, but the ODE-IEC model was working. If the government wanted more stress on project and less on thematic evaluation, it could have easily instructed the two entities accordingly. But scrapping both entities and downgrading the central evaluation function is the wrong way to go.

Evaluations are not an easy business. It is not easy to get them right, and it is even more difficult to be listened to when you are the bearer of bad news. They need a champion. ODE and IEC were DFAT’s champions of evaluation. No longer.

This blog was first published on The Interpreter.

image_pdfDownload PDF
Disclosure

The author contributed to both the 2006 White Paper and the Independent Review of Aid Effectiveness. Over the years, ODE and the ANU Development Policy Centre collaborated to run several evaluation workshops to publicise and discuss ODE evaluations.

Stephen Howes

Stephen Howes is Director of the Development Policy Centre and Professor of Economics at the Crawford School of Public Policy at The Australian National University.

5 Comments

  • In recent years, thanks to ODE, program evaluations have regularly been published online (i.e. those commissioned by program areas and posts). For me personally that has meant having a clutch of recent evaluations published online having had none published by the Australian government since 1999! I now wonder if this commitment to publish will evaporate. Indeed I wonder about the fate of program evaluations more generally given that it was ODE that seemed to be able to apply effective pressure on program areas and posts to commission a minimum number of evaluations each year. Will we ever see another annual evaluation plan?

  • Back in 2013 I attended a seminar in which the Secretary of the Dept of Finance praised ODE as being the best evaluation unit in any Commonwealth department. Abolishing ODE also seems inconsistent with the recommendations of the APS (Thodey) review on the need to strengthen the evaluation function in Commonwealth departments. These recommendations were supported by the Government in their response to the review when they stated “we will keep focussed on what works – building the capacity of the APS to evaluate how policies and programs are going and embedding evaluation into everyday practice in the APS”.

  • I tend to agree with this assessment. At a time when the ADB, IADB, WB, and even still DFID (FCDO now, specifically their Research and Evidence division) have strong and getting stronger internal research and impact evaluation units (and strong academic linkages and external partnerships in this regard, doing proper research), it has hard to not see this as a big backwards step and yet another potential boon for the consulting industry. Unfortunate, really, since we were already a bit of a laggard in many respects.

Leave a Comment