Supporting good practice in monitoring and evaluation in partner countries – lessons from Uganda

18 October 2012

As governments in developing countries across the world continue to dedicate a large share of their budgets to expenditure on essential services like health, roads and education, it is important for governments to be able to assess how well these services are being delivered. To collect and analyse this information, governments task particular agencies with undertaking monitoring and evaluation of government services, including reporting back to government where changes or improvements need to be made. If this analysis works well, it can provide a valuable feedback mechanism for governments to assess areas of need in the provision of services, and to direct future budget resources to improving these areas. However, if these activities are poorly coordinated, or do not generate improvements to government services, using public funds for M&E activities can quickly become an inefficient and ineffective form of government expenditure.

Here in Uganda, where I am an ODI Fellow in the Ministry of Finance, Planning and Economic Development, the Government has invested significant financial and human capital in monitoring and evaluating the essential services it provides. Across government, a wide range of agencies in both central and local governments have been assigned responsibility for M&E of government services. After travelling to the delivery site of a service, monitoring teams then present their findings in a report to their relevant Minister, with recommendations to be followed through in Cabinet.

However, at present the system does not always perform well, for two main reasons. Firstly, the M&E network is highly fragmented across government, with significant inefficiencies and overlapping M&E activities – in a recent example, a health clinic in a remote area was visited by two monitoring teams on the same day, from the Ministry of Health and the Ministry of Finance, and the two teams were not aware that the other would be visiting. A recent assessment of monitoring teams within government by the Ministry of Public Service indicates that at least twelve central government agencies have some role in conducting monitoring of public service provision. As well as duplicating their field visits, government agencies also do not share the information they have collected with other agencies within the government, or released publicly, meaning that data quality is reduced and potential economies of scale are not realised. The second issue in the performance of the M&E system is that the recommendations made to government and ministry leaders following the completion of field visits are not always followed up or acted upon, meaning that there are not always tangible improvements being made to services as a result of all the M&E activity being undertaken.

Donors are also having an impact on the success of the government’s M&E system, through two main channels. Firstly, donors have in the past contributed to the establishment of new or stand-alone M&E units in government, often in conjunction with broader PFM reforms or governance activities in support of improved transparency. These units, particularly if they are located in a central agency of government, often duplicate existing M&E units and can occasionally supersede their role. A clear example of this is the creation of the Budget Monitoring and Accountability Unit in the Ministry of Finance, which was established as part of a broader suite of PFM reforms with the aim of providing high-quality monitoring and analysis of government services – but which exists is in addition to numerous other similar teams in the sectoral ministries, Office of the Prime Minister, and the Inspectorate-General of Government. While the quality of the analysis produced by BMAU is high, its creation is nonetheless contributing to the overlapping and inefficient nature of the M&E system.

The second way in which donors are affecting partner government M&E systems is that donor agencies that deliver aid directly through projects tend to establish their own M&E system for their particular project, rather than working with the existing M&E system that is in place in the relevant government ministry. The results of these M&E activities may be shared with the ministry, but in general the monitoring visit or evaluation take place outside the existing government system. For example, a recent donor-supported project working to improve the distribution systems for antiretroviral medications to health posts throughout Uganda was monitored and inspected by members of the donor’s project team, including some who travelled from the donor’s home country specifically for this purpose. This duplicates the monitoring of health posts already being undertaken by the Ministry of Health, and misses the opportunity to work with the Ministry to strengthen its existing M&E procedures.

There is an important challenge here for donors, however. On the one hand, by channelling the M&E of the projects they are funding through partner government M&E systems, donors can support capacity improvements to the M&E systems being run by partner governments. On the other hand, if those partner government M&E systems are not performing well, donors may not be able to gain sufficient information to assess whether the projects they are supporting are achieving their goals. However, in the same way that channelling donor funds through partner governments’ budget processes can give donors the opportunity to support improvements to those processes, working through partner governments’ M&E systems can likewise have long-term benefits for improving the quality of those M&E systems. There are several mechanisms donors can utilise in order to support improvements to M&E practices, such as providing training programs on good M&E practice, conducting joint monitoring visits to the field, establishing mentoring arrangements with donors’ M&E experts, or developing improved M&E guidelines and tools for use by partner-government officials. Donors can support partner governments to create clear and concise frameworks defining which parts of government are responsible for M&E and how this will be undertaken, as well as defining how recommendations that arise from M&E will be implemented or followed up. Donors can encourage government agencies to share information across government or, ideally, to release M&E results to the general public for better accountability. Donors can also resist establishing their own stand-alone M&E teams that work outside the partner government’s own system, and avoid establishing new M&E units or teams that duplicate the roles and mandates of those that are already established.

Overall, donors can play an important role in assisting the governments they work with to develop well-defined, organised and effective M&E systems that will provide those governments with a solid information base to make future policy decisions. By learning more about which services are performing well and which are in need of improvement, both governments and donors can work towards essential services that successfully meet the needs of the community.

 Christine van Hooft is an ODI Fellow in the Ministry of Finance, Planning and Economic Development in Kampala, Uganda. She previously spent six years at AusAID in the Pacific Economic Growth team and then more recently on posting in Jakarta, working on Public Financial Management.

Author/s

Christine van Hooft

Christine van Hooft is an ODI Fellow in the Ministry of Finance, Planning and Economic Development in Kampala, Uganda. She previously spent six years at AusAID in the Pacific Economic Growth team and then more recently on posting in Jakarta, working on Public Financial Management.

Comments

  1. This is detailed and well elaborated, i do appreciate the effort put. I also want to highlight the challenges faced by particularly govt entities in tracking performance over time. Despite the several mechanisms in place to try and link different institutions M & E systems, i personally realize that there is still a lot of wastage of resources in terms of duplication of systems. Needless to mention the overlaps in mandates of different entities/ institutions, which in my view is rather political, the technical wing has also resorted to experiments, trail and error in a bid to re-invent the M &E phenomenon ignoring the other more effective and efficient alternatives of building synergies and working with what is in place. This is an issue that still requires urgent attention.

    Reply Comment
  2. Thanks colleagues for your informative news regarding the prospects and challenges in monitoring and evaluating governmnets programes supposed to transform us.My comment relates to the “baraza philosophy” introduced by the OPM. While it sounds a good idea that would promote accountability between right holders and duty bearers, in some districts especially in northern Uganda, its not functioning and seemed to have been abolished and the reason is attributed to the way it was conceptualised. The elements of ownership and participatory processes were an oversight on the part of the promoters (OPM) and Offices of the Resident District Commissioners. The right holders (citizens) often confronted and embarrassed duty bearers during these barazas thus losing the objectives. My suggestion would have been to first educate the duty bearers and rights holders on the whole concept and seek for their input before operationalising the same. Otherwise it would have been the best and effective way of promoting accountability between rights holders and duty bearers including empowering our local people in demanding for their rights as opposed to viewing service delivery as charity from Government.

    I thank you once again for this forum.

    Reply Comment
  3. Thanks this good article.

    However, there are several coordination initiatives including M&E policy spearheaded by the Office of the Prime Minister, the role of National Technical M&E technical working groups and Joint assessment between Development Partners on Half Annual and Annual Government Performance reporting (Cabinet retreats); Government Evaluation Facility on evaluations on Government.

    There is also Monitoring and oversight sub committee which comprises of Ministry of Finance, National Planning Authority, Ministry of Public Service, etc and the purpose of the subcommittee is among others to streamline M&E in oversight institutions.

    In addition, sharing of M&E information is already being done by Office of the Prime Minister. It is known as “Barazas” (public information sharing fora). see details here

    http://www.opm.go.ug/projects/Baraza_Programme.html

    Otherwise thanks for the good paper.

    Reply Comment
    • Dear Benjamin,

      Thanks for your comments. I have heard about the oversight mechanisms you have mentioned, and my understanding is that they have started to become effective in improving the coordination of evaluations across government. However, in a way, this is an example of the overlapping M&E mandates I refer to in my article: as you point out, there are now several coordination mechanisms for M&E, each of which has a similar mandate but has different meeting schedules, reporting lines and composition. The risk is that the coordination of M&E might itself in the future become as complex as the M&E system itself, if it is not properly managed.

      The Baraza program does indeed look very promising, even though it is still in a pilot phase. As I mention in my article, it will be most useful if it becomes a forum for generating change: if the feedback that community members provide to their representatives is properly responded to, and their concerns are acted upon. Time will tell if the program will achieve this goal, but the early indications are positive.

      Thanks again for your contributions.

      Reply Comment
      • Dear Christine,
        Thank you for such an insightful article,
        I want to acknowledge the fact that Uganda M&E system needs to increasingly build capacity of development practitioners especially government officials that are at the forefront of coordinating government projects. However, there still exist a knowledge gap between what should be basing on the set national standard and what actually is. Both the general public (who are rights bearers) and other government officials (taken as the duty bearers) need to be aware of the sector policies (which should be availed in the local language), understand their role and above all the vision of the Baraza initiative.
        It is a great initiative which if all communities positively take on, will improve on the quality of service delivery and promote accountability. CSOs like World Vision have involved different stakeholders in the citizen’s voice and action program but putting more emphasis on joint monitoring using set score cards.
        The Baraza initiative is a good way to go, however based on experience, communities need to be cautious about the big tendency of persons involved politicizing the whole process.

        Reply Comment

Leave a comment