Book on Evidence Use in Africa

Upcoming release of a book on evidence use in Africa

About the Book

This book asks how governments in Africa can use evidence to improve their policies and programmes, and ultimately, to achieve positive change for their citizens. Looking at how different evidence sources are used across a range of contexts, the book brings policy makers and researchers together to uncover what does and doesn’t work and why. This book will be perfect for policy-makers, practitioners in government and civil society, and researchers and academics with an interest in how evidence can be used to support policy making in Africa.

Download the Book

Forward by Prime Minister of the Republic of Uganda

Africa needs to develop, and to do so we need the best evidence to inform our choices for policies and programmes and how we implement them. In Uganda we have been implementing our evaluation system since 2011, and we now have one of Africa’s widely recognised evaluation systems. In fact, we have discovered we already have over 500 policy and programme evaluations that have been undertaken in Uganda! We also have a well-established research system and a growing Science and Innovation Fund, and Makerere University is one of the top universities in Africa with a promising Knowledge Translation (KT) innovation, the Rapid Response Service (RRS). In addition, we have well-established processes for citizen engagement, including our community information fora, Barazas.

We have to use these resources to help inform our policy choices. But how do we do so most effectively? How do we maximise the likelihood that evidence does not just sit on a shelf but is used? This is a timely book to help us in that journey, and it is so refreshing to see these interesting African examples of using evidence for us to learn from, including two examples from Uganda. It also reflects the value that we have obtained from our partnership with Benin, South Africa and more recently Ghana and Kenya through the Twende Mbele programme, and the value of transcending colonial boundaries to learn from our peers across Africa.

We look to our public managers and our scholars to read this book, learn from the experience, and see how it can be applied in our context, so that we don’t only generate the evidence, but we are consciously planning how to maximise the likelihood of use. And I see that one of the conclusions is that we need to take the role of our monitoring and evaluation units more seriously, and their role in brokering the demand from policy makers for evidence and ensuring that evidence is generated in a systematic way to inform ministers and senior managers. For countries that have less well-established evaluation and research systems, this provides an idea of what they can be aiming for.

I commend the authors, I welcome the learnings, and I look forward to seeing more high-quality evidence at Cabinet, and in pan-African fora, contributing to improving development outcomes on the African continent.

Dr Ruhakana Rugunda

Prime Minister of the Republic of Uganda

Contents

Introduction to the book - Ian Goldman and Mine Pabari
An introduction to evidence-informed policy and practice in Africa - Ian Goldman and Mine Pabari
Using evidence in Africa: a framework to assess what works, how and why - Laurenz Langer and Vanesa Weyrauch
Mere compliance or learning: M&E culture in the public service of Benin, Uganda and South Africa - Ian Goldman, Wole Olaleye, Stanley Sixolile Ntakumba, Mokgoropo Makgaba and Cara Waller
Using evaluations to inform policy and practice in a government department: the case of the Department of Basic Education in South Africa - Nedson Pophiwa, Carol Nuga Deliwe, Jabulani Mathe and Stephen Taylor
Use of evidence in a complex social programme: case of an evaluation of the state’s response to violence against women and children in South Africa - Matodzi M. Amisi, Thabani Buthelezi and Siza Magangoe
The influence of local ownership and politics of the use of evaluations in policy making: the case of the public procurement evaluation in Uganda - Ismael Kawooya, Timothy Lubanga, Abdul Muwanika, Edwin Muhumuza and Rhona Mijumbi-Deve
Rapidly responding to policy queries with evidence: learning from Rapid Response Services in Uganda - Ismael Kawooya, Isaac Ddumba, Edward Kayongo and Rhona Mijumbi-Deve
The potential and the challenges of evaluations to positively influence reforms: working with producers in the Benin agricultural sector - Bonaventure Kouakanou, Dossa Aguemon, Marius S. Aina, Abdoulaye Gounou and Emmanuel M. David-Gnahoui
Parliament and public participation in Kenya: the case of the Wildlife Conservation and Management Act 2013 - Mine Pabari, Yemeserach Tessema, Amina Abdalla, Judi Wakhungu, Ahmed Hassan Odhowa and Ali Kaka
The contribution of civil society generated evidence to the improvement of sanitation services in Ghana - Laila Smith, Dede Bedu-Addo, Mohammed Awal and Anthony Mensah
Using evidence for tobacco control in West Africa - Papa Yona Boubacar Mane, Abdoulaye Diagne and Salifou Tiemtore
Lessons for using evidence in policy and practice - Ian Goldman and Mine Pabari

Contributors

Editors

Ian Goldman, Advisor on Evaluation and Evidence Systems, CLEAR Anglophone Africa; Adjunct Professor, University of Cape Town, ian.goldman@wits.ac.za

Ian was the Head of Evaluation and Research in South Africa’s Department of Planning, Monitoring and Evaluation (DPME), where he led the establishment of South Africa’s national evaluation system and spearheaded work on evidence-based policy. He is a commissioner of 3ie and a founder of Twende Mbele, a partnership of African governments promoting monitoring and evaluation. He joined CLEAR Anglophone Africa at the University of Witwatersrand in July 2018. In addition, he is an adjunct professor at the Nelson Mandela School of Public Governance at the University of Cape Town and a visiting professor at the University of Reading in the UK.

Mine Pabari, Visiting Research Fellow, CLEAR Anglophone Africa, mine.pabari@athariadvisory.co.ke

Mine has over 20 years’ experience in the natural resource management and sustainable development as an evaluator as well as programme manager and implementer. From 2001 to 2004, she was responsible for monitoring and evaluation processes across a large-scale regional initiative covering 12 countries in eastern Africa. Thereafter, from 2005 to 2009, she provided technical advisory services to environmental and agricultural programmes in eastern and southern Africa. This included carrying out evaluations, facilitating self-appraisals and internal evaluations as well as training and supporting the development and implementation of monitoring systems. From 2009 to 2017, she was a senior manager heading up the International Union for the Conservation of Nature (IUCN) regional programme in eastern and southern Africa. She is currently a visiting research fellow with CLEAR Anglophone Africa and the managing partner of Athari Advisory.

Foreword

Hon Dr Ruhakana Rugunda, Prime Minister, Republic of Uganda 

Paul Cairney, Professor of Politics and Public Policy, University of Stirling, UK, p.a.cairney@stir.ac.uk  

Contributing authors

Hon Amina Abdalla, CBS, Policy Advisor, Governance and Natural Resources Consultant. Previously, nominated MP and Chair Committee on Environment and Natural Resources, Kenya National Assembly, Honaminaabdalla@gmail.com

Dossa Aguemon, Director of Planning and Prospective, Ministry of Agriculture, Livestock and Fisheries (MAEP), Benin, Aguemondossa@yahoo.fr

Marius S. Aina, Deputy Director of Planning and Prospective, Ministry of Agriculture, Livestock and Fisheries (MAEP), Benin, Asmarius@yahoo.fr

Matodzi M. Amisi, Researcher, CLEAR-AA, University of Witwatersrand, South Africa, michellematodzi@gmail.com

Mohammed Awal, Team Leader, Social Accountability & SDGs, Ghana Centre for Democratic Development (CDD-Ghana), m.awal@cddgh.org

Dede Bedu-Addo, Coordinator, Ghana Monitoring & Evaluation Forum (GMEF), abedums@gmail.com

Thabani Buthelezi, Chief Director M&E, Department of Social Development, South Africa, ThabaniB@dsd.gov.za

Emmanuel M. David-Gnahoui, University of Abomey-Calavi, Benin, edavid1@gmail.com

Isaac Ddumba, Assistant District Health Officer, Mukono District Local Government, Uganda iddumba08@outlook.com

Abdoulaye Diagne, Executive Director, Consortium pour la Recherche Economique et Sociale, Université Cheikh Anta Diop de Dakar, Sénégal, adiagne@cres-sn.org

Abdoulaye Gounou, Chief of the Bureau of Evaluation of Public Policies, Presidency, Benin, agounou0@gmail.com

Ali Kaka, Wildlife Sector Policy Advisor to the Cabinet Secretary, Ministry of Tourism and Wildlife, Kenya, ali.kaka@adeptconservation.net

Ismael Kawooya, Research Scientist, The Centre for Rapid Evidence Synthesis (ACRES), Regional East African Health Policy Initiative (REACH PI), Makerere University College of Health Scientist, Uganda, ikawooya@acres.or.ug

Edward Kayongo, Research Scientist, The Centre for Rapid Evidence Synthesis (ACRES), Regional East African Health Policy Initiative (REACH PI), Makerere University College of Health Sciences, Uganda ekayongo@acres.or.ug

Hon Bonaventure Kouakanou, Deputy Minister of Agriculture, Livestock and Fisheries (MAEP), Benin, bonaventure_kouakanou@yahoo.fr

Laurenz Langer, Senior Researcher, African Centre for Evidence, University of Johannesburg, South Africa, llanger@uj.ac.za

Timothy Lubanga, Commissioner Monitoring & Evaluation, Office of the Prime Minister, Uganda, tlubanga@gmail.com

Siza Magangoe, Chief Director, Families and Social Crime Prevention, Department of Social Development, South Africa, SizaM@dsd.gov.za

Mokgoropo Makgaba, Data Analysis Specialist, Department of Planning, Monitoring and Evaluation (DPME), South Africa, mokgoropo@dpme.gov.za

Papa Yona Boubacar Mane, Coordinateur scientifique, Consortium pour la Recherche Economique et Sociale, Université Gaston Berger–Saint-Louis, Senegal, yonamane@gmail.com

Jabulani Mathe, Formerly Senior Evaluation Specialist, Department of Planning Monitoring and Evaluation, now Senior Advisor, Monitoring and Evaluation, National Planning Commission, Office of the President, Namibia, jmathe@integration.org

Anthony Mensah, Director, EHSD, Ministry of Sanitation and Water Resources, Ghana, mensahanthony@hotmail.com

Rhona Mijumbi-Deve, Senior Research Scientist, The Centre for Rapid Evidence Synthesis (ACRES), Regional East African Health Policy Initiative (REACH PI), Makerere University College of Health Sciences, rmijumbi@acres.or.ug

Edwin Muhumuza, Director Corporate Affairs, Public Procurement and Disposal of Assets (PPDA) Authority, Uganda

Abdul Muwanika, Principal Economist, Office of the Prime Minister, Uganda, abdulmuwanika@hotmail.com

Stanley Sixolile Ntakumba, Acting Deputy Director-General, Department of Planning, Monitoring and Evaluation (DPME), South Africa, stanley@dpme.gov.za

Carol Nuga Deliwe, Chief Director, Strategic Planning, Research & Coordination, Department of Basic Education, South Africa; Research Associate, University of Pretoria, carolnuga@gmail.com

Ahmed Hassan Odhowa, Principal Research Officer, Parliament of Kenya, odhowa.ah@gmail.com

Wole Olaleye, PhD Candidate, University of Witwatersrand, South Africa; Visiting Research Associate, CLEAR-AA, wole4467@gmail.com

Nedson Pophiwa, Senior Researcher, National Consumer Commission; Research Fellow, CLEAR AA, pophiwan@gmail.com

Laila Smith, Research Associate with CLEAR-AA, former director of CLEAR-AA, laila.smith747@gmail.com

Stephen Taylor, Director, Research Coordination, Monitoring and Evaluation, Department of Basic Education, South Africa, Research Associate, University of Stellenbosch, taylor.s@dbe.gov.za

Yemeserach Tessema, Researcher, Athari Advisory, Kenya, yemi.tessema@athariadvisory.co.ke

Salifou Tiemtore, Director of Customs Union & Taxation, Department of Trade, Customs & Free Movement, ECOWAS, saliftiemtore@yahoo.fr

H.E. Prof. Judi Wakhungu, EGH, Kenya Ambassador to France, Portugal, Serbia & Holy See. Previously Cabinet Secretary, Ministry of Environment and Natural Resources, Kenya, judiwakhungu@gmail.com

Cara Waller, Programme Manager, Twende Mbele programme, based at CLEAR-AA, University of Witwatersrand, cara.waller@wits.ac.za

Vanesa Weyrauch, Co-founder, Politics & Ideas, Argentina, v_weyrauch@yahoo.com

Webinars

22 April 2020

12.45-14.00 UK time. Hosted by CEDIL Programme. This webinar focuses on the analytical framework guiding the research and the emerging overall lessons arising from the book. The speakers include the co-editors, Ian Goldman and Mine Pabari, as well as Laurenz Langer who wrote Chapter 3 on the Analytical Framework.

Webinar: https://bit.ly/2L9DaE7

Presentation: https://bit.ly/2L7zsuP

7 May 2020

09.00 New York time. Hosted by EVALSDGs. It focuses on Chapter 5, a case study on the use of evaluation evidence by the Department of Basic Education (DBE) in South Africa, a department which has been a pioneer of using evaluations and other evidence. The webinar will draw out the lessons for evidence use emerging from this example of country-driven evaluation. Key speaker is Carol Nuga Deliwe, Chief Director, DBE.

Webinar: https://www.youtube.com/watch?v=lrZz2iDGDVo

Presentation: https://bit.ly/30u0B3U

3 June 2020

16.00-17.15 Kenya time. Hosted by AFIDEP. This webinar focuses on Chapter 10 entitled "Parliament and public participation in Kenya". This chapter explores the role of Parliament in policy making through citizen engagement and public participation, drawing on experiences from the review and enactment of Kenya’s Wildlife Conservation and Management Act 2013.

Webinar: https://www.bigmarker.com/AFIDEP/Parliament-participation-and-policy-making

Presentation: https://bit.ly/30wntQf

21 July 2020

This webinar focuses on Chapter 8 entitled ‘Rapidly responding to policy queries with evidence: Learning from Rapid Response Services in Uganda’. This chapter explores the use of evidence from a rapid response service in supporting national policy processes such as food fortification, and district level decision making.

Webinar: https://www.youtube.com/watch?v=ZPx0agrGhQg

Presentation: https://bit.ly/2CRgnMS

17 August 2020

This webinar focuses on Chapter 12 entitled ‘Using evidence for tobacco control in West Africa’. This chapter explores the use of evidence from research conducted across West Africa led by CRES based in Dakar, working with ECOWAS, to get a directive adopted on tobacco taxation.

Webinar: bit.ly/3lt0BsU

Presentation: https://bit.ly/3lgasCe

15 September 2020

This webinar focuses on Chapter 7 entitled ‘The influence of local ownership and politics of the use of evaluations in policy making: The case of the public procurement evaluation in Uganda’. This chapter explores the use of evidence from this important evaluation of Uganda’s public procurement system.

Webinar registration link: https://bit.ly/3j6a9Im

October 2020

This webinar focuses on Chapter 11 entitled ‘The contribution of civil society generated evidence to the improvement of sanitation services in Ghana. This chapter explores the use of evidence with a NGO, CDD Ghana playing a knowledge broker role using government administrative data.

November 2020

This webinar focuses on Chapter 6 entitled ‘Use of evidence in a complex social programme: case of an evaluation of the state’s response to violence against women and children in South Africa’. This chapter explores the use of evidence from this important diagnostic review (evaluation) of the systems to address violence against women and children in South Africa.

December 2020

This webinar focuses on Chapter 11 entitled ‘The challenges and potential of evaluations to positively inform reforms: working with producers in the Benin Agriculture Sector’. This chapter explores the use of evidence in revising agricultural policy in Benin, notably with the introduction of a strong role for civil society.

27 January 2021

15.00-16.15 South Africa time. Hosted by Twende Mbele. This webinar focuses on Chapter 4 entitled ‘Mere compliance or learning – M&E culture in the public service of Benin, Uganda and South Africa’. This chapter explores some of the issues emerging from a survey conducted of performance culture in the public service in Benin, Uganda and South Africa.

24 February 2021

15.00-16.15 South Africa. Hosted by CLEAR-AA, University of Witwatersrand. Having tabled all the substantive chapters, this webinar focuses on the final chapter, ‘Lessons for using evidence in policy and practice’, as well as drawing out some of the issues emerging from the seminar series and the on-going work applying the lessons with partners. The speakers include Dugan Fraser, the Director of CLEAR-AA as well as the co-editors, Ian Goldman and Mine Pabari.

Videos

Chapter 5, DBE