2010 Banner

Return to search form  

Contact emails are provided for one-to-one contact only and may not be used for mass emailing or group solicitations.

Session Title: Evaluation and the Complexities of International Financial Assistance Programs
Multipaper Session 132 to be held in REPUBLIC A on Wednesday, Nov 10, 4:30 PM to 6:00 PM
Sponsored by the International and Cross-cultural Evaluation TIG
A Look Inside Development: What Do the Monitoring and Evaluation Framework Designs of Foreign-Funded Urban Development Programs in Metro Manilla, Philippines Reveal?
Presenter(s):
Romeo Santos, University of the Philippines, rbsantos1@up.edu.ph
Abstract: The study analyzed a number of urban development programs in Metro Manila, Philippines that are funded by overseas development assistance (ODA) from multilateral, donor or lending agencies, such as the World Bank (WB) and the Asian Development Bank (ADB). It looked at the monitoring and evaluation (M&E) framework components; the targeted outputs, outcomes and impacts, physical development objectives, and sustainability requirements to identify patterns that describe the nature of M&E designs of each program. Review and analysis of the selected foreign-funded programs based on official documents, evaluation reports, online publications, and many other public information materials were done. Resource persons’ interviews were used to validate information. The findings show patterns and features that reveal much about the evaluation designs, as well as on the evaluators or proponents involved in the M&E formulation of the programs. Keywords: donor or loan-led urban development programs, multilateral agencies, monitoring and evaluation (M&E) structure, results-framework
Does Aid Evaluation Work? Meta-evaluation of Aid Evaluation Quality
Presenter(s):
Ryoh Sasaki, International Development Center of Japan, sasaki.ryo@idcj.or.jp
Paul Clements, Western Michigan University, paul.clements@wmich.edu
Michael Scriven, Claremont Graduate University, mjscriv1@gmail.com
Liliana Rodriguez-Campos, University of South Florida, liliana@usf.edu
Abstract: This study describes the metaevaluation of aid evaluation reports generated in a single fiscal year (Fiscal Year 2004). Sample reports (n=102) were chosen by stratified random sampling from the pool of evaluation reports (N=1034) made by 51 donor agencies. The Key Aid Evaluation Checklist (KAEC) was developed based on the well-known Key Evaluation Checklist (KEC) (Scriven, 2006). A key conclusion of this metaevaluation is this: Quality of the current aid evaluation reports in general is regarded as “satisfactory” but far from “excellent,” although some are marked as high quality (i.e., they successfully examine a set of subevaluations and offer overall evaluative conclusions, such as a single grade), while others are of very poor quality (i.e., they do not determine overall or at least some dimensional evaluative conclusions but just present analytic conclusions or fact-findings). Based on these results, recommendations for improvement of the current quality are offered.
Evaluation of the Performance-based Concessionary Resources Allocation Systems of the Multilateral Development Banks and Funds
Presenter(s):
Kenneth Watson, International Monetary Fund, ken.watson@sympatico.ca
Abstract: Most of the multilateral development banks and Funds instituted “performance based” allocation systems between 2000 and 2010 to stop the horse trading that had previously characterized the allocation of cheap loans and grants to developing countries. The new systems were rules-based, with a formula that incorporated measures of country need and country performance. The tradeoffs between need and performance were expressed by the weights of the variables in the allocation formula. It was expected that concessionary funds allocated in this new way would be more effective in promoting economic growth and poverty reduction. However the distinction between “needs” and “performance” was not easy to make in practice, and the great diversity in size and character among developing countries has raised interesting issues in regard to resource allocation by formula. The author reports three evaluations of performance-based allocation systems that he led, their results and the methodological and practical issues they raised.
Improving Development Evaluation Product Quality in Africa: Experience From the African Development Bank
Presenter(s):
Foday Turay, African Development Bank, f.turay@afdb.org
James Edwin, African Development Bank, j.edwin@afdb.org
Mohamed Manai, African Development Bank, m.manai@afdb.org
Colin Kirk, African Development Bank, c.kirk@afdb.org
Abstract: The African development Bank has, over time, been effectively instituting changes in structure, rules and procedures in support of quality improvement of its evaluation products. These measures include a well-defined self- and independent evaluation function and structure and quality assurance mechanism. Notwithstanding the improvements in evaluation product quality as revealed by the primary evaluation customers, this paper argues for an enhanced customer-focused evaluation and assesses the key challenges in pursuing such an approach. These challenges, among others, comprises meeting customers’ expectations, which are most times implicit and inconsistent, and adapting and adopting approaches and methods for gathering and analyzing credible evidence, given the weak monitoring and evaluation culture and systems in the continent. Towards addressing some of these challenges, the paper also explores how a mixed methods’ approach using theory-based evaluation can be useful.
Doing Better at Doing Well by Doing Good: Evaluating Corporate Social Responsibility Projects in Developing Countries
Presenter(s):
Catherine Elkins, RTI International, celkins@gmail.com
Abstract: Standard assessments of Corporate Social Responsibility (CSR) focus on return on investment to the firm, its stakeholders, and/or the so-called triple bottom line (people, planet, and profit). In developing countries, CSR initiatives may stretch far beyond worker satisfaction and recycling, or philanthropy, to activities intended to build social and economic capacity, promote engagement in community concerns, or explicitly strive toward sustainable local development. We explore recent evolutions in the CSR arena toward interventions that resemble international development projects and examine specific attempts to use or adapt results monitoring and evaluation tools or methods to assess these initiatives. Notwithstanding CSR’s theoretical limits, the flexible hybrid approaches possible in the nontraditional CSR project arena offer rich potential to innovate and learn at accelerated rates, and thus to enhance the impact of this new type of intervention on targeted systems, institutions, policies, or beneficiaries.

 Return to Evaluation 2010

Add to Custom Program