38250 Document of The World Bank GLOBAL PROGRAM REVIEW THE PROVENTION CONSORTIUM June 28, 2006 Sector, Thematic, and Global Evaluation Division Independent Evaluation Group Abbreviations and Acronyms ACR Administrative Cost Recovery DiMP Disaster Mitigation for ADB Asian Development Bank Sustainable Livelihoods Programme at the University ADPC Asian Disaster Preparedness of Cape Town, South Africa Center, Thailand DMC Disaster Management Center ADRC Asian Disaster Reduction of the University of Wisconsin, Center, Japan U.S.A. AIDB Inter-American Development DMF Disaster Management Facility Bank at the World Bank (later HMU AIDMI All India Disaster Mitigation and HRM team) Institute (before DMI) DMI Disaster Mitigation Institute of ALNAP Active Learning Network for India, later AIDMI Accountability and DML Climate, Energy and Performance, U.K. Environmental Technology AURAN African Urban Risk Analysis Division, Netherland Ministry Network of Foreign Affairs BB Bank Budget DRR Disaster Risk Reduction CABEI Central American Bank for EM-DAT Emergency Disasters Data Economic Integration Base at the CRED, Université CAF Corporatión Andina de Catholique de Louvain in Fomento (Andian Brussels, Belgium Development Corporation) ESCAP Economic and social CAS Country Assistance Strategy development in Asia and the Pacific CAS Country Assistance Strategy FAO Food and Agriculture CBO Community-based Organization of the United Organization Nations CCISB Chamber if Commerce and GFDRR Global Facility for Disaster Industry for Small Businesses Reduction and Recovery CDB Caribbean Development Bank FY Fiscal Year CRA Community Risk Assessment GFMC Global Fire Monitoring Center, CSR Corporate Social Freiburg University, Germany Responsibility GPR Global Program Review CRED Center of Research on the GRID UNEP/GRID-Arendal, Epidemiology of Disasters, Norway Université Catholique de Louvain in Brussels, Belgium GTZ German cooperation enterprise for sustainable development DFID Department for International Development, U.K. HRM Hazard Risk Management Team at the World Bank DGF Development Grant Facility (before HMU and DMF) HMU Hazard Management Unit at MoU Memorandum of the World Bank (before DMF, Understanding later HRM team) NGI Norwegian Geotechnical IADB Inter-American Development Institute Bank NGO Non-governmental IBLF International Business Leaders Organization Forum NOAA National Oceanic and ICM Implementation Completion Atmospheric Administration Memorandum OAS Organization of American ICVA International Council of States Voluntary Agencies OCHA United Nations Office for the IEG Independent Evaluation Group Coordination of Humanitarian (before OED) Affairs IFC International Finance OECS Organization of Eastern Corporation Caribbean States IFIs International Financial OED Operations Evaluation Institutions Department (now IEG-WB) IFRC International Federation of Red OIL Oriental Insurance Company Cross and Red Crescent of India Societies PAHO Pan-American Health IIASA International Institute for Organization Applied Systems Analysis in PATS Partnership Approval and Laxenburg, Austria Tracking System IIED International Institute for PC Presiding Council Environment and Development, U.K. PRSP Poverty Reduction Strategy Paper INFVP Infrastructure Vice Presidency, the World Bank PSIVP Private Sector Development Vice Presidency, the World IRDA Insurance Regulatory and Bank Development Authority of India SC Steering Committee IRI International Research Institute SCIEM Sasol Center for Innovative for Climate Prediction of Environmental Management Columbia University of South Africa’s University of Witwatersrand LA RED Network for Social Studies on Disaster Prevention in Latin SDC Swiss Agency for America Development and Cooperation LFA Logical Framework Approach SIDA Swedish International Development Cooperation LIC Life Insurance Company of Agency India SIFs Social Investment Funds MFI Micro Finance Institution ToR Terms of Reference TUD Transport and Urban USAID United States Agency for Department, the World Bank International Development UN/GIST UN Inter-agency Geographic UW- University of Wisconsin Information Support Team DMC Disaster Management Center UN/ISDR United Nations International VCA Vulnerability and capacity Strategy for Disaster assessment Reduction WB The World Bank UNAM/ Instituto de Geofisica, WBG World Bank Group CENAPR Universidad Nacional ED Autonoma de Mexico / Centro WEF World Economic Forum, Nacional de Prevención de Switzerland Desastres WFP United Nations World Food UNCDF UN Capital Development Program Fund WSSD World Summit on Sustainable UNCHR The UN Refugee Agency Development UNDP United Nations Development ECLAC Economic Commission for Programme Latin America and the Caribbean UNEP United Nations Environment Programme UNICEF The United Nations Children's Fund Director-General Evaluation : Mr.Vinod Thomas Director, Independent Evaluation Group : Mr. Ajay Chhibber Manager, Sector, Thematic and Global Evaluation : Mr. Alain Barbu Task Manager : Mr. Ronald S. Parker Consultant : Ms. Silke Heuser i Contents Key Bank Staff Responsible during Period under Review .......................................... iii Program at a Glance: The ProVention Consortium..................................................... iii Glossary ..............................................................................................................................v Preface.............................................................................................................................. vii Summary........................................................................................................................... ix 1. Program Objectives, Design, and Costs.....................................................................1 ProVention’s Objectives ..........................................................................................1 Activities Organized in Performance Measurement Framework ............................2 Sources and Uses of Funds ......................................................................................3 Governance Structure ..............................................................................................5 2. The External Evaluation of ProVention ....................................................................6 Evaluation Findings and Recommendations ...........................................................6 Independence and Quality of the External Evaluation ............................................7 Independence ...............................................................................................7 Quality..........................................................................................................8 Effective Response to the Evaluation’s Recommendations....................................10 3. Relevance, Efficacy, and Efficiency of ProVention.................................................13 Relevance: ProVention Has Helped Put Risk Management onto the International Agenda .......................................................................................13 International Consensus that Global Action Is Required...........................13 Consistency with the Bank’s development objectives...............................14 Subsidiarity: Who Does What?..................................................................14 Efficacy: ProVention Is Meeting Its Partners’ Needs............................................15 Forging Partnerships ..................................................................................15 Raising Awareness and Advocating Policy Change..................................17 Improving Practice.....................................................................................18 Sharing Knowledge....................................................................................18 Efficiency: Lean Governance Structure Enhances Flexibility But at a Cost in Terms of Accountability ...............................................................................19 4. Bank Performance as a Partner ...............................................................................23 5. Lessons ........................................................................................................................26 ii References.........................................................................................................................27 Annex A. Evaluation Framework for Global Program Reviews.................................33 Annex B. List of Persons Interviewed ............................................................................37 Annex C. Memorandum of Understanding Between IFRC and the World Bank.....39 Annex D. ProVention Activities, 2000-2005 ..................................................................48 Annex E. IFRC ProVention Conferences and Workshops ..........................................57 Annex F. Financial Overview .........................................................................................59 Annex G. Membership of the ProVention Consortium................................................63 Annex H. Performance Measurement Framework from DFID Evaluation ..............67 Annex I. Performance Measurement Framework (2003-2006)...................................72 Annex J. Assessing the Independence and Quality of the External Evaluation.........75 Annex K. Response of the ProVention Consortium to IEGs Global Program Review .........................................................................................................................77 List of Figures, Tables, and Boxes Figure 1: Performance Measurement Framework.....................................................................3 Figure 2: Sources of Funds, ProVention Secretariat FY1999-FY2006……………………….5 Table 1: Assessment of ProVention’s Progress since the External Evaluation……………...11 Box 1: Community-based Activities Link ProVention Partners………………………..........16 Box 2: Questions Sent to the Hazard Risk Management Thematic Group………………..…23 iii Key Bank Staff Responsible during Period under Review Program Manager Alcira Kreimer, DMF February 2000 – August 2002 Margaret Arnold, DMF September 2002 – February 2003 Global Program Task Manager Margaret Arnold, DMF February 2003 – present Director Anthony J. Pellegrini, TUD April 1995 – June 2000 John Flora, TUD July 2001 – September 8, 2003 Maryvonne Plessis-Fraissard, September 2003 – present TUD Vice President Nemat Shafik, PSIVP/INFVP February 1999 – October 2004 Kathy Sierra, INFVP October 2004 – present Trust Fund Operations Greg Toulmin, Director June 1999 – present Global Programs & Partnerships Margret Thalwitz, Director May 2004 – present Program at a Glance: The ProVention Consortium Established February 2000 Objectives The overall goal of ProVention is to help developing countries reduce the risk and social, economic and environmental impact of natural and technological disasters on the poor in order to reduce poverty and build sustainable economies. This is achieved through: 1) Forging linkages, partnerships and closer interaction between members of the Consortium; 2) Advocating for disaster risk management amongst leaders and senior policy makers in international organisations, national governments and the private sector; 3) Developing and demonstrating innovative approaches to the practice of disaster risk identification; risk reduction; and risk transfer/risk sharing; 4) Sharing knowledge and information about best practices, tools and resources for disaster risk management. Activities 1) Generation and dissemination of information and knowledge about disaster risk management; 2) Advocacy comprising proactive interaction with policymakers and decisionmakers concerning disaster risk reduction; 3) Capacity building and training. WBG contributions From BB, FY99-02: US$900,000 (mostly staff time) From IFC, FY99-01: US$125,000 (mostly staff time) From DGF, FY01-03: US$1.01 million Other donor FY99-06: $7.13 million contributions Location February 2000 – February 2003: World Bank, Washington, D.C., USA March 2003 – present: IFRC, Geneva, Switzerland iv Original Governance Presiding Council (PC): The PC provides general guidance and support for the and Management, Consortium. It includes fifteen high level representatives from international 2000–2005 organizations, bilateral donor organizations, financial institutions, and research institutes. The PC was established by the World Bank at launch of ProVention, but never formally convened as a Council. Members of the PC are now recognized as voluntary patrons of ProVention. Steering Committee (SC): The SC provides oversight for the Consortium's activities and approves its annual workplans, financial plans and evaluation efforts. During ProVention’s first phase (2000-2002), the SC was chaired first by Norway and then by IFRC and included eighteen representatives. During its second phase (2003-present), the SC was chaired by IFRC and included sixteen representatives. Secretariat: The Secretariat is responsible for carrying out the administrative functions of the partnership and implementing its workplans. Revised Governance Presiding Council: Voluntary patrons and high level advocates and Management, ProVention Forum: Consortium dialogue, trends analysis, generation of new ideas 2005 to present and initiatives Advisory Committee: Strategic advice, direction, and workplan approval, and oversight of the Secretariat (main governance body) Secretariat: Workplan management and ProVention administration Host Organization: The International Federation of Red Cross and Red Crescent Societies (IFRC), is responsible for management oversight of the Secretariat and administers ProVention’s funds. Latest Program-level Tony Beck, Consultant, and Ian Christoplos, Consultant, February 2005 Evaluation v Glossary Consortium An association or a combination, as of businesses, financial institutions, or investors, for the purpose of engaging in a joint venture. A cooperative arrangement among groups or institutions Disaster risk management The systematic process of using administrative decisions, organization, operational skills and capacities to implement policies, strategies and coping capacities of the society and communities to lessen the impacts of hazards. Disaster risk reduction The conceptual framework of elements considered with the (disaster reduction) possibilities to minimize vulnerabilities and disaster risks throughout a society, to avoid (prevention) or to limit (mitigation and preparedness) the adverse impacts of hazards. Hazard A potentially damaging physical event, phenomenon or human activity that may cause the loss of life or injury, property damage, social and economic disruption or environmental degradation. Mitigation Structural and non-structural measures undertaken to limit the adverse impact of natural hazards, environmental degradation and technological hazards. Network An interconnected group of people; an organization; specifically a group of people having certain connections which may be exploited to gain information, especially for professional purposes. Preparedness Activities and measures taken in advance to ensure effective response to the impact of hazards, including the issuance of timely and effective early warnings and the temporary evacuation of people and property from threatened locations. Partner, partnership This Global Program Review uses the term “partner” and “partnership” broadly to include organizations and individuals that are involved in collaborating with ProVention on the issue of risk reduction. This usage goes beyond the narrower concept of formal membership in the governing body of the program. Prevention Activities to provide avoidance of the adverse impact of hazards and means to minimize related environmental disasters. Recovery Decisions and actions taken after a disaster with a view to restoring or improving the pre-disaster living conditions of the stricken community, while encouraging and facilitating necessary adjustments to reduce disaster risk. Relief / response The provision of assistance or intervention during or immediately after a disaster to meet the needs of those people affected. It is generally immediate and short-term. Resilience / resilient The capacity of a system, community or society potentially exposed to hazards to adapt, by resisting or changing in order to reach and maintain an acceptable level of functioning and structure. Risk The probability of harmful consequences, or expected losses (deaths, injuries, property, livelihoods, economic activity disrupted or environment damaged) resulting from interactions between natural or human-induced hazards and vulnerable conditions. Source: Adapted from UN International Strategy for Disaster Reduction, On-Line Dictionary: http://www.thefreedictionary.com/Consortium and Oxford English Dictionary. vii Preface The ProVention Consortium was created in February 2000 as a partnership between the World Bank, other International Financial Institutions (IFIs), bilateral donor organizations, the insurance sector, the academic community, and civil society. At the time, the UN Decade for Natural Disaster Reduction had just ended, and the founding partners perceived a need to take the UN effort one step further and better integrate disaster risk management into the development agenda. Designed as a think-tank (1) to commission research and (2) to disseminate risk reduction tools, the ProVention Secretariat was to rotate from one partner organization to another. Thus, after three years at the Bank, the Secretariat was transferred to the International Federation of the Red Cross and Red Crescent Societies (IFRC) in Geneva. ProVention was funded by the short-term window of the Development Grant Facility (DGF), five bilateral donors, and seven ProVention partners. The World Bank and IFC also contributed staff time to ProVention. In FY 2005, one year after the end of the DGF funding cycle, ProVention commissioned the independent consultants Tony Beck and Ian Christoplos to conduct an external evaluation of ProVention’s activities from 2000-2005. This Global Program Review (GPR) assesses the independence and quality of the external evaluation. It also provides an independent opinion on the relevance, efficacy, and efficiency of ProVention, while assessing the Bank’s performance as a ProVention partner. The review follows the World Bank's Independent Evaluation Group’s (IEG’s) Guidelines for GPRs (Annex A). It is based on the following: the external evaluation, a 2003 DFID evaluation, a desk review of program documentation, information on ProVention activities as reported by the ProVention Secretariat and interviews with staff from both the Washington and the Geneva-based Secretariats. In addition, interviews were held with twelve members of the ProVention Steering Committee (SC) and donor agencies. Silke Heuser (consultant) prepared the GPR under the supervision of Ron Parker (task manager). Ronald Parker conducted stakeholder interviews during a mission to London and Geneva from March 1-8, 2006. Other interviews were conducted in the Bank and elsewhere in Washington, D.C. Finally, a questionnaire was sent to the Hazard Risk Management Thematic Group in the World Bank, which consists of more than a hundred Bank staff in various organizational units. IEG gratefully acknowledges all those who made time for interviews and provided documents and information, in particular the ProVention donor agencies, governance members, management, and administrative staff. The list of people consulted can be found in Annex B. Copies of the draft GPR were sent to the Geneva-based ProVention Secretariat and to relevant Bank staff for their review and comments. A number of their observations have been incorporated into the GPR, as appropriate. The formal response received from the Geneva- based Secretariat is appended in Annex K. ix Summary Objectives. The ProVention Consortium was created in February 2000 as a formal partnership between the World Bank, other International Financial Institutions (IFIs), bilateral donor organizations, the insurance sector, the academic community, and civil society. At the time, the UN Decade for Natural Disaster Reduction had just ended, and the founding partners perceived a need to take the UN effort one step further and better integrate disaster risk management into the development agenda. Designed as a think-tank (1) to commission research and (2) to disseminate risk reduction tools, the ProVention Secretariat was to rotate from one partner organization to another.1 Thus, after three years at the Bank, the Secretariat was transferred to the International Federation of the Red Cross and Red Crescent Societies (IFRC) in Geneva. The overall goal of ProVention is to reduce the social, economic and environmental impacts of natural disasters on vulnerable populations in developing countries in order to alleviate poverty and contribute to sustainable development. This is achieved by: (a) Forging partnerships: bringing together key actors and sectors involved in disaster risk management; (b) Promoting policy: advocating for greater attention and commitment to disaster risk management by leaders and decision-makers; (c) Improving practice: developing and promoting innovative approaches and applications for risk reduction; and (d) Sharing knowledge: disseminating information from ProVention partners and projects about good practices, tools and resources for disaster risk management. Activities. While located at the World Bank in Washington, DC, from February 2000 to February 2003, the ProVention Secretariat implemented four types of activities: applied research studies, pilot and demonstration projects, education and training activities, and workshops and conferences. These activities fell into the following four thematic priority topics: (1) risk identification, (2) risk reduction, (3) risk sharing, and (4) knowledge sharing. A detailed list of the 12 activities supported, their regional focus, the partners involved, and the outputs and outcomes is provided in Annex D. After relocating to the IFRC in Geneva in March 2003, the ProVention Secretariat developed a performance measurement framework and implemented 17 activities organized according to five thematic priorities: (1) mainstreaming risk reduction, (2) risk analysis and application, (3) reducing risks in recovery, (4) risk transfer and private sector investment, and (5) expanding risk research and learning. The progress of these activities against their stated objectives and indicators is assessed in Annex I. Funding. The activities of the Washington-based Secretariat and the Secretariat’s transfer to Geneva were funded by the short-term window of the Development Grant Facility 1. During ProVention’s first Steering Committee (SC) meeting in February 2000, SC members developed the idea to rotate ProVention from one organization to another every two to three years. However, because of the high transaction costs, it was decided in September 2005 to have ProVention stay at the IFRC for at least five years (up to December 2008). In 2007, ProVention’s governance body will have to decide whether to move ProVention to yet another organization, to keep it within IFRC, or to make it an independent legal entity. x (DGF), which provided US$1.01 million. Additional contributions of about one million on average per year came from the U.K. and Norway among others. In FY2005, financial support from the World Bank ended, and the Geneva-based Secretariat was able to attract additional funding from Switzerland and Canada. The external evaluation. A program-level evaluation of ProVention was prepared from November through December 2004 by two external consultants. The external evaluation, a DGF requirement, was generally positive. It concluded that DGF and other donor funds had been well spent and that ProVention was “likely to be increasingly used as a channel for joint projects by SC institutions and others working in risk reduction.” The evaluation, however, did raise concerns with ProVention’s governance and purpose. It suggested greater transparency in selecting activities and recommended that ProVention reduce the number of its activities and spend more time on networking. The external evaluation was commissioned by the Geneva-based ProVention Secretariat and supervised by both the World Bank task manager and IFRC program manager. The present IEG review finds that the independence of the evaluation was compromised at three levels – with regard to its organizational independence, its behavioral independence, and its failure to avoid conflicts of interests. The quality of the external evaluation was also compromised by a number of factors: (1) the lack of sufficient time and resources allocated for the external evaluation, (2) the neglect of the existing performance measurement framework, and (3) the failure to provide or use existing quantitative data to assess ProVention’s performance. Notwithstanding the weaknesses of the evaluation, ProVention’s response in terms of implementing the evaluation’s recommendations has been impressive. Relevance. The present Global Program Review found that the issues addressed by ProVention are highly relevant. There was a research gap prior to the establishment of ProVention, and no development agency, including the Bank, had been willing to fill this gap by itself. ProVention was able to generate knowledge and tools to reduce disaster risk at the national and community levels. It has also identified research and advocacy gaps, and generated useful knowledge to fill these gaps at the global level. By commissioning the Natural Disasters Hotspots study (Natural Disaster Hotspots: A Global Risk Analysis), ProVention created an index to identify risk levels of developing countries. This index should enable developing countries and donors to take a proactive approach to natural disasters and incorporate disaster risk when planning investment projects. The way in which ProVention has been able to influence Bank thinking and practice with regard to both lending and non- lending services shows that ProVention has not only been relevant and consistent with the Bank’s development objectives, but also in some respects effective in identifying knowledge gaps and advancing the agenda of disaster risk reduction within the Bank. Efficacy. The external evaluation discussed the achievement of each of ProVention’s four objectives, including ratings by respondents. It did not, however, use the Secretariat’s existing performance measurement framework. The present IEG review complements the external evaluation by rating the progress of the Geneva-based Secretariat’s activities against the objectives and indicators in the performance measurement framework that was developed in 2003 (Annex I). The present IEG review finds that ProVention was largely effective in achieving the outputs described by the indicators of ProVention’s performance measurement xi framework. It has also made progress against its stated objectives, though it is still too early to assess the achievement of final outcomes for the activities undertaken under the Geneva- based Secretariat. Efficiency. The efficiency of ProVention is assessed according to two criteria: the quality of governance of ProVention itself, and the cost-effectiveness of ProVention activities. ProVention’s governance structure has been one of ProVention’s main weaknesses. At its inception, ProVention established a governance structure consisting of a Presiding Council (PC), a Steering Committee (SC), and a Secretariat. ProVention has been repeatedly criticized for this weak and informal governance structure. While an informal governance structure may facilitate an active, innovative and results-oriented response to ProVention’s clients, strategic direction and oversight exercised by the SC have been weak. In response to this criticism, the Geneva-based Secretariat commissioned a governance review in 2005, which recommended the following: the PC should be maintained consisting of “patrons” that provide legitimacy to ProVention; the SC should act as a forum to discuss topics related to reducing the impact of disasters in developing countries; and an Advisory Committee should be created as the main governing body to provide funding guidance and advice on major strategic, policy and organizational decisions. The Secretariat would solicit expert technical advice from independent project reviewers to ensure high-quality technical appraisal of ProVention activities and accountability in funding decisions. This new governance structure was adopted in September 2005 (see Annex C). While it resolves some of the issues addressed by the external evaluation, this Global Program Review finds that the new Advisory Committee has relatively little accountability for ProVention’s performance compared to its influence on what ProVention does. This lack of accountability could be addressed by preparing a written charter that clearly establishes the responsibilities and accountabilities of the Advisory Committee. The external evaluation highlighted that ProVention needed to expand and diversify its donor base. Since then, ProVention has done well but still needs to invest more efforts. DGF funding ended in FY03, and so far only Canada and Sweden have committed to supporting ProVention in addition to its long-time supporters ─ the United Kingdom, Norway, and Switzerland. Both the United Kingdom and the Norwegian government have committed to fund ProVention for at least three more years. Program partners have expressed in no uncertain terms the need for the Bank to stay engaged with the Consortium and to contribute to its budget. In its response to an earlier draft of this report, Bank management reaffirmed its continuing engagement in ProVention (also see footnote 25). Right from ProVention’s inception, it was planned to have the ProVention Secretariat rotate so that different organizations could contribute to its development. In addition, relocation outside the Bank was one of the DGF funding guidelines.2 The transfer of the ProVention Secretariat to Geneva was seen as a new opportunity for closer cooperation with the IFRC, the Geneva-based UN agencies such as UNDP’s Bureau for Crisis Prevention and 2. The DGF guidelines specify the following: Sponsors of programs with in-house secretariats should try to seek partners’ agreement to move such a secretariat outside of the Bank once the Bank's role in its start up has been accomplished, generally within two to three years. http://intranet.worldbank.org/WBSITE/INTRANET/UNITS/INTCFP/INTGPP/INTDGF/0,,contentMDK:20588 640~menuPK:64161695~pagePK:64161743~piPK:64160993~theSitePK:457686,00.html xii Recovery, and the United Nations International Strategy for Disaster Reduction (UN/ISDR), as well as with European civil society organizations. This review finds that transferring the Secretariat has enormous opportunity costs,3 and slowed down implementation of activities by about two year, because it took time to recruit new staff and for them to become familiar with thematic priorities, ongoing activities, and partner organizations − a problem that could have been mitigated to some extent by a short period of staff secondment. Bank performance as a partner. The review finds that the role of the World Bank as founder and initial host of ProVention was crucial. For several of ProVention’s members, participation in the Consortium was seen as an entry point to tap into the Bank’s knowledge and project expertise. The Washington-based Secretariat managed to raise funds and in-kind contributions from a variety of donors. The Bank and the UN/ISDR are currently planning a new facility – called the Global Facility for Disaster Reduction and Recovery (GFDRR) – to address hazard risk management. The new facility is intended to build on the work of ProVention, which made a substantive contribution to improving global awareness and knowledge of hazards. Moving from knowledge to practice is an immediate priority. The GFDRR is intended to provide technical assistance to assist the 86 high risk countries in mainstreaming hazard risk management in development strategies and investment grants for immediate recovery. Thus, three years after the ProVention Secretariat relocated from the Bank to IFRC, the Bank is planning to create a similar institution, which this time is intended not only to generate knowledge, but also to provide technical assistance. This demonstrates the difficulty of retaining the interest of Bank staff in those global programs which leave the Bank and which no longer provide trust funds to support their ongoing work, whether knowledge generation or technical assistance.4 Lessons. The ProVention Consortium is a relevant and innovative program. Its record in bringing about change at the global and country level in a relatively short amount of time has been impressive. ProVention was largely successful in achieving its objectives of networking, advocating, implementing activities, and disseminating research findings and best practices. ProVention’s experiences provide the following lessons: • Global programs are able to pool financial resources and bring together existing experts in the field to fill research gaps when no development agency, including the Bank, is willing to fill this gap by itself. By bringing together partners from a variety of sectors external to the Bank, ProVention was able to determine gaps in the field of 3. In its comments on a previous draft of this GPR, the Geneva-based Secretariat pointed out that the costs of the transfer should also be weighed against the opportunities and benefits. The shift to IFRC has brought a more community-oriented focus to the ProVention agenda through the global Red Cross network and brought in new partners from civil society. 4. The ProVention Secretariat supports this new and important initiative and the critical role it will play in providing technical assistance to high-risk countries. It believes that the knowledge, resources and partners available within ProVention could be of great benefit to the work of the GFDRR. It also hopes that the activities of the GFDRR might feed into ProVention and benefit the wider Consortium. xiii disaster risk management, generate fresh ideas, and catalyze new cooperation and funding, all of which benefited the Bank’s work with developing countries. Through its multi-stakeholder research in areas where no work was being done within the field, ProVention complemented the Bank’s work rather than substituting for it. • When a global program moves beyond the generation and dissemination of knowledge about development, the establishment of a regular monitoring framework is important to shorten the feedback loop and facilitate on-the-ground lesson learning for mid-term corrections. ProVention started out as a program focusing on research. When it moved into technical assistance, pilot projects, and policy reform, it recognized the need for such a monitoring framework. The establishment of this framework should also provide an important basis for periodic program-level evaluations of the program as a whole. • New global programs should pay a great deal of attention to governance issues in their start-up phase. The informal governance structure which ProVention established at the outset, although key for ProVention’s results-oriented interventions, has been one of its weakest features, at least with respect to the strategic direction and oversight exercised by the SC. • The relocation of a global program’s Secretariat from one partner organization to another has enormous opportunity costs. Although relocation has increased the community-oriented focus of ProVention as well as the participation of European civil society organizations, it was expensive and slowed down implementation of activities by about two years. Rather than birthing a global program at the Bank and spinning it off to other organizations, the major sponsors and partners should decide at the outset where a global program is best located and should plan to keep it there for the indefinite future. 1 1. Program Objectives, Design, and Costs PROVENTION’S OBJECTIVES 1. The ProVention Consortium (ProVention, hereafter) owes its existence to the World Bank Disaster Management Facility (DMF), which was established at the World Bank in 1998 as a focal point for disaster reconstruction and prevention.1 It was in the context of the DMF’s work that ProVention was created in February 2000.2 Other partners were brought on board that already had a working relationship with the DMF. The goal for establishing ProVention was to help developing countries build sustainable and successful economies and to reduce the human suffering that often results from natural disasters. But it also helped the DMF to further its risk reduction agenda to organize meetings and activities with global partners on this topic at the headquarters complex. 2. The ProVention Consortium is a global coalition of representatives from governments, international organizations, academic institutions, the private sector, and civil society. Its original objectives when the Secretariat was located at the World Bank in Washington, DC were: (a) To promote a culture of safety through education and training among leaders and citizens of developing countries; (b) To support public policy that can reduce the risk of natural and technological disasters within developing countries; (c) To support pilot projects and to disseminate information about "best practices" that have been proven to mitigate the scope and frequency of disasters; (d) To develop governments' ability to minimize disasters and to respond effectively when they occur; and 1. Between fiscal years 1999 and 2005 the Disaster Management Facility, later the Hazard Management Unit (HMU), assisted Bank task managers in helping countries develop a more strategic and rapid response to natural and technological disasters. The status of this unit changed in 2005. For budgetary reasons, Bank management adopted a distributed, decentralized approach to hazard risk management, rather than retain a specialized central unit. The current Hazard Risk Management Team of the Urban Unit (consisting of the same people as the HMU and DMF) has taken on some of the DMF functions while it serves as the anchor for the Hazard Risk Management Thematic Group, which consists of more than a hundred Bank staff in the various organizational units with a particular interest in hazard risk management. The Hazard Risk Management Team is currently applying for new funding from the Development Grant Facility (DGF) in order to create a Global Facility for Disaster Reduction and Recovery (GFDRR) at the World Bank. Adapted from IEG (2006): Hazards of Nature, Risks to Development, p. 18. 2. The 2003 DFID evaluation describes ProVention’s creation the following way: “The impetus behind its creation stemmed from work undertaken by the WB in 1998. At the invitation of the Government of Mexico, the DMF was requested to help assess the Government’s capacity to manage natural disaster risk. A case study was conducted in collaboration with the International Finance Corporation (IFC), the academic community and representatives of the private reinsurance sector. This successful experience led the WB (and DMF) to realize that to effectively address the many aspects of disaster risk reduction a broad-based partnership [would be] required. In addition, there was recognition that a process or mechanism was required whereby outside expertise might be fed into the WB’s decision-making processes and reflected in its outputs” (DFID 2003, p. 9f.). 2 (e) To forge links between public and private sectors, between the scientific community and policy makers, between donors and victims so that all stake holders work together to strengthen the economy, reduce pain and suffering, and protect the common good (DGF, FY2001, Application Form). 3. The ProVention Secretariat was relocated from the World Bank to the International Federation of the Red Cross and Red Crescent Societies (IFRC) in Geneva in March 2003. Just before the transfer of the Secretariat, in February 2003, DFID completed a first evaluation of ProVention. A second evaluation was commissioned by the Geneva-based Secretariat in 2004. The second evaluation, hereafter referred to as the external evaluation was conducted by Tony Beck, a consultant with experience in disaster risk management. Conducting the external evaluation was a requirement of the Development Grant Facility (DGF), which provided 20 percent of the program’s funding from FY01-03. 4. In response to the two evaluations, ProVention’s original objectives were revised twice in order to give stronger focus and direction to the program and to better measure results. The current statement of ProVention’s objectives reads as follows: The overall goal of ProVention is to reduce the social, economic and environmental impacts of natural disasters on vulnerable populations in developing countries in order to alleviate poverty and contribute to sustainable development. This is achieved through (a) Forging partnerships: forging linkages and partnerships among key actors and sectors involved in disaster risk management; (b) Promoting policy: advocating for greater policy attention and commitment to be given to disaster risk management by leaders and decision-makers; (c) Improving practice: developing and promoting innovative approaches and applications for reducing risk; and (d) Sharing knowledge: sharing knowledge and information from ProVention partners and projects about good practices, tools and resources for disaster risk management. ACTIVITIES ORGANIZED IN PERFORMANCE MEASUREMENT FRAMEWORK 5. Under the Washington-based Secretariat, ProVention supported four types of activities: applied research studies, pilot and demonstration projects, education and training activities, and workshops and conferences. These activities fell into the following four thematic priority topics: (1) risk identification, (2) risk reduction, (3) risk sharing, and (4) knowledge sharing. A detailed list of the 12 activities, their regional focus, the partners involved, and outputs and outcomes is provided in Annex D. 6. After relocating to the IFRC in Geneva in March 2003, the ProVention Secretariat developed a performance measurement framework. The Geneva-based Secretariat has implemented 17 activities, organized into five thematic priorities: (1) mainstreaming risk reduction, (2) risk analysis and application, (3) reducing risks in recovery, (4) risk transfer and private sector investment, and (5) expanding risk research, and learning (Figure 1). 3 Figure 1: Performance measurement framework developed by the Geneva-based Secretariat Source: Workplan 2003-2006, Revised Version, July 2004 SOURCES AND USES OF FUNDS 7. ProVention’s sources of funding are shown in Figure 2 and Annex F, Table 1. Total funds for the period FY99-FY06 amounted to US$9.1 million. Under the Washington-based Secretariat, ProVention received US$5.3 million. This includes the DGF grant, as well as contributions from five donor governments: United Kingdom, Norway, Switzerland, the Netherlands, and France, the bulk of the funds coming from the UK and Norway. Other organizations such as the Wharton School, the Aon Group, IIASA, the Global Development Gateway, Swiss Re, UNEP, and UNDP contributed between US$20,000 and US$80,000 (some in-kind, namely staff time) mainly in FY01. 8. When the Secretariat relocated to Geneva in 2003, US$1.0 million (including funds from the DGF, Norway, and the United Kingdom) was transferred to the Geneva-based ProVention Secretariat in five installments, the last installment being transferred in July 2004. Between February 2003 and April 2006, the Geneva-based Secretariat received an additional US$3.8 million. The Bank continued to administer funds for already-initiated activities. Once all the Secretariat’s funding was transferred to the IFRC, there was a projected shortfall in resources over the intermediate term. This was why the external 4 evaluation recommended that ProVention needed to broaden its donor base and perhaps even establish fixed quotas for contributions from organizations that joined the Consortium.3 9. According to the DGF guidelines, DGF funding should leverage contributions from other donors and not exceed 15 percent of total funding per year. However, where grant programs belong to new areas of activities (such as disaster risk management in the case of ProVention), the target for the Bank grant not to exceed 15 percent of total expected funding will be pursued after allowing for an initial start-up phase (maximum 3 years).4 As shown in figure 2, DGF funding amounted to 18 percent of total funding in FY01, to 12 percent of total funding in FY02, and to 100 percent of total funding in FY03, not including funds transferred from the Washington-based Secretariat. Since FY01 was the start-up year for ProVention, ProVention complied with the guidelines except in FY03. 10. The way in which funds were allocated to support the 12 activities under the Washington-based Secretariat and the 17 activities under the Geneva-based Secretariat are shown in Annex F, Tables 4 and 5. While four of the activities started by the Washington- based Secretariat were transferred to the Geneva-based Secretariat, others stayed at the Bank until their completion. The transfer of full responsibility without full control of the budget caused tensions between the World Bank and the Geneva-based Secretariat and made it difficult for IFRC to approach willing European donors for replenishment because not all their initial allocation had been spent. This is another opportunity cost of relocating the Secretariat. 11. The Washington-based Secretariat spent US$551,500 of the US$1,014,500 DGF grant for administrative purposes and activity management (staff time, travel, and publishing) in FY01 to 03 (Annex F, Table 2). In April 2003 the Washington-based Secretariat transferred the remaining DGF grant of US$463,000 to the Geneva-based Secretariat for the start-up phase (Annex F, Table 3). In April 2004, the Geneva-based Secretariat was audited by PriceWaterhouseCoopers for the period January 1, 2002 to December 31, 2003. The audit found that the Geneva-based Secretariat gave a “true and fair view of revenue collected and expenses paid.” 3. For instance, the May 2005 Review of the ProVention Consortium Governance Structures and Institutional Arrangements noted that a number of global programs specify minimum annual contributions to be entitled to sit on the governing body, such as the Humanitarian Response (SCHR), the Humanitarian Accountability Project International (HAP-I), and the Global Road Safety Project (GRSP), among others. Other programs which have minimum contributions are the Public-Private Infrastructure Advisory Facility (PPIAF) and the Cities Alliance. 4. Retrieved on 06/05/06 from: http://web.worldbank.org/WBSITE/EXTERNAL/PROJECTS/EXTFININSTRUMENTS/EXTTRUSTFUNDSA NDGRANTS/EXTDGF/0,,contentMDK:20225973~menuPK:64161795~pagePK:64161825~piPK:64161011~th eSitePK:458461,00.html 5 Figure 2: Sources of Funds, ProVention Secretariat FY1999-FY2006 $3,000 Transfer of $2,500 ProVention Secretariat $2,000 WB TFs Transferred US$ 000 DGF FY02 Transferred $1,500 Other Contributions $1,000 DGF Grant $500 $0 FY99 FY00 FY01 FY02 FY03 FY04 FY05 FY06 Source: DGF PATS, and IFRC Financial Overview 2002-2006 Note: US$131,000 of the DGF funds received in FY02 was transferred to the Geneva-based Secretariat. In addition, US$110,000 and US$86,473 from Norway and US$281,000 and US$430,000 from the United Kingdom was also transferred to the Geneva-based Secretariat. GOVERNANCE STRUCTURE 12. At its inception, ProVention established a governance structure consisting of a Presiding Council (PC), a Steering Committee (SC), and a Secretariat. The PC consisted of fifteen “patrons” who provided “legitimacy and institutional credibility,” (Hailey and Davey, 2005, p. 13), but who were not involved in ProVention’s governance and management (Annex G). The members of the PC convened only at the launch of ProVention. 13. The SC was intended to be the governing body of ProVention. It consisted of a shifting number of representatives from international and bilateral donor agencies, international financial institutions (IFIs), and at times from the insurance sector, academia, and civil society. The fluctuating number of participants depended on the agenda to be discussed in the SC – a sign of the flexible and informal governance structure of ProVention (see also para. 57 below). The SC has convened once a year (with the exception of FY02) to discuss and endorse the workplan, decide which activities to fund, and to provide general guidance. The Secretariat is responsible for carrying out the administrative functions of ProVention and implementing its workplans. 14. ProVention was repeatedly criticized for its weak governance structure. Therefore, the Secretariat commissioned a governance review in 2005. The governance review recommended reactivating the PC; replacing the SC by a forum to discuss the impact of disasters in developing countries; and creating an Advisory Committee as the main governing body. This new governance structure was adopted in September 2005 (Annex C). 6 2. The External Evaluation of ProVention 15. An external evaluation of ProVention was conducted as required by the DGF.5 The evaluation was a part of the completion process of the grant of US$1.01 million which the DGF made to the ProVention Consortium for the fiscal years 2001 to 2003. The evaluation covered the period from ProVention’s inception in 2000 through late 2004, and was prepared from November to December 2004 by two consultants, Tony Beck and Ian Christoplos. The final report was issued in February 2005. 16. The terms of reference (ToR) for the external evaluation called for an assessment of ProVention’s success in meeting its stated objectives during the three years of the DGF grant. The evaluation was to report on outputs, outcomes and impacts with regard to the use of the DGF grant. The ToR focused the evaluation on the global level and on partner performance of ProVention’s SC members. The evaluation was also to consider the broader results of the entirety of ProVention activities, and not just those financed with DGF funds. A key question to be addressed throughout the evaluation was: “Does the ProVention Consortium add value to the global efforts to reduce the impacts of disasters in developing countries over and above what would be accomplished without ProVention?” In addition, the external evaluation was to provide lessons learned and recommendations that could help improve the future quality and impact of ProVention’s work. The evaluation instruments included interviews with staff members of the founding organization (World Bank), current host organization (IFRC), SC, Secretariat (past and present), donors, key partners and stakeholders; and a desk review of relevant documents and outputs to date. At US$17,700, the budgetary allocation for the evaluation was surprisingly small for a program that had disbursed more than US$5 million during the evaluation time period.6 EVALUATION FINDINGS AND RECOMMENDATIONS 17. The findings of the external evaluation were generally positive. The consultants concluded that the DGF and other donor funds had been well used and that ProVention was “likely to be increasingly used as a channel for joint projects by SC institutions and others working in risk reduction.” Among its specific findings were: • ProVention’s activities were seen as relevant and innovative, particularly those on the economic impact of disasters, and on micro-insurance. ProVention’s work with 5. The DGF requires programs seeking DGF funding of $300,000 or more to incorporate a plan in its grant application for an independent evaluation (i.e. undertaken by evaluators who are not associated with the program) to be conducted every 3-5 years. Part of the DGF grant may be applied towards the cost of this evaluation. Retrieved on April 20, 2006 from: http://web.worldbank.org/WBSITE/EXTERNAL/PROJECTS/EXTFININSTRUMENTS/EXTTRUSTFUNDSA NDGRANTS/EXTDGF/0,,contentMDK:20589009~menuPK:64161799~pagePK:64161825~piPK:64161011~th eSitePK:458461,00.html. 6. According to the DGF evaluation guidelines, Independent Evaluation: Principles, Guidelines and Good Practice: “Evaluations of newer programs that do not require extensive field investigation may typically cost between $75,000 and $150,000. Older programs may have more development impacts to demonstrate and would be more costly to evaluate.” Retrieved on 06/05/06 from: http://siteresources.worldbank.org/INTDGF/Resources/Evaluation&LearningNote.pdf. 7 insurance companies was commended as a link between the private sector, IFIs, and risk managers in developing countries. • ProVention has been effective in establishing a positive working relationship between the World Bank and IFRC,7 the World Bank and other IFIs for policy dialogue, as well as the private sector and the international development community to promote risk reduction at the global level. • ProVention has only partially achieved its advocacy objective. At the Bank it successfully advocated for including disaster risk management in nine national Poverty Reduction Strategy Papers and a number of World Bank Country Assistance Strategies. It also supported bilateral donor policy reforms for natural disaster response. • ProVention has been particularly successful in implementing individual activities of high quality, though the selection process of these activities could be made more transparent. • ProVention needed to improve the dissemination of its research products and toolkits – the program’s fourth objective. The evaluation report cited several institutional factors that were limiting ProVention’s effectiveness in this regard. 18. The present IEG review confirms these findings of the external evaluation with no significant exceptions. In addition to interviewing relevant stakeholders, IEG reviewed several of ProVention’s research products, including the Natural Disaster Hotspots study (see References). This Global Program Review was also informed by the recent IEG evaluation Hazards of Nature, Risks to Development. INDEPENDENCE AND QUALITY OF THE EXTERNAL EVALUATION Independence 19. The present IEG review comes to the conclusion that the criterion of independence was violated at three levels – with regard to the evaluation’s organizational independence, its behavioral independence, and its failure to avoid conflicts of interests (see Annex A, Table 1). This conclusion is spelled out in greater detail in Annex J. 20. Organizational independence. The external evaluation was commissioned by the Geneva-based Secretariat – not by the Presiding Council or the Steering Committee.8,9 The Secretariat also provided technical and administrative support to the team. The World Bank 7. Prior to ProVention, the World Bank and IFRC did not interact in any way at all. 8. According to the terms of reference for the external evaluation, the evaluation was commissioned by the ProVention Consortium Secretariat at the International Federation of Red Cross & Red Crescent Societies (IFRC), Geneva, Switzerland. 9. According to the Geneva-based Secretariat, ProVention was informed by the World Bank’s Disaster Management Facility that an evaluation should be carried out as part of the completion of the DGF grant. The DGF did not insist that it be commissioned by the Steering Committee. 8 global program task manager prepared the shortlist, approved the selection of consultants, and participated in the briefing of the evaluation team. It is normal and good practice for the global program task manager to be involved in the selection process. The problem in this case, however, was that the task manager was also the previous program manager, whose work was being evaluated. 21. Behavioral independence. The Geneva-based Secretariat was in a position to influence the results of the external evaluation to a significant degree since it provided a large amount of input and managed the evaluation. After completion, the evaluation was circulated in draft form to the Secretariat and SC members, and changes were made where considered appropriate by the evaluator. While it is good practice for organizations being evaluated to have the opportunity to review the findings and correct factual errors, it was problematic in this case, because the consultants were reporting to the Secretariat, not the SC. 22. Failure to avoid conflicts of interests. The lead consultant for the evaluation had extensive expertise in the analysis and working of alliances, networks and partnerships, knowledge of program management/administration, and some experience with disaster risk management, but he was not sufficiently at “arm’s length” from the program.10 While he has not been involved in any of the Geneva-based ProVention work, he was chosen on the recommendations of the World Bank’s Disaster Management Facility, where the former Secretariat had been located, and whose work was being assessed. He was selected by default from a short list of three when the other two candidates declined due to scheduling conflicts, and he had earlier been involved as a consultant to the “Learning Lessons from Disaster Recovery” activity, which had been managed by the Washington-based Secretariat. In order to mitigate this conflict, a second consultant was commissioned to carry out an independent desk review of the “Learning Lessons from Disaster Recovery” activity. However, this review finds that the lead consultant cannot be considered sufficiently free of conflicts of interest to provide an independent assessment of the work of the Washington-based Secretariat ─ which formed an important part of the external evaluation. Quality 23. The quality of the external evaluation was also compromised by a number of factors: (1) the lack of sufficient time and resources allocated for the external evaluation, (2) the neglect of the existing performance measurement framework, and (3) the failure to provide or use existing quantitative data to assess ProVention’s performance. 24. Lack of sufficient time and resources allocated for the external evaluation. The ToR directs the external evaluation to use stakeholder views as a primary source of information, especially with respect to the performance of the SC. However, due to the timing of the evaluation (November-December 2004), the author did not have a chance to participate in the SC meetings (February 2004 and April 2005). In addition, the external evaluation did not take opinions of the beneficiaries on-the-ground into account. This omission was the fault of 10. The DGF Guidelines in place at that time (2003) stipulated that “evaluators should be selected on the basis of their expertise in the field, the diverse points of view they bring to a team and their objectivity [and] to avoid conflict of interest, evaluators should have an “arm’s-length” relationship with the program: They should have had no substantive prior involvement in its establishment or operation.” 9 the ToR and the small amount of money allocated to the evaluation rather than the evaluators. No survey was conducted and no on-the-ground verification was undertaken other than the face-to-face and phone interviews with ProVention members. 25. The neglect of the existing performance measurement framework. In its DGF grant application, ProVention organized its activities according to a comprehensive risk management strategy. However, the Bank’s disclosure policy did not allow sharing grant proposals prior to April 1, 2005.11 This is why neither the DFID evaluation team, nor the Geneva-based Secretariat, nor the consultant responsible for the external evaluation was able to see the original framework in the grant proposal. To this review this seems excessively bureaucratic since a great deal of confusion could have been prevented had the DGF grant proposal documents been shared.12 Thus, during the relocation phase of ProVention, a performance measurement framework had to be developed from scratch, which was done with the assistance from DFID. 26. DFID had completed a thorough analysis of ProVention’s 2001-2002 Workplan in February 2003, which led to the development of the new performance measurement framework for the Geneva-based Secretariat in September 2003, and which was included in the July 2004 version of ProVention’s Strategic Workplan (2003-2006). Thus the time elapsed between the development of this performance measurement framework (in September 2003) and the evaluation was only a little more than a year. In the external evaluation, the authors criticized and decided not to use this performance measurement framework. But instead of developing indicators to evaluate with, the consultants limited themselves to criticizing those available. 27. The ToR instructed the consultants to pay special attention to indicators. The external evaluation’s suggestion – to hire a results-based management specialist for half a day in order to work with the SC members to develop of a performance measurement framework – is certainly valid. But the utility of the external evaluation was nonetheless compromised by not using or building upon the existing performance measurement framework to systematically assess progress and achievements against ProVention’s stated objectives and indicators. 28. The failure to provide or use existing quantitative data to assess ProVention’s performance. Instead, the consultants interviewed key stakeholders using a checklist of five questions. A qualitative rating scale (good-satisfactory-unsatisfactory-poor) was used to assess the achievement of each of ProVention’s four main objectives. Similarly, the report did not provide any quantitative data, with regard to ProVention’s financing, on the sources and uses of funds. Thus, the credibility of the external evaluation was hampered by a lack of quantitative data, not withstanding the utility of its findings. Since the DFID evaluation had already been completed, and this also focused largely on the Washington-based activities, the 11. Documents related to grant programs funded by the Development Grant Facility (DGF) were disclosable after April 1, 2005. Retrieved on April 15, 2006 from: http://intranet.worldbank.org/WBSITE/INTRANET/KIOSK/0,,contentMDK:20396771~menuPK:34897~pageP K:37626~piPK:37631~theSitePK:3664,00.html. DGF Grant Letters of Agreement and Evaluation Reports can only be disclosed if all the parties relating to the grant give their consent. Retrieved on April 15, 2006 from: http://freedominfo.org/ifti/20030700f.htm. 12. Other global programs have avoided this problem by preparing a written charter. 10 external evaluation provided little value added. By selecting the “Lessons Learned from Disaster Recovery” activity for an in-depth review, which had already received a cursory review by the DFID evaluation, the evaluation missed the chance to provide a broader overview by assessing the quality of the ProVention-financed work with ECLAC, CRED, or Columbia University ─ all being ProVention’s partner organizations engaged in ongoing work. 29. The external evaluation’s methodology was based almost entirely on qualitative data drawn from interviews and desk studies. Interviews were conducted with 14 of ProVention’s shifting number of SC members, and with 13 of ProVention’s staff, DGF staff, donors, staff in institutions working on ProVention projects, and other key informants. A list with the names of the informants was provided; however, no selection criteria were discussed. The author conducted face-to-face interviews in Geneva, Washington and London, and contacted the rest of the interviewees by phone. In addition, the second consultant conducted an eleven page long review consisting of five country case studies plus one synthesis study. He also conducted six interviews with the researchers, one ProVention member, and the ProVention Secretariat manager. EFFECTIVE RESPONSE TO THE EVALUATION’S RECOMMENDATIONS 30. Notwithstanding the deficiencies cited above, ProVention’s response to the external evaluation’s recommendations has been impressive. Out of eight recommendations, six have been fully accepted, and one largely so (see Table 1). The one area of disagreement between the external evaluation and the present IEG review is the recommendation of the external evaluation that ProVention give up its advocacy role. The evaluation questioned the usefulness of this advocacy role, noting that most “SC members are mid-level managers who do not have regular access to senior policy makers.” The current Head of the ProVention Secretariat, has acknowledged that a key ongoing challenge to the work of the Consortium, and the wider disaster reduction community, concerns the persistent lack of political will to invest in mitigation and prevention and has admitted that a lack of commitment at the highest levels in developing country governments is a major roadblock. However, rather than accept the evaluation’s recommendation that ProVention give up its advocacy work, staff believe that there is an urgent need to influence senior policymakers and to continue efforts to push the issue of disaster risk reduction up the policy agenda. This point of view was supported by the May 2005 Governance Review, which recommended involving the PC in order to leverage support and increase policy commitment for disaster risk reduction. In addition, interviews conducted by IEG also revealed that the donor partners especially value ProVention’s advocacy role. 31. ProVention’s response to evaluation recommendations is an example of its responsiveness to a wide range of different partners and donors. Time and again this responsiveness, and especially the Head’s sensitivity and people-management skills, were highlighted in IEG’s interviews with SC members. 11 Table 1: Assessment of ProVention’s Progress since the External Evaluation Recommendation (2005) IEG Assessment of Progress (2006) Review of ProVention Recommendation largely implemented: During the SC objectives/outputs and performance meeting in April 2005, a Strategic Planning session was measurement framework (including facilitated by the independent management consultant as whether to continue with an advocacy recommended by the external evaluation. The consultant focus), drawing on current research on asked SC members whether ProVention’s main role was in networks. (Part of the Strategic “agenda-setting,” “knowledge creation,” or being a Planning session recommended in this “portal/forum.” In response, SC members selected the report should focus on revision of the “agenda setting” role as primary purpose of ProVention. performance measurement framework During the meeting, ProVention’s overall objectives and by SC members, facilitated by a results outputs were discussed, though not at the level necessary based management specialist. This to work out details of a performance measurement would take half a day, and would help framework (SC Report April 2005 and Annual Report, clarify ProVention’s overall objectives 2005). and how its various projects can contribute to these.) Review of activity selection and Recommendation accepted and implementation started: development of a set of guidelines for The MoU between the World Bank and IFRC for the hosting activity selection and funding of the ProVention Secretariat for the years 2005-2008 stipulates a transparent selection process for ProVention projects. The MoU states: “In reviewing proposed activities for ProVention funding and inclusion in the ProVention work program the Secretariat will solicit expert technical advice from independent project reviewers to ensure high quality technical appraisal of ProVention project activities and accountability in project funding decisions” (MoU dated September 2, 2005). ProVention should focus increasingly Recommendation not accepted and this review concludes on networking and dissemination of that it should not be: Tension exists within the SC between activities and should be less directly a focus on networking activities on the one hand and a involved in implementation of activities, focus on activity implementation on the other. However, as but should rather be involved as a staff rightly observed, ProVention members will not come catalyst for project activities together for no purpose. There need to be new products and developments to discuss. Therefore, ProVention will continue with activity implementation. Activities in future should be Recommendation implemented to the extent that many implemented mainly by southern current activities have a southern focus: Ongoing activities institutions implemented by southern institutions are the AURAN activity (para. 43 below), the Sudan activity for reducing flood risk in Africa, as well as projects in Latin American and South Asia. The work program in 2005 has included additional activities focused on strengthening the capacities of southern research institutions on a broader global basis and on enhanced south-south learning through both the Applied Grants Program and the development of a network of community risk assessment practitioners. Dissemination should become a Recommendation accepted and implementation started: A primary focus of ProVention. new position of Knowledge Sharing Officer was created in the Secretariat and an additional budget line for dissemination activities has been included in each activity with guidelines on dissemination strategies. The Secretariat has commissioned a paper on improving the website. 12 Recommendation (2005) IEG Assessment of Progress (2006) ProVention should develop a Recommendation accepted and implementation started: mechanism for measuring the impact ProVention has acquired software to track the number of of its products. A user survey of users website users per month. It has commissioned individual of the website would be a useful start. project reviews and self-evaluations for Sudan, India micro- insurance, and the Applied Grants Program. ProVention also developed a Monitoring and Evaluation Handbook to measure impact of ProVention products and other global disaster reduction programs. ProVention should initiate discussion Recommendation accepted and implementation started: with UN/ISDR and UNDP concerning The Prevention web idea is strongly supported by the development of a joint website on ProVention. Through regular meetings with UN/ISDR and disaster risk reduction. UNDP, the Secretariat has contributed significantly to the development of this idea and awaits its launch in 2006-07. Mechanisms should be developed to Recommendation accepted and implementation started: A ensure regular feedback from the SC feedback mechanism for Secretariat performance at the on Secretariat performance. annual meetings of the new governance body has been established. Source: IEG 13 3. Relevance, Efficacy, and Efficiency of ProVention 32. The sections below apply IEG’s standard evaluation criteria to the performance of ProVention. RELEVANCE: PROVENTION HAS HELPED PUT RISK MANAGEMENT ONTO THE INTERNATIONAL AGENDA 33. The present IEG review finds that the issues being addressed by ProVention are highly relevant. There is a strong international consensus that more global action is required to mitigate the effects of natural disasters in developing countries. There was a research gap prior to the establishment of ProVention, which no development agency, including the Bank, had been willing to fill by itself. ProVention was able to generate knowledge and tools to reduce risk at the national and community levels. It also continuously identifies research and advocacy gaps, and generates useful knowledge to fill these gaps at the global level. International Consensus that Global Action Is Required 34. The objectives and activities of ProVention reflect a growing international consensus that global action is required to mitigate and prevent losses from natural disasters. Historically, natural disasters have been perceived as unforeseeable acts of nature, and met with ad hoc responses from the development community once these occurred. Although disasters happen throughout the world, losses to disasters in developing countries are generally much higher than in developed countries. In order to prevent some of the losses, the Caribbean was one of the first regions in the developing world to be proactive. Already in the 1980s, Caribbean countries had started to push for prevention and mitigation rather than wait until the damage occurred. Subsequently, the UN declared the 1990s as a Decade for Natural Disaster Reduction13 and in 2000 included disaster risk reduction (under the seventh Millennium Development Goal of protecting our common environment) in the Millennium Development agenda.14 The UN effort was reinforced by the 2005 World Conference on Disaster Reduction in Kobe, Japan, which developed the Hyogo Framework for Action 2005-2015, which represents an attempt to build nations’ resilience to disasters.15 35. ProVention’s activities are also contributing to the growing international consensus. It played a major role at the Kobe Conference and brought together the World Bank, Inter- American Development Bank, Asian Development Bank, Caribbean Development Bank, 13. See UN/ISDR, International decade for natural disaster reduction (IDNDR). Retrieved on 04/10/06 from: http://www.fire.uni-freiburg.de/programmes/un/idndr/idndr.html 14. The UN Millennium Summit gathered in New York in September 2000. A total of 189 world leaders met and adopted the UN Millennium Declaration (A/RES/55/2). Under “Protecting our common environment [the declaration] adopts in all our environmental action a new ethic of conservation and stewardship and, as first steps, resolves...to intensify cooperation to reduce the number and effects of natural and man-made disasters” [paragraph 23]. Retrieved on 04/10/06 from http://www.unisdr.org/eng/mdgs-drr/link-mdg-drr.htm. 15. Hyogo Framework for Action 2005-2015: UN/ISDR International Strategy for Disaster Reduction International Strategy for Disaster Reduction. Retrieved on 04/10/06 from: http://www.unisdr.org/wcdr/intergover/official-doc/L-docs/Hyogo-framework-for-action-english.pdf. 14 African Development Bank, and Council of Europe Development Bank for a workshop on integrating risk reduction into development financing. Although the Asian tsunami in December 2004 and several major disasters in 2005 has increased global awareness of disasters, the international system for disaster risk reduction is still relatively weak, which highlights the importance of ProVention continuing with its mission. Consistency with the Bank’s development objectives 36. ProVention, which was just an idea in 2000, has since developed into a major player for introducing natural hazard risk management into development policy, planning and financing. ProVention has influenced the World Bank to explore financing mechanisms, like micro-insurance, catastrophe bonds, and contingency funds in Dominica, Morocco, Tunisia, countries belonging to the Organization of Eastern Caribbean States (OECS), Turkey, India, Colombia, and Vietnam. ProVention also pushed the Bank and borrowing countries to include natural disaster risk into nine PRSPs.16 The DMF and ProVention have been successful addressing environmental degradation that leads to disasters by including mitigation in regular World Bank projects. Between 2000 and 2004 alone, the Bank included mitigation measures in 140 projects, while between 1990 and 1994 it had included mitigation measures in only 94 projects. In addition, ProVention influenced DFID and SIDA while they were updating their policies on natural disaster risk management. By commissioning the Natural Disasters Hotspots study, ProVention has created an index to identify risk levels of developing countries. This index should enable developing countries and donors to take a proactive approach to natural disasters and include disaster risk when planning projects. The way in which ProVention has been able to influence Bank lending shows that ProVention was not only relevant and consistent with the Bank’s development objectives, but that in some respects it identified knowledge gaps and advanced the agenda of disaster risk reduction within the Bank and the development community. Subsidiarity: Who Does What? 37. When the Secretariat was at the World Bank it had an influence beyond what the number (12) of activities would lead one to expect. ProVention demonstrated the need to bring together partners from a great variety of sectors external to the Bank in order to determine knowledge gaps in the field of disaster risk management, generate fresh ideas, and catalyze new cooperation and funding, all of which benefited the Bank’s work with developing countries. Through its multi-stakeholder research, ProVention complemented the Bank’s work rather than substituting for it and this advanced disaster mitigation investments worldwide. 38. A potential area for overlap of ProVention activities with World Bank activities was the Bank’s ESW work. However, rather than duplicating research efforts, ProVention contributed to the Bank’s knowledge base and raised the Bank’s profile among risk reduction 16. According to the Hazard Risk Management Team, those PRSPs are: Cambodia (2003), Ghana (2003), Honduras (2001), Malawi (2002), Mongolia (2003), Mozambique (2001), Nicaragua (2001), Tajikistan (2002), and Vietnam (2002). 15 experts. Negative effects arose rather for ProVention. SC members expressed concerns with seeing ProVention’s work, such as the hotspots study, published under the Bank’s name. EFFICACY: PROVENTION IS MEETING ITS PARTNERS’ NEEDS 39. This evaluation rates the progress of the Geneva-based Secretariat’s activities against objectives and indicators as presented in the July 2004 version of the revised 2003-2006 Workplan (in Annex I). A summary of outputs and outcomes by activity for the whole period of ProVention is also presented in Annex D. Progress under the Washington-based Secretariat, as evaluated by DFID 2003, is presented in Annex H as supplementary information. 40. ProVention was largely effective in producing outputs (Annex I). Although disaster awareness has risen remarkably during the last few years, the relative contribution of ProVention among all the various players in disaster risk management is hard to disentangle. In addition, little has been done to demonstrate its outcomes because the means to do so is only now being developed in response to a recommendation of the external evaluation (see Table 1 above). Progress made against its stated objectives is explained more fully in the following paragraphs, though it is still too early to say very much about the final outcomes of the activities undertaken under the Geneva-based Secretariat. Forging Partnerships 41. ProVention was effective in forging linkages between IFIs, the private sector, governments, donors, academia, and civil society groups. Under the Washington-based Secretariat, ProVention commissioned research and organized conferences in order to create partnerships for risk reduction at the global level. The Geneva-based Secretariat was able to reach out to country and community-level activities, especially in Africa, South Asia, and Latin America (Box 1). 42. The intensive private sector involvement in its work is one of the great achievements of ProVention. In forging this partnership, IFC and the World Bank were of paramount importance. Examples of successful cooperation include actually incorporating catastrophic risk management in the privatization of infrastructure, new mechanisms to transfer and finance risk, and the development of market mechanisms for the very poor to manage disaster risk through microfinance and micro insurance. Micro-insurance schemes have been developed for Mexico, Turkey, India, OECS countries, Romania, Bulgaria, Colombia, and Vietnam, but they have not yet been tested by a disaster. However, what has been accomplished to date is quite modest. The 2006 IEG evaluation Hazards of Nature, Risks to Development found that more pilot efforts, and especially research on the lessons to be learned from them, are needed before risk-transfer mechanisms will begin to have a significant impact on the lives of the poor. 16 Box 1: Community-based Activities Link ProVention Partners ProVention’s engagement with the insurance sector to make insurance work for the very poor led the Geneva-based ProVention Secretariat to partner in a pilot with the All India Disaster Mitigation Institute (AIDMI). An NGO that partners with Oriental Insurance Company of India (OIC) and Life Insurance Company of India (LIC), the AIDMI provides disaster insurance against 14 hazards. For an annual (and hugely subsidized by whom?) premium of US$3.12 (135 Indian Rupees), slum dwellers receive US$2,200 (95,000 Indian Rupees) when a natural disaster occurs. In addition, property insurance, livelihood protection in the form of wage replacement, and accident-related life insurance are offered. As of September 2005, 2,000 policies had been sold. This micro insurance scheme (called Afat Vimo, or “disaster insurance” in Gujarati) was made possible through the Indian government’s regulation of the insurance sector. In 2000, the Insurance Regulatory and Development Authority of India (IRDA) introduced a quota “that requires insurers to sell a percentage of their insurance policies to low-income clients.” However, because the Afat Vima insurance scheme has been designed to lift disaster victims out of poverty, and it is not economically viable in any sense at all, the AIDMI experiences difficulties in finding private sector insurance companies interested in supporting this low premium and high-volume customer scheme. And the present IEG Review suggests that when prices come near to a sustainable, full actuarial cost level, the client base will be lost. Source: Adapted from Aysan 2005, p. 10f. 43. Another of the Geneva-based ProVention Secretariat’s activities is the African Urban Risk Analysis Network (AURAN). Funded by ProVention and coordinated by the International Institute for Environment and Development17 (IIED), AURAN forges South- South collaboration among six African universities. AURAN has supported the following activities: • A survey in order to develop a disaster risk reduction strategy for Greater Accra (Ghana) • Seismic vulnerability mapping of buildings in Algiers (Algeria) • Awareness-raising events and household surveys on local perceptions of flood risk in Saint Louis (Senegal) • Case studies on health risks in three settlements in Dar es Salaam (Tanzania) • A database to track fire incidents in informal settlements in Cape Town (South Africa), and • Strategies to avoid traffic accidents in Nairobi (Kenya). Cooperation among researchers has been established and two workshops have been organized, one in Nairobi in January 2003 on ”Disasters, Urban Development and Risk Accumulation in Africa” and the second in Lusaka (Zambia) in May 2004 on “Strategies for Disaster Risk Reduction in Urban Areas of Africa.“ 44. For these later activities, partnerships with civil society organizations and NGOs were especially important. As one ProVention member interviewed by IEG noted, regional people in the field are drawing on ProVention’s work. 17. IIED is an “international policy research institute and non governmental body working for more sustainable and equitable global development.” Retrieved on 04/18/06 from: http://www.iied.org/aboutiied/index.html. 17 Raising Awareness and Advocating Policy Change 45. The Washington-based ProVention Secretariat commissioned and managed a groundbreaking study. This study is likely to change policies in international organization, among bilateral donors and developing countries. The Natural Disaster Hotspots: A Global Risk Analysis, involved twelve ProVention partners. The study presented a set of data on the risks of mortality and economic losses associated with six major natural disaster types and determined the prevalence of natural disasters using a common geospatial unit of reference in all countries. In addition, the report ranked countries in terms of highest risk potential in order to influence risk mitigation investments. This has changed the global perception of disasters as random and unpredictable events and made hazard risk more predictable. The Natural Disaster Hotspots study has been selected as a noteworthy partnership highlighting collaborative work among multiple stakeholders (i.e., academia, an international consortium (ProVention), and the World Bank). Panelists recognized the study for influencing risk mitigation investments and better informing the Bank and other donors on how to manage future emergency lending.18 46. Most ProVention members interviewed by IEG stated that ProVention’s conference in October 2004 on insurance, and a presentation made at the 2004 Davos World Economic Forum were likely to influence policy relative to mitigating natural hazard risks in development agencies and in highly vulnerable countries, even though it will certainly take time to cause a world-wide paradigm shift. In addition, two meetings organized by ProVention illustrate its role as a convener, one during the 2005 World Conference on Disaster Reduction in Japan, and one during the 2006 ProVention Forum in Bangkok, where ProVention brought together the World Bank, the Inter-American Development Bank (IADB), the Caribbean Development Bank (CDB), the Asian Development Bank (ADB), and bilateral donor agencies to revise their natural disaster policies. By creating the right incentives in their policies, IFIs and bilateral donors are able to influence practice at the country level. ProVention influences policy discussions (and subsequent revisions) within each organization, by creating opportunities for exchange of ideas, discussions on harmonization, and critical review. Influencing policy is easiest for those who have access to the highest levels of political decision-making. Except in venues like Davos, ProVention staff rarely have this kind of access to senior policymakers. In addition to the above-listed activities, the Geneva-based Secretariat has participated in eighteen conferences (see Annex E for a detailed description) by making presentations, supporting the participation of representatives from developing countries, and by organizing workshops during the event. 47. This review finds that ProVention, given its short lifespan, has been highly effective in advocating for policy change through its ground-breaking research (especially the Hotspots study) and innovative conferences with insurance companies. 18. In 2006, the Natural Disaster Hotspots study received the World Bank's Independent Evaluation Group’s (IEG’s) Good Practice Award. The Awards are given to operations (including projects, programs, other initiatives, and evaluative documents) that exemplify strong Bank performance in design, implementation, and monitoring and evaluation and contribute to positive development outcomes. The winners are selected by an IEG Panel containing a broad spectrum of evaluation expertise. 18 Improving Practice 48. ProVention was less effective in producing and delivering cross-country lessons of relevance to client countries. The Washington-based Secretariat focused more on the global level than on the community level. What it did with respect to delivering cross-country lessons, was for example the five-country study “Learning Lessons from Disaster Recovery.” 49. ProVention commissioned five case studies on natural disaster recovery in Mozambique, Honduras, Bangladesh, Turkey, and India. The objective was to assess the degree to which risks to future disasters were reduced in the recovery process. The studies did not evaluate single agencies and their projects, but analyzed the whole recovery effort after a major disaster. Special attention was paid to the transition between relief and development. One of the major findings was that recovery processes must withstand the pressure to spend funds quickly and take enough time to integrate risk reduction into the development agenda (Beck 2005, p. 40). 50. While the various country studies are of high quality, publication was delayed so that the studies lost their immediate relevance to the people engaged in the activity (a point also raised in the external evaluation). Quicker feedback and cross-country lesson learning would have informed practitioners still involved in reconstruction rather than becoming available after the fact. In addition, two of five studies were not even published in time to inform emergency operations responding to the tsunami, so that a second opportunity for bringing the lessons from recovery to those groups that needed them the most was missed. However, immediately following the Pakistan earthquake, ProVention produced a synthesis of key lessons learned in post-earthquake recovery to support operational decision-makers and reconstruction planners in Pakistan. The Bank’s task teams, for example, specifically requested short précis of the findings rather than full publications, as the urgency did not allow them the time to read full documents. The lessons learned were also translated into Urdu for wider dissemination. Sharing Knowledge 51. The ProVention website is an important tool to connect the diverse ProVention partners with each other and to make ProVention’s work public. In 2002 alone, the Washington-based Secretariat recorded over 200,000 hits. In 2005, the Geneva-based Secretariat recorded more than one million hits. The majority of visitors in 2002 originated from the United States, followed closely by the United Kingdom, Australia, Argentina, Mexico, Switzerland, Canada, Peru, Japan, Turkey, Thailand, and South Africa. 52. Another important way to share knowledge was training provided over a period of two years to over 800 people in 25 events organized by the Washington-based Secretariat. In addition, the Washington-based Secretariat – in collaboration with the Disaster Management Center (DMC) of the University of Wisconsin, the Disaster Management Center of the University of Cranfield, and the Asian Disaster Preparedness Center (ADPC) – awarded 65 scholarships of $5,000 each to students and young professionals from 27 countries working on innovations in the field of risk reduction. In 2005, the Geneva-based Secretariat − in collaboration with the University of Wisconsin, the University of Cape Town and the Asian 19 Disaster Preparedness Center − launched a second round of grants for 52 projects in 34 countries. 53. ProVention has given greater priority to dissemination during the last year: it now spends more of its budget for knowledge sharing and dissemination. ProVention has hired additional staff for dissemination and redesigned its website. The new website was launched in April 2006. 54. When ProVention was transferred to Geneva, the management and control of the website initially stayed with the World Bank. In practice this meant that all changes had to be approved by the Bank. Delays in keeping the ProVention website up to date were frequent but understandably not the fault of the Secretariat.19 This issue was resolved with the MoU of September 2, 2005 and the transfer of the domain rights to IFRC. Other global programs could learn from ProVention and settle website issues early on in the negotiation process with key stakeholders. If and when the ProVention Secretariat was to rotate to another organization, the turnover of the website would be a critical early action. EFFICIENCY: LEAN GOVERNANCE STRUCTURE ENHANCES FLEXIBILITY BUT AT A COST IN TERMS OF ACCOUNTABILITY 55. The efficiency of ProVention is assessed according to two criteria: the quality of governance of ProVention itself, and the cost-effectiveness of ProVention activities. 56. Governance: ProVention’s governance structure has been the most glaring weakness noted by most observers.20 The DFID evaluation concurred that ProVention has been hampered by a weak governance structure. ProVention’s governance structure has been criticized for the following reasons: • Lack of clear roles and responsibilities. The PC, consisting of high-level decision makers, only met for ProVention’s inauguration. Its failure to meet again significantly constrained its utility thereafter. • Lack of accountability. The SC consisted initially of a small group of individuals who knew each other. Once ProVention became more visible through participation in international events, large institutions became interested in collaborating, which increased its impact but made it difficult for the SC to provide guidance to the Secretariat since those representing larger organizations had a large number of superiors to consult before they could make a decision as a representative (of a UN organization, for example). • Lack of transparency. Since ProVention’s initial work program reflected initiatives that SC members wanted to implement, the project selection process was neither formalized nor transparent. 19. Bank management disagrees with this and says that they promptly posted updates whenever they received these from the Geneva-based Secretariat. 20. This point was stressed in the external evaluation, as well as by the DFID evaluation. 20 • Lack of fairness. Potential conflict of interests existed with SC members deciding which programs to fund, including their own. No mechanism/window was set up through which outsiders could apply for funding. Another issue raised by both earlier evaluations was that the very small pool of disaster knowledgeable organizations and staff created the potential for a conflict of interest. Partner organizations eligible and most likely to be selected for ProVention funding were the ones who also decided which projects to support. 57. The main problem for ProVention was a lack of strategic direction and oversight exercised by the SC. SC members themselves saw the lack of clear roles and responsibilities both as a blessing and a challenge: while the flexible structure facilitated the free exchange of ideas, the informality of membership and participation arrangements led to high turnover of participants and a lack of accountability by the SC for ProVention’s activities. 58. One problem that existed in 2000 and which still seems to exist is the concept of who is a partner. ProVention initially took the "big tent" approach and included anybody with a genuine interest in the topic, whether they were contributing financially to the program or not. In this case, what entitled some non-contributors to sit on the SC, but not other non- contributors, was a willingness to participate in joint project implementation. The effect of such a loose ownership was that the SC was not really accountable for the activities of ProVention or its Secretariat, and that accountability reverted by default to the Bank during the first phase and to IFRC during the second phase. The present IEG review finds that this problem has not yet been resolved by the revised governance structure. 59. It is important for collective action organizations to establish boundaries in terms of who can be members, along with rules to cross this boundary. ProVention has not yet accomplished this. Rather, the Secretariat ran it as a Bank program to begin with, and then as an IFRC program, with the SC and now the Forum acting as a discussion group. The failure to address the partnership/membership issue has probably also had a negative impact on fund-raising. A number of global programs specify minimum annual contributions to be entitled to sit on the governing body. 60. Another problem that seems not to have been effectively addressed is the "two masters" problem, in which the program manager reports both to the governing body and to the line management of the organization in which the program is housed. The OED 2004 study on global programs describes this arrangement, which has both benefits and costs, as follows: “The managers of in-house programs that do not have independent governance structures report both to the program’s governing body and to their managers within the housing organization – a classic ‘two masters’ problem” (p. 58). To realize the benefits of being housed in an existing partner organization, while minimizing the costs, ProVention needs to specify more precisely for what functions the Secretariat is accountable to the governing body and for what functions to the hosting organization. 61. The evaluation findings on ProVention’s weak governance structure led the Secretariat to commission a governance review in 2005. The governance review recommended the following: 21 • The PC should be maintained consisting of “patrons” that provide legitimacy to ProVention; • The SC should act as a forum to discuss topics relating to reducing the impact of disasters in developing countries; and • An Advisory Committee should be created as the main governing body to provide funding guidance and advice on major strategic, policy and organizational decisions. In this role the input of the Advisory Committee would be strictly advisory to the Secretariat and the hosting partner who undertake the legal management and governance responsibilities necessary to execute and implement ProVention activities in line with the principles of the Consortium.21 • The Secretariat should solicit expert technical advice from independent project reviewers to ensure high-quality technical appraisal of ProVention activities and accountability in funding decisions. 62. This new governance structure was adopted in September 2005 (Annex C). While it resolves some of the issues addressed by the external evaluation (see Table 1 above), this Global Program Review finds that the new Advisory Committee has relatively little accountability for ProVention’s performance compared to its influence on what ProVention does. This lack of accountability ─ and the two masters issue ─ could be addressed by preparing a written charter, which that clearly establishes the responsibilities and accountabilities of the Advisory Committee. Another issue that also needs to be addressed is the fact that developing and middle income country stakeholders are still underrepresented in the governance of ProVention. There have been exceptions: Mexico had initially provided the platform for cooperation on insurance and thus had a formative influence on the evolving concept which is ProVention. The Secretariat does not yet have any staff from a developing country. ProVention has made progress, however, with respect to implementation. Five activities are being implemented by southern institutions under the Geneva-based Secretariat. 63. DGF funding ended in FY03 and the last World Bank funding ended in July 2004 with the transfer of assets to IFRC. Canada, a new member, has committed to supporting ProVention, joining its long-time supporters the United Kingdom, Norway, and Switzerland. Both the United Kingdom and the Norwegian government have committed to fund ProVention for at least three more years. 64. Cost-effectiveness: Despite ProVention’s limited human and financial resources, it undertook a wide range of activities. Interviews conducted for this review suggested that there was general agreement that ProVention’s work has been of a high quality, and has 21. ProVention is still in the process of selecting members for the Advisory Committee. According to the September 2005 MoU, the Advisory Committee is composed of a minimum of five and maximum of seven members representing various stakeholders in the ProVention Consortium. Membership of the Advisory Committee shall include a representative of the hosting organization (the International Federation), a representation of the founding organization (the World Bank), two representatives of ProVention implementing partners, and up to three representatives of the Consortium donors. The appointment of the other members is made through annual nomination by ProVention Consortium partners during the steering group sessions at the ProVention Forum (Annex C). 22 contributed to new thinking in disaster risk reduction. As a lean organization, it has facilitated flexible interaction with diverse organizations and is seen as a platform where controversial ideas could be discussed to reform policies in more bureaucratic organizations. Compared to other global programs, ProVention’s resources were relatively modest: US$9.1 million over the fiscal years 1999-2006. As envisioned in the DGF grant proposals for FY01 and FY02, partner organizations are all contributing to ProVention through sharing of data (insurance companies), staff (IFC, USAID, and others), information, ideas, and resources (donors). In this respect, ProVention operates in a cost-effective manner. 65. Asked about ProVention’s effectiveness today, members responded that ProVention is effective because of its light, un-bureaucratic touch. ProVention was especially praised for its chameleon-like ability to provide a platform and necessary support to a great variety of organizations, changing its outlook according to the organization’s needs. Compared to Geneva-based UN organizations working on risk-reduction, ProVention is less bureaucratic and better able to respond to the needs of NGOs and private sector organizations because only a few donor governments are involved. As the external evaluation stated, the other two Geneva-based organizations, UNDP’s Bureau for Crisis Prevention and Recovery and the UN’s International Strategy for Disaster Reduction (UN/ISDR) are subject to formal UN requirements and the direction of Member States. ProVention members perceived the three organizations complementing each other rather than duplicating each other’s work. According to one member, ProVention contributes to better cooperation among Geneva- based entities rather than competing with the other two players. 66. ProVention SC members interviewed were full of praise for the ProVention Secretariat. They described the relocation from Washington to Geneva as a transfer from strength to strength, but also expressed concerns about the high opportunity costs. World Bank staff instrumental in creating ProVention was recognized for their vision and expertise. The current Head has been praised for his highly effective leadership and his connections with humanitarian agencies, but concern has been voiced as to what will happen if he decides to move on, since a large measure of the success attained at both the Bank and IFRC has been due to two effective leaders. 23 4. Bank Performance as a Partner 67. The review finds that the role of the World Bank as founder and initial host of ProVention was critical. For several of ProVention’s members, participation in the Consortium was seen as an entry point to tap into the Bank’s knowledge and project expertise. The Washington-based Secretariat raised funds and in-kind contributions from a number of donors. Program partners express in no uncertain terms the need for the Bank to stay engaged with the Consortium and contribute financially to its budget. 68. The Bank was less effective in providing strategic direction and oversight of ProVention after the Secretariat moved to Geneva. This may be due to ProVention’s weak governance structure in the beginning and the fact that ProVention had little support from Bank management once the Consortium left Washington. One example where the World Bank missed an opportunity to provide oversight of the new Secretariat was to ensure that the external evaluation was managed by a body other than the Secretariat. An additional complicating fact was that following the transfer of the Secretariat to IFRC, the Bank went through a period of organizational restructuring with respect to its disaster risk management activities. The DMF was dissolved and the Hazard Management Unit was created which was soon restructured to become the Hazard Management Team. This restructuring and apparent downscaling inevitably affected the amount of time and attention the Bank could give to ProVention in Geneva when resources were limited in Washington. 69. In order to assess the perception of ProVention among Bank staff, IEG sent a questionnaire to the Hazard Risk Management Thematic Group, which consists of more than 100 World Bank staff in various organizational units with a particular interest in hazard risk management. Five questions were asked concerning ProVention (see Box 2). Box 2: Questions Sent to the Hazard Risk Management Thematic Group: The questions sent to the Hazard Risk Management Thematic Group were the following: • comments on the utility of the Consortium and/or the quality of its products and services • questions Bank staff would like to see addressed by the evaluation • suggested contacts • observations on the effectiveness of Bank participation in ProVention and/or the nature of its role, and • anything else staff would wish to contribute 70. According to the limited feedback IEG received from Bank staff,22 staff felt less informed about and less helped by ProVention’s activities once ProVention left Washington.23 One Bank staff member responded to a survey conducted by IEG in stating: “We haven’t heard much from ProVention since it was split off and moved to Geneva. It seems to me that we had more contact with ProVention in the past in part because it was 22. Although IEG sent the questionnaire to more than 100 World Bank staff, only three staff members responded. Because of the small number of responses, IEG did not tabulate them. 23. Bank staff, e-mail sent 02/23/2006. 24 Washington based, but also because it had trust fund monies available.” On the other hand, the move to Europe brought many European organizations into ProVention activities, some of which would never have chosen to become involved while ProVention was Washington- based (Annex G). 71. Right from ProVention’s inception, it was planned to have the ProVention Secretariat rotate so that different organizations could contribute to its development. In addition, relocation away from the Bank was one of the DGF funding guidelines, which state the following: “Sponsors of programs with in-house secretariats should try to seek partners’ agreement to move such a secretariat outside of the Bank once the Bank’s role in its start up has been accomplished, generally within two to three years.”24 The relocation of ProVention to Geneva was seen as a new opportunity for closer cooperation with the IFRC, the Geneva- based UN agencies such as UNDP and UN/ISDR, as well as with European civil society organizations. This review finds that transferring the Secretariat from agency to agency has enormous opportunity costs, as finding new staff slows down the implementation of activities by about two years while they are becoming familiar with the theme, the ongoing activities, and the partner organizations. The review also questions how effective a global organization can be should it wind up housed in a regionally focused institution, such as the Pan-American Health Organization (PAHO) for example, which expressed interest in housing ProVention. Given the opportunity costs of relocating, another option would be for ProVention to stay within IFRC. 72. One obvious lesson is that the transfer of the Secretariat from the Bank to Geneva can and should have been managed more smoothly. Had the Bank transferred ProVention funds at the same time as the Secretariat’s management responsibilities, a series of problems, including especially in the area of fundraising, could have been avoided. This should be kept in mind should further transfers of ProVention’s Secretariat be undertaken. 73. The Bank and the United Nations International Strategy for Disaster Reduction (UN/ISDR) are currently planning a new facility – called the Global Facility for Disaster Reduction and Recovery (GFDRR) – to address hazard risk management. The new facility is intended to build on the work of ProVention, which made a substantive contribution in improving global awareness and knowledge of hazards. Moving from knowledge to practice is an immediate priority. The GFDRR is intended to provide technical assistance to assist the 86 high risk countries in mainstreaming hazard risk management in development strategies. Thus, three years after the ProVention Secretariat relocated from the Bank to IFRC, the Bank is planning to create a similar institution, which this time is intended not only to generate knowledge, but also to provide technical assistance.25 This demonstrates the difficulty of retaining the interest of Bank staff in those global programs which leave the Bank and which 24. Retrieved on April 25, from: http://intranet.worldbank.org/WBSITE/INTRANET/UNITS/INTCFP/INTGPP/INTDGF/0,,contentMDK:20588 640~menuPK:64161695~pagePK:64161743~piPK:64160993~theSitePK:457686,00.html 25. In a recent meeting of the ProVention Secretariat and the Transport and Urban Department (TUD) in Washington, Bank management confirmed that the Bank will continue to stay actively engaged with ProVention in order to benefit from its functions as a think tank, mechanism for tool development, and global forum for policy discussion and development, and that the GFDRR will provide the support needed, particularly at the country level. 25 no longer provide trust funds to support their ongoing work, whether knowledge generation or technical assistance. 74. Stakeholders interviewed in Europe generally were of the opinion that ProVention’s future depends on what happens with the UN organizations, particularly ISDR. Interviewees in Washington were more concerned that the proposed new World Bank facility for disaster reduction might duplicate ProVention’s work and make it irrelevant. Thus, notwithstanding several large donations from European bilaterals, ProVention’s long-term sustainability seemingly will also depend on outside decisions. 26 5. Lessons 75. The ProVention Consortium is a relevant and innovative program. Its record in raising awareness, and in generating and disseminating knowledge about mitigating natural disasters in a relatively short amount of time has been impressive. ProVention was largely successful in achieving its objectives of networking, advocating, implementing demonstration projects, and disseminating research findings and best practices. ProVention’s experiences provide the following lessons: • Global programs are able to pool financial resources and bring together existing experts in the field to fill research gaps when no development agency, including the Bank, is willing to fill this gap by itself. By bringing together partners from a variety of sectors external to the Bank, ProVention was able to determine gaps in the field of disaster risk management, generate fresh ideas, and catalyze new cooperation and funding, all of which benefited the Bank’s work with developing countries. Through its multi-stakeholder research in areas where no work was being done within the field, ProVention complemented the Bank’s work rather than substituting for it. • When a global program moves beyond the generation and dissemination of knowledge about development, the establishment of a regular monitoring framework is important to shorten the feedback loop and facilitate on-the-ground lesson learning for mid-term corrections. ProVention started out as a program focusing on research. When it moved into technical assistance, pilot projects, and policy reform, it recognized the need for such a monitoring framework. The establishment of this framework should also provide an important basis for periodic program-level evaluations of the program as a whole. • New global programs should pay a great deal of attention to governance issues in their start-up phase. The informal governance structure which ProVention established at the outset, although key for ProVention’s results-oriented interventions, has been one of its weakest features, at least with respect to the strategic direction and oversight exercised by the SC. • The relocation of a global program’s Secretariat from one partner organization to another has enormous opportunity costs. Although relocation has increased the community-oriented focus of ProVention as well as the participation of European civil society organizations, it was expensive and slowed down implementation of activities by about two years. Rather than birthing a global program at the Bank and spinning it off to other organizations, the major sponsors and partners should decide at the outset where a global program is best located and should plan to keep it there for the indefinite future. 27 References Aysan, Yasemin 2006. Review of Regional Risk Transfer Initiative Implemented by the Disaster Mitigation Institute of India. Rehabilitation Research and Training Institute (RRTI) Review – January 2005. Beck, Tony. 2005. Evaluation of World Bank Development Grant Facility funding to the ProVention Consortium, 2000-2004. Bernard, Anne. 1996. IDRC Networks: An Ethnographic Perspective. Ottawa: IDRC Evaluation Unit. CIDA. 1995. Guide to Gender-Sensitive Indicators. Hull, Ottawa. Frost, Fenella, et. al. 2003. Review of ProVention Consortium. London: DFID. Gadja, Rebecca. 2004. “Utilizing Collaboration Theory to Evaluate Strategic Alliances.” American Journal of Evaluation, 25 (1), 65-67. Gerrard, Christopher D., Marco Ferroni, and Ashoka Mody (eds.). 2001. Global Public Policies and Programs: Implications for Financing and Evaluation. The World Bank: Washington, D.C. Gignos. 2004. Study on Synergies Among Disaster Reduction Entities Based in Geneva. Geneva: Gignos Research Paper No. 2, Muller, M. and P. Calvi-Parisetti. Hailey, John and Steve Davey. 2005. Review of the ProVention Consortium Governance Structures and Institutional Arrangements. Final Report. May 2005. IEG-World Bank (Independent Evaluation Group; formally OED). 2006. Hazards of Nature, Risks to Development. An IEG Evaluation of World Bank Assistance for Natural Disasters. Washington, D.C.: The World Bank. IFRC. 2003. Protecting Human Dignity. 28th International Conference of the Red Cross and Red Crescent. Declaration. Agenda for Humanitarian Action. Resolutions. Geneva: IFRC. Kewis, Paul. 1995. The Logical Framework Approach (LFA). Handbook for Objectives-oriented Planning. Second Edition. Windhook: NORAD. Kusek, Jody Z. and Ray C. Rist. 2004. Ten Steps to a Results-based Monitoring and Evaluation System. A Handbook for Development Practitioners. Washington, D.C.: The World Bank. Lele, Uma and Christopher D. Gerrard. 2003. “Global Public Goods, Global Programs, and Global Policies: Some Initial Findings from a World Bank Evaluation.” American Journal of Agricultural Economics (U.S.); 85, No. 3:686-91, August 2003. McGinn, Noel F. ed. 1996. Crossing Lines. Research and Policy Networks for Developing Country Education. Westport, Connecticut: Praeger. OED-World Bank. 2002. The World Bank’s Approach to Global Programs: An Independent Evaluation. Phase 1 Report. Washington, D.C.: The World Bank. OED-World Bank. 2004. Addressing the Challenges of Globalization. An Independent Evaluation of the World Bank’s Approach to Global Programs. Washington, D.C.: The World Bank. 28 Parsey, Atoussa K. 2005. Flood Disaster Risk Reduction in Sudan. Communities in Action. An Independent Review of ProVention Consortium Investment in Strengthening Community Flood Resilience in Sudan. Atoussa K. Parsey, Independent Humanitarian Consultant. Khartoum, August 2005. Patton, Michael Q. 1997. Utilization-focused Evaluation. Thousand Oaks: Sage. Pelling, Mark. 2006. The 2006 ProVention Forum. Incentives for Reducing Risk. A Reflection on Key Themes, Issues and Ideas on Risk Reduction Raised at the 2006 ProVention Forum. Hazards, Vulnerability and Risk Research Unit. King’s College London. March 2006. Rana, Saeed and Lauren Kelly. 2004. The Global Water Partnership. Addressing Challenges of Globalization: An Independent Evaluation of the World Bank’s Approach to Global Programs. Case Study. OED Working Paper Series. Washington, D.C.: The World Bank. Washington-Based ProVention Consortium Documents 2002 (March). Report to the Department for International Development (DFID) of the Government of the United Kingdom of Great Britain and Northern Ireland. (March 31, 2002). 2002 (April). ProVention Consortium Project – DFID TF024941: Second Semi-annual Interim Progress Report (1 October – 31 March, 2002). 2002 (April). ProVention Consortium Project – DFID TF024941: Second Semi-annual Interim Progress Report (1 October – 31 March, 2002). 2002 (October). ProVention Consortium Project – DFID TF024941: Third Semi-annual Interim Progress Report (1 April 2002 – 30 September, 2002). 2003 (June). ProVention Consortium Project – DFID TF024941: Fourth Semi-annual Interim Progress Report (01 October 2002 – 13 June, 2003). 2003 (September). ProVention Consortium Project – DFID TF024941: Fifth Semi-annual Interim Progress Report (14 June – 30 September, 2003). 2005 (July). DFID Implementation Completion Memorandum (ICM). Report Number 024941. Geneva-Based ProVention Consortium Documents 2000-01. ProVention Consortium Workplan for 2000-01. 2001-02. ProVention Consortium Workplan 2001-2002. Proposal to the UK’s Department for International Development. 2001-02. ProVention Consortium Workplan 2001-2002. Proposal to the UK’s Department for International Development. Revised: December 4, 2000. 2003 (June). Development Grant Facility Progress Report. 29 2003 (March). MoU: Agreement Between the International Federation of Red Cross and Red Crescent Societies and International Bank for Reconstruction and Development for the Hosting of the ProVention Consortium Secretariat for the Years 2002 – 2004. Washington, D.C. March 10, 2003. 2003 (March). Report of Steering Committee Meeting 5-6 March 2003 at Geneva-based Secretariat, Geneva. 2003 (September). Strategic Workplan (2003-2006). 2003 (September). Working in Partnership to Build Safer Communities and Reduce Disaster Risk in Developing Countries. ProVention Consortium Secretariat Progress Report (March to September). 2003. DFID Project Document 2003-2006. 2004 (April). PriceWaterhouseCoopers. Audit Report for Grants Provided to the ProVention Consortium Secretariat by the World Bank for the Period January 1, 2002 to December 31, 2003. 2004 (August). Report on the DFID Contribution to the ProVention Trust Funds by the ProVention Consortium Secretariat (September 2003- August 2004). 2004 (February) Report of ProVention Consortium Steering Committee Meeting at the Centre for Humanitarian Dialogue, Geneva, 4-5 February 2004. 2004 (July) Development of the “Resources” Section of the ProVention Website. John Twigg. 2004 (July). Strategic Workplan (2003-2006). Revised Version. 2004 (October). Solidarity and Opportunity: The Potential of Insurance for Disaster Risk Management in Developing Countries. Report on ProVention Consortium International Conference. Zurich, October 21, 2004. 2005 (April). Report of ProVention Consortium SC Meeting. The World Bank, Washington, D.C. 2005 (April). Working in Partnership to Build Safer Communities and Reduce Disaster Risk in Developing Countries. Progress Report. 2005 (December). Working in Partnership to Build Safer Communities and Reduce Disaster Risk. Annual Report. 2005 (July). Working in Partnership to Build Safer Communities and Reduce Disaster Risk in Developing Countries. Strategic Workplan 2005-2006. 2005 (June). Working in Partnership to Build Safer Communities and Reduce Disaster Risk in Developing Countries. ProVention Consortium Secretariat Progress Report. 2005 (September). MoU: Agreement Between the International Federation of Red Cross and Red Crescent Societies and International Bank for Reconstruction and Development for the Hosting of the ProVention Consortium Secretariat for the Years 2005 – 2008. Washington, D.C. September 2, 2005. 30 2005 (September). Working in Partnership to Build Safer Communities and Reduce Disaster Risk in Developing Countries. ProVention Consortium Secretariat Progress Report. 2006 (January). Financial Overview for Budget 2005-2006. DGF 2001. Governing Global Programs: Challenges, Principles and Practice. Development Grant Facility Technical Note. Washington, D.C.: The World Bank. 2003. Independent Evaluation: Principles, Guidelines and Good Practice. Washington, D.C.: The World Bank. Guidelines for DGF Funding for Programs with In-house Secretariats (The World Bank, 2006, Intranet). ProVention Studies Beck, Tony. 2005. Learning Lessons from Disaster Recovery: The Case of Bangladesh. Disaster Risk Management Working Paper Series, No. 11. Washington, DC: The World Bank. Benson, Charlotte and John Twigg. 2004. Measuring Mitigation. Methodologies for Assessing Natural Hazard Risks and the Net Benefits of Mitigation. A Scoping Study. Geneva: ProVention Consortium, December 2004. Benson, Charlotte, and Edward Clay. 2002. Bangladesh: Disasters and Public Finance. Disaster Risk Management Working Paper Series No. 6. Washington, D.C.: The World Bank. Benson, Charlotte, et. al. 2001. Dominica: Natural Disasters and Economic Development in a Small Island State. Disaster Risk Management Working Paper Series No. 2; Washington, D.C.: The World Bank. Clay, Edward et. al. 2003. Malawi and Southern Africa: Climatic Variability and Economic Performance. Disaster Risk Management Working Paper Series No. 7. Washington, D.C.: The World Bank. Dilley, M. et al. 2003. Global Natural Disaster Risk Hotspots. Synthesis Report. World Bank and Columbia University. ECLAC. 2003. Handbook for Estimating the Socio-economic and Environmental Effects of Disaster. Mexico City: ECLAC. PAHO. 2003. Guidelines for Vulnerability Reduction in the Design of New Health Facilities. ProVention. 2002. The Quality and Accuracy of Disaster Data: A Comparative Analyses of Three Global Data Sets - October, 2002; Telford, John and Margaret Arnold et. al. 2004. Learning Lessons from Disaster Recovery: The Case of Bangladesh. Disaster Risk Management Working Paper Series, No. 8. Washington, DC: The World Bank. 31 Wiles, P., K. Selvester, K., and L. Fidalgo, L. 2005. Learning Lessons from Disaster Recovery: The Case of Mozambique. Disaster Risk Management Working Paper Series, No. 12. Washington, DC: The World Bank. World Bank. 2004. Building Safer Cities. The Future of Disaster Risk. Disaster Risk Management Series no. 3. Washington D.C.: World Bank. 33 Annex A Annex A. Evaluation Framework for Global Program Reviews Note: This evaluation framework is a general framework that has been designed to cover the wide range of global programs in which the Bank is involved, encompassing both large and small programs and both investment programs and technical assistance programs, etc. It is not expected that every global program review will address every question in the following tables in detail. These are based upon OED’s standard evaluation criteria of relevance, efficacy, efficiency, and Bank performance, appropriately adapted for global programs by drawing upon the Bank’s selectivity and oversight criteria for global programs. 1. Assessing the Independence and Quality of the Global Program Evaluation 1. Evaluation process. To what extent was the global program evaluation independent of the management of the program, according to the following criteria: 1 • Organizational independence, • Behavioral independence, • Protection from external influence, and • Avoidance of conflicts of interest Factors to take into account in answering these questions include: • Who commissioned and managed the evaluation? • To whom did the evaluators report, and how was the evaluation reviewed and distributed? • How much did the evaluation cost? 2. Evaluation instruments. To what extent did the evaluation utilize the following instruments: • Desk and document review • Literature review • Consultations, and with whom • Surveys, and of whom • Site visits • Impact studies 3. Evaluation approach and scope. To what extent did the evaluation utilize a results-based framework? To what extent did the evaluation address: • Global relevance of the objectives and activities of the program • Achievement of outputs, outcomes and impacts in relation to the objectives and indicators • Governance, management, and financing • Partner performance 4. Monitoring framework. To what extent was the quality of the evaluation hindered by an inadequate monitoring framework for the program: • Clear and coherent program objectives and strategies that give focus and direction to the program, that are measurable, and that provide a basis for evaluating the performance of the program • The use of a results-based management framework with a structured set of (quantitative or qualitative) output, outcome, and impact indicators • Systematic and regular processes for data collection and management? 1. For more information on these criteria, see OED Reach, “Independence of OED,” February 24, 2003, which can be downloaded at http://www.worldbank.org/oed/intro/. See also World Bank Development Grant Facility, “Independent Evaluation: Principles, Guidelines and Good Practice,” November 2003, which can be downloaded at http://siteresources.worldbank.org/INTDGF/Resources/Evaluation&LearningNote.pdf. Annex A 34 5. Evaluation feedback. To what extent have the findings of the evaluation been reflected in: • The strategic focus of the program • The organization, management, and financing of the program 2. Assessing the Performance of the Program Relevance: The overarching global relevance of the program 1. International consensus that global action is required. To what extent does the program reflect an international consensus: • Concerning the main global challenges and concerns in the sector • That global collective action is required to address these challenges and concerns? What is the origin of the program: • Is it formally responsible for implementing an international convention • Did it arise out of an international conference • Is it facilitating the implementation of formal standards and approaches • Did donor partners collectively agree to establish the program • Did the World Bank seek other partners after initially founding the program? To what extent is the voice of developing and transition countries reflected in the program’s consensus? 2. Consistency with the Bank’s development objectives. To what extent is the program coherent with the Bank’s mission, global public goods priorities, and sectoral and country assistance strategies? 3. Subsidiarity. To what extent do the activities of the programs complement, substitute for, or compete with regular Bank instruments? To what extent should the activities of the program be carried out by the global program rather than, as the preferred option, implemented through the Bank’s country operations. Do the benefits of collective action relative to the transactions costs of the global partnership exceed the net benefits from the Bank’s using its normal instruments. Efficacy: Outcomes, impacts, and their sustainability 4. Strategic focus. What are the principal objectives and strategies of the program? To what extent is the program providing: • Global and regional public goods • Supporting international advocacy to improve policies at the national level • Producing and delivering cross-country lessons of relevance to client countries • Mobilizing substantial incremental resources? 5. Linkages to country-level activities. To what extent has the program established effective linkages with country-level activities, taking into account that: • The desired nature of these linkages will vary according to the objectives, design, and implementation of each program. • Adding value on the ground in client countries is generally a joint product of both global and county-level activities 6. Value added. To what extent is the program adding value to: • What developing and transition countries are doing in the sector in accordance with their own priorities? • What the Bank and other partners are doing in the sector to achieve sustainable development and poverty alleviation? 7. Risk to development outcome. What is the risk, at the time of evaluation, that development outcomes (or expected outcomes) will not be maintained (or realized)? 35 Annex A Efficiency: Organization, management, and financing of the program 8. Governance and management. To what extent does the governance and management of the program exhibit: • Clear roles and responsibilities – of the officers and bodies that govern and manage the program and of the mechanisms to modify and amend the governance and management of the program in a dynamic context. • Transparency – the program provides both shareholders and stakeholders with the information they need in an open and transparent manner (such as decision-making responsibilities, accountabilities and processes, accounting, audit, and material non-financial issues). • Fairness – the program does not favor some immediate clients over others (such as Bank staff, participating agencies or program secretariats, specific countries or their agencies, municipal agencies, local authorities, private service providers, NGOs, and community organizations). • Clear accountability – of the program for the exercise of power over resources to the program’s stakeholders, including international organizations, donors, developing countries, the private sector, and NGOs? 9. Partnerships and participation. To what extent do developing and transition country partners, clients, and beneficiaries participate and exercise effective voice in the various aspects of the program: • Design • Governance • Implementation • Monitoring and evaluation? 10. Financing. To what extent is the program succeeding in raising financial resources commensurate with its objectives? And from what sources – the Bank, bilateral donors, foundations, etc.? To what extent has the program succeeded in diversifying its funding beyond a small number of donors? To what extent are the sources of funding for the program affecting, positively or negatively: • The strategic focus of the program • The governance and management of the program • The sustainability of the program and the development outcomes of the program? 11. Legitimacy and efficiency. To what extent is the authorizing environment for the program effectively derived from those with a legitimate interest in the program (including donors, developing and transition countries, clients, and other stakeholders), taking into account their relative importance. To what extent has the program achieved, or is expected to achieve: • Benefits more cost-effectively than providing the same service on a country-by-country basis • Benefits more cost-effectively than if the individual contributors to the program acted alone? To what extent are the overhead costs of governing and managing the program reasonable and appropriate in relation to the objectives and activities of the program? Annex A 36 3. Assessing the Bank’s Performance as a Partner in the Program. 1. Comparative advantage at the global level. To what extent is the Bank playing up to its comparative advantages at the global level – its global mandate and reach and convening power? To what extent is the Bank’s presence as a partner in the program catalyzing other resources and partners for the program? 2. Comparative advantage at the country level. To what extent is the Bank contributing multi-sector capacity, analytical expertise, country-level knowledge to the program? To what extent has the Bank’s country operations established linkages to the global program, where appropriate, to enhance the effectiveness of both? 3. Oversight. To what extent is the Bank exercising effective and independent oversight of its involvement in the program, as appropriate, whether the program is housed in the Bank or externally managed? To what extent is the Bank’s oversight independent of the management of the program? To what extent does the Bank’s representative on the governing body have a clear terms of reference? 4. Risks and risk management. To what extent have the risks associated with the program been identified and are being effectively managed? For example, OED identified the following risks in its global review: • Bank bears a disproportionate share of responsibility for governing and managing in-house programs • Confusion at the country level between global program activities, Bank activities, and Borrower activities • Representation of NGOs and the commercial private sector on program governing bodies • Unclear role and application of Bank’s safeguards • Trust-funded consultants and secondees representing the Bank on some program governing bodies. 5. Disengagement strategy. To what extent is the Bank engaged at the appropriate level in relation to the Bank’s new strategic framework? • Watching brief • Research and knowledge exchange • Policy or advocacy network • Operational platform? To what extent is the Bank facilitating an effective, flexible, and transparent disengagement strategy for the program, in relation to the Bank’s objectives for its involvement in the program: • The program declares “mission accomplished” and closes, • The program continues and the Bank withdraws from all aspects of its participation, or • The program continues and the Bank remains engaged, but the degree of the Bank’s engagement in some or all aspects (such as financing) declines over time? 37 Annex B Annex B. List of Persons Interviewed Person Position Date of Interview The World Bank Margaret Arnold Sr Program Officer April 12, 2006 (Washington, D.C.) Alcira Kreimer (former) Manager April 23, 2006 (Washington, D.C.) Department for International Development (DFID) Nigel Adams Deputy Team Manager, Disaster Response March 1, 2006 (London, U.K.) and Risk Reduction Team, Conflict, Humanitarian and Security Department United Nations Development Programme (UNDP) Fenella Frost Global Disaster Reduction Mainstreaming March 2, 2006 (Geneva, Programme Coordinator, Disaster Switzerland) Reduction and Recovery Unit, Bureau for Crisis Prevention and Recovery, (UNDP/BCPR/DRU) ProVention Consortium Secretariat David Peppiatt Head March 2, 2006 (Geneva, Switzerland) Bruno Haghebaert Senior Officer March 2, 2006 (Geneva, Switzerland) Ian O'Donnell Senior Officer March 2, 2006 (Geneva, Switzerland) Maya Schaerer Officer March 2, 2006 (Geneva, Switzerland) Swedish International Development Cooperation Agency (SIDA) Johan Schaar (former) Head of Unit, Humanitarian March 3, 2006 (Geneva, Assistance and Conflict Switzerland) Royal Ministry of Foreign Affairs of Norway Fredrik Arthur Deputy Director-General, Section for March 3, 2006 (Geneva, Humanitarian Assistance Switzerland) United Nation’s International Strategy for Disaster Reduction (UN/ISDR) Salvano Briceño Director of the UN/ISDR Secretariat March 3, 2006 (Geneva, Switzerland) Steering Committee for Humanitarian Response Eva von Oelreich Executive Secretary March 3, 2006 (Geneva, Switzerland) International Federation of the Red Cross and Red Crescent Societies (IFRC) Richard Blewitt Director, Movement Cooperation Division March 3, 2006 (Geneva, Switzerland) Hisham Khogali Acting Head of Disaster Preparedness March 3, 2006 (Geneva, Department Switzerland) Swiss Agency for Development and Cooperation (SDC) Franklin Thévenaz Head of Division / Multilateral Affairs and March 6, 2006 (Geneva, Special Assignments Switzerland) Anne Hassberger SDC March 6, 2006 (Geneva, Switzerland) Annex B 38 Person Position Date of Interview The Inter-American Development Bank Caroline Clark Senior Specialist March 28, 2006 (Washington, D.C.) Fritz Institute – Partners for Effective Relief Anisya Thomas Capacity Building March 29, 2006 (Washington, D.C.) 39 Annex C Annex C. Memorandum of Understanding Between IFRC and the World Bank ProVention Consortium Secretariat for the years 2005 - 2008 This Framework Agreement (the Agreement), is dated as of September 2, 2005, by the INTERNATIONAL FEDERATION OF RED CROSS AND RED CRESCENT SOCIETIES, an international humanitarian organization, headquartered in Geneva, Switzerland (the “International Federation”) and the INTERNATIONAL BANK FOR RECONSTRUCTION AND DEVELOPMENT (the “World Bank”), (hereinafter collectively referred to as the “Parties”); WITNESSETH: Whereas, the ProVention Consortium (“ProVention”) is a consortium of international organizations, governments, the private sector, civil society organizations and academic institutions who collaborate in a global effort to reduce the impacts of disasters in developing countries; and Whereas, the World Bank has served as founding organization of ProVention and hosted the ProVention Secretariat (the “Secretariat”) for the years 2000-2002 before the transfer of the Secretariat to the International Federation in March 2003; and Whereas, the International Federation has hosted the Secretariat since March 2003 under the terms of an Agreement with the World Bank dated March 10, 2003, (the “Hosting Agreement”) which expired on March 31, 2005; and Whereas, the Parties now wish to continue the arrangements in the Hosting Agreement and outline their vision of the “governance structure” of ProVention and their respective obligations in regards to the administration, governance and management of ProVention; NOW, Therefore the Parties agree as follows: 1. General Principles 1.1 The International Federation agrees to continue to undertake the management of the Secretariat for the term of this Agreement. 1.2 The World Bank agrees to the extension of the hosting arrangements at the International Federation for the term of this Agreement. 1.3 The Parties agree to collaborate on guiding the strategic direction and future development of ProVention, including the strengthening of governance and organizational structures. Annex C 40 2. Goal and Objectives of ProVention 2.1 The overall goal of ProVention is to reduce the social, economic and environmental impacts of natural disasters on vulnerable populations in developing countries in order to alleviate poverty and contribute to sustainable development. This is achieved through (a) forging linkages and partnerships among key actors involved in disaster risk management; (b) advocating among leaders and decision makers for increased policy attention and commitment to be given to disaster risk management; (c) developing and promoting innovative approaches to reducing risk; and (d) sharing knowledge and information about good practices, tools and resources for disaster risk management. 2.2 ProVention functions as a consortium of organizations who share a common interest in reducing the impacts of disasters in developing countries. Working through partnership and collaborative action, ProVention links key actors and pools resources so that efforts and benefits are shared. It is based on the core principles of partnership and mutual benefit. 2.3 ProVention partners benefit from their participation in a number of ways: (a) partners become part of a community of interest in reducing disaster risk in developing countries, with the consequent social, economic and environmental benefits; (b) partners gain access to a wider communication network by virtue of the Consortium’s multi-sectoral nature, with resulting increase in knowledge, information and resources; (c) partners can receive direct financial support and resources for disaster reduction activities. 3. ProVention Governance Structure and Management 3.1 The Parties agree to submit a shared vision of the future governance structure of ProVention, building on the proposed structure outlined in Annex 1, to the Steering Committee on February 2, 2006 for adoption by the ProVention members. 3.2 The Secretariat will be managed by the International Federation in a manner consistent with its policies, procedures, and the Fundamental Principles of the Red Cross and Red Crescent Movement. As a “managed project” the International Federation will assume responsibility for agreed Secretariat activities in accordance with this Agreement. In managing the Secretariat, the International Federation will be guided and advised by the ProVention steering and advisory bodies. 4. The ProVention Secretariat 4.1 The Secretariat is responsible for the day to day management, administration and co- ordination of ProVention activities and serves as the contact hub for all partners of the Consortium. The main functions and tasks of the Secretariat involve: (a) Coordinating and managing the work program of project activities, including project planning, monitoring, evaluation and reporting; 41 Annex C (b) Administering ProVention project agreements and funding with implementing partners; (c) Disseminating the outputs and results of ProVention activities and sharing knowledge and information on good practice, tools and resources for disaster risk management; (d) Representing ProVention interests in the international community; (e) Serving as the contact hub for Consortium partners and facilitating the development of new partnerships and cross-sector linkages; (f) Supporting ProVention advocacy efforts aimed at promoting disaster risk management amongst leaders and policy decision makers; (g) Strengthening the governance and management structures of ProVention; (h) Fundraising for the ProVention work program and Secretariat. 4.2 The International Federation will continue to house and manage the Secretariat at its headquarters in Geneva. The Secretariat is currently composed of five persons including, a Head, two Senior Officers, an Officer, and an Assistant (“Secretariat Staff”). Any further capacity will be agreed by the International Federation. The International Federation will provide a Line Manager to supervise the Head. The performance of the Secretariat will be reviewed by the Line Manager in consultation with the Advisory Committee. 4.3 The International Federation will provide sufficient office space and facilities to accommodate the Secretariat staff and also provide meeting rooms on a space available basis. Additional requests for office accommodation and other supporting facilities have to be agreed with the Line Manager. 4.4 The International Federation will be responsible for the recruitment and employment of any agreed additional staff. All recruitment and hiring will be carried out in accordance with International Federation staff regulations and procedures, including remuneration, benefits, leave, and authorizations. 4.5 ProVention Staff will be accountable to the International Federation as its employees, including following all applicable Federation rules and regulations; adhering to the Code of Conduct and Staff Regulations as set forth in the relevant employment contracts. 4.6 ProVention Staff will be responsible for carrying out the functions and objectives of the ProVention Secretariat, as described in paragraph 4.1 of this Agreement and as further developed by the Line Manager in consultation with the Management Advisory Committee. Annex C 42 5. ProVention Consortium Name 5.1 For the purposes of this Agreement, the Parties agree that the Secretariat has the right to use the ProVention Consortium name and logo for agreed upon ProVention Consortium activities in conformity with the principles, goals and objectives of ProVention. 5.2 To protect the ProVention trade name and image it has been further agreed that the International Federation will register the ProVention name and logo with WIPO under Article 6ter of the Paris Convention, and any other registrar deemed prudent by the International Federation, after consultation with the World Bank. Upon registration of the name and logo, the International Federation will grant the World Bank an irrevocable, royalty-free right to use the ProVention name and logo. The ProVention Secretariat shall then be responsible for granting, on a case by case basis, permission to use the ProVention name and logo in regards to specific ProVention projects. 6. ProVention Consortium Website 6.1 The World Bank will transfer the ownership of the www.proventionconsortium.org domain name and copyright of the content of the ProVention Consortium Website to the International Federation for the term of this Agreement, and for the purpose of facilitating the performance of Secretariat functions by the International Federation. The Website will be maintained by the ProVention Secretariat for the term of this Agreement and the ProVention Secretariat agrees to consult with the World Bank regarding significant changes to the format and appearance of the Website. The Secretariat will remain solely responsible for the integrity and quality for the ProVention Consortium Website. 7. ProVention Consortium Funding 7.1 ProVention shall be funded as a project of the International Federation. Current donors include Canadian International Development Agency, Norwegian Ministry of Foreign Affairs, Swedish International Development Agency, Swiss Agency for Development and Cooperation and UK Government Department for International Development. Additional donors will be sought as required. 7.2 Financial administration shall be performed by the International Federation who will maintain separate records and ledger accounts in respect of all funds paid directly to ProVention. 7.3 The general funds of the International Federation shall not be responsible for funding ProVention activities or the Secretariat. All costs, including a set hosting fee, for the Project shall be paid out of funds generated for ProVention by the ProVention Secretariat. Unless otherwise indicated, ProVention shall, in accordance with specific financial arrangements, fully reimburse the International Federation for all costs incurred, including all Secretariat related costs. 43 Annex C 8. Implementation 8.1 The individuals with overall responsibility for implementation of this Framework Agreement are: For the World Bank: Maryvonne Plessis-Fraissard Director, Transport and Urban Department World Bank 1818 H St NW Washington D.C. 20433 Tel: (202) 473- 4314 Fax: (202) 522-3227 Email: Mplessisfraissar@worldbank.org For the International Federation: Ibrahim Osman Director, Policy & Relations International Federation of Red Cross and Red Crescent Societies 17 chemin des Crêts, Petit-Saconnex Case postale 372 CH-1211 Genève 19 Tel: +41 22 730 XXX Fax: +41 22 733 03 95 Email: ibrahim.osman@ifrc.org 9. Term 9.1 This Agreement shall remain in force from the date of signature until 31 December 2008, unless modified or terminated by the Parties in writing. 9.2 One year prior to the expiration of this agreement, a review of the hosting agreement shall be carried out and the Parties shall discuss arrangements for the future management of the ProVention Secretariat. 10. Expiration and Termination 10.1 This Agreement may be terminated by either party upon four months’ prior written notice to the other party. Either Party may immediately terminate this Agreement if a) a material breach has not been rectified following 10 working days after the breaching party has received notification of such breach; b) its name or emblem has been brought into dispute or disrepute by the activities carried out under this Agreement. 10.2 Within a reasonable time prior to termination by either Party, the terminating Party agrees to provide the other Party with the reasons for seeking termination and to undertake good faith efforts to attempt to resolve the causes prior to termination. Annex C 44 10.3 In the event that this Agreement is terminated either Party may request that its name and emblem be removed from the ProVention Consortium website and that the other party cease to refer to it as a partner in the ProVention Consortium. 10.4 Upon termination or expiration of this Agreement, the parties agree to cooperate to facilitate the next hosting agreement, including a possible extension or transfer to another host organization, and minimize disruption to the activities of ProVention. 11. Dispute Settlement 11.1 Any disputes between the parties arising out of or relating to this Agreement that is not settled by negotiation or mediation within 60 days may, at the request of one of the Parties, be settled by arbitration in accordance with the rules set out by the United National Commission on International Trade Law as at present in force, subject to such modification as the Parties may agree in writing. The appointing authority shall be the Secretary-General of the Permanent Court of Arbitration in The Hague, The Netherlands. 12. Final Provisions 12.1 This Agreement may be modified in writing by the Parties at any time. 12.2 Nothing contained in this Agreement is intended as or shall be deemed a waiver, express or implied, of any immunity of the Parties or of any privilege, exemption or other immunity enjoyed by the Parties. 12.3 Nothing in this Agreement is intended to, or shall be construed as creating a joint venture, an agency relationship or a legal partnership between the World Bank, the International Federation, and other ProVention Consortium partners. Each Party remains solely liable for the acts or omissions of their employees or agents under this Agreement, and shall indemnify and hold harmless the other for any costs or claims incurred from such acts or omissions. 12.4 This Agreement shall come into full force and effect upon signature by both parties on the respective dates set forth below. In witness whereof, the parties hereto execute this Framework Agreement. For the International Bank for For the International Federation of Reconstruction and Development: Red Cross and Red Crescent Societies: ____________________________ ____________________________ Maryvonne Plessis-Fraissard Markku Niskala Acting Vice-President, Infrastructure Secretary General 45 Annex C ANNEX I 1. Governance Structures of ProVention Based on an external governance review conducted in 2005, a revised ProVention governance structure is proposed, outlined below, to help improve the impact of ProVention’s work and ensure greater accountability, participation and ownership among Consortium partners. It is hoped that this revised structure will enable increased opportunities for a wider set of partner organizations to participate in ProVention and provide improved mechanisms for guiding the strategic direction of ProVention and multi- stakeholder participation in the work program of activities. 1.1 ProVention Forum 1.1.1 The ProVention Forum (the “Forum”) is the premier Consortium venue for ProVention partners and other risk reduction leaders to dialogue and explore the range of interconnected topics related to reducing the impacts of disasters in developing countries. The Forum meets once per year and encourages active participation and interaction among ProVention partners and across sectors from international organizations, governments, academia, the private sector and civil society. Through the Forum, ProVention seeks to create a rich, insightful setting for identifying critical gaps in disaster risk management, anticipating new trends, generating cutting-edge ideas and innovations in order to help drive the global risk reduction agenda. 1.1.2 All partners of the ProVention Consortium are also invited to participate in steering group sessions which will be scheduled concurrently with the annual Forum meeting to address matters of specific ProVention business. The Forum steering group sessions provide ProVention partners with an opportunity to contribute advice, ideas and input towards ProVention’s work program of activities. Participants in the steering group sessions are also invited to nominate representative members for the ProVention Advisory Committee. 1.2 Advisory Committee 1.2.1 The Advisory Committee is responsible for providing ongoing guidance and advice on major strategic, policy and organizational decisions. Its responsibilities include, but are not limited to, giving strategic advice and direction to the Secretariat, overseeing the implementation of the workplan and approving the annual budget. In this role the input of the Advisory Committee is strictly advisory to the Secretariat and the hosting partner who undertake the legal management and governance responsibilities necessary to execute and implement ProVention activities in line with the principles of the Consortium. 1.2.2 The Advisory Committee is composed of a minimum of five (5) and maximum of seven (7) members representing various stakeholders in the ProVention Consortium. Membership of the Advisory Committee shall include a representative of the hosting organization (the International Federation), a representation of the founding organization (the World Bank), two (2) representatives of ProVention partners and up to three (3) Annex C 46 representatives of the Consortium. The appointment of the other members is made through annual nomination by ProVention Consortium partners during the steering group sessions at the ProVention Forum. 1.2.3 The Advisory Committee appoints a Chairman from among its members for a term of three (3) years. All members of the Advisory Committee are expected to serve for a term of three (3) years. 1.2.4 The Advisory Committee meets a minimum of two (2) times a year. The Chairman and Secretariat determine the dates and location of its ordinary meetings. Additional meetings are arranged by means of telephone or electronic communications. The Advisory Committee will set the conditions for travel assistance, accommodation and meeting costs with the budget of ProVention. 1.3 The ProVention Secretariat 1.3.1 The Secretariat is responsible for the day to day management, administration and co- ordination of ProVention activities and serves as the contact hub for all partners of the Consortium. The main functions and tasks of the Secretariat involve: (a) Coordinating and managing the work program of project activities, including project planning, monitoring, evaluation and reporting; (b) Administering ProVention project agreements and funding with implementing partners; (c) Disseminating the outputs and results of ProVention activities; (d) Sharing knowledge and information from ProVention partners and projects on good practice, tools and resources for disaster risk management; (e) Serving as the contact hub for Consortium partners and facilitating the development of new partnerships and cross-sector linkages; (f) Supporting ProVention advocacy efforts aimed at promoting disaster risk management amongst leaders and policy decision makers; (g) Strengthening the governance and management structures of ProVention; (h) Fundraising for the ProVention work program and Secretariat. 1.3.2 In reviewing proposed activities for ProVention funding and inclusion in the ProVention work program the Secretariat will solicit expert technical advice from independent project reviewers to ensure high quality technical appraisal of ProVention project activities and accountability in project funding decisions. 1.3.3 In executing these activities the Secretariat is supported by one of the ProVention partners in the role of hosting organization. Currently (2005-08), the hosting role is provided by the International Federation and the Secretariat functions as a fully managed project of the International Federation where consequently liability, fiduciary and financial responsibility are vested with the International Federation. 47 Annex C 1.4 Presiding Council 1.4.1 The Presiding Council serves as voluntary patrons of ProVention, but with no formal governance duties, and is responsible for promoting the goals of ProVention among international leaders and senior policy decision makers. Council Members are invited to serve on a three year term in their capacity as individual advocates for disaster reduction and not as representatives of their organizations. 1.4.2 Members of the Presiding Council will also be invited to participate in the ProVention Forum and other key ProVention activities where they can help to leverage support and increase policy commitment to disaster risk reduction. 1.5 Membership 1.5.1 The ProVention Forum as well as a variety of work program activities provide opportunities for all Consortium partners to participate actively in ProVention. Through new “communities of practice” and the broad emphasis on knowledge sharing in all of its activities, ProVention encourages greater involvement both from existing members and from new partners who are interested in participating in the Consortium. Annex D 48 Annex D. ProVention Activities, 2000-2005 ProVention Work Program of Activities 2000-2003, When Located at the World Bank Implementing Thematic Regional Final products/ Activity Start End Organizations/ Outcomes Area Focus Outputs Consultants Methodology Risk Method used 2000 (completed, 16 partner organizations: Handbook for Estimating the Socio- The ECLAC methodology has been used for and Identification in Turkey, 2003) Economic and Environmental Effects of damage and needs assessments after disasters in Standards for India, ECLAC, WB, Asian Disasters, UN/ECLAC, 2003 in English Turkey, Mozambique, Belize, Grenada, Central Damage and Mozambique Development Bank (ADB), and Spanish; Pilot training modules have America, Gujarat, Sri Lanka, Indonesia, Maldives, Needs , Grenada, lADB, CENAPRED, UNDP, taken place at the World Bank in May and Pakistan. Assessments Sri Lanka, the Central American Bank for 2002 and in Quito, Ecuador in July 2002 Maldives, Economic Integration (organized by the Pan-American Health Indonesia, (CABEI), the Corporacion Organization (PAHO). The Asian and Andina de Fomento (CAF), Disaster Preparedness Center (ADPC) Pakistan; has also collaborated by co-organizing PAHO, USAID, OCHA, WFP, Training with the World Bank a workshop in workshops in FAO, UNICEF, UNCHR, and Bangkok in August 2002 to disseminate the USA, the UN Inter-agency the ECLAC methodology in that region. Ecuador, Geographic Information Training on use of the manual was also Thailand, Support Team (GIST). incorporated into learning events for Panama, urban managers organized by the DMF and Trinidad and the World Bank Institute in Panama and Tobago. in March 2003, and in Turkey in May 2003. The Panama event included about 30 city managers from various Latin American countries, and the Turkey event included approximately 45 participants from Armenia, Georgia, Hungary, Poland, Russia, and Turkey. Identification Risk Global 2000 (completed, 13 partner organizations: Natural Disaster Hotspots: A Global Risk The Natural Disaster Hotspots study presented a and Analysis Identification 2005) Analysis. By Maxx Dilley, Robert S. set of data on the risks of mortality and economic of Global Coordinated by the WB. Chen, Uwe Deichmann, Arthur L. Lerner- losses associated with six major natural disaster Disaster Risks Hazard and socio-economic Lam, Margaret Arnold. The World Bank, types and determined the prevalence of natural Hotspots data sources included the 2005. disasters using a common geospatial unit of Global Seismic Hazard reference in all countries. In addition, the report Assessment Program, WMO, ranked countries in terms of highest risk potential, the Munich and Swiss in order to influence risk mitigation investments. A Reinsurance Companies, recent evaluation of the Bank’s lending for natural FAO, the Center of Research disasters suggested, and the Bank’s management on the Epidemiology of and Board accepted to incorporate natural Disasters (CRED), and UNDP. disaster risk in Country Assistance Strategies The project team included (CASs) and Poverty Reduction Strategy Papers staff from Columbia (PRSPs) for countries classified at high and University, the World Bank, medium risk by the hotspots study. United Nations Environment Program (UNEP), the UN Office for the Coordination of Humanitarian Affairs, 49 Annex D Implementing Thematic Regional Final products/ Activity Start End Organizations/ Outcomes Area Focus Outputs Consultants Middlesex University, the Norwegian Geotechnical Institute (NGI), the World Food Program, and the National Center for Atmospheric Research, and Atmospheric and Environmental Research, Inc. Improved Risk Global 2000 (completed, 6 partner organizations: The Quality and Accuracy of Disaster The report on accuracy of disaster data states that Database for Identification 2002) Data: A Comparative Analyses of Three none of the three databases has adequate data the Social and Munich Reinsurance, Swiss Global Data Sets- October, 2002; on the socio-economic impacts of disasters. Economic Reinsurance, CRED, Lloyd's (CRED’s EM-DAT database, Munich Re’s Improved data quality in this area is essential to Analysis of of London, UNDP, NatCat; and Swiss Re’s Sigma justifying and promoting investments in disaster Disaster coordinated by the World database). prevention and preparedness. Since CRED’s Impacts Bank database is accessible by the public and aimed at the development community, follow-up has focused on improving the quality and utility of EM- DAT. The number of natural disasters logged in EM-DAT has increased, and sources are verified for completeness of information. In addition, four new data fields have been added to EM-DAT following recommendations from the Technical Assistance Group (in which ProVention participated). Critical Risk Dominica, 2000 (completed) 3 partner organizations: 3 publication: Originally designed to focus on the issue of Infrastructure, Identification Bangladesh, privatization and its impact on the vulnerability of Disaster and Malawi Consultants Benson & Clay. Dominica: Natural Disasters and critical infrastructure to disasters, based on Vulnerability Economic Development in a Small Island feedback from ProVention members, the scope of The World Bank, IIASA, State. Disaster Risk Management and the Role PAHO this activity was broadened to include the of the Private Working Paper Series No. 2; exploration of several key issues related to Sector Bangladesh: Disasters and Public protecting investments in critical infrastructure Finance. Disaster Risk Management from disaster impacts. Working Paper Series No. 6; Malawi and Southern Africa: Climatic Variability and Economic Performance. Disaster Risk Management Working Paper Series No. 7; Guidelines for Vulnerability Reduction in the Design of New Health Facilities (PAHO, 2003); 3 conferences 1 seminar: Reducing Socio-Economic Vulnerability; IIASA, in Laxenburg, Austria from August 1–4, 2001. Third Earthquakes and Megacities Workshop, in Shanghai, China from October 21-November 2, 2002. 30 research papers were commissioned and presented at the December 4-6, Annex D 50 Implementing Thematic Regional Final products/ Activity Start End Organizations/ Outcomes Area Focus Outputs Consultants 2002 Conference on “The Future of Disaster Risk: Building Safer Cities” in Washington, D.C. Seminar on "Hospitals in Disasters: Handle with Care" (El Salvador - July 8 – 10, 2003). International Risk Case studies 2000 (Studies Consultants Tony Beck, John 5 publications: Five case studies as well as one synthesis study Evaluation of Reduction were completed, Telford, and Peter Wiles were planned as meta-evaluations of recovery Recovery undertaken in three of five Learning Lessons from Disaster Recovery: processes. The case studies on Mozambique, Efforts for Bangladesh studies The Case of Mozambique. By Peter Wiles, Honduras, and Bangladesh were published as of Massive (floods published) Kerry Selvester, Lourdes Fidalgo - World March 2006. The studies did not evaluate single Natural 1998), Bank, 2005. projects, but analyzed the whole recovery effort. Disasters Honduras Learning Lessons from Disaster Recovery: Special attention was paid to the gap between (Hurricane The Case of Bangladesh. By Tony Beck - relief and development. One of the major findings Mitch 1998), World Bank, 2005. was that recovery processes must withstand the Turkey pressure to spend funds quickly and take enough (earthquakes Learning Lessons from Disaster Recovery: time to integrate risk reduction into the of 1999), The Case of Honduras (PDF 660 kB) - development agenda. According to Ian Mozambique June, 2004. Christoplos, the studies found that recovery (floods 2000 World Bank (2003b) Turkey: Lessons efforts missed the “window of opportunity […] to and 2001), Learned From Recovery Efforts. mainstream risk reduction in the development and India Unpublished working paper. agenda.” Christoplos found that while the studies (Gujarat provide a starting point for closing the knowledge earthquake World Bank (2003a) Gujarat, India: gap of the relief to development continuum, more 2001). Lessons Learned From Recovery Efforts. time and resources need to be committed in order Unpublished working paper. to do extensive field work, including interviews with policy makers in the respective countries. Washington, D.C.: Ad Hoc Advisory Committee Meeting, 21–23 July 2003, World Bank. Some cases involved desk reviews (Bangladesh, Turkey, and India), while others included field visits (Honduras and Mozambique). The cases for Honduras, India, and Mozambique also included community surveys to better capture the impact on and perspectives of the communities affected by the disaster events. 3 meetings: A brainstorming session for the recovery studies in January 2002 among ProVention members led to the formation of an ad-hoc advisory committee. Study findings were discussed in two subsequent meetings of the ad-hoc advisory committee in December 2002 and July 2003. 51 Annex D Implementing Thematic Regional Final products/ Activity Start End Organizations/ Outcomes Area Focus Outputs Consultants Workshop on Risk South Africa Workshop in (completed) 5 partner organizations: 2 events: 35 participants from 13 countries agreed on an Strengthening Reduction August 2002 action plan to be implemented during the next 5 Community WB, WFP, UNEP, Habitat, Both events were organized at the Sasol years, including the development of regional Resilience to and the African Development Center for Innovative Environmental training programs during 2003 and once a year Natural Management (SCIEM) of South Africa’s thereafter to target local government officials, Bank Disasters in University of Witwatersrand. The first senior NGO staff, and Municipal and District Sub-Saharan was a four-day course held from August Disaster Managers’ cooperation. Africa 12-16, 2002 on emergency response aimed at local government officials, NGOs and the emergency managers in Africa. This event was followed by a two- day workshop aimed at taking stock of the various disaster training activities in Africa and identifying opportunities to align efforts and promote cooperation. This special session on disaster management training in Africa was included in the program for the International Conference on Environmental Management in South Africa which was carried out in parallel with the World Summit on Sustainable Development (WSSD) that took place in Johannesburg during the same period. Report of proceedings completed. Reduced Risk Global 2001 (completed) 6 partner organizations: The World Meteorological Organization Global Outreach Forums have resulted in a) the Vulnerability to Reduction undertook extensive review of Global establishment of several new organizations which Climate Coordination was provided by Outreach Forums. aim to increase information available at Variability the World Meteorological national/regional level, e.g. North Africa and Organization, a ProVention 3 Conferences: Central American Forums and a centre for El Nino member. Other partners were in Ecuador, b) products under development to the International Research Teleconference in March 2002 with the World Bank, the IRI, and the NOAA to provide sector specific information. ProVention Institute (IRI) for Climate also part funded and participated in El Nino Prediction of Columbia advance the development of an on-line toolbox that would support the exchange Preparedness International Conference in Spring University, and the National 2002. Oceanic and Atmospheric of knowledge between regions and Administration (NOAA); provide a portal into regional climate additional partners were the forecasting. Netherlands Red Cross, the El Niño Preparedness Conference in the Netherlands Ministry of spring of 2002. Foreign Affairs, and the Climate, Energy and The Netherlands Red Cross, the Environmental Technology Netherlands Ministry of Foreign Affairs, Division (DML). and the Climate, Energy and Environmental Technology Division (DML), organized a conference on climate change adaptation in the Hague from 26-29 June, 2002. ProVention support facilitated the participation of developing country representatives. Annex D 52 Implementing Thematic Regional Final products/ Activity Start End Organizations/ Outcomes Area Focus Outputs Consultants Innovations in Risk Sharing/ Mexico, Conference (completed) 2 partner organizations: Two-day international conference held in Insurance-based World Bank projects Managing transfer OECS from January January 2001. Proceedings and papers implemented in Mexico, OECS countries, Catastrophic countries, 8-10, 2001 WB and Wharton School of from workshop published on ProVention Gujarat/India, Romania, and Turkey. Initiatives are Risks: How Gujarat/India the University of Pennsylvania Consortium website. also under preparation for Bulgaria, Colombia, Can they Help , Romania, three additional Indian states, and Vietnam; • the Poor? and Turkey; Mission undertaken in February 2002 to Analyses underway in South Asia, East Asia and Bangladesh, Bangladesh, India, Pakistan, and Sri Europe & Central Asia regions. Pakistan, Lanka. Draft report on India ready. India, and Sri Lanka Study and Risk Sharing/ Global Workshop in (completed) 3 partner organizations: Initial brainstorming to establish Identification and documentation of results of Evaluation of transfer February framework for activity conducted in microfinance based disaster reduction options Microfinance/ 2000 WB, UNDP, and UNCDF February 2000. included in the 2002 report. UNCDF, drafted Micro operational guidelines for MFI operations in insurance for Consultations held with UN Capital disaster situations, based on the ProVention Disaster Risk Development Fund (UNCDF) and UNDP report. Case studies to be developed by IFRC. Management for inputs on activity design and in- country partners. 2002 report 'Microfinance and Disaster management: Experiences and Lessons Learned.' The report is based on interviews with experts/practitioners. Targeted Risk Sharing/ Global 2001 (completed, The World Bank, Renos Vakis Paper produced by independent Support for transfer 2002) consultant Renos Vakis (2002): Disaster Complementing Natural Disasters Recovery: the Management: The Role of Social Role of Social Protection; finalized and published on Investment ProVention site. Includes case studies. Fund Based on the above paper, the activity is being redirected to include a broader approach of community based mechanisms. Knowledge Knowledge Global 2000 (ongoing) 6 partner organizations: Continuous updating of ProVention Website: Over 200,000 website hits in 2002 alone, and Learning Sharing webpage. with an upwards trend in monthly hits. The Program Secretariat-led activity for majority of visitors originate from the United ProVention members and the Awareness raising and dissemination of States, followed closely by the United Kingdom, general public. knowledge to the global disaster Australia, Argentina, Mexico, Switzerland, community; capacity building in Canada, Peru, Japan, Turkey, Thailand, and ProVention partners including developing countries through distance South Africa. While file download figures vary UNDP and the Asian Disaster learning, and through a systematic from month to month, downloads most often Preparedness Center, World training program including training of include Working Paper Series files. For example, trainers and monitoring results. from February - May 2003, the seven publications Bank Institute, Swiss RE, Munich RE, Lloyd's of London, in the series averaged over 2,400 downloads per UNDP and others. month. Other popular files that were downloaded on average 100 times or more per month throughout 2003 include the UNDP’s Disaster Management Training guide on Disaster Mitigation, as well as several of the commissioned 53 Annex D Implementing Thematic Regional Final products/ Activity Start End Organizations/ Outcomes Area Focus Outputs Consultants papers from the ProVention Consortium's December 2002 conference, "The Future of Disaster Risk: Building Safer Cities." Training: over 800 people attended 25 events in 2 years Disaster Knowledge Global 2000 (First phase 7 partner organizations: Launched at Dec. 4-6 conference 2002; The first round of studies has been Reduction Sharing completed) 65 awards of $5,000 each have been completed and a second round has Scholarships Implemented by ProVention granted to students and young been launched. A number of young Consortium partners providing professionals from 27 countries. researchers presented their findings at education and training a World Bank conference and at the programs, such as the Asian World Conference for Disaster Disaster Preparedness Reduction in Kobe, Japan, the latter Center, the University of event being organized by the Washington-based Secretariat. Geneva, the Disaster Management Center of the University of Wisconsin, Cranfield University, UNAM/CENAPRED, and UNDP. Coordinated by the World Bank Annex D 54 IFRC ProVention Work Program of Activities 2003-2006 Thematic Regional Implementing Final products / Outcomes Activity Start End Area Focus Organizations Outputs / Measuring mitigation: tools for Mainstreaming global 2003 2007 1 partner Measuring Mitigation (program in progress) mainstreaming risk risk reduction organizations: report, synthesis Charlotte report, policy brief, set Benson, of guidance notes John Twigg, Benfield Hazard Research Centre Mega cities: mainstreaming disaster risk Mainstreaming India, 2005 2006 Earthquake Guidance notes to (program in progress) management risk reduction Philippines, Mega cities integrate risk Nepal, Initiative reduction into urban Ecuador master planning Global Risk Information Program Risk analysis & global 2005 2006 14 partner (program in progress, building on the results of the application organizations: Natural Hazards Hotspots Project supported by (Preparatory ProVention) phase) UNDP, World Bank, IADB, (Follow-up Columbia activities University, planned) CRED, OCHA Relief Web, ADRC, LA RED, Munich Re, ECLAC, ESCAP, Norwegian Geotechnical Institute, UNEP- GRID, etc. Tools for community risk assessment & Risk analysis & global 2004 2006 3 partner On-line community (planned workshop and surveys) action planning application organizations: risk assessment (follow-up (CRA) toolkit on activities Ben Wisner of disaster risk under the Oberlin assessment, food consideration College, OH and security, and ) the Disaster livelihood security Mitigation for assessment at the Sustainable community level. Livelihoods Collection of 24 risk Programme assessment methods (DiMP) at the and 35 case studies University of from Latin America, Cape Town Asia, Africa, and Small Island Developing States. Community Risk Assessment 55 Annex D Thematic Regional Implementing Final products / Outcomes Activity Start End Area Focus Organizations Outputs / Workshop on Social Vulnerability in Geneva in May 2004 with 25 CRA researchers and practitioners. Workshop in Cape Town in June 2005 with 45 CRA practitioners from Africa, Asia, Europe, Pacific, the Caribbean and the Americas. Community based vulnerability and Risk analysis & Belize, 2004 2006 5 partner Vulnerability and - VCA assessment activities conducted in pilot capacity assessment in Central America application Guatemala, organizations: capacity assessment communities in each of the 4 target countries Honduras, (follow-up (VCA) cd-rom; 6 Costa Rica activities IFRC & 4 Red manuals produced; - core resources completed to allow scaling up by Red under Cross Societies, VCAs in 16 pilot Cross of the program starting in 2006 consideration OAS, PAHO communities. ) and CRID Climate risk and disaster reduction Risk analysis & global 2005 2005 2 partner Climate change (objectives oriented toward networking and capacity- application organizations: conference building) Red Cross / Red Crescent Climate Centre African Urban Risk Analysis Network Risk analysis & South Africa, 2004 2005 8 partner Initiation of disaster - network established among risk reduction application Tanzania, organizations: risk reduction researchers and practitioners in target cities Algeria, (extension initiatives in the six Ghana, under IIED, UNDP and cities; 2 workshops - base research conducted in all six cities on local risk Senegal and consider- 6 AURAN profiles, public awareness activities initiated in Kenya ation) partner Senegal. organizations These activities provide the groundwork laid for further follow-up activities through extended support to AURAN project or in relation to other ProVention and UNDP programs. Reducing flood risk in Africa Risk analysis & Sudan 2003 2006 3 partner regional trainings in - preparedness outreach activities conducted by application organizations: Sudan, private sector Sudanese Red Crescent branches in 4 target states, study including more than 9,000 home visits, 900 community IFRC, Sudanese awareness sessions, and 50 school "Friends of Red Crescent, ProVention* groups established UNEP and Khartoum - completion of preliminary private sector partnering University study. - Groundwork laid for follow-up through ProVention CSR programme and with additional support from UNEP Annex D 56 Thematic Regional Implementing Final products / Outcomes Activity Start End Area Focus Organizations Outputs / (evaluation report completed Dec. 2005) Reducing risks in recovery Reducing Risks South Asia - 2005 (in 2 partner lessons learned for - evaluation of WB lesson learned by Ian C. in recovery tsunami development) organizations: Pakistan region / - lessons papers for South Asia earthquake distributed Pakistan ALNAP, IFRC widely in Pakistan through UN cluster groups, Red Cross network, and ALNAP network Micro-insurance pilot scheme Risk transfer & India 2003 2006 5 partner pilot testing of models - provision of micro-insurance service to 2000 private sector organizations: of micro-finance and individuals and small businesses in Gujarat, India and micro-insurance, extension to an additional 2000 individuals and small investment AIDMI, IIASA, workshops and businesses in tsunami-affected area in India. Chamber if publications of Commerce and research (evaluation report by Yasemin Aysan in 2005) Industry for Small Businesses (CCISB), Oriental Insurance Company (OIL), and Life Insurance Corporation of India CSR and risk reduction Risk transfer & global 2005 2006 3 partner draft paper on CSR & (program in progress) private sector organizations: DRR investment Maplecroft, WEF, IBLF Applied research grants for disaster risk Expanding risk global 2005 (2nd 2007 3 partner 53 grantees (planned evaluation 2006) research & organizations: implementing DRR reduction learning round) research projects UW-DMC, DiMP, ADPC ProVention Forum Knowledge global 2005 (ongoing) ProVention Forums in (objectives oriented toward policy dialogue, ProVention sharing Washington DC (April networking and capacity-building) Secretariat & 05) and Bangkok (Feb partners 06) ProVention knowledge sharing activities Knowledge global 2003 (ongoing) ProVention WCDR and (website evaluation by John Twigg in 2004) sharing Secretariat & international partners conferences, dissemination of resources, Newsletter, Annual Report, new website. 57 Annex E Annex E. IFRC ProVention Conferences and Workshops Conference What happened? Bridgetown, Barbados The Tools for Mainstreaming Disaster Risk Reduction project is supported by an Measuring Mitigation advisory group drawn from donor and operational agencies. A first advisory Advisory Group Workshop, group meeting took place in Geneva, Switzerland in March 2004 and a second Caribbean Development meeting was held in Bridgetown, Barbados in June 2006. During the meeting all Bank, guidance notes were revised and discussions took place on how to effectively June 2006 disseminate the guidance notes and develop links with other mainstreaming initiatives. Cape Town, South Africa The African Urban Risk Analysis Network (AURAN) Cape Town workshop (7-9 AURAN workshop, March 2006) brought together urban risk researchers from African institutions, as June 2006 well as other partners such as local/provincial government, the International Federation of Red Cross & Red Crescent Societies, and Northern academics. Bangkok, Thailand In February 2006, ProVention hosted its second annual ProVention Forum in ProVention Forum 2006, Bangkok, Thailand. The 2006 Forum, which attracted over 100 participants, February 2006 addressed the central theme of 'Incentives for Reducing Risk' and examined a range of inter-related topics concerning risk, vulnerability and natural disasters. Bonn, Germany The ProVention Secretariat participated in this conference. Making insurance work for the poor, October 2005 The Hague, Netherlands The conference brought together 150 development and humanitarian 2nd International Conference practitioners, disaster risk reduction experts, climate change scientists, financial on Climate Change and specialists, and policymakers from more than 35 countries to exchange Disaster Risk Reduction, knowledge and experience from the overlapping fields of disaster risk reduction June 2005 and climate change adaptation. Cape Town, South Africa ProVention brought together leading academic researchers and NGO Community Risk practitioners to provide feedback and insights regarding recent work to develop Assessment (CRA) tools and applications for assessing community level risk and vulnerability. workshop, June 2005 Washington DC, USA & The Global Disaster Risk Hotspots report was launched at the Norwegian Geneva, Switzerland Geotechnical Institute in Oslo in September 2004, and later in New York, Hotpots Launch, Washington DC and Geneva. The IFRC-based ProVention Secretariat March & June 2005 participated in the Washington launch and organized a launch event at the United Nations in Geneva. Washington DC, The ProVention/OAS Forum, held in April 2005, addressed the central theme of ProVention/OAS Forum 'Development as a Natural Hazard Risk Management Tool' and examined how 2005, development processes can be used to reduce the risk and vulnerability of lesser April 2005 developed countries to natural hazard events with a specific focus on the Americas. Kobe, Japan Workshop with IFIs as presenters on integrating risk reduction into development World Conference on financing, launch of ‘Measuring Mitigation’ scoping study, ‘Applied Research Disaster Reduction, Grants’ side event. January 2005 The Secretariat published a CD-rom containing publications from the past four years in preparation for the conference and distributed over 700 copies at the World Conference ProVention booth in Japan. ProVention also supported the IFRC in leading a session entitled Supporting Community Resilience is the Key to Reducing Disaster Impact and sponsored a Annex E 58 range of developing country NGO participants. Zurich, Switzerland Contributing participants included Swiss Re, Munich Re, Partner Re, Interpolis Solidarity and Opportunity: Re, Milli Re, Risk Management Solutions, International Business Leaders Forum The Potential of Insurance (IBLF), World Bank, UNCDF, IIASA, GTZ, AIDMI and Opportunity International. for Disaster Risk Over 80 participants from 17 countries contributed through presentations of case Management in Developing studies, innovations, research and plenary debate on three main themes: micro- Countries, insurance for low income households and local businesses; innovative solutions October 2004 for risk transfer; partnerships linking the private and public sectors and global and local stakeholders. Oslo, Norway Release of the preliminary findings of the Global Disaster Risk Hotspots project. International workshop on the hotspots project, October 2004 Algiers, Algeria ProVention supported southern NGOs and academia participation at the 6th 6th PanAfrican Conference PanAfrican Conference of the Red Cross and Red Crescent societies of Africa in of the Red Cross and Red Algiers in September 2004. Crescent societies of Africa, September 2004 Stockholm, Sweden ProVention contributed to a seminar on Natural Hazard Risk Management Sida Seminar on Natural organized by Sida in September 2004 Hazard Risk Management, September 2004 Washington DC, USA A selection of ProVention grantees were invited to present their research Applied Research Grants findings at the 'Global Symposium for Hazard Risk Reduction', in July 2004 at Symposium, the World Bank headquarters in Washington, DC. July 2004 Lusaka, Zambia Workshop 'Strategies for Disaster Risk Reduction in Urban Areas of Africa' took African Urban Risk Analysis place in Lusaka (Zambia), 5-7 May 2004 Workshop, May 2004 Geneva, Switzerland An International Workshop on 'Social Vulnerability and Capacity Analysis' was Vulnerability and Capacity held in Geneva at the IFRC on May 25-26, 2004. The workshop brought together Assessment Workshop, some 26 leading academics and practitioners from different organizations and May 2004 countries, with representation from Central and Latin America, Southern Africa, South and South-East Asia, who contributed to the initiative through presentation of case studies, research and workshop discussion groups. Participants highlighted key elements of good practice in VCA but also identified a wide range of technical, social, conceptual and developmental gaps that await closure. Laxenburg, Austria The International Institute for Applied Systems Analysis (IIASA) organized a Workshop on Financial ProVention Conference in April aimed at ministries of finance, planning and other Management of Disaster high-level policymakers from five of the world’s most disaster-prone developing Risks, countries - Colombia, India, Mexico, the Philippines and Turkey. This pilot event April 2004 focused specifically on financial strategies of governments for improving the response of the public and private sectors to natural disasters. Geneva, Switzerland The 28th International Conference of the Red Cross and Red Crescent IFRC International Movement took place in Geneva from 2-6 December, 2003, involving over 1500 Conference, representatives of the Red Cross/Red Crescent and some 190 Member States December 2003 party to the Geneva Conventions. ProVention was invited to contribute to sessions relating to disaster reduction and given the opportunity to make a statement as well as participate in the conference workshops. 59 Annex F Annex F. Financial Overview Table 1 – Sources of Funds, ProVention Secretariat FY99-061 Washington-based Secretariat Geneva-based Secretariat FY99 FY00 FY01 FY02 FY03 FY04 FY05 FY06 Total World Bank Group 225 300 700 482.5 332.5 2,040 WB Admin. Budget 200 250 300 150 900 2 1,015 DGF 350 332.5 332.5 IFC 25 50 50 125 Multi-Donor 55 30 1,197.5 2,345 39 2,219 1,244 7,129 United Kingdom 400 1,428.30 3 884 884 3,596 Norway 666.7 4 747 1,414 Switzerland 77.5 39 12 129 Netherlands 250 250 500 France 230 230 Canada 575 360 935 Wharton School 30 30 Aon Group 35 35 IIASA 20 30 30 80 Global Development Gateway 30 30 Swiss Re 50 50 UNEP 20 20 UNDP 80 80 Other Donors 0.5 1 Total Contributions 280 330 1,897.5 2,827.5 332.5 39.0 2,218.5 1,244.0 9,169 1. Source: DGF: Partnership Approval and Tracking System (PATS), FY03; Geneva-based Secretariat, Financial Overview, 2005. 2. US$131,000 of the DGF funds received in FY02 was transferred to the Geneva-based Secretariat (received on 04/30/2003). 3. US$281,000 and US$430,000 from the United Kingdom was transferred to the Geneva-based Secretariat (received on 09/02/2003 and 07/01/2004 respectively). 4. US$110,000 and US$86,473 from Norway was transferred to the Geneva-based Secretariat (received on 11/1/2002 and 03/02/2004 respectively). Annex F 60 Table 2: Washington-based Secretariat, Expenses from the DGF Grant in US$ Activity FY2001 FY2002 Total Salary Allocation/Staff Costs 136,377 114,055 250,432 Short Term Consultants 60,025 4,750 64,775 Travel Costs 51,412 19,729 71,141 Travel Subsistence 26,979 2,012 28,991 Honorarium & Royalty 47,580 20,000 67,580 Telephone/Local Transport 769 25 794 General Supplies/Printing/ Publishing 26,794 26,794 Staff Retreat 40,000 40,000 Total US$349,936 US$200,571 US$550,5071 Source: World Bank Accounting System (SAP) Table 3: Geneva-based Secretariat, Expenses from the DGF Grant in CHF Activity 01/01/2002-12/31/2003 Amount in US$ Computers and Telecom 6,873 5,535 Transport and Vehicle Costs 750 604 Federation Payroll (Geneva) 406,132 327,079 Regional Deployed Staff 2,900 2,336 Travel 33,029 26,600 Information and Public Relation 6,829 5,500 Office Costs 548 441 Communications 3,688 2,970 Other Administrative Expenses 1,661 1,338 Program Support 57,152 46,027 Total CHF 519,563 US$418,4302 Source: Audit Report by PriceWaterhouseCoopers 1. Actual expenditures for FY01 and FY02 were US$550,507 of the US$551,500 DGF grant spent under the WB Secretariat. The remainder of US$993 was spent in FY03. 2. The financial statement audited by PriceWaterhouseCoopers states that US$409,105 out of US$463,500 was spent from January 1, 2002 to December 31, 2003 under the Geneva-based Secretariat with a balance of US$54,070 to be spent by December 2004. The exchange rate as of December 31, 2003 was CHF 1 = US$0.80535. 61 Annex F Table 4 – Expenditures by Activity and Fiscal Year (Washington-based Secretariat) in US$ Total # Activity Name FY011 FY02 FY03 FY04 Expenditures by Activity 1 Methodology and Standards for Damage and Needs Assessments 3,843 241,898 281,022 526,763 2 Identification and Analysis of Global Disaster Risks Hotspots 5,282 386,272 30,573 422,126 3 Improved Database for the Social and Economic Analysis of Disaster Impacts 5,393 14,415 19,808 4 Critical Infrastructure, Disaster Vulnerability and the Role of the Private Sector 56,117 232,478 716 289,311 5 International Evaluation of Recovery Efforts for Massive Natural Disasters 53,123 253,943 45,844 352,910 350,000 Workshop on Strengthening Community Resilience to Natural Disasters in Sub-Saharan 6 2 18,500 59,082 77,582 Africa 300,000 7 Reduced Vulnerability to Climate Variability 35,772 11,485 47,257 50,000 8 Innovations in Managing Catastrophic Risks: How Can they Help the Poor? 63,396 32,710 36,071 132,177 2 9 Study and Evaluation of Microfinance/ Micro insurance for Disaster Risk Management 25,217 3,207 101,302 129,726 2 10 Targeted Support for Disaster Recovery: the Role of Social Investment Fund 134,216 134,216 2 11 Knowledge and Learning Program 20,375 50,488 901,263 972,126 12 Disaster Reduction Scholarships 5,939 490,000 495,939 274,456 1,735,396 1,590,089 3,599,941 Totals 700,000 + 700,000 4,299,941 Source: World Bank Accounting System (SAP) 1. For FY01 there is no breakdown by activity available. However, a breakdown by expenditure category for the US$350,000 DGF funds is presented in Table 2 above. In addition, US$250,000 in staff time was spent from the Bank’s budget and US$50,000 in staff time from the IFC budget [$50,000 is unaccounted for]. 2. Funds from activities 6, 9, 10 and 11 were transferred to the Geneva-based ProVention Secretariat for completion. Annex F 62 Table 5 – Expenditures by Activity and Calendar Year (Geneva-based Secretariat) in US$1 # Activity Name 2003 2004 2005 Total Expenditures by Activity 1 Knowledge Sharing Activities 21,284 36,642 8,228 66,154 2 Measuring Mitigation: Tools for Mainstreaming Risk 20,965 77,314 35,462 133,741 3 Micro-insurance Scheme 71,667 119,854 191,521 4 Reducing Flood Risk in Africa 66,098 86,445 85,158 237,701 5 IFRC International Conference 16,697 16,697 6 WCDR - Kobe 9,391 20,937 30,328 7 Community-based Vulnerability and Capacity Assessment in Central America 83,412 135,533 218,945 8 CSR and Risk Reduction 69,970 69,970 9 African Urban Risk Analysis Network 215,083 215,083 10 Tools for Community Risk Assessment & Action Planning 24,370 155,266 179,636 11 Applied Research Grants for Disaster Risk Reduction 436,706 436,706 12 Hotspots 13,948 13,948 13 Climate Risk and Disaster Reduction 95,781 95,781 14 Micro Risk Transfer & Analysis 24,549 24,549 15 Megacities: Mainstreaming Disaster Risk Management 110,309 110,309 16 Global Risk Identification Program 185,800 185,800 17 Integrating Risk Reduction in Recovery 10,014 10,014 Totals 180,014 633,272 1,423,597 2,236,883 Source: Geneva-based Secretariat 1 The exchange rate used as of December 31, 2005 was CHF 1 = US$0.76016. 63 Annex G Annex G. Membership of the ProVention Consortium Table 1: Original Membership and ProVention Partners Presiding Council Jan Egeland Under-Secretary General, Office for the Coordination of Humanitarian Affairs, United Nations Walter Fust Director General, Swiss Agency for Development and Cooperation Enrique Iglesias President, Inter-American Development Bank Hilde F. Johnson Minister of Development and Cooperation, Ministry of Foreign Affairs, Norway Omar Kabbaj President, African Development Bank Tsuneo Katayama Director General, National Research Institute for Earth Science and Disaster Prevention, Japan Maritta Koch-Weser President, Earth 3000 Jong-Wook Lee Director General, World Health Organization Mark Malloch-Brown Administrator, United Nations Development Programme Markku Niskala Secretary General, International Federation of Red Cross and Red Crescent Societies Judith Rodin President, University of Pennsylvania Mirta Roses Periago Director, Pan-American Health Organization Amartya Sen Professor, Trinity College, University of Cambridge James Wolfensohn President, World Bank Muhammad Yunus Managing Director, Grameen Bank Steering Committee Members Representing their Organizations Margaret Arnold Manager, Hazard Management Unit, World Bank Steve Bender Chief, Division III, Unit for Sustainable Development & Environment, Organization of American States Mihir Bhatt Director, Disaster Mitigation Institute Sálvano Briceño Director, International Strategy for Disaster Reduction UN/ISDR Secretariat, United Nations Harouna M. Diallo Director, Technical Cooperation Department, World Meteorological Organization Janine Ferretti Environment Division Chief, Sustainable Development Department, Inter-American Development Bank Toni Frisch Delegate for Humanitarian Aid and Head of Swiss Humanitarian Aid Unit, Swiss Agency for Development and Cooperation Fenella Frost Disaster Reduction Adviser, Conflict and Humanitarian Affairs Department, Department for International Development (DFID) Vasantt Jogoo Principal Environmentalist, Environment and Sustainable Development Unit, African Development Bank Andrew Maskrey Chief, Bureau for Crisis Prevention & Recovery, Disaster Reduction & Recovery Programme Annex G 64 Stefan Micallef Chief, Disaster Management Branch, Division of Environmental Policy Implementation, United Nations Environment Programme (UNEP) Eva von Oelreich Head, Disaster Preparedness and Response Department, International Federation of Red Cross and Red Crescent Societies Jean-Luc Poncelet Area Manager, Emergency Preparedness and Disaster Relief, PAHO/WHO Lillian Wikstrom Adviser, Section for Humanitarian Assistance, Ministry of Foreign Affairs, Norway Aloysius Rego Director Partnerships & Regional Cooperation, Asian Disaster Preparedness Center Rolf S. Zelius Chief Compliance Officer & Deputy Director General, Regional and Sustainable Development Department, Asian Development Bank Partner Organizations Participating in Activity Implementation African Development Bank Asian Development Bank Inter-American Development Bank The World Bank Caribbean Development Bank Royal Ministry of Foreign Affairs, Norway Organization of American States Pan-American Health Organization World Food Programme United Nations Development Program World Meteorological Organization United Nations Office for the Coordination of Humanitarian Affairs United Nations Environmental Programme The World Conservation Union Department for International Development (DFID), United Kingdom Economic Commission for Latin America and the Caribbean Earth3000 International Institute for Applied Systems Analysis Earthquake Disaster Mitigation Research Center, Japan National Research Institute for Earth Science and Disaster Prevention Local Authorities Confronting Disasters and Emergencies, Israel International Federation of Red Cross and Red Crescent Societies Swiss Agency for Development and Cooperation Asian Disaster Preparedness Center Asian Disaster Reduction Center, Japan Earthquakes and Megacities Initiative - EMI International Strategy for Disaster Reduction Global Fire Monitoring Center (GFMC) Middle Eastern Technical University, Turkey International Institute for Environment and Development University of Kyoto, Japan Wharton School, University of Pennsylvania Natural Hazards Center at the University of Colorado CESIR, Stanford University 65 Annex G Cenapred Mexico Grameen Bank Lloyd's Voice Disaster Mitigation Institute, India Renaissance Re Insurances Swiss Re, Global Reinsurer World Institute for Disaster Risk Management Centre for Research on the Epidemiology of Disasters (CRED) The Earth Institute at Columbia University Munich Re Group Munich Re Foundation University of Wisconsin Disaster Management Center Table 2: Current Partners Participating in the ProVention Forum and in Activity Implementation International financial institutions • African Development Bank • Asian Development Bank • Caribbean Development Bank • Council of Europe Development Bank • Inter-American Development Bank • The World Bank Donor governments • Canadian International Development Agency • Department for International Development, United Kingdom • Royal Ministry of Foreign Affairs, Norway • Swedish International Development Agency • Swiss Agency for Development and Cooperation Private sector • Interpolis Re • Munich Re and Munich Re Foundation • Swiss Re • World Economic Forum Disaster Universities and research centers • Asian Disaster Preparedness Center • Asian Disaster Reduction Center • Benfield Hazard Research Centre • Centre for Research on the Epidemiology of Disasters • Columbia University – Center for Hazards and Risk Research • Cranfield University • Disaster Mitigation for Sustainable Livelihoods Programme – University of Cape Town • Earthquake Disaster Mitigation Research Center • Facultad Latinoamericana de Ciencias Sociales (FLACSO, Costa Rica) • Global Fire Monitoring Center Annex G 66 • International Institute for Applied Systems Analysis • International Institute for Environment and Development • King's College London • Maplecroft/Warwick Business School • Norwegian Geotechnical Institute • Pacific Disaster Center • University of Kyoto, Japan • University of Wisconsin Disaster Management Center • Wharton School, University of Pennsylvania NGOs • ActionAid International • All India Disaster Mitigation Institute • Catholic Relief Services (Madagascar) • Centre for Disaster Preparedness (Philippines) • Earth 3000 • ENDA Tiers Monde (Senegal) • GeoHazards International • International Council of Voluntary Agencies (ICVA) • NGO Voice • Novafrica (South Africa) • Tearfund International and regional organizations • Economic Commission for Latin America and the Caribbean • International Federation of Red Cross and Red Crescent Societies • Organization of American States • Pan American Health Organization • United Nations Development Programme • United Nations Environment Programme • United Nations International Strategy for Disaster Reduction • United Nations Office for the Coordination of Humanitarian Affairs • United Nations Habitat • World Meteorological Organization Networks • African Urban Risk Analysis Network • ALNAP • Earthquakes and Megacities Initiative • La RED • The World Conservation Union 67 Annex H Annex H. Performance Measurement Framework from DFID Evaluation Scores: objectives are likely to be achieved: fully achieved = 1 largely achieved = 2 partially achieved = 3 achieved to a very limited extent = 4 too early/unable to judge = x Goal/Activity Indicator Progress Score Comments Goal 1: Risk Identification: Increased % of WB Achieved: Ratio of mitigation to 1 Work is continuing to More complete disaster reconstruction funding increased mainstream disaster risk understanding of the full management from average of 17.3% over management into all WB economic, financial, and investment devoted 1980-99 to at least 69% for development operations, social impacts of disasters on to pre-disaster risk projects approved FY 2000-2002. including PRSPs, PRSCs a country in order to reduction versus In addition, PRSPs for and CAS'. demonstrate the importance post-disaster relief Mozambique, Malawi and of including risk reduction and recovery over Honduras, all approved in last 2 NB: Indicator relates to WB measures in any long-term average years, incorporate risk investment only. As a result development strategy, (2 year target: 25%, management and natural there is a mismatch between particularly those designed to up from 20%) disaster concerns. the score at Goal level and alleviate poverty. scores for some of the underlying Activities, which cover the work of other agencies. Activity 1: Methodology and Use of expanded Achieved: Applied by WB in 1 Standards for Needs damage and needs Turkey, India and Mozambique. Assessment: improved and methodology by Asian Development Bank (ADB) standardized methods and major international also used the methodology in practices for conducting, and agencies. 3 by year India (jointly with WB). Also used using, the results of disaster 1; 6 by year 2 by the IADB. CENAPRED, damage and needs UNDP, the Central American assessment, to promote Bank for Economic Integration more rapid and effective (CABEI); and the Corporacion restoration of livelihoods and Andina de Fomento (CAF) in economically important joint evaluations with ECLAC. infrastructure Also used by PAHO, in collaboration with ECLAC for the health sector. Most of these international agencies started using the new methodology during the last 2 years. Joint evaluations with ECLAC verified by Ricardo Zapata (contact:: rzaoata@un.orq.mx) Activity 2: Identification and Quantitative Delayed: All global analysis data 3 Delay primarily due to Analysis of Global Disaster identification of obtained or under development. protracted negotiations Risk Hotspots: global-scale geographic areas of MoU with Columbia signed in between the WB and prioritization of international high global disaster August 2002. Planning Columbia University in risk identification and disaster risk potential by end Workshop held Nov. 2002. agreeing the MoU. MoU now reduction efforts through of year 2 Revised completion date is now agreed. identification of geographic March 2004 areas of high disaster risk potential. Scientifically Delayed: Scientific analysis 3 -ditto- validated workplan to be finalized in Jan. explanation of 2003. Initial global analysis sources of risk for results expected by March 2003. each major natural Agreements for case studies are disaster for each being finalized and these will identified area, incorporate a peer review verified through process. Revised completion peer review process date is now March 2004 by end of year 2 Annex H 68 Goal/Activity Indicator Progress Score Comments Activity 3: Improved Increased number Achieved: A cross-database 1 ProVention partners involved Database for the Social and of natural disasters comparison of the three global included those from the Economic Analysis of are logged in databases was conducted with private sector and NGO Disaster Impacts: public publicly accessible ProVention partners. This community: CRED availability of the highest international exercise verified the validity of (EMDAT), Swiss Re (Sigma) possible quality global databases and EMDAT, which is the only and Munich Re (NatCat). database of social and jointly verified by a publicly available database, and economic impacts of public/private panel made recommendations for disasters and to improve of international improving data quality. The NB: original target future data quality through disaster database number of natural disasters underestimated number of systematic reporting of experts (target: all logged in the EMDAT has disasters already logged on standardized disaster major disasters, up increased (from about 400/ year) EMDAT damage assessments data. from 50 a year) to about 700 in 2001. All major disasters that fall within the EMDAT criteria are entered systematically and verified for source and completeness of information. Information verified by Debi Sapir (saDir@epid.ucl.ac.be) Increased number Partially achieved: Four new 3 Completion of data for other of data elements data fields have been added to continents depends on reported and EMDAT following whether further funding is recorded per recommendations from the 2001 accessed. Discussions also disaster based on TAG group (with participation by underway to develop more authoritative ProVention). 100% of all Asia complete economic data. sources and disasters reported (at least 50% standardized of all disasters), now have values methods or arriving (achieved through collaboration at their values (5 with FAO). Other continents new fields by year remain to be completed. 1; 25% of all disasters reported have values, 50% by end year 2) Activity 4: Critical Cost benefit Achieved: analysis presented at 1 ProVention Sec" suggest shift Infrastructure, Disaster analysis conference in December 2002 to broadening project scope, Vulnerability, and the role of (CBA)method resulting in new indicators the private sector: the developed and (see below) development of tested methodologies to integrate potential catastrophe losses CBA method Delayed: due to shift in project 4 in cost-benefit analysis for independently scope (see comments). critical infrastructure projects applied (5 additional and to incorporate cases by end year catastrophe risk management 2) in the privatization process of infrastructure. Revised Activity 4: as Revised Activity 4 Revised Progress R'vised above indicators Score - based on Achieved: Research presented commissioned and priorities agreed at 1 research, December 2002 conference. identification of and broad stakeholder agreement on priorities for protecting critical infrastructure and vulnerability (by December 2002) - new priorities Largely achieved: Activities 2 addressed in 3 W. informed by this initiative include Bank/ country a project under preparation for strategies (PRSPs, seismic risk in Istanbul to CAS', or projects) strengthening lifelines and critical 69 Annex H Goal/Activity Indicator Progress Score Comments by end project. infrastructure; a project in Vietnam that will address institutional strengthening, structural and non-structural mitigation measures, contingency funding mechanisms and community- based mitigation programs; the Cambodia PRSP, completed in Dec. 2002 which discusses the creation of a national disaster management strategy; and the Ethiopia CAS, which is currently under preparation, and will incorporate safety net provisions and community-level disaster management initiatives. Cambodia, Malawi and Mozambique PRSPs incorporate new priorities. Goal 2: Risk Reduction: Increased Largely achieved: 16 partners 2 There is a mismatch Avoiding hazards and application of risk from a range of sectors between the score at Goal reducing vulnerability reduction strategies (private/public/NGO) and level and some of the To address the need for through reduction of geographic regions applied subsequent activity level scientific and technical risks to transferable approaches or tools gained scores. This is because of knowledge and how to events (two year through their participation in the absence of a logical overcome the socio- target: 11 ProVention. Documentation framework. Thus, economic, institutional and documented cases exists for 7 of the cases (WB achievement of the Goal political barriers to the applied risk project documents, case indicator is not dependant adoption of effective risk reduction by partner assessment reports etc). on the achievement of the reduction strategies and organizations) Remainder is in draft. activity targets. measures in developing countries. Activity 5: International Post disaster Largely achieved: First draft 2 evaluation of recovery efforts reconstruction presented to ad hoc advisory for massive natural disasters: lessons identified committee Dec 2002. Final draft the identification of lessons and published by to be completed by March 2003. for ongoing and future efforts end year 2 Publication by end June 2003. of the international community in providing Partially achieved: AIDMI assistance for post disaster applying study methodology to reconstruction. Documented recovery efforts for other disaster independent events at the local level. 4 Further progress is applications of Discussion underway regarding dependant on above draft identified lessons (2 the potential for incorporating year target: 5) lessons within training programs of ProVention partners. Activity 6: Workshop on Plans for Largely/Partially achieved: 4 Delay in resources from strengthening community implementation by workshop held in August 2002 to funding partner resulted in resilience to natural disasters participants of major take stock of disaster mgt shift in scope of activity to in sub-Saharan Africa: new community training activities of training increase the focus at the strengthened resilience to level initiatives in institutes, to align efforts and NGO level. Next step is to natural disasters in sub- Africa to reduce increase cooperation. Report of review results of the August Saharan Africa at the vulnerability to proceedings completed. 2002 workshops and, based community level natural hazards. 3 Workshop held in August 2002 on these, discuss with IFRC by end year 2 to take stock of disaster further application of management training activities capacity building activities of training institutes, to align for sub-Saharan Africa. efforts and increase cooperation. 35 participants from 13 countries agreed on an action plan to be implemented during the next 5 years, including the development of regional training programs during 2003 and once a year thereafter to target local govt officials, senior NGO staff, Annex H 70 Goal/Activity Indicator Progress Score Comments and Municipal and District Disaster Managers. Activity 7: Increased direct Largely achieved: Extensive 2 Initiative still ongoing in order Reduced vulnerability to communication of review of Global Outreach to reach target of 70 climate variability: direct advance seasonal Forums undertaken and countries. communication with end climate forecast subsequent international meeting However, it is clear that users of climate early information directly held to review findings. This has funds (limited amounts) have warnings, and lower costs to the public at the resulted in a) the establishment been effectively used to forecast production and national level of several new organizations encourage action by national dissemination in regions (additional 70 which aim to increase information and regional agencies affected by climate extremes. countries by end available at national/regional (existing and new) to year 2) level, e.g. North Africa and enhance communication of Central American Forums and a climate forecast information. centre for El Nino in Ecuador, b) products under development to provide sector specific information. ProVention also part funded and participated in El Nino Preparedness international conference in Spring 2002. Link to both events at: http://iri.columbia.edu/ outreach/meeting/ENSOWS2002 Delayed: Discussions held in Reduced costs of March 2002, with several 4 producing seasonal ProVention partners regarding climate outlook the development of an on-line Funding is already in place guidance (down toolbox that would support the and initiative is still valid. from $50K forecast exchange of knowledge between However, technology takes to average of $20K regions and provide a portal into time to introduce in some by end year 2) regional climate forecasting. regions and occasional Revised completion date is now resistance to initiative from March 2004. regions has slowed progress. Progress verified by Max Dilley of IRI. Goal 3: Risk Greater number of Largely/Partially achieved: Risk 3 Indicator is unrealistic for 2 sharing/Transfer Effective transfer promotion projects year timeframe; still too early To protect development approaches to risk underway, for the first time in to judge 'effectiveness' of the investments and advance transfer developed, developing countries, in Mexico, model and these projects. disaster risk awareness. tested and applied OECS (Dominica, Grenada, St. (11 cases by end Kitts and Nevis, St. Lucia, St. year 2) Vincent), Turkey, Iran, Romania, and India (Gujarat). Initiatives under preparation in Bulgaria, Columbia and three other states in India. All WB projects and verified by Rodney Lester (rlester@ worldbank.org). Activity 8: Innovations in Development, Largely achieved: insurance 2 NB: Same projects as used managing catastrophic risk: implementation and based projects initiated in to verify Goal. Too early to analysis of traditional and documentation of Mexico, OECS countries and document results. non-traditional risk transfer results of innovative Gujarat. These are the first risk and sharing mechanisms risk transfer transfer projects of their kind for and their relevance to mechanisms (3 the WB. reducing the vulnerability of cases by end year the poor to hazards. 2). Activity 9: Study and Identification, Partially achieved: identification 3 Delayed involvement by evaluation of microfinance application and and documentation of results of project partner resulted in a and micro insurance for documentation of microfinance based disaster delay in developing the disaster risk management: results of reduction options included in the relevant case studies. In the development of options in the microfinance based 2002 report 'Microfinance and meantime, UNCDF, another area of microfinance and disaster reduction Disaster management: partner in the activity, is in micro insurance to help the options (3 cases by Experiences and Lessons the process of drafting very poor manage their end year 2) Learned.' The report is based on operational guidelines for 71 Annex H Goal/Activity Indicator Progress Score Comments assets more effectively and interviews with MFI operations in disaster reduce their disaster risk. experts/practitioners. situations, based on the ProVention report. Case studies to be developed by IFRC. Activity 10: Targeted support Good practices in Achieved: Paper produced by 1 for disaster recovery: the role the use of social independent consultant entitled: of social investment funds: investment funds Role of SIF's in Disaster Risk identification of good (SIFs) identified, Management, finalized and practises for the use of social verified, published published on ProVention site. investment funds and related Includes case studies. social protection mechanisms to help the poor recover from Documented Delayed: primarily due to death 4 Based on the above paper, disasters. independent of consultant commissioned to the activity is being applications of undertake work. ..Revised redirected to include a practices applied (5 completion date is March 2004 broader approach of by end yr 2) community based mechanisms. (Under discussion with IFRC). Linked to activity 6, but with broader geographical coverage. Goal 4: Knowledge ProVention Partially achieved: Web site 3 Despite achievements with sharing: disseminating Consortium has in established and regularly the training programme and information and building place appropriate updated; training delivered; the Website, the absence of capacity mechanisms for learning events held regularly. a comprehensive To increase access to regular and Involves partner Govts, partner communications strategy information that can help effective institutions, Bank colleagues, that results in proactive communities reduce their dissemination of other donors, ProVention information dissemination vulnerability to disasters, and lessons learnt and partners, and private sector with primary and secondary to build developing countries' member activities, to stakeholders, has resulted in capacity to manage disaster improve a lower score at the Goal risk more effectively. coordination level Activity 11: Knowledge and Disaster and risk Achieved: Training: over 750 1 learning programme: to management people attended develop, consolidate and training material conferences/training disseminate content on and seminar programmes in 2 years [taking disaster risk management for programmes into account minimal double the global community through identified, counting], Website: data the implementation of an developed and incomplete, but there were over integrated knowledge and communicated with 200,000 website hits in 2002 learning programme. The appropriate alone, with an upwards trend in proposed initiatives will build constituencies (500 monthly hits. on programme activities of professionals the Prevention Consortium trained by end yr 2; and its partners. 200,000 website hits by end yr 2) Activity 12: Disaster Completed On track: launched at Dec. 4- 2 Deadline for applications is Reduction Scholarship: proposals evaluated 6conference; approximately 80 end February 2003. Support of innovative disaster by a selected jury scholarships to be awarded by ProVention Secretariat risk management projects and fellowships April 2003. confident that will meet April and promotion of competent distributed (70 by deadline. Applicants must be professionals in developing endyr2) citizens of developing countries dedicated to countries, and are reducing disaster risk. encouraged to apply for scholarships for non US Universities. Annex I 72 Annex I. Performance Measurement Framework (2003-2006) This framework provides an outline of ProVention’s goals, outputs, and measurable indicators, for the full project term (2003-2006). The framework was developed through a joint planning process by the incoming IFRC-hosted Secretariat and outgoing WB-hosted Secretariat with additional support and input from DFID. In March 2005, IEG rated progress against ProVention’s stated objectives and indicators. MEASURABLE INDICATORS PROGRESS RATINGS SUPER GOAL To reduce poverty and build sustainable economies in developing countries. GOAL To support developing Reduction in future disaster loss countries reduce the risk and and damage in ProVention social, economic and project areas by project end. environmental impact of natural and technological disasters. OUTPUTS 1. ProVention forges cross- 1.1 80% of ProVention activities 1.1 Under the Geneva-based Secretariat, Largely sectoral linkages, involve partnerships 71% of activities involve partnerships achieved partnerships and closer between Consortium between Consortium members interaction on disaster members by project end. risk management between members of the 1.2 At least two projects involve 1.2 Three projects involve collaboration Consortium. specific collaboration with with the private sector. private sector by project end. 1.3 At least two projects 1.3 Red Cross societies are participating focused on increased in two projects in Sudan and Latin participation of civil society America, AIDMI is involved in one organizations in ProVention project in India. by project end. 1.4 At project end, ProVention 1.4 A new website has been launched members perceive there to facilitating dissemination. Internet be enhanced sharing of users were located mainly in the US knowledge, exchange of and Latin America. A stronger focus resources and on dissemination in the South may dissemination of information be desirable. The ProVention Forum on disaster risk has been started for information management between sharing with two meetings already ProVention stakeholders. held. According to interviews, ProVention members were satisfied with the flexibility with which ProVention attends to different needs. 2. Disaster risk 2.1 Disaster risk management 2.1 PRSPs include disaster risk management policy is integrated into a minimum management for Cambodia (2003), improved and promoted of 2 country strategy Ghana (2003), Mongolia (2003), amongst key policy papers (e.g. CAS) of 3 Nicaragua (2001), Tajikistan (2002), 73 Annex I MEASURABLE INDICATORS PROGRESS RATINGS decision makers multilateral agencies, and and Vietnam (2002). 25 CASs 3 new developing country approved after 2003 discuss natural PRSPs or development disaster risk management. Two plans, by project end. policy papers have been produced in cooperation with DFID and SIDA. However, inclusion of disaster risk management in Country Assistance Plans (DFID) varies; no numbers were provided. 2.2 Spending of development 2.2 Between 2000 and 2004 alone, the banks on disaster risk World Bank included mitigation management increased by measures in 140 projects. Between project end. 1990 and 1994 it had included mitigation measure in only 94 projects. 2.3 By project end, the profile 2.3 World Bank management is of disaster risk reviewing its policy for emergency management is increased lending. ProVention collaborated with in >70% of ProVention DFID and SIDA to review their member organizations in natural disaster policies. In addition, terms of policy attention it raised the profile of disaster risk and resource allocation management in IFRC. 2.4 Relevant practitioners and 2.4 Regional networks are aware of selected vulnerable ProVention through ProVention communities in project activities and ProVention’s countries are aware of contributions to the 2005 World ProVention and its work. Conference on Disaster Reduction in Japan. 2.5 Disaster reduction agenda 2.5 ProVention contributed to IFRC’s is better integrated into annual appeals, the 2004 World policies and programmes Disasters Report, and the 2003 of IFRC and national International Red Cross Conference. societies 3. ProVention develops 3.1 New, innovative 3.1 AURAN activity in progress in South Partially innovative approaches to approaches designed and Africa, Tanzania, Algeria, Ghana, achieved the practice of disaster tested to improve risk Senegal, and Kenya. risk identification/ identification and analysis, analysis, risk reduction risk reduction and risk and risk sharing/transfer. sharing/transfer in target countries. 6 by project end 3.2 4 sets of tools and 3.2 Four sets of tools and methodologies methodologies adopted have been developed; adoption and and applied by 6 project application only partially stakeholders by project documented. end. 3.3 Minimum of 2 initiatives 3.3 Two activities are in progress in implemented in sub Africa (AURAN and reducing flood Saharan Africa by project risk in Sudan) end. 4. ProVention shares 4.1 Website transferred to 4.1 Website transferred to Geneva- Largely knowledge and IFRC hosted secretariat by based Secretariat. achieved information about best end 2003. practices, tools and resources for disaster 4.2 Website regularly updated. 4.2 Website updated and relaunched in risk management and April 2006. communicates effectively with its 4.3 Develop electronic 4.3 ‘ProVention News’, a biannual e-zine, various stakeholders newsletter (e-zine) is reaching over 400 recipients at present. Annex I 74 MEASURABLE INDICATORS PROGRESS RATINGS 4.4 Develop promotional 4.4 Promotional materials were materials, such as flyers, developed. Updates needed. project fact sheets and standard presentation 4.5 Share project outputs, 4.5 Bi-annual newsletter has been agreed good practice, distributed. ProVention briefing pack resources and tools in developed. disaster risk management with ProVention members and other stakeholders 5. The Consortium has a 5.1 ProVention governance 5.1 The current governance structure Largely broad membership, and membership include has been reviewed and was adopted achieved supported by an representatives of all by the SC. effective Presiding stakeholder groups, by end Council, Steering first year of project. Committee and Secretariat. 5.2 Membership is broadened 5.2 Eleven NGOs partner with to include 3 new civil ProVention. Interpolis Re and World society organizations and 2 Economic Forum Disaster Resource new private sector actors Network have become engaged in engaged in project ProVention. activities by project end. 5.3 Selected members of 5.3 Letters written in order to engage Presiding Council are members of the PC. However, PC engaged in one ProVention members are not yet active. advocacy initiative by project end. 5.4 Steering Committee meets 5.4 The Steering Committee has met twice per annum to only once a year. However, two approve and monitor additional meetings were organized ProVention’s work. for the ProVention Forum, one in April 2005 and one in February 2006. 5.5 Strategic plan approved by 5.5 Steering Committee approved Steering Committee by strategic plan in September 2003 August 2003. 5.6 Secretariat coordinates 5.6 ProVention members praised the project activities efficiently, Secretariat for its coordination, its provides timely reports to timely reports, and successful donors and Steering fundraising initiatives; however, more Committee, prepares draft could be done to broaden strategic plans for Steering ProVention’s donor base. Committee approval, fund raises successfully for implementing the workplan, and communicates regularly with membership during project period. 5.7 At project end >60% of 5.7 IEG did not survey Steering steering committee Committee members and Presiding members and > 30% of Council members systematically to Presiding Council find out how aware they are of members are aware of ProVention’s activities. ProVention activities 75 Annex J Annex J. Assessing the Independence and Quality of the External Evaluation Independence. In assessing the independence of ProVention’s external evaluation, the Global Program Review comes to the conclusion that the criterion of independence was compromised at three levels: first with regard to the evaluation’s organizational independence, second with regard to its behavioral independence, and third with regard to avoidance of conflicts of interests (see Annex A, Table 1). This analysis is spelled out in greater detail below. Organizational independence. The 2003 DGF learning and evaluation note, which was sent to the ProVention Secretariat in December 2003, almost a year before the evaluation started,1 states that DGF evaluations be overseen by the program’s governing body and conducted with the assistance of program management. Evaluators should report to the governing body, not to management. It was the understanding of the ProVention Secretariat, however, that the Secretariat should commission the evaluation. In cases where the governing body is not yet well established, the 2004 OED review on the Bank’s involvement in global programs suggests having the first generation of evaluations managed by the founders, co-sponsors, lead donors, and financiers until a governing body is well established (OED, 2005, p. 40). Thus, IEG recommends that for future external evaluations, more organizational independence be sought. Behavioral independence. The Geneva-based Secretariat was in a position of influence since it provided a large amount of input and managed the evaluation. The World Bank global program task manager and IFRC program manager oversaw and approved the selection and briefing of the evaluation team, but independence does not seem to have been a priority. After completion, the report was circulated in draft form to the Secretariat and SC members, and changes were made where considered appropriate by the evaluator. Even though the evaluator reserved the right to make changes only where considered appropriate, negotiating the content of the draft report before it was presented to the Secretariat should have been avoided. Avoidance of conflicts of interests. The ToR also called for a desk review with a detailed assessment of a representative sample of past completed and present ongoing workplan activities. However, no criteria were provided for selecting the above mentioned activity “Learning Lessons from Disaster Recovery” for review, on which the external evaluation’s primary author himself had worked as a consultant. Though he subcontracted this review to another consultant, a conflict of interest cannot be excluded, since the primary author had the overall responsibility for the evaluation. The fact that the external evaluation was managed and supervised by the entity being evaluated, and that conflicts of interest were not completely excluded, combined with the 1. See e-mail from Jonathan Agwe dated 12/18/03. Annex J 76 generally positive findings of the evaluation, created the appearance that the evaluation was less than fully independent. 77 Annex K Annex K. Response of the ProVention Consortium to IEGs Global Program Review The ProVention Consortium Secretariat welcomes IEG’s Review of the Global Program and considers this report a significant contribution to the discourse and ongoing learning concerning the development of the ProVention program and partnership. The main findings and recommendations of the Review are duly noted and largely consistent with other recent external evaluations and reviews carried out of ProVention. Since its launch in 2000, ProVention has been evaluated or reviewed on five occasions, four of which have been external donor reviews or evaluations and one an internal governance review. The IEG review is an important addition and particularly valuable since it examines the evolution of ProVention as a global program; critically reviews the transfer of the Secretariat from the World Bank to IFRC; assesses the efficiency of the governance and management structures; evaluates the process and outcome of a previous external evaluation; and analyses ProVention’s relevance and progress. The Review also raises important issues concerning the future role of the World Bank in ProVention, particularly in light of the recent Bank initiative to establish a Global Facility for Disaster Reduction and Recovery. The Secretariat has responded in brief below to each of these aspects of the Global Program Review and will seek to address the Review recommendations in a systemic process of follow up and as part of the Strategic Work Plan 2007-09. It should be noted, however, that the following response is given by the Secretariat, composed of a small team of five in Geneva, and at the time of writing the Review had not been circulated by IEG among the wider ProVention Consortium for comment. In fact, unfortunately, the wider Consortium has had very limited involvement in this Review with relatively few ProVention partners interviewed in the process. Hence, the Secretariat believes that the views of key stakeholders have been missed in the Review and that this response cannot be considered a response of the entire ProVention Consortium but is limited to the comments of the Secretariat. ProVention’s relevance and progress The IEG Review reiterates the findings of other recent reviews in its conclusion that ProVention remains a relevant global program and continues to be effective in identifying knowledge gaps and advancing the agenda of disaster risk reduction. This pays tribute to the vision of the World Bank to create such an innovative global program and the support of the past and present host organizations, the World Bank and IFRC, to provide an institutional home and management oversight of the Secretariat. As the global concern for reducing natural hazard risk increases, with demand for policy reform, innovative solutions, collaborative initiatives and knowledge sharing across organizations and sectors, it is clear that ProVention will continue to play a key role in the international disaster reduction system. Both the founding organization (World Bank) and current host organization (IFRC), therefore, share an important responsibility and opportunity to shape the future direction of ProVention. However, as suggested in the Review, it is somewhat unclear as to the level of current commitment and interest within the World Bank to remain a lead partner in the Consortium and influence its progress. Evolution of ProVention and transfer of the Secretariat from World Bank to IFRC The Review provides a valuable historical account of the genesis of ProVention and, in particular, issues concerning the transfer of the ProVention Secretariat. The report highlights a number of salient lessons that should inform the evolution of similar global programs or indeed should a future transfer of the Secretariat take place. The Review questions the concept of a rotating Secretariat due to the considerable opportunity costs experienced in transferring the Secretariat from the World Bank to IFRC. Indeed, the Secretariat recognizes the considerable administrative costs in rotation and would, hence, recommend in the Annex K 78 future that either a Secretariat term should be a minimum of five years or, as the Review recommends, a more permanent institutional base be established for Secretariats at the outset of such global programs. It is surprising, however, that the Review recognizes few of the positive benefits of the transfer that have been highlighted in other evaluations and reviews of ProVention. These include a greater emphasis on community-oriented activities with increased participation of civil society organizations due to the comparative advantage of IFRC and its strong links with local Red Cross, NGOs and communities. It is evident that the shift to IFRC has enabled other Consortium partners to play a more active role in ProVention and inject new perspectives to the agenda. The Review considers that two years were lost as a result of the transfer. The Secretariat does not support this view and, in fact, a donor review carried out by DFID (2004) highlighted the benefits of the transfer period which forced a time of critical review and strategic planning and resulted in a number of important outputs, including the production of a performance measurement framework, advocacy and communications strategy and multi-stakeholder consultation on priorities for the next phase of the ProVention work programme. Thus, while the transition period is seen as a reduction in project activities and funding disbursements it was equally marked by an intense period of strategic planning (Strategic Work Plan 2003-06), partner consultations and development of a new phase of ProVention activities. It is our view that global programs like ProVention benefit from such a 3 year cycle of planning, project design, implementation, review and evaluation. An interesting and important point to note concerning the evolution of ProVention, and one which may not have been foreseen at its launch in 2000, has been the creation of a constantly growing network as opposed to a restricted Consortium. The creation of a global coalition like ProVention follows the growing trend to create global networks, in part in response to the inability of nation states and intergovernmental organizations to effectively address issues of global concern in a context of increasing globalization. Networks are increasingly key to organizing logic and finding solutions in the 21st century. It is believed that only when a wide variety of actors, each with unique skills and responsibilities are jointly involved in problem solving that global problems can be effectively addressed. ProVention has evolved, almost organically, into a multi-stakeholder network, often providing a network of networks around topics or areas of practice (e.g. network of IFIs, network of CRA practitioners, etc). The membership issue, as pointed out in the Review, therefore remains very pertinent and particularly challenging for the Secretariat as an ever-increasing number of organizations wish to be involved in and a part of ProVention. Governance and management structures The Review re-examines ProVention’s governance structures and provides further independent analysis of the findings and recommendations set out in the 2005 Governance Review of ProVention. The Review concludes that the subject of governance has remained one of ProVention’s weakest aspects since its creation in 2000. The Secretariat takes note of the specific recommendations offered in the Review concerning the strengthening of governance structures and will incorporate these in the ongoing governance reform process in the follow up to the 2005 Governance Review. It is interesting to note that the Review considers that the informality of ProVention’s governance is a particularly weak feature and, yet, paradoxically the informal nature of ProVention is also seen by many as one of its strengths. The recent Governance Review, for example, highlighted ProVention’s strengths as ‘flexible, light, informal and not overly bureaucratic’. This has presented a constant challenge, and at times dilemma, for the Secretariat as to whether to push for a more formal governance structure or improve accountability and transparency within more informal, light structures. ProVention stakeholders, in particular the donors, have predominantly preferred the informal model which have enabled a lighter and more flexible approach to governance. It must be said, however, that the Secretariat remains uncomfortable at the level of decision making entrusted to the Secretariat and that they should be leading the process of governance reform rather than the founding and host organization or Advisory Committee. 79 Annex K External evaluation of ProVention A key objective of the IEG Review was to evaluate the external evaluation carried out of ProVention in 2005, with a view to validate the evaluation findings, review the evaluation process and assess the outcome. The Review is particularly critical of the external evaluation and questions the independence and quality of the evaluation, although generally supports the evaluation findings and recommendations. The Secretariat believes that the external evaluation process could have been vastly improved had better guidance and clarity been given by the donor (World Bank) to the Secretariat with regard to the expectations and scope concerning this particular external evaluation of DGF funds. For example, there was at no point direct contact with DGF and all correspondence was made via the Hazard Management Unit. The Terms of Reference for the evaluation were sent to DGF but no comments were made. The original DGF project proposal for ProVention was never made available to the IFRC Secretariat or the evaluation consultant. The draft evaluation report was sent to DGF and the Hazard Management Unit but no comments were made. Thus, concerns such as the scope of the evaluation and time and resources allocated to the evaluation could have been addressed at the outset if there had been more direct involvement of DGF and the evaluation office of the World Bank. It should also be noted that the external evaluation was expected to cover the total period of the DGF grant and the entirety of ProVention activities. This presented a particular challenge for the IFRC Secretariat since (a) the first two years of the DGF grant were managed and executed by the World Bank’s DMF of which the IFRC Secretariat had limited institutional knowledge or access; and (b) less than a year earlier a major independent evaluation of ProVention had been carried out by DFID and hence there seemed limited value in repeating the entire exercise. The role of the World Bank in ProVention and implications of the Global Facility for Disaster Reduction and Recovery Surprisingly, the Review pays relatively little attention to the present and future role of the World Bank in ProVention. The Secretariat considers the role of the World Bank in ProVention as critical, not just as the founding organization but as one of the most key international organizations able to influence a paradigm shift in international development from reactive, ex-post response to disasters to proactive, ex-ante management of risk. The World Bank remains a lead partner in many ProVention initiatives and for a number of partners in the Consortium a key added value of ProVention is the opportunity to engage with the World Bank, either as a project partner or in policy dialogue. The Secretariat, therefore, greatly values the contribution of the World Bank to the ProVention endeavor and believes that the Bank continues to benefit through sharing the efforts and results of a consortium approach, pooling resources and forging linkages with different and diverse partners. It is a concern to the Secretariat that this viewpoint is not supported by more evidence in the Review. The launch of the Global Facility for Disaster Reduction and Recovery is an extremely important development for the global disaster reduction agenda. ProVention welcomes this initiative by the World Bank and hopes to promote the work of the Facility and also contribute knowledge, policy analysis; tools and resources which might help increase the effectiveness and impact of the Facility. The Review suggests that GFDRR might be seen as a threat to ProVention or at least possibly leaves the Bank’s role in ProVention as redundant. The Secretariat, however, believes that if well constructed and coordinated the GFDRR should complement and harmonize efforts with other global initiatives, such as ISDR and ProVention. Moreover, there is arguably a case for continued Bank involvement in specific ProVention activities that are not possible through the GFDRR and will not duplicate the work of the Facility. The GFDRR can learn much from the ProVention experience, both good and bad, as a global multi-stakeholder program. However, ProVention’s involvement in the development of the GFDRR has so far been very limited and it is unclear as to how the future relationship will pan out although we hope opportunities for coordination and collaboration will not be missed.