37876 IDA14 DEVELOPMENT POLICY OPERATIONS A FRAMEWORKASSESS TO COUNTRYREADINESS FOR MAKING PRODUCTIVEUSEOFDEVELOPMENT POLICY OPERATIONS InternationalDevelopment Association Operations Policy and Country Services October 2006 ABBREVIATIONSAND ACRONYMS CAS Country Assistance Strategy CFAA Country Financial Accountability Assessment CPAR Country Procurement AssessmentReport CPIA Country Policy and Institutional Assessment DPO Development policy operation IBRD International Bank for Reconstruction and Development IDA International Development Association IEG IndependentEvaluation Group IMF International Monetary Fund OPCS Operations Policy and Country Services PEFA Public Expenditure and FinancialAccountability (Initiative) PER Public Expenditure Review PFM Public financial management PRS Poverty reduction strategy PRSC Poverty Reduction Support Credit PRSP Poverty Reduction Strategy Paper TABLEOFCONTENTS Executive Summary.................................................................................................................... i I Introduction . ........................................................................................................................... 1 I1 A ReadinessFrameworkfor DevelopmentPolicyOperations........................................ . 6 A Policy and Institutional Framework ................................................................................ 9 B ..Ownership ...................................................................................................................... 10 C. Capacity ......................................................................................................................... 10 I11 EvaluatingReadiness . ....................................................................................................... 10 A. Assessing the Policy and Institutional Framework........................................................ 11 B . Assessing Ownership ..................................................................................................... 14 C. Assessing Capacity ........................................................................................................ 15 I V SummaryReadinessAssessments................................................................................... . 16 A. General Considerations.................................................................................................. 16 B Assessing Readiness inDifferent Country Circumstances............................................ 17 22 V Conclusions......................................................................................................................... .C.. Implications o f Readiness Considerations for IDA'SDPO Share ................................. 22 Boxes Box 1 Analytic Findings on Readiness Considerations for Policy-Based . 7 Box 2 Supporting PRS ImplementationinBurkinaFaso....................................................... Lending 1986-1995........................................................................................................ Box 3 Support for Institution-Building inAfghanistan.......................................................... 19 Box 4 Focusing on Select Policy Areas inTajikistan ............................................................ .. 20 21 Box 5 Responding to the Earthquake inPakistan................................................................... .. 21 Figures Figure 1 Share o f Policy-Based Financing............................................................................... Figure 2 Selectivity inIDA Policy-Based FinancingAgainst CPIA Ratings. FY98-06..........5 5 Figure 3 Schematic Representation o f the ReadinessFramework ........................................... ... 7 DEVELOPMENT POLICY OPERATIONS A FRAMEWORKASSESS TO COUNTRYREADINESSFORMAKING PRODUCTIVEUSE OFDEVELOPMENT POLICY OPERATIONS EXECUTIVE SUMMARY 1. This report responds to a request by the IDA Deputies for a proposal for a framework to assess countries' readiness to make productive use of development policy operations (DPO). It draws on a review o f recent experience, including the 2006 Development Policy Lending Retrospective,' and builds on over 20 years o f experience with fast-disbursing lending. Although the term "Development Policy Lending'' is widely usedinBank documents to refer to one of the two basic types o f Bank lending instruments, this report uses the term "Development Policy Operations" to clarify that these operations are funded by both IDA credits and IDA grants, and to maintain consistency with the IDA14 Deputies' Report. 2. Objective ofDPOs. DPOs encompass all Bank operations that provide rapidly disbursing policy-based financing to support a country's program o f policy and institutional actions that promote growth and enhance the well-being and increase incomes o f poor people. Building on the experiences accumulated during the 1980s and 1990s, a new comprehensive policy for development policy operations (known as Operational Policy 8.60) was adopted inAugust 2004. Inreplacing the previous guidelines, the Bank retired prescriptive passages on specific policy areas, such as privatization, financial sector reform, and public sector reform, because it had recognized that generalized prescriptions often fail and policies need to be country- and time- specific. 3, Readiness Considerations in Bank Lending. Current Bank policies and procedures imply assessment of readiness to make productive use of DPOs on two levels, the country assistance strategy (CAS) and the individual operation. The CAS allocates IDA resources across different instruments and sectors, and considerations about readiness for DPOs-including considerations regarding debt sustainability and absorptive capacity-feed into this strategic choice along with the country's financing requirements and its IDA allocation. According to the Bank's operational policy2,DPO readiness i s based on an assessmento f the country's policy and institutional framework-including the country's economic situation, governance, environmentalhatural resource management, and poverty and social aspects. The Bank also considers the strength o f the program and the country's commitment to and ownership o f the program against its track record. It assesses the country's institutional capacity and ability to implement effectively the program. Ultimately, the share and volume of DPOs in country programs reflect not only considerations o f readiness to make productive use o f DPOs (the main subject o f this paper), but also (a) considerations about the complementarity o f instruments in pursuing the same development objective, and (b) the potential productivity o f alternative instrumentsinpursuing other development objectives. ' Development Policy Lending Retrospective (SecM2006-3 19), July 13,2006. OPBP 8.60, Development Policy Lending, August 2004. - 11.. - 4. Corporate Oversight. To ensure broad corporate oversight o f the strategic choices in CASs and DPOs, Bank processes require two corporate reviews o f CASs and one corporate review of DPOs. These internal reviews-with a Bankwide distribution o f documents-ensure input from all relevant Bank units for decisions on shares of financing instruments and performance benchmarks in CASs, and on authorizing appraisal o f individual DPOs. CASs must be cleared by the responsible Managing Director (Operations) before they are distributed to the Board o f ExecutiveDirectors. 5 . DPO Shares. During FY06, 26 percent of IDA commitments were for policy-based operations. DPO shares are projected to remain within a similar range during FY07. Distributional analysis using Country Policy and Institutional Assessment (CPIA) ratings suggests that under the existing framework the Bank has used DPOs selectively. For example, during FY98-06, less than 14 percent o f IDA'Scommitments for policy-based operations have been made to the bottom 40 percent o f the CPIA distribution. 6. Proposed Readiness Framework. Readiness to make effective use o f DPOs reflects the likelihood that the borrower will implement the program as planned and that program actions will influence outcomes as expected. Policy research and reviews and retrospectives of policy- based lending suggest that readiness to make effective use o f DPOs depends on three main factors: (a) the policy and institutional framework, (b) ownership, and (c) capacity (see below). A Readiness Framework for DPOs The proposed readiness framework builds on three pillars and a set of assessments that inform any summary readiness assessment. In particular, the following elements form key ingredients to make readiness assessments identifiedinthe paper: Policv and Institutional Framework Macroeconomic Policy Framework Budget Framework PublicFinancialManagementandFiduciary GovernanceEnvironmentand Corruption ManagementofDistributionalEffects ManagementofEnvironmentalEffects MonitoringandEvaluationFramework RiskManagementFramework OwnershiD Track Record ParticipatoryProcesses and Consultation PoliticalEconomy CaDacitv ProgramDesign ProgramImplementation ProgramMonitoringand Evaluation 7. Assessing Readiness. The Bank has access to a variety o f tools to assess readiness under this framework. Core elements of development policy operation preparation include assessments of the policy and institutional framework, in particular the macroeconomic policy framework; - 111- ... the public financial management system; the management of distributional and environmental effects; the borrower's monitoring and evaluation framework, and the borrower's risk management framework. Regarding ownership, the Bank's assessment typically relies on the government's track record, indications o f country ownership as expressed in participatory processes, and, at times, political economy analysis. The Bank and other donors frequently identify capacity constraints when designing, executing, and evaluating programs, and this analysis informs the design o f the operation and triggers additional financial and technical support to address capacity bottlenecks. 8. Readiness Assessment and Country Circumstances. In practice, the Bank assesses a country's readiness to make productive use o f DPOs in its CAS as well as at the level o f the individual operation. Indoing so, it weighs different readiness criteria against each other and, in deciding on a DPO engagement, weighs the resulting risks against the strength o f the government program. Depending on country circumstances, different criteria may carry different levels of importance when reviewedagainst the potential benefits o f engagement. For example: In better-performing countries with recurrent DPOs, the soundness of policy and institutions, including public financial management systems, would typically receive important weight in assessing readiness given the relevance of sound budgetary systems for achieving results. Strong ownership, evidenced by a good track record, and relatively strong capacity levels are also important considerations under such medium-term engagements. In medium-term engagements for sectoral DPOs, similar considerations apply, but considerations regarding ownership o f the reform program may be more narrowly focused on the sectoral aspects of the program rather on the broad countrywide situation. In a subnational DPO setting, the policy and institutional framework of the subnational government, as well as its reform ownership and capacity, receive close attention. DPOs in post-conflict countries and after rapid policy shijh may offer important immediate benefits by restoring state functions or strengthening incipient reforms. Against such benefits, the Bank may be willing to take higher risks signaled by significant weaknesses inpolicy and institutions and capacity, as long as ownership o f the program i s strong. Gradual improvers may occasionally offer opportunities for engagement in policy areas where a consensus is emerging. Typically, in these cases there are still considerable weaknesses in the policy and institutional framework and in capacity, and a lack o f universal ownership. However, anticipated benefits o f deepening and enhancing policy reforms in select areas with a small financial engagement may at times outweigh such risks. Crisis and external shocks may require a reassessment o f the appropriate volumes o f DPO support for any given readiness level, provided that the government displays sufficient ownership and commitment to use the additional resources in a way that contravenes the crisis and shock and delivers the intendedbenefits. Deteriorating governance and conflict situations would typically not be conducive to making productive use o f DPOsunless a significant shift inpolicy stance occurs. - iv - 9. Implementation of the Framework. The Bank has the capacity and tools to review different elements of the readiness framework during preparation o f CASs and DPOs using widely available analytic work for IDA countries. As was recently emphasized in the Development Policy LendingRetrospective, the Bank's use of DPOs has been selective, and the overall policy framework is robust, although some elements of the framework-notably the tracking of progress inpublic financial management and the upstream use o f poverty and social impact analysis-may require additional strengthening during implementation. The framework will continue to rely on strong corporate oversight, including mandatory corporate review for DPO and CASs, senior management clearance o f CASs, and Board discussion of CASs and DPOs, except follow-on operations ina programmatic series. 10. Readiness Framework and DPO Shares. Many elements o f the readiness framework rely on country knowledge and do not lend themselves to the establishment of a summary numerical indicator that could be linked to an "appropriate" share o f DPOs. Taken together, these factors suggest that the appropriate share of DPOs will remain tied to a qualitative assessment within a framework o f tight corporate oversight. Past experience suggests that within such a framework, IDA's DPO commitments have been predominantly geared toward better performers, with selective engagements inweaker environments. 11. Monitoring Shares and Effectiveness of DPOs. The Bank monitors the effectiveness of DPOs, using its own work and independent or external evaluations o f budget support instruments.A new DPO retrospective is planned for FY09, giving a second progress report on implementation of the new DPO policy adopted in August 2004. As in FY05 and FY06, the Board will receive annual updates on past and projected three-year rolling averages o f the share o f DPOs for the Bank, and will be alerted if IDA's share for any given year i s projected to exceed 30 percent (excluding resources used to repay bridge financing to clear arrears in countries reengaging after prolonged periods o f inactivity). The Board will have the opportunity to give guidance to Management on DPO volumes at the time o f the annual discussion on the Medium-Term Strategy andFinance paper. DEVELOPMENT POLICYOPERATIONS A FRAMEWORK TO ASSESS COUNTRY READINESSFORMAKING PRODUCTIVE USE OF DEVELOPMENT POLICY OPERATIONS I.INTRODUCTION 1. At the Fourteenth Replenishmentof IDA,Deputies notedthat the commitment volume of development policy operations (DPOs) should remain below 30 percent o f total IDA commitments for the IDA14 period.' As a basis for further discussion on IDA'Sdevelopment policy operations (DPO) volumes, Deputiesrequestedthat by the Mid-Term Reviewthey receive a "proposal for a framework to assess the readiness o f countries to make productive use of development policy operations, basedon a systematic review o f experience.''2 This paper sets out such a framework, drawing on a recent Development Policy LendingRetrospective and a wealth of other analytic work conducted over more than 20 years on adjustment lending and budget support by the Bank and by the donor community in general. Although the term "Development Policy Lending" i s widely usedinBank documents to refer to one o f the two basic types of Bank lending instruments, this report uses the term "Development Policy Operations" to clarify that these operations are funded by both IDA credits and IDA grants, and to maintain consistency withthe IDA14Deputies' Report. 2. Objective of DevelopmentPolicy Operations. DPOs encompass all Bank operations that provide rapidly disbursing policy-based financing. As defined inthe Bank's policy inplace since August 2004, the overarching objective of DPOs is to support a country's economic and sectoral policies and institutions aimed at accelerated sustainable growth and efficient resource allocation to enhance the well-being and increase the incomes o f poor people. To this end, DPOs typically support a program of policy and institutional actions and finance the borrower's overall budgetary expenditures, except for a limited number of items on a standard list o f excluded expenditure (negative list). 3 , History of Fast-Disbursing Lending. Although the Bank had granted fast-disbursing program loans to member countries since its inception under the special circumstances rationaleY3 a policy framework for structural adjustment lending was set out for the first time inMay 1980.4 Structural adjustment lending objectives were originally defined as assisting countries in "modifying the structure o f an economy so that it can maintain both its growth rate and the viability o f its balance-of-payments in the medium term."' The number o f adjustment policy instruments was over time enhanced with the creation of sectoral adjustment lending to support sectoral reform processes and a variety o f options, such as special adjustment lendingfor middle- ' Resourcesto repay bridgefinancing inarrears clearance cases would be excluded from this ceiling. Additions to IDA Resources: Fourteenth Replenishment - Working Together to Achieve the Millennium Development Goals Report from the Executive Directors o f the InternationalDevelopment Association to the Boardo f Governors, March 10,2005. 3 Before 1980 Bank management assumed that program lendingmight amount to 7 to 10 percent of total lending commitments, see A Note on ProgramLending(SecM80-150), February29, 1980. 4 Structural Adjustment Lending (R80-122), May 9, 1980. All fast-disbursing lending has been and continues to bejustified under the special circumstancesprovisionofthe Bank's Articles ofAgreement. OperationalManual, StatementNo. 3.58, Annex 11, November 1982. - 2 - income countries in crisis. Both the Bank's Independent Evaluation Group and policy departments have at regular intervals reviewed experiences withthe lending instruments, leading to refinements o f policies, broadening o f objective, and evolution of its application over time.6 4. Evolution of Fast-Disbursing Lending Instruments. The Bank's lending instruments for fast-disbursing lending evolved during the1990s in response to lessons learned in the application o f first-generation adjustment lending focused on short-term balance-of-payment support. The new paradigm involved greater focus on poverty reduction, sustained support for policy and social programs, and capacity and institution building. Also, in response to research findings and studies suggesting that programs without sufficient ownership are more likely to fail, the Bank began highlighting the importance of adapting its support to a country's development priorities and implementation capacity. Important milestones in reflecting these lessons were the introduction of programmatic adjustment lending in 1999 and the launch o f poverty reduction support credits (PRSCs) in 2001 to support poverty reduction strategies (PRSS).~ 5. ProgrammaticApproach.' The programmatic approach involves a series o f operations with a single tranche that are sequentially presented to the Bank's Board, with a medium-term framework specified at the outset-including completed prior actions, monitorable progress indicators, and expected prior actions (triggers) for subsequent operations.' This approach combines the discipline o f a medium-term framework with triggers for subsequent operations that offer the flexibility to accommodate the unpredictability and uncertainty o f complex policy reforms. Unlike traditional multitranche operations, which relied on promises for future actions to justify disbursements, each single-tranche loan under a programmatic approach i s approved following actual performance-that is, on the basis of already completed actions-and thus contributes to systematic policy implementation." Typically, programmatic lending i s used to support complex medium-term institutional reforms. To the extent possible, programmatic approaches align disbursements with the borrowing country's financing needs during the annual budget cycle. In low-income countries, the PRSC is a programmatic development policy credit For example, Structural Adjustment Lending: A First Review of Experience, Operations Evaluations Department, Report No. 6409, September 9, 1986; Report on Adjustment Lending 11:Policiesfor the Recovery of Growth, (IDAR90-49), March 1990; The Third Report on Adjustment Lending: Private and Public Resources for Growth (IDA/R92-29), March 1992; Structural and Sectoral Adjustment: World Bank Experience, 1980-92, Report No. 14691, Operations Evaluations Departments, June 1995, and Adjustment Lending Retrospective (SecM2001-215), April 2,2001. PRSCs were designed as a separate adjustment lending instrument to support the implementation o f PRSs in low-income countries through programmatic adjustment operations. Their objective was to (a) help operationalize and finance a medium-termprogram to implement the PRS, (b) improve resource predictability, and (c) provide a framework for donor harmonization. Poverty Reduction Support Credits: A Stocktaking (IDA/SecM2005-238.), April 29,2005, reviews the Bank's experiences with this instrument. World Bank, Programmatic Adjustment Lending Retrospective (Report 26319, OPCS, March2004. See OP8.60, Development Policy Lending, para.14. Experience with the programmatic approach to date suggests that it has been robust and effective in a wide range o f country circumstances, largely because o fthe design features that have provided sufficient flexibility to facilitate a stronger focus on results, participation, and harmonization; see World Bank, Programmatic Adjustment Lending Retrospective (Report 26315), OPCS, March2004. - 3 - or grant designed to assist well-performing countries in implementing their poverty reduction strategy.' 6. From Adjustment Lending to Development Policy Lending. Building on the experiences accumulated during the 1980s and 1990s, a new comprehensive policy for development policy operations (known as Operational Policy 8-60) was adopted inAugust 2004. It replaced and unified all previous adjustment lending policies and instruments.'2 In replacing the previous guidelines, the Bank retired prescriptive passages on specific policy areas, such as privatization, financial sector reform, and public sector reform, because it had recognized that generalized prescriptions often fail and policies need to be country- and time-specific. Development policy operations explicitly aim at supporting a country's program o f policy and institutional actions to promote growth and achieve sustainable reductions in poverty. These programs are expected to be based on country and sectonvide analytic work (carried out by the country itself, third parties, or the Bank); in addition, operations need to assess the country's fiduciary arrangements; the policy effects on its environment, including forests and other natural resources; and the likely poverty and social impacts o f key policies supported by the operation. As regards conditionality, the new operational policy mandates that conditions should be confined to those actions that are critical for implementingthe country's program to achieve the expected results. Programs supported under the new operational policy are expected to reflect consultation with stakeholders in the country, and to include a results framework that allows adequate monitoring and evaluation. 7. Readiness Considerations in Bank Lending. Current Bank policies and procedures imply assessment of readiness to make productive use of DPOs on two levels, the country assistance strategy (CAS) and the individual operation. The CAS allocates IDA resources across different instruments and sectors, and considerations about readiness for DPOs-including considerations regarding debt sustainability and absorptive capacity-feed into this strategic choice along with the country's financing requirements and its IDA allocation. According to the Bank's operational p ~ l i c y 'DPO readinessi s basedon an assessment o f the country's policy and ~ , institutional framework-including the country's economic situation, governance, environmentalhatural resource management, and poverty and social aspects. The Bank also considers the strength o f the program and the country's commitment to and ownership o f the program against its track record. It assesses the country's institutional capacity and ability to implement effectively the program. However, whereas readiness considerations for DPOs can identify the risks associated with using the DPO instrument in a particular country setting, they do not necessarily suggest that other financing instrumentsare less risky or have a higher chance o f succeeding indelivering sustainable development outcomes. Ultimately, the share and volume o f DPOs in country programs therefore reflect not only considerations o f readiness to make productive use o f DPOs (the main subject of this paper), but also (a) considerations about the complementarity of instruments in pursuing the same development objective, and (b) the potential productivity o f alternative instruments in pursuing other development objectives. Where current circumstances do not suggest that IDA resources can be fully usedina productive 11 World Bank, Poverty Reduction Support Credits: A Stocktaking (IDAISecM2005-0238) OPCS, May 26,2005. l2 World Bank, From Adjustment Lending to Development Policy Lending: Update of WorldBank Policy (R2004- 0135), OPCS, July 15,2004. 13 OP/BP 8.60, Development Policy Lending, August 2004. - 4 - manner by any Bank instrument, the CAS can limit commitment volumes below the level o f the IDA allocation and indicate through performance triggers the circumstances under which the Bank would consider increasing financing volumes within the level o f the IDA allocations. Similarly, CAS performance indicators can be linkedto particular DPO readiness concerns and may allow for increasing DPO shares within a CAS period as an integral part of the Bank's strategy. 8. Corporate Oversight. To ensure broad corporate oversight, the Bank's processes require two corporate reviews o f CASs and one corporate review o f DPOs. These internal reviews-with a Bankwide distribution of documents-ensure input from all relevant Bank units for decisions on shares o f financing instruments and performance benchmarks in CASs, and on authorizing appraisal o f individual DPOs. CASs must be cleared by the responsible Managing Director (Operations) before they are distributed to the Board o f Executive Directors. It i s expected that results and recommendations o f the ongoing IDA control review will serve to further strengthen internalrisk controls for IDA. 9. DPO Share in Bank Commitments. The share of policy-based financing commitments by IBRD and IDA has fluctuated over time (see Figure 1). IBRD's policy-based lending share spiked as a result of crisis lending during FY02, whereas IDA's share fell sharply in FY04 during a rapid acceleration o f IDA financing for investment operations. During FY06, IBRD's share of policy-based lending was 34 percent, and IDA's share stood at 26 ~ercent.'~ The operational policy change in 2004 removed the prior 25 percent ceiling for the Bankwide share o f policy-based financing commitment^.'^ However, Management committed to report annually in a separate paper to the Board, at the same time as the Medium-Term Strategy and Finance paper and Credit Risk and Loan Provisioning paper, on the anticipated share for policy-based commitments on a three-year rolling average, giving Executive Directors an opportunity to approve a guideline for the share o f DPOs.I6 Management also monitors separately the anticipated share o f DPO commitments by IDA and would seek guidance fiom IDA Executive Directors if the projected share o f IDA DPO commitments exceeded 30 percent for any given year (excluding resources committed to countries reengaging with IDA for the purpose o f repaying bridge financing used to clear arrears). It i s currently not expected that IDA's DPO share will exceed 30 percent inFY07 or FY08. l4 IDA shares in Figure 1 include any resourcesto repay bridge financing for arrears clearances. l5 The limit in the policy had been exceeded in actual lending for several years, and thus was deemed not practical. See World Bank, From Adjustment Lending to Development Policy Lending: Update of WorldBank Policy (R2004-0135), OPCS, July 15,2004 for a detailed explanation. l6 FY05-07 Outlookfor the Bankwide Share of Development Policy Lending, First Annual Report (SecM2005- 128), March 17, 2005, and FY06-08 Outlookfor the Bankwide Share of Development Policy Lending, Annual Report (SecM2006-140), April 5,2006. - 5 - Figure 1. Share o fPolicy-BasedFinancing 70% 60% 50% 40% ' 40% 37% 3 0% 20% 10% 0% 2001 2002 2003 2004 2005 2006 Source: Staff calculations using data from SAP Business Warehouse. Excludes guarantees. 10. Selectivity of DPOs. Distributional analysis o f Country Policy and Institutional Assessment (CPIA) ratings and commitments for policy-based operations suggest that the Bank i s selective in its use o f policy-based financing (see Figure 2). A significantly larger share of policy-based commitments i s made to countries in the upper range o f the distribution o f CPIA ratings. Bankwide, less than 7 percent o f commitments for policy-based operations have been made to the bottom 32 percent o f the CPIA distribution duringFY98-06, and less than 17percent of commitments to the lowest 45 percent o f the CPIA distribution. Selectivity considerations are even more evident for IDA countries, where less than 14 percent o f IDA policy-based commitments during FY98-06 have been made to the bottom 40 percent of the CPIA distribution. At the same time, some fairly limited resources (9.6 percent of total policy-based IDA financing), including for cases to repay bridge financing used to clear arrears, have been committed to countries with a CPIA below 3.0, mostly to support countries emerging from conflict, experiencing rapid changes inpolicy environments or engaging in a new policy reform agenda. Figure 2. Selectivityin IDA Policy-BasedFinancing Against CPIA Ratings, FY98-06 - - - I C 5 100% .-E 90% 80% 70% 0 % 60% 85 50% 40% =>5 30% '3 m 20% 10% 0 0% 0% 20% 40% 60% 80% 100% I Cumulative Observationsof CPIA Source: Staff calculations. - 6 - 11. Structure ofthe Report. This report i s organized infive sections. Section I1outlines a set o f key considerations for development policy operations as a framework for assessing a country's readiness to make productive use o f DPOs. Section I11discusses operational aspects of these different considerations and different challenges in applying them, drawing on recent experiences and prior evaluations of adjustment operations. Section IV reviews challenges and examples in arriving at a summary judgment in determining the readiness for development policy operations in different types o f country circumstances. The last section sets out conclusions. 11. A READINESS FRAMEWORKDEVELOPMENT FOR POLICY OPERATIONS 12. The effectiveness o f any Bank financing instrument depends on the likelihood that the borrower" will implement activities as planned and that these activities will influence the outcomes as the borrower and the Bank anticipated at the outset." Within this broad context, this section outlines key considerations that affect the likelihood that DPOs will achieve their intended objectives, as a framework for assessing a borrower's readiness for making productive use of DPOs. 13. DPO Approach. DPOs rely on the strength of a government's program and on government program implementation to achieve program objectives. DPOs support the implementationo f policy and institutional actions as part o f an overall government program-in IDA countries set out in a Poverty Reduction Strategy Paper (PRSP)-with the ultimate objective o f sustainable reductions in poverty. By focusing on policy and institutional actions, DPOs can help address-in a sequential way-weaknesses in the country's systems that may hamper the achievement o f government objectives. At the same time, by providing financing for the government's budget, DPOs can assist governments with delivering their services or implementing policies insupport o f the programtargets. 14. Readiness Pillars. Because DPOs rely on the strength o fthe government's programs and policy implementation (including budget execution) for achieving the development objectives, the likelihood of their achieving their intendedresults, and the associated risks o f the instrument, are closely linkedto three areas: (a) the country's policy and institutional framework, including the effectiveness of the government in spending budgetary resources consistent with program objectives; (b) the country's ownership o f the program; and (c) the government's capacity to take program actions as planned and monitor program implementation. These three pillars are closely intertwined, but nonetheless represent separate reflections o f a country's strengths and weaknesses inimplementinga program (see Figure 3 for a schematic representation). Over many years, academic research, Bank retrospective studies, and the work o f the Bank's Independent Evaluation Group (IEG) have identified these three aspects as key factors in the success o f policy-based operations (Box 1offers an overview of some findings insome earlier studies). " The termborrowerhere is understoodto encompassrecipientsbothof IDA credits and o fIDA grants. " These and other dimensions are also reflected in the ratings of the Bank's Implementation Completion and Results(ICR)Reports. - 7 - Fivure 3. SchematicRepresentationof the ReadinessFramework Government Program Results ProgramPRS b Implementation b (Outputs& (InPUW Outcomes) L I Box 1. Analytic Findings on ReadinessConsiderations for Policy-Based Lending1986-1995 In 1986, the Bank's Operations Evaluation Department (now known as the Independent Evaluation Group) concluded that the "Bank needs to assess the commitment o f the important agencies concerned and, to the extent possible, assist countries to forge a consensus on the reforms that are to be undertaken." The study also advised that country capacity was frequently not properly assessed and was overtaxed by the complexity and the wide- ranging conditionality o f many o f the first structural adjustment loans (Structural Adjustment Lending: A First Review of Experience, Operations Evaluations Department, ReportNo. 6409, September9, 1986). In 1988, a review of adjustment lending noted three prerequisites for adjustment lending: (a) the Bank and the government should reach an understanding on the diagnosis o f the main impediments to growth and on the program, including short-term stabilization and longer-term development objectives; (b) the government must own the program, understand it, and hlly accept it; and (c) the program must be realistic inbeing restrictive enough to reflect available financing but not so restrictive as to prove socially and politically unacceptable (Adjustment Lending: An Evaluation of Ten Years of Experience, Policy and ResearchPaper Series No. 8022, December 1988). Progress reports in 1990 and 1992 stressed the important prerequisite o f macroeconomic stability and additional implementation issues regarding growth, poverty and distributional effects, and the importance of public sector spending allocations and public sector `reforms (Report on Adjustment Lending 11: Policies for the Recovery of Growth, (IDAfR90-49), March 1990; The Third Report on Adjustment Lending: Private and Public Resourcesfor Growth (IDA/R92-29), March 1992). A 1995 report by the Operations Evaluation Department stressed the importance of macroeconomic stability and ownership for program success. It highlighted that political stability, support o f various constituencies, and, to a lesser extent, official attitudes toward certain reforms were predictors o f ownership. The report suggested that important operational policy considerations were (a) the understanding o f a country's political system; (b) attention to track record; (c) focus on policy areas with consensus; and (d) explicit consideration of institution building. The report highlighted that programs with favorable initial conditions, such as strong institutions, perform better. It also suggested that adjustment lending may be inappropriate for countries recovering from war and natural disasters, and for those with drastic changes in political systems. Finally, it concluded that types and balance of lending instruments should depend on country conditions, and decisions on them should be taken in Country Assistance Strategies. (Structural and Sectoral Adjustment: World Bank Experience, 1980-92, Report No. 14691, Operations Evaluations Departments, June 1995). - 8 - 15. 2001 Adjustment Lending Retrospective. A comprehensive discussion of readiness considerations in the 2001 Adjustment Lending Retrospective gave the following main findings: Research findings of the late 1990s indicate a significant positive relationship between country policy and institutional characteristics and success rates of policy- based lending. Although lending itself may not initiate policy reform, it can help leverage the benefits o f policy improvement once a reform process is under way and reforms are accelerating. The Bank took such links into account to the extent that commitments for policy-based lending during FY95-00 were geared predominantly toward better performers as measured against the CPIA ratings. (This selective use o f policy-based lending was reconfirmed for the FY98-05 period in the 2006 Development Policy Lending Retrospective.20) Moreover, the 2000 Annual Review of Development Effectiveness found that all lending instruments-policy-based lending and investment lending alike-perform better inbetter policy environments, and that policy-based loans had consistently higher rates o f satisfactory outcomes even in weaker policy environments.21This finding, which has been reconfirmed for operations exiting during FY00-05," suggests that current choices o f lending instruments within country lending envelopes are consistent with maintaining high quality at exit, and, although facing greater risks, policy-based lending may work eveninweaker environments, as long as ownership o f a program and commitment to its implementationare strong. 0 Ownership and commitment are the most critical condition for ensuringthe success o f reforms supported by policy-basedlending. 0 It is essential to consider the government's capacity to carry out the reform program to be supported. Of particular importance are appropriate implementation arrangements, adaptation o f the design to country capacity, and realism o f policy actions and their timing and sequencing. 16. Recent Studies on Effectiveness of Budget Support. Recent studies indicate that assessingreadiness inthe three areas described above, with careful consideration o f the strengths and weaknesses o f programs, ownership, and capacity, combined with an approach to directly address weaknesses in government systems under the supported program, can make budget support an effective aid in~trument.~~ recent studies indicate that PRSP processes may help Two focus government spending on priority areas and affect budget processes and allocations, and that budget support, when combined with nonfinancial inputs, has proven effective in assisting 19 Adjustment Lending Retrospective (SecM2001-2 15), April 2,2001. 2o Development Policy LendingRetrospective (SecM2006-3 19), July 13,2006. 21 2000 Annual Review of Development Eflectiveness: From Strategy to Results, Independent Evaluation Group, Washington, D.C.: WorldBank, 2005. 22 Development Policy Lending Retrospective (SecM2006-319), July 13, 2006. 23 The term budget support inthis context is typically understood to characterize recurrent policy-based financing o f a government's general budget expenditure. - 9 - efforts to strengthen public financial management (PFM) systems and outcomes.24A recently concluded broad multiyear study on general budget support in seven countries notes that budget support can be an efficient, effective, and sustainable way o f supporting national PRSs, and that it can strengthen ownership, have positive effects on allocative and operational efficiency of public expenditures, and increase the general quality of aid.25It also finds that benefits are less conclusive ina country with a weaker policy environment and one with more volatile conditions for policymaking. This finding echoes the 2003 Annual Review o f Development Effectiveness on policy reform, which emphasized that the Bank was successful when linking its support with good or improving policy environments, but was less successful when it linked its support to policy reforms in countries with weak (or no) track records or with deteriorating policy environments. A. Policyand InstitutionalFramework 17. Research has confirmed that country policies and institutions affect the quality o f the program, program implementation, and the likelihood for DPO financing to have the intended results. The policy and institutional framework thus sets the stage for government efforts to change development outcomes as intended. Economic policies, the governance and PFM framework, the policy setting for managing any adverse effects o f policies, the risk management framework, and the institutions for monitoring and evaluating the program are part o f any consideration o fthe policy and institutional framework. 18. Economic Situation. A country's economic situation, in particular its macroeconomic policy framework and its need to finance its development program, affect its ability to achieve the objectives of any program supported by DPOs. Inappropriate macroeconomic policies-for example, policies leading to persistently high inflation and large fiscal deficits-make it much less likely that Bank financing will achieve the intended objectives. Similarly, programs with residual financial needs that cannot be met in a noninflationary way are not likely to achieve their objectives . 19. Governance. Governance in its different dimensions affects the likelihood that DPOs will have productive outcomes. The first and most direct governance area is the public sector, which plays a core role in the direct implementation o f the program. Foremost among public sector governance considerations for DPOs is the PFM system, which determines how resources are allocated, spent, and accounted for. Weaknesses in this area-from inefficient spending and procurement to outright fraud and corruption-directly increase the risks for achieving program objectives. Other areas o f public sector governance include the framework for managing the public administration, the relations between national and subnational governments, and more generally the country's legal andjudicial framework. The potential productivity o f DPOs would also be affected by the institutions and policies governing private sector activities, such as laws and regulations that can hamper the private sector response to incentives and thus reduce the 24 Rosa Alonso, Lindsay Judge, and Jeni Klugman, "PRSPs and Budgets: A Synthesis of Five Case Studies" and Tim Williamson, "General Budget Support and Public FinancialManagementReform: Emerging Lessonsfrom Tanzania and Uganda," in Budget Support as More Effective Aid? Recent Experiences and Emerging Lessons, StefanKoeberle, Zoran Stavreski, and Jan Walliser, Washington, D.C.: World Bank, April 2006. 25 Evaluation of General Budget Support: SynthesisReport, InternationalDevelopment Department, Universityof Birmingham, andAssociates, May 2006. - 10- likelihood that government interventions (such as expenditure on infrastructure or government services) will have the intendedeffect on growth, output, and incomes. 20. ManagingAdverse Program Effects. Adverse distributional effects or adverse effects on the environment and natural resources can reduce the likelihood of meeting development objectives. If growth-enhancing policies have adverse distributional implications, this may reduce their poverty-reducing impact. Similarly, a negative effect on natural resources could undermine the sustainability o f government policies aiming at growth and poverty reduction. 21. Monitoring and Evaluation. Institutional arrangements to monitor progress under the program and adjust implementation on the basis o f evidence are an essential element for successful program implementation. Without regular monitoring and evaluation, lessons of experience cannot be incorporated, and targets may be missedbecause necessary adjustments to the program have not beenidentified andmade. 22. Managing Risks. Government policy implementation is subject to a variety o f risks, including external shocks such as natural disasters, conflict, or fluctuations inexport prices. The institutions and policies in place typically affect how successfully a government can manage these risks and keepprogram objectives inreach even inface of adverse conditions. B. Ownership 23. Experience shows that ownership is a key ingredient for the success o f supported programs. Ownership i s a concept that denotes the likelihood that a government will implement a program as planned, even ifthere i s opposition. It also influences the likelihood that actions will not be underminedor reversedinthe future, and thus increasesthe chance that targeted outcomes will not only be achieved but also be sustained. Long-term experience also shows that conditionality cannot replace ownership and that reforms cannot be "bought.'yZ6 C. Capacity 24. Even where the policy and institutional framework is sound and government ownership strong, a program may not achieve its results ifthe government lacks capacity to design, execute, monitor, and evaluate the program. Government capacity influences the quality o f program implementation and i s a key element intranslating sound policies and institutions into activities and in successfully extracting lessons from experience. Program design, and the level and form o f external support, therefore must take into consideration any capacity constraints o f the government. 111. EVALUATINGREADINESS 25. In gauging a country's readiness for DPOs, Bank and country staff need to candidly assess each o f the different pillars to arrive at an overall judgment. This section reviews some dimensions along which these elements are typically evaluated and refers to recent experiences inmakingthese assessments. 26 Review of World Bank Conditionality (SecM2005-361), June 20, 2005, and Development Committee Communiquk, September 25,2005. - 11 - A. Assessing the Policy andInstitutionalFramework 26. Inassessing the key elements ofthe policy and institutional framework, the Bank draws on its own analysis and analysis by government and third parties. In joint budget support settings, assessments with other donors, such as joint fiduciary documents and the Public Expenditure and Financial Accountability (PEFA) program are increasingly common analytic underpinnings, allowing a commonview on key readiness aspects. 27. Macroeconomic P o k y Framework. Inthe DPO context, good practice suggests that the assessment should review the sustainability o f external and fiscal balances, and the contribution o f the supported reform program and Bank financing to sound macroeconomic policies and growth.'' Suchan assessmentby the Bank takes into account the Bank's own projections and the IMF's views but i s not necessarily tied to the existence of an IMF program. When the macroeconomic policy framework i s not appropriate (for example, there are policies that perpetuate a highly inflationary environment), DPO financing is unlikely to achieve its objectives and is therefore not appropriate." Recent experience suggests that the Bank routinely and systematically assesses macroeconomic policy frameworks inall its DPOs, drawing on debt sustainability projections under the debt sustainability framework with the IMF and systematically reporting on IMF views on macroeconomic policies.29Moreover, as part o f its assessment of the macroeconomic policy framework, the Bank ascertains that the program i s fully financed with the Bank's contribution, assuring the realism of the proposedprogram. 28. Budget Framework. The Bank regularly reviews countries' budgetary frameworks to ascertain that the overall resource allocations proposed inthe budget are consistent not only with sound macroeconomic policies but also are likely to support the government's poverty reduction objectives. In many IDA countries, therefore, as part o f the preparation o f DPOs the Bank discusses the contents of the government budget and medium-term expenditure framework as well as budget outturns. Moreover, in most countries with DPO involvement the Bank, with government and other donors, undertakes regular public expenditure reviews (PERs) to assess the efficiency of expenditureallocations. A decision for DPO financing would generally rely on congruence between the strategic objectives o f the program and the resources allocated for achieving these objectives. 29. Public Financial Management and Fiduciary Considerations. For DPOs the Bank and the borrower agree on a standard and limited set of items for which the resources may not be used (negative list), but otherwise Bank resources are normally made available for financing a country's budgetary expenditure. Hence, any assessment of fiduciary arrangements for DPOs and of the attendant risks of the borrower's capacity to receive and manage the resources must take a holistic view of a country's entire PFM system and en~ironment.~' highlighted inthe As 27 "Designing Development Policy Operations," in Good Practice Note for Development Policy Lending, Operations Policy and Country Services, World Bank, October 2004. 28 Adherence to a sound macroeconomic policy framework has been considered essential for achieving the results of policy-based lending since the inception o fthe adjustment lending instrument. 29 Development Policy Lending Retrospective (SecM2006-3 19), July 13,2006. 30 A similar vision applies to resourcesmade available under the multilateral debt relief initiative, which are also allocated through country's own budget management systems. Moreover, for subnational DPOs, the PFM environment ofthe subnational government must be considered. - 12- good practice note for financial management inDPOS,~'the Bank therefore reviews country PFM systems as part o f DPO preparation. This reviewdraws on (a) the analysis o f existing systems for budgetary and foreign exchange management; (b) an assessment o f the strength of the government's program to address identified PFM weaknesses and progress in implementing it; and (c) ajudgment on the government's commitment to implement any such program. A number of standard analytic tools-including the Country FinancialAccountability Assessment (CFAA) and the Country Procurement Assessment Report (CPAR)-are available for almost all IDA countries where DPOs are being considered and are the main sources o f country knowledge on PFM systems. The Bank i s now also moving to integrated assessments with other donors under the Public Expenditure and Financial Accountability (PEFA) program, which relies on a set of 28 indicators. As regards foreign exchange management, in most IDA countries the Bank can draw on the IMF's safeguard assessments of the central bank. The Bank does not use the level o f any single indicator or rating o f the PFM environment to come to a conclusion on the country's readinessbut instead weighs the risks of engagement against the potential benefits of addressing weaknesses directly under the program as long as credible progress i s made in a timely manner. Recent experience indicates that such an approach, which is similar to the approaches o f other development partners such as the European Commission, has resulted in (a) systematic evaluation o f PFM systems under Bank operations in IDA countries; (b) integration of reform programs for PFM systems invirtually all DPOs inIDA countries; and (c) reporting on program implementation in subsequent operations. The Development Policy Lending Retrospective suggests that the Bank can further strengthen this approach by (a) more systematically referring to the Bank's assessment o f the strength of PFM programs and their timely implementation; (b) better tracking of progress over time, including with PEFA indicators; and (c) ensuring a fuller discussion o f residual fiduciary 30. Broader Governance Considerations. The Bank regularly evaluates the broader governance environment for DPO implementation-such as public administration and civil service, the legal and judiciary framework, and the regulatory framework for private sector acti~ities~~-allo f which affect the potential impact o f DPO financing. An increasing number o f analytic tools and indicators are available for IDA countries on the private sector regulatory environment and incentives, such as investment climate assessments (ICA), Doing Business indicators. Drawing on these indicators, the Bank assesses the likelihood that the country will successfully implement the program and use financing productively to enhance growth and reduce poverty. Typically, weaknesses in this broader governance area would be covered under the policy dialogue, and time-boundactions to address weaknesses inthe governance framework would be reflected inthe program. 31. Managing Distributional Effects and Effects on Vulnerable Groups. Some government policies, although contributing to economic efficiency and growth, may at the same time harm certain groups o f the population and worsen income differences. As part o f assessing the country's readiness to make productive use of DPOs, it i s Bank policy to review the likelihood 3' "Financial Management Issues in Development Policy Lending," in Good Practice Note for Development Policy Lending, Operations Policy and Country Services, World Bank, October 2004. 32 Development Policy Lending Retrospective (SecM2006-3 19), July 13,2006. 33 For a broader discussion o f governance and anticorruption issues and the Bank's approach, see Strengthening the Bank Group Work inGovernance andAnticorruption (R2006-155), July 31,2006. - 1 3 - that policies supported under the program have distributional effects or affect vulnerable groups. Incase such effects are significant and likely, the Bank assesses the potential borrower's policy and institutional framework for reducing negative effects and enhancing positive effects under the program and identifies any knowledge gaps.34The readinessto make productive use ofDPOs would depend on the inclusion o f measures in the program to reduce any likely and significant negative distributional effects (and enhance positive effects), and to address analytic gaps in a timely manner. Most recent operations discuss distributional impacts and, where warranted, include a discussion o f how the program can address them. However, the quality and disclosure of analytic work could be significantly strengthened by more strategic upstream consideration, and analytic findings could still be better linkedto conclusions about the potential impact o f the program.35 32. Managing Environmental Aspects. Government policies may affect the environment, natural resources, and forests and may not be sustainable without additional policy actions. As part o f assessing the country's readiness to make productive use o f DPOs, the Bank reviews the likelihood that policies supported under the program will have significant environmental effects or will significantly affect forests and other natural resources. If such likely and significant effects are identified, the Bank assesses the potential borrower's policy and institutional framework for reducing negative effects and enhancing positive effects under the program and identifies any knowledge gaps.36The readiness to make productive use o f DPOs would depend on the inclusion o f measures in the program to reduce any likely and significant negative environmental effects (and enhance positive effects), and address analytic gaps in a timely manner. The Bank is reviewing operations systematically for any likely significant effects; however, better upstream integration o f analysis and progress in preparing country environmental analysis and, where applicable, strategic environmental assessments would improve the quality o f Bank assessment^.^' 33. Monitoring and Evaluation. The Bank assesses the adequacy of the borrower's monitoring and evaluation framework as part o f the preparation of DPOs; and as part o f supervision, Bank staff review progress in implementation and validate monitoring and evaluation findings, There is no minimum level o f quality for an institutional framework for monitoring and evaluation that the Bank uses to determine appropriateness o f DPOs. However, borrowers are expected to address weaknesses during program implementation so that they can fulfill their responsibility to monitor and evaluate the program. Although the Bank has made much progress in defining results frameworks for DPOs for Bank monitoring purposes, most DPOs could be used more strategically to address weaknesses in monitoring and evaluation systems. Moreover, a more systematic setting o f benchmarks for monitoringindicators is needed to renderthe frameworks fully ~perational.~' 34. Risk Management. In assessing readiness for the use o f DPOs, the Bank reviews the government's framework for managingand mitigating risksto program implementation. A weak 34 UsingPoverty and Social Impact Analysis to Support Development Policy Operations, October 2005. 35 Development Policy Lending Retrospective (SecM2006-3 19), July 13,2006. 36 EnvironmentalandNatural ResourceAspects of Development Policy Lending, October 2005, 37 Development Policy LendingRetrospective (SecM2006-3 19), July 13,2006. 38 Development Policy LendingRetrospective (SecM2006-3 19), July 13,2006. -14- government risk management fi-amework would likely exacerbate risks to DPO implementation and reduce the likelihood o f achieving targeted development objectives. Risk management considerations in the context o f DPO readiness include exposure to external shocks and such issues as whether rapid and unforeseen deteriorations in governance may expose a country with high aid dependency to large declines inresource flows if DPOs provide a significant share of recurrent budgetary spending. 39 B. Assessing Ownership 35. Although ownership has long been recognized as a key ingredient for the success of reform programs, inpractice the degree of ownership of a program i s not easy to assess. As the 2005 conditionality review recognized, careful review of the country's political economy and of stakeholders' concerns is requiredto identify the scope for a sustainable reform program.4oGiven the complexity of country situations, such an assessment goes beyond a notion of ownership that presupposes a uniform government position or a full consensus. Moreover, not all countries are functioning democracies, can successfully avoid elite capture, and respond to the interests of the majority of the population. A realistic assessment o f ownership relies on the government's track record of reform and a review of its participation in program formulation. It also acknowledges the political economy reality that reforms may be owned by some constituencies and opposed by others who stand to lose from them.4'All three dimensions-track record, participation, and political economy-can be explored, as needed, indeterminingreadiness to make productiveuse o f DPOs. Where analysis reveals insufficient ownership-including lack o f ownership in tackling key constraints under the program-the Bank would not engage inDPO and would not attempt to use conditionality to induce policy and institutional reforms that the country is not ready to undertake. External donor support, ifwell designed and targeted, can help strengthenthe analytic base o f policy making and support internal domestic processes to strengthen policymaking and consensus-building. 36. Track Record. The track record remains the most easily measurable proximate indicator o f ownership and commitment. Typically, past performance and the prior implementation record give a good indication o f the likelihood that a future program will For example, most IDA countries that receive recurrent DPO support from the Bank-frequently as a PRSC-have established a track record o f reform. Although the track record is a good predictor, it cannot identifycases of rapidperformance changes (e.g., emergenceo f a country from internal conflict), in which Bank engagement, including with DPOs, may add great value but possibly at higher than usual risk o f failure. In these cases the Bank will need to make an informed judgment on benefitsand risks, drawing on its knowledge of the country's historical and political background. 39 Such considerations would naturally take into accountthe flows already committed under the Multilateral Debt ReliefInitiative, which couldcover recurrentbudgetarycosts without any uncertainty. 40 Review of WorldBank Conditionality (SecM2005-361), June 20,2005. 4' For a discussion of conceptual frameworks for assessing ownership, see Adjustment Lending Retrospective, (SecM2001-215), April 2001, p. 73; see also J. Johnson and S. Wasty, Borrower Ownership o f Adjustment Programs and the Political Economy of Reform, World Bank DiscussionPaper No. 199, Washington D.C., World Bank, 1986; and World Bank, An Operational Approach to Assessing Country Ownership of Poverty ReductionStrategies, February2005. 42 Adjustment LendingRetrospective (SecM2OO1-215), April 2,2001. - 1 5 - 37. Participation. Broader country ownership of a program beyond the government can be gauged at least inpart through an assessment of the participatory and consultative processes that underpingovernment processes indesigning the program. Involvement of stakeholders and civil society inpreparing, implementing, and monitoring government programs can help broaden the acceptance of reform measures and also help identify possible adverse affects. As part o f any DPO preparation, the World Bank advises countries to consult with and engage the participation o f key stakeholders in designingthe program. The Bank also reviews the participatory processes a government may have used to design its program, and uses this information in any consideration of broader program ownership. (In addition, the Bank discloses its own analytic work to allow itto feed into any participatory processes or consultations.) 38. Political Economy Analysis. Political economy analysis, which can give additional insights into the likelihood o f a program's success, could be employed at both the CAS level and the level of the individual operation. Political economy analysis can also inform a realistic sequencing o f reforms, give indications for an appropriate mix o f instruments, and help provide the necessary space for country processes to be fully The Bank conducts some political economy analysis as part o f poverty and social impact analysis for certain reforms and, at times, inpreparing for CASs. C. Assessing Capacity 39. Capacity levels affect the government's ability to apply policies and use institutions in line with government objectives. Weak capacity can hamper the effectiveness o f programs supported by DPOs at program design, implementation, and monitoring. Capacity constraints are often assessed concurrently with policy and institutional frameworks. Usually, analytic work by the Bank, government, or third parties simultaneously identifies weaknesses in policy and institutions and shortfalls in capacity, and makes suggestions for capacity reinforcement. In assessing a country's readiness to make productive use o f DPOs, this information cannot only be usedto determine the likelihoodof success but typically also plays a central role inthe design o f any operation and would trigger additional financial and technical support to address capacity bottlenecks. 40. Capacity to Design Programs. Capacity to translate a country's objectives into concrete and time-bound actions i s a key element o f operationalizing country PRSs and policy priorities. Weak capacity in this area frequently hinders the Bank from drawing directly on country documents to design Bank-financed operations. Although external assistance for program design can help overcome weaknesses, it also risks undermining the government's ownership. For the Bank, operationalizing the PRS has meant that DPOs inIDA countries include increasingly large policy matrices that set out the broader government program; these matrices have been criticized as overly intrusive and complex.44Therefore, addressing weak capacity during the design phase 43 Shantayanan Devarajan, David Dollar, and Torgny Homgren, Aid and Reform in Africa, Lessonsfrorn Ten Case Studies, World Bank, 2001 discusses the stages of reform processesbasedon different country cases and argues that the donor community used aid instrumentstoo indiscriminately indifferent reform stages inthe past. It also underscores the relation between crisis and reforms, and the importance o f institutions in political economy analysis. The volume notesthat conditionality cannot entice reforms governments are not willing to undertake. 44 Review of WorldBank Conditionality (SecM2005-361), June 20,2005. - 16- through external support requires a considerable degree o f sensitivity that allows government and internalcountry processes to play the predominant role. 41. Capacity tu Implement Programs. Capacity to implement DPOs centrally relies on the strength o f the civil service and, inparticular, the government's financial management capacity inexecuting and controlling the budget. The Bank's assessmentalso places particular emphasis on the government's capacity to address potentially adverse distributional effects or effects on the environment, as both reflect important aspects of readiness. Capacity gaps in these areas, which would be normally identifiedinthe Bank's analytic underpinnings, are addressedthrough program design, including through targeted technical assistance. The supported program would usually serve as a platform for consideration o f broader capacity-building support with other financial partners. 42. Capacity to Monitor and Evaluate Programs. The Bank assesses the capacity to collect and process the information required to monitor and evaluate the program. This assessment is generally part o f the Bank's validation o f the country's monitoring and evaluation findings inthe context of progress reviews. As the recent Development Policy Lending Retrospective noted, Bank operations should more fully incorporate capacity weaknesses into the supported program and more directly address weaknesses instatistical, data collection, and evaluationca~acity.~' IV. SUMMARY READINESSASSESSMENTS 43. Assessing a country's readiness to make productive use o f DPOs requires an overall consideration o f the policy and institutional framework, ownership, and capacity. Such an integrated judgment-with the appropriate weighing of strengths or weaknesses under each of the pillars-would contribute to assessing the risk o f engaging with DPOs under the particular country circumstances, Inultimately deciding on the use of DPOs, these risks would need to be weighed against the strength of the program, potential benefits of engagement, and availability of alternative instruments to achieve the country's development objectives. This section offers an overview o f considerations in developing an overall judgment and discusses a variety o f typical cases and examples to illustrate experiences inmakingthese assessmentsinDPOs. A. GeneralConsiderations 44. Within the Bank's operational architecture, reviews of countries' readiness to make productiveuse of DPOs take place on two levels-the level of the CAS and that o f the individual operation. Generally the CAS is the appropriate level at which to make the strategic decisions on how best to use available IDA resources, taking into account the different elements o f the readiness framework. The readiness considerations feed into the CAS determination o f whether a DPO may deliver the results a CAS i s targeting, which risks are associated with using DPOs to deliver these results, and whether alternative instruments may be more efficient to support the same or other development objectives. DPOs would typically be well-suitedto help strengthen a country's systems (including public financial management), provide general support to development programs, and signal reform willingness. Investment operations typically support specific sectoral or subsectoral activities, particularly when close collaboration on implementation i s essential for success. Considering readiness for DPOs at the CAS level may 4s Development Policy Lending Retrospective (SecM2006-3 19), July 13,2006. - 17- also give valuable information for deciding on financing o f economic and sector work (ESW) under the CAS to support any emerging policy agenda or fill analytic gaps. Further readiness assessments have to take place at the level of individual operations, inparticular in areas where considerations at the CAS level necessarily have to remain incomplete or are too generic to judge the potential benefits o f the supported program against the weaknesses identified, and because readinessmay become more apparent once the proposed program contents are clear. 45. Weighingand Balancing Readiness Considerations. Differentelements o fthe readiness framework would need to be weighed against each other to judge the likelihood that a country could use DPOs productively. For example, a country with weaker capacity and weaker institutions but strong commitment may be more likely to implement a program successfully than one with stronger institutions but much weaker commitment. Thus, there i s no minimum level o f any one element o f the framework-except the need for appropriate macroeconomic policies-that would render DPOs unproductive. Instead, the likelihood for making productive use o f DPOs would vary depending on the totality of elements of the readiness framework, after a carefulbalancing of strengths and weaknesses. 46. Assessing Readiness Aspects against the Strength of the Program. An important element in considering readiness i s whether the program itself may enhance the likelihood o f success. For example, a program may address weaknesses in the policy and institutional framework and capacity (e.g., fiduciary and governance concerns) and thus already incorporate elements that enhance the likelihood o f success. The program may also receive additional, and complementary, support from other donors, which may help support readiness by offering additional confidence that program design and implementation capacity bottlenecks are being addressed. In other cases, the program may not be able to address weaknesses right away, but may carry large benefits. In these cases, the productive use o f DPOs may be less likely at the outset, but a successful DPO could address important shortcomings and bring important benefits that would otherwise be out o f reach. Those instances may be particularly relevant in post- conflict situations and rapidly shifting policy environments. The overall assessment o f risks and benefits of any DPO engagement resulting from weighing readiness concerns and program strength would also inform strategic decisions on the financial volume of any possible DPO engagement. B. AssessingReadinessin DifferentCountry Circumstances 47. The Bank has usedDPOs ina variety o f country settings, respondingto different country circumstances, and giving different weights to different readiness criteria. The CAS provides the overall rationale for the use o f DPOs and sets out their share inthe lendingprogram, taking into account an assessment o f readiness criteria and a broad weighing o f the benefits and risks of the instrument against those o f other available instruments. In addition, the individual operation is tailored to the strategic context through design options such as tranching (single or multiple tranches) and the possible choice o f a longer-term programmatic engagement through a series o f single-tranche operations. The Bank has also used sectoral DPOs and DPO options, such as subnational lending and supplemental financing, in IDA countries. Below, a number o f such engagements are characterized and discussed against readiness criteria. 48. Better-Performing Countries with Recurrent Support. Since 2001, the Bank has supported several better-performing IDA countries on a regular and recurrent basis through - 1 8 - PRSCs. PRSCs, typically annual single-tranche operations spanning several key areas o f the PRS, are intended to offer predictable support over the medium term provided that the government implements its program in a satisfactory manner over time (see Box 2).46PRSCs also frequently take up a substantial part of the IDA envelope. They allow addressing policy and institutional reforms in a medium-term setting and offer scope for scaling up financing o f essential services through predictable resource transfers. They frequently incorporate Bank support for the social sectors, at times replacinginvestmentoperations inthese areas. PRSCs also typically support wide-ranging reforms in the area o f public administration and public financial management. Readiness considerations for DPOs on the policy and institutional side in these cases build on (a) a poverty reduction strategy formulated by government; (b) a track record o f sound macroeconomic management; (c) established budget planning processes that allow translating programs into activities-often twinned with additional activities planned under the program to further improve medium-termplanning, monitoring, and evaluation; (d) solid public financial management systems, with a strong program for further upgrading; and, frequently, (e) established sector programs, especially inhealth and education. Not surprisingly, most countries with such characteristics also tend to have above-average CPIA ratings.47In addition, in most cases ownership assessments build on a track record o f policy implementation that established a degree o f mutual trust inthe policy dialogue between the government and the donor community. These countries also tend to have core capacity to conceive, execute, and evaluate the government program, in the context o f both sector program reviews and annual reviews o f the PRS. Overall, for medium-termrepeated engagements, the readiness assessment therefore gives fairly equal weights to the strength o f the policy and institutional environment (including the level o f fiduciary controls), ownership, and capacity. There is broad agreement on policy priorities; and addressing remaining weaknesses in policies and institutions and in capacity i s high on the government's agenda and integral part of the supported program. Thus, in these environments the risk that DPO resources would not be used productively i s generally low, and DPOs over time may take a rising share of the IDA envelope in these countries as domestic systems improve. Indeed, in the relatively few cases when PRSC series were interrupted, the interruption generally resulted from political instability that interfered with program implementation. 49. Sectoral and Subnational DPOs. In some cases, country circumstances may call for support o f sectoral or subnational reform processes rather than multisectoral or nationwide policies and reforms. In such cases, the Bank also has fiequently engaged in series o f single- tranche operations under a programmatic series (see Box 3). Readiness considerations for sectoral operations rely on the policy and institutional framework for the country as a whole (rather than for the sector only), since DPO resources flow to the general budget. However, the assessment o f commitment and ownership o f the reform program, and capacity to implement it, may be more narrowly focused on the sectoral aspects o f the reform program rather on the broad countrywide situation. In a subnational setting, typically the policy and institutional framework o f the subnational government, as well as its reform ownership and capacity, would be most relevant. National issues may be confinedto macroeconomic stability and the review o f financial relations between the national and subnational government. Typically, both sectoral and subnational operations rely on a selective engagement inbetter policy environments with strong 46 For hrther information, see Poverty Reduction Support Credits: A Stocktaking, April 29,2005. 47 The Africa Regionalstrategyexplicitlyreservesthe use o fPRSCs for better performers. - 19- government commitment and good core capacity, giving strong weight to all three readiness pillars for what is frequently a longer-term engagement. The risks for medium-term DPO engagement tend to be low. The choice for subnational and sectoral engagements i s normally driven by country and portfolio size rather than intrinsic differences in the composition of readiness aspects. Box 2. SupportingPRS Implementationin BurkinaFaso Burkina Faso has beenthe recipient of six annual PRSCs and grants since 2001. (IEG rated the first series of three operations as well as the fourth PRSC as having satisfactory outcomes.) Burkina Faso had already upgraded some of its systems and established a track record by 2001, supporting a decision for longer-term engagement. What particularly distinguished the country as a candidate for PRSCs was the combination o f determined leadership by government, commitment to a reform process driven by the PRSP, and the trust established with donors as a result of sustained policy implementation. These qualities allowed advancing step-by-step with further reforms under the PRSC-supported program, addressingremaining weaknesses and challenges. During 2001-06, PRSCs have accompanied core reforms in public financial management and in social and productive sectors. Two programmatic series o f three operations each have seen solid economic growth rates of about 6 percent, a successful opening and restructuring o f the cotton sector attracting important levels o f foreign investment, and first steps in reorganizing the electricity sector. A solid framework for managing and accounting for government resources-including the regular and timely production of accounts and budget execution laws, as well as creation o f a supreme audit institution-was put in place. In the social sectors, PRSC financing helped overcome disbursement delays inbasic education projects to increase coverage, supporting a 14.5 percentage point increase (to over 60 percent) in gross primary enrollment during 2001-05. Vaccination campaigns helped raise diphtheria and tetanus vaccination rates from 64 percent to 96 percent over the same period. LO. Post-Conflict Countries and Rapid Policy Shift. Incases o f political transitions-rapid shifts in policy stance-the Bank may be well placed to provide quick support to help stabilize the situation and support emerging reform processes (see Box 4). Insuch cases, governments- especially those emerging from a post-conflict situation with significant destruction o f physical and human capital-often must meet highexpectations of their populaces. Fast-disbursing DPO resources in situations o f weak domestic revenue can help stabilize the macroeconomy and quickly reestablish some, even if rudimentary, state function (for example, by beginningto make salary payments on time and clear anears), and thus can support rebuildingtrust in government institutions. DPOs also carry the internal benefit o f focusing programs on institutions and capacity building and enhancing the integrative feature o f interventions. Experience shows that transitions are often fragile, and thus DPOs in these environments face multiple risks from possible collapse o f a transition; insufficient information on social, economic, and political conditions; and weak fiduciary environments. Transitions take time, and stabilization can rarely be achieved with a "one-off' engagement, so waning donor enthusiasm after four to five years of a transition is one o f the dangers for sustaining progress. Thus, often a programmatic series of single-tranche operations can help balance the need for ensuring sufficient progress with some flexibility inadapting triggers to newly emergingpriorities in a fluctuating environment as long as the program stays broadly on In other circumstances, a single-tranche stand-alone operation may be appropriate to support early steps in a reform program, especially if the transition agenda is still emerging and the program i s not yet fleshed out. Readiness considerations inthese environments have to recognize weaknesses inthe policy and institutional framework-including serious weaknesses inpublic financial management and ability to manage 48 Development Policy Operations and Program Conditionality in Fragile States: Good Practice Note in Development Policy Lending, Operations Policy and Country Services, World Bank, June 2005. - 20 - potential adverse program effects and risks-and severe capacity constraints. Thus, an ultimately favorable bottom-line assessment for the use o f DPOs would need to rely on the government's commitment and ownership in combination with the strength o f the program to address weaknesses inthe institutional environment and capacity gaps. The risks for a productive use o f DPOs and failure o f the reformprocess, which inmost cases are high, would needto be weighed against the anticipated benefits o f the reform program, be acknowledged frankly, and taken into consideration inthe volume of support. Box 3. Support for Institution-Buildingin Afghanistan The Bank has supported Afghanistan's recovery with two policy-based operations since 2004 as part of a programmatic series of three operations. (IEG evaluated the first operation in the series as having satisfactory outcomes, with a filler evaluation to take place once the series has concluded.) Bank support was part of a multidonoreffortrelyingon a coordinatedpolicy matrix.The Bank's operations focusedon restoringkey functions of the state, raisingfiduciary standards, enhancinghumandevelopment, and strengthening the general environment for private sector activity. The programmatic structure was chosen (over single- or multiple-tranchedesigns) to support a medium-term process of institutionbuildingwhile retainingflexibility to adjust the programto emerging priorities. Giventhe relatively high risks o f engagement,the size of the financial envelope allocated to DPOs in Afghanistan remained limited, with a substantially larger share of the IDA commitments going to investment operations. The Bank's assessment o f the country's readiness to use DPOs productively rested largely on the government's ownership and commitment as laid out in a multidonor program, the important benefits from increasing government discretionary resources in a low-revenue environment, and the assessment that small advances inreestablishinga functioningstate would yield benefitsthat outweighedthe considerablerisks. 5 1. GradualImprovers. Insome circumstances, an opportunity arises to support a relatively narrow reform agenda that does not yet benefit from a vast change in the surrounding policy environment. In these cases, the Bank may consider one-off DPO support through a single- or multiple-tranche operation-if the reform process i s a relatively closed set of activities-or a series o f programmatic operations with limited financial volume and a clear understanding that support i s based on sustained improvements in performance (see Box 5). Typically, in these cases, there are still considerable weaknesses inthe country policy and institutional framework, capacity gaps remain, and ownership may not be universal. However, in contrast to countries with deteriorating governance or countries in crisis and conflict, "gradual improvers" can offer opportunities for engagement inpolicy areas where a consensus i s emerging. Drawing frequently on a longstanding policy dialogue, these emerging reform areas-for example on key public sector governance aspects-may offer a window o f opportunity for building momentum and establishing a track record that could eventually lead to larger volumes o f commitments (for example, by tackling policy and institutional weaknesses constraining IDA'Sperformance-based resource envelope). The readiness assessment would usually identify important weaknesses under all three pillars, reflectingthat risksof failure and reversal are particularly high, and would need to be counterbalanced by an assessment of the benefits as well as a careful scaling of the size o f DPO engagements inthe country program. -21 - Box 4. Focusingon Select PolicyAreas in Tajikistan I Tajikistan's economic managementand policy reformefforts slowed and policy implementation was uneven inthe middle to late 1990s inthe wake of a civil conflict. Two policy-based operations were approved in 1999 and 2001 after the end of the civil conflict and reestablishment of macroeconomic stability. However, progress under the second structural adjustment credit, a multitrancheoperation, was slow, and disbursement of the second tranche was delayed. (IEG ratedthe secondoperationas havingmarginallysatisfactoryoutcomes.) The PRS framework in Tajikistan also remained fairly weak, in terms o f both content and the underlying processes. In these circumstances, the Bank committed no further policy-based financing during 2002-2005. In 2006, a first programmatic development policy grant was approved as part o f a new programmatic series that focuses more narrowly onkey governance-relatedreformmeasures inprivate sector, productive areas, public administration, and service delivery. The re-engagementwith policy-based operations builds on emerging government consensus for reform in these areas, which could lead to an improved track record and CPIA over time. Recognizing the importantremaining weaknesses inpolicy and institutions,and the need for establishmento f apolicy track record, the engagementwith DPOsinthe current CAS remains limitedto $20 million(out of$120million). 52. Crisis and External Shocks. Fast-disbursing operations offer the possibility o f supporting countries that are incrisis or sufferingfrom external shocks (e.g, oil price increases). In these cases, the benefits of quick stabilization and relief may call for expanding the use of DPOs, even if readiness criteria may otherwise suggest a lower level o f financial engagement with DPOs(see Box 6). As aresult, changing external circumstances may require a reassessment of the appropriate volumes o f DPO support for any given set of policy and institutions and capacity, provided the government displays sufficient ownership and commitment to use the additional resources in a way that contravenes the crisis and shock and delivers the intended benefits (Le., maintenance o f a sound macroeconomic policy framework and deployment o f resources to alleviate the impact o f shocks). In these cases the readiness criteria that receive strong attention for medium-term DPO engagements-such as the institutional environment for public financial management-could be outweighedby the immediate benefits of stabilization. Box 5. Respondingto the Earthquakein Pakistan I The Bank may provide supplemental financingto a program under implementation ifthe program continues to be implemented as agreed and the borrower cannot obtain additional financing from other sources in time or at reasonable costs. Supplemental financing offers, for countries that are already implementing a DPO-supported program, the possibility o f obtaining fast access to additional resources in case of shocks. A powerfbl and destructive earthquake hit Pakistan on October 8, 2005. The national government and its North-West Frontier province were implementing programs supported by fast-disbursing financing from the Bank. As part o f the Bank's response package, two supplemental financing proposals were prepared for a total of $200 million and approved on an accelerated basis by the Boardon October 25, 2005, supportingthe government in addressingthe most immediate needs after the earthquake. These engagements increased the DPO share beyond the originally planned levels based on the judgment that they could support quick economic recovery most efficiently compared to other forms of Bank engagementandthus warranted increasingthe share offast-disbursingresources. 53. Deteriorating Governance and Conflict. Where weaknesses in country policy and institutions and capacity are not counterbalanced by commitment and ownership o f a sufficiently strong policy reform agenda, DPOs are not likely to be productive. Deteriorating governance situations or outright political crisis and conflict are therefore generally not conducive to using - 22 - DPOs effectively in support o f development goals, and DPOs would typically be inappropriate unless a significant shift inpolicy and/or strong commitment to policy reforms occurs.49 C. Implicationsof ReadinessConsiderationsfor IDA's DPO Share 54. The broadframework set out above, and the discussion o f its application, suggest that the evaluation o f readiness can result in different levels of DPO support, depending on an overall judgment that weighs country policy and institutions and capacity against commitment and ownership and the inherent strength o f the supported program. Many elements o f the readiness framework rely on country knowledge and do not lend themselves to the establishment o f a summary numerical indicator that could be linked to an "appropriate" share o f DPOs. For example, some weaknesses related to country institutions and policies inmaking effective use o f DPOs may carry over to weak outcomes for investment operations, and summary numerical indicators such as CPIA scores may therefore not carry enough information on the relative effectiveness of DPO and investment financing instruments. Ownership, a concept not readily accessible to numeric scoring, may be more important than any weaknesses in country institutions in assessing the likelihood of success of policy-based support. In addition, the program itself may tackle the weaknesses identified in the readiness framework, and thus, in spite of higher risk, may be worth supporting, if there i s sufficient ownership. Finally, external factors such as commodity price shocks and natural disasters may shift the appropriate level of DPO support for any given level o f readiness. Taken together, these factors suggest that the appropriate share o f DPOs will remain tied to a qualitative assessment, within a framework of strong corporate oversight. Past experience suggests that within such a framework, IDA's DPO commitments have been predominantly geared toward better performers, with selective engagements inweaker environments. V. CONCLUSIONS 55. This report which is based on 20 years of experience with policy-based lending, lays out a broad framework for assessing a country's readiness to make productive use o f DPOs. It suggests that such an assessment rests on a careful review o f (a) the country's institutional and policy framework; (b) ownership; and (c) capacity. 56. Implementation ofthe Framework. The Bank has the capacity and tools to review different elements of the readiness framework during preparation of CASs and DPOs using widely available analytic work for IDA countries. As was recently emphasized in the Development Policy Lending Retrospective, the Bank's use o f DPOs has been selective, and the overall policy framework i s robust, although some elements o f the framework-notably the tracking of progress inpublic financial management and the upstream use o f poverty and social impact analysis-may require additional strengthening during implementation. The framework will continue'to rely on strong corporate oversight, including mandatory corporate review for DPO and CASs, senior management clearance of CASs, and Board discussion o f CASs and DPOs, except follow-on operations ina programmatic series. 57. Monitoring the Aggregate Share of DPOs. The share o f DPOs resulting from these readiness considerations will vary with country circumstances, and will respond to shocks and 49 See StrengtheningBank Group Work in Governance and Anticorruption (R2006-0155), July 28,2006. - 23 - fluctuating economic conditions. In setting a country's DPO share, the CAS would buildon the readiness criteria and the strength o f the program, and would take into consideration the country's financing requirements given the actions necessary to achieve the expected results o f the program. As a result, general readiness criteria cannot be mapped to any single appropriate share of DPOs for IDA. However, within the framework outlined above, it i s not expected that the overall DPO share will deviate drastically from past experience, and evidence presented in this paper suggeststhat DPOsinthe past has beenselectively directed toward better performers. Moreover, as part o f the annual monitoring o f DPO commitments, Management will continue to inform the Board o f Executive Directors at the time o f the annual review o f the Medium Term Strategy and Finance paper o f the past DPO share for IBRD and IDA and the outlook for future years basedon a three-year rolling average. Ifthe projected share" o f DPO commitments by IDA exceeds 30 percent for any future year, Management will seek additional guidance from IDA ExecutiveDirectors. 58. Monitoring Effectiveness of DPOs. The effectiveness o f DPOs will continue to be subject to regular monitoring, drawing on the Bank's work and independent or external evaluations o f budget support instruments. A new DPO retrospective, planned for FY09, will provide a second progress report on implementation o f the new DPO policy adopted in August 2004. With growing experience with implementation o f DPOs, subsequent retrospectives would be expected to give additional information on the effectiveness o f the instrument in different circumstances to foster policy reform, strengthen governance and institutions, and support progress toward the MillenniumDevelopmentGoals. 50 Excludingresources committed to countries reengaging with IDA after a prolongedperiod of inactivity and usedby recipients for the purpose ofrepayingbridge financingusedto clear arrears.