Document of The World Bank Report No: ICR00001528 IMPLEMENTATION COMPLETION AND RESULTS REPORT (IDA-H0200 TF-26885 TF-92755) ONA GRANT IN THE AMOUNT OF SDR 15.8 MILLION (US$ 20.0 MILLION EQUIVALENT) TO THE REPUBLIC OF SIERRA LEONE FORA REHABILITATION OF BASIC EDUCATION PROJECT June 22,2010 Human Development II Country Department 10 Africa Region Office CURRENCY EQUIVALENTS (Exchange Rate Effective 06/1/2010) Currency Unit = Leone ·1,000 = US$0.25 US$ 1.00 = Le 3,925.00 FISCAL YEAR January 1 - December 31 ABBREVIATIONS AND ACRONYMS AfDB African Development Bank BECE Basic Education Certificate Examination BOG Board of Governors BOL Basic Operational Level CBC Capacity Building Coordinator CAS Country Assistance Strategy CBO Community Based Organization CREPS Complementary Rapid Education for Primary Schools CSR Country Status Report CWU Civil Works Unit DEO District Education Office DUD Department for International Development (UK) DGA Development Grant Agreement EFA Education for All EMIS Education Management Information System EQP End of Project EPDF Education Program Development Fund ESSF Education Sector Support Fund FMR Financial Monitoring Report GER Gross Enrolment Rate GGER Girls Gross Enrollment Rate GoSL Government of Sierra Leone mRD International Bank for Reconstruction and Development ICR Implementation Completion and Results IDA International Development Association IDP Internally Displaced Person ISR Implementation Status and Results I-PRSP Interim-Poverty Reduction Strategy Paper JSS Junior Secondary School MDG Millennium Development Goal MEST Ministry of Education, Science, and Technology MEYS Ministry of Education, Youth and Sports M&E Monitoring and Evaluation MOFD Ministry of Finance and Development MOU Memorandum of Understanding MTR Midterm Review NACSA National Commission for Social Action i NEC National Education Committee NGO Non-governmental Organization NPSE National Primary School Examination NPV Net Present Value PAD Project Appraisal Document PCU Project Coordination Unit PDO Project Development Objective PHRD Policy and Human Resource Development PPF Project Preparation Facility PRSP Poverty Reduction Strategy Paper PSC Project Steering Committee QAG Quality Assurance Group QSA Quality at Supervision Assessment REBEP Rehabilitation of Basic Education Project SIL Sector Investment Loan SA Supervising Agent SABABU Local name for the project meaning "opportunity" in Creo SDR Special Drawing Rights SMC School Management Committee SP Service Provider SSS Senior Secondary School TF Trust Fund TLM Teaching and Learning Materials TSS Transitional Support Strategy UNFPA United Nations Fund for Population Activities UNHCR United Nations High Commission for Refugees UNDP United Nations Development Program UNICEF United Nations Children's Emergency Fund UU Untrained and unqualified WMA Works Management Agents Definitions Basic Operational Level (BOL) is achieved in schools which have a physical structure safe for children and teachers, which are supplied with basic furniture, a set of core textbooks for each pupil, teaching and learning materials, where at least 50% of teachers are trained! and where there is an adequate teacher to student ratio (e.g. one teacher per 40 students), a school management committee (SMC) for primary schools and a Board of Governors (BOG) for junior secondary schools (JSS). Full Grants cover all of the Basic Operational Level (BOL) requirements defined above. Partial Grants exclude infrastructure (construction, rehabilitation and furniture costs). Primary completion rati (proxy: gross intake rate to last grade of primary) is defined as the total number of pupils in the last primary grade, minus the number of repeaters, divided by the total number of children of official entrance age to the last primary grade in the population. 1 Core textbooks include Mathematics, English, Science and Social Studies 2 Millenium Development Goal defmition 11 Vice President: Obiageli Katryn Ezekwesili Country Director: Ishac Diwan Sector Manager: Christopher Thomas Project Team Leader: Eunice Dapaah ICR Team Leader: Eunice Dapaah k~_=_~_~~~_~ __ "" ICR Primary Author(s): Sati Achath, Donald Hamilton, Eunice Dapaah ~~~~~_ 111 SIERRA LEONE Rehabilitation of Basic Education Project CONTENTS Data Sheet A. Basic In±ormation B. Key Dates C. Ratings Summary D. Sector and Theme Codes E. Bank Staff F. Results Framework Analysis G. Ratings of Project Perfonnance in ISRs H. Restructuring I. Disbursement Graph B. Key Dates ................................................................................................................... v C. Ratings Summary ....................................................................................................... v D. Sector and Theme Codes .......................................................................................... vi E. Bank Staff.................................................................................................................. vi F. Results Framework Analysis .................................................................................... vii G. Ratings of Project Performance in ISRs ................................................................. xiv 1. Disbursement Profile ............................................................................................... xiv 1. Project Context, Development Objectives and Design ............................................ 1 2. Key Factors Affecting Implementation and Outcomes ......................................... 11 3. Assessment of Outcomes ....................................................................................... 22 4. Assessment of Risk to Development Outcome ...................................................... 32 5. Assessment of Bank and Borrower Performance .................................................. 33 6. Lessons Leamed..................................................................................................... 35 7. Comments on Issues Raised by Borrower/Implementing AgencieslPartners ........ 36 Annex 1. Project Costs and Financing .................................................................... 37 Annex 2. Outputs and Components ........................................................................ 38 Annex 3. Economic and Financial Analysis ........................................................... 40 Annex 4. Bank Lending and Implementation Support/Supervision Processes ....... 50 Annex 5. Beneficiary Survey Results ..................................................................... 51 Annex 6. Stakeholder Workshop Report and Results ............................................. 52 Annex 7. Summary of Borrower's ICR and/or Comments on Draft ICR .............. 78 Annex 8 MAP of Sierra Leone ................................................................................ 106 IV N/A 11/20/2005 Outcome: rmance: overnment: plementing ~.--.- ............-........................- ........---... __ . . g~~~~(~s.~~~.i_e. s._..:............................ ; ..................... verall Borrower v and Implementation Performance Indicators _ _~_ _~~ Satisfactory roblem Project at any Satisfactory ime (YeslNo): o rating before losinglInactive status: administration 20 40 education 40 ~~~~,:"~rimary/Secon~~!IL~....~ __"_."." '-~""~~"'~~--~'-"'~--'--'.+"'~-"'-'~""''''''-'''-~-'''i o~!!i~!.p~~~.~~~on and post-con~.~,E~~~E~!~~!!~!1:~.._ ~~~~~_5.~0.~,___+~.__._~._..... ~_."._~ ... ducation for all 50 ICR Primary Author: VI F. Results Framework Analysis Project Development Objectives The objective of the project was to assist the Government of Sierra Leone (GOSL), to re-establish education services, and prepare the grounds for building up the sector. Specifically the project would: (i) assist participating schools to achieve basic operational levels (BOL), and (Ii) build up the capacity of Ministry of Education, Youth and Sports (MEYS) to plan and manage the delivery of education services. Revised Project Development Objectives The project development objective was not revised. (a) PDO Indicator(s) Value :quantitative or 12% iqualitative) Date achieved 0113112003 " """""""""",,"" ,,~"""'''''' ""'~,~""""""''''''',',_''''_'''~''''''''''''''''''''''''''''' " " j " " " " " ' , " , ' , ' " " ' " ,,,,,,,,,,c " " " " " " , """"'" """"~'~""""'''''', I et the target and supported by data on the number of full grants and partial grant schools a proportion of total number of primary schools. In a stakeholder survey, beneficiaries acknowledge that: (i) collectively, the participating schools have made conscious efforts to Comments achieve the Basic Operational level as defined by the project document. At least 80% , incl. % Ibeneficiaries surveyed are satisfied with BOL achievement. achievement) At least 92% of beneficiaries surveyed were satisfied with the quantity of core primary and JSS textbooks delivered to participating schools, 95% of beneficiaries surveyed were satisfied with teacher training provided and 92% of beneficiaries surveyed were satisfied with S]\;fgtr~il1il1g, ~""'''''''''''''''''''''''''''+ ndicator 2 : At least 50% of junior secondary. schools in target~d districts meet BOL standards by EOP ""...."".".1".""" ....... Value 60% of junior secondary quantitative or 50% 160% schools met BOL in qua}i!~ti.Y~} , J, '" targeted districts ........"""'.".+"...-.... ... "",. .. __ ~ ,m •••• " . " . " •• , , __ Date achieved 0 113112003 06/30/2009 112/30/2009 Exceeded the target and this is supported by data on the number of full grant and partial grant' Comments schools as a proportion of total number of junior secondary schools. The original target (incl. % according to the DGA is 50% of junior secondary schools in targeted districts meet BOL ,achievement) standards by EOP. This was rather modest since the baseline was also estimated at 50%. The estimated increase to 60% should therefore be seen in this Vll Indicator 3~,~~~~~ea~ec~l~pl~~~()nr~t~,forprimary . emolln1~I1~il1 . ta~~~tecldistr~~tst()?O%~~~()p Primary: 65%(CSR 2005) alue Junior Secondary: 31 % ,70% Update not readily available 06/30/2009 Comments _ N " __ Did not meet the target. The data is dated (2005) and it is likely that by 2010, the target has (incl. % be~rl11letl:>lltt~~r~isl1()current suPportingcl~t~: lachievement) 0···_·····,,················ ,"Ud~U ""'" , ,__ ,u,u W_~N , ~' __ m , ' . ~ m"""un"'''''M'_~_U~ """''''''''_''''.Ud~'''. , __ , ____ """" ~",,'''''., ''''''''''''''''''''''''''''?_W,_''',,' 1 Increase primary girls emollment in target districts of Northern and Eastern regions by 20% iIndicator 4 : from 2001 to 2007 Value 154.5% overall GER iquantitative or 8% 58% onMEYS EMIS lqu~~~~tiv. .e. ,)., . . . .,. . . : . 2006/07) iDate achieved "'""y,",. __ ",'.,nm.""",,,,,.,,.,,,,,, ""_',"_nnn",' 1131/2003 '06130/2009 Comments This indicator was not monitored as stated in the GA. However, it could be inferred that good (incl. % progress was made in these districts since overall GER was 154.5% in 2005. lachievement) j•• _______ •• a. ___uuum_ NN ••• _~"_.,_., •• , IIndicator 5 : ;. 1I1c:~~~~jlll1ior sec()l1cl.~l")'~n!~l!.IJ1.~l1t,.ill.t~:J?,etclis~i~tsbX~9% from 2001 to 2007 [value overall GER quantitative or 18% 38% (Based on MEYS EMIS 1911~li!~!iy~) data 2006/07) IDate achieved 0113112003 ....... .............. 12009 ~.~- !Comments This indicator was also not monitored as stated in the GA. However, it could be inferred that (incl. % good progress was made in these districts since overall GER was 154.5% in 2005. achievement) 1!ndica~<>.t:~...: .. JI.l1~:~~se . .in. p~~~.r~te 20% from 2001 to 2 Value 'quantitative or 164% 911~!i!~!~y~) .. :Date achieved 01/3112003 omments Did not meet the target. This indicator is not very appropriate given that the pass rate is incl. % o the number of junior secondary places available. chievement) Vlll (b) Intermediate Outcome Iudicator(s) IV .......... ... bo p;i~;Y~chools implement full grants in IDA districts by EOP. lindicator 1: al~~··· r"···········································,········....................................................................... ; (quantitative 0 250 I 192 qualitathre) .:~~~~~~:~~:~~~al ;:~:;::~;;!;.:.;;;~~:s:;;;~~;:~:;:::::~ I()f 1 mhc.. 0 ) [significantly during project implementation. c levement ...............................................................•..... [ . . . ......•..............................•.••••...•••••••..••••.......••.••.•..•.•••..•••••.••••................. i.!l~.i~~tor 2 : . . . ll,~~~.p~itl-J~~~~~~~I~i~ple.~~I1!p~J1.i~l~ants in IDA distr.i. ct....s. . . . .;, ... ,........~~............ "..."...........~.,._. . ~ .. . Value I :(quantitative 10 ;1,625 ?~. qlla!~!a.:!iy~) Date achieved 0113112003 06/30/2009 12/30/2009 Comments I Exceeded the target. The definition of partial grants includes textbooks, teacher training, 1(· i mc I . 0/ /0 ISMC, but excludes infrastructure and furniture. The project made every effort to spread the , hievement) I enefits of partial grants as widely as possible exceeding the targeted 1,625 primary schools. gjllI1i()E.second~~~~~~.I~.~?pl~~?eIl! full gr~IltsiIl!!2~~is~i~ts~y'EOP. 50 48 48 0113112003 6/30/2009 12/30/2009 Comments This target was substantially met since the achievements only fell short by 4% due to (incl. % :unexpectedly high increases in unit costs during project implementation. In addition the chievelll~Il!)Jpr~Le:t ~~~ed to provide a JSS in every chiefdom that did not have a secondary school. .. Il~iC:l:ltor 4 : . . . . . E~~)llIli~rs~~oI1d- !~-.t- ?-~-~u-'~-·!-··~-2;~:-·~-}n--"1-.a..-:':l1- -",-~r-s-.~~~-r-~~-~d-~- . ?-._?- . . .. . ·,·-,-j . . . ,- Iqualitative) Inot yet completed. ~~!.~:~~~~y~~.. --.. . --------'·"-··'. :·:l§?I.~~(~§§?"j::··: .-~:·_.:::~~=I::::.:::::~::~=::::~.:::..., IComments id not meet target. Although the statistical year book for frrst EMIS census was published, Kincl. % nnual school surveys were not conducted as planned. Data from the second EMIS data has la(;!!~~Y~~~!I:!t till not bee.~~~l~~.~~. . ~~.~!?~~~capacity C?~~~a.~ts.:......................... _.. . . . __ ._,...,_ . . ,. . .. IIndicator 10 : y~~~~s policy decisions_~a.~~~.?.n inform_a.!!?~~()~!~~!~~.~ sc~()?L~~.e. y::. s _ _,____.._,_{ . . ............ ..... ~~~~ ..... urvey of EMIS census data for tudi BOL d t d . tervention schools 006/2007 analyzed. os es. con uc e . onducted to MIS data for 2007/2008 idetermine BOL . - - - -.....~--......-...........----.--+---.........- 106/30/2009 IComments id not meet target. Some policy decisions were made on the basis of the only school census I(incl. % ompleted but some trend datawould have provided more insight. lachievement :.:.:...:............._ _ _ .<...........L __ • _ _ _....." .. _ ..... " ....................................................._ _._ _ _ ........ _ .................................._ ... _ _ _ _ _................._ ..........................._ ......_ .......................................... ' Xl .-.-,-'~~-"'---"'---------"'-"'-"'---"'-"'--"'---- ----,-----~---- ... --------,-------...- - -...----------- lndicator 11 : YS demonstrates transparency in the decision-making process pertaining to the allocation _____ ~~______~~~~_ect~ds ~alue Project Steering IProject Steering ;Committee activities iCommittee set up to Iquantitative or :niade more ,approve aU proposals and Iqualitative) _ _ " _______ . . _...... ___ j!I:~~Lar_en_._t___.____+-----.. --------------~---- _____!-Ia_lll_,__,,ca_.t..e,__fun d_in_l~g_ _+ o __ , ____ . !Date achiev :06/30/2009 t-- . . -- . . -- ... - I~omn:ents Met the target. Project Newsletter documents and regularly disseminates information on I(mcl. Yo ds allocated, and the location and completion rate of sub-projects. !achievement) ~~di;;t~~i-<----:-------1,------r----o---j~~ti~i;pi~~~~t~d~~~~;d~gt~~~~i~~d(MTR agreed) schedule ~:~~;i~;:~:r - - ~:--~a~;~--~~~::~~-- ---------------------'- . . '.-.----.-~~~% of targ~t---r--------- -" ..- -r~~~~":;:~et sc~::~~--'-- . .-- ~~~~~~:~~d- ;;;:_~~~;~:::nstruCted Comments L rstruc~re~~. I i(incl. % ,achievement 1---------------_...· ..._----------------_..._-----_...- :Indicator 1 l· ,. ",~·-'"-·<~-""'-'·-'- ·'IEMiS"'~~~~di~;to~'s I ~oo :assignment ended Nov. . 1.lquantl·tatl·ve or C . d EMIS omputerized EMIS :30, 2008. EMIS IT' staff , I 0 omputenze . functioning icontract was extended for! ~:_:~:_:e)---_-. -,-.~ ~ -_~_- - .-. _.- -. ,"' . _ _. ~-~_-_~~=-~~~ IComments 's target was partially met as the EMIS was established and was used to prepare and I kincl. % ublish a statistical yearbook. However, there was no in-house capacity in the MEYs to I __~t 1~~~i,~Y~!Een )'---J.._ana~e_th_e_~~~\Vhen the consultant' s contracts_ ~?_de_d~~___.",.__, . " , , , , , , , __ ,,,_,__ ______ ! XlI ---~ . '---'''..-.- .., -,-,~----,"----~--- wo national school surveys undertaken by end 2007 and updated each year during project implementation- ..-.-.-.-...--...--.-... '~f--''''''''---'"-- ... ·.------r----.. - r ' ' - - ' ' - - ' ' ' ' ' ' - ' ' ' ' ' ' - '.. -'.-T-~----··----___i 12 EMlS census - ate achiev .. --~. 003 _______. _ t -_ 2 EMlS _ . _._____....L-6~.~_Q~~Q~?___. J_._. ____ . . census ___ 1 ..... _ _ _ ..l . . ..e. .-.:. . . . o . ..9 ..-J7_2.- .3.o.rt . . . . 0.-.e.-.n,,___.._ . . I.~_ Comments ICincl. % artially met the target as only one school census was completed and analyzed ~!i~_~~!!lent) _~._ _._"._.__ IIndicator 15 : 00 School Management Committees established and fully functioning by end 2007 1° ccording to DGA t~_~c~~~~_ed_ 0 113 ~~~~~_ __ . __.. ~~_~20~~. . _ _... }~!~0/2~~~__....... _____..__._._ omments incl. % id not meet the original DGA target of 400 SMCs established and fully functioning. chievement) ndicator 16: ~.~~!books purcI:~~e.~ (number.L ___.......... 00% of planned textbook , umbers procured. This epresents 1,924,520 I rimary textbooks '100% of textbooks o textbooks procured 481,130 sets of primary . uantitative or Iprocured under the der project ore textbooks); and ,qualitative) project as intended 43,620 junior secondary ; , extbooks (35,905 sets of SS core textbooks) rocured. ---- 113112003 6/30/2009 12/30/2009 Date .................. --. i·-------achieved omments incl. % DA 15 target. Not in DGA. et the target. chievemenQ_r-______. _______. _______._________...________. _____ ._____..~ icator 17 : extb??~~_~.i.~~~1!!~~(J?:~?~r.2. ---....- ._ _-....,.__.............._...______.__. _._.. ..,... . . . ,. . _.. .-"C:'"-----------i 100% of procured extbooks distributed. is represents 1,924,520 ! alue I rimary textbooks 1100% of textbooks '" !NO textbooks distributed to 481,130 sets of primary ~rocured, distributed I Iquantitative or school under project Iqualitative) !under the project I I ore textbooks); and 143,620 junior secondary ! ext books (35,905 sets of ~:::Ved 1/31/2003 ~ J~~!3-Q(~Q~? ___ __-.. -.. _. _.______ . ~%~:7tboo:~ '(' I