Public Disclosure Copy The World Bank Implementation Status & Results Report READ PNG (P105897) READ PNG (P105897) EAST ASIA AND PACIFIC | Papua New Guinea | Education Global Practice | Recipient Executed Activities | Specific Investment Loan | FY 2011 | Seq No: 9 | ARCHIVED on 11-Dec-2014 | ISR17174 | Implementing Agencies: Key Dates Key Project Dates Board Approval date:03-Mar-2011 Effectiveness Date:28-Oct-2011 Planned Mid Term Review Date:16-Sep-2013 Actual Mid-Term Review Date:04-Nov-2013 Original Closing Date:30-Jun-2014 Revised Closing Date:30-Jun-2015 Project Development Objectives Project Development Objective (from Project Appraisal Document) The objective of the project is to: (i) improve the reading skills of elementary and primary education students, and (ii) to build the policy, monitoring and evaluation capacity of the Curriculum Development and Assessment Division in the Recipient’s National Department of Education. Has the Project Development Objective been changed since Board Approval of the Project Objective? Yes Board Approved Revised Project Development Objective (If project is formally restructured)PHRPDODEL The objective of the project is to promote better teaching and learning of reading skills in elementary and primary education. Components Name Increasing the Availability of Books and Learning Materials:(Cost $14.30 M) Promoting Reading Through Professional Development, Teacher Networks and Public Reading Campaigns:(Cost $1.70 M) Strengthening Early Grade Reading Assessment:(Cost $2.60 M) Project Management and Monitoring:(Cost $0.60 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO  Moderately Satisfactory  Moderately Unsatisfactory Overall Implementation Progress (IP)  Moderately Satisfactory  Moderately Unsatisfactory Overall Risk Rating  --  Substantial 12/11/2014 Page 1 of 9 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report READ PNG (P105897) Implementation Status and Key Decisions The project has made slower-than-anticipated progress in implementing its activities since the last mission caused by delays from government- related administrative and budget issues, as well as cash-flow challenges at the project level. Learning materials for elementary and primary classroom libraries are being distributed. School monitoring visits in the National Capital District (NCD) and New Island Province confirmed some classroom libraries have been delivered and are being used by teachers and students. The evaluation and identification of possible vernacular learning materials is also making progress (albeit slower than expected) and the classroom bookshelf reimbursement mechanism and templates have been established. In terms of professional development, the relevant materials and guides have been developed and are being distributed. The training of teachers is underway, and will be completed by the end of 2014. EGRA-related activities remain largely on track with an expected qualitative evaluation for both Madang and Western Highlands Province (WHP) interventions in February 2015. Lastly, project management performance remains mixed, with planning and budgeting activities having improved, while Monitoring and Evaluation (M&E), cash-flow management and follow-up/proactivity aspects needing to improve to avoid further delays and risking incomplete activities (for which the government would become financially liable). A concerted effort will be needed to complete all project activities in the next seven months ahead of the project closing date of June 30, 2015. Particular attention is required for the following: (i) sufficient cash-flow at the project level to support smooth implementation without any further delays; and (ii) proper planning ahead and undertaking of activities as required to meet implementation deadlines, taking into account the lengthy government bureaucratic procedures. Bank and government teams have committed to continue close and rigorous follow-up and monitoring to avoid any slippages that could undermine achievement of project objectives. 12/11/2014 Page 2 of 9 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report READ PNG (P105897) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance  --  --  High Macroeconomic  --  --  Moderate Sector Strategies and Policies  --  --  Moderate Technical Design of Project or Program  --  --  Substantial Institutional Capacity for Implementation and Sustainability  --  --  Moderate Fiduciary  --  --  Moderate Environment and Social  --  --  Low Stakeholders  --  --  Moderate Other  --  --  -- Overall  --  --  Substantial Results Project Development Objective Indicators PHINDPDOTBL  Proportion of primary school teachers using supplementary readers during reading instruction in a sample of 1800 classroom libraries, as defined by classroom observation checklists (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 100% of 658 teachers use sample Value ICB process in place 0 supplimentary readers (approx. 1,800 (NIP +2 NCD schools) classrooms) Date 01-Feb-2011 06-Jun-2014 31-Oct-2014 30-Jun-2015 PHINDPDOTBL  Improvement in students'average score in 3 EGRA sub-tests in Madang province (reported by gender) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Various - see Various - see Dissemination Value Various - see breakdown breakdown breakdown of results Date 01-Feb-2011 06-Jun-2014 06-Jun-2014 30-Jun-2015 12/11/2014 Page 3 of 9 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report READ PNG (P105897) PHINDPDOTBL  Madang Sub-test 2: Phonemic Awareness (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Boys: Boys Boys G3=46% G3 = 71% G3 = 71% G4=53% G4 = 73% G4 = 73% Dissemination Value Girls: Girls Girls of results G3=44% G3 = 73% G3 = 73% G4=49% G4 = 74% G4 = 74% Date 01-Feb-2011 06-Jun-2014 31-Oct-2014 30-Jun-2015 PHINDPDOTBL  Madang Sub-test 3: Letter-sound identification (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Boys: Boys Boys G3=26.1% G3 = 77.4 G3 = 77.4 G4=33% G4 =90.0 G4 =90.0 Dissemination Value Girls: Girls Girls of results G3=24% G3 = 80.6 G3 = 80.6 G4=29.9% G4 = 90.1 G4 = 90.1 Date 01-Feb-2011 06-Jun-2014 31-Oct-2014 30-Jun-2015 PHINDPDOTBL  Madang Sub-test 4: Familiar word reading (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Boys: Boys Boys G3=28.7% G3 = 32.6 G3 = 32.6 G4=41% G4 =50.9 G4 =50.9 Dissemination Value Girls: Girls Girls of results G3=29.7% G3 = 39.1 G3 = 39.1 G4=46.7% G4 =55.5 G4 =55.5 Date 01-Feb-2011 06-Jun-2014 06-Jun-2014 30-Jun-2015 PHINDPDOTBL  Improvement in students' average scores in 3 EGRA sub-tests in Western Highlands Province - WHP (reported by gender) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Assessment Endline assessment completed for Various - see Value N/A completed and results boys and girls breakdown due early 2015. in grade 3 & 4 in 3 sub-tests 12/11/2014 Page 4 of 9 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report READ PNG (P105897) Date 01-Feb-2011 06-Jun-2014 31-Oct-2014 30-Jun-2015 PHINDPDOTBL  WHP Sub-test 2: Phonemic Awareness (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Boys Assessment G3 = 43% Endline assessment completed for G4 =51% Value N/A completed and results boys and girls Girls due early 2015. in grade 3 & 4 G3 = 41% in 3 sub-tests G4 = 43% Date 01-Feb-2011 06-Jun-2014 31-Oct-2014 30-Jun-2015 PHINDPDOTBL  WHP Sub-test 3: Letter-sound identification (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Boys Assessment G3 = 22.7 Endline assessment completed for G4 = 27.98 Value N/A completed and results boys and girls Girls due early 2015. in grade 3 & 4 G3 = 21.5 in 3 sub-tests G4 = 28.6 Date 01-Feb-2011 06-Jun-2014 31-Oct-2014 30-Jun-2015 PHINDPDOTBL  WHP Sub-test 4: Familiar word reading (Text, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Boys Assessment G3 = 16.3 Endline assessment completed for G4 =30.4 Value N/A completed and results boys and girls Girls due early 2015. in grade 3 & 4 G3 = 16.4 in 3 sub-tests G4 = 34.1 Date 01-Feb-2011 06-Jun-2014 06-Jun-2014 30-Jun-2015 Overall Comments 12/11/2014 Page 5 of 9 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report READ PNG (P105897) Intermediate Results Indicators PHINDIRITBL  Number of students in elementary (E) and primary (P) schools with access to learning and reading materials in their classrooms provided by the project (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 7200.00 1095000.00 Date 11-May-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 Comments E = 0; P=7,200 students (NIP + 2 NCD schools) PHINDIRITBL  Number of teachers in elementary (E) and primary (P) schools who participated in professional development activities provided by the project. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 4458.00 8100.00 Date 11-May-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 Comments E=10 ; Primary teachers = 4448 PHINDIRITBL  At least 2 post-assessment reading intervention pilots designed and completed (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target (i) Planning for Completed 6 month scale up in Midline completed in implementation of provinces Madang; WHP intervention and endline requesting the Value 0 intervention began in assessment in two program; May. provinces; Madang and (ii) analysis of WHP results and dissemination Date 01-Feb-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 12/11/2014 Page 6 of 9 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report READ PNG (P105897) PHINDIRITBL  Classroom libraries established (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 444.00 18000.00 Date 01-Feb-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 PHINDIRITBL  Learning material kits and teacher guidelines to use kits in Grade EP-E2 classrooms (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 15000.00 Date 01-Feb-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 Comments In process, BER approved by CSTB, pending State Solicitor clearance PHINDIRITBL  Vernacular reading materials in 2,500 elementary classrooms (grades EP-E2) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 2500.00 Date 01-Feb-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 Comments Assessment completed and Procurement being implemented PHINDIRITBL  2 teams of coaches and 22 teams of provincial classroom library trainers trained by the project (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 13 national coaches ; 2 teams of 2 teams of 13 national 813 provincial classroom coaches and 22 Value 0 coaches trained in library training teams of February 2014 facilitators in 10 trainers provinces so far Date 01-Feb-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 12/11/2014 Page 7 of 9 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report READ PNG (P105897) PHINDIRITBL  At least one national public reading event during the life of the project (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Support to provincial education officers to carry book float complete; Preparations for Book out similar Completed on 8th Week to be held in events such as Value 0 August 2014 to end August 2014 are those National Book Week, underway conducted as with 6 schools in NCD part of the 2014 National Book Week(upon request) Date 01-Feb-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 PHINDIRITBL  Up to 4 EGRA provincial surveys and results reports completed from baseline assessments (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Achieved as scheduled. Complete all 4 EGRA (Madang, NCD, ENB 4 EGRA results Baseline assessment in 4 EGRA results reports Value and Western Highlands) reports Madang completed EGRA Reports endorsed endorsed by SSM and published. Date 01-Feb-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 PHINDIRITBL  Up to 4 events to disseminate results and findings from provincial EGRA surveys to NDOE, provincial officers and other stakeholders (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target ENB dissemination workshop - completed Feb 2014 Value 0 4 events held 4 events held WHP dissemination workshop - completed April 2014 Date 01-Feb-2011 06-Jun-2014 04-Dec-2014 30-Jun-2015 Overall Comments Data on Financial Performance 12/11/2014 Page 8 of 9 Public Disclosure Copy Public Disclosure Copy The World Bank Implementation Status & Results Report READ PNG (P105897) Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed Disbursed P105897 TF-98729 Effective USD 19.20 19.20 0.00 13.07 6.13 68% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P105897 TF-98729 Effective 02-Mar-2011 03-Mar-2011 28-Oct-2011 30-Jun-2014 30-Jun-2015 Cumulative Disbursements Restructuring History Level Approved on 07-Mar-2014 Related Project(s) There are no related projects. 12/11/2014 Page 9 of 9 Public Disclosure Copy