The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) Jordan Education Reform Support Program (P162407) MIDDLE EAST AND NORTH AFRICA | Jordan | Education Global Practice | Requesting Unit: MNC02 | Responsible Unit: HMNED IBRD/IDA | Program-for-Results Financing | FY 2018 | Team Leader(s): Dina N. Abu-Ghaida Seq No: 4 | ARCHIVED on 12-Dec-2019 | ISR39211 | Created by: Lisa Shawqui Lahalih on 03-Nov-2019 | Modified by: Dina N. Abu-Ghaida on 10-Dec-2019 Program Development Objectives Program Development Objective (from Program Appraisal Document) The Program is to expand access to early childhood education, and to improve student assessment and teaching and learning conditions for Jordanian children and Syrian refugee children. Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory   Implementation Status and Key Decisions During the second year of implementation, the Program has shown progress towards the achievement of overall objectives. In regards to the objectives: 1. Expanded access to quality early childhood education - there has been an increase in the number of children enrolled in public and private KG 2 from 80,000 103,991; 2. Improved teaching and learning environment - the MOE drafted a National Teacher Policy and Strategy Framework and Evaluation tools to assess teachers based on the newly adopted national teacher professional standards (NTPS); 3. Reformed student assessment and certification system - the MOE implemented the Grade 3 diagnostic (reading and math) test in all target schools and is drafting the TORs for the development of an overarching assessment framework and reform of the Tawjihi system. Nonetheless, it is not clear the extent to which the MOE is interested in the fundamental reform of the Tawjihi that is foreseen under the operation. This will become clearer with finalization of the TORs. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P162407 IBRD-88040 Effective USD 147.70 147.70 0.00 81.46 66.24 55% P162407 TF-A6420 Effective USD 2.09 2.09 0.00 0.26 1.83 13% P162407 TF-A6421 Effective USD 50.21 50.21 0.00 28.45 21.76 57% 12/12/2019 Page 1 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P162407 IBRD-88040 Effective 05-Dec-2017 12-Dec-2017 14-Dec-2017 31-May-2023 31-May-2023 P162407 TF-A6420 Effective 12-Dec-2017 12-Dec-2017 14-Dec-2017 31-May-2023 31-May-2023 P162407 TF-A6421 Effective 05-Dec-2017 12-Dec-2017 14-Dec-2017 31-May-2023 31-May-2023 Program Action Plan Action Description Complete and verify baselines for the PforR Program indicators Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 31-Jan-2020 Revised Date The baseline value for the dropout rate for Syrian refugees is still missing. Capacity building in M&E through the Completion recruitment of an M&E officer will support in verifying and finalizing the methodology for computation of this baseline Measurement value. Comments Action Description Establish an integrated system which captures procurement/contract cycle (Goods, Works, Consultants) Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 31-Aug-2020 Revised Date Completion Integrated system established and operational. Measurement The MOE is drafting the TOR related to integration of procurement and contract management systems at MOE and Comments MOPWH. Action Description Systematic Reporting for constructions activities, between MOE and MOPWH Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous In Progress Completion Operations Manual procedures on procurement of works are complied with. Measurement Comments No construction activities have been completed so far under the program. Environmental and Social Standards Operating Procedures and Guidelines including different measures to bridge Action Description identified gaps adopted Source DLI# Responsibility Timing Timing Value Status 12/12/2019 Page 2 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) Environmental and Social Client Recurrent Continuous In Progress Systems Completion Operations Manual updated and complied with Environmental and Social Standards Operating Procedures and Measurement Guidelines The Environmental and Social Standards Operating Procedures and Guidelines were not reviewed during this Comments mission Systematically integrating gender mainstreaming efforts into MOE activities through enhancing the capacity of MOE Action Description staff and respective partners to mainstream gender in program activities (e.g. teacher training, school construction and maintenance) Source DLI# Responsibility Timing Timing Value Status Technical Client Recurrent Continuous In Progress Completion Capacity building activities with a gender focus Measurement Comments This activity has not been initiated yet. Systematically integrating gender mainstreaming efforts into MOE activities through reducing gender biases and Action Description stereotypes in teacher trainings Source DLI# Responsibility Timing Timing Value Status Technical Client Recurrent Continuous In Progress Completion Teacher Training materials with gender balance. Measurement Comments This activity has not been initiated yet. Systematically integrating gender mainstreaming efforts into MOE activities through developing gender-sensitive Action Description guidelines for classroom management Source DLI# Responsibility Timing Timing Value Status Technical Client Recurrent Continuous In Progress Completion Gender-sensitive guidelines for classroom management Measurement Comments This activity has not been initiated yet Systematically integrating gender mainstreaming efforts into MOE activities through supporting teachers to provide a Action Description safe learning environment for girls and boys Source DLI# Responsibility Timing Timing Value Status 12/12/2019 Page 3 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) Technical Client Recurrent Continuous In Progress Completion Capacity building activities for teachers with a gender focus Measurement Comments This activity has not been initiated yet. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Moderate Moderate Moderate Macroeconomic Substantial Substantial Substantial Sector Strategies and Policies Substantial Substantial Substantial Technical Design of Project or Program Moderate Moderate Substantial Institutional Capacity for Implementation and Sustainability High High High Fiduciary Moderate Moderate Moderate Environment and Social Substantial Substantial Substantial Stakeholders Moderate Moderate Moderate Other -- -- -- Overall Substantial Substantial Substantial RiskComments Comments The ratings have not changed Results PDO Indicators by Objectives / Outcomes Expanded access to quality early childhood education IN00763918 ►Number of Jordanian children and Syrian refugee children enrolled in KG2 (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 80,000.00 101,768.00 103,991.00 110,000.00 Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 12/12/2019 Page 4 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) Comments Improved teaching and learning environment IN00763919 ►Percentage point reduction in the dropout rate of Syrian refugees (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 5.00 Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 Baseline for dropout rate of Syrian refugees to be finalized by January 31, 2020. Comments Improved learning and teaching environment IN00763920 ►Number of teachers evaluated against the new National Teacher Professional Standards (NTPS) who meet the minimum performance standards (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 5,000.00 Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 The NTPS have been finalized and adopted. A consulting firm has been recruited and developed the first Comments draft of the National Teacher Policy and Strategy Framework and Evaluation tools. Reformed student assessment and certification system IN00763951 ►First phase of Tawjihi reform completed (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 Assessment reform committee was established and conducted its first meeting on March 26, 2019. Terms of reference for a firm to provide technical assistance on the development of an overarching assessment Comments framework and Tawjihi reform are expected to be developed by December 2019. Intermediate Results Indicators by Results Areas Expanded access and improved quality of early childhood education IN00763952 ►In‐service training modules developed for KG teachers (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-Dec-2020 12/12/2019 Page 5 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) In-service training modules will be designed based on the quality assurance standards currently under Comments revision by the MOE. IN00763956 ►Percentage of public KG teachers that have completed the in-service training module (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 100.00 Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-Dec-2021 Comments IN00763960 ►Number of public and private KGs that have developed and implemented quality improvement plan (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 400.00 Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 Comments IN00763964 ►Public‐private partnership (PPP) setup designed and implementation plan for PPP rollout developed (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 30-Nov-2017 19-Apr-2019 10-Oct-2019 31-May-2023 A consulting firm has been contracted and the first draft of the KG demand-supply analysis report has been Comments developed. Improved teaching and learning environment IN00763954 ►Improved maintenance system adopted (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-Dec-2018 Legal framework for transfer of school-level budget for maintenance has been updated. The MOE has Comments established a steering committee to finalize all aspects of the improved maintenance system. IN00763958 ►Percentage of schools with high proportion of Syrian refugees implemeting the socioemotional learning program (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 70.00 Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 12/12/2019 Page 6 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) A consulting firm has been contracted for the socio-emotional learning needs assessment. The POWER-J intervention materials have been completed and will be piloted in MOE schools in November/December Comments 2019. IN00763962 ►Number of K‐12 teachers trained and certified (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 50,000.00 Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 The MOE has finalized the teacher standards and is working on the design of the certification requirements based on the standards. The MOE will conduct a three-day awareness training on the new teacher Comments standards for 80,000 teachers by the end of December 2019. IN00763965 ►Teacher feedback on training and certification training monitored, analyzed and included in the annual monitoring and progress reports developed by ETC (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 Comments Reformed student assessment and certification system IN00763953 ►Grade 3 diagnostic test on early grade reading and math implemented (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-Dec-2019 The verification agency has verified the accomplishment of this indicator. Comments IN00763957 ►Legal framework for the Tawjihi exam has been adopted so that its secondary graduation and certification function is separated from its function as a screening mechanism for university entrance (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-Dec-2021 Comments IN00763961 ►Student and Teacher Feedback on first phase Tawjihi reform inform the Tawjihi reform rollout plan (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes 12/12/2019 Page 7 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 Comments Strengthened management of education system IN00763955 ►Geographical Information System (GIS) and Open EMIS produce accurate and timely disaggregated data needed for program monitoring (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No Yes Yes Yes Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-Dec-2018 The verification agency has verified the accomplishment of this indicator. Comments IN00763959 ►Percentage of bids for goods and works that needed to be re‐bid (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No <20% Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 Comments IN00763963 ►Percentage of goods and works contracts that needed to be extended (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target <20% (goods) and Value No No No <50% (works) Date 31-Oct-2017 19-Apr-2019 10-Oct-2019 31-May-2023 Comments Disbursement Linked Indicators DLI_IND_TABLE ►DLI 1 DLR#1.1. Number of Syrian refugee children enrolled in target schools at the basic and secondary education levels (Output, 15,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value 125,000.00 134,121.00 131,476.00 160,000.00 Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Numbers of Syrian students has slightly decreased between December 2017 and April 2018. One explanation provided by MOE is that many Syrian families begun to return to their home country. The team will continue Comments to closely monitor this indicator and re-assess, in the future, whether this target needs to be revised. ►DLI 2 DLR#1.2. Number of Syrian refugee children enrolled in target schools at KG2 level (Output, 5,000,000.00, 0%) 12/12/2019 Page 8 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value 2,500.00 3,452.00 4,591.00 10,000.00 Date -- 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 3 DLR#2. Number of additional children enrolled in public and private KG2 (Output, 15,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value 80,000.00 101,768.00 103,991.00 110,000.00 Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 4 DLR#3.1. Comprehensive and harmonized quality assurance system adopted for public and private KG2 schools (Output, 4,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No No No Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- A consulting firm has been contracted and developed the first draft of KG quality standards. Comments ►DLI 5 DLR#3.2. 80 percent of KG2 schools assessed through the newly established quality assurance system (Process, 8,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value 0.00 0.00 0.00 80.00 Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 6 DLR#3.3. 95 percent of public KG2 teachers have completed the KG in-service training modules (Output, 8,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value 0.00 0.00 0.00 95.00 Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- KG in‐service modules will be developed once the quality assurance standards are finalized and approved. Comments 12/12/2019 Page 9 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) ►DLI 7 DLR#3.4. 25 percent of KG schools have improved quality as per the quality assurance system (Outcome, 7,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value 0.00 0.00 0.00 25.00 Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 8 DLR#4.1. New national teacher professional standards adopted and disseminated (Process, 6,000,000.00, 100%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No Yes Yes Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- The National Teacher Professional Standards (NTPS) were finalized, endorsed, and published on MOE's website. The specialized standards were completed and the standards for the non-core and supporting positions will be completed by December 2019. The MOE plans to conduct a three-day awareness training for Comments 80,000 teachers on the NTPS by the end of December 2019. The IVA has verified the accomplishment of the DLR. ►DLI 9 DLR#4.2. Teacher evaluation framework adopted (Process, 6,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No No No Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- A consulting firm has been contracted and developed the first draft of the National Teacher Policy and Comments Strategy Framework and Evaluation Tools. ►DLI 10 DLR#4.3. 5,000 teachers evaluated against the National Teacher Professional Standards (NTPS) (Outcome, 7,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value 0.00 0.00 0.00 5,000.00 Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 11 DLR#4.4. 30,000 K-12 teachers trained and certified (Output, 15,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 12/12/2019 Page 10 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) Value 0.00 0.00 0.00 30,000.00 Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 12 DLR#5.1. School program for improving student socioemotional learning designed and tested in schools (Process, 4,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No No No Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- A consulting firm has been contracted for the SEL needs assessment. The POWER-J intervention materials Comments have been completed and will be piloted in MOE schools in November/December 2019. ►DLI 13 DLR#5.2. 70 percent of schools with high proportion of Syrian refugee children implementing the socioemotional learning program (Outcome, 4,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value 0.00 0.00 0.00 70.00 Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 14 DLR#6.1. Improved maintenance system adopted (Output, 5,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No No No Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments Committee was formed and initiated working on the new maintenance system. ►DLI 15 DLR#6.2. Legal framework approved for allowing transfer of school-level maintenance and upkeep budget to schools (Output, 5,000,000.00, 100%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No Yes Yes Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- The relevant regulations were revised to increase budget to schools, as well as procurement threshold to allow Comments for school-level budgets on maintenance and upkeep. The DLR has been achieved and verified by the IVA. 12/12/2019 Page 11 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) ►DLI 16 DLR#6.3. 3,000 schools using a maintenance and upkeep budget (Outcome, 2,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value 0.00 0.00 0.00 3,000.00 Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 17 DLR#7.1. National assessment strategy adopted (Output, 5,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No No No Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Assessment committee was formed to kick start the work on the assessment framework. TORs relating to the development of an overarching assessment framework and reform of the Tawjihi system as expected to be Comments developed by the end of December. ►DLI 18 DLR#7.2. Grade 3 diagnostic test on early grade reading and math implemented in all target schools (Output, 7,000,000.00, 100%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No Yes Yes Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Grade 3 diagnostic test on early grade reading and math was implemented in all target schools during the Comments scholastic year 2017/2018. The IVA has verified the accomplishment of this DLR. ►DLI 19 DLR#7.3. First phase of Tawjihi reform completed and action plan for reform rollout is produced (Process, 9,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No No No Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 20 DLR#7.4. Legal framework for reform of the Tawjihi exam has been adopted so that its secondary graduation and certification function is separated from its function as a screening mechanism for univer (Process, 7,000,000.00, 0%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No No No Yes 12/12/2019 Page 12 of 13 The World Bank Implementation Status & Results Report Jordan Education Reform Support Program (P162407) Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- Comments ►DLI 21 DLR#8.1. Geographical Information System (GIS) is operational and updated with latest data required for management of the education system (Output, 3,000,000.00, 100%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No Yes Yes Yes Date 30-Oct-2017 19-Apr-2019 10-Oct-2019 -- The IVA has verified the accomplishment of this DLR. The GIS is operational and producing reports. The GIS is linked with OpenEMIS and 85% linked with the Department of Lands and Survey. MOE staff have been Comments trained on the use of the system and are able to use it to inform planning and monitoring. ►DLI 22 DLR#8.2. Approved annual MOE budget reflects an increase of US$134 million for the Program (Output, 45,000,000.00, 24%) Baseline Actual (Previous) Actual (Current) By end of Year 5 Value No Yes Yes Yes Date -- 19-Apr-2019 10-Oct-2019 -- This DLR has been achieved for 2019. Comments 12/12/2019 Page 13 of 13