The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Belarus Education Modernization Project (P148181) EUROPE AND CENTRAL ASIA | Belarus | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2016 | Seq No: 7 | ARCHIVED on 09-Nov-2018 | ISR34013 | Implementing Agencies: Ministry of Education, Republic of Belarus Key Dates Key Project Dates Bank Approval Date: 17-Sep-2015 Effectiveness Date: 20-Jan-2016 Planned Mid Term Review Date: 08-Oct-2018 Actual Mid-Term Review Date: 10-Sep-2018 Original Closing Date: 28-Feb-2021 Revised Closing Date: 28-Feb-2021 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The objectives of the proposed Project are to: (i) improve access to quality learning environment in selected general secondary schools; and (ii) strengthen student assessment and education management information systems of the Republic of Belarus. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Ensuring a quality learning environment in schools receiving students from closed/reorganized schools:(Cost $46.22 M) Modernization of system management in general secondary education:(Cost $2.90 M) Project implementation support:(Cost $1.40 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Satisfactory Satisfactory Overall Risk Rating Moderate Moderate Implementation Status and Key Decisions The PDOs of the project, as well as intermediary indicators, are in line with the initial plan, with some slight delays that are being remedied by the PIU and the Bank. The overall disbursement of the Project’s financing has been slightly delayed, but this is not impeding the achievement of the PDOs, or the counterpart plans to reach the 55 percent of the Project financing by the end of Q2 of the fiscal year 2019. The overall disbursement of the Project’s financing has been slightly delayed, but this is not impeding the achievement of the PDOs, or the counterpart plans to reach the 55 percent of the Project financing by the end of Q2 of the fiscal year 2019. The actual disbursement by that time will be US$18.9 million, around 37 percent of the Project amount and 13 percent behind the target set in the Project of disbursing 50 percent of the financing by 2019. 11/9/2018 Page 1 of 9 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Delays in Project implementation were caused by the insufficient attention to the on-site supervision of the activities and changes in the leadership of institutions in charge of the project implementation. Over the implementation of the project, three project ratings were downgraded to moderately satisfactory in March 2017, namely the monitoring and evaluation rating, the overall safeguards rating, and the environmental assessment rating. During the Bank team’s implementation support visit in March 2017, they noted that the project implementation unit (PIU) had carried out an insufficient number of actual site visits. This lack of attention to the physical verification had negative effects at several Project sites where the rehabilitation works, and planned packages of the laboratory equipment did not match. Also, the team identified five Project sites in which the PIU had not been able to track whether the civil works complied with the existing safeguards requirements. The PIU successfully remedied these implementation issues with the support of the Bank. Also, the PIU has developed an updated environmental and social framework (ESMF) document that addresses the identified issues, which will be used for the Additional Financing operation. The updated ESMF was consulted and disclosed by the PIU and the Bank on April 25, 2018. This mid-term review suggests downgrading the project’s component two indicator to moderately satisfactory due to delays in the implementation of the Education Management and Information System (EMIS) and National Assessments work. These works, however, are likely to achieve the planned outcomes, with the delivery shifted towards the final years of the Project. Currently, 28 project schools have been rehabilitated, and around 13,000 children are already benefitting from the improved learning environments. Civil works are ongoing in 11 schools, while the PIU has announced biddings for civil works in six more schools. In addition to the already developing construction design projects of 31 schools, the MoEd plans to select consultants to design a rehabilitation for the rest of the Project schools (around 60 schools) by the end of the calendar year 2018. The contracts for physics and chemistry school laboratories equipment concluded in September 2018. The package for information technology labs has been rebid, the contract award is expected in October 2018. The PIU is planning to rebid biology labs lot in October 2018. The next procurement package included all four subjects’ labs is expected to be announced in January 2019. PISA work in Belarus shows very good progress. The Republican Institute of Knowledge Control (RIKC) administered the main testing of PISA 2018 between April 4 and May 25, 2018. The previously delivered pilot study of PISA was successful. The official publication of PISA results will be available in December 2019. Then, further work on PISA with the results will be conducted by Belarusian specialists. Due to required extended preparation works for the informational system that would use disaggregated, individual data, the sub-component 2.3 to Improvement of the existing Education Management Information System (EMIS) to facilitate the use of data analysis to support sector management decisions is delayed. The Project will deliver the EMIS activities with a delay of 1.5 years. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Moderate Moderate Moderate Macroeconomic Moderate Moderate Moderate Sector Strategies and Policies Moderate Moderate Moderate Technical Design of Project or Program Moderate Moderate Moderate Institutional Capacity for Implementation and Sustainability Substantial Substantial Substantial Fiduciary Substantial Substantial Substantial Environment and Social Moderate Moderate Moderate Stakeholders Moderate Moderate Moderate Other -- -- -- Overall Moderate Moderate Moderate Results PDO Indicators by Objectives / Outcomes 11/9/2018 Page 2 of 9 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Improve access to quality learning environment in selected general secondary schools IN00570845 ►Students benefitting from improved learning environment in general secondary schools targeted by the project (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 11,139.00 11,139.00 25,000.00 Date 19-Jan-2016 15-Aug-2018 15-Aug-2018 25-Feb-2021 Total number of students enrolled in project schools which meet the minimum conditions of a quality Comments: learning environment per the quality learning environment checklist. IN00570854 Female students benefiting from improved learning environment (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 5,069.00 5,532.00 12,500.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 IN00570853 Students from closed/reorganized schools benefitting from improved learning environment in general secondary schools targeted by the project (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 1,382.00 1,620.00 5,000.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 IN00570856 Female students from closed/reorganized schools benefitting from improved learning environment (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 679.00 793.00 2,500.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 IN00570780 ►Number of schools rehabilitated under the project to meet minimum conditions for a quality learning environment (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 24.00 28.00 120.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 The number of project schools which are reconstructed and/or which have received capital repairs under Comments: the project. IN00570847 ►Beneficiaries reporting improved satisfaction with quality of learning environment, relative to appropriate control group (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The survey based on the Participants in schools Satisfaction is updated methodology covered by the Project No assessment is statistically higher in Value was conducted on have demonstrated conducted the treatment schools December 7, 2017 as more satisfaction (in % than in control schools. part of the annual points) than those in 11/9/2018 Page 3 of 9 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) national monitoring of the the control group as quality of education. The follows: report is under the (i) 24.4 percent and preparation and will be 17.6 percent of presented after chemistry and physics processing of the teachers respectively collected data on May 2, believe that their 2018. laboratories are better equipped; (ii) 12.4 percent of teachers are more satisfied with the provision of ICT; (iii) 11.9 percent of students perceive the equipment for experiments and practical work on physics as modern; (iv) 9.4 percent of teachers note the schools are more inclusive than previously for students with special needs and disabilities; and (v) 8.0 percent of students and 9.2 percent of teachers are more satisfied than previously with the condition of the canteen. Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 Strengthen student assessment and education management information systems IN00570837 ►Republic of Belarus’s participation in PISA is supported (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target A pilot phase of the PISA-2018 testing was Belarus conducted conducted in the No participation in PISA 2018 testing in PISA 2018 data is Republic of Belarus, Value international May 2018. The results submitted to and preparations are assessments have been submitted accepted by the OECD underway for the main to the OECD. stage of testing in April - May 2018. Date 20-Feb-2015 31-Dec-2017 30-Jun-2018 25-Feb-2021 Comments: All of the necessary PISA 2018 data is submitted to and accepted by the OECD. IN00570839 ►Annual education statistics reports produced using data generated by the integrated EMIS (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The TOR for the Integrated EMIS is No integrated EMIS in The integrated EMIS Value preparing a detailed operational. Annual place of Belarus for general EMIS TOR has been report produced using 11/9/2018 Page 4 of 9 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) developed by the Ministry education is under 100% of data of Education and cleared development. generated by the by the Bank. integrated EMIS Date 20-Feb-2015 31-Dec-2017 30-Jun-2018 25-Feb-2021 Reports providing education statistics are produced on an annual basis using the integrated EMIS that is Comments: developed under the project. Overall Comments PDO The results indicators in the system are now overlaping with the Additinal Finanacing results framework preparation, thus some actual current for PDO level indicators have not changed as they were entered earlier in the Additional Financing section of the operations portal. Intermediate Results Indicators by Components Ensuring a quality learning environment in schools receiving students from closed/reorganized schools IN00570836 ►Number of schools supplied with laboratory equipment under the project (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 120.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 The number of project schools that have received project-financed laboratory equipment to be used in Comments: physics, chemistry, biology, or IT laboratories. IN00570848 Number of physics laboratories equipped under the project (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 70.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 IN00570849 Number of IT laboratories equipped under the project (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 65.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 IN00570850 Number of chemistry laboratories equipped under the project (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 93.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 IN00570851 Number of biology laboratories equipped under the project (Number, Custom Breakdown) 11/9/2018 Page 5 of 9 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 82.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 IN00570840 ►Ratio of computers per 100 students in project beneficiary schools (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 3.78 8.62 8.57 4.32 Date 20-Feb-2015 31-Dec-2017 30-Jun-2018 25-Feb-2021 Comments: The number of computers for student use in project schools per 100 students enrolled in project schools. IN00570842 ►Percent of subject teachers in targeted schools successfully completing the IT training program (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 74.49 74.19 100.00 Date 19-Jan-2016 31-Dec-2017 30-Jun-2018 25-Feb-2021 The number of teachers who completed the IT training program (as confirmed by the body certifying Comments: completion of such program) expressed as a percentage of the number of teachers who were qualified to participate in the IT training program. Modernization of system management in general secondary education IN00570841 ►Improved sample-based national assessment (Republican monitoring) is carried out (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target A plan to improve the A plan to improve the national system for national system for assessing educational assessing educational achievements based on achievements based the sample of students in on the sample of institutions of general students in institutions secondary education of general secondary (republican monitoring) education (republican was developed. monitoring) was By the year 2020, the developed. plan would support: By the year 2020, the Existing sample-based 1) the development of a plan would support: Revised national Value national assessment concept and a model of 1) the development of assessments are system in place the republican monitoring a concept and a model carried out of the quality of general of the republican secondary education, monitoring of the taking into account the quality of general purposes and directions secondary education, of using the results of the taking into account the assessment; purposes and 2) the development of a directions of using the program of the results of the republican monitoring of assessment; the quality of general 2) the development of secondary education, a program of the 11/9/2018 Page 6 of 9 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) taking into account the republican monitoring need for information of of the quality of interested persons; general secondary 3) the development of education, taking into criteria, indicators and account the need for tools for assessing the information of quality of general interested persons; secondary education, 3) the development of taking into account the criteria, indicators and competence approach; tools for assessing the 4) the improvement of quality of general the procedure for secondary education, conducting monitoring taking into account the surveys in accordance competence approach; with the developed 4) the improvement of concept, model and the procedure for program of the conducting monitoring republican monitoring; surveys in accordance 5) the evaluation of the with the developed educational concept, model and achievements of students program of the using the improved republican monitoring; national sample based 5) the evaluation of the system (republican educational monitoring). achievements of students using the improved national sample based system (republican monitoring). Date 20-Feb-2015 31-Dec-2017 30-Jun-2018 25-Feb-2021 The national sample-based assessment (Republican monitoring) is improved through the capacity building Comments: of the National Institute ofEducation and is implemented on a nationally representative sample of students. The assessment results are submitted to and acceptedby the Ministry of Education. IN00570838 ►PISA 2018 national report is prepared (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Main testing of PISA Belarus enrolled in PISA 2018 was completed in 2018. The pilot PISA test PISA 2018 national Belarus. National was administered in report prepared and Value No analytical work report on PISA 2018 spring of 2017. The final disseminated for Belarus will be report is expected in ready in the end of 2019. 2019. Date 20-Feb-2015 31-Dec-2017 30-Jun-2018 25-Feb-2021 Comments: National report with PISA 2018 is prepared and disseminated IN00570843 ►Percent of schools connected to the integrated EMIS (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 100.00 Date 20-Feb-2015 31-Dec-2017 30-Jun-2018 25-Feb-2021 The number of project schools connected to the project-supported integrated EMIS expressed as a Comments: percentage of all general secondaryeducation institutions in Belarus. IN00570844 11/9/2018 Page 7 of 9 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) ►Number of administrative staff trained in the use of the integrated EMIS (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 3,100.00 Date 20-Feb-2015 31-Dec-2017 30-Jun-2018 25-Feb-2021 Total number of administrative staff who have completed training on the use of the integrated EMIS. Comments: IN00645146 Number of female administrative staff trained in the use of the integrated EMIS. (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 0.00 3,000.00 Date 19-Jan-2016 -- 30-Sep-2018 25-Feb-2021 Project implementation support IN00570846 ►Grievances registered related to delivery of project benefits addressed (%) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 100.00 100.00 100.00 Date 19-Jan-2016 31-Dec-2017 26-Sep-2017 25-Feb-2021 The indicator shows how many of the announced grievances in the project were addressed by the PIU Comments: IN00570855 Grievances related to delivery of project benefits that are addressed (number) (Number, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 5.00 5.00 9.00 Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P148181 IBRD-85290 Effective USD 50.00 50.00 0.00 13.52 36.48 27% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P148181 IBRD-85290 Effective 17-Sep-2015 23-Sep-2015 20-Jan-2016 28-Feb-2021 28-Feb-2021 11/9/2018 Page 8 of 9 The World Bank Implementation Status & Results Report Belarus Education Modernization Project (P148181) Cumulative Disbursements Restructuring History There has been no restructuring to date. Related Project(s) P166719-Belarus Education Modernization Project - Additional Financing 11/9/2018 Page 9 of 9