The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) Improving the Quality of Initial and Primary Education in Uruguay (P159771) LATIN AMERICA AND CARIBBEAN | Uruguay | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2017 | Seq No: 11 | ARCHIVED on 21-Jun-2022 | ISR51575 | Implementing Agencies: ANEP - Administracion Nacional de Educacion Publica, Oriental Republic of Uruguay Key Dates Key Project Dates Bank Approval Date: 16-Dec-2016 Effectiveness Date: 08-May-2017 Planned Mid Term Review Date: 15-Jun-2020 Actual Mid-Term Review Date: 11-Oct-2019 Original Closing Date: 31-May-2022 Revised Closing Date: 28-Feb-2023 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The objectives of the Project are to improve the teaching practices and the learning environment in early and primary education, as well as the internal efficiency in primary education, all in Full-Time Schools, and to strengthen the evaluation capacity of the education system. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Early Education:(Cost $5.53 M) Primary Education:(Cost $26.98 M) Transition between Primary and Secondary Education:(Cost $1.00 M) Monitoring and Evaluation System:(Cost $6.39 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Satisfactory Satisfactory Overall Risk Rating Moderate Moderate Implementation Status and Key Decisions The Project was restructured on April 11, 2022 to: 1. Extend the Project’s Closing Date by nine months, from May 31, 2022 to February 28, 2023. 2. Add an activity under Subcomponent 2.2 to support activities related to provision of training to school directors to enhance the synergies with the Strengthening Pedagogy and Governance in Uruguayan Public Schools Project, which is pending effectiveness. 3. Modify the verification protocol for Performance-Based Condition 5 given that it can be verified directly by the World Bank using administrative data. 4. Revise the end target date for all indicators to December 30, 2022 in line with the new Closing Date. 5. Add an Education Corporate Results Indicator into the Project’s Results Framework to comply with the Bank's requirements. 6/21/2022 Page 1 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) As the Project is in its last year of implementation, the Project Implementation Unit (PIU) is focusing on completing all activities planned under the Project in the required timeframe. In particular, it is focusing on completing the construction of four remaining schools, providing funding for school maintenance, providing physical and education equipment, and ensuring that existing infrastructure is adapted to guarantee COVID-19 sanitation measures. In terms of teacher training, the PIU is using the additional nine months of implementation, which allow for work during the entire 2022 academic year, to continue providing training and support for teachers. These activities are critical in the country's post-pandemic context, as unofficial data indicate that repetition and absenteeism rates are increasing at the national level. The continuation of evaluation activities throughout education levels for this additional period (namely, the INDI, LEO, and SEA+ evaluations in 2021 and 2022) will also generate invaluable information on the effects of the pandemic on the education sector, which can then be used to inform future education policymaking. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Low Low Low Macroeconomic Moderate Moderate Moderate Sector Strategies and Policies Low Low Low Technical Design of Project or Program Moderate Moderate Moderate Institutional Capacity for Implementation and Moderate Moderate Moderate Sustainability Fiduciary Moderate Moderate Moderate Environment and Social Low Low Low Stakeholders Low Low Low Other Low Moderate Moderate Overall Moderate Moderate Moderate Results PDO Indicators by Objectives / Outcomes Improve teaching practices in early and primary education IN01145439 ►PDO1. Increase in the teaching practices score in FTS based on class observation. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 2.60 2.50 2.70 2.91 Date 26-Oct-2018 07-Dec-2021 09-Jun-2022 30-Dec-2022 While the indicator has increased from its previous value, it remains below the target value of 2.91 for Comments: 2021. 6/21/2022 Page 2 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) IN01145623 Sub-PDO1. Increase in the teaching practices score in FTS based in self-reports. (Percentage, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 69.90 70.20 71.70 80.40 Improve the learning environment in early and primary education IN01145440 ►PDO2. Learning environment. Number of additional students enrolled in schools that meet required quality standards. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 6,213.00 8,073.00 4,500.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 The actual value corresponds to the total number of students in schools that meet the standards within the broader Project framework, including those finance with counterpart funding. 4,142 additional students Comments: enrolled in schools financed solely by the Project. Improve the internal efficiency in primary education IN01145621 ►PDO3. Internal efficiency. First grade repetition rate in FTS. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 11.00 8.70 9.30 9.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 Repetition rates have continued to worsen due to the effects of the pandemic, reversing some of the Comments: previous positive progress achieved under the Project. IN01145624 Sub-PDO3. First grade repetition rate gender gap in FTS. (Percentage, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 4.30 2.90 3.40 3.30 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 Strengthen the evaluation capacity of the education system IN01145622 ►PDO4. Evaluation Capacity. Share of schools that use national student-level assessment results for decision-making (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 35.00 35.00 35.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 6/21/2022 Page 3 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) Intermediate Results Indicators by Components Early Education IN01145625 ►IRI1. Number of additional classrooms for 3-year-olds resulting from Project interventions (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 15.00 18.00 20.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 IN01145629 ►IRI2. ECD teachers of FTS use mobile libraries at least once a week (Percentage, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 65.20 65.20 70.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 The actual data reported corresponds to the measurement taken in December 2018. Information for the December 2021 measurement is being processed, but preliminary results show that 76% of of ECD Comments: teachers of FTS use the mobile libraries at least once a week, surpassing the end target of 70%. IN01145633 ►IRI3. Increase in the share of 5-year-old students in FTS with an "expected" development level. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.50 3.75 0.81 1.50 Date 24-Sep-2019 07-Dec-2021 09-Jun-2022 30-Dec-2022 Previous ISRs mistakenly reported percentage increased compared to the baseline, rather than percentage point increases as stipulated in the indicator's description. As such annual values would be as follows: 2019: 2.70 2020: 3.07 Comments: 2021: 0.81 The drop in the reported development levels reflects the interruptions in schooling caused by the pandemic, which disproportionately affected children in early education (ages 3 to 5) according to preliminary data. IN01145636 ►IRI4. ECD assessment results inform first grade teachers (Text, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target ECD assessment Local ECD ECD assessment results results (EIT) integrated assessment is (EIT) integrated into ECD assessment has into GURI's database developed and Value GURI's databased and 50% coverage. and local ECD approved by the local ECD assessment assessment developed Project Implementing developed and approved and approved by the Entity. (DLI 6) 6/21/2022 Page 4 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) by the Project Project Implementing Implementing Entity. Entity. Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 This indicator has already met its end of Project target, as the local INDI assessment has been developed Comments: and approved. IN01145639 ►IRI5. FTS ECD teachers apply protocols for at-risk students (Text, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target 70% of ECD teachers ECD teaching of all FTS carry out ECD teaching guidelines guidelines and interventions according and protocols for at-risk protocols for at-risk Value Not started to the guidelines for students included in the students included in students that do not ECD in-service training the ECD in-service achieve the expected training level of development Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 The pilot to measure teachers' application of the protocols, originally planned for May 2020, was postponed due school closings as a result of the COVID-19 crisis. To address this, the self-survey was Comments: made available to teachers online and the interviews will be conducted by phone/video. The application of the protocols will be scaled up and measured in the second semester of 2022. IN01145641 ►IRI6. ECD teachers of FTS accredit in-service training courses (Text, Custom, PBC) Baseline Actual (Previous) Actual (Current) End Target 350 certified ECD Value Not started 254 certified teachers 202 certified teachers teachers Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 Accreditation per year is as follows: 2017-18: 265 2019: 293 Comments: 2020: 226 2021: 202 Primary Education IN01145626 ►IRI7. Number of additional primary level classrooms built or rehabilitated in FTS resulting from Project intervention. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 249.00 327.00 160.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 The current value represents all classrooms built and rehabilitated within the broader framework of the Project, included those financed with counterpart funds. 168 classrooms have been financed directly with Comments: Project funds. IN01145630 6/21/2022 Page 5 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) ►IRI8. Number of FTS that are equipped with physical and educational equipment. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 22.00 29.00 28.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 End target surpassed. Comments: IN01145634 ►IRI9. Number of FTS that annually receive resources and technical assistance for preventive maintenance. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 100.00 200.00 211.00 211.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 44 received resources in 2021 and 167 received resources in 2022. Comments: IN01145637 ►IRI10. Primary teachers, principals and inspectors accredit in-service training courses. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 2400 teachers, 3,472 passed the first of 3,417 passed the first Value Not started principals or inspectors two cycles of two cycles certified. Date 30-Dec-2016 07-Dec-2021 07-Dec-2021 30-Dec-2022 Accreditation per year: 2017-18: 1,296 2019: 852 Comments: 2020: 778 2021: 491 Transition between Primary and Secondary Education IN01145627 ►IRI11. Number of FTS that receive support targeted for teachers with students at risk in the sixth grade (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 24.00 24.00 30.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 Current value represents 9 FTS that received support in 2018, 7 in 2019, and 8 in 2021. 15 FTS have been designated for this support in 2022. The PIU will confirm if these are additional to those previously Comments: reported or if some are receiving support for a second time in order to properly calculate the indicator in the next ISR. IN01145631 ►IRI12. Pilot experience linking FTS with secondary schools. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 6/21/2022 Page 6 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) Activities began in 8 FTS in 2018 and 1 Activities began in 8 FTS additional FTS was in 2018 and 1 additional 10 FTS-EMB pairs Value Not started incorporated in 2019. 9 FTS was incorporated in fully aligned FTS have been 2019. included in the plan of activities for 2022. Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 Due to the pandemic, the CEA interventions were not carried out in 2020, but work has begun in 9 pairs Comments: for 2022. Monitoring and Evaluation System IN01145628 ►IRI 13. Creation of a monitoring system for students' academic trajectories (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Pilot implementation in 8 Results report of the Results report of the Value System not available jurisdictions pilot delivered pilot and its expansion Date 31-Dec-2017 07-Dec-2021 09-Jun-2022 30-Dec-2022 The SEA+ evaluation is planned to be continued and has been included for support in the Strengthening Comments: Pedagogy and Governance in Uruguayan Public Schools Project (P176105). IN01145632 ►IRI14. Number of census-based standardized student assessments carried out at the ECD or Primary levels. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 2.00 2.00 2.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 The two evaluations carried out are the EIT-INDI and the LEO. This indicator has met its end target. Comments: IN01145635 ►IRI15. First grade repetition rate in quintile 1 and 2 FTS. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 12.40 9.80 10.90 10.00 Date 31-Dec-2015 07-Dec-2021 09-Jun-2022 30-Dec-2022 Repetition has continued to increase from the previously reported value due to the effects of the pandemic Comments: on schooling, reversing some of the earlier progress made under the Project. IN01145638 ►IRI 16. Beneficiary Feedback. Share of FTS benefiting from Project interventions that use teacher or parent apps to carry out beneficiary satisfaction surveys (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 70.00 65.00 50.00 Date 30-Dec-2016 07-Dec-2021 09-Jun-2022 30-Dec-2022 6/21/2022 Page 7 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) While the target lowered from its previous value, it remains above the end target for the Project. Comments: IN01145640 ►Teachers recruited or trained (Number, Corporate) Baseline Actual (Previous) Actual (Current) End Target Value 693.00 693.00 693.00 693.00 Date 07-Dec-2021 07-Dec-2021 09-Jun-2022 30-Dec-2022 The current value represents teachers who have completed in-service (611), preschool (226), and Comments: management (170) trainings as of December 2020. IN01145642 Number of teachers recruited (Number, Corporate Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 0.00 Date 21-May-2021 07-Dec-2021 07-Dec-2021 30-Dec-2022 IN01145643 Teachers recruited or trained - Female (RMS requirement) (Number, Corporate Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 0.00 IN01145644 Number of teachers trained (Number, Corporate Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 693.00 693.00 693.00 693.00 Date 07-Dec-2021 07-Dec-2021 07-Dec-2021 30-Dec-2022 Performance-Based Conditions IN01145645 ►PBC 1 IRI4. ECD assessment results inform first grade teachers (Text, Process, 500,000.00, 100.00%) Baseline Actual (Previous) Actual (Current) June 30, 2021 ECD assessment results ECD assessment results (EIT) integrated into (EIT) integrated into GURI's databased and GURI's database and ECD assessment has 50% Value local ECD assessment local ECD assessment -- coverage. developed and approved developed and approved by the Project by the Project Implementing Entity. Implementing Entity. Date -- 07-Dec-2021 09-Jun-2022 -- 6/21/2022 Page 8 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) GURI will submit INDI documentation to the Bank this calendar year to confirm if the DLI can be considered Comments: met. IN01145646 ►PBC 2 IRI6. ECD teachers of FTS accredit in-service training courses (Text, Output, 500,000.00, 100.00%) Baseline Actual (Previous) Actual (Current) June 30, 2021 Value Not started 254 certified teachers 202 certified teachers -- Date -- 07-Dec-2021 09-Jun-2022 -- Comments: Guidelines have been revised submitted to CEIP for approval and publication. IN01145647 ►PBC 3 IRI2. ECD teachers of FTS use mobile libraries at least once a week (Percentage, Intermediate Outcome, 400,000.00, 100.00%) Baseline Actual (Previous) Actual (Current) June 30, 2021 Value 0.00 65.20 65.20 -- Date -- 07-Dec-2021 09-Jun-2022 -- IN01145648 ►PBC 4 IRI5. FTS ECD teachers apply protocols for at-risk students (Text, Intermediate Outcome, 400,000.00, 0.00%) Baseline Actual (Previous) Actual (Current) June 30, 2021 ECD teaching guidelines ECD teaching guidelines and protocols for at-risk and protocols for at-risk Value Not started -- students included in the students included in the ECD in-service training ECD in-service training Date -- 07-Dec-2021 09-Jun-2022 -- IN01145649 ►PBC 5 IRI4. ECD assessment results inform first grade teachers (Text, Process, 600,000.00, 0.00%) Baseline Actual (Previous) Actual (Current) June 30, 2021 Value ECD assessment has 50% ECD assessment results ECD assessment results -- coverage. (EIT) integrated into (EIT) integrated into GURI's databased and GURI's database and local ECD assessment local ECD assessment developed and approved developed and approved 6/21/2022 Page 9 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) by the Project by the Project Implementing Entity. Implementing Entity. Date -- 07-Dec-2021 09-Jun-2022 -- IN01145650 ►PBC 6 IRI4. ECD assessment results inform first grade teachers (Text, Output, 600,000.00, 100.00%) Baseline Actual (Previous) Actual (Current) June 30, 2021 ECD assessment results ECD assessment results (EIT) integrated into (EIT) integrated into GURI's databased and GURI's database and ECD assessment has 50% Value local ECD assessment local ECD assessment -- coverage. developed and approved developed and approved by the Project by the Project Implementing Entity. Implementing Entity. Date -- 07-Dec-2021 09-Jun-2022 -- Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P159771 IBRD-86750 Effective USD 40.00 40.00 0.00 37.71 2.29 94% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P159771 IBRD-86750 Effective 16-Dec-2016 22-Mar-2017 08-May-2017 31-May-2022 28-Feb-2023 Cumulative Disbursements 6/21/2022 Page 10 of 11 The World Bank Implementation Status & Results Report Improving the Quality of Initial and Primary Education in Uruguay (P159771) Restructuring History Level 2 Approved on 03-Dec-2019 ,Level 2 Approved on 11-Apr-2022 Related Project(s) There are no related projects. 6/21/2022 Page 11 of 11