The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) Kosovo Education System Improvement Project (P149005) EUROPE AND CENTRAL ASIA | Kosovo | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2016 | Seq No: 8 | ARCHIVED on 17-Jan-2020 | ISR38830 | Implementing Agencies: Ministry of Education, Science and Technology, Republic of Kosovo Key Dates Key Project Dates Bank Approval Date: 10-Sep-2015 Effectiveness Date: 13-May-2016 Planned Mid Term Review Date: 05-Nov-2018 Actual Mid-Term Review Date: 12-Nov-2018 Original Closing Date: 31-Dec-2019 Revised Closing Date: 31-Dec-2020 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective is to strengthen selected systems that contribute to quality, accountability, and efficiency improvements in education in the Republic of Kosovo. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Enhancing strategic planning, financial management, monitoring and decision-making in the education sector:(Cost $3.13 M) Strengthening management capacity and accountability to enhance quality of education:(Cost $3.72 M) Implementation and Communications Support:(Cost $0.65 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Unsatisfactory Moderately Satisfactory Overall Implementation Progress (IP) Unsatisfactory Moderately Satisfactory Overall Risk Rating Substantial Substantial Implementation Status and Key Decisions During the reporting period, two key milestones following project restructuring were completed: (i) School Development Grant (SDG) disbursement to schools with approved plans and their use of approximately 540,000 Euros in the eligible areas of goods and training; and (ii) piloting of the Grade 12 Matura exam with new items aligned to curricular reforms and launching of the National Student Assessment Framework. Project evaluation showed significant progress by MEST and satisfactory achievement of the milestones. Further, the Government requested an extension of the project closing date and it was approved by the Bank. The project now has 12 more months to implement the components and close on December 31, 2020. In addition to achieving the key milestones, a condition for extension of the project was to fortify the project team with key 1/17/2020 Page 1 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) staff/consultants to support implementation capacity which is now almost complete. It will be important for the new government to provide strong leadership in order to successfully complete the remaining activities of the project in the remaining months of implementation. Given the extension of the project, an additional 80 schools will benefit from SDGs under a new Call for Proposals to be awarded for 2020. Additionally, a work plan to enable the Ministry of Education, Science and Technology (MEST) to track student data was developed with the help of the Bank team so that the project can begin supporting programming of a national student registry, links to the Education Management Information System, and a sub registry for the Grade 12 Matura exam entrants. Under Learning Assessments, MEST has taken lessons from the Matura 12 pilot and continues to work on the reform of the exam for 2020. The final draft of the National Student Assessment Framework was sent out for consultation and is now being finalized. Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance Substantial Substantial Substantial Macroeconomic Substantial Substantial Substantial Sector Strategies and Policies Moderate Moderate Moderate Technical Design of Project or Program Moderate Low Low Institutional Capacity for Implementation and Sustainability Substantial High Substantial Fiduciary Moderate Moderate Moderate Environment and Social Low Low Low Stakeholders Moderate Moderate Moderate Other -- -- -- Overall Moderate Substantial Substantial Results PDO Indicators by Objectives / Outcomes Schools managing resources and quality investments to improve learning IN00752158 ►Beneficiary schools disseminating report on grant budget allocation and utilization (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 30.00 60.00 90.00 Date 30-Sep-2015 12-Mar-2019 06-Sep-2019 31-Dec-2020 1/17/2020 Page 2 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) Number of grant-recipient schools that disseminate their grant budget allocation and utilization reports, Comments: divided by the total number of grant-recipient schools. IN00752159 ►School report cards piloted at school level (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 20.00 Date 30-Sep-2015 12-Mar-2019 06-Sep-2019 31-Dec-2020 The school report card concept and design are underway. A committee is being set up under the office of the Pre-University Director with relevant stakeholders to guide the design, software needs, and use of the Comments: report cards. IN00752160 ►Reforms to Standardized 12 grade Assessment Applied (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No No No Yes Date 01-Jan-2019 12-Mar-2019 06-Sep-2019 31-Dec-2020 The Matura 12 exam delivered in Spring 2019 introduced some reforms in the form of new piloted items. Analysis and outcomes will guide the continued reform of the Matura 12 standardized school leaving Comments: assessment. Overall Comments PDO School report cards are a new task that the project is supporting this year, therefore, results will not be recorded until end of the project. Reforms to Standardized 12 Grade Assessment (Matura 12 exam) were piloted in June 2019. After this experience final adjustments to the reform will be executed for the Matura 12 exam scheduled to take place in June 2020. Intermediate Results Indicators by Components Enhancing strategic planning, financial management, monitoring and decision-making in the education sector IN00752185 ►School developing plans for quality investments through school grants (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 140.00 160.00 150.00 Date 30-Sep-2015 12-Mar-2019 06-Sep-2019 31-Dec-2020 Target is met after training of school management committees (which include participation of community members/parents) and preparation of school development plans to be financed through School Comments: Development Grants (SDG). IN00752186 ►Number of schools that receive School Development Grants (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target 1/17/2020 Page 3 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) Value 0.00 43.00 100.00 150.00 Date 30-Sep-2015 12-Mar-2019 01-Nov-2019 31-Dec-2020 The total number of schools that have received at least part of their school development grant is 160, however, this indicator is reporting the number of schools that have received the full amount of their SDG. Comments: It is expected that by December 31, 2019, all 160 schools will have received the entire amount. IN00752187 ►Number of beneficiary schools in which parents and/or community members were involved in grant planning or implementation (citizen engagement indicator) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 140.00 160.00 150.00 Date 30-Sep-2015 12-Mar-2019 06-Sep-2019 31-Dec-2020 Total number of grant-recipient schools in which parents and/or community members were involved in grant planning or implementation. This is the citizen engagement indicator. Comments: Strengthening management capacity and accountability to enhance quality of education IN00752181 ►Functional teacher professional development system Framework Designed (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target School based teacher Teacher Teacher Competencies professional Value No Competencies Framework Published development policy in Framework Published place Date 30-Sep-2015 31-Dec-2018 31-Dec-2018 31-Dec-2020 Publishing and launching of the Teacher Professional Competencies and Development Framework. Comments: IN00752183 ►Functional teacher performance assesssment system is in place. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Pilot application Pilot application Pilot application Value No completed completed completed Date 30-Sep-2015 31-Dec-2018 31-Dec-2018 31-Dec-2020 Target is met when teacher performance assessment is piloted and new system approved. Comments: IN00752184 ►Grade 12 examinations revised and piloted in line with Kosovo Curriculum Framework (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Grade 12 Matura Revised Grade 12 Grade 12 exams not Grade 12 exams Pilot Value exam revised and exams piloted and aligned with KCF preparation piloted in Spring 2019. evaluated Date 30-Sep-2015 12-Mar-2019 06-Sep-2019 31-Dec-2019 Target is met when Grade 12 Matura student examinations are revised in line with the Kosovo Curriculum Comments: Framework and are validated through piloting and subsequent evaluation. 1/17/2020 Page 4 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) Implementation and Communications Support IN00752182 ►Feedback from school directors on improved planning capacity (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Assessment Assessment Assessment findings Value No Assessment methodology being methodology being on principals' capacity revised revised building Date 30-Sep-2015 12-Mar-2019 12-Mar-2019 31-Dec-2020 The percent of school directors surveyed who report improvements in planning capacity on a set of specific tasks related to school development planning and implementation of SGDs, relative to the Comments: baseline. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P149005 IDA-57260 Effective USD 11.00 7.52 3.48 2.66 4.78 36% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P149005 IDA-57260 Effective 10-Sep-2015 20-Nov-2015 13-May-2016 31-Dec-2019 31-Dec-2020 Cumulative Disbursements 1/17/2020 Page 5 of 6 The World Bank Implementation Status & Results Report Kosovo Education System Improvement Project (P149005) Restructuring History Level 2 Approved on 25-Apr-2019 ,Level 2 Approved on 10-Oct-2019 Related Project(s) There are no related projects. 1/17/2020 Page 6 of 6