The World Bank Implementation Status & Results Report Education Improvement Project (P130182) Education Improvement Project (P130182) EUROPE AND CENTRAL ASIA | Armenia | Education Global Practice | IBRD/IDA | Investment Project Financing | FY 2014 | Seq No: 11 | ARCHIVED on 16-Sep-2019 | ISR36177 | Implementing Agencies: Center for Education Projects, Republic of Armenia Key Dates Key Project Dates Bank Approval Date: 13-Mar-2014 Effectiveness Date: 20-Nov-2014 Planned Mid Term Review Date: 05-Oct-2017 Actual Mid-Term Review Date: 02-Oct-2017 Original Closing Date: 30-Sep-2019 Revised Closing Date: 30-Sep-2021 pdoTable Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objectives (PDO) are to improve school readiness of children entering primary education, improve physical conditions and the availability of educational resources in upper secondary schools, and support improved quality and relevance in higher education institutions in Armenia. Has the Project Development Objective been changed since Board Approval of the Project Objective? No Components Table Name Component 1. Enhancing the Quality of General Education:(Cost $28.90 M) Component 2. Mainstreaming of the Competitive Innovation Fund (CIF) for Higher Education Institutions (HEI) into full implementation:(Cost $5.70 M) Component 3. Project Management, Monitoring and Evaluation:(Cost $2.90 M) Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Moderate Moderate Implementation Status and Key Decisions An Implementation Support Mission took place on March 2019 and follow-ups were done on June 2019. The Project implementation has picked up. As of August 2019, civil works of the second batch of high schools (8 of them) selected for rehabilitation and seismic strengthening under the project are ongoing. Additional 18 preschools have been selected and are being set up to open doors to preschoolers in September 2019. Additional six projects have been awarded under the Competitive Innovation Fund for higher education and the development of the subject standards are under way. The project has been extended by 24 months until September 30, 2021. 9/16/2019 Page 1 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) 9/16/2019 Page 2 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) 9/16/2019 Page 3 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) 9/16/2019 Page 4 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) 9/16/2019 Page 5 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Low Low Macroeconomic -- Moderate Moderate Sector Strategies and Policies -- Low Low 9/16/2019 Page 6 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) Technical Design of Project or Program -- Moderate Moderate Institutional Capacity for Implementation and Sustainability -- Moderate Moderate Fiduciary -- Moderate Moderate Environment and Social -- Moderate Moderate Stakeholders -- Moderate Moderate Other -- Moderate Moderate Overall -- Moderate Moderate Results PDO Indicators by Objectives / Outcomes EIP Project Development Objective IN00675355 ►1. Improved school readiness among those entering first grade in participating communities (Indicator to be measured at the aggregate level as well as separate by gender). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target EDI scores have increased in treatment group on average by 18 percent between the beginning and end of an academic year as opposed to 4 percent in control group. There are no significant gender differences observed in EDI scores, with Baseline collected in 4.63% increase September 2014 for observed in males and treatment & control group 4.61% increase for the communities observed in females; EDI scores are higher selected in the first Source: Baker Tilly in treatment group as round. For the Report (2016). compared to control Value -- communities to be group and this selected in the second Based on the Baker difference is round, the baseline will Tilly Report (2018) the statistically significant be collected in average difference September 2015 and between the beginning furnished in July 2016. and an end of an academic year for all tested domains was 25.3% for the target group, and 8.54% for the control group. As for Gender-driven progress, the average difference between the beginning and end of the academic year, for Males was 10.79% in target group and 9/16/2019 Page 7 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) 13.35% in control group, while for Females it was 14.5% in target group and 5.2% in control group. This difference is statistically insignificant. Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 This indicator is measured by the Early Development Index, which provides a community-level measure of young children’s development in five domains: language and cognitive skills, emotional maturity, physical Comments: health and well-being, communication skills and general knowledge, and social competence. The next report covering academic year 2018-2019 will be available in September 2019. IN00675356 ►2. Increased number of high schools targeted by the project which meet Armenia’s construction & safety standards. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 5.00 12.00 Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 Armenia is country with high seismic risk. However, many of its schools were built before 1994 - when the new safety standards were introduced - and risk collapse in case of seismic activity. Five high schools have been retrofitted. Additional eight are being retrofitted. Civil works in the first batch of 5 schools were completed. The tender process for the rehabilitation of the Comments: second batch of eight high schools was carried out in spring 2019 and upon the Bank's clearance and the Government's decision, contracts have been signed. Civil works in the eight schools kicked-off in July 2019. IN00675357 ►3. Increased number of high schools equipped with education resources provided by the project. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 0.00 107.00 Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 Education resources include STEM Laboratory equipment, computers and ICT material. Technical specifications for procurement of laboratory equipment for natural sciences have been finalized and cleared by the Bank. The launch of the bidding process which was postponed given the lack of Comments: financing allocated for the project in the state budget in the calendar year 2017 and 2018, has taken place in spring/summer of 2019. High schools will receive lab equipment in academic year 2019-2020. IN00675358 ►4. Share of grants established under the CIF achieving at least 80 per cent of their proposed objectives. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- 18.00 10.00 Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 Comments: According to the Competitive Innovation Funds' Operational Manual, each proposal must include a detailed Results Framework with measurable and quantifiable outcome and output indicators. Projects might tackle quality of education, relevance or efficiency. Due to the diversity in the range of possible projects, this indicator will measure what share of these outcome and output indicators of each grant have been met. 9/16/2019 Page 8 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) The implementation of grants awarded as part of the first round of the Competitive Innovation Fund (CIF) for higher education has been successfully completed. The third round of call for proposals was announced on January 14, 2019 and six out of 13 grant proposals have been selected for funding. The total number of CIF projects under the Project is 18, which exceeds the projected end target of 10. Intermediate Results Indicators by Components Component 1: Enhancing the Quality of General Education IN00675360 ►Number of subjects whose standards and syllabi have been revised and endorsed by the Government (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The work on the subject standards and syllabi that was delayed for two years, has kicked-off. The activity is being carried out in parallel with the EU4Innovation: STEM Pilot project covering STEM areas. To ensure synergy between the two projects leading the curriculum reform in the country, the PIU has revised the project procurement plan and method of Value 0.00 -- 9.00 implementation of this assignment, changing QCBS to individual consultants by forming relevant working groups to be supported by international experts per subject disciplines. EIP is focusing on Armenian language and literature, Foreign languages, Society and Social Sciences, Physical Education and Safety Activities, Arts and Technology. Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 Curricula revision has taken place in 2009. However, due to the extension of the length of general Comments: education from 10 to 12 years, refinements are needed to assure the syllabi are coherent and adequate. IN00675362 ►System for learning assessment at the primary level (Yes/No, Custom) Baseline Actual (Previous) Actual (Current) End Target 9/16/2019 Page 9 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) Value Yes Yes Yes Yes Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 The annual report has been made public in web-site: atc.am. It looks at progress in student performance on mathematics unified entrance exam. In 2012/2013 (baseline), there was a 76% total passing rate; in 2016, the total passing rate was 85.0%; and in 2018, it was 81.2 % (the decrease in the number was conditioned by a decrease in the number of student population). Comments: As per Core Institutional Indicators set and values defined by OPCS, Yes/No means whether the country has a sound assessment system in place, participates in international assessments and has national assessment system in place and uses data regularly from assessments to inform policy. The project is monitoring the achievement status. IN00675363 Utility of the learning assessment system (Years, Custom Supplement) Baseline Actual (Previous) Actual (Current) End Target Value 4.00 4.00 4.00 4.00 IN00675364 ►Number of classrooms rehabilitated in high schools resulting from project interventions (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Rehabilitation of the first batch of 5 schools was successfully completed and 77 classrooms in the five schools have been rehabilitated; tendering of the next batch of eight schools was carried out in spring Value 0.00 -- 162.00 2019 and upon the Bank's clearance and Government's decision, contracts with construction firms have been signed. Civil works in the second batch of high schools commenced in July 2019. Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 This indicator is inspired in a core indicator that measures classrooms built in primary schools. Since this Comments: project does not focuson primary education, the indicator was adjusted to upper secondary education. IN00675365 ►Number of administrative staff trained in the use of the integrated Education Management Information Systems (Indicator to be measured at the aggregate level as well as separate by gender). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 -- As of June 2019, 698 4,000.00 teachers and administrative representatives of schools (145 in Yerevan, 553 in marzes /regions/) were trained in the use of ICT. The next stage of training of subject 9/16/2019 Page 10 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) teachers will take place in fall of 2019.The final target is 4,000 teachers and admin staff trained. Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 Staff from the Ministry of Education and Science, schools and Marzes will be trained to extract relevant Comments: information on enrollment and attendance. IN00675366 ►System for the maintenance of hardware and software of Armenian schools designed and in operation (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The development of the NACET datacenter System fully is underway along with Value No -- operational and the ongoing expanded nationwide rehabilitation of the NaCET building. Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 All schools in Armenia are equipped with hardware and software that allow them to feed a central system with timely information on enrollment and attendance of their students. However, there are challenges to be faced by schools in remote areas, where it is difficult to provide maintenance services. The project is Comments: helping NACET to increase its capacity of catering to all schools in Armenia. A fully operational system needs to be capable of providing online support plus timely visits on-site to solve hardware or software problems. IN00675367 ►Improved student attendance in high schools targeted by the project (Indicator to be measured at the aggregate level as well as separate by gender). (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Student attendance in high schools targeted Baseline collected for The data on student by the project is treatment & control high attendance is being improved according to Value -- schools (collected in collected in schools the dynamic data school year 2013-2014). targeted by the project. available at schools and target group’s opinions. Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 High schools' infrastructure tend to be very poor. Among other issues, many of these schools do not have proper heating systems, which lead to high absenteeism during the winter. However, attendance is not adequately monitored at the moment. Hence, the project will include external monitors in order to capture Comments: real attendance in the baseline. Information of the collected baseline will be available in 2021. This activity has been integrated into the Project Final Evaluation Study according to the Project Restructuring Proposal prepared by PIU and initially agreed with the Bank. IN00675368 ►Education Management Information System for general and higher education integrated and in operation. (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value No -- The works on the Integrated system fully integration of EMIS operational and and EMIS systems expanded nationwide have been completed, 9/16/2019 Page 11 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) the corresponding software designed, which also includes changes and improvements in the reporting system and is more user friendly. The process of data entry by HEIs and VETs is underway. Additional trainings on the integrated system of TEMIS and EMIS took place, where two representatives from each educational institution took part. Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 Currently, the management information system for general education and vocational and tertiary education work separately. Users need to consult two different systems to get valuable information. An Comments: integrated system means that users can get information from a single source. Operational means that users can get relevant reports from the system according to their access profiles. IN00675369 ►Number of community-based pre-schools supported by the project. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 97.00 115.00 134.00 Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 Number of micro-projects (same as community-based pre-schools) awarded within the framework of the Comments: project. IN00675370 ►Five to six year old children enrolled in preschools supported by the project. (Indicator to be measured at the aggregate level as well as separate by gender) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 3,000.00 7,700.00 3,450.00 Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 Enrollment in preschools in the participants communities. This figure includes the number of children enrolled in year one, then in subsequent years of the preschool operation. Every year the number goes up, as newcomers enter the institutions. Thus, the Comments: number 7.700 is counted for the 97 preschools established in years 2015 to 2018 for each year the 97 institutions functioned. It includes the number of children enrolled not only in the year the preschool was established, but also for subsequent years the institution functioned. Component 2: Mainstreaming of the Competitive Innovation Fund (CIF) for Higher Education Institution IN00675359 ►Number of partnerships between public and private institutions established under the CIF (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Seven from the total of eighteen (18) grant Value 0.00 -- 5.00 projects are consortium projects, 5 9/16/2019 Page 12 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) out of 7 are consortium projects include partners from business sector. Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 Partnerships between public and private institutions are expected to make public institutions more Comments: responsive to the labor demand (and market incentives). This indicator also takes into account the participation of research centers that are not higher education institutes. IN00675361 ►Number of higher education institutions benefiting from the CIF’s component (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Total of 18 grants have been awarded as part of the first and second calls for proposals under the Competitive Innovation Fund (CIF) for higher education. Eleven of the projects have been successfully Value 0.00 -- 15.00 completed; the project at the Armenian State Pedagogical University will be completed by November 30, 2019; the other six projects were awarded in July 2019 and will be implemented until 2021. Date 13-Dec-2013 16-Jan-2019 06-Aug-2019 30-Sep-2021 This measures the number of higher education institutions selected under the project for CIF funding as Comments: individual universities or as part of consortium. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P130182 IBRD-83420 Effective USD 15.00 15.00 0.00 7.06 7.94 47% P130182 IDA-53870 Effective USD 15.00 15.00 0.00 7.02 6.57 52% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P130182 IBRD-83420 Effective 13-Mar-2014 23-May-2014 20-Nov-2014 30-Sep-2019 30-Sep-2021 9/16/2019 Page 13 of 14 The World Bank Implementation Status & Results Report Education Improvement Project (P130182) P130182 IDA-53870 Effective 13-Mar-2014 23-May-2014 20-Nov-2014 30-Sep-2019 30-Sep-2021 Cumulative Disbursements Restructuring History Level 2 Approved on 27-Aug-2018 Related Project(s) There are no related projects. 9/16/2019 Page 14 of 14