The World Bank Report No: ISR15340 Implementation Status & Results Afghanistan Afghanistan - Second Education Quality Improvement Program (P106259) Public Disclosure Copy Operation Name: Afghanistan - Second Education Quality Improvement Project Stage: Implementation Seq.No: 14 Status: ARCHIVED Archive Date: 04-Jul-2014 Program (P106259) Country: Afghanistan Approval FY: 2008 Product Line: IBRD/IDA Region: SOUTH ASIA Lending Instrument: Emergency Recovery Loan Implementing Agency(ies): Key Dates Board Approval Date 31-Jan-2008 Original Closing Date 01-Sep-2012 Planned Mid Term Review Date 17-Jul-2011 Last Archived ISR Date 26-Nov-2013 Effectiveness Date 20-Mar-2008 Revised Closing Date 01-Sep-2012 Actual Mid Term Review Date 31-Jul-2011 Project Development Objectives Project Development Objective (from Project Appraisal Document) The project development objective is to increase equitable access to quality basic education especially for girls through school grants, teacher training and strengthened institutional capacity with support from communities and private providers. Has the Project Development Objective been changed since Board Approval of the Project? Yes No Component(s) Component Name Component Cost School Grants 8.70 Teacher and Principal Training and Education 16.70 Project Management, Monitoring and Evaluation 4.60 School Grants 8.70 Teacher and Principle Training and Education 0.00 Public Disclosure Copy Project Management, Monitoring and Evaluation 0.00 Overall Ratings Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Overall Risk Rating Implementation Status Overview Page 1 of 8 The World Bank Report No: ISR15340 An Implementation Supervision Mission (ISM) was conducted for the Second Education Quality Improvement Project Additional Financing (EQUIP II AF) from June 1st – June 8, 2014. The mission objective was to review the overall progress made towards the project development objectives and to assess progress made in last one year of the Additional Financing phase. On 12 June, 2012, the ARTF Management Committee (MC) approved USD 250 million for EQUIP II additional financing period effective September 1, 2012 and extension of the project closing date to August 15, 2015. The full USD 250 million has now been released to MOE in 2 tranches. Public Disclosure Copy As of June 2014, EQUIP II had supported the construction of 838 schools: 241 schools using National Competitive Bidding and construction and/or rehabilitation of 597 schools using Community Contracting, and another 283 (178 CC and 105 NCB) schools under construction. Under Additional Financing, 8 projects (for the missing items which were not included in the original contract) are completed and 86 projects ongoing against the 465 awarded NCB projects; while 12 CC schools completed with 96 classrooms built and 87 ongoing against the 111 awarded CC projects. The slow progress in implementation is greatly associated with the procurement delay. The infrastructure department in collaboration with Procurement and Finance conducted a work flow analysis to identify bottlenecks and to facilitate a smooth work chain between different departments. The analysis discovered potential weaknesses in design of works projects, cost-estimation and redundant financial procedures that deteriorated the pace of implementation. It is expected that the rectification of these problems will increase disbursement at different levels. It is estimated that 3 million students are currently studying in EQUIP II supported schools, of this number 1.3 million ( 40%) are girls. Under EQUIP I and II (covering the extension period), social mobilization activities had been conducted in 14,125 communities which have resulted in setting up of 14,125 school management shuras (5391 EQUIP I and 8,734 EQUIP II) and the preparation of 13,412 [5045 EQUIP I & 8367 EQUIP II] school improvement plans (SIPs) nationwide. 16,587 [5045 EQUIP I and 11, 542 EQUIP II] schools had received USD 39.86 million Quality Enhancement Grants (QEGs) for purchase of school supplies, laboratory equipment etc. Of the 11,032 EQUIP II schools, 5567 schools received USD 13.83 million 1st generation and 5975 schools received USD 9.7 million 2nd generation of QEG. Training of all teachers in the system in In-service Training (INSET I and II) have been completed with 187,604 teachers trained (100,833 teachers under INSET I, 86,771 under INSET II, and 115,841 teachers under INSET III. INSET training packages are offered to teachers based on a needs assessment and correspond to skill gaps. MOE has now started training teachers offering more advanced packages of INSET IV, V and VI. Furthermore, the basic School Management Training program (SMTs I, II and III) was provided to 35,392 principals and school administrators. MOE has now started delivering more advanced packages of training beginning with SMT IV which has been offered to 8,367 principles and school administrators. The numbers for both teachers sand principals are based on multiple counting as they undergo different packages of training programs. To date, 8,042 scholarships have been awarded to female recipients enrolled in Teacher Training Colleges, and only this year 6,259 girls have registered for the scholarship program indicting the success of the program contributing to increased female participation in the teaching profession Assessing the quality of education is an important goal under the Additional Financing ph ase of EQUIP II. The roll out of the Learning Assessment System began in earnest in 2013 with the piloting and field testing of Grade 6 assessments. As of now, the assessment of 6000 grade 6 students has been conducted nation-wide and an assessment framework established. Assessment plan of Grade 3 is in progress and the rolling out process will start in July 2014. This is the first formal Learning Assessment conducted in the history of Afghanistan. This mission was conducted as a "reverse" mission with MOE key staff from the various departments coming to Dubai since Bank team could not go to Kabul given security restrictions. A total of 23 staff participated in the mission including several heads of departments. Mission costs were covered by MOE using their training budget. This is the third Public Disclosure Copy formal supervision mission under the Additional Financing phase. The mission focused on improving quality of each intervention supported by EQUIP II. Since building government own systems has been a priority under EQUIP, attention is paid to both improvement in quality of the system and processes as well as the outputs and outcomes of each system. Locations No Location data has been entered Results Project Development Objective Indicators Page 2 of 8 The World Bank Report No: ISR15340 Indicator Name Core Unit of Measure Baseline Current End Target System for learning assessment at the primary Yes/No Value No No Yes level Date 31-Jan-2008 08-Jun-2014 01-Sep-2014 Public Disclosure Copy Comments The Grade 6 assessment of Baseline results of Grade 6 6000 students completed Assessment available and nation-wide and the results informing the quality are available. Assessment interventions. Assessment plan for Grade 3 is in plans for Grade 6 and 9 in progress and ACER contract place. is being amended for it. The assessment will start in July 2014. Utility of the learning assessment system Number Value 1.00 1.00 3.00 Sub Type Supplemental Direct project beneficiaries Number Value 6299268.00 8046481.00 8500000.00 Date 31-Jul-2008 08-Jun-2014 01-Sep-2014 Comments Direct project beneficiaries is Direct project beneficiaries is EOP target by 2014 is 8.5 defined as children (boys and defined as children (boys and million students. Source girls) enrolled in schools in girls) enrolled in schools in EMIS. grades 1-12 in general grades 1-12 in general education. education. In the actual Baseline data updated based (previous), the figure reflects on the final EMIS report of the overall enrollment 2008 including TVET, Islamic Education and etc, while for this period only the General Education is being reported Female beneficiaries Percentage Value 36.31 40.00 42.00 Sub Type Supplemental Public Disclosure Copy Intermediate Results Indicators Page 3 of 8 The World Bank Report No: ISR15340 Indicator Name Core Unit of Measure Baseline Current End Target Number of additional qualified primary teachers Number Value 37000.00 15035.00 200000.00 resulting from project interventions. Date 10-Mar-2008 08-Jun-2014 01-Sep-2014 Public Disclosure Copy Comments At the beginning of EQUIP II, Cumulative to-date: This indicator refers both to there were 37000 qualified 205,971 teachers received students who have graduated teachers (EQUIP II project training. Additional 15,035 from TTCs as well as paper) are in-service TTC graduates teachers who have received since last reporting. the INSET training. Number of school administrators completing Number Value 0.00 14115.00 14000.00 management training program Date 31-Jan-2008 08-Jun-2014 30-Sep-2012 Comments This includes SMT I and SMT EQUIP EOP Targets have II training. The targets met. been met. All Administrators 21277 principals were trained in the system have now been under SMT III too. trained. This training will not be offered under AF. Number of female scholarship recipients in Number Value 0.00 8042.00 5000.00 Teacher Training Colleges Date 01-Jan-2008 08-Jun-2014 15-Aug-2014 Comments No scholarships were Cumulative to date: 8,042 Balance to be achieved by the provided under EQUIP I. females have received EOP 1672. scholarships under EQUIP II including additional financing period. Initial target of 5000 female students is surpassed by 60% Number of schools that have received and Number Value 0.00 638.00 1088.00 used the infrastructure development grant Date 01-Jan-2008 08-Jun-2014 15-Aug-2014 Comments 755 schools had received Cumulative to date: 1393 EQUIP II EOP target including infrastructure development (1152 CC and 241 NCB) additional financing. grants at the end of EQUIP I. schools received and used infrastructure development grants under EQUIP I & II Public Disclosure Copy including additional financing. 87 ongoing CC construction schools (of which 63 under additional financing) received the IEG but not used in completing the projects yet. In addition, 33 ongoing NCB Page 4 of 8 The World Bank Report No: ISR15340 schools (that includes 86 NCB under additional financing) has received IEG only partly. Number of teachers completing INSET -II Number Value 0.00 86771.00 100000.00 Public Disclosure Copy Date 01-Jan-2008 07-Oct-2013 31-Dec-2012 Comments No teachers were trained No teachers received INSET EOP target has been met. under EQUIP I INSET II. II since last report. The This training, INSET II, will not remaining teachers will be offered again. New receive INSET II training trainings INSET 3,4,5 are during extension period of being delivered. EQUIP II Number of additional teachers completing Number Value 0.00 100833.00 100000.00 INSET I under EQUIP II Date 01-Jan-2008 07-Oct-2013 31-Dec-2012 Comments 37,000 teachers received This figure was under- EOP target for EQUIP has INSET I training under EQUIP reported during the last been met. This training I (based on EQUIP II project INSET-I ended on July 31, (INSET I) will not be offered paper p.24) 2012. The EOP target again. Instead, all teachers surpassed. will receive advanced inset 3,4,5 trainings. Number of additional classrooms built as the Number Value 3425.00 2227.00 7330.00 result of project intervention Date 30-Nov-2008 08-Jun-2014 15-Aug-2014 Comments MOE data indicates Cumulative to date: A total of Target has been revised to that 3,425 classrooms 11236 have been built on site include classrooms being built were built under of which 9456 classrooms under AF. EOP target is 7330 EQUIP I. 120 schools completed and 1780 are classrooms. 2008 Baseline is consisting of 681 being constructed. 3425 classrooms. 2012 class rooms figures are 6715. originating under EQUIP I are still under construction but have not been completed due to Public Disclosure Copy various reasons including security. Number of Teachers completing INSET - III, IV Number Value 0.00 115841.00 140000.00 and V Date 21-Nov-2012 08-Jun-2014 15-Aug-2014 Comments Inset III, IV and V are INSETIII training has been EOP target is to train all advanced trainings that build delivered to 115,841.00 targeted teachers in INSET up on skills from INSET I and Science and Math (Grade III, IV and V. Additionally, II. 7-9) teachers of which 9130 newly hired teachers will be teachers were female. trained under additional financing period of EQUIP II. Page 5 of 8 The World Bank Report No: ISR15340 The EOP will be revised accordingly. Number of Principals and school administrators Number Value 0.00 8367.00 20000.00 completing School Management Training IV Public Disclosure Copy Date 21-Nov-2012 08-Jun-2014 15-Aug-2014 and V Comments SMT IV and V are advanced 8,367 school administrators EOP target is to train 20,000 School Management and principals received SMT school administrators and Trainings that build on SMT I, IV training. principals. Advanced school II and III delivered during management training in new EQUIP II> packages (SMT VI) and need based SMT trainings for newly hired principals and school administrators will be delivered. Data on Financial Performance (as of 03-Jun-2014) Financial Agreement(s) Key Dates Project Ln/Cr/Tf Status Approval Date Signing Date Effectiveness Date Original Closing Date Revised Closing Date P106259 IDA-H3540 Closed 31-Jan-2008 10-Mar-2008 20-Mar-2008 01-Sep-2012 01-Sep-2012 P106259 TF-91943 Closed 14-Aug-2008 14-Aug-2008 14-Aug-2008 31-Dec-2008 31-Mar-2009 P106259 TF-93962 Effective 14-Apr-2009 14-Apr-2009 14-Apr-2009 01-Sep-2012 15-Aug-2015 Disbursements (in Millions) Project Ln/Cr/Tf Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P106259 IDA-H3540 Closed USD 30.00 29.24 0.76 28.86 0.00 99.00 P106259 TF-91943 Closed USD 0.12 0.12 0.01 0.12 0.00 100.00 P106259 TF-93962 Effective USD 408.00 408.00 0.00 234.65 173.35 58.00 Disbursement Graph Public Disclosure Copy Page 6 of 8 The World Bank Report No: ISR15340 Public Disclosure Copy Key Decisions Regarding Implementation An Implementation Supervision Mission (ISM) was conducted for the project (currently only supported by the Afghanistan Reconstruction Trust Fund – ARTF - $283 million total) from June 1st – June 8, 2014. The ARTF Closing Date is August 15, 2015. Thus far, the project has supported the construction of 838 schools: 241 schools using National Competitive Bidding (NCB) and construction and/or rehabilitation of 597 schools using Community Contracting (CC), and another 283 (178 CC and 105 NCB) schools under construction The infrastructure department in collaboration with Procurement and Finance department conducted a work flow analysis to identify bottlenecks and to facilitate a smooth work chain between different departments. The analysis discovered potential weaknesses in design of works projects, cost-estimation and redundant financial procedures that deteriorated the pace of implementation. It is expected that the rectification of these problems will increase disbursement at different levels and will address quality issues to a large degree. IRD, as the third monitoring body prepares monthly report on the quality of infrastructure supported by EQUIP. It is estimated that 3 million students are currently studying in EQUIP II supported schools; , of this number 1.3 million ( 40%) are girls. Under EQUIP I and II (covering the extension period), social mobilization activities had been conducted in 14,125 communities which have resulted in setting up of 14,125 school management shuras (5391 EQUIP I and 8,734 Public Disclosure Copy EQUIP II) and the preparation of 13,412 [5045 EQUIP I & 8367 EQUIP II] school improvement plans (SIPs) nationwide. 16,587 [5045 EQUIP I and 11, 542 EQUIP II] schools had received USD 39.86 million Quality Enhancement Grants (QEGs) for purchase of school supplies, laboratory equipment etc. Of the 11,032 EQUIP II schools, 5567 schools received USD 13.83 million 1st generation and 5975 schools received USD 9.7 million 2nd generation of QEG. Training of all teachers in the system in In-service Training (INSET I and II) have been completed with 187,604 teachers trained (100,833 teachers under INSET I, 86,771 under INSET II, and 115,841 teachers under INSET III. INSET training packages are offered to teachers based on a needs assessment and correspond to skill gaps. MOE has now started training teachers offering more advanced packages of INSET IV, V and VI. Furthermore, the basic School Management Training program (SMTs I, II and III) was provided to 35,392 principals and school administrators. MOE has now started delivering more advanced packages of training beginning with SMT IV which has been offered to 8,367 principles and school administrators. The numbers for both teachers sand principals are based on multiple counting as they undergo different packages of training programs. To date, 8,042 scholarships have been awarded to female recipients enrolled in Teacher Training Colleges, and only this year 6,259 girls have registered for the scholarship program indicting the success of the program contributing to increased female participation in the teaching profession Page 7 of 8 The World Bank Report No: ISR15340 Assessing the quality of education is an important goal under the ARTF financing of EQUIP II. The roll out of the Learning Assessment System began in earnest in 2013 with the piloting and field testing of Grade 6 assessments. As of now, the assessment of 6000 grade 6 students has been conducted nation-wide and an assessment framework established. Assessment plan of Grade 3 is in progress and the rolling out process will start in July 2014. This is the first formal Learning Assessment conducted in the history of Afghanistan. Public Disclosure Copy This mission was conducted in Dubai with MOE key staff from the various departments because Bank team could not go to Kabul given security restrictions. A total of 23 staff participated in the mission including several heads of departments. The mission focused on improving quality of each intervention supported by EQUIP II. Since building government own systems has been a priority under EQUIP, attention is paid to both improvement in quality of the system and processes as well as the outputs and outcomes of each system Restructuring History There has been no restructuring to date. Related Projects There are no related projects. Public Disclosure Copy Page 8 of 8