The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Vietnam Enhancing Teacher Education Program (P150060) EAST ASIA AND PACIFIC | Vietnam | Education Global Practice | Requesting Unit: EACVF | Responsible Unit: HEAED IBRD/IDA | Program-for-Results Financing | FY 2016 | Team Leader(s): Dung Kieu Vo Seq No: 12 | ARCHIVED on 23-Jun-2022 | ISR50998 | Created by: Dung Kieu Vo on 07-Apr-2022 | Modified by: Dung Kieu Vo on 20-Jun-2022 Program Development Objectives PDO Table Program Development Objective (from Program Appraisal Document) The project development objective is to strengthen teacher training institutions to enhance teacher and principal effectiveness through improved continuous professional development. Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Satisfactory Implementation Status and Key Decisions The program was concluded successfully as it fully achieved both program development objectives. All six Lead Teacher Training Universities (LTTUs) achieved the Teacher Education Institution Development Index end target scores. Out of 653,360 respondents to the satisfaction survey on 2021 continuous professional development (CPD) programs, 630,393 rated the 2021 school based CPD support as satisfactory (96.5 percent). According to the Teacher Education Management Information System (TEMIS), more than 477,000 teachers and school principals completed five CPD modules via the Learning Management Systems, and more than 30,000 core teachers and principal advisors were trained on the six CPD modules by the LTTUs to provide school based support to their peers. Forty-five (45) TEMIS reports on teachers’ and school principals’ performance against professional standards, CPD needs and satisfaction with CPD programs were published. The program has disbursed 100 percent of the remaining IDA funding. MOET successfully integrated all ETEP deliverables and, together with the LTTUs, is committed to sustaining ETEP outcomes. The Government will conduct the final stakeholder workshop at the end of June 2022 and finalize the project completion report with feedback received at the stakeholder workshop. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P150060 IDA-58780 Effective USD 95.00 47.65 47.35 48.04 0.00 100% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P150060 IDA-58780 Effective 29-Jun-2016 06-Feb-2017 05-Jun-2017 30-Jun-2022 30-Jun-2022 6/23/2022 Page 1 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) DLI Disbursement Achievement Disbursed amount in Disbursement % for DLI ID DLI Type Description Coc DLI Amount Status Coc DLI Loan: IDA58780-001 Partially DLI2 Regular SYSTEMS ARE IN PLACE XDR 5,000,000.00 1,426,500.00 29 % Achieved NO OF CORE TEACHERS Partially DLI3 Regular XDR 9,232,072.00 3,826,466.00 41 % SELECTED N TRAINED Achieved NO OF CORE TEACHERS DLI4 Regular XDR 2,099,526.00 Fully Achieved 2,099,526.00 100 % PROVDING SBCPD NO OF TEACHERS Partially DLI5 Regular XDR 2,840,000.00 1,440,000.00 51 % SATISFIED WITH ITC Achieved INSTITUTIONAL Partially DLI1 Regular XDR 14,910,000.00 13,910,000.00 93 % CAPACITY OF LTTU Achieved Program Action Plan The Recipient shall develop and execute a Capacity Building Plan for the LTTUs to ensure sustainable provision of Action Description teacher school based continuous professional development support, all in form and substance satisfactory to the Association. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2018 Completed Completion Measurement A Capacity Building Plan developed, costed and executed (in cooperation with LTTUs). Comments The Plan was finalized in December 2019 and was fully executed in 2021. The Recipient shall carry out a study – under the terms of reference acceptable to the Association - to identify options Action Description and recommendations for financing teacher- continuous professional development. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 30-Jun-2020 Completed Completion Measurement Study validated by MOET Comments The study has been conducted with the final draft report submitted to the Bank in January 2021. The Recipient shall disclose information on the Program’s activities to the public, including financial information Action Description throughout the implementation of the Program. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Continuous Completed Completion Measurement Evidence of information disclosure 6/23/2022 Page 2 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Information on the program's activities, including financial information, is disclosed via the PMU/ LTTUs' websites and Comments fan page. PMU issued a guideline in April 2019 on information disclosure, among others, to be followed by PMU/ LTTUs. The Recipient shall maintain a system of receiving, recording and following-up on complaints, including anonymous Action Description ones. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Yearly Completed Completion Measurement Log of complaints and reports. One complaint was received on January 9, 2022, via email and on January 13, 2022, by MOET’s official letter relating Comments to activity under the investment project implemented by Vinh LTTU. The complaint was fully resolved. The Recipient shall maintain a database on complaints and denunciations from all the participating agencies and Action Description follows up on the resolution of those complaints and denunciations. Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Yearly Completed Completion Measurement Database verified MOET is in charge of maintaining the database. One complaint was received on January 9, 2022, via email and on Comments January 13, 2022, relating to activity under the investment project implemented by Vinh LTTU. The complaint was fully resolved. The Recipient shall (a) review LTTUs internal audit capacity; and (b) prepare and execute – or cause to be executed - Action Description plans to build the capacity of internal audit function in LTTUs. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 05-Jun-2019 Completed Internal audit capacity assessed and LTTUs capacity building plans developed, costed, approved and executed (in Completion Measurement cooperation with LTTUs). Comments The action was completed. Action Description The Recipient shall issue guidance on the performance based budgeting/allocation Source DLI# Responsibility Timing Timing Value Status Other Client Recurrent Continuous Completed Completion Measurement Guidance on the performance based budgeting/ allocation was issued by MOET. Comments The action was completed. 6/23/2022 Page 3 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) All proposals for detailed designs, construction supervision and bids for civil works, whether below or above cost Action Description estimates, shall be evaluated; proposals and bids shall not be rejected only on the basis of minor, non-substantive deviations. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous Completed Completion Measurement n/a Comments Complied, as noted in the May-June implementation completion and results report ICR mission. The Recipient shall design and adopt a mechanism – satisfactory to the Association - to coordinate teacher Action Description continuous professional development initiatives and activities among teacher education providers and concerned teacher management department Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2018 Completed Issuance of a circular on teacher continuous professional development which includes the regulated coordination Completion Measurement mechanism. Comments Circular 19/2019/TT-BGDDT was issued on November 12, 2019. At least 60 percent of contracts for consultancies and 85 percent of contracts for works shall be competitively bid Action Description annually. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous Completed Completion Measurement n/a Comments Complied, as noted in the May-June implementation completion and results report (ICR) mission. No contract having cost estimate above the thresholds for using DC/SSS method set forth in the national public Action Description procurement law and regulation will be awarded on DC/SSS basis. Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Recurrent Continuous Completed Completion Measurement n/a Comments Complied, as noted in the May-June implementation completion and results report (ICR) mission. Action Description Firms on the local, national, or Bank debarment list shall not be allowed to participate. Source DLI# Responsibility Timing Timing Value Status 6/23/2022 Page 4 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Fiduciary Systems Client Recurrent Continuous Completed Completion Measurement n/a Comments Complied, as noted in the May-June implementation completion and results report ICR mission. The Recipient shall develop a guideline to facilitate meaningful consultation and inform participation of beneficiary Action Description principals and teachers, including those from ethnic minorities and vulnerable groups. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 05-Jun-2018 Completed Systems Completion Measurement Formal issuance of the guideline Comments The guideline was formally issued in November 2018. The above referenced guideline, which will be implemented by LTTUs should fully operationalize the existing Action Description Vietnamese legislation with respect to ethnic minorities through a process of free, prior, and informed consultations. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 05-Jun-2018 Completed Systems Completion Measurement n/a Comments Complied, as noted in the May-June implementation completion and results report ICR mission. Action Description The Recipient will prepare an Operational Manual. Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 05-Jun-2017 Completed Completion Measurement OM agreed by the Bank Comments This action was completed. Action Description The Recipient will execute the Operation according to the Manual. Source DLI# Responsibility Timing Timing Value Status Technical Client Recurrent Continuous Completed Completion Measurement Implementation Support Missions will review implementation quality Complied with good implementation progress, as noted in the May-June implementation completion and results report Comments ICR mission. 6/23/2022 Page 5 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Low Low Macroeconomic -- Low Low Sector Strategies and Policies -- Low Low Technical Design of Project or Program -- Moderate Moderate Institutional Capacity for Implementation and -- Moderate Low Sustainability Fiduciary -- Moderate Moderate Environment and Social -- Low Low Stakeholders -- Low Low Other -- Moderate Low Overall -- Low Low RiskComments Comments The program has ended with two program development objectives (PDO) and three out of four intermediate result (IR) indicators fully achieved. The program sustainability is likely. Therefore institutional capacity for implementation and sustainability is downgraded to Low. Results PDO Indicators by Objectives / Outcomes Strengthened teacher education institutions to enhance teacher and principal effectiveness IN01127407 ►Improved performance of the six Lead Teacher Training Universities to provide CPD as measured by the Teacher Education Institutional Development Index (TEIDI) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Hanoi LTTU 5.00; Thai Hanoi LTTU 5.35; Thai Nguyen LTTU 4.74; Nguyen LTTU 5.35; Vinh Vinh LTTU 4.88; Hue TEIDI score of each Baseline established for Value LTTU 5.56; Hue LTTU LTTU 4.95; Danang LTTU increases to at each LTTU 5.0; Danang LTTU 5.11; LTTU 4.88; HCMC least level 5 (>4.43) HCMC LTTU 5.18. LTTU 4.73. Date 31-Dec-2017 31-Dec-2021 15-May-2022 30-Jun-2022 Achieved (100 percent) By May 15, 2022, six LTTUs’ TEIDI scores were verified to have exceeded the end target of level 5 (i.e. over Comments 4.43). 6/23/2022 Page 6 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) IN01127408 ►Number of teachers and principals satisfied with school-based continuous professional development (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 541,696.00 630,393.00 320,000.00 Date 30-Jun-2016 31-Dec-2021 15-May-2022 30-Jun-2022 Achieved (179 percent). 630,393 teachers/ principles/ core teachers and principal advisors rated the school-based CPD in Comments 2021Satisfactory vs. 2021 target of 320,000. The result has been verified with initial data processing by IVA. Intermediate Results Indicators by Results Areas Improved capacity of Lead Teacher Training Universities to enhance teacher and principal effectiveness IN01127409 ►Number of LTTUs that sign Performance Agreements with MOET. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 6.00 6.00 6.00 Date 30-Jun-2016 31-Dec-2021 15-May-2022 30-Jun-2022 Achieved (100 percent). Six Performance Agreement (PAs) were signed between MOET and LTTUs, and the PAs/ revised PAs were Comments verified by the IVA. Development of teacher and principal training needs assessment system to informed CPD program development IN01127410 ►Number of TEMIS-generated annual reports on CPD needs by DOET. (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 47.00 45.00 45.00 Date 30-Jun-2016 31-Dec-2021 15-May-2022 30-Jun-2022 Achieved (100 percent). 45 reports (vs. the 2021 target of 45) were generated from the Teacher Education Management Information System (TEMIS) on CPD needs by DOET. All reports were reported to have met the quality set by the program. Comments The result has been verified with the first draft report from IVA. School-based and continuous professional development for teachers and principals IN01127431 ►Number of deployed core teachers and/ or principal advisors having completed different priority training modules set for the year (Text, Custom) 6/23/2022 Page 7 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Baseline Actual (Previous) Actual (Current) End Target No core teachers/ 24,000 core teachers and 22,549 core teachers 28,600 core teachers principal advisors principal advisors have and principal advisors and principal advisors Value completed any training completed six mandatory have completed six having completed six modules modules. mandatory modules. modules Date 30-Jun-2016 31-Dec-2021 15-May-2022 30-Jun-2022 Partially achieved (79 percent) The six LTTUs were reported to have provided training on six mandatory modules to 30,127 deployed core teachers and principal advisors, vs end target of 28,600. Based on the initial verification result, 79 percent of Comments the end target of 28,600, or 22,549, is expected to be achieved by June 30, 2022. Final verification reports will be finalized by June 27, 2022. Teachers and principals have access to CPD programs and resources through a ICT based system IN01127432 ►Number of teachers and school principals having completed different mandatory online modules of the CPD program set for the year through the Learning Management System(s) (LMS(s)) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target 519,465 teachers and school principals completed four out of five 477,922 teachers and No teachers/ principals mandatory online school principals 480,000 teachers/ having completed any modules and 220,469 completed five school principals Value online module of the CPD teachers and school mandatory online having completed five program through the principals completed all modules through the modules through the LMS(s) five mandatory online Learning Management LMS(s) modules through the Systems (LMS). Learning Management Systems (LMS). Date 30-Jun-2016 31-Dec-2021 15-May-2022 30-Jun-2022 Achieved (99.6 percent). 477,922 teachers and school principals completed five mandatory online modules through the Learning Management Systems (LMS) (vs. the end target of 480,000 teachers and school principals completed all five mandatory modules). Comments The result is verified with data already processed by IVA. Final verification report will be provided by June 27, 2022. Disbursement Linked Indicators DLI_IND_TABLE ►DLI 1 Institutional capacity of LTTUs to support the new Continuous Professional Development system for teachers and principals enhanced (Output, 24,693,495.00, 43%) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 Up to six LTTUs Six out of eight LTTUs Six out of eight LTTUs conduct an annual LTTUs have inadequate have conducted annual have conducted annual TEIDI assessment capacity to support the TEIDI-self assessments, TEIDI-self assessments, Value and MOET continuous professional and the MOET has and the MOET has publishes the TEIDI development published the TEIDI published the TEIDI scores on its scores on its websites. scores on its websites. website. Date 30-Jun-2016 31-Dec-2021 31-Mar-2022 -- Comments Achieved (100 percent) 6/23/2022 Page 8 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Six out of eight LTTUs have conducted annual TEIDI self-assessments, and the MOET has published the TEIDI scores on its websites vs the period 5 target of six. IVA completed the final verification reports for 4 LTTUs’ TEIDI self-assessment reports (Hà Nội, Huế, Đà Nẵng, Thái Nguyên). Final draft reports of the remaining two (Vinh, HCMC) will be completed by June 27, 2022. ►DLI 2 Systems are in place to:(i)measure whether teachers/principals meet new professional standards;(ii) track & record evaluations of CPD programs;(iii) record assessments CPD needs of teachers/principals (Output, 16,487,091.00, 0%) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 Up to forty-five DOETs publish a TEMIS-generated CPD annual report for its respective province. The annual reports present trends on professional standards, beneficiary assessments of Existing systems to assess CPD programs and teacher and principal CPD assessments of needs are not aligned with CPD needs of requirements of the teachers and 47 TEMIS -generated 45 TEMIS -generated fundamental and principals. MOET Value CPD annual reports were CPD annual reports were comprehensive education establishes an in- published. published. reform (FCER) nor house Teacher adequately inform the Education development of CPD Management programs. Information System (TEMIS) that: (i) tracks teacher and principal professional standards rating; (ii) records beneficiary evaluations of CPD programs and interventions; and (iii) records teacher and principal CPD needs. Date 30-Jun-2016 31-Dec-2021 31-Mar-2022 -- Achieved (100 percent) 45 TEMIS reports were generated vs the period 5 target of 45. The July 2021 mission acknowledged the fact that the MOET, by Decision No.2164/QD-BGDĐT, dated 29 June 2021, decided to cancel the development of the MOET in-house TEMIS, given the remaining time for ETEP implementation is too short to have such a system developed within the program timeframe, and given MOET has already had a plan to develop an Information and Communication Technology (ICT) master plan for the sector which shall include the development of the teacher and principal education management Comments information system. The assessment of the DLRs under the disbursement linked indicator (DLI) #2, achieved in period 5, has taken into account this cancellation. Funding relating to this DLR of the MOET in-house TEMIS was already cancelled in April 2022. The result is verified with the first draft report by IVA. Final verification report is expected by June 27, 2022. 6/23/2022 Page 9 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) ►DLI 3 Number of core teachers and principal advisors selected and trained to provide systematic face-to-face school based CPD to teachers and principals (Output, 14,242,800.00, 0%) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 A corps of trained school- 24,000 (including LTTUs provide based specialists that approximately 21,500 25,600 core teachers and basic training to provide systematic face-to- core teachers and 2,500 principal advisors have Value 25,000 core face school-based CPD to principal advisors) have been trained on six teachers and 3,600 teachers and principals been trained on six mandatory modules. principal advisors does not exist. mandatory modules. Date 30-Jun-2016 31-Dec-2021 31-Mar-2022 -- Partially achieved (89 percent) 30,127 deployed core teachers and principal advisors vs. the period 5 target of 28,600 were trained with six CPD modules of 1,2,3,4,5, and 9. However, given the past/ ongoingverification results, only 89 percent of the Comments period 5 target, or 25,600, is expected to be achieved. The result is partially verified. Final verification report is expected by June 27, 2022. ►DLI 4 Number of core teachers and principal advisors providing school-based continuous professional development to teachers and principals (Output, 10,168,614.00, 0%) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 Up to 25,000 core teachers and 3,600 principal advisors A corps of trained 13,785 (including 13,689 provide school- 28,288 core teachers and specialists that provide core teachers and 87 based continuous principal advisors have systematic fact-to-face principal advisors) have professional Value provided school-based school-based CPD to provided school-based development to CPD to teachers and teachers and principals CPD to teachers and teachers and principals. does not exist. principals. principals during period 5, as per their individual annual plan. Date 30-Jun-2016 31-Dec-2021 31-Mar-2022 -- Partially achieved (98.9 percent) 28,288 core teachers and principal advisors provided school-based peer support vs. the target of 28,600 . The result is verified with first draft verification report by IVA. Final verification report is expected by June 27, Comments 2022. ►DLI 5 Number of teachers and principals who are satisfied with ICT-based interactive CPD services provided under the program (Output, 6,231,069.00, 0%) From April 2021 to Baseline Actual (Previous) Actual (Current) March 2022 541,696 teachers and 608,000 teachers and Up to 320,000 principals are satisfied principals are satisfied teachers and with ICT-based with 2021 ICT-based principals are Value 0.00 interactive CPD services interactive CPD services satisfied with ICT- provided under the provided under the based interactive program program CPD services Date 30-Jun-2016 31-Dec-2021 31-Mar-2022 -- 6/23/2022 Page 10 of 11 The World Bank Implementation Status & Results Report Vietnam Enhancing Teacher Education Program (P150060) Achieved (190 percent) 608,000 teachers and principals are satisfied with ICT-based interactive CPD services provided under the program vs the period 5 target of 320,000. Comments The result is verified with data processing by IVA. Final verification report is expected by June 27, 2022 6/23/2022 Page 11 of 11