The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Odisha Higher Education Program for Excellence and Equity (P160331) SOUTH ASIA | India | Education Global Practice | Requesting Unit: SACIN | Responsible Unit: GED06 IBRD/IDA | Program-for-Results Financing | FY 2018 | Team Leader(s): Kurt Larsen, Sangeeta Dey Seq No: 4 | ARCHIVED on 11-Mar-2019 | ISR34910 | Created by: Kurt Larsen on 15-Nov-2018 | Modified by: Kurt Larsen on 26-Feb-2019 Program Development Objectives Program Development Objective (from Program Appraisal Document) The development objective of the Program is to improve the quality of and students' equitable access to selected institutions and enhance governance of the higher education system in Odisha. Overall Ratings Name Previous Rating Current Rating Progress towards achievement of PDO Satisfactory Satisfactory Overall Implementation Progress (IP) Satisfactory Satisfactory Implementation Status and Key Decisions The third supervision implementation mission was held during February 4 - 8, 2019. The project is on track and implementing most activities on schedule. The Higher Education Department in Odisha has selected the second round of Higher Education Institutions including 70 colleges and 5 universities, and is expected to sign Memorandum of Understandings with them by mid-May 2019. The PMU has committed to speeding up the activities in implementation of civil works and in completion of CAPA data entry by the colleges, for which the progress has been slow since the last mission. The selected Independent Verification Agency will submit the verification report on year 2 disbursement linked indicators (DLIs) by May 31, 2019. Given that there is a good overall progress on the project activities and all the Year 1 DLI targets have been met, the ratings for the PDO and the IP are satisfactory. Data on Financial Performance Disbursements (by loan) Project Loan/Credit/TF Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P160331 IBRD-87820 Effective USD 119.00 119.00 0.00 18.51 100.49 16% Key Dates (by loan) Project Loan/Credit/TF Status Approval Date Signing Date Effectiveness Date Orig. Closing Date Rev. Closing Date P160331 IBRD-87820 Effective 31-Aug-2017 07-Nov-2017 07-Dec-2017 30-Nov-2022 30-Nov-2022 Program Action Plan 3/11/2019 Page 1 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Program related: Consultants for M&E, capacity building and faculty development recruited to the PMU Action Description Completion Measurement: Contracts signed Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 31-May-2017 Completed Completion PMU is staffed Measurement Comments Program related: HED MIS operational Action Description Completion Measurement: MIS reports available Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 31-Aug-2018 Completed Completion MIS Functional Measurement Comments Program related: Needs assessment for short-term faculty training programs completed Action Description Completion Measurement: Needs assessment report published on the HED website Source DLI# Responsibility Timing Timing Value Status Technical Client Due Date 31-Mar-2019 Completed Completion Report received Measurement Comments FM and Procurement: Executive order issued by the HED mandating the use of online FM system at the all government-aided colleges in Action Description Odisha Completion Measurement: Executive Order published on the HED website Source DLI# Responsibility Timing Timing Value Status Client Due Date 31-Mar-2018 Completed Completion Measurement 3/11/2019 Page 2 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Comments FM and Procurement: Model Finance Rules for colleges developed and recommended for adoption Action Description Completion Measurement: Executive order issued recommending Model Finance Rules for adoption and made available on the HED website Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 31-Oct-2018 In Progress Completion Executive order issued recommending Model Finance Rules for adoption and made available on the HED website Measurement HED has constituted a Committee to develop the model Finance Rules for Colleges. The Committee is chaired by the Comments retired FA cum Special Secretary HED and the work is in progress. FM and Procurement: Procurement Manual prepared by the GoO adopted by the HED Action Description Completion Measurement: Manual disseminated to all colleges in the state Source DLI# Responsibility Timing Timing Value Status Fiduciary Systems Client Due Date 31-Aug-2018 Completed Completion Manual received Measurement Comments FM and Procurement: FM and Procurement training to nominated staff of selected institutions Action Description Completion Measurement: Training on use of manuals to all colleges in the state Source DLI# Responsibility Timing Timing Value Status Client Due Date 07-Dec-2019 In Progress Completion Measurement Comments Action Description Governance and Accountability: Strengthening the vigilance cell in the HED 3/11/2019 Page 3 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Completion Measurement: Strengthening the vigilance cell in the HED to handle procurement complaints Source DLI# Responsibility Timing Timing Value Status Client Due Date 31-Mar-2018 Completed Completion Measurement Comments Social and environment actions: MoUs for HEIs should incorporate at least two to three specific actions to improve enrolment, retention and on-time Action Description graduation for the SC, ST and female students completion measurement: PMU Annual Report Source DLI# Responsibility Timing Timing Value Status Client Due Date 07-Dec-2017 Completed Completion Measurement Comments Social and Environment actions: HEIs should ensure functional GRM cells, Equal Opportunity Cells and Women Harassment Redressal Cells with Action Description adequate students and faculty representation in selected institutions Completion Measurement:PMU annual Report Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Recurrent Yearly Completed Systems Completion PMU annual report Measurement Comments Social and Environment Actions: Inclusion of the Environment Audit and Management Plan as part of the MoUs of selected universities/colleges Action Description Completion Measurement: Inclusion in MoUs with universities/colleges Source DLI# Responsibility Timing Timing Value Status Client Due Date 07-Dec-2017 Completed 3/11/2019 Page 4 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Completion Measurement Comments Social and Environment Actions: Inclusion of EHS aspects in bidding documents of the construction agencies Action Description Completion Measurement: Inclusion in bid documents of the construction agencies Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 30-Sep-2018 In Progress Systems Completion Inclusion of EHS aspects in bidding documents of the construction agencies Measurement Comments The bidding documents have not yet been prepared Social and Environment Actions: Capacity building of relevant staff of universities, colleges, the HED, and construction agencies to ensure awareness Action Description of and adherence to the existing legal and regulatory provisions. Completion Measurement: PMU A.R. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Recurrent Yearly In Progress Systems Completion Awareness and training done Measurement Comments The civil works have not started yet Social and Environment Actions: Strengthening insttl. and monitoring systems of HED/HEIs to adequately capture env. dimension thro' designation of Action Description an Env. Officer in PMU and assigning EHS functions to Bldg mgt Committee with HEIs. Source DLI# Responsibility Timing Timing Value Status Environmental and Social Client Due Date 07-Dec-2017 Completed Systems Completion Staff in place Measurement Comments 3/11/2019 Page 5 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Risks Systematic Operations Risk-rating Tool Risk Category Rating at Approval Previous Rating Current Rating Political and Governance -- Substantial Substantial Macroeconomic -- Moderate Moderate Sector Strategies and Policies -- Moderate Moderate Technical Design of Project or Program -- Substantial Moderate Institutional Capacity for Implementation and Sustainability -- Substantial Substantial Fiduciary -- Substantial Substantial Environment and Social -- Moderate Moderate Stakeholders -- Moderate Moderate Other -- -- -- Overall -- Substantial Moderate RiskComments Comments The risk rating of the Technical Design of the project is downgraded from the previously rated substantial rating to a moderate rating currently, as the implementation progress is satisfactory. Consequently, the overall risk of OHEPEE has been downgraded to moderate. Results PDO Indicators by Objectives / Outcomes Improve the quality of selected institutions IN00648338 ►Improved quality of selected government and government-aided institutions. Percentage of selected colleges that have improved their NAAC grade from the previous cycle of accreditation. (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 20.00 20.00 20.00 35.00 Date 01-Apr-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments Improve the students' equitable access to selected institutions IN00648339 ►Improved student outcomes. 1) Percentage of on-time graduation rate of students in undergraduate degree programs in selected institutions( total students) (Amount(USD), Custom) Baseline Actual (Previous) Actual (Current) End Target 3/11/2019 Page 6 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Value 60.00 60.00 60.00 70.00 Date 01-Aug-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments IN00648346 ►Improved student outcomes. 2) Percentage of on-time graduation rate of students in undergraduate degree programs in selected institutions(SC) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 51.00 51.00 51.00 61.00 Date 01-Aug-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments IN00648347 ►Improved student outcomes. 3) Percentage of on-time graduation rate of students in undergraduate degree programs in selected institutions(ST) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 42.00 42.00 42.00 52.00 Date 01-Aug-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments IN00648348 ►Improved student outcomes. 4) Percentage of on-time graduation rate of students in undergraduate degree programs in selected institutions(women) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 67.00 67.00 67.00 77.00 Date 01-Aug-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments Enhance governance of the higher education system in Odisha IN00648340 ►Revised regulations on the creation/composition of Governing Bodies (GBs) and their functionning issued by the HED and percentage of affiliated government-aided colleges that implement the regulations (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target The guidelines have The guidelines are been issued by the GoO 90 % of colleges Value N.A. expected to be issued by and 40% of the colleges implement the revised Nov. 2018 have implemented the guidelines (GO). revised guidelines. Date 01-Aug-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments Intermediate Results Indicators by Results Areas 3/11/2019 Page 7 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Results Area 1: Improving quality of and students' equitable access to selected institutions IN00648349 ►Number of project beneficiaries (students) disaggregated by gender (core) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 661,700.00 727,800.00 793,548.00 827,200.00 Date 01-Apr-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments IN00648352 Number of project beneficiaries (female) (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target Value 333,600.00 367,000.00 385,835.00 417,000.00 Date 01-Aug-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 IN00648353 ►Annual performance milestones met by the HED and selected institutions (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 40.00 75.00 Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments IN00648355 ►Percentage of sanctioned posts filled with regular faculty in selected institutions (Core) (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 74.00 84.00 84.00 95.00 Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments IN00648356 ►Number (cumulative) of faculty and administrators in degree colleges and state universities who completed a short-term training program (by gender) (Core) (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 250.00 395.00 896.00 13,000.00 Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments IN00648357 Number (cumulative) of female faculty and administrators in degree colleges and state universities who complete a short- term training program (Number, Custom Breakdown) Baseline Actual (Previous) Actual (Current) End Target 3/11/2019 Page 8 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Value 85.00 150.00 290.00 4,300.00 Date 01-Aug-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 IN00648358 ►Number of affiliating universities that establish an online evaluation system for examinations (Number, Custom) Baseline Actual (Previous) Actual (Current) End Target Value 0.00 0.00 0.00 6.00 Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments IN00648359 ►Evaluation of the curriculum implementation (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value Evaluation to be done In progress Evaluation done. Evaluation conducted Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 31-Mar-2020 Comments IN00648360 ►Improved satisfaction levels of beneficiaries (students and faculty) in selected institutions (core) (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target End-term satisfaction Expected to be survey conducted. Expected to be launched completed and results Satisfaction levels of Value n.a. by Sep. 2018 disseminated by March stakeholders increased 31, 2019 by 20% over the baseline Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 31-Mar-2022 Comments Results Area 2: Enhancing governance of the higher education system IN00648350 ►The HED's MIS strengthened up to the specified standards (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target Value n.a. Expected by Sep. 2018 MIS functional MIS functional. Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 31-Mar-2019 Comments IN00648351 ►Percentage of selected government-aided colleges that completed data entry using online FM system (Percentage, Custom) Baseline Actual (Previous) Actual (Current) End Target 3/11/2019 Page 9 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Value 0.00 5.00 0.00 95.00 Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 31-Mar-2020 The World Bank team agreed that given the legacy issues with CAPA, the present benchmark of less than 30 days of backlog in data entry is too ambitious and difficult to achieve. Based on HED’s request, the mission agreed to seek the necessary approvals with the World Bank management to extend the timeline to Comments less than 180 days. This would increase the percentage of government-aided colleges that completed data entry using online FM system to around 20 percent. IN00648354 ►Governance benchmarking score card exercise (Text, Custom) Baseline Actual (Previous) Actual (Current) End Target First round Institutional First round carried out by reports to be complete Value n.a. exercise carried out March 2019 and shared with HEIs by March 31, 2019 Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 31-Mar-2021 Comments Disbursement Linked Indicators DLI_IND_TABLE ►DLI 1 DLI1: Improved quality of selected institutions (Percentage of selected colleges that have improved their NAAC grade from the previous cycle of accreditation) (Output, 18.00, 0%) Baseline Actual (Previous) Actual (Current) 2022 Value 20.00 0.00 0.00 -- Date 31-Mar-2018 12-Jul-2018 12-Feb-2019 -- Comments ►DLI 2 DLI2: Improved student performance. Increased on-time graduation rate of students in undergraduate degree programs in selected institutions (disaggregated by women, ST, SC, and total students) (Process, 20.00, 0%) Baseline Actual (Previous) Actual (Current) 2022 Value 60.00 0.00 0.00 -- Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 -- Comments ►DLI 3 DLI3: Annual performance milestones met by the HED and selected institutions (Process, 38.00, 11%) Baseline Actual (Previous) Actual (Current) 2022 Value 0.00 4.00 40.00 -- 3/11/2019 Page 10 of 11 The World Bank Implementation Status & Results Report Odisha Higher Education Program for Excellence and Equity (P160331) Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 -- Comments ►DLI 4 DLI4: Revised regulations on the creations/composition of GBs and their functioning issued by the HED and percentage of affiliated government-aided colleges that implement the regulations (Output, 18.00, 33%) Baseline Actual (Previous) Actual (Current) 2022 Value 0.00 0.00 40.00 -- Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 -- Comments ►DLI 5 DLI5: Improved fiduciary management in selected institutions: Percentage of selected institutions that completed data entry using online FM system (Online accounting system) (Output, 10.00, 40%) Baseline Actual (Previous) Actual (Current) 2022 Value 0.00 4.00 0.00 -- Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 -- For the upcoming years, the PMU has requested the Bank management to consider revising the target of 30 Comments days to 180 days. ►DLI 6 DLI5: Part 2: Enhanced procurement management (Output, 10.00, 40%) Baseline Actual (Previous) Actual (Current) 2022 Value 0.00 4.00 0.00 -- Date 04-Dec-2017 12-Jul-2018 12-Feb-2019 -- It is too early to measure this DLI. It will be done closer to the end of March 2019. It is expected that this DLI Comments will be met. 3/11/2019 Page 11 of 11