68354 TRAINING ON INFRASTRUCTURE FINANCE IN PUBLIC PRIVATE PARTNERSHIP PROJECTS 20 July, 2010 Final Report ORIGINAL Submitted by: Cambridge Economic Policy Associates Ltd FINAL REPORT CONTENTS 1. Introduction ................................................................................................................. 3 2. The Course ................................................................................................................... 4 3. The Participants ........................................................................................................... 6 4. Participant Evaluation ................................................................................................. 7 5. Course Evaluation........................................................................................................ 8 6. Conclusions ................................................................................................................. 10 Annex 1: Participant Attendance ........................................................................................ 11 Annex 2: Ideas for Further Courses .................................................................................... 14 FINAL REPORT 1. INTRODUCTION Cambridge Economic Policy Associates (CEPA) was selected to provide a training course on Infrastructure Finance for the State Bank of Pakistan (SBP), co-funded by the World Bank. The course was held at the SBP’s Learning and Resource Centre (LRC) at Karachi, Pakistan, From Monday July 12th to Friday July 16th, 2010. This final report provides: • an overview of the final course provided (Section 2); • a summary of the participants (Section 3); • the results of two assessments (one of the learning arising from the training and one relating to the provision and coverage of the course – Sections 4 and 5); and • some conclusions and next steps (Section 6). CEPA and the team that provided the course would like to thank the SBP and the participants of the course for their support, active involvement and feedback. All these things made the course, in our view, a success. We would also like to thank the staff at the LRC and believe that the facilities available at the LRC created an environment which made the provision of the course possible. 3 FINAL REPORT 2. THE COURSE Following an Inception Report a final outline for the five day course was agreed which built on an earlier proposal provided by the World Bank Institute. Figure 2.1 provides an overview of the final course outline. The course was structured around: • initially developing key concepts relating to Project Finance and PPPs; • considering the way that core ideas, such as Risk Transfer, are implemented and what they mean for each of the stakeholders; • establishing the tools that can be used to evaluate the core issues, especially the Financial Model; and • using examples of the tools and concepts to cement the understanding of the concepts. This is reflected in the build-up of the course through plenary sessions, case studies and exercises, culminating in a morning long computer based exercise on the final day, evaluating a proposed PPP project. Where possible examples from Pakistan and more broadly across South Asia were used to illustrate issues. However, these needed to be supplemented with broader experience owing to the lack of detailed case studies available. In addition, a CD was provided to all participants. This included: • copies of all the slides used; • a copy of the financial model used for the final exercise; and • background papers that covered the issues considered in the course. The SBP also provided hard copies of all slides and exercise documentation for participants at the beginning of the course. 4 FINAL REPORT Table 2.1: Course outline Session Monday Tuesday Wednesday Thursday Friday 1) 8:30 to 9:00 Registration Recap and intro Recap and intro Recap and intro Recap and intro 2) 9:00 to 10:15 Introduction & Plenary 5 Plenary 10 Plenary 13 Exercise 2 welcoming remarks Sources of Finance Financial Modelling I Fiscal risk Risk allocation and management & PPPs funding (1) 3) 10:15 to 10:45 (T) 4) 10:45 to 12:00 Plenary 1 Plenary 6 Plenary 11 Case study 2 Exercise 2 Project Finance PPP project risks I Financial Modelling II Risk allocation and Risk allocation and mitigation in a road funding (2) project 5) 12:00 to 13:00 Plenary 2 Plenary 7 Case study 1 Plenary 14 Exercise 2 Public Private PPP project risks II Example of a Description of the Risk allocation and Partnerships financial model for Concession funding (3) roads Agreement 6) 13:00 to 14:00 (L) 7) 14:00 to 15:00 Plenary 3 Plenary 8 Plenary 12 Plenary 15 Exercise 2 Public Sector ‘for & Project Feasibility Weighted Cost of Contract Award Group report back against’ PPPs Capital (WACC) methods on exercise 8) 15:00 to 15:30 (T) 9) 15:30 to 16:30 Plenary 4 Plenary 9 Exercise 1 Evaluation Final summing up Requirements for a Value for Money Assessing the successful PPP viability of a project Programme proposal 10) 16:30 to 17:00 Wrap-up Wrap-up Wrap-up Wrap-up Wrap-up 5 FINAL REPORT 3. THE PARTICIPANTS The SBP made the course available to a range of stakeholders in Pakistan as well as SBP staff, including: • Commercial banks; • Government agencies and Development Finance Institutions; and • Other companies, potential sponsors etc. Over 60 participants registered for the course, with over 50 actually attending. Information on the participants is provided in table 3.1. Table 3.1: Attendance Type Booked No. of people Institutions SBP 14 1 GoP 5 3 Commercial Banks 37 14 DFIs 7 4 Other 2 2 Total 65 24 Final attendance was actually 57 of the 65 who had booked. As is ever the situation with a long course, attendance did vary during the week. However, the average number of days attendance for each participant was 4.3 (for those people who attended at least one day of the course) and 41 participants attended every day of the course. 6 FINAL REPORT 4. PARTICIPANT EVALUATION One issue that CEPA was asked to assess was the impact of the course on attendees. Ideally this sort of evaluation would be undertaken through a test that is implemented twice, once at the beginning of a course and once at the end (what the World Bank Institute refers to as a level 2 assessment). Rather than this detailed level 2 assessment a simpler level 1 assessment was undertaken – this was through a single test towards the end of the course. While this does not allow the impact of the course to be directly evaluated (through the change in the scores of the participants) it does allow for an assessment of whether a level of understanding had been achieved. Further, we viewed the test as a way of establishing whether there were areas that had been taught on the course which required clarification or correction rather than testing how well participants remembered issues – so the test was also undertaken on an open-book basis. The dispersion of results of the test are shown in the following figure. It should be noted that the maximum score was 15 (no-one scored this but two people did score 14.5). Figure 4.1: Dispersion of participant scores 12 10 8 6 4 2 0 Below 8 8 to 10 10 to 12 Above 12 The average mark was 10.66. 7 FINAL REPORT 5. COURSE EVALUATION Apart from evaluating the participants, a questionnaire was circulated to help assess the course in terms of content, presentations and presenters. Table 5.1 summarises the responses to the general questions raised in the questionnaire. Table 5.1: Summary of responses Question Responses Absolute Percentage Yes No Yes No Was the course what you expected? 30 23 7 77 23 Were the case studies useful? 30 29 1 97 3 Were the exercises useful? 28 25 3 89 11 Were the slides clear? 30 24 6 80 20 What is clear is that the course met the expectations of the majority of respondents (who were in turn over half the attendees). For those respondents who did not think expectations were met the majority focused on issues around practical experience and examples, wanting more hands- on aspects to the course. This was clearly supported through the significant support for the case study and exercise aspects of the course, shown through the second and third questions. While we are clearly aware of the problems that a primarily plenary based course raise, and the frustration that this can cause, the course was designed to: • cover a wide range of subjects – hence the need for significant plenary time; and • be accessible to a large group – the expected numbers were between 50 and 60 – which makes practical sessions difficult. Future courses that can either focus on a more specific issue or have a smaller number of participants could address some of the concerns raised by participants – the computer room at the LRC has 15 computers and would ideally have only one or two people working on a screen (depending on the type of course – that would bring the participant numbers down significantly compared to the numbers at this course). Possible future courses were an issue also raised in the questionnaire and the responses to this are discussed below. The final general question related to the slides. While the majority of people found the slides acceptable there were some general concerns about the font size and amount of information on the slides. These are issues that can be addressed if future courses are held. With respect to the speakers, feedback was requested. For the majority of respondents no issues were raised. A few requested that speakers should speak more slowly. Many of the respondents provided suggestions for further courses – a comprehensive list is provided as annex 2. Issues identified by multiple attendees included: • financial modelling – related to more hands-on development of models (something that would be possible with the resources available at the LRC; • power sector issues – including more about IPPs, especially as this is an area where Pakistan has been particularly active; 8 FINAL REPORT • other sector issues – as per the power sector issue above, each of the sectors have specific issues and examples that could be investigated; • Pakistan case studies – learning lessons from relevant case studies can be helpful, although work would be required to develop the case studies outside of the power sector; • documentation issues – ranging across more detailed investigations of concession documents, other legal documents etc; and • Shariah compliant issues – how infrastructure financing can be made Shariah compliant. 9 FINAL REPORT 6. CONCLUSIONS This report has summarised the results of the course provided by CEPA during July 2010. We believe that the results show that the course was a success. Several possible interesting areas for further courses were identified by participants. These are things that the World Bank, SBP and other relevant agencies in Pakistan should consider. We would be happy to help develop course outlines and deliver courses where appropriate. Finally, the support of the SBP and the facilities available at the LRC helped make the course a success. Again we would like to thank our hosts for all their help and support. 10 FINAL REPORT ANNEX 1: PARTICIPANT ATTENDANCE 11 FINAL REPORT 12 FINAL REPORT 13 FINAL REPORT ANNEX 2: IDEAS FOR FURTHER COURSES Disclosure requirements Legal and regulatory framework for infrastructure financing Shariah compliant modes for infrastructure financing (x2) Contractual frameworks Power sector issues (esp IPPs x3) Pakistan case studies (x2) Financial modelling (x2) Concession agreements Bid evaluation Legal documentation Quantifying risk in the discount factor Sector wise issues (x2) Financial aspects of PPP International case studies Project documentation 14