75532 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making Conference Edition (unedited) Human Development Department East Asia and Pacific Region KEMENTERIAN PENDIDIKAN NASIONAL TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making Conference Edition (unedited) Human Development Department East Asia and Pacific Region Table of Contents Table of Contents Continuing Professional Development Recognition of Prior Learning (RPL) 69 71 Teacher Appraisal and Career Development 77 3.2. Conclusions 85 Introduction 7 Chapter 4 The Impact of the Reform on Teacher Quality and Student Outcomes 87 Chapter 1 Indonesia as a Case Study for Comprehensive Teacher Reform 14 4.1. The Certification Tool 87 1.1. The Status of the Teaching Profession in Indonesia 14 4.2. Certification, recruitment, and the attractiveness of the teaching profession 89 1.2. The Situation of Indonesian Education before Teacher Reform 16 4.3. Certification as a financial incentive for academic upgrading 94 The Low Status of Teachers 18 4.4. Impact of the certification process and the professional allowance: Supply and Distribution Issues 21 Evidence from a randomized field experiment 102 Low Level of Student Outcomes 22 4.5. Conclusions 109 1.3. Key Triggers for Reform 23 1.4. Major Components of the Teacher Law of 2005 24 Chapter 5 Looking inside the Classroom Black Box 111 1.5. The Political-Economic Context of the Teacher Law 26 5.1. Teacher Classroom Practice 111 1.6. Conclusions 33 5.2. Methodology and Analytical Approach 112 5.3. Findings: Practices in Terms of Usage and in Relation to Student Learning 113 Chapter 2 Teachers as the Cornerstone of Education Quality 34 Time spent on Mathematics 115 2.1. A Definition of Education Quality 34 Teaching Approaches 118 2.2. A Conceptual Framework for Teacher Quality 36 Breakdown of public (whole class) time by participants 120 Defining a good teacher 36 The Context and Language of Problems and their Solutions 122 Process-Product Function 36 5.4. Impact of the Reforms 127 Teacher Knowledge and Classroom Behavior 38 Do certified teachers teach any differently? 127 Conceptual Framework for Quality Education: Is there a relationship between teacher education level and student outcomes? 129 Managing and Developing Good Teachers 40 Does degree type have a relation to teaching? 129 The Political and Financial Context 41 Teacher Knowledge 132 Recruitment 41 5.5. Conclusions 135 Pre-service Teacher Education 42 Induction, Mentoring, and Probation 43 Chapter 6 The Impact of the Reforms on the Efficiency and Equity of Public Spending 138 Certification 44 6.1. Introduction 138 Continuing Professional Development 45 6.2. What reforms were introduced? 139 Teacher Appraisal and Career Development 46 6.3. The Impact of Reform 140 2.3. Teacher Reform around the World 47 Effects on teacher supply 140 Effects on public spending 141 Chapter 3 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes 50 Effects on the efficiency of teacher use 147 3.1. The Laws and Regulations Supporting Teacher Reform 50 Effects on the composition of the teaching force 151 Setting Standards 57 Effects on teacher distribution 156 Recruitment 57 6.4. Conclusions 159 Training Pathways Available to Indonesian Teachers 57 Pre-service Teacher Education 60 Chapter 7 Conclusions and Recommendations 160 The Post-graduate Professional Teacher Training Course 65 Induction, Mentoring and Probation 68 References 170 ii TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making iii Table of Contents List of Figures Lis Figure 1.1 Relative primary school teacher wages by qualification level, 2004 19 Figure 5.10 Relationship of problem approach categories with student learning outcomes 125 Figure 1.2 Cross-country comparisons of student-teacher ratios pre-reform, 2003 20 Figure 5.11 Analysis of differences in teaching practices used by Figure 1.3 Education levels of primary school teachers by location, 2005 22 certified teachers vs. uncertified teachers 128 Figure 1.4 Indonesian PISA scores 2000-2009 23 Figure 5.12 Relationship of teacher degree to student learning outcomes 130 Figure 2.1 Conceptual Framework for Quality Education 40 Figure 5.13 Teaching Practices of teachers with a Mathematical Education Degree 132 Figure 3.1 Teacher shortfall in remote areas 2011 67 Figure 5.14 Relationship between Teacher Knowledge and Student Learning 133 Figure 3.2 Open University Student Enrolments by Faculty June 2009 70 Figure 5.15 Teaching Practices of Teachers with Higher Knowledge (Teacher Assessment) 134 Figure 3.3 Changing Activities in Local Teacher Working Groups 2007-2010 75 Figure 6.1 Average lifetime monthly salary for teachers and non-teachers Figure 3.4 Standardised Gains in Teacher Abilities 2010-2011 76 with a four-year degree, 2010 140 Figure 3.5 An Integrated Framework 78 Figure 6.2 Public expenditure on education, 2001-2010 141 Figure 3.6 Career Development Framework for Teachers 80 Figure 6.3 Share of total pre-tertiary education budget spent on salaries i Figure 3.7 Perception of the Competencies of Supervisors 84 n selected countries, 2009 142 Figure 4.1 Total Number of Higher Education Students Enrolled 2005-2010 89 Figure 6.4 The budgetary impact of the certification program 144 Figure 4.2 Applicants to Makassar State University 2004-2005 to 2010-2011 91 Figure 6.5 Share of education spending by level, selected EAP countries, 2009 145 Figure 4.3 Applicants to different study programs at 15 different institutions 91 Figure 6.6 Salary and certification costs for civil service teachers under Figure 4.4 Rising entry scores of new teacher candidates, junior secondary graduation different student-teacher ratios 146 cohort 2006-2009 92 Figure 6.7 Student teacher-ratios in basic education, 2010 147 Figure 4.5 Growth in Number of Teachers with a Four-Year Degree 95 Figure 6.8 Population density, the proportion of small schools, and Figure 4.6 Indonesian PISA scores 2000-2009 96 the number of teachers in each province, 2010 150 Figure 4.7 Percentage of teachers who qualified for certification at the start of Figure 6.9 Composition of the teaching force after reforms, 2006-2010 151 the certification program. 96 Figure 6.10 Scale of redistribution necessary to comply with current staffing standards Figure 4.8 How many teachers are upgrading? 97 in primary and junior secondary schools, 2010 155 Figure 4.9 Teacher subject-matter knowledge test scores, breakdown by academic degree 98 Figure 6.11 Percentage of teachers with a four-year degree by location, 2010 157 Figure 4.10 Value added by Primary Teachers with a Four-year Degree 101 Figure 4.11 Pathways to Certification. 103 Figure 4.12 Effects of Certification: Fewer teachers with second jobs and less concern for family welfare 104 Figure 4.13 Student-teacher ratios have been declining over time 105 Figure 4.14 Effects of Certification: No measurable effects on student learning gains. 106 Figure 4.15 Percentage of Teachers with Different Levels of Professional and Pedagogical Competence 108 Figure 5.1 Proportions of Lesson Structure practices in 2007 and 2011 116 Figure 5.2 Relationship of Lesson Structure teaching practices with student learning outcomes 117 Figure 5.3 Time spent on using different teaching approaches 119 Figure 5.4 Relationship of Teaching Approach practices with student learning outcomes 120 Figure 5.5 Breakdown of public (whole class) time by participants 121 Figure 5.6 Relationship of Public Interaction categories with student learning outcomes 122 Figure 5.7 Language used in problem time as mathematical language and symbols versus real-world situations 124 Figure 5.8 Routine vs. Non-routine approaches to problems 124 Figure 5.9 Open versus Closed problems 125 iv TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making v Introduction List of Boxes L Introduction Box 1.1 Brief description of methods and design of the teacher certification impact evaluation Why Indonesia? study. 9 Box 1.2 Design and methods of the TIMSS 8th grade mathematics video study in Indonesia. 10 The critical role played by teachers in enhancing the quality of education is especially salient in a populous, Box 1.3 Design and methods of the political economy analysis 11 geographically dispersed, and culturally diverse country such as Indonesia. The evolving nature of its education Box 2.1 School-Based Management in Indonesia 32 system and the increasing – and increasingly complex – challenges facing individual teachers and the teach- Box 3.1 District education authorities 60 ing profession as a whole are of immense importance in Indonesia. With close to four million teachers1 – from Box 3.2 Adopting new training approaches 63 kindergarten through academic and vocational secondary education; in public, private, and Islamic schools; and Box 3.3 The University of Manado “in-service, on-service� program model 64 with both civil service and temporary, school-based contract status – Indonesia has one of the largest and most Box 3.4 An example of coordination between districts, universities and schools 65 diverse cadres of teachers in the world. How it is attempting to reform its teacher management and develop- Box 3.5 The SM-3T Program (Frontier, outermost, disadvantaged areas). 68 ment system and the teacher education institutions and processes which produce its teachers – and the kind Box 3.6 Making Use of the Open University’s Experience with Distance Learning Materials 71 of impact this is having on the quality of education and on the outcomes of its learners – are therefore of great Box 3.7 International experience with Recognition of Prior Learning (RPL) 72 importance to the future development of the nation. Box 3.8 Impact of Teacher Working Groups 76 Box 3.9 Selecting supervisors in Karawang District 85 The Indonesian teacher reform was designed and is being implemented as a genuinely comprehensive program Box 4.1 Teacher Education and Competency by Grade 99 – not piecemeal, as many teacher improvement efforts often are. From its beginning, it has therefore considered Box 5.1 The use of questioning from the perspective of the teacher’s goals 127 and responded to all of the necessary stages of an effective teacher management and development process. Box 6.1 District initiatives to improve teacher distribution 157 The seriousness of this effort is underlined by two important facts: • First, the reform is embedded in law – the pioneering Teacher and Lecturer Law (hereafter called the List of Tables L Teacher Law) of 2005 – which was both built upon an even more comprehensive Education Law of 2003 and extensively discussed by a wide range of stakeholders (ministry officials, parliamentarians, Table 1.1 In-service Teacher Training Needs 2006 18 civil society representatives, and teacher associations) and ultimately adopted by the Indonesian Par- Table 2.1 Characteristics of Good Teachers 38 liament. Table 3.1 Law and Regulations of the Teacher Reform 51 • Second, the financing of the reform has been made possible through funds derived from a consti- Table 3.2 Agencies involved in the pre-service education and continuing professional development 58 tutional mandate which requires the government to spend 20% of its budget for education; this has Table 3.3 The seven national standards used for Indonesian university program accreditation 62 had serious implications for the percentage of that budget spent on teacher salaries and professional Table 4.1 Changes in the number of Elementary School Teachers 2006-2011 94 allowances. The reform calls for the provision of such an allowance equivalent to the base salary of all Table 5.1 Two models used to examine the relationships between teaching practices and student certified teachers – in essence, doubling (and in some cases tripling) the income of literally millions outcomes 114 of teachers in Indonesia. Table 6.1 Primary and Junior Secondary School Size, 2010 149 The importance of this reform is further underlined by the efforts made by the Ministry of Education and Culture2 , supported by the World Bank, to examine (1) the quality of existing (pre-reform) and new (post-reform) teachers in the system; (2) the promotion of higher standards and enhanced competencies for teachers through more effective processes of recruitment, teacher education, certification, remuneration and other incentives, ongoing 1Though exact numbers vary according to source and, of course, over time, for the purpose of this book data from the school census of 2010 are used; these indicate approximately 2.7 million teachers managed by the Ministry of Education and Culture (from kindergarten to senior secondary school), with around 2 million at the primary and junior secondary level; these 2 million are the priority target of the teacher certification process. The Ministry of Religious Affairs manages close to an additional one million teachers. These figures have certainly increased since 2010. (NUPTK 2010) 2 At the time of the Teacher Law, the Ministry was named the Ministry of National Education. In 2011, this was changed to be the Ministry of Education and Culture. vi TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 7 Introduction professional development and support, and career promotion/progression; and (3) the impact of these actions Box 1.1 on teacher behavior and knowledge, student achievement, and the financing and efficiency of the education Brief description of methods and design of the teacher certification impact evaluation study system. The discussion in Chapter 4 includes evidence from a randomized controlled evaluation of Indonesia’s Thus, the World Bank team, with the Indonesian Ministry of National Education, designed and managed a wide teacher certification program. Such an evaluation has the explicit objective to estimate the causal ef- fects of a program or intervention under minimal statistical assumptions. For the study 240 public range of research projects and program support activities that, taken together, tell the story of the design, imple- primary and 120 public junior secondary schools were sampled. All core subject teachers (n=3,000) mentation, and impact of this reform. The result, outlined in this publication, Teacher Reform in Indonesia: The and all students (n=90,000) were tested using a multiple choice subject matter test. Teachers were also Role of Politics and Evidence in Policy Making, is based on the premise that a multi-faceted reform related to interviewed. The data is representative of 40% of the primary and junior secondary schools in Indone- teacher development and management as comprehensive as that in Indonesia can inform countries elsewhere sia. Three rounds of data have been carried out -- a baseline in November 2009, a midline in April 2011, in the world seeking to improve their education systems and, ultimately, the outcomes of their teachers and and an endline in April 2012. This book presents findings from an analysis of the first two rounds of data students. collection. The final results, which include the analysis of endline data, are expected in 2013. One-third of the schools were randomly selected into a treatment group; the remaining two-thirds Of particular importance in regard to this book is its systematic basis in analysis and evidence. In addition to over became the control or comparison group. The random selection into treatment and control ensures 50 background reports, it also presents the results from two innovative, methodologically-rigorous studies; from that treatment schools are similar to control schools on average, prior to the study’s intervention. The an exploration of the political economy of the time which strongly influenced the design and implementation of study intervened by granting immediate access to the certification process for all teachers in treatment the reform; and from an analysis of the tensions and trade-offs around policy-making when educational invest- schools who prequalified for certification. Prequalified teachers in control schools were subject to the ments are significantly increased (e.g., between large teacher salary increases and investments in other system standard procedure. The number of certified teachers in control schools is consequently much lower, expansion and quality improvement strategies). but not zero. The intervention created an artificial difference between treatment and control schools. If the certification process were to have any effects, differences would be observed between treatment and control schools one or two years after the project’s intervention. In terms of the new studies, the book first reports results from a randomized controlled trial (RCT) that aims to evaluate various impacts of Indonesia’s teacher certification program and its subsequent doubling of teacher Chapter 4 presents the effects of this intervention -- teacher certification and the associated profes- income. (See Box 1.1 for a description of the method used in this trial.) The explicit objective of this impact evalu- sional allowance – on teacher behavior and welfare and on student learning outcomes. For a more ation study is to assess the effect of this increase in teacher income on performance. And because this increase detailed discussion of the research design, see De Ree, Muralidharan, Pradhan, and Rogers (2012). is not conditional on later performance improvement, either of the teachers or their students, the analysis will add to a growing body of research that is investigating the effect of pay increases that are conditional on perfor- mance. (See Bruns, Filmer, and Patrinos (2011)) The second innovative study featured in the book examines at the classroom level the links among the teacher quality improvement reforms, changes in teaching practices, and student learning. The video study linked to the Indonesia Trends in International Mathematics and Science Study (TIMSS) aims to make clear what takes place in the classroom through detailed coding of videotaped lessons to provide insights into classroom activities in terms of the time spent on teaching and the frequency of various teaching-learning activities, their sequencing, and the quality of delivery. (See Box 1.2 for a description of the method used in this trial.) 8 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 9 ix Introduction Box 1.2 Box 1.3: Design and methods of the TIMSS 8th grade mathematics video study in Indonesia. Design and methods of the political economy analysis The video study took place in two phases (2007 and 2011) and involved 205 eighth grade mathemat- “Political economy (PE) is the study of both politics and economics and specifically the interactions be- ics teachers and over 6,000 students in total. The two-phase approach allowed for the identification of tween them. It focuses on power and resources, how they are distributed and contested in different general patterns and changes in teaching practices that took place since the beginning of the teacher country and sector contexts, and the resulting implications for development outcomes. Political econ- reform. The teachers and students in the study also participated in the TIMSS, providing unique ben- omy analysis involves more than a review of institutional and governance arrangement: it also considers efits in terms of nationally representative sampling; extensive student, teacher and school background the underlying interests, incentives, rents/rent distribution, historical legacies, prior experience with re- surveys; and student assessment results. forms, social trends, and how all of these factors effect or impede change. “ It is these political economy drivers or triggers that explain why things are the way they are and therefore also help to explain the The use of video provided many advantages. Since the videos are permanent records of classroom content of the reform and the process by which it came about. activities, multiple analyses could be performed in an iterative manner and revisited whenever neces- sary. Different observers were also able to focus on the same video as the basis of a shared analysis. The Based on these principles outlined in the World Bank’s publication, Political Economy Assessments at Sector videotaping sessions involved two cameras, with one on the teacher and one on the students, allowing and Project Level, World Bank, 2011, a detailed questionnaire was developed which dealt with the follow- different aspects of the classroom to be captured simultaneously. ing issues: A mixed methods (quantitative and qualitative) analytical approach was used. The quantitative analysis • the rationale for, and origin of, the Teacher Law (e.g., the problems which the Law was meant to utilized advanced forms of multi-level and value-added modeling. The coding of teaching practices fol- solve, the political and economic context of and reasons for the Law, and the most controversial lowed a model developed for the 1999 TIMSS Video Study (Hiebert (2003)). The codes have their founda- components of the Law) tion in prominent theories on effective teaching and cover the themes of Structure of Lessons, Content of Lessons, Actions of Participants, Instructional Practices, and Classroom Climate and Resources. The practices • the implementation of the Law at both national and local levels (e.g., what institutional, structur- were linked to student, teacher, and school survey data and student learning outcomes as measured al, and financial changes had to be put in place to implement the Law; the key actors, challenges, through pre- and post-testing in the 8th grade year. and internal and external and obstacles to its implementation; the monitoring and evaluation of the Law’s implementation; the capacity building required to improve the implementation of The qualitative analysis used case studies of ten relatively high-impact teachers to provide an in-depth the Law; and the “rent� processes (corruption, favoritism, political interference) – if any -- which examination of the ‘how and why’ aspects of practices. Over intensive one-week visits, the teachers might have had an impact on its implementation participated in multiple interviews, additional videotaping of lessons, stimulated recall sessions (where teachers watched their own videotaped lessons and discussed specific events), and a mathematical • the impact of the reform (e.g., its perceived success, most powerful impacts, and greatest fail- scenarios game. Specific topics explored included teachers’ use of questioning, the selection and use of ures); its effect on the balance of power among key political actors; and the gaps between re- problems, the handling of student misconceptions, and the decision-making process for teaching ap- form’s vision, design, and implementation. proaches. It also explored two factors seen as driving teaching practices: teachers’ mathematical beliefs and mathematical knowledge in teaching. A stakeholder analysis was central to this process with information being sought concerning which levels and actors in the system benefited (or lost) because of the reform, what kind of resistance or opposition Its scope, magnitude, and distinctive approach make the study unique and allow it to contribute signif- to the reform existed and how it was overcome, and the major champions of the reform. The stakehold- icantly to the understanding of how key background and contextual factors play a role in determining ers examined were teachers and teacher associations, politicians and parliamentarians, individual units what takes place in the classroom, as well as the relationship between teaching practices and student of the Ministry of Education and Culture (including the Minister), local governments, the private sector, learning outcomes. external development partners, the media, civil society organisations, the general public, and parents. Interviews were carried out with important original designers of the Law, both in the Ministry and in Par- The second important methodological aspect of this book is the analysis of the political economy which shaped liament; the leadership of the largest teacher association of the country; the president of a well-known the reform. Early in the development of this book, it became clear that the full story of the origin, evolution, private university in Jakarta; and the educational leadership of two districts including one in West Java implementation, and impact of the teacher reform process in Indonesia could only be told against the back- with the head of the district education office, a member of the district legislature’s education commis- ground of an analysis of the political and economic context which influenced this process. This resulted in the sion, the chair of the local district-level Education Council, and the secretary of the local branch of the development of a detailed questionnaire exploring various aspects of a political economy analysis and a series of teacher association. Interviews at the district level focused especially on the impact of decentralisation interviews with individuals both involved in and affected by the teacher reform. (See Box 1.3 for a more detailed on the implementation of the reform. description of this process). 10 x TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 11 Introduction The third important focus in this book is its in-depth analysis of the trade-offs policy-makers face when a deci- • What are the likely short-term and long-term impacts of a more systematic certification process and sion is made to significantly increase investment in education. The Indonesia government has invested heavily higher remuneration on teacher behavior and attitudes, teaching-learning methods, and student in education. Between 2001 and 2012, spending doubled in real terms partly from the fulfilment in 2009 of a outcomes? constitutional commitment to spend 20% of the government budget on education. The vast majority of this • What is the cost of serious imbalances in the distribution of teachers, especially to remote, isolated, additional spending has gone to teachers through increased levels of recruitment as well as significant improve- and difficult areas, and the effectiveness of various mechanisms to solve this problem? ments in pay (Cerdan-Infantes & Makarova (2013)). Despite these massive investments in education, Indonesia’s scores on international assessments of educational achievement have not improved significantly. The book • How can in-service training be made both more accessible and of better quality; e.g., through dis- looks closely at the trade-offs associated with the higher investment in teacher salaries and explores the extent tance learning, formal training in teacher education institutions, in-school, or via school clusters? to which it has crowded out investments in other areas to improve education quality and expand pre- and/or • What role should processes such as induction and probation play in the certification process? post-basic educational opportunities. • What can be said about the ultimate cost – and cost-effectiveness - to a system of a more systematic teacher certification process and a considerably higher level of remuneration for certified teachers? Virtually every country in the world – in every region of the world – is faced with similar trade-offs related to teacher quality improvement, management, and development. This is especially true for countries such as In- • What is the potential impact – negative or positive – of decentralisation on an improved teacher donesia which have had relatively high and stable rates of growth and therefore can – or could, it they wished – development and management process? What tensions around this process might arise between significantly increase their investments in education. Equitably distributing teachers across all schools regardless central and decentralised authorities? of their location is a challenge faced by all countries. And demand for schools and teachers in rural and remote areas is also moving to towns and cities – while the need to keep good teachers in less developed parts of the Organization of the Book country where they are often needed the most remains large. Answers to these questions are sought in a series of chapters which moves from a situation analysis of the politi- The Indonesian experience is particularly relevant because it not only presents a comprehensive approach to cal economy and the situation of teachers in Indonesia prior to the reform (Chapter 1) to a description of the reform but also highlights the interplay among the complex political and economic contexts of the nation, conceptual framework of quality education being used in the book (Chapter 2) and then to additional chapters policymaking processes, and the challenges in both implementing a comprehensive reform and creating an evi- dealing with the following issues: dence base for future actions. Although few countries need to deal with Indonesia’s size (or, in fact, its problems of a teacher surplus and unreasonably low student-teacher ratios), most have serious concerns about the whole • the pre- and post-reform structure and processes of the entire teacher management and develop- range of challenges related to teacher management and development. ment system (Chapter 3) Indonesia’s experience as described in this book can provide useful lessons in regard to these concerns. This • the impact of these efforts on teacher status, motivation, and skills and on student outcomes both includes examining questions such as the following: generally (Chapter 4) and in relation to 8th grade mathematics teaching (Chapter 5) • an in-depth analysis of the pre- and post-reform efficiency of Indonesia’s education system – both • What can be done to raise the status of the teaching profession, especially in countries where teach- financial and in terms of teacher distribution and student-teacher ratios – and of what is still needed ing is seen as a second-class, last-choice profession? to ensure that the current reforms are, in fact, able to be sustained (Chapter 6) • What is the impact of the level of remuneration as a result of certification on the number and quality • a summary of the major impacts and key messages arising from the entire reform process and of the of candidates to the teaching profession? influence of Indonesia’s political economy on the reform’s outcomes (Chapter 7) • How can teacher education institutions be reformed in order to better ensure their graduates (both It is hoped that the data and analyses discussed in this book will be able to unravel some of the complexities of new students and in-service trainees) have the content and pedagogical competencies required of the teacher reform process in Indonesia and therefore make available insights and recommendations useful to the education system? What is the impact of a more systematic certification process on the number, other countries faced with similar challenges. nature, and programmes of teacher education institutions? • How and when are teachers best “qualified� and “certified�? How can one guarantee that formal quali- fication and certification result in better teaching and enhanced learning? 12 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 13 Indonesia as a Case Study for Comprehensive Teacher Reform Chapter 1 crease in second jobs, often quite menial in nature, in teacher absenteeism, and ultimately to a decline in many teachers’ work ethic – and consequently to a further decrease in the status of the profession. Indonesia as a Case Study This loss of a sense of “vocation� and the “deprofessionalization� of teaching in the decades before the turn of the for Comprehensive Teacher Reform century were significant. Teachers were clearly seen – and were meant to see themselves – as civil servants first, answering up the system rather than out to students, parents, and local school boards. At a time of considerable political uncertainty and even instability in the transition from the rule of President Sukarno to the “New Order� 1.1. The Status of the Teaching Profession in Indonesia of President Suharto, teachers were meant to demonstrate loyalty and obedience to the government and to transmit the national curriculum, promote the national creed of Pancasila, and therefore strengthen national “Indonesia has constructed a definition of “teacher� that fits the unique contours of the nation’s social, unity. “This designation of teacher as civil servant carried profound implications for the definition of the educa- historical, and political landscape. The structure and goals of the government have exerted a par- tor and for the way that Indonesian instructors approached their work. Educators, like post office workers and ticularly powerful influence of the behavior of school employees...State authority in Indonesia is, and tax collectors, conceived of themselves as public servants first and foremost.� 2 Teachers, in other words, “came has always been, so pervasive that few individuals question their lack of power in the schools. As civil to define their professional responsibilities quite narrowly: to faithfully disseminate a set of ideas formulated in servants they have learned to follow the directives of upper level officials, not dispute them...The In- the capital�3 – in other words, to “educate� their pupils in terms of moral and ethical development rather than to donesian government has ensured...that educators treat the civil servant identity as ‘superordinate’.... “teach� them in terms of intellectual growth.4 One effect of that emphasis is that teachers have not established an identify for themselves separate from that applied to all civil servants, or a distinct set of professional standards. Bjork (2005) As the new century approached, however, Indonesian political life became more stable and predictable, and its economy began to grow. Along with this came an increase in the number of community members – village The story of teacher reform in Indonesia must begin with a description of the historical status and significance leaders, government extension workers, private entrepreneurs -- with education levels and salaries equal to or of its teaching profession. As in many other countries of the world, teaching was once a highly respected and exceeding those of teachers, thus further weakening their earlier privileged position within the community. And desirable occupation in Indonesia. Given the limited number of schools during both Dutch colonial rule and the then the education system as a whole became larger, more complex, and more challenging to teachers in many Japanese occupation and the important role given to education by the early leaders of independent Indonesia ways: – a feeling shared by the leaders of virtually all of the nations which became independent as the world of colo- nialism crumbled -- teaching was originally a vocation of choice. Only the best of students were admitted, with • Partly as a result of efforts following the Jomtien and Dakar Education for All commitments and the scholarships, into teacher education programs. As a result, teachers, especially those in rural areas, were not only Millennium Development Goals for education (the latter two made in 2000), the system rapidly ex- often the best educated and most influential members of the community; they were also, in a larger perspective, panded with much higher enrolment and an increasing number of teachers (which led finally to an the actors who were meant to transform Indonesia into a democratic, prosperous nation and bring it into the oversupply of teachers and one of the lowest student-teacher ratios in the region). modern world. The image of the wise, incorruptible, and hard-working teacher -- often struggling alone under difficult circumstances, in remote villages and urban slums, with little pay but much dedication – is one that an • Educational programs and options at all levels of the system (from pre-school to tertiary education) older generation of Indonesians still fondly remembers. became more diversified, each demanding better and more specialised facilities, teachers, and ma- terials. But eventually several issues came into play. First, the education system expanded rapidly in the 1970s and • The curriculum also frequently changed and often was made more complicated, all within less than 1980s with a massive national program promoted by then President Suharto. This program built tens of thou- 10 years - from a competency-based curriculum introduced in 2004 to a school-based curriculum sands of new primary schools and between 1975 and 1987 rapidly hired and trained hundreds of thousands of in 2006 and now to a very different curriculum for 2013, In general, the curriculum became both new teachers who were often thrust into classrooms with only a minimum amount of initial teacher education, more accelerated (teach faster) and congested (teach more), moving from the essentials of reading, few opportunities for further training, and therefore limited subject knowledge and inadequate pedagogical writing, and arithmetic (and the national creed of Pancasila) to a wider range of content areas (e.g., skills. This infusion of new but not very rich blood diluted the strength of the teacher cadre, blurred the mythic sustainable development and life skills) and new ways of teaching (e.g., child-centred and interactive), image of the teacher as community-leader and nation-builder, and ultimately, combined with a large expansion sometimes as separate subjects, sometimes integrated into a few basic subjects such as language. of the rest of the civil service, reduced the salaries of teachers and other civil servants relative to other profes- These frequent changes have often been difficult for the majority of the teachers, many of whom are sions. “The principal attractions of a career in the civil service became job security, undemanding work, short work hours, and lifetime employment. Low expectations led to decreased productivity.� 1 The result was an in- 2 Bjork: 94 3 Bjork: 110 1 Bjork: 96 4 Bjork: 107 14 15 Indonesia as a Case Study for Comprehensive Teacher Reform quite senior but with weak subject knowledge, limited professional support, and few opportunities But with its stronger focus on a more comprehensive definition of quality, the Dakar World Conference on Edu- for further training. cation for All in 2000 shifted government thinking around the world to greater concern about the nature and relevance of the education they were providing. This led to more careful analyses of a range of indicators seen • Schools and individual teachers faced more learners of ever more diverse backgrounds and identities, as useful proxies for quality. One important set of indicators (later followed by systematic studies of student with different values and different ways of thinking, acting, and being motivated; with greater inde- outcomes such as TIMSS, PISA5 , and EGRA6 ) focused on teachers – particularly their educational level, subject pendence, creativity, and open-mindedness and more enterprising minds; and with skills often better matter competency, and pedagogical skills. than their teachers in using new information and communication technologies. • The governance of the education system was quite radically and rapidly decentralized, leading to Prior to enactment of the 2005 Teacher Law, the Ministry of National Education in Indonesia had identified a new and sometimes difficult accountabilities and expectations of teachers, often made more difficult number of shortcomings in the education system related to teachers. First, teaching standards were ill-defined. by newly empowered school committees and more educated parents demanding more from their Although standards were specified, they were neither sufficiently detailed nor clearly defined and therefore were schools. difficult both to translate into the curricula of the wide range of teacher education institutions then existing in • And finally, despite the frenzy surrounding the annual national examinations at the end of primary, Indonesia and to enforce through supervision at the school level. junior secondary, and higher secondary school and the exceedingly high rates at which they are passed, increasing evidence from both international and national studies of achievement showed Secondly, prior to the adoption of the Teacher Law, the teacher management system in Indonesia was charac- that despite the best intentions, higher enrolments, greater investments, and steady progress towards terized by both inefficiency and inequality. The certification of teachers was non-existent (beyond successfully quantitative global targets, the Indonesian education system and its teachers were failing to achieve passing probation), and the appointment, deployment, and further professional development of new teachers, the results expected of them. haphazard. Standards regulating these processes were inconsistent over time and across regions and often subject to personal relationships rather than professional training or competence, especially for temporary and Indonesia’s answer to these challenges was the pioneering Teacher Law of 2005. The most salient feature of this contract teachers. This confusion worsened during the process of decentralisation which began in 2000 and law was its attempt to “re-professionalize� teaching – to once again make it a “profession� -- both through formal was later defined for the education system in the Education Law of 2003. In theory this Law mandated that the certification and through the doubling or even tripling of teacher incomes through the granting of a professional employment and remuneration of teachers (except for Islamic schools), the setting of standards, the monitoring allowance upon such certification. The Law also called for a comprehensive package of reforms that established of performance, and the implementation of sanctions and remediation should be transferred from the Ministry an ambitious agenda for improving the national education system by laying out the roles and responsibilities of to district offices. But issues around the granting of various kinds of incentives, the dismissal and the deployment teachers, principals, supervisors, and local education authorities as well as the strategies needed to improve their of teachers (both within and across districts), the appointment and training of school principals and supervisors, quality and welfare in support of the earlier Education Law of 2003. the continuing professional development of teachers, and the request for the establishment of new civil service posts for teachers remained ambiguous. In fact, the over-hiring of teachers was rampant and was partly the consequence of decentralisation where local governments had strong incentives to hire more teachers whether they were needed or not. As a result, national student-teacher ratios were low, but inefficient distribution meant that many schools had insufficient teachers. Schools in rural and remote areas also tended to have teachers with 1.2. The Situation of Indonesian Education before Teacher Reform lower levels of academic qualifications. The Indonesian experience in reforming the nation’s teacher management and development structures and processes has been unique both in its comprehensiveness and in the attention paid to analyzing and assessing its implementation and impact. The situation in regard to teachers before the reform, why reform was consid- ered essential, what the reform’s major components were, and the political-economic context in which the re- form was developed and has been implemented must all be understood before its impact on teachers, teaching, students, and the system as a whole are assessed. For a decade and more from 1990, Indonesian education policy was generally directed at increasing the number of children with access to formal education. With the focus of the Millennium Development Goals on universal primary enrolment and gender equity and the prioritization of Education for All targets towards enrolment (Goal 2) rather than quality (Goal 6), the country’s education system was most concerned with increasing access to 5 Program for International Student Assessment school. The result was a significant increase in the primary school net enrolment rate to 94.76% by 2010. 6 Early Grade Reading Assessment 16 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 17 Indonesia as a Case Study for Comprehensive Teacher Reform The Low Status of Teachers UNESCO estimates, in Indonesia a primary school teacher earned USD 1,002 to USD 3,022 per annum or a mere 50% of Gross Domestic Product (GDP) per capita. By comparison, primary school teachers in the Philippines The third shortcoming, as introduced above, was that teacher status was low compared to other occupations and Thailand earned over twice as much as GDP per capita, in relative terms a fourfold greater salary than their in Indonesia and to teachers in a number of neighboring countries. Such status derives from a combination of Indonesian counterparts. many factors including: (1) educational qualification, (2) salary or income level, (3) competence in both subject matter and pedagogy, (4) perceived motivation to teach (i.e., the extent to which they are considered to be com- Thus, the teaching profession was unattractive for individuals who were better educated and had more opportu- mitted to their work), and (5) official certification (i.e., in the Indonesian case, official recognition that a teacher nities for more challenging, better-paid jobs (Figure 1.1). Wages for the three-quarters of primary school teachers is a “professional�). with second-level diplomas or below were high in comparison with the wages they could expect to receive out- In the case of Indonesian teachers before 2005, first, their educational qualification was relatively low, and a side of the teaching profession. This is likely to have created strong incentives for individuals with these qualifica- significant proportion of serving teachers was under-qualified. Counting all teachers -- kindergarten through tion levels to enter the teaching profession. However, the wages of better qualified teachers were significantly senior secondary school and vocational secondary schools (excluding Islamic schools) - more than 60% of the below the wages of individuals with similar qualifications who worked outside of education. The wage structure total number did not hold the four-year degree required by the Teacher Law. In fact, around 25% of the teachers therefore created incentives for less well-qualified candidates to enter the profession while better-qualified and had failed to go beyond high school. more able candidates were likely to opt for a non-teaching career. The table below illustrates how the new higher qualification mandate in the Teacher Law compounded the Figure 1.1 training requirement for in-service teachers: Relative primary school teacher wages by qualification level, 2004 Table 1.1 In-service Teacher Training Needs 2006 Source: Calculations based on the 2006 NUPTK/SIMPTK teacher’s census Secondly, as discussed above, the salaries of teachers were also low and contributed to their low status. Although traditionally relatively high compared to other occupations, especially in rural areas, teacher salaries had been Source: Ragatz (2010) declining in real terms as the number of teachers increased so that by 2005 incomes from teaching, compared to those of other occupations requiring a similar education level, were relatively low. Also, teacher salaries in Indo- In regard to a third factor related to status, Indonesian teachers in general demonstrated low competency on nesia compared unfavorably to other middle-income countries in the region. For example, in 2008 the starting subject matter tests. This was due not only to the relatively low levels of initial education for many teachers, salary of a primary or junior secondary school teacher in Indonesia was approximately 40% of average per capita especially those hired at the time of the great expansion of primary education in the 1970s and 1980s, but also income. This compared unfavorably with other countries in the region such as the Philippines where starting to relatively few opportunities for systematic in-service training. Thus, for example, in a study completed by the salaries were around 145% of average income (UNESCO Institute of Statistics 2010). Absolute differences were Ministry in 2004, a large percentage of one million teacher applicants (many of whom were already likely teach- also large. In comparison to other nations in the region, salaries of starting primary school teachers in Indonesia, ing on local, temporary contracts), who were competing for 64,000 positions as civil service teachers, demon- in US dollars, were less than 1/3 the salaries of teachers in Malaysia and the Philippines and less than ½ those in strated poor content mastery, even in the subjects that they were going to be required to teach. On a general Thailand. Their top salaries showed even greater disparities with those in Malaysia and Thailand. According to test for primary school teachers, the average score was 34 correct answers for 90 questions (with a range from 18 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 19 Indonesia as a Case Study for Comprehensive Teacher Reform six to 67), and on 14 special subjects (e.g., civics, art, language, biology, art), in only four subjects was the average score more than 50% (Ragatz, 2010). Fourth, in terms of commitment and motivation to teach, many factors reinforced doubts about the status and professionalism of teachers. The low wages of teachers were perceived to have a significant effect on teacher behavior; many teachers, especially those in primary schools, were concerned quite correctly about the welfare of their families. This led in many cases to second jobs and high teacher absenteeism. In 2002/03 a teacher ab- senteeism study showed that 19% of teachers were absent when enumerators made surprise visits to a random sample of primary and junior secondary schools (Usman., Syaikhu, and Suryadarma (2004)). These relatively high rates of absenteeism were likely to have been driven by the fact that many teachers held second jobs to supple- ment their income from teaching. Such absenteeism impacts on the quality of teaching, of course, because it disrupts the learning process by reducing teacher-student contact time and interfering with the relationship between teachers and students. Also, the commitment of teachers to their profession was also put in doubt because of what was seen as a rela- tively light workload. Many had few teaching hours per week in classes with low student-teacher ratios. A World Bank study in 2005 found considerable variety in teacher work, but the “total percentage of teachers whose teaching workload [was] below the set minimum of 18 hours per week [was] 23 percent for primary schools and Source: World Bank Education Statistics Database (Edstats), data for 2003, cited in “Teacher Employment and Deployment in 44 percent for junior secondary schools.� The average hours taught by teachers in remote schools was consider- Indonesia: Opportunities for Equity, Efficiency and Quality Improvement� (2008) ably higher than for urban and rural schools, likely indicating an undersupply of teachers in these remote areas. Indonesia also had (and still has) some of the lowest primary and junior secondary student-teacher ratios in the World (Figure 1.2). At the primary level in 2003, Indonesia had a teacher for every 20 students, a ratio similar to Supply and Distribution Issues Japan and much lower than the ratio in Korea. The ratio for junior secondary schools in Indonesia was 13:1. These Another shortcoming identified as a serious problem in relation to teachers in Indonesia was the issue of the low ratios have arisen because of the practice of providing staff to schools on the basis of the number of classes supply and distribution. Prior to the education reforms in the mid-2000s there was no attempt to match teach- rather than the total number of students. er education institution intake with the demand for teachers. Most countries rely on the demand for teachers to send a signal to prospective teacher trainees about the benefits of becoming a teacher. However, in Indonesia, a Figure 1.2 far greater number of individuals enter teacher education institutions than required when compared to overall Cross-country comparisons of student-teacher ratios pre-reform, 2003 needs. A recent study showed that only 53% of students graduating from teacher education courses were actu- ally able to be employed as teachers (Ragatz (2010)). In 2005, a survey using the existing entitlement formula showed that 55% of primary schools in Indonesia were overstaffed and 34% understaffed. Despite incentives to overhire and the low aggregate student-teacher ratios that result, the distribution of teachers prior to the reforms was very uneven. In 2004, the primary student- teacher ratio ranged from less than 10 in some districts to more than 30 in others (WorldBank (2008b)). In junior secondary schools approximately 20% of all districts had a student-teacher ratio of less than 20. Small schools tended to have low student-teacher ratios because of low enrolment and generous staffing standards. Remote schools tended to have higher than average student-teacher ratios because of the difficulty in deploying teach- ers to these schools. Although nationally there was an oversupply of teachers in 2004, poor distribution meant that a significant num- ber of schools did not have enough teachers (World Bank 2005). In 2005, it was estimated that approximately a third of all primary schools were short of teachers according to the prevailing staffing standards at the time. Rural 20 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 21 Indonesia as a Case Study for Comprehensive Teacher Reform and remote areas tended to have a greater proportion of schools with shortages compared with urban schools. Figure 1.4 Conversely, 55% of primary schools had more teachers than the minimum standards set at the time. Indonesian PISA scores 2000-2009 Another aspect to inequitable distribution was that teachers in rural and remote schools tended to have lower levels of education than their counterparts in urban areas. A survey conducted in 2005 showed that less than 10% of primary school teachers in remote areas had a four-year degree compared to 27% of urban school teach- ers (Figure 1.3). These differences in teacher qualification levels tend to reinforce patterns of inequality across Indonesia. Remote areas tend to be the poorest and children in these areas, the most disadvantaged. To the extent that teacher characteristics are causal factors in student learning, it is likely that the pre-reform teacher distribution pattern widened disparities in learning achievement for children in rural and remote areas. Figure 1.3 Education levels of primary school teachers by location, 2005 Source: (OECD, 2010) 1.3. Key Triggers for Reform The increasing complexity of the education system in Indonesia as outlined in Chapter 1 and an increasingly sophisticated and insightful analysis of the challenges faced by its teachers convinced policy-makers of the need for a major reform of the country’s teacher management and development system. Originally, the key trigger for the reform was the relatively low pay and low status of the teaching profession, leading both to the prevalence of second jobs and high absenteeism rates and to the generally small number and poor quality of candidates Source: (WorldBank, 2008b) applying from secondary education to teacher education institutes. This situation created a general consensus around the need to improve teacher “welfare� (greater income) but to do this not through a routine increase in Low Level of Student Outcomes their base salary (which would have led to demands for similar increases from other civil servants) but rather A final and very critical shortcoming related to teachers was the low level of student outcomes, especially as through a “professional allowance�; such an allowance would also reinforce the sentiment, strongly endorsed measured by international comparative tests. Indonesian students simply performed poorly when compared by Indonesia’s teacher associations, that teaching had to be seen again as a “profession� closed to those not ad- to students in other countries. International benchmark tests showed (and continue to show) that student out- equately qualified and not officially certified. comes in Indonesia are lower than those in neighbouring countries. For example, in 2007 Indonesia ranked 36 out of 49 countries in the Trends in International Mathematics and Science Study (TIMSS) test. In science, it As described above, this focus on income and status was linked to the realisation that a large percentage of the ranked 35. In the 2006 Program for International Student Assessment (PISA), which focuses on how well 15-year- teachers in 2005 had been hired during the large expansion of the system in the 1970s-80s with a relatively low olds are prepared for real-world situations, Indonesia ranked 48 out of 56 countries in reading. It also ranked 52 level of initial education, little pre-service education, few opportunities for later systematic in-service upgrading, in science and 51 in mathematics. As the following table shows, PISA scores are well below 400. and exposure to a school culture which rewarded passivity and loyalty rather than proactive and innovative ap- proaches to the improvement of student outcomes. Many of these teachers still had another decade or more to work with little incentive and few opportunities for further professional development (in 2005 some 77% of Indonesia’s teachers were 41 years or age or older, with a retirement age of 60), all at a time when they were faced with many changes occurring in the education system -- a more diversified and accelerated competency- 22 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 23 Indonesia as a Case Study for Comprehensive Teacher Reform based curriculum, a more child-centred pedagogy, a more varied student body, and more empowered school Specifically, the 2005 Law and the many presidential and ministerial regulations which govern its implementa- committees. tion have major components covering virtually all aspects of teacher management and development. These include the following: The realization by the Ministry of National Education that the teacher cohort of the time was not only failing to respond adequately to these changes but also producing disappointing student outcomes led it to insist that • The core principle that teaching is a “profession�. Teachers who fulfil certain established academic any increase in the status, welfare, and income for teachers as professionals would need to be accompanied by qualifications and demonstrate essential pedagogic, personal, social, and professional competencies an increase in quality. It therefore saw both the need to condition the granting of the professional allowance to must be considered “professional� and therefore worthy of a professional allowance equal to their active teachers on some system of certification and the opportunity presented by the retirement of such a large base salary. cohort of teachers in a relatively short period of time to recruit and educate new generations of higher quality • The development by the National Education Standards Board of a standards framework for courses, teachers. This marriage of the “status trigger� with the “quality trigger� produced a rare consensus among the tests, role definitions, and other education elements to underpin change. The Board centered its core major actors on the need for a comprehensive new law on teachers. standards and indicators on the four core competencies mandated in the Teacher Law. Over time, another set of triggers provided added incentive to the implementation of the Teacher Law and led • The requirement that all teachers must meet a minimum standard of a four-year degree before being to a variety of complementary guidelines and regulations to help ensure it achieved what it was expected to certified. achieve. These triggers included: • A course of additional professional training after the four-year degree - mostly classroom-based – of six months for primary school teachers and one year for secondary school teachers. • the need to enhance the capacity of teachers and their role in school self-assessment and improve- • The requirement that all teachers much be formally certified after the four-year degree has been ment given the increasing decentralisation of the system which has given more authority (and ac- gained through either a portfolio of the teacher’s education and teaching achievements or a 90-hour countability) for improving the quality of education to the school (i.e., the school principal and his/ remedial in-service course. her teachers) • The reform of pre-service teacher education institutions so that their subject and pedagogical courses • the increasing amount of funds being transferred directly to schools on a per student basis for qual- were closely linked to the school curriculum competency standards in order to ensure that all gradu- ity improvement through an operational cost program; this puts more demands on teachers to take ates meet the new performance standards for the teaching profession and are eligible for certification. part in school self-assessment and improvement programs and to produce better student outcomes • Reformed practicum experience through improved links with districts and schools. The key feature • eventually, as a result of the constitutional amendment to earmark 20% of the national budget for of this component of the reform is the requirement that students undertake the largest part of their education, a flood of new funding came into the system, from both internal and external sources, pedagogical training and practice under supervision in the classroom. which gave the Ministry an opportunity to undertake a range of programs under the reform. • A mandatory 24-period (18-hour) per week workload required to gain and maintain certification. • A “special� area allowance to be paid to teachers in defined areas – remote, in border regions, etc. 1.4. Major Components of the Teacher Law of 2005 • Improved processes of in-school induction, mentoring, and probation to ensure that a beginning teacher receives close supervision and guidance in the workplace in order to successfully make the The result of these various triggers led to the pioneering Teacher Law of 2005 which laid out the roles and re- transition from university education to the school. sponsibilities of teachers as well as the strategies needed to improve their quality and welfare in support of the earlier Education Law of 2003. The Teacher Law defined the competencies required of teachers in four areas • A system of teacher appraisal and public service salary increases which links the teaching objectives (pedagogic, personal, social, and professional), their incorporation into national teacher standards, the role of of schools to individual teacher performance appraisal, career progression, and salary increments. various Ministry units and agencies in supporting teachers to reach these competencies, the teacher certifica- • A more systematic program of continuous professional development which links backward to the tion process and the qualifications required for such certification, and the conditions under which teachers teacher appraisal process and forward to salary increments and career progression in a new career could receive special and professional allowances. It also raised important issues concerning teacher manage- development framework for teachers. ment and development which required further consideration: continuous professional development and its link • The strengthening of teacher working groups to bring teachers together in a forum to discuss teach- to promotion and salary increments, teacher performance appraisal, and the role of principals in instructional ing problems and work cooperatively to undertake common tasks such as curriculum development, leadership. In other words, the Teacher Law provided a comprehensive, clearly defined package of reforms that the creation of teaching aids, and the design of test items. established an ambitious agenda for improving the national education system. 24 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 25 Indonesia as a Case Study for Comprehensive Teacher Reform • The more systematic and merit-based appointment of principals and supervisors based on mastery population and of its teaching cadre presented a difficult financial challenge: how to make a significant impact of the four core competencies for educators meant to be achieved through early identification of in terms of qualifying and certifying so many teachers and then radically increasing their levels of remuneration promising candidates, careful selection, and then further training prior to promotion to more senior in a country as large in Indonesia, even when 20% of the national budget is reserved for education? positions. At the same time, evidence began to accumulate that despite the best intentions and increased resourcing, the education system was not producing the kind of graduates needed to face the political and economic chal- lenges of the new century. This was the challenge to be addressed. The aging, relatively poorly paid, poorly edu- 1.5. The Political-Economic Context of the Teacher Law cated, and often demotivated (and “deprofessionalized�) teaching force (at least in comparison to its comparable ASEAN partners) began to be considered as a major factor in what was seen as the poor quality of the education As can be seen, the Teacher Law of 2005 and the plethora of regulations which flowed from it produced an un- system and its graduates. But teachers were also considered to be important opinion leaders in the communi- usually substantial and comprehensive reform of not only teacher management and development but of many ties where they taught – though considerably less so than in the decades following independence – and so were other aspects of the education system. But such a reform – both its content and its implementation – did not an important political constituency to support. happen in a vacuum but rather must be understood in terms of the political and economic environment of the day. This environment has always been particularly complex in Indonesia given its history, its geographic spread, As a result of a combination of these various factors – national aspirations towards Indonesia’s role in an expand- its large and growing population, and its cultural, religious, and linguistic diversity. In general, therefore, a range ing global community, more resources for education, and the realisation that the system was not producing the of political economy factors were important in the context of the development of the Teacher Law. results it should -- the various stakeholders concerned with teachers began to reach consensus on what to do next: an unusual “win-win� situation in the process of education reform. Part of the environment of decision-making in Indonesia relates to the complexity of the nation itself. This complexity derives from many sources. In the most ordinary sense, Indonesia is one of the most ethnically and Discussions concerning some kind of government regulation concerning the welfare and protection of teachers linguistically diverse – and geographically challenged -- countries of the world. A combination of 722 language started before the turn of the century and took several years – and a number of presidents and ministers of edu- groups spread out over a 3,000 mile archipelago of more than 17,000 islands – with a cross-matrix of Islamic, cation – to come to fruition. The various teacher associations in Indonesia argued strongly that the income and Buddhist, Hindu, Protestant, and Catholic faiths (and dozens of animistic beliefs) underlain by English, Dutch, status of teachers – and therefore the quality of their teaching – were so desperate that serious action was re- and Chinese heritages – makes any standardised or centralised approach to change difficult. The primacy of the quired. This led to the upgrading of what was first proposed as a government regulation to a law to be approved national language, Bahasa Indonesia, which has penetrated at least administratively to all regions of the country, by the Indonesian Parliament. It also led to the agreement that teacher salaries had to be doubled (an increase has facilitated standardisation to some extent, but cultural, religious, and historic differences have still prevented of 100%). But because such an increase, in effect, would have led to two streams of civil servant pay scales and full achievement of the national aspiration of “bhinneka tunggal ika� – unity in diversity. Related to this is another therefore demands for equal increases for all civil servants, and because the associations argued that teaching challenge to the implementation of reform: the sheer isolation and remoteness of many of the country’s com- needed to be considered a profession (like law and medicine), the proposal was made to identify the increase as munities, whether they be found on small, distant, rarely visited islands or equally hard-to-reach mountain peaks a “professional allowance�. With the professional allowance, teacher income indeed became commensurate with and valleys. doctors and lawyers and even exceeded them, especially given their low teaching load.7 At the beginning of the century, Indonesia aspired to play a larger role both within ASEAN (the Association of At about the same time, within the Ministry of National Education, a new Directorate General for the Quality Southeast Asian Nations) and internationally. This required a government both more visibly stable and demo- Improvement of Teachers and Education Personnel was created and given responsibility for virtually all aspects cratic and – at least in the eyes of the major international development agencies, both bilateral and multi-lateral, of the management of teachers, both in formal schools and in non-formal education programs, and at both active in the country – with long-term, systematic national and sectoral development plans. In the context of primary and secondary levels of education. One of its first acts was to develop a profile of the teacher popula- increasing globalisation and the economic changes this process demands, Indonesia also began to more clearly tion of Indonesia; this profile reinforced the view that teachers, in general, were badly paid, poorly motivated, understand the importance of a better-trained workforce, educated within a more diversified, responsive educa- inequitably deployed, increasingly disrespected by the communities they served, and with few opportunities for tion system and ultimately more adaptable to the ever-changing demands of a growing and changing economy. further training. The profile helped convince the Ministry that any additional professional allowance had to focus This understanding led to the unusual mandate, contained in an amendment to the 1945 Constitution approved in 2002, which required that 20% of the national and local budgets be devoted to education – a percentage 7 According to one source, although beginning medical doctors and teachers receive almost the same base pay of over Rp. often promoted internationally but rarely made legally binding at the national level. But the size of Indonesia’s 1,900,000 per month, the professional allowance for ceritifed teachers (for teaching 24-period hours or 18 hours per week) is equivalent to this base pay while for a doctor (working 40 hours per week), it is Rp. 325,000. The maximum allowance for senior doctors is Rp. 1,400,000 and for senior teachers, Rp. 4,100,000. Source: http://kesehatan.kompasiana.com/medis/2011/08/16/ gaji-guru-vs-gaji-dokter/ (downloaded December 15, 2012. 26 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 27 Indonesia as a Case Study for Comprehensive Teacher Reform not only on teacher welfare but also on teacher quality and therefore on some process of certifying that teachers Early in the process of implementing the Teacher Law, and from a political economy perspective, a range of bu- who were provided this allowance were, in fact, professional. reaucratic, political, and financial problems began to appear at both national and local levels. Finally, the newly elected Parliament contained a number of representatives who themselves had been teachers • The new Directorate General responsible for the process was understaffed, and many of its officers and therefore had experienced directly the results of low status and inadequate pay. Supported by their political were new to the process of implementing a major, comprehensive, and largely untested reform. The parties and leaders who recognised the importance of teachers as a voting constituency and as local opinion management of such a programmatically and bureaucratically complex process in a system known leaders, they therefore enthusiastically supported the move for a comprehensive Teacher Law which would di- for the inefficiency of many of its administrative processes was not easy – a task made even more rectly address the twin issues of welfare and quality. (Rather late in the process this officially became the Teacher difficult by the sense of independence, nourished by the process of decentralisation, felt by many and Lecturer Law to allow some coverage of university-level staff.) This enthusiasm persisted even when shown district officials and principals who were reluctant to listen to the mandates of the central ministry in by the Ministry what the likely budget would require for putting in place the structures and processes needed the absence of any clear incentives. for the certification process and paying the allowance. • Detailed guidelines were therefore needed to try to ensure that district offices would follow the direc- tions of the Ministry. Thus, in the early 2000s there was considerable consensus among the major education stakeholders of the country – the government (the Ministry of National Education, the Ministry of Finance, and the National Plan- • District education offices had no units comparable to the new Directorate General and therefore con- ning Board), the political parties and Parliament, and teachers as represented by their various associations – that tinued to handle teacher management and development in a piecemeal and often uncoordinated what became known as the Teacher Law of 2005 was necessary to clarify the roles, responsibilities, and desired fashion. competencies of teachers and to identify the strategies needed to improve their quality and welfare. • The regulations determining which teachers in a given school or district would first enter the queue for certification (in theory, senior teachers with a four-year degree) were not always followed, leading Once the general framework of the Teacher Law was set, however, the consensus among the stakeholders be- to charges of favoritism and corruption both in schools and in district education offices. gan to fall apart about its implementation. A major issue in this regard was the means proposed to prove “com- • Reports emerged of fictitious and falsified portfolio documentation with sample lesson plans, up- petency� (after the gaining of a minimum four-year degree) for the purposes of certification and receipt of the grading certificates, and other documents shared among applicants. professional allowance. The Ministry, supported by a new National Education Standards Board, wished to assess the four core competencies – professional, pedagogical, personal, and social – through both written tests and • There were too few teacher education institutions involved in assessing the large number of port- classroom observation. folios, and in some cases they were pressured into passing a much larger percentage of portfolios than the 20% the Ministry had anticipated; not enough teachers, therefore, were seriously assessed in The teacher associations, however, harking back to the original focus on welfare, felt that this was an assault on terms of their existing competencies. the fact that most candidates for certification had already passed a four-year degree and, in many cases, also • Because funding to be provided to the teacher education institutions for the portfolio assessment had many years of experience accompanied by a range of in-service training activities. A majority in Parlia- and the 90-hour training course was seriously delayed, what was meant to be a leisurely seven-month ment agreed with this opinion and therefore refused to provide funds to implement the competency tests but planning and implementation process had to be completed in two months; this led to standard train- rather agreed that proof of competency would be based only on the submission of “portfolios� of achievement ing modules (rather than modules tailor-made to fit profiles of teachers’ needs at different levels of (e.g., personal references, publications, certificates of attendance at in-service courses, model lesson plans, etc.). competence), inefficient training processes (e.g., up to 25 parallel classes in one institution and a large Insistence by the Ministry that some kind of competency assessment was essential in this process led to a com- percentage of time devoted to breaks and administrative tasks), and an almost 100% pass rate at the promise whereby those teachers whose portfolios were evaluated and approved by local teacher education end of the training. institutions (selected and oriented by the Ministry) would pass immediately to certification while those who did not would be required to undertake a 90-hour training program and then be tested on its content – a test When the teacher law was passed in 2005 only about 15% of the government’s budget was devoted to educa- which was ultimately passed by most who took it. In other words, the process of certifying teachers – and thus tion. It was recognised by the government that the introduction of the professional allowance and a commit- of providing them a professional allowance equal to their base salary – was not strongly linked to demonstrated ment to certify all teachers by 2015 would put significant pressure on the education budget. Despite evidence competencies in either subject content or pedagogical skill. showing this impact the pressure to improve the welfare of teachers meant that the provisions for the profes- sional allowance remained. These budgetary pressures were partially relieved after 2008 when the constitutional court ruled that the government was failing to meet its constitutional obligation to spend 20% of its budget on education. Government education spending increased significantly and its share has remained above 20% since 2009. 28 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 29 Indonesia as a Case Study for Comprehensive Teacher Reform In addition to these problems, other, more subtle issues arose to complicate the process. Three years after the district office level – where one office can be in charge of 1000 schools or more -- little reform or change, in fact, passing of the Law, the Directorate General for Quality Improvement of Teachers and Education Personnel was may happen at the level where it matters the most: the community and the school. dismantled, and different aspects of teacher management and development were again placed not only in dif- ferent Directorates but also in a new Board for Educational and Cultural Human Resources Development and This decentralization process both transferred substantial policy-making and planning authority – and resources Quality Assurance for Education. Partly as a result, the original intention of the reform to adapt its strategies – from the central level down to the district level and moved implementation processes (and resources) from to the particular needs of different regions of Indonesia, different districts, and even different teachers – e.g., the sub-district level up to the district level; this resulted in much larger and much more powerful district-level greater variety, more local content, and more options in the 90-hour course – was never carried out. Likewise, offices. But the unclear and incomplete division of labor among the different levels of the system and the lack of the expectation that certified teachers would use a portion of their new allowance for continuing professional management and technical skills in planning, budgeting, procurement, and accounting needed at lower levels development has rarely been fulfilled. Detailed regulations around a new rule which mandated that every certi- of the system to take on more authority (and the willingness of the upper level to give up its authority) made fied teacher teach a minimum of 24 period-hours per week (a rule hotly contested by teacher associations which decentralisation a problematic process. Also, by taking away most of the center’s carrots and sticks which can preferred 18 period-hours) were also only belatedly developed. Very importantly, also, plans to implement other be used to ensure that decentralised entities still work within some kind of central framework, the pressure for aspects of the reform focused more on quality assurance of both the process and the products – more effective district offices to do much more than merely send the reform messages downward is limited. and merit-based procedures for the appointment of school principals and supervisors and new and more rigor- ous mechanisms for induction, probation, and teacher appraisal – were therefore either delayed or remained Decentralization and the introduction of school grants led to increases in the size of the teaching force in- only central government regulations not actively implemented down to the district level. Funds available at the creasing further the future costs of certification. The intergovernmental transfer system introduced to allocate district level for continuing professional development of certified teachers were therefore often unspent. resources across levels of governments included incentives to hire civil-service teachers (Cerdan-Infantes & Ma- karova, 2013). Part of the overall fund transfer was determined by the size of the civil-service establishment and Worries about the impact of the Teacher Law on private schools and systems also arose. Although the Law itself local governments with large civil services received more central funds. This led to an increase in teacher hiring does not distinguish between “public� and “private�, priority for entry into the certification queue was usually which has meant that student teacher ratios have declined substantially since decentralization began. Incen- given first to public school teachers who were much more likely to have both a civil service post and financial tives to hire more teachers were also exacerbated by the large increase in school-hired teachers following the in- support to obtain the four-year degree necessary for certification and then to temporary teachers with govern- troduction of the school grants program in 2005. In 2005, the BOS program was launched nationally and schools ment contracts. It is therefore said that many of the best private school teachers moved to public schools, even used these resources partly to hire more teachers. Between 2006 and 2010 an additional 260,000 teachers were as contract teachers, with the intention of eventually gaining a post and then certification. recruited in this way in primary and junior secondary schools across Indonesia. Ultimately, however, evidence began to accumulate both about the integrity of the content and the fairness of What decentralization did mandate was the popular election of district-level legislatures and the district “regent� the portfolio assessment procedure across teacher education institutions and about the efficacy of the 90-hour (chief ) and then to the subsequent appointment by these regents of the heads of local government sectoral training program. This evidence was compelling and convinced the Ministry, despite opposition from some offices, such as education – appointments open to favoritism and manipulation rather than to experience and teacher associations, that a test of actual competency prior to certification was required. This led to the elimina- merit. It gave to these heads of district education offices influence over processes such as the appointment of tion of the portfolio as a means to gain certification and the development of both a Pre-Test of Teacher Com- sub-district office heads and school principals (in one reported case, 120 principals were replaced at one time by petency which determines whether a teacher remains in the certification queue and a post-training Teacher a new district education), the request for and deployment of new teaching posts, and the prioritisation of can- Competency Test to determine if the teacher has achieved the desired competencies and thus is eligible for didates for obtaining the four-year degree and, subsequently, entry into the certification process. And although certification and the professional allowance. Even in this process, however, political pressures (from teacher as- the Teacher Law gives to district offices the right to withhold the professional allowance from teachers who fail sociations to find most teachers competent) and financial exigencies (from the Ministry of Finance for the Minis- to meet given criteria of quality, due to a variety of local personal and political pressures this right is seldom try of Education and Culture to expend its budget for professional allowances) meant that the passing score for exercised. the competency test given in early 2012 was set by the Ministry at 30%. Another aspect of decentralisation is meant to be a stronger voice in education decision-making and budget Another aspect of Indonesia’s political and economic environment which became important in the implemen- oversight of parents and the community through elected school committees, an essential component of a ma- tation of the Teacher Law was the strong policy of decentralisation of authority and resources from the centre jor program on school-based management. Despite some progress in this regard in districts and schools which to regional (district and municipal) governments and agencies. This policy, starting in 2000, was expected to consciously attempt to promote this process, local voices are generally not an important factor in issues around weaken the hierarchical, almost feudal attitudes which made Indonesia’s bureaucracy so unwieldy and often so teacher reform. As a recent review of the school-based management program concluded, “Parents generally unimaginative by increasing the efficiency of the system and making it more innovative and responsive to the had a small voice in school matters. Parents’ deferential attitudes toward school staff, perceptions of the effec- needs of its constituencies and ultimate “clients�. And by stopping much of the decentralisation process at the tive division of labor between school and home, and schools’ lack of outreach appear to prevent parents from effectively exercising their voice in school affairs. Parents are rarely part of final decisions on school matters�. (Chen, 2011) 30 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 31 Indonesia as a Case Study for Comprehensive Teacher Reform Box 2.1 1.6. Conclusions School-Based Management in Indonesia The Indonesian Teacher Law of 2005 is unusual in the comprehensiveness of its various components and of the As part of a broad decentralization of governance responsibilities to districts, the Indonesian govern- institutions, mechanisms, strategies, and processes put in place to implement it. It is also unusual in the principal ment adopted school-based management (SBM) principles through regulations in 2003. SBM is a form incentive designed to inspire it – the granting of status as a “professional� and, probably more importantly, the of education governance that grants responsibilities and authority for individual school academic op- large and unconditional increase in income provided on gaining this status. erations to principals, teachers, and other local community-based stakeholders. The expectations are that local, and often shared, decision-making will lead to more efficient and effective policies and pro- grams aligned with local priorities, which in turn will lead to improved school performance and student But the evolution of the Teacher Law of 2005 from its original conceptualization to its current state of implemen- achievement. Because of the limited scope of past research on the implementation and effects of SBM tation is not unusual for major reforms. From larger macro-level political and economic considerations to more in Indonesia during its eight years of implementation, the Ministry of Education and Culture and the personal and institutional rivalries, a number of complications have arisen to delay or derail the implementation development partners expressed the need to undertake a study that aimed to (1) provide a nationwide of various parts of the reform. These are well understood by the Ministry of Education and Culture, and steps quantitative and qualitative status report on the implementation of SBM, (2) identify factors associated with successful practices of SBM, and (3) assess the effects of SBM on student achievement. are being undertaken to resolve many of them. Whether these are successful will go a long way to determining whether the lofty goals and aspirations of the Teacher Law are finally met. The study was carried out in 2010 and 2011 and was based on face-to-face surveys of principals, teach- ers, school committee (SC) members, and parents in 400 elementary schools; surveys of district staff With the context of this comprehensive reform now in place, the next Chapter turns to the conceptual frame- in 54 districts; and case studies in a subsample of 40 schools. Although the study determined that in work for quality education through reformed teacher management and development which forms the basis for general the structures (e.g., school committees, district-level supervision, teacher councils) and pro- the remaining chapters of this book. cesses (e.g., school committee elections, principal-teacher consultations) supportive of school-based management were nominally in place, successful implementation of the SBM program – still, in the history of things, relatively young – would require greater clarity of the roles and responsibilities of the various administrative levels of the system, more capacity building of all the system’s actors, and a stronger commitment to its goals and objectives. Based on the findings of the study and given the importance of SBM in the further development of Indonesian education, recommendations for improving the implementation and the outcomes of SBM focused on three actions: (1) expanding principal, teacher, and SC member capacity to implement SBM; (2) increasing school staff ability to make managerial and instructional changes; and (3) developing district capacity to support schools and SBM. Thus, both the economic impact of more resources available to local governments and the political impact of more power exercised by these governments have caused considerable concern about the fairness and pro- priety of a range of activities in the teacher management and development cycle, especially at the district and school level. As a result, the Law’s focus on longer-term, continuing quality improvement achieved through flexible, more adaptable, and individualised implementation has in some ways been lost due to political pres- sures for rapid certification and standardized treatment for all and economic pressures to quickly and completely spend the new funds moving into the education system. More generally, perhaps, the focus on a “structural� rather than a “cultural� solution to the low status and compe- tency levels of teachers – including a formal degree, portfolios and multiple choice tests, standardized processes for certification and standardized content for quality improvement, all leading to formal professional labelling and greater income – resulted, in some people’s view, in the downgrading of what in the past had actually been the basis for status: a strong commitment to, and passion, for teaching. 32 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 33 Teachers as the Cornerstone of Education Quality Chapter 2 Such a comprehensive definition of quality was at the core of the Dakar Framework for Action for EFA of 2000 .2 It contained both a target and a strategy on quality: Teachers as the Cornerstone • Target 6: Improving all aspects of the quality of education for all of Education Quality • Strategy 8: Create safe, healthy, inclusive, and equitably resourced educational environments with clearly defined levels of achievement for all. And it focused on ten characteristics of educational quality: “Available studies suggest that the main driver of the variation in student learning in school is the quality of the teachers…Studies that take into account all of the available • Healthy, well-nourished, and motivated students evidence on teacher effectiveness suggest that students placed with high-performing teachers will progress three times as fast as those placed with low-performing teachers.� 1 • Well-motivated and professionally competent teachers • Active learning techniques 2.1 A Definition of Education Quality • A relevant curriculum The evolution of the definition of quality in education has been a complex and non-linear one. But in simplified • Adequate, environmentally friendly, and easily accessible facilities terms, early definitions of quality focused on inputs and outputs. More schools and classrooms, more books and • Healthy, safe, and protective learning environments teachers, would inevitably lead not only to higher enrolments but also to higher completion rates and greater achievement. When such logic did not always lead to the expected results, attention eventually turned to the • Adequate evaluation of school environments, processes, and outcomes “black box� in the middle – the quality of the teachers, the teaching-learning process, and the curriculum it was • Participatory, school-based management meant to deliver – where the inputs were meant to be used in creative ways to produce the outcomes desired. Efforts were also focused on the “quality� of the children who entered school – were they healthy, well-nourished, • Respect for and engagement with local communities and cultures motivated to learn, and ready for school? Still later, the school climate or environment – what surrounded the • Adequate and equitable financing “black box� – also became of interest. Was the school a physically healthy and psycho-socially friendly and protective place to be – a sanctuary for children rather than a place with poor hygiene and unhealthy facilities, With this list, the definition of quality became truly comprehensive and multi-dimensional. This included char- corporal punishment, peer bullying, and teacher indifference and even cruelty? acteristics of the major actors (students, teachers, parents, the community), inputs (books, learning materials, facilities), processes (teaching and learning, school governance, monitoring and evaluation, financing), environ- Even later, the larger environment of parents, families, and communities was included in the definition. Are ments (of the classroom, the school, and the surrounding community), and, ultimately, outcomes (enrolment, families willing and able to be involved in making the school better and helping their children learn more? And retention, completion, achievement). is the school willing and able to accept their involvement? Is the larger community supportive of – rather than dismissive of – the school? Is the school sensitive to and supportive of the local community and its culture(s)? Whatever the definition of “good� education has been – and particularly in any more comprehensive definition used today – the role of the teacher in providing an education of good quality is seen as ever more critical; “the Most recently, the nature and quality of school governance have become important. Do individual schools, quality of education, in other words, cannot exceed the quality of its teachers.� 3 It is the teacher who must use through a collaborative partnership of school staff, parents, and the community, develop efficient school-based more student-centred, active teaching-learning techniques to deliver a relevant curriculum; who, often in the management mechanisms and procedures, including sensitive self-assessments of school conditions (inputs, context of increasingly powerful school-based management, must promote community support for the school processes, outcomes) and forward-looking, innovative, and hopefully adequately-financed school improvement and demonstrate respect for and engagement with local communities; who must demonstrate both good prac- plans? tice and strong ethical principles; and, ultimately, who must motivate students, ensure their health and safety, and help them learn what they want to – and need to – learn. A strong, rigorous, merit-based teacher manage- ment and development system is therefore essential in creating the teachers who can fulfil this increasingly important role. 1 Barber, M., and Mourshed, M. 2007. How the World’s Best Performing School Systems Come out on Top. McKinsey & Company. p. 12. 2 UNESCO. 2000. Dakar Framework of Action for EFA. Paris. UNESCO. 3 Barber, M., et al, ibid. p. 16 34 35 Teachers as the Cornerstone of Education Quality 2.2. A Conceptual Framework for Teacher Quality edge domains (Bereiter et al., 20035 ; Greeno, Collins, and Resnick (1996)). This approach typically involves ex- perimental or quasi-experimental studies of specific instructional approaches and how these approaches affect Defining a good teacher student learning. The comprehensive and multi-dimensional definition of quality provided above requires an equally comprehen- In both of these approaches, student performance is often used as a more easily measurable proxy of teacher sive and multi-dimensional framework for teacher quality. But describing the nature and quality of a teaching effectiveness. An important feature of such measurement is that student learning is characterized as multi- force in any nation is a complex task; this is even truer in an education system as large and diverse as Indonesia’s. dimensional, making it quite distinct from the older process-product studies. Student outcomes are often ex- The logical place to start, of course, is an assessment of its quality – just how good are the teachers, how well do amined not only on cognitive outcomes but also on affective and meta-cognitive outcomes ((Snow & Lohman, they teach, and what kinds of outcomes do they achieve for their students? 1984). This view holds teaching to be the creation of a learning environment for students to undertake cognitive activities through which they are able to build knowledge and reasoning capacity. This, of course, has its own What constitutes effective teaching is a matter that has long been deliberated by psychologists, sociologists and challenges, especially at the primary school level where, over a number of years, students may experience a educators with a general focus on what teaching strategies, techniques, and devices contribute most effectively variety of different teachers. Furthermore, student performance in (say) arithmetic is conditioned not only by a to student learning. Although there is often an attempt to simplify it, learning is a complex and contextual pro- wide range of external factors (the student’s health and nutritional status, family background, prior experience in cess. It requires specifics of what teaching methods, under what conditions, with what students, in what subject an early childhood development program, extent of exposure to the language of instruction used in school) but areas, and at what grade levels are essential to achieve effective learning (O’Neill, 1988). also by many internal school factors beyond teacher quality including the availability of texts and other materials, the language of instruction, and the physical and psycho-social environment of the school as a whole. There are many ways in which the quality of teachers and teaching can be conceptualised and measured.4 One focuses principally on teacher productivity. This is perhaps best assessed by general classroom performance and Assuming such factors can be taken into account in any systematic assessment, resulting student outcomes specific teacher practices. In recent decades, greater attention has been given to such practices, in part due to can be correlated with a number of policy indicators related to teacher management and development. For landmark studies that found classroom effects to be greater than school effects (e.g., Sanders and Rivers (1996), example, (Rice) identifies a number of these as follows: Scheerens (1992)). One result has been that research related to effective teaching has been expanding rapidly. • teacher preparation programs and degrees; i.e., what is the structure of teacher education in terms of the balance between practice and theory, what percentage of teachers has how many years of formal Process-Product Function pre-service education, and what percentage has attained the desired/required degree mandated by Teaching behavior and its relation to student achievement had traditionally been studied through what have the Ministry? become known as “process-product� studies in which teaching practices and behavior are statistically linked • teacher experience, including both induction/mentoring in the early years of a teacher’s career and to student outcomes with the goal of determining which practices or behaviors positively or negatively affect later in-service training outcomes (Muijs & Reynolds, 2002). But this process-product model is limited – seen as often too subjective, un- • in both pre-service and in-service education, the extent to which teachers have followed coursework dertaken by principals or supervisors rather than neutral assessors, sporadic, and unsystematic - and new models relevant to the subject area(s) they teach and the pedagogical skills needed to teach it are emerging to replace it (Seidel & Shavelson, 2007). Such models of teaching and learning have changed to emphasize cognitive and affective components. A critical reason for this shift is that in the past decade teaching • the teachers’ own test scores, especially the teacher’s literacy level or verbal abilities, but also subject effectiveness research has concentrated on more global aspects of teaching and on analyzing teaching patterns knowledge or regimes instead of single teaching acts (Borko, 2004). • ultimately, based on a mixture of some or all of the above, some kind of formal teacher certification (especially when certification is in the subject which the teacher is assigned to teach). In this shift, two distinct approaches have emerged. One approach has focused on large-scale surveys with sophisticated multi-level statistical models of students nested within classes nested within schools with extrane- Unfortunately, the literature on the impact of these policy indictors is not altogether clear. This is especially the ous variables controlled. This has increased statistical power in detecting effects (Raudenbush (2004); Rowan, case in regard to issues of qualification and certification. These are often used as a measure of teacher quality, and Correnti, and Miller (2002)). In the second approach, there is a focus on processes of learning in specific knowl- a great deal of research has been done examining education levels (e.g., a four-year degree), degree types (e.g. mathematics versus mathematics education), and qualifications (e.g. certification, training received). In a study 4 Much of this analysis derives from Craig, Helen, et al. Teachers Matter: Attracting, Developing and Retaining Effective Teachers. OECD, Paris, 5 Bereiter, C., & Scardamalia, M. (2003). Learning to work creatively with knowledge. Powerful learning environments: Unravelling basic compo- 2005. nents and dimensions, 55-68. 36 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 37 Teachers as the Cornerstone of Education Quality employing multiple years of the reading and mathematics assessments of the National Assessment of Educa- This approach also recognizes that the role of a teacher involves a broad range of knowledge and skills. The tion Progress (NAEP), (L. Darling-Hammond, 2000) examined the relative contributions of teacher qualifications, teacher needs to have an in-depth understanding of the subject matter being taught and the requirements other school inputs, and student characteristics to student achievement. After controlling for student poverty of the curriculum. The teacher also needs to understand child development (physical, cognitive and linguistic, and student language background, this study found that “measures of teacher preparation and certification were social, and moral), appreciate factors that facilitate or inhibit learning, and have a good understanding of the the strongest correlates of average student achievement in reading and mathematics. The most strongly signifi- context for learning, including both factors in the classroom (such as its climate) and factors in the home and cant predictor of achievement was the proportion of well-qualified teachers, defined as the proportion holding community (such as their general support for the school). Also necessary is a good knowledge of instructional both full certification and a major in the field being taught.� (L. Darling-Hammond & Berry, 2006) also note that it psychology including theories of teaching and learning and of methods of teaching that foster active learning is the less advantaged students that benefit most, stating, “studies show that well prepared and well-supported and problem solving, facilitate group learning and constructive student interaction, and develop in children a teachers are important for all students, but especially for students who come to school with greater needs.� love of reading and learning. On the other hand, there have also been many studies that find certification programs and other qualifications Beyond this knowledge base, the teacher needs a range of skills: to be a poor measure of teacher quality. Leigh (2007) argues that formal qualifications of teachers and other information frequently recorded on a database of teachers (e.g., gender, age, degrees held, certification) seldom • classroom management -- planning lessons, organizing structured but personalised learning experi- predict effectiveness in raising student achievement. Others (Wayne & Youngs, 2003) agree, finding “little differ- ences, delivering the required content in the language of instruction (and helping children weak in ent in the average academic achievement impacts of certified, uncertified, and alternatively certified teachers�. that language to gain this content), providing appropriate reinforcement, and assessing what stu- (Kane, Rockoff, & Staiger, 2008) Many of such instances relate to the inability to use effective pedagogy; there is dents learn and being alert to children who show evidence of being at risk of failure often a significant discordance between knowledge of subject and ability to manage in the classroom. Clearly, • school relationships and improvement -- collaborating with colleagues in assessing the school’s sta- aptitude and calling have a place in the teaching profession. tus, developing school improvement plans, and building a positive school climate Teacher Knowledge and Classroom Behavior • school-community relationships -- providing appropriate reports to parents and motivating their sup- port of and involvement in school affairs A second way to conceptualise and measure teacher quality looks not at outcomes but rather at what teachers should know and be able to do – essential knowledge and skills rather than outcomes. Research in this vein sug- • self-reflection and improvement -- being able to reflect on their own teaching (including with their gests that high quality/effective teachers who are able to increase the academic achievement of their students peers) and improve their performance accordingly. tend to share many of the characteristics listed in Table 2.1: Such teaching skills, perhaps less easily measured but essential indicators of quality, have been one of the major Table 2.1 foci of the reforms in Indonesia and are addressed in different ways in most chapters of this book. For example, Characteristics of Good Teachers many of the key skills have been built into the teaching/learning packages used by the Ministry through the local teacher working groups as discussed in Chapter 3. The video-study discussed in Chapter 5 also has a clear OECD List (2005) Synthesis by (Craig, Kraft, & Du Plessis, 1998) focus on the nature of the teaching-learning process and presents a pioneering in-depth analysis of secondary school mathematics teaching which directly links student outcomes with teacher knowledge and behaviours. • demonstrate commitment • know their subject matter • have subject specific knowledge and know their • use pedagogy appropriate for the content craft • use an appropriate language of instruction and Also examined in this book are more general values and behaviors related to teacher quality including profes- • love children have mastery of that language sional commitment, ethical behavior, and -- more concrete and measurable -- absenteeism, the holding of sec- • set an example of moral conduct • create and sustain an effective learning environ- ond jobs, and workload. The assumption that higher status and remuneration will somehow automatically lead • manage groups effectively ment to better outcomes in regard to such behaviors is subject to detailed analysis. • incorporate new technology • find out about and respond to the needs and • master multiple models of teaching and learning interests of their students and communities • adjust and improvise their practice Such a plethora of desired knowledge, skills, and values makes imperative some set of professional compe- • reflect on their teaching and children’s responses • know their students as individuals and make changes to the learning environment as tency standards. This also includes measures and methods to assess their achievement. These standards usu- • exchange ideas with other teachers necessary ally underpin training courses, assessment instruments, and accreditation requirements as well as professional • reflect on their practice • have a strong sense of ethics development courses. They should be (but seldom are) developed collaboratively by Ministry of Education staff, • collaborate with other teachers • are committed to teaching academics and teacher trainers, and representatives of professional teacher associations. Such standards have • advance the profession of teaching • care about their students also been a major focus of the reform. • contribute to society at large 38 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 39 Teachers as the Cornerstone of Education Quality Conceptual Framework for Quality Education: The Political and Financial Context Managing and Developing Good Teachers “Policy design and implementation is a complex, multi-directional, fragmented and unpredictable process. A political economy lens broadens operational considerations beyond technical solutions to include an emphasis “Countries that have succeeded in making teaching an attractive profession have often done so on stakeholders, institutions, and processes by which policy reform is negotiated and played out in the policy not just through pay, but by raising the status of teaching, offering real career prospects, and giv- arena...A vital component of understanding context is the political dynamics of policy change – how reforms en teachers responsibility as professionals and leaders of reform. This requires teacher education get tabled and why; how they are perceived; and who will support, oppose or attempt to change the proposals that helps teachers to become innovators and researchers in education, not just deliverers of the which have been made.� (WorldBank, 2008a)7 curriculum.�(OECD, 2011)6 No education policy is perhaps more complex, multi-directional, fragmented, and unpredictable than that re- garding teacher management and development. Teachers often represent a large percentage of the total civil Managing teachers – individually, both in a classroom and throughout a career, and collectively, as an entire service, and in many societies they play an important and influential role in the community as well as in the cadre – is a difficult enough task. Ensuring that they progressively develop in their profession, from first recruit- school. Thus, all of the various stages of teacher reform described below, both in general and then in relation to ment to final retirement, only adds to the complexity of the challenge facing ministries of education around the Indonesia, must be analyzed in terms of the larger political context surrounding them – both the historical con- world. Meeting this challenge successfully requires a comprehensive framework of teacher reform encompass- text relevant to education (which has played an important role in the development of Indonesia education) and ing essential standards and competencies and the institutions, mechanisms, strategies, and processes required the current structure and nature of the government and the ministry of education which propose the reform, to ensure these competencies are achieved, assessed, continuously improved on, and ultimately rewarded. Fig- those who support and oppose it (and why), and those who win and those that lose from it. ure 2.1 reflects such a framework. Equally important is the financial context – national, local, school, and community support to education and the Figure 2.1 start-up and recurring costs of the reform itself – which helps determine what can be done, how quickly, and Conceptual Framework for Quality Education how rigorously. More and more middle-income countries such as Indonesia are finding additional resources to put into education, and the financial decisions they make about these resources, whether into teachers or infrastructure, pre-schools or universities, will have important long-term effects on the development of their education systems. Recruitment A comprehensive framework towards quality education requires attention to many different steps in the teacher management and development framework. Recruitment into teacher education institutions is the first step in the career of a new teacher, and an ever wider range of strategies is being used by countries to recruit higher- level candidates for the teaching profession. Higher pay, of course – competitive with other “professions� – helps, but many other strategies are also being applied. These include8 9 : • active recruitment campaigns, especially (1) among secondary school graduates with the highest achievement levels and, in some countries, “non-traditional� candidates (e.g., mid-career professionals seeking a career change), and (2) for subjects (usually science and mathematics) and regions (rural and remote) where shortages of good teachers are often the greatest • rigorous selection processes – not only graduation records and entrance examinations but also test- ing of subject knowledge, literacy, numeracy, and communication skills and interviews to assess mo- tivation, personality, and sensitivity to student needs; these processes can help prove to candidates and the larger public that teaching is, in fact, a high-status profession 7 The World Bank (2008). “The Political Economy of Policy Reform: Issues and Implications for Policy Dialogue and Development Operations, The World Bank: Washington, D.C. p. i. 6 OECD. 2011. Building a High-Quality Teaching Profession: Lessons from Around the World. OECD: Paris. p. 5. 8 Ibid. 9 McKinsey and Company. 2007. How the World’s Best-Performing Systems Come out on Top 40 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 41 Teachers as the Cornerstone of Education Quality • financial incentives such as fee waivers, loans, and scholarships, perhaps biased toward under-repre- In regard to the last point, it has become increasingly important to place candidate teachers into classrooms sented fields and teachers destined for difficult locations as early as possible. This should not happen in the second semester of the last year as is often the case but as early as possible so that future teachers can both practice and improve the whole range of skills they need and • more flexible approaches to teacher education such as part-time study and distance education, espe- clearly see the challenges (and rewards) of being a teacher (thereby perhaps weeding out those not committed cially for non-traditional candidates and those from usually under-represented groups such as people enough to face the challenges). Success of this professional component of pre-service education depends on from ethnic minorities and with disabilities and also males in pre-school and primary education both: (1) an effective partnership among the lecturers of the teacher education institution, the school coordina- • a clearly defined career path which holds out the possibility of both merit-based promotion and di- tor of the professional experience, the supervising classroom teacher(s), and, of course, the candidate teacher, verse opportunities within the system and (2) the use of a range of “real� schools for this professional experience, demonstrating good practice in a • ultimately, the prospect of actually being a “professional�, able to exercise responsibility, autonomy, number of often challenging contexts, rather than only in elite, often university-based laboratory schools.12 and innovativeness in one’s daily work. The role of assessment, both of teacher education institutions and of the newly educated teacher, has become Pre-service Teacher Education especially critical. In many countries such as Indonesia, which are moving aggressively toward a more system- atic process of teacher certification, there have been increasingly greater demands on their teacher education Once the candidate is selected, the nature and quality of pre-service teacher education become paramount. institutions and a greater need for their formal accreditation. What standards should be used for such accredita- There are many options for such education, including (Stevenson, 2009)10 : tion, and should there be different levels of accreditation? Who should accredit? For what level(s) of teaching and what subject content? Is there a maximum number of institutions which should receive accreditation, and • a multi-year course (e.g., four years leading to a Bachelor of Education) which integrates pedagogy, how to control what is often a mushrooming of such institutions, especially in remote areas of a country such as subject content, and practical teaching experience Indonesia? And how, using what criteria and mechanisms, will these institutions determine when a candidate • an “end-on� option which adds one or two years of professional training (pedagogy and practical teacher is adequately prepared for assignment to a school? When, how, and by whom is such an assessment experience) to a subject-matter university degree made? And, ultimately, how serious is the system of assessment if it is not willing to “push out� candidates who • a double degree (with a major and a minor) with additional training in education are not qualified - or qualifiable? • for mid-career professionals, a short course of pedagogy and practical experience with continual su- Induction, Mentoring, and Probation pervision in school by the training institution. But getting new teachers into a school is only the first step in a career-long program of professional develop- In all such programs there are a number of essential, basic principles:11 ment. In the best of worlds, an education system manages to attract better candidates to become teachers – most likely through a combination of higher pay, higher status, and appeals to commit oneself to an honorable • the existence of clear and concise profiles or standards outlining desired teacher competencies -- profession – and one way or another provides them during their pre-service education the basic knowledge, what teachers are expected to know and be able to do in specific subject areas; such competencies skills, and values needed to be a good teacher. But even if this initial education is soundly based in classroom can guide not only teacher education but also certification, evaluation, professional development, experience, the transition to being a full-time teacher responsible for the education of one or more classes of and career advancement learners, expected to fit in and work well with a team of strangers, and accountable both up the system to the • more innovative content in teacher education with emphases on such skills as personalised instruc- principal and supervisor/inspector and, more and more often, out of the system to parents and the community tion based on the individual learner’s needs, reflective practice, and in-school, on-the-job research is not an easy process. Facilitating this transition, helping teachers be successful at the beginning of their careers (and easing out those who cannot be), continuously enhancing teacher motivation and improving teaching • training for special circumstances; e.g., multi-grade and double-subject teaching for small, remote practice, and systematically assessing teacher performance for the sake of both their students’ learning and their schools, teaching in the students’ mother tongue, and teaching learners with disabilities and in (post-) own career progression – these are all essential components of continuous professional development. emergency or conflict contexts • a move toward the preparation of professionals in school settings, separate from the largely academic The processes of induction, mentoring, and probation should be linked seamlessly to the teacher’s future pro- preparation in the training institution, thus finding a proper balance between theory and practice. fessional development. These are especially important because “the learning curve during the first years of teaching is particularly steep. Having support to confront this learning curve in a gradual but steady manner is important to build new teachers’ self-confidence, help them cope with the demands of the profession, and re- 10 Stevenson, Ritchie. 2009. Some International Perspectives and Ideas on Pre-service Teacher Education (draft). Jakarta: World Bank. 11 OECD. op. cit. 12 Stevenson. op.cit. 42 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 43 Teachers as the Cornerstone of Education Quality duce drop-outs�. Induction, well-implemented, is important for new teachers for several reasons: “familiarization Continuing Professional Development with the responsibilities of teaching and the culture of the school in which they teach…increased competency Accompanying these early-career experiences and continuing beyond them, throughout a teacher’s career, is through improvement of their professional skills in the classroom by learning from experienced teachers in an more focused continuing professional development or in-service education. New and updated content knowl- authentic environment…assessment of their classroom performance to ensure they are effective in their duties edge, curricula, and textbooks have to be mastered; existing skills refined and new ones required in new teach- as a teacher…improved retention of teachers in the profession…� 13 ing contexts and derived from new research learned; and new challenges facing teachers need to be met. These challenges inter alia include: There is a range of activities that can be considered as induction. This may vary from the very informal (a wel- come by the principal) to the formal (mentoring, workshops, observation of model classes, etc.). However, a well- • new roles for teachers in the context of decentralisation and newly empowered school committees planned induction should at least include orientation to the school community; the provision of a systematic • more diversified programs requiring more specialised skills program of formal instruction in areas such as curriculum content, teaching methods, classroom management and assessment, advice to students, and school policies; and mentoring by an experienced teacher. • new kinds of learners with more diverse backgrounds and identities, different values and different ways of thinking and acting, and greater independence and open-mindedness This last, of course, links into the other important part of early professional development – probation. This is in • new information and communication technologies (which students often master more quickly than theory a trial period (often one year with the possibility of extension) when new teachers can be evaluated as their teachers). 14 (Shaeffer, In print) to whether they are genuinely suited to teaching. In a sense, the evaluation concerns the extent to which the teacher has become successful in the practice of teaching - in other words, can the teacher be confirmed as a The professional development needed to help teachers both improve what they currently do and meet the permanent civil servant? The tools of probation are several – all designed to assess whether the new teacher new demands thrust upon them can be carried out in several ways. Unfortunately, the most typical are one-off has met the required teaching standards – and can include written tests, classroom observation of content seminars and in-service short courses often conducted, as in Indonesia, in cascade fashion where the message knowledge and teaching practice, the teacher’s classroom documentation, feedback from parents and students, received at the bottom of the cascade bears little resemblance to that delivered at the top. What is rather need- interviews, the assessment of the teacher’s relationships with other teachers and his/her general contributions ed, and what teachers are reported as wanting, is both training linked to some kind of longer-term qualifica- to school activities and decision-making processes, etc. tion process and more on-going, school-based, research-focused training, practice, and feedback with adequate time, follow-up support, and involvement in learning activities that are similar to those they will use with their Certification students.15 For permanent employment as a teacher, most school systems require teachers to hold certification. This is official recognition that the teacher has reached the standard endorsed by the education authorities and is a Much of this development, of course, is best done through effective teacher collaboration. “Teachers report rela- mark of the teacher’s competence in subject-matter knowledge and teaching methodology. It also indicates the tively infrequent collaboration with colleagues within the school, beyond a mere exchange of information and teacher possesses the attitudes and personal characteristics necessary for the special relationships of trust and ideas; direct professional collaboration to enhance student learning is rarer.� 16 Much of this collaboration can be guidance they must have to effectively impart knowledge and skills to the young. Certification is most usually promoted in schools through group- and inquiry-based collaboration, but in many systems with relatively small based upon the academic achievement of teachers in their teaching subject as well as their knowledge of child schools (as in Indonesia), school clusters – groupings of schools geographically in close proximity – can serve a development and education. However, skill and expertise in the classroom in the delivery of effective learning very useful function in promoting collaboration in what can become genuine learning communities. Teachers experiences for students is also part of certification. In making certification decisions, some authorities consider of the same grade or subject can meet regularly to share lesson plans and teaching practices, explore the use of the academic qualifications as provided by the university or college to the teacher on graduation but will only new materials and media, and work through issues such as teaching children with special needs or in mother accept the practical professional capability of the teacher following a formal assessment by a school principal, tongue. usually during the probationary period. In this situation the certification award is based on a balance between academic excellence as judged by the lecturers and teaching expertise as judged by the employer. This would A further mechanism of professional development is distance learning. This is especially useful for teachers in dis- seem to be a very worthwhile method of ensuring only well-rounded teachers with the best knowledge, skills tant or difficult contexts where they cannot get to institution-based in-service programs and perhaps not even and attitudes are certified to educate children. to cluster meetings. Such distance learning ranges from radio- and television-based programming directed at the individual school and teacher to immense open universities providing a range of distant-learning services to teachers throughout the nation. 14 Shaeffer, Sheldon, The quality of basic education: Issues and challenges for Asia, Asian Development Bank and the National University of Singapore 13 Stevenson, Ritchie, 2009. Paper on Induction of Beginning Teachers. Draft. p.3. 15 OECD op cit p21 16 Ibid p23 44 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 45 Teachers as the Cornerstone of Education Quality Teacher Appraisal and Career Development old and has been the subject to much research…that evidence shows that merit pay plans seldom last longer than five years and that merit pay consistently fails to improve students’ performance.� 18 A final component of continuous professional development relates to the appraisal of teachers’ performance. Hopefully this will be linked to progression, promotion, and diversification in their careers. Such appraisal usually Another view is as follows: “In an influential article, (Murnane & Cohen, 1986) suggest that merit pay and edu- considers three aspects of professional competence17 : cation do not mix because the complex work that teachers do is difficult to evaluate. Without clear measures • professional knowledge and understanding – of their students, school, and community; of the cur- and criteria for judging success, decisions about rewarding performance are, at best, subjective and, at worst, riculum they are meant to deliver; and of the education system (and its policies and practices) of unworkable. They also suggest that merit pay is problematic because it raises the potential for dysfunctional (or, which they are a part as they call it, opportunistic) behavior: that is, teachers may end up focusing only on tasks that are rewarded by • professional skills and abilities – of planning and delivering coherent programs, in well-managed a merit pay plan at the expense of additional goals or tasks valued by the public (e.g., promoting citizenship, or classrooms, appropriate to their pupils’ needs and abilities; of using relevant media, teaching strate- reducing drug use or violence). Furthermore, at its worst, merit pay may have a demoralizing and counterpro- gies, and resources; of working cooperatively with their colleagues, parents, and the community; of ductive effect on the work place, corroding teacher collegiality by introducing competition. In sum, this is the implementing appropriate and fair assessment and reporting of student progress; and of systemati- view that there is something about the nature of teaching and schooling that makes the effective use of merit cally reflecting on – and improving -- one’s performance pay in public education unlikely.� (Goldhaber, DeArmond, Player, & Choi, 2008) • professional values and personal commitment – to promoting social justice and inclusion, to continu- 2.3. Teacher Reform around the World ing professional learning and development, and to valuing and respecting the partners with whom they work. The literature on comprehensive teacher reform around the world, covering all aspects and stages of teacher Just as important as the competencies to be gained is the nature of the appraisal process itself. Whoever is in- management and development, is limited. The literature which does exist, like the reforms themselves, is largely volved in the appraisal – e.g., the principal and/or supervisor – must work with the teacher at the beginning of piecemeal in nature – some on incentives, some on pre-service education, some on principal and supervisor the process to identify individual goals and performance indicators, then to review progress mid-year and later training – which is why the reform in Indonesia and the analysis of it offered by book is so potentially useful. The at an annual performance review, and then to make decisions regarding actions such as confirmation (or not) following are some of the issues addressed and lessons learned from this literature: of probationary teachers and the need for further development and training in areas of weakness or areas for future growth. Teacher status: “Successful countries have shown how a teaching profession that assumes a high level of re- sponsibility and is well rewarded can attract some of the best graduates into a teaching career. Dramatically Formal appraisal can also support a system’s merit-based progression (and promotion) process. The setting of increasing the quality and prestige of a nation’s teaching corps is far from easy and cannot be done overnight. goals and the provision of appropriate professional in-service training and advanced mentoring can improve However, solutions include measures at recruitment stage, but more importantly involve transforming the teach- teacher quality and motivation and also act to prepare teachers for accelerated professional progression, promo- ing profession from within…Above all, professional development needs to be integrated into both an individual tion, and future educational leadership. teacher’s career and school and system changes. At the career level, in-service education, appraisal and reward need to be closely aligned. At the same time, learning that improves individual competencies and collaboration One final point concerning teacher management and student achievement: there is a rapidly expanding body among teachers to produce better instruction in the classroom must go hand-in-hand.� (OECD, 2011) of research that evaluates the effects of bonus payment schemes on teachers’ work. Bonus payment schemes, or pay-for-performance schemes, top up salaries in ways that are conditional on performance. Performance can Recruitment: “The issue of teacher demand and supply is both complex and multi-dimensional, as it reflects be measured on the basis of inputs (e.g., absenteeism levels) or outputs (e.g., student learning gains). It has been several challenges: how to expand the pool of qualified teachers, how to address shortages in specific subjects, shown that pay-for-performance schemes can work in developing country settings (see (Bruns et al., 2011) for how to recruit teachers to the places where they are most needed, how to distribute teachers in equitable and a summary or (Muralidharan & Sundararaman, 2011), one of the most comprehensive studies on this topic to efficient ways, and how to retain qualified teachers over time. Policy responses are needed at two levels. The date). Muralidharan and Sundararaman (2011), for example, show that individual teacher incentives work -- and first concerns the nature of the teaching profession itself and teachers’ work environment. Such policies seek to work better than group incentives -- which in turn work better than unconditional block grants to schools. How- improve the profession’s general status and competitive position in the job market and are the focus of this pa- ever, even though some literature shows that bonus payment schemes can work, there are perhaps insurmount- per. The second involves more targeted responses and incentives for particular types of teacher shortage, which able difficulties associated with implementing such schemes in real-world, whole-system contexts. Pfeffer and recognizes that that there is not a single labor market for teachers, but a set of them, distinguished by school Sutton sum up the debate as follows: “It turns out that merit pay for teachers is an idea that is almost 100 years type and characteristics, such as subject specialization. Competitive compensation and other incentives, career 17 Stevenson, Ritchie, 2009, Approaches to the Management of Underperforming Teachers in Indonesia, Draft 18 Pfeffer, J. and Sutton, R. 2006. Hard Facts, Dangerous Half-truths, and Total Nonsense. Boston: Harvard Business School Press. pp. 22-23. 46 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 47 Teachers as the Cornerstone of Education Quality prospects and diversity, and giving teachers responsibility as professionals are important parts of strategies to work of teachers and school principals. Aligning criteria for school evaluation with those for teacher appraisal attract the most talented teachers to the most challenging classrooms.�OECD (2011) and feedback would emphasize the importance of policy objectives at the school level and could give teachers and school principals an incentive to meet such objectives� (OECD 2009). Teacher education: “What teacher preparation programs are needed to prepare graduates who are ready to teach well in a 21st-century classroom? One of the key challenges for the teaching profession is to strengthen A focus on learning: In its groundbreaking study of learning in the best school systems in East Asia (Hong Kong, the “technical core� of its professional practices which requires the development of educational ecosystems that South Korea, Shanghai and Singapore), the Grattan Institute shows that success in high-performing systems is support the creation, accumulation and diffusion of this professional knowledge. Such ecosystems need to draw not always the result of spending more money. These four systems all focus on “…things that are known to mat- on four sources: innovation and knowledge inspired by science (research and evaluation); innovation inspired ter in the classroom, including a relentless, practical focus on learning, and the creation of a strong culture of by firms (entrepreneurial development of new products and services); innovation and knowledge inspired by teacher education, research, collaboration, mentoring, feedback and sustained professional development. These practitioners (teachers, school heads); and innovation inspired by users (students, parents, communities).� (OECD, are precisely the reforms that Australia and other Western countries are trying to embed� (Jensen, 2012) 2011) Finally, some of the most sensitive analysis of comprehensive (as opposed to piecemeal) education reform de- School autonomy: “School leaders can make a difference in school and student performance if they are grant- rives from the work of Michael Fullan. In essence, he argues that “all really does mean all. You can’t solve the prob- ed the autonomy to make important decisions. To do this effectively, they need to be able to adapt teaching lem of whole-system reform through piecemeal efforts that try to get parts of the system improving in order programs to local needs, promote teamwork among teachers, and engage in teacher monitoring, evaluation to show the way. System reform does not, cannot work that way.� 19 (Fullan, 2010) On the one hand, this refers and professional development. They need discretion in setting strategic direction and must be able to develop to whole-school reform – not one teacher being trained (or certified) at a time, which means pupils move from school plans and goals and monitor progress, using data to improve practice. They also need to be able to in- good to bad teachers and back again, but all teachers, with the school leadership, the parent-teacher association, fluence teacher recruitment to improve the match between candidates and their school’s needs. Last but not and the community as a whole involved in the process. This focus on both the individual teacher and the col- least, leadership preparation and training are central and building networks of schools to stimulate and spread lective school community makes possible change essential in the school culture. “The obvious point is that the innovation and to develop diverse curricula, extended services and professional support can bring substantial culture of the school, itself a collective capacity by definition, is more important, in fact essential for full success… benefits.� (OECD, 2011) Thus, individual capacity thrives if it is integrated with strategies and experiences that foster collective capacity. There is no other way. The top-performing countries have quality teachers, but they have them in numbers – School leadership: “School leadership and particular school personnel practices may be a driving force in ef- that is, the entire profession or virtually all teachers, not just a percentage of selectively rewarded ones.� 20 fective schooling. Not only are school leaders responsible for personnel practices, but recent prior work has highlighted the importance of personnel practices and other organizational management practices for distin- But, significantly, Fullan is also talking about whole-system reform which “involves all schools in the system get- guishing (if not causing) effective schools (Grissom and Loeb 2009; Horng, Klasik, and Loeb 2010). The results ting better, including reducing the gap between high and low performers. Whole-system reform produces are also not surprising. Teachers strongly affect students’ educational opportunities. Higher performing schools higher levels of education performance on important cognitive and social learning goals, and it does so while seem better able to build a staff of strong teachers through differential retention of good teachers, through reducing the gap toward a more equal public education system�.21 Ultimately, therefore, change is systemic. In recruitment and hiring, and through providing supports for teacher improvement…more effective schools are most contexts, “political pressures combine with the segmented, uncoordinated nature of educational organiza- doing all three. In addition, these schools appear to use their teaching resources more efficiently, not assigning tions to produce…a steady stream of episodic innovations – cooperative learning, effective schools research, new teachers to lower performing students.� (Loeb, Kalogrides, & Beteille, 2011) classroom management, assessment schemes, career ladders, peer coaching, etc., etc. – come and go. Not only do they fail to leave much of a trace, but they also leave teachers and the public with a growing cynicism that Teacher appraisal: “Teacher appraisal and feedback has a positive impact on teachers…both to teachers per- innovation is marginal and politically motivated…[Rather] 1) reform must focus on the development and inter- sonally and to the development of their teaching. Positive impacts on job satisfaction and, to a lesser extent, job relationships of all the main components of the system simultaneously – curriculum, teaching and teacher de- security are important, given that the introduction of systems of teacher appraisal can be met with criticism and velopment, community, student support systems, and so, and 2) reform must focus not just on structure, policy, potential negative reactions, especially where it is linked to accountability. Moreover…such systems contribute and regulations but on deeper issues of the culture of the system.� 22 (Fullan & Miles, 1992) to school improvement. Numerous initiatives developed by policy makers aiming to lift school improvement have had teacher development at the core...The school evaluative framework is often policy malleable so that not only can the strength of the evaluative framework be altered but also its focus. The criteria by which schools are evaluated and teachers are appraised and receive feedback should be aligned with the objectives of the sys- tem of school education. These objectives may relate to aspects of student performance, teacher development, 19 Fullan, Michael, 2010. All Systems Go: The Change Imperative for Whole System Reform, Corwin: Thousand Oaks, California. p. 5. 20 Fullan, p. 87 specific teaching practices, the maintenance of specific standards and procedures, and a variety of aspects of the 21 Fullan, p. 18. 22 Fullan, Michael, and Matthew Miles, 1992. “Getting reform right: What works and what doesn’t�. Phi Delta Kappan, 73, 745-752 48 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 49 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes Chapter 3 Table 3.1 Law and Regulations of the Teacher Reform The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes “Countries that have succeeded in making teaching an attractive profession have often done so not just through pay, but by raising the status of teaching, offering real career prospects, and given teachers re- sponsibility as professionals and leaders of reform. This requires teacher education that helps teachers to become innovators and researchers in education, not just deliverers of the curriculum.� (OECD, 2011) 3.1. The Laws and Regulations Supporting Teacher Reform Past attempts in Indonesia to deal with issues of teacher quality have had limited impact partly because they have been conceived and implemented in a piecemeal fashion. Salary increases, higher training requirements, professional development courses, promotion opportunities, and other strategies, in themselves, have had only limited impact. Only the Teacher Law, with its emphasis on the certification of all teachers, has attempted to comprehensively address the issue of teacher quality improvement by linking a range of strategies to the pow- erful incentive of a significant increase in income. This has resulted in a period of fundamental change with the whole teaching service being subject to new rules and regulations governing the conditions of teachers. These include performance appraisal being linked to career progression, major education institutions being subject to new standards and required to deliver new services such as four-year degrees and professional training courses, teachers being required to do continuous professional development, and districts and schools being required to enforce new workload rules. The period since the enactment of the Teacher Law has therefore been one of con- stant pressure to change the education system to meet the changing requirements of a modern and dynamic Indonesian state. The Law has been the springboard for this extensive change. Most impressive, given the massive size and complexity of the Indonesian education system, has been the fi- nancial capacity and sustained energy required to transform a poorly paid and ineffectively managed teaching service. This has required an almost fearless determination to develop and implement procedures to deal with the system’s large numbers of districts, schools, and teachers. Over it all, certification has been adopted as a re- quirement for both in-service and pre-service teachers and designed to act as a benchmark for all teachers, both government and non-government. It is intended to provide the community with a guarantee of the quality and professionalism of all teachers, everywhere – their standard of training, their skills and capacity, and their ability to shape the next generation in a way agreed with and satisfying to the wider community. The remarkable comprehensiveness of the reform in Indonesia in regard to its systematic attempt to cover all institutions, mechanisms, strategies, and processes related to teachers from recruitment to retirement is evident in not only the 2005 Teacher Law itself but also in a series of national and ministerial regulations, sometimes as annual updates, which outline, often in considerable detail, the definitions and procedures to be followed in the implementation of the law. These are described in the pages which follow: 50 51 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes 52 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 53 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes 54 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 55 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes Setting Standards A very early essential step in the complex process of teacher reform was the establishment of the National Edu- cation Standards Board in May 2004 to provide a sound basis for the reform process. The Board’s work consists of establishing, monitoring and evaluating standards in eight areas: graduate competencies, subject content, education processes, teaching personnel and training, infrastructure and facilities, management, education funding, and educational assessment. Its standards and indicators for graduate teachers are based on the four core competencies (professional, pedagogical, personal and social) mandated in the Teacher Law. They have been the basis for developing the competencies which now underpin the instruments used in the certification of teachers; the redesigned university training courses; university accreditation requirements; competency tests; statements of duties for supervisors, principals, and teachers; performance appraisal instruments; and other key elements of the reform. The standards, as defined by Regulation 19/2009, create a unifying point for the reforms and ensure that the new training programs designed are able to better meet international best practice. These standards were developed through the collection of data on best national and international practice, the inductive gathering of academic and practitioner opinion, and the testing of draft material in wider public forums to ensure the standards finally adopted were reflective of the highest levels of practice. Once finalized, the developed standards were man- dated in a series of regulations and decrees (such as those listed above) and provide a blueprint for quality. Ref- erence to the incorporation of these standards in various instruments and processes used in the reform attests to the work of this Board and the desire to keep all education activity aligned to the values and standards which represent the essential expectations by the nation of the education sector. However, as described in Chapter 1, while the intention was to ensure consistent and high standards as implied in the law, the use of suitable instru- ments for measuring teacher competencies and therefore ensuring quality met with opposition from teacher associations and therefore was significantly compromised during implementation. Recruitment Indonesia has not yet formally adopted all of the various strategies available to attract more and better candi- dates to the teaching profession including active recruitment campaigns and rigorous selection processes from (say) the top 20% of a graduating secondary school class. But it has adopted or is experimenting with several other strategies: financial incentives such as fee waivers, loans, and scholarships; more flexible approaches to teacher education such as part-time study and distance education; a clearly defined career path; and, with the Teacher Law, the prospect of actually being considered a “professional. As has been seen, the last has been achieved by the doubling of teachers’ income through the provision of a professional allowance equal to a teacher’s base salary for all teachers meeting the four-year degree qualification followed by official certification. This allowance has definitely made teaching an attractive profession in Indonesia. Details of the impact of this allowance on recruitment are presented in Chapter 4. Training Pathways Available to Indonesian Teachers Once the standards are set and new candidates attracted to the profession, Indonesia has a plethora of agencies involved in both pre-service education and in-service teacher education/continuous professional development ranging from both traditional and open teacher education institutions, to a variety of in-service actors, and to 56 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 57 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes what is meant to be ongoing support through district education offices. Before exploring in detail how these agencies have changed as a result of the Teacher Law, an overview of their scope and function is presented in the table below. Table 3.2 Agencies involved in the pre-service education and continuing professional development 58 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 59 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes Box 3.1 These challenges have created an extensive agenda for the reform of pre-service teacher education. In essence, District education authorities university-level pre-service programs now need to prepare teachers for the latest curriculum at the national, provincial, or district levels and see this as part of a lifetime of continuous professional development. Subject and The district office is responsible for the schools and teachers under its management, ranging from 14 pedagogy courses need to be closely linked to the school curriculum competency standards and ensure that primary schools (in Anambas Island) to 1,986 schools in Garut and from 10 junior secondary schools all graduates meet the new performance standards for the teaching profession and are eligible for certification. in Asmat to 809 schools in Malang. Districts have an initiating and coordinating role in the training This agenda for reform includes the following aspects: of teachers. In this regard, for example, they facilitate the establishment of local teacher working groups, identify key teachers from schools to receive training to act as consultants and trainers in the • provision of increased course time for practical classroom teaching with coaching and mentoring by roll-out of national training programs, and conduct their own training programs using these trainers. lecturers and, periodically, by experienced classroom teachers District officers are responsible for the administration and implementation of the certification pro- • more extensive school-based experience, observation, tutoring, small group assistance, school-based gram within the district, and technical teams have been organized at the local level to plan, monitor, action research, and collaboration on an induction year and report the progress of implementation to Ministry agencies. The districts are also involved with socialization of the certification process to principals and teachers. District authorities also liaise with • greater school-university collaboration through greater use of on-campus micro-teaching to exhibit local universities regarding teacher education matters, provide scholarships for teacher upgrading, best practice and identify areas of teacher shortage. The effectiveness of training programs usually depends heav- • closer cooperation between the universities and teacher working groups in order to ensure higher ily on the enthusiasm with which district authorities identify school and teacher needs and support quality experiences for both pre- and in-service teachers and follow-up training activities. The response of districts to training initiatives varies widely. • expert classroom teachers employed to supervise future teachers, assist in or teach courses in the pre- service university programs, and collaborate on action research with university faculty • the requirement for universities to possess appropriate infrastructure in terms of science and lan- guage laboratories, curriculum development centers and libraries, and instructional technology in- cluding internet connection. Pre-service Teacher Education The significant increase in the number and quality of entrants to teacher education institutions as a result of the Significant changes have been required by the universities to meet these new challenges, and grants have been enactment of the Teacher Law has given these institutions both new obligations and new challenges. In other made available to support pre-service teacher education institutions to meet them. The government’s BERMUTU words, new ways to strengthen the efficiency and effectiveness of pre-service teacher education institutions in (Better Education through Reformed Management and Universal Teacher Upgrading) program supported by the context of implementing the Teacher Law have become essential. These include effective delivery of a new the World Bank provided US$25 million for reforming university-based teacher education courses in the light of four-year degree education program for all elementary teachers (replacing the previous two-year diploma), as the requirements of the Teacher Law and for strengthening the national accreditation agency for higher educa- well as the need to revise and upgrade existing primary and secondary training courses to incorporate the newly tion, especially to accredit the newly established four-year pre-service education programs for primary school mandated competencies and the adoption of new teaching methodologies. This has meant that the universities teachers.. By 2011, for example, 56 study programs (26 for the four-year primary teacher degree, and 30 study have had to change many of their practices. New competency-based curricula and methodologies are being programs for junior secondary teachers) had participated in the accreditation incentive grants program to re- introduced to improve the knowledge and skills of new teachers. Changed management structures and new vise their programs and purchase resources to implement these innovations. In addition, the funding provided resources have been identified to cater for the larger numbers of candidates staying longer in training. distance learning grants for a consortium of universities to develop and promote a distance learning initiative In short, a number of new challenges facing pre-service teacher education institutions have arisen: (HYLITE )1; grants to support technological improvements at the Open University to enhance distance learning capacity; and scholarships for lecturers to update their knowledge and skills in delivery of the new courses to • the need for the better selection and retention of high calibre candidates for teacher education upgrade in-service teachers. The government has reinforced this support by widening the number of universi- ties involved to 90 and mandating that courses be competency-based. • more coordinated planning to ensure that the number of teacher education graduates more closely meets the demand from schools and district authorities The national accreditation agency for higher education also received funding to improve its capacity to assess • the need to improve the preparation of candidates to become more effective teachers the quality of the new courses and the ability of the universities to meet the new standards. The new standards, • the need to strengthen pre-service institutions to become “after-sales� service centers to support im- 1 HYLITE (Hybrid Learning for Indonesian Teachers): A distance learning program prepared by a consortium of 13 universities for use by 23 proved classroom effectiveness of recently graduated students. universities to train under-qualified primary school teachers; see below for more detail. 60 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 61 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes procedures, and instruments are contained in a series of eight manuals which relate data collection and analysis the others with little inter-program exchange of either students or activities. Such an arrangement has several to the set of seven national standards set out in the box below. These documents can be found on the website2 inherent difficulties: (i) the level of content is specific to teaching rather than to a corpus of academic knowledge of the accreditation agency. For each of these national standards, there are a number of items in the accredita- so that there is little equivalence between, say, a mathematics course taken by an engineer and one taken by a tion instrument which require the assessors to explore the evidence the university can provide regarding imple- teacher – a later career change for a teacher then becomes difficult, and, on a broader scale, limits the flexibility mentation and outcomes for the program being accredited. of the Indonesian labor force with a consequent cost to the whole economy; and, (ii) while all teachers gain a “major� teaching subject from the study program in which they enroll, it is rare for a teacher to have a “minor� Table 3.3 or second teaching subject because they usually do not have the opportunity to study outside their particular The seven national standards used for Indonesian university program accreditation3 study program. This means that many secondary teachers unable to gain sufficient teaching periods in the “ma- jor� subject they have been certified to teach are officially unable to teach a second “minor� subject to achieve the 24 hours per week teaching load necessary to gain their professional allowance. This also unnecessarily in- creases the number of teachers a secondary school requires – yet another reason for the apparent over-staffing in some secondary schools. Likewise, many small primary schools in Indonesia have a surplus of teachers because they are provided with teaching staff on the basis of the number of classes they have rather than the number of students. Others, however, do not meet this criterion with perhaps only four teachers or less – a situation which will become more common as teacher distribution inequities are reduced. This requires teachers to teach in multi-grade classes, but most primary teachers are not trained in multi-grade teaching. Universities will therefore need to ensure that their graduates have the skills to promote this form of class organisation through their subject and pedagogical instruction. Some teacher education institutions are attempting to resolve these problems of mismatch and provide other flexibilities in teacher education. Because teachers at the secondary level are trained and certified in only one subject, principals sometimes have difficulty obtaining a specialist teacher for some subject areas and must ask Universities are under some pressure to incorporate these new approaches if they wish to gain accreditation capable (but subject-untrained) teachers to teach classes outside their area of expertise. This mismatch means for their re-designed courses. For the new courses to be accredited, for example, universities should be able to students in that class are denied the expertise of a correctly trained teacher. While regulations concerning multi- provide evidence of new student-centred and interactive teaching methodologies, international best practice in grade teaching and multi-subject teaching have not been issued, some universities have found creative ways teacher internship and practicum, actual school teaching experience by their lecturers, their willingness and abil- of solving the problem of teacher over-supply as well as mismatch between the teacher’s subject area and the ity to recognize the prior learning of teachers upgrading their qualifications, and the provision of highly skilled subject they actually teach. The University of Surabaya, for example, trains such teachers at courses conducted lecturing staff to work with teachers, schools, and district staff in the assessment of teachers and the conduct of during school vacations (Box 3.2). training activities within schools. Whether or not the new courses have resulted in improved quality of graduates or have resulted in higher student scores in schools will be a project for the future. Box 3.2 Adopting new training approaches An added complication in the reform of teacher education institutions is that their curriculum structures and content often work against the efficient and effective deployment of school staff. Within teacher education in- The city of Surabaya district government has implemented a pilot (WorldBank, 2009a) to solve the stitutions, courses are organised into study programs for each teaching subject. Each study program consists of subject mismatch problem by enrolling teachers at the University of Surabaya (UNESA) or the Open two main elements: (i) the knowledge content of the particular subject adapted for the needs of teaching; and, University (UT) to improve their competencies in the other subjects for which they have no train- (ii) the pedagogy appropriate to the teaching of that subject (the latter is a relatively small component of only ing but in which they have been asked to teach. The plan is that by 2015 there will be no further two to four months over four years). In this fairly self-contained structure, each study program is separate from mismatch problems. Currently, the university faculty has established a cooperative relationship with the local government and is obtaining the necessary equipment to improve the practical part of the subject instruction. Additional workshops will be held to raise the quality of the instruction provided. 2 Further details can be found on this agency’s website: http://ban-pt.kemdiknas.go/id 3 Accreditation of Degree Study Programs, Book 5, BAN-PT, 2008 62 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 63 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes Some universities offer innovative solutions to meet local needs and offer a wide range of practical experiences provide local government scholarships for selected students. These teachers are then guaranteed a position in to teacher candidates to prepare them for their teaching career. The University of Manado provides a model for that district on graduation. This is most used for secondary subject areas, particularly in short-fall areas such as active involvement in the training of local teachers (see Box 3.3). science and mathematics. These scholarships can reduce the mismatch caused when teachers are employed into a subject vacancy for which they are not qualified. Box 3.3 The University of Manado “in-service, on-service� program model Box 3.4 An example of coordination between districts, universities and schools The University of Manado has been assisting many teachers to upgrade their training. In order to support this government policy, it has developed an “in-service, on-service program� which started Close coordination between district offices, teacher education institutions, and schools has impor- in 2009. This is an integrated program which caters for both pre-service and in-service teachers. The tant benefits. First, district offices need to work more closely with their schools and local universities university uses Monday to Thursday to train pre-service teachers, while Friday and Saturday is used to to identify the teacher profile of the district in order to match the demand for teachers (particu- train in-service teachers. The pre-service teachers (Semester 3 students) will take the school position larly subject specialist teachers) by its schools with the supply available from the universities. Such of those teachers who go to campus on Friday and Saturday. This in turn will create an opportunity a profile, constantly updated, can map teachers according to academic qualifications and schools’ for them to experience real teaching activities. need for teachers at each education level. This is especially true in preparing teachers to teach dual subjects in secondary school in remote areas. As teachers retire or resign, further vacancies arise, Several reasons make this program particularly worthwhile: it gives a chance for in-service teachers transfers occur, and new hiring takes place. One district conducts an annual district workshop to plan to upgrade their knowledge (supporting the certification process); schools welcome the practising teacher appointments for each level of school and each subject area, incorporating known retiring students; many students from remote areas are willing to be assigned to teach in their own areas; stu- teachers as well. This process addresses the problem of overstaffing in some schools and the short- dents are exposed to real situations (from the early period of their study) and know what is needed age of teachers in other schools to ensure more efficient personnel deployment and resource use. by schools; and it encourages action research with students and lecturers together developing the learning model. The university does not provide financial assistance for the practicing students due to financial constraints. However, they let the students pick a school in their hometown area. To support the monitoring of practical training, however, the university as budgeted additional funds for staff lecturers to cover transport costs to supervise these practicum students in more distant The Post-graduate Professional Teacher Training Course locations. This is an imaginative response to the need to find regular and longer-term placements in International experience has shown that a post-graduate focus on pedagogy will enable greater flexibility in schools to implement the policies of the new training program student entry to teaching. By providing a one-year professional teacher education course as an “add-on� diploma to a regular three-year or four-year degree in a teaching subject, universities can increase the options available for candidates who may seek a future career change. This model is often offered as an alternative to a four-year While a renewed emphasis on practical classroom training is necessary to produce good teachers, it has been “integrated� degree. The great benefit of the 3+1 year model is that it enables greater flexibility for students than difficult to identify quality teachers in these schools to work alongside the trainees in improving their practical a straight four-year teacher education degree at an Indonesian university. For example, it enables subject gradu- knowledge and skills for classroom teaching. Furthermore, universities have not budgeted for their lecturers to ates to make a last-minute decision to opt for a teaching career if they are able to apply for and are accepted into spend more time in the schools and classrooms supervising and guiding their trainees and supporting the men- the post-graduate training course. In addition, it may also facilitate the entry of mature-aged graduates making tors. Maintaining productive and on-going relationships with schools is also proving to be difficult to sustain a mid-life career change from another profession into teaching if they already have a relevant subject degree. because of the number of trainees to be placed and the longer time period they are expected to remain in the Provided the enrolment opportunity into the post-graduate course remains open in this manner, a great deal school. more flexibility will exist to enable movement into and out of teaching as a career. This will enrich the experience of the teaching workforce and enhance the exposure of students to a wider range of teacher backgrounds. District scholarships for high achieving graduates are seen to be an essential part of the larger strategy of teacher education reform. Schools in remote and disadvantaged areas are forced to hire temporary, often poorly trained In Indonesia, the Teacher Law requires that a post-graduate course of professional study and classroom practice teachers to fill their vacancies. Some universities recognize that almost all districts face some challenges in terms be undertaken by all teachers seeking certification. This course is of one year’s duration for secondary teachers of appointing the appropriately trained teacher to the appropriate vacancy. One university has reported that it and six months for primary teachers and is in addition to the four-year teacher education degree course taken will focus its post-graduate professional training course on teachers prepared to serve in remote areas. A number by all. The course is designed to focus on interactive, student-centred teaching methodologies with 60% of the of other universities have signed Memoranda of Understanding with their local district offices to ensure they course time being spent in classrooms involved in practical classroom work (watching and analyzing the lessons 64 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 65 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes of master teachers, preparing and conducting lessons prepared by the trainee, and so on). However, in addition teaching, each for a number of weeks, in order to teach a defined topic from the curriculum using a range of to providing effective training, it is also meant to be used as a filter to restrict the number of candidates being methods and to gain experience in the testing of students and the analysis of their scores to judge their progress employed into teaching to ensure that only the most highly skilled teachers enter the profession in the future. and their reaction to different methodologies. Reflection time should be included so that student teachers can By reducing the number of teacher graduates currently entering the profession, it will also be used to ensure consider the responses to their teaching and can also have a debriefing session with their mentors. that the supply of graduates more closely matches the demand for new teachers. Selection for enrolment will involve a more rigorous testing regime. This is clearly a move in the right direction. However, by coming at the The final advantage of the professional post-graduate program has been used to ensure the more equitable end of the four-year teacher education degree, it does not effectively manage the number entering the educa- distribution of teachers. In spite of its surplus of teachers, Indonesia has a continual shortage of teachers in rural tion degree in the first place and thus does little to improve efficiency of resource usage by the teacher educa- and isolated areas. Inadequate teacher provision in remote, border and disadvantaged areas was recognized by tion institutions. the Teacher Law which provided a generous locality allowance (equal to the professional allowance) to attract teachers to these areas. Other incentives such as subsidized housing, payment of travel expenses, and longer Teacher candidates for the new post-graduate professional year must already have completed their four-year vacations have also been tried but without much success. The graph below indicates the number of vacancies degree. In 2012 the quota for this professional training was 3000 degree graduates. Most will be filled by newly in the defined remote and border areas to be addressed in 2011-12. Twelve universities have been approved to graduated teachers. Because of the incentive of the professional allowance, competition for these limited places commence a series of strategies using access to the post-graduate professional training year as an incentive. has been vigorous. The benefit to a teacher of priority entry to the post-graduate course is that it advances them in the queue for employment and the opportunity to gain the professional allowance. Figure 3.1 Teacher shortfall in remote areas 2011 Regulation 8/2009 governs the introduction of this post-graduate professional course. A team from the Director- ate General of Higher Education ensures that the teacher education institutions meet the following conditions prior to receiving approval to give this course: • in curriculum, a course of subject-specific pedagogy and a field experience program for each study program • in human resources, a permanent faculty of two PhD’s and four Masters for each program • in infrastructure, the necessary specialist equipment and materials • an improvement program for all instructional activities • an organised partnership program with schools • a professional post-graduate course for every study program, although an organizing university may arrange shared programs • a regular Directorate of Higher Education evaluation of programs with re-approval necessary after three years. Source: Directorate General of Higher Education Of particular importance in the conduct of the post-graduate professional training program is the need for universities to build closer links with schools; this reinforces the more general mandate to do so for all teacher Priority to undertake the post-graduate professional course has therefore been given to teachers prepared to ac- education institutions. The key feature of this regulation is the requirement that students undertake the largest cept appointment to a school in a remote locality, a border zone or a rural area4 . On their return they are awarded part of their pedagogical training and practice under supervision in the classroom. The program has four core a scholarship to complete post-graduate professional training and can then immediately undertake certification. areas: (i) content in at least two teaching subject areas; (ii) teaching methodologies which are both generalist This not only assists remote schools to fill their vacancies with up-to-date and specially selected graduates, but and subject-oriented; (iii) foundations of education, including child psychology and stages of child growth; and it also ensures teachers have a unique opportunity to practice in a special type of school.. Clearly, the Ministry is (iv) professional practice in the classroom. The regulation emphasises practice teaching or a professional experi- using this kind of teacher placement strategy to address the issue of staff shortages in remote areas (see Box 3.5). ence component which should be carried out in a number of schools with a variety of observations and practice opportunities with an experienced teacher/lecturer mentor. The trainee should also have one or two blocks of 4 3T: Terdepan, Terluar, Tertinggal (frontier, outer islands, disadvantaged areas). 66 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 67 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes Box 3.5 program to deliver such training programs at the local level. Twelve modules were developed for school princi- The SM-3T Program (Frontier, outermost, disadvantaged areas). pals and supervisors to mentor beginning teachers and to assess them at the end of their first year. The material developed emphasizes the adoption of an important new duty for the principal – that of school instructional In January 2012 the Ministry of Education and Culture reported that it had recently dispatched nearly leader which requires all principals with beginning teachers to take an active role in the professional develop- 3,000 fresh graduate teachers on a one-year teaching assignment in frontier, outermost and remote ment of that teacher. Materials provided also include classroom video lessons to be shown and discussed in areas (3T) under the ‘Education Bachelor’s’ program in 3T Areas. This program is in line with the workshops with the principal as well as an instrument for the assessment of beginning teachers at the end of government’s concentrated effort this year to expand education access in 3T locations in East Nusa their probation. Tenggara, Aceh, Papua, Maluku and Kalimantan. Demand for teachers in the 3T areas reaches 6,000 people annually, which the government attempts to meet by redistributing 3,000 in-service teachers This teaching resource is critical for building the capacity of school instructional leaders and underlines part of and supplying 3,000 pre-service teachers through the SM-3T program. The SM-3T is not a teacher re- the professional duty of principals as set out in Regulation 28/2010 on the role of the principal. The knowledge cruitment program, but it offers fresh graduates of teacher education institutions opportunity to gain and skills gained by a principal through the use of this course material with his/her beginning teachers will have first-hand experience in teaching before continuing with their professional post-graduate teacher application right across the school into other classrooms and will assert the right and duty of the principal to education. There was a strong demand for the SM-3T program, with a total of 7,000 graduates apply- enter classrooms and take an active part in the improved performance of all his/her teachers (including those ing for the assignment. who are under-performing). By June 2011, the modules had been prepared and trialed to support the induc- tion procedure and training materials had been developed to socialize the process. Core teams have also been trained at national and district level to support this reform. Training will be largely through the supervisors’ and Induction, Mentoring and Probation principals’ working groups. One of the most important reforms emerging from the Teacher Law is the development of a school-based (or This reform has closed a gap in Indonesian in-service training. Pre-service university teacher education has a local working group-based) induction program for beginning teachers. This policy is meant to link the begin- strong focus on subject matter and education theory with only a small component of face-to-face teaching ning teacher induction program and classroom assessment report by the school with the certification process practice in schools and classrooms. The new requirement that principals and supervisors adopt a more active and completion of the probationary period. Currently, a teacher, like any other member of the civil service, has role in mentoring new teachers in the classroom during the probationary year is an important new reform. By a one-year probationary period (with a possibility of having an extension to two years) after joining a school inducting beginning teachers into their new school role, the principal is providing the first comprehensive train- staff and commencing his/her teaching career. Traditionally, any civil servant, including teachers, must complete ing of the teacher within the intensive, everyday environment of the school and classroom. This is a critical step induction training in civics and administrative routines through the district government. However, it is also im- in the training of teachers as they are, for the first time, under pressure to prepare and present lessons while portant to prove to the authorities that the teacher is of the required standard in his/her chosen profession (both controlling students in the class. It would be unfortunate if the teacher’s probationary year concluded and they in subject knowledge and classroom pedagogy). The Government intends to defer certification until the end of were confirmed as a civil servant before the employer’s representative (the principal) was able to confirm the the probationary year of the teacher when the principal’s report can also be incorporated in the process and be teacher’s efficiency and effectiveness. sent to the university for inclusion as part of the certification and probationary process. This gives a better bal- ance between the university’s view and the employer’s view of the overall ability of the prospective teacher. This Continuing Professional Development also retains some of the links from the previous year between the practice teaching and the university lecturer’s teaching. The Teacher Law had a dramatic impact on the quantity of teachers undertaking in-service training. With 65% of the 2.7 million teachers not meeting the new minimum of a four-year degree academic requirement, the process The teacher induction process became mandated through Regulation 27/2010. This marks an important point of in-service upgrading has been the starting point for reform. In fact, it represents the area with the greatest for the quality of Indonesia’s teaching profession as it acknowledges that a beginning teacher requires closer potential for achieving improvement in the quality of in-service teachers. This is an area where a range of train- supervision, mentoring and guidance in the workplace than other teachers in order to successfully make the ing options and other useful initiatives is now becoming available. These include an expanded role for the Open transition from university training to the school workplace. University whose enrolment of external students doubled almost 300,000 in-service students almost overnight; adoption of distance learning modes by a limited number of education faculties of the teacher education institu- It has been recognized that such an induction/probation program is best delivered by principals able to take a tions; learning modules for use at the local level through the school cluster teacher working groups; recognition true leadership role within the school. After mentoring and monitoring the new teacher during the probation- of prior learning; and university accreditation of local cluster-based training. ary year, the principal can undertake a classroom performance assessment of the beginning teacher before writing a report on the teacher’s work. To complete this task, funding for a professional development program to strengthen the capacity of principals and supervisors was made available by the government’s BERMUTU 68 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 69 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes Improving teacher knowledge through distance education reforms Box 3.6 The Open University is the traditional supplier of distance learning in Indonesia. The ability of the Open Uni- Making Use of the Open University’s Experience with Distance Learning Materials versity to rapidly expand its capacity to supply upgrade training for in-service teachers has made a significant contribution to the certification process. As the graph below indicates, in 2009 over 485,000 in-service teachers Materials developed for distance learning are quite different from those meant for the traditional were enrolled. Enrolment in the four-year degree in primary teaching and the degree in early childhood educa- learning process. Open and distance learning (ODL) materials need to be more engaging and en- tion constituted 86% of the total students of the university. The Open University has provided learning materials courage learners to actually use them. In order to achieve that goal, developers of ODL materials to teachers in printed form throughout Indonesia, and it conducts over 14,000 local workshops for in-service need to have specific knowledge, skills, and experience. In this regard, the Open University’s learning teachers which are coordinated by its 36 Regional Centers. Additional support materials and e-resources have materials for the four-year degree for in-service teachers are well designed along open and distance recently become available through its website, Guru Pintar (Clever Teacher) Online. learning (ODL) instructional design principles. Figure 3.2 Indonesia’s Open University has significantly more experience in developing ODL materials than the Open University Student Enrolments by Faculty June 2009 regular teacher education institutions which have more recently entered the field under the HY- LITE program. From interviews with the Open University’s rector and staff, it is clear that it receives feedback from its users and continues to develop its staff’s capacity in instructional design. This experience could usefully be shared with other universities in supporting the development of ODL materials in Indonesia and making them more instructionally effective. Another ODL approach, the first time distance learning strategies were used in Indonesia outside of the Open University, is the innovative HYLITE training mode; this mode has also been used to increase the capacity of regular universities to provide distance learning. With the increased demand from teachers seeking to upgrade their qualifications, the government established a trial program using regular universities in 2007. A consortium of thirteen universities was commissioned to create a program to support primary teachers seeking to upgrade their qualifications to a four-year degree for certification. Grant funding supplied by the BERMUTU program was used to develop these materials, and twenty three universities agreed to adopt the program. This new four-year degree expanded existing teachers’ access to upgrading opportunities through provision of instructional materi- als and packages for 32 courses. These comprised audio-visual materials, printed booklets, a web-based format, additional test items, sets of assignments and other online initiations, and tutorial plans and materials. This change in government policy created a new mode of study for teachers seeking to upgrade and has estab- Source: Indonesia Open University website: www.ut.ac.id/ lished the principle that distance instruction can be delivered by regular universities. The graph shows that to the end of 2010 over 7,000 incumbent teachers had used this avenue to upgrade. Recognition of Prior Learning (RPL) As part of the reform process, the principle of recognition for prior learning has been introduced for in-service teachers enrolling for upgrading. Many teachers needing academic upgrading to a four-year degree may already be very effective teachers with a depth of workplace experience. It was recognized that, as in other education systems, such knowledge and skills could be assessed to count toward their degree. RPL was therefore included under the banner of in-service teacher upgrading, and universities were given the authority to determine how much advanced standing to give for in-service teachers enrolling for training. Accordingly, a policy and instru- ments for the recognition of prior learning were developed and trialed in 2008. All 81 universities appointed to 70 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 71 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes offer upgrade courses for under-qualified teachers were also approved to offer RPL. In 2009, implementation While there has been a significant increase in the number of teachers awarded RPL, the relatively slow uptake by commenced. The Open University was excluded from this Regulation as the process is not a new one for it. the universities has been a cause for concern. This may partly lie in the fact that there remains reluctance about the idea of gaining the four-year degree through in-service training at regular universities; thus, he overwhelm- ing majority of upgrading in-service teachers is enrolled at the Open University. However, the slow uptake may Box 3.7 also be due to: International experience with Recognition of Prior Learning (RPL) • some District Education Offices refusing to permit their teachers to leave their classes for an extended period The theoretical benefits of RPL make it an attractive policy option in a number of countries. However, practical implementation has often proved difficult, and take-up has frequently been lower than • many of the appointed universities not establishing a partnership with local districts, rendering their anticipated. According to the City and Guilds Centre for Skills Development (Sims, 2010)5 , chal- program inaccessible for many teachers lenges encountered include: a lack of demand from learners who, even when eligible for it, value the • many teachers failing to receive the allocated subsidy from the provincial office, due to the limited learning process and the social interactions that accompany it; lack of awareness of the process; a quota and the provincial policy to prioritize teachers enrolling at the Open University perception that it is an ‘easy option’ not valued by stakeholders; the complexity of the process which requires a fairly sophisticated understanding of subject unit structures may end up being mired in • many districts in general still not allocating subsidies for in-service teachers to upgrade their qualifica- heavy bureaucracy; and, finally, the difficulty many students have in gathering evidence acceptable tion. to the institution . Thus, despite progress in the socialization and implementation of the RPL and its procedures, only about 50,000 teachers have gained access to such recognition through regular universities (Pusbangprodik, Badan PPSDM The core requirement for successful RPL is an established framework of credit, qualifications, and/or PMP, MoEC 2011). occupational standards. The support of stakeholders and efforts to raise awareness among universi- ties and candidates are necessary, as well as a fairly rigorous assessment process to ensure quality. Establishment of a quality assurance system for RPL will increase confidence in this reform. To date, practices Clear, jargon-free information is also essential. There should be minimal difficulty in accessing the used by universities to calculate the levels of RPL to be awarded have varied considerably. The Ministry is aware process and support from the university to help practitioners and candidates through the process. of a growing lack of rigour in the procedures being used in some universities and is taking steps to carefully audit If RPL is seen as a tool for skill identification and capacity building, it is argued that the emphasis how procedures are being applied to ensure standards are maintained. While it is understandable for universities should lie even more on using it as a way to bring individuals into further education and training. This to resist the adoption of practices they consider will lower standards, the justification for offering RPL is quite may, however, require a change in culture and mindset. In a number of RPL initiatives in developing sound and is a common international practice. It saves time and money and also avoids needlessly the repetition countries, outcomes were linked to occupational standards rather than curricular structures, leading of material which late entrants to academic courses often experience. to a lack of connectivity with further education and a mindset that receipt of a certificate of recogni- tion is an end rather than a means to further development. Teacher/principal/supervisor Working Groups Teacher working groups (KKG/MGMP)6 have been recognized as “…the most viable and accessible avenue for teachers to receive continuing professional development� (WorldBank, 2011). They have played an integral role in supporting teachers in training and professional development activities for over 20 years and provide a forum for teachers to discuss teaching problems and work cooperatively to undertake common tasks such as curricu- The Open University has adopted a very straightforward approach to RPL based on a simple formula taking into lum development, the creation of teaching aids, and the design of test items as well as more advanced activities account a teacher’s education level at point of entry, additional in-service training received, and the number of such as lesson study and classroom action research. However, support for these groups has varied over the years years’ experience as a teacher. It is difficult to judge how successful this formula is in determining the quality of and while many are still active and productive, a large number have become inactive or fail to provide effective the candidate on entry. However, up to 28 credit points out of a degree of 145 credit points can be awarded for support for career development. They often wax and wane in importance in the local education community this work. depending upon the support of the district and sub-district education offices or the interest of teachers. 5 Chris Sims, Policy & Strategy Adviser,Recognition of Prior Learning, No 27 in the Briefing Note Series, City and Guilds Centre for Skills 6 KKG (Kelompok Kerja Guru): clusters of primary schools; MGMP (Musyawarah Guru Mata Pelajaran): clusters of subject-based secondary Development (CSD), July 2010 teachers from a group of high schools 72 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 73 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes With the surge of training generated by the Teacher Law reforms, however, the teacher working group has been Figure 3.3 seen as providing a model method of delivering in-service training at the local level. This required attempts to Changing Activities in Local Teacher Working Groups 2007-2010 reactivate and strengthen these groups. While the Ministry began a revitalization process through a block grant program in 2005, funding for this has been supplemented from other sources in selected districts (such as the government’s BERMUTU program, which is supported by the World Bank) with the intention of using the groups to support teachers for upgrading, certification, and professional development activities. In 2005, the status of working groups was also not well understood, and thus a comprehensive study (WorldBank, 2009b) was under- taken by the World Bank. The report in 2007 described their activities, confirmed their potential benefits, and identified the characteristics of a model working group. The study produced a number of important findings regarding the profile of an effective working group. In 2007, for example, the central features of the best working groups were confirmed to be: • a size of approximately 6-10 schools for a KKG, and 10-12 schools for an MGMP • bi-weekly working meetings (approximately 16 meetings per year) Source: 2007 results and “ideal model� (WorldBank, 2009c). The 2010 results are Author’s calculations based on baseline data col- • financial and technical support and frequent visits from the District education staff, supervisors, and lected for Teacher Working Group Impact Evaluation study. principals • focused meetings that lasted approximately four hours; The first column shows the range of teacher professional development activities and their relative importance as identified in the 2007 World Bank study of 45 districts. From this study it was possible to postulate a theoretical, • small group work or “ideal model� of how a teacher working group should operate - in particular, what sort of teacher education • close to full attendance by all teachers in the school cluster working group it should deliver to local teachers. In terms of teacher effectiveness and improvement it was considered that the • office bearers consisting of a minimum of a chairperson, a secretary and a treasurer “training� element was probably the most critical one to examine. The consensus was that the chief function of working groups should be one of training – not just the amount of training but also the quality in terms of • a focus on providing core activities such as the development of syllabi and lesson planning, discus- subject content and methodology. The graph shows a training component in working group activities of 10% in sions of subject matter, the development and practice of active and innovative teaching methods, the 2007 when the preferred level was postulated to be 45% (i.e., a difference of 35% at the cost of “socialisation and design of teaching aids, and testing and student achievement. dissemination� and writing “test items�). In 2010 a second study7 was undertaken by the Ministry of National Education using a sample of 30 of the 75 In the 2010 Ministry study, the actual figure for training had grown from 10% in 2007 to 38% in 2010. In addi- BERMUTU project districts. It was estimated that 267,000 teachers were participating in a total of 6,155 work- tion, the types of training activities were more diverse and classroom-focused. Data collected mentioned “learn- ing groups. On this basis it can be estimated that there are well over 60,000 working groups in Indonesia. This ing models, teaching aids, and classroom action research� – so the quality of what was undertaken during this is a massive structure through which to deliver teacher in-service training and is probably the most significant larger slice of working group time was more classroom and teaching-focused. This additional time came about avenue through which teachers receive their continuing professional development – particularly in rural and through reductions in the proportion of time spent developing “test items� (reduced from 40% to 15%), and in remote areas where teachers’ access to professional training is limited. The following graph looks at the key “socialisation and dissemination� of administrative and routine circulars (reduced from 20% to 3%). activities conducted by working groups in 2007 and again in 2010 with an “ideal model� of an effective working group in the centre as a comparison. Although there was only a small district overlap in these two studies, there appears to be a reorientation of the working group activities. This change is in two directions: (i) a significant growth in the time spent in training ac- tivities and (ii) an improvement in the nature and quality of activities on which that time was spent. This is good news for those involved in educational reform because the local school working groups are a critical strategy for bringing in-service training to the grass roots and into schools where the greatest improvement in teacher quality is desired (see Box 3.8). 7 Report dated July 2011 74 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 75 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes Teacher working groups depend heavily on the availability of resource persons. These are usually provided by universities, provincial institutes for quality assurance, Centres for the Development and Empowerment of Teach- All regular primary working groups in the BERMUTU program received a direct grant through the ers and Education Personnel in subject areas, expert teachers from district schools, and, at times, private consul- provincial quality assurance agency of US$5,200 (for junior secondary, $5,500) over the three years tants. In general, however, the number of such facilitators is small and funding for payment to them is scarce. of the program. This funding was conditional on adhering to the program guidelines which meant expenditures were to be directed to the purchase of learning materials and activities associated with Box 3.8 modules of work provided by the program. These predominantly focused on class action research, Impact of Teacher Working Groups lesson study, active learning, group work, and other effective classroom methodologies. A further requirement was that each working group would meet 16 times each year (fortnightly) to conduct There is some evidence that the teacher working groups are effective in increasing knowledge levels activities – a more intensive pattern than in the past. As the graph shows, while there is some gain of teachers. Teachers in working groups receiving a direct grant under the BERMUTU program show in cognitive (subject) ability, the larger gain is in pedagogical (teaching method) ability. This finding a significant improvement in cognitive and pedagogical ability. A Ministry study (CEA, 2010) of a is in line with the re-orientation of working group activities towards syllabus development, lesson sample of 1,015 teachers drawn from working groups in the 75 BERMUTU districts showed that some study, and training. improvement in teacher’s abilities had occurred. Generally the same teachers were tested twice: at baseline (2010) and at midline (2011) of a three-stage study. The tests used contained linked (anchor) The findings concerning the effectiveness of teacher working groups are significant for policymakers. items which means that a small percentage of questions were the same in both baseline and midline While this structure has been in place for many years as a meeting point for teachers to exchange tests. This can be used to construct test scores that are comparable over time. From the graph below ideas, it is not sufficient to simply leave them on their own without guidance if real teacher improve- it is possible to conclude that the sample teachers are better in 2011 than they were in 2010, in both ment is to take place. They do need some funding on a regular basis, and they do need a structured cognitive and pedagogical ability. program of improvement to implement. This should be clearly focused on subject content framed within a comprehensive program of classroom lesson improvement. Furthermore, through the work- Figure 3.4 ing group the roles of teachers, principals and supervisors also need to be aligned. Regular schedul- Standardised Gains in Teacher Abilities 2010-2011 ing of meetings should be a requirement for funding (perhaps 16 sessions per year), and auditing should be rigorous. However, this audit must be of two kinds; first, it must record details of the teach- ers’ classroom products including lesson implementation and improvement; and second (and only second), it should require financial records and receipts of funds expended. If done in a systematic manner, it can be shown that the training available at the local level can have a significant impact on teacher ability. Teacher Appraisal As part of the teacher reforms, the Ministry has also begun to implement some changes to the teacher account- ability system. The focus is on a revision to the teacher performance appraisal (TPA) scheme and a stronger link- age to the professional development system. The implementation of an annual performance appraisal scheme will ensure that school principals and supervisors take an active part in the work and performance of each teacher. Through an annual review of a teacher’s work in relation to the knowledge and skills he/she is required to demonstrate and the standards mandated by the Teacher Law, a principal can identify the weaknesses of a teacher’s performance and require that the necessary professional development take place. Teacher Appraisal and Career Development With scores from the performance appraisal instrument linked to a teacher’s salary increment and future pro- gression, there will be a strong incentive for teachers to undertake the necessary development course recom- mended for improvement. Furthermore, if this performance is a component of future promotion opportunities, the cycle is complete and an integrated framework is established. Teachers who are identified as underperform- ing will be provided with support but also face sanctions for non-performance. The teacher’s clear link to ac- countability for work productivity is, therefore, established. 76 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 77 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes It is therefore critical to develop an integrated framework to sustain and continually enhance the quality and and criterion-referenced teacher performance appraisal for all education professionals; and (iii) regular, continu- accountability of teachers after they have been certified. This is being achieved by: ing professional development based on identified teacher and school needs. The diagram shows the three basic processes. For example, a teacher failing the competency test must undertake a course of basic training available • reforming existing policies, procedures, and instruments for performance appraisal for progression in the continuous professional development circle before he/she is able to undertake performance appraisal. and promotion Should the appraisal reveal further weaknesses in the teacher’s work, a specific remedial course must be under- taken as part of their continuous professional development. However, a teacher shown to be performing at the • linking incentives created under the Teacher Law to career advancement minimum standard or better will progress to an improved salary and the opportunity for promotion. • clarifying lines of accountability between principals and supervisors and their teachers The management of performance and career progression of all education personnel is therefore now governed In this context, a recent Ministerial memorandum has promoted the principle of integrated training. This involves by structures and procedures based on a comprehensive legislative framework. The reforms have resulted in a providing courses through the cooperation of a number of education and training agencies acting together. In revised operational and functional framework8 supported by legislation specifying the competency require- this case the Ministry has brokered an agreement among universities, provincial Institutes for Educational Qual- ments of teachers and counsellors. This includes specific core competencies required for increased levels of ity Assurance, and subject-focused Centres for the Development and Empowerment of Teachers and Education responsibility, as well as additional competencies related to career stages. Teachers will thus have on-going, Personnel, and a Memorandum of Understanding has been signed and funding provided for the development career-long incentives which provide the motivation for improvement upon which modern education systems of additional accredited teacher education modules to be delivered jointly by these agencies. It has been agreed function. that these will form part of the continuous professional development requirement for all teachers set out in the Teacher Law and will slot into teacher performance appraisal for the calculation of credit points for progression The Ministry is currently preparing an on-line teacher assessment recording system9 to measure the subject con- and salary increments. tent knowledge and classroom performance of teachers. This e-system will record the data from each teacher’s performance appraisal and competency test results into a specially designed computer database. This informa- This integrated framework now links the key elements shown in the figure below: tion will be used to develop individual teacher profiles in the legislated competencies and will enable manage- ment to measure progress towards their achievement. This data will enable the targeted planning of continu- Figure 3.5 ous professional development programs for teachers from individual to the national level of demand. Teachers, An Integrated Framework principals and district authorities will have access to this information. It is intended that this database will be an invaluable tool for teachers in assisting them to make professional decisions about their annual professional development plans. Career Development The ultimate goal of this cycle, of course, is a new career development and salary framework based on the achievement of required competencies and successful continuing professional development. As a result of ne- gotiations between the Ministry of National Education and the Ministry of Administrative Reform, a new career framework was agreed on and formalized in Regulation 16/2009. This Regulation clusters the many salary in- crements defined for the Indonesian civil service into four major career levels (five levels with the inclusion of teacher induction). This is a particularly significant reform as the teacher-specific framework it adopts differs from the overall civil service pay-scale. This new structure is illustrated in the diagram below: This diagram shows the elements which will govern the performance cycle for all teachers. It consists of three basic processes: (i) competency tests completed as part of certification and at other times to determine the competency levels being achieved by teachers and being applied in the classroom; (ii) annual, evidence-based, 8 Ministry of Administrative Reform, PermenMenpan 16/2009, Chapter3 9 See Ministry website: http://ekinerjaguru.org/ 78 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 79 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes Figure 3.6 With appropriate legislation, this process could lead to a full performance-related pay scheme. For example, in Career Development Framework for Teachers10 future reforms teacher certification could be linked to specific professional levels rather than the current practice of one-off certification qualifying a teacher for a lifelong entitlement to a professional allowance. If this route is taken, it would move the whole teacher performance management process closer to the goal of linking incen- tives to career advancement. In implementing this system, particular attention is being given to the capacity building of the personnel need- ed to complete key tasks, including: • management of teacher performance appraisal and continuous professional development by the district education office • management and use of databases by relevant users • training to implement the control and support system including school supervisors, provincial staff, and the outside monitoring agencies to be involved • training of personnel at national Centres for the Development and Empowerment of Teachers and Education Personnel to produce, deliver, and train in the use of distance learning materials to be pro- vided to local teacher working groups and schools • further development of the professional working groups for supervisors, principals, and teachers to deliver the needs-based modular continuous professional development program Policy-makers have agreed that at each annual teacher performance appraisal, a total credit-point score will be calculated for each teacher. The score achieved will vary according to how well a teacher performs on each • inclusion of preparatory training for delivering programs for induction, teacher performance apprais- dimension of the instrument. Every two years a teacher will have these scores matched against the salary scale al, and continuous professional development in the professional development programs of supervi- and a decision made about progression to the next increment. The many steps of the salary scale are shown sors and principals. on the diagram. In the final step of implementation of this project, principals will be able to enter the scores by computer and transfer the data to district level. These are complex and ambitious reforms requiring negotiation with a number of agencies, professional bodies, and teacher associations. Principals and supervisors, for example, have only recently been involved in making The performance appraisal instrument will make reference to the professional development activities under- professional judgments and preparing reports on the competency of their teachers. The performance appraisal taken by the teacher. Many professional development modules have already been developed. Others will be process will require them to regularly enter this sensitive field, which some consider to be “culturally inappropri- prepared. A framework is being developed incorporating all these modules and to ensure they are graded ac- ate�. Although some training has been given, there is need for on-going work in this area to build confidence cording to the types of professional development required at different levels of a teacher’s career. On the dia- and enhance their role as instructional leaders in schools. The associations will also need assurance that princi- gram above the various themes for training are shown as follows: (i) Induction: modules already developed to pals and supervisors are acting in a supportive and developmental tasks to improve the quality of teaching. The support beginning teachers; (ii) Novice Teacher (Guru Pertama): Teachers just starting out who need material methods of dealing with underperforming teachers will be particularly important. to focus on competency development; (iii) Junior Teacher (Guru Muda): More experienced teachers seeking material to focus on improvements in student performance and school management; (iv) Senior Teacher (Guru This point is very important: when certification of teachers is complete, the continued motivation of teach- Madya): Associate teachers needing material to focus on the development of the school; and (v) Master Teacher ers towards quality improvement will depend heavily on the teacher management structures in place and the (Guru Utama): Senior teachers needing material on school leadership and teacher development. quality of leadership at the local level – of the district education office, of principals, and of supervisors. In the past, particularly since decentralization, the quality of leadership at this level has been poor and often tainted by patronage or reflective more of administrative function than genuine educational leadership. It has been rec- ognized that this state of affairs must change if teacher quality is to improve. Two recent Regulations define the future competencies demanded by these positions and establish a list of requirements for them, including civil Board of Education Human Resources Development, Education and Quality Assurance (BPSDMP-PMP), 10 Ministry of Education and Culture service level, maximum age limit, a competency test based on the standards of specialized training, and passing 80 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 81 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes a selection test. However, there is no mention of selection on merit. Since the promulgation of these decrees, a School supervisors major training course for principals has been developed and a specialist unit established to visit districts to train The school supervisor (pengawas) employed by the district office to visit schools provides an accountability principals and supervisors who, if successful, will be “licensed� to practice. This will create a pool of eligible candi- link between the school principal and the district officers. When visiting schools supervisors may have a range dates from which district education authorities can draw when they wish to fill a vacancy. of tasks such as collecting and analyzing reports and providing information about curriculum implementation and school effectiveness to the district office. Unfortunately, following the decentralisation of the administra- Selection for these key positions should be based on ability to undertake educational leadership at the local lev- tion of education, the nature of the role now varies widely from district to district and usually focuses more on el. The need to improve teacher quality means that principals and supervisors must be skilled in direct classroom administrative issues than on the improvement of the classroom performance of teachers. A recent review of the assessment of teachers and the identification and support of poorly performing teachers. They must undertake capacity of the school supervisor concluded: an instructional leadership role in teaching methodologies and pedagogy, including student-centred teaching, classroom management, and student achievement measurement. Although both these positions will require “School principals, teachers and school committee members regard the position of school supervisor as a low some administrative responsibility, great time must be devoted towards their leadership role in curriculum de- status position rather than an attractive career pathway. School supervisors reported that they have limited ac- velopment and management. School supervisors, in particular, should take a significant role in the training of cess to training and development opportunities.�11 principals in educational management, including mentoring and coaching their decision-making and support- ing their school leadership on a day-to-day basis. Part of their commitment must be to facilitate the work of However, there is considerable potential in this position; a well-trained school supervisor can be a significant teacher working group management committees in providing continuous professional development programs change agent operating across a cluster of, say, 10 to 15 schools. Freed of many administrative tasks and equipped for schools. Only the direct involvement of principals and supervisors in the observation and improvement of with the knowledge and skills of a modern instructional leader, a school supervisor can effectively mentor and teaching in the classroom will sustain continued development of teacher competency. coach principals and arrange workshops and seminars for teachers in the new methodologies during visits to each school. This role is a significant one and needs continual strengthening through training and the selection Principals of capable officers with good qualifications and extensive experience. While many principals in Indonesia are well educated and capable, their training and knowledge of school man- agement is often inadequate for modern requirements. Most principals simply implement educational policy Ministerial Decree 12 of 28 March 2007 recognizes the potential in this position for re-orienting the face of Indo- and administrative requirements as a matter of routine without the knowledge and skills of an instructional nesian education. It defines the competencies required of school supervisors in six dimensions: personal com- leader. Often their professional development as school leaders consists of little more than a briefing on policy petence, managerial supervision competence, academic supervision competence, education evaluation com- documents issued by the district office. They are poorly paid and have little authority over the teachers they su- petence, research and development competence, and social competence. But the review mentioned above pervise. Consequently, few adopt a pro-active supervisory and developmental role towards their teaching staff. identified a large number of deficiencies in the knowledge and skill of school supervisors to undertake the newly They are often selected following an examination or are simply the nomination of a district education officer. defined tasks. This is shown in the table below: They are rarely selected by a formal merit process and receive little training for the task. Ministerial Regulation 44/2002 mandated school-based management in Indonesia which placed educational management firmly in the school with the principal as the key decision-maker. The commencement of the BOS (School Operational Assistance) funding program in 2005 placed resources at the school-level to facilitate this decision-making. Principals now have an effective role in a range of areas including school planning, curriculum development, school finance and budgeting, staff management, and community involvement. The principal thus has a key responsibility at the centre of a devolved system where school-based management is the expec- tation. Principals in Indonesia now need greater skill in more effectively managing these processes. In time it is anticipated that school principals will take a more active role in the management of their schools in terms of the effectiveness of their personnel, efficient use of financial resources, and their accountability for student results and achievements to parents and the wider community. Principals will also become instructional leaders taking a positive role in the improvement of the quality of instruction at their school and this will be reflected in improved student scores. 11 Australia-Indonesia Basic Education Project: Review of the Capacity of School Supervisors. September 2007 82 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 83 The Comprehensive Reform of Institutions, Mechanisms, Strategies, and Processes Figure 3.7 Box 3.9 Perception of the Competencies of Supervisors Selecting supervisors in Karawang District The new district head of education at Karawang intends to improve the quality of his school supervi- sors (who each manage 10 schools) in order to establish them as “quality advisers� to lead the dis- trict’s teacher quality improvement program. School supervisors are to form a cadre of experienced educational leaders to assist teachers and principals to improve the standard of teaching in schools and hence lift student achievement scores. His plan is to select from a pool of school principals who have had eight years (two four-year terms) of successful experience in managing a school and have returned to the classroom for two years. This selection strategy is based on the need to have school leadership experience as well as a classroom teaching “refresher experience�. The district head’s intent is clear – he recognizes the need to focus closely on improvement in classroom teaching as the es- sential core of teacher quality and improvement. However, in discussion he spoke of his uncertainty about how to select the type of school supervisor who could successfully undertake such a task. While these personnel can face special training and competency tests, at the final point of selection they rarely face an interview or go through a serious merit process in which a panel deliberates over matching the best person from a number of applicants for the position. Source: Australia Indonesia Basic Education Program (2007) 3.2 Conclusions This summary of qualitative data shows the extent to which principals and teachers agreed or disagreed with the In the long-run, the reforms being promoted in the teacher career cycle, from attracting better recruits, to en- proposition that school supervisors possess competency in each of the six dimensions. The small percentage of suring that they know their subject(s) well and can teach them effectively through ever better and ever more those in agreement indicates the generally low perception of school supervisor competencies reported in inter- school-based training, are most important in developing a cadre of teachers who deserve both professional cer- views and focus group discussion. Clearly, this creates a considerable agenda for the professional development tification and the rewards that come with it. To the extent these reforms are implemented successfully, of course, of school supervisors. Data from the Directorate of Basic Education Educational Personnel Development indicate less time and fewer resources will need to be devoted to “catch-up� in-service training and more time and more an increasingly aging school supervisor workforce with 35% of the 21,627 school supervisors in the government resources can be used for more systematic, career-long continuing professional development. system reaching retirement age within the next five years. Within the Ministry of Religious Affairs 67% of the 7,060 school supervisors will retire in the next five years. This presents an important opportunity to replace over While many ministerial reforms have been introduced to improve the system of teacher management, a major 40% of all school supervisors over the next five years and create a new elite workforce of these key personnel to factor in its implementation and final success is the proper recruitment and selection process into the posts drive educational improvement in schools and districts. which can help ensure adequate attention to quality; namely, principals and supervisors. Mechanisms are now being piloted to guarantee that this process is based on merit and competence instead of political and/or per- sonal favoritism. The pre-service education and continuing professional development needed to make these reforms succeed have also involved significant policy changes for the institutions providing this training -- in particular, the closer linking of teacher education institutions to schools and district offices, the introduction of limited distance mode training by regular universities, and the authority for them to facilitate this through new rules for recognition of prior learning. These policy changes are essential for the on-going professional development of the new genera- tion of teachers and will also have a wider impact on university operations of the future. 84 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 85 But there are two critical caveats. First, this comprehensive and systematic teacher management and develop- ment process is based on the assumption that teachers begin with some minimum level of competence and Chapter 4 a certain degree of motivation – to teach and to help their students learn. Earlier chapters have described the sometimes indifferent attitude of teachers – many of whom, given their seniority, are now certified -- whose pri- The Impact of the Reform on orities, according to the exigencies of the time, were obedience and loyalty up the system rather than proactive service to their students and out to the larger community. Ensuring that the post-certification quality assurance Teacher Quality and Student Outcomes process works for them as well as for the new generation of teachers mentioned above is a major challenge. Over the last decade, many developing countries have embarked on large educational reforms aimed at rapidly expanding the supply of education, achieving equity in the provision of education, and signifi- Equally challenging is the need, as Fullan maintains, to focus not only on individual capacity building as the cantly improving the quality of education. Some of these reforms have been far-reaching, transforming current pre-service-induction-probation-certification-professional development-teacher appraisal process does the budget priorities of many countries ………A number of developments have served as catalysts for but also on whole-school, collective capacity building. This is where the new roles for the principal – supported reform (Tiongson, Economist) by the supervisor – become so essential in the process of reprofessionalizing teaching. 4.1 The Certification Tool A Quality Assurance Mechanism and a Potential Way to Improve Learning A major proportion of the Indonesian teacher reforms of the last decade was shaped by the 2005 Teacher Law. The law aimed to address a wide range of teacher quality issues simultaneously. Most of the evidence provided in this chapter is used to discuss the impact of a key component of the law, the teacher certification program. The professional label gained by certification and the associated allowance were meant, in part, to improve teacher welfare and increase their status and recognition. Teachers with a four-year university degree or with a high rank in the civil service (i.e., rank IV) or very senior teachers qualify for certification. Since the start of the program, the government has admitted 200,000 to 300,000 (qualified) teachers into the certification process each year. The eligibility conditions for certification were meant eventually to ensure a minimum level of competencies of all teachers in the system. Since the program started, teachers have passed through the certification process either through an assessment of a portfolio of past expe- riences and training or through 90 hours of additional training. Overall passing rates of this process have been high at around 95%. The financial implications of the program are, of course, enormous. The teacher wage bill, already the largest expense of the Ministry of Education and Culture, will approximately double over the years to come [“Spend- ing more or spending better: improving education financing in Indonesia�, World Bank 2012]. The question is whether this is money well-spent. This section, therefore, discusses some of the impacts of certification on the quality of learning in Indonesia. The analysis can provide important information to policymakers in countries with conditions similar to those in Indonesia. A number of countries, especially in Southeast Asia, combine high economic growth rates with relatively poor performance of the education system as a whole. Such conditions mean that in the years ahead, increasing amounts of government budgets will become available for quality improvements to the education system. 86 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 87 The Impact of the Reform on Teacher Quality and Student Outcomes There are three different channels through which the current teacher certification process in Indonesia can im- 4.2 Certification, recruitment, and the attractiveness prove the quality of teaching in the country: of the teaching profession The attraction channel: The professional allowance makes the teaching profession considerably more at- The attraction channel tractive (and competitive). This results in better qualified high school graduates entering into teacher edu- cation institutions across the country. This section discusses the effects of certification on prospective teachers; i.e., on high school graduates who might or might not choose a career in teaching. Depending on the nature and rigor of the selection mechanisms The attraction channel applies to high school graduates who are confronted with the choice to become a teach- used in accepting these graduates, higher demand could translate into better quality if higher ability graduates er or to choose another career. The higher salaries and status now given to teachers should increase the relative are selected over those with lower ability. attractiveness of the teaching profession. High school graduates who might have opted for a career in engineer- ing or in business in the absence of certification might now be persuaded to choose a career in teaching. Figure 4.1 shows that the number of students enrolled in education programs in universities in the country increased several fold in the years following the Teacher Law. Between 2005 and 2010 this number increased The upgrading channel: Teachers who do not qualify for certification normally need to acquire a four-year from 200,000 to over one million – a growth of five times. The regained attractiveness of the profession is more degree. In this process of upgrading, teachers acquire skills that improve their capacities as a teacher. clearly visualized by the increase in the percentage of students enrolled in education programs. The percentage increased from 15% before the law to almost 30%in 2008. The one million enrolled in education programs in The upgrading channel applies to in-service teachers who do not yet qualify for certification. Such teachers must 2010 are recent high school graduates and exclude the approximately 500,000 in-service teachers enrolled in the normally enrol in courses to upgrade their academic qualifications to the four-year post-secondary degree level. Open University. Certification seems to have significantly increased the attractiveness of the profession. Certification and the professional allowance provide a strong financial incentive to upgrade these qualifications. At the start of the certification program, 84% of the primary school teachers and 40% of the junior secondary One of the intended consequences of the certification program was that a more attractive teaching profession school teachers did not qualify for certification (Ragatz, 2010). This large group of teachers is expected to up- would increase the quality of teacher intake as higher calibre high-school graduates would want to become grade to the four-year degree level. Because this mechanism applies to the majority of in-service teachers, the teachers. There are indications that at least for some specific teacher education institutions, the demand for va- aggregate effect of the certification program, channelled through academic upgrading, is potentially large. cancies has outpaced the supply and that in some cases the quality of the intake has gone up over time. The behavioral channel: Certification implies increased recognition and a doubling of income. This moti- Figure 4.1 vates teachers to become more productive in their profession. Total Number of Higher Education Students Enrolled 2005-2010 The behavioral channel applies to all teachers who become professionally certified and receive the professional allowance. The allowance is permanent and not conditional on subsequent performance in the classroom with the exception of the requirement to teach 24 period-hours per week. Teachers who are certified, therefore, have few explicit financial incentives to change their teaching practices. But teachers might feel a moral obligation to invest more effort in their work and be absent less often. At the same time their need to take up second jobs decreases which means that teachers have more time in a day for professional work such as classroom prepara- tion and participation in teacher working groups. Whether certification in its current form has positive effects on teacher quality and student learning outcomes depends on the potency of these three channels. Separating these three different channels for analysis will aid in the discussion of the effects of certification. 88 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 89 The Impact of the Reform on Teacher Quality and Student Outcomes Figure 4.2 Applicants to Makassar State University 2004-2005 to 2010-2011 Source: Indonesia Ministry of Education and Culture, Directorate General of Higher Education “dashboard� (www.PDPT.dikti.go.id/ dashboard/v002)] Source: Directorate General of Higher Education, Jakarta 2012 Figure 4.1 for example, shows a massive increase in the number of applicants for the teacher education institu- A similar message is conveyed in Figure 4.3. It compares the attractiveness of education study programs with tion of one of the larger universities in the country, the State University of Makassar (UNM). The number of actual programs that are similar, but not for training to become a teacher. English language education, for example, enrolees increased at a slower rate, from about 1,000 in 2004/2005 to about 2,000 in 2010/2011. The figure indi- received many more applicants than just English language and literature, and it has been increasing at a faster cates that this university could have been more selective in enrolling the best candidates out of the increased rate. The same is true for mathematics and mathematics education. From 2005 to 2009 the number of applicants pool of applications. Whether this has happened and whether it has led to an increase in the average quality of for the mathematics education program increased by 100%. the accepted applicants, however, depends in large part on whether the group of graduates applying for the college consists of a sufficiently large number of high calibre candidates. In the case of Makassar, the process of Figure 4.3 obtaining a position in one of the education programs has become more competitive as the demand for vacan- Applicants to different study programs at 15 different institutions cies increased at a much higher pace than the increase in supply. In all likelihood this would have also led to an increase in the quality of enrollment at that college. Source: Research and Development Board, Indonesia Ministry of National Education (2009). Blue bars represent the number of ap- plicants in 2005, and red bars represent the number of applicants in 2009. 90 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 91 The Impact of the Reform on Teacher Quality and Student Outcomes More competition for places is expected to have led to higher quality of those accepted. The graph below traces new problem. Even if the quality of new intake is higher on average, it does not necessarily mean that the best the average senior high school national exit examination scores for three different graduation cohorts (2006, ones eventually get the jobs. Indeed, finding jobs as (certified) teachers might be difficult in a situation where 2008 and 2009). It compares the average scores of a sample of primary teacher candidates from 15 universities the number of new teachers entering the market greatly exceeds the demand for teachers from schools. With (the same 15 as used for the construction of Figure 4.3) to the average scores of the total exiting population of around three million teachers currently active in the system, roughly 100,000 will retire each year. 1 With around senior high school students in the country. The first observation is that the overall score level of primary school one million students enrolled in pre-service education programs today, it is expected that, for the years to come, teacher candidates is higher than the national average. The second observation is that the scores of the new about 250,000 new teachers each year will enter the labor market. Not all of these will be able to find jobs as cohorts of teacher candidates tend to increase at a faster rate than the national average. If this trend continues, teachers. The disconnect between demand and supply of the labor market for teachers creates another concern it could eventually lead to changes in the quality of the future teaching service. about the quality of the teachers who finally end up being hired. Hiring procedures in Indonesia are not always efficient or based on merit, and it is not obvious that systems are in place that guarantee that the best candidate Figure 4.4 will get the job. A second order effect of the impending oversupply may be that current high calibre candidates Rising entry scores of new teacher candidates, junior secondary graduation cohort 2006-2009 internalize this in their decision-making and opt out of a career in teaching -- not because they do not want to become teachers but because they are uncertain about whether they will succeed in finding a position. The system needs amendments to curb these (unintended) consequences of the certification program. Compe- tition can be increased by requiring universities to produce the right number of graduates to meet labor market demands and by calling a halt to the proliferation of private universities of dubious quality. Policymakers are aware of this changing scenario, and commencing in 2013 the government has set an annual quota of 40,000 teacher candidates to enrol at private and state universities. This decision is intended to ensure that the number of student teachers admitted each year will match the number of teachers expected to retire four years later (when the cohort is graduating). In the past and in the near future, however, the inflow of new teachers to the system has exceeded and will exceed the outflow due to retirement. Individual teachers deal with this situation by often approaching schools directly and applying informally with their curricula vitae. The school then employs these extra teachers with school funding (salaries paid for such teachers are often quite low) after which they often attempt to gain greater permanency (e.g., through seeking civil service status). This loose management of extra teachers by schools and district authorities is a major reason for the constant “over-supply� of teachers in the Indonesian school system. Source: The national exam scores of students studying to become primary school teachers were obtained from the Research and The net results of these inefficiencies are clearly visible in the following table. The number of primary school Development Board, Indonesia Ministry of National Education (2009), “Dampak Peningkatan Kesejahteraan Guru terhadap Mutu teachers has increased by over 30% in five years. The increase in the number of teachers has outpaced the in- Input (Quality Enrollment) dan Pemberian Bantuan Dana Kompetitif terhadap Kemampuan Lulusan LPTK�, Jakarta, Indonesia. crease in the number of students over that same time period (Cerdan-Infantes & Makarova, 2013). Only much Note: The national exam scores of the total population of senior secondary graduates were compiled based on population- stricter regulation of teacher graduates and teaching hiring will help balance the over-supply of teachers found level data (school-level) published yearly by the Center for Educational Assessment, Research and Development Board, in Indonesia. This will be examined further in Chapter 6. Indonesian Ministry of Education and Culture. Teacher education institutions have become more attractive in the five-year period leading up to 2010-11. The supply, however, has kept pace with the increase in demand, which has limited the beneficial effects of com- petition. Figure 4.2 indicates that the number of applicants who succeeded in gaining a position in a teacher education program has increased manifold. The demand and the supply for vacancies in education study programs have increased to the point that an 1 The 100,000 is a rough estimate and it may differ from year to year. With 3 million teachers in the system, and with an average length oversupply of newly graduated, highly motivated, and aspiring teachers is a relevant concern. This presents a of service of 30 years, the number of retirees is estimated at 100,000 per year. Due to the skewed distribution of age in the population of teachers, however, retirement figures over the next 10 years are likely to be higher than 100,000 per year. 92 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 93 The Impact of the Reform on Teacher Quality and Student Outcomes Table 4.1 Figure 4.5 Changes in the number of Elementary School Teachers 2006-2011 Growth in Number of Teachers with a Four-Year Degree Source: Author’s calculations based on 2006 SIMPTK/NUPTK and 2011 NUPTK teacher census. Teachers of Islamic schools are not considered for this table. 4.3 Certification as a financial incentive for academic upgrading The upgrading channel Teachers with a university four-year degree and with high rank in the civil service and very senior teachers qualify Source: Calculations based on NUPTK/SIMPTK teacher census 2006, 2008, 2010 and 2011. (Islamic school teachers are not consid- ered for this figure.) for certification. Because rank and seniority are not easily manipulated by individual teachers, those without these qualifications should normally obtain their four-year degrees. The prospect of receiving the professional allowance is a strong financial incentive to acquire this degree. The Open University, the traditional supplier of This wave of academic upgrading has only recently started, and many teachers are, in one form or another, still distance learning courses for upgrading teachers’ knowledge and skills, reports on their website to have close to in the middle of the process. Thus, the full scale of the effects of this academic upgrading should only appear 500,000 teachers actively enrolled to upgrade their academic qualifications to the required level. In the process over the years to come. The ultimate test, perhaps, will be to continuously monitor the changes in PISA and of upgrading to the four-year degree level, teacher’s knowledge levels and pedagogical skills should increase. TIMSS scores – does a massive increase in the number of teachers with an academic diploma lead to simultane- The extent to which this happens is ultimately an empirical question. ous increases in the scores on PISA and TIMSS? To date, there do not appear to be any improvements that are systematic across all subjects, at least not in Indonesia’s PISA scores (see Figure 4.6). Given uncertainty whether Figure 4.5 reports increases in the percentage of teachers with a four-year degree based on the NUPTK teacher Indonesia will continue to participate in cross-country comparison studies such as PISA and TIMSS, it would be census. The series indicates that the professional allowance had important effects on encouraging unqualified useful for Indonesia to set up its own system for monitoring student achievement gains over time and across teachers to upgrade academic qualifications. From other data sources, such as the recent 2011 PODES school geographical areas. The current national examinations given at the end of grades six, nine, and 12 are inadequate facility census, even higher percentages emerge. Based on calculations from PODES, close to 44% of primary for this purpose. school teachers currently have a four-year degree.2 These are important changes when compared to before the law and are quite likely directly attributable to the financial incentives internal to the certification program. In some cases the upgrading was made possible through central, provincial, and district government scholarships. 2 The difference between the NUPTK and the PODES school census is perhaps due to imperfect updating of the NUPTK census, which was established in 2006 as SIMPTK. The figures of 2006 are therefore perhaps more likely to be accurate than the later ones. The increase from 2010 to 2011 may also be partly explained by updating the administrative data. 94 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 95 The Impact of the Reform on Teacher Quality and Student Outcomes Figure 4.6 Further evidence on this issue can be provided through a database collected by the government in partnership Indonesian PISA scores 2000-2009 with the World Bank. 240 public primary schools and 120 public junior secondary schools in Indonesia were sampled for this study. The sample is representative of approximately 40% of the public primary and junior secondary schools in Indonesia. All core subject3 teachers and all students in these schools were administered a multiple-choice subject matter test. Furthermore, all core subject teachers were interviewed. The data collec- tion was repeated three times; a baseline was held in November 2009, a midline in April 2011, and an endline in April 2012 (not yet available for analysis). The study has an experimental component which is used to evalu- ate the certification process and the effects of unconditional teacher salary increases on teacher performance. These results are presented in the next section. [See the Introduction and (De Ree et al., 2012) for a more detailed description of this study.] The survey data confirms that academic upgrading is continuing on a massive scale. Only a minority of teachers with a four-year degree report to be further upgrading their academic qualifications [Figure 4.8]. Around 30% of the few teachers who qualify for certification based on the civil service rank or seniority still try to upgrade academic qualifications although they do not strictly need to in order for them to be qualified for certification. Source: OECD (2010). The vast majority of the unqualified teachers (70%), however, is actively engaged in the upgrading process. This Associations between academic qualifications and student learning outcomes: Evidence from linked survey and shows clearly that teachers take the incentives provided by the certification program very seriously. Financial testing data incentives for academic upgrading seem to work. The upgrading mechanism is likely to have the largest impact in primary schools because at the time of the Figure 4.8 Teacher Law in 2005, only about 40% of primary school teachers qualified for certification (mostly because of How many teachers are upgrading? rank and/or age). 70% of the junior secondary school teachers qualified in 2005/2006, mainly because a four-year degree was already required before the introduction of the law. Figure 4.7 shows the percentage of teachers who qualified for certification at the start of the program and the criteria on which this qualification was based. Figure 4.7 Percentage of teachers who qualified for certification at the start of the certification program Source: Calculations based on survey information from the teacher certification impact assessment study: 1746 primary school teachers of a sample of 240 public primary schools in Indonesia. Source: Calculations based on NUPTK/SIMPTK teacher census 2006 3 Core subject teachers are class teachers in primary schools and Indonesian language, English language, Mathematics, and Science (Biol- ogy and Physics) teachers in junior secondary schools. 96 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 97 The Impact of the Reform on Teacher Quality and Student Outcomes The potential for quality improvements through academic upgrading are enormous, but they are not automatic. Box 4.1 Most teachers who upgrade to the four-year degree level already have a two-year post-secondary diploma. Teacher Education and Competency by Grade These teachers therefore really “upgrade� rather than start a full-fledged four year academic program. Upgrading typically happens remotely through the Open University but also, more and more, through other higher educa- An interesting aside from the data on teacher background (with a four-year degree or not and sub- tion institutions accredited to offer the four-year degree program in education. ject matter competency) relates to how these differ according to grade in which the teacher is teach- ing. One could argue that given the importance of ensuring a strong foundation for learning in the The quality of the Indonesian universities is highly variable. Figure 4.9 shows that primary school teachers both early grades of primary school, especially for children who have not had a pre-school experience, it with and without four-year degrees do rather poorly on the subject matter test which was part of the data col- would be essential for principals to assign highly qualified teachers to those grades. The data from lection for the impact assessment study discussed briefly above. The tests were designed by the government’s the impact assessment study show the following: Centre of Educational Assessment and were explicitly designed to measure competencies deemed necessary for effective teaching. Teachers with degrees perform somewhat better than teachers without degrees.4 These differences are smaller than expected and suggest that teachers, on average, do not gain enough extra knowl- edge from obtaining a degree. A minimum amount of subject matter knowledge is a prerequisite for being an effective teacher. This may, therefore, appear to present a challenge for the future. Figure 4.9 Teacher subject-matter knowledge test scores, breakdown by academic degree The percentage of teachers in Grades 1-3 holding a four-year degree (in blue) is considerably lower than that of the teachers in Grades 4-6. More importantly, the standardized scores for the subject matter test (in green) show dramatic differences – much lower for the teachers of the early grades than for those of the upper grades. In a system where a relatively small percentage of Grade 1 en- trants has had pre-school experience and where later student achievement (e.g., in the PISA and TIMSS studies) is of great concern, the fact that the teachers with least subject matter mastery are assigned to the youngest pupils should encourage both the Ministry (in terms of national policy) and individual principals (in terms of teacher assignments) to reconsider how they can guarantee a high quality of teachers in the grades which need them most. Source: Calculations based on subject matter test information from the teacher certification impact assessment study: 1714 primary school teachers of a sample of 240 public primary schools in Indonesia. One issue in this regard is whether teachers who received their four-year degree in a more full-time, pre-service, perhaps residential setting (say, before the Teacher Law was passed) do better than teachers who have received it over a longer period of time, at a distance, and/or more recently (e.g., through the greater number of institu- tions now accredited to provide the degree). On the one hand, perhaps the online/distance methods preva- lent today, the considerable amount of the required curriculum gaining recognition as prior learning, and the 4 Note, however, that the difference in test scores is statistically significant at the 1% level, and, even though the 4 percentage point differ- mushrooming of new, smaller, and private (even if accredited) institutions offering the four-year degree add up ence seems small, it still amounts to about 0.3 standard deviations in the population. 98 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 99 The Impact of the Reform on Teacher Quality and Student Outcomes to a less rigorous approach to obtaining the four-year degree and therefore to less impact on teacher content ing a teacher with a four-year degree. It attempts to answer the question: do students of teachers with four-year knowledge, pedagogical skills, and student outcomes. On the other hand, it could be argued that teachers with degrees progress faster? The answer is affirmative. more recent, presumably up-to-date content and more explicitly child-centered methods would perform better than those trained a decade or more ago in a more traditional style. The survey information is not sufficiently Figure 4.10 informative to support either one of these theories. Value added by Primary Teachers with a Four-year Degree We did, however, investigate whether teachers who actively participated in the upgrading process between baseline and midline data collections gained more than those who did not. The group of teachers who acquired a four-year degree between baseline and midline and those who report to be actively in the process of upgrad- ing are compared to the rest. At baseline in November 2009, the upgraders scored lower than the others. After a period in which they actively engaged in the upgrading process, however, they scored higher than the oth- ers. The relative increase, however, is relatively small and not statistically significant which confirms the pattern observed in Figure 4.9. On the whole, therefore, having a four-year degree is a very imperfect marker for subject matter knowledge of teachers. There are many teachers without a four-year degree who do very well on these subject matter tests. At the same time, there are a fair number of teachers with a four-year degree doing extremely poorly. This fact can be used as an argument against using objective indicators such as formal degrees as the primary basis for ad- mission to the certification process. Whether academic degrees are useful indicators of trainable competencies such as subject matter knowledge depends in part on the quality of the universities. Singling out high quality Source: Analysis based on data from the teacher certification impact assessment study. teachers from low quality teachers on all levels of competency is even more challenging; the huge variability in quality among teachers is typically not easily explained by observable indicators such as academic qualifications Learning gains here are an estimated 0.15 standard deviation higher for students with a teacher with a four-year or experience (Rivkin, Hanushek, & Kain, 2005). degree. This “four-year degree� effect can be broken down into a subject matter component (0.05 standard de- viations) and an additional effect (0.10).5 The analysis suggests that teachers with academic degrees are better Primary school teachers with a four-year degree have more subject knowledge than those who do not, and teachers, not only because they score (slightly) higher on subject matter tests but also because they have ad- some of that seems to be due to their education. Differences, however, are not very large, perhaps suggesting ditional skills, such as pedagogic skills. that the process of academic upgrading is not leading to the large increases in teacher quality that Indonesia needs in order to catch up with economically more developed nations. It should be realized that the evidence presented in Figure 4.10 are correlations which are not necessarily causal. There is a variety of reasons why teachers with a four year academic degree have students that do better, and The evidence provided in Figure 4.9 is only part of the story, however. As the literature suggests, there is much only one of them is that these teachers are truly better teachers. A similar correlation can be found if students variation in teacher quality related to student learning outcomes that is not easily explained. Figure 4.9 only fo- from better socio-economic backgrounds are sent to schools with a higher proportion of teachers with four year cuses on the subject matter knowledge of teachers. Teachers, however, might acquire a variety of pedagogical degrees. Also, higher ability and more motivated teachers are more likely to obtain a four-year degree. As a con- skills when undertaking the upgrading process. sequence, teachers with a degree perhaps are not better because they have a degree, but rather because they are more motivated and capable to begin with. More in-depth research is needed to make any final claims about It is not straightforward to evaluate whether or not academic upgrading leads to improvements in student learn- whether academic upgrading works and, consequently, how well it works. We cannot be certain, therefore, ing outcomes and by how much. Experimental or quasi-experimental evidence on the effects of academic up- whether this finding can be used to project the effects of academic upgrading into the future. But if all teachers grading on student learning outcomes are not available for Indonesia. We do present, however, some evidence who upgrade to the four-year degree level would produce 0.15 standard deviations improvements in learning to shed light on the issue. outcomes, the total effects of upgrading will indeed be substantial. Teacher academic qualifications and student learning gains are positively related, even after controlling for teacher’s subject matter knowledge. It is possible to correlate student learning gains produced by teachers with 5 The figure is constructed based on a regression of midline student test scores, baseline student test scores, the (subject matter) test score of the teacher and a dummy variable that indicates if the teacher has a four-year degree or not. Both teacher subject matter knowledge four-year degrees and those without. The following Figure 4.10 estimates the additional learning gains of hav- and the indicator for having a teacher with a four-year degree appear statistically significant in this regression. This indicates that subject matter knowledge matters, and that the academic degree of teachers matters over and above a difference in subject matter knowledge. 100 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 101 The Impact of the Reform on Teacher Quality and Student Outcomes Another notable fact of Figure 4.10 is that the four percentage point difference in teacher test scores between work but also that there are perhaps insurmountable difficulties associated with implementing such schemes teachers with and without four-year degrees [see Figure 4.9] is associated with a 0.05 standard deviation increase in real world contexts. 6 in learning gains. That such (apparently) small differences in teacher’s subject knowledge are associated with fairly substantial student learning gains indicates that teacher’s subject matter knowledge is important. The The Indonesian teacher salary system leaves little room for explicitly rewarding top performers individually. In- fact that the subject matter component shown in the figure is smaller than the additional, unexplained effect is donesia is in that respect not very different than many other countries in the world. Salary levels are determined because differences in subject knowledge for teachers with and without degrees are really quite small. From a on the basis of academic degrees and on seniority. Also, the current design of Indonesia’s certification program policy point of view, the findings suggest that large learning gains can be achieved by attempting to increase does not allow for merit-based rewards. It is largely true that the most experienced and best educated teachers levels of subject knowledge among teachers. entered the certification process first, but eventually all teachers must be certified by 2015. This experimental evaluation is relevant for at least two reasons. First, unconditional salary increases are much easier to implement than pay-for-performance schemes. This is especially true in developing countries where 4.4 Impact of the certification process and the professional allowance: monitoring systems to operate functional pay-for-performance schemes are generally not very well established. Evidence from a randomized field experiment Indeed, Indonesia’s certification program is currently being rolled out across the country and, by 2011, had certi- fied about one million teachers. Second, there is no experimental evidence on the effects of large, permanent, The behavioral channel and unconditional salary increases on teacher performance (as measured by student learning outcomes). One of the well-established results of the recent empirical literature on teacher effectiveness is that there are As mentioned earlier, there has been an evolution in the procedure for gaining certification including an original very good and very bad teachers in a population: teachers matter! There is much less certainty, however, about option of portfolio assessment, with those who failed enrolling in a 90-hour training program, to the current what makes for a good or a bad teacher. Rivkin et al. (2005) find, for example, that that formal certificates, de- situation where almost all candidates go through (and rarely fail) the 90-hour course. Figure 4.11 illustrates the grees, experience, etc., explain very little of the variation in teacher quality. This suggests that whereas some pathways to certification and the number of teachers using these pathways: teachers are better in delivering a message than others, this skill is not easily acquired at teacher education institutions or by experience. Whether money matters depends in large part on whether there is some dormant Figure 4.11 “unused� potential that can be realized if additional incentives appear. Teachers could do better, in other words, Pathways to Certification. but they hold back because they are not paid enough. This chapter presents experimental evidence on the effects of certification (and the associated professional al- lowance) through the behavioral channel - that is, the effects of certification through changes in motivation or behavior of qualified in-service teachers. The analysis basically evaluates the effects of doubling a teacher’s income -- although certified teachers would have also successfully passed a portfolio assessment or graduated from a 90-hour training course. This is the first empirical study that attempts to evaluate the relationship between permanent, unconditional pay increases and teacher productivity using experimental methods. The experimental nature of the study means that there can be high levels of confidence in the findings presented here [see also (De Ree et al., 2012) for more details on the methodology and findings]. Furthermore, the study is unique in that it evaluates the effects of a real-world program that is a very expensive one in the context of Indonesia. At the moment teachers become certified, neither the continuation of the certified status nor the payment of the professional allowance is conditional on subsequent performance. This evaluation, therefore, comple- Source: Data provided by the Indonesian Ministry of Education and Culture in 2012 ments a rapidly expanding body of research that evaluates the effects of bonus payment or pay-for-performance schemes. These schemes link pay levels explicitly to the performance of teachers. Teacher performance can be 6 There are theoretical reasons to believe that pay explicitly tied to performance would work better than pay that is not -- in which case the measured based on inputs (e.g., low teacher absenteeism levels) or outputs (e.g., high student learning gains). As financial incentive to perform is lacking. The practical implementation of pay-for-performance schemes in the real world is, however, not straightforward at all. The main concern is whether measures of “value added�, i.e., average learning gains of students of a particular teacher, discussed earlier, it has been shown in some developing country settings that pay-for-performance schemes can are sufficiently accurate measures of teacher performance (see for example Guarino, Reckdase, and Wooldridge (2011)). Also, difficulties with practical implementation are one likely reason why pay-for-performance schemes are not adopted at large scale. 102 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 103 The Impact of the Reform on Teacher Quality and Student Outcomes The income for certified teachers practically doubled as a result of certification. Based on findings from the The first two bars present the effects of certification on teacher subject knowledge. As part of the study, teachers survey cited earlier, close to 100% of teachers who entered the certification process at a given year had been were tested on their levels of subject matter knowledge with a multiple-choice test. Subject matter tests are, certified in the next. Around 30% of teachers report to have received payment of the professional allowance one admittedly, a very incomplete measure of teacher’s overall competencies although they do measure subject year after entering the certification procedure. Two years after entering the certification quota, all teachers had matter knowledge which is a pre-requisite but not sufficient for overall teacher quality. Certification has not received the allowance. Baseline data was collected prior to certifying the teachers that were targeted by the in- caused any measurable changes to these scores. The certification process and the payment of the professional tervention but after they enrolled in the quota (see Box 1.1). At midline, all teachers who entered the 2009 quota, allowance do not make teachers more knowledgeable. This is hardly a surprise; however, it does indicate that the which includes the teachers that were targeted by the intervention, were certified and were paid. 90-hour training, which was part of the certification procedure for many teachers, is perhaps not quite sufficient to bring the competence of teachers to the next level. Money matters for some changes in teacher behavior: Teachers rely less on second jobs and have fewer difficulties financially supporting their households. Figure 4.12 presents the effects of certification on teacher Changes in time-on-task. In order to be eligible to receive the professional allowance, teachers must teach a characteristics.7 The livelihoods of teachers have improved. Certification can lead to a 27% point decrease in minimum of 24 period-hours. This regulation should force teachers who teach less to find employment in other the likelihood of teachers holding a second job because the professional allowance decreases the need to rely (nearby) schools. But given the current oversupply of teachers in the system, it might not be easy to find these on such jobs to supplement income. This is also reflected in a decrease in the number of teachers who report additional hours. It was assumed that the 24-hour workload rule would help to push out surplus teachers from problems with financially supporting the household. There is no evidence that certification makes teachers more the system. Because in treatment schools the pressure on teachers to adhere to the 24-hour rule is much higher likely to participate in teacher working groups, teach more hours, or self-report to be absent8 less often. than in the control schools, it would be expected that the former teachers would teach more hours. This appears not to be the case. Figure 4.12 Effects of Certification: Fewer teachers with second jobs and less concern for family welfare The idea that the 24-hour rule has not worked as planned can also be inferred following trends in student- teacher ratios. While there have been weak increases in student-teacher ratios in junior secondary schools since 2006, there is still a steady decrease for primary schools. Thus, the implementation of the 24-hour workload rule has not led to the desired improvement in efficiency in the use of teachers, although Figure 4.15 suggests that it has worked better with junior secondary schools. Recent changes in regulations are expected to have additional beneficial effects. For example, the recently introduced restrictions on the use of team teaching will now prevent schools from simply appointing two teachers to single classes and double counting teaching hours just to build teacher workloads up to the 24-hour minimum workload to ensure teachers receive the professional allowance. It seems, unlikely, however that the 24-hous rule alone can solve the problem with teacher oversupply in the country. (See Chapter 6 for further discussion of this issue.) Figure 4.13 Student-teacher ratios have been declining over time Source: Analysis based on teacher certification impact assessment data (De Ree et al., 2012) 7 The empirical specification use to obtain the results of Figure 4.12 is one in which the outcome variable of interest, for example a dummy variable of having a second job, is regressed on the baseline value, a full set of district dummy variables, and an dummy variable that indicates whether a teacher is certified or not. To account for non-random selection, the certification dummy is instrumented with the random treatment indicator that measures whether a school is in the treatment or the control group. The procedure obtains so-called local average treatment effects. This measures the average effect of certification on the group of teachers that was granted preferential access to the certification process in 2009. It can be seen as the effect of certification on those teachers that would normally enter the certification quota in 2010 or later. A final note is that for observations that did not have baseline values (new teachers or teachers who were absent at baseline), the baseline scores are set to zero. Included is an additional dummy variable that is marked as “one� if baseline scores are missing. Similar effects are found, however, if the model is run on a balanced panel -- that is, only on those observations for which there are baseline and midline observations. See De Ree et al. (2012) for more details. 8 A more generally accepted way of measuring absenteeism is by doing surprise visits. This was not done in this study Source: Ministry of National Education Statistical yearbook (Seri Ikhtisar Data Pendidikan Nasional) 1995-2010. 104 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 105 The Impact of the Reform on Teacher Quality and Student Outcomes Changes in teacher behavior have not translated into better student learning outcomes. Professional certifica- The effectiveness of the certification process tion increases the wellbeing of teachers, but does it also benefit students? The figure below presents the esti- The results of the randomized field experiment discussed above indicate that the actual process of certification mates of the effects of certifying teachers on the learning outcomes of their students. There is no evidence that – either through an assessment of portfolio or after passing the 90-hour training course – and the doubling of certification makes teachers teach better, at least not in ways that are measurable through student test scores. income do not lead to learning improvements in the classroom. The effects shown are well within the boundaries for statistical significance. The first column relates to the effects of certifying a primary school class teacher on student learning outcomes in primary school. The second to fifth A 90-hour training course is possibly not sufficiently intensive to lead to significant changes. A study by the columns present the effects of certifying a subject teacher in junior secondary school on student learning gains Ministry assessed10 the capacities of teachers graduating from this 90-hour training course. The analysis does in that particular subject.9 not provide a definitive before- and after- comparison to assess quality improvements. It does make some judg- ments about whether teachers who graduate from the course really meet the minimum standards along the Figure 4.14 lines of the four competencies spelled out in the Teacher Law: professional, pedagogical, personal and social. Effects of Certification: No measurable effects on student learning gains. This face-to-face course, supposedly with 30 hours of theory and 60 hours of practice (but with many hours taken over by rest breaks and administrative matters), provides a peer-teaching experience as well as observa- tion and feed-back on teaching skills demonstrated by participants. The curriculum follows the competency requirements of the Teacher Law and is based on a child-centered, active learning model. Instructors are univer- sity-trained with a minimum qualification of a Masters degree and at least 10 years of teaching experience. There is a separate curriculum for each category of teacher. The course is structured around the four competencies mandated by the Teacher Law. The basic curriculum of the 90-hour program requires participants to complete 90 hours (in 50-minute lessons) as specified in the guidelines. This includes general content, subject content, and a written test consisting of a pre-test and a post-test. In the learning process, instructors use multi-media and follow the principles of active, creative, joyful and effective learning. In practice, participants are trained using case analysis, group discussion and peer teaching (three days continuously with the instructor acting as a supervisor). The learning approach adopted is intended to stimulate participants into discovering their potential as teachers and to become sensi- tive to new problems. This interaction results in a two-way learning process (geared both for the more active participants who might raise an issue and to the less active who may find a solution to a problem by themselves). Source: Ministry of National Education Statistical yearbook (Seri Ikhtisar Data Pendidikan Nasional) 1995-2010. The 90-hour course is therefore focused on both professional (subject) and pedagogical (methodology) com- The experimental evidence presented in Figure 4.14 shows that the certification process and the payment of the petencies. Personal and social competencies are integrated into the other activities which are assessed continu- professional allowance do not benefit student learning. In summary, fewer certified teachers have second jobs ously throughout the duration of the course. The assessment at the end of the course is based on four compo- and fewer worry about providing adequate financial support to their families, but these changes in behavior nents: (a) 35% -- written examination; (b) 40% - practicum (teaching); (c) 10% - participation; and (d) 15% -- peer have not led to significant improvements in teacher productivity. With regard to the broader picture, the conclu- teaching. Scores from the four areas form 75% of the final determination towards certification. The remaining sion is that the greatest impact of certification is expected from the academic upgrading of teachers who did 25% is the score originally obtained in the portfolio assessment, if applicable. The final test verifies that the not yet qualify before the law was passed and from the higher quality of new inflow. Variability in the quality of participating teacher has met the standards in the four competency areas as referred to in the Teacher Law and the upgrading courses and the apparently large increases in supply of seats in university programs in education, subsequent regulations. however, also limit the potential effectiveness of these channels. In 2010 a qualitative study was undertaken to explore the impact of the 90-hour course on teacher knowledge 9 The teacher survey and the information on the answer sheet of students were used to match teachers to students. The results and skills. The course was already being undertaken by approximately 50% of the applicants, and it became presented in Figure 4.14 were obtained using a similar empirical model as was used for the results of Figure 4.12. The midline score of students was regressed on the baseline score, a full set of district dummies and a dummy variable that indicates whether the student had a certified teacher over the past year. This indicator was instrumented with a dummy variable indicating whether the student’s school was treatment or control. Here, also, baseline values were set to zero if they were not available (e.g., for first grade students at midline there are 10 Research and Development Board, Indonesian Ministry of National Education (2010), “Studi Kualitatif: Pelaksanaan Sertifikasi Guru (Kinerja no baseline scores). This procedure was accounted for by including a dummy variable that is one if baseline scores are not available. Pendidikan dan Latihan Profesi Guru/PLPG dan Pola Pembinaan Guru)�, Jakarta, Indonesia. 106 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 107 The Impact of the Reform on Teacher Quality and Student Outcomes important to identify whether the course: (i) increased the competency and performance of teachers, (ii) estab- 4.5. Conclusions lished a pattern of regular developmental activities to be taken by teachers, and (iii) identified potential strate- gies that could be used to enhance the professional skills of teachers. Certification sets minimum quality standards and provides recognition and higher levels of pay for teachers who adhere to these standards. In the case of Indonesia, due to the instruments used for the certification, the certifi- Instruments to gather data were based on the standards established in the four competency domains. In the cation program has had a number of different consequences. The attractiveness of the teaching profession has study, two major areas were assessed: (i) subject knowledge with a competency test and (ii) classroom perfor- increased. More high school graduates apply for places in one of the country’s teacher education institutions, mance through completion of a questionnaire on the teacher’s work by the principal. A score of 1-4 (ranging and there is some indication that the increased competitiveness has also led to increased quality of the candi- from poor, through below average, to satisfactory and above average) was given for each item. The graph below dates enrolled. At the same time, however, universities providing teacher education have responded to market was prepared from the data collected to illustrate the levels of proficiency of the professional and pedagogical forces which has led to an increased intake of new students. This process might further contribute to the general competencies of the sample of teachers measured. oversupply of teachers in the country and dampens the beneficial effects on the quality of the intake on average. Figure 4.15 At the same time, certification has provided the financial incentive for teachers to upgrade to the four-year Percentage of Teachers with Different Levels of Professional and Pedagogical Competence degree level, which applies to the majority of teachers currently active in the system. Although academic up- grading of the majority of the teaching forces should, at least intuitively, lead to important increases in student learning gains, the evidence provided in this chapter shows that this is not automatic. For example, teachers with degrees do not display much higher levels of subject matter knowledge than teachers without degrees. But at the same time there are correlations between student learning gains and academic degrees of teachers that cannot be solely explained by differences in subject matter knowledge between teachers with and without de- grees: teachers with degrees seem to be better teachers for reasons other than their subject matter knowledge. The general conclusion drawn from the evidence, perhaps somewhat prematurely, is that the process of aca- demic upgrading itself (currently happening at a massive scale) does not automatically translate into substantial steps forward in terms of the quality of teaching. This implies that universities supplying these degrees should be rigorously controlled in terms of the quality of the training they provide and properly accredited when they do. The law mandates that all Indonesian teachers must be certified by 2015.11 All of them therefore go through the certification process and receive the professional allowance at some point in their careers. This chapter has dis- cussed experimental evidence on the effects of certifying teachers and doubling their income. The certification tool used at the beginning of the reform fell short of measuring competence resulting in a number of teachers lacking minimum subject knowledge and pedagogical skills receiving double income but not improving the outcomes of their students. But teachers did respond to their new status by refusing second jobs and by being Source: Research and Development Board, Indonesia Ministry of National Education (2009). Government of Indonesia. Ministry of National Education. 2010. “Studi Kualitatif Sertifikasi Guru (Kinerja Pendidikan dan Latihan Profesi Guru/PLPG dan Pola Pembinaan much less likely to have financial difficulties. Teachers’ welfare and wellbeing have improved. There is no evidence Guru)� that the certification procedure and the increased levels of pay have led to better performance in the classroom. It seems that there is no dormant, unused potential that can be activated by paying teachers more money. This is In general the scores suggest that most primary school teachers had less than optimal training results in terms not surprising given that there are no clear theoretical reasons of why salary increases that are not conditional on of both professional and pedagogic competence. More than 90% of the teachers who passed the 90-hour train- performance in the classroom or further professional development would lead to better performance. It is also ing course were classified as “very incompetent� on the pedagogical domain. Scores were also inadequate for not surprising given the earlier analysis of the civil service mentality of many (mostly older) teachers who have professional capacities (i.e., subject knowledge). The scores, however, were considered better than on pedagogy. focused for many years more on “educating� their students rather than “teaching� them. Competency scores for personal and social competencies were higher and generally not below standard. In regard to junior high school teachers, the test results showed that most had less than optimal training in terms of professional and pedagogic competence. This is an important finding and an indication that the desired level 11 In fact, in the current regulation all civil servants and all government-hired contract teachers should be certified by 2015. School-hired of support needs to much higher than the current structure provides. contract teachers who are not explicitly recognized by the district government are not eligible for certification even if they have a four year post-secondary degree. 108 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 109 All evidence combined suggests that efforts must be made to closely monitor the upgrading process and make sure that academic upgrading, which currently happens at a massive scale, is of high quality. At the same time, Chapter 5 the increased popularity of the teaching profession among young high school graduates should be utilized to select the best among the pool of applicants, rather than to increase the levels of intake. Looking inside the Classroom Black Box 5.1 Teacher Classroom Practice The Indonesian government continuously improves the rules of the game. It realizes the huge benefits the certification program could have in improving the quality of the system. Despite the pressure of various interest The teacher reform effort has a strong focus on increasing teacher qualifications, both through requiring the groups such as the teacher associations, the Ministry of Education and Culture has made changes to the system attainment of a four-year degree and through certification. These qualifications are, of course, not the end goal which are likely to result in its improvement. Whereas the first batches of teachers passed the certification pro- but are instead part of a chain. Qualifications are expected to subsequently improve what takes place in the cess only through an assessment of portfolio of past training and professional experience, later batches had to classroom which should in turn lead to improved student learning outcomes. The certification study, elaborated pass a 90-hour training program to become certified. The latest batch, which entered the certification quota in in Chapter 4, explored the “book ends� to determine how qualifications are related to learning outcomes. It found 2012, also needed to pass an entrance examination to this 90-hour training. (Even though close to 90% of the no difference in the learning outcomes of students taught by certified compared to uncertified teachers, but enrolees passed this test, it implied an additional selection on quality. that students taught by teachers with four-year degrees did, in fact, have better learning outcomes than those with teachers having lower degrees -- and that the effect is quite large. It further identified a “teacher knowledge� The next chapter will deal with the second way to conceptualise teacher quality – what teachers should be able component as measured through teacher competency tests which helps to partially explain the contribution to know and to do in the classroom. made from four-year degree teachers. This chapter extends the certification study analysis by exploring the “in between� – the black box -- of what takes place in the classroom through a video study of 8th grade mathematics classrooms that participated in the Trends in International Mathematics and Science Study (TIMSS). When looking at the same “book ends� dimen- sions used in the certification study, the findings are strikingly similar. The students of certified teachers did not have better learning outcomes than students of uncertified teachers. There was also no difference in the subject matter and pedagogy assessment scores of certified and uncertified teachers. Education level, on the other hand, did have a positive relationship with student outcomes. Teacher knowledge – both subject matter and pedagogy – stood out as having a particularly strong relationship with, and a large effect on, student learning outcomes. Teacher degree type was also explored, and a striking difference emerged between the outcomes of students taught by teachers holding a mathematics education degree compared to a pure mathematics de- gree. While the pure mathematics degree teachers tended to have slightly higher subject matter scores on the teacher assessment, when it came to student outcomes, those with teachers having a mathematics education degree actually performed better than those with a pure mathematics degree. Although the video study can provide insights on qualifications, its true power comes through its comprehen- sive information on classroom process. Videos of 200 teachers working in classrooms were coded in great detail with multiple layers of teaching practices. These practices were then analyzed and linked with the critical dimen- sions identified in the certification study. When looking at the certification study dimensions through the lens of teaching practices, some telling results emerged in the areas of certified versus uncertified teachers, teachers with a four-year degree, and teachers with higher knowledge as measured through assessments. By analyzing the use and frequency of teaching practices and relating them to student learning outcomes, further insights were gained on which practices tend to be related to better learning. Some results confirm what would be expected, but there were also some surprising results that tend to contradict some well-known teaching-learning theories. 110 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 111 Looking inside the Classroom Black Box The video study was designed to examine not only what practices are used but also how the use of these 5.3 Findings: Practices in Terms of Usage and in Relation practices changes over time. With a two-phase design involving nationally representative samples in each year, to Student Learning insights were gained not only into what teaching practices were used but also into how the use of these prac- tices changed between 2007 and 2011. While some changes in teaching practices appear to be related to the Teaching practices were examined from various angles with the intention of understanding their frequency of teacher reforms, it seems that other factors beyond the teacher reforms are having greater influence on teaching use, how the practices relate to student learning outcomes, and how the teacher reforms and other factors may practices, in particular an increased emphasis on the national examination and changes in school resources. be influencing trends in practices. Detailed results concerning the above-mentioned conclusions are elaborated in the sections below. The first step in the analysis below examines categorizations of teaching practices in relation to the following questions: 5.2 Methodology and Analytical Approach 1. In looking at the teaching practices for the full, nationally representative samples of teachers in 2007 The Indonesia TIMSS Video Study uses detailed coding of videotaped lessons of 200 teachers to provide insights and 2011, are there any changes where teachers are using certain practices more or less frequently? on classroom activities in terms of time spent, frequency, sequencing, and quality of delivery. The participants 2. Is there a statistically significant positive or negative relationship between practices and student of the study participated in the Trends in International Mathematics and Science Study (TIMSS). This provided learning outcomes? unique benefits in terms of nationally representative sampling; extensive student, teacher, and school back- ground surveys; and student assessment results. The coding of the videos followed the coding structure devel- If there were, in fact, changes in the use of specific teaching practices between 2007 and 2011, an additional two oped for the 1999 TIMSS Video Study. This was beneficial not only in providing a high-quality, proven coding questions were asked: scheme but also in providing a context for a comparison of Indonesia’s results with other countries. 1. Would the changes be considered positive or negative from the perspective of student learning out- A mixed methods approach involving both quantitative and qualitative analysis was used. The quantitative anal- comes? ysis utilized advanced forms of multi-level and value-added modeling. The qualitative analysis used case studies of relatively high-impact teachers to provide in-depth insights on specific practices and also to explore two fac- 2. What might have caused these changes from the perspective of policies, training, demographics or tors seen as driving teaching practices: teacher mathematical beliefs and mathematical knowledge in teaching. some other factor? The data collection took place in two phases (2007 and 2011)1 , allowing for exploration of changes that had The relationship between teaching practices and student learning outcomes is presented through two models. taken place since the beginning of the teacher reform. The TIMSS rigorous sampling approach provided nation- The first is a regression that includes 30 background variables on student, student home, classroom, school, ally representative samples in each year. The fact that the video study is based on these samples allowed for and community characteristics. The second is the same regression as the first but also includes multiple teacher general snapshots of teaching practices to be created for each year.2 background characteristics (such as experience, gender, whether the teacher is a civil servant, degree type, etc.), as well as variables that could be seen as indicators of quality, including teacher competency scores, education Multi-level and value-added concepts were used in the analysis of the relationships between teaching practices level, and certification. When looking at teaching practices, the first model can generally be interpreted as how and student learning outcomes. The multi-level model used advanced techniques developed by the Centre for the practices relate to student learning when not taking into account teacher-related factors. The second can be Multilevel Modeling and included students nested within classes nested within provinces. The value added ap- interpreted to be how practices relate to student learning with teacher background and quality aspects taken proach relied on measurement of student learning over the 8th grade year by using a pre-test at the beginning into account. of the 8th grade year and a post-test at the end.3 The pre-test provides a baseline of the level of knowledge for students as they enter the year and the post-test provides an exit level of knowledge. As an example for comparing the two models, teachers holding a mathematics education degree tend to use the expositional teaching approach less than teachers holding pure mathematics degrees. In the first regres- sion this information would not be captured and would give the relationship of exposition to student learning outcomes without considering which teachers use it. The second model, on the other hand, takes the teacher 1 Different teachers and students participated in each phase so the two-phase approach should not be seen as providing panel data. degree (and other teacher variables) into consideration so it captures the relationship between exposition and 2 By summarizing the practices of the full sample of teachers, a “lesson signature� of Indonesian 8th grade mathematics teachers in general was obtained. student learning outcomes while controlling for teacher degree and other teacher variables. By controlling for 3 While the study utilizes TIMSS student test results in some analyses, this measure only provides a snapshot of student achievement levels these variables, the teaching practice can be thought of as applying across teachers of various backgrounds. as they finish the 8th grade year. For in-depth analysis of the relationship of teaching practices to student learning outcomes, an additional component of pre- and post-testing was added in the 2011 phase. Only the 2011 data was used for analyses involving student learning Both provide interesting perspectives, and while the second model would generally be considered more rel- outcomes because pre- and post-testing is critical for properly measuring student learning progress within the 8th grade year. 112 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 113 Looking inside the Classroom Black Box evant because it provides the relationship across all teachers, the first gives an important contrast when thinking For any category, teachers typically use multiple practices rather than just one. In looking for the relation- about teaching practices and what role teachers’ background and quality play in the use of the teaching practice. ship of a practice with student learning outcomes, the interpretation is not whether teachers do or do not use a practice, but rather to what extent the practice is used. Table 5.1 Two models used to examine the relationships between teaching practices and student outcomes Keeping these important points in mind, the results still provide critical insights into practices used in Indonesia’s mathematics classrooms and how they relate to student learning outcomes. The creation of an overall picture of practices and trends allows for a better understanding of what takes place in Indonesia’s mathematics class- rooms. In relating these practices to student learning, many statistically significant results are obtained, giving insights into the teaching-learning process and how it might be improved. Time spent on Mathematics In what could be considered the foundational layer of classroom time allocation, all lesson time was first catego- rized as being either mathematical, mathematical organization or non-mathematical in nature. The theoretical heart of this layer is based on research related to time on task which has its roots in Carroll’s “A Model of School Learning� (Carroll, 1963) and has been one of the most widely discussed concepts in the education community since the 1970’s. Mathematical time also represents what has been called Academic Learning Time (ALT)5 which represents when learning takes place. Mathematical organization time may be effective and necessary for set- ting up a learning situation but could be detrimental if not conducted efficiently or if it breaks the rhythm of The relationship of teaching practices with student outcomes, however, must be interpreted with caution. The learning. While some non-mathematical time may not be avoidable, it clearly takes away from learning time analysis identifies statistically significant relationships based on the frequency and extent of use for given prac- and may also be an indicator of classroom management and behavior issues (e.g., Doyle, 61990 ; Kounin (1970), tices. Any statistically significant relationship that emerges is an important signal of how practices relate to stu- Wragg (1993)). dent outcomes but should not be oversimplified or misinterpreted to provide a right way of teaching. Below are some important points to keep in mind regarding what is measured and pitfalls to avoid in interpretation: Definitions of the teaching practices for the Lesson Structure category include: It is not only the amount of time spent for a given practice but also the quality of how the teacher conducts • Mathematical: Time spent on mathematical content presented either through a mathematical prob- the practice. A practice may emerge as having a positive relationship with student learning based on overall lem or outside the context of a problem. frequency and extent of use, but individual teachers may use the practice effectively or ineffectively. • Mathematical Organization: Time devoted to preparing materials or discussing information related Each lesson requires a unique set of practices. There is not an optimal formula to apply to all lessons; in fact, to mathematics but not qualifying as mathematical work. particularly effective teachers are able to vary their practices according to the material and the needs of the • Non-mathematical: Time devoted to non-mathematical content such as taking roll call, prayer time, students within a given lesson. disciplining a student while other students wait, or listening to school announcements on a public- address system. Context is important. The regressions take into account many contextual factors in an attempt to determine effects across various contexts, but the results certainly should not be interpreted to indicate a standardized ap- proach to mathematics teaching.4 The teaching practices are typically proportions within a given category. A negative relationship should not necessarily be interpreted as being a bad practice. It could possibly indicate that relatively too much of the pro- portional time tends to be allocated to the practice. 5 Academic Learning Time (ALT) is defined by Berliner (1990) as that part of allocated time in a subject-matter area (physical education, science, or mathematics, for example) in which a student is engaged successfully in the activities or with the materials to which he or she is exposed and in which those activities and materials are related to educational outcomes that are valued (Berliner, 1987 Berliner, D. C. (1987). Simple views of effective teaching and a simple theory of classroom instruction. In D. C. Berliner & B. Rosenshine (Eds.), Talks to teachers (pp. 93-110). New York: Random House.; Fisher et al., 1980, Fisher, C. W., Berliner, D. C., Fully, N. N., Marliave, R. S., Cahen, L. S., & 4 The effects of practices across contexts are explored in great detail in the full video study, but due to space constraints much of the detail Dishaw, M. M. (1980). Teaching behaviors, academic learning time and student achievement: An overview. In C. Denham & A. Lieberman cannot be presented in this chapter. (Eds.), Time to learn (pp. 7-32). 6 Doyle, Walter. (1990) “Classroom management techniques.� Student discipline strategies: Research and practice: 113-127. 114 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 115 Looking inside the Classroom Black Box Comparison between 2007 and 2011 Figure 5.2 Relationship of Lesson Structure teaching practices with student learning outcomes Teachers spent less time on mathematics and more time on mathematical organization. The data from 2007 to 2011 indicate that the proportion of classroom time spent on mathematics fell from 89% to 86% while math- ematical organization time increased from 8% to 10% and that these changes were statistically significant. While non-mathematical time increased slightly, the change was not significant. Although it is not intended to be specifically for mathematics classrooms, the Stallings benchmarks for effective time use indicate that instruction time should make up at least 85% of class time while classroom management should be 15% or less and off-task time should be 0% (Stallings and Knight, 2003). Indonesia’s instructional time (mathematics time) is just above the benchmark, but off-task time (non-mathematics time), while low, is considered something to be eliminated in the benchmark. Figure 5.1 Proportions of Lesson Structure practices in 2007 and 2011 The coefficients indicate that a percentile increase in the proportion of time spent on mathematics is related to an increase of student test scores by 0.56 percentage points while an increase of a percentile point in the propor- tion of non-mathematics time is related to a decrease of 0.83 percentage points. An alternative way to look at the relationship is using standardized coefficients which allow for easier comparison to other variables examined in Note: changes in mathematical time and mathematical organization time were statistically significant. this chapter. The standardized coefficients indicate that a one standard deviation increase in mathematics time is related to a 0.30 standard deviation increase in student test scores while a one standard deviation increase in non-mathematics time is related to a 0.18 standard deviation decrease. Both of these changes are large in com- Relationship with student learning outcomes parison to other teaching practices. The relationship of these time categories with student learning outcomes was examined starting with a base regression controlling for student, classroom, school, and community characteristics and then with a second The trend of decreased time spent on mathematics is of concern because, in line with expectations based on regression that also included teacher background and quality characteristics. Mathematical time had a posi- theory, mathematics time should have a positive relationship with student outcomes. Non-mathematics time tive relationship with student outcomes while non-mathematical time had a negative relationship. As would be tends to have the strong negative relationship with student outcomes, but the change between 2007 and 2011 predicted in time-on-task theory, students in classrooms with a higher proportion of time spent on mathematics of this variable from 3% to 4% is not statistically significant and represents a small proportion of lesson time; the tended to have higher learning outcomes while classes with higher time on non-mathematical tasks tended to highest proportion in the sample was 11%. have lower outcomes. Mathematical organization did not have a statistically significant relationship with learn- ing outcomes. While the result of time on task having a positive relationship and time off task having a negative relationship is not surprising, it drives home an important fundamental point that teaching requires management of time, and the trend toward less mathematics time, while not dramatic, should raise a flag. The other seven countries in the 1999 TIMSS study all had at least 95% of classroom time allocated to mathematics, and no country had more than 1% of time on non-mathematics ((Hiebert, 2003) page 39). 116 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 117 Looking inside the Classroom Black Box Time on task extends to the breakdown of mathematical time into problem and non-problem time. Indonesia’s Comparison between 2007 and 2011 results showed a decrease in problem time from 76% in 2007 to 67% in 2011 but that this time tended to have a Compared to 2007, Indonesian teachers in 2011 tended to use much more exposition while discussion, practi- positive relationship with student learning outcomes. Teachers also have increased the proportion of mathemat- cal work, and investigation all decreased. This result is somewhat surprising in that the practices taught in many ics time used for the introduction of new material from 46% in 2007 to 58% in 2011 while reducing practice time recent government programs (e.g., through the national mathematics training organization and in teacher work- from 39% to 26%. The reason for the decrease may be related to the increased availability of textbooks and to ing groups) generally encourage teachers to use less exposition and more student-centered learning. Various teachers being able to more easily give practice work as homework rather than using class time. Teachers now theories have been proposed by the mathematics experts involved in the study as to why this trend occurred, seem to be using that time instead to introduce new material, possibly allowing for the coverage of more top- including the possibility that certification is influencing teachers to be more teacher-centered, either through ics and material. Interviewed teachers also spoke of the curriculum being spread thin where it is difficult to get the pride they may feel by being certified (i.e., as “professionals�) or a greater sense of obligation. This theory did through all the topics expected to be covered over the course of the year. This may be a contributing factor to not bear out in further analysis where certified teachers were not found to be any more likely to use exposition. teachers rebalancing to use time for the introduction of new material.7 These examples of changing time indi- Another possibility is that exposition is considered by teachers as an easier or more direct method to prepare stu- cate that classroom resources and influences such as the curriculum can alter the composition of time on task dents for the national examination. This and other possible reasons for this trend are continuing to be explored. and teaching practices. Figure 5.3 Teaching Approaches Time spent on using different teaching approaches The teaching approaches used in classroom activities can also play an important role in how students learn. Various models of teaching approaches have been developed with a progressive (socio-constructive) versus traditional (behaviorist) model often used to distinguish between ways of teaching (e.g., Dewey (1938), Handal, 20038 ). The teacher’s conception of role is also an important factor with (Kuhs & Ball, 1986) defining categories of (1) instructor (for skill mastery), (2) explainer (for conceptual understanding), and (3) facilitator (for confident problem-solving). In the coded approaches used in the video study, exposition or lecturing encompasses an approach that is high- ly prevalent in many countries and is often associated with traditional or teacher-centered learning where stu- dent participation is limited.9 Discussion becomes more student-centered with dialogue between the teacher and students, while problem-solving, practical work, and investigation are approaches that revolve more around mathematical problems and tend to encourage more student-centered learning. Note: the changes between 2007 and 2011 are statistically significant for discussion, exposition and investigation. Definitions for the Teaching Approaches category include: • Exposition: Time when the teacher lectures while students listen and answer closed questions (with Relationship with Student Learning Outcomes no discussion). In examining the relationship between teaching approaches used and student learning outcomes, some striking differences emerged. Exposition had a negative relationship and surpassed the statistical threshold. Investiga- • Discussion: Time when the teacher and student(s) discuss their own ideas about mathematics. tion, practical work and problem solving all had positive tendencies with investigation and problem solving • Problem solving: Time when the teacher provides a problem/situation as a basis to discuss ideas in both reaching thresholds of statistical significance.10 These three approaches tended to involve a mathematical mathematics. problem focus and tended to encourage active student engagement and participation. • Practical work: Time when equipment or situations in the real world are used to explore ideas in mathematics. • Investigation: Time when students explore the issues (problems) in various mathematical situations. 7 Full results for these layers are not shown due to space constraints. 8 Handal, B. (2003) Teachers’ mathematical beliefs: A review. The Mathematics Educator, 13 (2), pp. 47-57. 9 At the same time it is important to note that just because students are not actively participating through dialogue, this does not neces- 10 It is important to note that while investigation shows up as having a strong positive relationship, it was only used by three teachers in the sarily indicate a lack of engagement as students could still be actively thinking and working on problems. sample so the results should be interpreted with caution. 118 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 119 Looking inside the Classroom Black Box Figure 5.4 Definitions for the Public Interaction Participants category include: Relationship of Teaching Approach practices with student learning outcomes • Teacher interaction: Time when the teacher leads the class and presents to all students. • Teacher and student interaction: Time when a presentation is made by both the teacher and students (in intervals), intended for all students. • Student interaction: Time when a presentation is made by a student or students, intended for the teacher and all students. Comparison between 2007 and 2011 Within the public or whole class interaction, there was much more teacher-only time in 2011. This typically involved expositional or lecture activities. Student involvement in the form of teacher-student interaction fell dramatically. Figure 5.5 Breakdown of public (whole class) time by participants The trend in practices, in combination with the evidence of their relationship with student learning outcomes, raises some flags. Exposition had a large negative relationship yet it increased significantly in use from 2007 to 2011. On the other hand, the techniques of investigation and practical work, which had positive relationships, were decreasing in use (although practical work never reaches the 5% threshold of statistical significance). Exposition and problem-solving, the two approaches with increases, could often be used as a way of “teaching to the test� whereas investigation and practical work could lead to greater understanding but require a more indirect approach to getting students to be able to answer typical national examination questions. Breakdown of public (whole class) time by participants Note: the changes between 2007 and 2011 are statistically significant for Public:teacher only and Public: teacher and student. Mathematical time was divided into public time, where the whole class participates in a task, and private time, where students are broken up into groups or do individual seatwork. In 2011 the allocation was 64% whole class Relationship with Student Learning Outcomes time and 36% group or seatwork time. There was no statistically significant relationship between the propor- tions of these categories and student learning outcomes, but a further breakdown of the interaction uncovered The standout feature of the different types of public whole-class interaction was the positive relationship of interesting results in terms of changes from 2007 to 2011 and in how it relates to student learning outcomes. student learning outcomes with participation involving both teacher and students. In contrast, activities that are teacher-only or student-only had negative but not statistically significant relationships with student outcomes. Whole class time was further broken down into the types of interaction by the participants. The division of whole As will be shown later when looking at private interaction, a similar pattern emerged -- activities that are student- class time into teacher-only, teacher-student, and student-only interaction is closely linked with traditional ver- only tend to have a negative relationship to student learning while teacher-student activities have a positive sus progressive teaching approaches. Teacher-only interaction is considered traditional whereas teacher-student relationship. This may indicate the importance for teachers to be actively involved even in student-led activities and student-only interactions are often associated with progressive and student-centered learning. They also and to monitor, speak to, and encourage students. On the other hand, teacher-centered activities tended to be relate to the teacher’s conception of his or her role as instructor (for skill mastery), explainer (for conceptual un- negative in relationship to learning. derstanding), or facilitator (for confident problem-solving) (Kuhs & Ball, 1986). 120 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 121 Looking inside the Classroom Black Box Figure 5.6 Generally, application of mathematics to real-world problems and the use of non-routine problem solutions Relationship of Public Interaction categories with student learning outcomes tend to be seen as involving more higher-order thinking and requiring a deeper understanding of mathematics. This is not to say that problems in the context of mathematical language and symbols and problems that can be solved with a routine approach are inferior; indeed, they are necessary. Still, many advocates of progressive learning tend to promote real-world contexts and non-routine problem solving. Definitions for the Problem Context category include: • Real world: Time spent on mathematical problems presented within a real-life context. • Mathematical language: Time spent on problems presented only with mathematical language and symbols. Definitions for the Problem Solution category include: • Routine: Time spent on a problem that can be solved directly using a formula, definition, or proposi- tion. • Non-routine: Time spent on problems that cannot be solved with a usual procedure (directly using a formula, definition, or proposition) but instead must be solved using a non-routine strategy. The trend of less teacher and student interaction goes against the practices reportedly encouraged by the Min- Definitions for Problem Nature include: istry of Education and Culture in their training and their teacher working group activities. Combining this trend with the fact that the amount of teacher-student interaction time had a positive relationship with student learn- • Open: Time involving problems or questions where there is more than one correct answer. ing outcomes raises some concerns as well as questions as to why it might be declining. As mentioned earlier, • Closed: Time involving problems or questions where there is only one possible answer. one possible explanation suggested by teachers and policy makers is that certification may indirectly encourage teachers to use more teacher-centered learning approaches due to a sense of pride and self-importance or even Comparison of 2007 and 2011 of obligation to earn their increased income. In 2011 mathematical problems overwhelmingly involved mathematical language and symbols, and there was an increase in the amount of time where mathematical language and symbols were used from 89% in 2007 to The Context and Language of Problems and their Solutions 93% in 2011. A likely explanation for the decrease in problems involving real-world contexts is that there was a Problems can be presented in a variety of way, including the context and language used and in terms of the push for contextual teaching and learning (CTL) starting in the late 90s but that this had been promoted less method of solving them. Real-world problems may provide a contextual understanding of how mathematical in recent years. The change therefore possibly reflects a fading out of the CTL approach. Still, it is surprising to concepts relate to actual situations. Application of mathematical concepts to situations may also require more see how unbalanced the mix of problem contexts is with the use of real-world contexts making up a very small advanced cognitive thinking relative to problems presented in mathematical language. The use of mathemati- proportion of the total. cal language and symbols at times is associated with rote learning but can also be required for advanced and complex mathematical problems. Similarly, problems may be considered routine or non-routine with the latter generally considered as requiring more advanced cognitive thinking. Routine problems can be solved directly through formulas whereas non- routine problems cannot be solved with a usual procedure but instead require a non-routine strategy. 122 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 123 Looking inside the Classroom Black Box Figure 5.7 Figure 5.9 Language used in problem time as mathematical language and symbols versus real-world Open versus Closed problems Note: the changes between 2007 and 2011 are not statistically significant for Open and Closed. Note: the changes between 2007 and 2011 are statistically significant for Mathematical language and Real world. Relationship of the practices with student learning Teachers tended to present and spend time on problems that could be solved in a routine manner rather than Surprisingly, problems within the context of mathematical language and problems solved through routine pro- through a non-routine approach; this proportion increased between 2007 and 2011. The fact that only 4% of cedures had a positive relationship with student outcomes. The results in the graph below combine the two problem time was spent on non-routine problems is of concern, particularly since non-routine problems are separate categorizations of approaches to mathematical problems. On the left is the mathematical language typically considered to be related to higher-order thinking. versus real-world contexts and on the right is routine versus non-routine problem solving. The results indicate that there was a strong positive relationship for both mathematical language and routine problem-solving, while Figure 5.8 the real-world contexts and non-routine practices had a negative relationship. The use of non-routine approach- Routine vs. Non-routine approaches to problems es also had a positive relationship with student learning outcomes. Figure 5.10 Relationship of problem approach categories with student learning outcomes Note: the changes between 2007 and 2011 are statistically significant for Routine and Non-routine. Teachers also overwhelmingly used problems and asked questions that were closed in nature. Only 3% of time spent involved open problems and questions. Note: the practices with the dotted lines are the same, mirrored values as the corresponding practices above but with negative values. 124 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 125 Looking inside the Classroom Black Box The results vary in terms of statistical significance depending on whether the regression includes the teacher Box 5.1 variables or not. In the case of mathematical language and real-world contexts, these become statistically sig- The use of questioning from the perspective of the teacher’s goals nificant only when the teacher background and quality variables are included. On the other hand, the routine versus non-routine and closed versus open distinctions are statistically significant when no teacher variables Questioning can be a powerful instrument in a mathematics teacher’s repertoire of teaching prac- are included but are no longer significant when teacher variables are added. One interpretation is that the non- tices and can serve various purposes in defining the dynamics of the classroom and developing stu- routine and open practices are rarely used and typically only the “higher quality� teachers use them so once this dent learning. Through interviews and the observation of case study teachers in the video study, an is taken into account the practices no longer become statistically significant. The mathematical language and interesting picture emerged of how teachers conceive of and utilize questioning. Teachers said that real-world contexts, on the other hand, may be used by a mix of teachers, but once the background and qualities they used questioning to check understanding (majority), keep the attention of students, and direct are taken into account it appears that the use of mathematical language and symbols in problems has a positive the students’ attention and also as a way of understanding what students were thinking. They also relationship across teacher background and quality. explained that they called on individual students as a way of building their self-confidence, although some teachers at times used it as a punishment for not paying attention. Ainley (1988) developed These problem context and approach categories bring up very interesting aspects related to testing, what is a framework of questioning based on the teacher’s goals where questions were categorized in the truly being measured, and how teachers might change their teaching practices in order to better support their following way: students to succeed in high-stakes assessments such as Indonesia’s national examination (in this case, held at the end of Grade 9). Teachers seem to have moved towards more routine, formulaic, and possibly rote learning Pseudo Questions: to establish an acceptable behavior or a social contract with their approaches, and these actions could be considered “teaching to the test�. The increase in mathematical lan- students guage and the use of routine approaches and closed problems and questions may have to do with an increased Testing Questions: to find out if students respond correctly emphasis on performing well on the national examination where questions typically require a routine approach Genuine Questions: to seek information; thus, teachers do not know the answers to in their solution. these types of questions Direct or Provoking Questions: to provoke students’ thinking by making new connec- There was a positive relationship between teachers’ self-reported influence of the national examination and tions or clarifying existing ones and by exploring new areas of mathematical knowl- their use of routine problems as well as with their use of mathematical language contexts. Teachers were asked edge. whether their teaching was influenced by the national examination. Those who said they were more influenced In Indonesia’s classrooms the use of pseudo and testing questions dominated, but the relatively ef- also tended to use routine problems, closed problems, and mathematical language contexts -- evidence that fective teachers would more frequently use genuine questions and direct or provoking questions. these practices could be seen by teachers as being the more effective and/or efficient in preparing students for The latter is considered to be particularly effective at encouraging higher order thinking. the national examination. In addition, the percentage of teachers who said they were influenced by the national examination increased from 70% to 75% between 2007 and 2011 which indicates the national examination is increasingly influencing how teachers prepare and implement their lessons. 5.4 Impact of the Reforms This raises an important contradiction: many educationalists argue that the teaching approach encapsulated in these routine, closed, and formulaic techniques does not promote true understanding of mathematics. Still, In light of the results from the previous section on the frequency and use of teaching practices as well as their if teachers are “teaching to the test� and these approaches tend to help students score better (as at least the relationship to student learning outcomes, the practices can now be seen in the context of the teacher reform. mathematical language relationship with student outcomes indicates), is it a wise strategy? Could it, in fact, The following section explores key elements of the teacher reform, including the cornerstone aspects of certifi- lead to better learning, albeit more through a mechanistic, rote learning approach? The non-routine and open cation and the requirement that all teachers obtain a four-year degree. For the latter, a special focus is also placed results are an indication that the less mechanistic approach could, in fact, lead to better learning, but it is used on teachers who did not have a four-year degree at the start of the reform (2005) but subsequently upgraded very infrequently. to a four-year degree. Do certified teachers teach any differently? As elaborated in Chapter 4, the certification process itself did not have an impact on altering teaching per- formance as measured through student learning outcomes. The video study had similar results: there was no statistically significant difference between student learning outcomes for certified and uncertified teachers, and there was also not a statistically significant difference in their teacher assessment scores. But differences may still 126 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 127 Looking inside the Classroom Black Box emerge related to their teaching. In the 2011 sample, 53% of teachers were certified, providing a nice balance of The results coincide with the certification study findings giving further evidence that certification did not have certified and uncertified teachers for comparative purposes. an impact on teaching practices and behavior. This lack of difference is not particularly surprising. Almost every teacher who went through the certification process obtained it so there was no separation of teachers during The teaching practices of certified and uncertified teachers may differ due to either teacher motivation or fun- the process in terms of quality criteria.11 While there was an additional 90-hour course taken by approximately damental underlying differences between the two groups. Teachers may alter their teaching practices through 2/3 of the teachers, such training would be highly unlikely to alter teaching practices in any measurable way. higher motivation from the increased salary, an increased sense of status, or an increased sense of obligation. The certification study found that certified teachers were less likely to hold a second job but did not identify More time could also be dedicated to teaching because of not having a second job, which could conceivably any other differences in teacher behavior such as teaching hours, absenteeism, or student outcomes. The video lead to changes in the way teachers plan and execute their lessons. In this section the teaching practices of study accords with those results by further indicating no discernible differences in practices. certified teachers are compared with those of uncertified teachers to determine whether any differences can be seen. Is there a relationship between teacher education level and student outcomes? The requirement that all teachers obtain a four-year degree by 2015 is based on the assumption that the teach- The queuing process of teachers for the certification process is important to take into account when analyzing ers with a higher level of education will be more effective teachers. The following section explores how educa- certified and uncertified teachers. Teachers were selected first based primarily on age and years of experience. tion level relates to student learning outcomes. In order to meet the requirement, many existing teachers who Civil servant teachers also received priority. These and other important background characteristics of teachers had less than a four-year degree upgraded through additional in-service training. This section explores how and contextual characteristics of their working environment were controlled for in the analysis. teachers who have upgraded to a four-year degree compare to teachers who obtained their degree directly through pre-service training. Teaching practice comparison In looking at teaching practices, the striking feature is the lack of statistically significant differences between The video study sample in 2011 is made up almost completely of teachers who have already obtained their four- certified and uncertified teachers. The figure below shows results where the teaching practices of interest were year degree, so it unfortunately doesn’t lend itself well to analyzing differences between teachers who have met placed (one at a time) into a regression model that controlled for multiple contextual variables. Only one differ- this critical threshold requirement for certification and those who have not. Still, similar results were obtained ence emerged: certified teachers tended to use more public (whole-class) interaction and less private (group with those of the certification study: students who were taught by teachers with a four-year degree tended to and seatwork) interaction. As demonstrated in the previous section, there is no statistically significant relation- have higher learning outcomes. Such students tended to have nearly 4% higher scores on the post-test (than ship between these practices and student learning outcomes. those who were taught by teachers with less than a four-year degree) after controlling for multiple background factors and the students’ pre-test scores. Since the average score on the post-test was only 34%, the 4% differ- Figure 5.11 ence is quite large and can be interpreted to represent a difference of nearly 12% relative to the average score. Analysis of differences in teaching practices used by certified teachers vs. uncertified teachers Does degree type have a relation to teaching? One of the components of the teacher reform in Indonesia was the requirement that teachers hold a degree in the subject they teach. There was concern with teacher mismatch where a large number of teachers were teach- ing subjects different from their training degree and that this could potentially be harmful if they did not have a sufficient level of subject competence. Teachers undergoing certification could only obtain certification in a single subject and were expected to teach only that subject. One of the more striking results of the study is the difference in student learning outcomes of teachers holding a mathematics education degree compared to those with a pure mathematics degree. Students of both teachers holding mathematics education and pure mathematics degrees had positive learning outcomes on average, but students taught by teachers having a mathematics education degree tended to perform relatively better. Students of teachers who held a mathematics education degree on average scored 1.3% lower on the pre-test than those with teachers holding mathematics degrees but scored 1.3% higher on the post-test, showing bigger 11 The queuing criteria such as experience and education level did mean that differences do exist between certified and uncertified teach- ers, but these factors were controlled for in the analysis. Note: bars that pass the 5% threshold are considered to be statistically significant. 128 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 129 Looking inside the Classroom Black Box gains. The graph below highlights the contrast, with student learning outcomes of those taught by teachers It is important to note that this result should not be oversimplified to conclude that only teachers with a math- with a degree in mathematics education having a positive and statistically significant relationship while teachers ematics education degree should be hired. In fact, teachers with a pure mathematics degree do tend to have with degrees in pure mathematics were strongly negative. It is important to emphasize that this negative rela- important foundational skills and can be very effective teachers. What is important about this result is that it may tionship is relative to teachers who did not have a pure mathematics degree and does not indicate that students provide insights into how training can support teacher development. The result may be capturing important had negative learning outcomes. Their progress in learning was just relatively less. pedagogical skills that mathematics education degree teachers obtain through their degree work. Ensuring that pure mathematics degree teachers receive similar additional pedagogical training could have a positive impact. Surprisingly, students with teachers lacking any formal mathematics training did not have lower student out- It may also capture differences in the way the degree courses teach mathematics with the mathematics degree comes. Such non-mathematics teachers made up only 8% of the sample and held a diverse range of degrees teachers learning how to solve problems whereas mathematics education degree courses tend to approach including economics, Indonesian, chemistry, and even religion. Their results tended to be positive but did not problems within the context of teaching mathematical concepts and problem-solving approaches to students. reach statistical significance. It is not known what sort of training they received over their careers to possibly sup- port their knowledge of mathematics, but the results at least don’t indicate that they are teaching worse due to Teaching practice comparison the lack of mathematics focus in their degree as is feared in the case of mismatch. The difference between teachers holding mathematics education degrees compared to pure mathematics de- grees is one of the biggest distinguishing factors in terms of the types of teaching practices employed. Teach- Figure 5.12 ers with mathematics education degrees tended to generally use the practices that are positively related with Relationship of teacher degree to student learning outcomes student learning outcomes. They tended to use a teaching approach of investigation, problem-solving, and discussion more often than exposition which has a strong negative relationship with student learning. Question- ing was also an important distinguishing factor where mathematics education teachers used questioning much more frequently and with various techniques including question-and-answer and rhetorical questioning. They tended to do more private interaction teaching (group and individual seatwork) than public (whole-class) teach- ing and tended to do more monitoring of student activities. It is not always the case that the techniques used more often by mathematics education teachers than mathe- matics-only degree teachers had a positive relationship with student outcomes. For example, they tended to do more teacher-only public interaction and less teacher-student public interaction. Real-world contexts in working on mathematical problems were also used more often by mathematics education teachers, and mathematical language and symbols (which have a positive relationship with learning), less often. In interpreting the regression coefficient for the teacher degree type and its relation to student post-test scores, the students having a teacher with a mathematics education degree tended to have 3% higher scores on the post-test after controlling for multiple background factors and the students’ pre-test scores.12 12 As noted earlier, students of teachers with mathematics education degrees started out with lower pre-test scores so the 3% difference is based on their relative improvement. 130 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 131 Looking inside the Classroom Black Box Figure 5.13 Teacher subject knowledge tended to have a stronger relationship with student learning than pedagogical Teaching Practices of teachers with a Mathematical Education Degree knowledge. This may in part be due to the measurements themselves, with subject matter knowledge lending itself well to a test whereas pedagogical knowledge is much more difficult to measure through a paper test. 13 Still, the fact that pedagogical knowledge also tended to have strong results indicates its important role in learn- ing outcomes. Figure 5.14 Relationship between Teacher Knowledge and Student Learning Teacher Knowledge Teacher competency testing is an important recent inclusion in the certification process. In 2012 such testing was introduced into the process; teachers falling below the passing mark are not allowed to become certified and must reapply the following year. Whereas virtually all teachers were able to obtain certification in the previ- ous process, the new process truly has the possibility of distinguishing between higher and lower quality teach- ers from a competency standpoint. But is competency testing a valid way of determining higher and lower quality teachers, and will it make a differ- In interpreting the regression coefficient for the degree and its relation to student post-test scores, a percentage ence in terms of improving student learning outcomes? The following section presents an analysis that indicates point increase on a teacher’s assessment score is related to a 0.17 percentage point increase in a student’s post- a very strong relationship between knowledge and student learning outcomes and also indicates that teachers test score after controlling for multiple background factors and the student’s pre-test score. Teacher assessment with greater knowledge utilize different practices than teachers with less knowledge. scores ranged from 7% to 75% with an average score of 48%. For example, a 10% higher teacher assessment score resulted in a student’s post-test score being 1.7% higher. Again, since the average score on the post-test Knowledge and Student Learning Outcomes was only 34%, the 1.7% difference represents a difference of 5% relative to the average score. (Similar but lower Of all factors explored, teacher knowledge had the strongest relationship to student learning outcomes. The coefficients were found when looking at the subject and pedagogy score in relation to student post-test, with a results below emphasize the particularly strong relationship between teacher knowledge and student learning 0.14 and 0.10 percentage increase respectively.) The standardized coefficients indicate that a one standard devia- outcomes. They indicate that both subject matter knowledge and pedagogical knowledge in almost all cases tion increase in teacher assessment scores is related to a 0.23 standard deviation increase in student test scores. were well above the generally accepted 5% statistical significance threshold and typically above the 1% signifi- cance threshold. The significance levels tended to drop when including teacher background variables such as education level and experience, likely indicating the fact that other teacher characteristics also play an important 13 A great deal of caution should be used in assessing a teacher through a pedagogy examination since a teacher’s pedagogical effective- role in student learning. ness is not about knowing facts about teaching methods that can be reduced to a question in a multiple choice examination. The video study is specifically intended to explore how teachers use their pedagogical knowledge “in the moment�. Still, the fact that such a strong relationship exists between pedagogy score and student learning indicates that the test is, in fact, capturing some aspect of the teacher’s knowledge and appears to provide a proxy for what they do in the classroom. 132 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 133 Looking inside the Classroom Black Box Knowledge and Teaching What is somewhat surprising is that students with teachers having greater knowledge tended to do much bet- The strong relationship between teacher knowledge and student learning indicates that teachers with more ter, but the teaching practices are not so drastically different. This likely indicates that teachers were more effec- knowledge tended to teach more effectively, but can this knowledge be communicated through the teach- tive at conducting the same practices. For example, two teachers could conduct a review of previous material, ing practices employed in the classroom? When dividing teachers into high and low knowledge groups and but teachers with greater knowledge may tend to be more effective due to clearer explanations and being able then comparing the frequency and approach in teaching practices, certain differences emerged. Teachers with to spot and correct student errors and misconceptions and other factors since they have a better grasp of math- greater knowledge tended to use mathematical language rather than real-world contexts. They also tended to ematics and pedagogical concepts. use questioning techniques such as question and answer, rhetorical, and true-false questioning more often. In terms of teaching strategy, they tended to use the investigative technique more14 . All other teaching practices 5.5 Conclusions were not statistically significant. In examining teaching practices in a sample of Indonesia’s 8th grade mathematics classrooms, important find- Figure 5.15 ings emerged that have implications for the teacher reform process and how the quality of teachers can be im- Teaching Practices of Teachers with Higher Knowledge (Teacher Assessment) proved over time. Key aspects of certification and the four-year degree requirement were explored in the context of what takes place in the classroom and how they relate to student learning outcomes. Qualifications Comparisons The video study had strikingly similar results with the findings of the certification study when examining teacher qualifications and their relation to student learning outcomes. The students of certified teachers did not have better student learning outcomes than students of uncertified teachers. This seems to indicate that teachers were not improved through the certification process itself. It also underscores the fact that the process did not separate higher from lower quality teachers; this is self-evident since virtually all teachers passed the certification process. There was also no difference in the subject matter and pedagogy assessment scores of certified and uncertified teachers. Certification could have conceivably improved teacher competency in subject and pedagogy through the additional training received by teachers in the certification training course (for those who did not directly pass the portfolio process). Certified teachers also generally tended to participate in a greater number of train- ing courses, possibly in order to strengthen their portfolios. But the fact that there is no statistically significant difference in the competency test scores of certified teachers is a further indication that the certification process itself has not boosted competency and has also not been separating out teachers in terms of quality. With the Note: bars that pass the 5% threshold are considered to be statistically significant. introduction of the teacher competency testing as part of the certification process, however, this could change – especially if the testing and certification process are carried out more rigorously than in the past. The differences in teaching practices may be interpreted as teachers with greater knowledge having a greater Education level, on the other hand, did have a positive relationship with student outcomes. The requirement confidence with mathematics. Teachers’ use of problems with mathematical language may indicate a fluency in that all teachers obtain a four-year degree may lead to a significant improvement in the quality of the teacher mathematics. The much greater use of questioning could possibly be related to teachers feeling more confident workforce over time. in dialogue with their students whereas teachers with less knowledge might shy away from questioning as it could lead to unexpected challenges. Finally, the teaching approaches of investigation (statistically significant) A very strong relationship exists between teacher knowledge – both subject matter and pedagogy -- and stu- and discussion (positive, but not quite statistically significant) may require a higher comfort level and fluency in dent learning outcomes. This result is particularly important. There are concerns about the quality of four-year mathematics depending on how they are used. 14 There is an issue with using this variable in that only three teachers actually used the investigative technique so any positive or negative relationship may be inaccurate due to it being used so infrequently and by so few teachers. 134 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 135 Looking inside the Classroom Black Box degrees offered by many universities across Indonesia. The fact that the competency tests had such a strong re- they appeared to be less effective than teacher-student involvement. Time on task was also clearly important, lationship with student outcomes underscores the importance of including it as part of the certification process. and students with teachers who spent more time on mathematics and who did more problem time than non- Requiring teachers to meet a minimum threshold of skills and knowledge would likely have a significant impact problem time tended to have better learning outcomes. on improving the teacher workforce over the long term both through pushing teachers to improve their skills and in rewarding teachers who demonstrate higher quality. The change in practices between 2007 and 2011 also provided interesting insights. In terms of approach, teach- ers tended to be using more exposition and less discussion and investigation in 2011. Teachers were also spend- Interesting differences also emerged for teacher degree type, comparing teachers with mathematics education ing more time on new material and less time on practice. Teachers’ time on task appears to have gone in the degrees to those with pure mathematics degrees. The pure mathematics degree teachers tended to have higher opposite direction from what would be hoped, with less time dedicated to mathematics time and less of that subject matter scores on the teacher competency assessment, but when it came to student outcomes, those mathematics time involving mathematical problems. Teachers also tended to be using more mathematical lan- with teachers having a mathematics education degree performed better than those with a pure mathematics guage and routine approaches. degree. This result should not be interpreted to mean that teachers should be required to hold an education- oriented degree but rather that those coming into the system with a non-education degree are likely to require While some teacher reform factors appear to be related to more teachers having a four-year degree, certification pedagogical training. This could be given in the extra year of training now required for all wanting to become a itself appears to not be driving change in the classroom. It actually appears that other factors beyond the teacher teacher. reforms are having greater influence on teaching practices. Of particular importance is that the increased em- phasis on the national examination appears to be leading teachers to use practices that better prepare students Teaching Practices Comparisons for the examination. This could be seen as positive or negative. With more “teaching to the test�, students may When looking at the certification study dimensions through the lens of teaching practices, some telling results be learning to answer questions rather than gaining true mathematical understanding. Still, techniques such as emerged. Of particular relevance was that the teaching practices of certified teachers did not differ from prac- focusing on mathematical language and formulas as opposed to real-world contexts did have a positive relation- tices used by uncertified teachers.15 This builds on the evidence that there is no difference in student learning ship with student test scores. outcomes of certified teachers and extends further to indicate that certification also appears to have no impact from the perspective of changing practices used in the classroom. It indicates that certification itself, even with The video study highlights the important relationship between what takes place in the classroom and student increased income, doesn’t appear to alter the way teachers teach. This can be seen in two ways: after certification learning outcomes. It also highlights the fact that teaching practices evolve over time and that there are multiple (1) teaching practices do not change and (2) the quality of the practices used (which could have arisen through system and cultural influences that contribute to this evolution. The teacher reform is contributing to this evolu- increased motivation and preparation) also does not change. tion, although not always as intended and not working in isolation from other influencing factors. On the other hand, striking differences emerged in the teaching practices for teachers with greater subject and pedagogical knowledge (compared to lower knowledge) and also teachers holding mathematical education degrees (compared to pure mathematics degrees). Both groups tended to more frequently use practices that were related with higher learning outcomes. Practices in Relation to Student Outcomes Some insights were gained on the extent to which specific practices were used, the trend in the use of these practices between 2007 and 2011, and how they related to student learning. In the area of teaching approaches, teachers often used exposition (lecturing) in the classroom, and this tended to have a negative relationship with student outcomes, while other techniques such as investigation, practical work, and problem-solving had a positive relationship. Student participation also emerged as an important dif- ferentiator. Teacher-centered activities tended to have a negative relationship whereas active participation of students in learning activities tended to be positive. But interestingly, when those activities were student-only, 15 One difference did emerge, where certified teachers tended to have more whole-class interaction and less seatwork and group work interaction. These practices do not have a statistically significant relationship with student outcomes. 136 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 137 The Impact of the Reforms on the Efficiency and Equity of Public Spending Chapter 6 In order to assess the effect of reforms on teacher pay and management, the next section provides an outline of the specific aspects of the reform process that were designed to tackle some of the perceived inadequacies The Impact of the Reforms in teacher pay and the significant inefficiencies in teacher hiring and deployment systems. This is followed by a section which explores the effect of these reforms, and the final section offers some conclusions. on the Efficiency and Equity 6.2 What reforms were introduced? of Public Spending Prior to the Teacher Law, the perceived low quality of the Indonesian education system was seen to be associ- ated with low teacher motivation because of low relative rates of pay. As previous chapters have discussed, a pro- 6.1 Introduction fessional allowance was introduced as the result of teachers being certified. The Teacher Law also attempted to tackle the inefficiencies in teacher deployment by making certification conditional on a 24-hour teaching week. Progress in education in Indonesia over the last 15 years has been driven by significant increases in public spend- In many schools, particularly at the junior secondary level, teachers taught for a relatively limited amount of the ing. Since 2001, government education spending has doubled in real terms, and in 2009 approximately 4% of working week. At the secondary level, teachers officially can only teach one subject; for many, teaching 24 hours GDP was devoted to the sector. These large increases in public spending have come about through the achieve- in the same school is difficult because of the limited number of classes and the number of hours devoted to each ment of a constitutional obligation to devote a fifth of the government budget to education. subject in the curriculum. For example, the current curriculum suggests approximately four hours of teaching on mathematics, English, Bahasa Indonesia, the natural sciences, and social sciences per week for each grade. For A significant proportion of the increased government investment in education has financed the teacher reforms a teacher certified to teach only one subject and teaching in a school with only one class in each grade -- often outlined in previous chapters. Most notably, the introduction in the 2005 Teacher Law of a professional allow- the case for small, often isolated schools -- it is only possible to teach a maximum of 12 hours. This has in some ance for certification and of incentives for working in remote areas has added significant commitments to gov- cases promoted improved efficiency in teacher deployment as those unable to achieve 24 hours of teaching in ernment spending. As a way of balancing the increases in the education budget from rising teacher compensa- their own school have fulfilled the criteria by teaching in more than one school. tion, the government introduced measures to improve the efficiency of teacher use. For example, the Teacher Law requires teachers to teach for a minimum of 24 period-hours per week, and school staffing standards were Remote area allowances were also introduced as part of the Teacher Law to address both the overall shortage revised to address the low national student-teacher ratios for basic education. of teachers and the poor educational background of existing teachers in these areas. These initial reforms have been supplemented with scholarships and upgrading programs for teachers already working in these areas. For The purpose of this chapter is to assess the effect of these reforms on the efficiency and equity of teacher sup- example, as described in Chapter 3, a program for graduate teachers to work in remote areas was introduced in ply and distribution. The key message that arises from this assessment is that improvements in teacher pay have 2011. The program promises scholarships for post-graduate professional training, a requirement for certification, placed a significant additional burden on the government budget while reforms designed to improve efficiency if recipients are willing to move back to remote areas to teach for at least a year. Currently about 5,000 teachers and equity have had limited impact. are participating in this program. Many of the issues addressed in this chapter are relevant for other countries in the region and beyond. Countries Central and district hiring of non-civil service (non-PNS) teachers was also frozen in 2005, and a process of con- such as Indonesia which have experienced relatively high and stable rates of growth have been able to – or verting existing non-PNS teachers to civil servants began (Ragatz, 2010). This was in part a response to low edu- have the potential to -- rapidly increase their investments in education. Insights from Indonesia’s experience cation quality and the generally lower levels of education non-PNS teachers had. At the same time, the School of utilizing these additional resources can provide valuable lessons for countries aiming to improve education Operational Assistance (BOS) program was introduced that provided all primary and junior secondary schools quality. Getting the right number of competent teachers equitably distributed across all schools regardless of with grants for operational spending. As much as 30 per cent of these grants were used to finance non-civil ser- their location is a challenge faced by all countries. In Indonesia, these challenges are particularly acute given its vice hiring (Ragatz, 2010). Recognizing that this was contributing to the overstaffing of schools, the government geographical and socio-economic diversity. Rapid rates of urbanization across the world are also shifting the introduced in 2011 a 20 per cent ceiling on teacher payments from BOS funds. demand for schools and teachers from rural and remote areas to towns and cities without neglecting the need to keep good teachers in less developed parts of the country where they are often needed the most. Managing At the same time, a number of other reforms also had an impact on the efficiency of the teaching force. Since this shift in a cost-effective way is becoming an increasingly pressing problem in many countries in Europe and 2007, staffing standards have been introduced to ensure that schools are adequately staffed but also as a way Asia. The analysis presented in this chapter highlights how these trends have affected school size and teacher of identifying schools with surplus teachers who could potentially be moved to schools without enough teach- demand in Indonesia. ers. The most recent set of regulations, issued as a joint decree by all central ministries with responsibility for teacher hiring and deployment in 2011, aimed to improve the distribution of teachers and tackle the incentives for overhiring. 138 139 The Impact of the Reforms on the Efficiency and Equity of Public Spending 6.3 The Impact of Reform While increases in teacher pay have raised the quality of student intakes in pre-service education institutions, there is a significant mismatch between the numbers graduating from colleges and teacher need. Chapter 4 Effects on teacher supply showed that in 2011 there were approximately 500,000 students currently training to be teachers. Given the lim- ited need for new teachers over the next few years (see below), it is unclear how this magnitude of newly quali- Ensuring that the teaching profession attracts some of the brightest school leavers into pre-service education is fied teachers will enter the current teaching profession. It is possible that they could replace existing teachers crucial for the quality of any education system. To do this, the teaching profession has to be attractive compared who do not have the required qualifications to teach under the new law. However, almost all of these in-service to other similar jobs in terms of remuneration, working conditions, and job satisfaction. In many of the best teachers (approximately 500,000) are currently upgrading their qualifications to ensure that they comply with performing countries, selection processes for teacher education ensure that only appropriate individuals are the new qualification requirements. As many of these teachers are non-PNS teachers, the political consequences selected for teacher education and that intakes match with teacher needs. For example, in Singapore only one of replacing non-PNS teachers with newly qualified graduates would be significant. in five applicants for teacher education programs is offered a place, but almost all of those graduating enter the teaching profession ((Ragatz, 2010). Effects on public spending In Indonesia, the increased salary of teachers brought about through certification has made teaching a very at- Reforms to improve teacher quality, outlined in earlier chapters, have had and will continue to place signifi- tractive profession. Wages for non-certified teachers with a four-year degree are similar to non-teachers with the cant pressure on the education budget. In particular, the teacher professional allowance paid to teachers who same qualifications (Figure 6.1). However, certified teachers earn substantially more than other individuals with become certified effectively doubles the basic pay of teacher’s salaries. With over 2 million teachers currently similar levels of education. In fact, certified teachers can earn approximately twice as much as individuals with teaching in primary and junior secondary schools across Indonesia, the resources necessary to implement the similar qualifications. While these wage increases have not led to significant improvements in teacher behavior certification program fully are enormous. and student learning outcomes, there is some evidence to suggest that high wages have begun to attract some- what better candidates into teacher education programs (see Chapter 3). The reforms have been largely financed by increases in government investment in education and the fulfilment in 2009 of the constitutional obligation to devote 20% of the public budget to education. Between 2001 and Figure 6.1 2009 government spending on education increased by 120 per cent in real terms (Figure 6.2). Increases in the Average lifetime monthly salary for teachers and non-teachers with a four-year degree, 2010 education budget have been most rapid since the introduction of the certification program. Between 2006 and 2010 the overall education budget increased in real terms by 47% or Rp. 66 trillion (US$ 6 billion). Figure 6.2 Public expenditure on education, 2001-2010 Note: Wages for teachers without certification and non-teachers include all categories of workers (e.g. public and private sector workers and civil service/non-civil service workers) and are calculated using the labor force survey (Sakernas). Monthly wages are calculated as an unweighted average of four age groups (20-29, 30-39, 40-49 and 50-59). The wages for a certified civil service teacher are based on Ministry of Education and Culture salary scales and the size of the professional allowance. It is assumed a teacher is certified in the 30-39 age group. Source: Sakernas 2010 and Ministry of Education and Culture teacher salary scales Source: World Bank, 2012 140 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 141 The Impact of the Reforms on the Efficiency and Equity of Public Spending A significant proportion of the increased public investment in education has been devoted to hiring more teach- Certifying the remaining 1.7 million teachers (70% of the total) by 2015 will have enormous budgetary impli- ers and increasing their pay through the certification program. Between 2006 and 2010 an additional 450,000 cations.2 With the current pay scale and information on all teachers currently teaching in primary and junior teachers were recruited and by 2010 approximately 30% of all teachers had been certified.1 Approximately 60% secondary, it is possible to estimate the total cost of certification. 3 Using this approach, it is estimated that the of the increased resources going to education between 2006-08 and 2009 were absorbed by teacher salaries provision of the existing professional allowance associated with only the certification of all primary and junior and allowances (Cerdan-Infantes & Makarova, 2013). In 2011, the professional allowance associated with certifi- secondary school teachers would cost approximately Rp. 68 trillion (US$ 7 billion in constant 2012 prices) 4. cation cost IDR 23 trillion or 9% of the overall education budget. Combining this with estimates of salaries and allowances suggests that the total salary bill for these teachers Up until recently, the large proportion of non-PNS teachers has constrained the budgetary impact of the reform. would rise in real terms to Rp. 139 trillion (US$ 16 billion), a 43 per cent increase over the estimated 2012 salary Teacher salaries combined with the number of students a typical teacher teaches are key drivers of the costs of bill. education provision. Indonesia’s low student-teacher ratios and higher salaries resulting from teacher certifica- tion imply that a large proportion of the education budget is devoted to paying teachers. However, 30% of the In 2005, when the Teacher Law was introduced, the budgetary impact was even larger. At that time the con- primary and secondary school teaching force is made up of non-PNS teachers who earn significantly less than stitutional obligation to spend 20% of the budget on education had not been met, and the education budget their civil service counterparts. This limits the overall salary bill and is a key factor in explaining Indonesia’s rela- had only grown by 37% in real terms between 2000 and 2005. Questions about the affordability of the program tively low share of teacher salaries in overall government education spending compared with other countries were raised at the time of its introduction. However, the strength of the demands of the teacher associations, (Figure 6.3). supported by many parliamentarians, to raise teacher income appears to have trumped issues of the future af- fordability of the program. Figure 6.3 Share of total pre-tertiary education budget spent on salaries in selected countries, 2009 There are substantial trade-offs associated with the increases in salary spending that result from certifying all teachers. Government medium-term budget projections show that overall government spending is estimated to grow by approximately 3% in real terms between 2012 and 2015 (World Bank IEQ – 2012). This also suggests that the education budget will increase only marginally over the next few years if it is assumed that the share of government spending going to education remains constant at 20%. Certifying all eligible primary and ju- nior secondary school teachers by 2015 will absorb approximately 41% of the total education budget in 2015 compared to 32% in 2012. If non-salary spending in basic education is maintained at its 2012 level, this would imply that basic education would absorb 64% of the budget in 2015 compared to approximately 56% in 2012. This increased spending would require cut-backs in other levels of education. The remaining budget for other education levels, after all civil service teachers were certified, would be Rp. 113 trillion (US$ 11.8 billion) in 2015 compared to Rp. 135 trillion (US$ 14.1 billion) in 2012. 2 Currently school-hired temporary teachers (Guru Tidak Tetap - GTT) are not eligible for the certification program. In 2010 there were approximately 900,000 teachers of this type teaching between kindergarten and senior secondary. These teachers are included in the 1.7 million teachers reported as being non-certified. 3 These estimates assume that the professional allowance associated with certification is equivalent to the basic pay of a civil service 1 This data is from NUPTK (2010) and includes teachers from kindergarten to senior secondary. It excludes teachers in the madrassah teacher and Rp. 1.5 million per month for a non-civil service permanent private school teacher (Guru Tetap Yayasan - GTY). system. 4 These estimates exclude the certification of madrassah teachers. 142 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 143 The Impact of the Reforms on the Efficiency and Equity of Public Spending Figure 6.4 tive estimates suggest that the additional public costs of expanding senior secondary access in this way would The budgetary impact of the certification program be IDR. 15 trillion (US$ 1.5 billion), equivalent to 26% of the overall cost of the basic education certification pro- gram (World Bank 2012). It is unclear where these resources will come from given the costs of the certification program and the limited prospects for education receiving more than 20% of the government budget in the near future. More broadly, the costs of the certification program will slow the shift of spending from basic to post-basic edu- cation seen in other rapidly developing middle-income countries. The budget projections show that the share of the budget going to basic education will increase as more teachers become certified. Indonesia already spends a relatively high share of its public education spending on basic education and significantly more than other countries in the region (see Figure 6.5). In a similar way to these countries, Indonesia will need to start investing more heavily in both pre-school and post-basic education if it is to provide the skilled labor force necessary to improve productivity and continue its impressive record of economic growth. Figure 6.5 Share of education spending by level, selected EAP countries, 2009 Source: Budget data and projections from World Bank (Cerdan-Infantes & Makarova, 2013) and World Bank (2012 – IEQ). Informa- tion on salary spending – Calculations based on teacher numbers and salary grade from NUPTK (2010) and the 2012 civil service salary scale. Projections of certification costs based on author’s calculations of basic pay for all current PNS teachers and a monthly Rp. 1.5 million allowance for GTY teachers. GTY (Guru Tetap Yayasan) teachers are non-PNS teachers currently eligible to receive a certification allowance. Conversion of non-PNS teachers – Calculations based on the assumption that non-PNS teachers would be distributed across the pay scale in a similar way to PNS teachers. Conversion cost also includes the increase in the professional allow- ance from Rp. 1.5 million per month to an amount equivalent to the basic pay of newly converted GTY non-PNS teachers. Notes: Projections for 2015 assume that the number of teachers is the same as in 2012. The rising cost of the certification program will continue to limit investments in other areas crucial for improv- Government plans to convert all non-PNS teachers to civil servants are financially unsustainable given current ing education quality. So far the certification program has not had a significant impact on teacher quality and budget projections. 5 Approximately Rp. 68 trillion (US$5 billion) would be needed to certify and convert all student learning outcomes. Improving other factors associated with teacher quality has the potential to deliver existing non-PNS teachers to civil servants.6 Taking the certification and conversion of non-PNS teachers to civil bigger impacts on student learning outcomes. For example, weaknesses in pre-service and in-service teacher servants of all primary and junior secondary school teachers together would imply that 89% of the total educa- education, ongoing professional development, and incentive systems have all been highlighted as factors asso- tion budget in 2015 would need to be devoted to basic education (see Figure 6.4). Given the commitments ciated with low teacher quality. Improvements in these areas would likely have significant pay-offs, but the costs outside of basic education, this level of spending is completely unsustainable. of the on-going certification program will limit the resources available to make these additional investments. The future costs of certification will also threaten other government objectives in the education sector. For ex- 5 Current certification guidelines exclude school-hired contract teachers which make up approximately 30% of the teaching force at the ample, the government plans to expand early childhood education programs, including kindergartens, and primary and secondary level. 6 This includes the increased cost of the professional allowance associated with certification that contract teachers would receive upon mandate that compulsory education should include the three years of senior secondary education. Conserva- conversion. 144 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 145 The Impact of the Reforms on the Efficiency and Equity of Public Spending Improving the use of teachers and raising student-teacher ratios hold out the prospect of lessening the bud- Effects on the efficiency of teacher use getary impact of certification. Simple simulations demonstrate the significant savings that could be realised by Changes to the staffing standards introduced in the aftermath of the Teacher Law have not addressed the over- raising student-teacher ratios. Figure 6.6 shows the overall salary and certification costs for teachers eligible for staffing issue. Teacher numbers have continued to rise at a faster rate than the student population at the primary certification at different student-teacher ratios. The first bar shows the costs of salaries and professional allow- level, and student-teacher ratios have declined from 19:1 when reforms were introduced in 2005 to around 17:1 ances if all these teachers were certified at current student-teacher ratios. The subsequent bars show the effect in 2010 (Cerdan-Infantes & Makarova, 2013). At the junior secondary level, student-teacher ratios have risen since of modest increases in the student-teacher ratio of certifying all teachers. If the student-teacher ratio increased to the introduction of the teacher reforms which may be largely due to the faster enrolment expansion in this sub- 22, a level Indonesia was at in the early 2000s, the salary and certification costs would be IDR 102 trillion (US$ 10.6 sector. billion) or 21% less than the costs estimated at current student-teacher ratios. Comparing this with the budget projections outlined earlier in the chapter shows that this increase in the student-teacher ratio would result in Overall, Indonesia continues to have some of the lowest student-teacher ratios in the World (Figure 6.7Error! basic education absorbing a slightly smaller share of overall education resources in 2015. This would leave more Reference source not found.). While some other countries have seen student-teacher ratios decline significantly resources available for other access and quality investments. Clearly, raising student-teacher ratios to these levels over the last five years, these are from much higher levels and are much more likely to be associated with im- requires reducing the overall teaching force in basic education and adjusting staffing standards to improve the provements in quality. For example, between 2007 and 2010 the junior secondary student-teacher ratio in Cam- efficiency of teacher use. bodia declined from 31 to 24. Figure 6.6 Figure 6.7 Salary and certification costs for civil service teachers under different student-teacher ratios Student teacher-ratios in basic education, 2010 Notes: The estimates compare the salary and certification costs under different student-teacher ratios. It is assumed that the stu- dent population remains the same. 146 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 147 The Impact of the Reforms on the Efficiency and Equity of Public Spending The 24-hour rule for teachers has not had a significant impact on the size of the teaching force so far. A recent study showed that approximately one-half of all primary and junior secondary school teachers’ workloads fell be- low the 24-hour minimum for certification (Ragatz, 2010). A much larger proportion of junior secondary school teachers (71 per cent) fell below the threshold than primary school teachers (30 per cent) (Ragatz, 2010). As more teachers seek certification, a greater proportion of teachers will need to teach a minimum of 24 period-hours a week. It is possible that this will reduce the overall need for teachers and address some of the over-staffing issues. While this will rely on strong enforcement of the 24-hour rule, it also has the potential to affect learning quality. Evidence suggests that teachers are complying with the law by teaching in more than one school. The increased travel time and burden on teachers of teaching in different schools may have negative effects on learning. The impact evaluation study, however, does not reveal any systematic effects of certification on teaching hours (see Figure 4.12). Staffing standards for small schools are a key contributor to the low student-teacher ratios in primary and junior secondary schools. Indonesia is not alone in facing the challenge of providing an adequate learning environ- ment in schools serving relatively few children. In much of Eastern Europe where population levels are declining and in countries such as China where massive urban migration has shrunk enrolment in rural schools, tradi- tional class-based teacher allocations have increased the costs of education provision. Approximately a third of Indonesia’s primary schools have fewer than 120 students (Error! Reference source not found.). These schools commonly have one learning group for each grade, and under current staffing norms this would require a total of eight teachers: six class-based teachers and a sports and religion teacher (and, in some cases, a principal as Source: Edstats well). Staffing levels of this kind result in low student-teacher ratios. Schools with fewer than 120 students have Note: Data for Malaysia, Philippines and Singapore are for 2009. Student-teacher ratios for Indonesia may be different to rates re- a maximum student-teacher ratio of 15, and for schools with fewer than 90 students, the ratio falls to 11. Similar ported from national sources because of adjustments made for international comparability. issues exist in junior secondary schools because all schools are required to have a subject teacher for each of the eleven curriculum subjects. Staffing small schools at these levels clearly has a downward impact on national Estimates of the size of the teaching force needed to fulfil the new staffing standards show that there are too student-teacher ratios and the overall efficiency of the education system. many teachers (both civil service teachers and non-PNS) currently in the system. Comparing existing staffing levels with the student-teacher ratios standards laid out in the latest joint decree on teacher management shows Table 6.1 that there is a surplus of approximately 100,000 primary school teachers, equivalent to 7% of the current teach- Primary and Junior Secondary School Size, 2010 ing force. At junior secondary level there are approximately 30,000 surplus teachers, equivalent to 6% of the teaching force.7 But while there are too many teachers in the system, their unequal distribution means that many schools still have fewer teachers than they need. While there are more teachers in the national teaching force than required under existing staffing norms, imple- menting these standards fully would not lead to significant improvements in teacher efficiency. Despite some gains in efficiency at the junior secondary level, existing staffing standards limit the extent to which student- teacher ratios can rise further. For example, based on levels of enrolment in 2010, fulfilment of the joint decree staffing standards would increase the student-teacher ratio at primary and junior secondary by only one student. These changes are unlikely to improve the efficiency of overall teacher use significantly. 7 These figures are used to demonstrate the magnitude of the oversupply. They are based on 2010 data for all teachers (both civil and non-civil service) and do not take account of subject mismatches. For example, at primary schools there are approximately 165,000 surplus class-based teachers, but there are shortages of sports teachers that reduce the overall surplus. See Cerdan-Infantes (2013) for more details. Source: Ministry of Education and Culture school data, 2010 148 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 149 The Impact of the Reforms on the Efficiency and Equity of Public Spending The large number of small schools is commonly explained by the low population density of many areas in Indo- ever, these pilot programs have not been successfully expanded and have not begun to address the significant nesia. Where areas are sparsely populated, the size of schools can be limited because the number of potential inefficiencies associated with the staffing of small schools. students in any school’s catchment area can be small. One way of looking at this is to compare the proportion of small schools in a province with its population density (Figure 6.7). This shows that schools tend to be smaller in At the junior secondary level, dual subject-based teaching also has the potential to improve the efficiency of provinces with sparser populations, but the relationship is weak. 8 For example, 64% of all primary schools have staffing in small schools. Current staffing norms require junior secondary schools to have one teacher for each fewer than 120 students in East Kalimantan where population density is very low (64 people per square kilo- subject, and teachers can only be accredited in a single subject. In small schools where class sizes are small, these meter). However, in South Sumatra the proportion of small schools is much lower despite only having a slightly standards result in low student-teacher ratios. They also make it difficult for teachers to fulfil their commitment higher population density than East Kalimantan (86 people per square kilometer). to teach 24 period-hours each week. Informally, dual subject teaching takes place, but reforms to pre-service education courses certification criteria to make teaching in more than one subject acceptable have not yet been Figure 6.8 planned or implemented. Population density, the proportion of small schools, and the number of teachers in each province, 2010 Effects on the composition of the teaching force While recent reforms have failed to tackle significantly the overstaffing of schools, they have affected the com- position of the primary school teaching force. Between 2006 and 2010, a large number of teachers hired at the district level were converted to civil servants. Coupled with temporary freezes on recruitment, the number of civil service teachers has remained relatively unchanged since 2006. However, the increased hiring of teachers at the school level has meant that total teacher numbers have continued to rise (Figure 6.9). For example, between 2006 and 2010 the number of school-hired temporary primary school teachers (GTT) increased from 175,000 to 475,000; they now represent nearly 30 per cent of all primary school teachers. The BOS program, introduced in 2005, has contributed to these increases. In 2011, schools used approximately a fifth of the school grants re- ceived under the program to hire teachers. Figure 6.9 Composition of the teaching force after reforms, 2006-2010 Note: The size of the bubbles represents the number of primary school teachers Source: Ministry of Education and Culture school and teacher data (2010), population density data from Ministry of Home Affairs However, some of the most densely populated provinces have large numbers of small schools and relatively low student-teacher ratios (see Figure 6.8). For example, 39% of the primary schools in East Java have fewer than 120 students despite being densely populated (i.e., a population density of 828 people per square kilometer). Given that 14% of teachers and 21% of all primary school students are located in East Java, raising teacher efficiency through increasing the size of schools in this province could have significant national payoffs. Additional efforts to address staffing issues in small schools have not been implemented on a national scale. Source: NUPTK (2006, 2008 and 2010). For example, multigrade teaching has been used successfully in other countries to tackle staffing issues in small schools (Little, 2006). In Indonesia, multigrade teaching is already practiced in a very small number of primary Teacher hiring at the school level is not governed by existing regulations outlining the required qualifications schools, and training for teachers in this approach is available from a number of sources (WorldBank, 2010). How- and experience that civil service teachers require. This circumvents any attempt by central and local govern- ments to achieve a more efficient teaching force. While there is little evidence of the criteria used for school hir- ing, it is possible that other factors apart from teaching competency are used which result in weaker candidates 8 A similar weak relationship holds when density and the proportion of small schools are analysed at the district level 150 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 151 The Impact of the Reforms on the Efficiency and Equity of Public Spending being employed. On the whole, non-PNS teachers are less qualified and experienced than civil service teachers. civil service and non-PNS teachers. On the one hand, a national survey on teacher absenteeism found that non- For example, in 2010 24% of primary school non-PNS teachers had qualifications at the four-year degree level or PNS teachers were more likely to be absent compared with their civil service counterparts (Usman, Akhmadi, & above compared with 29% of civil service teachers. (NUPTK 2010). Suryadarma, 2004). On the other hand, more recent work in the poorer and more remote Papua province shows that non-PNS teachers are less likely to be absent than civil service teachers (UNCEN, UNIPA, SMERU, BPS, & UNI- The large number of non-civil service teachers in Indonesian schools is also common in other countries such CEF, 2012). as Cambodia, China, India, Nepal, Nicaragua, Pakistan and Sri Lanka (Duthilleul (2005), Fyfe (2007)). Contract or temporary teachers have been employed in these countries for a range of reasons. In some countries, they are The Teacher Law and the requirement for all teachers to have a four-year degree are having a significant impact seen to provide a cheap/cost-effective way of extending access to education. For example, in West Africa much on non-PNS teachers. Approximately three-quarters of all primary school non-PNS teachers, or 400,000 teachers, of the recent expansion in primary school access has been facilitated by the hiring of contract teachers (UNESCO, will need to upgrade their qualifications to a four-year degree to continue to teach and become eligible for cer- 2009). In other countries they have been an effective way of tackling teacher deployment issues by recruiting tification. Upgrading is occurring on a massive scale with approximately 500,000 in-service teachers enrolling in from the local population in hard-to-reach areas. In India, many states have recruited contract teachers from distant learning courses. However, non-PNS teachers are not eligible for the same professional allowances, and marginalized communities, thus increasing the teaching force in areas where civil service teachers are generally this will add to growing pressure from teacher associations for these teachers to become civil servants. unwilling to work (Govinda & Josephine, 2004). Contract teachers have also been seen as a way of addressing weaknesses in the mechanisms used to hold civil service teachers accountable. In particular, short-term con- Despite the slowdown in civil service hiring, significant incentives for overhiring civil service teachers remain. tracts controlled by lower levels of government, the school, or school committees are seen to provide stronger With the introduction of decentralization in 2001, the teacher recruitment process for local governments in- incentives and better monitoring of teacher performance. cluded significant incentives for overhiring civil service teachers. Intergovernmental resource transfers are partly determined by the size of a local government’s pay roll. Districts with larger numbers of civil servants receive International evidence on the impact contract teachers have on teacher performance is mixed. While the evi- more from the transfer system. It has been estimated that central government transfers cover approximately dence base remains small and concentrated in only a few countries, a review of recent evaluations using ran- 75% of the salary of an additional civil service teacher. This in effect subsidizes the cost of additional teachers domized controlled trials and matching methodologies showed that in some countries contract teachers were faced by local governments and creates incentives for increased hiring. less often absent than civil service teachers and their students learned more (Bruns et al., 2011). In other coun- tries, contract teachers were more likely to be absent and their effect on learning was not uniform. While com- The process of establishing new civil service teaching posts also contributes to incentives for overhiring. Deci- parisons between civil service and contract teachers are illuminating, these two types of teachers are not usually sions on the establishment of new posts in each district are made at the central level by the Ministry of Admin- alternatives for each other. Many teachers accept the lower wages and poorer working conditions of contract istrative and Bureaucratic Reform (MenPAN) and the Ministry of Finance based on requests from local govern- teaching because it is the first step to securing a civil service job. It is unlikely in these cases that introducing ments. Quotas are set annually by considering local government requests for additional staff and the current contract teaching on a wider scale would be sustainable over the longer term. A study in India showed that dif- budget situation. The actual process within MenPAN of determining quotas remains unclear (J Kluyskens & M ferences in learning outcomes between contract and civil service teachers narrowed as the number of contracts Firdaus, 2009). However, the process usually results in provincial and district governments receiving every year received by the contract teacher increased (Goyal & Pandey, 2009). fewer posts than they requested. This creates incentives for local governments to exaggerate their actual needs knowing that they will only receive a fraction of their initial request. In Indonesia, the recruitment of non-civil service teachers has been a contributory factor to the poor distribu- tion and overstaffing of the basic education system. The large number of school-hired and temporary non-PNS The political economy of local governance also creates incentives for local governments to seek to raise the teachers is only partly driven by filling vacant civil service posts. Schools with shortages of civil service teachers number of civil service teachers. A recent symposium held at the Ministry of Education and Culture concluded tend to hire more non-PNS teachers, but many small schools with adequate civil service teachers also hire non- that the appointment of teachers is “characterized by corruption, lack of transparency, primordial regionalism, PNS teachers from their own funds. For example, in 2010 over 80% of primary schools with adequate or surplus and co-opted by the political interests of the ruling authorities� and that “many teachers are not appointed in numbers of civil service teachers employed non-PNS teachers. Approximately 30% of all non-PNS teachers were accordance with the requirements of the minimum standards of teacher competencies.�9 A number of studies teaching in these schools. Non-PNS teachers are also not heavily concentrated among the more remote and have shown that it is common for payments to be made to obtain access to civil service jobs. A study conducted poorer areas of Indonesia. For example, approximately 6% of all non-PNS teachers teach in remote areas of Indo- in 2004 interviewed 60 civil-servants in two districts in Nusa Tenggara Barat and found that payment for jobs was nesia compared with 4% of civil service teachers. commonplace (Kristiansen and Ramli 2006). Civil-servants reported paying Rp. 24 million on average in 2004 (Rp. 41 million in 2012 prices) to obtain their position - equivalent to about one year’s basic pay for a primary and In a similar way to the international literature, evidence on the impact of non-PNS teachers in Indonesia is mixed. A recent cross-sectional study suggested that the share of non-PNS teachers is positively related to learning outcomes (Chen, 2011). However, there does not seem to be a clear difference in absenteeism levels between 9 Report of a workshop on workshop/symposium by Balitbang Ministry of Education and Culture, July 2012, on “Recruitment of Teachers in the Future� 152 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 153 The Impact of the Reforms on the Efficiency and Equity of Public Spending junior secondary teacher.10 The study also found that payment for posts had increased since decentralization The distribution of teachers across schools in Indonesia is unequal and has not improved significantly as a result reforms were implemented. While payment for civil service positions appears to be common, it is not uniform of reform efforts over the last 10 years. In 2005, a survey using the existing entitlement formula showed that 55 across districts. A 2005/06 study found that in seven of the eight districts surveyed, non-government respon- per cent of primary schools in Indonesia were overstaffed and 34 per cent understaffed. Analysis using data from dents reported the necessity to pay for civil service positions although the amount of the payment varied signifi- 2010 and the latest staffing standards show that 30 per cent of primary schools remain understaffed, and 59 per cantly. In the remaining district, Solok in West Sumatra, no payments were thought to be needed to gain access cent remain overstaffed. to the civil service (von Luebke 2009). The scale of redistribution necessary to allocate teachers more equally is large. If local governments redistrib- For the individual, paying for a post provides access to a stable income and a number of non-monetary benefits uted existing teachers to fulfil the latest standards, approximately 343,000 primary and junior secondary school that are often unavailable outside of the civil service. On the other side of the transaction, payments for civil teachers or 17% of the total workforce would need to be transferred. Most of this redistribution would involve service positions do not just benefit those allocating the posts. They are frequently part of revenue generating moving teachers within the same districts. However, approximately 66,000 teachers would need to be moved schemes that support political activity at the local and national levels. Positions are also sometimes allocated as from districts with surplus teachers to deficit districts in the same province (Figure 6.10). After transfers within rewards for political support or part of the pay-off for broader local political settlements. This has become more and across districts, approximately 37,000 teachers could transfer from districts in one province to fill deficits in commonplace with the election of district regents who then appoint the heads of government offices such other provinces to further improve teacher redistribution. as education – who then have considerable influence in personnel issues in the district. The upshot of these recruitment practices is that a larger civil service often serves a number of personal and political objectives at Figure 6.10 the local level. Scale of redistribution necessary to comply with current staffing standards in primary and junior secondary schools, 2010 Recruitment practices can also have consequences for the quality of the national teaching force. Once in the civil service, teachers have the opportunity to recoup payments made to obtain their job through, for example, charging informal fees at school or obtaining side payments from school suppliers (Rosser, Joshi, Edwin 2011). These practices can have negative impacts for education because they divert resources intended for improving access and quality. In addition, where payments are required for positions, it is rare for only the best qualified candidates to gain employment. This can have the effect of reducing the overall quality of the national teaching force. If existing recruitment processes are left unchanged, some of the longer-term positive effects of the certifica- tion program will be reduced. As previous chapters have shown, increased teacher pay is attracting more and perhaps better students into teacher education. However, current recruitment practices imply that merit is only one factor in determining who gets a teaching position, and it is therefore unclear whether the more able new graduates will enter the profession. Furthermore, the significant increase in the supply of new teachers and the limited projected need for additional teachers are likely to raise the cost of obtaining a civil service teaching post and may deter more able students from entering the profession. Note: The estimates show the number of teachers currently in schools with excess teachers (according to the joint decree) that could Effects on teacher distribution be transferred to take up teaching in schools with deficits in their staffing levels. Class-based, sports, and local content teachers are included in the estimates. The estimates include both civil service and non-civil service teachers. Madrasahs are not included in these Many countries face enormous challenges in allocating teachers across schools in a fair and transparent way estimates. (Mulkeen (2009); UNESCO (2009). Frequently, weaknesses in teacher distribution lead to very different learning Source: Ministry of Education and Culture school data (2010) and NUPTK (2010) environments for children in different areas. For example, in many countries children in remote areas and from poor households often face a double disadvantage in their school careers. School infrastructure tends to be in Existing mechanisms that govern cross-border redeployment are not sufficient to deal with the scale of transfer a poorer state, and the teaching force is less qualified and experienced compared to schools in more affluent needed to improve the distribution of teachers. Transfers across districts and provinces tend to be done on an ad areas. hoc basis and rely on individual teachers identifying openings in one district or school and each district initially agreeing to a transfer. When transfers are agreed, the budget for the salaries of transferring teachers is moved to the receiving district or province. It seems unlikely that districts and provinces would be willing to lose a The study found that teachers as a sub-group of the civil service paid a similar amount for their posts as the average. Based on data from 10 NUPTK (2010) and the 2012 civil service salary scale. 154 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 155 The Impact of the Reforms on the Efficiency and Equity of Public Spending teacher and the associated resources to effect a transfer (J. Kluyskens & M. Firdaus, 2009). These relatively informal Figure 6.11 mechanisms for redistribution are therefore unlikely to be sufficient to realize the large redistribution required to Percentage of teachers with a four-year degree by location, 2010 achieve a more equitable distribution of teachers nationally. The Teacher Law also introduced a remote area allowance to encourage teachers to teach in remote areas and improve their motivation. In 2012, approximately 53,000 teachers were in receipt of the allowance. However, many of the teachers who are currently receiving the allowance were already working in remote areas, and so the extent to which it has attracted new teachers to these areas is unclear. In some areas, enlightened local gov- ernments have used these allowances to enforce redistribution without which this remote allowance may not have a major effect on the distribution of teachers. Despite the limited coverage of incentives of this kind, they have the potential to improve teacher distribution. A 2008 study in four districts showed that in one, absenteeism rates for teachers receiving the allowance were lower but in the remaining districts differences were either small or higher for teachers receiving the allowance (SMERU, 2010). In a more recent study conducted in Papua in 2011, absenteeism rates for teachers receiving incentives for teaching in remote areas were lower compared with other teachers (UNCEN et al., 2012). However, the study also noted that the coverage and targeting of the remote area allowance were weak and that this re- sulted in many teachers not receiving the support they needed to teach in remote areas. These results suggest that incentives introduced as part of the Teacher Law need to be strengthened to maximize their impact on the distribution of teachers. Recruiting teachers from local communities may also be an effective strategy for improving teacher distribution. Teachers who move to remote and hard-to-reach areas can face significant challenges in finding accommoda- tion, enrolling their children in school and generally assimilating to local life. These challenges can be reduced Note: includes all teachers from TK to SMU. The box plot graph shows the distribution of districts within each province in terms of if teachers are recruited from the local community. However, the poor state of education in remote areas fre- the percentage of teachers with at least an S1 degree. The box represents the difference between the districts at the 25th and 75th percentile of the distribution (i.e. the interquartile range) and the line within the box represents the value for the median district. The quently means that the number of individuals with the requisite qualifications is limited. Some local govern- lines (whiskers) above (below) the box shows the most extreme value above (below) the 75th (25th) percentile that is within 1.5 times ments havebegun to address these constraints by providing scholarships to local youth to train as teachers on the interquartile range. the condition that they return and teach in their own community. A similar program, introduced by the central Source: NUPTK 2010 government is also supporting the professional development of teachers in remote areas. These initiatives pro- vide an alternative strategy to providing incentives for teachers to move to remote areas. Box 6.1 Differences in the education qualifications of teachers between provinces and districts still remain significant District initiatives to improve teacher distribution despite the reforms that have taken place. A teacher’s educational background provides only a partial proxy for teaching competency, but data from 2010 show that there are still large disparities across provinces and districts A successful program was introduced in Gorontalo district in 2006. The local government introduced (Figure 6.11). Just over 20 per cent of teachers in Kalimantan Barat Province have a four-year degree compared to a policy to only employ teachers who agreed to be posted to schools that required that particular 60 per cent in Jakarta. While it may be difficult to move existing teachers, it is possible that the distribution can be teacher’s skill set. Teachers also agreed through an eight-year contract with the local government to improved over time by allocating newly qualified teachers to areas and schools with the greatest need (Box 6.1). be redeployed with the changing staffing needs of schools within the district (Kluyskens, Rawlinson, & Ragatz, 2007). This allowed new teachers to be deployed to schools with greatest need as well as giving the local education office the flexibility to move teachers according to changing needs. 156 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 157 The Impact of the Reforms on the Efficiency and Equity of Public Spending 6.4 Conclusions It is important to recognize that improvements to the current distribution of teachers will take time to imple- ment. However, there are a number of trends that present opportunities to improve teacher management over Large-scale teacher reforms have been introduced over the last decade to improve the quality of teaching in the mid-term. Government plans for further expansion of both kindergartens and secondary education will Indonesia. A key component of these reforms has been an increase in pay for certified teachers. While previous require more teachers, and this provides an opportunity to redeploy existing teachers to teach in these new chapters have shown that the short-run impact of certification on teacher behavior and student learning has schools. Reductions in the teaching force resulting from retirement also present opportunities to improve effi- been limited, the current chapter shows that its impact on the education budget has and will continue to be ciency. In the next five years, approximately 10% (150,000 primary and 30,000 junior secondary school teachers) enormous. Failure to address the rapidly rising costs of certification will result in the crowding out of spending in of the teaching force will reach retirement age. This represents a large opportunity for adjusting the size of the other areas necessary to improve education quality and further expand access. Key to tackling the growing wage teaching force without having to resort to the reassignment of teachers across levels. bill is therefore efforts to improve teacher management. Education is central to Indonesia’s ambitious plans to accelerate economic growth and reduce poverty. If these Reforms to manage the overstaffing and low student-teacher ratios that characterize the Indonesian education plans are to be achieved, the education system needs to provide broader access to education opportunities system have been less successful. The chapter has shown that student-teacher ratios, a good indicator of the and improve the quality of existing provision. The government has signalled its commitment to achieving these efficiency of teacher use, are very low in Indonesia compared to other countries. Efforts to improve staffing stan- goals by earmarking 20% of the national budget to education. However, significant inefficiencies exist which, dards and the introduction of the 24-hour rule have not, up until now, led to significant improvements in these left unchecked, will severely constrain future improvements in education quality and access. Teacher oversupply ratios. At the primary level, student-teacher ratios have continued to decline over the decade. and the very low student-teacher ratios that result are a key determinant of existing inefficiency. Tackling these inefficiencies through improved teacher management is vital if national goals for education and accelerated The failure to improve teacher management is only partly to do with how staffing standards have been imple- economic growth are to be realized. mented. While many schools are not staffed according to current standards, the chapter shows that even if these standards were implemented fully, student-teacher ratios would not increase significantly. A number of struc- tural issues limit the ability of staffing standards to improve efficiency. In particular, standards are yet to tackle staffing issues in the large number of small schools in Indonesia. Potential solutions to staffing small schools such as multi-grade and dual/cluster-based teaching have not been introduced on a national scale. These structural issues are only likely to intensify as Indonesia continues to urbanize. The distribution of teachers has also not improved significantly over the last 10 years. Despite increases in the overall number of teachers, many schools still have fewer teachers than they need while others have too many. Clearly, some local governments and schools choose to employ more teachers than the minimum set out in staffing standards. However, this raises serious issues about equity when some urban schools are better staffed than more remote schools in the same district. The finding that better and more qualified teachers tend to teach in urban areas reinforces these inequalities. The political economy of teacher hiring and distribution is also important in explaining the current situation. The current overstaffing of schools and the low student-teacher ratios are not driven by the lack of a detailed diag- nosis of the problem; the issues covered in this chapter have been well documented in studies commissioned prior to the reforms. It is likely that some of the increased teacher hiring in recent years has been the result of the 20 per cent commitment. Local governments and schools, with few alternatives, have hired teachers as a way of fulfilling these spending commitments. At the local level, teacher hiring and transfer decisions are also highly political, and there are many benefits to hiring teachers as well as agreeing to teacher demands to stay in urban and better-connected areas. Addressing these issues will be vital if the efficiency of teacher management is to be improved. 158 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 159 Conclusions and Recommendations Chapter 7 This book has documented the interplay in the reform process between the political context and evidence- based policymaking and has drawn useful lessons for other emerging nations. The key lesson is that teacher Conclusions and Recommendations reform is a very long-term and iterative process where compromises appropriate to the political and economic context of the time will likely have to be made. However, over time, with the support of empirical evidence and renewed commitment from the Ministry, adjustments to reform efforts can be made, as in Indonesia, which may “Teachers in Indonesia do not cast themselves in the role of change agent; they do not even audition for go a long way toward a much more faithful implementation of the reform’s original intentions the part�. 1 So what has worked and what has not – and why? Organized around the conceptual framework for teacher The Indonesian Teacher Law of 2005 was a landmark in many ways. In one sweep of legislation, it confirmed reform as shown in Chapter 1, the lessons resonate with international literature: teaching as a “profession� equivalent to other professions, dramatically increasing the income of teachers to be commensurate or exceed those of lawyers or doctors. It attempted to reverse a decades-long decline in the sta- tus of teaching and put in place a massive scheme of academic qualification and formal certification which has had an impact on every aspect of the education system, at all levels of government; it mandated a wide range of other reforms focusing on the entire teacher management and development system of the ministry; and it committed the government to increasingly large financial outlays to reward professional certification which may have serious implications for the ability of the education budget to further expand the system or improve its quality. It is not surprising, therefore, that so much attention has been paid by its various stakeholders and supporters to the impact of this law on the structure, mechanisms, strategies, processes, and ultimate outcomes of the Indone- sian education system. The Ministry of Education and Culture itself, of course, is very attentive since the effective- ness of the implementation of the Law directly reflects on the efficiency and professionalism of the Ministry. The national Parliament, the Ministry of Finance, and the National Planning and Development Board worry about the added value to the education system and its “clients� – the learners – by the large investment now being paid to certified teachers. The teachers’ associations, especially the largest and most official – the Teachers’ Association of the Republic of Indonesia - are concerned not only about the welfare and status of their individual members but also about the extent to which they have genuinely earned and will remain worthy of the title of professional�. And such worthiness will be ultimately assessed, of course, by the learners themselves, their parents, their future employers, and the larger society.2 Implementation of such a reform, however, is a political process that in Indonesia involves almost three million teachers (or as one political analyst put it, at least 30 million votes given the minimal estimate that each teacher can each affect 10 votes from family members). As a result, media coverage of the reform has focused on teach- ers’ rights and welfare (e.g., late payment of the professional allowance, administrative charges levied on the allowance by district offices) and has lost sight of the original aim of making teachers (once again) professionals. Elevating the public debate beyond that of solely teacher welfare to the quality of schooling for students has Financial and Political Economy Factors been a challenge for the Ministry of Education and Culture. But as empirical evidence surfaced in this regard, it For a variety of factors related to the political economy of the time, the mere fact of certification and the has helped to embolden the Ministry to take more stringent measures to ensure that the original intentions of consequent doubling of teacher income have not achieved what was expected – better teaching and better the Law are achieved. learning. Certification was meant to be based on a minimum academic qualification (a four-year degree) and mastery of the teacher’s subject and its required pedagogy; the assumption was that this would be translated 1 Bjork: 110 into different teacher behaviors and better student outcomes. The logic of this process, however, was distorted 2 Anecdotal evidence is mixed in this regard with some certified teachers reportedly using their allowance to purchase reference books in several ways: and laptops to support their work and others hiring assistants to teach their classes, going into debt to buy cards, and even losing the respect of parents because they appear to be less professional, despite their higher income, than before certification. 160 161 Conclusions and Recommendations • The selection of teachers for the early rounds of certification was based largely on seniority rather The costs of extending the certification program to all civil-service teachers and other eligible contract/tempo- than merit and thus gave preference either to those whose four-year degree was already many years rary teachers is associated with significant trade-offs. Estimates suggest that spending on teacher compensation old or to the large cohort of teachers employed during the expansion of the system in the 1970s and will need to absorb a much larger share of the available public education resources. This means that spending 1980s with low academic qualification, low motivation, and little training – either then or subsequent- in other areas of the education budget will need to be reduced. For example, resources for increasing access ly – who either did not need the four-year degree because of their age and seniority or got the degree to early childhood and post-basic education and investments in other quality improving strategies are likely to in a piecemeal fashion. Many, therefore, began the certification process with very low mastery of the be limited by the certification program. The book has also shown that converting non-PNS teachers to civil- required competencies. (Others, anecdotally, also got into the certification queue through political servants and certifying them will be unsustainable given current budgetary projections. and personal favouritism or outright bribery.) In order to reduce the budgetary impact of the certification program, the inefficiencies associated with teacher • Many of these same teachers, as the analysis presented in Chapter 1 shows, had begun their careers hiring and deployment need to be addressed. Student teacher ratios are already low by international standards in an era where accountability (and loyalty) to the central government and identification with the and at the primary level are continuing to fall. The book has shown that even relatively small increases in stu- civil service took precedence over accountability to their students and identification as a member of dent-teacher ratios could realise significant budget savings while having limited impact on quality. Serious the profession of teaching. Working for decades in such a bureaucratic environment and the school attention must therefore be paid very soon to significantly restricting intake to teacher education institutions cultures this engendered did little to make them able or eager to become agents of change. and new hiring at all levels, removing incentives for overhiring at school and district levels, enforcing the policies • The first method of measuring competency – the portfolio – did little to demonstrate either subject and bearing the expense of moving teachers from teacher-surplus to teacher-deficit schools and districts, and knowledge or pedagogical skill. The questionable manner through which the portfolios were often moving underperforming teachers elsewhere in (or out of ) the civil service system. Attention will also need to assembled and the rather inconsistent way in which they were evaluated did little to assure that the be paid to staffing standards in small schools which are a key driver of low student-teacher ratios. required competencies had, in fact, been mastered. • The remedial measure to a failed portfolio – the 90-hour course – was helpful but, given its short Recruitment length and the fact that it was largely standardized across all teachers rather than responsive to indi- It can be argued that the expectation around certification for the senior cohort of existing teachers (i.e., that after vidual needs, could not make up for the low levels of competency of the participating teachers. 25 years of teaching, with limited pre-service education, a school culture which encouraged civil servant obedi- ence rather than pedagogic innovation, and few opportunities for further development) was over-optimistic, The result was that the quality of the certification process as a whole was not as good as originally intended – i.e., especially in the absence of any systematic post-certification follow-up. But the incentive of both professional based on tested mastery of specific skills and knowledge and adapted to the needs of individual teachers – so status and professional pay is now attracting more (and sometimes better quality) candidates into teacher that there is now virtually no evidence of differences in the competencies between certified and non-certified education at the expense of other fields. So while there has been little impact of the professional allowance on teachers nor in their impact on student learning outcomes. the quality of current teacher competence or student outcomes, it may produce a better cadre of teachers in the future if the rapid growth of low quality teacher education institutions is controlled, minimum competency stan- This is consistent with the OECD Teaching and Learning Internal Survey (TALIS) finding that key aspects of teach- dards are enforced at all stages of teacher management and development – and, of course, if qualified graduates ing and learning that have shown to improve learning include teachers’ content knowledge, teachers’ pedagogi- have (merit-based) access to a teaching job upon graduation.. cal knowledge (both general and specific to their subject), teaching practices that focus on clear and well-struc- tured lessons supported by effective classroom management, individualized instruction, and active professional Pre-service Education collaboration including classroom observations, team teaching, and constructive feedback. The attraction of certification has led to an increase in the number of teachers who have achieved the re- quired minimum of a four-year degree. This, as opposed to just the fact of certification, can lead to greater For countries therefore considering a blanket increase in teacher pay, the bar to gain this increase has to be set mastery by a graduate teacher of relevant subject knowledge which can then be directly correlated with student to ensure that teachers are tested for competencies known to be necessary for a good teacher and to ensure achievement; the more the teachers knows, the more is transmitted successfully to their students. Likewise, at that low performing teachers do not remain in the profession. This requires that politicians and senior decision- least in the sample of Grade 8 mathematics studies in the context of TIMSS, teachers with mathematics educa- makers parties take a firmer stand in supporting the efforts of ministries of education to enforce higher stan- tion degrees (as opposed to pure mathematics) have adequate knowledge of their subject but also demonstrate dards, implement more effective competency assessment, and redeploy or dismiss teachers who cannot meet more useful teaching practices such as investigation and problem-solving. This supports the Law in its defini- the required competencies. tion of teacher quality as depending on both subject knowledge and pedagogy. The increase in enrolment for four-year degrees by practicing teachers at the Open University (and other teacher education institutions with a From a financial perspective, Indonesia increased its budget 120% between 2001 and 2009, but significant ineq- distance learning programme) could be a good sign, therefore, that a better quality of teachers will be entering uity remains, starting with the inequitable distribution as well as the overall over-supply of teachers. the certification queue in the future – if the quality of these upgrading four-year programmes can be assured. 162 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 163 Conclusions and Recommendations For countries setting new standards for their teaching force, and depending on the structure of the education But useful induction processes and good mentoring and appraisal skills on the part of school principals and dis- system, a four-year degree could be a useful benchmark, but there has to be careful accreditation of teacher trict supervisors do not just happen by themselves. It is therefore essential in Indonesia – and in other countries education institutions to ensure they test graduates for subject matter and pedagogical competencies as well undertaking comprehensive teacher reforms – to lay out clearly what a useful process of induction looks like as other necessary characteristics of a good teacher. In Singapore, for example, in order to put the focus on and the kinds of mentoring skills (and training to produce them) needed by principals and supervisors in order student learning, the National Institute of Education (the sole provider of initial teacher education) cut subjects to ensure that the final certification of teachers (unconditionally and for life in Indonesia) is based on adequate such as history and philosophy of education from their undergraduate teacher education syllabus since these knowledge, skills, and motivation. One good example of an induction process whereby mentors and mentees were not leading to noticeable increases in student learning. More emphasis was instead placed on practical regularly observe each other’s lessons and observe demonstration lessons together is in Shanghai where men- classroom teaching with a strong focus on subject content; e.g. mathematics teachers should graduate with the toring focuses on core teaching skills such as diagnosing student learning, and teachers are trained in classroom same mathematics content knowledge as straight mathematics graduates. In Korea, pre-service institutions are and lesson observation by colleagues as part of the professional culture. rated, and those with an A-rating receive substantial financial bonuses. Courses with a D-rating must reduce their student numbers by 50% the following year. In additions, graduates must sit for examinations before they Continuing Professional Development become teachers. The original intention of the Teacher Law was to put in place a framework of effective policies and proce- dures which would both assure the quality of the process and its products and encourage continuing pro- Induction, Mentoring, Probation, and Certification fessional development. It is, in fact, essential both for new teachers, by enforcing minimum competency stan- Although in many education systems, these stages in a teacher’s career are quite distinct, in Indonesia their dards at all stages of their management and development, and for older, already certified teachers, by putting precise sequence in the process of teacher management and development remains unclear – thus, their combi- in place a post-certification process which can try to assure that many of the new “professionals� gain, maintain, nation here in one critical stage of this process. For practicing teachers who enter the certification queue (with and enhance the competencies they never really mastered in the first place. In other words, it is essential to try the four-year degree) and then got certified via a portfolio or (as is currently the case) following the 90-hour to rectify the weaknesses in the implementation process of the Teacher Law through quickly putting in place the training course, there is no induction, mentoring, and probation. They were teachers before certification, and essential parts of a quality assurance/professional development framework. they are (supposedly more “professional�) teachers after certification. And there is no post-certification process in place (except regular and routine appraisals) – such as a new round of mentoring and probation or regular One of these parts – the teacher working groups – is already in place and apparently performing effectively. Re- re-certification - to ensure that they are now acting as professionals; i.e., teaching better. search has shown that this decades-old but often neglected mechanism is expanding in reach, in the relevance of its activities, and in the improvement of its members’ cognitive and pedagogical abilities. It is interesting to For new entrants to teacher education institutions, there is the need to pass the coursework to obtain the four- note that while this particular effective method of in-service training was not related to certification and that year degree (granted by the institution); then to pass the newly mandated post-graduate, classroom-focused teachers do not receive double income as a result of participation, there has been a significant increase in mem- course of professional study (six months for primary school teachers, one year for secondary teachers); then to bership in, and benefits gained from, these groups. gain an authorised teaching post (as opposed to being hired on a school contract); and then, through what is meant to be a systematic process of induction and mentoring, pass their one-year probation. The last is meant But other parts of this quality assurance framework need also be to put in place – and probably should have to be based both on the teacher’s previous academic record and on the principal’s report of the new teacher’s been established at the start of the Teacher Law (and the certification process) rather than several years later. competence, efficiency, and effectiveness and is completed when the teacher education institution finally certi- These include: fies the new teacher – which, if accepted by the Ministry, will lead to provision of the professional allowance. • more rigorously accredited teacher education institutions charged with both the pre-service prepa- This whole process is largely still intention, although the regulations are in place and the necessary guidelines ration of candidates as teachers and their certification and the in-service work of continuing profes- and formats have been developed and, in some cases, piloted for wider use throughout the system. What is es- sional development sential here is the combination of institution- and employer-based assessment. Since many teacher educators • a cadre of principals selected on merit, specifically trained for their work (both administrative and have had little experience in actual school teaching(especially at the primary level) and often have little com- academic), deployed to where they are needed most, and focused on the essential teacher manage- petence in the kind of dynamic, interactive, child-centered pedagogy meant to be used in schools, assessment ment and development tasks of both early induction, mentoring, probation and ongoing teacher solely on one’s academic, institutional record is simply not adequate. Thus, it is also important that principals development and supervisors join in the assessment leading to certification through well-planned induction and mentoring to ensure that new teachers have good knowledge of their subject(s) and relevant methodologies but also, even • a cadre of supervisors likewise chosen on merit and trained for their work, in a post of enhanced more essential, excellent skills in pedagogy. This should be proven through probationary teaching for at least a responsibility for the system’s effective functioning and therefore of a higher status to match this year with a full load of classroom hours – and perhaps even evidence of strong dedication to the profession of responsibility teaching. 164 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 165 Conclusions and Recommendations • a supportive, non-politicized district education office (backed up by a similarly non-politicized district • require that the graduates of these pre-service programmes pass the competency test (i.e., for subject regent) with a specific unit focused on continuing professional development, quality assurance, and matter and pedagogy) required for certification at an appropriate passing grade; again, the credibility the unified servicing of all aspects of teacher management and development of the Ministry is at stake if the majority of those who pass the test do so with a grade of (say) only 50% • ensure that appropriate induction, mentoring, and probation processes are in place at the school Teacher Appraisal and Career Development level, based on the required competencies, and supervised by the principal and supervisor, preferably What this whole process of teacher management and development ultimately leads to is a systematic teacher so that final certification is based on both the candidate teacher’s academic record and classroom appraisal process linked not only to ongoing professional development but also to the regular and accelerated performance. progression and/or promotion of teachers through the education system. The last is especially important. All teachers should be held accountable through an annual performance appraisal mechanism for the quality of For teachers not yet certified: their work, and principals and supervisors must likewise be held accountable through the district authorities for the manner in which this mechanism of quality assurance is applied. Those meeting or exceeding the required • monitor the methods used for uncertified teachers to apply for entry into a four-year degree pro- standards should be guided through further stages of professional and perhaps administrative training, leading gramme (e.g. the Open University, HYLITE), the quality of the four-year programme (e.g., its basis on to promotions within the teaching career structure or into more administrative, supervisory positions. In other the essential competencies for subject matter and competencies), and the awarding of the degree words, for further quality enhancement, good teachers should not always get promoted out of classrooms but (e.g., at an appropriate passing grade). rather become master teachers and mentors for more classrooms. This implies that rather than providing blan- • establish structured, well-monitored, and supervised in-service training focusing on classroom needs ket increases for all teachers regardless of performance, the teacher career structure should eventually reward (specifically subject mastery and pedagogical techniques). high performers with additional responsibilities and higher salaries that encourage them to remain in teaching. For certified teachers: On the other hand, those unable to maintain the required standards must be compelled to undertake some kind of intensive program of professional improvement (e.g., related to subject mastery, pedagogic competence, • implement rapidly and effectively the full range of quality assurance/continuing professional devel- or both) and then be assessed as to their improvement. On the basis of the result, decisions need to be made opment mechanisms to further enhance the competency and professionalism of certified teachers, about their future as teachers. The system must divest itself of underperforming teachers (as it is often most including the KKG/MGMP, well-chosen and well-trained principals and supervisors able and willing to eager to do in regard to underperforming students!) who are unable or unwilling to improve their performance monitor and improve the performance of certified teachers, and continuing teacher appraisal linked – perhaps re-deploying them to another part of the civil service or even dismissing them. Either way, it is critical to further career achievement. for some form of sanction to be applied to non-compliant personnel. • encourage/mandate the expenditure of a certain percentage of a teacher’s professional allowance for Specific Recommendations for Indonesia continuing professional development activities. The above conclusions and recommendations should be relevant to any education system attempting to reform • establish some system of ensuring that teachers master the required competencies at ever higher its teacher management and development system. But for Indonesia, given that the reform process still has a levels of achievement during their career; e.g., putting even newly certified teachers on probation long way to go and that there are large numbers of certified and as well as uncertified teachers not meeting and through a process of further mentoring, , requiring some kind of re-certification or confirmation competency standards, the following specific recommendations are provided: of certification every five years (perhaps with a higher passing grade), etc. For new teachers: • establish and implement procedures for underperforming teachers, including both additional sup- port, supervision, and training and, if needed, redeployment or dismissal. • ensure that the intake of teacher candidates across all teacher education institutions is linked to the likely number of teachers required by the system – by level and subject – when each cohort graduates • ensure that the hiring of new teachers is based on merit; it will do nothing for the credibility of the Ministry if bright, motivated new graduates emerge from teacher education with little chance of get- ting a teaching post – unless, perhaps, they pay for it • ensure that essential competencies in subject matter and pedagogy underlie all aspects of the pre- service education programme 166 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 167 Conclusions and Recommendations Teaching as a Vocation and the School as a Learning Community learn. Fullan argues that the task is to “hearten� the disenheartened, not through individualistic incentives such as pay for performance but rather through incentives that focus on the collective. He lists eleven: “Indonesian teachers are rooted in environments that have not historically promoted the behaviors and attitudes that lie at the core of recently adopted education reforms...Indonesian civil service culture...promotes values and • good salaries behaviors that are fundamentally at odds with the new role of the teacher that the government is currently pro- moting. The civil service system is structured to reward individuals who display loyalty and obedience.� 3 • decent surroundings • positive climate A final lesson related to teacher development. Even comprehensive, expensive reforms concerning teacher management and development will not work if teachers don’t have the intrinsic motivation to be a teacher. • strong induction Teachers who are passionate about teaching are likely to teach better than those who just want to get paid • extensive professional learning more or those who follow only the required upgrading programs and certification processes. The Teacher Law • opportunity to work with and learn from others has placed personality as one of the four required competencies for teachers. This is important for the teacher recruitment process in Indonesia given the opportunity it now has, with a surplus of teacher applicants, to be • supportive, even assertive leadership about the agenda more selective in this process and only allow those who want to treat teaching as a genuine vocation to enter • getting helpful feedback the profession. Based on international literature (Gratten Institute, 2012), people change behavior if they have a purpose to believe in, if their role models act consistently, if they have skills and capacity for the new behavior, • reasonable class size and if reinforcement systems such as performance measures are consistent. If the first of these is absent, any be- • long-term collective agreements (i.e., career stability) havior change resulting from the other three may very well be superficial at best. And for teachers accustomed • realizable moral purpose8 to seeing themselves as civil servants first and teachers second, enhancing their motivation will take more than the label “professional� and an increase in their income. Besides the incentive of “reasonable class size� (which in the case of Indonesia might be unreasonably small), the Teacher Law of 2005 and the comprehensive standards and regulations that have supported it cover most of this This is where the concept of whole-school reform towards a learning community becomes so essential. Any list. The salaries and the career stability came first, for quite understandable reasons given the political economy reforms adopted “must facilitate the development of a culture of continuous professional improvement for all of the time, but this has led now to serious challenges in realizing the rest of the items on the list. These include: teachers and the concept that every school is a ‘learning community’ with students, teachers, and the wider community enhancing their knowledge and skills through activities generated in the school.�4 In such a learn- • how to guarantee “decent surroundings� for all education institutions when so much of the education ing community, for example, having a good mentor for a new teacher is not enough; what is needed is working budget is going to an oversized and now well-compensated cohort of teachers in a school with an integrated, collective professional culture. Fullan quotes (Byrk, Sebring, Allensworth, Luppes- cu, & Easton, 2010)5 in listing five key factors for such a collective solution: “(1) school leadership (the principal) • how to ensure that the “learning� is actually both extensive and professional when the pressure is to as driver who works with teachers, students, parents, and the community to build, in turn, four other interrelated certify as many teachers as possible in the time mandated by the Law focuses and supports – (2) parent and community ties, (3) professional capacity of staff (including focused work • how to effectively put in place the other post-certification, quality assurance incentives on the list - orientation, (4) a student-centered learning climate, and (5) instructional focus and guidance.� 6 strong induction, opportunity to work with and learn from others, supportive leadership about the agenda, and getting helpful feedback Fullan goes on to quote a survey done by Yarrow (2009)7 which resulted in three categories of teachers: the disenheartened (in the survey, 40%), who get little support and are concerned about working conditions and • perhaps most challenging, how to create in schools a “positive climate� and in teachers a “realizable student behavior; the idealists (23%), who became teachers to help students and think that good teachers can moral purpose� – when historically these were not the priorities of the education system. lead all students to learn and that they have had an impact on their students; and the contented, who report excellent working conditions in better schools and also think they have helped their more advantaged students The Government of Indonesia, through its Teacher Law, has undertaken the immense and complicated task of essentially trying to re-professionalize a de-professionalized occupation; whether it succeeds or not will go a long way to determining the response of Indonesia to the national and global challenges it is facing in the new 3 Bjork, pp. 84, 96 4 The World Bank 2009. Teacher Certification in Indonesia: A Strategy for Teaching Quality Improvement. Jakarta: The World Bank. p. 202. century. 5 Byrk, A. et al, 2010. Organising Schools for Improvement: Lessons from Chicago. Chicago: University of Chicago Press. 6 Fullan. P. 101 7 Yarrow, A. 2009. “State of Mind: America’s Teaching Corps�. Education Week (29)8, 21-23. 8 Fullan. Pp. 83-84 168 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 169 References References Guarino, C. M., Reckdase, M. D., & Wooldridge, J. M. (2011). Can Value-Added Measures of Teacher Performance Be Trusted? Hiebert, J. (2003). Teaching mathematics in seven countries : results from the TIMSS 1999 video study. Washington, DC: National Center for Education Statistics : U.S. Dept. of Education, Institute of Education Sciences : Ainley, J. (1988) Perceptions of teachers’ questioning styles. Proc. 12th Conf. of the Int. Group for the Psychology of For sale by the Supt. of Docs., U.S. G.P.O. Mathematics Education, pp. 92. Jensen, B. (2012). Catching up: Learning from the best school systems in East Asia: Grattan Institute. Berliner, D. C. (1990). What’s All the Fuss About Instructional Time? New York and London: Teachers College Press; Kane, T., Rockoff, J., & Staiger, D. (2008). What does certification tell us about teacher effectiveness? Evidence from Teachers College, Columbia University. New York City. Economics of Education Review 29, 29. Bjork, C. (2005). Indonesian Education: Teachers, School, and Central Bureaucracy Routledge, New York & London. Kluyskens, J., & Firdaus, M. (2009). Teacher management: Recruitment, Selection and Data, Probation and Transfer Borko, H. (2004). Professional development and teacher learning: Mapping the terrain. Educational Researcher, 33 Backgound paper for the ESW study - Formulation of the medium term strategy (RENSTRA) for the education (8), 3-15. sector (2009-2014). Bruns, B., Filmer, D., & Patrinos, H. A. (2011). Making schools work : new evidence on accountability reforms. Wash Kluyskens, J., & Firdaus, M. (2009). Teacher management: Recruitment, Selection and Data, Probation and Transfer. ington DC: World Bank. The World Bank. Indonesia. Byrk, A., Sebring, P. B., Allensworth, E., Luppescu, S., & Easton, J. Q. (2010). Organising Schools for Improvement: Kluyskens, J., Rawlinson, R., & Ragatz, A. (2007). Improving efficiency and equity in teacher employment and deploy Lessons from Chicago. Chicago: University of Chicago Press. ment. Jakarta, Indonesia: The World Bank. Carroll, J. B. (1963). A Model of School Learning. Teachers College Record, 64(8), 723-733. Kounin, J. S. (1970). Observing and Delineating Technique of Managing Behavior in Classrooms. Journal of Research Cerdan-Infantes, P., Makarova, Y. (2013). Spending more or spending better: improving education financing in Indo and Development in Education, 4(1), 62-72. nesia. Jakarta, Indonesia: World Bank. Kuhs, T., & Ball, D. (1986). Approaches to teaching mathematics: Mapping the domains of knowledge, skills and Chen, D. (2011). School-based management, school decision-making and education outcomes in Indonesian pri dispositions. mary schools Policy Research Working Paper (Vol. 5809). Washington D.C.: The World Bank. Leigh, A. (2007), ‘Estimating Teacher Effectiveness from Two-Year Changes in Students’ Test Scores’, unpublished Craig, H. J., Kraft, R. J., & Du Plessis, J. (1998). Teacher development : making an impact. Washington, DC: U.S. paper, Australian National University, 2007 Agency for International Development : World Bank. Little, A. (2006). Education for All and multi-grade teaching: challenges and opportunities. London: Springer. Darling-Hammond, L. (2000). Teacher quality and student achievement: A review of state policy evidence. . Educa Loeb, Susanna, Kalogrides, Demetra and Beteille, Tara, Effective Schools: Teacher Hiring, Assignment, Develop tional Policy Analysis Archives, , 8(1 ). ment, and Retention (June 2011). NBER Working Paper No. w17177. Available at SSRN: http://ssrn.com/ Darling-Hammond, L., & Berry, B. (2006). Highly qualified teachers for all. Educational Leadership, 64(3), 14-20. abstract=1879039 De Ree, J., Muralidharan, K., Pradhan, M., & Rogers, H. (2012). Double for what? The impact of unconditional Ministry of Education and Culture Statistical yearbook (Seri Ikhtisar Data Pendidikan Nasional) 1995-2010, Cen teacher salary increases on performance. The World Bank. tre for Educational Statistics Data, Ministry of National Education, Jakarta, Indonesia. Dewey, J. (1938). Experience and education. New York,: The Macmillan company. Muijs, D., & Reynolds, D. (2002). Teacher-level effects in school effectiveness research: first findings of a longitudinal Duthilleul, Y. (2005). Lessons learnt in the use of ‘contract’ teachers. Paris: UNESCO International Institute for Educa study. Toronto, Canada. tional Planning. Mulkeen, A. (2009). Teachers in Anglophone Africa: Issues in teacher supply, training and management. (Vol. 52278). Fullan, M. (2010). All Systems Go: The Change Imperative for Whole System Reform. Thousand Oaks, California: Washington D.C: The World Bank. Corwin: . Muralidharan, K., & Sundararaman, V. (2011). Teacher Performance Pay: Experimental Evidence from India. The Fullan, M., & Miles, M. (1992). Getting reform right: What works and what doesn’t. Phi Delta Kappan 73, 745-752. Journal of Political Economy, 119(1), 39-77. Fyfe, A. (2007). The use of contract teachers in developing countries: trends and impact. Geneva: International Murnane, R. J., & Cohen, D. K. (1986). Merit Pay and the Evaluation Problem: Why Most Merit Pay Plans Fail and Few Labour Organization. Survive. Harvard Educational Review, 56(1), 1-17. Goldhaber, D., DeArmond, M., Player, D., & Choi, H. (2008). Why Do So Few Public School Districts Use Merit Pay? . O’Neill, G. P. (1988). Teaching Effectiveness: A Review of the Research. Canadian Journal of Education, 13 (1), 162- Journal of Educational Finance, 33(3), 262-289. 185. Govinda, R., & Josephine, Y. (2004). Para teachers in India: A review. . Paris: IIEP. OECD. (2010). PISA 2009 Results: Learning Trends: Changes in Student Performance Since 2000 (Vol. V): OECD Pub Goyal, S., & Pandey, P. (2009). How do government and private schools differ? Findings from two large Indian States. lishing. http://dx.doi.org/10.1787/9789264091580-en Washington D.C.: The World Bank. OECD. (2011). Building a High-Quality Teaching Profession: Lessons from Around the World. Paris, France: Organisa Greeno, J. G., Collins, A. M., & Resnick, L. B. (1996). Cognition and learning. In D. Berliner and R. Calfee (Eds.). Hand tion for Economic Co-operation and Development. book of Educational Psychology, 15-41. 170 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 171 References Ragatz, A. (2010). Transforming Indonesia’s Teaching Force. Volume II: From Pre-service Training to Retirement: Pro WorldBank. (2009a). Rapid Assessment Study in Pre-service Training of Teachers. World Bank. ducing and Maintaining a High-quality, Efficient, and Motivated Workforce. Jakarta, Indonesia: The World WorldBank. (2009b). Teacher Working Groups in Indonesia: A Study of the Current Situation and Opportunities for Bank. Increased Effectiveness. World Bank. Jakarta, Indonesia. Raudenbush, S. W. (2004). Schooling, statistics, and poverty: Can we measure school improvement? . Paper pre World Bank, (2009c), “Teacher working groups in Indonesia: a study of the current situation and opportunities for sented at the William H. Angoff Memorial Lecture Series. Educational Testing Service, Policy Evaluation increased effectiveness.� World Bank, Jakarta, Indonesia and Research Center, Princeton, NJ. WorldBank. (2010). Investing in multi-grade teaching in Indonesia. The World Bank. Jakarta, Indonesia. Research and Development Board, Indonesian Ministry of National Education (2009), “Dampak Peningkatan K WorldBank. (2011). Mid-Term Review of the BERMUTU project. Kesejahteraan Guru terhadap Mutu Input (Quality Enrollment) dan Pemberian Bantuan Dana Kompetitif Wragg, E. C. (1993). Multimedia in Education - Bane or Boon. Journal of Educational Television, 19(2), 73-79. terhadap Kemampuan Lulusan LPTK�, Jakarta, Indonesia]. Yarrow, A. (2009). State of Mind: America’s Teaching Corps. Education Week 29(8), 21-23. Rice, J. K. (2003). Teacher Quality: Understanding the Effectiveness of Teacher Attributes: Economic Policy Institute. Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2005). Teachers, schools, and academic achievement. Econometrica, 73(2), 417-458. Rowan, B., Correnti, R., & Miller, R. J. (2002). What large-scale, survey research tells us about teacher effects on student achievement: Insights from the Prospects study of elementary schools. Teachers College Record, 104(8), 1525–1567. Sanders, W. L., & Rivers, J. C. (1996). Cumulative and residual effects of teachers on future student academic achieve ment: Knoxville: University of Tennessee Value-Added Research and Assessment Center. Scheerens, J. (1992). Effective Schooling: Research, Theory and Practice. London: Cassell. Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and re search design in disentangling meta-analysis research. Review of Educational Research, 77, 454-499. Shaeffer, S. (In print). The quality of basic education: Issues and challenges for Asia: Asian Development Bank and the National University of Singapore. Sims, C. ( 2010). Recognition of Prior Learning: City and Guilds Centre for Skills Development (CSD). SMERU. (2010). Remote area allowance and absentee levels for teachers in remote areas. Indonesia: SMERU. Snow, R. E., & Lohman, D. F. (1984). Toward a theory of cognitive aptitude for learning from instruction. Journal of Educational Psychology, 76, 347-376. Stevenson, R. (2009). Some International Perspectives and Ideas on Pre-service Teacher Education (Background Paper). The World Bank. UNCEN, UNIPA, SMERU, BPS, & UNICEF. (2012). We like to be taught: a study on teacher absenteeism in Papua and West Papua. Indonesia. UNESCO. (2009). Universal primary education in Africa: The teacher challenge. . Dakar, Pole de Dakar: UNESCO. Usman, S., Akhmadi, & Suryadarma, D. (2004). When Teachers are Absent: Where do They Go and What is the Im pact on Students? Jakarta, Indonesia The SMERU Research Institute. Usman., Syaikhu, A., & Suryadarma, D. (2004). When Teachers Are Absent: Where Do They Go and What Is the Im pact on Students. Jakarta: SMERU. Wayne, A. M., & Youngs, P. (2003). Teacher characteristics and student achievement gains: A review. Review of Edu cational Research, 73(1), 89-122. WorldBank. Political Economy Assessments at Sector and Project Levels: GAC, World Bank WorldBank. (2008a). The Political Economy of Policy Reform: Issues and Implications for Policy Dialogue and Develop ment Operations. Washington, D.C.: The World Bank WorldBank. (2008b). Teacher employment and deployment in Indonesia: opportunities for equity, efficiency and quality improvement. . Jakarta: The World Bank. 172 TEACHER REFORM IN INDONESIA: The Role of Politics and Evidence in Policy Making 173