+ MAINSTREAMING ICT and Education Series 31953 KNOWLEDGE MAPS: ICT IN EDUCATION What do we know about the KNOWLEDGE MAPS: effective uses of information and communication technology in ICT IN EDUCATION education in developing countries? Information for Development Program www.infoDev.org KNOWLEDGE MAPS: What do we know about the effective uses of information and communication technologies in ICT IN EDUCATION education in developing countries? AN info Dev PUBLICATION PREPARED BY Michael Trucano ICT AND EDUCATION SERIES Information for Development Program www.infoDev.org To cite this publication: Trucano, Michael. 2005. Knowledge Maps: ICT in Education. Washington, DC: infoDev / World Bank. Available at: http://www.infodev.org/en/Publication.8.html ©2005 The International Bank for Reconstruction and Development/ The World Bank 1818 H Street, N.W. Washington, D.C. 20433 U.S.A. All rights reserved Manufactured in the United States of America The findings, interpretations and conclusions expressed herein are entirely those of the author(s) and do not necessarily reflect the view of infoDev, the Donors of infoDev, the International Bank for Reconstruction and Development/The World Bank and its affiliated organizations, the Board of Executive Directors of the World Bank or the governments they represent. The World Bank cannot guarantee the accuracy of the data included in this work. The boundaries, colors, denominations, and other information shown on any map in this work do not imply on the part of the World Bank any judgement of the legal status of any territory or the endorsement or acceptance of such boundaries. The material in this publication is copyrighted. Copying or transmitting portions of this work may be a violation of applicable law. The World Bank encourages dissemination of its work and normally will promptly grant permission for use. For permission to copy or reprint any part of this work, please contact info@infodev.org. TABLE OF CONTENTS About these Knowledge Maps v Executive Summary: Key Findings 1 Theme 1: Impact Knowledge Map: Impact of ICTs on learning and achievement 5 Knowledge Map: Monitoring and evaluation issues 9 Knowledge Map: Equity issues: Gender, special needs and marginalized groups 13 Theme 2: Costs Knowledge Map: Costs 19 Theme 3: Current implementations of ICTs in education Knowledge Map: Current projects and practices 25 Knowledge Map: Specific ICT tools used in education 31 Knowledge Map: Teachers, teaching and ICTs 35 Knowledge Map: Content and curriculum issues 41 Theme 4: Planning Knowledge Map: School-level issues 47 Knowledge Map: ICT in education policy issues 49 Appendix: Millennium development goals related to education 55 Bibliography 59 Table of Contents iii ABOUT THESE KNOWLEDGE MAPS STUDY BACKGROUND Recent work at infoDev investigated what is known (and what isn’t) about the uses of ICTs in various ways to benefit education in developing countries. Despite a decade of large investment in ICTs to benefit education in OECD countries, and increasing use of ICTs in education in developing countries, important gaps remain in the current knowledge base. In addition, there appears to be a dearth of useful resources attempting to translate what is known to work—and not work—in this field for policymakers and donor staff working on education issues in developing countries, especially those issues related to Education For All and other education-related Millennium Development Goals. The “knowledge mapping” exercise investigated ten topics: ■ impact of ICTs on learning and achievement; ■ monitoring and evaluation; ■ equity issues; ■ costs; ■ current projects and practices; ■ specific ICT tools; ■ teachers, teaching and ICTs; ■ content & curriculum; ■ school-level issues; and ■ policy issues the key findings of which were divided into four major themes: Impact, Costs, Current Implementation and Planning. GOALS AND PURPOSE These “Knowledge Maps” outline where important gaps in received knowledge exist, and have been utilized in the formulation of recommendations in support of a series of related research projects and workshops at infoDev. Initially a series of internal documents, expressed demand from partner organizations and various donor staff focusing on education issues resulted in infoDev deciding to publish these knowledge maps, in the hope that a wider audience may find them useful as well. The individual Knowledge Map briefing sheets are meant to serve as quick snapshots of information in key areas related to the use of ICTs in education. Taken together, they are not meant to be an exhaustive catalog of everything that is known (or has been debated) about this field; rather, they are an attempt to summarize and give shape to a very large body of knowledge. Based on the findings of this knowledge mapping process, a series of related research, outreach activities, and policymaker workshops is being undertaken by infoDev in the coming years. About these Knowledge Maps . v SOURCES It should be noted that this knowledge mapping exercise relies entirely on existing research and literature, and borrows liberally from it. The knowledge maps were initially meant for internal use to aid in the development of work plans over a three year period, and so explicit individual citations from the research literature are, for the most part, not made. That said, a list of key recommended resources is provided with each knowledge map; these resources are the primary (although not exclusive) sources from which the information presented in each “knowledge map” was drawn, and could be considered “required reading” for someone wishing to get up to speed quickly on each topic. A full listing of useful resources consulted during the knowledge mapping exercise is also presented in a bibliography. A WORK IN PROGRESS infoDev’s series of Knowledge Maps on ICT in Education are a work in progress. They will be updated on a regular basis to reflect new developments and research. Comments and feedback are welcome at www. infodev.org/education. SPECIAL THANKS Special thanks for comments and suggestions on the Knowledge Maps are due to the infoDev team, especially Kerry McNamara; the Distance and Open Learning and Information Technology thematic groups at the World Bank (DOLIT), especially Juan Manuel Moreno and Shobhana Sosale; Robert Hawkins of the World Bank Institute; Cedric Wachholz and the ICT in Education team at UNESCO-Bangkok; and the staff and organizations affiliated with the World Links programs around the world. Knowledge Maps: ICTs in Education prepared by Michael Trucano for infoDev Washington, DC USA November 2005 www.infodev.org/education vi Knowledge Maps: ICT in Education EXECUTIVE SUMMARY – KEY FINDINGS infoDev has created a series of “Knowledge Maps” outlining what is known—and what isn’t—about the use of information and communication technologies (ICTs) in education. These knowledge maps reveal that, despite a decade of large investment in ICTs to benefit education in OECD countries, and increasing use of ICTs in education in developing countries, important gaps remain in the current knowledge base. In addition, there appears to be a dearth of useful resources for policymakers and donor staff working on education issues in developing countries, identifying what is known to work—and not work—in this field, especially in support of Education For All (EFA) and other education-related Millennium Development Goals (MDGs). The knowledge maps investigate ten topics (impact of ICTs on learning and achievement; monitoring and evaluation; equity issues; costs; current projects and practices; specific ICT tools; teaching and ICTs; content and curriculum; policy issues; and school-level issues). The key findings are divided into four major themes: Key Findings: Impact ■ The impact of ICT use on learning outcomes is unclear, and open to much debate. ■ Widely accepted, standard methodologies and indicators to assess impact of ICTs in education do not exist. ■ A disconnect is apparent between the rationales most often presented to advance the use of ICTs in education (to introduce new teaching and learning practices and to foster 21st century thinking and learning skills) and their actual implementation (predominantly for use in computer literacy and dissemination of learning materials). Key Findings: Costs ■ Very little useful data exists on the cost of ICT in education initiatives, especially related to Total Cost of Ownership and guidance on how to conduct cost assessments. Key Findings: Current implementation of ICT in education ■ Interest in and use of ICTs in education appear to be growing, even in the most challenging environ- ments in developing countries. Key Findings: Policy: Lessons learned and best practices ■ Best practices and lessons learned are emerging in a number of areas, but with few exceptions (notably on ‘schoolnet’ development and general lessons learned), they have not been widely disseminated nor packaged into formats easily accessible to policy makers in developing countries, and have not been explicitly examined in the context of the education-related MDGs. While much of the rhetoric about (and rationale for) using ICTs in education has focused on the potential for changing the teaching-learning paradigm, in practice, ICTs are most often used in education in LDCs to support existing teaching and learning practices with new (and, it should be noted, often quite expensive) Executive Summary . 1 tools. While impact on student achievement is still a matter of reasonable debate, a consensus seems to have formed that the introduction and use of ICTs in education can help promote and enable educational reform, and that ICT is a useful tool to both motivate learning and promote greater efficiencies in education systems and practices. 2 Knowledge Maps: ICT in Education THEME 1: IMPACT KNOWLEDGE MAP: IMPACT OF ICTs ON LEARNING AND ACHIEVEMENT GUIDING QUESTIONS: ■ How are ICTs actually being used in educa- tion? ■ What do we know about the impact of ICTs on student learning? ■ What do we know about the impact of ICTs on student motivation and engagement for This Knowledge Map is an excerpt learning? from the publication, Knowledge CURRENT Maps: ICTs in Education: What Do KNOWLEDGEBASE We Know About the Effective Uses What we know, what we believe of Information and Communica- — and what we don’t tion Technologies in Education in Developing Countries? produced General by the Information for Development Program (infoDev). ■ It is generally believed that ICTs can empower teachers and learners, promote change and foster the development of ‘21st century skills, but data to support these beliefs are still limited There is widespread belief that ICTs can and will empower teachers and learners, transforming teaching and learning processes from being highly teacher-dominated to student-centered, and that this transfor- mation will result in increased learning gains for students, creating and allowing for opportunities for learners to develop their creativity, problem-solving abilities, informational reasoning skills, communica- tion skills, and other higher-order thinking skills. However, there are currently very limited, unequivo- cally compelling data to support this belief. ■ ICTs are very rarely seen as central to the overall learning process Even in the most advanced schools in OECD countries, ICTs are generally not considered central to the teaching and learning process. Many ICT in education initiatives in LDCs seek (at least in their rhetoric) to place ICTs as central to teaching and learning. ■ An enduring problem: putting technology before education One of the enduring difficulties of technology use in education is that educational planners and technol- ogy advocates think of the technology first and then investigate the educational applications of this technology only later. Impact of ICTs on Learning and Achievement 5 Impact on student achievement ■ The positive impact of ICT use in education has not been proven In general, and despite thousands of impact studies, the impact of ICT use on student achievement remains difficult to measure and open to much reasonable debate. ■ Positive impact more likely when linked to pedagogy It is believed that specific uses of ICT can have positive effects on student achievement when ICTs are used appropriately to complement a teacher’s existing pedagogical philosophies. ■ ‘Computer Aided Instruction’ has been seen to slightly improve student performance on multiple choice, standardized testing in some areas Computer Aided (or Assisted) Instruction (CAI), which refers generally to student self-study or tutorials on PCs, has been shown to slightly improve student test scores on some reading and math skills, although whether such improvement correlates to real improvement in student learning is debatable. ■ Need for clear goals ICTs are seen to be less effective (or ineffective) when the goals for their use are not clear. While such a statement would appear to be self-evident, the specific goals for ICT use in education are, in practice, are often only very broadly or rather loosely defined. ■ There is an important tension between traditional versus 'new' pedagogies and standardized testing Traditional, transmission-type pedagogies are seen as more effective in preparation for standardized testing, which tends to measure the results of such teaching practices, than are more ‘constructivist’ peda- gogical styles. ■ Mismatch between methods used to measure effects and type of learning promoted In many studies there may be a mismatch between the methods used to measure effects and the nature of the learning promoted by the specific uses of ICT. For example, some studies have looked only for improvements in traditional teaching and learning processes and knowledge mastery instead of looking for new processes and knowledge related to the use of ICTs. It may be that more useful analyses of the impact of ICT can only emerge when the methods used to measure achievement and outcomes are more closely related to the learning activities and processes promoted by the use of ICTs. ■ ICTs are used differently in different school subjects Uses of ICTs for simulations and modeling in science and math have been shown to be effective, as have word processing and communication software (e-mail) in the development of student language and communication skills. ■ Access outside of school affects impact The relationships between in class student computer use, out of class student computer use and student achievement are unclear. However, students in OECD countries reporting the greatest amount of computer use outside school are seen in some studies to have lower than average achievement (the presumption is that high computer use outside of school is disproportionately devoted to computer gaming). ■ Users believe that ICTs make a positive difference In studies that rely largely on self-reporting, most users feel that using ICTs make them more effective learners. Impact on student motivation ■ ICTs motivate teachers and students There appears to be general consensus that both teachers and students feel ICT use greatly contributes to student motivation for learning. ■ Access outside of school affects user confidence (Not surprisingly) Students who use a computer at home also use them in school more frequently and with more confidence than pupils who have no home access. 6 Knowledge Maps: ICT in Education ICT use in education ■ Placement of computers has an impact Placing computers in classrooms — rather than separate computer laboratories — enables much greater use of ICTs for ‘higher order’ skills. Indeed, a smaller number of computers in classrooms may enable more actual use than a greater number of computers located in separate computer labs). Related to this is an increasing amount of attention, given by both teachers and students, to the use of laptops (and in some places, ‘computers-on-wheels’), as well as, to a much lesser extent, the use of personal digital assistants and other mobile devices. ■ Models for successfully integrating ICT use in school and after school hours are still emerging There are few successful models for the integration of student computer use at home or in other ‘infor- mal settings’ outside of school facilities with use in school. ■ The appropriate ages for introducing computers to students are hotly debated Generally speaking, appropriate ages for student ICT use in general are unclear. However, it is clear that certain uses are more or less appropriate, given student ages and abilities. Emerging research cautions against widespread use at younger ages. ■ ICTs can promote learner autonomy Evidence exists that use of ICTs can increase learner autonomy for certain learners. ■ Gender affects impact Uses of ICTs in education in many cases to be affected by the gender of the learner. ■ The ‘pilot effect’ can be an important driver for positive impact Dedicated ICT-related interventions in education that introduce a new tool for teaching and learning may show improvements merely because the efforts surrounding such interventions lead teachers and students to do ‘more’ (potentially diverting energies and resources from other activities). COMMENTS General comments ■ A review of the research on impacts of ICTs on student achievement yields few conclusive statements, pro or contra, about the use of ICTs in education. For every study that cites significant positive impact, another study finds little or no such positive impact. ■ Many studies that find positive impacts of ICTs on student learning rely (to an often uncomfortable degree) on self-reporting (which may be open to a variety of positive biases). Applicability to LDC/EFA context ■ Where ICTs are to be utilized to improve educational quality as measured by most standardized tests, few such gains are to be expected. ■ With sufficient teacher training, and given the existence of a variety of enabling factors, ICTs can be used to impact the nature and types of learning in which students engage. Some areas for further investigation and research ■ How does exposure to and use of ICTs in school affect future employment? ■ What is the impact of ‘computer-literacy’ instruction in schools? ■ What is the gender impact of ICTs in education on access, use of, attitudes toward, and learning outcomes? ■ How can ICTs be used to present, comment on and discuss student work, and what are the implications of such impact? ■ Are some school subjects better suited for ICT integration than others? Impact of ICTs on Learning and Achievement 7 Some Recommended Resources to learn more …. ■ Assessing the Impact of Technology in Teaching and Learning [Johnston 2002] ■ Changing the Conversation about Teaching, Learning and Technology: A Report on 10 Years of ACOT Research [Apple Computer 1995] ■ Comparative International Research on Best Practice and Innovation in Learning [Holmes 2000] ■ Consultative Workshop for Developing Performance Indicators for ICT in Education [UNESCO-Bangkok 2002] ■ Developing and Using Indicators of ICT Use in Education [UNESCO 2003] ■ The Digital Disconnect : The Widening Gap Between Internet-Savvy Students and Their Schools [Levin 2002] ■ Findings from the Teaching, Learning, and Computing Survey: Is Larry Cuban Right? [Becker 2000] ■ ICT and attainment: A review of the research literature [Cox 2003] ■ ImpaCT2: Emerging Findings from the Evaluation of the Impact of Information and Communications Technologies on Pupil Attainment [Becta 2001] ■ Impact of Educational Technology on Student Achievement—What The Most Current Research Has To Say [Schachter 1999] ■ The Learning Return on our Educational Technology Investment—A Review of Findings from Research [WestEd 2002] ■ Literacy Scores, human capital and growth across 14 OECD countries [Statistics Canada 2004] ■ Monitoring and Evaluation of Research in Learning Innovations—MERLIN [Barajas 2003] ■ Report on the OECD PISA Student ICT Survey [Australian Council for Educational Research 2002] ■ The Second Information Technology in Education Study: Module 2 (SITES: M2) Case Reports [ISTE 2003] ■ Technology and Classroom Practices: An International Study [Kozma 2003] ■ Technology, Innovation, and Educational Change—A Global Perspective [Kozma 2003] ■ Using ICT to Develop Literacy and Numeracy: Research Summary [Institute of Education, University of London 2001] ■ West Virginia Story—Achievement Gains from a Statewide Comprehensive Instructional Technology Program [Mann 1999] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the re- search literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of every- thing that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge map- ping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millen- nium Development Goals (MDGs). 8 Knowledge Maps: ICT in Education KNOWLEDGE MAP: MONITORING AND EVALUATION GUIDING QUESTIONS: ■ What do we know about effective monitoring and evaluation practices and studies related to the uses of ICTs in education? ■ What large scale comparative studies of ICT uses in education exist, and what do they tell us about the monitoring and evaluation This Knowledge Map is an excerpt process? ■ What do we know about useful indicators from the publication, Knowledge related to the uses of ICTs in education? Maps: ICTs in Education: What Do We Know About the Effective Uses CURRENT of Information and Communica- KNOWLEDGEBASE tion Technologies in Education in What we know, what we believe Developing Countries? produced — and what we don’t by the Information for Development Program (infoDev). ■ Monitoring and evaluation is not receiving the attention it warrants A consensus holds that insufficient attention is paid to monitoring and evaluation issues and feedback loops during the program design process of most ICT in education initiatives. ■ The issues are known, but tools and data are missing In general, many of the issues and challenges associated with ICT in education initiatives are widely known by experts and advanced practitioners in the field (although this general awareness does not appear to extend to most policymakers, donor staff and educators new to ICT use in education). However, data on the nature and extent of these issues remain limited in most places because of the lack of monitoring and evaluation tools and methodologies dealing with the use of ICTs in schools and their impact on teaching and learning. ■ Much of the work done to date may suffer from important positive biases Where evaluation data is available and monitoring and evaluation projects have occurred, much of such work is seen to suffer from important biases. ■ No common set of indicators There are no common international usage, performance and impact indicators for ICTs in education. Examples of monitoring and evaluation indicators and data collection methods exist from many countries. The process for the development of ICT in education indicators is the same as the process for the development of indicators in other fields. Monitoring and Evaluation 9 ■ Few international comparative evaluations have been done There have been very few international evaluations of impact of ICT use in education. Those that exist rely in large part on self-reported data. ■ Quantitative data related to infrastructure has been the easiest to collect Quantitative data, typically related to the presence and functionality of ICT-related hardware and software, are seen as the easiest to collect, and most monitoring and evaluation indicators and collection efforts have focused on such data. In general, there has been a greater emphasis on technical infrastruc- ture issues than on program design, monitoring and evaluation, training and on-going maintenance/ upgrades issues. ■ Data collection methods are varied Data collection methods are quite varied. The use of the Internet to collect data, and for self-assessment, especially in LDCs, has not been very successful and is seen as problematic. ■ A reliance on self-reported data Qualitative indicators have focused to a large report on self-reported data. ■ ICTs are not being well used in the M&E process There is a general belief that the communication potential of ICTs to facilitate feedback from findings of monitoring and evaluation work, to create and sustain communities of interest/practice, and to provide information and communication linkages with other communities is being under-utilized. COMMENTS General comments ■ Simply put: A lot of work needs to be done in this area if ICTs are to become effective and integral tools in education, and if impact is to be demonstrated to donors and communities financing ICT- related initiatives in education! ■ Bias is a very real issue in most of the monitoring and evaluation work done of ICT in education issues across the board. Such biases are often introduced at the monitoring and evaluation design stage, and include a lack of relevant and appropriate control groups, biases on the part of ‘independent evaluators’ (who often have a stake in seeing positive outcomes), and biases on the part of those evaluated (who may understandably seek to show that they have made good use of investments in ICTs to benefit education). The opportunity for such biases (which are usually positive biases) are especially acute where there a great reliance on self-reported data. ■ There appears to be a lack of institutional and human resource capacity to carry out independent evaluations of ICT in education initiatives by local organizations in LDCs (which increases the cost of such activities and potentially decreases the likelihood that the results will be fed back into program design locally). ■ A general lack of formal monitoring and evaluation activities inhibits the collection and dissemination of lessons learned from pilot projects and the useful formation of necessary feedback loops for such lessons learned to become an input into educational policy. Where such activities have occurred, they focus largely on program delivery, and are often specific to the project itself. Applicability to LDC/EFA context ■ The issues highlighted above are particularly acute in most developing countries. ■ Developing in-country capacity for monitoring and evaluation work will be vital if ICT in education investments are to be monitored and evaluated at less cost. ■ The opportunity costs of monitoring and evaluation work related to ICT in education interventions are potentially great, as there is typically a limited number of people able to do such work, and schools typically have little room in their calendars to participate in such activities. This is especially true where control groups are needed for interventions in rural and/or hard to reach areas—particular areas of interest for educational investments targeting education-related MDGs. That said, given the potential implications 10 Knowledge Maps: ICT in Education of costly mistakes in this field, especially in countries with education budgets that are severely constrained, investing in monitoring and evaluation in this field should be considered money well spent. ■ Attention to equity issues needs to be included in all monitoring and evaluation efforts related to the uses of ICTs in education. While the introduction of ICTs in LDCs is seen as a mechanism to reduce the so-called ‘digital divide’, in most cases such introductions serve to increase such divides, at least initially. Some areas for further investigation and research ■ In general, there is a pressing need for additional work related to performance indicators to monitor the use and impact of ICTs in education. ■ What would be a useful set of ‘core’ indicators that could be used across countries? ■ How have monitoring and evaluation studies related to the uses of ICTs in education been conducted in LDCs, and what can we learn from this? ■ How should monitoring and evaluation studies of the impact of ICTs in education in LDCS be con- ducted? Some Recommended Resources to learn more …. ■ Assessing the Impact of Technology in Teaching and Learning: A Sourcebook for Evaluators [Johnston 2002] ■ Comparative International Research on Best Practice and Innovation in Learning [Holmes 2000] ■ Consultative Workshop for Developing Performance Indicators for ICT in Education [UNESCO- Bangkok 2002] ■ Developing and Using Indicators of ICT Use in Education [UNESCO 2003] ■ The Flickering Mind: The False Promise of Technology in the Classroom and How Learning Can Be Saved [Oppenheimer 2003] ■ Monitoring and Evaluation of Research in Learning Innovations—MERLIN [Barajas 2003] ■ The Second Information Technology in Education Study: Module 2 (SITES: M2) [ISTE 2003] ■ Technology, Innovation, and Educational Change—A Global Perspective. A Report of the Second Information Technology in Education Study, Module 2 [Kozma 2003] ■ World Links for Development: Accomplishment and Challenges, Monitoring and Evaluation Reports [Kozma 1999, 2000] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the research literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of everything that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge mapping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millennium Development Goals (MDGs). Monitoring and Evaluation 11 KNOWLEDGE MAP: EQUITY ISSUES: GENDER, SPECIAL NEEDS AND MARGINALIZED GROUPS GUIDING QUESTIONS: ■ What do we know about equity issues as they relate to ICTs in education, and how they are being / can be addressed? ■ What is known about how ICTs can be used to reach marginalized groups (economic, linguis- tic, cultural, gender) to benefit education, and This Knowledge Map is an excerpt how ICT use may have differential impact on such groups? from the publication, Knowledge Maps: ICTs in Education: What Do CURRENT KNOWLEDGE- We Know About the Effective Uses BASE of Information and Communica- What we know, what we believe -- tion Technologies in Education in and what we don’t Developing Countries? produced by the Information for Development General Program (infoDev). ■ Equity issues are critical — and acute It is clear that there are critical equity issues related to the uses of ICTs in education. There is a real danger that uses of ICTs can further marginalize groups already excluded or marginalized from existing educational practices and environments. That said, ICT use also holds very real promise for facilitating greater inclusion of such groups into existing educational practices and environments as well. Special Needs and Disabilities ■ Solid documentation from OECD countries There is a richly documented history of what works – and what doesn’t – related to the uses of ICTs to assist in the education of students with a variety of disabilities, both cognitive and physical based on OECD experience. Certain applications of ICTs have been shown to have positive and important effects on the educational development of students exhibiting a great variety of special needs (including blind, deaf, and learning disabled students). ■ Accessibility issues well documented There is a large and rich literature of best practices and lessons learned related to accessibility issues related to the use of ICTs in education based on OECD experience. Equity issues: Gender, Special Needs and Marginalized Groups 13 ■ Applicability to LDC context under-studied That said, there is very little study of uses of ICTs as they relate to the educational requirements and circumstances of ‘special needs’ students in LDCs. ■ Impact on motivation varies While ample evidence exists that ICT use can have a positive impact on student motivation, such gains in motivation tend to correlate most closely with students who are already the most academically motivated and highest achievers. Gender ■ Lots of research from OECD countries There is a large and robust research literature on gender issue related to ICTs in education (access to, attitudes towards, uses of, and impact of ) in OECD countries. ■ Some research from LDC experience There is limited but emerging quality research into such issues in LDCs. ■ What is known has not been mainstreamed There appears to be little mainstreaming of lessons learned in this area into educational practice of using ICTs in LDCs, although the need to do so is almost universally acknowledged. Marginalized & indigenous groups ■ Impact on marginalized groups is being studied, but lessons are slow to emerge While ICTs are increasingly being used in pilot projects to aid in the education of marginalized and/or indigenous groups in LDCs, there is very little impact data to date on impact and cost effectiveness of such programs, and there have not been many nor case studies and lessons learned from such programs (many of which are on-going). ■ Some useful lessons from OECD experience That said, there is literature on the use of ICTs to ‘reach out’ to marginalized and indigenous groups in OECD countries, most notably from Canada and Australia. ■ Cultural context is all important It is clear that ICT in education interventions targeting marginalized and indigenous groups must place ICT-related interventions within the broader cultural and social contexts that frame education in issues in such groups more generally. Failure to do so may result in minimal (or deleterious) results from such programs. COMMENTS General comments ■ To date, much of the research in this area has focused on access-to-ICT issues as they relate to equity. However, less work has been done surrounding how specific types of uses of ICTs impact equity issues as well. ■ Much research has focused on the impact of ICTs on learning outcomes (which, in the case of special needs students, are in many cases more compelling than for the ‘average’ student), but less on the impact of ICT of on psychological, emotional and cultural issues of teachers and learners. Applicability to LDC/EFA context ■ If education-related MDGs are to be realized, new and innovative methods for reaching out to disadvan- taged and special needs students need to assume greater prominence. ■ At the same time, where ICTs are used in education to help meet education-related MDGs, care must be taken that such use does not further marginalize already marginalized groups. 14 Knowledge Maps: ICT in Education Some areas for further investigation and research ■ What is the gender impact of ICTs in education on access, use of, attitudes toward, and learning outcomes? ■ How can/should educational content for dissemination via ICTs be produced to ensure inclusion? ■ How do the types of learning strategies fostered by the use of ICTs impact special needs and disadvan- taged students, and how do they differ by gender? ■ How do different ICT applications, audio/verbal versus visual representations of educational content, and communicative modes impact communicative practices and create/reinforce/ameliorate various exclusions and inclusions as curriculum and communication methods are moved on-line? ■ What are the best practices for producing, disseminating, and using educational content in audio format (including via radio) for deaf students? ■ How can issues related to ICT use for special needs and disadvantaged students by introduced into teacher professional development activities, and what are best practice examples of such activities? ■ What are the emotional, psychological and cultural impacts of ICT use on learners from disadvantaged, marginalized and/or minority communities? ■ What is the impact of the promotion of collaborative activities in groups facilitated by ICTs on students with little interest or background in computers, and what practices can better promote their inclusion? ■ Are there differential impact of ICT use in education on identifiable sub-groups of boys and girls? ■ How can ICTs be utilized to attract and retain out-of-school and at-risk students (for example, through improved communication and provision of alternative modes of learning)? ■ How can ICTs be used to reach out to and teach illiterate youth? Some Recommended Resources to learn more …. ■ Effective Use of Information and Communication Technology (ICT) to Enhance Learning for Disadvantaged School Students [Blackmore 2003] ■ Engendering ICT: Ensuring Gender Equality In ICT for Development [World Bank 2003] ■ Gender issues in the use of computers in education in Africa [Derbyshire 2003] ■ ICT Based Solutions for Special Educational Needs in Ghana [Casely-Hayford 2003] ■ Inclusive Learning and Teaching - ILT for Disabled Learners [Becta 2003] ■ Overcoming the Gender Digital Divide: Understanding ICTs and their Potential for the Empowerment of Women [Huyer 2000] ■ Preparing Disadvantaged Youth for the Workforce of Tomorrow [Teens and Technology Round Table 2002] ■ A Review of Good Practice in ICT and Special Educational Needs for Africa [Casely-Hayford 2003] ■ Special Educational Needs and ICT provision [Becta 2003] ■ Understandings of Education in an African Village: The Impact of Information and Communication Technologies [Pryor 2003] ■ What the Research Says about Special Education Needs [Becta 2003] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the research literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of everything that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge mapping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millennium Development Goals (MDGs). Equity issues: Gender, Special Needs and Marginalized Groups 15 THEME 2: COSTS KNOWLEDGE MAP: COSTS GUIDING QUESTIONS: ■ What is known about the cost of using ICTs in education? ■ What is known about costing and budgeting for ICT use in education? ■ What is known about the costs of ICT- enhanced distance learning? This Knowledge Map is an excerpt from the publication, Knowledge CURRENT Maps: ICTs in Education: What Do KNOWLEDGE BASE We Know About the Effective Uses What we know, what we believe -- of Information and Communica- and what we don’t tion Technologies in Education in General Developing Countries? produced ■ Little is known about the true costs of ICTs by the Information for Development in education Program (infoDev). Few good, rigorous cost studies of ICTs in education exist in LDCs (and surprisingly few in OECD countries as well). ■ Even less is known about cost effectiveness, especially in LDCs Even fewer studies of cost-effectiveness of ICT in education initiatives in LDCs exist. ■ Opportunity costs under-studied as well Little research exists into opportunity costs related to ICT in education investments – this is especially relevant, and problematic, given the resource scarcities that define many LDCs seeking to meet educa- tion-related MDGs. ■ ICTs seen as playing a useful role in many LDCs by driving efficiencies in the sector as a whole It may be that the most cost effective uses of ICTs to benefit education in LDCs at this time – at least in the near term – may be in their roles to improve organizational and systemic efficiencies (including use as tools to combat corruption in the education sector). ■ Widespread roll-out of ICTs in education in LDCs generally felt to be too expensive Given existing resources constraints and lack of adequate supporting technical, commercial and human infrastructure, widespread, ubiquitous uses of ICTs in education are not believed to be currently possible in most LDCs. ■ More compelling evidence for use at secondary, tertiary and higher education levels For cost reasons alone, UNESCO has concluded that, in many countries it is probably unrealistic to consider deploying computers in primary schools. At secondary level, where there may be strong Costs 19 curricular arguments for some investment, this is likely to make for significant increases in total educa- tional expenditure if it is to allow students more than rare and occasional access to computers. ■ Computers in schools may be most cost-effective when placed in common areas The few available cost figures suggest that many countries may want to deploy computers in school libraries, in teacher-training institutions and perhaps in community telecentres (although these may possibly be school-based), but stop short of seeking to do so in every classroom. ■ Best treatment of cost issues was published in 2001 The best general examination of relative costs of ICT initiatives to help realize education-related MDGs can be found in Applying New Technologies and Cost-Effective Delivery Systems in Basic Education; published in 2001, it remains little improved upon today. Distance education ■ Economies of scale are available in distance education, but have large up-front costs Economies of scale are achievable in distance education investments; such investments typically require large up-front costs (which may make them good candidates for donor support). ■ There is compelling evidence for use of distance education in teacher training Teacher professional development has been shown to be less costly when delivered through distance education. ■ Cost per graduate may be much higher than cost per participant Given higher drop-out rates associated with some distance learning initiatives, costs per graduate may be much higher than cost per learner. ■ Distance education provides opportunity for cost shifting Distance education often allows some costs to be shifted from the public sector onto participants/ learners themselves (and/or their communities). While this reduces public expenditure, it may give rise to equity issues. Total Cost of Ownership (TCO) ■ TCO is typically underestimated in planning exercises “Total cost of ownership” (TCO) is often underestimated, sometimes grossly, when calculating costs of ICT in education initiatives. Estimates of initial costs to overall costs vary widely, typically they lie between 10-25% of total cost. ■ TCO toolkits exist in OECD countries TCO toolkits for education exist, based on circumstances in OECD countries. Little evidence exists of their use in LDC environments. ■ On-going recurrent costs are under-studied Little research exists regarding on-going recurrent costs over time of ICT in education initiatives in LDCs. ■ There are real costs associated with successful planning for these types of initiatives Costs of planning for ICT use in education are often overlooked or underestimated, but are essential. ■ Training costs are not uniform Training costs of both end users and those involved in infrastructure maintenance related to ICT in education investments in LDCs vary quite widely. ■ Different types of costs vary over time Hardware costs typically decrease, often quite dramatically, over time. Software costs are typically quite low as a percentage of overall investment, and remain so over time. Maintenance and training costs vary greatly, and typically do not decrease over time. ■ Lack of guidance on how to conduct TCO studies In addition to lack of data, there is a lack of case studies and toolkits on how to conduct TCO and cost effectiveness research. Where such case studies and toolkits exist, they have largely been designed for corporate settings and/or for OECD circumstances. 20 Knowledge Maps: ICT in Education Internet ■ Internet connectivity costs vary tremendously Costs related to the provision of Internet connectivity appear to vary greatly, both between and within countries, and depend on a wide variety of factors, including existence of existing delivery infrastructure, nature of Internet provider (public/private/monopoly), and the nature of Internet technology (dial-up, lease line, ADSL, cable, satellite, wireless). ■ e-Rates can improve access “E-rates”, or special national/regional tariffs for Internet access by schools, have been shown to increase Internet access in OECD countries, although resulting cost data may not be relevant to LDCs environ- ments. Costs associated with specific types of ICTs ■ Radio may be the most cost-effective form of ICT Interactive radio instruction (IRI) has been shown to offer significant cost savings in some circumstances. Computers are seen to be much more costly (up to ten times more expensive), as is television. ■ Cost savings from open source and thin client solutions are (as yet) unproven Many claims about cost savings from the use of “open source” software and “thin client solutions”) in education have been made, but little reliable and/or persuasive hard cost data exist to support such assertions. ■ Donated and refurbished equipment can carry significant costs The use of donated computer equipment contains many hidden costs that may make their usage more expensive over time than the purchase of new equipment. ■ ICT-related costs often viewed on a marginal cost basis in OECD countries Use of ICTs in education is often treated on a marginal cost basis, with quality/impact gains possible as ICTs supplement/complement existing programs. Financing mechanisms ■ Financing mechanisms are varied Financing mechanisms for ICT in education initiatives are quite varied. Due to the high up-front costs and large recurrent costs, countries and communities typically employ a great variety of financing and cost recovery mechanisms. ■ Costs savings from public-private partnerships are unclear Public-private partnerships are seen as an important component of financing mechanisms for ICT in education initiatives, although little research has been done in this area. ■ Cost recovery at user level is attractive, but problematic Cost recovery at the user level is seen as an important tool to finance and maintain ICT in education initiatives, although many barriers (legal, regulatory, administrative, cultural, and equity) exist compli- cating attempts at cost recovery. COMMENTS General comments ■ Much work needs to be done related to the costs of ICT in education investments. ■ The lack of reliable cost data in virtually all areas is quite striking. ■ Given the lack of reliable cost data, the lack of reliable cost effectiveness studies should come as little surprise. Applicability to LDC/EFA context ■ Before large scale investments in ICTs to benefit education and to help meet education-related MDGs, much more work needs to be done on the cost issue. ■ The relevance of existing cost data related generated in OECD countries related to ICT use in education in OECD countries is questionable for many reasons. For example: While labor costs in general are Costs 21 typically lower in LDCs, labor costs in LDCs related to the ICT sector may be much higher compared to other costs in the education sector. In addition, hardware costs may in many cases be higher in LDCs than in OECD countries, due to important restrictions, customs, taxes, less competition among vendors, etc. ■ Toolkits, based on OECD experience, exist to help in measuring costs of ICT use in education, but do not appear to have been widely used in LDC contexts. Some areas for further investigation and research ■ Significant work needs to be done related to the costs of ICT in education initiatives in LDCs. All of the claims listed above found in current literature deserve additional scrutiny. Most cost studies neglect to ask perhaps the most fundamental question: Can you reach the same educational goals and objectives in a different manner at less cost without using ICTs? ■ What is the Total Cost of Ownership (TCO) for computers in a variety of educational settings, at both the school and system level? How should we calculate such figures? ■ What are the costs/benefits of situating ICTs for use in schools outside of computer classroom? ■ How can public-private partnerships be used to ‘cut costs’ and what are the resulting cost savings (if any)? Some Recommended Resources to learn more …. ■ A Chance to Learn: Knowledge and Finance for Education in Sub-Saharan Africa [World Bank 2001] ■ Applying New Technologies and Cost-Effective Delivery Systems in Basic Education. World Education Forum Education For All 2000 Assessment [Perraton 2001] ■ Computers in secondary schools in developing countries: An analysis of costs [Cawthera 2001] ■ Cost analysis of information technology projects in education: experiences from developing countries. Measuring and managing the costs of ICTs in Latin American schools [Potashnik 1996] ■ The Costs of Computers in Classrooms Data from Developing Countries [Bakia 2000] ■ Enhancing Learning Opportunities in Africa: Distance Education and Communication Technologies for Learning [Murphy 2002] ■ Fighting Corruption To Improve Schooling: Evidence From a Newspaper Campaign In Uganda [Reinikka 2004] ■ Financing of Education in East Asia: EFA and beyond [Rose 2002] ■ Sustainability Challenge - Taking EdTech to the Next Level [EDC 2003] ■ Taking TCO to the Classroom [COSN 2000] ■ Teacher Education through Distance Learning: Technology, Curriculum, Evaluation and Cost [UNESCO 2001] ■ Total cost of ownership (TCO): A review of the literature [Scrimshaw 2003] ■ The True Cost of Ownership [McKenzie 2003] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the research literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of everything that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge mapping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millennium Development Goals (MDGs). 22 Knowledge Maps: ICT in Education THEME 3: CURRENT IMPLEMENTATIONS OF ICTs IN EDUCATION KNOWLEDGE MAP: CURRENT PROJECTS AND PRACTICES GUIDING QUESTIONS: ■ What do we know about how ICTs are being used for teaching and learning? ■ What do we know about how ICTs are currently being used in education in develop- ing countries? ■ What is known about donor investments in This Knowledge Map is an excerpt ICTs as part of their support for education? from the publication, Knowledge CURRENT Maps: ICTs in Education: What Do KNOWLEDGEBASE We Know About the Effective Uses What we know, what we believe of Information and Communica- — and what we don’t tion Technologies in Education in Developing Countries? produced How ICTs are currently being used in by the Information for Development schools Program (infoDev). ■ ICT use is increasing In general, uses of ICTs in education in both OECD countries and LDCs are seen as increasingly widespread and continuously growing. That said … ■ ICTs are typically used only for brief periods each month In general we know that there is limited contact time per month using ICTs by both teachers and students, and even less time spent with reliable internet access, even in OECD countries. Contact time with ICTs and teacher- and student/ICT ratios vary widely. ■ ICT use in schools in the United States is not great Even in the United States, in the areas where one would expect to see the largest potential gains— students acquiring information, demonstrating and communicating content understanding in specific school subjects—ICTs are used only rarely. Reasons for this include scheduling issues inhibiting access to ICTs, lack of congruence between curriculum demands and ICT use, and lack of convenient access to ICTs. ■ Most common uses in the United States can be grouped into four categories In the United States, frequent computer experiences occur primarily in four contexts: computer educa- tion (basic ICT literacy); business/vocational preparation; exploratory uses in primary school; and word processing and presentation software. ■ Very little is known about just how (and how often) ICTs are used in LDCs While there is a great deal of knowledge about how ICTs are (and are not) being used in OECD countries, there is not much data on how ICTs are being used in schools in LDCs. Current Projects and Practices 25 ■ Content filtering has important impacts Even where Internet access is reliable, content filtering affects access in important ways. Where internet access is available, it is often limited in frustrating ways for teachers and students, by content filters designed to protect students from inappropriate material. Where filters are not available, there is a greater reluctance to access the internet in school because of fear of exposure to inappropriate material. ■ Teacher use lags behind student abilities Students use ICTs in much more sophisticated ways than teachers. In OECD countries, students themselves are figuring out ways to take advantage of the communication potential of ICTs for learning in a self-organized, ad hoc manner that correlates closely with their own personal uses of ICTs in their daily lives. Communication tools and applications (such as chat, e-mail and SMS) appear to be under- utilized in education environments. ■ Use by teachers and administrators outside of school under-studied There is little knowledge of teacher and school administrator use of ICTs outside of school, and how this relates to in-school use of ICTs. Landscape of initiatives ■ ICT in education programs in Asia-Pacific are fairly well mapped ICT in education initiatives in developing countries in Asia-Pacific have been well mapped and recently documented by UNESCO’s Bangkok office. ICTs are being used quite extensively throughout the region in education activities. ■ ICT in education programs in Africa have been mapped to a decent extent In Africa, Schoolnet Africa and Imfundo (through its KnowledgeBank) have done a decent job of cataloguing ICT in education initiatives in Africa, although most data appears to be a few years old. It is notable that, even in some of the most challenging environments, such as those found in the first twelve countries participating in the so-called Fast Track Initiative (FTI), most of which are in sub-Saharan Africa, ICTs are being used to help meet education objectives. Interestingly, ICTs are mentioned explicitly (if obliquely) in the official government requests to participate in the FTI. That said, most such initiatives are small pilot projects, loosely (if at all) coordinated with other education initiatives (and the Ministry of Education), and often in partnership with outside NGOs and donor agencies. ■ Less is known about ICT use in education other developing countries No comprehensive mapping exists of ICT in education initiatives throughout Latin America (although initiatives in some individual countries are quite well documented), the Caribbean or Eastern Europe/ Central Asia. ■ It is very difficult to identify ICT components in donor-supported education projects It is extremely difficult to identify where donor-supported education initiatives, including those funded by the World Bank, utilize ICT components and, where such components are identifiable, it is quite difficult to identify the size of such investments, for a variety of reasons. ■ Donor education experts often have little knowledge of ICT use in education issues Many task managers working on education projects in donor agencies have incomplete knowledge of uses of ICTs for education in their countries. It is surmised that this relates to the fact that most ICT interventions in the education sector in many developing countries – especially the poorest, and especially in Africa – have been through small, uncoordinated pilot projects. In addition, there is a tension in many donor organizations between those who feel that the use of ICTs in education is an unaffordable luxury for countries struggling to meet Education For All (EFA) targets, and those who feel that, given the pressing and often seemingly intractable challenges faced by these countries, it is hard to see how some targets can be reached without considering the use of ICTs. Typical uses for ICTs in education in donor-supported projects ■ ICT components in donor-supported education projects can be divided into five categories Where large scale donor-supported education projects exist that utilize ICTs in the target countries to 26 Knowledge Maps: ICT in Education benefit education, ICT components typically help in (a) supplying computers and connectivity and building school computer labs; (b) enabling instruction in computer programming and computer literacy; (c) (to a lesser extent) developing and disseminating new curricula in electronic format; (d) distance learning (especially as it relates to teacher professional development); and (e) enabling better administration in the education sector (particularly through the development of education management information systems, or EMIS). ■ Where ICTs are used for learning, they are chiefly used to present and disseminate information Where ICTs are used in donor-supported projects at a large scale in teaching, to support subjects other than computer programming and computer literacy in the target countries, they are typically used as tools for presentation. The justification for and rhetoric surrounding such implementations often cite the potential role of ICTs to promote and develop a set of “twenty-first century skills” related to critical thinking, information evaluation and reasoning, collaboration, and international awareness. However, in most cases ICTs are largely used in schools to teach ICT skills. Issues in identifying ICT components in World Bank (and other donor-supported) education projects ■ No common vocabulary for ICT use in education projects There is a lack of consensus about definitions of ICTs as used in education. Perhaps for this reason, no comprehensive mandated standards exist with which ICT components in education projects can be coded. ■ Existing data is dicey Existing World Bank studies and figures related to the ICT components in World Bank education projects are problematic. The methodologies used in the studies are either highly questionable and/or very difficult to reproduce, and never explicit. Internal World Bank data is incomplete and/or confusing relating to the uses of ICTs in World Bank education projects. ■ No standard coding at the World Bank There is no standard coding for ICT components in World Bank, or other donor-supported, projects. Where codes have been developed, they typically focus more on the presence of easily identifiable, physical information infrastructure components (computers, routers, televisions, software purchases) than on other ‘softer’ components, especially those related to services (training, curriculum development, systems integration, custom software development, on-going maintenance). In addition, procurement guidelines and thresholds often obfuscate the presence of ICT components, which are often believed to be purchased piecemeal and/or combined with other goods or services. This is true for the World Bank as for other donors (including the Asian Development Bank and the European Commission/Union). ■ EMIS implementations are widely used and easy to find Documentation relating to the use of EMIS, explicitly mentioned in official EFA documents as impor- tant ICT tools to use related to EFA goals, is easy to find. Based on feedback from World Bank educa- tion task managers and other ICT in education practitioners, such components of education projects are mostly of less interest than the uses of ICTs as teaching and learning tools. ■ The PAD is the best source of information at the World Bank The best source of information about the existence of ICT components in World Bank education projects is the “project appraisal document” (PAD). However, anecdotal evidence suggests that ICT components in such projects, even when they are identifiable, are often not implemented as outlined in the PAD, and it is difficult to determine where such changes have occurred, given current reporting guidelines and practices. ■ ICT investments are often multi-sectoral By their very nature, investments in ICTs are often multi-sectoral, and thus uses of ICTs to benefit education can be found in projects mapped to other sectors (considered to be ‘outside’ the education sector). This is an artificial / bureaucratic distinction that may well result in a systematic underestimation of the impact of ICTs investments on education in donor-financed projects. Current Projects and Practices 27 COMMENTS General comments ■ Locating and identifying the uses of ICTs to benefit education in developing countries is a tedious, difficult, time-consuming and ad hoc task. ■ No standard reference or methodology exists for identifying such investments. ■ Observations and conclusions on how ICTs are actually used in schools are drawn almost exclusively from OECD experience. Little such data exists for LDCs, and essentially none for countries most at risk of meeting education-related MDGs. Applicability to LDC/EFA context ■ If ICTs are to be useful in helping to meet education-related MDGs, it will be necessary to identify where such investments have been made, and their magnitude, so that comparative and cost/benefit analyses can be conducted. At present, this is not an easy task. ■ Emerging evidence from OECD countries suggests that even massive investments in ICTs in schools may not bring about the desired changes in teaching and learning processes unless such investments are supported by similar initiatives to improve access to ICTs outside of the school environment. This may be especially important for uses of ICTs to support EFA goals, as effective use in school may require high levels of access outside school if gains in such investments are to be maximized, especially where ICTs are to be used for communication purposes. Some areas for further investigation and research ■ How should ICT components in education projects supported by donors be identified and quantified? ■ How does access to and use of ICTs outside school impact the use and impact of ICT use in school? Some Recommended Resources to learn more …. ■ Best Practices for Technology Utilization in High Schools: A Delphi Research Report [Clark 2003] ■ COL Experiences in ICT for School Education [Menon 2003] ■ Distance Education and Technology in Sub-Saharan Africa [Saint 2000] ■ Experts’ Meeting for Documenting Experiences in the Use of ICT in Education and SchoolNet Operations [UNESCO 2003] ■ ICTs in African Schools Workshop: Workshop Report [SchoolNet Africa 2003] ■ Information and Communication Technologies @ the World Bank: Overview of Roles of Central Units [World Bank 2004] ■ IICTs and MDGs: A World Bank Perspective [World Bank Group, 2003] ■ Information Infrastructure: The World Bank Group’s Experience [Barbu 2001 ■ Imfundo KnowledgeBank [imfundo 2004] ■ Integrating ICTs into Education: Lessons Learned [UNESCO-Bangkok 2004] ■ Metasurvey on the use of Technologies in Education in Asia and the Pacific (2003-2004) [Glen Farrell 2003] ■ New Perspectives for Learning: Insights from European Union funded Research on Education and Training [European Commission DG for Research 2003] ■ Task Managers’ ICT Toolkit: A Route Map for ICT Components In World Bank Projects [World Bank 2004] ■ Task Managers’ ICT Toolkit: Good Practice for Planning, Delivering, and Sustaining ICT Product [World Bank 2004] ■ Ten Lessons for ICT and Education in the Developing World [Hawkins 2000] 28 Knowledge Maps: ICT in Education ■ Technology in World Bank Education Projects: An Operational Review – Fiscal Years 1997 to 2000 [Georgiades, unpublished] ■ World Bank Projects Database [World Bank 2004] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the research literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of everything that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge mapping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millennium Development Goals (MDGs). Current Projects and Practices 29 KNOWLEDGE MAP: SPECIFIC ICT TOOLS GUIDING QUESTIONS: ■ What do we know about which ICTs are most useful to benefit education? ■ What do we know about the usefulness, appropriateness and efficacy of specific ICTs (including radio television, handheld devices, computers, networked computers and the This Knowledge Map is an excerpt Internet) for educational purposes? ■ What do we know about the use of open from the publication, Knowledge source and free software in education? Maps: ICTs in Education: What Do We Know About the Effective Uses CURRENT of Information and Communica- KNOWLEDGEBASE tion Technologies in Education in What we know, what we believe -- Developing Countries? produced and what we don’t by the Information for Development Program (infoDev). General ■ The Internet is not widely available in most LDCs; radio and TV are Broadcast technologies such as radio and television have a much greater penetration than the Internet throughout much of the developing world, and this substantial gap is not expected to be closed soon. ■ Radio and TV can have high start-up costs, and reinforce existing pedagogical styles Educational initiatives that utilize radio and television typically have quite high initial start-up/capital costs, but once they are up and running, on-going maintenance and upgrade costs are much lower (making initiatives utilizing radio and TV for distance learning in the educations sector particularly appealing for donor support in many cases). One-to-many broadcast technologies like radio and television (as well as satellite distribution of electronic content) are seen as less ‘revolutionary’ ICTs in education, as their usage is seen as reinforcing of traditional instructor-centric learning models, unlike computers, which many see as important tools in fostering more learner-centric instructional models. ■ Radio instruction has been used widely and is reasonably well-studied Radio instruction in formal education has been well-studied, especially the links between the use of radio in combination with school-based educational resources and a variety of pedagogical practices. ■ TV has been used with success in a few places Television has been utilized successfully as a mechanism for reaching out-of-school youth in a number of countries, especially in Latin America and China, and the results of such projects have been widely disseminated. Specific ICT Tools 31 ■ In some cases, where markets have been liberalized, ICTs are used to distribute educational content regionally within a country Market liberalization has in many countries allowed for the development of locally- (as opposed to centrally-) controlled distribution channels that utilize ICTs (like radio and the Internet, and to a lesser extent television) to create and broadcast educational content more targeted to the needs of specific communities, and as a result have a greater flexibility to employ local languages. ■ CAI is not highly regarded by experts and in OECD countries, but still receives much interest in LDCs The usefulness of computer-aided instruction (CAI), in which computers are seen as simple replacements for teachers, has been largely discredited, although there appears to still be great interest in CAI in many LDCs where computers are being introduced. ■ It is unclear where to place computers to make sure they are used most efficiently There is very little research on the most appropriate placement of computers in schools, or in the community, used to achieve various learning objectives. ■ Multi-channel learning is a useful concept The emerging practice of ‘multi-channel learning’, which focuses on enriching the educational experi- ence by engaging all resources that are available to help effect incremental change by coordinating the various ways to connect learners with information, knowledge, and stimulation, and to mediate those interactions, provides valuable insight into how blended learning approaches can be delivered and tailored in areas of great resource scarcity. ■ Satellite is much hyped, but under-studied While satellite broadcasting of electronic educational resources is thought to hold much promise, there are few case studies of successful implementation of satellite broadcasting to small LDCs. ■ New Internet technologies hold promise, but are not yet operational Emerging Internet technologies, especially recent and emerging wireless protocols (including 802.11, and shortly WiMax), are thought to hold much promise for providing connectivity to remoter areas, but projects utilizing such technologies are for the most part in pilot or planning stages, and face many regulatory hurdles. ■ Mobile Internet centers (vans, etc.) are being deployed as a way to reach rural areas A number of educational initiatives utilizing mobile Internet centers have been piloted in the past decade, but little cost and impact data has emerged from such projects. ■ Community telecenters are a hot topic, but successful, replicable models have not yet emerged Community telecenters (sometimes based in schools) have be touted as important tools to provide access to learners (including teachers engaged in personal enrichment and professional development opportuni- ties) to ICTs outside of formal school settings. ■ The use of handheld devices is just now receiving serious widespread attention Little research has been done on uses of handheld devices (including personal digital assistants and mobile phones) in education. ■ ‘Free software’ holds promise, but costs and impact are still not well documented The use of ‘free software’ is widely touted as a cost effective alternative to the uses of proprietary software (especially Microsoft products), but research in this area is largely advocatory in nature. COMMENTS General comments ■ We know that technology changes—rapidly—and newer, more cost-effective and powerful technologies will continue to emerge with potential use in education. At the same time, evidence shows that, once installed in schools, ICTs continue to be used for the functioning life of the technology, whether or not newer, more cost effective and powerful technologies emerge (especially as upgrade paths are seldom part of initial planning). ■ Much of the publicly available information about the effectiveness of particular ICT tools is generated by the companies who market such products and related services. 32 Knowledge Maps: ICT in Education Applicability to LDC/EFA context ■ While it is clear that it is the application of various ICTs that are the most important determinants of the effectiveness of such tools in education, the choices of tools are quite varied, and each has its own advan- tages and disadvantages. Policymakers and donor staff are often bombarded by information and studies from vendors on the suitability of their products or services, and there is a need for further, independent research on the appropriateness on specific tools with potential to help meet education-related MDGs. Some areas for further investigation and research ■ What models exist for the effective utilization of ICTs to support on-going professional development for educators? ■ What are the best practices for mainstreaming pilot projects involving interactive radio instruction (IRI) at the Ministry of Education, and how are such projects managed and maintained over time? ■ Where should computers reside if they are to have the greatest learning impact in education? ■ Is the use of ICTs as in-class presentation mechanisms a cost-effective use of technology? ■ How have/can handheld devices (including SMS-enabled mobile phones) be used to support education (especially related to the professional development of teachers and school administration), and what are the emerging best practices? ■ How can existing community and interactive radio networks outside the education sector be used to benefit education? ■ What successful models exist for opening ICT facilities in schools to the wider community? ■ Does the use of so-called “open source software” offer compelling benefits in education? ■ What models exist on effective public-private-community partnerships in education for ICT equipment provision and maintenance? Some Recommended Resources to learn more …. ■ African Tertiary Institutions Connectivity Study (Draft Report) [Steiner 2004] ■ Applying New Technologies and Cost-Effective Delivery Systems in Basic Education. World Education Forum Education For All 2000 Assessment [Perraton 2001] ■ Free Open Source Software — A General Introduction [Wong 2004] ■ Interactive Radio Instruction: Twenty-three Years of Improving Educational Quality [Bosch 1997] ■ Integrating ICTs into Education: Lessons Learned [UNESCO-Bangkok 2004] ■ Learning With Handhelds: Findings From Classroom Research [Vahey 2003] ■ Open Source as Appropriate Technology for Global Education [Carmichael 2004] ■ Schoolnet Toolkit [UNESCO-Bangkok 2004] ■ The Use of Information and Communications Technology (ICT) in Learning and Distance Education [Intelecon Research 2000] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the research literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of everything that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge mapping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millennium Development Goals (MDGs). Specific ICT Tools 33 KNOWLEDGE MAP: TEACHERS, TEACHING AND ICTs GUIDING QUESTIONS: ■ What do we know about successful pedagogical strategies utilizing ICTs for teaching and learning? ■ What is known about effective teacher professional development? ■ What do we know about the impact of ICTs This Knowledge Map is an excerpt on teacher performance? ■ What do we know about the impact of ICTs from the publication, Knowledge on teacher motivation? Maps: ICTs in Education: What Do We Know About the Effective Uses CURRENT of Information and Communica- KNOWLEDGEBASE tion Technologies in Education in What we know, what we believe Developing Countries? produced — and what we don’t by the Information for Development Program (infoDev). General ■ Training is key Teacher training and on-going, relevant professional development are essential if benefits from invest- ments in ICTs are to be maximized. Role of the teacher ■ Teachers remain central to the learning process A shift in the role of a teacher utilizing ICTs to that of a facilitator does not obviate the need for teachers to serve as leaders in the classroom; traditional teacher leadership skills and practices are still important (especially those related to lesson planning, preparation and follow-up). ■ Lesson planning is crucial when using ICTs Teacher lesson planning is vital when using ICTs; where little planning has occurred, research shows that student work is often unfocused and can result in lower attainment. Pedagogy ■ Introducing technology alone will not change the teaching and learning process The existence of ICTs alone does not transform teacher practices. However, ICTs can enable teachers to Teachers, Teaching and ICTs 35 transform their teacher practices, given a set of enabling conditions. Teachers’ pedagogical practices and reasoning influence their uses of ICTs, and the nature of teacher ICT-use impacts student achievement. ■ ICTs seen as tools to help teachers create more 'learner-centric' learning environments In OECD countries, research consensus holds that the most effective uses of ICT are those in which the teacher, aided by ICTs, challenge pupils’ understanding and thinking, either through whole-class discussions or individual/small group work using ICTs. ICTs are seen as important tools to enable and support the move from traditional ‘teacher-centric’ teaching styles to more ‘learner-centric’ methods. ■ ICTs can be used to support change and to support/extend existing teaching practices Pedagogical practices of teachers using ICTs can range from only small enhancements of teaching practices, using what are essentially traditional methods, to more fundamental changes in their approach to teaching. ICTs can be used to reinforce existing pedagogical practices as well as to change the way teachers and students interact. ■ Using ICTs as tools for information presentation is of mixed effectiveness The use of ICTs as presentation tools (through overhead and LCD projectors, television, electronic whiteboards, guided “web-tours”, where students simultaneously view the same resources on computer screens) is seen to be of mixed effectiveness. While it may promote class understanding of and discussion about difficult concepts (especially through the display of simulations), such uses of ICTs can re-enforce traditional pedagogical practices and divert focus from the content of what is being discussed or dis- played to the tool being utilized. Teacher technical abilities and knowledge of ICTs ■ Preparing teachers to benefit from ICT use is about more than just technical skills Teacher technical mastery of ICT skills is a not a sufficient precondition for successful integration of ICTs in teaching. ■ 'One-off training' is not sufficient Teachers require extensive, on-going exposure to ICTs to be able to evaluate and select the most appro- priate resources. However, the development of appropriate pedagogical practices is seen as more impor- tant that technical mastery of ICTs. ■ Few teachers have broad 'expertise' in using ICTs in their teaching Even in the most advanced school in OECD countries, very few teachers typically have a comprehensive knowledge of the wide range of ICT tools and resources. ■ In OECD countries, the use of ICTs to promote 'computer literacy' is seen as less important than in using ICTs as teaching and learning tools In OECD experience, the use of technology in everyday teaching and learning activities appears to be more important than specific instruction in “computer classes”. While the development of technology skills is seen to have a role in the teaching and learning process, it is more important as an enabler of other teaching and learning practices, and not too important in and of itself. Schools that report the highest levels of student ICT-related skills and experience are often not those with heavy computer course requirements, but rather ones that made use of ICTs on a routine basis throughout the teacher professional development and the teaching and learning process. ■ Students are more sophisticated in their use of technology than teachers In OECD countries, there appears to be a great disconnect between student knowledge and usage of ICTs the knowledge and abilities of teacher to use ICTs. This suggests that teacher inexperience and skill deficiencies may often be an important factor inhibiting the effectiveness of ICT use in education by students. Teacher usage of ICTs ■ Teachers most commonly use ICTs for administrative tasks Teachers most often use ICTs for ‘routine tasks’ (record keeping, lesson plan development, information presentation, basic information searches on the Internet). 36 Knowledge Maps: ICT in Education ■ More knowledgeable teachers rely less on "computer assisted instruction" Teachers more knowledgeable in ICTs use utilize computer assisted instruction less than other teachers who use ICTs, but utilize ICTs more overall. ■ How teachers use ICTs is dependent on their general teaching styles Types of usage of ICTs correlate with teacher pedagogical philosophies. Teachers who use ICTs the most—and the most effectively—are less likely to use traditional ‘transmission-method’ pedagogies. Teachers who use more types of software tend to practice more “constructivist” pedagogies. ■ Teaching with ICTs takes more time Introducing and using ICTs to support teaching and learning is time consuming for teachers, both as they attempt to shift pedagogical practices and strategies and when such strategies are used regularly. Simply put: Teaching with ICTs takes more time (estimates vary on how much extra time is required to cover the same material; 10% is a common estimate). Teacher confidence and motivation ■ Few teachers are confident users of ICTs Few teachers are confident in using a wide range of ICT resources, and limited confidence affects the way the lesson is conducted. ■ Fear prevents many teachers from using ICTs In OECD countries, many teachers still fear using ICTs, and thus are reluctant to use them in their teaching. ■ ICTs motivate (some) teachers, at least at the start At least initially, exposure to ICTs can be an important motivation tool to promote and enable teacher professional development. ■ Incentives must be developed to promote effective teacher participation in continuing professional development Teachers require additional motivation and incentives to participate actively in professional development activities. A variety of incentives can be used, including certification, professional advancement, pay increases, paid time off to participate in professional development, formal and informal recognition at the school and community levels and among peers, reduced isolation, and enhanced productivity. ■ Access to ICTs is the most significant factor in whether teachers use them The most significant factor for continuing the development of teachers’ ICT-related skills is for them to have regular access to functioning and relevant ICT equipment. Subject knowledge ■ Teachers' subject knowledge influences how ICTs are used The way ICTs are used in lessons is influenced by teachers’ mastery of their subjects, and how ICT resources can be utilized and related to them. ■ Teacher content mastery and understanding of student comprehension make ICT use more effective The evidence shows that when teachers use their knowledge of both the subject and the way pupils understand the subject, their use of ICTs has a more direct effect on student achievement. ■ Exposure to new/additional information via ICTs is not enough The effect on attainment is greatest when pupils are challenged to think and to question their own understanding, rather than on exposure to new and additional information. ■ ICTs can aid teacher self-learning in subject matter By providing access to updated and additional learning resources, ICTs can enable teacher self-learning in his/her subject area. Teachers, Teaching and ICTs 37 Teacher professional development ■ On-going teacher training and support is critical to the successful utilization of ICTs in education Teacher training and professional development is seen as the key driver for the successful usage of ICTs in education. ■ Teacher professional development is a process, not an event Traditional one-time teacher training workshops have not been seen as effective in helping teachers to feel comfortable using ICTs, let alone in integrating it successfully into their teaching. Discrete, ‘one-off’ training events are seen as less effective than on-going professional development activities. ■ Introducing ICTs expands the needs for on-going professional development of teachers Effective ICT use in education increases teachers’ training and professional development needs. However, ICTs can be important tools to help meet such increased needs, by helping to provide access to more and better educational content, aid in routine administrative tasks, provide models and simulations of effective teaching practices, and enable learner support networks, both in face to face and distance learning environments, and in real time or asynchronously. ■ Successful teacher professional development models can be divided into three phases Successful on-going professional development models can be divided into three phases: 1) pre-service, focusing initial preparation on pedagogy, subject mastery, management skills and use of various teaching tools (including ICTs); 2) in-service, including structured, face-to-face and distance learning opportuni- ties, building upon pre-service training and directly relevant to teacher needs; and 3) on-going formal and informal pedagogical and technical support, enabled by ICTs, for teachers, targeting daily needs and challenges. ■ Effective teacher professional development should model effective teaching practices Effective teacher professional development should approximate the classroom environment as much as possible. “Hands-on” instruction on ICT use is necessary where ICTs are deemed to be vital components of the teaching and learning process. In addition, professional development activities should model effective practices and behaviors and encourage and support collaboration between teachers. On-going professional development at the school level, using available ICT facilities, is seen as a key driver for success, especially when focused on the resources and skills directly relevant to teachers’ everyday needs and practices. ■ Training in assessment methods is important Professional development should include methods for evaluating and modifying pedagogical practices and expose teachers to a variety of assessment methods. ■ Effective professional development requires substantial planning A needs assessment should precede the creation of and participation in teacher professional development activities, regular monitoring and evaluation should occur of these activities, and feedback loops should be established, if professional development is to be effective and targeted to the needs of teachers. ■ On-going, regular support for teachers is crucial On-going and regular support is essential to support teacher professional development and can be facilitated through the use of ICTs (in the form of web sites, discussion groups, e-mail communities, radio or television broadcasts). Enabling factors ■ A variety of changes must be implemented to optimize teacher use of ICTs Shifting pedagogies, redesigning the curriculum and assessment, and providing more autonomy to the schools help to optimize the use of ICT. With sufficient enabling factors in place, teachers can utilize ICTs in as ‘constructivist’ a manner as their pedagogical philosophies would permit. ■ Functioning technical infrastructure is (obviously) crucial Teachers must have adequate access to functioning computers, and be provided with sufficient technical support, if they are to use ICTs effectively. 38 Knowledge Maps: ICT in Education ■ Introducing ICTs takes time Adequate time must be allowed for teachers to develop new skills, explore their integration into their existing teaching practices and curriculum, and undertake necessary additional lesson planning, if ICTs are to be used effectively. ■ Support from school administration and the community can be important Support of school administrators and, in some cases, the surrounding community, for teacher use of ICTs is seen as critical if ICTs are to be used at all, let alone effectively. For this reason, targeted outreach to both groups is often necessary if investments in ICTs to support education are to be optimized. ■ Communities of practice can be important tools to support teacher professional development The existence of formal and informal communities of practice and peer networks can be important tools to support ICT in education initiatives and activities. Such support mechanisms can be facilitated through the use of ICTs. ■ Lessons learned from introducing ICTs in education need to be shared As the introduction of ICTs to aid education is often part of a larger change or reform process, it is vital that successful uses of ICTs are promoted and disseminated. COMMENTS General comments ■ There appears to be general consensus from OECD experience as to the most effective pedagogical practices for teachers when using ICTs. ■ In addition, the barriers impeding the successful development and delivery of effective pedagogical practices are also generally agreed upon. Applicability to LDC/EFA context ■ ICTs are used in education in two general ways: to support existing ‘traditional’ pedagogical practices (teacher-centric, lecture-based, rote learning) as well as to enable more learner-centric, ‘constructivist’ learning models. Research from OECD countries suggests that both are useful, but that ICTs are most effective when they help to enable learner-centric pedagogies. ■ However, studies of ICT use in LDCs suggest that, despite rhetoric that ICTs can enable new types of teaching and learning styles, for the most part they are being used to support traditional learning practices. ■ Additional barriers to effective use of ICTs in education may well be present in LDCs beyond those identified from OECD experience. Some areas for further investigation and research ■ Can the same types of pedagogical practices and transformations thought to be enabled by the introduc- tion of ICTs be introduced and maintained in environments where ICTs are not used? ■ How can we measure outcomes of ICT use by teachers resulting from participation in professional development activities? ■ Which types of ICTs can provide the most effective and relevant support for professional development, including enabling peer networks, and how? ■ How are ICTs currently being used at the pre-service level (if at all) to train teachers in LDCs, and what can we learn from such use? ■ What are the most successful and relevant strategies for using ICTs to change pedagogical practices? Teachers, Teaching and ICTs 39 Some Recommended Resources to learn more …. ■ Breaking Down the Digital Walls: Learning to Teach in a Post-Modem World [Burniske 2001] ■ Building Capacity of Teachers/Facilitators in Technology-Pedagogy Integration for Improved Teaching and Learning [UNESCO 2003] ■ E-learning for Educators - Implementing the Standards for Staff Development [National Staff Development Council 2001] ■ Enabling Teachers to Make Successful Use of ICT [Peter Scrimshaw 2004] ■ ICT and pedagogy: A review of the research literature [Cox 2003] ■ ICT Supporting Teaching - Developing Effective Practice [Becta 2002] ■ Impacts of ICT in education. The role of the teacher and teacher training [Jager 1999] ■ Information Technology: Underused in Teacher Education [Milken Family Foundation 1999] ■ The Missing Link in Educational Technology: Trained Teachers [Carlson 2002] ■ Multichannel Learning Maximizes Scarce Resources in Developing Countries: A theory evolves from years of practical experience [EDC 2001] ■ Teacher professional development on ICT Use in Education in Asia and the Pacific: Overview from Selected Countries [UNESCO-Bangkok 2004] ■ Teachers … Training … and Technology [Haddad 2000] ■ Technology, Innovation, and Educational Change—A Global Perspective [Kozma 2003] ■ Teacher professional development on ICT Use in Education in Asia and the Pacific: Overview from Selected Countries [UNESCO 2004] ■ Teacher Professional Development in the Use of Technology [Carlson 2002] ■ Technology in Teacher Education: A Closer Look [Bielefeldt 2001] ■ Towards a Strategy on Developing African Teacher Capabilities in the Use of ICT [Schoolnet Africa 2004] ■ What styles of computer training enhance teachers’ competence and confidence to use ICT? [Edmondson 2002] ■ What the Research Says about ICT and Teacher Continuing Professional Development [Becta 2003] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the research literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of everything that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge mapping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millennium Development Goals (MDGs). 40 Knowledge Maps: ICT in Education KNOWLEDGE MAP: CONTENT AND CURRICULUM ISSUES GUIDING QUESTIONS: ■ What do we know about how ICTs can enhance access to and dissemination of educational content? ■ What do we know about the relationships between ICT use, curricula and standardized testing? ■ What do we know about language and content This Knowledge Map is an excerpt issues related to ICT use in education? from the publication, Knowledge CURRENT Maps: ICTs in Education: What Do KNOWLEDGEBASE We Know About the Effective Uses What we know, what we believe— of Information and Communica- and what we don’t tion Technologies in Education in Developing Countries? produced ■ “Accessing information” is the main use of by the Information for Development ICTs in education Program (infoDev). “Access to information” is considered to be one of the most important benefits of the uses of ICTs in education. Accessing information— not using ICTs for communication purposes—is the most common use of the Internet in schools beyond providing a tool for the development of basic computer literacy skills. ■ Learning materials in electronic format are most useful when they are directly linked to the curricu- lum The absence of educational content directly linked to curricula is one of the key inhibiters of ICT use by teachers and learners. ■ Creating digital/electronic content is difficult, and expensive Adapting and/or digitizing curricular content for access via ICTs is a lengthy and expensive process. This holds for digitized content accessible on PCs, and is especially true with regards to educational television and video production. Radio dissemination may offer cost savings. The large up-front costs related to the adaptation and/or digitization of curricular content for access via ICTs may make such initiatives attractive for donor aid. ■ Simply importing educational content is to be avoided Where indigenous educational content expertise on the uses of ICTs does not exist, it is necessary to have international and local groups work together. Simply importing existing educational content and expertise from abroad is fraught with difficulties; total reliance on local companies and organizations is often not practical in the early stages. Content and Curriculum issues 41 ■ Digital clearing houses and evergreen curricula are useful Establishing a clearing house or digital libraries of ready-to-use and customizable ICT-based resources promotes better use of ICTs in teaching and facilitates quick and easy access to resources for making lesson plans and for teaching. ■ Evaluation of ‘imported’ content for cultural relevance must not be neglected Guidelines, resources and mechanisms for evaluation of content are critical if such content is to be culturally relevant. ■ Digitizing content has important equity implications Because of large up-front costs in digitizing content, minority language use may suffer when ICTs are introduced in education and minority language users are at risk of becoming further marginalized. Because of limitations in using minority languages to disseminate content via the Internet, radio may provide a more appropriate mechanism for disseminating content in minority languages. ■ ICT use in testing requires new processes When ICTs are introduced into the testing and assessment processes and procedures, such processes and procedures need to be evaluated and possibly reconfigured. ■ Public-private partnerships can be key Public-private partnerships are often crucial for the development of digital content. ■ ICT use often promotes English language use ICT-enabled teaching and learning is often seen as an important vehicle for the development of English (and other linguas francas) language competencies by teachers and learners. This is especially true with science and mathematics instruction, which are delivered in English in many countries where English is not an indigenous or dominant local language. This raises important issues related to learner equity and access to education. ■ Intellectual property issues are very real Intellectual property issues are of tremendous importance when developing digital content for use in education. Ownership of content developed is a key issue to consider. Licensing of content is often an option, but may contain hidden costs. ■ Official guidelines and directives enhance use of ICT-enabled content Guidelines from the Ministry of Education relating to the integration of ICTs in and with the curricu- lum greatly facilitate the use of ICTs in schools. COMMENTS General ■ At first glance, content issues related to ICT use in education might seem to some to be of minor importance. After all, access to the Internet (to cite one example) means access to an entire world of educational resources. Access to the Internet provides access to seemingly endless sets of educational resources—and indeed it does. However, experience shows that there is a dearth of educational resources in a format that makes them easily accessible and relevant to most teachers and learners in LDCs, especially as they relate to a given country’s current curriculum. ■ Experience tells us that, unless electronic educational resources are directly related to the curriculum, and to the assessment methods used to evaluate educational outcomes (especially standardized testing), lack of appropriate and relevant educational content is actually an important barrier to ICT use in schools. Applicability to LDC/EFA context ■ The applicability of all content issues noted above to an LDC/EFA context is quite clear. The use of ICTs to create, disseminate and/or access educational content can have profound impacts on issues of equity and access to education. 42 Knowledge Maps: ICT in Education Some areas for further investigation and research ■ What are the best practices for creating electronic/digital curricular content? ■ What is the relationship between uses of ICTs, curricular issues and standardized testing? ■ What special issues relate to the creation, dissemination and use of curricular content in indigenous languages? Some Recommended Resources to learn more …. ■ Enhancing Learning Opportunities in Africa: Distance Education and Communication Technologies for Learning [Murphy 2002] ■ ICTs in African Schools: Using Information and Communication Technologies (ICTS) in Education: Challenges for Curriculum Integration and Strategies for Success in African Schools [Ngu 2003] ■ Interactive Radio Instruction: Twenty-three Years of Improving Educational Quality [Bosch 1997] ■ Integrating ICTs into Education: Lessons Learned [UNESCO-Bangkok 2004] ■ IT in Education Innovation for Development—Interfacing Global and Indigenous Knowledge [UNESCO- ACEID 2003] ■ The Second Information Technology in Education Study: Module 2 (SITES: M2) Case Reports [ISTE 2003] ■ Teacher Education through Distance Learning: Technology, Curriculum, Evaluation and Cost. Summary of Case Studies: Brazil, Burkina Faso, Chile, China, India, Mongolia, Nigeria, South Africa (two studies), United Kingdom [UNESCO 2001] ■ Schoolnet Toolkit [UNESCO-Bangkok 2004] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the research literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of everything that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge mapping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millennium Development Goals (MDGs). Content and Curriculum issues 43 THEME 4: PLANNING KNOWLEDGE MAP: SCHOOL-LEVEL ISSUES GUIDING QUESTIONS: ■ What do we know about effective planning for ICTs in schools at the school level? ■ What do we know about necessary school-level infrastructure to support ICTs in education? CURRENT This Knowledge Map is an excerpt KNOWLEDGEBASE from the publication, Knowledge What we know, what we believe Maps: ICTs in Education: What Do — and what we don’t We Know About the Effective Uses of Information and Communica- ■ Much is known about what work at the school level tion Technologies in Education in A great deal is known about what works – and Developing Countries? produced what doesn’t – related to implementations of by the Information for Development ICT in education initiatives at the school level, Program (infoDev). based on both OECD and LDC experience. ■ Good documentation is available Good documentation exists of specific practices and models for a great number of issues based on experience in the United States and the United Kingdom. The Commonwealth of Learning and UNESCO have adapted the models and lessons learned from such experiences, together with other experiences from LDCs, into a very useful Schoolnet Toolkit. COMMENTS General comments ■ Best practice exists for most issues relating to uses of ICTs in education at the school level. Applicability to LDC/EFA context ■ Despite the wealth of documentation mentioned above, little if any of this knowledge and information appears to have been incorporated into planning for and delivery of ICT in education initiatives in LDCs, where the ‘same old mistakes’ are often made again and again. School-level Issues 47 Some areas for further investigation and research ■ The greatest need related to this topic is for existing knowledge and information to be delivered to the relevant people in charge of ICT in education initiatives in LDCs, as well as those (in donor agencies, NGOs and the private sector) who advise or contribute to such initiatives. Short workshops could be delivered to target countries preparing to scale up ICT in education initiatives to transmit such lesson learned. ■ What are successful examples of how ICTs have been introduced and maintained in schools? ■ What types of information must be provided to schools to aid in the introduction and maintenance of ICT-related equipment and to promote ICT-related instruction? Some Recommended Resources to learn more …. ■ British Educational Communications and Technology Agency (Becta) Tools and Services ■ Consortium for School Networking (COSN) Studies and Toolkits ■ ICT and School Management A Review of Selected Literature [Passey 2002] ■ Integrating ICTs into Education: Lessons Learned [UNESCO-Bangkok 2004] ■ A Review of the Research Literature on Barriers to the Uptake of ICT by Teachers [Becta 2004] ■ Schoolnet Toolkit [UNESCO-Bangkok 2004] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the research literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of everything that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge mapping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millennium Development Goals (MDGs). 48 Knowledge Maps: ICT in Education KNOWLEDGE MAP: POLICY ISSUES GUIDING QUESTIONS: ■ What do we know about which areas are of particular relevance for ICT use in the education sector? ■ What do we know about effective policy frameworks for the uses of ICTs? ■ What do we know about the role of ICTs in This Knowledge Map is an excerpt educational reform and change? ■ What do we know about how ICTs can be from the publication, Knowledge used to enhance educational efficiency at the Maps: ICTs in Education: What Do local, regional and national level? We Know About the Effective Uses ■ What do we know about how ICTs can be of Information and Communica- used to enhance educational planning? ■ What do we know about the necessary tion Technologies in Education in enabling environment to support the introduc- Developing Countries? produced tion and on-going maintenance of ICTs in the by the Information for Development education sector? Program (infoDev). ■ What do we know about how to scale up and deliver national ICT for education pro- grammes? ■ What do we know about how ICTs can be used to combat corruption in the education sector? CURRENT KNOWLEDGEBASE What we know, what we believe — and what we don’t General ■ There is general agreement on the most important issues and best practices There is general agreement on issues impacting ICT in education policy decisions, and the broad lessons learned from ICT in education initiatives in LDCs to date. Both the general issues and general lessons learned in this regard have been well documented. Case studies and specific best practices in policy formulation and delivery have not been well documented. ■ Introducing ICTs raises important equity issues The use of ICTs in education is seen to have a great effect on equity issues in education. They are seen to preferentially advantage schools and learners in urban areas and in locations where existing infrastructure is the best in a country. ■ Changes and innovations in technology come much faster than changes in the education system The product cycle of most ICT-related products is much faster than the ‘life-cycle’ of education change Policy Issues 49 and reform. This disconnect is important. Many studies cite the usefulness of ICTs to instigate and implement educational reform as a strong reason to undertake ICT investments in education in the first place. A lack of congruence between the timelines for role out of educational reform efforts and the role out of supporting ICT tools (hardware, software, training) is a potential area of great concern, as reform may be dependent on technologies that are no longer available (and/or supported). Even within a particular educational reform process, or indeed where no reform process is on-going, the pace of technological innovation outruns the pace of institutional innovation. Existing policies ■ Different parts of government are responsible for ICT in education policies in different countries There does not appear to be a standard coordinating body responsible for the formulation of a country’s ICTs in education policies. In some countries this is strictly the purview of the Ministry of Education (which may have a separate ICT in education policy, or fold ICTs strategies into existing education policies), while in others it is handled by the Ministry of Science/Technology (if such an institution exists) as part of a larger technology or information policy, although in most cases there is no national policy at all. ■ There is no database of existing policies There is no standard repository for existing ICT in education-related national policies, although regionally the European Union has done a good job of collecting them for European countries, as has UNESCO-Bangkok in the Asia-Pacific region. ■ Successful policy requires consultation with a diverse group of stakeholders It is believed that the formulation of successful policies related to ICTs in education must include not only the Ministry of Education, but also a variety of stakeholders from other government ministries, as appropriate (often this includes the Ministry of Finance, the PTT and ministries related to science/ technology/IT, labor and rural development), communities and other civil society groups (including NGOs) and the private sector. Scaling up ■ Little is documented about the 'scaling up' of ICT in education initiatives in LDCs Little documentation exists related to the “scaling up” of large scale ICT in education initiatives in developing countries, whether as expansion of pilot projects or from scratch. ■ Models for scaling up are quite varied Models for large scale ICT in education initiatives are varied and appear to be specific to individual developing country circumstances. In some instances, these are purely government funded and directed initiatives (as in China), public-private partnerships (as in the Indian state of Karnataka), private sector initiatives directed by government (as in Malaysia), or non-governmental organizations, either affiliated with government at some point in their development (as in the cases of Chile and Thailand) or not (as is the case in the Philippines and Uganda). ■ Schoolnets are a useful tool “Schoolnets” are seen useful mechanisms both for introducing pilot initiatives in ICTs in education and as vehicles for investments at scale. Issues and guidance on developing and maintaining schoolnets have been well documented. Reform, organizational, management and efficiency issues ■ ICTs can be important drivers for educational reform Introducing ICTs in educational systems has been used as important mechanism and driver for educa- tional reform efforts in some countries. In this context, ICTs can be utilized in many ways: as both a lever for organizational change, as a vehicle to introduce new teaching and learning practices and/or as an enabler of restructuring of the educational system. 50 Knowledge Maps: ICT in Education ■ ICTs can help in anti-corruption efforts in the education sector ICTs may be useful tools in helping to combat corruption and leakage/shrinkage in the education sector. Wide dissemination of information about education budgets, objectives and priorities down to the village and school level using existing media (radio, television, print) and Internet-related technologies (web sites, discussion boards, e-mail, accessed in schools and/or at community telecenters). ■ ICTs can aid decentralization ICTs may be useful tools in facilitating the process of decentralization that is occurring as part of, or concurrent with, the efforts of Ministries of Education to meet education-related MDGs. ■ ICTs are vital for data collection and analysis ICTs can be used to facilitate education-related data collection and processing efforts in ways previously not possible. Pilot projects have shown installed basic IC infrastructure can be used to enable data collection efforts in remote areas more quickly, inexpensively and effectively than using tradition methods. One example: using handheld computers to collect EFA-related population data, which is uploaded to installed computers in schools and community telecentres, and then transmitted to central location for loading into the national EMIS. COMMENTS General comments ■ Given the lessons learned from the explosion of pilot ICT in education initiatives in developing coun- tries over the past decade, and the stated interest in many countries in exploring how/if such lessons may be relevant to the urgent needs to achieve education-related MDGs, the time appears ripe to include discussion of potential uses of ICTs in the education planning process in some countries, as relevant and desired. Applicability to LDC/EFA context ■ Where countries are interested in learning from existing pilot initiatives in using ICTs in education to help meet education-related MDGS, and/or where government is interested in utilizing ICTs at scale to meet such goals, additional work in the policy arena would (obviously) be directly applicable to such countries. Some areas for further investigation and research ■ How can/should EFA-related issues as they relate to the uses of ICTs be included in the decision-making processes of education officials? ■ Existing knowledge and information on this topic needs to get into the hands of key decision makers. ■ What ICT in education policies are currently in place, and how they address EFA-related issues? ■ How can ICTs be used to facilitate the decentralization process underway or contemplated in many Ministries of Education? ■ How can ICTs be used to combat corruption in the education sector? ■ What are the best practices from implementing education management information systems (EMIS)? ■ What regulatory issues exist related to connectivity and information access issues as they relate to the education sector, and what guidelines and best practices have emerged? Some Recommended Resources to learn more …. ■ Emerging Trends in ICT and Challenges to Educational Planning [Hernes 2001] ■ Fighting Corruption To Improve Schooling: Evidence From a Newspaper Campaign In Uganda [Reinikka 2004] Policy Issues 51 ■ A Framework for Understanding ICTs-related Innovations in Primary and Secondary Education & Policy Recommendations [SEPRYDEM 2002] ■ ICT and Educational Reform in Developing and Developed Countries [Kozma 2002] ■ ICT in Education Policy-Makers Toolkit [UNESCO-Bangkok unpublished draft] ■ Masterplan II for IT in Education [Ministry of Education, Singapore 2002] ■ A Retrospective on Twenty Years of Education Technology Policy [Culp 2003] ■ Technology in American Schools—7 Dimensions for Gauging Progress—A Policymaker’s Guide [Milken Exchange on Education Technology 1999] ■ Technology in Schools: Education, ICT and the Knowledge Society [Hepp 2004] ■ Thwarted Innovation: What Happened to e-learning and Why [Zemsky 2004] ■ Towards a Strategy on Developing African Teacher Capabilities in the Use of ICT [Schoolnet Africa 2004] ■ The World of ICT in Education: A Seminar for Policymakers [World Bank Institute 2002] About these Briefing Sheets: infoDev’s Knowledge Maps on ICTs in education are intended to serve as quick snapshots of what the research literature reveals in a number of key areas. They are not meant to be an exhaustive catalog of everything that is known (or has been debated) about the use of ICTs in education in a particular topic; rather, taken together they are an attempt to summarize and give shape to a very large body of knowledge and to highlight certain issues in a format quickly accessible to busy policymakers. The infoDev knowledge mapping exercise is meant to identify key general assertions and gaps in the knowledge base of what is known about the use of ICTs in education, especially as such knowledge may relate to the education-related Millennium Development Goals (MDGs). 52 Knowledge Maps: ICT in Education APPENDIX MILLENNIUM DEVELOPMENT GOALS (MDGS) RELATED TO EDUCATION Goal 2. Achieve universal primary education Target 3. Ensure that, by 2015, children everywhere, boys and girls alike, will be able to complete a full course of schooling Goal 3. Promote gender equality and empower women Target 4. Eliminate gender disparity in primary and secondary education, preferably by 2005, and in all levels of education no later than 2015 EDUCATION FOR ALL (EFA) GOALS (from the Dakar Framework for Action) Goal 1. Early childhood care and education expanding and improving comprehensive early childhood care and education, especially for the most vulnerable and disadvantaged children; Goal 2. Universal Primary Education ensuring that by 2015 all children, particularly girls, in difficult circumstances and those belonging to ethnic minorities, have access to and complete free and compulsory primary education of good quality; Goal 3. Learning needs of all young people and adults ensuring that the learning needs of all young people and adults are met through equitable access to appropriate learning and life skills programs; Goal 4. Adult literacy achieving a 50 percent improvement in levels of adult literacy by 2015, especially for women, and equitable access to basic and continuing education for all adults; Goal 5. Gender equality eliminating gender disparities in primary and secondary education by 2005, and achieving gender equality in education by 2015, with a focus on ensuring girls’ full and equal access to and achievement in basic education of good quality; Goal 6. Education equality improving all aspects of the quality of education and ensuring excellence of all so that recog- nized and measurable learning outcomes are achieved by all, especially in literacy, numeracy and essential life skills. Appendix. Millennium Development Goals (MDGs) related to Education . 55 NOTES ON THE DAKAR FRAMEWORK FOR ACTION Strategy #10: Harness new information and communication technologies to help achieve EFA goals ¶69: Information and communication technologies (ICT) must be harnessed to support EFA goals at an affordable cost. These technologies have great potential for knowledge dissemination, effective learning and the development of more efficient education services. This potential will not be realized unless the new technologies serve rather than drive the implementation of education strategies. To be effective, especially in develop- ing countries, ICTs should be combined with more traditional technologies such as books and radios, and be more extensively applied to the training of teachers. ¶70: The swiftness of ICT developments, their increasing spread and availability, the nature of their content and their declining prices are having major implications for learning. They may tend to increase disparities, weaken social bonds and threaten cultural cohesion. Governments will therefore need to establish clearer policies in regard to science and technology, and undertake critical assessments of ICT experiences and options. These should include their resource implications in relation to the provision of basic education, emphasizing choices that bridge the ‘digital divide’, increase access and quality, and reduce inequity. ¶71: There is need to tap the potential of ICT to enhance data collection and analysis, and to strengthen management systems, from central ministries through sub-national levels to the school; to improve access to education by remote and disadvantaged communities; to support initial and continuing professional development of teachers; and to provide opportunities to communicate across classrooms and cultures. ¶72: News media should also be engaged to create and strengthen partnerships with educa- tion systems, through the promotion of local newspapers, informed coverage of education issues and continuing education programmes via public service broadcasting. 56 Knowledge Maps: ICT in Education BIBLIOGRAPHY (note: All URLs current as of June 2005.) Given the constantly changing nature of the Internet, we suggest that you copy the document or web site title (and author name, as appropriate) into your favorite search engine to locate the current home of a given publication on the Internet if a link below is not working. Alliance For Childhood (2004). Tech Tonic: Towards a New Literacy of Technology. Available: http://www.allianceforchildhood.org/projects/computers/pdf_files/tech_tonic.pdf Alliance For Childhood (2000). Fool’s Gold : A Critical Look at Computers in Childhood Available: http://www.allianceforchildhood.org/projects/computers/computers_reports.htm Apple Computer (1995). Changing the Conversation about Teaching, Learning and Technology: A Report on 10 Years of ACOT Research. Available: www.apple.com/education/k12/leadership/acot/pdf/10yr.pdf Arias, Sonia, Jan Visser, Tony Streit and Jeffrey Goveia (2004). Basic Education, Innovation & Technology in DR Congo: Preliminary Pilot Findings & Recommendations. Available: http://www.learndev.org/dl/DRC-ProgressRpt2004.pdf Australian Council for Educational Research (date unknown). Report on the OECD PISA Student ICT Survey. Available: http://icttaskforce.edna.edu.au/documents/research/oecd_pisa_student_ict.pdf Aoki, Aya et. Al. (date unknown). Education. in PRSP Sourcebook (p.231-275). The World Bank Available: http://www1.worldbank.org/hdnetwork/efa/PRSP/PRSP%20-%20Education%20Chapter%20- %20English.pdf Bakia, Marianne (date unknown). The Costs of Computers in Classrooms Data from Developing Countries. Available: http://classroomtco.cosn.org/cic.pdf Barajas, Mario (2003). Monitoring and Evaluation of Research in Learning Innovations – MERLIN. Brussels: European Commission DG for Research. Available: http://www.ub.es/euelearning/merlin/docs/finalreprt.pdf Barbu, Alain, Rafael Dominguez, and William Melody (2001). Information Infrastructure: The World Bank Group’s Experience. Washington, DC: The World Bank. Available: http://wbln0018.worldbank.org/oed/oeddoclib.nsf/07478b6552bb9ec385256808006a0010/ 5d12991104bac1ae85256aa9007279bc/$FILE/information_infrastructure.pdf Becker, Henry Jay (2000). Findings from the Teaching, Learning, and Computing Survey: Is Larry Cuban Right? Available: http://www.crito.uci.edu/tlc/findings/ccsso.pdf Becta (2004). Inclusive Learning and Teaching - ILT for Disabled Learners. Available: http://ferl.becta.org.uk/display.cfm?resID=5708 Becta (2004). A Review of the Research Literature on Barriers to the Uptake of ICT by Teachers. Available: http://www.becta.org.uk/page_documents/research/barriers.pdf Becta (2003). What the Research Says series. Available: http://www.becta.org.uk/research/research.cfm?section=1&id=546 Becta (2003). What the Research Says about ICT and Teacher Continuing Professional Development. Available: http://www.becta.org.uk/page_documents/research/wtrs_cpds.pdf Becta (2003). What the Research Says about Special Education Needs. Available: http://www.becta.org.uk/page_documents/research/wtrs_ictsupport.pdf Bibliography . 59 Becta (2001). ImpaCT2: Emerging Findings from the Evaluation of the Impact of Information and Communications Technologies on Pupil Attainment. Available: http://www.becta.org.uk/page_documents/research/ngflseries_impact2.pdf Becta (date unknown). ICT Supporting Teaching - Developing Effective Practice Available: http://www.becta.org.uk/subsections/awards/practice_awards/documents/effectivepractice.pdf Becta (date unknown). Special Educational Needs and ICT provision. Available: http://www.ictadvice.org.uk/index.php?section=tl&rid=1955&catcode=as_inc_sup_03 Bielefeldt, Talbot (2001). Technology in Teacher Education: A Closer Look ISTE: Journal of Computing in Teacher Education ,Vol. 17 / No. 4. Available: print only Blackmore, Jill, Lesley Hardcastle, Esmé Bamblett and Janet Owens (2003) Effective Use of Information and Communication Technology (ICT) to Enhance Learning for Disadvantaged School Students Deakin Centre for Education and Change; Institute of Disability Studies, Deakin University and Institute of Koorie Eduction, Deakin University July 2003 Available: http://pandora.nla.gov.au/pan/40453/20040221/www.dest.gov.au/schools/publications/2003/ICT/ ICTreport.pdf Bosch, Andrea (2004). Sustainability and interactive radio instruction: why some projects last. in: Adapting technology for school improvement: a global perspective. David W. Chapman & Lars O. Mählck (Eds.): Paris: UNESCO: International Institute for Educational Planning. Available: http://www.unesco.org/iiep/PDF/pubs/F165.pdf Bosch, Andrea (1997). Interactive Radio Instruction: Twenty-three Years of Improving Educational Quality. World Bank Education and Technology Technical Notes Series, Volume 2, Number 1. Washington, DC: The World Bank. Available: http://www-wds.worldbank.org/servlet/WDSContentServer/WDSP/IB/1999/11/13/000094946_ 99110105304360/Rendered/PDF/multi_page.pdf Bridges.org (2003). Spanning the Digital Divide: Understanding and Tackling the Issues. Available: http://www.bridges.org/spanning/pdf/spanning_the_digital_divide.pdf Bruns, Barbara, Alain Mingat, & Ramahatra Rakotomalala (2003). Achieving Universal Primary Education by 2015 - A Chance for Every Child. Washington, DC: The World Bank. Available: http://www-wds.worldbank.org/servlet/WDS_IBank_Servlet?pcont=details&eid=000094946_ 03082204005065 Burniske, R.W., Lowell Monke and Jonas F. Soltis (2001). Breaking Down the Digital Walls: Learning to Teach in a Post-Modem World. Available: print only Caelis International (2004). The Future Role of Information and Communication Technologies in Education and Training in Asia and the Pacific. Prepared for the Asian Development Bank, April 2004. Available: print only Candy, Philip C. (2004). Linking, Thinking: Self-directed learning in the digital age. Canberra: Department of Education, Science and Training, Commonwealth of Australia. Available: http://www.dest.gov.au/research/publications/linking_thinking/ Carlson, Sam (2002). The Missing Link in Educational Technology: Trained Teachers. Available: http://www.techknowlogia.org/TKL_active_pages2/CurrentArticles/main.asp?IssueNumber=18&Fil eType=PDF&ArticleID=435 Carlson, Sam and Cheikh Tidiane Gadio (2002). Teacher Professional Development in the Use of Technology. aed.org: Technologies for Education. Available: http://www.aed.org/publications/TechnologiesForEducation/TechEdChapters/08.pdf Carmichael, Patrick and Leslie Honour (date unknown). Open Source as Appropriate Technology for Global Education. Available: http://www.col.org/tel99/acrobat/carmichael.pdf 60 Knowledge Maps: ICT in Education Casely-Hayford, Leslie and Paul Lynch (2003). ICT Based Solutions for Special Educational Needs in Ghana. An Imfundo KnowledgeBank Initiative. Available: http://imfundo.digitalbrain.com Casely-Hayford, Leslie and Paul Lynch (2003). A Review of Good Practice in ICT and Special Educational Needs for Africa. An Imfundo KnowledgeBank Initiative. Available: http://imfundo.digitalbrain.com/imfundo/web/papers/SEN/SENPHASE1FINAL.pdf CEO Forum on Education & Technology (2001). School Technology and Readiness (STaR) Report: Key Building Blocks for Student Achievement in the 21st Century. Available: http://www.ceoforum.org/downloads/report4.pdf Chapman, David W. & Lars O. Mählck (eds.) (2004). Adapting technology for school improvement: a global perspective. Paris: UNESCO International Institute for Educational Planning. Available: http://www.unesco.org/iiep/PDF/pubs/F165.pdf Clark, Kevin (2003). Best Practices for Technology Utilization in High Schools: A Delphi Research Report. Available: http://www.winwinsf.org/Delphi-final.pdf Clemens, Michael A. (2004). Long Walk To School: International Education Goals in Historical Perspective. Washington, DC: Center for Global Development. Available: http://www.cgdev.org/docs/cgd_wp037.pdf Clements, Douglas H. and Julie Sarama (date unknown). Strip Mining for Gold: Research and Policy in Educational Technology — A Response to “Fool’s Gold”. Available: http://dl.aace.org/12683 Cogan, John J. and Neil Baumgart (2003). Views of Educators and Policy Makers in the Asia-Pacific Region Towards Schooling for the Future: Survey Findings. OECD Forum on Schooling for Tomorrow. Poitiers, France: 12-14 February 2003. Available: http://www.oecd.org/dataoecd/11/11/2499015.pdf Commonwealth of Learning (2004). Connections. Vol. 9, No. 2. September 2004. Available: http://www.col.org/news/connections/ Commonwealth of Learning (2002). Distance education and open learning in Sub-Saharan Africa: A literature survey on policy and practice. Available: http://www.col.org/Consultancies/02DEinSSA_LiteratureSurvey.pdf Consortium for School Networking (COSN). Taking TCO to the Classroom. (Website) Available: http://classroomtco.cosn.org/ Consortium for School Networking (2001). A School Administrator’s Guide To Planning for the Total Cost of New Technology. Available: http://classroomtco.cosn.org/tco2class.pdf Coulombe, Serge, Jean-Francois Tremblay and Sylvie Marchand (2004). Literacy Scores, human capital and growth across 14 OECD countries. Ottawa: Canadian Ministry of Industry. Available: http://www.nald.ca/fulltext/oecd/oecd.pdf Cox, Margaret, Chris Abbott, Mary Webb, Barry Blakeley, Tony Beauchamp and Valerie Rhodes (date unknown). ICT and pedagogy: A review of the research literature. ICT in Schools Research and Evaluation Series – No.18. DfES-Becta Available: http://www.becta.org.uk/page_documents/research/ict_pedagogy_summary.pdf Cox, Margaret, Chris Abbott, Mary Webb, Barry Blakeley, Tony Beauchamp and Valerie Rhodes (date unknown). ICT and attainment: A review of the research literature ICT in Schools Research and Evaluation Series – No.17. DfES-Becta Available: http://www.becta.org.uk/page_documents/research/ict_attainment_summary.pdf Cuban, Larry (2001). Oversold and Underused: Computers in the Classroom. Available: http://www.hup.harvard.edu/pdf/CUBOVE.pdf Culp, Katie McMillan, Margaret Honey and Ellen Mandinach (2003). A Retrospective on Twenty Years of Education Technology Policy. Washington, DC: U.S. Department of Education, Office of Educational Technology. Available: http://www.nationaledtechplan.org/participate/20years.pdf Bibliography . 61 The Dakar Framework for Action: Education For All: Meeting Our Collective Commitments (2000). Dakar, Senegal: April 2000. Available: http://www2.unesco.org/wef/en-conf/dakframeng.shtm de Ferranti, David, Guillermo E. Perry, et. al. (2003). Closing the Gap in Education and Technology. Washington, DC: The World Bank. Available: http://lnweb18.worldbank.org/External/lac/lac.nsf/0/CA690C199E3E051985256C4D006C3043 ?OpenDocument de Moura Castro, Claudio (2004). Are new technologies better technologies? For whom? in: Adapting technology for school improvement: a global perspective. David W. Chapman & Lars O. Mählck (eds.). Paris: UNESCO International Institute for Educational Planning. Available: http://www.unesco.org/iiep/PDF/pubs/F165.pdf Derbyshire, Helen (January 2003). Gender issues in the use of computers in education in Africa. Available: http://imfundo.digitalbrain.com/imfundo/web/learn/documents/Gender%20Report.pdf DFID (2004). DFID Education Factsheet. September 2004. Available: http://www.dfid.gov.uk/pubs/files/education-factsheet.pdf DFID (2001). The Challenge of Universal Primary Education: Strategies for achieving the international development targets. Available: http://www.dfid.gov.uk/pubs/files/tspeducationsummary.pdf Easterly, William (2001). The Elusive Quest for Growth: Economists’ Adventures and Misadventures in the Tropics. Cambridge, MA: MIT Press. Available: print only EDC Center for Children and Technology (2003). Sustainability Challenge - Taking EdTech to the Next Level. Washington, DC: Benton Foundation. Available: http://www.benton.org/publibrary/sustainability/sus_challenge.pdf Education For All (EFA) Fast Track Initiative Progress Report (2004) Education Sector, Human Development Network, The World Bank Washington, DC: World Bank, April 25. 2004. Available: http://siteresources.worldbank.org/DEVCOMMINT/Documentation/20190709/DC2004- 0002(E)-EFA.pdf Education For All - Fast Track Initiative Framework Document (March 30, 2004, updated November 2004) Available: http://www1.worldbank.org/education/efafti/documents/FrameworkNOV04.pdf EFA-FTI Catalytic Fund Progress Report (revised). (April 23, 2004) Available: http://www1.worldbank.org/education/efafti/documents/ProgressReportApr_23_04.pdf Edmondson , Andrea (date unknown). What styles of computer training enhance teachers’ competence and confidence to use ICT? Available: http://www.becta.org.uk/page_documents/research/cpd_edmondson.pdf Education Development Center (2001). Multichannel Learning Maximizes Scarce Resources in Developing Countries: A theory evolves from years of practical experience. Washington, DC: EDC. Available: http://main.edc.org/newsroom/features/mcl2001.asp European Commission DG for Research (2003). New Perspectives for Learning: Insights from European Union funded Research on Education and Training. Issue Five, April 2003. Available: http://www.pjb.co.uk/npl/npl5.pdf Farrell, Glen (ed.) (2004). ICT and Literacy: Who benefits? Experience from Zambia and India. Commonwealth of Learning. Available: http://www.col.org/Consultancies/04Literacy.htm Farrell, Glen and Cedric Wachholz (eds.) (2003). Metasurvey on the use of Technologies in Education in Asia and the Pacific (2003-2004). Bangkok: UNESCO. Available: http://www.unescobkk.org/ips/ebooks/documents/metasurvey/ Fink, Carsten and Charles J. Kenney (2003). W(h)ither the Digital Divide? Available: http://topics.developmentgateway.org/ict/rc/filedownload.do?itemId=307615 62 Knowledge Maps: ICT in Education Fredriksson, Ulf (2003). New technologies in education: trends, risks and opportunities. Working Papers Number 1. Brussels: Education International. FTI Steering Committee Meeting of 22-23 July 2004 – Paris Minutes. Available: http://www1.worldbank.org/education/efafti/documents/minutes_SCmeeting_Aug10.pdf Gadio, Coumba Mar (2001). Exploring The Gender Impact of The World Links Program In Some Selected Participating Countries: A Qualitative Approach. Available: http://www.world-links.org/modules/Downloads/fileuploads/gender_study_v2.pdf Georgiades, Kyriakos Andrea-Maria (unpublished draft). Technology in World Bank Education Projects: An Operational Review – Fiscal Years 1997 to 2000. Available: print only (draft) Gigling, Max (2004). Needs Assessment of ICT in Education Policy Makers in Asia and the Pacific: Towards the Development of a Toolkit for Policy Makers. Bangkok: UNESCO. Available: http://www.unescobkk.org/education/ict/resources/JFIT/policy/assessmentfull.pdf Grace, Jeremy and Charles Kenny (2003). A short review of information and communication technologies and basic education in LDCs – what is useful, what is sustainable? In: International Journal of Educational Development 23 (2003), p.627-636. Available: print only Haddad, Wadi (2000). Teachers … Training … and Technology. Available: http://www.techknowlogia.org/TKL_active_pages2/CurrentArticles/main.asp?IssueNumber=8&File Type=PDF&ArticleID=190 (free registration required) Haddad, Wadi D. and Alexandra Drexler (eds.) (2002). Technologies for Education: Potentials, Parameters and Prospects. UNESCO & The Academy for Educational Development (AED). Available: http://www.aed.org/ToolsandPublications/upload/TechEdBook.pdf Hafkin, Nancy and Nancy Taggart (2001). Gender, Information Technology, and Developing Countries: An Analytic Study. Washngton, DC: AED. Available: http://learnlink.aed.org/Publications/Gender_Book/Home.htm Hawkins, Robert (2002). Ten Lessons for ICT and Education in the Developing World. Cambridge, MA: Harvard Center for International Development. Available: www.cid.harvard.edu/cr/pdf/gitrr2002_ch04.pdf Heyneman, Stephen P. & Katherine Taylor Haynes (2004). International uses of education technology: threats and opportunities. in: Adapting technology for school improvement: a global perspective . David W. Chapman & Lars O. Mählck (Eds.): UNESCO: International Institute for Educational Planning, París, 2004 Available: http://www.unesco.org/iiep/PDF/pubs/F165.pdf Hepp, Pedro, Enrique Hinostroza, Ernesto Laval and Lucio Rehbein (2004). Technology in Schools: Education, ICT and the Knowledge Society. World Bank. Available: http://www1.worldbank.org/education/pdf/ICT_report_oct04a.pdf Hepp, Pedro et. al. (2004). Schooling For Tomorrow: The Role of ICT in the OECD/CERI Schooling Scenarios. Available: http://www.oecd.org/dataoecd/41/62/32503182.PDF Hernes, Gudmund (date unknown). Emerging Trends in ICT and Challenges to Educational Planning. Paris: UNESCO. Available: http://www.schoolnetafrica.net/fileadmin/resources/Emerging%20Trends%20in%20%20ICT%20and %20Challenges%20to%20Educational%20Planning.pdf Holmes, Bryn, Tim Savage, Brendan Tangney (eds.) (2000). Comparative International Research on Best Practice and Innovation in Learning. Dublin: The Centre for Research in I. T. in Education, Trinity College. Available: http://odtl.dcu.ie/mirror/crite/CRITEfinal.html Huyer, Sonia and Tatjana Sikoska (date unknown). Overcoming the Gender Digital Divide: Understanding ICTs and their Potential for the Empowerment of Women. INSTRAW Occasional Paper No. 2, INSTRAW/Ser.E/2. Available: http://www.un-instraw.org/en/docs/gender_and_ict/Synthesis_Paper.pdf Bibliography . 63 Intelecon Research (2000). The Use of Information and Communications Technology (ICT) in Learning and Distance Education. Commonwealth of Learning: 24 January 2000. Available: http://www.col.org/colint/00intelecon.pdf International ICT Literacy Panel (2001). Digital Transformation: A Framework for ICT Literacy. A Report of the International ICT Literacy Panel. Available: http://www.ets.org/research/ictliteracy/ictreport.pdf ISTE. Technology Support Index. (Website) Available: http://tsi.iste.org/ ISTE (2003). The Second Information Technology in Education Study: Module 2 (SITES: M2) Case Reports. Available: http://sitesm2.org/sitesm2_search/ ISTE (2002). National Educational Technology Standards (NETS). Available: http://cnets.iste.org/ Jager, A.K. and A.H. Lokman (1999). Impacts of ICT in education. The role of the teacher and teacher training. Stoas Research, Wageningen, The Netherlands. Paper Presented at the European Conference on Educational Research, Lahti, Finland 22 - 25 September 1999 Available: http://www.leeds.ac.uk/educol/documents/00001201.htm Johnston, Jerome and Linda Toms Baker (2002). Assessing the Impact of Technology in Teaching and Learning. Ann Arbor, MI: University of Michigan. Available: http://rcgd.isr.umich.edu/tlt/TechSbk.pdf Kenny, Charles (2003). Development’s False Divide. in: Foreign Policy, January/February 2003, p.76-77. Available: http://www.foreignpolicy.com/Ning/archive/archive/134/Kinney.qxd.pdf Kleiman, Glenn M. (2004). Myths and Realities about Technology in K-12 Schools: Five Years Later. Contemporary Issues in Technology and Teacher Education (CITE) Journal, 4(2). Available: http://www.citejournal.org/vol4/iss2/seminal/article2.cfm Kleiman, Glenn M. (1999). Myths and Realities about Technology in K-12 Schools. Contemporary Issues in Technology and Teacher Education (CITE) Journal. Available: http://www.edletter.org/dc/kleiman.htm KM International Co. (2003). Engendering ICT: Ensuring Gender Equality In ICT for Development. Washington, DC: The World Bank. Available: print only Kozma, Robert B. (ed.) (2003). Technology, Innovation, and Educational Change—A Global Perspective. A Report of the Second Information Technology in Education Study, Module 2. Eugene, Oregon, USA: ISTE. Available: print only Kozma, Robert B. (date unknown). ICT and Educational Reform in Developing and Developed Countries. Available: http://web.udg.es/tiec/orals/c17.pdf Lartigue, Laura (date unknown). Interactive Radio Instruction: Lessons Learned. Washington, DC: USAID. Available: http://www.usaid.gov/gn/education/news/010701_interactiveradio/lessonslearned.htm Levin, Douglas and Sousan Arafeh (2002). The Digital Disconnect : The Widening Gap Between Internet- Savvy Students and Their Schools. Washington, DC: Pew Internet & American Life Project, August 14, 2002. Available: http://www.pewinternet.org/pdfs/PIP_Schools_Internet_Report.pdf Linden, Leigh, Abhijit Banerjee and Esther Duflo (2003). Computer-Assisted Learning: Evidence from a Randomized Experiment. Cambridge, MA: Poverty Action Lab No. 5, October 2003. Available: http://www.povertyactionlab.com/papers/banerjee_duflo_linden.pdf Maclay, Colin, Geoffrey Kirkman and Robert Hawkins Global Networked Readiness for Education (2005). Preliminary Findings from a Pilot Project to Evaluate the Impact of Computers and the Internet on Learning in Eleven Developing Countries. World Bank. Available: print only 64 Knowledge Maps: ICT in Education Mählck, Lars O. & David W. Chapman (2004). Effective use of technology to improve education: lessons for planners. In: Adapting technology for school improvement: a global perspective. David W. Chapman & Lars O. Mählck (eds.): UNESCO: International Institute for Educational Planning, París. Available: http://www.unesco.org/iiep/PDF/pubs/F165.pdf Mann, Dale, Carol Shakeshaft, Jonathan Becker and Robert Kottkamp (1999). West Virginia Story - Achievement Gains from a Statewide Comprehensive Instructional Technology Program. Milken Family Foundation. Available: http://www.mff.org/publications/publications.taf?page=155 McKenzie, Jamie. (2003) The True Cost of Ownership. in: From Now On: The Educational Technology Journal, Vol 12, No.7, March 2003. Available: http://fno.org/mar03/truecost.html McNamara, Kerry S. (2003). Information and Communication Technologies, Poverty and Development: Learning from Experience. A Background paper for the InfoDev Annual Symposium. Available: http://wbln0018.worldbank.org/ict/resources.nsf/0/1e51786cd26a825585256e750063a3e7/ $FILE/Learning%20From%20Experience.PDF Menon, Mohan and Vis Naidoo (2003). COL Experiences in ICT for School Education. Africa Regional Conference in Teacher Training on ‘Use of ICT in the Classroom’. Nairobi : 4-6 November 2003. Available: http://www.schoolnetafrica.net/fileadmin/resources/COL_experiences_in_ICTs_for_Education.pdf Milken Exchange on Education Technology (date unknown). Technology in American Schools - 7 Dimensions for Gauging Progress - A Policymaker’s Guide. Available: http://www.mff.org/pubs/ME158.pdf Milken Family Foundation (1999). Information Technology: Underused in Teacher Education. Available: http://www.mff.org/edtech/article.taf?_function=detail&Content_uid1=131 Ministry of Education, Singapore (2002). Masterplan II for IT in Education. Available: http://www.moe.gov.sg/edumall/mp2/mp2.htm Naidoo, Vis and Heba Ramzy (eds.) (2004). Emerging Trends in the Development of School Networking Initiatives. Vancouver: Commonwealth of Learning. Available: http://www.col.org/PSemerging/ National Center for Education Statistics and its National Forum on Education Statistics (2002). Technology in Schools - Suggestions, Tools and Guidelines for Assessing Technology in Elementary and Secondary Education. Available http://nces.ed.gov/pubs2003/2003313.pdf National Research Council (2005). How Students Learn: History, Mathematics and Science in the Classroom. Committee on How People Learn, A Targeted Report for Teachers, Center for Studies on Behavior and Development, National Research Council Executive summary available: http://www.nap.edu/catalog/10126.html National Staff Development Council (2001). E-learning for Educators - Implementing the Standards for Staff Development. Available: http://www.nsdc.org/connect/projects/e-learning.pdf Natrins, Lesley (2004). IT can make a difference if IT is fit for purpose. Learning and Skills Development Agency. Available: http://www.lsda.org.uk/files/PDF/1629.pdf Ngu, Joseph N. (2003). ICTs in African Schools: Using Information and Communication Technologies (ICTS) in Education: Challenges for Curriculum Integration and Strategies for Success in African Schools. UNESCO-IICBA. OECD (2004). Schooling For Tomorrow and the International Toolbox for Forward-thinking, Innovation and School System Change (Main OECD Paper). Toronto: International Schooling For Tomorrow Forum, 6-8 June 2004. Available: http://www.oecd.org/dataoecd/11/8/2499051.pdf OECD (2004). Schooling For Tomorrow: OECD Scenarios. Available: http://www.ncsl.org.uk/mediastore/image2/randd-futures-schooling-for-tomorrow.pdf Bibliography . 65 OECD Centre for Educational Research and Innovation (2001). Learning to Change - ICT in Schools Available: http://www1.oecd.org/publications/e-book/9601131E.pdf OECD Development Assistance Committee (2004 revised). OECD Donor ICT Strategies Matrix Available: http://www.oecd.org Ontario Ministry of Education, Canada (2004). Schooling For Tomorrow: The Schooling Scenarios (Background OECD Papers). Available: http://www.oecd.org/dataoecd/41/62/32503182.PDF Oppenheimer, Todd (2004). The Flickering Mind: The False Promise of Technology in the Classroom and How Learning Can Be Saved. Available: print only Oppenheimer, Todd (1997). The Computer Delusion. in: The Atlantic Monthly: July 1997. Available : http://www.tnellen.com/ted/tc/computer.htm Orsin, Luis (1998). Computers in Education in Developing Countries: Why and How? Washington, DC: The World Bank. Available: http://wbln0018.worldbank.org/HDNet/HDdocs.nsf/ C11FBFF6C1B77F9985256686006DC949/9F0209063ADBE47085256755005274A6/$FILE/v3n1.pdf Papert, Seymour (date unknown). Technology in the Schools: To support the system or render it obsolete? Available: http://www.mff.org/edtech/article.taf?_function=detail&Content_uid1=106 Passey, Don (2002) ICT and School Management A Review of Selected Literature Lancaster University: June 2002 Available: http://www.becta.org.uk/research/reports/docs/ict_sm.pdf Perraton, Hilary (1997). The cost effectiveness of distance education for primary teacher training. International Research Foundation for Open Learning, UK. Available: http://www.col.org/consultancies/97primeteach.htm Perraton, Hilary & Charlotte Creed (2001). Applying New Technologies and Cost-Effective Delivery Systems in Basic Education. World Education Forum Education For All 2000 Assessment. Paris: UNESCO. Available: http://unesdoc.unesco.org/images/0012/001234/123482e.pdf Potashnik, Michael and Douglas Adkins (1996). Cost analysis of information technology projects in education: experiences from developing countries. Measuring and managing the costs of ICTs in Latin American schools. Education and Technology Series, Vol 1 No. 3. Washington, DC: Education Section, Human Development Department, The World Bank. Available: http://wbln0018.worldbank.org/HDNet/HDdocs.nsf/ C11FBFF6C1B77F9985256686006DC949/167A6E81A893851B8525675500681C7E/$FILE/v1n3.pdf Reinikka, Ritva and Jakob Svensson (2004). Fighting Corruption To Improve Schooling: Evidence From a Newspaper Campaign In Uganda. Washington, DC: The World Bank. Available: http://econ.lse.ac.uk/staff/rburgess/eea/svenssonjeea.pdf Rose, Pauline (2002). Financing of Education in East Asia: EFA and beyond. Available: http://oxfamgb.org/eastasia/documents/ Financing%20of%20Education%20in%20East%20Asia %20report.doc Saint, William (2000). Distance Education and Technology in Sub-Saharan Africa. World Bank Education and Technology E&T Technical Notes Series, Volume 5, Number 1. Available: http://www-wds.worldbank.org/servlet/WDS_IBank_Servlet?pcont=details&eid=000094946_ 00100705583945 Sanyal, Bikas C. (2001). New functions of higher education and ICT to achieve education for all. Paris: UNESCO International Institute for Educational Planning. Available: http://literacy.org/products/ili/pdf/UTLPsanyal.pdf Schoolnet Africa, Commonwealth of Learning, IICD, Open Society Institute for Southern Africa (2004). Towards a Strategy on Developing African Teacher Capabilities in the Use of ICT. A draft report, July 2004. Available: http://www.col.org/Consultancies/04Towards_Strategy_Africa.pdf 66 Knowledge Maps: ICT in Education Schoolnet Africa et. al. (2003). ICTs in African Schools Workshop: Workshop Report, Gaborone, Botswana, 27 April – 2 May 2003. Available: http://www.schoolnetafrica.net/index.php?id=1286 Scrimshaw, Peter (date unknown). Total cost of ownership (TCO): a review of the literature. Becta: ICT in Schools Research and Evaluation Series – No. 6. Available: http://www.becta.org.uk/page_documents/research/tco.pdf Scrimshaw, Peter (2004). Enabling Teachers to Make Successful Use of ICT. British Educational Communications and Technology Agency (Becta), June 2004. Available: http://www.becta.org.uk/page_documents/research/enablers.pdf Schachter, John (1999). Impact of Educational Technology on Student Achievement - What The Most Current Research Has To Say. Milken Exchange on Education Technology. Available: http://www.mff.org/publications/publications.taf?page=161 SEPRYDEM Project (2002). A Framework for Understanding ICTs-related Innovations in Primary and Secondary Education & Policy Recommendations. Available: http://promitheas.iacm.forth.gr/sypredem/texts/deliverable02.pdf Siemens, George (2004). Connectivism: A Learning Theory for the Digital Age. December 12, 2004. Available: http://www.elearnspace.org/Articles/connectivism.htm Slater, Don and Jo Tacchi (2004). Research: ICT Innovations for Poverty Reduction. Paris: UNESCO. Available: http://www.bellanet.org/leap/docs/136121e.pdf?OutsideInServer=no Sloan-C Reviews (2004). Review: Thwarted Innovation: What Happened to Elearning and Why. Available: http://www.sloan-c.org/resources/reviews/pdf/review18.pdf South African Institute for Distance Education (SAIDE) (2004). Costing distance education and open learning in Sub-Saharan Africa. Vancouver: Commonwealth of Learning. Available: http://www.col.org/Consultancies/04DEinSSA_CriteriaforQuality.pdf South African Institute for Distance Education (SAIDE) (2004). Distance education and open learning in Sub-Saharan Africa: Criteria and conditions for quality and critical success factors. Vancouver: Commonwealth of Learning. Available: http://www.col.org/Consultancies/04DEinSSA_CriteriaforQuality.pdf Teens and Technology Round Table (2002). Preparing Disadvantaged Youth for the Workforce of Tomorrow. Available: http://www.digitale-chancen.de/transfer/downloads/MD552.pdf Trucano, Michael (2005 draft). ICT Components in World Bank Education Projects. infoDev. Available: print only UNESCO (2004). EFA Global Monitoring Report 2005. Available: http://portal.unesco.org/education/en/ev.php-URL_ID=35939&URL_DO=DO_TOPIC&URL_ SECTION=201.html UNESCO (2003). Building Capacity of Teachers/Facilitators in Technology-Pedagogy Integration for Improved Teaching and Learning. Experts’ Meeting on Teachers/Facilitators Training in Technology- Pedagogy Integration. Bangkok, Thailand: 18-20 June 2003. Available: http://www.unescobkk.org/ips/ebooks/documents/ICTBuilding_Capacity/BuildingCapacity.pdf UNESCO (2003). Information and Communication Technologies in Education Bibliography Series Volume 1, 2003 Available: http://www.unescobkk.org/ips/ebooks/documents/ictbib1/ UNESCO (2003). Developing and Using Indicators of ICT Use in Education. Bangkok: UNESCO. Available: http://www.unescobkk.org/ips/ebooks/documents/ICTedu/index.htm UNESCO (2003). Experts’ Meeting for Documenting Experiences in the Use of ICT in Education and SchoolNet Operations. Bangkok: UNESCO, 7-8 July 2003. Available: http://www.unescobkk.org/education/ict/resources/JFIT/schoolnet/julyreport/wholedoc.pdf UNESCO (2002). Consultative Workshop for Developing Performance Indicators for ICT in Education. Manila, the Philippines, 28-30 August 2002. Bangkok: UNESCO. Available: http://www.unescobkk.org/education/ict/v2/info.asp?id=13232 Bibliography . 67 UNESCO (2001). Using ICT for Quality Teaching Learning and Effective Management UNESCO-ACEID International Conference on Education, 7th, Bangkok, Thailand. Available: http://www.unescobkk.org/ips/ebooks/documents/aceidconf7/rajaroysingh.pdf UNESCO (2001). Teacher Education through Distance Learning: Technology, Curriculum, Evaluation and Cost. Summary of Case Studies: Brazil, Burkina Faso, Chile, China, India, Mongolia, Nigeria, South Africa (two studies), United Kingdom. Available: http://unesdoc.unesco.org/images/0012/001242/124208e.pdf UNESCO-ACEID (2003). IT in Education Innovation for Development - Interfacing Global and Indigenous Knowledge. Available: http://www.unescobkk.org/ips/ebooks/documents/aceidconf6/themetwo.pdf UNESCO-Bangkok (2005, unpublished draft). ICT in Education Policy-Makers Toolkit . see http://www.unescobkk.org/education/ict/v2/detail.asp?id=15399 UNESCO-Bangkok (2005). Infoshare: Sources and Resources Bulletin. ICT for Education in Asia and the Pacific. Volume 6, 2004/2005. Bangkok: The ICT Unit, Asia and Pacific Regional Bureau for Education, UNESCO-Bangkok. Available: http://www.unescobkk.org/ips/ebooks/infoshare/infoshare.html UNESCO-Bangkok (2004). Integrating ICTs into Education: Lessons Learned Available: http://www.unescobkk.org/education/ict/v2/info.asp?id=16158 UNESCO-Bangkok (2004). Schoolnet Toolkit. Bangkok: UNESCO. Available: http://www.unescobkk.org/education/ict/v2/info.asp?id=16282 UNESCO-Bangkok (2004). Schoolnetworking: Lessons Learned (part 2) Bangkok: UNESCO. Available: http://www.unescobkk.org/education/ict/v2/info.asp?id=17377 UNESCO-Bangkok (2004). Teacher professional development on ICT Use in Education in Asia and the Pacific: Overview from Selected Countries. Available: http://www.unescobkk.org/ips/ebooks/documents/ICTteacher/index.htm University of London Institute of Education (2001). Using ICT to Develop Literacy and Numeracy: Research Summary. Available: http://www.basic-skills-observatory.co.uk/uploads/doc_uploads/284.pdf UN Millennium Project (2005). Investing in Development: A Practical Plan to Achieving the Millennium Development Goals Available: http://www.undp.org/mdg/ Vahey, Phil and Valerie Crawford (2003). Learning With Handhelds: Findings From Classroom Research. Menlo Park, CA: SRI International. Available: http://makingsens.stanford.edu/pubs/LearningFromHandhelds.pdf Wagner, Dan, Bob Day, and Joseph S. Sun (2004). Information Technologies and Education for the Poor in Africa (ITEPA). Recommendations for a Pro-Poor ICT4D Non-Formal Education Policy. Final Report for Imfundo: Partnership for IT in Education U.K. Department For International Development (DFID). Available: http://imfundo.digitalbrain.com/imfundo/web/papers/itepa/ITEPA.pdf WestEd (2002). The Learning Return on our Educational Technology Investment - A Review of Findings from Research. Available: http://www.wested.org/online_pubs/learning_return.pdf Wong, Kenneth and Phet Sayo (2004). Free Open Source Software - A General Introduction. UNDP- APDIP. Available: http://www.iosn.net/foss/foss-general-primer/foss_primer_print_covers.pdf World Bank (May 2004) Information and Communication Technologies @ the World Bank: Overview of Roles of Central Units Available: Print only World Bank (2004). Task Managers’ ICT Toolkit: A Route Map for ICT Components In World Bank Projects. 68 Knowledge Maps: ICT in Education Available: http://wbln0018.worldbank.org/ict/resources.nsf/a693f575e01ba5f385256b500062af05/ 009339446b44a82585256da400504bd3/$FILE/ATTQS146/Report%20No.%2025919A.pdf World Bank (2004). Task Managers’ ICT Toolkit: Good Practice for Planning, Delivering, and Sustaining ICT Products. Available: http://wbln0018.worldbank.org/ict/resources.nsf/a693f575e01ba5f385256b500062af05/ 009339446b44a82585256da400504bd3/$FILE/Report%20No.%2025919B.pdf World Bank (2001). A Chance to Learn: Knowledge and Finance for Education in Sub-Saharan Africa. Available: http://www-wds.worldbank.org/servlet/WDS_IBank_Servlet?pcont=details&eid=000094946_ 01032905304794 World Bank (date unknown). Achieving EFA in Uganda - The Big Bang Approach. Available: print only World Bank Group, Global ICT Department (2003). ICTs and MDGs: A World Bank Perspective. Washington, DC: World Bank Group. Available: http://info.worldbank.org/ict/assets/docs/mdg_Complete.pdf World Bank Institute (2002). The World of ICT in Education: A Seminar for Policymakers. Available: http://www.worldbank.org/wbi/ictforeducation/html/policymakers.html World Declaration on Education For All and Framework For Action To Meet Basic Needs (1990). Jomtein, Thailand Available: http://www.unesco.org/education/efa/ed_for_all/background/jomtien_declaration.shtml Zemsky, Robert and William F. Massy (2004). Thwarted Innovation: What Happened to e-learning and Why. A Final Report for The Weatherstation Project of the Learning Alliance at the University of Pennsylvania. Available: http://www.irhe.upenn.edu/Docs/Jun2004/ThwartedInnovation.pdf Bibliography . 69 About infoDev infoDev is a partnership of international development agencies, coordinated and served by an expert Secretariat housed at the World Bank, one of its key donors and founders. It acts as a neutral convener of dialogue, and as a coordinator of joint action among bilateral and multilateral donors—supporting global sharing of information on ICT for development (ICT4D), and helping to reduce duplication of efforts and investments. infoDev also forms partnerships with public and private-sector organizations who are innovators in the field of ICT4D. For more information visit www.infoDev.org or send an email to info@infodev.org 70 Knowledge Maps: ICT in Education