{"id":2350,"date":"2012-03-20T09:39:36","date_gmt":"2012-03-20T13:39:36","guid":{"rendered":"https:\/\/edutechdebate.org\/?p=2350"},"modified":"2012-09-27T10:39:00","modified_gmt":"2012-09-27T14:39:00","slug":"where-is-the-focus-of-olpc-in-peru-and-ict4e-in-general","status":"publish","type":"post","link":"https:\/\/edutechdebate.org\/olpc-in-peru\/where-is-the-focus-of-olpc-in-peru-and-ict4e-in-general\/","title":{"rendered":"Where is the Focus of OLPC in Peru and ICT4E in General?"},"content":{"rendered":"<p><a href=\"http:\/\/www.flickr.com\/photos\/jeffpatzer\/5148333279\/in\/set-72157625046512665\/\"><img loading=\"lazy\" src=\"http:\/\/edutechdebate.org\/wp-content\/uploads\/2012\/03\/problems-olpc-peru.jpg\" alt=\"\" title=\"problems-olpc-peru\" width=\"550\" height=\"257\" class=\"alignnone size-full wp-image-2351\" srcset=\"https:\/\/edutechdebate.org\/wp-content\/uploads\/2012\/03\/problems-olpc-peru.jpg 550w, https:\/\/edutechdebate.org\/wp-content\/uploads\/2012\/03\/problems-olpc-peru-300x140.jpg 300w\" sizes=\"(max-width: 550px) 100vw, 550px\" \/><\/a><\/p>\n<p>A fascinating discussion has emerged on one laptop per child programs &#8211; much has been said in the previous articles and there have been many posts in the past several days on the topic of OLPC in Peru and similar efforts elsewhere. Research has been cited, and personal experiences and opinions shared. Where do we go from here?<\/p>\n<p>I want to specifically address the broader ICT for Education (ICT4E) question of whether or not a single intervention can have an impact on student achievement.<\/p>\n<p>In looking at the discussions and research to date, I suggest an ICT4E intervention can have (and should have!) an impact, but only through <strong>focus. <\/strong>Specifically, focus on:<\/p>\n<ul>\n<li>Specific problems and explicit objectives<\/li>\n<li>Student achievement<\/li>\n<li>Monitoring and evaluation<\/li>\n<\/ul>\n<p>To start, let me clarify what I mean with ICT4E initiatives for the purpose of this article: I am talking about comprehensive ICT interventions at the classroom\/student level such as OLPC (but not only one-to-one programs). Such efforts would at a minimum combine elements of providing electronic teaching and learning resources (content), devices to access the content, and related teacher training. Under the paradigm of <em>focus<\/em>, I also propose that we get more precise when we talk about ICT4E, as clearly one intervention type or implementation model does not necessarily compare to the other.<\/p>\n<p><strong>Focus ICT4E interventions on specific problems and formulate explicit objectives<\/strong><\/p>\n<p>The OLPC Peru program aims \u201cTo improve the quality of public primary education, especially that of children in the remotest places and in extreme poverty, prioritizing multi-grade schools with only one teacher\u201d. The <a href=\"http:\/\/www.perueduca.edu.pe\/olpc\/OLPC_programa.html\">program description<\/a> does not mention specific subjects or explicit skills in any of its objectives, and there are plenty of programs out there with similarly vague statements.<\/p>\n<p>I think we need to get more evidence-based, specific, and realistic when talking about anticipated impacts and avoid overgeneralization in our program descriptions and general ICT4E rhetoric.<\/p>\n<p>In a focused approach to ICT4E intervention planning and program design we would unpack the broader goal, identify the key problems area(s) on the classroom level, and address them in a systematic manner. <a href=\"http:\/\/go.worldbank.org\/407WNWUWP0\">Children\u2019s early reading skills, e.g., are low<\/a> \u201c\u2026most children read badly, with poor fluency and limited comprehension\u201d. Oscar Becerra in <a href=\"http:\/\/edutechdebate.org\/olpc-in-peru\/oscar-becerra-on-olpc-perus-long-term-impact\/\">his contribution<\/a> also mentions the challenges of teachers\u2019 reading levels. Further, the effort to add 200 e-Books to the other content provided on the XOs, and the fact that the section on how to use these provides the most descriptive and detailed pedagogical guidance in the <a href=\"http:\/\/www.perueduca.edu.pe\/olpc\/archivos\/GUIA%20Pedagogica%20OLPC_p2.pdf\">OLPC manuals<\/a>, is an indicator that reading has already been recognized, although not explicitly and systematically, for specific attention.<\/p>\n<p>Continuing using early reading as an example, a focused ICT intervention could draw on research to date on how to improve reading in the early grades even in low-resource environments. From this work, we can learn that a focus on the classroom-level and the very specific, underlying skills of early reading (such as phonemic awareness and letter recognition), with simple-to-implement and direct approaches to teaching (and teacher training), low-cost materials and a focus on continuing assessment to monitor progress can make a <a href=\"https:\/\/www.eddataglobal.org\/reading\/index.cfm?fuseaction=pubDetail&amp;ID=346\">significant difference in students\u2019 early reading outcomes<\/a> already within a relatively short period of time.<\/p>\n<p>A role for an ICT intervention in this scenario could then be how to get to such results in a more effective and efficient manner and\/or for specific groups of students whose needs are not yet fully addressed through existing, though working, approaches.<\/p>\n<p>In an effort to respond to the (very valid) sustainability and scale up requirements, to adhere to best practices in institutionalization and sector-wide approaches, and in dealing with the significant challenges related to procurement \u2013 of equipment and content \u2013  ICT4E initiatives get caught up in investing resources and efforts on too many fronts already at the very beginning, without having had a chance to even get to the classroom and validate their impact where it should matter most: at the student level.<\/p>\n<p><a href=\"http:\/\/www.flickr.com\/photos\/olpc\/2630005753\/in\/set-72157608735606146\"><img loading=\"lazy\" src=\"http:\/\/edutechdebate.org\/wp-content\/uploads\/2012\/03\/olpc-student.jpg\" alt=\"\" title=\"olpc-student\" width=\"549\" height=\"294\" class=\"alignnone size-full wp-image-2354\" srcset=\"https:\/\/edutechdebate.org\/wp-content\/uploads\/2012\/03\/olpc-student.jpg 549w, https:\/\/edutechdebate.org\/wp-content\/uploads\/2012\/03\/olpc-student-300x160.jpg 300w\" sizes=\"(max-width: 549px) 100vw, 549px\" \/><\/a><\/p>\n<p><strong>Focus on student achievement  <\/strong><\/p>\n<p>A lot of discussion related to this month\u2019s topic raised the question of whether or not ICT4E initiatives should be assessed in regards to their contribution to improved student learning outcomes and specifically academic achievement.<\/p>\n<p>In environments where resources are extremely limited, the choice for implementing a certain program is de facto a decision <em>against<\/em> an alternative approach. I question how we justify <strong>not<\/strong> expecting comprehensive classroom-level ICT initiatives to focus on learning outcomes when even the most foundational skills critical for future learning, such as early reading, are <a href=\"http:\/\/www.rti.org\/pubs\/early-reading-report_gove_cvelich.pdf\">not being acquired by large proportions of children.<\/a><\/p>\n<p>Clearly, other skills, including cognitive skills, critical thinking skills, etc., are important for learning and child development. Thus it is important to move the body of knowledge on ICT for Education further into exploring such new domains. However, should this really be done on the expense of education systems that already struggle with basic service delivery and ensuring universal learning of the most foundational skills? As many of us remember, there has already been <a href=\"http:\/\/edutechdebate.org\/ict-in-schools\/there-are-no-technology-shortcuts-to-good-education\/\">much discussion<\/a> around the issue of added-value of technology in good schools, versus challenge schools (systems).<\/p>\n<p>I propose to go back to the drawing board and try to get more specific about where we expect ICT can make an impact, define impacts more narrowly, and develop a roadmap of the steps including outputs and outcomes to get there.<\/p>\n<p>A revised ICT4E initiative objective could under such an approach read like: \u201c\u2026 aims to improve early reading skills, specifically fluency, among students in grades 1 and 2 of public primary schools\u201d within an average timeline of a donor-funded project of some 5 years. The OLPC Peru program <a href=\"http:\/\/www.perueduca.edu.pe\/olpc\/OLPC_programa.html\">sets a good example<\/a> in regard to focusing on a specific target:  \u201c\u2026children in the remotest places and in extreme poverty, prioritizing multi-grade schools with only one teacher.\u201d<\/p>\n<p>While ICT is still <a href=\"http:\/\/www.bestevidence.org\/reading\/tech\/tech.html\">not a magic bullet<\/a> to resolve this issue, such an objective is at least measurable as there are internationally validated tools, and &#8211; as we can learn from reading curricula around the world &#8211; results should be detectable within a reasonable timeframe of 1-2 years for most languages and scripts. Other objectives may take longer to achieve and may need to be broken down into intermediate results and steps to find the balance between being ambitious and realistic.<\/p>\n<p>Establishing priorities and validating impact on specific aspects of larger objectives and expanding on these over time will go a long way to building credibility for the ICT4E and the larger ICT for Development practice area, and rallying the national support needed for a program.<\/p>\n<p>With such a focused objective in hand, program implementers can then align activities (provision of content, equipment, training, etc. ) and design monitoring and evaluation frameworks that provide relevant information to the project internally and to the larger body of knowledge.<\/p>\n<p><a href=\"http:\/\/www.flickr.com\/photos\/jdebner\/5022073596\/in\/set-72157624896951300\/\"><img loading=\"lazy\" src=\"http:\/\/edutechdebate.org\/wp-content\/uploads\/2012\/03\/olpc-peru-teacher.jpg\" alt=\"\" title=\"olpc-peru-teacher\" width=\"550\" height=\"301\" class=\"alignnone size-full wp-image-2352\" srcset=\"https:\/\/edutechdebate.org\/wp-content\/uploads\/2012\/03\/olpc-peru-teacher.jpg 550w, https:\/\/edutechdebate.org\/wp-content\/uploads\/2012\/03\/olpc-peru-teacher-300x164.jpg 300w\" sizes=\"(max-width: 550px) 100vw, 550px\" \/><\/a><\/p>\n<p><strong>Focus on rigorous Monitoring and Evaluation in ICT4E interventions<\/strong><\/p>\n<p>Much has already been said about the lack of systematic Monitoring and Evaluation (M&amp;E) of progress and impact <a href=\"http:\/\/wiki.laptop.org\/images\/a\/a5\/OLPC_Lit_Review_v4_Aug2010.pdf\">in OLPC programs<\/a> and <a href=\"http:\/\/blogs.worldbank.org\/edutech\/worst-practice\">elsewhere.<\/a><\/p>\n<p>Implementing good M&amp;E is difficult. It is hard to design relevant and appropriate frameworks with coherent indicators, realistic data collection methods, and validated tools. Thus, M&amp;E costs money, which can be more or less depending on the complexity of the program and\/or the objectives and questions driving program implementation.  And it is even harder to focus on M&amp;E when at the same time available resources and people engaged in the program are tied up with the enormous tasks related to the logistics of getting the hardware devices into children\u2019s hands.<\/p>\n<p>In spite of this, however, absence of systematic M&amp;E deprives any program of the opportunity to tell a story much beyond anecdotal evidence once it comes to <em>evaluation<\/em>.<\/p>\n<p>Furthermore, without systematic <em>monitoring<\/em>, there is no opportunity to implement corrective measures to program parameters and to continually check back whether activities and resources are moving the initiative towards project objectives before scale up\/institutionalization. Monitoring can take many faces and each of them can be strategically employed at different times in a project life-cycle to help improve the program. Monitoring may involve low-effort usability tests with target group users on ease of use of equipment, user acceptance tests for new content and approaches, pilots for new curricula, or comprehensive randomized controlled trial methodologies that allow for a more precise look at the effect of the equipment versus that of the content or the teacher training on the overall project objective before scale-up.<\/p>\n<p>Although no written M&amp;E framework was found on the OLPC Peru website, some monitoring- type activities have taken place. From an outsider\u2019s glance it seems, however, as if these were not yet fully capitalized on to improve the implementation model.<\/p>\n<p>In 2007, in advance of the main roll-out, <a href=\"http:\/\/idbdocs.iadb.org\/wsdocs\/getdocument.aspx?docnum=35422036\">a pilot<\/a> was conducted in Arahuay with 48 students for several months. The pilot unearthed a number of hardware design and technical installation issues that were <a href=\"http:\/\/wiki.laptop.org\/go\/OLPC_Peru\/Arahuay\">subsequently fixed.<\/a> However, there seems to be little documentation of any change in the pedagogical model related to the educational resources or teacher training provided as a result of the pilot.<\/p>\n<p>Further, the <a href=\"http:\/\/idbdocs.iadb.org\/wsdocs\/getdocument.aspx?docnum=35422036\">first IDB study<\/a> was conducted in 2009 and found that \u201cConcerning use, it is worth making note of what looks like a decreasing utilization of computers in the classroom, which could be a reflection of the need for more technical and pedagogical support for the teachers, as well as of the lack of planning sessions, activities and digital resources appropriate for educational use.\u201d  Although in <a href=\"http:\/\/walterbender.org\/?p=386\">other sources<\/a>, an iterative improvement process to the roll-out is being stated, the IDB 2012 report does not indicate implementation design adjustments towards more pedagogical support or resources appropriate for educational use between 2009 and 2010.<\/p>\n<p>The OLPC Peru program has been given a potentially huge opportunity through this present IDB study, which, given the rigor of its methodology should be taken very seriously. For this, however, the community would need to agree that the current study is conceptualized as a <em>monitoring<\/em> effort, providing relevant feedback at a strategic point in time for the program, rather than constituting an \u201cend of program\u201d type <em>evaluation<\/em> effort.  On the side of project implementers, it will require some potentially hard strategic decisions about the need for and focus of future efforts and resources.<\/p>\n<p>In general for the ICT4Ed practice area, I propose we adopt a more focused approach to establish the added-value ICT provides in low-income countries and:<\/p>\n<ol>\n<li>Avoid generalizing results from studies done on specific models\/intervention types (and their particular choices for equipment, content and implementation) to \u201cICT for Education\u201d as a whole.<\/li>\n<li>Focus on very explicit problems and measurable objectives for ICT interventions first of all and avoid general, overambitious objective statements.<\/li>\n<li>Get more systematic and rigorous in monitoring ICT for Education initiatives to find out first, on a small scale, what works (or not) for specific contexts before scale up.<\/li>\n<li>Increase expectations on comprehensive classroom-level ICT initiatives to contribute to measurable results &#8211; specifically in key learning areas &#8211; instead of expecting different standards for ICT4Education compared to other educational improvement efforts.<\/li>\n<\/ol>\n<div class=\"embednewsletter\">\n<h2>Don&#8217;t miss a moment of the action!<\/h2>\n<p>Subscribe now and get the latest articles from Educational Technology Debate sent directly to your inbox.<\/p>\n<form action=\"http:\/\/feedburner.google.com\/fb\/a\/mailverify\" method=\"post\" target=\"popupwindow\" onsubmit=\"window.open('http:\/\/feedburner.google.com\/fb\/a\/mailverify?uri=EducationalTechnologyDebate', 'popupwindow', 'scrollbars=yes,width=550,height=520');return true\"><input class=\"text\" id=\"email\" name=\"email\" type=\"text\"><input value=\"EducationalTechnologyDebate\" name=\"uri\" type=\"hidden\"><input name=\"loc\" value=\"en_US\" type=\"hidden\"><input value=\"Sign Up\" class=\"img\" type=\"Submit\"><a href=\"http:\/\/feeds.feedburner.com\/EducationalTechnologyDebate\"><img loading=\"lazy\" src=\"http:\/\/feeds.feedburner.com\/~fc\/EducationalTechnologyDebate?bg=003366&amp;fg=FFFFFF&amp;anim=0\" height=\"26\" width=\"88\" style=\"border:0\" class=\"fburner\" alt=\"\" \/><\/a><br style=\"clear:left;\" \/><\/div>\n","protected":false},"excerpt":{"rendered":"<p>A fascinating discussion has emerged on one laptop per child programs &#8211; much has been said in the previous articles and there have been many posts in the past several days on the topic of OLPC in Peru and similar efforts elsewhere. Research has been cited, and personal experiences and opinions shared. Where do we [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1249],"tags":[660,1099,799,1291,1285,1289,1286,1292,17,1063,1290,1288,623,1281,1294,1284,1287,800,1293],"_links":{"self":[{"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/posts\/2350"}],"collection":[{"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/comments?post=2350"}],"version-history":[{"count":7,"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/posts\/2350\/revisions"}],"predecessor-version":[{"id":2663,"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/posts\/2350\/revisions\/2663"}],"wp:attachment":[{"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/media?parent=2350"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/categories?post=2350"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/edutechdebate.org\/wp-json\/wp\/v2\/tags?post=2350"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}