Positive results in laptop program schools in Doti
Background:
OLE Nepal’s laptop program was introduced in fifteen schools in Doti on September 2017, with the deployment of laptops and installation of digital library in the schools after the completion of 7 days initial teacher training program for 65 teachers in August 11-24, 2017. All the teachers from the schools participated in a three-stage training program designed to develop their skills and confidence in using technology in classrooms. In addition, two teaching residents were assigned to support all 15 schools for a period of four months on a rotation basis, to support students and teachers.
In order to check the effectiveness of the program on student learning (specifically in math, science and English subjects), we had conducted two sets of surveys, with the baseline survey done in September 7 to 18, 2017 (before the introduction of digital resources and laptops at the schools), and the midline survey in November 2018 (after one year of program launch).
Methodology:
The baseline survey was conducted amongst students from grade two to four of all 15 program schools. A group of 15 students from each grade were randomly picked to take the survey in three subjects, and students were further subgrouped to five students for each subject. If there were less than 15 students in a class, all the students were equally divided into 3 groups. Students were allowed an hour to complete the survey questions that consisted of multiple choice questions. Students from younger grades were guided by the enumerator or the teachers. They read the questions to the students as they might have had problems in reading the instructions. They were also given examples on how to mark the answers of their choice from the set of multiple choice questions. The baseline survey was jointly administered by the respective school teachers and the OLE Nepal volunteers. Similarly, after one year, a midline survey with the same set of questions was conducted amongst students of the same grades. The midline survey was conducted by the respective school teachers and OLE Nepal’s teaching residents. In total, 479 students from all 15 schools took the survey, and among them 51% were girls and 49% were boys.
There was varied number of students according to the grade and subjects. So, while dividing equal number of students in each subject, we have excluded or minimized extra number of students in analysis were randomly done on the basis of serial number (not relevant with obtained marks). For instance, if surveyor took the test of 13 students, then there is a difference in number for different subjects at that time. In such cases, we have excluded one person from analysis to balance equal number (4 students) in each subject. There were 15 to 45 students chosen from each school depending on the total number of students.
Data analysis:
All the tests papers were checked and scores were compiled for both the baseline and the midline surveys in excel sheets. These scores were then tabulated on excel, compared, and graphs were generated for easy comparisons.
Findings:
Average scores of Mathematics, English and Science in the baseline survey was 26.29, 38.75 and 46.74 respectively, and in the midline survey, subject wise averaged 63.89, 70.67 and 75.99 respectively. The average score of baseline survey was around 25% to 50%, but the average score of midline survey was around 60% to 80%. The average score increment was higher in math, than the increment in science and English. This shows that laptop integrating teaching method has had a positive impact on student learning. We can see increment 37.6 in math, 29.25 in science and 31.92 in English from baseline to midline.
Notably, all grades have shown improvements between the baseline to midline period. The graph shows the grade-wise average scores of all schools. The percentage of improvement was impressive in midline survey, in comparison to the baseline score. The average improvement of grade 3 was higher in comparison to grades 2 and 4. We can see more increment in grade 3, where the average score was 32.67 in baseline, whereas it was 70.03 in midline.
As the graph indicates, student performances in most schools have increased significantly. Krishnanagar Basic School has shown significant improvement from 35.05% to 86.43% in students learning, whereas Kaladhunga Basic School has shown relatively lower increment in performance of around 12% only. Secondly, Kalika Basic School, Deukhala Basic School, Bhairav Basic School and Sitaram Basic School has shown around 40% increment in student performance. The digital literacy program in schools has been running smoothly and has generated interest amongst students and teachers. It ensured that each student gets to learn at his or her own pace. That has resulted in students comprehending concepts and ideas better, thus resulting in a lower standard deviation, whilst keeping a high mean.
Conclusion:
The comparison of baseline and midline survey results revealed that students have made an impressive improvement in learning English, Science and Mathematics. Though we are aware that many factors contribute to the improvement in student learning, students were able to learn concepts at a pace that would not have been possible with the traditional way of learning. As the graph indicates, student performances in all schools in three classes’ subjects have increased significantly and digital literacy program has shown positive impact on student performance. We can claim that effective integration of digital materials in the classroom practices will enhance student learning and lead to better results in future.