Guest Column

OPINION | Missing learners and shaky data: Why data collection systems need to be fixed

Listen to this article
-00:00
Subscribers can listen to this article
The mother of a child bullied at school wants strong action against the guilty parties.
The mother of a child bullied at school wants strong action against the guilty parties. (Duncan Alfreds, News24)

A seven-month inquiry into data discrepancies at one school in a low-resourced community reveals how pupils are falling through the cracks of our schooling system. Rahima Essop, Amanda Edwards, Sias Bolton and Manoj Chiba examine what can be done to stop it.

If someone wants to know how many pupils are enrolled in the South African public schooling system, we say ask the Department of Basic Education (DBE). If someone wants to know about absenteeism rates, repetition rates and matric pass rates, the department would have those answers too. The education department should, in theory, be the most reliable source of learner-level information. If you ask the minister, she would - and has said - the same thing. But when these datasets are inaccurate or incomplete, children can get lost in the system or drop out without anyone noticing.

There are several aggregated datasets tracking information about learners. What you don't often hear or read about is that these 'big picture' datasets have gaps and inaccuracies. You seldom hear about why these problems exist and the implications of unreliable data on learner outcomes. This lack of awareness is perhaps why many educators themselves struggle to grasp how and why accurate data can help to improve learner outcomes.

In this article, we use the findings of a seven-month inquiry into data discrepancies at one school in a low-resourced community to demonstrate how pupils are falling through the cracks of our schooling system and what we can do to stop it. These data discrepancies demonstrate weaknesses in existing systems, processes, capacity and accountability mechanisms at schools. But they are not insurmountable.

READ | ANALYSIS: Now more than ever, we need to help learners catch up. Here's why

During our inquiry, we found over one hundred discrepancies (amounting to more than 10% of the dataset) in learner-level information when comparing paper-based class registers with data captured on electronic monitoring systems from just one school.

The problems included: missing pupils who had potentially dropped out, others had moved to new schools in different provinces and some learners' names were incorrectly captured. We also discovered pupils who were registered twice in one school - in two different classes. Some learners were officially enrolled in the school but none of the staff knew who they were and whether the missing pupils had ever attended classes. Perhaps they were registered as new applicants but never arrived? A lack of updated contact information for pupils or their parents made it difficult to know for sure.

The issues listed above are material discrepancies that impact learner outcomes. Typically, absent learners who don't complete their assessments are assigned naught or a calculated average - if they are not simply marked absent.

Pupils who consistently underperform are likely to fail and may have to repeat a year unless they meet the criteria for progression. But when they are progressed to the next grade, based on average scores, without adequate remedial support, these learners struggle to catch up with their peers. High rates of grade repetition are stoking high dropout rates in grades 10 and 11.

What is happening in schools?

*Lindsey and *Sipho represent the anonymised experiences of real pupils enrolled in the school we examined. Neither attended classes for the better part of 2021.

Lindsey was not in her Grade 10 class for most of the second term. She did not do any of her assessments or write tests. None of her teachers knew where she was. Her classmate *Elijah also didn't know what happened to her, but he did know why his brother *Sipho was no longer showing up to his Grade 8 classes.

Both Lindsey and Sipho were on their school's electronic enrolment register but did not appear on class-based attendance registers.

Their academic performance records were largely blank. If school staff had followed Lindsey's attendance accurately and contacted Lindsey's mother, they would have learnt the news that she had been sexually assaulted and moved to another province. If they had tracked down Sipho, they would have known that he was pulled out of school because his parents could not afford to fund his education. They didn't have enough money to pay for two sets of school uniforms and shoes, coupled with the costs of transport and stationery.

If absenteeism tracking happened as it should, Lindsey and Sipho would have been marked absent on paper-based registers when their class teachers took daily attendance each morning.

Ideally, their subject teachers for maths, science, etc. would have done their own roll calls to ensure that learners not only arrived in the mornings but stayed for the full school day. Their class teachers would have sent paper-based registers to their school's administrator with accurate information.

This data would then enter an electronic pipeline that flows to provincial and national departments of education. When things happened as they should, heads of department would also review and approve attendance data at the end of each week so that chronically absent learners are flagged and tracked.

READ | South African children have lost 1.3 years of schooling due to Covid-19

However, things did not play out as expected at the school Lindsey and Sipho attended.

In no-fee schools, overburdened administrators usually juggle different tasks and roles. It's not uncommon for administrators to get interrupted multiple times while capturing data on an electronic system because they are answering telephones or dealing with queries from staff, learners, parents and other school visitors.

Such distractions allow data inaccuracies to creep in, and administrators often don't have the capacity to follow up with teachers when information is incomplete or unclear. Strictly speaking, it's not their responsibility either.

This responsibility lies with school management teams. But members of the school management team at Lindsey's and Sipho's school were not monitoring absenteeism in a consistent way. Perhaps they didn't have the time, or they didn't quite understand the link between accurate data collection and learning outcomes.

At most, attendance data was signed off every term, so the absent learners' parents were not contacted by the school when they should have been. This breakdown in communication has legal implications (that school staff may not fully understand).

According to the Policy on Learner Attendance, a learner with unexcused, continuous absence for 10 or more consecutive school days can be considered to have dropped out. However, the onus is on the principal to follow up and provide necessary support for each case of continuous absence.

Can we fix these problems?

The basic education sector relies on administrative data to track the overall health and functioning of our schooling system, including learner progress, grade repetition and dropout.

To fix data discrepancies, the sector must acknowledge where the problems lie and how these issues are contributing to poor pupil outcomes and high rates of dropout. Fixing the problems that we identified in this article requires budgetary commitment, political will and innovation.

Firstly, government must fund Data Assistant posts in schools and ensure there is budget for training. These appointments will help schools identify and respond to the needs of learners and ultimately reduce dropout.

Data Assistant posts will also give young people skills for future work. Mobilising the Basic Education Employment Initiative to include a category for data administrators could fill this essential role. Data clerks also need the support of school management teams to get the job done, since junior administrators don't have the authority to hold teachers accountable for missing data.

Secondly, administrators and school staff should be supported to participate in ongoing school-based training, some of which is available at no cost through various non-profit organisations that support the sector.

In addition to capacitating schools with competent and skilled administrators, they must be properly resourced with computers, internet connectivity and a stable power supply. Moreover, to strengthen accountability schools need clear standard operating procedures for educators, senior management teams and administrators, and these protocols must be closely monitored by circuit and district managers.

READ | IN-DEPTH: Basic education during Covid-19 - 'We will feel the effect for years to come' - expert

Thirdly, the success of these efforts hinges on the understanding that data collection is not a box-ticking exercise for compliance but an essential tool for improving learner outcomes.

The good news is that the sector is not short of innovative data capturing and monitoring solutions that demonstrate the value of information. The Data Driven Districts (DDD) programme, which is implemented by the non-profit New Leaders Foundation (NLF), offers free data visualisation tools through its DDD dashboard. These help educators, school management teams and department officials make informed decisions about their learners' needs, and how to focus their support on where it's needed most.

There are also frameworks for Early Warning Systems that schools can adopt to prevent dropout using learner-level data on attendance, behaviour and academic performance. Capturing and monitoring the right type of data can help schools to flag learners at risk of dropping out based on indicators of disengagement. These solutions must be supported from the ground up and adopted on a national scale.

The way data is collected at school level has far-reaching implications for the education pipeline. We need accurate, reliable and complete datasets to prevent tens of thousands of learners from disappearing from our schooling system each year.

- Rahima Essop worked as the Head of Communications and Advocacy for the Zero Dropout Campaign. Amanda Edwards is the Schools Development and Operations Manager at Public School Partnerships. Sias Bolton is an independent education consultant and former principal. Manoj Chiba is the Managing Director at New Leaders Foundation.

To receive Opinions Weekly, sign up for the newsletter here.

*Want to respond to the columnist? Send your letter or article to opinions@news24.comwith your name and town or province. You are welcome to also send a profile picture. We encourage a diversity of voices and views in our readers' submissions and reserve the right not to publish any and all submissions received.

Disclaimer: News24 encourages freedom of speech and the expression of diverse views. The views of columnists published on News24 are therefore their own and do not necessarily represent the views of News24.

Rahima Essop, Amanda Edwards, Sias Bolton and Manoj Chiba