Why data is key to protecting kids online and ensuring the digital future we deserve

However, one of the most critical threats to children is the alarming growth in online child sexual exploitation and abuse (CSEA).

Rights-respecting approach

Children worldwide are being groomed to share intimate images, coerced into performing explicit sexual acts and having images of their sexual abuse shared online – all of which cause devastating harm to children’s lives and wider societies. Disrupting Harm, a first-of-its-kind large-scale, multi-country research project on children’s experiences with digital technology highlights that between 1-20 per cent of children (12-17 years of age) were subjected to CSEA in 2020 across 13 countries in Eastern and Southern Africa and South East Asia. Scaled to the general population of internet-using children, these estimates represent millions of children in each country. In an alarming new report, the Internet Watch Foundation (IWF) says that sexual abuse imagery of primary school children has risen 1,000 per cent since 2019.

The recent spate of progressive legislative actions by world leaders is an attempt to respond to the new digital era’s existing and emerging challenges. The proposed EU legislation to prevent and combat online CSEA, the EU Digital Services Act (DSA), the UK Online Safety Bill, the California Age-Appropriate Design Code Act and Australia’s e-Safety Commissioner, which is the world’s first government agency created to keep people safe online, are efforts to shape the contours of a rapidly changing world. They set high standards to protect children online through policy action and incentivize the technology industry to prioritize child safety.

As laid out in the World Economic Forum white paper, “Global Principles on Digital Safety”, creating a safer digital ecosystem necessitates a rights-respecting approach, requiring adherence to international human rights law and balancing human rights, such as safety, privacy, freedom of expression, and others.

Privacy and safety are interconnected

Acknowledging that digital safety requires a range of deliberations balancing legal, policy, ethical, social and technological considerations is vital. Such decisions must be rooted in existing human rights laws and principles that recognize that fundamental human rights are indivisible.

To create a safer digital ecosystem, regulators must collaborate with other players in the ecosystem, necessitating multi-stakeholder cooperation. Any action taken should be grounded in necessity, proportionality, and legality, and decisions should be made with a comprehensive understanding of the various stakeholder’s interests and concerns.

The fact is that privacy and safety are intrinsically interconnected and, most of the time, mutually reinforcing. In many cases, users’ privacy is a prerequisite for safety. Some privacy measures, however, can complicate children’s safety. For instance, the polarizing debate on End-to-End Encryption (E2EE) of digital communications often ignores the situation’s complexities and the fact that there are legitimate concerns on both sides of the ‘E2EE divide’.

While the weakening of E2EE could endanger the confidentiality and security of communications, it will also severely impede efforts to monitor and remove online child sexual abuse material and identify offenders.

Efforts to tackle online child sexual exploitation and abuse, and ensure safe and age-appropriate experience have led to development of new privacy preserving technologies such as Client-Side-Scanning and various on-device Age Estimation tools. But concerns remain about their impact on user privacy and that needs to be acknowledged. The key question is how to balance the trade-offs between efforts to detect and act on harmful and illegal content, and protect privacy when there is a conflict.

Data can help us address this tension: it is a fundamental asset to drive informed decision-making and needs to take priority over emotional or ideological approaches.

Role of data in vital new insights

Currently, there is limited understanding of how children engage with digital technology in countries across the globe, and little evidence on what forms of online abuse children experience, who is more vulnerable, who the common offenders are, and whether children know how to recognize and report online abuse. Large-scale projects like Disrupting Harm demonstrate the role of data and evidence in generating vital new insights on online CSEA, which are crucial in addressing the issue.

Secondly, we need more data on the prevention and response side, particularly on national child protection systems and how they respond to the rapidly growing scale of the problem, and whether these policies and practices fit the digital age.

Finally, we need data that can help us leverage cutting-edge technologies to overcome polarized positions on privacy and safety. For instance, a decision on whether to implement Client-Side-Scanning technologies to identify child sexual abuse material (CSAM) material could be made considering objective data such as: i) benefits in terms of number of CSAM material identified and removed; ii) potential prosecution of abusers, hence preventing re-occurrence of crimes; iii) share of false positives; and iv) occurrences of unwanted usage of the technology.