The rapid spread of artificial intelligence is creating new dangers for children online, prompting the United Nations and child protection groups to call for stronger safeguards and global action.
Experts warn that digital technologies are increasingly being used to target minors through harassment, exploitation and manipulation, with the risks intensifying as AI tools become more sophisticated.
Cosmas Zavazava, Director of the Telecommunication Development Bureau at the International Telecommunication Union (ITU), said children today face a wide range of online threats.
These include grooming by predators, cyberbullying, exposure to harmful content and the growing misuse of technologies such as deepfakes.
“We saw that during the COVID-19 pandemic many children, particularly girls and young women, were abused online and, in many cases, that translated into physical harm,” he said.
AI Tools Creating New Forms Of Abuse
Child protection organisations say artificial intelligence is making it easier for offenders to target and manipulate children.
Predators can use AI systems to analyse a child’s online activity, emotional state and personal interests, allowing them to tailor grooming strategies more effectively.
Another growing concern involves the creation of explicit fake images using AI technology. These manipulated images can be used for blackmail or sexual extortion.
A report released in 2025 by the Childlight Global Child Safety Institute highlighted the scale of the problem. It found that technology-facilitated child abuse cases in the United States rose dramatically, increasing from around 4,700 incidents in 2023 to more than 67,000 in 2024.
Governments Begin Introducing Restrictions
As awareness of these risks grows, some governments are introducing stricter regulations to protect young users online.
Australia became the first country to prohibit children under the age of 16 from having social media accounts at the end of 2025. Authorities said the decision was based on evidence that online platforms expose children to harmful material and harassment.
A government study cited in the decision found that nearly two-thirds of children aged between 10 and 15 had encountered violent, hateful or distressing content online. More than half reported experiencing cyberbullying, most of it on social media platforms.
Several other countries, including the United Kingdom, France, Canada and Malaysia, are considering similar measures or drafting new legislation to limit children’s exposure to online risks.
Young adults check social media in North Macedonia /UN
Lack Of AI Awareness A Major Concern
In January 2026, several UN agencies released a joint statement warning that societies remain poorly prepared to address the impact of artificial intelligence on children.
The statement emphasised widespread “AI illiteracy” among children, parents, teachers and caregivers, as well as limited understanding among policymakers about how AI systems function.
The document also noted that many governments lack the technical expertise needed to regulate emerging technologies effectively, including frameworks for data protection and assessments of how digital tools affect children’s rights.
Pressure On Technology Companies
UN officials say technology companies also bear significant responsibility for protecting young users.
Many of the AI tools currently being developed, along with the systems that power them, were not originally designed with children’s safety in mind.
Zavazava said the UN is urging the private sector to work more closely with international organisations and governments to reduce risks.
“We are really concerned and we would like the private sector to be involved, to engage and to be part of the story we are writing together,” he said.
He added that responsible use of AI does not necessarily conflict with business interests.
“With responsible deployment of AI, you can still make a profit, you can still do business and gain market share,” he said.
Protecting Children’s Rights In The Digital Age
The UN says protecting children online is fundamentally a human rights issue.
The Convention on the Rights of the Child, one of the most widely ratified human rights treaties in the world, was updated in 2021 to address challenges emerging from the digital environment.
However, UN agencies believe additional guidance is needed to help governments respond to rapidly evolving technologies.
New child online protection guidelines have therefore been developed to support different groups involved in safeguarding children.
The recommendations provide guidance for parents, teachers, regulators and the technology industry on how to create safer digital environments.
“Children are getting online at a younger age, and they should be protected,” Zavazava said.
UN officials stress that while technology can be a powerful tool for learning and communication, ensuring children’s safety will require coordinated action from governments, companies, educators and families alike.
