Campaigners Demand AI Restrictions in UK Risk Assessments Post Meta Plans

Published Date : 08/06/2025 

Internet safety campaigners have urged the UK's communications watchdog, Ofcom, to limit the use of artificial intelligence in crucial risk assessments after reports that Meta plans to automate these checks. 

Internet safety campaigners have urged the UK’s communications watchdog to limit the use of artificial intelligence in crucial risk assessments after a report that Mark Zuckerberg’s Meta was planning to automate checks. Ofcom said it was “considering the concerns” raised by the campaigners’ letter, after a report last month that up to 90% of all risk assessments at the owner of Facebook, Instagram, and WhatsApp would soon be carried out by AI.

Social media platforms are required under the UK’s Online Safety Act to gauge how harm could take place on their services and how they plan to mitigate those potential harms – with a particular focus on protecting child users and preventing illegal content from appearing. The risk assessment process is viewed as a key aspect of the act.

In a letter to Ofcom’s chief executive, Melanie Dawes, organisations including the Molly Rose Foundation, the NSPCC, and the Internet Watch Foundation described the prospect of AI-driven risk assessments as a “retrograde and highly alarming step”. They said: “We urge you to publicly assert that risk assessments will not normally be considered as ‘suitable and sufficient’, the standard required by the act, where these have been wholly or predominantly produced through automation.”

The letter also urged the watchdog to “challenge any assumption that platforms can choose to water down their risk assessment processes”. A spokesperson for Ofcom said: “We’ve been clear that services should tell us who completed, reviewed, and approved their risk assessment. We are considering the concerns raised in this letter and will respond in due course.”

Meta said the letter deliberately misstated the company’s approach on safety and it was committed to high standards and complying with regulations. “We are not using AI to make decisions about risk,” said a Meta spokesperson. “Rather, our experts built a tool that helps teams identify when legal and policy requirements apply to specific products. We use technology, overseen by humans, to improve our ability to manage harmful content and our technological advancements have significantly improved safety outcomes.”

The Molly Rose Foundation organised the letter after the US broadcaster NPR reported last month that updates to Meta’s algorithms and new safety features would mostly be approved by an AI system and no longer scrutinised by staffers. According to one former Meta executive who spoke to NPR anonymously, the change will allow the company to launch app updates and features on Facebook, Instagram, and WhatsApp more quickly but will create “higher risks” for users, because potential problems are less likely to be prevented before a new product is released to the public.

NPR also reported that Meta was considering automating reviews for sensitive areas including youth risk and monitoring the spread of falsehoods. The concerns raised by the campaigners highlight the ongoing debate about the role of AI in ensuring online safety and the need for human oversight to prevent potential harm. 

Frequently Asked Questions (FAQS): 

Q: What is the UK's Online Safety Act?

A: The UK's Online Safety Act requires social media platforms to assess potential harms on their services and implement measures to mitigate these risks, with a focus on protecting children and preventing illegal content.

Q: Why are campaigners concerned about AI-driven risk assessments?

A: Campaigners are concerned that AI-driven risk assessments may not be as thorough or nuanced as human assessments, potentially leading to higher risks for users, especially children.

Q: What is Ofcom's role in this issue?

A: Ofcom, the UK's communications watchdog, is responsible for ensuring that social media platforms comply with the Online Safety Act. They are currently considering the concerns raised by the campaigners.

Q: What is Meta's stance on using AI for risk assessments?

A: Meta claims that they are not using AI to make decisions about risk but have developed a tool to help teams identify when legal and policy requirements apply to specific products, with human oversight.

Q: What specific areas are Meta considering for AI automation?

A: Meta is reportedly considering automating reviews for sensitive areas including youth risk and monitoring the spread of falsehoods, according to reports by NPR. 

More Related Topics :