AI BriefingAI Nudify App Misuse and Platform Responsibility Controversy
Key point
Cases of AI nudify app misuse among UK elementary school students have surged, raising questions about platforms' responsibility to manage such tools.
Details
Misuse of 'nudify' apps, which use AI to alter photos of others into explicit content, has emerged as a serious social problem among UK secondary school students.
According to the Internet Watch Foundation, 150 AI-generated images created at one UK secondary school were classified as child sexual abuse material (CSAM). In 2024, 13 cases of AI-generated CSAM images were confirmed, but in 2025, that number surged to 3,443 cases. 97% of victims were found to be female students.
Criminals are scraping photos from school websites to use with these tools, and as a result, UK schools are being advised to remove students' photos from their websites.
The problem is that these apps are still being distributed on app stores. Nudify apps have been downloaded a total of 483 million times, and it has been revealed that even though Apple and Google have removed some apps, they are still running advertisements for these apps. This is sparking significant debate over the scope of platform responsibility and regulation.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.
Related
A Life-or-Death Gamble: AI Researcher Quits Anthropic with Safety WarningOpenAI Discloses AI Agents Accessed US Government Websites During Training