The short version
- Researchers using test accounts for thirteen-year-olds successfully downloaded one hundred thirty-five apps with nudification features from Apple and Google stores.
- Many of these applications were inaccurately rated as suitable for young children, bypassing parental controls designed to restrict access to adult content.
- Both tech giants have responded by tightening moderation guidelines and removing specific violating apps following the release of the findings.
A new investigation reveals that artificial intelligence applications capable of creating nonconsensual nude imagery remain widely accessible to teenagers on major mobile platforms, despite existing parental controls and corporate policies. The Tech Transparency Project conducted a study using test accounts designated for thirteen-year-olds to assess the effectiveness of safety measures on Apple and Google app stores. The researchers were able to download one hundred thirty-five applications that featured tools for stripping clothing from images or swapping faces onto nude bodies. This finding underscores a significant vulnerability in current digital safeguards, allowing minors to access software designed to generate sexualized content without triggering standard age-restriction alerts.
The practical implications of these findings are illustrated by recent incidents in American high schools where students have used such technology to harass peers. In one documented case in Pennsylvania, a student utilized an app called Movely to create pornographic videos featuring the likeness of a classmate and several other girls. The victim’s mother, Morgan Dorfman, noted that she was unaware such tools could be applied to ordinary individuals rather than just celebrities. She described the confusion and fear experienced by the students involved, who did not know how to respond to the digital abuse. This incident reflects a broader pattern of harassment reported by students across the country, indicating that the threat is not isolated but part of a growing trend in cyberbullying.
The investigation highlighted systemic issues with how app stores manage content ratings and developer compliance. Both Apple and Google prohibit the distribution of apps that facilitate nonconsensual intimate imagery and typically employ age-gating mechanisms to block minors from accessing adult material. However, the study found that these platforms largely depend on developers to self-report the appropriate age rating for their applications. This reliance creates a loophole where malicious software can be mislabeled as suitable for young audiences. In one striking example, a face-swapping app advertised with sexually explicit imagery was rated as appropriate for children as young as four years old.
The ease of access extends to both free and paid versions of these applications. Researchers observed that the free version of Movely promoted suggestive templates, while the paid subscription offered more explicit options. Crucially, the study found that a thirteen-year-old test account could purchase a subscription to one of these apps without any notification being sent to linked parental accounts. This bypasses the intended function of family sharing features and parental controls, leaving guardians unaware that their children have accessed harmful content. The ability to make such purchases without friction suggests that current verification processes are insufficient for preventing underage access to sensitive material.
Regulatory efforts in the United States have attempted to address this issue, with most states implementing laws that criminalize the possession of AI-generated child sexual abuse material. International governments have also moved to ban these platforms from app stores. Despite these legal and regulatory frameworks, the proliferation of nudification apps continues. The Tech Transparency Project’s report indicates that the combination of lax developer self-rating and inadequate platform oversight allows these tools to persist in digital marketplaces. The findings suggest that legislative bans alone are not enough to stop the distribution of such software when enforcement mechanisms on private platforms remain porous.
In response to the study, both major tech companies have taken steps to address the identified vulnerabilities. Google stated that it regularly takes proactive measures to detect and remove harmful content, including suspending violating apps and restricting related search terms. A company spokesperson emphasized that investigations are conducted swiftly when violations are detected or reported. Apple also implemented changes to its content moderation guidelines after being contacted by the researchers. The company now requires developers to preemptively prevent and remove nonconsensual intimate imagery, including AI-generated content, before their apps are published.
Apple further clarified that it reviews every application prior to publication and removes apps and developers who misrepresent features. The company noted that it had already removed some of the apps identified in the report and has taken action on the remaining ones. However, Apple also pointed out that several applications listed in the study are mainstream photo and video editing tools with legitimate functionality, arguing that they do not inherently possess nudification capabilities. This distinction highlights the complexity of moderating dual-use technology, where standard editing features can be exploited for harmful purposes.
The ongoing presence of these apps raises questions about the long-term effectiveness of self-regulation in the tech industry. While platforms have responded to the specific findings of this investigation, the underlying reliance on developer honesty regarding age ratings remains a structural weakness. Parents and educators are left navigating a landscape where digital threats can emerge rapidly and bypass traditional safety nets. The case of the Pennsylvania student serves as a stark reminder that the technology is not only available but actively being used to harm young people. Future efforts will likely need to focus on more robust automated detection systems and stricter penalties for developers who mislabel their applications.
As the debate over AI regulation continues, this report provides concrete evidence of the gaps between policy and practice. The ability of a thirteen-year-old to access hundreds of apps capable of generating nonconsensual pornography demonstrates that current safeguards are not foolproof. While Apple and Google have taken immediate action on the specific apps identified, the broader ecosystem remains vulnerable to similar abuses. Ensuring the safety of minors online will require sustained pressure on platforms to improve their verification processes and reduce their dependence on self-reporting by app developers.
Sources behind this briefing
Go to the original reporting
- The Guardian US↗US teens can access ‘nudify’ apps despite Apple and Google’s parental controls, report finds
