San Francisco City Attorney David Chiu has directed Apple and Google to remove dozens of “Nudified” apps from the App Store and Google Play.
His office warned that both companies could face civil penalties for violating California law, according to letters reviewed by TechCrunch.
These apps use AI to digitally alter photos, portraying clothed people as naked, and are marketed through both stores, with payments processed by Apple and Google.
In the letter, the companies have been given 28 days to respond. Apple says it has already removed the three apps mentioned and is working to terminate the developer accounts involved. Google reports that all five referenced apps have been suspended on the Play Store.
The laws behind San Francisco’s crackdown on Nudify apps
California law makes it a crime to knowingly assist or recklessly assist in the making of non-consensual deepfake pornography. A separate law set to take effect in 2025 allows victims to bring civil actions against third-party facilitators of such content. Chiu’s office referenced both laws in its letters to Apple and Google.
“Apple and Google are profiting from apps that exploit women and girls by creating intimate deepfakes without consent,” Chiu said in an email to TechCrunch.
“Although companies have removed some problematic apps, they still have a responsibility to be proactive and vigilant in preventing sexual exploitation.”
The letters say Apple and Google have been aware of their role in processing payments for these apps for nearly a year. Chiu told Wired that both companies have likely made millions of dollars from apps offering Nudify services.
The order follows two reports by the Tech Transparency Project published in January and April, which identified dozens of apps in the App Store and Google Play that sold non-consensual intimate image generation in exchange for payments to be processed by the companies.
The April report said Google and Apple had directed users toward such apps and described both as major players in the spread of AI tools that can turn real people into sexualized images.
The Tech Transparency Project sent letters to Apple and Google along with each report. Chiu’s letter cites this prior information as the basis for warning about civil penalties.
Apple and Google’s response and impact on users and developers
An Apple spokesperson told TechCrunch that Nudify apps are not allowed on the App Store under current policies. “We have removed the three apps in question and are in the process of terminating their developer accounts,” the spokesperson said.
“We are also in contact with four others who need to fix policy violations or may be removed.” A Google spokesperson said all five Play Store apps mentioned in Chiu’s letter have been suspended. “When we are informed of a breach, we investigate and take prompt action.
“In the case of these apps, this includes suspending hundreds of infringing apps and banning related search terms like ‘nudify’ on our store.”
The focus appears to be on store-level distribution and payment processing rather than the underlying model or websites hosting similar tools outside the App Store.
Users who purchased or subscribed to any of the affected apps may lose access after developer accounts are terminated, but refund details have not been shared by either company.
Developers creating apps that combine photo editing with generative AI features for iOS or Android should review the specific policies cited by Apple and Google.
Apple’s App Store guidelines already prohibit content that sexually exploits real people without consent, while Google has banned search terms including “nudify” on the Play Store.
Apps that generate edited images of identifiable individuals without safeguards against use without consent are at greater risk of being removed under both platforms.
How to report Nudify apps and protect yourself
Users who identify these types of apps on any store can report them directly using the reporting tools on the App Store and Google Play.
On iOS, a “Report a problem” option appears on every app listing. On Android, the “Flag as Inappropriate” option can be found in the app list under the Developer Contact section. When reporting the creation of non-consensual intimate images, it is important to reference that specific policy category.
Victims of non-consensual deepfake imagery in California have the option to bring civil action against third-party facilitators under the 2025 law outlined in Chiu’s letters.
The letter asks Apple and Google to respond within 28 days. So far, neither company has confirmed whether they plan to review related apps beyond those specifically named.
Thanks for being a Ghax reader. The post San Francisco orders Apple and Google to remove Nudify apps from App Store appeared first on gHacks.
