Google, Apple hosted dozens of deepfake nudify apps, investigation reveals
A new investigation claims that the Apple and Google app stores hosted dozens of so-called "nudify" AI apps, despite such apps violating the companies' rules.
The Transparency Project (TTP), a group affiliated with the Kennedy School of Government at Harvard University, found dozens of apps in both stores that digitally remove clothes, rendering the subjects naked or nearly naked. It found 55 such apps in the Google Play Store and 47 in the Apple App Store.
Wrote TTP:
"The apps identified by TTP have been collectively downloaded more than 705 million times worldwide and generated $117 million in revenue, according to AppMagic, an app analytics firm. Because Google and Apple take a cut of that revenue, they are directly profiting from the activity of these apps."
Both tech giants have responded to the TTP report. Apple told CNBC it had removed 28 apps identified in the TTP report, while Google told the outlet it had "suspended several apps" while noting its investigation was ongoing.
However, the TTP concludes that both App Stores need to do more to stop non-consensual deepfakes.
"TTP’s findings show that Google and Apple have failed to keep pace with the spread of AI deepfake apps that can 'nudify' people without their permission," the report states. "Both companies say they are dedicated to the safety and security of users, but they host a collection of apps that can turn an innocuous photo of a woman into an abusive, sexualized image."
The report from TTP comes on the heels of the controversy surrounding Elon Musk and xAI's Grok, which is under investigation in several countries for creating sexualized, nonconsensual images. A Mashable investigation found that Grok lacks basic safety guardrails to prevent deepfakes. In addition, researchers say Grok has created more than 3 million sexualized images — including more than 20,000 that appeared to depict children — over an 11-day period between Dec. 29 and Jan. 8.
With the dawn of the AI age, sexual deepfakes will continue to be a major issue for tech companies moving forward.