San Francisco Sues 16 AI-Powered Sites for Non-Consensual Deepfakes

San Francisco Takes Legal Action Against AI-Powered "Undressing" Websites

The San Francisco City Attorney's office has commenced legal proceedings against 16 popular AI-powered websites that facilitate the creation of nude deepfakes, targeting primarily women and girls. Announced by City Attorney David Chiu, this landmark lawsuit highlights the significant issue of non-consensual imagery that has surged with the rise of generative AI technologies.

Understanding the Problem

The lawsuit claims that these websites saw over 200 million visits in just the first six months of 2024. Users can upload images of clothed individuals, which are then manipulated by AI to simulate nudity. Chillingly, one unnamed site even promotes the idea that seeking real relationships is futile compared to acquiring such manipulative content.

Legal Implications

These sites are accused of violating several laws, including:

• Revenge pornography laws
• Deepfake pornography laws
• Child pornography laws
• California's unfair competition law

According to the lawsuit, the harm caused to individuals far exceeds any potential benefits these practices may claim.

Seeking Justice and Accountability

The City Attorney's suit aims for civil penalties and seeks to have these sites taken offline permanently, preventing their operators from engaging in the creation of deepfake pornography in the future. This action reflects a growing commitment to combating the use of technology for exploitation and abuse.

The Rise of Non-Consensual Content

As generative AI continues to advance, incidences of non-consensual nudes have become alarmingly prevalent. Many high-profile victims, including celebrities like Taylor Swift, have suffered from such invasions of privacy. The issue also extends to schools, where students have faced serious repercussions for sharing AI-generated explicit images of their peers.

A Call to Action

Chiu emphasized the urgency of addressing this troubling trend, stating, "This investigation has taken us to the darkest corners of the internet, and I am absolutely horrified for the women and girls who have had to endure this exploitation." The situation underscores a pressing need for society to confront and mitigate the exploitation enabled by AI technologies.

Conclusion

The San Francisco lawsuit represents a crucial step in recognizing and addressing the ramifications of AI-powered technologies in our digital society. By holding these platforms accountable, the city is challenging the normalization of exploiting individuals through deepfake technology.