Lawsuit filed to shut down 'web app that makes it easy to create deep fake porn'
In recent years, with the development of generative AI technology, it has become easier to generate sexual images 'deep fake porn' using AI, and harassment by deep fake porn has
Complaint_Final_Redacted.pdf
(PDF file) https://www.sfcityattorney.org/wp-content/uploads/2024/08/Complaint_Final_Redacted.pdf
City Attorney sues most-visited websites that create nonconsensual deepfake pornography – City Attorney of San Francisco
https://www.sfcityattorney.org/2024/08/15/city-attorney-sues-most-visited-websites-that-create-nonconsensual-deepfake-pornography/
San Francisco Files Nation's First Suit Over AI Pornography (1)
San Francisco sues AI-generated deepfake porn sites
https://sfstandard.com/2024/08/15/ai-generated-deepfake-porn-sites-sued-by-san-francisco/
The San Francisco City Attorney's Office alleges that 16 websites, which received a combined total of 200 million visits in the first half of 2024 alone, are misusing an open-source image generation model that allows users to 'nude' images of women. It also states that victims of AI-generated deepfake pornography 'may suffer severe psychological and economic harm, as well as negative publicity from the dissemination of their images on the Internet.'
In addition, these sites require users to pay a subscription fee to generate the images, although some sites offer free trials. As a result, it has been pointed out that millions of deepfake porn images are generated each year, the majority of which feature women.
'We must be clear that deepfake porn is not an innovation; it is sexual abuse. This is a serious problem that we need to solve as quickly as possible,' said Prosecutor David Chiu.
The San Francisco City Attorney's Office is seeking to shut down the websites and pay damages to the operators of these sites, about 50 of whom are violating state and federal laws, including the prohibition on revenge porn, by generating deep fake porn without the consent of the victims. Deputy Attorney General Karun Tilak said, 'We cannot determine with certainty at this time what image generation AI these websites are using. However, early versions of Stability AI's open source image generation AI, Stable Diffusion, are prone to being misused for deep fake pornography and other purposes.'
'We all have an obligation to do our part to crack down on bad actors who use AI to exploit and abuse real people, including children,' Prosecutor Chiu declared. The operators of the websites targeted in the lawsuit have not commented on the lawsuit.
Related Posts:
in Web Service, Posted by log1r_ut