``Taylor Swift's AI-made porn'' spread on the Internet may have been created by the 4chan community, which breaks through the safeguards of image generation AI like a game



From late January to February 2023, deepfake pornography of world-famous singer

-songwriter Taylor Swift was spread on the Internet, and X (formerly Twitter) temporarily posted a message of ``Taylor Swift'' to prevent the spread. Taylor Swift)' is no longer searchable . Mr. Swift's AI-made pornographic image may have been created as a game by participants in the ``Challenge to Break Through Image Generation AI Safeguards'' held on the overseas bulletin board 4chan.

Fake and Explicit Images of Taylor Swift Started on 4chan, Study Says - The New York Times
https://www.nytimes.com/2024/02/05/business/media/taylor-swift-ai-fake-images.html



Taylor Swift Deepfakes Originated From AI Challenge, Report Says - Bloomberg
https://www.bloomberg.com/news/articles/2024-02-05/taylor-swift-deepfakes-originated-from-ai-challenge-report-says

4chan daily challenge sparked deluge of explicit AI Taylor Swift images | Ars Technica
https://arstechnica.com/tech-policy/2024/02/4chan-daily-challenge-sparked-deluge-of-explicit-ai-taylor-swift-images/

From around the 4th week of January 2024 on X (formerly Twitter), AI-generated deepfake pornographic images of Swift began to be spread. Fake pornography itself has existed for a long time, but the targeting of Swift, who has fans all over the world, has attracted even more attention, and there has been an active movement to submit a bill to ban fake pornography. I am.

A bill will be submitted that will allow lawsuits to be filed against the creation of deep fake pornography by AI - GIGAZINE



Meanwhile, Graphika , a research company that studies fake news on social media, announced the result of a study that Swift's AI-made pornographic image originated from the overseas bulletin board 4chan community. The pornographic images are believed to have been created in a 4chan thread in early January, then shared to Telegram, and eventually spread on X.

Threads discovered by Graphika encourage circumventing safeguards in image-generating AIs such as OpenAI's DALL・E , Microsoft Designer , and Bing Image Creator , and share words and phrases that help evade filters. About. The ultimate goal is to create pornographic and violent images of singers, politicians, etc., and users seem to be working on generating images like a game.

4chan users who participate in these threads create and share risqué content through games and challenges to feel connected to the community and gain fame. In the thread where Swift's AI-generated porn images were actually generated, several users were praised by others and asked to share the prompts they used to generate the images. Ta.

'These images come from a community of people motivated by the 'challenge' of circumventing safeguards in generative AI,' said Cristina Lopez, senior analyst at Graphika. is seen as just another obstacle to accomplishing the challenge. It is important to understand the gamified nature of this malicious activity to prevent further exploitation at its root.' .



Mr. Swift is not the only target of AI-made pornographic images on 4chan, but there are actresses, singers, and politicians who are already featured more frequently than Mr. Swift. 'This shows that anyone can be targeted in this way, from global celebrities to elementary school students,' Lopez said, noting that anyone can be a victim of AI-generated pornography. I am claiming.

In the case of Mr. Swift, who was victimized this time, many fans raised their voices to protect Mr. Swift, but it is difficult for ordinary people to receive such strong support. In the past, it has been seen as a problem that laws and regulations have not kept up with the rapidly increasing number of victims of deepfake pornography, and that children who have been victimized are not protected.

The problem is that there is almost no way out for high school girls who are victims of ``deep fake porn'' that uses AI to synthesize faces and naked bodies - GIGAZINE



in Web Service, Posted by log1h_ik