Apr 12, 2023 13:00:00

``The damage of spam bots using ChatGPT is serious,'' Reddit's moderator talks about the terrible reality

“Generative AI” such as chatGPT for conversational AI and “Stable Diffusion” image generation AI

have been pointed out by AI technology ethics groups as “weapons that threaten public safety,” and will increase global GDP by 7% and lead to 300 million people. It is believed that Goldman Sachs will have a large-scale impact on the world and people, such as announcing a survey report when it affects the employment of . On the other hand, as a damage that is often overlooked, the moderator of the bulletin board-type social news site Reddit talks about the fact that bots using AI such as ChatGPT are destroying the community as spam.

Reddit Moderators Brace for a ChatGPT Spam Apocalypse
https://www.vice.com/en/article/jg5qy8/reddit-moderators-brace-for-a-chatgpt-spam-apocalypse

While generative AI can be used for various jobs and hobbies, in a report of a workshop held by the European Criminal Police Organization (Europol) for experts, large-scale language models (LLM) used especially for ChatGPT etc. , It has been pointed out that there is a high possibility that it will be used for spreading hoaxes, fraud, and cybercrime. Since ChatGPT can create very realistic sentences, it is believed that sentences used for fraud and spam will be less likely to contain grammatical errors and strange expressions, and will be mass-produced with natural fraud documents.

Europol summarizes how excellent chatbot AI such as ChatGPT is easy to use for crime - GIGAZINE

Reddit's forum for asking and discussing history , r/AskHistorians , has been targeted by spam created on ChatGPT, said Reddit moderator Sara Gilbert. r/AskHistorians is one of the largest history forums on the Internet, as you can submit questions on any history topic and receive detailed answers from history experts. By February 2023, according to Gilbert, r/AskHistorians and several other Reddit communities had 'bots entering forum questions into ChatGPT and spitting out answers through a number of fake accounts.' It was discovered that I was the victim of a systematic bot attack using ChatGPT.

Some Reddit moderators believe that ``ChatGPT's repeated posts are testing how much moderators and users will notice and respond to AI-generated text.'' In addition, other ChatGPT posts are seen as part of `` astroturfing '' and spam campaigns, in which specific groups and organizations express their opinions behind the scenes under the guise of individual grassroots movements. In addition, on Reddit, collecting 'up votes' for daily posts is considered by other users to be a 'trustworthy account', so after daily doing 'good deeds' by posting with ChatGPT and establishing it as a trustworthy account Moderators also point out cases of 'karma farming' used for malicious purposes.

Historically, when astroturfing occurs, many different accounts reuse the same text, making it relatively easy to detect and deal with. But since ChatGPT makes it easy to create new spam posts, 'the problem with bots was so serious that Reddit's automated anti-spam system was of little help. By the time it worked, it was too late, and the bots It has served its purpose,' commented a moderator at r/Technology, one of Reddit's largest forums. According to r/Technology moderators, the majority of Reddit bots are not used for political purposes, but for advertising purposes, including simple fraudulent sites such as marijuana, pornography and gambling. .

While a moderator of r/Cybersecurity said, 'The subsystem for catching ChatGPT content has a high detection rate when explicitly used for marketing purposes.' “When it comes to karma farming, where fake accounts pretend to be real accounts, moderation tools have done little to detect it, and we don’t know how much of it is currently being detected. is not a problem, but what you have overlooked is the problem,' he says of the seriousness of bot damage. In fact, tools such as 'AI Text Classifier ', a tool for detecting AI sentences by OpenAI , which developed ChatGPT, and 'GPTZero' published by Mr. However, it is not said that it can reliably detect content created by AI, and the difficulty of detecting spam messages by AI is known.

What is the accuracy of the tool `` GPTZero '' that distinguishes between humans and AI who wrote sentences? -GIGAZINE

The problem of ChatGPT-powered bots across Reddit is 'pretty bad at the moment,' said a Reddit moderator familiar with the platform's broader moderation system. According to its moderators, hundreds of accounts have already been removed from Reddit, with more being discovered every day. Reddit declined to comment when VICE Media contacted Reddit about the matter. According to Gilbert, a Reddit employee notified the moderator that ``Reddit is working on an AI detection tool,'' but for the time being, volunteer moderators will manually deal with AI posts. It says it needs to be done.