Online trolls on platforms like 4chan are using AI tools to spread harassing and racist material. These tools have enabled users to manipulate images and generate fake audio, causing immense harm to individuals who have appeared before organizations like the Louisiana parole board. While the manipulated content has not spread widely beyond 4chan, experts warn that it provides a chilling glimpse into the potential for AI-powered online harassment.
These fringe platforms often serve as a breeding ground for adopting new technologies such as AI, allowing users to amplify their extremist ideologies and project them into mainstream spaces. The rise of AI image generators designed specifically for creating pornographic content has become a major concern. These tools, like Dall-E and Midjourney, allow users to generate explicit images by simply providing text descriptions.
Regulators and technology companies are grappling with the challenges posed by these AI tools. While federal laws are lacking, some states, like Illinois, California, Virginia, and New York, have taken steps to ban the creation and distribution of nonconsensual AI-generated pornography. The Louisiana parole board itself has launched an investigation into the creation of manipulated images by online trolls.
Another use of AI that has raised alarms is voice cloning. An AI tool developed by ElevenLabs allows for the creation of convincing digital replicas of someone’s voice. This tool has been misused to create fake audio clips of prominent individuals saying offensive and racist things. Restrictive measures implemented by ElevenLabs have done little to curb the spread of AI-generated voices on platforms like TikTok and YouTube, where political disinformation is often shared.
Moreover, open-source AI tools, like Meta’s Llama language model, have been exploited by users on 4chan to produce antisemitic ideas, far-right talking points, sexually explicit content, racist memes, and more. This highlights the potential dangers of releasing AI software code without proper safeguards and oversight.
As AI continues to advance, it is crucial for regulators and technology companies to collaborate in developing robust measures to address the misuse of these tools. Balancing responsibility and openness will be key to ensuring that AI is not weaponized for malicious purposes and that individuals are protected from the harmful effects of online harassment and hate campaigns.
The source of the article is from the blog maltemoney.com.br