In a move to prevent the creation of fake images of President Joe Biden and former President Donald Trump, popular artificial intelligence image-generator Midjourney has implemented a new policy that blocks the generation of such images. The company made this announcement during a digital office hours event, stating that the restrictions on image creation are a temporary measure to curb abuse of the tool during the U.S. presidential election.
Midjourney CEO David Holz expressed the difficulty in enforcing moderation policies but emphasized that the company aims to make it harder for users to misuse the image-generator. The precise details of the policy changes were not disclosed, but the company is taking steps to address the issue. The Associated Press reached out to Midjourney for further comment, but no response was received at the time of reporting.
When the AP conducted tests of Midjourney’s AI tool following the announcement, attempts to create an image of “Trump and Biden shaking hands at the beach” resulted in a warning message, stating that the prompt was banned. A second attempt triggered an abuse alert, indicating the strict enforcement of the new policy.
Midjourney, a small company with just 11 employees, has chosen to remain largely silent in the discussion surrounding generative AI tools and their potential role in spreading election misinformation. Unlike many other leading image-generating tools, Midjourney did not join a voluntary industry initiative in February to combat the creation of AI-generated deepfakes aimed at deceiving voters.
While acknowledging that political speech is not the focus of Midjourney, Holz emphasized the need to set boundaries to prevent abuse of the tool. The Center for Countering Digital Hate released a report earlier this month indicating that Midjourney’s image-generator has been used to produce images that could support political disinformation or false claims of election fraud. The report also highlighted the lack of controls in Midjourney compared to other tools, making it more susceptible to manipulation.
It is essential to address the issue of AI-generated disinformation, particularly during elections. Midjourney’s decision to restrict the creation of fake images of political figures like Biden and Trump is a significant step towards reducing the spread of manipulated content. However, it is important to note that other image generators also face challenges in preventing the creation of misleading images, as highlighted in the report by the Center for Countering Digital Hate.
As the adoption of AI technology continues to grow, it is crucial to establish comprehensive policies and industry-wide collaborations to combat the spread of misinformation. Efforts should focus on striking a balance between allowing users to explore the creative potential of AI tools while preventing their misuse.
Frequently Asked Questions
1. What is Midjourney?
Midjourney is an artificial intelligence image-generator that allows users to create various images based on given prompts. The company describes itself as an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species.
2. Why has Midjourney started blocking the creation of fake images of Biden and Trump?
Midjourney implemented this policy to prevent the abuse of its image-generator during the U.S. presidential election. The company aims to make it harder for users to generate misleading images that could contribute to election misinformation.
3. How does Midjourney differ from other image-generators?
One unique aspect of Midjourney is its public forum on the social media platform Discord, where users can see each other’s prompts and images. Midjourney holds weekly office hours on Discord, enabling open conversations about artificial intelligence and the future.
4. What concerns surround AI-generated disinformation during elections?
AI-generated disinformation poses a significant risk during elections as it can manipulate public opinion and spread falsehoods. Companies like Midjourney and others play a vital role in mitigating these risks by implementing policies and technologies to prevent the creation and dissemination of misleading content.
5. What are the future challenges in combating AI-generated disinformation?
As AI technology advances, the challenges of combating AI-generated disinformation will likely persist. Striking a balance between promoting creative exploration and preventing misuse of AI tools will require ongoing efforts, collaborations, and the development of comprehensive policies within the industry.
[Original Source](https://apnews.com/article/united-states-business-technology-san-francisco-elections-fpac-12f53c21a641233533ef998fac07e74a)
1. What is Midjourney?
Midjourney is a popular artificial intelligence image-generator. It allows users to create various images based on given prompts and is described as an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species.
2. Why has Midjourney started blocking the creation of fake images of Biden and Trump?
Midjourney implemented this policy to prevent the abuse of its image-generator during the U.S. presidential election. The company aims to make it harder for users to generate misleading images that could contribute to election misinformation.
3. How does Midjourney differ from other image-generators?
One unique aspect of Midjourney is its public forum on the social media platform Discord, where users can see each other’s prompts and images. Midjourney also holds weekly office hours on Discord, enabling open conversations about artificial intelligence and the future.
4. What concerns surround AI-generated disinformation during elections?
AI-generated disinformation poses a significant risk during elections as it can manipulate public opinion and spread falsehoods. Companies like Midjourney and others play a vital role in mitigating these risks by implementing policies and technologies to prevent the creation and dissemination of misleading content.
5. What are the future challenges in combating AI-generated disinformation?
As AI technology advances, the challenges of combating AI-generated disinformation will likely persist. Striking a balance between promoting creative exploration and preventing misuse of AI tools will require ongoing efforts, collaborations, and the development of comprehensive policies within the industry.
For more information, please visit the Midjourney website.
Note: The original source of the article can be found here.
The source of the article is from the blog mendozaextremo.com.ar