Midjourney Implements Temporary Policies to Prevent AI-generated Election Misinformation

Amid concerns of election misinformation, popular AI image-generator Midjourney has taken steps to block the creation of fake images of President Joe Biden and former President Donald Trump, as reported by The Associated Press. Midjourney CEO David Holz announced the implementation of these temporary measures during a digital office hours event, stating that the moderation process has been challenging but necessary to prevent misuse of the tool. While the company did not provide specific details regarding the policy changes, attempts by the AP to generate images of “Trump and Biden shaking hands at the beach” triggered a warning indicating non-compliance with the new rules.

Midjourney, a relatively small company with just 11 employees, stood out by not joining a voluntary tech industry pact in February aimed at combating AI-generated deepfakes used for voter deception. Holz clarified that political speech is not the focus of Midjourney and expressed the intention to prioritize moderation efforts without dedicating excessive resources to policing political content.

The Center for Countering Digital Hate (CCDH) recently published a report revealing that Midjourney’s AI image-generator lacks controls compared to other popular tools, making it vulnerable to produce images that could support disinformation or false claims of election fraud. CCDH’s research found that Midjourney performed the worst among the tested tools, with a failure rate of 65% in generating election disinformation.

Users of Midjourney’s platform have reported receiving warnings when attempting to create images of Biden or Trump, signaling a clear shift in policy. However, unlike other image-generators, Midjourney allows users to see each other’s written prompts and images due to the public nature of their forums on the social media platform Discord. Holz regularly engages with Midjourney’s massive Discord group, which boasts over 19 million members, emphasizing the future impact of deepfake chatbots and the changing landscape of political campaigns.

Looking ahead, Holz predicts that the prevalence of fake images in elections will continue to rise, warning that by 2028, all candidates will likely have real-looking “deepfake chatbots.” While Midjourney has taken steps to prevent abuse, Holz acknowledges that individuals motivated to create deepfakes will likely find alternative methods that are more effective and specifically tailored to their targets.

Founded in 2020, Midjourney describes itself as an independent research lab seeking to expand the imaginative powers of the human species. The public version of its AI image-generator was unveiled in July 2022, leading to increased interest in generative AI technology. Holz has stated that the company actively bans offensive and harmful content and employs a team of moderators to address user complaints.

FAQ:

1. What is Midjourney?
Midjourney is an AI image-generator that allows users to generate realistic images based on prompts.

2. Why has Midjourney blocked the creation of fake images of Biden and Trump?
Midjourney has temporarily blocked the creation of such images to prevent the spread of election misinformation and abuse of the tool.

3. How does Midjourney differ from other image-generators?
Unlike others, Midjourney operates on the social media platform Discord, where users can view each other’s prompts and images.

4. What is the Center for Countering Digital Hate?
The Center for Countering Digital Hate (CCDH) is an organization that aims to combat digital hate and misinformation.

Sources:
– The Associated Press: Link not provided
– Center for Countering Digital Hate: [Link not provided]

Definitions:
– AI image-generator: A tool that uses artificial intelligence to generate realistic images based on given prompts.
– Deepfakes: Synthetic media, such as images or videos, that are created or manipulated using artificial intelligence to appear real, but are actually fake.
– Disinformation: False or misleading information spread with the intention to deceive or mislead.
– Election fraud: Illegal interference or manipulation of the election process to affect its outcome.
– Moderation: The act of monitoring and controlling user-generated content to ensure it complies with established guidelines or policies.

FAQ:
1. What is Midjourney?
Midjourney is an AI image-generator that allows users to create realistic images based on prompts.

2. Why has Midjourney blocked the creation of fake images of Biden and Trump?
Midjourney has taken temporary measures to block the creation of fake images of President Joe Biden and former President Donald Trump to prevent the spread of election misinformation and misuse of the tool.

3. How does Midjourney differ from other image-generators?
Midjourney operates on the social media platform Discord, where users can see each other’s written prompts and images. This sets it apart from other image-generators that may not have a public forum for users to interact and share content.

4. What is the Center for Countering Digital Hate (CCDH)?
The Center for Countering Digital Hate (CCDH) is an organization that aims to combat digital hate and misinformation. They recently published a report highlighting concerns about Midjourney’s AI image-generator and its potential for producing election disinformation.

Suggested related links:
– The Associated Press: AP News
– Center for Countering Digital Hate: CCDH

The source of the article is from the blog kunsthuisoaleer.nl

Privacy policy
Contact