OpenAI, the artificial intelligence lab backed by Microsoft, has announced the formation of a new team called “Collective Alignment” to establish democratic processes for governing their AI software. This initiative aims to address concerns over bias and other factors in the development and use of AI technology. The team extends the work of a grant program introduced in May 2023, which focused on funding experiments related to democratic processes in AI.
The goal of the Collective Alignment team is to allow direct input from people as OpenAI continues its mission to develop advanced AI models that could become integral parts of society. Tyna Eloundou, a research engineer and founding member of the team, emphasized the importance of public participation in shaping the future of AI.
To ensure that only humans can provide input, OpenAI may collaborate with Worldcoin, a cryptocurrency project founded by OpenAI’s CEO, Sam Altman. Worldcoin offers a method for distinguishing between human users and AI bots. Teddy Lee, a product manager and member of the new team, mentioned the possibility of integrating Worldcoin’s technology, although no concrete plans have been made yet.
OpenAI gained significant attention with the release of ChatGPT, an AI program capable of generating coherent and persuasive text. However, concerns regarding AI’s potential to manipulate information, such as creating “deepfake” images and spreading misinformation, have raised alarms, particularly with the approaching 2024 U.S. election campaign. Critics argue that AI systems like ChatGPT can have inherent biases derived from the data on which they are trained, leading to instances of racist or sexist outputs.
OpenAI’s new team is actively recruiting a research engineer and research scientist. They will collaborate closely with the “Human Data” team, which constructs frameworks for gathering human input on the AI models, as well as other research teams.
Overall, OpenAI’s commitment to democratic governance and the involvement of diverse voices in the development and use of AI technology is an essential step towards ensuring its responsible and unbiased integration into society.
The source of the article is from the blog karacasanime.com.ve