OpenAI, a leading AI start-up, has announced the creation of a new team called Collective Alignment, which aims to crowdsource public opinion to influence the behavior of its AI models. The team will work on designing systems that incorporate public inputs and address various challenges, such as the digital divide, polarization, diversity representation, and concerns about the future of AI governance.
As part of its efforts, OpenAI will collaborate with external advisors and grant teams, including running pilots to implement the grant prototypes into steering its AI models. The company is actively recruiting research engineers from diverse technical backgrounds to join the Collective Alignment team.
This initiative stems from OpenAI’s public programme launched in May, where it awarded grants worth €100,000 each to support experiments on “democratic inputs to AI” around the world. The program aimed to establish a democratic process for determining rules that AI systems should follow.
OpenAI acknowledges the apprehension some participants expressed about AI’s involvement in policy-making and highlights the importance of transparency in the use of AI in democratic processes. Participants in the program experienced a shift in sentiment, with many becoming more hopeful about the public’s ability to contribute to guiding AI through deliberative discussions.
In addition to the formation of the Collective Alignment team, OpenAI has also shared the code developed by the grant program participants and provided summaries of their work. This move contributes to OpenAI’s commitment to openness and transparency in its approach to AI development.
By incorporating public opinion and creating systems that reflect diverse perspectives, OpenAI aims to ensure AI models are aligned with societal values and avoid biases or unintended consequences. The Collective Alignment team represents OpenAI’s dedication to responsibly incorporate public input into the shaping of AI technology.
The source of the article is from the blog reporterosdelsur.com.mx