While acknowledging limitations – including the need to test on larger models and optimise for domains without easily verifiable rewards – the work opens “a scalable and principled path for building AI systems” in areas demanding complex interaction and verifiable outcomes, such as theorem proving, software engineering, and scientific discovery.(Image by Gerd Altmann)See also: How does AI judge? Anthropic studies the values of ClaudeWant to learn more abou