Quality Diversity through AI Feedback

Herbie Bradley1,2,3, Andrew Dai4, Jenny Zhang5,6, Jeff Clune5,6, Kenneth Stanley7, Joel Lehman1,2 1CarperAI, 2Stability AI, 3University of Cambridge, 4Aleph Alpha, 5University of British Columbia, 6Vector Institute, 7Maven Figure 1: Maps showing the diversity across...

Diff Models – A New Way to Edit Code

CarperAI is releasing a series of diff models—models trained to predict a code diff, trained on millions of commits scraped from GitHub. We are releasing 3 models of different sizes, all fine-tuned from Salesforce’s CodeGen code synthesis models: diff-codegen-350m...

OpenELM Release

Today, CarperAI is releasing OpenELM, an open-source library combining large language models with evolutionary algorithms for code synthesis. ELM stands for Evolution Through Large Models, a technique from a recent OpenAI paper demonstrating that large language models...