OpenELM Paper & 0.9 Release

Jul 10, 2023 | Blogs

CarperAI is happy to announce the paper and 0.9 release of OpenELM! OpenELM is an open-source library that enables evolutionary search with language models in both code and natural language.  This release is intended to be mostly feature-complete, and we intend...

Quality Diversity through AI Feedback

May 24, 2023 | Blogs

Herbie Bradley1,2,3, Andrew Dai4, Jenny Zhang5,6, Jeff Clune5,6, Kenneth Stanley7, Joel Lehman1,2 1CarperAI, 2Stability AI, 3University of Cambridge, 4Aleph Alpha, 5University of British Columbia, 6Vector Institute, 7Maven Figure 1: Maps showing the diversity across...

Diff Models – A New Way to Edit Code

Jan 27, 2023 | Blogs

CarperAI is releasing a series of diff models—models trained to predict a code diff, trained on millions of commits scraped from GitHub. We are releasing 3 models of different sizes, all fine-tuned from Salesforce’s CodeGen code synthesis models: diff-codegen-350m...

OpenELM Release

Nov 25, 2022 | Uncategorized

Today, CarperAI is releasing OpenELM, an open-source library combining large language models with evolutionary algorithms for code synthesis. ELM stands for Evolution Through Large Models, a technique from a recent OpenAI paper demonstrating that large language models...