BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

BigCode

BigCode is an open scientific collaboration working on responsible training of large language models for coding applications. You can find more information on the main website or follow Big Code on Twitter. In this organization you can find the artefacts of this collaboration: StarCoder 2, a state-of-the-art language model for code, and the previous StarCoder family of models, The Stack, the largest available pretraining dataset with permissive code, Astraios, scaling instruction-tuned language models for code via diverse fine-tuning methods, OctoPack, artifacts for instruction tuning large code models, and SantaCoder, a 1.1B parameter model for code.