Pinned Loading

1. openai/evals openai/evals Public

   Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

   Python 15.9k 2.7k

2. openai/preparedness openai/preparedness Public

   Releases from OpenAI Preparedness

   Python 634 55

3. openai/mle-bench openai/mle-bench Public

   MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

   Python 665 90

4. bitblaster-16 bitblaster-16 Public

   BitBlaster-16 is a 16-bit computer built from scratch using only NAND gates and data flip-flops as primitives! :)

   Python 2

5. fermi-poker fermi-poker Public

   Want to get better at making better estimates under uncertainty? No? Well, now you can!

   Python 3

6. summarizing-from-human-feedback summarizing-from-human-feedback Public

   Implementation of OpenAI's "Learning to Summarize with Human Feedback"

   Jupyter Notebook 7 1