A public catalog of biology evaluations: what they measure, benchmark variants, implementation status, and linked GitHub issues and PRs.
The catalog contains 94 benchmarks, each tracking one selected version. Notes retain other versions from the 120 original spreadsheet entries. It uses Observable Framework with a searchable overview, benchmark pages, and daily GitHub issue/PR status snapshots.
Project issues and scope · Contributing · Import reconciliation
Edit YAML records in benchmarks/ and commit to main. GitHub Actions validates
the records, runs focused tests and browser checks, and deploys to GitHub Pages.
Linked GitHub status refreshes daily and on catalog deployments, with a manual
refresh option. The explorer is deployed at the link above.
Evaluation adapters remain in their framework repositories. Model attempts and result displays are deferred; the explorer focuses on understanding evaluations and coordinating implementation.