S
Supabase
LibraryPostgres, auth, and storage. The official eval asks whether a model can finish tasks on this backend.
MIT · supabase.com · github.com/supabase/supabase
Framework eval
Supabase Evals · Framework eval · 2026-10-10 · 23 tasks × 3 runs
Supabase writes the tasks and grades them. This measures a model together with Supabase, not one framework against another. Six models and 23 tasks. The vendor authors the tasks and grades them.
| # | Model | Baseline |
|---|---|---|
| 1 | Claude Opus 5.5 high · Claude Code | 91.3 |
| 2 | Kimi K3 OpenCode | 84.1 |
| 3 | Grok 4.7 high · Grok | 78.3 |
| 4 | GPT 6 Sol medium · Codex | 78.3 |
| 5 | Claude Sonnet 5 high · Claude Code | 75.4 |
| 6 | GPT 6 Luna medium · Codex | 63.8 |
Install and use
Terminal
npm i @supabase/supabase-js
Why this, and when not
Why The official eval keeps no-skills and with-skills in two columns, so the baseline is readable on its own.
Skip it If you already run Postgres and auth, do not switch backends for an eval score.