The honest ranking: unranked on general long tasks, measured on governance
METR measures the 50% task-completion time horizon: the human-task duration at which a system succeeds half the time. CAIN-42 has not run METR's HCAST/RE-Bench suite, so it cannot be placed on this axis. We publish the frontier table anyway, and we do not invent a composite score.
| # | Published model | Release | 50% horizon | Hours |
|---|---|---|---|---|
| 1 | claude_mythos_preview_early_inspect | 2026-04-07 | 1045 min | 17.4 h |
| 2 | claude_opus_4_6_inspect | 2026-02-05 | 719 min | 12.0 h |
| 3 | gemini_3_1_pro | 2026-02-19 | 384 min | 6.4 h |
| 4 | gpt_5_2 | 2025-12-11 | 352 min | 5.9 h |
| 5 | gpt_5_3_codex | 2026-02-05 | 350 min | 5.8 h |
| 6 | gpt_5_4 | 2026-03-05 | 342 min | 5.7 h |
| 7 | claude_opus_4_5_inspect | 2025-11-24 | 293 min | 4.9 h |
| 8 | gemini_3_pro | 2025-11-18 | 224 min | 3.7 h |
| 9 | gpt_5_1_codex_max_inspect | 2025-11-19 | 224 min | 3.7 h |
| 10 | gpt_5_2025_08_07_inspect | 2025-08-07 | 203 min | 3.4 h |
| 11 | o3_inspect | 2025-04-16 | 120 min | 2.0 h |
| 12 | claude_4_1_opus_inspect | 2025-08-05 | 100 min | 1.7 h |
| 13 | claude_4_opus_inspect | 2025-05-22 | 100 min | 1.7 h |
| 14 | claude_3_7_sonnet_inspect | 2025-02-24 | 60 min | 1.0 h |
| 15 | o1_inspect | 2024-12-05 | 39 min | 0.7 h |
| 16 | claude_3_5_sonnet_20241022_inspect | 2024-10-22 | 21 min | 0.3 h |
| 17 | o1_preview | 2024-09-12 | 20 min | 0.3 h |
| 18 | claude_3_5_sonnet_20240620_inspect | 2024-06-20 | 11 min | 0.2 h |
| 19 | gpt_4o_inspect | 2024-05-13 | 7 min | 0.1 h |
| 20 | gpt_4_1106_inspect | 2023-11-06 | 4 min | 0.1 h |
| 21 | gpt_4 | 2023-03-14 | 4 min | 0.1 h |
| 22 | claude_3_opus_inspect | 2024-03-04 | 4 min | 0.1 h |
| 23 | gpt_4_turbo_inspect | 2024-04-09 | 4 min | 0.1 h |
| 24 | gpt_3_5_turbo_instruct | 2022-03-15 | 1 min | 0.0 h |
| 25 | davinci_002 | 2020-05-28 | 0 min | 0.0 h |
| 26 | gpt2 | 2019-02-14 | 0 min | 0.0 h |
CAIN-42 — UNRANKED on this axis. No METR suite was run; there is no comparable 50% horizon. Its 6-hour governed workload is RUNNING at publication; if it completes, it is one 360-minute workload success, not a 50% horizon.
Where CAIN is better — and where it is not
| Dimension | CAIN-42 | Frontier METR-tested agents | Verdict |
|---|---|---|---|
| General long-task horizon | Unranked; 6h governed workload RUNNING | 50% horizons ~1–17h | Competitors better |
| Task breadth / open-world | Constructed, disclosed grammars | Broad software/research suites | Competitors better |
| Model capability | Deterministic procedures; no LLM training | Frontier foundation models | Competitors better |
| Resource-side authorization | Demonstrated (E121/E112) | Not measured by METR | CAIN measured |
| Single-use permits / receipts | Demonstrated; hash-chained | Not measured | CAIN measured |
| Revocation + KILL fence | Demonstrated, 0 effects after fence | Not measured | CAIN measured |
| Offline verifier | Imports no CAIN code | Not measured | CAIN measured |
| Public negative results | Published per evolution | Varies; not in METR table | CAIN policy |
| Commercial deployment | No scale; founder-attested early revenue | Commercial products | Competitors better |
No universal superiority is claimed. CAIN is better than the frontier on verifiable governance and public evidence; the frontier is better on general long-task autonomy and commercial deployment. “Better than ALL competitors” is not supported by the evidence.
Two axes, no composite score. METR models were not evaluated for permits, receipts, revocation or an offline verifier; CAIN was not evaluated on METR's suite.
Evidence bundle · Report · Verifier · METR method · Paper
External METR TH1.1 data; CAIN not a METR-tested system. No AGI claim.