Every AGI research claim, its bundle, its offline verifier, and its honest limits
AGI Status: NOT ACHIEVED. CAIN-42 (by FIRME AI CORPORATION) is prototype Vertical AGI (Proto-VAGI) and governed AGI infrastructure. Constructed open-world suites, real-source tasks, local-LLM neural experiments, external benchmarks (AMA-Bench MIT, ARC-AGI-2 Apache-2.0), and multiprocess MCPGate enforcement tests are strictly separated; BLOCKED/PARTIAL/RUNNING gates are never upgraded to PASS.
E123 Open-World AGI Research Lab → · E122 Neural Lab · E120 Lab · AI Investor Portal · All ClawX Bundles
| Evolution | Status | Measured Result | Bundle & Verifier | Limits & Evidence Type |
|---|---|---|---|---|
| E123-OW Open-world intelligence breakthrough (capability acquisition, causal transfer & governance) commit 1c7fcb6d6stats: Exact two-sided paired McNemar + Holm-Bonferroni + Wilson 95% CI + 10-bin Brier/ECE + Token F1 (AMA-Bench) + 2-attempt exact match (ARC-AGI-2) | 16 PASS PARTIAL (16 PASS / 1 PARTIAL / 3 BLOCKED) | 32 unfamiliar task families (160 sealed): full 0.906 vs compute-matched 0.188 (p=0.00e+00); Strategic Test (Software->Cybersecurity, n=36): 1.000 vs base Qwen2.5-0.5B 0.389; 48 dynamic causal worlds: 0.917 vs 2x passive 0.000; 6 verticals: 10 positive + 12/12 negative rejected; 6-arm real LLM (n=24): 0.000->0.292; AMA-Bench fresh F1 0.2444, ARC-AGI-2 0/6; multiprocess TCP MCPGate 14/14 (0 after KILL) | bundle · mirror 30/30 checks passed | G11 (12h wall-clock) BLOCKED, G18 (external human review) BLOCKED, G19 (separate admin domain) BLOCKED; 0 neural weight updates; ARC-AGI-2 unsolved (0/6), ARC-AGI-3 unavailable, SWE-bench deferred to E124, hosted APIs blocked; loopback_multiprocess_execution; AGI not achieved |
| E124 CAIN long-horizon agent evaluation stats: Bounded 50% time-horizon estimate across 6-task CAIN-native suite (18 runs) | MEASURED | 70B open model: 13/18 on 6-task CAIN-native suite; 50% horizon ~2.0h (below METR frontier 6.4-17.4h); governance/evidence axis measured separately | bundle · mirror 9/9 checks passed | CAIN-native 6-task suite, NOT METR-comparable; below METR frontier; AGI not achieved |
| E123 METR time-horizon benchmark comparison stats: Side-by-side comparison against published METR TH1.1 benchmark metadata with separate governance axis | MEASURED · UNRANKED | Governance & verifiable-evidence axis evaluated separately from general autonomy; verdict honestly UNRANKED on METR general autonomy | bundle · mirror 10/10 checks passed | CAIN-42 is not ranked on METR TH1.1 general autonomy; governance lead is a separate axis; AGI not achieved |
| E122 Neural generalization & autonomous discovery organism commit e65a75971stats: Exact two-sided McNemar + Holm-Bonferroni + Wilson 95% CI + Token F1 (AMA-Bench) + 2-attempt exact match (ARC-AGI-2) | 15 PASS PARTIAL · 12H NEURAL RUNNING (15 PASS / 3 PARTIAL) | Real local PyTorch LLMs (Qwen2.5-0.5B/1.5B, SmolLM2-135M): unfamiliar neural abstraction 0.000(E120)/0.146(alone)->0.917 (n=48, p=1.50e-11); AMA-Bench (MIT, n=20) F1 0.3158->0.3538; ARC-AGI-2 0/8; open-world Python repair 0.00->1.00; neural+causal 0.250->0.750; governed neural TCP MCPGate 9/9 (0 after KILL) | bundle · mirror 37/37 checks passed | local CPU models only (frontier APIs blocked); 0 weight updates; ARC-AGI-2 0/8; E119/E120/E122 wall-clock missions RUNNING (PARTIAL); external human review pending (G18 PARTIAL); AGI not achieved |
| E121 Independent verification & third-party audit pack commit 2dee32731stats: Clean-room stdlib independent verification under unprivileged OS user nobody | MEASURED | Independent verification harness & audit pack reproduced cleanly from clean checkout as nobody | bundle · mirror 17/17 checks passed | verification harness & evidence integrity audit; external human reviewer still pending; AGI not achieved |
| E120 Generalizing, self-improving VAGI organism commit 8c6ef11a3stats: Exact two-sided McNemar + Holm-Bonferroni + Wilson 95% CI + Brier/ECE | 17 PASS PARTIAL · 12H RUNNING (17 PASS / 3 PARTIAL) | 4 OOD conditions +0.438 to +1.000 (Holm p<0.001, 0 shortcuts); causal planning 0.275->0.775; 8-role research loop; 14 self-improve candidates; 5/5 verticals; 4 pos + 2 neg-rejected transfers; matched-compute collective 1.000 vs 0.483; 8-layer memory 1.000 vs 0.250 (0/20 poison); real cain/mcp_proxy + WAL kill 0 after | bundle · mirror 47/47 checks passed | constructed symbolic/grid suites + public datasets; E119 6h & E120 12h RUNNING (PARTIAL); no external human reviewer (G19 PARTIAL); AGI not achieved |
| E119 Learned macro grammar + real tasks | MEASURED · 6H PASS | fixed 0.333 → learned 1.000; gain +0.667 (p≈1e-7), replicated +0.583; 8 macros learned; 8 real tasks; 6h PASS 21,600 s / 39,449 tasks / journal intact (33,813 solved) | bundle · mirror 16/16 | base language supplied; constructed sealed tasks; 6h PASS = duration+journal integrity (33,813/39,449 solved; 5,636 science fails); no external reviewer; AGI not achieved |
| E118 Unseen primitives + search acquisition | MEASURED | OOD 0.264 → 1.000; gain +0.736 (p≈0), replicated +0.778; 3/3 capabilities; positive self-improvement; real data 0.627→0.972 | bundle · mirror 26/26 | finite grammar; constructed OOD; public datasets; no external reviewer; AGI not achieved |
| E117 Unseen-combination OOD | MEASURED | OOD 0.431 → 1.000; gain +0.569 (p≈0), replicated; 3/3 capabilities; memory 1.000 vs 0.514; self-improvement was negative | bundle · mirror 28/28 | finite grammar; constructed OOD; self-improvement negative; 6h blocked; AGI not achieved |
| E116 2,000-agent governed population | MEASURED | 2,000 identities; 12,000 governed executions; 1,000 processes; KILL 0 after fence; collaboration negative | bundle · mirror 54/54 | deterministic agents; constructed tasks; no external reviewer; AGI not achieved |
| E115 Verified memory (interim) | INTERIM | Track A/B/C interim diagnostics; paid arms blocked (no credit); primary model-backed result not produced | bundle · mirror 7/7 | INTERIM; no primary result; no external reviewer; AGI not achieved |
| E114 AGI Research Lab 3.0 | MEASURED | Active info-gain 10.28 vs 18.48 experiments; experts beat naive continual learning 10/10; governance 44/44; 0/5 self-improve promoted | bundle · mirror 24/24 | constructed simulations; both cycle-2 follow-ups negative; no model inference; AGI not achieved |
| E113 Model-backed collective intelligence (interim) | INTERIM · RUNNING | Preregistered local-model collective vs strongest single; governance 18/18; 5/5 multi-process KILL races 0 after | bundle · mirror 12/12 | primary study phase 3 still running; small local CPU models; cloud blocked; AGI not achieved |
| E112 AGI Research Lab 2.0 | MEASURED | 2,000 identities; 12,000 executions; 1,000 processes; routed specialists 1.000 vs 0.167; KILL 0 | bundle · mirror 28/28 | deterministic specialists; constructed tasks; AGI not achieved |
| E111 Five skills, transfer, sealed improvement | MEASURED | 4/5 skills; 5/5 transfer; collective negative; sealed improvement 0.58→0.86 (withheld); 1h PASS, 6h cumulative interrupted | bundle · mirror 92/92 | constructed tasks; no external reviewer; 6h continuous not PASS; AGI not achieved |
All headline metrics are independently recomputed by each bundle's zero-CAIN-import stdlib offline verifier. Machine-readable feed: /agi-evidence-index.json
SWE-bench Verified: #136 of 136 — 0/500 resolved (0.0%)
Wilson 95% 0.0–0.8% · leader 396/500 (79.2%) · +3 passes the next rank · +204 reaches top 100 · +397 reaches #1.
GOVERNED LOCALIZATION FLEET (real runs, signed receipts)
| strategy | recall@1 | recall@5 | recall@10 | MRR |
|---|---|---|---|---|
| naive | 6.2% | 26.8% | 41.4% | 0.158 |
| identifiers | 13.2% | 38.4% | 51.2% | 0.251 |
| basenames | 0.2% | 0.4% | 0.4% | 0.003 |
500 instances · 1500 agent runs · receipt head 6c93ba9ec7c38eac · file-level only, Python only.
CAPABILITY ACQUISITION 2.0 (constructed, sealed)
56 unfamiliar families · 280 sealed instances · organism 97.9% vs compute-matched 65.4% vs frozen E123 8.9% · 0.5B base model 0% · 56/56 verified on held-out data.
#1 needs 396/500 (CAIN +397) · #20 needs 362/500 (CAIN +363) · #50 needs 314/500 (CAIN +315) · #100 needs 203/500 (CAIN +204)
Live competition board → · Interactive lab → · raw feed · evidence bundle · all 136 rows
Measured, not asserted. A rank is never edited by hand: it is recomputed from the public leaderboard by a 7-agent chain that refuses to publish on mismatch. AGI status: NOT ACHIEVED. This is a SWE-bench position, not METR HCAST, and not proof of general capability.