CAIN-42 CLAWX
SWE-BENCH VERIFIED · ALL 136 PUBLIC SUBMISSIONS · OFFICIAL 500-TASK RUN

CAIN-42: #75 of 136

257/500 resolved · 51.4% · Wilson 95% 47.0–55.8% · leader 396/500 (79.2%) · to pass #135: +2 · to #1: +140

Open the live interactive board · raw feed · evidence · refreshed 2026-11-21T21:58:25Z · checksum f0efdb950a16265f

#submissionresolvedrate50% horizongap from CAIN
120251215_livesweagent_claude-opus-4-5396/50079.2%4.3 hCAIN needs +140
220251205_sonar-foundation-agent_claude-opus-4-5396/50079.2%4.2 hCAIN needs +140
320250928_trae_doubao_seed_code394/50078.8%4.1 hCAIN needs +138
420251127_openhands_claude-opus-4-5388/50077.6%3.3 hCAIN needs +132
520251120_livesweagent_gemini-3-pro-preview387/50077.4%2.5 hCAIN needs +131
620250902_atlassian-rovo-dev384/50076.8%2.1 hCAIN needs +128
720250804_epam-ai-run-claude-4-sonnet384/50076.8%1.7 hCAIN needs +128
820250819_ACoder382/50076.4%1.9 hCAIN needs +126
920250901_warp378/50075.6%2.7 hCAIN needs +122
1020250612_trae376/50075.2%1.7 hCAIN needs +120
1120251103_sonar-foundation-agent_claude-sonnet-4-5374/50074.8%2.6 hCAIN needs +118
1220250731_harness_ai374/50074.8%1.4 hCAIN needs +118
1320250915_JoyCode373/50074.6%2.3 hCAIN needs +117
1420250720_Lingxi-v1.5_claude-4-sonnet-20250514373/50074.6%1.7 hCAIN needs +117
1520251015_Prometheus_v1.2.1_gpt5372/50074.4%2.5 hCAIN needs +116
1620250603_Refact_Agent_claude-4-sonnet372/50074.4%1.8 hCAIN needs +116
1720251103_SalesforceAIResearch_SAGE_OpenHands369/50073.8%1.8 hCAIN needs +113
1820250522_tools_claude-4-opus366/50073.2%2.3 hCAIN needs +110
1920251021_SalesforceAIResearch_SAGE_bash_only365/50073.0%2.1 hCAIN needs +109
2020250522_tools_claude-4-sonnet362/50072.4%2.0 hCAIN needs +106
2120260901_mini-v2.4.2_gemini-3-5-flash359/50071.8%3.0 hCAIN needs +103
2220250807_openhands_gpt5359/50071.8%1.5 hCAIN needs +103
2320250929_Prometheus_v1.2_gpt5356/50071.2%1.7 hCAIN needs +100
2420250710_bloop356/50071.2%1.4 hCAIN needs +100
2520251014_Lingxi_kimi_k2356/50071.2%1.2 hCAIN needs +100
2620250715_qodo_command356/50071.2%1.2 hCAIN needs +100
2720250623_warp355/50071.0%1.7 hCAIN needs +99
2820250611_moatless_claude-4-sonnet-20250514354/50070.8%1.3 hCAIN needs +98
2920250519_trae353/50070.6%1.2 hCAIN needs +97
3020250610_augment_agent_v1352/50070.4%1.4 hCAIN needs +96
3120250524_openhands_claude_4_sonnet352/50070.4%1.3 hCAIN needs +96
3220250515_Refact_Agent352/50070.4%1.2 hCAIN needs +96
3320250519_devlo351/50070.2%1.1 hCAIN needs +95
3420250430_zencoder_ai350/50070.0%1.1 hCAIN needs +94
3520250805_openhands-Qwen3-Coder-480B-A35B-Instruct348/50069.6%1.1 hCAIN needs +92
3620250516_cortexa_o3341/50068.2%1.1 hCAIN needs +85
3720250930_zai_glm4-6341/50068.2%1.1 hCAIN needs +85
3820250522_sweagent_claude-4-sonnet-20250514333/50066.6%1.0 hCAIN needs +77
3920250514_aime_coder332/50066.4%1.1 hCAIN needs +76
4020250415_openhands329/50065.8%0.9 hCAIN needs +73
4120250716_openhands_kimi_k2327/50065.4%0.9 hCAIN needs +71
4220250316_augment_agent_v0327/50065.4%0.8 hCAIN needs +71
4320250405_amazon-q-developer-agent-20250405-dev327/50065.4%0.8 hCAIN needs +71
4420250117_wandb_programmer_o1_crosscheck5323/50064.6%0.9 hCAIN needs +67
4520250503_patchpilot-v1.1-o4-mini323/50064.6%0.9 hCAIN needs +67
4620250728_zai_glm4-5321/50064.2%0.9 hCAIN needs +65
4720250206_agentscope317/50063.4%0.7 hCAIN needs +61
4820250224_tools_claude-3-7-sonnet316/50063.2%0.7 hCAIN needs +60
4920250110_blackboxai_agent_v1.1314/50062.8%0.7 hCAIN needs +58
5020250228_epam-ai-run-claude-3-5-sonnet314/50062.8%0.6 hCAIN needs +58
5120250225_sweagent_claude-3-7-sonnet312/50062.4%0.6 hCAIN needs +56
5220241221_codestory_midwit_claude-3-5-sonnet_swe-search311/50062.2%0.6 hCAIN needs +55
5320250203_openhands_4x_scaled304/50060.8%0.6 hCAIN needs +48
5420250901_entroPO_R2E_QwenCoder30BA3B_tts302/50060.4%0.6 hCAIN needs +46
5520250110_learn_by_interact_claude3.5301/50060.2%0.5 hCAIN needs +45
5620250629_deepswerl_r2eagent_tts294/50058.8%0.5 hCAIN needs +38
5720241213_devlo291/50058.2%0.5 hCAIN needs +35
5820250410_cortexa291/50058.2%0.5 hCAIN needs +35
5920241223_emergent286/50057.2%0.4 hCAIN needs +30
6020250924_artemis_agent_v2285/50057.0%0.5 hCAIN needs +29
6120241208_gru285/50057.0%0.4 hCAIN needs +29
6220250405_swe-rizzo_claude37283/50056.6%0.4 hCAIN needs +27
6320241212_epam-ai-run-claude-3-5-sonnet277/50055.4%0.4 hCAIN needs +21
6420241202_amazon-q-developer-agent-20241202-dev275/50055.0%0.4 hCAIN needs +19
6520241108_devlo271/50054.2%0.4 hCAIN needs +15
6620251110_frogboss-32b268/50053.6%0.3 hCAIN needs +12
6720250804_codesweep_sweagent_kimi_k2_instruct267/50053.4%0.3 hCAIN needs +11
6820250120_Bracket266/50053.2%0.4 hCAIN needs +10
6920241029_OpenHands-CodeAct-2.1-sonnet-20241022265/50053.0%0.3 hCAIN needs +9
7020241212_google_jules_gemini_2.0_flash_experimental261/50052.2%0.3 hCAIN needs +5
7120250901_entroPO_R2E_QwenCoder30BA3B261/50052.2%0.3 hCAIN needs +5
7220241125_enginelabs259/50051.8%0.3 hCAIN needs +3
7320250122_autocoderover-v2.1-claude-3-5-sonnet-20241022258/50051.6%0.3 hCAIN needs +2
7420250805_openhands-Qwen3-Coder-30B-A3B-Instruct258/50051.6%0.3 hCAIN needs +2
75CAIN-42 (cain-anthropic-e124; 257/500 evaluated) — LAST PLACE257/50051.4%—
7620241202_agentless-1.5_claude-3.5-sonnet-20241022254/50050.8%0.3 h
7720241028_solver250/50050.0%0.3 h
7820241125_marscode-agent-dev250/50050.0%0.3 h
7920241105_nfactorial246/50049.2%0.2 h
8020241022_tools_claude-3-5-sonnet-updated245/50049.0%0.2 h
8120241025_composio_swekit243/50048.6%0.2 h
8220241106_navie-2-gpt4o-sonnet236/50047.2%0.2 h
8320250616_Skywork-SWE-32B+TTS_Bo8235/50047.0%0.2 h
8420250520_openhands_devstral_small234/50046.8%0.2 h
8520241023_emergent233/50046.6%0.2 h
8620241108_autocoderover-v2.0-claude-3-5-sonnet-20241022231/50046.2%0.2 h
8720250528_patchpilot_Co-PatcheR230/50046.0%0.2 h
8820240924_solver227/50045.4%0.2 h
8920240824_gru226/50045.2%0.2 h
9020251110_frogmini-14b225/50045.0%0.2 h
9120250118_codeshellagent_gemini_2.0_flash_experimental221/50044.2%0.2 h
9220240920_solver218/50043.6%0.2 h
9320250214_agentless_lite_o3_mini212/50042.4%0.1 h
9420250527_amazon.nova-premier-v1.0212/50042.4%0.1 h
9520250629_deepswerl_r2eagent211/50042.2%0.1 h
9620250806_SWE-Exp_DeepSeek-V3210/50042.0%0.1 h
9720250112_ugaiforge208/50041.6%0.1 h
9820241030_nfactorial208/50041.6%0.1 h
9920250226_swerl_llama3_70b206/50041.2%0.1 h
10020241113_nebius-search-open-weight-models-11-24203/50040.6%0.1 h
10120241016_composio_swekit203/50040.6%0.1 h
10220240820_honeycomb203/50040.6%0.1 h
10320241022_tools_claude-3-5-haiku203/50040.6%0.1 h
10420250511_sweagent_lm_32b201/50040.2%0.1 h
10520241029_epam-ai-run-claude-3-5-sonnet198/50039.6%0.1 h
10620240721_amazon-q-developer-agent-20240719-dev194/50038.8%0.1 h
10720241028_agentless-1.5_gpt4o194/50038.8%0.1 h
10820240628_autocoderover-v20240620192/50038.4%0.1 h
10920250725_sweagent_devstral_small_2507190/50038.0%0.1 h
11020250616_Skywork-SWE-32B190/50038.0%0.1 h
11120240617_factory_code_droid185/50037.0%0.1 h
11220240620_sweagent_claude3.5sonnet168/50033.6%0.1 h
11320250306_SWE-Fixer_Qwen2.5-7b-retriever_Qwen2.5-72b-editor164/50032.8%0.1 h
11420240612_MASAI_gpt4o163/50032.6%0.1 h
11520241120_artemis_agent160/50032.0%0.0 h
11620241007_nfactorial158/50031.6%0.1 h
11720241128_SWE-Fixer_Qwen2.5-7b-retriever_Qwen2.5-72b-editor_20241128151/50030.2%0.1 h
11820241002_lingma-agent_lingma-swe-gpt-72b144/50028.8%0.0 h
11920241016_epam-ai-run-gpt-4o135/50027.0%0.1 h
12020240615_appmap-navie_gpt4o131/50026.2%0.0 h
12120241001_nfactorial129/50025.8%0.0 h
12220240509_amazon-q-developer-agent-20240430-dev128/50025.6%0.0 h
12320240918_lingma-agent_lingma-swe-gpt-72b125/50025.0%0.0 h
12420240820_epam-ai-run-gpt-4o120/50024.0%0.0 h
12520250627_agentless_MCTS-Refine-7B116/50023.2%0.0 h
12620240728_sweagent_gpt4o116/50023.2%0.0 h
12720240402_sweagent_gpt4112/50022.4%0.0 h
12820241002_lingma-agent_lingma-swe-gpt-7b91/50018.2%0.0 h
12920240402_sweagent_claude3opus79/50015.8%0.0 h
13020240918_lingma-agent_lingma-swe-gpt-7b51/50010.2%0.0 h
13120240402_rag_claude3opus35/5007.0%0.0 h
13220231010_rag_claude222/5004.4%0.0 h
13320240402_rag_gpt414/5002.8%0.0 h
13420231010_rag_swellama7b7/5001.4%0.0 h
13520231010_rag_swellama13b6/5001.2%0.0 h
13620231010_rag_gpt352/5000.4%0.0 h

Every row is a published SWE-bench Verified submission. Scaffolds and model versions differ, so this is a SWE-bench rank, not METR HCAST. CAIN's 0/500 is reported as measured. Generated by scripts/e124/rank_agents.py (7 agents, hash-chained) — no row is typed by hand. AGI status: NOT ACHIEVED.