Leberkäsbench

Model economics

Average cost, total tokens, and elapsed time for each model's latest successful result per active benchmark task.

Models

Cost, tokens and time

48 models · 9 active tasks

01Anthropic: Claude Fable 5anthropic/claude-fable-5$10 / $50 per 1M · Context 1M
09.06.2026$0.98719,9654:03
02OpenAI: GPT-5.6 Sol Proopenai/gpt-5.6-sol-pro$5 / $30 per 1M · Context 1.05M
09.07.2026$0.80846,5882:29
03MoonshotAI: Kimi K3moonshotai/kimi-k3$3 / $15 per 1M · Context 1.05M
16.07.2026$0.39626,59812:04
04Anthropic: Claude Sonnet 5anthropic/claude-sonnet-5$2 / $10 per 1M · Context 1M
30.06.2026$0.30230,4534:44
05OpenAI: GPT-5.6 Terra Proopenai/gpt-5.6-terra-pro$2.5 / $15 per 1M · Context 1.05M
09.07.2026$0.2933,94351s
06OpenAI: GPT-5.5openai/gpt-5.5$5 / $30 per 1M · Context 1.05M
24.04.2026$0.2528,5491:51
07OpenAI: GPT-5.6 Solopenai/gpt-5.6-sol$5 / $30 per 1M · Context 1.05M
09.07.2026$0.2287,7471:54
08Anthropic: Claude Opus 4.8anthropic/claude-opus-4.8$5 / $25 per 1M · Context 1M
27.05.2026$0.1445,9691:01
09Z.ai: GLM 5.1z-ai/glm-5.1$0.966 / $3.036 per 1M · Context 202.75K
07.04.2026$0.12733,0998:44
10Google: Gemini 3.1 Pro Previewgoogle/gemini-3.1-pro-preview$2 / $12 per 1M · Context 1.05M
19.02.2026$0.1119,3611:11
11Anthropic: Claude Sonnet 4.6anthropic/claude-sonnet-4.6$3 / $15 per 1M · Context 1M
17.02.2026$0.1087,3391:30
12OpenAI: GPT-5.6 Luna Proopenai/gpt-5.6-luna-pro$1 / $6 per 1M · Context 1.05M
09.07.2026$0.10229,87838s
13OpenAI: GPT-5.3-Codexopenai/gpt-5.3-codex$1.75 / $14 per 1M · Context 400K
24.02.2026$0.0856,2261:17
14Google: Gemini 3.6 Flashgoogle/gemini-3.6-flash$1.5 / $7.5 per 1M · Context 1.05M
21.07.2026$0.07910,63744s
15xAI: Grok 4.5x-ai/grok-4.5$2 / $6 per 1M · Context 500K
08.07.2026$0.07813,3031:58
16OpenAI: GPT-5.6 Terraopenai/gpt-5.6-terra$2.5 / $15 per 1M · Context 1.05M
09.07.2026$0.0785,34339s
17Z.ai: GLM 5.2z-ai/glm-5.2$0.91 / $2.86 per 1M · Context 1.05M
16.06.2026$0.07118,5673:45
18OpenAI: GPT-5.4openai/gpt-5.4$2.5 / $15 per 1M · Context 1.05M
05.03.2026$0.0714,84229s
19Google: Gemini 3.5 Flashgoogle/gemini-3.5-flash$1.5 / $9 per 1M · Context 1.05M
19.05.2026$0.0637,11130s
20MoonshotAI: Kimi K2.7 Codemoonshotai/kimi-k2.7-code$0.719 / $3.49 per 1M · Context 262.14K
12.06.2026$0.06115,9096:04
21OpenAI: GPT-5.2-Codexopenai/gpt-5.2-codex$1.75 / $14 per 1M · Context 400K
14.01.2026$0.0594,36737s
22Qwen: Qwen3.6 27Bqwen/qwen3.6-27b$0.289 / $2.4 per 1M · Context 262.14K
27.04.2026$0.03714,1345:35
23Thinking Machines: Inklingthinkingmachines/inkling$1 / $4.05 per 1M · Context 1.05M
17.07.2026$0.0379,1751:41
24MiniMax: MiniMax M3minimax/minimax-m3$0.3 / $1.2 per 1M · Context 1.05M
31.05.2026$0.03630,2299:35
25Qwen: Qwen3.7 Maxqwen/qwen3.7-max$1.25 / $3.75 per 1M · Context 1M
21.05.2026$0.0318,3942:29
26DeepSeek: DeepSeek V4 Prodeepseek/deepseek-v4-pro$0.435 / $0.87 per 1M · Context 1.05M
24.04.2026$0.03115,5373:53
27StepFun: Step 3.7 Flashstepfun/step-3.7-flash$0.2 / $1.15 per 1M · Context 256K
28.05.2026$0.02924,9331:51
28Z.ai: GLM 5z-ai/glm-5$0.6 / $1.92 per 1M · Context 202.75K
11.02.2026$0.02713,2393:16
29Mistral: Mistral Medium 3.5mistralai/mistral-medium-3-5$1.5 / $7.5 per 1M · Context 262.14K
30.04.2026$0.0273,76428s
30Kwaipilot: KAT-Coder-Pro V2.5kwaipilot/kat-coder-pro-v2.5$0.74 / $2.96 per 1M · Context 256K
10.07.2026$0.0279,1621:19
31OpenAI: GPT-5.6 Lunaopenai/gpt-5.6-luna$1 / $6 per 1M · Context 1.05M
09.07.2026$0.0254,34425s
32NVIDIA: Nemotron 3 Ultranvidia/nemotron-3-ultra-550b-a55b$0.5 / $2.2 per 1M · Context 1M
04.06.2026$0.0227,8751:34
33MoonshotAI: Kimi K2.6moonshotai/kimi-k2.6$0.66 / $3.41 per 1M · Context 262.14K
20.04.2026$0.0226,4021:48
34Meituan: LongCat 2.0meituan/longcat-2.0$0.3 / $1.2 per 1M · Context 1.05M
20.07.2026$0.01714,5994:14
35OpenAI: GPT-5.4 Miniopenai/gpt-5.4-mini$0.75 / $4.5 per 1M · Context 400K
17.03.2026$0.0163,74221s
36Google: Gemini 3.5 Flash-Litegoogle/gemini-3.5-flash-lite$0.3 / $2.5 per 1M · Context 1.05M
21.07.2026$0.0125,02112s
37xAI: Grok 4.3x-ai/grok-4.3$1.25 / $2.5 per 1M · Context 1M
30.04.2026$0.006922,96720s
38Google: Gemini 3 Flash Previewgoogle/gemini-3-flash-preview$0.5 / $3 per 1M · Context 1.05M
17.12.2025$0.006522,30311s
39Kwaipilot: KAT-Coder-Air V2.5kwaipilot/kat-coder-air-v2.5$0.15 / $0.6 per 1M · Context 256K
10.07.2026$0.005028,48942s
40DeepSeek: DeepSeek V4 Flashdeepseek/deepseek-v4-flash$0.09 / $0.18 per 1M · Context 1.05M
24.04.2026$0.002129,4902:41
41Mistral: Mistral Small 4mistralai/mistral-small-2603$0.15 / $0.6 per 1M · Context 262.14K
16.03.2026$0.002083,40017s
42Google: Gemini 3.1 Flash Litegoogle/gemini-3.1-flash-lite$0.25 / $1.5 per 1M · Context 1.05M
07.05.2026$0.001671,2434s
43Poolside: Laguna S 2.1poolside/laguna-s-2.1$0.1 / $0.2 per 1M · Context 1.05M
21.07.2026$0.001366,9221:12
44Tencent: Hy3tencent/hy3$0.14 / $0.58 per 1M · Context 262.14K
06.07.2026$0.001182,09529s
45Poolside: Laguna XS 2.1poolside/laguna-xs-2.1$0.06 / $0.12 per 1M · Context 262.14K
02.07.2026$0.000887,44041s
46Google: Gemma 4 31Bgoogle/gemma-4-31b-it$0.06 / $0.35 per 1M · Context 262.14K
02.04.2026$0.00082,20252s
47OpenAI: gpt-oss-120bopenai/gpt-oss-120b$0.03 / $0.15 per 1M · Context 131.07K
05.08.2025$0.00073,2891:03
48Cohere: North Mini Code (free)cohere/north-mini-code:free$0 / $0 per 1M · Context 256K
17.06.2026$0.0011,6601:38