ModelContextInputOutputProvidersAgentsCodingReasoningKnowledgeMathMultilingualMultimodalInstruction followingThroughputLatencyRelease date
Ling 3.0 Flash VLinclusionAIContext131.1KInputOutputProviders
51.9±16.0P
55.1±13.9P
Throughput
Latency
Release date2026-09-10
  • 51.9
  • 55.1
DeepSeek V4.1 FlashDeepSeekContext1.0MInput$0.300/MOutput$1.20/MProviders
+42
50.6±18.4P
57.6±16.0P
56.9±16.0P
Throughput
Latency
Release date2026-09-10
  • 50.6
  • 57.6
  • 56.9
Nex-N2.5-ProNex AGIContext262.1KInputOutputProviders
+2
Throughput
Latency
Release date2026-09-08
Nex-N2.5-MiniNex AGIContext262.1KInputOutputProviders
+2
Throughput
Latency
Release date2026-09-08
Qwen3.8 Max (0902)QwenContext1MInputOutputProviders
+1
Throughput
Latency
Release date2026-09-03
GPT-6 AstraOpenAIContext1.1MInput$10.00/MOutput$50.00/MProviders
+88
63±8.4
59.5±11.9E
62.1±8.7
58±16.6P
72.3±16.1P
66.4±16.4P
Throughput
Latency
Release date2026-09-04
  • 63
  • 59.5
  • 62.1
  • 58
  • 72.3
  • 66.4
Ling 3.0 Flash SanteinclusionAIContext262.1KInputOutputProviders
Throughput
Latency
Release date2026-09-04
Muse Spark 1.3 ContributorMetaContext1.0MInputOutputProviders
+2
Throughput
Latency
Release date2026-09-02
Muse Spark 1.3MetaContext1.0MInput$1.25/MOutput$4.25/MProviders
+2
63.4±8.4
58.3±11.9E
60.9±10.8E
56.9±14.0P
Throughput
Latency
Release date2026-09-02
  • 63.4
  • 58.3
  • 60.9
  • 56.9
Gemini 3.8 FlashGoogleContext1.0MInput$0.750/MOutput$3.75/MProviders
+60
59.9±11.3E
58.8±11.9E
59.7±10.8E
61.3±14.0P
54±16.4P
Throughput
Latency
Release date2026-09-02
  • 59.9
  • 58.8
  • 59.7
  • 61.3
  • 54
Claude Fable 5.1AnthropicContext1MInput$10.00/MOutput$50.00/MProviders
+66
61.7±8.6
68.5±6.9
61.2±8.7
68±14.0P
Throughput
Latency
Release date2026-09-01
  • 61.7
  • 68.5
  • 61.2
  • 68
Granite 4.2 8BIBMContext131.1KInput$0.060/MOutput$0.250/MProviders
42±16.0P
45.9±13.9P
Throughput
Latency
Release date2026-08-31
  • 42
  • 45.9
Ling 3.0 Flash FininclusionAIContext262.1KInputOutputProviders
+6
Throughput
Latency
Release date2026-08-27
Qwen3.8 FlashQwenContext1MInputOutputProviders
+26
Throughput
126 t/s
Latency
2.96s
Release date2026-08-26
GLM 5.3 FlashZ.aiContext1.3MInput$0.150/MOutput$0.500/MProviders
+79
60.6±11.9E
56.6±9.3E
57.6±11.1E
54.2±14.0P
57.9±16.1P
Throughput
336 t/s
Latency
31.71s
Release date2026-08-26
  • 60.6
  • 56.6
  • 57.6
  • 54.2
  • 57.9
Muse Spark 1.2 ContributorMetaContext1.0MInputOutputProviders
+2
Throughput
Latency
Release date2026-08-21
DeepSeek V4 Flash Vision ExpDeepSeekContext1.0MInputOutputProviders
+24
Throughput
Latency
Release date2026-08-21
Ox AlphaStealthContext1.0MInputOutputProviders
+1
Throughput
Latency
Release date2026-08-20
GLM 5.3Z.aiContext1.3MInput$1.40/MOutput$4.40/MProviders
+80
50.8±18.4P
62.9±16.0P
60.8±13.9P
Throughput
379 t/s
Latency
30.00s
Release date2026-08-18
  • 50.8
  • 62.9
  • 60.8
Qwen3.8 27BQwenContext1MInput$0.500/MOutput$3.00/MProviders
+16
58.7±8.4
51.6±8.6
54.7±10.8E
43.9±14.0P
57.6±11.3E
56.3±16.0P
Throughput
Latency
Release date2026-08-14
  • 58.7
  • 51.6
  • 54.7
  • 43.9
  • 57.6
  • 56.3
Gemini 3.7 FlashGoogleContext1.0MInput$0.750/MOutput$3.75/MProviders
+70
54.6±8.6
57.9±11.9E
58.5±10.8E
60.8±14.0P
56.9±16.1P
Throughput
Latency
Release date2026-08-13
  • 54.6
  • 57.9
  • 58.5
  • 60.8
  • 56.9
Qwen3.8 2.4T A95BQwenContext1.0MInput$2.00/MOutput$6.00/MProviders
59.2±16.0P
62.1±13.9P
Throughput
Latency
Release date2026-08-12
  • 59.2
  • 62.1
Seed 2.1 TurboByteDance SeedContext262.1KInputOutputProviders
+1
Throughput
Latency
Release date2026-08-10
Grok 4.6SpaceXAIContext500KInput$2.00/MOutput$6.00/MProviders
+92
60.8±8.4
58.5±11.9E
59.5±10.8E
60.2±14.0P
Throughput
150 t/s
Latency
22.76s
Release date2026-08-12
  • 60.8
  • 58.5
  • 59.5
  • 60.2
DeepSeek V4 Pro 0813DeepSeekContext1.0MInputOutputProviders
+29
57.7±7.3
54.9±6.1
60.8±8.3
58.4±18.0P
58.9±12.2E
55±16.0P
Throughput
Latency
Release date2026-08-12
  • 57.7
  • 54.9
  • 60.8
  • 58.4
  • 58.9
  • 55
LFM2.5-2.6BLiquidAIContext65.5KInputOutputProviders
+4
Throughput
Latency
Release date2026-08-11
Nemotron 3.5 LightningNVIDIAContext262.1KInput$0.060/MOutput$0.200/MProviders
+16
42.5±16.0P
48.7±13.9P
Throughput
391 t/s
Latency
34.71s
Release date2026-08-11
  • 42.5
  • 48.7
Solar Pro 4UpstageContext524.3KInput$0.300/MOutput$1.20/MProviders
+1
52.2±16.0P
57.6±13.9P
Throughput
Latency
Release date2026-08-10
  • 52.2
  • 57.6
Muse Glimmer 30BMetaContext131.1KInputOutputProviders
+5
46.2±9.9E
43.6±6.9
55.9±10.8E
41.7±14.0P
46.1±16.3P
45.9±9.4E
55.2±16.0P
Throughput
Latency
Release date2026-08-09
  • 46.2
  • 43.6
  • 55.9
  • 41.7
  • 46.1
  • 45.9
  • 55.2
Ling 3.0 TinyinclusionAIContext262.1KInputOutputProviders
+1
35.3±16.0P
48±13.9P
Throughput
Latency
Release date2026-08-06
  • 35.3
  • 48
Muse Spark 1.2MetaContext1.0MInput$1.25/MOutput$4.25/MProviders
+2
56.3±8.9
55.7±11.9E
58.5±10.8E
58.8±14.0P
Throughput
69 t/s
Latency
22.53s
Release date2026-08-05
  • 56.3
  • 55.7
  • 58.5
  • 58.8
Qwen3.8 MaxQwenContext1MInput$2.00/MOutput$6.00/MProviders
+65
61.5±10.9E
61.7±11.2E
63.5±10.1E
52.2±14.0P
64.3±6.3
57.9±16.0P
Throughput
292 t/s
Latency
4.31s
Release date2026-08-03
  • 61.5
  • 61.7
  • 63.5
  • 52.2
  • 64.3
  • 57.9
Inkling SmallThinking MachinesContext1.0MInput$0.300/MOutput$1.20/MProviders
+7
54.6±10.8E
51.9±6.9
50.9±8.7
49.7±14.0P
52.5±14.4P
45.8±11.9E
57.6±16.0P
Throughput
Latency
Release date2026-07-30
  • 54.6
  • 51.9
  • 50.9
  • 49.7
  • 52.5
  • 45.8
  • 57.6
DeepSeek V4 Flash 0731DeepSeekContext1.3MInputOutputProviders
+34
51.3±8.3
50.6±6.3
58.7±8.3
47.5±18.0P
57.9±12.2E
Throughput
74 t/s
Latency
2.70s
Release date2026-07-31
  • 51.3
  • 50.6
  • 58.7
  • 47.5
  • 57.9
Qwen3.7 FlashQwenContext1MInputOutputProviders
+18
Throughput
388 t/s
Latency
11.58s
Release date2026-07-27
Claude Opus 5AnthropicContext1MInput$5.00/MOutput$25.00/MProviders
+107
65.9±7.7
67.5±6.6
59.5±8.7
66.9±14.0P
64.3±17.1P
56.7±16.4P
Throughput
284 t/s
Latency
5.44s
Release date2026-07-24
  • 65.9
  • 67.5
  • 59.5
  • 66.9
  • 64.3
  • 56.7
Ling-3.0-flashinclusionAIContext262.1KInput$0.075/MOutput$0.220/MProviders
+11
46.7±10.2E
48.4±9.3E
53.1±10.8E
38.9±14.0P
46.7±11.5E
54.2±16.0P
Throughput
Latency
Release date2026-07-23
  • 46.7
  • 48.4
  • 53.1
  • 38.9
  • 46.7
  • 54.2
Laguna S 2.1PoolsideContext1.0MInputOutputProviders
+18
52.7±16.0P
53.2±9.3E
Throughput
41 t/s
Latency
1.46s
Release date2026-07-21
  • 52.7
  • 53.2
Gemini 3.5 Flash-LiteGoogleContext1.0MInput$0.300/MOutput$2.50/MProviders
+49
42.1±8.7
44.5±9.3E
52±10.8E
51±14.0P
44.7±16.4P
Throughput
Latency
Release date2026-07-21
  • 42.1
  • 44.5
  • 52
  • 51
  • 44.7
Gemini 3.6 FlashGoogleContext1.0MInput$0.750/MOutput$3.75/MProviders
+87
51.4±8.6
53.1±11.9E
58.6±10.8E
59±14.0P
53.9±16.4P
Throughput
737 t/s
Latency
2.34s
Release date2026-07-21
  • 51.4
  • 53.1
  • 58.6
  • 59
  • 53.9
InklingThinking MachinesContext1.0MInput$1.00/MOutput$4.05/MProviders
+19
48.6±8.2
47.9±6.9
55.2±10.8E
51.3±14.0P
65.4±16.3P
45.7±11.9E
56.4±16.0P
Throughput
25 t/s
Latency
0.79s
Release date2026-07-17
  • 48.6
  • 47.9
  • 55.2
  • 51.3
  • 65.4
  • 45.7
  • 56.4
Muse Spark 1.1MetaContext1.0MInput$1.25/MOutput$4.25/MProviders
+2
61.6±7.4
58±9.3E
57.5±10.2E
63.3±14.0P
56.5±16.1P
Throughput
Latency
Release date2026-07-16
  • 61.6
  • 58
  • 57.5
  • 63.3
  • 56.5
Kimi K3MoonshotAIContext1.0MInput$3.00/MOutput$15.00/MProviders
+115
65.7±7.3
56.4±11.9E
60.1±10.8E
59.4±14.0P
64.9±11.3E
Throughput
138 t/s
Latency
30.06s
Release date2026-07-16
  • 65.7
  • 56.4
  • 60.1
  • 59.4
  • 64.9
GPT-5.6 Sol ProOpenAIContext1.1MInputOutputProviders
+2
Throughput
Latency
Release date2026-07-09
GPT-5.6 Terra ProOpenAIContext1.1MInputOutputProviders
+2
Throughput
Latency
Release date2026-07-09
GPT-5.6 Luna ProOpenAIContext1.1MInputOutputProviders
+4
Throughput
193 t/s
Latency
15.30s
Release date2026-07-09
GPT-3.5 Turbo 16kOpenAIContext16.4KInputOutputProviders
+3
Throughput
Latency
Release date2023-08-28
GPT-4 Turbo PreviewOpenAIContext128KInputOutputProviders
Throughput
Latency
Release date2024-01-25
GPT-3.5 Turbo (older v0613)OpenAIContext4.1KInputOutputProviders
+3
Throughput
Latency
Release date2024-01-25
Llama 3 8B InstructMetaContext8.2KInputOutputProviders
+1
Throughput
Latency
Release date
GPT-4o (2024-05-13)OpenAIContext128KInput$5.00/MOutput$15.00/MProviders
+2
44.7±16.0P
42.6±11.1E
46±11.8E
Throughput
Latency
Release date2024-05-13
  • 44.7
  • 42.6
  • 46
GPT-4o-mini (2024-07-18)OpenAIContext128KInputOutputProviders
+2
Throughput
Latency
Release date2024-07-18
Llama 3.1 70B InstructMetaContext131.1KInputOutputProviders
+1
Throughput
Latency
Release date2024-07-23
Llama 3.1 8B InstructMetaContext131.1KInputOutputProviders
+3
Throughput
Latency
Release date2024-07-23
GPT-4o (2024-08-06)OpenAIContext128KInput$2.50/MOutput$10.00/MProviders
+1
44.3±16.0P
38.9±13.9P
46.2±11.8E
Throughput
Latency
Release date2024-08-06
  • 44.3
  • 38.9
  • 46.2
Hermes 3 70B InstructNousContext131.1KInput$0.700/MOutput$0.700/MProviders
40.9±16.0P
37.6±11.1E
39.6±11.8E
Throughput
Latency
Release date2024-08-18
  • 40.9
  • 37.6
  • 39.6
Llama 3.2 11B Vision InstructMetaContext131.1KInputOutputProviders
+4
Throughput
Latency
Release date2024-09-25
Llama 3.2 1B InstructMetaContext60KInputOutputProviders
+4
Throughput
Latency
Release date2024-09-25
Llama 3.2 3B InstructMetaContext131.1KInputOutputProviders
+8
Throughput
Latency
Release date2024-09-25
Mistral Large 2407MistralaiContext131.1KInput$2.00/MOutput$6.00/MProviders
43.1±16.0P
41±11.1E
44.5±11.8E
Throughput
Latency
Release date2024-11-19
  • 43.1
  • 41
  • 44.5