Why is this comparison indexable?

It has 3 verifiable comparison points, and both models have pricing or benchmark data.

Are missing metrics invented?

No. Metrics without LMSpeed data are omitted from this report.

Back to models

Data points: 88

Key Takeaways

The readout for GPT-5.4 and Qwen3.5-27B, before the detailed comparison sheet.

Decision read

GPT-5.4

GPT-5.4 currently has the stronger profile, with verified wins split 3 to 0.

Evidence depth

88 data points

Includes 33 benchmark rows, 0 audit samples, and 0 provider examples.

Selection signal

Start with GPT-5.4

The charts below split 33 high-signal samples across speed, scores, and audit health.

Change comparison

Switch either side of this report to compare another model with the same LMSpeed data pipeline.

Model AModel B

Select a different model to open a new comparison URL.

Model compare GPT-5.4 vs Qwen3.5-27B gpt-5-4-vs-qwen3-5-27b	Model A GPT-5.4	Model B Qwen3.5-27B
Overall leader	Leading	Contender
Verified metric wins	3 wins	0 wins
Where it leads	Free providers, Provider coverage, Recent tests

Model compare

GPT-5.4 vs Qwen3.5-27B

gpt-5-4-vs-qwen3-5-27b

Model A

GPT-5.4

Model B

Qwen3.5-27B

Overall leader

Leading

Contender

Verified metric wins

3 wins

0 wins

Where it leads

Free providers, Provider coverage, Recent tests

Benchmark score comparison

Third-party benchmark profile synced into LMSpeed; only metrics available for both models are shown.

Category performance

Compare benchmark category scores on a 0-100 scale. Select a category to inspect the gap.

Model A coverage: 6 / 8
Model B coverage: 7 / 8
Shared: 6 shared categories

GPT-5.4Qwen3.5-27B

Avg. score

GPT-5.4

63.6

Avg. score

Qwen3.5-27B

65.6

Selected category

Coding

GPT-5.4 leads by 18.3

Professional benchmark details

Metric-level scores with benchmark source, rank depth, confidence, error, and evaluation date where available.

Group

Aggregateverified

BenchLM overall score

SourceGPT-5.4

GPT-5.4

winner

86.0

Rank #3/96 · confidence 4 · eval date 2026-03-05

+27.0

Qwen3.5-27B

59.0

Rank #41/96 · confidence 3 · eval date 2026-03-04

Performanceverified

Time to first answer token

SourceGPT-5.4 (Non-reasoning)

GPT-5.4

winner

0.69 s

Rank #19/113 · confidence 4

+0.76 s

Qwen3.5-27B

1.45 s

Rank #46/113 · confidence 4

Performanceverified

Time to first token

SourceGPT-5.4 (Non-reasoning)

GPT-5.4

winner

0.69 s

Rank #24/113 · confidence 4

+0.76 s

Qwen3.5-27B

1.45 s

Rank #72/113 · confidence 4

Performanceverified

Output speed

SourceGPT-5.4 (Non-reasoning)

GPT-5.4

winner

106.7 tok/s

Rank #47/113 · confidence 4

+15.5 tok/s

Qwen3.5-27B

91.2 tok/s

Rank #54/113 · confidence 4

Pricingverified

Input price

SourceGPT-5.4 (Non-reasoning)

GPT-5.4

$2.50/M

Rank #114/138 · confidence 4

+$2.20/M

Qwen3.5-27B

winner

$0.300/M

Rank #41/138 · confidence 4

Pricingverified

Blended price

SourceGPT-5.4 (Non-reasoning)

GPT-5.4

$5.63/M

Rank #116/138 · confidence 4

+$4.80/M

Qwen3.5-27B

winner

$0.825/M

Rank #56/138 · confidence 4

Pricingverified

Output price

SourceGPT-5.4 (Non-reasoning)

GPT-5.4

$15.00/M

Rank #116/138 · confidence 4

+$12.60/M

Qwen3.5-27B

winner

$2.40/M

Rank #63/138 · confidence 4

Reasoningverified

CritPt

SourceGPT-5.4

GPT-5.4

winner

23.4

Rank #2/54 · confidence 4 · eval date 2026-03-05

+22.5

Qwen3.5-27B

0.9

Rank #43/54 · confidence 3 · eval date 2026-03-04

Reasoningverified

AA-LCR

SourceGPT-5.4

GPT-5.4

winner

74.0

Rank #4/67 · confidence 4 · eval date 2026-03-05

+6.7

Qwen3.5-27B

67.3

Rank #20/67 · confidence 3 · eval date 2026-03-04

Reasoningverified

BenchLM Reasoning score

SourceGPT-5.4

GPT-5.4

winner

87.5

Rank #4/65 · confidence 4 · eval date 2026-03-05

+48.3

Qwen3.5-27B

39.2

Rank #48/65 · confidence 3 · eval date 2026-03-04

Reasoningverified

GPQA

SourceGPT-5.4 (Non-reasoning)

GPT-5.4

74.8%

Rank #75/152 · confidence 4

+9.4%

Qwen3.5-27B

winner

84.2%

Rank #34/152 · confidence 4

Reasoningverified

HLE

SourceGPT-5.4 (Non-reasoning)

GPT-5.4

10.6%

Rank #68/150 · confidence 4

+2.6%

Qwen3.5-27B

winner

13.2%

Rank #59/150 · confidence 4

Codingverified

AA-SciCode

SourceGPT-5.4

GPT-5.4

winner

56.6

Rank #2/74 · confidence 4 · eval date 2026-03-05

+17.1

Qwen3.5-27B

39.5

Rank #45/74 · confidence 3 · eval date 2026-03-04

Codingverified

Terminal-Bench Hard

SourceGPT-5.4

GPT-5.4

winner

57.6

Rank #2/69 · confidence 4 · eval date 2026-03-05

+25.0

Qwen3.5-27B

32.6

Rank #37/69 · confidence 3 · eval date 2026-03-04

Codingverified

BenchLM Coding score

SourceGPT-5.4

GPT-5.4

winner

86.4

Rank #5/83 · confidence 4 · eval date 2026-03-05

+15.2

Qwen3.5-27B

71.2

Rank #30/83 · confidence 3 · eval date 2026-03-04

Codingverified

SciCode

SourceGPT-5.4 (Non-reasoning)

GPT-5.4

winner

47.1%

Rank #13/149 · confidence 4

+10.4%

Qwen3.5-27B

36.7%

Rank #75/149 · confidence 4

Knowledgeverified

BenchLM Knowledge score

SourceGPT-5.4

GPT-5.4

winner

96.9

Rank #1/79 · confidence 4 · eval date 2026-03-05

+26.1

Qwen3.5-27B

70.8

Rank #24/79 · confidence 3 · eval date 2026-03-04

Knowledgeverified

AA-GPQA Diamond

SourceGPT-5.4

GPT-5.4

winner

92.0

Rank #2/74 · confidence 4 · eval date 2026-03-05

+6.2

Qwen3.5-27B

85.8

Rank #28/74 · confidence 3 · eval date 2026-03-04

Knowledgeverified

AA-HLE

SourceGPT-5.4

GPT-5.4

winner

41.6

Rank #3/74 · confidence 4 · eval date 2026-03-05

+19.4

Qwen3.5-27B

22.2

Rank #33/74 · confidence 3 · eval date 2026-03-04

Knowledgeverified

Artificial Analysis Intelligence Index

SourceGPT-5.4

GPT-5.4

winner

51.4

Rank #3/77 · confidence 4 · eval date 2026-03-05

+17.6

Qwen3.5-27B

33.8

Rank #35/77 · confidence 3 · eval date 2026-03-04

Knowledgeverified

AA-Omniscience Accuracy

SourceGPT-5.4

GPT-5.4

winner

50.0

Rank #4/68 · confidence 4 · eval date 2026-03-05

+29.0

Qwen3.5-27B

21.0

Rank #54/68 · confidence 3 · eval date 2026-03-04

Knowledgeverified

AA-Omniscience Hallucination Rate

SourceGPT-5.4

GPT-5.4

winner

88.6

Rank #15/68 · confidence 4 · eval date 2026-03-05

+8.9

Qwen3.5-27B

79.7

Rank #30/68 · confidence 3 · eval date 2026-03-04

Multilingualverified

BenchLM Multilingual score

SourceGPT-5.4

GPT-5.4

winner

100.0

Rank #1/59 · confidence 4 · eval date 2026-03-05

+29.4

Qwen3.5-27B

70.6

Rank #19/59 · confidence 3 · eval date 2026-03-04

Multimodalverified

AA-MMMU-Pro

SourceGPT-5.4

GPT-5.4

winner

78.4

Rank #7/41 · confidence 4 · eval date 2026-03-05

+3.4

Qwen3.5-27B

75.0

Rank #15/41 · confidence 3 · eval date 2026-03-04

Multimodalverified

BenchLM Multimodal Grounded score

SourceGPT-5.4

GPT-5.4

60.0

Rank #41/70 · confidence 4 · eval date 2026-03-05

+2.9

Qwen3.5-27B

winner

62.9

Rank #33/70 · confidence 3 · eval date 2026-03-04

Instruction followingverified

BenchLM Instruction Following score

SourceGPT-5.4

GPT-5.4

winner

92.6

Rank #1/66 · confidence 4 · eval date 2026-03-05

+11.3

Qwen3.5-27B

81.3

Rank #13/66 · confidence 3 · eval date 2026-03-04

Instruction followingverified

AA-IFBench

SourceGPT-5.4

GPT-5.4

73.9

Rank #18/70 · confidence 4 · eval date 2026-03-05

+1.7

Qwen3.5-27B

winner

75.6

Rank #14/70 · confidence 3 · eval date 2026-03-04

Agentsverified

BenchLM Agentic score

SourceGPT-5.4

GPT-5.4

winner

88.3

Rank #3/81 · confidence 4 · eval date 2026-03-05

+44.4

Qwen3.5-27B

43.9

Rank #53/81 · confidence 3 · eval date 2026-03-04

Agentsverified

Gert Labs

SourceGPT-5.4

GPT-5.4

winner

64.9

Rank #3/42 · confidence 4 · eval date 2026-03-05

+25.5

Qwen3.5-27B

39.4

Rank #33/42 · confidence 3 · eval date 2026-03-04

Agentsverified

OSWorld-Verified

SourceGPT-5.4

GPT-5.4

winner

75.0

Rank #4/16 · confidence 4 · eval date 2026-03-05

+18.8

Qwen3.5-27B

56.2

Rank #13/16 · confidence 3 · eval date 2026-03-04

Agentsverified

Terminal-Bench 2.0

SourceGPT-5.4

GPT-5.4

winner

75.1

Rank #5/33 · confidence 4 · eval date 2026-03-05

+33.5

Qwen3.5-27B

41.6

Rank #31/33 · confidence 3 · eval date 2026-03-04

Agentsverified

BrowseComp

SourceGPT-5.4

GPT-5.4

winner

82.7

Rank #7/17 · confidence 4 · eval date 2026-03-05

+21.7

Qwen3.5-27B

61.0

Rank #14/17 · confidence 3 · eval date 2026-03-04

Agentsverified

Tau2-Telecom

SourceGPT-5.4

GPT-5.4

87.1

Rank #27/68 · confidence 4 · eval date 2026-03-05

+6.8

Qwen3.5-27B

winner

93.9

Rank #20/68 · confidence 3 · eval date 2026-03-04

API audit comparison

Latest completed audits from shared providers, with four safety and integrity score groups plus report links.

Provider	GPT-5.4	Qwen3.5-27B
No completed audits are available from shared providers yet.

Provider examples

Speed aggregates and input/output pricing share each provider row for real API selection and migration cost checks.

Provider	GPT-5.4	Qwen3.5-27B
No shared provider examples are available yet.

When to choose each model

This report only uses LMSpeed data for GPT-5.4 and Qwen3.5-27B: pricing, speed aggregates, third-party benchmark scores, and shared provider samples.

Guidance	GPT-5.4	Qwen3.5-27B
When to choose each model	GPT-5.4 GPT-5.4 is stronger when you prioritize Free providers, Provider coverage, Recent tests.	Qwen3.5-27B Qwen3.5-27B does not clearly lead on the verified metrics here, so check provider-specific pricing before choosing.

FAQ

TL;DR: GPT-5.4 leads across 88 verifiable data points, including pricing, speed, latency, benchmarks, and provider examples.

Why is this comparison indexable?: It has 3 verifiable comparison points, and both models have pricing or benchmark data.
Are missing metrics invented?: No. Metrics without LMSpeed data are omitted from this report.

Continue from GPT-5.4 vs Qwen3.5-27B into nearby model comparisons with enough verified LMSpeed data.

Model metadata	GPT-5.4 exposes 1.1M tokens; notable signals: Text input, Image input, File input, Text output.	Qwen3.5-27B exposes 262.1K tokens; notable signals: Text input, Image input, Text output, Tool calling.
Developer	OpenAI	Qwen
Context window	1.1M tokens	262.1K tokens
Max output	128K tokens	65.5K tokens
Released	Mar 2026	No data
Modalities	Input TextImageFile Output Text	Input TextImagevideo Output Text
Features	Text inputImage inputFile inputText outputTool callingStructured outputsJSON modeReasoning	Text inputImage inputText outputTool callingStructured outputsJSON modeReasoning
Parameters	No data	27B
Tokenizer	GPT	Qwen3
Knowledge cutoff	No data	No data
OpenRouter ID	openai/gpt-5.4	qwen/qwen3.5-27b
References	No data	No data

Key Takeaways

Change comparison

GPT-5.4 vs Qwen3.5-27B

GPT-5.4

Qwen3.5-27B

Benchmark score comparison

Category performance

Professional benchmark details

BenchLM overall score

Time to first answer token

Time to first token

Output speed

Input price

Blended price

Output price

CritPt

AA-LCR

BenchLM Reasoning score

GPQA

HLE

AA-SciCode

Terminal-Bench Hard

BenchLM Coding score

SciCode

BenchLM Knowledge score

AA-GPQA Diamond

AA-HLE

Artificial Analysis Intelligence Index

AA-Omniscience Accuracy

AA-Omniscience Hallucination Rate

BenchLM Multilingual score

AA-MMMU-Pro

BenchLM Multimodal Grounded score

BenchLM Instruction Following score

AA-IFBench

BenchLM Agentic score

Gert Labs

OSWorld-Verified

Terminal-Bench 2.0

BrowseComp

Tau2-Telecom

API audit comparison

Provider examples

When to choose each model

FAQ

Related compare reports