/ vercel / next.js
Updated 7/19/2026
The React Framework
Key Takeaways
- GPT-5.6 Sol leads with 55 of 74 tasks resolved, narrowly ahead of Kimi K3 at 54.
- Grok 4.5 is the strongest value option, resolving 50 tasks for $0.99 per test in 322 seconds.
- GPT-5.6 Sol and Kimi K3 resolve 59 of 74 tasks together, showing complementary strengths beyond their adjacent leaderboard positions.
Cost / Test vs. Accuracy
Grok 4.5 gives up five tasks relative to GPT-5.6 Sol but cuts cost per test from $2.51 to $0.99.
Latency vs. Accuracy
Grok 4.5 resolves 50 tasks in 322 seconds, compared with 55 tasks in 508 seconds for GPT-5.6 Sol. The faster GPT-5.6 Terra run resolves only 34 tasks.
Average token use / test
Tasks with failures
| Model | 143926d | 1682685 | 26ba360 | 27e225f | 2850659 | 2ce362f | 2e1eb88 | 3bb780e | 40b0e3d | 420ab0c | 422c93e | 47d4abc | 491f780 | 4a4590a | 4b1c74a | 4ebf4bd | 501f347 | 510d00b | 5af030c | 5f57774 | 63375cd | 64fbcb6 | 668cd3a | 814135a | 824fcd6 | 831ca50 | 83e99f0 | 84457f4 | 88c05db | 9097ef6 | a249dcb | a4c56f5 | a7b0469 | ab8e832 | ae62a6f | ae6d43b | b1f4916 | b420536 | c099530 | c39c717 | c3bf2a3 | d538cfb | db1f3a6 | de8e2e0 | e37c6d6 | e383590 | e59eb73 | f282e47 | f656c59 | f81c34f | f965c00 | fa71595 | fab0afc |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-5.6 Sol | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Kimi K3 | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Claude Fable 5 | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Grok 4.5 | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Claude Opus 4.8 | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| GLM 5.2 | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Claude Sonnet 5 | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Gemini 3.5 Flash | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Muse Spark 1.1 | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| GPT-5.6 Luna | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| GPT-5.5 | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Claude Opus 4.7 | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| GPT-5.6 Terra | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Gemini 3.1 Pro Preview | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| Claude Haiku 4.5 |
Task detail
143926d6a2c2Issue statement
When a Next.js project sets output: 'export' (or output: 'standalone') and also enables the experimental supportsImmutableAssets flag, the flag is incorrectly left enabled in the resolved configuration.
supportsImmutableAssets is designed to work together with the adapter code path, which controls how static assets are emitted (e.g. under a versioned _next/static/immutable/ directory). The output: 'export' and output: 'standalone' modes currently use a non-adapter code path, so honoring supportsImmutableAssets there produces incorrect output.
Expected behavior: while resolving/normalizing the Next.js configuration, if experimental.supportsImmutableAssets is enabled but output is set to 'export' or 'standalone', the flag must be force-disabled (experimental.supportsImmutableAssets === false) in the final resolved config, even when the user explicitly requested true. When output is not one of those values, an explicitly enabled supportsImmutableAssets must remain enabled.
This resolution should happen as part of the same config finalization that applies other framework defaults, so it is reflected in the config returned by loading the configuration.
Hidden tests
diff --git a/test/unit/isolated/supports-immutable-assets-output.test.ts b/test/unit/isolated/supports-immutable-assets-output.test.tsnew file mode 100644index 00000000..e80a1c84--- /dev/null+++ b/test/unit/isolated/supports-immutable-assets-output.test.ts@@ -0,0 +1,45 @@+/* eslint-env jest */+import { PHASE_PRODUCTION_BUILD } from 'next/constants'++// force require usage instead of dynamic import in jest+// x-ref: https://github.com/nodejs/node/issues/35889+process.env.__NEXT_TEST_MODE = 'jest'++describe('config - supportsImmutableAssets with output', () => {+ let loadConfig: typeof import('next/dist/server/config').default++ beforeEach(async () => {+ jest.resetModules()+ const configModule = await import('next/dist/server/config')+ loadConfig = configModule.default+ })++ it('force-disables supportsImmutableAssets when output is "export"', async () => {+ const config = await loadConfig(PHASE_PRODUCTION_BUILD, '<rootDir>', {+ customConfig: {+ output: 'export',+ experimental: { supportsImmutableAssets: true },+ },+ })+ expect(config.experimental.supportsImmutableAssets).toBe(false)+ })++ it('force-disables supportsImmutableAssets when output is "standalone"', async () => {+ const config = await loadConfig(PHASE_PRODUCTION_BUILD, '<rootDir>', {+ customConfig: {+ output: 'standalone',+ experimental: { supportsImmutableAssets: true },+ },+ })+ expect(config.experimental.supportsImmutableAssets).toBe(false)+ })++ it('keeps supportsImmutableAssets enabled when output is not set', async () => {+ const config = await loadConfig(PHASE_PRODUCTION_BUILD, '<rootDir>', {+ customConfig: {+ experimental: { supportsImmutableAssets: true },+ },+ })+ expect(config.experimental.supportsImmutableAssets).toBe(true)+ })+})
Head-to-head
Accuracy
74.32%Δ 1.35%
72.97%
Cost / test
$2.51Δ $9.22
$11.73
Latency
508sΔ 495s
1004s
Cost distribution
Latency distribution
Input token distribution
Output token distribution
Task outcomes
74 tasks