Claude Fable 5 vs GPT-6 Astra: Benchmark Comparison

Claude Fable 5 has the higher score on 5 of 10 shared benchmarks; GPT-6 Astra leads on 5.

The largest observed score gap is 47.14 pts on Terminal-Bench-Science , where GPT-6 Astra leads.

Reported ±1 standard-error ranges overlap on 2 of 9 shared benchmarks with comparable uncertainty data. This is not a pairwise statistical significance test.

Shared benchmark results

Scores and reported standard errors come from the latest visible Vals benchmark version available for both models.

Benchmark Claude Fable 5 GPT-6 Astra Gap Reported uncertainty
Vals RSI Index 24.32% 27.07% 2.75 pts Uncertainty comparison unavailable
Legal Research Bench 49.52% ±3.48 39.42% ±3.40 10.10 pts Reported ±1 SE ranges do not overlap
Tax Agent Bench 38.28% ±3.50 20.72% ±2.92 17.56 pts Reported ±1 SE ranges do not overlap
MedCode 56.07% ±2.20 48.49% ±2.13 7.58 pts Reported ±1 SE ranges do not overlap
MedScribe 88.52% ±1.95 87.91% ±1.94 0.61 pts Reported ±1 SE ranges overlap
ProofBench v1.1 95.00% ±2.19 99.00% ±1.00 4.00 pts Reported ±1 SE ranges do not overlap
Terminal-Bench-Science 15.71% ±4.38 62.86% ±5.82 47.14 pts Reported ±1 SE ranges do not overlap
ProgramBench 2.00% ±0.99 5.50% ±1.62 3.50 pts Reported ±1 SE ranges do not overlap
Terminal-Bench 4.0 41.41% ±1.34 59.60% ±4.40 18.18 pts Reported ±1 SE ranges do not overlap
Vibe Code Bench v1.1 90.35% ±2.10 89.59% ±2.17 0.76 pts Reported ±1 SE ranges overlap

Performance by category

Category Claude Fable 5 average GPT-6 Astra average
Legal 49.52% 39.42%
Finance 38.28% 20.72%
Healthcare 72.30% 68.20%
Math 95.00% 99.00%
Science 15.71% 62.86%
Coding 44.59% 51.56%

Cost and latency

Cost per test appears only where the benchmark reports it for both models. Latency is the measured completion time for that benchmark.

Benchmark Claude Fable 5 cost GPT-6 Astra cost Claude Fable 5 latency GPT-6 Astra latency
Vals RSI Index $491.22 $759.51 90h00m 90h00m
Legal Research Bench $9.79 $10.58 22m18s 24m51s
Tax Agent Bench $6.70 $5.80 14m27s 15m01s
MedCode N/A N/A 91.44s 102.86s
MedScribe N/A N/A 119.47s 2m34s
ProofBench v1.1 $5.23 $1.71 13m43s 5m08s
Terminal-Bench-Science $51.99 $20.80 1h59m 1h49m
ProgramBench $75.68 $11.57 2h37m 27m02s
Terminal-Bench 4.0 $30.34 $9.58 1h08m 35m42s
Vibe Code Bench v1.1 $41.71 $38.51 1h02m 39m04s

Results available only for Claude Fable 5

  • LegalBench
  • MortgageTax
  • TaxEval v2
  • GPQA Diamond
  • MMLU Pro
  • MMMU Pro
  • LiveCodeBench
  • SWE-bench
  • Public Benefits Bench v1.1

Results available only for GPT-6 Astra

  • Vals Index
  • Vals Finance Index
  • Vals Legal Index
  • Vals Science Index
  • HLAB-Vals-1.1
  • Immigration
  • EMB v1.1
  • Finance Agent v2.1
  • BioMysteryBench
  • MysteryMechanism
  • Robo-bench
  • Code Migration v1.1
  • IOI
  • SWE-bench Multimodal
  • CyberBench v1.1
  • SRE Bench
  • Financial Coaching Bench
  • CUA-bench
  • Time Horizon Index: KSP
Model details Claude Fable 5 Model details GPT-6 Astra