We just evaluated DeepSeek V3 on all benchmarks!

• DeepSeek V3 is DeepSeek’s latest model, boasting speeds of 60 tokens/second and claiming to be 3x faster than V2, with an average accuracy of 73.9% (4.2% better than previous versions).
• DeepSeek V3 performs comparably (slightly better) to Claude 3.7 Sonnet (71.7%).
• The model demonstrates strong legal capabilities, scoring particularly well on CaseLaw and LegalBench, though it scores lower on ContractLaw.
• It shows impressive academic versatility with top-tier performance on MGSM, Math500, and MedQA.