Avg. Accuracy
61.9%
Latency
13.6s
Cost (In/Out)
1.25 / 5.00
Context Window
2M
Max Output Tokens
8k
Input Modality
Academic Benchmarks
Proprietary Benchmarks (contact us to get access)
Avg. Accuracy
61.9%
Latency
13.6s
Cost (In/Out)
Context Window
2M
Max Output Tokens
8k
Input Modality
Model benchmarks are seriously lacking. With Vals AI, we report how language models perform on the industry-specific tasks where they will be used.
By subscribing, I agree to Vals' Privacy Policy.