Benchmarks on Public Repositories

Independent benchmarks for industry-specific AI performance.

Recently Evaluated

sashabaranov / go-openai

go-openai

Created8/24/2026

OpenAI, GPT 5.6, GPT-Image-2, Whisper API clients for Go

5Models30Tasks

Languages

Go100%

Top Models

1Claude Opus 5
2GLM 5.2
3GPT-5.6 Sol

View Details

leanprover-community / mathlib4

mathlib4

Created8/18/2026

The math library of Lean 4

4Models30Tasks

Languages

Lean99.6%Python0.3%Shell<0.1%TeX<0.1%Dockerfile<0.1%HTML<0.1%Other<0.1%

Top Models

1Claude Opus 5
2Muse Spark 1.2
3Gemini 3.6 Flash

View Details

rubyforgood / human-essentials

human-essentials

Created8/18/2026

Human Essentials is an inventory management system for diaper, incontinence, and period-supply banks. It supports them in distributing to partners, tracking inventory, and reporting stats and analytics.

1Models30Tasks

Languages

Ruby73.8%HTML23.6%JavaScript1.7%SCSS0.7%Shell<0.1%Dockerfile<0.1%Other<0.1%

Top Models

1DeepSeek V4 Flash 0731

View Details

C

torvalds / linux

linux

Created8/15/2026

Linux kernel source tree

14Models85Tasks

Languages

C98%Assembly0.7%Rust0.4%Shell0.4%Python0.3%Makefile0.2%

Top Models

1GPT-5.6 Sol
2Claude Fable 5
3Claude Opus 4.8

View Details

C++

NVIDIA / nccl

nccl

Created8/13/2026

Optimized primitives for collective multi-GPU communication

3Models30Tasks

Languages

C++53.6%Cuda18%C13.6%Python9%Cython2.3%Rust1.6%Other1.9%

Top Models

1Claude Opus 5
2GPT-5.6 Sol
3Muse Spark 1.2

View Details

Cuda

nikil-ravi / ThunderKittens

ThunderKittens

Created8/13/2026

Tile primitives for speedy kernels

1Models30Tasks

Languages

Cuda86.3%Python12.9%Makefile0.8%

Top Models

1GPT-5.6 Luna

View Details

Dart

flutter / flutter

flutter

Created8/13/2026

Flutter makes it easy and fast to build beautiful apps for mobile and beyond

3Models30Tasks

Languages

Dart75%C++16.1%Objective-C++2.7%Java2.7%Objective-C0.6%C0.6%Other2.3%

Top Models

1Gemini 3.6 Flash
2Claude Haiku 4.5 (Nonthinking)
3Gemini 3.1 Pro Preview (02/26)

View Details

Go

sashabaranov / go-openai

go-openai

Created8/24/2026

OpenAI, GPT 5.6, GPT-Image-2, Whisper API clients for Go

5Models30Tasks

Languages

Go100%

Top Models

1Claude Opus 5
2GLM 5.2
3GPT-5.6 Sol

View Details

chrisanderton / tyk-gateway

tyk-gateway

Created8/16/2026

Tyk Open Source API Gateway written in Go, supporting REST, GraphQL, TCP and gRPC protocols

4Models30Tasks

Languages

Go98%Shell0.7%Python0.6%JavaScript0.3%Java0.2%Dockerfile<0.1%Other0.3%

Top Models

1Claude Opus 5
2GPT-5.6 Sol
3Claude Opus 4.8

View Details

ladydascalie / core

core

Created8/15/2026

A collection of packages for building a Go microservice on the LUSH platform

4Models30Tasks

Languages

Go100%

Top Models

1DeepSeek V4 Flash 0731
2GLM 5.2
3Qwen 3.7 Plus

View Details

goharbor / harbor

harbor

Created8/13/2026

An open source trusted cloud native registry project that stores, signs, and scans content.

4Models30Tasks

Languages

Go53.2%TypeScript21.4%HTML7.8%Python5.4%RobotFramework5%Jinja3.8%Other3.3%

Top Models

1Claude Opus 5
2Claude Sonnet 5
3Grok 4.5

View Details

HTML

benredmond / apex

apex

Created8/13/2026

Custom repository benchmark.

2Models30Tasks

Languages

HTML72.5%TypeScript19.3%JavaScript7.9%Shell0.2%CSS0.1%Dockerfile<0.1%

Top Models

1GPT-5.6 Luna
2GPT-5.6 Terra

View Details

Java

nationalsecurityagency / ghidra

ghidra

Created8/13/2026

Ghidra is a software reverse engineering (SRE) framework

2Models30Tasks

Languages

Java86%C++6%HTML4.1%C1.5%Python1.4%Shell0.3%Other0.6%

Top Models

1GLM 5.2
2Grok 4.5

View Details

JavaScript

vercel / next.js

next.js

Created8/15/2026

The React Framework

14Models74Tasks

Languages

JavaScript52.2%TypeScript32.1%Rust14%MDX0.8%CSS0.8%Other0.1%

Top Models

1GPT-5.6 Sol
2Kimi K3
3Claude Fable 5

View Details

Kotlin

arandomhooman / hoomans-morphe-patches

hoomans-morphe-patches

Created8/17/2026

Patches for morphe

4Models30Tasks

Languages

Kotlin89.6%Java10.4%

Top Models

1GPT-5.6 Sol
2Claude Opus 4.8
3Claude Opus 5

View Details

poalrom / sharepaste

sharepaste

Created8/14/2026

Custom repository benchmark.

2Models30Tasks

Languages

Kotlin40.5%Rust34.8%TypeScript23.6%CSS0.7%Makefile0.2%JavaScript0.1%Other<0.1%

Top Models

1Claude Opus 5
2GPT-5.6 Sol

View Details

Lean

leanprover-community / mathlib4

mathlib4

Created8/18/2026

The math library of Lean 4

4Models30Tasks

Languages

Lean99.6%Python0.3%Shell<0.1%TeX<0.1%Dockerfile<0.1%HTML<0.1%Other<0.1%

Top Models

1Claude Opus 5
2Muse Spark 1.2
3Gemini 3.6 Flash

View Details

Python

18jeffreyma / Valkyrie

Valkyrie

Created8/18/2026

Scalable, cloud-native infrastructure for evaluating AI agents across any benchmark.

1Models30Tasks

Languages

Python99.5%Makefile0.4%Dockerfile<0.1%Mako<0.1%Shell<0.1%

Top Models

1Claude Opus 4.8

View Details

18jeffreyma / OpenHands

OpenHands

Created8/18/2026

🙌 OpenHands: Code Less, Make More

1Models30Tasks

Languages

Python77%TypeScript20.1%Shell1.4%Jinja0.9%JavaScript0.3%Makefile0.2%Other0.2%

Top Models

1Muse Spark 1.2

View Details

geopandas / geopandas

geopandas

Created8/17/2026

Python tools for geographic data

4Models30Tasks

Languages

Python100%Shell<0.1%

Top Models

1Gemini 3.6 Flash
2Claude Sonnet 5
3GPT 5.5

View Details

pallets / click

click

Created8/17/2026

Python composable command line interface toolkit

1Models30Tasks

Languages

Python100%Shell<0.1%

Top Models

1Claude Opus 5

View Details

ucbepic / docetl

docetl

Created8/17/2026

A system for agentic LLM-powered data processing and ETL

1Models30Tasks

Languages

Python68.6%TypeScript31.1%Makefile0.1%CSS<0.1%Dockerfile<0.1%JavaScript<0.1%

Top Models

1GLM 5.2

View Details

sgl-project / sglang

sglang

Created8/15/2026

SGLang is a high-performance serving framework for large language models and multimodal models.

14Models59Tasks

Languages

Python76.9%MDX6.8%Rust6.1%Cuda4.3%C++2.7%JavaScript1.9%Other1.3%

Top Models

1GPT-5.6 Terra
2Claude Fable 5
3GLM 5.2

View Details

jax-ml / jax

jax

Created8/15/2026

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

14Models54Tasks

Languages

Python87.1%C++9.9%Starlark2%Shell0.5%Jupyter Notebook0.4%C<0.1%

Top Models

1GPT-5.6 Sol
2Claude Fable 5
3Claude Sonnet 5

View Details

vals-ai / valkyrie

valkyrie

Created8/15/2026

Scalable, cloud-native infrastructure for evaluating AI agents across any benchmark.

14Models46Tasks

Languages

Python99.4%Makefile0.5%Mako0.1%

Top Models

1GPT-5.6 Sol
2Claude Fable 5
3Claude Opus 4.8

View Details

mirumee / ariadne

ariadne

Created8/13/2026

Python library for implementing GraphQL servers using schema-first approach. Created with :heart: by Mirumee

2Models30Tasks

Languages

Python99%HTML0.8%Just0.2%

Top Models

1GLM 5.2
2DeepSeek V4 Flash 0731

View Details

BerriAI / litellm

litellm

Created8/13/2026

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

2Models30Tasks

Languages

Python84.5%TypeScript12.6%HTML1.5%Rust0.6%HCL0.2%Go0.2%Other0.4%

Top Models

1Gemini 3.6 Flash
2GLM 5.2

View Details

harbor-framework / terminal-bench

terminal-bench

Created8/13/2026

Measuring and evolving with the frontier of agent work

1Models30Tasks

Languages

Python48.8%JavaScript14%Lean12%TypeScript9.3%Shell4.4%Dockerfile2.2%Other9.3%

Top Models

1Claude Haiku 4.5 (Nonthinking)

View Details

conjfrnk / memovox

memovox

Created8/13/2026

A local-first multimodal video-to-knowledge engine.

2Models30Tasks

Languages

Python97.9%JavaScript2%Makefile0.1%Dockerfile<0.1%

Top Models

1Claude Opus 5
2GPT-5.6 Luna

View Details

skypilot-org / skypilot

skypilot

Created8/13/2026

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

4Models30Tasks

Languages