CI Bench

Managed · CI Bench v1

GitHub-hosted runners (ubuntu-latest, 2 vCPU)

The reference configuration for every comparison.

Speed
1.0×
the baseline
every comparison on this site is relative to this configuration
Cost per job
1.00
the baseline
US dollars per $1.00 spent
Lowest median time
0 / 12
workloads
none of the workloads
Failed runs
3 of 360
measured runs
vite 3 of 30. Counted, not replaced.

Speed on each workload

× faster than GitHub-hosted (ubuntu-latest) on the same workload
Burst: 20 jobs at once
1.0×
cli
1.0×
codex-lint
1.0×
container
1.0×
fd
1.0×
flask
1.0×
guava
1.0×
monorepo
1.0×
pydantic
1.0×
ts
1.0×
vite
1.0×
vue
1.0×

Configuration

Managed · 2 vCPU / 8 GB
Measured configuration
GitHub-hosted, 2 vCPU
Size
2 vCPU / 8 GB
Label or setup
ubuntu-24.04 (private repository) or a 2-core larger runner (public repository)
Price as measured
$0.006 a minute, each job rounded up to a whole minute; list price on 2026-10-05 (source)
Definition
providers/gh2.json

Per workload

Green marks the lowest median time on the workload. The burst row covers all 20 jobs.
WorkloadMedian timevs GitHub-hosted (ubuntu-latest)p95 timeMean costvs GitHub-hosted (ubuntu-latest)Successful runsRank
Burst: 20 jobs at once259 sbaseline283 s$0.500baseline30 of 309th
cli368 sbaseline382 s$0.039baseline30 of 309th
codex-lint884 sbaseline934 s$0.087baseline30 of 309th
container239 sbaseline282 s$0.027baseline30 of 307th
fd92 sbaseline120 s$0.012baseline30 of 308th
flask23 sbaseline28 s$0.0060baseline30 of 306th
guava1167 sbaseline1249 s$0.109baseline30 of 309th
monorepo384 sbaseline401 s$0.040baseline30 of 309th
pydantic179 sbaseline196 s$0.020baseline30 of 309th
ts784 sbaseline824 s$0.077baseline30 of 309th
vite603 sbaseline753 s$0.061baseline27 of 309th
vue121 sbaseline129 s$0.014baseline30 of 309th
Indexes and 95% intervals
Time index
1.000 (95% interval 1.000 to 1.000)
Cost index
1.000 (1.000 to 1.000) at 100,000 jobs a month

Compare with…

Head-to-head pages: speed, cost, failures and each workload