CI Bench

Managed · CI Bench v1 · Vitko sells this product

Vitko Runners

1.7x faster than GitHub's 2 vCPU runner and 84% lower cost per job, averaged over 12 workloads.

Speed
1.7×
faster than GitHub-hosted (ubuntu-latest)
2nd of 9 by speed
Cost per job
−84%
vs GitHub-hosted (ubuntu-latest)
2nd of 9; the same at 1,000 to 100,000 jobs a month
Lowest median time
1 / 12
workloads
codex-lint
Failed runs
0 of 360
no failed measured run
across all workloads

Speed on each workload

× faster than GitHub-hosted (ubuntu-latest) on the same workload
Burst: 20 jobs at once
1.6×
cli
1.4×
codex-lint
2.2×
container
1.3×
fd
1.9×
flask
1.4×
guava
1.8×
monorepo
2.1×
pydantic
1.7×
ts
2.1×
vite
1.7×
vue
1.9×

Configuration

Managed · up to 2 vCPU / 8 GB
Measured configuration
Vitko Runners
Size
up to 2 vCPU / 8 GB
Label or setup
Vitko Runners label
Price as measured
$0.002 a minute, billed per second; list price on 2026-10-05 (source)
Notes
Every workload, codex-lint included, runs at 2 vCPU / 8 GiB; the guest has swap, as GitHub-hosted runners do (the probe records memory and swap per job).
Definition
providers/vitko.json

Per workload

Green marks the lowest median time on the workload. The burst row covers all 20 jobs.
WorkloadMedian timevs GitHub-hosted (ubuntu-latest)p95 timeMean costvs GitHub-hosted (ubuntu-latest)Successful runsRank
Burst: 20 jobs at once160 s1.6x faster372 s$0.05689% lower30 of 305th
cli272 s1.4x faster326 s$0.009775% lower30 of 303rd
codex-lint404 s2.2x faster441 s$0.01484% lower30 of 301st
container179 s1.3x faster199 s$0.006078% lower30 of 304th
fd49 s1.9x faster56 s$0.001687% lower30 of 302nd
flask16 s1.4x faster20 s$0.000592% lower30 of 303rd
guava655 s1.8x faster661 s$0.02280% lower30 of 302nd
monorepo180 s2.1x faster211 s$0.005885% lower30 of 303rd
pydantic105 s1.7x faster140 s$0.003483% lower30 of 303rd
ts372 s2.1x faster404 s$0.01284% lower30 of 302nd
vite350 s1.7x faster389 s$0.01281% lower30 of 303rd
vue63 s1.9x faster64 s$0.002085% lower30 of 302nd
Burst queue, p95
295 s, against 31 s for GitHub-hosted (ubuntu-latest)
Indexes and 95% intervals
Time index
0.574 (95% interval 0.556 to 0.602)
Cost index
0.157 (0.155 to 0.159) at 100,000 jobs a month

Compare with…

Head-to-head pages: speed, cost, failures and each workload

Try Vitko Runners