CI Bench

Managed · CI Bench v1 · Vitko sells this product

Vitko Runners (warm starts + test splitting)

2.3x faster than GitHub's 2 vCPU runner and 84% lower cost per job, averaged over 12 workloads.

Speed
2.3×
faster than GitHub-hosted (ubuntu-latest)
1st of 9 by speed
Cost per job
−84%
vs GitHub-hosted (ubuntu-latest)
3rd of 9; the same at 1,000 to 100,000 jobs a month
Lowest median time
8 / 12
workloads
cli, fd, guava, monorepo, pydantic, ts, vite, vue
Failed runs
3 of 360
measured runs
vite 3 of 30. Counted, not replaced.

Speed on each workload

× faster than GitHub-hosted (ubuntu-latest) on the same workload
Burst: 20 jobs at once
2.0×
cli
2.6×
codex-lint
2.2×
container
1.3×
fd
2.0×
flask
1.8×
guava
1.8×
monorepo
2.2×
pydantic
2.6×
ts
3.2×
vite
3.0×
vue
3.8×

Configuration

Managed · up to 2 vCPU / 8 GB
Measured configuration
Vitko Runners, recommended configuration (warm starts + split tests)
Size
up to 2 vCPU / 8 GB
Price as measured
$0.002 a minute, billed per second; list price on 2026-10-05 (source)
Notes
Warm starts: vitko-inc/checkpoint after the setup steps, captured from a run on the default branch; measured runs come from another branch. Split tests: vitko-inc/split-tests on the splittable test steps (unit tests, and vite's three end-to-end steps), with spec files that need the outside network in a separate unsplit step. Only the parts are billed while a split step runs.
Definition
providers/vitko-opt.json

Per workload

Green marks the lowest median time on the workload. The burst row covers all 20 jobs.
WorkloadMedian timevs GitHub-hosted (ubuntu-latest)p95 timeMean costvs GitHub-hosted (ubuntu-latest)Successful runsRank
Burst: 20 jobs at once131 s2.0x faster191 s$0.05290% lower30 of 302nd
cli140 s2.6x faster145 s$0.01270% lower30 of 301st
codex-lint405 s2.2x faster425 s$0.01484% lower30 of 302nd
container178 s1.3x faster208 s$0.006177% lower30 of 302nd
fd45 s2.0x faster48 s$0.001488% lower30 of 301st
flask13 s1.8x faster14 s$0.000494% lower30 of 302nd
guava651 s1.8x faster661 s$0.02280% lower30 of 301st
monorepo172 s2.2x faster191 s$0.005686% lower30 of 301st
pydantic69 s2.6x faster119 s$0.002289% lower30 of 301st
ts243 s3.2x faster332 s$0.02765% lower30 of 301st
vite199 s3.0x faster212 s$0.01379% lower27 of 301st
vue32 s3.8x faster33 s$0.001788% lower30 of 301st
Burst queue, p95
115 s, against 31 s for GitHub-hosted (ubuntu-latest)
Indexes and 95% intervals
Time index
0.436 (95% interval 0.423 to 0.459)
Cost index
0.158 (0.156 to 0.160) at 100,000 jobs a month

Compare with…

Head-to-head pages: speed, cost, failures and each workload

Try Vitko Runners