CI Bench

Measured · Result set v1 · Oct 7–11, 2026 · Updated October 28, 2026

GitHub-hosted larger runner vs the 2-core runner: worth it?

Eleven single-job workloads on GitHub's 2-core and 4-core Linux runners: time and cost per job.

Short answer

In CI Bench v1 the 4 vCPU larger runner was 1.6x as fast as the 2 vCPU runner on median job time overall (faster on 11 of 11 single-job workloads) but its list price is twice as high ($0.012 against $0.006 a minute), so its cost per job was 39% higher than the 2 vCPU runner's (a ratio of 1.39). A larger runner pays off only when the job's time falls by more than the price ratio. Maintained by Vitko, Inc., which sells one of the products measured.

Workload by workload

GitHub-hosted 2 vCPU against 4 vCPU
Workload2 vCPU median4 vCPU median4 vCPU speed vs 2 vCPU2 vCPU mean cost4 vCPU mean cost
cli368 s192 s1.9x faster$0.039$0.045
codex-lint884 s476 s1.9x faster$0.087$0.099
container239 s185 s1.3x faster$0.027$0.042
fd92 s66 s1.4x faster$0.012$0.019
flask23 s21 s1.1x faster$0.0060$0.012
guava1167 s946 s1.2x faster$0.109$0.181
monorepo384 s220 s1.7x faster$0.040$0.046
pydantic179 s154 s1.2x faster$0.020$0.033
ts784 s435 s1.8x faster$0.077$0.099
vite603 s288 s2.1x faster$0.061$0.060
vue121 s67 s1.8x faster$0.014$0.020

List prices ($0.006 and $0.012 a minute, GitHub's runner pricing, read 2026-10-27); each job rounded up to a whole minute. A job that takes 100 s on 2 cores and 50 s on 4 cores costs the same on both only if billing were per second; with per-minute rounding check your own job lengths. List price per minute is not cost per job; faster runners finish sooner.

More: all questions answered · 12 options compared · ranked by speed · ranked by cost per job · burst workload.

Method: how the runs were made; data: results.json; every raw record: the repository. Maintained by Vitko, Inc., which sells one of the products measured. Page dated October 28, 2026.