Ubicloud vs GitHub-hosted (ubuntu-latest): speed and cost on 12 real CI workloads

Speed

× faster than GitHub-hosted (ubuntu-latest) · higher is better

Ubicloud

1.1×

GitHub-hosted (ubuntu-latest)

1.0×

USD per $1.00 spent on GitHub-hosted (ubuntu-latest), at 100,000 jobs a month · lower is better

Ubicloud

$0.17

GitHub-hosted (ubuntu-latest)

$1.00

Ubicloud had the lowest median time of the two on 11 of 12 workloads, GitHub-hosted (ubuntu-latest) on 1.

Workload	Ubicloud	GitHub-hosted runners (ubuntu-latest, 2 vCPU)	Lowest median
Burst: 20 jobs at once	203 s	259 s	Ubicloud
cli	359 s	368 s	Ubicloud
codex-lint	682 s	884 s	Ubicloud
container	213 s	239 s	Ubicloud
fd	87 s	92 s	Ubicloud
flask	36 s	23 s	GitHub-hosted runners (ubuntu-latest, 2 vCPU)
guava	881 s	1167 s	Ubicloud
monorepo	276 s	384 s	Ubicloud
pydantic	159 s	179 s	Ubicloud
ts	560 s	784 s	Ubicloud
vite	502 s	603 s	Ubicloud
vue	114 s	121 s	Ubicloud

Mean cost per job in USD, from the benchmark’s sensitivity results

Volume	Ubicloud	GitHub-hosted runners (ubuntu-latest, 2 vCPU)
100,000 jobs a month	$0.173	$1.000
10,000 jobs a month	$0.173	$1.000
1,000 jobs a month	$0.173	$1.000

Counted, never replaced

Ubicloud: 1 of 360 measured runs (0.3%)
GitHub-hosted runners (ubuntu-latest, 2 vCPU): 3 of 360 measured runs (0.8%)

Each configuration page lists where its failures happened. All losses.

One line per configuration pairing, generated from the benchmark data

Ubicloud ran jobs 1.1× faster than GitHub-hosted runners (ubuntu-latest, 2 vCPU) (95% interval 1.1× to 1.2×); Ubicloud cost 83% less per job (at 100,000 jobs a month).