Compared with Ubicloud
| Configuration | Type | Speed vs Ubicloud | Cost per job vs Ubicloud (10,000 jobs a month) | Detail |
|---|---|---|---|---|
| Vitko Runners (warm starts + test splitting)Vitko | Managed | 2.0x faster | 9% lower | head to head |
| Vitko RunnersVitko | Managed | 1.5x faster | 9% lower | head to head |
| GitHub-hosted larger runner (4 vCPU) | Managed | 1.4x faster | 701% higher | head to head |
| Blacksmith | Managed | 1.4x faster | 179% higher | head to head |
| Self-hosted runners on Google Cloud | Self-hosted | 1.3x faster | 136% higher | head to head |
| RunsOn | Self-hosted | 1.1x faster | 44% higher | head to head |
| Self-hosted runners on AWS (one VM per job) | Self-hosted | about the same | 128% higher | head to head |
| GitHub-hosted runners (ubuntu-latest, 2 vCPU) | Managed | 1.1x slower | 478% higher | head to head |
Ratios come from the time and cost indexes in results.json (geometric mean over 12 workloads, each against GitHub-hosted (ubuntu-latest)), divided by Ubicloud's. List prices dated 2026-10-05; List price per minute is not cost per job; faster runners finish sooner. Method: how the runs were made.
Providers not measured
- Depot: Not measured in v2: Depot runners were assigned but did not start jobs for our account during the test window (checks on 2026-10-01 and 2026-10-24).
- WarpBuild: Not benchmarked
- Namespace: Not yet measured; joins in v2.
- BuildJet: Shut down (per its own docs, read 2026-10-24).
- Sengi: Not measured.
- CRACI: Not measured.
Their list prices, with sources, are on the list-prices page (read 2026-10-24).
Maintained by Vitko, Inc., which sells one of the products measured. Page generated October 27, 2026.