Ranking by speed
| Rank | Configuration | Type | Speed vs GitHub-hosted | 95% interval (time index) | Median time, monorepo job |
|---|---|---|---|---|---|
| 1 | Vitko Runners (warm starts + test splitting)Vitko | Managed | 2.3x faster | 0.423 to 0.459 | 172 s |
| 2 | Vitko RunnersVitko | Managed | 1.7x faster | 0.556 to 0.602 | 180 s |
| 3 | GitHub-hosted larger runner (4 vCPU) | Managed | 1.6x faster | 0.629 to 0.669 | 220 s |
| 4 | Blacksmith | Managed | 1.6x faster | 0.606 to 0.759 | 177 s |
| 5 | Self-hosted runners on Google Cloud | Self-hosted | 1.5x faster | 0.658 to 0.692 | 278 s |
| 6 | RunsOn | Self-hosted | 1.2x faster | 0.816 to 0.859 | 288 s |
| 7 | Self-hosted runners on AWS (one VM per job) | Self-hosted | 1.2x faster | 0.833 to 0.947 | 281 s |
| 8 | Ubicloud | Managed | 1.1x faster | 0.847 to 0.921 | 276 s |
| 9 | GitHub-hosted runners (ubuntu-latest, 2 vCPU) | Managed | baseline | 1.000 to 1.000 | 384 s |
Speed is the inverse of the time index: the geometric mean over the 12 workloads of the configuration's median job time divided by GitHub-hosted (ubuntu-latest)'s. Higher is faster. Intervals cover sampling, not your workflow.
Time by workload
Head to head: Vitko Runners vs Blacksmith · Vitko Runners vs Ubicloud · Vitko Runners vs RunsOn · Vitko Runners vs Self-hosted runners on AWS · Vitko Runners vs Self-hosted runners on Google Cloud · Vitko Runners vs GitHub-hosted larger runner (4 vCPU) · Vitko Runners vs GitHub-hosted (ubuntu-latest) · Blacksmith vs GitHub-hosted (ubuntu-latest).
More: speed ranking · cost ranking · alternatives to GitHub-hosted · monorepo workload · self-hosted vs managed · list prices · free minutes · alternatives to Blacksmith, RunsOn, Ubicloud.
Maintained by Vitko, Inc., which sells one of the products measured. Measured October 7 to 11, 2026 (result set v1); page generated October 27, 2026. Every number comes from results.json; the workflows and every raw job record are in the repository, and the method says how the runs were made.