Side by side
| Rank | Configuration | Type | Speed vs GitHub-hosted | Cost per job at 1,000 a month | At 10,000 | At 100,000 | Failed runs |
|---|---|---|---|---|---|---|---|
| 1 | Vitko Runners (warm starts + test splitting)Vitko | Managed | 2.3x faster | 84% lower | 84% lower | 84% lower | 3 of 360 |
| 2 | Vitko RunnersVitko | Managed | 1.7x faster | 84% lower | 84% lower | 84% lower | 0 of 360 |
| 3 | Blacksmith | Managed | 1.6x faster | 52% lower | 52% lower | 52% lower | 3 of 360 |
| 4 | Self-hosted runners on Google Cloud | Self-hosted | 1.5x faster | 59% lower | 59% lower | 59% lower | 1 of 360 |
| 5 | RunsOn | Self-hosted | 1.2x faster | 43% higher | 75% lower | 88% lower | 1 of 360 |
| 6 | Self-hosted runners on AWS (one VM per job) | Self-hosted | 1.2x faster | 49% lower | 60% lower | 62% lower | 0 of 360 |
| 7 | Ubicloud | Managed | 1.1x faster | 83% lower | 83% lower | 83% lower | 1 of 360 |
We operated the self-hosted options, which sets how much operations time they took; that time is not in the cost figures. Self-hosted options spread fixed monthly costs over the volume, so their cost per job falls as the volume rises; managed per-minute prices do not change with volume. Limits of the method.
Head to head: Vitko Runners vs Blacksmith · Vitko Runners vs Ubicloud · Vitko Runners vs RunsOn · Vitko Runners vs Self-hosted runners on AWS · Vitko Runners vs Self-hosted runners on Google Cloud · Vitko Runners vs GitHub-hosted larger runner (4 vCPU) · Vitko Runners vs GitHub-hosted (ubuntu-latest) · Blacksmith vs GitHub-hosted (ubuntu-latest).
More: speed ranking · cost ranking · alternatives to GitHub-hosted · monorepo workload · self-hosted vs managed · list prices · free minutes · alternatives to Blacksmith, RunsOn, Ubicloud.
Maintained by Vitko, Inc., which sells one of the products measured. Measured October 7 to 11, 2026 (result set v1); page generated October 27, 2026. Every number comes from results.json; the workflows and every raw job record are in the repository, and the method says how the runs were made.