CI Bench

Workload ranking · Result set v1 · Measured Oct 7–11, 2026

GitHub Actions runners for a monorepo build, measured

One monorepo CI job (vercel/ai, Build Examples) on 9 runner configurations: median time 172 s to 384 s. It is one project's job, not every monorepo.

Ranking on the monorepo workload

Monorepo workload ranking
RankConfigurationTypeMedian timep95 timevs GitHub-hostedMean cost per job
1Vitko Runners (warm starts + test splitting)VitkoManaged172 s191 s2.2x faster$0.0056
2BlacksmithManaged177 s291 s2.2x faster$0.014
3Vitko RunnersVitkoManaged180 s211 s2.1x faster$0.0058
4GitHub-hosted larger runner (4 vCPU)Managed220 s235 s1.7x faster$0.046
5UbicloudManaged276 s366 s1.4x faster$0.0061
6Self-hosted runners on Google CloudSelf-hosted278 s297 s1.4x faster$0.016
7Self-hosted runners on AWS (one VM per job)Self-hosted281 s342 s1.4x faster$0.012
8RunsOnSelf-hosted288 s313 s1.3x faster$0.0039
9GitHub-hosted runners (ubuntu-latest, 2 vCPU)Managed384 s401 sbaseline$0.040

The job is the project's own Build Examples workflow at a pinned release commit, with the portability edits listed on the workload page. Results on your monorepo depend on its size, cache use and parallelism: measure yours with the same method.

Head to head: Vitko Runners vs Blacksmith · Vitko Runners vs Ubicloud · Vitko Runners vs RunsOn · Vitko Runners vs Self-hosted runners on AWS · Vitko Runners vs Self-hosted runners on Google Cloud · Vitko Runners vs GitHub-hosted larger runner (4 vCPU) · Vitko Runners vs GitHub-hosted (ubuntu-latest) · Blacksmith vs GitHub-hosted (ubuntu-latest).

More: speed ranking · cost ranking · alternatives to GitHub-hosted · monorepo workload · self-hosted vs managed · list prices · free minutes · alternatives to Blacksmith, RunsOn, Ubicloud.

Maintained by Vitko, Inc., which sells one of the products measured. Measured October 7 to 11, 2026 (result set v1); page generated October 27, 2026. Every number comes from results.json; the workflows and every raw job record are in the repository, and the method says how the runs were made.