Skip to content

CI Bench v1

Runners measured

Each page has the per-workload results, failed runs, the price rule and head-to-head comparisons for one configuration.

Vitko Runners (warm starts + test splitting)

Managed · 2.3× faster · 84% lower cost per job

Managed · 1.7× faster · 84% lower cost per job

GitHub-hosted larger runner (4 vCPU)

Managed · 1.6× faster · 39% higher cost per job

Managed · 1.6× faster · 52% lower cost per job

Self-hosted runners on Google Cloud

Self-hosted · 1.5× faster · 59% lower cost per job

Self-hosted · 1.2× faster · 88% lower cost per job

Self-hosted runners on AWS (one VM per job)

Self-hosted · 1.2× faster · 62% lower cost per job

Managed · 1.1× faster · 83% lower cost per job

GitHub-hosted runners (ubuntu-latest, 2 vCPU)

Managed · baseline for every comparison