Lowest median time
32 s
Vitko Runners (warm starts + test splitting)
GitHub-hosted (ubuntu-latest): 121 s
Slowest median
121 s
GitHub-hosted runners (ubuntu-latest, 2 vCPU)
3.8× the lowest
Lowest cost, managed
$0.0017
Vitko Runners (warm starts + test splitting)
mean per job
Failed runs
0
no failed runs
of 270 measured runs
Median time
Seconds from start to finish · lower is betterTable
Ordered by median time. Self-hosted options are priced all-in at 100,000 jobs a month. Green marks the lowest median time and the lowest cost among the managed runners.| Configuration | Median | p95 | Queue p50 | Queue p95 | Cost | OK |
|---|---|---|---|---|---|---|
| Vitko Runners (warm starts + test splitting) | 32 s | 33 s | 1.5 s | 2 s | $0.0017 | 30 of 30 |
| Vitko Runners | 63 s | 64 s | 1.5 s | 2 s | $0.0020 | 30 of 30 |
| GitHub-hosted larger runner (4 vCPU) | 67 s | 88 s | 3 s | 22.7 s | $0.020 | 30 of 30 |
| Self-hosted runners on Google Cloud | 76 s | 109 s | 1 s | 2 s | $0.0044 | 30 of 30 |
| Blacksmith | 76 s | 104 s | 7 s | 10 s | $0.0077 | 30 of 30 |
| RunsOn | 101 s | 108 s | 19 s | 21.5 s | $0.0020 | 30 of 30 |
| Ubicloud | 114 s | 152 s | 18 s | 22 s | $0.0027 | 30 of 30 |
| Self-hosted runners on AWS (one VM per job) | 117 s | 155 s | 51 s | 89.6 s | $0.0051 | 30 of 30 |
| GitHub-hosted runners (ubuntu-latest, 2 vCPU) | 121 s | 129 s | 3 s | 4 s | $0.014 | 30 of 30 |
The job
- Project: vuejs/core at
v3.5.43(5be58b4c475c1d14b4abacbfeda610394a0ee4e5), licence MIT. Fetched at run time, not vendored. - Upstream job:
.github/workflows/test.yml, job unit-test. - Benchmark workflow:
.github/workflows/wl-vue.yml.
Portability edits (identical for every provider)
- Node is set up before pnpm.
suite/vue holds the workflow and notes.