Lowest median time
243 s
Vitko Runners (warm starts + test splitting)
GitHub-hosted (ubuntu-latest): 784 s
Slowest median
784 s
GitHub-hosted runners (ubuntu-latest, 2 vCPU)
3.2× the lowest
Lowest cost, managed
$0.012
Ubicloud
mean per job
Failed runs
0
no failed runs
of 270 measured runs
Median time
Seconds from start to finish · lower is betterTable
Ordered by median time. Self-hosted options are priced all-in at 100,000 jobs a month. Green marks the lowest median time and the lowest cost among the managed runners.| Configuration | Median | p95 | Queue p50 | Queue p95 | Cost | OK |
|---|---|---|---|---|---|---|
| Vitko Runners (warm starts + test splitting) | 243 s | 332 s | 2 s | 20.3 s | $0.027 | 30 of 30 |
| Vitko Runners | 372 s | 404 s | 2 s | 39.6 s | $0.012 | 30 of 30 |
| Blacksmith | 401 s | 570 s | 8 s | 11 s | $0.030 | 30 of 30 |
| Self-hosted runners on AWS (one VM per job) | 433 s | 467 s | 50 s | 73.9 s | $0.017 | 30 of 30 |
| GitHub-hosted larger runner (4 vCPU) | 435 s | 548 s | 3 s | 3 s | $0.099 | 30 of 30 |
| Self-hosted runners on Google Cloud | 533 s | 582 s | 2 s | 3.1 s | $0.029 | 30 of 30 |
| Ubicloud | 560 s | 844 s | 18 s | 248 s | $0.012 | 30 of 30 |
| RunsOn | 570 s | 597 s | 18 s | 25.6 s | $0.0061 | 30 of 30 |
| GitHub-hosted runners (ubuntu-latest, 2 vCPU) | 784 s | 824 s | 3 s | 5.1 s | $0.077 | 30 of 30 |
The job
- Project: microsoft/TypeScript at
v6.0.3(050880ce59e30b356b686bd3144efe24f875ebc8), licence Apache-2.0. Fetched at run time, not vendored. - Upstream job:
.github/workflows/ci.yml, job Test Node 24 on ubuntu-latest. - Benchmark workflow:
.github/workflows/wl-ts.yml.
Portability edits (identical for every provider)
- One matrix cell (Node 24, Linux).
- The test bundle is built in its own step before the tests (the test step's own build is then a no-op).
suite/ts holds the workflow and notes.