Lowest median time
45 s
Vitko Runners (warm starts + test splitting)
GitHub-hosted (ubuntu-latest): 92 s
Slowest median
114 s
Self-hosted runners on AWS (one VM per job)
2.5× the lowest
Lowest cost, managed
$0.0014
Vitko Runners (warm starts + test splitting)
mean per job
Failed runs
0
no failed runs
of 270 measured runs
Median time
Seconds from start to finish · lower is betterTable
Ordered by median time. Self-hosted options are priced all-in at 100,000 jobs a month. Green marks the lowest median time and the lowest cost among the managed runners.| Configuration | Median | p95 | Queue p50 | Queue p95 | Cost | OK |
|---|---|---|---|---|---|---|
| Vitko Runners (warm starts + test splitting) | 45 s | 48 s | 1 s | 2.5 s | $0.0014 | 30 of 30 |
| Vitko Runners | 49 s | 56 s | 2 s | 9.2 s | $0.0016 | 30 of 30 |
| Self-hosted runners on Google Cloud | 64 s | 72 s | 1 s | 2 s | $0.0035 | 30 of 30 |
| Blacksmith | 65 s | 81 s | 8 s | 9.5 s | $0.0055 | 30 of 30 |
| GitHub-hosted larger runner (4 vCPU) | 66 s | 81 s | 3 s | 4 s | $0.019 | 30 of 30 |
| Ubicloud | 87 s | 125 s | 16.5 s | 29.6 s | $0.0021 | 30 of 30 |
| RunsOn | 89 s | 93 s | 18.5 s | 20 s | $0.0018 | 30 of 30 |
| GitHub-hosted runners (ubuntu-latest, 2 vCPU) | 92 s | 120 s | 3 s | 3.5 s | $0.012 | 30 of 30 |
| Self-hosted runners on AWS (one VM per job) | 114 s | 139 s | 56.5 s | 81.3 s | $0.0047 | 30 of 30 |
The job
- Project: sharkdp/fd at
v10.5.0(4f81778774463bf414a184cbe6d5219ad2229646), licence Apache-2.0 OR MIT. Fetched at run time, not vendored. - Upstream job:
.github/workflows/CICD.yml, job x86_64-unknown-linux-gnu (ubuntu-24.04). - Benchmark workflow:
.github/workflows/wl-fd.yml.
Portability edits (identical for every provider)
cargoinstead ofcrossfor the native x86_64 target (cross wraps the same build in Docker).- Release packaging steps after the tests are omitted.
suite/fd holds the workflow and notes.