I've seen this pattern quite a bit with our users, and we've implemented "snapshots" for this.

It essentially makes a copy of your entire state of the runner, which you can then use in subsequent runs, with no concurrency limits.

This essentially automates out a lot of the work you're doing to make the jobs faster.

https://docs.warpbuild.com/snapshot-runners

We provide a product similar to Blacksmith.