Postmortem: Intermittent Failure in SimKube CI Runners

We’re very sorry if your SimKube CI pipeline looked like this at some point in the last week or so. Really, honest.

On Wednesday, November 26, 2025, while testing changes to ACRL’s SimKube CI Runner¹, an ACRL employee discovered an intermittent failure in the runner. This failure caused approximately 50% of the simulations scheduled on the runner to fail…