Runner using registry image randomly gets stuck with API error (401)
Seemingly at random around 20-50% of the CI jobs on our self-hosted Gitlab CI Multi Runner get stuck.
Running in debug mode I get the following output (identifiers redacted):
WARNING: Preparation failed: API error (401): Get https://registry.gitlab.com/v2/acc/repo/manifests/image: unauthorized: HTTP Basic: Access denied
build=build project=project runner=runner
Will be retried in 3s ... build=build project=project runner=runner
Appending trace to coordinator... ok build=build build-log=0-1270 build-status=pending code=202 runner=runner sent-log=876-1270 status=202 Accepted
Feeding runners to channel builds=1
ERROR: Job failed (system failure): API error (401): Get https://registry.gitlab.com/v2/acc/repo/manifests/image: unauthorized: HTTP Basic: Access denied
build=build project=project runner=runner
The same job will work fine if I then cancel and then retry the job.
I couldn't find any similar issues; let me know what information I can pass on to help debug this.
Thanks.