Reduce concurrency on sidekiq-pullmirror
OOM killer has been terminating some ongoing jobs on these hosts:
$ be knife ssh 'roles:gitlab-base-be-sidekiq-pullmirror' "sudo dmesg -T | grep 'Kill process' | grep -c ' Sep '"
sidekiq-pullmirror-02.sv.prd.gitlab.com 30
sidekiq-pullmirror-01.sv.prd.gitlab.com 10
Concurrency is currently:
"sidekiq-cluster": {
"enable": true,
"queue_groups": [
"repository_update_mirror",
"repository_update_mirror",
"repository_update_mirror",
"repository_update_mirror",
"repository_update_mirror",
"repository_update_mirror",
"repository_update_mirror",
"repository_update_mirror"
]
}
Let's get that number down and see if this helps.
/cc @jarv @smcgivern