Ability to configure sidekiq concurrency

Created by: jeffutter

It would be nice to have some way to configure the concurrency of sidekiq.

By default sidekiq starts up with 25 threads. I'm running gitlab on a memory constrained, low-traffic VPS. This is surely overkill. I can currently override this by changing the command-line in the sidekiq.rake task and adding -c 5 (or whatever number) It would be nice if this could be added to the config file though so it would get carried through deploys. Details on command line options for sidekiq can be seen here: https://github.com/mperham/sidekiq/wiki/Advanced-Options

Created by: diazruy

See https://github.com/mperham/sidekiq/blob/master/examples/config.yml

By Administrator on 2013-02-19T01:59:01 (imported from GitLab)

Created by: dzaporozhets

Basically its feature request so please use Feedback forum.

By Administrator on 2013-02-26T08:03:22 (imported from GitLab)

Created by: jeffutter

Sure. I've created a post in the Feedback Forum here: http://gitlab.uservoice.com/forums/176466-general/suggestions/3693339-ability-to-configure-sidekiq-concurrency in case anyone finds this issue and wants to contribute.

I still, however feel this is partially a 'bug'. The default behavior (25 threads) brings my memory constrained VPS to it's knees.

By Administrator on 2013-02-26T15:43:36 (imported from GitLab)

Created by: voidzero

Same problems here.... sidekiq uses too much memory. Did you ever solve it, @jeffutter?

By Administrator on 2013-12-17T20:46:51 (imported from GitLab)

Created by: jeffutter

I just edit the rake task and change it to -c 2 or whatever. It helps a little i still find sidekiq using 800+mb of virtual memory (as reported by top) on a 1gig vps. I agree that seems like far too much for sidekiq tasks but I just deal with it anyway.

By Administrator on 2013-12-17T23:18:05 (imported from GitLab)

Created by: OptimusCrime

@jeffutter : This comes from a total noob, what file do I edit to change this? I can't find it anywhere in the gitlab-directories.

By Administrator on 2013-12-20T16:26:30 (imported from GitLab)

Created by: jeffutter

https://github.com/gitlabhq/gitlabhq/blob/master/script/background_jobs#L35

By Administrator on 2013-12-20T16:30:34 (imported from GitLab)

Created by: zzjin

you can simply touch one file under config dir with name sidekiq.yml, and put :concurrency: in it. such as:

---
:concurrency: 5

when server restarted every thing goes ok.

By Administrator on 2015-02-04T10:20:38 (imported from GitLab)