Skip to content
Snippets Groups Projects
  1. Mar 18, 2020
  2. Mar 17, 2020
  3. Oct 02, 2019
  4. Feb 28, 2019
  5. Oct 21, 2016
    • Yorick Peterse's avatar
      Re-organize queues to use for Sidekiq · 97731760
      Yorick Peterse authored
      Dumping too many jobs in the same queue (e.g. the "default" queue) is a
      dangerous setup. Jobs that take a long time to process can effectively
      block any other work from being performed given there are enough of
      these jobs.
      
      Furthermore it becomes harder to monitor the jobs as a single queue
      could contain jobs for different workers. In such a setup the only
      reliable way of getting counts per job is to iterate over all jobs in a
      queue, which is a rather time consuming process.
      
      By using separate queues for various workers we have better control over
      throughput, we can add weight to queues, and we can monitor queues
      better. Some workers still use the same queue whenever their work is
      related. For example, the various CI pipeline workers use the same
      "pipeline" queue.
      
      This commit includes a Rails migration that moves Sidekiq jobs from the
      old queues to the new ones. This migration also takes care of doing the
      inverse if ever needed. This does require downtime as otherwise new jobs
      could be scheduled in the old queues after this migration completes.
      
      This commit also includes an RSpec test that blacklists the use of the
      "default" queue and ensures cron workers use the "cronjob" queue.
      
      Fixes gitlab-org/gitlab-ce#23370
      Unverified
      97731760
  6. Apr 28, 2016
    • Jacob Vosmaer (GitLab)'s avatar
      Use 'exec' in Unicorn and Sidekiq launch scripts · 8a6776ca
      Jacob Vosmaer (GitLab) authored
      When running Unicorn or Sidekiq in the foreground this change removes
      an intermediate /bin/sh process. This makes process supervision in the
      GitLab Development Kit more reliable.
      
      This change does not affect Omnibus-GitLab (because there we do not
      use these launch scripts). Installations from source do use the launch
      scripts but for the standard GitLab init script this change will not
      make a difference.
      
      Custom installations using Upstart or Systemd may be affected however,
      because under certain configurations these systems count exactly how
      many forks happen during process startup, and we are reducing that
      number by one here.
      8a6776ca
  7. Jan 15, 2016
  8. Jan 14, 2016
  9. Dec 03, 2015
  10. Aug 26, 2015
  11. Aug 19, 2015
  12. Apr 01, 2015
  13. Sep 10, 2014
  14. Sep 08, 2014
  15. Jul 04, 2014
  16. Jun 12, 2014
  17. May 27, 2014
  18. Apr 01, 2014
  19. Mar 20, 2014
  20. Feb 10, 2014
  21. Oct 22, 2013
  22. Oct 15, 2013
Loading