Upgrade Reconfigure Failure and Possible Solution
Summary: Upgrade to 7.13.5 failed on gitlab-ctl reconfigure
.
Steps to Reproduce:
- Update gitlab-ce using yum.
- Run
gitlab-ctl reconfigure
with root access. (using sudo or logging in as root seems to have no effect) - See following error message below.
Expected Behavior: gitlab-ctl reconfigure
completes successfully.
Observed Behavior: gitlab-ctl reconfigure
fails. Web UI unreachable.
Relevant logs and/or screenshots:
[root@gitlab ~]# gitlab-ctl reconfigure
Starting Chef Client, version 12.4.0.rc.2
resolving cookbooks for run list: ["gitlab"]
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T11:58:22-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
Synchronizing Cookbooks:
- gitlab
- package
- runit
Compiling Cookbooks...
Recipe: gitlab::default
* directory[/etc/gitlab] action create (up to date)
[2015-08-17T11:58:22-04:00] WARN: Cloning resource attributes for directory[/var/opt/gitlab] from prior resource (CHEF-3694)
[2015-08-17T11:58:22-04:00] WARN: Previous directory[/var/opt/gitlab]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/default.rb:43:in `from_file'
[2015-08-17T11:58:22-04:00] WARN: Current directory[/var/opt/gitlab]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/users.rb:23:in `from_file'
[2015-08-17T11:58:23-04:00] WARN: Cloning resource attributes for cron[gitlab-ci schedule builds] from prior resource (CHEF-3694)
[2015-08-17T11:58:23-04:00] WARN: Previous cron[gitlab-ci schedule builds]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/cron.rb:19:in `from_file'
[2015-08-17T11:58:23-04:00] WARN: Current cron[gitlab-ci schedule builds]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/cron.rb:24:in `from_file'
/sbin/init: unrecognized option '--version'
-.mount loaded active mounted /
[2015-08-17T11:58:23-04:00] WARN: Selected systemd because systemctl shows .mount units
[2015-08-17T11:58:24-04:00] WARN: Cloning resource attributes for directory[/var/opt/gitlab/gitlab-rails/etc] from prior resource (CHEF-3694)
[2015-08-17T11:58:24-04:00] WARN: Previous directory[/var/opt/gitlab/gitlab-rails/etc]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/gitlab-rails.rb:41:in `block in from_file'
[2015-08-17T11:58:24-04:00] WARN: Current directory[/var/opt/gitlab/gitlab-rails/etc]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/definitions/unicorn_config.rb:21:in `block in from_file'
[2015-08-17T11:58:24-04:00] WARN: Cloning resource attributes for service[unicorn] from prior resource (CHEF-3694)
[2015-08-17T11:58:24-04:00] WARN: Previous service[unicorn]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/default.rb:88:in `block in from_file'
[2015-08-17T11:58:24-04:00] WARN: Current service[unicorn]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/runit/definitions/runit_service.rb:191:in `block in from_file'
[2015-08-17T11:58:24-04:00] WARN: Cloning resource attributes for execute[sysctl] from prior resource (CHEF-3694)
[2015-08-17T11:58:24-04:00] WARN: Previous execute[sysctl]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/postgresql.rb:84:in `from_file'
[2015-08-17T11:58:24-04:00] WARN: Current execute[sysctl]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/unicorn.rb:39:in `from_file'
[2015-08-17T11:58:24-04:00] WARN: Cloning resource attributes for service[sidekiq] from prior resource (CHEF-3694)
[2015-08-17T11:58:24-04:00] WARN: Previous service[sidekiq]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/default.rb:88:in `block in from_file'
[2015-08-17T11:58:24-04:00] WARN: Current service[sidekiq]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/runit/definitions/runit_service.rb:191:in `block in from_file'
Converging 202 resources
* directory[/etc/gitlab] action nothing (skipped due to action :nothing)
* directory[/var/opt/gitlab] action create (up to date)
* directory[/opt/gitlab/embedded/etc] action create (up to date)
* template[/opt/gitlab/embedded/etc/gitconfig] action create (up to date)
Recipe: gitlab::web-server
* group[gitlab-www] action create (up to date)
* user[gitlab-www] action create (up to date)
Recipe: gitlab::users
* directory[/var/opt/gitlab] action create (up to date)
* group[git] action create (up to date)
* user[git] action create (up to date)
* template[/var/opt/gitlab/.gitconfig] action create (up to date)
Recipe: gitlab::gitlab-shell
* directory[/var/opt/gitlab/git-data/repositories] action create (up to date)
* directory[/var/opt/gitlab/.ssh] action create (up to date)
* file[/var/opt/gitlab/.ssh/authorized_keys] action create (up to date)
* file[/opt/gitlab/embedded/service/gitlab-shell/authorized_keys.lock] action create (up to date)
* execute[chcon --recursive --type ssh_home_t /var/opt/gitlab/.ssh] action run
- execute chcon --recursive --type ssh_home_t /var/opt/gitlab/.ssh
* directory[/var/log/gitlab/gitlab-shell/] action create (up to date)
* directory[/var/opt/gitlab/gitlab-shell] action create (up to date)
* directory[/var/opt/gitlab/git-data] action create (up to date)
* template[/var/opt/gitlab/gitlab-shell/config.yml] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-shell/config.yml] action create (up to date)
* template[/var/opt/gitlab/gitlab-shell/gitlab_shell_secret] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-shell/.gitlab_shell_secret] action create (up to date)
Recipe: gitlab::gitlab-rails
* directory[/var/opt/gitlab/gitlab-rails/etc] action create (up to date)
* directory[/opt/gitlab/etc/gitlab-rails] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails/working] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails/tmp] action create (up to date)
* directory[/var/opt/gitlab/backups] action create (up to date)
* directory[/var/log/gitlab/gitlab-rails] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails/uploads] action create (up to date)
* template[/opt/gitlab/etc/gitlab-rails/gitlab-rails-rc] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/config.ru] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config.ru] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/secret] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/.secret] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/database.yml] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/database.yml] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/resque.yml] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/resque.yml] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/aws.yml] action delete (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/aws.yml] action delete (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/smtp_settings.rb] action delete (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/initializers/smtp_settings.rb] action delete (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/gitlab.yml] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/gitlab.yml] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/rack_attack.rb] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/initializers/rack_attack.rb] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret] action create (up to date)
* directory[/var/opt/gitlab/git-data/gitlab-satellites] action create (up to date)
* directory[/opt/gitlab/etc/gitlab-rails/env] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/HOME] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/RAILS_ENV] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/SIDEKIQ_MEMORY_KILLER_MAX_RSS] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/BUNDLE_GEMFILE] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/PATH] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/tmp] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/public/uploads] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/log] action create (up to date)
* link[/var/log/gitlab/gitlab-rails/sidekiq.log] action create (skipped due to not_if)
* file[/opt/gitlab/embedded/service/gitlab-rails/db/schema.rb] action create (up to date)
* remote_file[/var/opt/gitlab/gitlab-rails/VERSION] action create (up to date)
* execute[chown -R root:root /opt/gitlab/embedded/service/gitlab-rails/public] action run
- execute chown -R root:root /opt/gitlab/embedded/service/gitlab-rails/public
* execute[clear the gitlab-rails cache] action nothing (skipped due to action :nothing)
Recipe: gitlab::selinux
* execute[semodule -i /opt/gitlab/embedded/selinux/rhel/7/gitlab-7.2.0-ssh-keygen.pp] action run (skipped due to not_if)
Recipe: gitlab::cron
* cron[gitlab-ci schedule builds] action delete (up to date)
* cron[gitlab-ci schedule builds] action delete (up to date)
Recipe: gitlab::default
* service[unicorn] action nothing (skipped due to action :nothing)
* service[ci-unicorn] action nothing (skipped due to action :nothing)
* service[sidekiq] action nothing (skipped due to action :nothing)
* service[ci-sidekiq] action nothing (skipped due to action :nothing)
Recipe: runit::systemd
* directory[/usr/lib/systemd/system] action create (up to date)
* cookbook_file[/usr/lib/systemd/system/gitlab-runsvdir.service] action create (up to date)
* file[/etc/systemd/system/default.target.wants/gitlab-runsvdir.service] action delete (up to date)
* execute[systemctl daemon-reload] action nothing (skipped due to action :nothing)
* execute[systemctl enable gitlab-runsvdir] action nothing (skipped due to action :nothing)
* execute[systemctl start gitlab-runsvdir] action nothing (skipped due to action :nothing)
Recipe: gitlab::redis
* group[gitlab-redis] action create (up to date)
* user[gitlab-redis] action create (up to date)
* directory[/var/opt/gitlab/redis] action create (up to date)
* directory[/var/log/gitlab/redis] action create (up to date)
* template[/var/opt/gitlab/redis/redis.conf] action create (up to date)
* directory[/opt/gitlab/sv/redis] action create (up to date)
* directory[/opt/gitlab/sv/redis/log] action create (up to date)
* directory[/opt/gitlab/sv/redis/log/main] action create (up to date)
* template[/opt/gitlab/sv/redis/run] action create (up to date)
* template[/opt/gitlab/sv/redis/log/run] action create (up to date)
* template[/var/log/gitlab/redis/config] action create (up to date)
* ruby_block[reload redis svlogd configuration] action nothing (skipped due to action :nothing)
* file[/opt/gitlab/sv/redis/down] action delete (up to date)
* link[/opt/gitlab/init/redis] action create (up to date)
* link[/opt/gitlab/service/redis] action create (up to date)
* ruby_block[supervise_redis_sleep] action run (skipped due to not_if)
* service[redis] action nothing (skipped due to action :nothing)
Recipe: gitlab::ci-redis_disable
* link[/opt/gitlab/service/ci-redis] action delete (up to date)
Recipe: gitlab::postgresql
* group[gitlab-psql] action create (up to date)
* user[gitlab-psql] action create (up to date)
* directory[/var/opt/gitlab/postgresql] action create (up to date)
* directory[/var/opt/gitlab/postgresql/data] action create (up to date)
* directory[/var/log/gitlab/postgresql] action create (up to date)
* link[/var/opt/gitlab/postgresql/data] action create (skipped due to not_if)
* file[/var/opt/gitlab/postgresql/.profile] action create (up to date)
* execute[sysctl] action nothing (skipped due to action :nothing)
* bash[add shm settings] action run
- execute "bash" "/tmp/chef-script20150817-19683-1ly17s9"
Recipe: gitlab::unicorn
* execute[sysctl] action run
================================================================================
Error executing action `run` on resource 'execute[sysctl]'
================================================================================
Mixlib::ShellOut::ShellCommandFailed
------------------------------------
Expected process to exit with [0], but received '255'
---- Begin output of /sbin/sysctl -p /etc/sysctl.conf ----
STDOUT: kernel.randomize_va_space = 2
net.ipv4.ip_forward = 0
net.ipv4.conf.all.send_redirects = 0
net.ipv4.conf.default.send_redirects = 0
net.ipv4.conf.all.accept_source_route = 0
net.ipv4.conf.default.accept_source_route = 0
net.ipv4.conf.all.accept_redirects = 0
net.ipv4.conf.default.accept_redirects = 0
net.ipv4.conf.all.secure_redirects = 0
net.ipv4.conf.default.secure_redirects = 0
net.ipv4.conf.all.log_martians = 1
net.ipv4.conf.default.log_martians = 1
net.ipv4.icmp_echo_ignore_broadcasts = 1
net.ipv4.icmp_ignore_bogus_error_responses = 1
net.ipv4.conf.all.rp_filter = 1
net.ipv4.conf.default.rp_filter = 1
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_timestamps = 0
net.ipv4.conf.all.forwarding = 0
kernel.shmall = 4194304
kernel.shmmax = 17179869184
kernel.shmall = 4194304
STDERR: sysctl: cannot stat /proc/sys/kernel/exec-shield: No such file or directory
---- End output of /sbin/sysctl -p /etc/sysctl.conf ----
Ran /sbin/sysctl -p /etc/sysctl.conf returned 255
Resource Declaration:
---------------------
# In /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/unicorn.rb
39: execute "sysctl" do
40: command "/sbin/sysctl -p /etc/sysctl.conf"
41: action :nothing
42: end
43:
Compiled Resource:
------------------
# Declared in /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/unicorn.rb:39:in `from_file'
execute("sysctl") do
action :nothing
retries 0
retry_delay 2
default_guard_interpreter :execute
command "/sbin/sysctl -p /etc/sysctl.conf"
backup 5
returns 0
declared_type :execute
cookbook_name "gitlab"
recipe_name "unicorn"
end
Running handlers:
[2015-08-17T11:58:28-04:00] ERROR: Running exception handlers
Running handlers complete
[2015-08-17T11:58:28-04:00] ERROR: Exception handlers complete
Chef Client failed. 3 resources updated in 8.00574845 seconds
[2015-08-17T11:58:29-04:00] FATAL: Stacktrace dumped to /opt/gitlab/embedded/cookbooks/cache/chef-stacktrace.out
[2015-08-17T11:58:29-04:00] ERROR: Found 1 errors, they are stored in the backtrace
[2015-08-17T11:58:31-04:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)
Output of Checks: n/a. Could not run.
Possible Fixes: The following fix worked for my platform (RHEL 7 x86_64).
- Edit the following files:
/opt/gitlab/embedded/cookbooks/gitlab/recipes/postgresql.rb
/opt/gitlab/embedded/cookbooks/gitlab/recipes/unicorn.rb
- For every instance of
/sbin/sysctl -p /etc/sysctl.conf
, replace it with/sbin/sysctl -e -p /etc/sysctl.conf
. Note the change in flags. There was one occurrence in each file. - Run
gitlab-ctl reconfigure
. It finishes successfully and the Web UI works again. Output attached below.
Note: Using the '-e' flag for sysctl will ignore unknown variable errors. Not sure of implications of this toward other aspects of the program.
[root@gitlab ~]# gitlab-ctl reconfigure
Starting Chef Client, version 12.4.0.rc.2
resolving cookbooks for run list: ["gitlab"]
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:25-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:26-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:26-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
[2015-08-17T12:03:26-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
Synchronizing Cookbooks:
[2015-08-17T12:03:26-04:00] WARN: Cookbook 'local-mode-cache' is empty or entirely chefignored at /opt/gitlab/embedded/cookbooks/local-mode-cache
- runit
- package
- gitlab
Compiling Cookbooks...
Recipe: gitlab::default
* directory[/etc/gitlab] action create (up to date)
[2015-08-17T12:03:26-04:00] WARN: Cloning resource attributes for directory[/var/opt/gitlab] from prior resource (CHEF-3694)
[2015-08-17T12:03:26-04:00] WARN: Previous directory[/var/opt/gitlab]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/default.rb:43:in `from_file'
[2015-08-17T12:03:26-04:00] WARN: Current directory[/var/opt/gitlab]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/users.rb:23:in `from_file'
[2015-08-17T12:03:26-04:00] WARN: Cloning resource attributes for cron[gitlab-ci schedule builds] from prior resource (CHEF-3694)
[2015-08-17T12:03:26-04:00] WARN: Previous cron[gitlab-ci schedule builds]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/cron.rb:19:in `from_file'
[2015-08-17T12:03:26-04:00] WARN: Current cron[gitlab-ci schedule builds]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/cron.rb:24:in `from_file'
/sbin/init: unrecognized option '--version'
-.mount loaded active mounted /
[2015-08-17T12:03:26-04:00] WARN: Selected systemd because systemctl shows .mount units
[2015-08-17T12:03:27-04:00] WARN: Cloning resource attributes for directory[/var/opt/gitlab/gitlab-rails/etc] from prior resource (CHEF-3694)
[2015-08-17T12:03:27-04:00] WARN: Previous directory[/var/opt/gitlab/gitlab-rails/etc]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/gitlab-rails.rb:41:in `block in from_file'
[2015-08-17T12:03:27-04:00] WARN: Current directory[/var/opt/gitlab/gitlab-rails/etc]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/definitions/unicorn_config.rb:21:in `block in from_file'
[2015-08-17T12:03:27-04:00] WARN: Cloning resource attributes for service[unicorn] from prior resource (CHEF-3694)
[2015-08-17T12:03:27-04:00] WARN: Previous service[unicorn]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/default.rb:88:in `block in from_file'
[2015-08-17T12:03:27-04:00] WARN: Current service[unicorn]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/runit/definitions/runit_service.rb:191:in `block in from_file'
[2015-08-17T12:03:27-04:00] WARN: Cloning resource attributes for execute[sysctl] from prior resource (CHEF-3694)
[2015-08-17T12:03:27-04:00] WARN: Previous execute[sysctl]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/postgresql.rb:84:in `from_file'
[2015-08-17T12:03:27-04:00] WARN: Current execute[sysctl]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/unicorn.rb:39:in `from_file'
[2015-08-17T12:03:27-04:00] WARN: Cloning resource attributes for service[sidekiq] from prior resource (CHEF-3694)
[2015-08-17T12:03:27-04:00] WARN: Previous service[sidekiq]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/default.rb:88:in `block in from_file'
[2015-08-17T12:03:27-04:00] WARN: Current service[sidekiq]: /opt/gitlab/embedded/cookbooks/cache/cookbooks/runit/definitions/runit_service.rb:191:in `block in from_file'
Converging 202 resources
* directory[/etc/gitlab] action nothing (skipped due to action :nothing)
* directory[/var/opt/gitlab] action create (up to date)
* directory[/opt/gitlab/embedded/etc] action create (up to date)
* template[/opt/gitlab/embedded/etc/gitconfig] action create (up to date)
Recipe: gitlab::web-server
* group[gitlab-www] action create (up to date)
* user[gitlab-www] action create (up to date)
Recipe: gitlab::users
* directory[/var/opt/gitlab] action create (up to date)
* group[git] action create (up to date)
* user[git] action create (up to date)
* template[/var/opt/gitlab/.gitconfig] action create (up to date)
Recipe: gitlab::gitlab-shell
* directory[/var/opt/gitlab/git-data/repositories] action create (up to date)
* directory[/var/opt/gitlab/.ssh] action create (up to date)
* file[/var/opt/gitlab/.ssh/authorized_keys] action create (up to date)
* file[/opt/gitlab/embedded/service/gitlab-shell/authorized_keys.lock] action create (up to date)
* execute[chcon --recursive --type ssh_home_t /var/opt/gitlab/.ssh] action run
- execute chcon --recursive --type ssh_home_t /var/opt/gitlab/.ssh
* directory[/var/log/gitlab/gitlab-shell/] action create (up to date)
* directory[/var/opt/gitlab/gitlab-shell] action create (up to date)
* directory[/var/opt/gitlab/git-data] action create (up to date)
* template[/var/opt/gitlab/gitlab-shell/config.yml] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-shell/config.yml] action create (up to date)
* template[/var/opt/gitlab/gitlab-shell/gitlab_shell_secret] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-shell/.gitlab_shell_secret] action create (up to date)
Recipe: gitlab::gitlab-rails
* directory[/var/opt/gitlab/gitlab-rails/etc] action create (up to date)
* directory[/opt/gitlab/etc/gitlab-rails] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails/working] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails/tmp] action create (up to date)
* directory[/var/opt/gitlab/backups] action create (up to date)
* directory[/var/log/gitlab/gitlab-rails] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails/uploads] action create (up to date)
* template[/opt/gitlab/etc/gitlab-rails/gitlab-rails-rc] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/config.ru] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config.ru] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/secret] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/.secret] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/database.yml] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/database.yml] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/resque.yml] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/resque.yml] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/aws.yml] action delete (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/aws.yml] action delete (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/smtp_settings.rb] action delete (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/initializers/smtp_settings.rb] action delete (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/gitlab.yml] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/gitlab.yml] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/rack_attack.rb] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/config/initializers/rack_attack.rb] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret] action create (up to date)
* directory[/var/opt/gitlab/git-data/gitlab-satellites] action create (up to date)
* directory[/opt/gitlab/etc/gitlab-rails/env] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/HOME] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/RAILS_ENV] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/SIDEKIQ_MEMORY_KILLER_MAX_RSS] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/BUNDLE_GEMFILE] action create (up to date)
* file[/opt/gitlab/etc/gitlab-rails/env/PATH] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/tmp] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/public/uploads] action create (up to date)
* link[/opt/gitlab/embedded/service/gitlab-rails/log] action create (up to date)
* link[/var/log/gitlab/gitlab-rails/sidekiq.log] action create (skipped due to not_if)
* file[/opt/gitlab/embedded/service/gitlab-rails/db/schema.rb] action create (up to date)
* remote_file[/var/opt/gitlab/gitlab-rails/VERSION] action create (up to date)
* execute[chown -R root:root /opt/gitlab/embedded/service/gitlab-rails/public] action run
- execute chown -R root:root /opt/gitlab/embedded/service/gitlab-rails/public
* execute[clear the gitlab-rails cache] action nothing (skipped due to action :nothing)
Recipe: gitlab::selinux
* execute[semodule -i /opt/gitlab/embedded/selinux/rhel/7/gitlab-7.2.0-ssh-keygen.pp] action run (skipped due to not_if)
Recipe: gitlab::cron
* cron[gitlab-ci schedule builds] action delete (up to date)
* cron[gitlab-ci schedule builds] action delete (up to date)
Recipe: gitlab::default
* service[unicorn] action nothing (skipped due to action :nothing)
* service[ci-unicorn] action nothing (skipped due to action :nothing)
* service[sidekiq] action nothing (skipped due to action :nothing)
* service[ci-sidekiq] action nothing (skipped due to action :nothing)
Recipe: runit::systemd
* directory[/usr/lib/systemd/system] action create (up to date)
* cookbook_file[/usr/lib/systemd/system/gitlab-runsvdir.service] action create (up to date)
* file[/etc/systemd/system/default.target.wants/gitlab-runsvdir.service] action delete (up to date)
* execute[systemctl daemon-reload] action nothing (skipped due to action :nothing)
* execute[systemctl enable gitlab-runsvdir] action nothing (skipped due to action :nothing)
* execute[systemctl start gitlab-runsvdir] action nothing (skipped due to action :nothing)
Recipe: gitlab::redis
* group[gitlab-redis] action create (up to date)
* user[gitlab-redis] action create (up to date)
* directory[/var/opt/gitlab/redis] action create (up to date)
* directory[/var/log/gitlab/redis] action create (up to date)
* template[/var/opt/gitlab/redis/redis.conf] action create (up to date)
* directory[/opt/gitlab/sv/redis] action create (up to date)
* directory[/opt/gitlab/sv/redis/log] action create (up to date)
* directory[/opt/gitlab/sv/redis/log/main] action create (up to date)
* template[/opt/gitlab/sv/redis/run] action create (up to date)
* template[/opt/gitlab/sv/redis/log/run] action create (up to date)
* template[/var/log/gitlab/redis/config] action create (up to date)
* ruby_block[reload redis svlogd configuration] action nothing (skipped due to action :nothing)
* file[/opt/gitlab/sv/redis/down] action delete (up to date)
* link[/opt/gitlab/init/redis] action create (up to date)
* link[/opt/gitlab/service/redis] action create (up to date)
* ruby_block[supervise_redis_sleep] action run (skipped due to not_if)
* service[redis] action nothing (skipped due to action :nothing)
Recipe: gitlab::ci-redis_disable
* link[/opt/gitlab/service/ci-redis] action delete (up to date)
Recipe: gitlab::postgresql
* group[gitlab-psql] action create (up to date)
* user[gitlab-psql] action create (up to date)
* directory[/var/opt/gitlab/postgresql] action create (up to date)
* directory[/var/opt/gitlab/postgresql/data] action create (up to date)
* directory[/var/log/gitlab/postgresql] action create (up to date)
* link[/var/opt/gitlab/postgresql/data] action create (skipped due to not_if)
* file[/var/opt/gitlab/postgresql/.profile] action create (up to date)
* execute[sysctl] action nothing (skipped due to action :nothing)
* bash[add shm settings] action run (skipped due to not_if)
* execute[/opt/gitlab/embedded/bin/initdb -D /var/opt/gitlab/postgresql/data -E UTF8] action run (skipped due to not_if)
* template[/var/opt/gitlab/postgresql/data/postgresql.conf] action create (up to date)
* template[/var/opt/gitlab/postgresql/data/pg_hba.conf] action create (up to date)
* template[/var/opt/gitlab/postgresql/data/pg_ident.conf] action create (up to date)
* directory[/opt/gitlab/sv/postgresql] action create (up to date)
* directory[/opt/gitlab/sv/postgresql/log] action create (up to date)
* directory[/opt/gitlab/sv/postgresql/log/main] action create (up to date)
* template[/opt/gitlab/sv/postgresql/run] action create (up to date)
* template[/opt/gitlab/sv/postgresql/log/run] action create (up to date)
* template[/var/log/gitlab/postgresql/config] action create (up to date)
* ruby_block[reload postgresql svlogd configuration] action nothing (skipped due to action :nothing)
* file[/opt/gitlab/sv/postgresql/down] action delete (up to date)
* directory[/opt/gitlab/sv/postgresql/control] action create (up to date)
* template[/opt/gitlab/sv/postgresql/control/t] action create (up to date)
* link[/opt/gitlab/init/postgresql] action create (up to date)
* link[/opt/gitlab/service/postgresql] action create (up to date)
* ruby_block[supervise_postgresql_sleep] action run (skipped due to not_if)
* service[postgresql] action nothing (skipped due to action :nothing)
* execute[create gitlab database user] action run (skipped due to not_if)
* execute[create gitlabhq_production database] action run (skipped due to not_if)
Recipe: gitlab::unicorn
* directory[/var/log/gitlab/unicorn] action create (up to date)
* directory[/opt/gitlab/var/unicorn] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails/sockets] action create (up to date)
* directory[/var/opt/gitlab/gitlab-rails/etc] action create (up to date)
* template[/var/opt/gitlab/gitlab-rails/etc/unicorn.rb] action create (up to date)
* directory[/opt/gitlab/sv/unicorn] action create (up to date)
* directory[/opt/gitlab/sv/unicorn/log] action create (up to date)
* directory[/opt/gitlab/sv/unicorn/log/main] action create (up to date)
* template[/opt/gitlab/sv/unicorn/run] action create (up to date)
* template[/opt/gitlab/sv/unicorn/log/run] action create (up to date)
* template[/var/log/gitlab/unicorn/config] action create (up to date)
* ruby_block[reload unicorn svlogd configuration] action nothing (skipped due to action :nothing)
* file[/opt/gitlab/sv/unicorn/down] action delete (up to date)
* link[/opt/gitlab/init/unicorn] action create (up to date)
* link[/opt/gitlab/service/unicorn] action create (up to date)
* ruby_block[supervise_unicorn_sleep] action run (skipped due to not_if)
* service[unicorn] action nothing (skipped due to action :nothing)
* execute[sysctl] action nothing (skipped due to action :nothing)
* bash[add somaxconn settings] action run (skipped due to not_if)
Recipe: gitlab::ci-unicorn_disable
* link[/opt/gitlab/service/ci-unicorn] action delete (up to date)
Recipe: gitlab::sidekiq
* directory[/var/log/gitlab/sidekiq] action create (up to date)
* directory[/opt/gitlab/sv/sidekiq] action create (up to date)
* directory[/opt/gitlab/sv/sidekiq/log] action create (up to date)
* directory[/opt/gitlab/sv/sidekiq/log/main] action create (up to date)
* template[/opt/gitlab/sv/sidekiq/run] action create (up to date)
* template[/opt/gitlab/sv/sidekiq/log/run] action create (up to date)
* template[/var/log/gitlab/sidekiq/config] action create (up to date)
* ruby_block[reload sidekiq svlogd configuration] action nothing (skipped due to action :nothing)
* file[/opt/gitlab/sv/sidekiq/down] action delete (up to date)
* link[/opt/gitlab/init/sidekiq] action create (up to date)
* link[/opt/gitlab/service/sidekiq] action create (up to date)
* ruby_block[supervise_sidekiq_sleep] action run (skipped due to not_if)
* service[sidekiq] action nothing (skipped due to action :nothing)
Recipe: gitlab::ci-sidekiq_disable
* link[/opt/gitlab/service/ci-sidekiq] action delete (up to date)
Recipe: gitlab::nginx
* directory[/var/opt/gitlab/nginx] action create (up to date)
* directory[/var/opt/gitlab/nginx/conf] action create (up to date)
* directory[/var/log/gitlab/nginx] action create (up to date)
* link[/var/opt/gitlab/nginx/logs] action create (up to date)
* template[/var/opt/gitlab/nginx/conf/gitlab-http.conf] action create (up to date)
* template[/var/opt/gitlab/nginx/conf/gitlab-ci-http.conf] action delete (up to date)
* template[/var/opt/gitlab/nginx/conf/nginx.conf] action create (up to date)
* directory[/opt/gitlab/sv/nginx] action create (up to date)
* directory[/opt/gitlab/sv/nginx/log] action create (up to date)
* directory[/opt/gitlab/sv/nginx/log/main] action create (up to date)
* template[/opt/gitlab/sv/nginx/run] action create (up to date)
* template[/opt/gitlab/sv/nginx/log/run] action create (up to date)
* template[/var/log/gitlab/nginx/config] action create (up to date)
* ruby_block[reload nginx svlogd configuration] action nothing (skipped due to action :nothing)
* file[/opt/gitlab/sv/nginx/down] action delete (up to date)
* link[/opt/gitlab/init/nginx] action create (up to date)
* link[/opt/gitlab/service/nginx] action create (up to date)
* ruby_block[supervise_nginx_sleep] action run (skipped due to not_if)
* service[nginx] action nothing (skipped due to action :nothing)
Recipe: gitlab::remote-syslog_disable
* link[/opt/gitlab/service/remote-syslog] action delete (up to date)
Recipe: gitlab::logrotate
* directory[/var/opt/gitlab/logrotate] action create (up to date)
* directory[/var/opt/gitlab/logrotate/logrotate.d] action create (up to date)
* directory[/var/log/gitlab/logrotate] action create (up to date)
* template[/var/opt/gitlab/logrotate/logrotate.conf] action create (up to date)
* template[/var/opt/gitlab/logrotate/logrotate.d/nginx] action create (up to date)
* template[/var/opt/gitlab/logrotate/logrotate.d/unicorn] action create (up to date)
* template[/var/opt/gitlab/logrotate/logrotate.d/gitlab-rails] action create (up to date)
* template[/var/opt/gitlab/logrotate/logrotate.d/gitlab-shell] action create (up to date)
* template[/var/opt/gitlab/logrotate/logrotate.d/gitlab-ci] action create (up to date)
* directory[/opt/gitlab/sv/logrotate] action create (up to date)
* directory[/opt/gitlab/sv/logrotate/log] action create (up to date)
* directory[/opt/gitlab/sv/logrotate/log/main] action create (up to date)
* template[/opt/gitlab/sv/logrotate/run] action create (up to date)
* template[/opt/gitlab/sv/logrotate/log/run] action create (up to date)
* template[/var/log/gitlab/logrotate/config] action create (up to date)
* ruby_block[reload logrotate svlogd configuration] action nothing (skipped due to action :nothing)
* file[/opt/gitlab/sv/logrotate/down] action delete (up to date)
* link[/opt/gitlab/init/logrotate] action create (up to date)
* link[/opt/gitlab/service/logrotate] action create (up to date)
* ruby_block[supervise_logrotate_sleep] action run (skipped due to not_if)
* service[logrotate] action nothing (skipped due to action :nothing)
Recipe: gitlab::database_migrations
* execute[initialize gitlab-rails database] action nothing (skipped due to action :nothing)
* execute[initialize gitlab-ci database] action nothing (skipped due to action :nothing)
* bash[migrate gitlab-rails database] action nothing (skipped due to action :nothing)
* bash[migrate gitlab-ci database] action nothing (skipped due to action :nothing)
Running handlers:
Running handlers complete
Chef Client finished, 2/162 resources updated in 7.681953737 seconds
gitlab Reconfigured!