GitLab 8.0 migration issues with GitLab CI Multi Runner
I don't know whether this is specific to our use of GitLab CI Multi Runner. However I report the issues here for completeness, with reference to #804 (closed) and #2648
We were also seeing the following in /var/log/syslog
:
WARN[0347] 33ba87b6 13 Submitting build to coordinator... failed
along with some 404 errors in sudo gitlab-ctl tail
, and the build logs from old builds were not visible via GitLab's new CI interface.
The problems were ultimately fixed by three things, but two issues remain (see further down)
Fix 1 (incomplete)
As suggested in this comment I needed to modify (by hand for now) /var/opt/gitlab/nginx/conf/nginx.conf
to include:
include /Storage/gitlab/opt/nginx/conf/gitlab-ci-http.conf;
Fix 2
Seems the old build logs didn't get put in place
sudo cp -rp /var/opt/gitlab/gitlab-ci/builds.1443028350/* /var/opt/gitlab/gitlab-ci/builds
Fix 3
And then permissions were incorrect:
sudo chown -R git:root /var/opt/gitlab/gitlab-ci/builds
Then restart everything.
Remaining issues
Two issues remain however:
- Fix 1 is a manual 'hack' for now - is this the right fix?
- We are seeing these entries in
sudo gitlab-ctl tail
:
==> /var/log/gitlab/gitlab-rails/production.log <==
Started POST "/ci//api/v1/builds/register.json" for 127.0.0.1 at 2015-09-23 21:00:40 +0000
==> /var/log/gitlab/nginx/gitlab_ci_access.log <==
172.31.39.78 - - [23/Sep/2015:21:00:40 +0000] "POST //api/v1/builds/register.json HTTP/1.1" 404 58 "-" "Go 1.1 package http"
==> /var/log/gitlab/nginx/gitlab_access.log <==
172.31.39.78 - - [23/Sep/2015:21:00:40 +0000] "POST /ci//api/v1/builds/register.json HTTP/1.0" 404 47 "-" "Go 1.1 package http"
I don't know where these errors are coming from, because CI builds are now 'working'. But clearly something is not right...
Any thoughts?