docker gitlab-runner alpine-v10+ cannot download artifacts from previous stage

Summary

Using gitlab/gitlab-runner:alpine (tested v10.0.0 and v10.0.1) in docker with docker executor the runner cannot download artifacts from the previous stage. This works with alpine-v9.5.0

Steps to reproduce

1. Have 2 stages
2. Stage 1 uploads artifacts (e.g. build)
3. Stage 2 should use artifacts from stage 1 (e.g deploy)

Actual behavior

1. Stage 1 (build) successfully uploads artifacts
2. Stage 2 (deploy) reports Missing /usr/bin/gitlab-runner-helper. Artifacts downloading is disabled. when downloading artifacts.

Expected behavior

Stage 2 (deploy) should be able to download artifacts from Stage 1 (build)

Relevant logs and/or screenshots

From alpine-v10.0.1 (fails)

Running with gitlab-runner 10.0.1 (e991d1b4)
  on staging_80 (de8140fa)
Using Docker executor with image docker:latest ...
Starting service lordgaav/dind-options:latest ...
Pulling docker image lordgaav/dind-options:latest ...
Using docker image lordgaav/dind-options:latest ID=sha256:92fc5995e152877f79c025028d5f94be85f295cbe3860ec33cfe6228390689b8 for lordgaav/dind-options service...
Waiting for services to be up and running...
Using docker image sha256:7392378af7ede5394e6a7ca268f9bbced2fb4e54f89bee0e8a312aa9deabe964 for predefined container...
Pulling docker image docker:latest ...
Using docker image docker:latest ID=sha256:6f114d6c63208eabe25ee9639004a9afd2a3e3bd7e523ac08f5894e1d6b5c916 for build container...
Running on runner-de8140fa-project-15-concurrent-0 via 6e5d8b23a716...
Cloning repository...
Cloning into '/builds/developers/adjuster-main'...
Checking out 537215e9 as develop...
Skipping Git submodules setup
Missing /usr/bin/gitlab-runner-helper. Artifacts downloading is disabled.
$ mkdir $BASE_DIR/system-build
.....

From alpine-v9.5.0 (success)

unning with gitlab-ci-multi-runner 9.5.0 (413da38)
  on staging_80 (51a3e33a)
Using Docker executor with image docker:latest ...
Starting service lordgaav/dind-options:latest ...
Pulling docker image lordgaav/dind-options:latest ...
Using docker image lordgaav/dind-options:latest ID=sha256:92fc5995e152877f79c025028d5f94be85f295cbe3860ec33cfe6228390689b8 for lordgaav/dind-options service...
Waiting for services to be up and running...
Using docker image sha256:b17641cdb1d7a25442c5e7a08858022ed1f06eb76be07a8a8b437595587d3003 for predefined container...
Pulling docker image docker:latest ...
Using docker image docker:latest ID=sha256:6f114d6c63208eabe25ee9639004a9afd2a3e3bd7e523ac08f5894e1d6b5c916 for build container...
Running on runner-51a3e33a-project-15-concurrent-0 via ff36db972035...
Cloning repository...
Cloning into '/builds/developers/adjuster-main'...
Checking out 537215e9 as develop...
Skipping Git submodules setup
Downloading artifacts for build_develop (8471)...
Downloading artifacts from coordinator... ok        id=8471 responseStatus=200 OK token=2PLbVS29
$ mkdir $BASE_DIR/system-build
....

Environment description

config.toml

concurrent = 4
check_interval = 0

[[runners]]
  name = "staging_80"
  url = "https://gitlab.<domain>/ci"
  token = "75217bfafa0402bf8dbff0ccceeaf5"
  executor = "docker"
  [runners.docker]
    tls_verify = false
    image = "<image>"
    privileged = true
    disable_cache = true
    volumes = ["/cache"]
    shm_size = 0
  [runners.cache]

Docker Info

Containers: 4
 Running: 2
 Paused: 0
 Stopped: 2
Images: 3
Server Version: 1.12.6
Storage Driver: overlay2
 Backing Filesystem: xfs
Logging Driver: journald
Cgroup Driver: systemd
Plugins:
 Volume: local
 Network: null host bridge overlay
Swarm: inactive
Runtimes: docker-runc runc
Default Runtime: docker-runc
Security Options: seccomp
Kernel Version: 3.10.0-514.26.2.el7.x86_64
Operating System: CentOS Linux 7 (Core)
OSType: linux
Architecture: x86_64
Number of Docker Hooks: 2
CPUs: 4
Total Memory: 7.631 GiB
Name: staging
ID: UPZA:VDEE:OOET:F2MT:25PO:C5J7:INRM:KNVZ:OBDP:25SS:WJAW:C3F5
Docker Root Dir: /home/gitlab-runner/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Insecure Registries:
 127.0.0.0/8
Registries: docker.io (secure)

Used GitLab Runner version

Tested with version docker gitlab/gitlab-runner:alpine-v10.0.1 and gitlab/gitlab-runner:alpine-v10.0.0

Version:      10.0.1
Git revision: e991d1b4
Git branch:   10-0-stable
GO version:   go1.8.3
Built:        Wed, 27 Sep 2017 21:47:08 +0000
OS/Arch:      linux/amd64

Runner is self-hosted and connecting to a self-hosted gitlab-ee instance.

changed the description

Also happens on a server with Docker Server Version: 17.06.0-ce

@chris.fitzpatrick To make it clear - you're using Runner installed as a Docker container from gitlab/gitlab-runner:alpine and with this Runner you're using the Docker executor, right?

In that case - could you post how you're setting up the Runner's container? I'll try to reproduce it.

@tmaczukin That is correct, runner installed as Docker container from gitlab/gitlab-runner:alpine and it is set to be a Docker executor. Here is the config that I use.

docker run -d --name gitlab-runner --restart always \
  -v /var/run/docker.sock:/var/run/docker.sock \
  -v /srv/gitlab-runner:/etc/gitlab-runner \
  gitlab/gitlab-runner:alpine

docker exec -it gitlab-runner gitlab-runner register -n \
        --executor docker \
        --registration-token <token> \
        --url https://<url>/ci \
        --description <description> \
        --limit 0 \
        --tag-list <tags> \
        --docker-image <image> \
        --docker-disable-cache \
        --docker-privileged true \
        --locked false

The only difference between my working environment currently and the broken one is I used gitlab/gitlab-runner:alpine-v9.5.0 instead of just gitlab/gitlab-runner:alpine in the docker run command

same here, 10.0.2 does not work either