Build instructions

Please provide instructions for building the runner from sources.

I am trying to build a patched version on mac. What I did so far:

1. Installed go.
2. Added /usr/local/go/bin to the PATH.
3. Set GOPATH to ~/.go
4. Added $GOPATH/bin to the PATH.
5. Installed mercurial.
6. Ran make.

(Not in this order.)

I get this error:

bash-3.2$ make
# Installing dependencies...
go get github.com/tools/godep
go get -u github.com/golang/lint/golint
go get github.com/mitchellh/gox
go get code.google.com/p/winsvc/eventlog
package code.google.com/p/winsvc/eventlog
	imports code.google.com/p/winsvc/eventlog
	imports code.google.com/p/winsvc/eventlog: no buildable Go source files in /Users/gitlab-runner/.go/src/code.google.com/p/winsvc/eventlog
make: [deps] Error 1 (ignored)
godep restore
# Running tests...
go test
main.go:11:2: cannot find package "gitlab.com/gitlab-org/gitlab-ci-multi-runner/commands" in any of:
	/usr/local/go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/commands (from $GOROOT)
	/Users/gitlab-runner/.go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/commands (from $GOPATH)
main.go:12:2: cannot find package "gitlab.com/gitlab-org/gitlab-ci-multi-runner/common" in any of:
	/usr/local/go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/common (from $GOROOT)
	/Users/gitlab-runner/.go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/common (from $GOPATH)
main.go:13:2: cannot find package "gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/docker" in any of:
	/usr/local/go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/docker (from $GOROOT)
	/Users/gitlab-runner/.go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/docker (from $GOPATH)
main.go:14:2: cannot find package "gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/parallels" in any of:
	/usr/local/go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/parallels (from $GOROOT)
	/Users/gitlab-runner/.go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/parallels (from $GOPATH)
main.go:15:2: cannot find package "gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/shell" in any of:
	/usr/local/go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/shell (from $GOROOT)
	/Users/gitlab-runner/.go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/shell (from $GOPATH)
main.go:16:2: cannot find package "gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/ssh" in any of:
	/usr/local/go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/ssh (from $GOROOT)
	/Users/gitlab-runner/.go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/executors/ssh (from $GOPATH)
main.go:17:2: cannot find package "gitlab.com/gitlab-org/gitlab-ci-multi-runner/shells" in any of:
	/usr/local/go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/shells (from $GOROOT)
	/Users/gitlab-runner/.go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner/shells (from $GOPATH)
make: *** [test] Error 1
bash-3.2$ 

Thanks

mentioned in issue #14 (closed)

The version I'm trying to build is !2 (closed).

Hello,

I'm new to the go development too, and I have had the same problem as you.

I'm maybe wrong, but it seems that your project must be in the correct path in your go environment. Try this:

cd ~/.go
mkdir -p src/gitlab.com/gitlab-org
git clone git@gitlab.com:gitlab-org/gitlab-ci-multi-runner.git
cd gitlab-ci-multi-runner
make

It should be better.

Hope this help, and have a nice day.

-- Olivier

mentioned in issue #14 (closed)

@mespak I'll make the instructions. What system do you use?

Generally it's sufficient to:

go get gitlab.com/gitlab-org/gitlab-ci-multi-runner

Status changed to closed

Status changed to reopened

Mac OS X 10.10.3

I agree with ayufan. It's sufficient to do:

go get gitlab.com/gitlab-org/gitlab-ci-multi-runner

to have the sources. Then to compile, you must do:

cd $GOPATH/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner
make

HTH.

No luck, I always get the same errors. Are you also using Mac? Does it depend on the version of go? I use 1.4.2.

Added ~60197 label

@mespak Can you post terminal log when you do?

cd $GOPATH/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner
ls -al
make

I'm using Mac OS X 10.10.3 with go 1.4.2 from brew.

@ayufan

Here it is. The only difference is that I used Olivier's fork.

cmiclab-mac:~ gitlab-runner$ export GOPATH=/Users/gitlab-runner/src/go
cmiclab-mac:~ gitlab-runner$ which go
/usr/local/go/bin/go
cmiclab-mac:~ gitlab-runner$ echo $PATH
/Users/builder/opt/qt-4.8.7/bin:/Applications/CMake-3.1.3.app/Contents/bin:/Applications/Doxygen-1.8.7.app/Contents/Resources:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/git/bin:/usr/local/go/bin
cmiclab-mac:~ gitlab-runner$ cd $GOPATH/src/gitlab.com/PuckCh/gitlab-ci-multi-runner
cmiclab-mac:gitlab-ci-multi-runner gitlab-runner$ ls -la
total 104
drwxr-xr-x  28 gitlab-runner  staff   952 11 May 16:15 .
drwxr-xr-x   3 gitlab-runner  staff   102 11 May 16:15 ..
-rw-r--r--   1 gitlab-runner  staff    67 11 May 16:15 .env
drwxr-xr-x  13 gitlab-runner  staff   442 11 May 16:25 .git
-rw-r--r--   1 gitlab-runner  staff    31 11 May 16:15 .gitignore
-rw-r--r--   1 gitlab-runner  staff    46 11 May 16:15 .godir
-rw-r--r--   1 gitlab-runner  staff  3170 11 May 16:15 CHANGELOG.md
-rw-r--r--   1 gitlab-runner  staff   446 11 May 16:15 Dockerfile
drwxr-xr-x   5 gitlab-runner  staff   170 11 May 16:15 Godeps
-rw-r--r--   1 gitlab-runner  staff  5985 11 May 16:15 Makefile
-rw-r--r--   1 gitlab-runner  staff    73 11 May 16:15 Procfile
-rw-r--r--   1 gitlab-runner  staff  3794 11 May 16:15 README.md
-rw-r--r--   1 gitlab-runner  staff     6 11 May 16:15 VERSION
drwxr-xr-x   5 gitlab-runner  staff   170 11 May 16:15 ci
drwxr-xr-x   8 gitlab-runner  staff   272 11 May 16:15 commands
drwxr-xr-x  10 gitlab-runner  staff   340 11 May 16:15 common
-rw-r--r--   1 gitlab-runner  staff  1061 11 May 16:15 config.toml.example
drwxr-xr-x   3 gitlab-runner  staff   102 11 May 16:15 dockerfiles
drwxr-xr-x   7 gitlab-runner  staff   238 11 May 16:15 docs
drwxr-xr-x   7 gitlab-runner  staff   238 11 May 16:15 executors
drwxr-xr-x   7 gitlab-runner  staff   238 11 May 16:15 helpers
-rwxr-xr-x   1 gitlab-runner  staff    45 11 May 16:15 install.sh
-rw-r--r--   1 gitlab-runner  staff  1569 11 May 16:15 main.go
drwxr-xr-x   4 gitlab-runner  staff   136 11 May 16:15 packaging
drwxr-xr-x   3 gitlab-runner  staff   102 11 May 16:15 parallels
drwxr-xr-x   5 gitlab-runner  staff   170 11 May 16:15 shells
drwxr-xr-x   5 gitlab-runner  staff   170 11 May 16:15 ssh
drwxr-xr-x   3 gitlab-runner  staff   102 11 May 16:15 tests
cmiclab-mac:gitlab-ci-multi-runner gitlab-runner$ 

I installed go from the installer package, not brew. But the version is the same.

Hi,

cmiclab-mac:~ gitlab-runner$ cd $GOPATH/src/gitlab.com/PuckCh/gitlab-ci-multi-runner

put it in:

$GOPATH/src/gitlab.com/gitlab.com/gitlab-ci-multi-runner

HTH.

You mean "$GOPATH/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner" ?

I wanted to build your fork.

I tried to build the gitlab-org version now, it does not work either, unfortunately. Now I get different error, though.

gox -build-toolchain -os="linux" -os="darwin" -os="windows"
The toolchain build can't be parallelized because compiling a single
Go source directory can only be done for one platform at a time. Therefore,
the toolchain for each platform will be built one at a time.

--> Toolchain: darwin/386
--> Toolchain: darwin/amd64
--> Toolchain: linux/386
--> Toolchain: linux/amd64
--> Toolchain: linux/arm
--> Toolchain: windows/386
--> Toolchain: windows/amd64

7 errors occurred:
darwin/386: Error building 'darwin/386'.

Stdout: # Building C bootstrap tool.
cmd/dist


Stderr: ld: can't open output file for writing 'cmd/dist/dist.ld_NmoNgs', errno=13 for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)


darwin/amd64: Error building 'darwin/amd64'.

Stdout: # Building C bootstrap tool.
cmd/dist


Stderr: ld: can't open output file for writing 'cmd/dist/dist.ld_PlJO4v', errno=13 for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)


linux/386: Error building 'linux/386'.

Stdout: # Building C bootstrap tool.
cmd/dist


Stderr: ld: can't open output file for writing 'cmd/dist/dist.ld_311Jz2', errno=13 for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)


linux/amd64: Error building 'linux/amd64'.

Stdout: # Building C bootstrap tool.
cmd/dist


Stderr: ld: can't open output file for writing 'cmd/dist/dist.ld_f12asN', errno=13 for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)


linux/arm: Error building 'linux/arm'.

Stdout: # Building C bootstrap tool.
cmd/dist


Stderr: ld: can't open output file for writing 'cmd/dist/dist.ld_QpYwTp', errno=13 for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)


windows/386: Error building 'windows/386'.

Stdout: # Building C bootstrap tool.
cmd/dist


Stderr: ld: can't open output file for writing 'cmd/dist/dist.ld_wV0DqZ', errno=13 for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)


windows/amd64: Error building 'windows/amd64'.

Stdout: # Building C bootstrap tool.
cmd/dist


Stderr: ld: can't open output file for writing 'cmd/dist/dist.ld_1WyM7V', errno=13 for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)


make: *** [toolchain] Error 1

Right, I mean "$GOPATH/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner".

Even with my fork, it should be "$GOPATH/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner", as I don't have change the package names.

About your error, it seems to me that you don't have the right to write in the cmd/dist directory.

HTH.

Ah, yes. That's one of the problems. If I do go get gitlab.com/PuckCh/gitlab-ci-multi-runner it will create a PuckCh directory, and print errors like:

package gitlab.com/PuckCh/gitlab-ci-multi-runner
	imports github.com/Sirupsen/logrus
	imports github.com/codegangsta/cli
	imports gitlab.com/gitlab-org/gitlab-ci-multi-runner/commands: unrecognized import path "gitlab.com/gitlab-org/gitlab-ci-multi-runner/commands"

If I rename PuckCh to gitlab-org and run 'make', I get the same error as above. I do not think it is a permission issue. Every file is owned by the same user that runs the make command.

Which version of clang do you use? Here is mine:

builder ~/src/go/src/gitlab.com/gitlab-org/gitlab-ci-multi-runner$clang --version
Apple LLVM version 6.1.0 (clang-602.0.49) (based on LLVM 3.6.0svn)
Target: x86_64-apple-darwin14.3.0
Thread model: posix

Same as you:

$ clang --version
Apple LLVM version 6.1.0 (clang-602.0.49) (based on LLVM 3.6.0svn)
Target: x86_64-apple-darwin14.3.0
Thread model: posix

Maybe an answer here: https://github.com/mitchellh/gox/issues/17

I'm using brew version of go.

HTH.

Yeah, it looks like the same issue. I installed go with brew and managed to build the runner with a different (admin) user. It did not work earlier with that user either, and it still does not work with the gitlab-runner user with the brew version of go, but finally I could build the runner, so I'm happy.

Thanks very much.

https://gitlab.com/gitlab-org/gitlab-ci-multi-runner/blob/master/docs/development/README.md

Status changed to closed

mentioned in issue #2611

added Documentation and removed ~60197 labels