Run GitLab Runner integration tests on all supported platforms and in all supported configurations
Currently we support these executors:
- Shell
- Docker
- Docker-SSH
- VirtualBox
- Parallels
- SSH
We support these systems:
- Windows
- Linux
- OSX
- FreeBSD
We support these shells:
- Bash
- Sh
- PowerShell
- Windows Batch
However we do only run a few integration tests for these executors only on Linux. We should extend our testing to verify Runner correctness on other systems. I believe that the most of our bug reports are for Windows. We should make sure that we continuously run integration tests on this system first and fix all bugs that arrive to make this integration to be green.
The next thing should be adding support for OSX and BSD. I believe that it's fine as started to have these tests running, but make them allowed to fail to at least have the overview what does and what does not work.