Flog and Flay unit tests not working properly?

I was looking at the gitlab-ce builds just now to see if I can work out why my flay tests are failing but the gitlab-ce ones are passing and it looks like the gitlab-ce tests might not be running properly.

Looking at the latest 8.8 flay build at 12:10 pm today, https://gitlab.com/gitlab-org/gitlab-ce/builds/1502968, it doesn't appear to be running the flay command (look at the bottom of the log):

$ bundle exec rake flay
/usr/local/lib/ruby/gems/2.1.0/gems/bundler-1.12.4/lib/bundler/rubygems_integration.rb:373:in `block in replace_bin_path': can't find executable bundle (Gem::Exception)
	from /usr/local/lib/ruby/site_ruby/2.1.0/rubygems.rb:278:in `activate_bin_path'
	from /usr/local/bundle/bin/bundle:22:in `<main>'
Creating cache ruby21...
vendor: found 40057 matching files                 
Uploading cache.zip                                

Build succeeded

But for some reason the error isn't causing the build to fail?

Looking at some of the other build output for the same commit I saw that flog was doing the same as well. https://gitlab.com/gitlab-org/gitlab-ce/builds/1502967