Dump output of website build to wiki (or elsewhere)

The recent 0.3 tag of the website has been built and deployed to f-droid.org.

It was supposed to include the /badge directory (by downloading a .zip from the fdroid/artwork repository on gitlab and extracting it). However, the https://f-droid.org/badge/get-it-on.png (and associated) badges are not present on the server.

I'm at a loss as to how to debug, because this works as expected for me:

gitlab-runner exec docker f-droid.org --docker-volumes `pwd`/_site:/builds/output --env DEPLOY_DIR=/builds/output

Including the following portion of the log:

...
$ bundle install --path vendor
Fetching gem metadata from https://rubygems.org/...........
...
Bundled gems are installed into ./vendor.

$ ./tools/add-artwork.sh
Ensuring the /badge/ directory is present in the website source.
--2017-08-01 00:03:49--  https://gitlab.com/fdroid/artwork/repository/archive.zip?ref=master
Resolving gitlab.com (gitlab.com)... 52.167.219.168
Connecting to gitlab.com (gitlab.com)|52.167.219.168|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2425148 (2.3M) [application/zip]
Saving to: ‘./tools/../artwork.zip’

     0K .......... .......... .......... .......... ..........  2% 88.6K 26s
    50K .......... .......... .......... .......... ..........  4% 50.0K 35s

...

  2250K .......... .......... .......... .......... .......... 97%  185K 1s
  2300K .......... .......... .......... .......... .......... 99%  176K 0s
  2350K .......... ........                                   100%  530K=20s

2017-08-01 00:04:11 (120 KB/s) - ‘./tools/../artwork.zip’ saved [2425148/2425148]

Archive:  ./tools/../artwork.zip
d3aa8ff0461625fb5f36f88c9ea503c7b47e7584
   creating: ./tools/../artwork-master-d3aa8ff0461625fb5f36f88c9ea503c7b47e7584/
  inflating: ./tools/../artwork-master-d3aa8ff0461625fb5f36f88c9ea503c7b47e7584/README.md  
   creating: ./tools/../artwork-master-d3aa8ff0461625fb5f36f88c9ea503c7b47e7584/badge/
  inflating: ./tools/../artwork-master-d3aa8ff0461625fb5f36f88c9ea503c7b47e7584/badge/README.md  
  inflating: ./tools/../artwork-master-d3aa8ff0461625fb5f36f88c9ea503c7b47e7584/badge/export-png.sh  
  inflating: ./tools/../artwork-master-d3aa8ff0461625fb5f36f88c9ea503c7b47e7584/badge/get-it-on-af.png  
  inflating: ./tools/../artwork-master-d3aa8ff0461625fb5f36f88c9ea503c7b47e7584/badge/get-it-on-af.svg  
  inflating: ./tools/../artwork-master-d3aa8ff0461625fb5f36f88c9ea503c7b47e7584/badge/get-it-on-az.png  
...

One thing I can change is that this script should have set -x so that it outputs each command it runs, but that is somewhat orthogonal to the actual problem.

After the ./tools/add-artwork.sh script has run, it correctly puts a /badge directory in my resulting webroot.

@CiaranG: To debug, are we able to publish the build logs somewhere world readable? There is nothing secret in them to the best of my knowledge. If so, I'm happy to write a script which is based on the code used in fdroid update to update info on the wiki. Just assign this issue back to me and leave a comment if you'd like that.

Alternatively, if @eighthave or I was able to have access to a shell with restricted permissions, perhaps in a chroot or some other arrangement.

Open to other suggestions as to how best we can diagnose this.

mentioned in issue fdroid-website#107 (closed)

assigned to @CiaranG

Please, give the proper priority to this as it is damaging a bit the image of F-Droid with broken links to badge images everywhere. Thanks.

Just dump it to https://f-droid.org/build.log!