Allow to access individual files for artifacts stored on Object Storage
The current implementation of Object Storage for Artifacts doesn't allow to access individual files.
This simple proof of concept verifies that it is easy to add to Workhorse an ability to download single files from Archives stored on Object Storage: https://gitlab.com/ayufan/external-zip-archive-seeker.
The cost is:
-
reading metadata from the end of archive: transfer for reading metadata (depends on the number of files), between 2 to 4 requests (depends on the number of files),
-
reading the actual compressed file: one request, and egress traffic to transfer compressed metadata (we do read exact amount of what is needed).
Thus, this removes limitations for having Object Storage for Artifacts.