Collapse parallel builds of similar name on Pipeline graph

Description

Pipelines with lots of parallel jobs that are all running the same basic command such as rspec 0 20 through rspec 19 20 should be collapsed to a single node on the pipeline graph.

This is continuation of https://gitlab.com/gitlab-org/gitlab-ce/issues/18141.

Proposal

• We will automatically collapse build names of this format: job-name {index} {total} or job-name {index}/{total} - e.g. /\s(\d+)[ \/](\d+)(\s|$)/ and replace with a single node; cutting the index and total.
• Use the worse status of all jobs.
• Add a drop-down for selecting individual jobs, sorted by our current convention (e.g. failed first).

Required work

• Backend to provide a list of builds grouped by similar name with the status including a list of builds
• Frontend to implement collapsing and showing a single entry, and having a clickable / hover-able option to show all collapsed builds

Links

• Should work seamlessly with official parallel jobs (#21480 (moved)), but could be implemented independently.

mentioned in issue #21277 (closed)

let me add the most recent design

mentioned in issue #21477 (closed)

mentioned in issue #21480 (moved)

@dimitrieh Can you make a separate issue for any cosmetic changes in your graph outside of the drop-down? I'm afraid the details will get lost.

Update description with comments from redundant #21477 (closed).

Note that our current .gitlab-ci.yml has jobs in the format rspec 0 20 ruby21 so we should either support that, or change our job names to always put the index/total at the end. Also, I think we should support slashes instead of spaces in between numbers in preparation for a automatic parallization solution (e.g. #21480 (moved)). This regex is pretty permissive and might work: /\s(\d+)[ \/](\d+)(\s|$)/ and can be tested here. If we actually implement #21480 (moved) in the same release, we might be able to tighten up the regex to just /\s\d+\/\d+$/.

Can you make a separate issue for any cosmetic changes in your graph outside of the drop-down? I'm afraid the details will get lost.

@markpundsack on it: https://gitlab.com/gitlab-org/gitlab-ce/issues/21604

mentioned in issue #21604 (closed)

I could make the backend change for this. It seems we're iterating with Pipeline#stages_with_latest_statuses for now, which would return {stage_name: [job]}, I could change it to like {stage_name: [[job]]}, which for example would be like:

{"tests": [[rubocop], [rspec 0 2, rspec 1 2, rspec 2 2]]}

Would this work?

mentioned in merge request !6242 (merged)

@lbennett Are you taking this while @annabeldunstone is out? Looks like @godfat is waiting for an answer to the above.

@markpundsack the MR for this is already up and frontend work is done https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/6242. Cosmetic changes will go into a separate MR

Great, Thanks for clarifying.

Mentioned in merge request !6403 (merged)

This is done.

Status changed to closed

mentioned in issue gitlab#5972