8.14 CI Plan

deleted

I'd like to propose SSL client certificate support for the runner - https://gitlab.com/gitlab-org/gitlab-ci-multi-runner/merge_requests/340 - we've had several contributors attempt to get this in, we might be about there this time.

I believe that main focus on Backend and Runner should be:

efficiency of provisioning runners,
implement limits on free CI service

I'm confident I can write a sensible backend for https://gitlab.com/gitlab-org/gitlab-ce/issues/22745 that will work with any future build trace enhancements (store timestamp + byte offset for each PATCH build trace call where the byte offset changes. From this we can efficiently infer an approximate time for each line of output).

I'd like to do it for 8.14 - debugging performance issues with builds or the runner itself is very difficult without this information.

It needs a little frontend work, but nothing major in a first iteration.

Updated description with direction issues that are already assigned to 8.14. It might be too much already so we can certainly discuss cutting some.

Cut some scope. Dropped coverage and cross-project stuff.

@markpundsack

We should add https://gitlab.com/gitlab-org/gitlab-ce/issues/23205 as @tauriedavis is actively working on that and should soon be ready for implementation.

@markpundsack what about this as it has the %8.14 milestone .. will have to work together with chris on having the search https://gitlab.com/gitlab-org/gitlab-ce/issues/21747 work with it at the same time in that sense perhaps, see comment https://gitlab.com/gitlab-org/gitlab-ce/issues/18054#note_17124277

Global Pipelines List + Filters for pipelines #18054 (moved)

Assigned myself for now to work on it next week.

another one, plus already has %8.14 :

Manual actions on the pipeline graph #22604 (closed)

Needs a little bit more UX work, then ready for front end.. assigned myself for upcoming week

Mentioned in issue #22642 (closed)

#23205 (closed) was created from I2P and will help the demo, so yeah, sounds good.

I had #18054 (moved) in the list originally but cut it out since it's not urgent and we don't want to overload the plan. It can probably be decoupled and done the release following the general search changes. At the very least, don't ship #18054 (moved) while not shipping something else on the list. :)

#22604 (closed) is interesting, but if we include it, it should be at the bottom of the list. @annabeldunstone @dimitrieh Can you be confident of shipping everything else on the list already and #22604 (closed)? If not, then let's not add it to the list.

Display "folders" for environments: #22539 (closed) !7015 (merged)

needs backend work

https://gitlab.com/gitlab-org/gitlab-ce/issues/23628 reduce IOPS load of PATCH /api/v3/builds/trace.json

@markpundsack This was what I was collecting (some of these issues are already in here)

Clean up commit meta info view and title bar #20892 (closed) (already in)
Tabs to switch between graph and build list in pipeline view #21953 (closed)
- Rename the "Builds" tab to "Latest Builds" in Commit and MR view #23605 (closed)
- Get rid of Pipeline Graph in Builds Tab in Merge Request and Commit view, but keep the retry all failed builds button #23604 (closed)
Get build "Retry" button in to title bar from the sidebar on Build Page #23273 (closed) (already in)
Introduces the system information element in the Build page to give info about currently deployed environments #23205 (closed) (already considered in comments above)
Status buttons broken in pipelines tab in MR/Commit views #23607 (closed) (@Annabel already working on this)

Basically I was thinking of creating an issue to give the pipelines view the same treatment as the #20892 (closed) (still have to create an issue for this)

Basically I was thinking of creating an issue to give the pipelines view the same treatment as the #20892 (closed)

@dimitrieh Yes, let's add this. Specifically, I'd like to see a "title bar" for Pipelines page.

I'm still against #23605 (closed) and would rather see the Builds tab disappear than rename it. Maybe we need a new issue for quickly accessing the latest pipeline from a MR/Commit. Maybe "Latest Builds" is the right thing, but maybe not. Elsewhere we believe that the graph is more important than the build list, so why would we include "Latest Builds" and not "Latest Pipeline"? But perhaps there other UX improvements that would make accessing the most recent pipeline better? Like a link from the overall pipeline status message? And clicking on the mini pipeline graph to get directly to the important build log without having to go through the intermediate page. (#19703 (closed)) With #19703 (closed), I imagine clicking on Pipelines, seeing the mini graph with the last node in red, then clicking on that node and going directly to the failed job. If there are more than one failed job, then a popup (like we use on the pipeline graph for parallel jobs) lets you quickly get to the right one. This feels like it might be even faster than going through the Builds list because you don't have to scroll to find the build you care about.

Mentioned in issue #19703 (closed)

Milestone changed to %8.14

Added labels and milestone to all issues currently in the description, so this issue board should be pretty close. There are a few other items in the milestone that aren't in the description though.

@annabeldunstone @dimitrieh If we are diligent about using the UX and ~Frontend labels on the issues, would the issue board work for you for tracking your work to be done?

BTW, we lost the Backend label when it was renamed to Platform (to represent Douwe's team). Do we need a CI Backend label for Kamil's team?

Is ~CI sufficient?

Mentioned in issue #22445 (closed)

@stanhu No because we use ~CI for the wider team of backend, frontend, and design so when we make an issue board filtered by ~CI, we still need some other label so items assigned to the backend team have a column rather than the Backlog.

I'm not sure if I see these issues discussed here, but I do think we need to put a big focus on reducing the database load on GitLab.com. Right now the ci_commits SELECT FOR UPDATEs are responsible for the slowest queries on GitLab.com. More specifically:

1) 7d11h33m51.563s - 11,251 - 2.002s/4m59.999s/57.455s - select "ci_commits".* from "ci_commits" where "ci_commits"."id" = '' limit 0 for update;

7 days!

Thoughts?

/cc: @pcarranza

@stanhu

This is plan. The timings are due to locking, and !7040 (merged) solves that.

Changed title: 8.14 CI Plan → ~

Changed title: ~ → 8.14 CI Plan

Please fix alpine image https://gitlab.com/gitlab-org/gitlab-ci-multi-runner/issues/1625

removed ~Frontend labels ;)

Marked the task Left-over: Clean up commit meta info view: #20892 (closed) !6994 (merged) as completed

Marked the task Improve build "Retry" button on Build Page: #23273 (closed): !7126 (merged) as completed

Marked the task Add initial Prometheus metrics server to runner manager : gitlab-org/gitlab-ci-multi-runner!358 as completed

Marked the task Left-over: Client-Side Terminal Emulation with Line Numbers: https://gitlab.com/gitlab-org/gitlab-ce/issues/13205: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/5744 Community Contribution as completed

Marked the task P1 Integrate pipeline e-mails into GitLab Notification system: #21930 (closed) !6342 (merged) (Backend: @godfat) (this seems to be almost finished, needs @ayufan review) as completed

Marked the task Fix error when using invalid branch name when creating a new pipeline !7324 (merged) (@grzesiek) as completed

Marked the task Left-over: New state for skipped builds that are waiting for manual action trigger #22642 (closed): https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7276 as completed

Marked the task Left-over: Client-Side Terminal Emulation with Line Numbers: https://gitlab.com/gitlab-org/gitlab-ce/issues/13205: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/5744 Community Contribution as incomplete

Marked the task Status buttons broken in pipelines tab in MR/Commit views #23607 (closed) as completed

Marked the task Left-over: Allow builds to be executed for longer then day: https://gitlab.com/gitlab-org/gitlab-ce/issues/22087, gitlab-org/gitlab-ce!7146 (@tmaczukin) as completed

Marked the task P1 Auto-close environments when branch is deleted: #23218 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7355 (Backend: @grzesiek) as completed

Marked the task technical debt Technical debt - Stop environment link needs to be refactored into a template #23474 (closed) as completed

Marked the task P1 Use optimistic-locking: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7040 @ayufan as completed

Marked the task P1 Allow to map Chat user to GitLab: https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7450 as completed

Marked the task Fix frequently failing test suite for unit tests job : gitlab-org/gitlab-ci-multi-runner#1834 gitlab-org/gitlab-ci-multi-runner!370 (@tmaczukin) as completed

Mentioned in issue #24643 (closed)

Marked the task Tabs to switch between graph and build list in pipeline view: #21953 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7487 as completed

Marked the task P3 Introduces the system information element in the Build page to give info about currently deployed environments: #23205 (closed): https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7251 as completed

Marked the task P1 Display "folders" for environments: #22539 (closed) !7015 (merged) @filipa @grzesiek as completed

Marked the task P1 Mattermost slash commands: #22540 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7438 (Backend: @ayufan and @zj) as completed

Marked the task Title bar for pipeline details page: #23637 (closed) as completed

Marked the task Left-over: Show "Created" and skipped builds/stages in mini Pipeline Graph in the pipeline list and have a separate "skipped" icon #22914 (closed) as completed

Mentioned in merge request gitlab-com/www-gitlab-com!3851 (merged)

Marked the task Handle received 'failed' build state while patching the trace : gitlab-org/gitlab-ci-multi-runner!366 (@tmaczukin) as completed

Marked the task P1 Display "folders" for environments: #22539 (closed) !7015 (merged) @filipa @grzesiek as incomplete

Marked the task P1 Mattermost slash commands: #22540 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7438 (Backend: @ayufan and @zj) as incomplete

Marked the task P3 Introduces the system information element in the Build page to give info about currently deployed environments: #23205 (closed): https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7251 as incomplete

Marked the task P3 Introduces the system information element in the Build page to give info about currently deployed environments: #23205 (closed): https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7251 as completed

Marked the task Tabs to switch between graph and build list in pipeline view: #21953 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7487 as completed

Marked the task P1 Display "folders" for environments: #22539 (closed) !7015 (merged) @filipa @grzesiek as completed

Marked the task P1 Mattermost slash commands: #22540 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7438 (Backend: @ayufan and @zj) as completed

Marked the task Handle received 'failed' build state while patching the trace : gitlab-org/gitlab-ci-multi-runner!366 (@tmaczukin) as completed

Marked the task technical debt Extend unit tests for objects using state_machine transitions backstage https://gitlab.com/gitlab-org/gitlab-ce/issues/23261 as incomplete

Marked the task P1 Display "folders" for environments: #22539 (closed) !7015 (merged) @filipa @grzesiek as incomplete

Marked the task P1 Mattermost slash commands: #22540 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7438 (Backend: @ayufan and @zj) as incomplete

Marked the task P2 Make GitLab Runner to fetch private docker images from GitLab Container Registry: https://gitlab.com/gitlab-org/gitlab-ci-multi-runner/issues/1828, gitlab-org/gitlab-ce!7474, gitlab-org/gitlab-ci-multi-runner!386, gitlab-org/gitlab-ci-multi-runner!376 (Runner: @tmaczukin) as completed

Marked the task P3 Introduces the system information element in the Build page to give info about currently deployed environments: #23205 (closed): https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7251 as incomplete

Marked the task Tabs to switch between graph and build list in pipeline view: #21953 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7487 as incomplete

Marked the task Handle received 'failed' build state while patching the trace : gitlab-org/gitlab-ci-multi-runner!366 (@tmaczukin) as incomplete

Marked the task technical debt Extend unit tests for objects using state_machine transitions backstage https://gitlab.com/gitlab-org/gitlab-ce/issues/23261 as completed

Marked the task P3 Introduces the system information element in the Build page to give info about currently deployed environments: #23205 (closed): https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7251 as completed

Marked the task P1 Display "folders" for environments: #22539 (closed) !7015 (merged) @filipa @grzesiek as completed

Marked the task Tabs to switch between graph and build list in pipeline view: #21953 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7487 as completed

Marked the task P1 Mattermost slash commands: #22540 (closed) https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/7438 (Backend: @ayufan and @zj) as completed

Marked the task Handle received 'failed' build state while patching the trace : gitlab-org/gitlab-ci-multi-runner!366 (@tmaczukin) as completed

Status changed to closed

Marked the task technical debt Extend unit tests for objects using state_machine transitions backstage https://gitlab.com/gitlab-org/gitlab-ce/issues/23261 as incomplete

8.14 CI Plan

The key focus (sorted by severity):

Other planned improvements:

The planned GitLab Runner improvements:

From previous plan (8.13 CI Plan)

Future proposals

Links

Designs

Child items ...

Activity

Admin message

Admin message

8.14 CI Plan

The key focus (sorted by severity):

Other planned improvements:

The planned GitLab Runner improvements:

From previous plan (8.13 CI Plan)

Future proposals

Links

Activity