Database goals for September 20th, 2017

@yorickpeterse:

• https://gitlab.com/gitlab-org/gitlab-ce/issues/36878 Re-investigate after the 10.0 RC1 deploys to see what remains
  • https://gitlab.com/gitlab-org/gitlab-ce/issues/36878#note_40689175
• Start looking into https://gitlab.com/gitlab-org/gitlab-ce/issues/36880
  • Investigation is ongoing in the issue, see comments and such for more details
  • Depends on at least 2 other issues in order to fix things in the best way possible
• Evaluate results of 10.0 RC1 deploy, what slow controllers are fixed with it, etc
  • The daily overview is conflicting a bit with the graphs showing timings over time. I'm considering more and more to deprecate the daily overview in favour of a dashboard that just draws all the controllers over time
  • I'm also beginning to believe the p99 may not be that useful to focus on since it only takes very few slow requests to skew the p99
• Improve Users::LastPushEvent#find_event_in_database which seems to behave badly from time to time
  • Cause: missing index, fixed in https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/14273

@_stark:

• https://gitlab.com/gitlab-com/infrastructure/issues/2513 Investigate discrepancies between bundled schema against prod
  • Identified all discrepancies and have identified some but not all root causes
  • https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/14343 - found bug in rails handling of partial indexes
  • https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/14378 - reconciled one living dead "temporary" index
  • https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/14381 - WIP: reconcile varchar limits
  • Also ran SQL script on staging to test reconciling defaults and not null constraint
  • This will spawn some longer-term plans https://gitlab.com/gitlab-com/infrastructure/issues/2513
• https://gitlab.com/gitlab-org/gitlab-ee/issues/3425 Inefficient query on push_rules where is_sample
  • Created index in production. MR: https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/2966 (bug in 14343 above blocked this for a bit)
• https://gitlab.com/gitlab-org/gitlab-ce/issues/36454

Last week's goals: https://gitlab.com/gitlab-com/infrastructure/issues/2719

assigned to @yorickpeterse and @_stark

changed milestone to %WoW ending 2017-09-19

changed the description

changed the description

marked the checklist item Improve Users::LastPushEvent#find_event_in_database which seems to behave badly from time to time as completed

changed the description

marked the checklist item https://gitlab.com/gitlab-org/gitlab-ce/issues/36878 Re-investigate after the 10.0 RC1 deploys to see what remains as completed

marked the checklist item Evaluate results of 10.0 RC1 deploy, what slow controllers are fixed with it, etc as completed

marked the checklist item Evaluate results of 10.0 RC1 deploy, what slow controllers are fixed with it, etc as incomplete

marked the checklist item Evaluate results of 10.0 RC1 deploy, what slow controllers are fixed with it, etc as completed

changed the description

marked the checklist item Start looking into https://gitlab.com/gitlab-org/gitlab-ce/issues/36880 as completed

changed the description

@yorickpeterse please close the WoW when you close this issue.

changed the description

closed

mentioned in issue #2818 (closed)

changed the description

marked the checklist item https://gitlab.com/gitlab-com/infrastructure/issues/2513 Investigate discrepancies between bundled schema against prod as completed

marked the checklist item https://gitlab.com/gitlab-org/gitlab-ee/issues/3425 Inefficient query on push_rules where is_sample as completed