Update notes immediately after closing/reopening

What does this MR do?

Fixes MR https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/4127 Thanks @bendyorke!

Are there points in the code the reviewer needs to double check?

Nope.

Why was this MR needed?

Constant conflicts in that MR

What are the relevant issue numbers?

Screenshots (if relevant)

Fixes #15091 (closed)