"Merge When Build Succeeds" doesn't work

Experienced in !2794 (merged). The build was green but the branch wasn't merged automatically:

I canceled the automatic merge and did it manually in the end.

cc @ayufan

@rymai We are aware of this problem, we will try to fix this in next week, since this is on our roadmap for 8.5.

Milestone changed to 8.5

mentioned in issue #4263 (closed)

@ayufan Ok, great then!

Added ~19173 label

Milestone changed to 8.6

We will need to investigate this.

mentioned in issue #13559 (closed)

We introduced a few fixes to Merge When Success that should resolve this: the builds were improperly interpreted, leading sometimes to auto merge not happening.

Status changed to closed

@ayufan We still experience this issue on 8.12.4. Is there a way to investigate that on our side? I mean what we can possibly check to provide more info for the issue or just find the cause and fix it ourselves if it is on our side.