The default merge batch size, 1000, is much too large for efficient merging of vector indexes. At this large a batch size, merge workers encounter a lot of contention with fixups, which tanks performance. For a small merge set, like exist in unit tests, this isn't especially noticeable but, for larger merge sets, it can become indistinguishable from deadlock.

Jira issue: CRDB-55342