Fix timeouts caused by destroy() waiting for the same lock on sort.

Bug: 72458997
Test: manually reproduced error and verified that it is fixed with this
code change on a Taimen.

Change-Id: I03ddbc8a1b3cfb6f720413248cc5813458d35851