Revert "Fix clicking the allow/deny button of the dialog was not working after...

Revert "Fix clicking the allow/deny button of the dialog was not working after quickly clicking multiple times."

This reverts commit 6e79d125.

Reason for revert: b/234737949 - the test this added is failing

Change-Id: Ia88853e738faea7fd7b4bfc6d2099cee0fb7d256