Remove onClick when Clear all button not visible

It was technically possible to still tap the button even if it wasn't
visible.

Fix: 365878735
Test: manually verified that sensitive notifications can't be cleared by
tapping on the empty space
Flag: EXEMPT trivial bugfix

Change-Id: I023ab53fc5e5020694acdd96c77b1fe625636a05