Ignore following touch actions if we didn't have window focus

Previously we would ignore the down action, but then get the up if
window focus had changed (such as when hitting back to get rid of the
keyboard in all apps, which would launch the app in that position).

Bug: 73887575
Change-Id: I5405223982ef52633180ecd960a697af0d0b76d9