Always remember the last touch mode state when touch mode changes.

Do not just rely on getting an onWindowFocusChanged() event. There are cases
where we might not get it (view removed from the window for instance.)