Fix "disappearing history fragment" issue.

Swiping down too quickly after swiping up to hide history could
cause history fragment to disappear and freeze.

Fixes: 34717239
Test: manual - with history open, tap back, then immediately start drag
before fragment finishes animating.
Change-Id: I2196ba224712a66c406980f7453d5fc443a5fb5a