SF: Fix display on Pixel 4

* All other devices were fine with the below commit, except Pixel 4
* They're fine with this change too so let's just live with it for now,
  till Fold is out or a proper fix is found.

Fixes: 76742845 ("SF: Fix display mode transitions for multi-display")
Change-Id: Ief3e1730ea0ad23e1aff04a278d5565ad2f05834