Revert "input: Adjust priority"

 * This seems to interact poorly with cpusets, just revert it.
   It was improperly merged anyway and didn't become obvious
   until enabling HWC2.

This reverts commit 2a6b780a.

Change-Id: If3badb1c3136da3fc15a7e4c20cdf18ad27ec0b8