Added skip delays when activating user id device affinities

Bug: 269208752
Test: Ran MU workflow observed 90% reduction in audio routing
(cherry picked from https://googleplex-android-review.googlesource.com/q/commit:299565553494ad0fbe38d0c737e3140057552fce)
Merged-In: I000369822c82ac38ff7008fafab8bc569bd762a2
Change-Id: I000369822c82ac38ff7008fafab8bc569bd762a2