Make stopSource delay conditional

We delay the output device change in stopSource since it is usually
called from stopOutput (in order to ensure the drain completes prior to
teardown.

Since we now call this method from disconnectAudioSource, parametrize
the delay, and ensure that when simply disconnecting the patch (used
when reconnecting telephony patches), we don't have unecessary delay.

This removes 225ms of unnecessary call output device switching delay.

Bug: 382818781
Flag: EXEMPT BUGFIX
Test: manual - speakerphone call switching perfetto
Change-Id: I6a6a6964047cafd384c360384cd8118a4e61e254