AIDL: Release patches on external device disconnection

When an external device is being disconnected, check
which patches are holding the port and release them.
This replaces the behavior of "postponed disconnection".

Bug: 327449747
Test: repro steps from the bug
Change-Id: I98399fd6e820046391ad9ee1e2cb3ae0afc7eed2