asoc: swr-dmic: select correct port type for swr-dmic

When same swr dmic is first enabled as HIFI, secondly as LP
and closed HIFI, it would disable LP port by mistake. Update
the logic to select correct port for swr-dmic.

Change-Id: I5d4d1461d8cd7db7bc7f37fc91ee1c9324413980
Signed-off-by: Meng Wang <mengw@codeaurora.org>