ASoC: codecs: remove dmic device during dev err

Remove sound wire dmic device from master device list only during
critical error and not for probe defer.

Signed-off-by: Vignesh Kulothungan <vigneshk@codeaurora.org>