ALSA: pcm: Remove qos request only when it is active

Remove pm qos request for latency_pm_qos_request
only when it is active as it might lead to list corruption
in pm driver if removal is already done.

Change-Id: Ia9b5e933b217e2d988f18ae61673228b54e388bc
Signed-off-by: Aditya Bavanari <abavanar@codeaurora.org>