dsp: fix logic to send AFE calibration for TDM AFE ports

AFE calibration should be sent even when the number of group ports is 1.
Remove this condition from API to send AFE calibration for any number of
group ports.

Change-Id: I7f0c8ab739da2831e17e5dbbaf013cf99f2e6d88
Signed-off-by: Xiaoyu Ye <benyxy@codeaurora.org>