Revert "ASoC: wcd9335: Increase slimbus clock gear to reduce cold start latency"

This reverts commit dac17fb6 ("ASoC: wcd9335: Increase slimbus clock
gear to reduce cold start latency").
This change is not needed as pre and post dapm events are getting
called even for front end dai links which results in latency
during device path bringup.

Change-Id: I3f35317bc11aec100fbcc1f9304bc23a97c7c39a
Signed-off-by: Sudheer Papothi <spapothi@codeaurora.org>