configs: Make cpufreq not set for RT

Not sure this is going to do the right thing but it fixes errors that
the CI sees.  Why isn't the RT testing just setting the performance
governor anyway?

Signed-off-by: Mark Brown <broonie@linaro.org>