clk: qcom: gcc-sdm845: Remove control of some CLKREF_EN registers

Not all CLKREF_EN registers need to be controlled by Linux.
Only hold references for the ones that HLOS drivers need.

Change-Id: Ia2aaf57c11cbc3de01fb7a32984495e2fee08b02
Signed-off-by: Deepak Katragadda <dkatraga@codeaurora.org>