Adjust the config order for different scenarios

Bug: 271247229
Bug: 272597112

Test: atest --host bluetooth_le_audio_test bluetooth_le_audio_client_test --no-bazel-mode & manual testing
Change-Id: I6f4b17c84bb5a609114f0d22ac5e20979ca199a4