LeAudio: Fix crash on bad remote audio allocation config am: 8e1b191c

Original change: https://googleplex-android-review.googlesource.com/c/platform/packages/modules/Bluetooth/+/20479368



Change-Id: I9fc98c34bc06beccbc9cd839b8c7f223337c4afa
Signed-off-by: Automerger Merge Worker <android-build-automerger-merge-worker@system.gserviceaccount.com>