leaudio: Fix deactive group corner case

If group was deactived just after Codec Config has been sent out to
remote device, the group would keep configure even it shall not.
This would lead to assert when state machine reports back streaming case
for not active group.

Bug: 281951123
Test: atest BluetoothInstrumentationTests
Tag: #feature
Change-Id: I9a2282b495fa0f79036fe7fef3b4051aea3ec482