[Inline Reply] Fix RemoteInputView visibility listener leak

Whenever notification is updated, we are adding a new listener for the same ContentView instance. The list is getting bigger.
This CL fixes this issue by getting back to 1-1 listener model from 1-N.
Bug: 349628193
Test: presubmit
Flag: NONE BUGFIX

Change-Id: I1e572ad8bf2b665fa027416c0ae496d50203124b