Revert "Notify listeners when syncing group expansion mgr with the pipeline."

This reverts commit 2b64f514.

Reason for revert: b/296881063

Bug: 296881063
(cherry picked from https://googleplex-android-review.googlesource.com/q/commit:55efa1c567d680162c459af39a76ec1e87b0a163)
Merged-In: I6cf0eca0f84dd3f02a737920569035ab5793d872
Change-Id: I6cf0eca0f84dd3f02a737920569035ab5793d872