Fix bug that filters out system providers

When setAllowedProvider is specified, currently we are filtering out all
the system providers. With this change, we will always ping the system providers
+ the providers specified in the allow list.

Bug: 277773297
Test: built locally & deployed on devive

Change-Id: I8a82f68edbd75b9a879d7e32aa32413af3a35cd9