Don't tear down a network unnecessarily.

If conditions ease so restricted networks are now allowed don't
just assume every up network needs to be torn down.  Instead
check and see if it's marked restricted (or not, not-restricted)
first.

bug:30490689
Change-Id: Ib19d45979f6f9e0b605a3e5b39f569a01d30d42b