Don't check synthetic package name on dir removal.

The package name might not be the correct one when removing invalid
folder.

Ignore-AOSP-First: packageName not present in AOSP
Bug: 204810986
Bug: 201090222
Test: presubmit and boot
Change-Id: I5a74191df8f180159b693ef1b551ea76d71051cf