manifest: Stop tracking hardware/invensense

This is not used by any device since a few years, it also contains
Android.mk which we are eliminating, so get rid of it.

Change-Id: I4c42ef9c7534831b79b983e9bda95ec6aaa58097