msm: ipa: eth: Perform refresh for devices under removal

Skipping the offload refresh for a device that is undergoing a removal
will unpair the device without deinitializing the offload path, causing
de-stability to the system and impairs network driver's ability to free
up resources allocated for the device.

Change-Id: I69b6417f34824812014718fc873e1ec8db1861b0
Signed-off-by: Jinesh K. Jayakumar <jineshk@codeaurora.org>