AudioManager: add previous AudioPort list

Maintain a cache of previously attached audio ports used
to create lists of added and removed devices following
a port list update callback.

Change-Id: Iad1c95b85c8ae9bdbed79eb0cdc46aeedeafccea