Dialer : Don't hold on to views used in listviews

Lets not hold references to views used inside of a listview adapter since it
will try to recycle it and if something is holding a reference to that view it is
trying to recycle, it will block things on the ui thread and queue up all events during that time
and only dispatch once focus is lost.

Change-Id: Idd113e4f13f08d706a33fd4d07fd9a12f5382671