Fix various Quick Contact visuals

Also fixed a bug where the secondary action can be tapped even though
it doesn't exist (crashes)

This also fixes pushed states, which have been filed a couple of times

Bug:5137515

Change-Id: I810d12a79f0088a0770a0eaf9225fe7906ebd8e7