Move view-specific logic to ViewHolders.

There's a lot of logic around inflating/initializing which lives in
the adapter, but only really applies to the views. Move this into
the View Holder for now. This may not be its final resting place,
but in any case this seems like it can be extracted from the adapter.

Bug: 19372817
Change-Id: Ib3436ad4d8e666a8df8cb2f894e71b321ecb68da