Polish card view and directory padding

Polish the card view and directory by design requirement,
to solve layout shift up and down after switching display mode.

Fix: 123401745
Fix: 126181453
Test: visual
Test: atest DocumentsUITests
Change-Id: Ib1d2877cfa25e1adc3440deb2f7a6364016217b7