Revert "phy dp83867: Fix compilation with CONFIG_OF_MDIO=m"

This reverts commit 7f32541c.

This needs reverting too, as per requests.

Signed-off-by: David S. Miller <davem@davemloft.net>