Check for ARCH_ARM_HAVE_NEON flag only for ARM arch

This patch prevents ARM neon code from being included
for Arm64, where ARM is the 2nd architecture.

Change-Id: I5a283991034f2650a0e7d4227aef967be276fc9c
Signed-off-by: Ashok Bhat <ashok.bhat@arm.com>