qdsp6v2: Fix access issues in adsp loader

Access issues are present in adsp loader. These are introduced
by the changes made for making adsp loader an in kernel component.

Change-Id: I111c0c99710b66211cffa3340afed57dc6eabdc1
Signed-off-by: Krishnankutty Kolathappilly <kkolat@codeaurora.org>