usb: gadget: amd5536udc: remove unused structure member

that member isn't used anywhere in the driver
and be removed with no mercy.

Signed-off-by: Felipe Balbi <balbi@ti.com>