soc: swr-mstr: Store and compare dev_addr along with dev_num

-> If enumeration is changed runtime, dev_num gets changed
-> so it might result in different dev_num for same device
-> between swrm_connect_port and swr_disconnect_port while powering
up and down of widget
-> This results in not emptying the port_req list, hence swrm not
going to suspend state
-> This results into adsp not going to sleep state

Change-Id: I80326a35f0cac7f7be30cbbee119a8ba247a0f76