slimbus: Fix the connect operation

Slimbus controller maintains port information associated with the Slimbus
master. When a channel is connected with a port, the port is assigned with
the channel properties. But the connect operation assigns the channel
properties even for a slave port.

Assign the channel properties only for the master port during the connect
operation.

CRs-Fixed: 2016162
Change-Id: Ic936b9d859b25da13ad63ce06a58b40838289909
Signed-off-by: Karthikeyan Ramasubramanian <kramasub@codeaurora.org>