Donate to e Foundation | Murena handsets with /e/OS | Own a part of Murena! Learn more

Commit a0c64a17 authored by Jack Morgenstein's avatar Jack Morgenstein Committed by Roland Dreier
Browse files

mlx4: Add alias_guid mechanism 



For IB ports, we paravirtualize the GUID at index 0 on slaves.  The
GUID at index 0 seen by a slave is the actual GUID occupying the GUID
table at the slave-id index.

The driver, by default, requests at startup time that subnet manager
populate its entire guid table with GUIDs. These guids are then mapped
(paravirtualized) to the slaves, and appear for each slave as its GUID
at index 0.

Until each slave has such a guid, its port status is DOWN.

The guid table is cached to support special QP paravirtualization, and
event propagation to slaves on guid change (we test to see if the guid
really changed before propagating an event to the slave).

To support this caching, add capability to __mlx4_ib_query_gid() to
obtain the network view (i.e., physical view) gid at index X, not just
the host (paravirtualized) view.

Based on a patch from Erez Shitrit <erezsh@mellanox.com>

Signed-off-by: default avatarJack Morgenstein <jackm@dev.mellanox.co.il>
Signed-off-by: default avatarRoland Dreier <roland@purestorage.com>
parent 993c401e

drivers/infiniband/hw/mlx4/Makefile

+1 −1
Original line number Diff line number Diff line 
obj-$(CONFIG_MLX4_INFINIBAND)	+= mlx4_ib.o



mlx4_ib-y :=	ah.o cq.o doorbell.o mad.o main.o mr.o qp.o srq.o mcg.o cm.o
 
mlx4_ib-y :=	ah.o cq.o doorbell.o mad.o main.o mr.o qp.o srq.o mcg.o cm.o alias_GUID.o

drivers/infiniband/hw/mlx4/alias_GUID.c

0 → 100644
+688 −0

File added.

Preview size limit exceeded, changes collapsed.

drivers/infiniband/hw/mlx4/mad.c

+18 −1
Original line number Diff line number Diff line
@@ -791,8 +791,10 @@ void mlx4_ib_mad_cleanup(struct mlx4_ib_dev *dev) 


static void handle_client_rereg_event(struct mlx4_ib_dev *dev, u8 port_num)

{

	/* re-configure the mcg's */

	/* re-configure the alias-guid and mcg's */

	if (mlx4_is_master(dev->dev)) {

		mlx4_ib_invalidate_all_guid_record(dev, port_num);



		if (!dev->sriov.is_going_down)

			mlx4_ib_mcg_port_cleanup(&dev->sriov.demux[port_num - 1], 0);

	}
@@ -1808,9 +1810,20 @@ int mlx4_ib_init_sriov(struct mlx4_ib_dev *dev) 
		return 0;

	}



	err = mlx4_ib_init_alias_guid_service(dev);

	if (err) {

		mlx4_ib_warn(&dev->ib_dev, "Failed init alias guid process.\n");

		goto paravirt_err;

	}



	mlx4_ib_warn(&dev->ib_dev, "initializing demux service for %d qp1 clients\n",

		     dev->dev->caps.sqp_demux);

	for (i = 0; i < dev->num_ports; i++) {

		union ib_gid gid;

		err = __mlx4_ib_query_gid(&dev->ib_dev, i + 1, 0, &gid, 1);

		if (err)

			goto demux_err;

		dev->sriov.demux[i].guid_cache[0] = gid.global.interface_id;

		err = alloc_pv_object(dev, mlx4_master_func_num(dev->dev), i + 1,

				      &dev->sriov.sqps[i]);

		if (err)
@@ -1828,6 +1841,9 @@ int mlx4_ib_init_sriov(struct mlx4_ib_dev *dev) 
		mlx4_ib_free_demux_ctx(&dev->sriov.demux[i]);

		--i;

	}

	mlx4_ib_destroy_alias_guid_service(dev);



paravirt_err:

	mlx4_ib_cm_paravirt_clean(dev, -1);



	return err;
@@ -1854,5 +1870,6 @@ void mlx4_ib_close_sriov(struct mlx4_ib_dev *dev) 
		}



		mlx4_ib_cm_paravirt_clean(dev, -1);

		mlx4_ib_destroy_alias_guid_service(dev);

	}

}

drivers/infiniband/hw/mlx4/main.c

+31 −6

File changed.

Preview size limit exceeded, changes collapsed.

drivers/infiniband/hw/mlx4/mlx4_ib.h

+74 −0

File changed.

Preview size limit exceeded, changes collapsed.