Configuring InfiniBand devices

Limitations

• As the admin panel only shows IP states and does not show InfiniBand (IB) connection states, it may report plugged in but yet unconfigured IB devices as Disconnected. The status will change to Connected once you assign an IP address to such a device.

Prerequisites

• The Storage traffic type is moved to a dedicated network.

To configure InfiniBand devices

1. On the Infrastructure > Networks screen, assign the traffic type Storage to an empty network (without any other traffic types). If needed, create a new network by clicking Create network.
2. On the Infrastructure > Nodes screen, click the name of the node, go to the Network interfaces tab, and then click the network interface.
3. On the interface right pane, click Edit.
4. In the Edit network interface window, specify the network with the Storage traffic type, select Manually, and then specify the IP address in CIDR notation by clicking Add.
5. Specify a gateway. The provided gateway will become the node’s default.
6. Select Connected mode.

7. Enter the 65520 value in the MTU field.

   Setting a custom MTU in the admin panel prior to configuring it on the network hardware will result in network failure on the node and require manual resetting. Setting an MTU that differs from the one configured on the network hardware may result in a network outage or poor performance.

8. Click Save to apply your changes.
9. Repeat the steps for each IB device on your infrastructure nodes.