5 Replies Latest reply on Mar 6, 2017 7:07 AM by alkx

    How to configure two HCAs in a compute node?

    rollyng

      Hi,

      I am trying to install 2 Connect-X3 HCAs in a compute node. Each HCA was inserted to corresponding PCIe slot of a CPU and I have installed Ubuntu 16.04 LTS.

      Ubuntu detects the HCAs and I can see them with sudo lspci | grep "Mellanox".

      I am doing this because I would like to install 4 Xeon Phi co-processor to the node and each Phi will be linked to respective HCA of the same CPU. Each Phi needs an IP in the cluster.

      For example,

      HCA1 ib0 192.168.8.7, Phi_0 192.168.8.70, Phi_1 192.168.8.71

      HCA2 ib0 192.168.8.8, Phi_2 192.168.8.80, Phi_3 192.168.8.81

      I will install MLNX_OFED_LINUX-3.4-2.0.0.0-ubuntu16.04-x86_64 on the node, so what is the best practice to achieve such configuration?

      My experience with phi installation on Ubuntu 16.04 is successful.

      How to setup 4 Xeon Phi 7120P in a single node via Infiniband?

      Thank you,

      Rolly