Hello everyone. I am running into what I think is a compatibility issue. I hope someone has ran into this before.
Server: Dell R710 w/ PCIe 2.0 x8
NIC: MT26428 (ConnectX VPI - 10GigE / IB QDR, PCIe 2.0 5GT/s)
NIC Firmware: 2.9.1000
Driver: nmlx4_en <---what ESXi uses
Software: Server is running ESXi 6.5
IB Switch: MSX6005-2BFS (Unmanaged)
When ESXi or XenServer boots, it loads the Ethernet driver, and I am able to establish a 10gb connection using the ethernet protocol, but I cannot get the IB protocol working and a connection will not establish between NIC and IB switch. I couldnt get the 6.0 VIB's installed on 6.5 just because of versioning.
Anyone else have luck getting IB working?
I think you have the answer within your current setup description...
you are using native Mellanox Ethernet driver (nmlx4_en) so you'll get working only ETH protocol, which explains why you were able to get the 10Gb ETH connection
Moreover, all nmlx4 drivers within Esxi6.5 OS are officially not supporting CX-2 adapters anymore (EOL)