I'm having trouble on a machine that was previously running Ubuntu 16.10 and was just upgraded today to 17.04 using ConnectX-3 cards. This machine is using a Super Micro X8SIA-F motherboard. I have another machine running a more modern motherboard that was also on 16.10 with the inbox drivers and was upgraded to 17.04 that is using a ConnectX-3 card. The problem I'm having with the older rig is no Ethernet devices show up for the ConnectX-3 card (meaning when I run ifconfig or ip addr, no devices for the card show up).
The card seems to be getting detected Ok (output from lspci):
05:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]
Output from lshw:
*-pci:1 description: PCI bridge product: HIO524G2 PCI Express Gen2 Switch vendor: Integrated Device Technology, Inc. [IDT] physical id: 4 bus info: pci@0000:03:04.0 version: 02 width: 32 bits clock: 33MHz capabilities: pci pciexpress pm msi normal_decode bus_master cap_list configuration: driver=pcieport resources: irq:35 memory:fb000000-fb1fffff *-network UNCLAIMED description: Network controller product: MT27500 Family [ConnectX-3] vendor: Mellanox Technologies physical id: 0 bus info: pci@0000:05:00.0 version: 00 width: 64 bits clock: 33MHz capabilities: pm vpd msix pciexpress cap_list configuration: latency=0 resources: memory:fb000000-fb0fffff memory:fb100000-fb1fff ff
The unique thing about the lshw output is the "UNCLAIMED" bit after network.
Necessary modules seem to be loaded:
$ sudo lsmod | grep mlx mlx4_en 114688 0 ptp 20480 2 e1000e,mlx4_en mlx4_core 294912 1 mlx4_en devlink 32768 2 mlx4_en,mlx4_core
I thought maybe I needed to edit the port type by writing into /sys/bus/pci/devices/0000\:05\:00.0/, but I couldn't create the mlx4_port1 or mlx4_port2 files when logged in as root. I even tried runlevel 1, but no matter what , I was getting permission denied errors. On my other machine, those files exist by default. Not sure, what to do at this point. I know it's not a card issue because I swapped a card from the working machine and symptoms were the same.
If anyone knows what the possible issue might be, I'd appreciate any insight.