It is found that when configuring the adapter as RoCEv2 by “options mlx4_core roce_mode=0000:81:00.0-1,0000:84:00.0-1”, after OS rebooting, one MT4103 can not work well. But there is nothing wrong for another one with the same firmware.
The port state always shows “Disabled" as below:
# ibstat mlx4_1
CA type: MT4103
Number of ports: 1
Firmware version: 2.42.5000
Hardware version: 0
Node GUID: 0xe41d2d030029ecb0
System image GUID: 0xe41d2d030029ecb0
Physical state: Disabled
Base lid: 0
SM lid: 0
Capability mask: 0x04010000
Port GUID: 0xe61d2dfffe29ecb0
Link layer: Ethernet
And related ethnet interface’s link can not be detectable, but actually the cable is connected.
# ethtool ens259
Settings for ens259:
Supported ports: [ FIBRE ]
Supported link modes: 1000baseKX/Full
Supported pause frame use: Symmetric Receive-only
Supports auto-negotiation: No
Advertised link modes: 1000baseKX/Full
Advertised pause frame use: Symmetric
Advertised auto-negotiation: No
Duplex: Unknown! (255)
Supports Wake-on: d
Current message level: 0x00000014 (20)
Link detected: no
I have tried OFED driver of MLNX_OFED_LINUX-4.4-18.104.22.168-rhel7.4-x86_64 and MLNX_OFED_LINUX-4.4-22.214.171.124-rhel7.4-x86_64. Neither can work.
The switch is Dell 4048-on.
So, what is the problem with one MT4103? How can I enable the physical port?