0 Replies Latest reply on Mar 2, 2015 3:18 PM by steved

    connectx 2 eth mode between two hosts with passive copper cable

      Hello,

       

      I've put connectx 2 adapters into eth mode on two hosts, and connected them with a passive copper cable (QSFP). The link state comes up but I cannot get any connectivity between the hosts.

       

      ib mode works when the hosts are connected to a switch so it seems like the cables and nics are working properly.

       

      When I ping host A -> host B in eth mode (no switch) I get no response. I do see rx_crc_errors which seems to point to a physical issue.

       

      OS: CentOS 7

       

      HostA:

      ifconfig

      eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500

              inet 192.168.199.1  netmask 255.255.255.0  broadcast 192.168.199.255

              inet6 fe80::f652:14ff:fed4:8035  prefixlen 64  scopeid 0x20<link>

              ether f4:52:14:d4:80:35  txqueuelen 1000  (Ethernet)

              RX packets 0  bytes 0 (0.0 B)

              RX errors 35  dropped 0  overruns 0  frame 35

              TX packets 51  bytes 8429 (8.2 KiB)

              TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

       

       

      ethtool

      rx_crc_errors: 35

       

      Settings for eth0:

          Supported ports: [ TP ]

          Supported link modes:   10000baseT/Full

          Supported pause frame use: No

          Supports auto-negotiation: No

          Advertised link modes:  10000baseT/Full

          Advertised pause frame use: No

          Advertised auto-negotiation: No

          Speed: 10000Mb/s

          Duplex: Full

          Port: Twisted Pair

          PHYAD: 0

          Transceiver: internal

          Auto-negotiation: off

          MDI-X: Unknown

          Supports Wake-on: d

          Wake-on: d

          Current message level: 0x00000014 (20)

                         link ifdown

          Link detected: yes

       

      driver: mlx4_en

      version: 2.0 (Dec 2011)

      firmware-version: 2.9.1000

      bus-info: 0000:07:00.0

      supports-statistics: yes

      supports-test: yes

      supports-eeprom-access: no

      supports-register-dump: no

      supports-priv-flags: no

       

       

      HostB:

      ifconfig

      eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500

              inet 192.168.199.2  netmask 255.255.255.0  broadcast 192.168.199.255

              inet6 fe80::f652:14ff:fed4:8034  prefixlen 64  scopeid 0x20<link>

              ether f4:52:14:d4:80:34  txqueuelen 1000  (Ethernet)

              RX packets 0  bytes 0 (0.0 B)

              RX errors 0  dropped 0  overruns 0  frame 0

              TX packets 38  bytes 6640 (6.4 KiB)

              TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

      ethtool

      (no errors)

       

      Settings for eth0:

          Supported ports: [ TP ]

          Supported link modes:   10000baseT/Full

          Supported pause frame use: No

          Supports auto-negotiation: No

          Advertised link modes:  10000baseT/Full

          Advertised pause frame use: No

          Advertised auto-negotiation: No

          Speed: 10000Mb/s

          Duplex: Full

          Port: Twisted Pair

          PHYAD: 0

          Transceiver: internal

          Auto-negotiation: off

          MDI-X: Unknown

          Supports Wake-on: d

          Wake-on: d

          Current message level: 0x00000014 (20)

                         link ifdown

          Link detected: yes

       

      driver: mlx4_en

      version: 2.0 (Dec 2011)

      firmware-version: 2.9.1000

      bus-info: 0000:06:00.0

      supports-statistics: yes

      supports-test: yes

      supports-eeprom-access: no

      supports-register-dump: no

      supports-priv-flags: no