3 Replies Latest reply on Oct 19, 2015 9:32 AM by einave

    How to enable wake-on-la (wol) on a mellanox InfiniBand card ?

      Hi everyone,

       

      I have two computer (A and B) directly connected by an InfiniBand wired.

      I'm interested in sending a magicPacket from computer A thoughout the Infiniband wire to wakeup computer B.

       

      My problem is that I'm struggling to enable wake-on-lan on computer B.

       

      Here are steps that I'm following now

      1. Turn both InfiniBand ports in Ethernet mode

      comA > connectx_port_config (followed by the choice of option 2)

      comB > connectx_port_config (followed by the choice of option 2)

       

      2. Confirm that ports are enable

      comB > ifconfig

      eth1 Link encap:Ethernet  HWaddr 00:02:c9:4d:58:ee
      adr inet6: fe80::202:c9ff:fe4d:58ee/64 Scope:Lien
      UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
      Packets reçus:8003 erreurs:0 :0 overruns:0 frame:0
      TX packets:12075 errors:0 dropped:0 overruns:0 carrier:0
      collisions:0 lg file transmission:1000
      Octets reçus:1901314 (1.9 MB) Octets transmis:2818792 (2.8 MB)

       

      2. Observe characteristics of the Ethernet port on computer B,

      comB > ethtool eth1

      Settings for eth1:

          Supported ports: [ TP ]

          Supported link modes:   10000baseT/Full

          Supported pause frame use: No

          Supports auto-negotiation: No

          Advertised link modes:  10000baseT/Full

          Advertised pause frame use: No

          Advertised auto-negotiation: No

          Speed: 10000Mb/s

          Duplex: Full

          Port: Twisted Pair

          PHYAD: 0

          Transceiver: internal

          Auto-negotiation: off

          MDI-X: Unknown

          Supports Wake-on: d

          Wake-on: d

          Current message level: 0x00000014 (20)

                         link ifdown

         Link detected: yes

       

      3. Confirm that both port are up

      comB > ibstat

      CA 'mlx4_0'

          CA type: MT26428

          Number of ports: 1

          Firmware version: 2.8.600

          Hardware version: b0

          Node GUID: 0x0002c903004d58ee

          System image GUID: 0x0002c903004d58f1

          Port 1:

              State: Active

              Physical state: LinkUp

              Rate: 10

              Base lid: 0

              LMC: 0

              SM lid: 0

              Capability mask: 0x00010000

              Port GUID: 0x0202c9fffe4d58ee

              Link layer: Ethernet

       

      4. Enable the wake-on-lan on computer B

      comB > ethtool -s eth1 wol g

      Cannot set new wake-on-lan settings: Operation not supported

        not setting wol

       

      What am I missing here ?

       

      Any help is welcome !

       

      I'm using Ubuntu 12.04 as operating system and here are characteristifs of both InfiniBand cards

       

      ComA > lspci -v

      01:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0)

              Subsystem: Mellanox Technologies Device 0028

              Physical Slot: 1

              Flags: bus master, fast devsel, latency 0, IRQ 26

              Memory at fb100000 (64-bit, non-prefetchable) [size=1M]

              Memory at f2800000 (64-bit, prefetchable) [size=8M]

              Capabilities: [40] Power Management version 3

              Capabilities: [48] Vital Product Data

              Capabilities: [9c] MSI-X: Enable+ Count=256 Masked-

              Capabilities: [60] Express Endpoint, MSI 00

              Capabilities: [100] Alternative Routing-ID Interpretation (ARI)

              Capabilities: [148] Device Serial Number 00-02-c9-03-00-4d-58-ee

              Kernel driver in use: mlx4_core

              Kernel modules: mlx4_core

       

      ComB > lspci -v

      01:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0)

              Subsystem: Mellanox Technologies Device 0028

              Physical Slot: 1

              Flags: bus master, fast devsel, latency 0, IRQ 26

              Memory at fb100000 (64-bit, non-prefetchable) [size=1M]

              Memory at f2800000 (64-bit, prefetchable) [size=8M]

              Capabilities: [40] Power Management version 3

              Capabilities: [48] Vital Product Data

              Capabilities: [9c] MSI-X: Enable+ Count=256 Masked-

              Capabilities: [60] Express Endpoint, MSI 00

              Capabilities: [100] Alternative Routing-ID Interpretation (ARI)

              Capabilities: [148] Device Serial Number 00-02-c9-03-00-4d-28-f0

              Kernel driver in use: mlx4_core

              Kernel modules: mlx4_core