0 Replies Latest reply on Dec 7, 2018 4:29 AM by hughen

    ethernet_read_keys: Couldn't read remote address

    hughen

      Background

      Two host, host1 ib0: 192.168.2.1, host2 ib0: 192.168.2.2

       

      Topology

      host1 ib0 <=> MSX6018F-1SFS <=> host2 ib0

       

      In host1:

      ibv_devinfo
      hca_id: mlx4_0
              transport:                      InfiniBand (0)
              fw_ver:                         2.42.5000
              node_guid:                      (hidden)
              sys_image_guid:                 (hidden)
              vendor_id:                      0x02c9
              vendor_part_id:                 4099
              hw_ver:                         0x1
              board_id:                       (hidden)
              phys_port_cnt:                  1
              Device ports:
                      port:   1
                              state:                  PORT_ACTIVE (4)
                              max_mtu:                4096 (5)
                              active_mtu:             4096 (5)
                              sm_lid:                 1
                              port_lid:               1
                              port_lmc:               0x00
                              link_layer:             InfiniBand
      

       

      In host2:

      ibv_devinfo
      hca_id: mlx4_0
              transport:                      InfiniBand (0)
              fw_ver:                         2.42.5000
              node_guid:                      (hidden)
              sys_image_guid:                 (hidden)
              vendor_id:                      0x02c9
              vendor_part_id:                 4099
              hw_ver:                         0x1
              board_id:                       (hidden)
              phys_port_cnt:                  1
              Device ports:
                      port:   1
                              state:                  PORT_ACTIVE (4)
                              max_mtu:                4096 (5)
                              active_mtu:             4096 (5)
                              sm_lid:                 1
                              port_lid:               3
                              port_lmc:               0x00
                              link_layer:             InfiniBand
      

       

       

      In host1:

      ib_write_bw -a
      ************************************
      * Waiting for client to connect... *
      ************************************
      Couldn't get device attributes
      ---------------------------------------------------------------------------------------
                          RDMA_Write BW Test
       Dual-port       : OFF          Device         : mlx4_0
       Number of qps   : 1            Transport type : IB
       Connection type : RC           Using SRQ      : OFF
       CQ Moderation   : 100
       Mtu             : 2048[B]
       Link type       : IB
       Max inline data : 0[B]
       rdma_cm QPs     : OFF
       Data ex. method : Ethernet
      ---------------------------------------------------------------------------------------
       local address: LID 0x01 QPN 0x0244 PSN 0x968878 RKey 0x60010100 VAddr 0x007f558e61d000
      ethernet_read_keys: Couldn't read remote address
       Unable to read to socket/rdam_cm
       Failed to exchange data between server and clients
      

       

      In host2:

      ib_write_bw -a 192.168.2.1
      Couldn't get device attributes
      Couldn't allocate MR
      failed to create mr
      Failed to create MR
       Couldn't create IB resources
      

       

      But if I test this on the same host, everything is normal.

      Why is there such a problem as me?

      Host1 and host2 can ping each other, ethernet is unobstructed