1 Reply Latest reply on Dec 21, 2017 10:44 PM by leafjingyi

    mellanox connectX3 adapter failed to reach the rational speed

    leafjingyi

      Hello,

              We are using the mellanox connectx3 adapter(Link Speed:40Gps) on windows10 PCs. We also use the proper infiniband cable for this kind of adapter which can provide the rational infiniband speed .

              However, we still failed to reach the rational speed. I use the nd_read_bw to test the speed , it was just about 6Gps. It's further out of our expectation.

              So l use the command "vstat" to show some info about my PC:

      This is vstat result on the same host:11.4.12.11

      C:\Windows\system32>vstat

       

       

              hca_idx=0

              uplink={BUS=PCI_E Gen2, SPEED=5.0 Gbps, WIDTH=x2, CAPS=8.0*x8}

              MSI-X={ENABLED=1, SUPPORTED=128, GRANTED=10, ALL_MASKED=N}

              vendor_id=0x02c9

              vendor_part_id=4099

              hw_ver=0x0

              fw_ver=2.42.5000

              PSID=MT_1100110028

              node_guid=f452:1403:0047:63f0

              num_phys_ports=1

                      port=1

                      port_guid=f452:1403:0047:63f1

                      port_state=PORT_ACTIVE (4)

                      link_speed=10.00 Gbps

                      link_width=4x (2)

                      rate=40.00 Gbps

                      real_rate=32.00 Gbps (QDR)

                      port_phys_state=LINK_UP (5)

                      active_speed=10.00 Gbps

                      sm_lid=0x0004

                      port_lid=0x0004

                      port_lmc=0x0

                      transport=IB

                      max_mtu=4096 (5)

                      active_mtu=4096 (5)

                      GID[0]=fe80:0000:0000:0000:f452:1403:0047:63f1

       

       

      This is test result on the same host:11.4.12.11

       

       

      C:\Windows\system32>nd_read_bw -S 11.4.12.11

      Listening for incoming connection request...

      Connection accepted.

       

       

      C:\Windows\system32>nd_read_bw -S 11.4.12.11

      Listening for incoming connection request...

      Connection accepted.

       

       

      C:\Windows\system32>nd_read_bw -C 11.4.12.11

       

       

      #qp #bytes #iterations    MR [Mmps]     Gb/s     CPU Util.

      0   65536     100000       0.011        5.95     100.00

       

       

      Test finished. Releasing resources...

       

       

      C:\Windows\system32>nd_read_bw -C 11.4.12.11

       

       

      #qp #bytes #iterations    MR [Mmps]     Gb/s     CPU Util.

      0   65536     100000       0.011        5.94     100.00

       

       

      Test finished. Releasing resources...

               Can someone help me solve the problem why we can't reach the rational speed?