1 Reply Latest reply on Mar 3, 2017 1:37 AM by zhangsuo

    How to accelerate 10GE(SR or LR) linkup speed on MCX4121A-XCAT?

    zhaoweiseu

      Hello Admin,

       

      There is an application that need quick linkup on MCX4121A-XCAT to transmit data.

      It will be 3 second later to linkup when compare Intel_82599_NIC+Finisar_Optical_Module with MCX4121A-XCAT+Finisar_Optical_Module.

       

      Configuration:

      1. OpenPower(RHEL7.2) server with both Intel_82599_NIC+Finisar_Optical_Module and MCX4121A-XCAT+Finisar_Optical_Module.

      2. The 2 Finisar_Optical_Modules on Intel_NIC and Mellanox_NIC   is connecting with one optical splitter to remote transmit point via optical cables.

      3. When remote transmit point laser open to ready to transmit data,  Mellanox MCX4121A-XCAT linkup slower 3 seconds than Intel_82599_NIC.

       

      BTW: OFED4.0 and EN3.4 on MCX4121A-XCAT have the same behave.  Firmware updated by the driver installation.

       

      The question is: How to accelerate 10GE(SR or LR) linkup speed on MCX4121A-XCAT?

       

      Thanks for help in advance~

       

      BR/Wei

       

      ----------------------------

      1. used mlxconfig to configure the following paramter, no improvement to reduce linkup speed.

      KEEP_ETH_LINK_UP_P1 True(1)        
      KEEP_IB_LINK_UP_P1 False(0)       
      KEEP_LINK_UP_ON_BOOT_P1 True(1)        
      KEEP_LINK_UP_ON_STANDBY_P1 True(1)         
      KEEP_ETH_LINK_UP_P2 True(1)        
      KEEP_IB_LINK_UP_P2 False(0)       
      KEEP_LINK_UP_ON_BOOT_P2 True(1)        
      KEEP_LINK_UP_ON_STANDBY_P2 True(1)      

      2. mlxreg , time_to_link_up seems relative to linkup speed ,  but it is RO Access.

       

      [root@zoom ~]# mlxreg -d 0003:01:00.0 --show_reg  SLRG
      Field Name          | Address (Bytes) | Offset (Bits) | Size (Bits) | Access 
      =============================================================================
      lane | 0x00000000      | 8             | 4           | INDEX         
      pnat | 0x00000000      | 14            | 2           | INDEX         
      local_port          | 0x00000000      | 16            | 8           | INDEX
      version | 0x00000000      | 24            | 4           | RO            
      status | 0x00000000      | 28            | 4           | RO            
      grade_lane_speed    | 0x00000004      | 0             | 4           | RO            
      time_to_link_up     | 0x00000004      | 16            | 16          | RO            
      grade | 0x00000008      | 0             | 24          | RO            
      grade_version       | 0x00000008      | 24            | 8           | RO            
      height_eo_neg       | 0x00000018      | 0             | 16          | RO            
      height_eo_pos       | 0x00000018      | 16            | 16          | RO            
      phase_eo_neg        | 0x00000020      | 0             | 8           | RO
      phase_eo_pos        | 0x00000020      | 16            | 8           | RO            
      =============================================================================

      3. try to use mlxreg to modify admin_status in PAOS, but don't know what is the value of swid.  -------- Please help.

       

      [root@zoom ~]# mlxreg -d 0003:01:00.0 --show_reg  PAOS
      Field Name      | Address (Bytes) | Offset (Bits) | Size (Bits) | Access 
      =========================================================================
      oper_status     | 0x00000000 | 0             | 4           | RO            
      admin_status    | 0x00000000      | 8             | 4           | RW            
      local_port      | 0x00000000      | 16            | 8           | INDEX         
      swid            | 0x00000000      | 24            | 8           | INDEX
      e | 0x00000004      | 0             | 2           | RW
      ee | 0x00000004      | 30            | 1           | WO            
      ase             | 0x00000004      | 31            | 1           | WO            
      =========================================================================