3 Replies Latest reply on Aug 31, 2016 11:57 AM by ophirmaor

    vSphere 6.0 PFC configuration for Ethernet iSER with Ethernet Driver 1.9.10.5

    inbusiness

      I want to use iSER on vSphere 6.0 environment.

      I was setup SX6036G to enable PFC and PFC priority 3 & all ethernet port to support it.

      But iSER initiator can see iSER Target but can't connect to LUN.

      I think last step is ESXi host configuration.

       

      mlx4_en driver have a pfc configurtaion and here is some options.

       

      # esxcli system module parameters list -m=mlx4_en

      Name               Type  Value  Description                                                                                                                                                                                                                                            

      -----------------  ----  -----  ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

      enable_device_rss  int          Enable device RSS (1 - enabled, 0 - disabled, default: 0)

              This mode is not compatible with NETQ RSS. Once activated, NETQ RSS is disabled and all rings are managed by RSS                                                                         

      heap_initial       int          Initial heap size allocated for the driver.                                                                                                                                                                                                            

      heap_max           int          Maximum attainable heap size for the driver.                                                                                                                                                                                                           

      inline_thold       uint         threshold for using inline data                                                                                                                                                                                                                        

      pfcrx              int          Priority based Flow Control policy on RX (0x0-0xff, default: 0x0)

              It's 8 bits bit mask, each bit indicates priority [0-7]. Bit value:

                 1 - respect pause frames on the specified priority.

                 0 - ignore pause frames on the specified  priority.

      pfctx              int          Priority based Flow Control policy on TX (0x0-0xff, default: 0x0)

              It's 8 bits bit mask, each bit indicates priority [0-7]. Bit value:

                 1 - respect pause frames on the specified priority.

                 0 - ignore pause frames on the specified  priority.

      rx_ring_size       int          RX ring size (64 -8192, default: 512)

              Must be power of 2                                                                                                                                                                                             

      skb_mpool_initial  int          Driver's minimum private socket buffer memory pool size.                                                                                                                                                                                               

      skb_mpool_max      int          Maximum attainable private socket buffer memory pool size for the driver.                                                                                                                                                                              

      tx_ring_size       int          TX ring size (64 -8192, default: 512)

              Must be power of 2                                                                                                                                                                                             

      udp_rss            int          Enable RSS for incoming UDP traffic (1 - enabled, 0 - disabled, default: 1)

       

      How can I configure pfcrx, pfctx?

       

      I tried pfcrx = 3, pfctx = 3 and pfcrx = 0x08, pfctx = 0x08

      But 0x08 value shows a error in host profile because that's not a supported values...:(

       

      I found link in this communities.

       

      HowTo Run RoCE and TCP over L2 Enabled with PFC

       

      How can I configure specific VLAN acts a loseless network with PFC?

       

      Message was edited by: Jae-Hoon Choi