Getting Started with RoCE Configuration

Version 38

    This post provides a simple method for RoCE Configuration on Mellanox HCAs and switches.

    The below information is applicable for ConnectX-4 and ConnectX-5 family adapter cards only, with MLNX_OFED version 4.1 or WinOF-2 version 1.70 installed.

     

    References

     

    Network Profiles

    The following table maps the configuration types to the relevant network characteristics:

     

    Configuration Mode

    Trust

    VLAN Required

    ECN

    PFC

    RDMA Priority

    Adapter

    Switch

     

     

     

     

     

     

    Linux

    Windows

    MLNX_OS

    Cumulus

    Cisco
    Lossy fabric

    N/A

    No

    Yes

    No

    Any

    link

    link

    link

    soon

    soon

    Lossy fabric with QoS

    Layer 3

    No

    Yes

    No

    DSCP = 26

    link

    link

    link

    soon

    soon

    Layer 2

    Yes

    Yes

    No

    PCP = 3

    link

    N/A

    link

    soon

    soon

    Lossless fabric

    Layer 3

    No

    Yes

    Yes

    DSCP = 26

    link

    link

    link

    soon

    soon

    Layer 2

    Yes

    Yes

    Yes

    PCP = 3

    link

    N/A

    link

    soon

    soon

     

    To understand more about the network characteristics and profile selection, see: Understanding QoS Configuration for RoCE