Getting Started with RoCE Configuration

Version 18

    This post supplies easy start and navigation for basic RoCE Configuration on Mellanox adapter and switches as well as 3rd party switches.

    The below information is applicable for ConnectX-4/4Lx/5 adapters only, with MLNX_OFED version 4.1.

     

    References

     

    Network Profiles

    The following table maps configuration types to relevant network characteristics.

     

    ProfileConfiguration
    Trust layer

    VLAN

    required

    ECNPFC

    RDMA

    PCP/DSCP

    Adapter

    (Linux)

    Spectrum

    (MLNX-OS)

    Profile 1Resilient RoCE, no QoSN/A (any)noprio=any(0)noany(0)linklink
    Profile 2Resilient RoCE, QoS, L2 networkL2yesprio=3noPCP=3linklink
    Profile 3Resilient RoCE, QoS, L3 networkL3noprio=3noDSCP=26linklink
    Profile 4Lossless RoCE, QoS, L2 networkL2yesprio=3yesPCP=3linklink
    Profile 5Lossless RoCE, QoS, L3 networkL3noprio=3yesDSCP=26linklink

     

    To understand more about the network characteristics and profile selection see Understanding QoS Configuration for RoCE (Profile Selection)