RoCE Modes and Defaults on Mellanox Adapters

Version 2

    This post discusses RoCE modes and defaults for each Mellanox network adapter.

    The post is basic and is meant for beginners.

     

    References

     

     

    There are two modes for RoCE: RoCEv1 and RoCEv2.

    An adapter can be configured with either mode (per supported distribution), but the default mode differs - depending on the adapter family.

     

     

    AdapterDefault RoCE Mode (OFED, WinOF-2)

    ConnectX-3,

    ConnectX-3 Pro

    RoCEv1

    ConnectX-4

    ConnectX-4 Lx

    RoCEv2

     

    If you wish to run RoCE between two hosts that have different Mellanox adapters installed, make sure to align the adapters to run the same RoCE mode.