Mellanox Adapters - Comparison Table

Version 25

    This post shows the main differences and feature support on the latest Mellanox adapters.

    This post is basic and aimed for FAE and IT managers.

     

    References

     

    The following table is wide and might require zooming out for the full view (last column is "References and Notes").

    ClassFeatureConnectX-3ConnectX-3 ProConnectX-4ConnectX-4 LxConnectX-5
    ConnectX-6
    References and Notes
    InterfacePort/Speed options2 ports of 10/40/56GbE2 ports of 10/40/56GbE2 ports of 100/56/50/40/25/10GbE

    2 ports of 10/25GbE

    1 port of 40/50GbE

    2 ports of 100/56/50/40/25/10GbE2 ports of 200/100/56/50/40/25/10GbENote: There various of adapter cards. Some OPNs for example could be speed limited, e.g.ConnectX-4 FDR (that won’t link up EDR) or Connect-IB that is x8 only and not x16.
    InterfacePCIex8 Gen3x8 Gen3x8, x16 Gen3x8 Gen3

    x16 Gen3

    x16 Gen4

    2x Gen3 x16

    Gen4 x16

    InterfacePCIe SwitchPCIe x16PCIe x32
    InterfaceCoherent Accelerator Processor Interface (CAPI)----Supported (v2)Supported (v2)

    IBM - Coherent Accelerator Processor Interface (CAPI)

    http://openpowerfoundation.org/blogs/interconnect-your-future-mellanox-100gb-edr-capi-infiniband-and-interconnects/

    IB RDMA / RoCEIB RDMA / RoCEIB RDMA, RoCE*IB RDMA, RoCE

    IB RDMA, RoCE

    RoCEIB RDMA, RoCEIB RDMA, RoCE

    RDMA/RoCE Solutions

    RoCERoCE Congestion Control-SupportedSupportedSupportedSupportedSupported

    RDMA/RoCE Solutions

    Understanding RoCEv2 Congestion Management

    RoCEv2 CNP Packet Format Example

    HowTo Configure RoCE Congestion Control for Windows 2012

    HPC

    CORE-Direct®

    SupportedSupportedSupportedSupportedSupportedSupported

    Exploited by FCA and extended by Mellanox SHARP technology.

    http://www.mellanox.com/related-docs/whitepapers/TB_CORE-Direct.pdf

    HPCPeerDirect®SupportedSupportedSupportedSupportedSupportedSupported

    GPU Direct Uses PeerDirect.

    http://www.mellanox.com/page/products_dyn?product_family=116

    HPC

    Dynamically Connected Transport (DCT)--SupportedSupportedSupportedSupportedhttp://www.mellanox.com/related-docs/applications/SB_Connect-IB.pdf

    CPU Offloads

    Stateless Ethernet offloadSupportedSupportedSupported + LRO, LSOv2Supported + LRO, LSOv2Supported + LRO, LSOv2Supported + LRO, LSOv2

    LRO = Large Receive Offload.

    LSO = Large Send offload.

    See MLNX_OFED User Manual for more info.

    CPU OffloadsRSS (MAC, VLAN 5 Tuple)SupportedSupportedSupported +Supported +Supported +Supported +
    VirtualizationSR-IOVSupportedSupportedSupportedSupportedSupportedSupportedVirtualization Solutions
    VirtualizationMulti Host--4 hosts4 hosts4 hosts8 hostshttp://www.mellanox.com/page/products_dyn?product_family=210&mtag=multihost
    Open V-Switch (OVS)OVS Offload---SupportedSupported +Supported +

    Describes whether the adapters can run the OVS data-plane in HW. Supported means that at least matching for a specific flow is performed in HW. Supported+ means that HW Encap/Decap is also included.

    See http://www.mellanox.com/page/asap2.

    Overlay Network

    Stateless offload-SupportedVXLAN / NVGRE / GENEVEVXLAN / NVGRE / GENEVEVXLAN / NVGRE / GENEVE and FlexParseVXLAN / NVGRE / GENEVE and FlexParseVirtualization Solutions

    Overlay Network

    (VXLAN/NVGRE)

    Encap/Decap (in HW)---SupportedSupportedSupported
    StorageErasure Coding Offload--SupportedSupportedSupportedSupported

    Reed Solomon Erasure Coding hardware offload is supported by the adapters.

    Verbs API are available.

    Understanding Erasure Coding Offload

    StorageT10/DIF Signature Handover--Supported-SupportedSupportedHowTo Enable T10-PI (T10-DIF) Data Integrity Protection in iSER with LIO Target
    Storage

    NVMe oF Target Offload

    (also for Burst Buffer)

    ----SupportedSupported +
    StorageHost Chaining----SupportedSupported
    Cloud IntegrationMirantis Fuel

    Supported Fuel 7.0/8.0

    Supported Fuel 7.0/8.0Supported Fuel 8.0Supported Fuel 8.0SupportedSupported

    Cloud Solutions

    Media & EntertainmentPacket Pacing--SupportedSupportedSupportedSupported
    SecuritySecure Firmware update--SupportedSupportedSupportedSupported
    SecuritySecure Boot-----Supported

    * Partial support. Contact Mellanox for details.