This post describes the RoCE CNP packet fields, with examples.
- Understanding RoCEv2 Congestion Management
- HowTo Configure RoCE Congestion Control for Windows 2012
- Annex 17 RoCEv2
- Download Wireshark with RoCEv2 Support
RoCEv2 CNP Headers
Here is the RoCEv2 CNP Packet format as described in the standard Annex 17.9.3 RoCEv2:
Here is a wireshark example of this packet:
Note: there is an option to Download Wireshark with RoCEv2 Support, in this case the parsing will be easier.
The CNP data starts in the UDP payload which is the BTH InfiniBand header.
Here are the fields of the BTH header aligned with the example above in hexa 0x81 00 ff ff 40 00 00 d2 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 e4 2d ad 81:
|Field||Size (in bits)||Description||Example (as above)|
Indicates the IBA packet type. The OpCode also specifies which extension headers follow the Base Transport Header
0x81 = 10000001b
As described above, the CNP packet will have this OpCode.
|Solicited Event (SE)||1|
Indicates that an event should be generated by the responder
|MigReq (M)||1||Used to communicate migration state||0|
|Pad Count (PadCnt)||2|
Indicates how many extra bytes are added to the payload to align to a 4 byte boundary
|4||Indicates the version of the IBA Transport Headers.||0|
|Partition Key (P_KEY)||16|
Indicates which logical Partition is associated with this packet
Res1*: Transmitted as 0, ignored on receive. This field is not included in the invariant CRC.
Res1*: Transmitted as 0, ignored on receive. This field is not included in the invariant CRC. see 7.8 CRCs on page 207 for details.
Note: this is part of the 0x40 octet (01000000b).
Transmitted as 0, ignored on receive. This field is not included in the invariant CRC.
|Destination QP (DestQP)||24|
Indicates the Work Queue Pair (QP) Number at the destination.
|0x0000d2 = 210|
Used to indicate that an acknowledge (for this packet) should be scheduled by the responder.
Transmitted as 0, ignored on receive. This field is included in the invariant CRC.
Used to detect a missing or duplicate Packet.