I am using the ConnectX-3 EN (BCBT) in a Centos 6.5 server to generate packets (proprietary packet generation software) for my test network. Most of the time, the NIC operates as expected but over the course of my 12 hour test run, I see the NIC get into a state where every 256th packet is sent on the wire tagged with VLAN 0. When in this state, wireshark on the Linux server shows that the outgoing packet has my configured VLAN tag (VLAN id = 11) but if I Wireshark the receiving port, I see every 256th packet has the wrong VLAN id (0). This leads me to believe it is a problem in the driver/firmware (since wireshark is reporting the packet as sent to the NIC for tx). Once in the offending state, I connected two ConnectX-3 EN (BCBT) back to back (to rule out my test network) and I still see the issue.
Is this a known issue? Has anyone seen anything similar?
Attached are the details of the packet as transmitted and received, the ethool output for the NIC in question, and server details.
Upgrade the connectX-3 EN to the latest firmware/driver then confirm if you still experiencing the same issue.
This seem like an issue unique to your environment.