The incompatible drivers & platforms that you're using seem to be the root cause of the PSOD
- SRP initiator mlnx_ofed_esxi ver126.96.36.199 is not supporting ESXi 6.
- It support Esxi5.X only, which proved to work fine in your case
- As for iSER over RoCE v1 - ConnectX-3(10G 40G) is supported with Esxi6.and using mlnx eth driver v188.8.131.52, yet Solaris OS as a target was not tested therefore we cannot commit stable workability
Suggesting to approach Mellanox rlease note & user-manual to get more insight on the iSER supported oprtions
I'm also try ETH driver 184.108.40.206 with my MCX354A-FCBT at ETH mode with mlnxconfig.
When I boot the ESXi 6.0u2 host with SX6036G ETH port mode shows me a 56Gb Ethernet link up, but vSphere network tab shows me a 10Gb link up...:(
What do you think about it?
Does it just display incorrectly unlike SX6036G's MLNX-OS?
I found some informant for new vSphere 6.5 native driver model.
VMware change driver model in vSphere 6.5.
That doesn't permit to use vKernel driver like Mellanox old SRP, iSER for IB driver model.
That's a big change, VMware will launch new ESXi 6.5 updates then support new driver that I can't say it will be include iSER with IB.
But Mellanox said new ESXi update include SRIOV in IPoIB, but never said about iSER in IB or ETH mode.
VMware shows a very big bad hobby in historically.
That always change their product name and driver model.
That's why Mellanox can't support RDMA storage protocol on latest ESXi update.
VMware's new native driver interact with ESXi hypervisor directly.
Therefore VMware must work to embedded iSER driver (IB or ETH) like TCP/IP iSCSI initiator.