I have seen delays getting the links up on our systems. I have not investigated it since it is not an issue.
Have you tried adjusting any of the subnet manager configurations? I assume that you have the SM running on the switch? Perhaps there are sweep timings or caching that can be adjusted to improve the startup time.
I'm also tried adjust sweep time in my SM configuration.
But getting the link-up delay was exist.
There is not a link-up delay that I was change the switch to DDR switch with SM.
(I have some hybrid cables and DDR Switchs, too)
vSphere driver loading and immediatly logical link-up established on DDR switch environments.
Is there any user or admins on vSphere environments with above QDR switches?
What do you mean by linkup delay? the time that takes to the physical link to come up?
It means logical link with ZFS SRPT.
logical... does that mean:
"no issues with physical link. it comes up as expected. but the ZFS SRPT connection takes time..." right?
If yes, on the very basic level - how long until the server gets LID from the SM? and how long from that event until the ZFS connection is established?
what type of SM are you using?
SM is embedded in Voltaire 4036 QDR switch.
Major problem is your vSphere SRP Initiator.
This driver doesn't disconnect (logout) from ZFS SRPT when ESXi host reboot everytimes.
Frankly speak logical link-up is not a problem.
Major problem is vSphere OFED 1.8.2 SRP Initiator's behavior to reconnect to ZFS SRPT when host reboot.
Sometimes repeat this rejection and then connect to ZFS SRPT.
But this is late for ESXi host's auto start VM function.
Cause this problem, I'm alway use dummy IPoIB iSCSI target on ZFS storage
and configure IPoIB iSCSI Initiator every ESXi host for late ZFS SRPT connection.
Do you have any solution?
Hi! I found the root of problem.
When ESXi host reboot vSphere OFED 22.214.171.124 doesn't logout from SRP Target.
If stop the ibd daemon on ESXi host with "/opt/mellanox/bin/openib.sh stop" command then
ZFS Comstar SRP Target will ACK the vSphere SRP initiator logout from SRP Target and
ESXi VM Auto Start will work...:)
But If you have a plan to release a new vSphere OFED, this problem should be resolve...!!