3 Replies Latest reply on Nov 27, 2015 4:48 AM by gencap

    Configure SM on SX6036 to match opensmd configuration for OpenStack Mellanox Plugin (IB)

    gencap

      I'm deploying a test OpenStack environment using Fuel community edition 6.1 with Mellanox Fuel Plugin, over InfiniBand networking.

      In order to "free up" an additional node, I'm trying to move my Subnet Manager from a "bare" CentOS node to the local SM in SX6036.

       

      I never configured the local SM on the IB switch, so I started with a clean default configuration, having only the "default" entry (PKey 0x7ffff) with its (fixed?) parameters.

       

      In "IB SM Mgmt -> Partitions" I have created my 12 PKeys, specifying their Name ("vlanX"), PKey hex value, Default Member = full and SL = 0.

       

      Once added my 12 PKeys, I stopped the remote opensmd on the computing node and started the local SM on the SX6036.

       

      The result was disappointing: "Verify Networks" failed, before the OpenStack environment deployment.

      All the VLANs (2-9,101-102) were not reachable, while the former "opensm" configuration worked flawlessly.

       

      I think that the problem could be related to an incomplete "porting" of the opensm config files to the internal SX6038 SM.

      In particular, I didn't find any way to "translate" the "allow_both_pkeys TRUE" config-line present in opensm.conf.

       

      Is any furter configuration needed?

       

      TIA,

      GC.

       

      PS: this is my partitions.conf:

      management=0x7fff,ipoib, sl=0, defmember=full : ALL, ALL_SWITCHES=full,SELF=full;

      vlan1=0x1, ipoib, sl=0, defmember=full : ALL;

      vlan2=0x2, ipoib, sl=0, defmember=full : ALL;

      vlan3=0x3, ipoib, sl=0, defmember=full : ALL;

      vlan4=0x4, ipoib, sl=0, defmember=full : ALL;

      vlan5=0x5, ipoib, sl=0, defmember=full : ALL;

      vlan6=0x6, ipoib, sl=0, defmember=full : ALL;

      vlan7=0x7, ipoib, sl=0, defmember=full : ALL;

      vlan8=0x8, ipoib, sl=0, defmember=full : ALL;

      vlan9=0x9, ipoib, sl=0, defmember=full : ALL;

      vlan10=0xa, ipoib, sl=0, defmember=full : ALL;

      vlan101=0x65, ipoib, sl=0, defmember=full : ALL;

      vlan102=0x66, ipoib, sl=0, defmember=full : ALL;