9 Replies Latest reply on Jul 26, 2013 8:50 AM by branko

    opensmd fails to start on connectx-3 card

      my opensmd daemon will not start, instead it logs this error

       

      Jul 25 16:54:59 606856 [9957B700] 0x80 -> OpenSM 4.0.0.MLNX20130311.156f5c0

      Entering DISCOVERING state

       

      Jul 25 16:54:59 607626 [9957B700] 0x02 -> osm_vendor_init: 1000 pending umads specified

      Jul 25 16:54:59 607706 [9957B700] 0x80 -> Entering DISCOVERING state

      Jul 25 16:54:59 607812 [9957B700] 0x02 -> osm_vendor_bind: Mgmt class 0x81 binding to port GUID 0x202c9fffe242ce1

      Jul 25 16:54:59 614548 [9957B700] 0x01 -> osm_vendor_bind: ERR 5426: Unable to register class 129 version 1

      Jul 25 16:54:59 614562 [9957B700] 0x01 -> osm_sm_mad_ctrl_bind: ERR 3118: Vendor specific bind failed

      Jul 25 16:54:59 614590 [9957B700] 0x01 -> osm_sm_bind: ERR 2E10: SM MAD Controller bind failed (IB_ERROR)

       

      Error from osm_opensm_bind (0x2A)

      Perhaps another instance of OpenSM is already running

      Jul 25 16:54:59 614609 [9957B700] 0x01 -> perfmgr_mad_unbind: ERR 5405: No previous bind

      Jul 25 16:54:59 614615 [9957B700] 0x01 -> osm_congestion_control_shutdown: ERR C108: No previous bind

      Jul 25 16:54:59 614621 [9957B700] 0x01 -> osm_sa_mad_ctrl_unbind: ERR 1A11: No previous bind

      Exiting SM

        • Re: opensmd fails to start on connectx-3 card
          branko

          Hi, note that opensm can be run as a daemon -- are you sure there are no other instances running on the system? If no, then you may be missing some of the underlying userspace libraries needed for the SM to function correctly?

           

          Which ConnectX-3 card are you using? Can you run:

          # lspci -v | grep Mellanox

           

          Also, are the port in InfiniBand mode? Can you run:

          # connectx_port_config

           

          Also, do you have the correct (and latest) firmware version installed? Can you run:

          # ibstat

            • Re: opensmd fails to start on connectx-3 card

              05:00.0 Ethernet controller: Mellanox Technologies MT27500 Family [ConnectX-3]

                  Subsystem: Mellanox Technologies Device 0049

               

              both ports are in ETH mode, however changing to ib mode fails with this error

               

              ConnectX PCI devices :

              |----------------------------|

              | 1             0000:05:00.0 |

              |----------------------------|

               

              Before port change:

              eth

              eth

               

              |----------------------------|

              | Possible port modes:       |

              | 1: Infiniband              |

              | 2: Ethernet                |

              | 3: AutoSense               |

              |----------------------------|

              Select mode for port 1 (1,2,3): 1

              Select mode for port 2 (1,2,3): 1

              WARNING: Illegal port configuration attempted,

                  Please view dmesg for details.

               

              my dmesg output is as follows:

               

               

               

              mlx4_core 0000:05:00.0: Only same port types supported on this HCA, aborting.

              mlx4_core 0000:05:00.0: Only same port types supported on this HCA, aborting.

              mlx4_core 0000:05:00.0: Requested port type for port 1 is not supported on this HCA

              mlx4_core 0000:05:00.0: Requested port type for port 1 is not supported on this HCA

               

              this is despite having selected infiniband for both ports.  firmware is as follows:

               

               

              CA 'mlx4_0'

                  CA type: MT4099

                  Number of ports: 2

                  Firmware version: 2.30.3000

                  Hardware version: 1

                  Node GUID: 0x0002c90300242ce0

                  System image GUID: 0x0002c90300242ce0