1 Reply Latest reply on Apr 12, 2017 4:45 AM by aviap

    Not able to run Open Fabic nvm cli with Mellanox OFED stack

    ramakris

      Hi,

       

      I can able to use nvme connect and nvme discovery cli with inbox OFED stack as per the below procedure.

      https://community.mellanox.com/docs/DOC-2504#jive_content_id_Using_MLNX_OFED

      The above document specifying with MLNX OFED 3.4.2 stack we can able to run NVME Over Open Farbrics (nvme cli).

      For us the observations are like this.

       

      1. when I install NVME Over Farbrics kernel, I can able to run nvme cli as per above document

      2. After installing MLNX OFED stack 3.4.2 to run ibdump, the MLNX OFED stack removing existing rdma driver. it will inserts its own dummy rdma driver

      3.  After this step if I run nvme cli, it is failing to execute.

       

      I would like to take ibdump with nvme cli execution of Open Fabric.

      Please help me on this.

        • Re: Not able to run Open Fabic nvm cli with Mellanox OFED stack
          aviap

          Not sure I understand what you mean by "... it will inserts its own dummy rdma driver"

          Mellanox OFED derives from Open fabric and the rdma modules within Mellanox OFEd package are aligned with the standard RDMA

          I also assume you have installed mlnx_ofed v3.4.2 using the pre-required  --add-kernel-support flag

          However if you use NVMEoF with mlnx_ofed you need to ensure that your Linux kernel version is 4.8.x , other wise NVMEoF is not supported

          Have you ensured that RDMA layer is configured properly and that it is running?
          this is mandatory to implement and test before running nvme-cli. (use tests such as ib_send_bw,ib_write_bw)

          Make sure the Mellanox adapter is on the top of the latest fw

           

          In case above is implemented and problem persist, suggesting to approach mellanox support and open a support ticket for further assistance