1 Reply Latest reply on Jul 28, 2016 10:36 AM by sophie

    mlx4_0, memreg 5 slots 32 ird 16

    atulyadavtech

      Hi Team,

       

      in our enviorment we implemented NFS over RDMA with the help of mellanox community.

      All things are working fine, but in log file continuously below mention error is coming

      rpcrdma: connection to 172.16.2.240:20049 on mlx4_0, memreg 5 slots 32 ird 16

      rpcrdma: connection to 172.16.2.240:20049 closed (-103)

      rpcrdma: connection to 172.16.2.240:20049 on mlx4_0, memreg 5 slots 32 ird 16

      rpcrdma: connection to 172.16.2.240:20049 closed (-103)

      rpcrdma: connection to 172.16.2.240:20049 on mlx4_0, memreg 5 slots 32 ird 16

       

      Need your guidance to resolve the issue.

       

      Environment Details:-

      ---- Performing Adapter Device Self Test ----

      Number of CAs Detected ................. 1

      PCI Device Check ....................... PASS

      Kernel Arch ............................ x86_64

      Host Driver Version .................... MLNX_OFED_LINUX-3.3-1.0.0.0 (OFED-3.3-1.0.0): 2.6.32-573.el6.x86_64

      Host Driver RPM Check .................. PASS

      Firmware on CA #0 VPI .................. v2.35.5000

      Firmware Check on CA #0 (VPI) .......... NA

          REASON: NO required fw version

      Host Driver Initialization ............. PASS

      Number of CA Ports Active .............. 1

      Port State of Port #1 on CA #0 (VPI)..... UP 4X FDR (InfiniBand)

      Error Counter Check on CA #0 (VPI)...... PASS

      Kernel Syslog Check .................... PASS

      Node GUID on CA #0 (VPI) ............... 7c:fe:90:03:00:17:21:b0

      ------------------ DONE ---------------------

       

      Linux inble02.local 2.6.32-573.el6.x86_64 #1 SMP Wed Jul 1 18:23:37 EDT 2015 x86_64 x86_64 x86_64 GNU/Linux

      Red Hat Enterprise Linux Server release 6.7 (Santiago)

       

      mount.nfs: trying text-based options 'rdma,port=20049,nfsvers=3,rsize=262144,wsize=262144,hard,timeo=600,retrans=2,addr=172.16.2.240'

      172.16.2.240:/storage/cfd on /home/cfd type nfs (rw,_netdev,rdma,port=20049,nfsvers=3,rsize=262144,wsize=262144,hard,timeo=600,retrans=2)

      mount.nfs: timeout set for Fri Jul 15 01:15:33 2016

      mount.nfs: trying text-based options 'rdma,port=20049,nfsvers=3,rsize=262144,wsize=262144,hard,timeo=600,retrans=2,addr=172.16.2.240'

      172.16.2.240:/storage/fea on /home/fea type nfs (rw,_netdev,rdma,port=20049,nfsvers=3,rsize=262144,wsize=262144,hard,timeo=600,retrans=2)

       

       

       

      Thank You

      Atul Yadav

        • Re: mlx4_0, memreg 5 slots 32 ird 16
          sophie

          Hi Atul,

           

          What is the amount of memory on the server & client?

          Also, 3.3.1.0.0.0 was removed from our website and replaced with 3.3.1.0.4.0; can you try with this driver version?

          If you just validate the RDMA connectivity between the server & client (NFS aside), are you getting the same messages?

           

          Sophie.