• What are some good budget options for NICs and Switch?

    I have a limited budget, and I want to buy a high speed network interface cards and a switch to connect multiple PCs into a local network (just a couple of meters away from one another) for HPC research. Some of the ...
    last modified by kiriller
  • mlx5_core enable hca failed, mlx5_load_one failed with error code -22

    I have two physical cards each with two ports but only one Physical card is getting enabled and getting following error on the dmesg   mlx5_core enable hca failed, mlx5_load_one failed with error code -22  ...
    last modified by pharthiphan
  • Various ping programs segfaulting

    I have a build of rdma-core in kernel 4.17 using yocto for an Altera Arria10 with a dual-core A53 ARM processor.  The system is build and rxe configures correctly, i.e. I can rxe_cfg start, rxe_cfg add eth0 and i...
    last modified by fwmiller
  • rxe driver does not support kernel ABI

    Getting a small error when I try to do an rping test. I'm building rxe into kernel 4.16 and rdma-core using yocto on an Arria10 socfpga containing a dual core A53 ARM processor. I get the kernel modules and userland l...
    last modified by fwmiller
  • Yocto embedded build of rdma-core

    Greetings,   I'm working with an embedded build of the rdma-core code (and rdma-perftest but I'm not that far yet).  We're doing a cross build of the rdma-core code using yocto targeted at an Altera Arria10...
    last modified by fwmiller
  • configure connectx-3 to fdr

    Hi,   I have a Mellanox connect-3 card in plugged into a PCI-E 3 slot in my Supermicro motherboard with fibre plugged into it. It is only operating at 4xSDR, how do I force it to use FDR and preferably 56gig? It...
    created by linux1
  • How to run DHCP server on SB7700 InfiniBand switch

    Hello, I want to use DHCP to manage the  IPoIB IP numbers in our IB network. Managing static IPs gets to cumbersom. Ideally I want to run DHCP on the main IB switch SB7700 Mlnx-os 3.6.4006. So the questions are ...
    last modified by heb
  • Maximum message size supported for multicast?

    I was testing out the example multicast application provided by mellanox in section 7.3 of their document: http://www.mellanox.com/related-docs/prod_software/RDMA_Aware_Programming_user_manual.pdf . I'm able to compil...
    last modified by sriktib
  • How to install Mellanox Infiniband card and Intel Omni Path in  same server RHEL 7.3/7.4

    Hi Team,      I am having another doubt with is Possible to install and submit the job via both Mellanox Infiniband Card and Intel Omni path in same machine.   If its possible please share link ...
    created by mmurugayen
  • How to install two Mellanox Infiniband card in RHEL 7.3/7.4

    Hi Team,   I have one doubt with how to install and configure 2 Mellanox Infiniband Card (mlx4_0 / 'mlx5_0). And configure configure ip in RHEL 7.3/7.4.   Please share any link or document its useful to ...
    created by mmurugayen
  • about the function of verbs API ibv_exp_peer_commit_qp and ibv_exp_peer_peek_cq

    I ran into this two API recently when I browsed code from github but I never used before. I have found some explanation of these API in source code of libibverbs, but still feeled confused about the "descriptors" whi...
    last modified by hannah
  • Problem while running application on multiple nodes on SR-IOV enviroment using OpenMPI [Build from source]

    Problem while running application on multiple nodes on SR-IOV enviroment using OpenMPI [Build from source]   I'm using Mellanox 56G FDR with SRIOV on KVM virtualization, and I want to use the RDMA to communicate...
    created by pasokan
  • RoCEv2 on Windows 7 using  ConnectX-3 Pro Ethernet adapter

    Hello, I'm trying to figure out how to use RoCEv2 (or v1, neither seems to work...) on Windows 7 using a ConnectX-3 Pro Ethernet Adapter and WinOF v5.35. I have enabled RoCEv2 and set the RoCEv2 Port to 4791 using t...
    created by dominic.tietz
  • EDR and backwards compatibility?

    HI,   We have a bunch of QDR hosts and are looking to buy nodes with EDR now as well as an EDR switch, can the QDR nodes connect to the EDR switch? Or is it not supported?
    created by seritlj
  • hpc-x for arm

    Hi All I want to use hpc-x for Ubuntu in arm machines connected by infiniband by EDR. However I found that for for desired Mellanox drivers(ofed) , the binaries are not available , Is this possible to compile it b...
    last modified by pawangh
  • Connect two adapters without switch?

    Trying to setup two nodes between adapters to test machine learning lab but do not have switch. I heard about using opensm, any guidance on this configuration?
    last modified by djlawler53
  • lspci | grep Mellanox  - how old is old.

    Good morning, Could you kindly help me find out how old this card in our Linux machine? Our server is very slow in running MPP jobs. lshal | grep system.hardware   system.hardware.product = 'C2112-4GP3' ...
    last modified by tempelma
  • Achieving 40Gbps with Ethernet mode on ConnectX-3 VPI

    Hi, i'm trying to get some more understanding  of achieving near line speed of 40Gbps on the following adapter card: [root@compute8 scripts]# lspci -vv -s 07:00.0  | grep "Part number" -A 3   &#...
    last modified by susinthiran
  • New to InfiniBand, so we are unable to configure to communicate between server and switch

    Dear Member   I am new to InfiniBand I have a problem I have  7 server and one Mellanox switch we need to configure ethernet over InfiniBand As I am new to InfiniBand technologies, so please help us to sor...
    last modified by sandisaha
  • solution for design small HPC

    we have 35 HP G9 and 40 HP G8 server. Help us for solution to create one or 2 HPCs.
    last modified by moalem