• mlx5_core enable hca failed, mlx5_load_one failed with error code -22

    I have two physical cards each with two ports but only one Physical card is getting enabled and getting following error on the dmesg   mlx5_core enable hca failed, mlx5_load_one failed with error code -22  ...
    created by pharthiphan
  • configure connectx-3 to fdr

    Hi,   I have a Mellanox connect-3 card in plugged into a PCI-E 3 slot in my Supermicro motherboard with fibre plugged into it. It is only operating at 4xSDR, how do I force it to use FDR and preferably 56gig? It...
    created by linux1
  • How to run DHCP server on SB7700 InfiniBand switch

    Hello, I want to use DHCP to manage the  IPoIB IP numbers in our IB network. Managing static IPs gets to cumbersom. Ideally I want to run DHCP on the main IB switch SB7700 Mlnx-os 3.6.4006. So the questions are ...
    last modified by heb
  • Maximum message size supported for multicast?

    I was testing out the example multicast application provided by mellanox in section 7.3 of their document: http://www.mellanox.com/related-docs/prod_software/RDMA_Aware_Programming_user_manual.pdf . I'm able to compil...
    last modified by sriktib
  • How to install Mellanox Infiniband card and Intel Omni Path in  same server RHEL 7.3/7.4

    Hi Team,      I am having another doubt with is Possible to install and submit the job via both Mellanox Infiniband Card and Intel Omni path in same machine.   If its possible please share link ...
    created by mmurugayen
  • How to install two Mellanox Infiniband card in RHEL 7.3/7.4

    Hi Team,   I have one doubt with how to install and configure 2 Mellanox Infiniband Card (mlx4_0 / 'mlx5_0). And configure configure ip in RHEL 7.3/7.4.   Please share any link or document its useful to ...
    created by mmurugayen
  • about the function of verbs API ibv_exp_peer_commit_qp and ibv_exp_peer_peek_cq

    I ran into this two API recently when I browsed code from github but I never used before. I have found some explanation of these API in source code of libibverbs, but still feeled confused about the "descriptors" whi...
    last modified by hannah
  • Problem while running application on multiple nodes on SR-IOV enviroment using OpenMPI [Build from source]

    Problem while running application on multiple nodes on SR-IOV enviroment using OpenMPI [Build from source]   I'm using Mellanox 56G FDR with SRIOV on KVM virtualization, and I want to use the RDMA to communicate...
    created by pasokan
  • RoCEv2 on Windows 7 using  ConnectX-3 Pro Ethernet adapter

    Hello, I'm trying to figure out how to use RoCEv2 (or v1, neither seems to work...) on Windows 7 using a ConnectX-3 Pro Ethernet Adapter and WinOF v5.35. I have enabled RoCEv2 and set the RoCEv2 Port to 4791 using t...
    created by dominic.tietz
  • EDR and backwards compatibility?

    HI,   We have a bunch of QDR hosts and are looking to buy nodes with EDR now as well as an EDR switch, can the QDR nodes connect to the EDR switch? Or is it not supported?
    created by seritlj
  • hpc-x for arm

    Hi All I want to use hpc-x for Ubuntu in arm machines connected by infiniband by EDR. However I found that for for desired Mellanox drivers(ofed) , the binaries are not available , Is this possible to compile it b...
    last modified by pawangh
  • Connect two adapters without switch?

    Trying to setup two nodes between adapters to test machine learning lab but do not have switch. I heard about using opensm, any guidance on this configuration?
    last modified by djlawler53
  • lspci | grep Mellanox  - how old is old.

    Good morning, Could you kindly help me find out how old this card in our Linux machine? Our server is very slow in running MPP jobs. lshal | grep system.hardware   system.hardware.product = 'C2112-4GP3' ...
    last modified by tempelma
  • Achieving 40Gbps with Ethernet mode on ConnectX-3 VPI

    Hi, i'm trying to get some more understanding  of achieving near line speed of 40Gbps on the following adapter card: [root@compute8 scripts]# lspci -vv -s 07:00.0  | grep "Part number" -A 3   &#...
    last modified by susinthiran
  • New to InfiniBand, so we are unable to configure to communicate between server and switch

    Dear Member   I am new to InfiniBand I have a problem I have  7 server and one Mellanox switch we need to configure ethernet over InfiniBand As I am new to InfiniBand technologies, so please help us to sor...
    last modified by sandisaha
  • solution for design small HPC

    we have 35 HP G9 and 40 HP G8 server. Help us for solution to create one or 2 HPCs.
    last modified by moalem
  • how to load os defaule module,not the module in the mellanox driver .

    in redhat 6.7 ,the os have a rds module, after install mellanox driver which also include rds module ,the module reference to the mellanox rds module ,how to reference the module to the os ?     os defaule ...
    last modified by hao.wang
  • Why the very high MAXIMUM latency in UDP ping-pong test?

    I've set up a test system with two Dell R730 servers, each of them with a ConnectX-3 Pro NIC card and connected by a 40GE cable. I've followed the BIOS tuning for R730 (https://community.mellanox.com/docs/DOC-2631) an...
    last modified by hongyuanh
  • IB Interface Serial Number

    I have a 60+ node HPC cluster with IB connectivity. The OS is redhat 5/6. Is there a way to obtain the serial number of my ib interfaces without manually taking the interfaces out of the node?   thx Warren Crummer
    last modified by wcrummer
  • Getting started with DPDK and ConnectX-5 100Gb/s

    This post provides detailed steps for people that are not familiar with Mellanox cards and DPDK to connectX-5 and use it with DPDK. In this tutorial, we are using the Model No: CX555A that supports Infiniband (IB). st...
    last modified by charif