HowTo Install Mellanox OFED driver for Lustre

Version 3

    This post shows how to install MLNX_OFED 3.0_1.0.1 with Lustre kernel environment.

     

    References

     

    Some Lustre kernel versions are not supported for MLNX_OFED ISO installation. You will need to install the missing packages as well as add that specific kernel into the supported list.

     

    Setup

    • CentOS6.6 Lustre system
    • Linux MDS0-A200 2.6.32-504.16.2.el6_lustre.x86_64 #1

     

    Configuration Problem and Solution Flow

     

    1. While trying to install the MLNX_OFED, the system complains the following:

    # ./mlnxofedinstall

    Logs dir: /tmp/MLNX_OFED_LINUX-3.0-1.0.1.30445.logs

    The 2.6.32-504.16.2.el6_lustre.x86_64 kernel is installed, MLNX_OFED does not have drivers available for this kernel.

    You can run mlnx_add_kernel_support.sh in order to to generate an MLNX_OFED package with drivers for this kernel.

     

    2. When running the mlnx_add_kernel_support.sh, the install script failed as well:

    # ./mlnx_add_kernel_support.sh --mlnx_ofed /root/MLNX_OFED_LINUX-3.0-1.0.1-rhel6.6-x86_64 --make-iso

    Note: This program will create MLNX_OFED_LINUX ISO for rhel6.6 under /tmp directory.

    All Mellanox, OEM, OFED, or Distribution IB packages will be removed.

    Do you want to continue?[y/N]:y

    See log file /tmp/mlnx_ofed_iso.31260.log

     

    Building OFED RPMs. Please wait...

     

    ERROR: Failed executing "MLNX_OFED_SRC-3.0-1.0.1/install.pl --tmpdir /tmp --kernel-only --kernel 2.6.32-504.16.2.el6_lustre.x86_64 --kernel-sources /lib/modules/2.6.32-504.16.2.el6_lustre.x86_64/build/ --builddir /tmp/mlnx_iso.31260 --disable-kmp --build-only"

    ERROR: See /tmp/mlnx_ofed_iso.31260.log

     

     

    3. At this point, you need to check the log file. In this case it's /tmp/mlnx_ofed_iso.31260.log

     

    Logs dir: /tmp/OFED.31288.logs
    Error: One or more required packages for installing OFED-internal are missing.
    Please install the missing packages using your Linux distribution Package Management tool.

    Run:yum install python-devel redhat-rpm-config rpm-build

     

    4. Run the yum command to install all required packages.

     


    # yum install python-devel redhat-rpm-config rpm-build
    ...

     

    5. After that, you can add the kernel support into the iso:

    # ./mlnx_add_kernel_support.sh --mlnx_ofed /root/MLNX_OFED_LINUX-3.0-1.0.1-rhel6.6-x86_64 --make-iso

    Note: This program will create MLNX_OFED_LINUX ISO for rhel6.6 under /tmp directory.

          All Mellanox, OEM, OFED, or Distribution IB packages will be removed.

    Do you want to continue?[y/N]:y

    See log file /tmp/mlnx_ofed_iso.4839.log

     

    Building OFED RPMs. Please wait...

     

    Running mkisofs...

    Created /tmp/MLNX_OFED_LINUX-3.0-1.0.1-rhel6.6-x86_64-ext.iso

     

    6. Now you successfully created the new MLNX_OFED ISO with the kernel support of your Lustre system.

    It's located here: /tmp/MLNX_OFED_LINUX-3.0-1.0.1-rhel6.6-x86_64-ext.iso

     

    Finally, you can install this OFED ISO into your Lustre system using normal MLNX_OFED installation process.