Troubleshooting Guidelines for Mellanox NEO

Version 7

    This post is basic, and is meant for Mellanox NEO users who wish to troubleshoot various issues related to the product.

     

    References

     

    A shortage of free disk space

    A shortage of free disk space may generate various of errors.

    Make sure that you have enough disk space per each monitored switch.

     

    To check the current available space, run:

    # df -h

    Filesystem                    Size  Used Avail Use% Mounted on

    /dev/mapper/VolGroup-lv_root  3.9G  1.9G  1.9G  51% /

    tmpfs                         939M     0  939M   0% /dev/shm

    /dev/sda1                     485M   32M  428M   7% /boot

     

    Note: NEO's database is located by default under /var/lib/carbon/whisper/sites/default_site

    # cd /var/lib/carbon/whisper/sites/default_site

    # for each in $(ls) ; do du -hs "$each" ; done

    64M 10_20_2_51

    64M 10_20_2_52

    64M 10_20_2_53

    64M 10_20_2_54

     

    In this case, you can see four SX1710 switches, each is consuming 64MB of disk space.

     

    Verify Services

    Make sure that the following services are up and running:

    # /etc/init.d/httpd status

    httpd (pid  1627) is running...

     

    # /opt/neo/neoservice status

    neo-access-credentials (pid  1294) is running...

    neo-controller (pid  1251) is running...

    neo-device-manager (pid  1318) is running...

    neo-eth-discovery (pid  1350) is running...

    neo-ib (pid  1372) is running...

    neo-ip-discovery (pid  1402) is running...

    neo-monitor (pid  1428) is running...

    neo-provisioning (pid  1465) is running...

    In case the service ends abnormally, restart the program.

     

    Expand Disk Space in Windows 2012

    NEO requires large disk to save the configuration and performance counters per switch (or other network element). 10GB is recommended.

    In case of disk shortage you mage see Graphite Error appear on the GUI, to solve that, enlarge NEO's disk space.

    In order to verify and enlarge the disk for Windows 2012 Hyper-V environment, run the following commands:

     

    1. Shut down the NEO VM

     

    2. Open Hyper-V Manager, and Click on Actions > Edit disk

     

     

     

    3. Click Next and Locate your Disk (vhdx format)

     

    4. Click on Expand

     

     

    5. Change the current size to 10G or more

     

     

    6. Click on Finish.

     

     

    7. Restart The NEO VM.