HowTo Enable MLAG Switch Pair Using Mellanox NEO

Version 8

    This post shows how to create an MLAG switch pair using Mellanox NEO.

    The example below was tested using Mellanox NEO 1.7

     

    The reader is required to understand MLAG concepts, and MLAG configuration. Refer to HowTo Configure MLAG on Mellanox Switches and Ethernet Switch Solutions pages for more details.

     

    References

     

    Setup and Prerequisites

     

    MLAG Configuration Planning

    Before you start the configuration itself, design your network.

     

    Here are the list of parameters needed for MLAG Service.

    ParameterDescriptionExample
    NameAny name (4-20 characters), should be unique if you have more than one MLAG in your network.MLAG
    DescriptionAny description (in text).MLAG-Service
    LAGThis will be the IPL port-channel (in our case on ports 1/35-1/36 on both switches). Any number from 1-65335 would work.1
    VLAN ID

    This will be the IPL VLAN ID. Any VLAN ID would work, but not the default VLAN (normally VLAN ID 1).

    Note: It is possible to use VLAN ID 1 if the default VLAN is changed on the switch to a different number.

    2
    Virtual system MAC

    Virtual MAC to be used for the LACP protocol for MLAG port channels configued. Any unicast MAC address would work.

    This MAC is not binded to any IP address.

    AA:AA:AA:AA:AA:AA
    IPL port rangeThe range of ports used for the IPL link (on one of the switches), in the format 1/<port>-1/<port>. The number of ports to be used determines the high-availability needed. It is recommended to use two or more links.1/35-1/36
    IPL peer port rangeThe range of ports used for the IPL link (on the peer switch), in the format 1/<port>-1/<port>. The number of ports to be used determines the high-availability needed. It is recommended to use two or more links.1/35-1/36
    Device IPOne of the switches management IP10.20.2.43
    Peer Device IPThe peer switch management IP10.20.4.131
    MLAG Virtual IP

    This will be the Virtual IP of the MLAG switch pair. The user should assign an IP address from the management network subnet.

    In this example, the switches have an IP address in the range 10.20.x.x/16. Obviously, this address should not be assigned to any other network element.

    10.20.2.150
    MLAG Virtual IP MaskThe mask of the management subnet. In this example it is /16.16
    IPL IP addressThis IP address (assigned to one of the switches) is internal to be able to pass MLAG control packets between the switches. Any IP address would do. This IP is not distributed externally (i.e. anywhere outside the MLAG switches) but should not be part of any other addressing of the switch.1.1.1.1
    IPL IP Address MaskAs there are only two addresses, the subnet mask of /30 could work here (4 addresses).30
    Peer IPL IP AddressThis IP address (assigned to the peer switch) is internal to be able to pass MLAG control packets between the switches. Any IP address would do. This IP is not distributed externally (i.e. anywhere outside the MLAG switches) but should not be part of any other addressing of the switch.1.1.1.2

     

     

    MLAG Configuration

    Before you start, make sure the Setup and Prerequisites requirements are met.

     

    1. Before you start, make sure that the switches are clean of configuration. Login to the switch CLI, and run show running-config.

     

    2. Open NEO, and click Services > MLAG > Add

     

    3. Fill in the planned configuration of the MLAG pair, (General and MLAG Attributes tabes) and click Finish.

     

     

     

    4. New MLAG service will appear. Right click it and select Apply Config.

     

     

    At this point MLAG pair should be configured on the switch.

    Important note: NEO 1.7 does not configure MLAG port-channel. To do that you need to enter the MLAG-VIP address and configure the MLAG port-channels to be connected to the servers. At this point no server port is configured.

     

    MLAG Validation

    1. Enter each switch CLI and run show running-config

     

    Switch ASwitch B

    protocol mlag

    interface port-channel 1

    interface ethernet 1/35-1/36 channel-group 1 mode active

    lacp

    vlan 2

    no spanning-tree

    ip routing vrf default

    interface vlan 2

    interface vlan 2 ip address 1.1.1.1 255.255.255.252

    dcb priority-flow-control enable force

    lldp

    mlag-vip neo-mlag-vip-2 ip 10.20.2.150/16 force

    no mlag shutdown

    mlag system-mac AA:AA:AA:AA:AA:AA

    interface port-channel 1 ipl 1

    interface vlan 2 ipl 1 peer-address 1.1.1.2

    interface port-channel 1 dcb priority-flow-control mode on force

    protocol mlag

    interface port-channel 1

    interface ethernet 1/35-1/36 channel-group 1 mode active

    lacp

    vlan 2

    no spanning-tree

    ip routing vrf default

    interface vlan 2

    interface vlan 2 ip address 1.1.1.2 255.255.255.252

    dcb priority-flow-control enable force

    lldp

    mlag-vip neo-mlag-vip-2 ip 10.20.2.150/16 force

    no mlag shutdown

    mlag system-mac AA:AA:AA:AA:AA:AA

    interface port-channel 1 ipl 1

    interface vlan 2 ipl 1 peer-address 1.1.1.1

    interface port-channel 1 dcb priority-flow-control mode on force

     

    2. Check the MLAG status on the switch CLI

    Switch-B [neo-mlag-vip-2: master] (config) # show mlag

    Admin status: Enabled

    Operational status: Up

    Reload-delay: 30 sec

    Keepalive-interval: 1 sec

    Upgrade-timeout: 60 min

    System-mac: AA:AA:AA:AA:AA:AA

     

    MLAG Ports Configuration Summary:

    Configured: 0

    Disabled:   0

    Enabled:    0

     

    MLAG Ports Status Summary:

    Inactive:       0

    Active-partial: 0

    Active-full:    0

     

    MLAG IPLs Summary:

    ID   Group         Vlan       Operational  Local           Peer

         Port-Channel  Interface  State        IP address      IP address

    --------------------------------------------------------------------------

    1    Po1           2          Up           1.1.1.1         1.1.1.2        

     

    MLAG Members Summary:

    System-id          State     Hostname

    -------------------------------------

    00:02:C9:72:9C:F8  Up        Switch-A

    00:02:C9:60:DC:E8  Up        Switch-B

     

    3. Login to the MLAG VIP (MLAG master)

    # ssh admin@10.20.2.150

     

    Mellanox MLNX-OS Switch Management

     

    Last login: Thu Apr  7 16:09:31 2016 from 10.20.2.58

     

    Mellanox Switch

     

    Server-A [neo-mlag-vip-2: master] > enable

    Server-A [neo-mlag-vip-2: master] # configure terminal

    Server-A [neo-mlag-vip-2: master] (config) #

     

     

    MLAG Port Channel Configuration

    Once the MLAG switch pair configured and Up. You can start configuring MLAG port channels.

    It is recommended to use the same port numbering on both switches.

     

    Here is a short example to set eth 1/1 on both MLAG switch pair to be part of MLAG port channel 1.

    Before you start, connect eth 1/1 on each switch to the server (or another switch), and verify that the ports are up.

     

    Run on Switch A:

     

    Switch-A [neo-mlag-vip-2: standby] (config) # interface mlag-port-channel 1

    Switch-A [neo-mlag-vip-2: standby] (config interface mlag-port-channel 1) # exit

    Switch-A [neo-mlag-vip-2: standby] (config) # interface ethernet 1/1 mlag-channel-group 1 mode on

    Switch-A [neo-mlag-vip-2: standby] (config) # interface mlag-port-channel 1 no shutdown

     

    Run on Switch B:

    Switch-B [neo-mlag-vip-2: master] (config) # interface mlag-port-channel 1

    Switch-B [neo-mlag-vip-2: master] (config interface mlag-port-channel 1) # exit

    Switch-B [neo-mlag-vip-2: master] (config) # interface ethernet 1/1 mlag-channel-group 1 mode on

    Switch-B [neo-mlag-vip-2: master] (config) # interface mlag-port-channel 1 no shutdown

     

    To do that via NEO, simply click on the two switches > Right click > Provisioning

     

    Fill the commands to be applied on both switches. Click on Apply and Start

     

     

     

     

    Verify the MLAG port status

    Switch-B [neo-mlag-vip-2: master] (config) # show mlag

    Admin status: Enabled

    Operational status: Up

    Reload-delay: 30 sec

    Keepalive-interval: 1 sec

    Upgrade-timeout: 60 min

    System-mac: AA:AA:AA:AA:AA:AA

     

    MLAG Ports Configuration Summary:

    Configured: 1

    Disabled:   0

    Enabled:    1

     

    MLAG Ports Status Summary:

    Inactive:       0

    Active-partial: 0

    Active-full:    1

     

    MLAG IPLs Summary:

    ID   Group         Vlan       Operational  Local           Peer

         Port-Channel  Interface  State        IP address      IP address

    --------------------------------------------------------------------------

    1    Po1           2          Up           1.1.1.1         1.1.1.2        

     

    MLAG Members Summary:

    System-id          State     Hostname

    -------------------------------------

    00:02:C9:72:9C:F8  Up        <mti-mar-sx23>

    00:02:C9:60:DC:E8  Up         mti-mar-sx24

    mti-mar-sx23 [neo-mlag-vip-2: master] (config) # 

     


    For more info, refer to HowTo Configure MLAG on Mellanox Switches, and to Ethernet Switch Solutions.