Oracle ZFS Storage: Configuring LACP & VLAN tagging with Cisco vPC and the ZFS Storage Appliance

Asset ID:	1-79-1645434.1
Update Date:	2018-05-25
Keywords:

Solution Type Predictive Self-Healing Sure

Solution 1645434.1 : Oracle ZFS Storage: Configuring LACP & VLAN tagging with Cisco vPC and the ZFS Storage Appliance

Applies to:

Sun ZFS Storage 7420 - Version All Versions to All Versions [Release All Releases]
Oracle ZFS Storage ZS3-4 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7320 - Version All Versions to All Versions [Release All Releases]
Oracle ZFS Storage ZS3-2 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7120 - Version All Versions to All Versions [Release All Releases]
7000 Appliance OS (Fishworks)

Purpose

Cisco's Virtual PortChannel (vPC) feature provides the ability to aggregate links to provide redundancy and increase throughput. This document describes how to configure a Cisco Nexus switch and the ZFS Storage Appliance to interoperate with LACP and VLAN tagging.

Details

Network Diagram

LACP Network Diagram

vPC Network Diagram

ZFSSA Controller	ZFSSA 10GbE Port	Cisco Switch	Switch Port	vPC
1	ixgbe0	A	1	200
1	ixgbe3	B	1	200
1	ixgbe1	B	2	201
1	ixgbe2	A	2	201
2	ixgbe0	A	3	202
2	ixgbe3	B	3	202
2	ixgbe1	B	4	203
2	ixgbe2	A	4	203

Cisco vPC Configuration

Enter configuration mode

switch1# configure terminal

Enable vPC and LACP

switch1(config)# feature vpc
switch1(config)# feature lacp

Create a VLAN (if already doesn't exist)

switch1(config)# vlan 100

Create vPC's for both switch1 and switch2 (only switch1 shown)

switch1(config)# interface port-channel 200
switch1(config-if)# switchport access vlan 100
switch1(config-if)# spanning-tree port type edge
switch1(config-if)# speed 10000
switch1(config-if)# vpc 200
switch1(config-if)# exit

switch1(config)# interface port-channel 201
switch1(config-if)# switchport access vlan 100
switch1(config-if)# speed 10000
switch1(config-if)# vpc 201
switch1(config-if)# exit

switch1(config)# interface port-channel 202
switch1(config-if)# switchport access vlan 100
switch1(config-if)# spanning-tree port type edge
switch1(config-if)# speed 10000
switch1(config-if)# vpc 202
switch1(config-if)# exit

switch1(config)# interface port-channel 203
switch1(config-if)# switchport access vlan 100
switch1(config-if)# speed 10000
switch1(config-if)# vpc 203
switch1(config-if)# exit

Add ports to vPC's for both switch1 and switch2 (only switch1 shown)

switch1(config)# interface Ethernet1/1
switch1(config-if)# switchport access vlan 100
switch1(config-if)# channel-group 200 mode active
switch1(config-if)# exit

switch1(config)# interface Ethernet1/2
switch1(config-if)# switchport access vlan 100
switch1(config-if)# channel-group 201 mode active
switch1(config-if)# exit

switch1(config)# interface Ethernet1/3
switch1(config-if)# switchport access vlan 100
switch1(config-if)# channel-group 202 mode active
switch1(config-if)# exit

switch1(config)# interface Ethernet1/4
switch1(config-if)# switchport access vlan 100
switch1(config-if)# channel-group 203 mode active
switch1(config-if)# exit

Verify vPC / LACP / VLAN layout on both Switch1 and Switch2:

switch1# sho port-channel summary
[…]
200   Po200(SU)   Eth      LACP      Eth1/1(P)
201   Po201(SU)   Eth      LACP      Eth1/2(P)
202   Po202(SU)   Eth      LACP      Eth1/3(P)
203   Po203(SU)   Eth      LACP      Eth1/4(P)

switch1# sho vpc
[…]
vPC status
----------------------------------------------------------------------------
id     Port        Status Consistency Reason                     Active vlans
------ ----------- ------ ----------- -------------------------- -----------
200    Po200       up     success     success                    100
201    Po201       up     success     success                    100
202    Po202       up     success     success                    100
203    Po203       up     success     success                    100

ZFSSA Configuration

From the ZFSSA CLI, go to the datalink configuration

controller1:> configuration net datalinks

Create LACP aggregations for ixgbe0/3 on Controller 1 (see network diagram for reference)

controller1:configuration net datalinks> aggregation
controller1:configuration net datalinks aggregation (uncommitted)> set links=ixgbe0,ixgbe3
                         links = ixgbe0,ixgbe3 (uncommitted)
controller1:configuration net datalinks aggregation (uncommitted)> set policy=L3
                        policy = L3 (uncommitted)
controller1:configuration net datalinks aggregation (uncommitted)> set mode=active
                          mode = active (uncommitted)
controller1:configuration net datalinks aggregation (uncommitted)> set timer=short
                         timer = short (uncommitted)
controller1:configuration net datalinks aggregation (uncommitted)> set label=vPC1_vPC3
                         label = vPC1_vPC3 (uncommitted)
controller1:configuration net datalinks aggregation (uncommitted)> commit

Create LACP aggregations for ixgbe1/2 on Controller 2 (see network diagram for reference)

controller2:configuration net datalinks> aggregation
controller2:configuration net datalinks aggregation (uncommitted)> set links=ixgbe1,ixgbe2
                         links = ixgbe1,ixgbe2 (uncommitted)
controller2:configuration net datalinks aggregation (uncommitted)> set policy=L3
                        policy = L3 (uncommitted)
controller2:configuration net datalinks aggregation (uncommitted)> set mode=active
                          mode = active (uncommitted)
controller2:configuration net datalinks aggregation (uncommitted)> set timer=short
                         timer = short (uncommitted)
controller2:configuration net datalinks aggregation (uncommitted)> set label=vPC2_vPC4
                         label = vPC2_vPC4 (uncommitted)
controller2:configuration net datalinks aggregation (uncommitted)> commit

Assign VLAN tags on Controller 1

controller1:configuration net datalinks> vlan
controller1:configuration net datalinks vlan (uncommitted)> set links=aggr1
                         links = aggr1 (uncommitted)
controller1:configuration net datalinks vlan (uncommitted)> set label=vPC1_vPC3
                         label = vPC1_vPC3 (uncommitted)
controller1:configuration net datalinks vlan (uncommitted)> set id=100
                            id = 100 (uncommitted)
controller1:configuration net datalinks vlan (uncommitted)> commit

Assign VLAN tags on Controller 2

controller2:configuration net datalinks> vlan
controller2:configuration net datalinks vlan (uncommitted)> set links=aggr1
                         links = aggr1 (uncommitted)
controller2:configuration net datalinks vlan (uncommitted)> set label=vPC2_vPC4
                         label = vPC2_vPC4 (uncommitted)
controller2:configuration net datalinks vlan (uncommitted)> set id=100
                            id = 100 (uncommitted)
controller2:configuration net datalinks vlan (uncommitted)> commit

You can now build IP interfaces on top of the aggregations.

***Checked for relevance on 25-MAY-2018***

Attachments

This solution has no attachment