In this section of the project, I will configure the Shared Uplink Sets on the Virtual Connect Manager, create LACP groups on the HP 5900AF and add the new uplinks to our VMware vSphere 5.5 Distributed Switch. I also include a short brief on setting up LAGs in the vSphere Web Client.

The basic idea is to create Active/Active links from each Virtual Connect Module to each HP 5900 switch. In the previous section, we configured the two switches as an IRF domain. In this setup I am using X1-X2 on each Virtual Connect for Management, vMotion and iSCSI. For the Provisioning Uplink set I am using X3-X6. Unfortunately, I’m waiting to receive more SFP+ adapters that are compatible with the Virtual Connect, so to start, we will only use 2 links from each module(X5, X6). Each Virtual Connect module has its own link aggregation group on the ToR. The management Set will use group 1000 for VC module 1 and 1001 for VC module 2. The provisioning set uses group 880 for VC module 1 and 881 for VC module 2.

 

Networking layout

 

To begin open up a terminal to the HP 5900 switch. After logging in we create link aggregation groups for each shared uplink set.

 

<Master01> sys
[Master01] interface Bridge-Aggregation880
[Master01-Bridge-Aggregation-880] port link-type trunk
[Master01-Bridge-Aggregation-880] port trunk pvid vlan 880
[Master01-Bridge-Aggregation-880] port trunk permit vlan 800 818 820 822
[Master01-Bridge-Aggregation-880] link-aggregation mode dynamic
[Master01-Bridge-Aggregation-880] stp edged-port
[Master01-Bridge-Aggregation-880]quit
[Master01] interface Bridge-Aggregation881
[Master01-Bridge-Aggregation-881] port link-type trunk
[Master01-Bridge-Aggregation-881] port trunk pvid vlan 880
[Master01-Bridge-Aggregation-881] port trunk permit vlan 800 818 820 822
[Master01-Bridge-Aggregation-881] link-aggregation mode dynamic
[Master01-Bridge-Aggregation-881] stp edged-port
[Master01-Bridge-Aggregation-881] quit
[Master01] interface Bridge-Aggregation1000
[Master01-Bridge-Aggregation-1000] port link-type trunk
[Master01-Bridge-Aggregation-1000] port trunk permit vlan 1 160 180 190
[Master01-Bridge-Aggregation-1000] link-aggregation mode dynamic
[Master01-Bridge-Aggregation-1000] stp edged-port
[Master01-Bridge-Aggregation-1000]quit
[Master01] interface Bridge-Aggregation1001
[Master01-Bridge-Aggregation-1001] port link-type trunk
[Master01-Bridge-Aggregation-1001] port trunk permit vlan 1 160 180 190
[Master01-Bridge-Aggregation-1001] link-aggregation mode dynamic
[Master01-Bridge-Aggregation-1001] stp edged-port
[Master01-Bridge-Aggregation-1001]quit

 

Now configure and add ports to the Shared Uplink Set link aggregation groups. Even though I don’t have all the SFP+ adapters, I still want to configure all of the ports on the 5900. Below is an example for the first two, group 880 and 881.

 

[Master01] int ten1/0/1
[Master01-Ten-GigabitEthernet1/0/1] port link-mode bridge
[Master01-Ten-GigabitEthernet1/0/1] port link-type trunk
[Master01-Ten-GigabitEthernet1/0/1] port trunk pvid vlan 880
[Master01-Ten-GigabitEthernet1/0/1] port trunk permit vlan 800 818 820 822
[Master01-Ten-GigabitEthernet1/0/1] port link-aggregation group 880
[Master01-Ten-GigabitEthernet1/0/1] quit
[Master01] int ten1/0/2
[Master01-Ten-GigabitEthernet1/0/2] port link-mode bridge
[Master01-Ten-GigabitEthernet1/0/2] port link-type trunk
[Master01-Ten-GigabitEthernet1/0/2] port trunk pvid vlan 880
[Master01-Ten-GigabitEthernet1/0/2] port trunk permit vlan 800 818 820 822
[Master01-Ten-GigabitEthernet1/0/2] port link-aggregation group 880
[Master01-Ten-GigabitEthernet1/0/2] quit
[Master01] int ten2/0/1
[Master01-Ten-GigabitEthernet2/0/1] port link-mode bridge
[Master01-Ten-GigabitEthernet2/0/1] port link-type trunk
[Master01-Ten-GigabitEthernet2/0/1] port trunk pvid vlan 880
[Master01-Ten-GigabitEthernet2/0/1] port trunk permit vlan 800 818 820 822
[Master01-Ten-GigabitEthernet2/0/1] port link-aggregation group 880
[Master01-Ten-GigabitEthernet2/0/1] quit
[Master01] int ten2/0/2
[Master01-Ten-GigabitEthernet2/0/2] port link-mode bridge
[Master01-Ten-GigabitEthernet2/0/2] port link-type trunk
[Master01-Ten-GigabitEthernet2/0/2] port trunk pvid vlan 880
[Master01-Ten-GigabitEthernet2/0/2] port trunk permit vlan 800 818 820 822
[Master01-Ten-GigabitEthernet2/0/2] port link-aggregation group 880
[Master01-Ten-GigabitEthernet2/0/2] quit
[Master01] int ten1/0/3
[Master01-Ten-GigabitEthernet1/0/3] port link-mode bridge
[Master01-Ten-GigabitEthernet1/0/3] port link-type trunk
[Master01-Ten-GigabitEthernet1/0/3] port trunk pvid vlan 880
[Master01-Ten-GigabitEthernet1/0/3] port trunk permit vlan 800 818 820 822
[Master01-Ten-GigabitEthernet1/0/3] port link-aggregation group 881
[Master01-Ten-GigabitEthernet1/0/3] quit
[Master01] int ten1/0/4
[Master01-Ten-GigabitEthernet1/0/4] port link-mode bridge
[Master01-Ten-GigabitEthernet1/0/4] port link-type trunk
[Master01-Ten-GigabitEthernet1/0/4] port trunk pvid vlan 880
[Master01-Ten-GigabitEthernet1/0/4] port trunk permit vlan 800 818 820 822
[Master01-Ten-GigabitEthernet1/0/4] port link-aggregation group 881
[Master01-Ten-GigabitEthernet1/0/4] quit
[Master01] int ten2/0/3
[Master01-Ten-GigabitEthernet2/0/3] port link-mode bridge
[Master01-Ten-GigabitEthernet2/0/3] port link-type trunk
[Master01-Ten-GigabitEthernet2/0/3] port trunk pvid vlan 880
[Master01-Ten-GigabitEthernet2/0/3] port trunk permit vlan 800 818 820 822
[Master01-Ten-GigabitEthernet2/0/3] port link-aggregation group 881
[Master01-Ten-GigabitEthernet2/0/3] quit
[Master01] int ten2/0/4
[Master01-Ten-GigabitEthernet2/0/4] port link-mode bridge
[Master01-Ten-GigabitEthernet2/0/4] port link-type trunk
[Master01-Ten-GigabitEthernet2/0/4] port trunk pvid vlan 880
[Master01-Ten-GigabitEthernet2/0/4] port trunk permit vlan 800 818 820 822
[Master01-Ten-GigabitEthernet2/0/4] port link-aggregation group 881
[Master01-Ten-GigabitEthernet2/0/4] quit

 

I also want to configure Bridge-Aggregation groups for my Access switches that will connect to Bare-Metal hosts on specific VLANs. There are two Access Switches for each provisioning VLAN (refer back to the project summary).

 

[Master01] interface Bridge-Aggregation890
[Master01-Bridge-Aggregation-890] port link-type access
[Master01-Bridge-Aggregation-890] port access vlan 800
[Master01-Bridge-Aggregation-890] link-aggregation mode dynamic
[Master01-Bridge-Aggregation-890] stp edged-port
[Master01-Bridge-Aggregation-890]quit
[Master01] interface Bridge-Aggregation891
[Master01-Bridge-Aggregation-891] port link-type access
[Master01-Bridge-Aggregation-891] port access vlan 800
[Master01-Bridge-Aggregation-891] link-aggregation mode dynamic
[Master01-Bridge-Aggregation-891] stp edged-port
[Master01-Bridge-Aggregation-891] quit

[Master01] interface Bridge-Aggregation892
[Master01-Bridge-Aggregation-892] port link-type access
[Master01-Bridge-Aggregation-892] port access vlan 818
[Master01-Bridge-Aggregation-892] link-aggregation mode dynamic
[Master01-Bridge-Aggregation-892] stp edged-port
[Master01-Bridge-Aggregation-892]quit
[Master01] interface Bridge-Aggregation893
[Master01-Bridge-Aggregation-893] port link-type access
[Master01-Bridge-Aggregation-893] port access vlan 818
[Master01-Bridge-Aggregation-893] link-aggregation mode dynamic
[Master01-Bridge-Aggregation-893] stp edged-port
[Master01-Bridge-Aggregation-893] quit

 

 

Now that LACP is configured on the 5900, we can continue by creating Shared Uplink Sets. From a web browser log into the Virtual Connect Manager. Select Shared Uplink Sets and add a new set (+Add). When adding the Uplink Set Name, we differentiate each module by designating ‘-1’ or ‘-2’.

 

Click to add an Associated Network. Much like the naming convention for Shared Uplink Sets, we want to split the connections so we can add more than one adapter to the ESXi hosts.

 

VC_SUS_2

 

This completes the Shared Uplink Set creation. Now we can create Server Profiles and assign networks. Currently we only have 4 uplinks coming from each Virtual Connect module so we will add 6 ports (Management 1-2, Provisioning 3-4 and a set for 4Gb iSCSI using port 5-6). With future expansion, I hope to add FCoE storage along with a set of Flex-10 modules and mezzanine cards. Then I will move the Provisioning Uplink to the new modules and incorporate FCoE storage using the FCoE HBA connections on our current FlexFabric VCs.

 

 

To add the uplink sets to your distributed switches in vSphere, simply navigate to Inventory>Networking, right-click the distributed switch and select Add Hosts. Select the vmnics and the destination Port Group. For iSCSI multipathing, only one link should be configured as active, while the other is unused. VLANs for each port group should be configured as VLAN Access.

 

For those that want to test out the inclusion of LAGs with vSphere, here’s a brief rundown. Log into the vSphere Web client and navigate to the Networking tab. Under the Settings tab for the distributed switch, left-click LACP and select to add a new LAG (+). Select the number of uplink ports, choose ‘Active’ mode and choose your desired load balancing mode. Then Manage Distributed Port Groups and set the LAG as a Standby uplink. Set the uplinks used in the LAG with the Manage Host Wizard and finally, move the LAG to the Active uplink and the former uplinks to the ‘unused’ section.

Bare-Metal Project

Project Synopsis

Part 1: HP 5900AF Initial Setup and IRF Configuration

Part 3: HP StoreVirtual VSA 2014 and HP D2200sb