Home

Dell PowerConnect M8024-K White Paper

1. 45 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F interface Tel 0 2 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 shutdown spanning tree port priority 0 mtu 2500 switchport switchpor switchport mode general general pvid 20 general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role auto down exit interface Tel 0 3 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 mtu 2500 switchport mode general switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lidp dcbx port role auto down exit interface Tel 0 4 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 shutdown spanning tree port priority 0 mtu 2500 switchport mode general switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role auto down exit interface Tel 0 5 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 spanning tree port priority 0 mtu 2500 switchport mode general switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role a
2. this will set the name for your zone bladel can be any chosen name vsan 2 will match the vsan you have created Member interface fc2 1 this adds the fc2 1 interface as a member of the zone member pwwn Xx XX XX XX XX XX XX XxX adds the port WWN of the ENode device to the zone insert the port WWN of the device being used o zoneset name setl vsan 2 move into the zoneset interface in this case the name is set1 but could be any name and the VSAN number is based on the FCoE VLAN being used member bladel this includes the bladel zone into this zoneset o zoneset activate name set1 vsan 2 activates the zoneset containing these zones Further explanation of key points e In order for devices to communicate end to end they must participate in the same VSAN In this sample configuration the VFC is bound to either the FCoE FIP MAC Address of the Converged Network Adapter in the blade server or an actual interface that would be a connection from the modular switch in this case M8024 K connecting the blade servers The recommended configuration for this is to bind to the FCoE FIP MAC address of the CNA However as an easy setup step it is possible to bind a VFC to the physical interface or port channel in order to determine which FCoE FIP MAC addresses will present from the CNA s These can be noted and then matched with the M1000e s CMC gt Server Overview gt WWN MAC Summary that can be seen in Figure 15 on the next pag
3. E when available In many of the business environments where this configuration will be installed there will be different administrators for the different areas of the infrastructure In other words there may be a LAN infrastructure administrator a storage or SAN administrator and potentially a server administrator These different team members will have to work together for a successful deployment of all the involved parts In an M1000e bladeserver environment it may be the server admin that deploys the blade servers operatings systems network adapter drivers and very possibly configures the blade IOM networking switches If different admins are involved as described these tasks can be done in parallel to enable a quicker deployment It is important to understand certain checks or validations along the way may rely on configurations being completed in a different part of the infrastructure 12 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F The Dell PowerConnect 8024 model switches will monitor FIP packets and will establish the proper filtering and priorities for the FCoE traffic that is passed through the configured links To see an example of the full configuration see M8024 K Example configure no mode simple vlan database vlan 20 1000 exit hostname mySwitch vlan database vlan 20 1000 exit feature fip snooping vlan 20 1000 fip snooping enable exit interface o
4. Firmware version 4 2 or later must be active for the DCB or stacking features to work correctly Do not downgrade the switch to firmware version 4 1 x x or earlier 44 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Appendix A Full CLI examples M8024 k CLI example show running config Current Configuration System Description PowerConnect M8024 k 4 2 1 3 VxWorks 6 6 System Software Version 4 2 1 3 Cut through mode is configured as disabled System Operational Mode Normal configure no mode simple vlan database vlan 20 1000 exit slot 1 0 2 PCM8024 k feature fip snooping vlan 20 1000 fip snooping enable exit stack member 1 1 PCM8024 k exit no logging console username root password e6e 66b8981c1030d5650da159e79539a privilege 15 encrypted line console exec timeout 0 exit classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp mapping interface Tel 0 1 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 shutdown spanning tree port priority 0 mtu 2500 switchport mode general switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role auto down exit NOR UN a NOR G WV a
5. s that are snooped and configured along with how many FCF s and ENode devices that are available If there is no entry or 0 FCF s or ENode s after running this command there is possibly a missed step in the configuration Proceeding beyond this point will not be possible until this configuration error is corrected PowerConnectM8024 k show fip snooping Global Mode Enabled FCoE VLAN List 20 1000 FECES ENodes Sessions Max VLANs Max FCFs in VLAN Max ENodes Max Sessions 25 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F The following command will show a set of vital information on the DCBX configuration Type sHow LLDP DCBX INTERFACE ALL The important things to note with this command are that the configuration source selected is True and that the configuration source port is configured as expected to be the uplink to the top of rack FCF switch It can also be noted that ports that are expected to be passing DCBX traffic should have counter statistics listed here PowerConnectM8024 k show lldp dcbx interface all Is configuration source selected Configuration source port unknown Interface Status Te1 0 1 Enabled Auto down Tel 0 2 Enabled Auto down Tel 0 3 Enabled Auto down 22562 Tel 0 4 Enabled Auto down 0 Tel 0 5 Enabled Auto down 22151 Tel 0 6 Enabled Auto down 0 Te1 0 7 Enabled Auto down 22292 Te1 0 8 Enabled Auto down 3 0 Tel 0 9 Enabled A
6. switch As mentioned above the full configuration with these settings in place can be seen in the Appendix A M8024 k CLI example 37 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Further notes on ETS CoS behavior settings Careful consideration should be taken when establishing the strict priority queues and managing bandwidth reservations It FCoE and iSCSI are configured on the same switch and these settings are used to configured both CoS queues it is possible to choke the bandwidth being allowed for regular LAN traffic As a suggested method limiting the queues for these priorities to 30 or 40 percent would keep this from occurring The preferred method for configuration is fabric separation or in simpler terms separating the two storage types onto different switches for ease of management and bandwidth control Figure 29 Fabric separation as preferred method for management of networks and storage LAN FCoE LAN FCoE storage storage LAN iSCSI LAN iSCSI storage storage gt mer ee ea o o o LAN mgmt 38 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Updating firmware K NOTE Be sure to check the Release Notes and any special instructions that may have come with new firmware updates It is important to follow instructions found in those documents if they deviate from this white paper Steps for u
7. two native VLANs In this example the configuration is set to use VLAN 20 since typically the recommendation is to have regular untagged traffic on a different VLAN other than just 1 for segregation of the network In addition when the FCF sends information to the fip snooping bridge FSB or M8024 k in this case the M8024 k is receiving the initial information for negotiation on its untagged vian vlan 20 in this case Once the initial negotiations have occurred properly the FCoE traffic will traverse the FCoE VLAN in this case VLAN 1000 e The last configuration line fip snooping port mode fcf is also key to this configuration This line establishes where the FCF is attached to the switch With this setting the port is configured to make Fibre Channel aware of the connection via this port to the forwarder The previous line Illdp dcbx port role auto up is setting this port to be aware of DCBx TLV s he difference being the fip snooping configuration line points to the port for using fip snooping tohe FCF and the Ildp configuration points to the point for doing DCBx negotiations 15 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Figure 9 Configuration overview of Dell PowerConnect M8024 k Establish native vlan and FCoE vlan onrig ratio 1 Turn on FCoE fip snooping features classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp m
8. FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F The following CLI commands are necessary for an un configured Cisco Nexus 5548UP or Cisco Nexus 5596 The full CLI will show additional lines that are either default or can t be changed and are not added for this example The CLI will also show the lines in a different order after they have been entered Appendix A Cisco Nexus 5548UP CLI example will have a copy of the full configuration feature fcoe feature npiv feature telnet feature lacp system default switchport trunk mode auto system qos service policy type qos input fcoe default in policy service policy type queuing input fcoe default in policy service policy type queuing output fcoe default out policy service policy type network qos fcoe default nq policy vlan 20 vlan 1000 fcoe vsan 2 vsan database vsan 2 vsan 2 interface vfcl vsan 2 interface fc2 1 interface vfcl bind interface Ethernet1 1 no shutdown interface fc2 1 switchport trunk mode auto no shutdown interface Ethernet1 1 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 zone name bladel vsan 2 member interface fc2 1 member pwwn XX XX XX XX XX XX XX XX zoneset name setl vsan 2 member bladel zoneset activate name setl vsan 2 amp Note that the provided Cisco commands should be referenced in the Nexus 5000 Series NX OS SAN Switching Configuration Guide The CLI entries ab
9. FLOGI DATABASE PORT NAME Oxc6000c 20 04 00 20 c2 10 ab cd 10 00 00 20 c2 10 ab 0xc60009 20 01 14 fe b5 07 12 34 20 00 14 fe b5 07 12 3 Total number of flogi 2 At this point the VFC and FC interfaces should be populated in the FLOGI database This command is showing the devices that have done a valid FLOGI fabric login to the Cisco Nexus switch The VFC should show the expected port and node WWN of the CNA being used in the server The following command will show the status of the zones that have been put into place The asterisks will indicate devices that have an established session have negotiated and logged in with the Cisco Nexus 5020 Type SHOW ZONESET ACTIVE This command will show the current activated zoneset and all the participating zones with their individual members Demo 5020 1 show zoneset active zoneset name setl vsan 2 zone name bladel vsan 2 foid 0xc 6000e interface fc2 1 sum 20 00 00 05 73 a6 12 34 feid 0xc60009 pwwn 20 01 14 fe b5 07 12 34 23 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F With all cables in place between the switches and the FC FCoE SAN use the following commands to validate your configuration First check general status of the ports and links by using SHOW INTERFACE STATUS PowerConnectM8024 k show interfaces status Flow Control Status Te1 0 1 Unknown Inactive Tel 0 2 Unknown Inactive Tel 0 3 10000 Inactive Tel
10. See PowerConnect 8024 CLI section for explanation of enabling both VLAN s for fip snooping 28 Problem Potential Problem Area The VFC entries may not be present on the Cisco Nexus 5000 series switch The VFC entry may not be enable no shutdown Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Potential Fix Ensure that VFC s are created that will be applicable to the connection This can be bound to the FCoE FIP MAC of the CNA or to the physical interface of the Cisco Nexus 5000 Series switch Check VFC entries applicable to the connection and make sure no shutdown is part of the configuration for that interface The FCoE VLAN may not match on both sides PowerConnect 8024 and Cisco Nexus 5000 series tagged VLAN entries matched to the FCoE feature The same tagged VLAN should pass FCoE traffic from the PowerConnect 8024 series switch to the Cisco Nexus 5000 series switch Configure this VLAN appropriately see CLI explanation sections LACP feature may not be enabled on Cisco Nexus 5000 series switch for applicable LAG s between the two switches Configure feature LACP on the Cisco Nexus and make sure the applicable port channel is put into the configuration see CLI explanation sections for further detail Configuration classofservice dot1p mapping may not be in place on the PowerConnect switch See PowerConnect 8024 CLI section for explanation
11. database vsan 2 interface port channel2 switchport mode trunk switchport trunk switchport trunk interface vfc3 bind mac address no shutdown interface vfc4 bind mac address no shutdown interface vfc5 bind mac address no shutdown interface vfc6 bind mac address no shutdown interface vfc7 bind mac address no shutdown interface vfc8 bind mac address no shutdown vsan database vsan 2 interface vsan 2 interface vsan 2 interface vsan 2 interface vsan 2 interface vsan 2 interface vsan 2 interface vsan 2 interface feature npv feature npiv interface fc1 31 switchport trunk no shutdown native vlan 20 allowed vlan 1000 14 fe b5 8e 5b f2 14 fe b5 8e 5b f0 14 fe b5 8e 5c 09 14 fe b5 8e 5c 0b 14 fe b5 8e 5c 26 14 fe b5 8e 5c 24 v c3 v c4 v c 5 v c6 vic7 v c8 fc1 31 fc1 32 mode on 53 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F interface fcl 32 switchport trunk mode on no shutdown interface Ethernet1 1 interface Ethernet1 2 interface Ethernet1 3 interface Ethernet1 4 interface Ethernet1 5 interface Ethernet1 6 interface Ethernet1 7 interface Ethernet1 8 interface Ethernet1 9 interface Ethernet1 10 interface Ethernet1 11 interface Ethernet1 12 interface Ethernet1
12. the CNA of the server being used in this case blade 2 zoneset name setl vsan 2 move into the zoneset interface in this case the name is set1 but could be any name and the VSAN number is based on the FCoE VLAN being used member bladel this includes the bladel zone into this zoneset member blade2 this includes the blade2 zone into this zoneset zoneset activate name setl vsan 2 activates the zoneset containing these zones 32 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F This is an example of the necessary CLI commands for 8024 model switches configured with two links in a LAG or port channel uplinked to the Cisco 5020 This provides more bandwidth and fail over capability which would be more typical in the larger scale infrastructure typically used 33 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Step by Step explanation of Dell PowerConnect M8024 k CLI example with multiple port LAG uplink this only covers the differences from the single port configuration o interface te1 0 19 this moves into the interface te1 0 19 configuration channel group 1 mode active adds this interface to the channel group 1 IIidp dcbx port role auto up sets the DCBX port role to be auto up for an FCF connection exit exit the interface configuration o interface te1 0 20 this moves into the interface te1 0 20 configuration c
13. the Cisco Nexus 5000 series switch with firmware ver 5 0 3 N2 2a in NPV mode for a multiple link LAG link aggregation connection from the Dell PowerConnect M8024 k or 8024 F MOI E A AA AA A E 36 Configuring the Dell PowerConnect M8024 k 8024 and 8024F for FIP Snooping with Cisco Nexus 5000 series switch in NPV mode ees cece ceded ce eka neve cab ee ede eb bru Ka A Ka Na aa a aa ang sabe dees 37 ETS Behavior and CoS configurations on the PowerConnect 8024 series switChes 37 Updating firmwares aaa gh ag Gre os ei ear eee A MATA Sheba Rava Ge ae Gee 39 Command line interface method Ang ia eee eee etna tate eee 39 Web interface method iveco ceases beatae bag ht protesta seen Ka BE ed bees bests par ads 41 Appendix A Full CLexamples asa a idas a ca 45 M8024 K CEKEXIMPI E isi cots clad ances dunce alle he Wade ada AE a a Ka EN MN ts 45 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Cisco Nexus 5548UP CLI example star o as oia o pr 52 Appendix B Network Switch VersiONS oooccoccocccccoconnonnncnnccnncnnnnnrnnrn cnn eg aaa da aa ka RR 56 PPP at aE EO EE E E DED aA KA aana EA aa ana aii 56 About Dell aaa aan a a gue Ad a a aa rd ali o gun an a Tan 56 Figures Figure 1 Dell PowerConnect M8024 k Switch 10G Ethernet cccseeeceeeeeeee sete aaa ara 6 Figure 2 Dell PowerConnect 8024F 10G Ethernet ccccccccsecceeeeeeeeesateeaeesateeeese
14. turns the fc2 1 interface on since default is shutdown interface Ethernet 1 1 selects interface Ethernet 1 1 switchport mode trunk set switchport mode to trunk for the 2 VLAN s switchport trunk native vlan 20 add native VLAN 20 to the trunk switchport trunk allowed vlan 1000 add allowed VLAN 1000 to the trunk channel group 1 mode active this interface is part of a port channel 1 interface Ethernet 1 2 selects interface Ethernet 1 2 switchport mode trunk set switchport mode to trunk for the 2 VLAN s switchport trunk native vlan 20 add native VLAN 20 to the trunk switchport trunk allowed vlan 1000 add allowed VLAN 1000 to the trunk channel group 1 mode active this interface is part of port channel 1 zone name blade1 vsan 2 this will set the name for your zone blade1 can be any chosen name vsan 2 will match the vsan you have created member interface fc2 1 this adds the fc2 1 interface as a member of the zone member pwwn Xx XX XX XX XX XX XX XxX adds the port WWN of the ENode device to the zone this should match the CNA of the server being used in this case blade 2 zone name blade2 vsan 2 this will set the name for your zone bladel can be any chosen name vsan 2 will match the vsan you have created member interface fc2 2 this adds the fc2 1 interface as a member of the zone member pwwn XX XX XX XX XX XX IXX XxX adds the port WWN of the ENode device to the zone this should match
15. typical scenario in a business environment consists of more than one connection or uplink The following pictures and examples describe a two link LAG from an M8024 k to the Cisco 5020 36 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Step by Step explanation of CLI example for the Cisco Nexus 5000 Series using NPV only covering the differences from the single port configuration o feature NPV enables the NPV feature which turns off zoning The FC side of the Nexus 5000 series switch effectively turns into just a FC gateway just passing FC out to another switch When this feature is enabled the Cisco Nexus 5000 series switch will have to do a full reload because it is completely changing the way it deals with the FC packet behavior Be prepared for this reload because it may impact a currently running network environment Configuring the Dell PowerConnect M8024 k 8024 and 8024F for FIP Snooping with Cisco Nexus 5000 series switch in NPV mode The configuration will be the same as previously mentioned in the single or multiple port configurations The simplicity of the PowerConnect 8024 series switch setup for FIP Snooping is one of the great advantages to using this in an FCoE network ETS Behavior and CoS configurations on the PowerConnect 8024 series switches The 8024 family devices will pass ETS information between end devices and the FCF but local settings are not changed in the 8024 s
16. 0 4 Unknown Inactive Tel 0 5 10000 Inactive Tel 0 6 Unknown Inactive Tel 0 7 10000 Inactive Tel 0 8 Unknown Inactive Tel 0 9 Unknown Inactive Te1 0 10 Unknown Inactive Te1 0 11 10000 Active Te1 0 12 10000 Inactive Te1 0 13 Unknown Inactive Te1 0 14 Unknown Inactive Tel 0 15 Unknown Inactive Tel 0 16 Unknown Inactive Te1 0 17 Unknown Inactive Te1 0 18 Unknown Inactive Te1 0 19 10000 Inactive Tel 0 20 10000 Inactive Oob Type oob Out Of Band Port Type Link Aggregate Link Aggregate Po3 127 removed from example for spacing Pol28 Link Aggregate Down Flow Control Enabled 24 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F With the SHOW SPANNING TREE BLOCKEDPORTS command the status of ports that may be impacted by spanning tree can be checked This is also a good point to make sure that the spanning tree behaviors are as expected such as Priority which switch is root etc PowerConnectM8024 k show spanning tree blockedports Spanning tree Enabled BPDU flooding Disabled mode rstp CST Regional Root 80 00 5C 26 0A AD 0C 39 Regional Root Path Cost 0 MST 0 Vlan Mapped 1 20 1000 ROOT ID Priority 32768 Address 5C26 0AAD 0C39 This Switch is the Root Hello Time 2 Sec Max Age 20 sec Forward Delay 15 sec Interfaces Role RestrictedPort On the PowerConnect M8024 k 8024 or 8024F the sessions can be checked by using SHOW FIP SNOOPING This will show the VLAN
17. 0 4 imagel imagel The current active column now shows the same values as the next active column The next step is to activate the image that contains the new firmware In this example the switch will need image2 activated Perform the following commands console boot system image2 Activating image image2 Images currently available on Flash unit imagel image2 current active next active 1 A 1 0 9 4 2 0 4 imagel image2 Notice that the next active column now shows different values than the current active column Before performing the following update bootcode command read the Release Notes and any special instructions for updating the firmware release It is generally required that you update bootcode only on major releases of the firmware whereas minor releases will not require the update to bootcode It is recommended to only run this command if required Press Y when prompted console update bootcode Update bootcode and reset Y N Y Issuing boot code update command Validating boot code from image CRC Valid Updating and rebooting the switch will take a few minutes If the bootcode is not required then a simple reload command will need to be performed After reload the firmware upgrade is complete 40 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F To validate login to the switch and perform a show version command For the example given the following is displayed cons
18. 13 interface Ethernet1 14 interface Ethernet1 15 interface Ethernet1 16 interface Ethernet1 17 interface Ethernet1 18 interface Ethernet1 19 interface Ethernet1 20 interface Ethernet1 21 interface Ethernet1 22 interface Ethernet1 23 zal interfac thernet1 24 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F interface Ethernet1 25 interface Ethernet1 26 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 interface Ethernet1 27 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 ct ct interface Ethernet1 28 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 interface Ethernet1 29 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 2 mode active interface Ethernet1 30 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 channel group 2 mode active interface mgmt0 ip address 172 25 188 100 16 line console line vty boot kickstart bootflash n5000 uk9 kickstart 5 0 3 N2 2a bin boot system bootflash n5000 uk9 5 0 3 N2 2a bin interface fc1 31 switchport mode NP interface fc1 32 switchport mode NP 55 Deploying FCoE FIP Snooping on Dell Powe
19. 500 switchport mode general switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 at tte ct 47 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F lldp dcbx port role auto down exit interface Tel 0 10 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 shutdown spanning tree port priority 0 mtu 2500 switchport switchpor switchport switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role auto down exit interface Tel 0 11 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 spanning tree port priority 0 mtu 2500 switchport mode general switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role auto down exit interface Tel 0 12 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 spanning tree port priority 0 mtu 2500 switchport switchport switchport mode general general pvid 20 general allowed vlan add 20 at tee ct mode general general pvid 20 general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan re
20. Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F A Dell Deployment Guide Authors Network Enabled Solutions Team Kevin Locklear Contributor Kili Land Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F This document is for informational purposes only and may contain typographical errors and technical inaccuracies The content is provided as is without express or implied warranties of any kind 2011 2012 Dell Inc All rights reserved Dell and its affiliates cannot be responsible for errors or omissions in typography or photography Dell the Dell logo PowerConnect and PowerEdge are trademarks of Dell Inc Intel and Xeon are registered trademarks of Intel Corporation in the U S and other countries Microsoft Windows and Windows Server are either trademarks or registered trademarks of Microsoft Corporation in the United States and or other countries Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products Dell disclaims proprietary interest in the marks and names of others March 2012 Rev 2 0 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Contents INCRODUCUION li A AGA Ae eae een A eee de 6 Basic TOTMINO NY sana aa naa aa A BA AK AS Ai 6 FIP SNOOPING ss vic A AD 6 FIP snooping bridge ESB 52 555 anak ario rr ari
21. If PVID is changed on 8024 series VLAN 1 must be removed Configure Native VLAN s appropriately See PowerConnect 8024 CLI section or Cisco Nexus 5000 series CLI section for detail on this ENode s or FCF entries are not present on the PowerConnect 8024 series switch See above basic connectivity problems see above Applicable FCoE or storage driver is not configured in the server OS for the CNA This could be an indication that the storage side of the CNA driver has not been fully installed CNA may not be configured as willing will negotiate values with the FCF switch Some CNA s have the option to configure the DCB settings manually This will potentially cause misbehavior due to the DCBX negotiations not occurring as expected ENode s or FCF entries are not present on the PowerConnect 8024 series switch continued PowerConnect 8024 may not have appropriate firmware in place it must be 4 2 0 4 or greater Cisco Nexus 5000 series switch may not have the supported firmware in place Must be 5 0 2 N1 1 or greater Download and install firmware 4 2 0 4 or greater see upgrade firmware section Download and install latest Cisco firmware Feature FCoE may not be configured on Cisco Nexus 5000 series switch Ensure FCoE feature is configured on Nexus 5000 Series switch fip snooping may not be enabled on the native and FCoE VLAN on the Dell PowerConnect 8024 series switch
22. N to be used for the Native VLAN vlan 1000 this is the VLAN being used for FCoE in this example fcoe vsan 2 this establishes the previous VLAN 1000 as an FCoE VLAN in VSAN 2 vsan database enter into the vsan database interface vsan 2 initializes VSAN 2 vsan 2 interface vfcl set interface vfcl to be part of VSAN 2 vsan 2 interface fc2 1 set interface fc2 1 to be part of VSAN 2 interface vfcl selects virtual fc interface vfcl vfcl is an example and can be a different number based on the admin s choice at configuration time Bind interface Ethernet1 1 this binds interface Ethernet 1 1 to the virtual fc interface which in this case is vfcl This is one form of binding the VFC The other form would be to bind the VFC to the FCoE FIP MAC address of the CNA being used Examples of this will be included later in the document no shutdown turns the virtual interface on since default is shutdown Interface fc2 1 selects the fc2 1 interface which will typically be the first fibre channel port on the Nexus 5020 no shutdown turns the fc2 1 interface on since default is shutdown interface Ethernet 1 1 selects interface Ethernet 1 1 switchport mode trunk set switchport mode to trunk for the 2 VLAN s switchport trunk allowed vlan 1000 add allowed VLAN 1000 to the trunk 19 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F o Zone name bladel vsan 2
23. a Di Mate bead 6 Pis Das aida a an gan gana a a a Ds a a an ati abla 6 A NARA 7 NP Vivan a A A A AA A A A A 7 NP A A AA A A ta aa Re ts 7 SAN A E Sk A AS 7 Configuration scenarios Wi di Ka NA a BA Kg nai Ed a 8 Important notes prior to deployment aas aaa aa aa AA KANEA eer Pa BAN AA aa aaa 9 Scenario 1 Deploying the Dell PowerConnect 8024 Series FSB in a Cisco 5000 Series Switch NPIV NN AAA RR E A AA 10 Configuring the Dell PowerConnect M8024 k 8024 and 8024F for FIP Snooping 13 Configuring the Cisco 5000 series switch with firmware ver 5 x for a single connection from the Dell PowerConnect M8024 k or B024 F oococccccnccccccnnncccnc cnn aa aaa a Nan Na nn aaa Ka rra rn ranas 17 Basic Validation for the PowerConnect M8024 k configuration sake cece cette eee ee eee eaes 23 Basic Troubleshooting Areas cial till is ld adsl e ad aii 28 Scenario 2 Configuring Multiple Uplinks into LAG for Cisco Nexus 5000 Series Switch NPIV ENVIFONMENE asar ray quilt dad ga aab iia 30 Configuring the Cisco Nexus 5000 series switch with firmware ver 5 x for a multiple link LAG link aggregation connection at the Top Of RacK oooocccccccccnnccnnccnncnnccnnca nano nar aa ada rn rr ag ana A A 31 Configuring the M8024 k 8024 and 8024F for FIP Snooping skak keanaan anae anae 33 Scenario 3 Configuring Multiple Uplinks into LAG for Cisco Nexus 5000 Series Switch NPV mode ENVIO Md A A is 35 Configuring
24. and 8024F Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Introduction The PowerConnect M8024 k 8024 and 8024F switches are now DCB DCBx capable with a downloadable update Starting with firmware 4 2 the latest PowerConnect 10 Gigabit switches can now be used as an FCoE Transit Switch FIP Snooping Bridge T11 BB 5 With this new firmware implementation Converged Network Adapters CNAs can be used in the rack mount or blade server to enable access to Fibre Channel networks and their storage NOTE The PowerConnect M8024 predecessor to the M8024 k does not support the FIP Snooping capability and will not be supported for any of the described scenarios This document provides an easy to use guide for configuring FIP Snooping on the Dell PowerConnect M8024 k Blade Switch Figure 1 and the PowerConnect 8024F Figure 2 Figure 1 Dell PowerConnect M8024 k Switch 10G Ethernet Figure 2 Dell PowerConnect 8024F 10G Ethernet o D AL PowerConnect 8024F Basic Terminology FIP snooping With FIP snooping enabled on the PowerConnect 8024 model switches FIP logins solicitations and advertisements are monitored In this monitoring or snooping process the switch gathers information pertaining to the ENode and FCF addresses With this information the switch will then place filters that only allow access to ENode devices that have logged in successfully Thi
25. apping classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp mapping No mode simple vlan database vlan 20 1000 feature fip snooping vlan 20 1000 fip snooping enable interface Tel pvid 20 allowed vlan add 20 switchport switchport ger spanning ti spanning tree port prio switchport mod eral Ildp dcbx auto up spanning tree portf fip snooping port moc 16 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F The CLI commands below are necessary for an un configured Cisco 5020 The CLI will show additional lines that are either default or can t be changed and are not added for this example The CLI will also show the lines in a different order after they have been entered will have a copy of the full configuration for a 5548UP for reference feature fcoe feature npiv feature telnet feature lacp feature lldp system default switchport trunk mode auto vlan 20 vlan 1000 fcoe vsan 2 vsan database vsan 2 vsan 2 interface vfcl vsan 2 interface fc2 1 interface vfcl bind interface Ethernet1 1 no shutdown interface fc2 1 switchport trunk mode auto no shutdown interface Ethernet1 1 switchport mode trunk switchport trunk native vlan 20 switchport trunk allowed vlan 1000 zone name bladel vsan 2 member interface fc2 1 member pwwn XX XX XX XX XX XX XX XX zoneset name setl vsan 2 member bladel zoneset activate name setl vsan 2 17 Deploying
26. auto up exit interface Tel 0 20 channel group 2 mode active cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 0 3 spanning tree port priority 0 mtu 2500 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role auto up exit Gt nak a interface port channel 2 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 spanning tree port priority 0 switchport mode general switchport general pvid 20 switchport general allowed vlan add 20 50 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 mtu 2500 fip snooping port mode fcf exit interface port channel 3 mtu 2500 exit interface port channel 4 mtu 2500 exit gt skipped port channel 5 through 126 for space interface port channel 127 mtu 2500 exit interface port channel 128 mtu 2500 exit enable password f611e082a05f5562f1d0d2bbcef2b5bf encrypted exit console 51 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Cisco Nexus 5548UP CLI example Technet5548 1 show running config Command Time Tue show runni
27. chpor switchport lldp dcbx exit interface cos queue cos queue shutdown port role auto down Te1 0 16 min bandwidth 0 0 0 50 0 0 0 strict 3 tree port priority 0 mode general general pvid 20 general allowed vlan add 20 general allowed vlan add 1000 tagged Gh Eber gt et general allowed vlan remove 1 port role auto down Tel 0 17 min bandwidth 0 0 0 50 0 0 0 strict 3 spanning tree port priority 0 49 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F mtu 2500 switchport switchport switchpor switchpor switchpor exit interface Tel 0 18 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 shutdown spanning tree port priority 0 mtu 2500 switchport switchport mode general general pvid 20 general allowed vlan add 20 general allowed vlan add 1000 tagged general allowed vlan remove 1 Gt eb Gh Gh at mode general general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 exit interface Tel 0 19 channel group 2 mode active cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 0 3 spanning tree port priority 0 mtu 2500 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role
28. e puts switch into normal mode o vlan database moves down into the VLAN database interface vlan 20 add VLAN 20 to used for untagged traffic or as the native VLAN vlan 1000 add VLAN 1000 to the VLAN database this will be the FCoE VLAN exit exit the current level of the interface configuration o hostname mySwitch set the hostname of the switch in this example mySwitch o feature fip snooping this turns on the fip snooping capability of the switch o vlan 20 1000 this moves the interface into vlan 20 1000 fip snooping enable this enables the fip snooping capabilities on these particular VLAN s Both must be included for the initial TLV negotiation to establish the FCoE VLAN exit exit interface configuration o interface out of band move into the interface out of band configuration interface ip address 192 168 100 1 255 255 255 0 192 168 100 254 this sets the out of band management interface IP address subnet and gateway for the switch exit exit the interface configuration o Classofservice dot1lp mapping x x establishes direct CoS mapping for the priorities must be in place for certain CNA s o interface te1 0 1 this moves into the interface tel 0 1 configuration switchport general pvid 20 establishes the native VLAN as 20 you must remove VLAN 1 in order for this to function correctly switchport general allowed vlan add 20 adds VLAN 20 the trunk as an untagged VLAN switc
29. e This is applicable only to the M8024 k modular switch with blade servers For the rack mounted 8024 switches the CNA s would need to be verified on the servers themselves This verification can be done through each adapters driver properties in the different operating systems Figure 12 Cisco Nexus 5000 series configuration sequence Add QoS Turnon alt settings if the features ToR is Nexus feature fcoe vlan 20 interface vfcl system qos i i feature npiv service policy type qos input fcoe default in policy vlan 1000 bind interface Ethernetl 1 fcoe vsan 2 no shutdown feature telnet service policy type queuing input fcoe default in policy feature lacp service policy type queuing output fcoe default out policy service policy type network qos fcoe default nq policy Configure zones Activate Zoneset o and zonesets vsan database interface Ethernet1 1 vsan 2 switchport mode trunk vsan 2 interface vfcl switchport trunk native vlan 20 vsan 2 interface fc2 1 switchport trunk allowed vlan 1000 zoneset activate name setl vsan 2 zone name bladel vsan 2 member interface fc2 1 member pwwn KAKAK AK KAKAK gt 22 gt SP gt 3 zoneset name setl vsan 2 member bladel 20 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Figure 13 M1000e Chassis Management Controller gt Server Overview gt Properties gt WWN MAC information for Blade Server 3 s B
30. eries switches This process allows for a best effort approach in the default configuration This will be sufficient for the typical business usage model but for more in depth settings the following CoS settings can be set in order to apply exact minimum thresholds for the queues that will be used for FCoE or iSCSI These minimum thresholds are a guaranteed minimum bandwidth for the queues involved in this case priority queue 3 for FCoE or 4 for iSCSI The following example is applicable to the FCoE class of service queue 3 settings These settings can also be found in the appendix in the full CLI example Figure 28 CoS settings to establish minimum bandwidth for FCoE queue Default priority is 0 CoS queue 0 Untagged frames receive the default priority treatment interface range tel 0 1 16 Set CoS queue 3 to strict priority not WRED 802 1Q0az Reserve 50 bw for CoS queue 3 exit interface tel 0 20 I Set CoS queue 3 to strict priority not WRED 802 10az traffic selection class 0 Reserve 50 bw for CoS queue 3 other queues best effort This bandwidth is shared with other queues if used cos queue min bandwidth Exit K NOTE In the above example the first setting is made on interfaces tel 0 1 through 16 These are all the internal server facing ports on the M8024 k modular switch The settings for te1 0 20 are based on this port being an uplink from the M8024 k modular switch to the Cisco Nexus 5000 series
31. exus 5000 Series Switch NPIV Environment Figure 23 Multiple port link LAG configuration between switches and storage Dell Compellent FC SAN solution da Dell PowerConnect M8024 k Dell PowerEdge M1000e Blade Server Chassis 30 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Configuring the Cisco Nexus 5000 series switch with firmware ver 5 x fora multiple link LAG link aggregation connection at the Top of Rack The typical scenario in a business environment consists of more than one connection or uplink The following illustrations and examples describe a two link LAG from an M8024 k to the Cisco Nexus 5020 Command Line Interface Method Figure 24 Multiple port link LAG Cisco 5020 configuration can be copied and pasted Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Step by Step explanation of CLI example only covering the differences from the single port configuration interface vfcl selects virtual fc interface vfcl vfcl is an example and can be a different number based on choice at configuration time bind interface port channell this binds interface port channell to the virtual fc interface which in this case g nA PR turns the virtual interface on since default is shutdown interface fc2 2 selects the fc2 2 interface this is an additional FC port for the 2 connections no shutdown
32. fabric CNA port 2 B2 D CMC LIL6JSR1 WWN MAC Summary HASSIS MANAGEMENT CONTROLLER Sehip Power 14FERSRESBEE 14FEBS865E11 14 FEB5 8E3E 12 Blade Server 3 with Mezz GEN 20 83 20 MFERS H soms cards installed in Band C 40 CHEKR 00 4048 AT FARA VFERARESEAR 4 fabric slots SETE EEA 5 O SCSI 00 10 18 14FEB53E5E17 6 00 10 18 A7FAB 14FEBSSESE18 EA SLOT 07 E tocalnost E slota 10 q 00 10 18 A7 FAB 14 FEBIREJEA1C 10 E sot 41 0 O01 RATEA AFERARES H siora2 2 all 14 FR RG RE SRE 20 01 14 FEBS 8E5E18 14FEB5 2E35E 1D 20 01 14 FEBS SESE1E 14FEB53E5E 22 14FE B58E5E 23 1FEBIREJE2 E 10 Got KR M E 10 GbE KR 4 WK 00 14FFRARFARFF BZ 10 Gbt KK R 10 GbE KR C2 Fans ikVM Power Supplies 20 01 14FE25 Temperature Sensors CNA to the created VFC and it will use the FCOC WWN for Zoning purposes 14FEBSSE5BF5 TSFEEOBEDE HG 21 Deploying FCoE FIP Snooping on Del PowerConnect 10G Switches M8024 k 8024 and 8024F With connections made via fiber optic cable or direct connect cable twin ax the basic connectivity on the port between the two switches can be verified These cables or SFP transceivers must only be Cisco branded products for the Cisco Nexus to link properly The following command is used to give a port status overview SHOW INTERFACE BRIEF This example has been shortened from the actual results but will display the results of active ports and VFC interfaces Verify that the port
33. hannel group 1 mode active adds this interface to the channel group 1 lldp dcbx port role auto up sets the DCBX port role to be auto up for an FCF connection exit exit the interface configuration o interface port channel 1 this moves into the interface te1 0 20 configuration switchport general allowed vlan add 1000 tagged this sets up a trunk with a tagged VLAN of 1000 the FCoE VLAN and includes the native VLAN as untagged if general mode is enabled switchport mode general this enables the port for mode general fip snooping port mode fcf enables the port for fip snooping from an FCF connection exit exit the interface configuration o exit exit from configuration mode Validation Follow the same validation steps as mentioned with the single link steps to ensure that this configuration is working correctly The ideal method for troubleshooting or validation isto take one link at a time 34 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Scenario 3 Configuring Multiple Uplinks into LAG for Cisco Nexus 5000 Series Switch NPV mode Environment Figure 26 Multiple link configuration between switches and storage Brocade 300 5100 Dell Compellent FC SAN solution Dell PowerConnect M8024 k Dell PowerEdge M1000e Blade Server Chassis 35 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F The
34. hport general allowed vlan add 1000 tagged this sets up a trunk with a tagged VLAN of 1000 the FCoE VLAN and includes the native VLAN as untagged if general mode is enabled switchport general allowed remove vlan 1 this removes vlan 1 which would typically be the native vian otherwise switchport mode general this enables the port for general mode Ildp dcbx port role auto down sets the DCBx port role to be auto down for an ENode connection spanning tree portfast sets the ports to a portfast behavior since these are internal facing server ports exit exits the interface configuration 14 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F o interface te1 0 20 this moves into the interface te1 0 20 configuration switchport general pvid 20 establishes the native VLAN as 20 you must remove VLAN 1 in order for this to function correctly switchport general allowed vlan add 20 adds VLAN 20 the trunk as an untagged VLAN switchport general allowed vlan add 1000 tagged this sets up a trunk with a tagged VLAN of 1000 the FCoE VLAN and includes the native VLAN as untagged if general mode is enabled switchport general allowed remove vlan 1 this removes vlan 1 which would typically be the native vian otherwise switchport mode general this enables the port for mode general spanning tree cost 0 sets spanning tree cost to 0 spanning tree port priori
35. identifier virtualization which enables multiple N port fabric logins at the same time on the same physical FC link Cisco Systems Inc 2011 This term is in reference to the Cisco Nexus 5000 series switches implementation of NPIV NPV N port virtualizer is a FC aggregation method which passes traffic through to end devices while eliminating the need to use a domain ID for this device Cisco Systems Inc 2011 This term is also in reference to configuration settings on the Cisco Nexus 5000 series switches VSAN Virtual SAN is a logical partitioning of physical connections to provide for fabric or SAN separation K Note The Dell M1000e Server Chassis includes a console redirect feature that allows you to manage each PowerConnect M8024 k module from a single serial connection to the chassis For more information about console redirect see the Dell Blade Server CMC User s Guide at http support dell com support edocs software smdrac3 cmc index htm Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Configuration scenarios The following sections will present very basic examples of deploying the 10G switches for FIP Snooping and will provide step by step explanations of the CLI commands as a guide The GUI does not currently support configurations for FIP Snooping Consult the table of contents above for a list of examples covered in this document Figure 3 General overview of deploymen
36. lso see PFC enable vector 3 1 this shows that priority queue 3 is set as strict and will be lossless 27 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Finally after these validation steps go into the disk management interface of the server If the SAN is configured appropriately the server will have an available LUN to use for storage Basic Troubleshooting Areas Problem Basic Connectivity Between CNA and 8024 Series switch is not present ping between devices Potential Problem Area Cable is not connected or is failing Potential Fix Connect or Change cable and reconnect The OS on the server is not configured to have the network card enabled or active Check adapter settings in the OS and verify ports turned on or enabled The driver for the applicable OS is not loaded Load driver and ensure both Ethernet and storage device drivers are in place for CNA if applicable Internal server facing ports on the M8024 k may not be enabled no shutdown Determine which internal ports should be enabled and configure the ports on with the no shutdown command External or regular ports on the 8024 series switch or Cisco Nexus 5000 series switch may not be enabled no shutdown Determine which external ports should be enabled and configure the ports on with the no shutdown command Untagged or Native VLAN s are not configured appropriately
37. move 1 lidp dcbx port role auto down exit interface Tel 0 13 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 shutdown spanning tree port priority 0 mtu 2500 switchport switchport switchport GE GTS OPE SEE GI mode general general pvid 20 general allowed vlan add 20 UA LN Gt 48 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx exit interface cos queue cos queue shutdown spanning mtu 2500 switchport switchpor switchpor switchpor switchpor lldp dcbx exit interface cos queue cos queue shutdown toetdctaad port role auto down Te1 0 14 min bandwidth 0 0 0 50 0 0 0 strict 3 tree port priority 0 mode general general pvid 20 general allowed vlan add 20 general allowed vlan add 1000 tagged general allowed vlan remove 1 port role auto down Te1 0 15 min bandwidth 0 0 0 50 0 0 0 SEPUCE 3 spanning tree port priority 0 mtu 2500 switchport mode general switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx exit I interface cos queue cos queue shutdown spanning mtu 2500 switchport switchpor switchpor swit
38. nd storage The scenarios following this one will show some of these larger configurations Note that this configuration will also work in the rack server environment with Dell PowerConnect 8024F switch Figure 5 Simple 1 link connection between devices as Dell Compellent FC SAN solution telde Dell PowerConnect M8024 k Dell PowerEdge M1000e Blade Server Chassis 10 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F The flowchart in Figure 8 is a general overview of how the deployment will occur This includes the basic planning that will need to take place in order for most of the steps in the rest of the document to fall into place Figure 6 General Overview of the whole configuration and planning procedure 11 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Figure 9 isa graphical representation of how many of the configuration pieces are considered parallel settings Most of the configuration will depend heavily on configurations being completed in more than just one place Figure 7 Overview of parallel configuration FCoE LLDP different Pen 7 ii 2 ai dii for the specific or physical be used r and LACP y Jenn default Sorte ia y inbound ports Configure ports for appropriate LLDP port role and fip snooping port Native and mode where FCoE traffic applicable Storage fi sto e WWN s Configuration
39. neennennes 6 Figure 3 General overview of deployment sisa anana aana ane teeta nett aane anaa 8 Figures DiSablingMple MODE aaa sanake tari Bas A an Bada arang aa A aana aa aa a aba aaa ag ana aa Ken gga A Aa 9 Figure 5 Simple 1 link connection between devices kasenenan eee anan anana nn ene tetas 10 Figure 6 General Overview of the whole configuration and planning procedure 11 Figure 7 Overview of parallel CONfigurati0N ooococcoccccccccnccnnonnncnrncrnnnn ner teeta rr 12 Figure 8 Example commands for Dell PowerConnect M8024 k can be copied and pasted 13 Figure 9 Configuration overview of Dell PowerConnect MBO24 koooo coooccccccccconccnccncnnonccnncanns 16 Figure 10 Sample CLI for Cisco Nexus 5020 can be copied and pasted oooccccccccccccccccnccnncnnns 17 Figure 11 Sample CLI for Cisco Nexus 5548 can be copied and pasted siii aana aaa 18 Figure 12 Cisco Nexus 5000 series configuration seguenCe saranane nana anane anana 20 Figure 13 M1000e Chassis Management Controller gt Server Overview gt Properties gt WWN MAC information for Blade Server 3 s B fabric CNA port 2 B2 0oooooccocccccccnconnccn naco anana 21 Figure 14 Example of show interface brief command cece cece eee cnc aana nett eae 22 Figure 15 show spanning tree summary command showing current configuration with ports states 23 Figure 16 sh
40. ng config Feb 14 22 47 07 2012 version 5 0 3 N2 2a feature fcoe feature telnet cfs ipv4 distribute feature lacp feature lldp username admin password 5 1S0bcPjaAdSt3MSaSb34 4Q0i0x il5VMO role network admin ip domain lookup hostname Technet5548 1 class map type qos class fcoe class map type queuing class fcoe match qos group 1 class map type queuing class all flood match qos group 2 class map type queuing class ip multicast match qos group 2 class map type network qos class fcoe match qos group 1 class map type network qos class all flood match qos group 2 class map type network qos class ip multicast match qos group 2 system qos service policy type qos input fcoe default in policy service policy type queuing input fcoe default in policy service policy type queuing output fcoe default out policy service policy type network qos fcoe default nq policy slot 1 port 31 32 type fc snn 0x1 0x1 np server user admin network admin auth md5 lizedkey snn 8e86ba84d1 8e86ba84d1 d5 as lfcb6fe4b5e02dc408 priv lfcbh 6 fe4b5e02dc408 loca no server nable traps entity fru vrf context management vi ip route lan 1 vi lan 20 name NATI 0 0 0 0 0 172 25 188 254 VE_VLAN 52 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F vlan 1000 fcoe vsan 2 name FCoE _VLAN vsan
41. o Unit No Boot Version Image1 Version Image2 Version Current Active Next Active 1 4 2 0 3 4 2 0 3 42 04 image1 image1 nooo o L Apply 8 Under the Next Active column select the new image i e image2 for the switch or stack Image1 Version Image2 Version Current Active Next Active 4 2 0 3 4 2 0 4 image image 9 Click Apply The Current Active column should now show the opposite values as what is in the Next Active column A reload is required to active the firmware 10 Select System gt General gt Reset Choose All in the Switch ID menu DOLL OPENMANAGE SWITCH ADMINISTRATOR Reset Detad Reset Detail HH GC Swich Ale 11 Click Apply 12 After the stack resets verify the new firmware has become active 13 Select System gt File Management gt Active Images again 43 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Notice that the new firmware i e 4 2 0 4 is now the Current Active image for each member Active Images Detail Active Images Detail Ha Os Unit No Boot Version Image1 Version Image2 Version Current Active Next Active 1 42 0 3 4203 42 0 4 image2 image2 y Apply While downgrading to a previous firmware is supported all features and functions that were not part of the previous firmware will be lost including those features and functions that were introduced in the current firmware in use
42. of applying this configuration CNA s that have NPAR capabilities may not have the partitions configured appropriately for FCoE See CNA documentation for applicable partition settings for FCoE use FLOGI entries for CNA s are not present See above basic connectivity on Cisco Nexus 5000 series switch problems see above Verify above section on ENode s or FCF present on PowerConnect 8024 series switch see above FLOGI entries for FC devices are not present on Cisco Nexus 5000 series switch Cable is not connected or is failing Connect or Change cable and reconnect Storage license for Cisco Nexus may not be installed Check licenses on Cisco Nexus and install if necessary End storage device is not powered on Power on Storage device Storage device is not configured to communicate with FCF or FC switch Configure storage device to have applicable settings FC port on Cisco Nexus not configured Configure FC ports for particular storage device and turn on no shutdown Cisco Nexus may be configured for NPV which allows for the logins to occur on FC switch further downstream Check configuration of Cisco Nexus If configured for NPV check for FLOGI logins on the FC switch that the Cisco Nexus is connected to 29 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Scenario 2 Configuring Multiple Uplinks into LAG for Cisco N
43. ole show version Images currently available on Flash unit imagel image2 current active next active 1 AL El e 4 image2 image2 While downgrading to a previous firmware is supported all features and functions that were not part of the previous firmware will be lost including those features and functions that were introduced in the current firmware in use Firmware version 4 2 or later must be active on all switches or stack members in order for stacking and DCB to work Do not downgrade a switch or stack to firmware version 4 1 x x or earlier Web interface method Find the firmware versions that the stack members are using 1 Select System gt File Management gt Active Images 2 Look in the Current Active column to find which images are enabled 3 Since image is active look in the Image 2 Version column to see what version each stack member is at These firmware versions being used should be the same across all stack member units Support About Log Out OPENMANAGE SWITCH ADMINISTRATOR Active Images Detail Active Images Detail He GC Unit No Boot Version Image1 Version Image2 Version Current Active NextActive 1 4203 4203 4202 image1 image Apply The commands below demonstrate how to copy the firmware file down to the switch via a TFTP server The switch will need access to the TFTP server on the network and the firmware file will need to be present in the download folder of the TFTP
44. ove only cover the areas that must be added to enable FCoE capabilities on the particular ports being used of a Cisco Nexus 5020 and Nexus 5548 This topic will be covered after the Step by Step explanation of the CLI example 18 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Step by Step explanation of the CLI example Configure this brings you into the configuration interface o feature FCOE enables the feature for FCOE as long as the licensing and FC modules are installed feature NPIV enables the FC ports to accept multiple logins Necessary for Compellent feature LACP enables the switch to be able to use port channel groups in a LACP mode feature LLDP enables the switch to use LLDP which is needed for DCBx negotiations Some switch versions will have this on by default and the entry will not be needed system qos o service policy type qos input fcoe default in policy service policy type queuing input fcoe default in policy service policy type queuing output fcoe default out policy service policy type network qos fcoe default nq policy these are qos settings that are in place by default on the 5010 and 5020 Cisco Nexus switches These settings will have to be input for the 5548 and 5596 Cisco Nexus switches system default switchport trunk mode auto sets trunk mode to auto for FC ports optionally this can be set to off or on if needed vlan 20 this is the VLA
45. ow flogi database command showing devices that have completed fabric login 23 Figure 17 Example of show zoneset active command ooocoocccccccnccnncnnoccrn cnn rnnnnn nenen anane aane 23 Figure 18 Show interface status results saananing iang aaa eg ea Aa aden a aan speeds ohn ed eee eee 24 Figure 19 show spanning tree blockedports command cece eect eee eee nett cnn 25 Figure 20 Show fip snooping command which gives a brief status on available ENode s and FCF s 25 Figure 21 show lldp debx interface alls soon aa id ai 26 Figure 22 Show Ildp dcbx interface tel 0 20 detail 0 0 0 ccc cetera 27 Figure 23 Multiple port link LAG configuration between switches and storage 30 Figure 24 Multiple port link LAG Cisco 5020 configuration can be copied and pasted 31 Figure 25 Multiple port uplink LAG M8024 k configuration can be copied and pasted 33 Figure 26 Multiple link configuration between switches and storage cece cece ee ee eee ee eae 35 Figure 27 Multiple port link Cisco 5020 configuration can be copied and pasted 36 Figure 28 CoS settings to establish minimum bandwidth for FCoE gueue cece ects eee eee ee 37 Figure 29 Fabric separation as preferred method for management of networks and storage 38 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024
46. pgrading the firmware on a stack of switches are similar to upgrading the firmware on a single switch After downloading a new image to the Master by using the File Download page in the Web UI or the copy command in the CLI the downloaded image is distributed to all member units of the stack The instructions below will guide you through these steps Command line interface method To find the firmware version the switch is using enter the following command show version PowerConnectM8024 k show version Image Descriptions imagel default image image2 Images currently available on Flash unit imagel image2 current active next active 11 4 1 0 9 Ale ORG imagel imagel The commands below demonstrate how to copy the firmware file down to the switch via a TFTP server The switch will need access to the TFTP server on the network and the firmware file will need to be present in the download folder of the TFTP server Perform the following command from the CLI interface Press Y when prompted Be patient as this procedure may take a few minutes 39 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Perform another show version command to confirm that the new firmware has been downloaded to the switch Notice that the firmware was copied into the inactive image for each member console show version Images currently available on Flash unit imagel image2 current active next active 1 ASE 4 2
47. r greater firmware installed See updating firmware section for instructions on performing this update oS Stacking is not recommended in an FCoE environment with the Dell PowerConnect 8024 Model Switches If the switches are stacked the configuration should be changed to disable stacking Please refer to the Dell PowerConnect 8024 4 2 firmware user s guide for further details on disabling or changing stacking ports If the configuration is used in this manner lossless Ethernet and reliability can not be guaranteed O PowerConnect 4 2 or greater firmware on M8024 k or 8024F As mentioned in the non FIP aware bullet the Dell PowerConnect Switches will not support FCoE or FIP snooping without 4 2 or greater firmware See updating firmware section to perform this update Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Scenario 1 Deploying the Dell PowerConnect 8024 Series FSB in a Cisco 5000 Series Switch NPIV environment This first example is a basic single connection between devices example using the Dell PowerConnect M8024 k This configuration is being shown for the purposes of simplification and potentially easing into the progression of a more in depth setup It is also easier to use a simple configuration such as this setup to aid in troubleshooting of the initial install In a typical business environment most configurations will be scaled to include several connections between servers a
48. rConnect 10G Switches M8024 k 8024 and 8024F Appendix B Network Switch Versions Version information for the network switches used in creating this document are as follows Table 1 Switch Firmware Versions 4 2 0 1 4 2 0 2 4 2 0 1 4 2 0 2 4 2 0 3 5 0 3 N2 2a 4 2 0 3 4 2 0 4 4 2 1 3 4 2 0 4 4 2 1 3 5 0 3 N1 1b Software version References Fibre Channel over Ethernet Initialization Protocol Cisco http www cisco com en US prod collateral switches ps9441 ps9670 white paper c11 560403 html T11 08 264v0 FCoE Increasing FCoE Robustness using FIP Snooping and FPMA T11 http www t11 org ftp t11 pub fc bb 5 08 264v0 pdf T11 09 291v0 FIP VLAN discovery updates T11 http www t11 org ftp t11 pub fc bb 5 09 291v1 pdf IEEE 2008 November 24 802 1Qaz D0 2 Draft Standard for Local and Metropolitan Area Networks Virtual IEEE 2009 Feb 9 802 1Qbb D1 0 Draft Standard for Local and Metropolitan Area Networks Virtual Cisco Systems Inc 2011 Cisco Nexus 5000 Series NX OS SAN Switching Configuration Guide Release 5 0 3 N2 1 San J ose Cisco Systems Inc About Dell Dell NASDAQ DELL is a leading technology provider to commercial and public enterprises around the world 56
49. s enables the FCoE VLAN to deny all other traffic except this lossless FCoE storage traffic The filtering process also secures the end to end path between the ENode device and the FCF The ENode will only be able to talk with the FCF in which it has logged into FIP snooping bridge FSB With a switch configured to performing FIP snooping the industry term for this switch is FSB or FIP snooping bridge It is performing FIP snooping as described in the previous term FCF FCoE forwarders FCFs act as an Ethernet and FC switch combined All typical termination functions that would occur on a FC switch occur on the FCF FCF s give VF_Ports and VE_Ports for their virtual FC interfaces Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F PFC Priority Flow Control PFC or Per Priority Pause is defined in the IEEE 802 1Qbb standard PFC is flow control based on priority settings and adds additional information to the standard pause frame The additional fields added to the pause frame allow devices to pause traffic on a specific priority instead of pausing all traffic IEEE 2009 Pause frames will be initiated by the FCF in most cases when its receive buffers are starting to reach a congested point With PFC traffic is paused instead of dropped and retransmitted This provides the lossless network behavior necessary for FC packets to be encapsulated and passed along the Ethernet paths NPIV N port
50. s which are expected to have links show up correctly Demo5548 1 fc1 31 fc1 32 Ethernet Interface Eth1 1 Eth1 2 Eth1 3 access Eth1 4 access Eth1 5 access Eth1 6 access rest of the ports removed for si Port channel VLAN Type Mode Interface Admin Trunk Speed Channel 10G D 10G D 10G D SFP not inserted 10G D SFP not inserted 10G D SFP not inserted zing Status Reason 1000 1500 Status Speed Channel trunking down trunking down trunking down trunking 22 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Check the spanning tree configuration Blocking ports should be understood and when they show in this entry it should be the number expected Otherwise it could be that an unintentional cable loop has been created that will need to be resolved Type SHOW SPANNING TREE SUMMARY rrent configuration with uli Figure 15 show s Demo 5020 1 show spanning tree summary Switch is in rapid pvst mode Root bridge for VLAN0001 Port Type Default is disable Edge Port PortFast BPDU Guard Default disabled Edge Port PortFast BPDU Filter Default disabled Bridge Assurance is enabled Loopguard Default is disabled Pathcost method used is short Blocking Listening Learning Forwarding STP Active Next verify that negotiations have happened properly between the FCF and end devices in this case the Cisco Nexus 5020 is the FCF Type SHOW
51. server If other methods are preferable over TFTP please see the User s Guide Perform the following steps 1 Select System gt File Management gt File Download 2 Select Firmware for the File Type and TFTP for the Transfer Mode 41 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F 3 Enter the IP address of the TFTP server into the Server Address field and enter the name of the Firmware file into the Source File Name field 4 If not in the root directory of the TFTP server enter the path of the firmware file DGLL OPENMANAGE SWITCH ADMINISTRATOR 15181264 Hosrarre of P actress PCE024A 2 04 atk 110 32 characters 10 160 Characters Apply 5 Click Apply The dialog box below will appear after a short period stating that the transfer is complete 2 informational Webpage Dialog US m7 File Transfer operation is complete Please check Transfer Status for details Clase 6 Click Close 7 Select System gt File Management gt Active Images Notice that the firmware i e 4 2 0 4 was copied into the inactive image for each member 42 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Also notice that the switch still has the same Current Active image as before Support About Log Out OPENMANAGE SWITCH ADMINISTRATOR Active Images nnect M8024 k admin rw Detail Active Images Detail He O
52. t The following suggested configurations used to deploy this solution is done in a sequential order for reading but as Figure 3 represents this is more of a simultaneous process There are dependencies that will be occuring during the configuration that will rely on other parts of the process Storage configuration is not covered in any depth due to the possibility for various supported storage devices as part of the whole solution Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Important notes prior to deployment y No Simple Mode Each of the following scenarios in this document assume that the PowerConnect 8024 model switch being used is in normal Switch Mode not Simple Mode and is using firmware version 4 2 x x or later E NOTE If Simple Mode is enabled it will need to be disabled prior to implementing the deployment covered in this document FCoE is not supported with the PowerConnect 8024 model switches in Simple Mode The CLI command in the example may be used for disabling Simple Mode but please consult the User Guide for more information on specifics of Simple Mode Figure 4 Disabling simple mode configure no mode simple Occ switches If a Non FIP Aware switch is introduced anywhere in the data path FCoE will not be supported and can t be expected to work as designed The Dell PowerConnect M8024 k and 8024F are considered non FIP aware switches until they have the 4 2 o
53. ty 0 sets this ports priority to 0 so that it has the lowest spanning tree priority in case a loop is created elsewhere on the switch IIdp dcbx port role auto up sets the DCBx port role to be auto up which dynamically sets the configuration source for an FCF connection fip snooping port mode fcf enables the port for fip snooping from an FCF connection exit exits the interface configuration exit exits from configuration mode K Critical steps The copy running configuration startup configuration command should be issued after important steps so that the switch will retain the configuration settings when the switch is next rebooted or if a power loss occurs It is also a good practice to copy a well validated working configuration to a separate location such as the management station for the networks and have a backup configuration saved local to the switch Further explanation of key points e The spanning tree settings in this example are established to keep the port from being potentially blocked by spanning tree This could occur because another cable is plugged into a port with a lower priority causing a loop When the uplink port is set to 0 it will have the lowest priority and therefore most likely not end up in a blocked state e A second key setting to note is switchport general allowed vlan remove 1 This command must be entered if you are choosing to use a different PVID or native VLAN A port cannot have
54. ut of band ip address 192 168 10 1 255 255 255 0 192 168 10 254 exit classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp mapping classofservice dotlp mapping exit interface Tel 0 1 switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 switchport mode general lldp dcbx port role auto down spanning tree portfast exit interface Tel1 0 20 switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 spanning tree cost 0 spanning tree port priority 0 switchport mode general lldp dcbx port role auto up fip snooping port mode fcf exit E CAUTION The copy running configuration startup configuration command should be issued after several impacting steps so that the switch will retain the configuration settings put into place on the next boot E Routed VLAN s can t have FIP snooping enabled VLAN 1 may be set for routing and this must be changed in the VLAN database if it is going to be used as the native VLAN or PVID 13 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F Step by Step explanation of CLI example o Configure this brings the prompt into the configuration interface o no mode simpl
55. uto down Atado 46 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F exit interface Tel 0 6 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 shutdown spanning tree port priority 0 mtu 2500 switchport switchport switchpor switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role auto down exit interface Tel 0 7 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 spanning tree port priority 0 mtu 2500 switchport mode general switchport general pvid 20 switchport general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lldp dcbx port role auto down exit interface Tel 0 8 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 spanning tree port priority 0 mtu 2500 switchport switchpor switchport mode general general pvid 20 general allowed vlan add 20 at tte ct mode general general pvid 20 general allowed vlan add 20 switchport general allowed vlan add 1000 tagged switchport general allowed vlan remove 1 lidp dcbx port role auto down exit interface Tel 0 9 cos queue min bandwidth 0 0 0 50 0 0 0 cos queue strict 3 spanning tree port priority 0 mtu 2
56. uto down 35 Te1 0 10 Enabled Auto down 0 Te1 0 11 Enabled Auto down 0 Te1 0 12 Enabled Auto down Te1 0 13 Enabled Auto down 0 Tel 0 14 Enabled Auto down Tel 0 15 Enabled Auto down Tel 0 16 Enabled Auto down Tel 0 17 Enabled Manual Te1 0 18 Enabled Manual Tel 0 19 Enabled Auto up Te1 0 20 Enabled Auto up oe O Oo oO 0 GOGON oe Oe Oo Oo Oc o E 8 SO DB Oo ceo am amp mi a The highlighted port lines show the ports that are actively taking part in FCoE traffic The role shown by each of the server facing ports should always be auto down while the role for the uplinks to the FCF should be auto up or configuration source There should be both DCBX Tx counters as well as DCBX Rx counters to show that the negotiations actually occurred with the particular devices 26 Deploying FCoE FIP Snooping on Dell PowerConnect 10G Switches M8024 k 8024 and 8024F The following command will show a set of vital information on the DCBX configuration Type sHow LLDP DCBX INTERFACE TE1 0 20 DETAIL This command will show more specific detail about the configuration that has been negotiated between the devices In this example port tel 0 20 is used as it is one of the uplink ports into the top of rack FCF switch Some key items in these results will be true for peer is configuration source Auto up for auto configuration port role and local configuration PFC 3 En Will Error configured as Y Y N As an additional note you should a

Dell PowerConnect M8024-K White Paper

Contents

Download Pdf Manuals

Related Search

Related Contents