IBM QLogic 10Gb VFA
Contents
1. THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some states do not allow disclaimer of express or implied warranties in certain transactions therefore this statement may not apply to you This information could include technical inaccuracies or typographical errors Changes are periodically made to the information herein these changes will be incorporated in new editions of the publication IBM may make improvements and or changes in the product s and or the program s described in this publication at any time without notice Any references in this information to non IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you Information concerning non IBM products was obtained from the suppliers of those products their published announcements or other publicly available sources IBM has not tested those products and cannot confirm the accuracy of performance compatibility or any other claims related to non IBM products Questions on the capabilities of non IBM products should2. be addressed to the suppliers of those products This information contains examples of data and reports used in daily business operations To illustrate them as completely as possible the examples include the names of individuals companies brands and products All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental Any performance data contained herein was determined in a controlled environment Therefore the results obtained in other operating environments may vary significantly Some measurements may have been made on development level systems and there is no guarantee that these measurements will be the same on generally available systems Furthermore some measurement may have been estimated through extrapolation Actual results may vary Users of this document should verify the applicable data for their specific environment COPYRIGHT LICENSE This information contains sample application programs in source language which illustrate programming techniques on various operating platforms You may copy modify and distribute these sample programs in any form without payment to IBM for the purposes of developing using marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written These examples have not been thoroughly tested under all conditions IBM th
3. ul jn Redbooks QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter IBM Redbooks Product Guide The QLogic 10Gb Virtual Fabric Adapter and Virtual Fabric CNA for IBM BladeCenter are based on the third generation QLogic Converged Network Adapter CNA 8200 ASIC which supports simultaneous LAN TCP IP and SAN Fibre Channel over Ethernet FCoE iSCSI traffic at line rate 10 Gbps Ethernet speed This convergence of networking traffic can lower data center costs by eliminating the need for separate LAN and SAN infrastructure Data centers now need fewer adapters cables and switches which also means reduced management power and cooling costs The QLogic 10Gb Virtual Fabric Adapter is shown in the following figure Figure 1 QLogic 10Gb Virtual Fabric Adapter for IBM BladeCenter Did you know QLogic 10Gb Virtual Fabric Adapters can operate in pNIC mode as regular 10Gb Ethernet adapters or in switch independent vNIC mode NIC partitioning NPAR where they can be divided into up to eight virtual adapters each up to four vNICs per physical port When QLogic 10Gb Virtual Fabric Adapters operate as CNA they can concurrently support multiple protocols such as running IP iSCSI and FCoE on the same port at the same time QLogic 10Gb Virtual Fabric Adapters support full hardware offload for IP FCoE and iSCSI protocol processing This feature frees up the servers CPU to perform other tasks Consequent
4. 0 Gb Virtual Fabric CNAs support simultaneous LAN TCP IP and SAN FCoE iSCSI traffic at line rate 10 Gbps Ethernet speed These adapters interface to the host server with a PCle Gen2 x8 bus designed to ensure that internal performance bottlenecks do not occur FCoE and iSCSI hardware offload When operated as a CNA the 10 Gb adapters support full hardware offload for FCoE and iSCSI protocol processing The QLogic FlexOffload features free up the server CPU to perform other tasks Consequently server applications can run faster and virtualized servers can support more virtual machines VMs Convergence The 10 Gb Virtual Fabric CNAs can reduce data center costs by converging data and storage networking This convergence can result in buying fewer adapters cables and switches In addition convergence can offer lower power consumption reduced cooling and easier LAN and SAN management Common drivers The 10 Gb Virtual Fabric CNAs are compatible with the same Fibre Channel and iSCSI software driver stacks that have been deployed in millions of previous installations These drivers are common across QLogic s lineup of Fibre Channel and iSCSI adapters simplifying revision management in heterogeneous environments Management Networking FCoE and iSCSI management can be easy with the new unified management application from QLogic QConvergeConsole QCC QCC provides single pane of glass management for QLogic s broad product line of s
5. O bay 7 I O bay 8 I O bay 9 I O bay 10 Supported I O Not used Supported I O Not used module module QLogic 10Gb Virtual Fabric CNA Supported I O Not used Supported I O Not used module module QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 8 Supported operating systems The adapters support the following operating systems Microsoft Windows Server 2012 Microsoft Windows Server 2008 R2 Microsoft Windows Server 2008 Datacenter x64 Edition Microsoft Windows Server 2008 Datacenter x86 Edition Microsoft Windows Server 2008 Enterprise x64 Edition Microsoft Windows Server 2008 Enterprise x86 Edition Microsoft Windows Server 2008 Web x64 Edition Red Hat Enterprise Linux 6 Server Edition Red Hat Enterprise Linux 6 Server x64 Edition Red Hat Enterprise Linux 5 Server Edition Red Hat Enterprise Linux 5 Server x64 Edition Red Hat Enterprise Linux 5 Server with Xen x64 Edition SUSE Linux Enterprise Server 11 for x86 SUSE Linux Enterprise Server 11 for AMD64 EM64T SUSE Linux Enterprise Server 11 with Xen for AMD64 EM64T SUSE Linux Enterprise Server 10 for x86 SUSE Linux Enterprise Server 10 for AMD64 EM64T SUSE Linux Enterprise Server 10 with Xen for x86 SUSE Linux Enterprise Server 10 with Xen for AMD64 EM64T VMware vSphere 5 1 VMware vSphere 5 0 VMware ESX 4 1 VMware ESXi 4 1 For the latest information about the specific versions and service packs supported see the IBM ServerProven website at http ibm com se
6. al copytrade shtml The following terms are trademarks of the International Business Machines Corporation in the United States other countries or both BladeCenter IBM Redbooks Redbooks logo ServerProven ServicePac system Storage System x The following terms are trademarks of other companies Linux is a trademark of Linus Torvalds in the United States other countries or both Microsoft Windows and the Windows logo are trademarks of Microsoft Corporation in the United States other countries or both Other company product or service names may be trademarks or service marks of others QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 15
7. ement tools and device utilities e QConvergeConsole A unified management tool GUI and CLI for Fibre Channel FCoE iSCSI and networking e Native OS management tools for networking e Boot support e Pre execution environment PXE FCoE and iSCSI boot e APIs e SNIA HBA API V2 SMI S QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter Supported servers The QLogic Virtual Fabric Adapters are supported in the BladeCenter servers listed in the following table Table 2 Supported BladeCenter and Flex System servers Part number Product description OOY3332 QLogic 10Gb Virtual Fabric Adapter Y 00Y5618 QLogic 10Gb Virtual Fabric CNA 00Y5622 QLogic 10Gb Virtual Fabric Advanced FoD Upgrade NIN N Y y N The QLogic 10Gb Virtual Fabric Adapters are also supported in the I O expansion units when the expansion unit is attached to the supported blade server as shown in the following table ow P aa PA 4 T A IRIS IEIS lalis So jo N o oO ope oo wn oO wma ae oe ee Se ee Z Z Z lt lt Z Table 3 Supported I O expansion units QLogic 10Gb QLogic 10Gb Virtual Fabric Virtual Fabric Part Adapter CNA number Description 00Y3332 00Y5618 PCI expansion units GPU expansion units 68Y 7479 IBM BladeCenter GPU Expansion Blade II with NVIDIA Tesla M2070Q Yes This expansion unit is available only via CTO See the IBM ServerProven website for the latest compatibili
8. erefore cannot guarantee or imply reliability serviceability or function of these programs Copyright International Business Machines Corporation 2013 All rights reserved Note to U S Government Users Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 14 This document was created or updated on June 24 2013 Send us your comments in one of the following ways e Use the online Contact us review form found at ibm com redbooks e Send your comments in an e mail to redbook us ibm com e Mail your comments to IBM Corporation International Technical Support Organization Dept HYTD Mail Station PO99 2455 South Road Poughkeepsie NY 12601 5400 U S A This document is available online at http www ibm com redbooks abstracts tips1025 html Trademarks IBM the IBM logo and ibm com are trademarks or registered trademarks of International Business Machines Corporation in the United States other countries or both These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol or indicating US registered or common law trademarks owned by IBM at the time this information was published Such trademarks may also be registered or common law trademarks in other countries A current list of IBM trademarks is available on the Web at http www ibm com leg
9. full 10 Gbps line rate on both ports 10 Gbps per port maximum throughput Based on the QLogic 8200 ASIC PCI Express 2 0 x8 host interface CFFh form factor 10 Gb ports operating either in a virtual NIC VNIC or physical NIC pNIC mode e vNIC mode Up to eight vNICs up to four vNICs per one 10 Gb port e Switch Independent mode of operation e Virtual port bandwidth allocation in 100 Mbps increments e Upto four vNICs can be configured as a NIC iSCSI or FCoE vNICs up to four NIC vNICs one FCoE vNIC and one iSCSI vNIC per port with optional Advanced Upgrade OOY5622 or with QLogic 10Gb Virtual Fabric CNA OOY5618 e pNIC mode dual port 10 Gb Ethernet adapter With optional Advanced Upgrade 00Y5622 or with QLogic 10Gb Virtual Fabric CNA OOY5618 the pNIC mode enables two LAN 10 GbE ports and four storage ports 2 iSCSI and 2 FCoE Supports Serial over LAN SoL and concurrent KVM cKVM IBM Fabric Manager support Preboot Execution Environment PXE support Switch Independent vNIC mode is also known as NIC Partitioning or NPAR where each physical port appears to the server as four virtual NICs Bandwidth for each vNIC can be configured from 100 Mbps to 10 Gbps This vNIC mode extends the existing VLANs to the virtual NIC interfaces It uses IEEE 802 1Q VLAN tags to separate data traffic the VLAN tags are added to the packet by the applications or drivers rather than by the switch Note The adapter only suppo
10. hernet and converged configurations 10 Gb Ethernet configuration The QLogic 10Gb Virtual Fabric Adapters can be used in the 10 GbE data center network In the example below we use QLogic 10Gb Virtual Fabric Adapters connected to the IBM Virtual Fabric 10Gb Switch Modules as shown in the following figure IBM BladeCenter H chassis Figure 3 IBM Virtual Fabric 10 GbE networking solution with QLogic 10Gb adapters The solution components used in the scenario described in Figure 3 are shown in the following table Table 6 IBM Virtual Fabric 10 GbE networking solution with QLogic 10Gb adapters IBM BladeCenter HS23 or other supported server 00Y5618 QLogic 10Gb Virtual Fabric CNA 8852 IBM BladeCenter H chassis 46C7191 IBM Virtual Fabric 10 Gb Switch Module installed in bays 7 and 9 44W4408 IBM 10GBase SR SFP Transceiver QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 11 FCoE converged networking The QLogic 10Gb Virtual Fabric CNAs can be used to deliver the converged data center solution In the example below we use QLogic 10Gb Virtual Fabric CNAs connected to the IBM Virtual Fabric 10Gb Switch Modules and the IBM switches are connected to the QLogic Virtual Fabric Extension Modules as shown in Figure 4 QLogic Extension Modules can be connected directly to Fibre Channel storage systems or to FC SAN IBM provides extensive FCoE testing to deliver network interoperability For a full listing of IBM su
11. ly the server s applications can run faster and virtualized servers can support more virtual machines QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 1 Part number information The following table shows the ordering part numbers and feature codes for QLogic 10Gb Virtual Fabric Adapters Table 1 Ordering part numbers and feature codes Description Feature code Adapter QLogic 10Gb Virtual Fabric Adapter for IBM BladeCenter 00Y3332 A4AC QLogic 10Gb Virtual Fabric CNA for IBM BladeCenter OOY5618 A4AD Features on Demand upgrade a ee QLogic 10Gb Virtual Fabric Advanced FoD Upgrade for IBM BladeCenter OOY5622 A4AE The standard QLogic10Gb Virtual Fabric Adapter can be upgraded to the same features as the QLogic Virtual Fabric CNA with the addition of the QLogic 10Gb Virtual Fabric Advanced FOD Upgrade option part number OOY5622 The adapter part numbers OOY3332 and 00Y5618 include the following items One QLogic adapter VFA or Advanced VFA Quick install guide Documentation CD Important notices flyer Features on Demand FoD upgrade option part number OOY5622 includes the following items e Feature authorization code e Feature activation instructions QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 2 Features The QLogic 10Gb Virtual Fabric Adapters have the following features QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 10 Gb converged adapters The QLogic 1
12. ms xbc cog IBM ServerProven http ibm com servers eserver serverproven compat us IBM System Storage Interoperation Center SSIC http ibm com systems support storage ssic QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter Notices This information was developed for products and services offered in the U S A IBM may not offer the products services or features discussed in this document in other countries Consult your local IBM representative for information on the products and services currently available in your area Any reference to an IBM product program or service is not intended to state or imply that only that IBM product program or service may be used Any functionally equivalent product program or service that does not infringe any IBM intellectual property right may be used instead However it is the user s responsibility to evaluate and verify the operation of any non IBM product program or service IBM may have patents or pending patent applications covering subject matter described in this document The furnishing of this document does not give you any license to these patents You can send license inquiries in writing to IBM Director of Licensing BM Corporation North Castle Drive Armonk NY 10504 1785 U S A The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES
13. pported FCoE and iSCSI configurations see the IBM System Storage Interoperation Center SSIC website at http ibm com systems support storage ssic IBM BladeCenter HS23 BM BladeCenter H chassis Figure 4 Converged IBM Virtual Fabric solution with QLogic 10Gb CNAs The solution components used in the scenario described in Figure 4 are shown in the following table Table 7 Converged IBM Virtual Fabric solution with QLogic 10Gb CNAs reference as IBM BladeCenter HS23 or other supported server e 14 ovs QLogic 10Gb Virtual Fabric CNA per server ez IBM BladeCenter H chassis o e eraa R F li While IBM Virtual Fabric 10 Gb Switch Module has ten external 10 Gb ports the configuration described above allows use of only up to eight external ports on each IBM switch because two 10 Gb external ports on each switch are remapped to two internal connections to each of QLogic Virtual Fabric Extension Modules as shown in Figure 4 QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 12 Related publications For more information refer to these documents Product web page http iom com systems bladecenter hardware openfabric ethernet html Announcement letter for the QLogic 10Gb Virtual Fabric Adapter and CNA http ibm com common ssi cgi bin ssialias infotype dd amp subtype ca amp amp htmlfid 89 7 ENUS 1 13 099 IBM System x Configuration and Options Guide http www ibm com syste
14. rts fixed 10 GbE connectivity no auto negotiation 1 Gb Ethernet connectivity is not supported Ethernet specifications Throughput 10 Gbps full duplex line rate per port Ethernet frame 1500 byte or 9600 byte jumbo frame Stateless offload IP TCP and UDP checksum offloads Large and giant send offload LSO and GSO Large receive offload LRO Receive side scaling RSS Header data split Interrupt coalescing VMware NetQueue and Microsoft VMQ QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 4 e Wake on LAN e Enhanced Ethernet e Priority Based Flow Control 802 1Qbb e Enhanced Transmission Selection 802 1Qaz e DCBX Protocol 802 1Qaz Protocols IEEE 802 3ae 10 Gb Ethernet IEEE 802 3ap 10GBASE KR IEEE 802 1Q VLAN IEEE 802 3ad Link Aggregation IEEE 802 1p Priority Encoding IEEE 802 3x Flow Control IPv4 RFQ 791 IPv6 RFC 2460 FCoE specifications e Logins Support for 2 048 concurrent logins and 2 048 active exchanges e Port virtualization N_ Port ID virtualization NPIV e Protocols SCSI 3 Fibre Channel Protocol SCSI FCP Fibre Channel Tape FC TAPE Profile SCSI Fibre Channel Protocol 2 FCP 2 Second Generation FC Generic Services FC GS 2 Third Generation FC Generic Services FC GS 3 FCoE and FIP FC BB 5 iSCSI Specifications Protocols RFC 3347 iSCSI Requirements and Design Considerations CHAP ISNS SLP Tools and utilities e Manag
15. rvers eserver serverproven compat us Warranty The adapters carry a 1 year customer replaceable unit CRU limited warranty When installed in a supported IBM blade server these adapters assume your system s base warranty and any IBM ServicePac upgrade Physical specifications The QLogic 10Gb Virtual Fabric Adapters have the following physical specifications Dimensions and weight approximate Height 167 mm 6 6 in Width 69 mm 2 7 in Depth 17 mm 0 7 in Weight 95 g 0 2 Ib QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter Shipping dimensions and weight approximate Height 189 mm 7 5 in Width 90 mm 3 5 in Depth 38 mm 1 5 in Weight 450 g 1 0 Ib Operating environment The adapter is supported in this environment e Temperature e Operating 0 C 55 C 32 F 131 F e Storage 20 C 70 C 4 F 158 F e Relative humidity 10 90 non condensing Agency approvals The adapters have the following agency approvals e Safety US Canada Europe e EMI e EMC e EN55022 e EN55024 e EN60950 CE e EN 61000 3 2 e EN 61000 3 3 e IEC 950 CB Scheme e FCC Part 15 Class A e UL1950 e CSA C22 2 950 95 e VCCI e NZAS3548 C tick e RRL for MIC KCC e BSMI e UL94 V QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter Configuration examples This section illustrates how the QLogic 10Gb Virtual Fabric Adapters and CNAs can be used in 10 Gb Et
16. torage and networking adapters The 10 Gb VFA also has API support so that it can be managed by other popular third party management tools including native OS management tools for networking Diskless boot The 10 Gb Virtual Fabric CNAs support booting the server from remote storage over both the LAN and SAN Consequently data centers can deploy thinner servers centralize OS image management increase system availability and simplify image redeployment Enhanced Ethernet Numerous additions to the Ethernet standard enable it to transport lossless converged LAN and SAN traffic The QLogic Virtual Fabric Adapters support all of the new Ethernet standards including 802 1Qbb Priority based Flow Control and 802 1Qaz Enhanced Transmission Unmatched expertise QLogic has an unparalleled advantage in delivering this new Converged Network Adapter technology QLogic is one of the leaders in both Fibre Channel and iSCSI adapters with years of experience providing Fibre Channel and Ethernet based products IBM Features on Demand The QLogic Advanced FoD upgrade for IBM BladeCenter OOY5622 enables support for full FCoE and iSCSI hardware offload through the Features on Demand FoD license upgrade This support enables flexibility and investment protection by offering the FCoE iSCSI license when you need it Technical specifications The QLogic 10Gb Virtual Fabric Adapters have the following specifications Host interface Operate at
17. ty information for BladeCenter servers http ibm com servers eserver serverproven compat us eserver html QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 6 Supported BladeCenter chassis and O modules The following table lists the supported chassis and I O module combinations that the QLogic 10Gb Virtual Fabric Adapters support in both pNIC and vNIC modes Table 4 Chassis I O modules supported with the QLogic 10Gb Virtual Fabric Adapters io oo oo ga on Part number Description wm i ser roce eEnener Paso Mowie w ES eseo nens sonsmenmea f aceeen ej l QLogic 10Gb Virtual Fabric Adapter and CNA for IBM BladeCenter 7 In BladeCenter H the ports of QLogic 10Gb Virtual Fabric Adapters are routed through the midplane to I O bays 7 and 9 Figure 2 The BladeCenter HT is similar in that the QLogic VFA card ports are also routed through the midplane to I O bays 7 and 9 Blade Server 14 Standardi bridge bays expansion cand Te H A a High speed QLogic VFA TT S bays expansion card QLogic 10Gb VFA port connections Other connections Chassis midplane Figure 2 IBM BladeCenter H I O topology showing the I O paths from QLogic 10Gb VFA The QLogic 10Gb Virtual Fabric Adapters require I O modules to be installed in bays 7 and 9 of the BladeCenter H or HT chassis Table 5 Table 5 Locations of I O modules required to connect to the expansion card Expansion card I
Download Pdf Manuals
Related Search