Home
BR-Series Adapter Installation Guide
Contents
1. EE AE aE aE aE aE aE aE aE aE AE aE aE aE aE aE E E AE aE aE AE aE aE aE a a aE aE aE aE HE aE aE aE TE TEE E aE aE AE aE aE aE aE aE EE THE Memory required by all installed packages 587202560 Current target 780140544 greater skipping Pack installation successful Unmount the storage bfa driver iso file root xenserver my dir umount iso Mount the network bna driver iso file root xenserver my dir mount o loop brocade brocade bfa 3 2 1 00801 xen 6 1 0 iso brocade bna 3 2 1 00801 xen 6 1 0 iso brocade bfautil noioctl 3 2 1 0 0 noarch rpm brocade driver linux xen61 v3 2 1 0 tar gz root xenserver my dir mount o loop brocade bna 3 2 1 0 xen 6 1 0 iso iso Change to the mount point directory root xenserver my dir cd iso 151 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 11 12 13 14 Install the network bna driver iso file root xenserver my iso install sh Installing QLogic 10G Ethernet Driver Preparing daa IE AE AE AE a aA AE AE AE AEE AE AE FE aE aE EEE aE aE AE AE AE EE EE 100 1 brocade bna modules xen it tH Hit tH HH HEE EE EEE E E EE EN Heeettt 50 2 brocade bna modules kdud4 f EET EE HER AEER E ER E ER E HEHEH 1005 Memory requi
2. 153 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Removing driver packages on Citrix XenServer systems The following procedures remove drivers and utilities supporting Citrix XenServer version 6 1 as an example Removing packages for other Citrix XenServer versions is similar 1 Boot the host and log on with Administrator privileges 2 Listthe drivers and utilities on the system root xenserver umfzwtyv iso rpm qa grep brocade brocade bfa modules kdump 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 0 0 brocade bna modules xen 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 40 0 brocade bfautil noioctl 3 2 1 0 0 brocade bfa modules xen 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 vede brocade bna modules kdump 2 6 32 43 0 4 1 xs1 6 10 734 170748 35 24 1450 0 3 Remove the drivers from the system root xenserver umfzwtyv iso rpm e brocade bfa modules kdump 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 0 0 brocade bna modules xen 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 0 0 brocade bfa modules xen 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 0 0 brocade bna modules kdump 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 0 0 Driver installation and removal on Solaris systems Use the following steps to install remove and upgrade the driver and utility packages on Solaris systems Installing driver packages on Solaris systems Use the following
3. 1 Refer to the QLogic BR Series Adapter Administrator s Guide for details Managing Windows driver configuration with Device Manager Use the Windows Device Manager to configure the following parameters Flow Control Interrupt Moderation IPv4 Checksum Offload Jumbo Packet Size NDIS QoS Large Segmentation Offload V1 IPv4 LSOv1 Large Segmentation Offload V2 IPv4 LSOv2 Large Segmentation Offload V2 IPv6 LSOv2 Locally Administered Network Address Receive Side Scaling RSS TCP UDP IPv4 Checksum Offload TCP UDP IPv6 Checksum Offload 335 BR0054504 00 A A Adapter Configuration Network driver parameters Following is an example for using the Device Manager on Windows Server To configure these parameters use the following steps 1 Run devmgmt msc to open the Device Manager window 2 Expand Network Adapters An instance of the adapter model should display for each installed adapter port 3 Right click an adapter port instance and select Properties to display the Properties dialog box for the port 4 Select the Advanced tab Figure A 1 illustrates the Advanced tab from a host running Windows Server 2008 R2 Brocade 10G Ethernet Adapter Properties 21 x General Advanced Diiver Details Resources The following properties are available for this network adapter Click the property you want to change on the left and then select its value on the right Property Value Tx
4. 345 BR0054504 00 A A Adapter Configuration Network driver parameters Table A 7 Network driver module parameters Continued Parameter Default value Possible values Method to Notes NetQueue Other NetQueue Configuration E Number of NetQueues and filters W Heap values Legacy Ethernet pause Enable or disable rx bw limiting Disable LRO Disable GRO Transmit NetQueues Receive NetQueues Enabled NA NA enable Enable Disable NA autoneg off on rx off on tx off on Disable Enable 1 Enable 0 Disable 1 Enable 0 Disable 0 Enabled 1 Disabled 0 Enabled 1 Disabled configure Configure in vSphere Client or vCenter esxcfg module ethtool A command bnad rbl enable bnad lro disable bnad gro disable bnad tx netq disabl e bnad rx netq disabl e Enables NetQueue for improving receive side networking performance on servers with multiple CPUs Refer to Configuring NetQueue on page 349 Refer to Configuring NetQueue on page 349 Flow control mechanism for Ethernet BR0054504 00 A A Adapter Configuration Network driver parameters Managing VMware driver configuration with cfg B Following is an example of using the esxcfg module command to disable message signaled interrupts MSI X sxcfg modul s bnad msix disable 1 bna where bnad_msix_disab1le QLogic netw
5. For example to overwrite the existing drivers with the new drivers use the following command brocade adapter software installer windows platform ve rsion exe DCHOSEN INSTALL SET BOTH DFORCE WIN DRIVER INSTALLATION 1 i silent CQ If VLAN configurations exist CNAs and Fabric Adapter ports configured in CNA mode a backup message displays during upgrade or reinstallation of drivers This message will note the location where configurations were stored You can restore these configurations after installation completes m Linux systems When upgrading the driver for Linux systems you do not need to reboot the host system after installation m Solaris systems When upgrading the driver for Solaris systems you must reboot the host system The new driver is effective after system reboot m VMware systems When upgrading the driver for VMware systems you must reboot the host system The new driver is effective after system reboot Because some versions of ESX and ESXi do not enforce maintenance mode during driver installation it is recommended that you put the host in maintenance mode as a system reboot is required after installation W X Software installation or upgrade on a host system with a large number of adapters could take much longer than normal To make sure that the drivers and adapter boot code are synchronized be sure to update your adapter with the latest boot image fro
6. 127 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Linux systems sh brocade_adapter_software_installer_linux_ lt version gt bin DCHOSEN INSTALL SET DRIVER i silent Solaris systems sh brocade adapter software installer solaris x86 version bin DCHOSEN INSTALL SET DRIVER i silent sh brocade adapter software installer solaris sparo version bi n DCHOSEN INSTALL SET DRIVER i silent B To install the driver packages HCM and management utilities in silent mode Windows systems brocade adapter software installer windows platform versio n exe DCHOSEN INSTALL SET BOTH i silent Linux systems sh brocade adapter software installer linux version bin DCHOSEN INSTALL SET BOTH i silent Solaris systems sh brocade adapter software installer solaris x86 version bin DCHOSEN INSTALL SET BOTH i silent sh brocade adapter software installer solaris sparc version bi n DCHOSEN INSTALL SET BOTH i silent B To overwrite existing driver packages with the new driver packages on a Windows system using silent mode brocade adapter software installer windows version exe DCHOSEN INSTALL SET DRIVER DFORCE WIN DRIVER INSTALLATION 1 i silent 128 BR0054504 00 A 3 Software Installation Using the QLogic
7. 0 00 02 e eee eee A 3 X Windows driver configuration parameters 0 000 ee A 4 Solaris driver configuration parameters 0000 eee eee xiii BR0054504 00 A Installation Guide BR Series Adapters A 6 A 7 A 8 A 9 B 1 Network driver configuration parameters 00 0c cee ee 333 Network driver configuration parameters 0 00 cee ee 338 Network driver module parameters 0 0000 eee ee 344 NetQueues and filters per NetQueue for CNAS 0000 e eee eee 350 NetQueues and filters per NetQueue for Fabric Adapter ports in CNA mode 351 Supported MIB groups and objects for SNMP 0 00 eee eee 353 xiv BR0054504 00 A Preface Intended Audience This guide introduces users to the BR Series adapters and explains its installation and service It is intended for users who are responsible for installing and servicing network equipment What Is in this Guide This manual provides installation and reference information on QLogic host bus adapters converged network adapters CNAs and Fabric Adapters for version 3 2 4 It is organized to help you find the information that you want as quickly and easily as possible The document contains the following components Chapter 1 Product Overview provides a detailed product overview and description Information on adapter hardware and software compatibility is also included Chapter 2 Hardware Installation provid
8. The Trunking license must be installed on the switch connected to the host bus adapter port or Fabric Adapter port configured in HBA mode Before enabling trunking consider the following requirements Q When trunking is enabled a trunked logical port Port 0 is created and reported per host bus adapter or Fabric Adapter port configured in HBA mode Most BCU commands are applicable in this logical port s context only OY When configuring Fabric Zones and LUN Masking for Storage use the PWWN for adapter port 0 Q Both adapter ports should be connected to the same port group on the switch C Only two ports on the same adapter can participate in trunking and both of these should be operating at the same speed 58 BR0054504 00 A 1 Product Overview Adapter features Q N Port Trunking is supported on dual port host bus adapter and Fabric Adapter models only C To enable or disable trunking on the adapter you must perform configuration tasks on both the switch using Fabric OS commands as well as the adapter using BCU commands and HCM Refer to the Brocade Fabric OS Administrator s Guide and QLogic BR Series Adapter Administrator s Guide for details Point to point topology PowerPC support QLogic Fabric Adapter ports configured in HBA mode support PowerPC extended error handling EEH for Linux on IBM POWER based pSeries and iSeries systems For Fabric Adapters this support is limited to RHEL 6 2 and SLES 11
9. 2202000 00 e eee eee 94 Stand up adsplBt6a aeos TIPP SI442 ERE UbeDee aereis 94 Mezzanine adapters 0 000 cece 94 2 Hardware Installation Introduction 0 0 0 0 cee eee 95 iv BR0054504 00 A Installation Guide BR Series Adapters ESD precautions ADD 96 Stand up adapters soecou 9c ac io a Ee PEK cen a e Ra 96 What you need for installation 000 0c eee ee eee 96 Installing an adapter losses RR Rhe 97 Connecting an adapter to switch or direct attached storage 100 Removing and installing SFP transceivers llus 100 Replacing an adapter 2 0 cee ee 102 Mezzanine adapters cesse s vee ee ee ERR REIR ERE ees 102 BR 804 host bus adapter 00 00 eee eee 102 BR 1867 and BR 1869 host bus adapters 103 BR 1007 CNA csse ga up RE ERR Ed Edid e mad ep xS pn 104 BR 174 I CNA ia ii aer ER AERE RARI DONE ss ES eU Ra e add 105 3 Software Installation Introduction sues REY REX ERE REGERE hee 107 Installation notes 0 2 00 0 eee 108 General cao ease ici over ica dur chet tab bade Run ae thane ud ob ea 108 LINUX ioa sng EG E en ee ae ee PERS P ed ated podes 110 Seca sax saat heehee eae es eae Re CRA eA Cee eee 111 WIfIdOWS 34 0624 64 234440450404 ea EA EE Iba OA ded a es 111 VMWABIG vei es Bao RE YEREXGX Ge EEE ee 112 Using the QLogic Adapter Software Installer llis 113 Using the GUl based installer 0 000
10. Following is an example to enable or disable Ethernet pause ethtool A ethx autoneg on off rx onl off tx onloff where ethx Adapter position in server For example ethO is the first Ethernet interface found in the system eth1 is the second eth2 is the third and so on autoneg Autonegotiate on or off rx Receive on or off tx Transmit on or off Managing Linux driver configuration with module parameter Either the driver configuration parameter values can be loaded with the driver or can be set in etc modprobe conf before loading the driver Following are examples of using modprobe to change network driver configuration This example sets the Linux logging level to debugging mode and loads the driver with the parameter value modprobe bna bnad log level 7 This example sets the Linux logging level to debugging mode Add the entry in etc modprobe conf and then load the driver options bna bnad log level 7 This example enables or disables MSI X and loads the driver with the parameter value modprobe bna bnad msix 0 1 342 BR0054504 00 A A Adapter Configuration Network driver parameters This example enables or disables MSI X Add the entry in etc modprobe conf and then load the driver options bna bnad msix disable 0 1 MSI X is enabled in the network driver by default and must remain enabled for NetQueue to function Enabling NetQueue in VMware system also enables MSI X in the system
11. Eliminating the requirement for local hard drives B Centralized storage management and administration of client workstations 203 BR0054504 00 A 4 Boot Code Boot over SAN Disaster recovery More control and efficiency for software distribution Increased host reliability since operating system boots from highly available storage devices W q improved security QLogic Legacy BIOS support The boot BIOS provides boot support for the QLogic BR Series Adapters in x86 and x64 host platforms The BIOS can discover up to 256 storage targets such as RAID units and the logical unit numbers LUNs on those units when the LUNs are bound to adapter ports When adapter BIOS is enabled the boot code loads from adapter option ROM into system random access memory RAM and integrates with the host system server BIOS during system boot to facilitate booting from LUNs which are also referred to as virtual drives and boot devices LUNs targeted as boot devices must contain the boot image for the host s operating system and adapter driver Boot over SAN can be supported on a maximum of 16 ports for example 8 dual port adapters Configure boot over SAN and other options for Legacy BIOS systems or UEFI systems operating in Legacy BIOS mode using the BIOS Configuration Utility BCU commands and HCM The BIOS Configuration Utility is embedded with the boot code Configuration options include the following W Enabling and disa
12. 5 Specifications Regulatory compliance Table 5 23 Regulatory certifications and standards Continued Country Safety specification EMC specification Japan CISPR22 VCCI V 3 2009 04 VCCI V 4 2009 04 VCCI A and Statement Republic of Korea KN24 KN22 KCC Mark Class A United States UL 60950 1 2nd Edition ANSI C63 4 cCSAus FCC Class A and Statement 309 BR0054504 00 A 6 Adapter Support Providing details for support Contact your QLogic adapter support provider for hardware firmware and software support including product repairs and part ordering Provide the following information 1 General information QLogic adapter model number Host operating system version Software name and software version if applicable Support Save output To expedite your support call use the Support Save feature to collect debug information from the driver internal libraries and firmware You can save valuable information to your local file system and send it to support personnel for further investigation For details on using this feature refer to Using Support Save on page 313 Detailed description of the problem including the switch or fabric behavior immediately following the problem switch description model and software version and specific questions Description of any troubleshooting steps already performed and the results 2 Adapter serial number The adapter serial number and correspo
13. Boot ver SAN cians ae ex Ricco a 3408 OX Ree whee ORC CC E nd 203 QLogic Legacy BIOS support 000 cece eee 204 QLogi URFUSUPDON 12225442236 Fondi ee o e LU REIP ED IERS 25 206 Booting from direct attach storage eee eee 207 Host system requirements for boot over SAN iilius 208 Storage system requirements for boot over SAN 209 Disabling N Port trunking cR RR RR RR eR 210 Important notes for configuring boot over SAN ilsssuu 210 Configuring boot over SAN subse c Re DR EE AR RELCERRIPEYLes 211 Operating system and driver installation on boot LUNs 217 Installing the full driver package on boot LUNs 233 Fabric based boot LUN discovery 00 cee eee eee eee 234 Configuring fabric based boot LUN discovery Brocade fabrics 235 Configuring fabric based boot LUN discovery Cisco fabrics 237 Boot systems over SAN without operating system or local drive 240 Using a LiveCD image lllseleeelnBBl 241 Creating a WinPE image llslllllllellsslssnr 242 Updating Windows driver on adapter used for boot over SAN 243 Using VMware Auto Deployment to boot QLogic custom images 243 Building a custom image for auto deployment or ISO image 244 Configuring BIOS with the BIOS Configuration Utility 246 Configuring BIOS with HCM or BCU commands 5 254
14. Fast flashing green Off Fast flashing green Beacon flashing green Beacon flashing green Off Adapter not operational It may not be powered up or not initialized Adapter is operational but the physical link is down Link is up No Ethernet or storage traffic Link is up Storage traffic only Link is up Ethernet traffic only Link is up Both Ethernet and storage traffic Port beaconing function End to end beaconing function CNA port and port on connected switch beacon Unsupported SFP transceiver 1 1 second on 1 second off 2 50 msec on 50 msec off 3 1 sec on 250 msec off 4 1 sec on 250 msec off 5 640 msec on 640 msec off 284 BR0054504 00 A 5 Specifications Converged Network Adapters Environmental and power requirements This section provides environmental and power specifications for the stand up and mezzanine card CNAs Stand up CNAs Table 5 11 lists environmental and power specifications for the stand up type CNAs Table 5 11 Environmental and power requirements Property Requirement Airflow 45 LFM Operating altitude 3 048 meters 10 000 ft at 40 C 104 F Nonoperating altitude 12 192 meters 40 000 ft at 25 C 77 F Operating temperature 5 C to 50 C 23 F to 122 F dry bulb Nonoperating temperature 43 C to 73 C 40 F to 163 F Operating humidity 10 to 93 relative noncondensing Nonoperating humidity 5
15. Multimode fiber optic small form factor pluggable plus adapters SFP transceiver B Copper SFP transceiver Connectivity E Stand up adapters LC cable connectors E Mezzanine adapters Interfaces to enclosure midplane for connection to switch I O and other modules are built on the card surface ASIC W Provides the FCoE functionality for the CNA B Two on board processors each operating at 400 MHz which coordinate and process data in both directions External serial FLASH E Stores firmware and CNA BIOS code memory B 4 MB capacity Data transfer rate 10 312 Gbps full duplex 278 BR0054504 00 A 5 Specifications Converged Network Adapters Table 5 8 CNA hardware specifications Continued Feature Description Performance per port 500 000 IOPs maximum 1 M IOPS per dual port adapter Topology 10 Gbps DCB Supported Ethernet protocols and features 803 3ae 10 Gbps Ethernet 802 19 VLAN 802 1q tagging 802 1P tagging 802 1Qaz enhanced transmission selection 802 1Qbb priority flow control 802 1AB Link Layer Discovery Protocol 802 3ad link aggregation 802 1p priority encoding 802 3x Ethernet flow control 802 3ap KX KX4 auto negotiation 802 3ak CX4 PXE Preboot Execution Environment UNDI Universal Network Device Interface NDIS Network Data Interface Specification 6 2 EEE 1149 1 JTAG for manufacturing debug and diagnostics IP TCP UDP Checksum Offload IPv4 Sp
16. Select the Manual option in Startup type 5 Click OK 185 BR0054504 00 A 3 Software Installation HCM configuration data W Changing the default communication port 1 Change to the agent installation directory default is c opt brocade adapter hbaagent conf 2 Edit abyss conf to change the entry SecurePort 34568 to any other nonconflicting TCP IP port for example SecurePort 4430 HCM configuration data HCM configuration data is compatible between versions 3 2 x x 3 0 x x 2 3 x x 2 2 X X 2 1 x x 2 0 1 1 x x and 1 0 Configuration data backed up when prompted during software removal with the Adapter Software Uninstaller and when using the HCM Backup Data dialog box includes the following Adapter application data HCM user data Alias data Setup discovery data Syslog data HCM logging data Support save data Backing up configuration data Use the HCM Backup Data dialog box to back up configuration data before removing HCM Also be sure to back up data when the backup message displays when removing software with the Adapter Software Uninstaller Following are default locations for HCM configuration data H Versions 1 1 0 8 and above user home HCM data a Versions 1 1 0 6 and below lt installation location gt FC HBA data Restoring configuration data Follow these guidelines when restoring configuration data backed up during software removal or with the HCM Backup Data dialog box B For
17. WinPE Only supported by Windows Server 2008 R2 and later network and storage drivers BR 1867 adapter Not supported by WinPE Windows Server Core Only supported on Windows Server 2008 R2 systems and later BNI Driver Supported on Windows Server 2008 R2 systems only 61 BR0054504 00 A 1 Product Overview Operating system considerations and limitations MSI X Supported by Windows Server 2008 R2 and later Team Virtual Machine Queue VMQ Supported by Windows Server 2008 R2 and later Virtual machines must be running Windows 7 or Windows Server 2008 R2 with Integration Services Setup disk installed Linux W PowerPC support Support in only technology preview mode for Fabric Adapters ports configured in HBA mode for RHEL 6 2 and SLES 11 SP1 m MSI X Supported by RHEL 5 RHEL 6 SLES 10 and SLES 11 Citrix XenServer This does not support HCM or QASI VMware Multiple Transmit Priority Queues only supported by ESX 5 0 or later MSI X Supported by ESX 5 0 and ESXi 5 x HCM ESXi systems can support HCM when CIM Provider is installed on these systems using the ESXi Management feature W QASI Not supported on VMware systems QASI will install HCM on VMware guest systems B Network Boot Not supported on VMware systems Solaris BR 804 adapter Not supported BR 1867 adapter Not supported BR 1007 adapter Not supported ISCSI over DCB Not supported NPIV Not supported Authenti
18. shell to get a bcu gt prompt where only the command adapter list is required W X Before installing the driver on Windows systems install the following hot fixes from the Microsoft Help and Support website and then reboot the System L Windows 2008 R2 KB977977 is recommended for CNAs and Fabric Adapter ports configured in CNA mode 111 BR0054504 00 A 3 Software Installation Installation notes VMware KB2490742 is recommended when installing storage drivers to avoida Ox000000B8 stop error when shutting down or hibernating a system running Windows 7 or Windows Server 2008 R2 Note that you can change the default communication port 34568 for the agent using the procedures under HCM Agent operations on page 183 Following are notes that you should be aware of when installing adapter software on VMware systems The QLogic Adapter Software Installer is not supported on the VMware ESX platforms for installing drivers HCM or utilities However you can use an appropriate QLogic Adapter Software Installer to install HCM on a guest system For VMware drivers and utilities are provided as ISO images packed in a tarball file A QLogic installer script is available for installation There are firewall issues with the HCM Agent and Common Information Model CIM Provider on VMware systems When installing the driver package on these systems open the following TCP IP ports from a guest system the se
19. 3 Software Installation Installation notes 4 Locate the boot code package for your adapter in the table click on it and then follow the directions Refer to Boot code updates on page 189 for instructions to install the image Installation notes This section contains general notes and specific notes for host system operating systems that you should consider before installing adapter software General Following are general notes you should be aware of when installing adapter software B For details on operating system requirements for installing adapter drivers refer to Host operating system support on page 70 and Software installation and driver packages on page 81 Also download the latest release notes from the QLogic Web Site using the following steps 1 Go to the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 3 Click the Driver link at the top of the page to direct you to the driver packages 4 Locate the driver for your adapter in the table and then click on the release notes link m Findthe installer program for your host s operating system and platform under Software installation and driver packages on page 81 Following are generic names for the Installer program for supported operating systems Q Wind
20. Because some versions of ESX and ESXi do not enforce maintenance mode during driver installation it is recommended that you put the host in maintenance mode as a system reboot is required after installation 139 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools To make sure that the drivers and adapter boot code are synchronized be sure to update your adapter with the latest boot image whenever you install or update adapter driver packages Use the following steps 1 Go to the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 3 Click the Boot Code link at the top of the page to direct you to the boot code packages 4 Locate the boot code package for your adapter in the table click on it and then follow the directions Refer to Boot code updates on page 189 for instructions to install the image For Windows systems installing the management utilities creates a QLogic BCU desktop shortcut on your system desktop Select this to open a Command Prompt window in the folder where the BCU commands reside You then run enter full BCU commands such as bcu adapter list or enter bcu shell to get a bcu prompt where only the command adapter list is required Driver installation and r
21. Contiguring UEFI ste RE REPE ERR Dr AR e gor Cm qe ac ex 255 Using Network menu options 02 000 eee eee 255 Using Storage menu options 0 000 eee 257 Fabric Adapter configuration support e eee eee 259 IBM Agentless Inventory Manager AIM support 259 Alternate methods for configuring UEFI 0055 260 UEFI Driver Health Check 0 00 c eens 263 Accessing UEFI driver health screen through IBM server 264 vii BR0054504 00 A Installation Guide BR Series Adapters 5 Specifications Fabric ACSBBIS x scaena E DAUERTE Eee ERE ee RE wee m De t toc 265 PCI Express interface iive sees soo ex E ELIO RR ENG ERE Rd 265 Hardware specifications s a ee kr RR RR Rhen 266 Cabling stand up adapters 000 cee eee eee 272 Adapter LED operation stand up adapters 274 Environmental and power requirements 20000e ee 276 Converged Network Adapters 0 000 e eee eee eee 277 PCI Express interface s uade des me Gee eet ted eta CERE 277 Hardware specifications s n aaua cee eee eee 278 Cabling stand up adapters nanana aaae 282 Adapter LED operation stand up adapters 283 Environmental and power requirements a an nuaa aunan 285 Host Bus AGADIGISs 042 Sx SOR RR Oed ERU EanRCR Mien CAGATRHA RET e c 288 PCI Express interface ise ondes se cR RESO S ERG RERO RU
22. bnasd service Updating drivers with HCM You can update installed drivers on connected hosts using the Adapter Software dialog box in HCM Updating the driver updates all of the following components to the latest versions Network and storage driver HCM Agent initrd file Linux systems To update drivers with HCM use the following steps 1 Go to the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model In the table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go Click the Drivers link at the top of the page to direct you to the driver packages Locate the driver package for your adapter in the table click on it and then follow the directions Select a host on the device tree and then select Adapter Software under the Configure menu The Adapter Software dialog box displays Enter the filename of the updated driver in the Driver File text box OR Click the Browse button and navigate to the location of the driver file to update Select Start Update The selected file downloads If an error occurs during the downloading process an error message displays Review the installation progress details that display in the dialog box to determine if the files install successfully 181 BR0054504 00 A 3 Software Installation Installing HCM to a host from the HCM Agent W This featur
23. gPXE boot This is an open source feature that allows systems without network PXE support to boot over the network It enhances existing PXE environments using TFTP with additional protocols such as DNS HTTP and iSCSI This feature is supported on QLogic standup CNAs and Fabric Adapter ports configured in CNA or NIC mode Enter a VLAN ID for a specific port for use when booting over the network bcu ethboot vlan port id vlan id where port id Specifies the ID of the port for which you want to set network boot attributes This could be the adapter id port id port PWWN port name or port hardware path VLAN id A value from 0 through 4094 Displays the PXE configuration on the specified port bcu ethboot query port id where port id Specifies the ID of the port for which you want to display configuration information All configuration values are stored to adapter flash memory For details on using BCU commands refer to instructions for ethboot in the QLogic BCU CLI appendix of the QLogic BR Series Adapter Administrator s Guide gPXE functions with the PXE feature using Universal Network Device Interfaces UNDI Configuration is not required through the BIOS Configuration Utility BCU commands or HCM Once the initial gPXE image is loaded through TFTP the required menu is presented by the gPXE image Stateless boot with ESXi Starting with ESXi 5 0 the ESXi image image profile resides on an auto
24. 306 BR0054504 00 A 5 Specifications Regulatory compliance Communications Commission KCC statement This is the Republic of Korea Communications Commission KCC regulatory compliance statement for Class A products Class A device Broadcasting Communication Device for Office Use This device obtained EMC registration for office use Class A and may be used in places other than home Sellers and or users need to take note of this AZ 77 GLE PSSA Ol WE SP S Ag S z BAW cid amp e 7 7 o e L OHA SEASAE Ol S FAHA HeH 2 3919 AISA AFg sre AS S ioz gLIcE VCCI statement Japan This is Class A product is based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment VCCI If this equipment is used in a domestic environment radio disturbance might arise When such trouble occurs the user might be required to take corrective actions C OE tt Ve fr He SUL BEC eet BLU t v EI dL B Dp d V CCI ORME CODIII A te EIN CS CO X EE ARERR ECC MS Sc ji dixe SHOT CEMHVES COBBAICIL H Aa ume d d45ormckedTp5ccAG6033 CE statement NOTE This is a Class A product In a domestic environment this product might cause radio interference and the user might be required to take corrective measures The standards compliance label on the adapter contains the CE mark which indicates that this system conforms to the provisions of European Council directives laws and standards listed in Table 5
25. As an example for the storage driver bfa mount o loop vmwar sx drivers scsi bfa 400 3 0 0 0 10EM 468461 iso ISO As an example for the network driver bna mount o loop vmwar sx drivers net bna 400 3 0 0 0 10EM 468498 iso ISO 162 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 13 14 15 16 17 18 Scan the ESXi 4 1 host against the driver CD bulletin IDs using the following command vihostupdat S bundle path of driver zip in mount location gt As an example vihostupdate s bundle ISO offline bundle offline bundle zip Once the target server is set using the vifptarget command you can also run the QLogic installer script on ESXi 4 1 hosts from VMA to extract files and install drivers packages Refer to Using the QLogic installer script for ESX 4 1 ESXi 4 1 and ESXi 5 0 systems on page 158 for details on using installer script commands Install the driver CD bulletin IDs using the following command vihostupdat i bundle path of driver zip in mount location As an example vihostupdate i bundle ISO offline bundle offline bundle zip Repeat steps 10 13 for each adapter driver to be installed Unmount the adapter driver ISO and delete the temporary ISO directory created in Step 12 using the following commands umount ISO rmdir p ISO Af
26. BR 1867 host bus adapter Figure 1 7 illustrates major components of the BR 1867 an host bus adapter mezzanine adapter containing two Fibre Channel ports operating at 16 or 8 Gbps The adapter measures 10 65 cm 4 19 inches deep 8 49 cm 3 34 inches wide and 4 15 cm 1 64 inches high The following illustration is representative and may have minor physical differences from the card that you purchased 1 x8 PCle interface connector 2 ASIC with heat sink 3 Connector guide 4 Midplane connector Figure 1 7 BR 1867 host bus adapter bottom view Labels showing the part number PWWNs model number and serial number for the BR 1867 host bus adapter are on the top side of the card reverse from side shown in previous illustration 22 BR0054504 00 A 1 Product Overview Host Bus Adapters The BR 1869 Adapter provides four Fibre Channel connections capable of providing 8 Gbps or 16 Gbps to devices on Fibre Channel FC SANs Depending on the system configuration the adapter provides up to 16 Gbps of full duplex line rate bandwidth per port The BR 1867 mounts on a compute node that installs in an IBM Flex System chassis Mezzanine adapters do not have external SFP transceivers and port connectors Fibre Channel communications are routed through the internal ports on the adapter to the chassis midplane and then onto switch modules installed in the chassis For information on installing the BR 1867 host bust ada
27. CL For ESX 4 1 systems rpm galgrep i bfa CQ For ESXi 5 X systems esxcli software vib list grep bfa These commands print the names of the Brocade network driver bna if installed Q For ESX 4 1 systems rpm ga grep i bna C For ESXi 5 X systems esxcli software vib list grep bna This command lists loaded modules sxcfg modul l For the storage driver verify that an entry for bfa exists and that the ID loaded For the network driver verify that an entry for bna exists and that the ID loaded This command displays the latest versions of installed drivers for ESX 4 1 systems cat proc vmware version For the storage driver verify that an entry for bfa exists For the network driver verify that an entry for bna exists This command displays the latest versions of installed drivers for ESXi 5 X systems esxcli software vib list grep i brocade 176 BR0054504 00 A 3 Software Installation Verifying adapter installation m This displays the driver package name version vendor Brocade and release date using vSphere ESXi Image Builder CLI for ESXi 5 X Get EsxSoftwarePackage W This utility displays information about all PCI buses in the system and all devices connected to them Fibre Channel QLogic Corporation displays for an host bus adapter or Fabric Adapter port configured in HBA mode Fibre Channel QLogic Corporation and Ethernet Controller display for a CNA or Fabric Adapter por
28. FC GS FC FS2 FC FDMI FC CT FCP FCP 2 FCP 3 FC BB 5 FCoE checksum offload SCSI SBC 3 NPIV tj B 5j D B a D m 5 B Target rate limiting Boot Over SAN including direct attached Fabric Based Boot LUN Discovery Persistent binding I O interrupt coalescing and moderation Class 3 Class 2 control frames 270 BR0054504 00 A 5 Specifications Fabric Adapters Table 5 2 Fabric Adapter hardware specifications Continued Feature Description Fibre Channel features and SCSI over FC FCP standards FCP2 FCP3 FC SP Authentication NPIV Quality of Service QoS Target rate limiting Boot over SAN Fabric Based Boot LUN Discovery I O Interrupt Coalescing T10 Data CRC Multiple Priority VC_RDY Frame Level Load Balancing Persistent Binding per Channel Fabric Based Configuration vHBA Fibre Channel Framing and Signaling Interface FC FS Fibre Channel Methodologies for Interconnects FC MI SCSI Architecture Model 2 Private Loop SCSI Direct Attach FC PLDA Fibre Channel Backbone FC BB 5 Fibre Channel Backbone FC BB 5 FIP 1 03 dpANS BB Credit error recovery D Port diagnostics port Forward error recovery FEC Target reset control 271 BR0054504 00 A 5 Specifications Fabric Adapters Table 5 2 Fabric Adapter hardware specifications Continued Feature Description Other adapter features and ASIC Flip flops Parity Protected standards
29. Names and Contents of the Toxic and Hazardous Substances or Elements In accordance with China s Management Measures on the Control of Pollution caused by Electronic Information products Decree No 39 by the Ministry of Information Industry the information in Table 5 22 is provided regarding the names and concentration level of Hazardous substances HS which may be contained in this product 303 BR0054504 00 A 5 Specifications Regulatory compliance Table 5 22 Hazardous Substances Toxic Substances HS TS concentration chart Hazardous Toxic Substance Elements Name of the Mercury Cadmium Hexavalent Polybrominated Polybrominated Component Lead Hg CD Chromium Biphenyl PBB Diphenyl Ether PB CR6 PBDE Fiber Channel X O Switch Fan Blower assemblies PCBA cards Host Bus Adapter HBA USB Flash Drive Power Supply kit SFPs optical cable O OIO OO O O connectors ey Sheet Metal Chassis Assembl Mechanical brackets amp Slides Slot Filler Cable management tra Cable Comb Cables and power cords D Replacement Doors Software Documentation CDs O O lt x xXx O O OO O OO O O OO O OO O O OO O OO x lt O O O O X indicates that the concentration of such hazardous toxic substance in all the units of homogeneous material of such component is higher than the SJ T11363 2006 Requirements for Concentration Lim
30. Rx Enabled Disabled 1514 9014 Enable Disable Enable Disable Enable Disable Hexadecimal value for MAC address Device Manager Device Manager Device Manager Device Manager Device Manager Device Manager Device Manager Device Manager Enables 802 3x flow control for Windows Server 2008 R2 only Supported on Windows Server 2008 R2 for IPv4 traffic Sets MTU size Size must not be greater than size set on switch that supports Data Center Bridging DCB Supported on Windows Server 2008 R2 for IPv4 traffic Supported on Windows Server 2008 R2 for IPv4 traffic Supported on Windows Server 2008 R2 for IPv4 traffic Overrides the burned in MAC address 333 BR0054504 00 A A Adapter Configuration Network driver parameters Table A 5 Network driver configuration parameters Continued Function Default value Possible values Method to configure Notes NDIS QoS Priority and VLAN Receive Buffers Receive Side Scaling RSS TCP UDP IPv4 Checksum Offload TCP UDP IPv6 Checksum Offload Teaming VLAN ID Disable Disable 2048 Enable Enable Enable N A Disabled 0 Enable Disable Enable Disable 512 1024 2048 Enable Disable Enable Disable Enable Disable Team up to eight ports Can enable VLAN IDs with values from 0 4094 Device Manager Device Manager Device Manager Device
31. Updating PHY firmware The Ethernet PHY module located in the BR 1741 mezzanine CNA port hardware only aids in communications to and from the Ethernet LAN Instructions are provided in this section to update this firmware if required Determining firmware version To query the PHY module and determine attributes such as the PHY module status and installed firmware version use the bcu phy query command bcu phy query port id where port id is the ID of the port for which you want to determine the firmware version This could be the PWWN port hardware path or user specified port name This could also be the adapter index port index For example to specify adapter 1 port 1 you would use 1 1 as the port identification 105 BR0054504 00 A 2 Hardware Installation Mezzanine adapters Updating firmware Download the latest PHY firmware file and update the PHY using the bcu phy update command bcu phy update ad id a image file where a if specified means that the update will apply to all adapters in the system that contain the PHY module ad idis the ID of the adapter file name is the name of the binary firmware file After updating the firmware you must disable and then enable the adapter to activate it 106 BR0054504 00 A 3 Software Installation Introduction This chapter provides procedures to install adapter drivers HCM and other software using the following options m
32. Windows Server 2012 N A Yes N A N A Windows Server 2012 R2 N A Yes N A N A RHEL 6 x N A Yes N A N A Linux XEN yes Yes N A N A Linux KVM N A Yes N A N A Oracle VM 3 0 N A Yes N A N A Citrix XenServer 5 6 6 0 and6 1 N A Yes N A N A 71 BR0054504 00 A 1 Product Overview Host operating system support For the latest support information on specific operating system release levels service pack levels and other patch requirements please refer to the latest release notes for your adapter Adapters and network technology This section describes operating system support for the QLogic BR Series Adapters and their supported network technologies W Fabric Adapters Refer to the following subsections depending on your port mode and SFP transceiver configurations J FCoE support on page 73 and Ethernet support on page 74 for ports configured in CNA mode CQ Fibre Channel support on page 73 for ports configured in HBA mode Q Ethernet support on page 74 for ports configured in NIC mode m CNAs Refer to the following subsections C FCoE support on page 73 Q Ethernet support on page 74 W X Host bus adapters Refer to Fibre Channel support on page 73 Specific operating system release levels service pack levels and other patch requirements are detailed in the current adapter release notes To keep drivers and boot code synchronized be sure to update your ad
33. amp Rx Enabled Header Data Split Interrupt Moderation IPv4 Checksum Offload Jumbo Packet Size Large Send Offload Version 1 IP 4 Large Send Offload Version 2 IPv4 Large Send Offload Version 2 IPv6 Locally Administered Address Priority and VLAN support Receive Side Scaling TCP UDP Checksum Offload IPV 4 TCP UDP Checksum Offload IPV 6 VlaniD Figure A 1 Properties dialog box for adapter port Advanced tab 5 Select the Property that you want to configure and select the Value 6 Click OK when finished 7 Repeat steps 2 through 5 for each port that you want to configure 336 BR0054504 00 A A Adapter Configuration Network driver parameters NIC Teaming When adapter ports are configured as members of NIC teams an instance of the team name Teamsz Team Name appears in the Device Manager Right clicking this instance displays a Properties dialog box similar to the example shown in Figure A 2 on page 337 Note that the team name Failover displays in the dialog box title Configure team related parameters for all ports belonging to a team using the Advanced tab f Team MyFailover Properties General Advanced Driver Details Resource The following properties are available for this network adapter Click the property you want to change on the left and then select its value on the right Property Value IPv4 Checksum Offload 4 Enabled Jumbo Packet Size Large Send Offload Ve
34. refer to 2 Hardware Installation For additional information related to the supported server blade blade enclosure and other devices installed in the enclosure such as I O and switch modules refer to the installation instructions provided with these products Hardware compatibility This section outlines important compatibility information SFP transceivers stand up adapters Use only the Brocade branded small form factor pluggable SFP transceivers described in Table 1 4 in BR Series stand up CNAs The table provides the type description and switch compatibility information for supported SFP transceiver Table 1 4 Compatible SFP transceivers for QLogic stand up CNAs SFP transceiver type Description Switch compatibility 10 Gbps SR short range SFP transceiver 1490 NM 10 Gbps LR long range SFP transceiver 10 km 1310 NM 1 meter direct attached SFP transceiver copper cable 3 meter direct attached SFP transceiver copper cable 5 meter direct attached SFP transceiver copper cable Optical short range SFP transceiver for Distance depends on cable type Refer to Cabling stand up adapters on page 282 Optical long range SFP transceiver for fiber optic cable 10 km 6 2 mi SFP transceiver with twinaxial copper cable 1 meter 3 2 feet maximum SFP transceiver with twinaxial copper cable 2 meters 9 8 feet maximum SFP transceiver with twinaxial copper cable 5
35. 00 00 00 50 00 00 05 00 00 00 01 1e 41 9a ca 00 00 00 02 DD EE FF 00 00 00 00 03 09 AA BB CC Enter the FOS OS cfgSave command on the switch to save the zone configuration Enter the FOS OS cfgenable command to enable the configuration The zone created is only an entity to store boot LUN data There is no zone enforcement by the fabric You must create a separate zone containing the adapter port and storage target port to ensure that the adapter port is able to see the target Configuring fabric based boot LUN discovery Cisco fabrics For CISCO fabrics zones are configured within VSANs Before you begin determine the VSAN configured in a current fabric for which you want to configure a zone to include boot LUN information Also you must enable enterprise zoning Note that zone information must always be identical for all switches in the fabric To store the boot LUN information in the fabric zone database you must use the zone name and member commands while in switch configuration mode The zone name command will be BFA adapter port WWN BLUN For example if the adapter PWWN is 01 00 05 1E 01 02 03 04 the zone name will be the following BFA 0100051E01020304 BLUN The member command must be specially coded values for the target PWWN and LUN identification for example 06 00 00 02 DD EE FF 00 To obtain the zone name and member values you will run the BCU boot blunZone command from yo
36. 23 Canadian requirements This Class A digital apparatus complies with Canadian ICES 003 Cet appareil num rique de la classe A est conforme a la norme NMB 003 du Canada 307 BR0054504 00 A 5 Specifications Regulatory compliance Safety and EMC regulatory compliance Table 5 23 lists the regulatory compliance standards and certifications for which the adapter is certified Table 5 23 Regulatory certifications and standards Country Safety specification ENC specification Australia and New Zealand Canada European Union Austria Belgium Cyprus Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta Poland Portugal Slovakia Slovenia Spain Sweden The Netherlands and United Kingdom International CSA 60950 1 07 2nd Edition cCSAus EN60950 1 2006 A11 TUV EN55022 or CISPR22 or AS NZS CISPR22 C Tick Mark ICES 003 Class A CE EN55022 2006 Class A Emissions EN55024 Immunity EN61000 3 2 2000 A14 Harmonics EN61000 3 3 A1 2001 Voltage Fluctuations EN55022 Emissions EN55024 Immunity IEC 61000 4 2 Electrostatic Discharge IEC 61000 4 3 Radiated Fields IEC 61000 4 4 Electrical Fast Transients IEC 61000 4 5 Surge Voltage IEC 61000 4 6 Immunity IEC 61000 4 8 Magnetic Fields IEC 61000 4 11 Voltage Dips and Interruptions 308 BR0054504 00 A
37. 4 in by 4 5 in 10 16 cm by 11 43 cm Mezzanine adapters mount in blade servers that install in supported blade system chassis Refer to the Server blades and system enclosures mezzanine adapters on page 16 for references for Fabric Adapter compatibility information Note that mezzanine Fabric Adapters do not have external port connectors with optics such as stand up adapters but internal ports that connect to switch and I O modules installed in the blade system chassis through high speed links in the internal chassis or enclosure backplane Three models of host bus mezzanine adapters are available B BR 804 B BR 1867 B BR 1869 20 BR0054504 00 A 1 Product Overview Host Bus Adapters BR 804 host bus adapter Figure 1 6 illustrates major components of the BR 804 mezzanine host bus adapter This mezzanine card installs in supported blade servers that install in Hewlett Packard BladeSystem c Class enclosures The following illustration is representative and may have minor physical differences from the host bus adapter that you purchased je dLTTTTTLLLLTM LLLI eri O 30 09 00 05 1E C7 ct Per 1 10 00 00 05 1E C7 84 06 K ps s haa iaa Pap m ale sibheiill 1 Mounting screws ASIC OEM serial and part number PWWNs for adapter ports a fF WO N QLogic serial and part number Figure 1 6 BR 804 mezzanine host bus adapter 21 BR0054504 00 A 1 Product Overview Host Bus Adapters
38. Adapter Software Installer W To install drivers in silent mode and overwrite the existing backed up initrd file in Linux systems sh brocade_adapter_software_installer_linux_ lt version gt bin DCHOSEN INSTALL SET BOTH FORCE INITRD BACKUP YES i silent W To install HOM interactively Windows systems brocade_adapter_software_installer_windows_ lt platform gt _ lt versio n gt exe Linux systems sh brocade_adapter_software_installer_linux_ lt version gt bin Solaris systems sh brocade_adapter_software_installer_solaris_x86_ lt version gt bin sh brocade_adapter_software_installer_solaris_sparc_ lt version gt bi n W To install the noarch driver on Linux systems in silent mode sh brocade_adapter_software_installer_linux_ lt version gt bin DCHOSEN INSTALL SET DRIVER DCONT NOARCH DRIVER YES i silent Installing HCM and driver package in silent mode using file option By identifying the default installation properties file after the software installer command HCM the storage driver and the network driver are installed by default in silent mode The HCM Agent starts automatically after installation This is the recommended method for silent installation BR 804 and BR 1007 adapters are not supported on Solaris systems so Solaris options in this section do not apply 129 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Use the following
39. At the boot prompt enter one of the following commands and press Enter a For booting over SAN use the following command linux dd W X For booting over SAN with multi path use the following command linux dd mpath The mpath option installs the operating system and driver to a LUN connected to the server through multiple paths and provides a unique and single name for the device If the mpath option were not used in a multi path configuration a separate device instance would display for each path during installation By using the option only one instance displays for the device although multiple paths still exist When the Driver Disk message box displays the Do you have a driver disk prompt select Yes and then press Enter You must load the QLogic BR Series Adapter driver at this stage so that the system can access the boot LUN for Linux installation From the Driver Disk Source window select the driver source hax where x is the CD or USB drive letter and then press Enter The Insert Driver Disk window displays Insert the driver update disk dud that you created in Step 3 into the CD or DVD Select OK and then press Enter The driver loads automatically 221 BR0054504 00 A 4 Boot Code Boot over SAN 10 When the Disk Driver window displays prompting for more drivers to install select No or Yes depending on the installed adapter and operating system and then press Enter For RHEL 5 and
40. Auto Auto Drv 25 Ctr1 27 Lang eng Options set Action Required is None Entering the drvcfg command with an f option drvcfg f sets adapter options to default values For example enter drvcfg f 25 27 Entering the command with the v option drvcfg v checks whether options configured for the adapter are valid For example enter drvcfg v 29 3F You could configure the other adapter port using the drvcfg command by keeping the driver handle the same and using the other controller handle drvcfg s 25 28 262 BR0054504 00 A 4 Boot Code UEFI Driver Health Check Execute a reset EFI shell command to reinitialize the system When the system restarts all available Fibre Channel devices display in map output as the EFI Shell initializes SAN drives display with Fibre as part of the device name Find the LUN that you have targeted for boot over SAN in the system s map output Note that you can also enter the following EFI shell command to list all storage targets and LUNs visible to the adapter port SAN drives display with Fibre as part of the device name dh d controller handle Refer to procedures for your system s Boot Configuration menu to verify that your host is configured to automatically boot from the target remote LUN Refer to instructions under Operating system and driver installation on boot LUNs on page 217 to install the host s operating system and adapter d
41. B Adapter LED operation stand up adapters on page 283 m Adapter LED operation stand up adapters on page 293 Using vMA to install driver packages on ESXi 4 1 systems This section provides steps to use the VMware vSphere Management Assistant vMA to install driver packages on ESXi 4 1 systems To install driver packages on ESX 4 1 and ESXi 5 0 systems refer to Using the QLogic installer script for ESX 4 1 ESXi 4 1 and ESXi 5 0 systems on page 158 Ensure that the following prerequisites are met before installation The vSphere Management Assistant vMA must be installed on an ESX system other than where you are installing the driver Download vMA from the VMware website Once vMA is downloaded please refer to the vSphere Management Assistant Guide for instructions on how to deploy vMA Put the ESXi server where the driver is to be installed in maintenance mode using vSphere client Using the vSphere Client right click ESXi and select the Enter Maintenance Mode option Use the following steps to install the driver package 1 Download the VMware driver package from the QLogic Web Site Refer to Software installation and driver packages on page 81 for details on driver packages and download instructions Extract the file using the following command tar zxvf brocade_driver_ lt esxversion gt _ lt driverversion gt tar gz Power on the vMA virtual machine Follow instructions from vSphere Managemen
42. BR 804 HBA B BR 1867 HBA B BR 1007 CNA B BR 1741 CNA For the BR 804 HBA refer to the regulatory compliance information in the Mezzanine Card Installation Instructions that ship with your adapter and to information in your blade system enclosure documentation BR 1867 HBA For the BR 1867 HBA refer to the regulatory compliance information in the IBM User Guide for your adapter BR 1007 CNA For the BR 1007 CNA refer to the regulatory compliance information in the Installation and User s Guide that ships with your adapter BR 1741 CNA This section provides regulatory compliance information for the BR 1741 mezzanine card Also refer to regulatory information provided by Dell for the blade server and Dell PowerEdge M1000e modular blade system FCC warning US only This equipment has been tested and complies with the limits for a Class A computing device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual might cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at the user s own expense Korea
43. Code Configuring BIOS with HCM or BCU commands 11 Press Enter The selected device will be added to the list of boot devices for the adapter on the Boot Device Settings screen Figure 4 12 Adapter Selected Adapter Model PCI Bus Dev Fn PWWN BR 1020 8c 700700 19 00 00 05 1E 55 27 60 Boot Device Settings ID PWWN LUN 8 50 06 GE 80 10 03 4A 90 0005000000000000 00 20 37 DE C3 2E OOOOCOOCOOOOOOOOO 3e 00 00 00 00 00 00 Baoegagaagaaggagaagagaga 80 68 88 98 80 80 90 00 B8O98008008000008008 Press C to clear the selection Press M to Manually edit the values R Select and configure lt Up Down gt Navigate lt ALt Q gt Exit lt Alt S gt Save and exit lt Left Right gt Change values Figure 4 12 BIOS Configuration Menu Boot Device Settings 12 Saveor exit the configuration utility W To save the configuration press ALT S W To exit without saving press the ALT Q Configuring BIOS with HCM or BCU commands Using BCU commands and HCM you can perform the following tasks Enable or disable BIOS for booting over the SAN Set port speed for HBAs and Fabric Adapter ports configured in HBA mode Select the boot option auto flash first visible LUN Set bootup delay Display BIOS configuration parameters Select boot LUNs You can only designate bootable devices LUNs using the Boot Device Settings feature of the BIOS Configuration Utility 254 BR0054504 00 A 4 Boot Code Co
44. Creates and saves the Support Save output under the tmp directory on Linux and Solaris systems C Creates and saves the Support Save output under the current directory for Windows systems W bfa supportsave dir Creates and saves the Support Save output under a directory name that you provide m b a supportsave dir ss file name Creates and saves the Support Save output under a directory and file name that you provide If the directory already exists it will be overwritten If specifying a directory make sure that the directory does not already exist to prevent overwriting the directory Do not just specify a drive such as C or C Program Files Messages display as the system gathers information When complete an output file and directory display The directory name specifies the date when the file was saved For more information on the bfa_supportsave command refer to the Host Connectivity Manager HCM Administrator s Guide VMware ESX systems For VMware ESXi 5 0 and later systems BCU commands are integrated with the esxcli infrastructure To initiate the BCU Support Save command enter esxcli brocade supportsave on the ESX system 316 BR0054504 00 A 6 Adapter Support Using Support Save Initiating Support Save through the Internet browser Initiate bfa_supportsave through an Internet browser 1 Open an Internet browser and type the following URL https localhost 34568 JSONRPCServiceApp SupportSa
45. EBUG tru DEBUG tru Software upgrade using the QLogic Adapter Software Installer To upgrade HCM adapter driver packages or the driver simply follow the instructions under Using the GUI base packages and HCM d installer on page 114 or Software installation using Software Installer commands on page 120 You do not need to remove the existing software first However refer to the following important notes when upgrading as procedures may vary from first time installation on specific operating systems B Windows systems reboot after installation install the new driver without first removing th C When using the QLogic Adapter Software Ins Q When upgrading the driver for Windows systems you do not need to Q The recommended procedure for upgrading Windows drivers is to e existing driver taller commands for installation and an existing driver is installed on the system you must use the following parameter to overwrite with DFORCE WIN DRIVER INSTALLATION 1 135 the new driver BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer For example to overwrite the existing driver packages with the new driver packages and start the HCM Agent automatically use the following command brocade adapter software installer windows platform ve rsion exe DCHOSEN INSTALL SET DRIVER DFORCE WIN DRIVER INSTALLATION 1 i silent
46. FCC warning 306 KCC statement 307 safety and EMC regulatory compliance table 308 VCCI statement 307 BR 1007 adapters 306 BR 1867 adapters 306 BR 804 adapters 306 stand up adapters 298 BSMI warning 299 Canadian requirements 300 CE statement 300 FCC warning 298 KCC statement 299 laser compliance 300 safety and EMC regulatory compliance table 301 VCCI statement 299 removing driver and HCM 134 removing driver with software installer 130 removing driver with software uninstaller commands 133 removing HCM with software installer 130 removing HCM with software uninstaller commands 135 replacing stand up adapters 102 restart conditions for HCM Agent 183 RoHS statement 303 RoHS 6 33 S safety and EMC compliance 1741 adapters 308 stand up adapters 301 safety information stand up adapters 305 scripts for software installer 78 serial number location 310 BR0054504 00 A Installation Guide BR Series Adapters SFP transceivers CNAs 15 Fabric Adapters 5 HBAs 25 QLogic 25 removing and installing 100 SLES11 errata kernel upgrade 111 SMI S 33 60 SNMP 37 46 adapter support 67 subagent installation 180 software compatibility 5 15 25 downloading from website 92 driver package 75 HCM 79 installation packages 81 installing 107 installing with scripts and commands 138 installing with software installer 113 overview 75 removal with scripts and commands 138 removing with software installer 130 using software uninstaller comm
47. GUI in silent mode no interaction required sh brocade_adapter_software_installer_solaris_x86_ lt version gt bin i silent Install software in silent mode using default installation properties file Note that this is recommended for silent mode sh brocade adapter software installer solaris x86 version bin i silent f HCMDefaultInstall properties 122 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Install software in silent mode using default installation properties file Note that this is recommended for silent mode sh brocade adapter software installer solaris x86 version bin i silent f HCMDefaultInstall properties Install driver HCM GUI or both in silent mode Overwrites th xisting driver installed on the system sh brocade adapter software installer solaris x86 version bin DCHOSEN INSTALL SET DRIVER GUI BOTH i silent SPARC platforms Install driver HCM GUI or both Overwrites th xisting driver installed on the system sh brocade adapter software installer solaris sparc version gt bin Installs drivers and HCM GUI in silent mode no interaction required sh brocade_adapter_software_installer_solaris_sparc_ lt version gt bin i silent Install drivers and the HCM GUI using a default installation properties file sh brocade_adapter_software_installer_solaris_sparc_ lt version gt bin f HCMD
48. HCM Agent and full range of utilities refer to Installing the full driver package on boot LUNs on page 233 after completing the following steps Refer to Boot installation packages on page 88 for a list of driver update disk files and the operating systems that support these files Also refer to Host operating system support on page 70 for information on operating system support for adapter drivers NOTE For RHEL 5 x86 and x86_64 systems install the fc DUD files for CNAs and Fabric Adapter ports configured in CNA mode and for HBAs and Fabric Adapter ports configured in HBA mode The fc dud file format is brocade_fc_adapter_operating system_platform_dud_version iso Download the RHEL adapter driver update disk DUD iso file for your host platform from the QLogic Web Site a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column Linux Red Hat in the third column and then click Go 220 BR0054504 00 A 4 Boot Code Boot over SAN c Click the Driver Update Disks link at the top of the page to direct you to the DUD zip file d Locate the DUD link for your adapter in the table click on it and following the instructions Create a driver update disk CD or USB drive from the ISO image Insert the Linux Red Hat product CD 1 into the host system s CD drive and boot the system
49. If enabling NetQueue make sure that bnad_msix 0 is not listed in VMware module parameters because that would disable NetQueue Managing Linux driver configuration with module ifconfig Following are examples of using ifconfig to change network driver configuration This example sets the locally administered MAC address ifconfig ethX hw ether addr where ethx Adapter position in server For example ethO is the first Ethernet interface found in the system eth1 is the second eth2 is the third and so on This example sets the Jumbo Packet MTU size ifconfig ethx mtu MTU size where ethx Adapter position in server For example ethO is the first Ethernet interface found in the system eth1 is the second eth2 is the third and so on MTU size MTU size 1514 9014 kb 343 BR0054504 00 A A Adapter Configuration Network driver parameters VMware Table A 7 describes the instance specific network configuration parameters available for VMware hosts You can list all module parameters that you can configure for the network driver using the following command vmkload mod s bna Parameter bnad num rx n etq bnad num tx n etq Jumbo Packet Size VLAN ID Table A 7 Network driver module parameters Default value 1500 Disabled 0 Possible values 0 1500 9000 Can enable VLAN IDs with values from 0 4094 Method to configure esxcfg vswitch command esxcfg vswi
50. Installation Verifying adapter installation Product Overview on page 1 This includes hardware and software compatibility information This chapter also describes software installation packages supported by host operating system and platforms Hardware Installation on page 95 This chapter provides hardware installation instructions Software Installation This chapter provides software installation instructions Specifications This chapter describes product specifications Following is a list of general items to verify during and after installation to avoid possible problems Verify the following and make corrections as necessary Make sure that the adapter is correctly installed and seated in the connector in the host system slot or connector Press firmly down on the top of the adapter to make sure it has seated in the connector Check your system hardware manual and Fabric Adapter Hardware compatibility on page 5 CNA Hardware compatibility on page 15 or host bus adapter Hardware compatibility on page 25 to verify that you installed the adapter in the correct slot Make sure that the correct driver package for the host operating system and platform is properly installed If the host system requires special configuration to enable adapters adapter connectors and interrupt request IRQ levels verify these options in the system BIOS menu and in your system documentation Make sure that all Fibre
51. Manager may also choose to perform actions to transition devices from a bad state to a usable state All QLogic BR Series adapters support Driver Health Protocol This feature works only with UEFI 2 2 or higher system BIOS versions Receive side scaling RSS feature for advanced link layer This feature enables receive processing to be balanced across multiple processors while maintaining in order delivery of data parallel execution and dynamic load balancing Simple Network Management Protocol SNMP SNMP is an industry standard method of monitoring and managing network devices QLogic CNAs and Fabric Adapter ports configured in CNA or NIC mode provide agent and MIB support for SNMP For more information refer to Simple Network Management Protocol on page 67 TCP segmentation offload TSO and large send offload LSO Large chunks of data must be segmented to smaller segments to pass through network elements LSO increases outbound throughput by reducing CPU overhead Offloading to the network card where segmentation can be done by the Transmission Control Protocol TCP is called TCP segmentation Also see Windows Hyper V VMQ look ahead data split Team Virtual Machine Queue VMQ support For Windows Server 2012 the BNI driver is not installed because teaming is natively supported by the Windows 2012 operating system 46 BR0054504 00 A 1 Product Overview Adapter features VMQ support allows classification of p
52. Public loop is not supported If a device attaches to a loop with an FL Port it continues to function as a private NL Port in the loop Auto topology detection is not supported You must configure the loop topology manually when attaching to a loop The default configured topology is P2P Fibre Channel Security Protocol FC SP providing device authentication through key management This feature is not available for Solaris platforms Using BCU commands and HCM you can configure the following parameters L Enable authentication C Enter the Challenge Handshake Authentication Protocol CHAP secret CL Specify the authentication algorithm 55 BR0054504 00 A 1 Product Overview Adapter features Forward Error Correction FEC provides a method to recover from errors caused on links during data transmission FEC works by sending redundant data on a specified port or range of ports to ensure error free transmission FEC enables automatically when negotiation with a switch detects FEC capability Although you cannot enable or disable FEC on adapters manually you can enable FEC on Brocade switches using appropriate Fabric OS commands This feature is enabled by default and persists after driver reloads and system reboots FEC may coexist with other port features such as QOS TRL trunking BBCR and FAA Following are limitations of this feature J FEC is supported only on BR 1860 and BR 1867 Fabric Adapter ports oper
53. T10 Data CRC ECC Memory Parity Protected PCI Express Base Specification PCI Express Root Complex Discovery Topology PCI Express Reset Limit Adjustment Errata for PCI Express Base Specification Rev 1 0a Cabling stand up adapters This section describes cabling specifications for Fabric Adapters Table 5 3 lists the supported cabling for Ethernet transceivers for stand up adapters Table 5 3 GbE transceiver cable specifications Transceiver Cable Minimum Maxum Length Length Ethernet 10 Gbps OM1 6 25 125 multimode NA 33m 104 98 ft SR short range o2 50 125 multimode 82m 269 ft SFP 1490 nm p OM3 50 125 multimode 300m 984 25 ft OM4 50 125 multimode 550 m 1804 ft Ethernet 10 Gbps Single mode media 9 125 NA 10 km 6 2 mi LR long reach microns SFP 10 km 1310 nm im Copper active Twinaxial cable 1m 3 2 ft 1m 3 2 ft direct attached SFP copper cable 3m Copper active Twinaxial cable 3m 9 8 ft 3m 9 8 ft direct attached SFP copper cable 272 BR0054504 00 A 5 Specifications Fabric Adapters Table 5 3 GbE transceiver cable specifications Maximum Length Minimum Transceiver Length 5m direct attached SFP copper cable Copper active Twinaxial cable 5m 16 4 ft 5m 16 4 ft 1 Besides Brocade branded active Twinaxial cables QLogic BR Series Adapters allow active cables from other vendors based on supported switch
54. The switch initiates and stops tests on the adapter port as specified by switch configuration You cannot restart the test or specify a test parameter through BCU commands or HCM For dynamic mode D Port configuration is not required on the adapter Also if D Port is enabled on host bus adapter port this will automatically enable connected switch port as D Port 50 BR0054504 00 A 1 Product Overview Adapter features In dynamic mode you can disable the adapter physical port using the bcu port disable command This will disable the port as a D_Port When the adapter port is enabled again the switch will again enable the adapter port as a D Port if the switch port is still enabled as a D Port However you must restart tests from the switch side Static mode This mode is initiated after disabling the adapter port using bcu port disable enabling D Port on the switch port using appropriate Fabric OS commands then configuring the adapter port as a D Port through BCU commands or HCM In static mode you can control and configure tests establish a test pattern and transmit frame count for loopback tests display results and restart testing from the adapter using BCU commands You can use HCM to enable D Port testing set the test pattern and transmit frame count This mode cannot be initiated if the adapter is in dynamic mode The following are BCU commands can be used for D Port configuration and control LC bcu diag
55. Using the QLogic Adapter Software Installer on page 113 B Using software installation scripts and system tools on page 138 Procedures are also provided for removing software using the QLogic Adapter Software Uninstaller refer to Software removal using Adapter Software Uninstaller on page 130 and upgrading software using the QLogic Adapter Software Installer refer to Software upgrade using the QLogic Adapter Software Installer on page 135 Procedures are also provided for configuring HCM agent operations and setting the IP address and subnet mask on CNAs and Fabric Adapter ports configured in CNA or NIC mode This manual does not provide instructions for installing the CIM Provider Please refer to the CIM Provider for QLogic BR Series Adapters Installation Guide To troubleshoot problems after installation refer to the QLogic BR Series Adapters Troubleshooting Guide To keep adapter drivers and boot code synchronized be sure to update your adapter with the latest boot image whenever you install or update adapter driver packages Use the following steps 1 Goto the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 3 Click the Boot Code link at the top of the page to direct you to the boot code packages 107 BR0054504 00 A
56. VFR formset The support is for the BR 1867 and BR 1869 adapters only and is limited to retrieving get and not for updating set configuration 32 BR0054504 00 A 1 Product Overview Adapter features Host Connectivity Manager HCM device management and QLogic Command Line Utility BCU tools for comprehensive adapter management Hyper V This consolidates multiple server roles as separate virtual machines VMs using the Windows Server 2008 R2 and later operating system and provides integrated management tools to manage both physical and virtual resources Management APIs for integration with a management application such as Brocade Network Advisor PCle interface with eight lanes The adapter operates in Gen 1 and Gen 2 server connectors that have the following specifications per lane C PCle Gen 2 connector Transfer rate of 5 Gigatransfers per second GT s per lane Data rate of 500 MBps per lane LC PCle Gen 1 connector Transfer rate of 2 5 GT s per lane Data rate of 250 MBps per lane Plug n play and power management for all supported operating systems RoHS 6 Certification by the European Union Restriction of Hazardous Substances Directive RoHS that adapter hardware components do not contain any of the six restricted materials These are mercury chromium VI cadmium polybrominated biphenyl ether lead and polybrominated biphenyl Small form factor pluggable SFP transceiver optics on stand up adapt
57. VMware ESX and ESXi systems M Download the adapter driver CD from downloads vmware com and use VMware tools such as vSphere Management Assistant VMA Virtual CLI vCLI Update Manager and the Console Operating System COS or Direct Console User Interface DCUI to install driver packages from offline bundles Access offline bundles from http driverdownloads qlogic com BW ForVMware 5 0 and later adapter driver packages are inbox with VMware Download the driver rollup iso file from downloads vmware com Driver packages support the Brocade BR 1860 Fabric Adapter BR 815 BR 825 and BR 1020 adapters Software installation options You can use the QLogic Adapter Software Installer or options in native installation scripts and commands to install software on your host system B QLogic Adapter Software Installer Use this to install the following components Q Storage driver network driver and HCM C Storage and network driver QO HCM only For more information refer to Using the GUI based installer on page 114 W QLogic native installer scripts and commands For CNAs use this to install the storage driver network driver and utilities 87 BR0054504 00 A 1 Product Overview Boot installation packages For host bus adapters and Fabric Adapter ports configured in HBA mode use this to install the storage driver and utilities only For more information refer to Using software in
58. Windows driver configuration parameters The BFA driver configuration parameters are located under the registry hive HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services bfad Para meters Device Table A 3 describes the Windows configuration parameters Table A 3 Windows driver configuration parameters Parameter Default Notes value Enables or disables Fabric Device Management Interface FDMI registrations To disable set this parameter to 0 fdmi enable val lt 0 1 gt bfa lun queue depth 32 Maximum SCSI requests per LUN This parameter is passed to the SCSI layer during SCSI transport attach ioc auto recover 1 Auto recovery of IOC IO Controller on heartbeat failure rport del timeout 90 Delay in seconds after which an offline remote port will be deleted rport max logins 1024 Maximum number of concurrent logins to a remote port msix disable 0 Disable or enable MSIx interrupt and use line based INTx 328 BR0054504 00 A A Adapter Configuration Storage driver level parameters Managing Windows driver configuration parameters To change any driver configuration parameter use the Registry Edit tool regedt32 or the BCU drvconf key command For details on using these commands refer to the QLogic BR Series Adapter Administrator s Guide m We recommend using the applicable BCU command to dynamically update the value where available rather than reloading the driver E D
59. a driver update disk CD or USB drive and use this to install drivers as outlined in the following steps Refer to Boot installation packages on page 88 for a list of these files and the operating systems that support these files Also refer to Host operating system support on page 70 for information on operating system support for adapter drivers Download the driver update disk DUD iso file for your SLES system from the QLogic Web Site 222 BR0054504 00 A 4 Boot Code Boot over SAN a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column Linux SUSE SLES in the third column and then click Go c Click the Driver Update Disks link at the top of the page to direct you to the DUD zip file d Locate the DUD link for your adapter in the table click on it and following the instructions Create a driver update disk CD or USB drive from the ISO image Insert the SLES product CD 1 into the host system drive and follow your system procedures to boot from the CD The main installation screen eventually appears Perform the following steps depending on your host platform W For SLES 10 systems press F5 When the system prompts to select Yes No or File select Yes and press Enter W For SLES 11 systems press F6 When the system prompts to select Yes No or File select Yes
60. access control MAC addresses These are applicable to CNAs and Fabric Adapter ports configured in CNA mode only The MAC address can be found in HCM by selecting the adapter in the device tree and clicking the Properties tab in the right pane to display the adapter Properties panel Look for the MAC Address field Each port has a burned in local port MAC address This is the source MAC for LLDP communications between the adapter and the switch that supports Data Center Bridging DCB To find this MAC address select a DCB port in the HCM device tree and then click the Properties tab in the right pane to display the port Properties panel Look for the Local port MAC field 311 BR0054504 00 A 6 Adapter Support Providing details for support The Ethernet MAC address is used for normal Ethernet operations To find this MAC address using HCM select an Ethernet port in the HCM device tree and then click the Properties tab in the right pane to display the port Properties panel Look for the Current MAC address and Factory MAC address fields Each enode logging in to the fabric through a local adapter port is assigned a MAC address during FCoE Initialization Protocol FIP operations This MAC is assigned for the current FCoE communication only To find this MAC address perform one of the following tasks WB Select an FCoE port in the HCM device tree and then click the Properties tab in the right pane to display the port Properti
61. active Twinaxial cable 3m 9 8 ft 3m 9 8 ft copper cable 5m direct attached SFP Copper active Twinaxial cable 5m 16 4 ft 5m 16 4 ft copper cable 1 Besides Brocade branded active Twinaxial cables QLogic BR Series Adapters allow active cables from other vendors based on supported switches although non Brocade cables have not been tested and are not supported 282 BR0054504 00 A 5 Specifications Converged Network Adapters Cables are not shipped with the stand up CNA Adapter LED operation stand up adapters Figure 5 2 illustrates LED indicator locations on a BR 1020 stand up CNA LED indicators for each port are visible through the mounting brackets Figure 5 2 LED locations for BR 1020 CNA 283 BR0054504 00 A 5 Specifications Converged Network Adapters Table 5 10 describes operation for the following LEDs visible on the CNA B Lnk Link state up or down W Act Storage or network activity traffic is occurring over the Ethernet link W X Storage icons FCoE activity is occurring over link Table 5 10 LED operation Storage e Off Slow flashing green Steady green Steady green Steady green Steady green Beacon flashing green Beacon flashing green Flashing amber Off Off Off Off Fast flashing green Fast flashing green Beacon flashing green Beacon flashing green Off Off Off Off
62. adapter port Advanced tab 0 A 2 Advanced Properties dialog box for team 6 ee xi BR0054504 00 A Installation Guide BR Series Adapters xii BR0054504 00 A Installation Guide BR Series Adapters List of Tables Table 1 1 Compatible SFP transceivers for ports configured in CNA or NIC mode 1 2 Compatible SFP transceivers for ports configured in HBA mode 1 3 QLogic Fibre Channel CNAS 2 0 succeeds Peds ads bee SP X XR R4 REX X OE 1 4 Compatible SFP transceivers for QLogic stand up CNAS 005 1 5 Host bus adapter model information 0000 eee 1 6 Factory default physical function PF configurations for Fabric Adapter ports 1 7 Operating system support for network and storage drivers 1 8 Hypervisor support for QLogic BR Series Adapters n n naaa anaana 1 9 Installer script commands 0000 cee eect ess 1 10 Supported software installation packages llli elles 1 131 Boot installation packages 22 elles 4 1 BIOS Configuration Utility field descriptions 00 0 cee eee eee 4 2 Fabric Adapter configuration support 5 1 Fabric Adapter mounting brackets llle 5 2 Fabric Adapter hardware specifications 0 0 cee ee 5 8 GbE transceiver cable specifications liliis 5 4 Fibre Channel transceiver cable specifications llle 5 5 LED GPG
63. adjusted to a maximum of 32 during I O by calling the adjust_queue_depth SCSI interface fdmi_enable 1 Enables or disables Fabric Device Management enabled Interface FDMI registrations To disable set this parameter to 0 host_name NULL Host name linkup_delay 30 Sets the wait time for boot targets to come online seconds Local boot is immediate ioc_auto_recover Auto recover IOC IO Controller on heartbeat 1 enabled failure log_level 3 BFA log level setting See bcu log level information Warning in the QLogic BR Series Adapter Administrator s Guide for more information max_rport_logins 1024 This limits number of logins to initiator and targets by physical ports and the logical ports max_xfer_size 32 MB Maximum transfer size in Mb Default value registered during SCSI host template registration msix_disable_cbfor 0 Disable 0 or enable 1 MSIx interrupt and use BR 815 BR 825 INTx msix disable ct for BR 1020 BR 804 BR 1860 BR 1867 NetQueue Enable Enable or Disable Configure in vSphere Client or vCenter Enables NetQueue for improving performance on servers with multiple CPUs Refer to Configuring NetQueue on page 349 num fcxps 64 Maximum number of unassisted FC exchanges 325 BR0054504 00 A A Adapter Configuration Storage driver level parameters Table A 2 Linux and VMware driver configuration parameters Continued Parameter E value num_ioims 2000 Maximu
64. an MTU of 9000 The greatest savings are provided for larger packets 38 BR0054504 00 A 1 Product Overview Adapter features Configurable Max NetQueue By reducing the number of NetQueues MSI vectors are reduced for installed adapter ports With many adapters a high number of MSI X vectors on ESX platforms can cause poor performance and cause adapters to run in INTx mode Using new bnad QLogic network adapter driver parameters the driver can set NetQueue limits and allocate MSI X vectors according to these limits For Max NetQueue configuration values refer table Network driver module parameters on page 344 Data Center Bridging Capability Exchange Protocol DCBCXP IEEE 802 1 standard DCBOXP is used between the CNA or Fabric Adapter port configured in CNA mode and the switch that supports Data Center Bridging DCB to exchange configuration with directly connected peers DCBCXP uses LLDP to exchange parameters between two link peers Enhanced transmission selection IEEE 802 1Qaz standard ETS provides guidelines for creating priority groups to enable guaranteed bandwidth per group More important storage data traffic can be assigned higher priority and guaranteed bandwidth so it is not stalled by less important traffic Ethernet flow control Ethernet flow control is a mechanism for managing data transmission between two network nodes to prevent a fast sender from overrunning a slow receiver When an overwhelmed rec
65. brocade adapter software in staller solaris sparc versio n bin Installs HCM and appropriate driver package E brocade driver linux version tar gz E brocade driver linux slestispi versio n tar gz E brocade driver linux version tar gz3 E brocade driver linux slestisp2 versio n tar gz WI brocade driver linux version tar gz3 E brocade driver linux slestisp2 versio n tar gz brocade driver linux xen56sp2 version gt tar gz4 brocade_driver_linux_xen60_ lt version gt tar ope brocade_driver_linux_xen61_ lt version gt tar gz brocade_driver_solaris10_ lt version gt tar Leadville based storage driver with user applications such as HCM Agent QLogic Adapter Software Installer and BCU for x86 platforms brocade_driver_solaris10_ lt version gt tar Leadville based storage driver with user applications such as HCM Agent QLogic Adapter Software Installer and BCU for SPARC platforms 85 BR0054504 00 A 1 Product Overview Adapter software Table 1 10 Supported software installation packages Continued Operating Systemand QLogic Adapter Software Platform Installer Driver Package Solaris 11 0 x86 Solaris 11 0 SPARC x86 64 VMware ESXi x64 5 0 5 1 and 5 5 brocade adapter software in staller solaris x86 version bin Installs HCM and appropriate driver package for operating system and platform brocade adapt
66. brocade bna kmp default 3 0 3 3 3 0 13 0 27 0 x86 64 rpm Header V3 RSA SHA256 signature NOKEY key ID c2bea7e6 To ensure authenticity and integrity of the driver package we recommend that you install the public PLDP key if not already installed before installing driver package The PLDP key and installation instructions can be found at http drivers suse com doc pldp signing key html On Linux SLES 10 and 11 systems when installing the source based noarch driver packages brocade_driver_linux_ lt version gt tar gz or when using the QLogic Adapter Software Installer and the kernel has been upgraded to a version without precompiled binaries perform the following tasks to make sure the drivers will load on system reboot We strongly recommend a reboot after these steps to avoid any issues For Linux SLES 10 systems perform the following steps 1 Make sure the load unsupported modules automatically variable is set to yes in etc sysconfig hardware config 2 Runthe mkinitrd command to load automatically during system boot For Linux SLES 11 systems perform the following steps 1 Make sure the allow unsupported modules value is set to 1 in etc modprobe d unsupported modules 2 Run the mkinitrd command to load automatically during system boot By default the initrd file will be backed up automatically during Linux installations During installation a dialog box displays with the location of the file If a file
67. compiler and the kernel sources Although this package installs SLES drivers the error message bfa or bna module not supported by Novell setting U taint flag displays You can complete installation and use this driver although in this format it is not certified or supported by Novell Inc This package contains the latest precompiled RPMs for either RHEL or SLES distributions as well as user applications such as HCM Agent QLogic Adapter Software Installer and BCU An installer program is available for use when you untar this package Be sure to use this installer on Linux x64 systems This package contains all network drivers storage drivers management utilities and installation script for Solaris distributions 86 BR0054504 00 A 1 Product Overview Adapter software For the latest support information on specific operating system release levels service pack levels and other patch requirements please refer to the latest release notes for your adapter Downloading software and documentation To download the software installer driver packages boot code driver update disks the CIM provider and documentation go to http driverdownloads qlogic com and search by adapter type adapter model and operating system Downloading software for VMware systems Besides downloading driver packages using steps under Downloading software and documentation on page 87 you can use the following options for
68. configuration Driver logs Install logs Core files Details on the CNA or Fabric Adapter Ethernet interface including IP address and mask Status and states of all adapter ports including the Ethernet FCoE and DCB ports on CNAs and Fabric Adapters DCB status and statistics for CNAs and Fabric Adapters Network driver information Ethernet statistics offload parameters and flow control coalesce parameters for CNAs and Fabric Adapters Ethernet offload and flow control parameters for CNAs and Fabric Adapters Before collecting data through the Support Save feature you may want to disable auto recovery on the host system When adapters are reset after an auto recovery from a failure traces initiated before the failure may be lost or overwritten To disable auto recovery use the following commands For Linux use the following commands and then reboot the system QJ To disable auto recovery for the network BNA driver insmod bna o bnad_ioc_auto_recover 0 L To disable auto recovery for the storage BFA driver insmod bfa o ioc_auto_recover 0 314 BR0054504 00 A 6 Adapter Support Using Support Save For VMware use the following commands C Tounload and load the network BNA driver with IOC auto recovery disabled use the following commands sxcfg modul u bna sxcfg module bna bnad ioc auto recover 0 To disable IOC auto recovery for the network BNA driver across reboots use t
69. configuring boot over SAN mask the boot LUN so that the initiator has exclusive access to the boot LUN Refer to the QLogic BR Series Adapter Administrator s Guide for more information 57 BR0054504 00 A 1 Product Overview Adapter features Management APIs for integration with a Management application such as Network Advisor and other management frameworks Management support for Storage Management Initiative Specification SMI S N_Port ID Virtualization NPIV Allows multiple N_Ports to share a single physical N_ Port Multiple Fibre Channel initiators can share this single physical port and reduce SAN hardware requirements N_Port Trunking works in conjunction with the Fibre Channel trunking feature on Brocade switches whereby the Fabric Operating System OS provides a mechanism to trunk two switch ports of the same port group into one link When trunking is enabled two physical ports belonging to the same QLogic dual port adapter are trunked together to form a single pipe This provides advantages such as the following OY Simplified management for example zoning and VM setup only require one WWN instead of two if using two different ports 1 More VMs can be deployed on a single server m Higher throughput for such applications as video streaming C Single failures within a port group are completely transparent to upper level applications N Port Trunking is not supported on QLogic mezzanine adapters
70. create a brocade_esx50_ lt version gt zip offline bundle and brocade_esx50_ lt version gt iso ESXi 5 0 installation image that includes brocade drivers and utilities Refer to your Image Builder documentation for details on using Image Builder PowerCLI Using the QLogic installer script for ESX 4 1 ESXi 4 1 and ESXi 5 0 systems This section provides instructions for using the QLogic installer script to install driver packages on ESX 4 1 ESXi 4 1 and ESXi 5 0 systems Drivers are provided as ISO images packaged in a tarball file Use the install script to selectively install storage and network driver packages with utilities to VMware systems Refer to Software installation and driver packages on page 81 for a description of driver packages and download instructions Ensure that the following prerequisites are met before installation The vSphere Management Assistant VMA must be installed on an ESX and ESXi systems other than where you are installing the driver Download vMA from the VMware website Once vMA is downloaded please refer to the vSphere Management Assistant Guide for instructions on how to deploy vMA Put the server where the driver is to be installed in maintenance mode using vSphere client Using the vSphere Client right click ESXi and select the Enter Maintenance Mode option 158 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Installation procedure Download th
71. deploy server This server can stream the ESXi image to a mapped network server without local storage to boot ESXi on the server For more information refer to Using VMware Auto Deployment to boot QLogic custom images on page 243 202 BR0054504 00 A 4 Boot Code Boot over SAN Boot over SAN The Boot Over SAN feature allows a host to boot its operating system from a boot device directly attached to the host system or located somewhere on the SAN instead of the host s local disk Specifically this boot device is a logical unit number LUN located on a storage device LUNs can be specifically targeted to boot hosts running Windows Linux or VMware or Solaris For booting over SAN from direct attached storage both Fibre Channel Arbitrated Loop FC AL and point to point P2P configurations are supported For more information on how the Boot BIOS functions to implement this feature refer to QLogic Legacy BIOS support on page 204 Booting from a remote SAN location provides the obvious advantage of recovering quickly from a host or adapter malfunction With the adapter boot BIOS enabled for booting over SAN and configured with boot device locations and boot sequences replacing an old host with a new one involves installing the adapter from the old host into the new one with the same configuration and then booting the new host The host s operating system automatically boots from the remote SAN boot device Although fast re
72. dportenable Enables a D Port on a specific port sets the test pattern and sets the frame count for testing C bcu diag dportdisable Disables a D Port on a specific port and sets the port back to an N Port or NL Port L bcu diag dportshow Displays test results for a test in progress on a specific D Port C bcu diag dportstart Restarts a test on a specific D Port when the test has completed Q bcu port list Displays the D Port enabled or disabled state on the adapter and connected switch Consider the following limitations and considerations for D Port configurations on QLogic BR Series Adapters m The D_Port is supported only on BR 1860 Fabric Adapter ports operating in HBA mode with a 16 Gbps SFP and on Brocade 16 Gbps switches running Fabric OS version 7 1 0 or later The F_Port of the connected must be D_Port capable The adapter must be using driver version 3 2 0 or later There is a limit on the number of switch ports on which you can run simultaneous D_Port tests that applies to both static and dynamic D_Port modes This limit is four ports when the switch is running Fabric OS v7 1 x and v7 2 x and the Adapter is running v3 2 0 or later 51 BR0054504 00 A 1 Product Overview Adapter features Trunking cannot be enabled on ports operating in D_ Port mode so that ports can be tested independently of a trunk D Ports do not support the loop topology The adapter D Port is supported
73. duplex Ethernet performance 10 312 Gbps throughput per port Line rate performance for 700 byte packets Low latency receive 1 5us transmit 2us Topology Ethernet 10 Gbps DCB Fibre Channel Point to Point N_Port Fibre Channel Switched Fabric N_Port Fibre Channel Arbitrated Loop FC AL Data protection Cyclic redundancy check CRC on PCIE and line side links ECC within the ASIC memory blocks 2 bit detection and 1 bit correction Error correction code ECC and parity through the ASIC 267 BR0054504 00 A 5 Specifications Fabric Adapters Table 5 2 Fabric Adapter hardware specifications Continued Feature Description Supported Ethernet 803 3ae 10 Gbps Ethernet features and standards 802 1q VLAN 802 1q tagging 802 1P tagging 802 1Q VLAN 802 1Qbb priority flow control 802 1 Qau congestion notification 802 1Qaz enhanced transmission selection 802 1AB Link Layer Discovery Protocol 802 3ad link aggregation 802 1p priority encoding 802 3x Ethernet flow control 802 3ap KX KX4 auto negotiation 802 3ak CX4 PXE Preboot Execution Environment UNDI Universal Network Device Interface NDIS Network Data Interface Specification 6 2 Dell iSCSI DCB EEE 1149 1 JTAG for manufacturing debug and diagnostics IP TCP UDP Checksum Offload IPv4 Specification RFC 791 IPv6 Specification RFC 2460 TCP UDP Specification RFC 793 768 ARP Specification RFC 826 Da
74. er boot fw v i 5 1 gt iSO ersion gt VMware bfa esx55 version zip live cd brocade adapt ESX ESX pna esx55 lt version gt zip lt version er_boot_fw_ lt v i 5 5 i iso ersion gt Unified drivers for boot over SAN and network PXE boot Use unified DUD for RHEL 5 7 and above 2 Drivers for host bus adapters CNAs and Fabric Adapter ports for boot over SAN 3 Storage drivers for host bus adapters and Fabric Adapter ports configured in HBA mode Note that you can use the VMware Image Builder PowerCLI to create an offline bundle and ISO ESXi 5 0 installation image that includes drivers and utilities Refer to your Image Builder documentation for details on using Image Builder PowerCLI 4 Network drivers for CNAs and Fabric Adapter ports configured in CNA or NIC mode You can use the VMware Image Builder PowerCLI to create a brocade esx50 version zip offline bundle and brocade esx50 version iso ESXi 5 0 installation image that includes drivers and utilities Refer to your Image Builder documentation for details on using Image Builder PowerCLI Downloading software and publications To download all host bus adapter software and boot code use the following steps 1 Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the thir
75. firmware will be available in boot code for updating installed adapters All QLogic BR Series Adapters installed in a host system must use the same boot code version To keep drivers and boot code synchronized be sure to update your adapter with the latest boot image after you install or update adapter driver packages Be sure to update drivers before updating the boot code You can determine the current BIOS version installed on your adapter using the following methods m q View the BIOS that displays on your system screen during hardware reinitialization just before you are prompted to press CTRL B or ALT B to enter the BIOS Configuration Utility W Enter the bcu adapter query command The installed BIOS version displays in the Flash Information section of the command output B X View the adapter Properties panel in HCM To view the panel select the adapter in the d 0O1evice tree and then click the Properties tab in the right pane W Ifthe system supports UEFI verify the installed BIOS version through the UEFI system BIOS setup menu For servers with operating system and QLogic BR Series Adapter drivers installed you can use BCU commands or HCM directly to update boot code on adapters If updating v1 1 x x or v2 x boot code installed on BR 825 BR 815 and BR 804 HBAs to v3 0 or later refer to Updating older boot code on HBAs on page 192 For servers without a hard disk or operating system that have a
76. install directory Q Windows systems cd install directory gt UninstallBrocade Adapter Software The default install directory is C Program FilesiBROCADE Adapter Q Linux and Solaris systems cd install directory UninstallBrocade Adapter Software The default install directory is opt brocade adapter To launch the uninstaller in silent mode you must use and provide values for both the following parameters CQ DCHOSEN INSTALL SET L i silent Uninstall examples To remove the network and storage drivers only in silent mode with debug messages Windows systems Uninstall bat DCHOSEN INSTALL SET DRIVER DEBUG tru ui Silent Linux or Solaris systems sh Uninstall sh DCHOSEN INSTALL SET DRIVER DEBUG true silent 134 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer W To remove the network and storage drivers HCM and management utilities in silent mode but without debug messages Windows systems Uninstall bat DCHOSEN INSTALL SET BOTH silent Linux or Solaris systems DEBUG fals 3i sh Uninstall sh DCHOSEN INSTALL SET BOTH DEBUG false silent W X To remove HOM only without using silent mode but with debug messages Windows systems Uninstall bat DCHOSEN INSTALL SET GUI D Linux or Solaris systems sh Uninstall sh DCHOSEN INSTALL SET GUI
77. is supported using the IBM 1 GbE NIC included on the IBM server blades 13 BR0054504 00 A 1 Product Overview Converged Network Adapters BR 1741 CNA gt A c I Figure 1 4 illustrates the major components of the BR1741M k 2P Mezz Card also known as the BR 1741 CNA This is a small form factor SFF mezzanine card containing two ports operating at 10 Gbps that mounts on a Dell blade server The following illustration is representative and may have minor physical differences from the card that you purchased Blade connector located on underside of card RAIA RE ae s ARSON SoA coe MEL UTERINE SUMO aa OUR Ba ASS E TE nre UE aa Aiks e o o es SEEE E i a iare fer ict eae iamiam ASIC with heat sink Port WWN and MAC address label OEM PPID and part number label QLogic serial number label Figure 1 4 BR 1741 mezzanine card The BR 1741 mounts on supported blade servers that install in Dell PowerEdge M1000e modular blade systems It is used in conjunction with matching I O modules also installed in the blade enclosure The adapter uses FCoE to converge standard data and storage networking data onto a shared Ethernet link Ethernet and Fibre Channel communications are routed through the DCB ports on the adapter to the enclosure backplane and then to the I O module 14 BR0054504 00 A 1 Product Overview Converged Network Adapters For information on installing the BR 1741 CNA on a blade server
78. later on x86 and x86 x64 platforms install the fc dud for an HBA Fabric Adapter port configured in HBA mode CNA or Fabric Adapter port configured in CNA mode The fc file format is brocade fc adapter operating system platform dud version iso Insert the Linux Red Hat product CD 1 in the CD drive remove the adapter driver update CD first if necessary and then press Enter Continue responding to on screen instructions and refer to your system documentation as necessary to format and complete installation on the target boot LUN Installing Linux SLES 10 and later and the driver Use the following steps to install SLES 10 and later and the adapter driver on an unformatted Fibre Channel disk configured as a bootable device To install SLES 11 on UEFI supported systems refer to Installation on systems supporting UEFI on page 231 If the LUN you have targeted for booting over SAN already has an operating system installed be sure to use options for reformatting the LUN during Linux installation Refer to your operating system documentation for details If you are installing SLES 11 for systems with HBAs and Fabric Adapter ports configured in HBA mode only the appropriate drivers are included with the SLES product CD so you can ignore steps 1 through 3 in the following procedures However if the driver is not detected on the SLES product CD during installation you should download the latest driver update ISO file create
79. low profile bracket works go on to Step 9 The adapter ships with one bracket installed and another size bracket in the shipping container a Remove all SFP transceivers from the adapter Refer to Removing and installing SFP transceivers on page 100 for procedures b Remove the two screws attaching the bracket to the adapter and pull off the bracket Refer to Figure 2 1 Figure 2 1 Removing or installing adapter mounting bracket c Carefully guide the new mounting bracket onto the adapter making sure the bracket mounting tabs align with the holes in the adapter d Replace and tighten the two screws e Store the mounting bracket that you removed for future use 98 BR0054504 00 A 2 Hardware Installation Stand up adapters 9 Insertthe adapter into the desired empty PCle bus slot Press firmly until the adapter seats Refer to Figure 2 2 for seating directions a fF C Iv Mounting screw Top edge of adapter press down into slot PCI X8 slot Edge of host board SFP transceivers Figure 2 2 Installing adapter in system chassis 10 Secure the adapter s mounting bracket to the case using the method required for your case Note that in some systems the bracket may secure to the case with a screw 11 If you removed transceivers in Step 7 make sure to install adapter receivers Refer to Removing and installing SFP transceivers on page 100 for proced
80. not be allowed from the host operating system or in certain cases a third party user application If allowed the target is reset A maximum of 16 I T nexuses can be configured to have target resets disabled Other related BCU commands include fcpim trs query to display a list of initiator vs target WWNSs with target reset disabled and fcpim trs enable to enable target reset For more information on BCU commands refer to the QLogic BR Series Adapter Administrator s Guide A bus reset issues target resets to all targets on a specific bus Targets are not reset for which target reset has been disabled with a BCU command vHBA Virtual HBAs vHBAs are virtual port partitions that appear as virtual or logical HBAs to the host operating system Multiple vHBAs are not supported therefore you cannot create or delete them from an adapter For more information refer to l O virtualization on page 28 Operating system considerations and limitations This section lists exceptions for adapter and feature support for specific host system operating systems Assume that features not listed in this section are fully supported by Windows Linux Solaris VMware ESX and ESXi versions described under Host operating system support on page 70 Windows Storport miniport driver Supported SCSI miniport driver Not supported Hyper V Supported by Windows Server 2008 R2 and later Windows 7 Supported by Windows Server 2008 R2 x64 drivers
81. of the following European Council directives laws and standards B Electromagnetic Compatibility EMC Directive 89 336 EEC and the Complementary Directives 92 31 EEC 93 68 EEC and 2004 108 EEC B low Voltage Directive LVD 73 23 EEC and the Complementary Directive 93 68 EEC B EN50082 2 EN55024 1998 European Immunity Requirements C EN61000 3 2 JEIDA European and Japanese Harmonics Spec C EN61000 3 3 Canadian requirements This Class B digital apparatus complies with Canadian ICES 003 Cet appareil num rique de la classe B est conforme la norme NMB 003 du Canada Laser compliance This equipment contains Class 1 laser products and complies with FDA Radiation Performance Standards 21 CFR Subchapter and the international laser safety standard IEC 825 2 Use only optical transceivers that are qualified by QLogic Corporation and comply with the FDA Class 1 radiation performance requirements defined in 21 CFR Subchapter and with IEC 825 2 Optical products that do not comply with these standards might emit light that is hazardous to the eyes 300 BR0054504 00 A 5 Specifications Regulatory compliance Safety and EMC regulatory compliance Table 5 21 lists the regulatory compliance standards and certifications for which the adapter is certified Table 5 21 Regulatory certifications and standards Country Safety specification ENC specification Australia and New Zealand Ca
82. only on connections between the switch and adapter D Ports on the adapter do not support Forward Error Correction FEC and CR Credit Recovery If these features are enabled on the switch side the adapter ignores them The D Port is not supported on adapter ports configured in CNA mode The D Port test result optic loopback electrical loopback or link traffic test will be updated only after all the tests has been completed but the start time will be updated upon test start Disabling and enabling the port on either side of the link will not restart the test Due to SFP EWRAP bleed through during the beginning of the switch electrical loopback test the adapter will receive some broken frames which may cause the port statistic error counter to increase Some examples are CRC err bad EOF and invalid order set Similar results occur for the optical loopback test You should ignore these port statistics on the host bus adapter The following commands from the switch are not supported by the adapter port and the adapter port will reject them B portdporttest stop B portdporttest restart The adapter does support portdporttest start however options for this command are ignored The link between the switch and adapter D Port has to be marginally functional and be capable of supporting minimal traffic to enable the switch and adapter D Port A D Port is useful to diagnose marginal faults only A complete failure o
83. perform the following tasks to configure the adapter values that are stored in adapter flash memory B Enable or disable adapter ports for boot over SAN When enabled available Fibre Channel devices attach as UEFI devices and obtain UEFI device names Once the Fibre Channel devices have UEFI device names you can select them in the systems Boot Configuration menu as boot devices WB Set the port speed HBAs and Fabric Adapter ports configured in HBA mode only Autonegotiate is the only speed option for the 10 Gbps CNAs and Fabric Adapter ports configured in CNA or NIC mode W Select LUNs for booting over SAN Depending on your system different tools may be available to obtain adapter and controller handle numbers that identify the appropriate adapter for configuration enable adapter port s and change port speeds The following examples use EFI shell commands Refer to your system documentation and help system for details on these commands W Onsystems with EFI shell commands you can use such commands as drvcfg dh and drivers to configure adapter values an example procedure for these systems follows E Onsome systems you can access drvcfg and other commands from a menu system to configure adapter values Refer to instructions or online help provided for your system W On other systems you will need to use BCU commands and the system s BIOS menus to configure adapter values Refer to instructions or online help pr
84. shipped with different sizes of brackets for mounting adapters in your host system Table 5 7 lists the two bracket types and dimensions Table 5 7 CNA mounting brackets Bracket Type Dimensions Low Profile 1 84 cm by 8 01 cm 73 in by 3 15 in Standard 1 84 cm by 12 08 cm 73 in by 4 76 in Mezzanine CNAs are smaller than stand up modules For example the BR 1007 adapter is an IBM compact form factor horizontal CFFh adapter measuring approximately 12 44 cm by 1 27 cm by 16 cm 4 9 in by 0 5 in by 6 3 in Mezzanine adapters mount on blade servers that install in supported blade system enclosures Refer to the Server blades and system enclosures mezzanine adapters on page 16 for references to CNA compatibility information Note that mezzanine CNAs do not have external port connectors with optics such as stand up CNAs but internal ports that connect to switch and I O modules installed in the blade system enclosure through high speed links in the internal enclosure backplane PCI Express interface Install QLogic stand up CNAs in PCI Express PCle computer systems with an Industry Standard Architecture Extended Industry Standard Architecture ISA EISA bracket type Install the QLogic mezzanine CNAs in supported server blades in supported blade system enclosures On board flash memory provides BIOS support over the PCle bus The CNA is designed to operate on an x8 lane DMA bus master at 250 GMhz Operation can neg
85. software vib install d BCD bfa bna release ver offline bundle build number zip For ESXi 5 0 hosts you can also extract the VIB file from the offline bundle and install from local file system using the following command esxcli Server server name software vib install v directory path VIB file name 5 Verify the installation was successful For ESX and ESXi 4 1 hosts use the following command vihostupdate q server IP or hostname For ESXi 5 0 hosts use the following command esxcli s u p software vib list Use the rebooting image option to see newly added drivers on the alternate bootbank before you reboot Reboot the host T Exit maintenance mode Verify the new driver is installed and loaded using one of the following steps For ESX and ESXi 4 1 hosts use the following command vihostupdate q server IP or hostname For ESXi 5 0 hosts use the following command esxcli software vib list grep bfalbna 166 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Using VMA to install drivers from offline bundles Use the following steps to install driver packages from VMware offline bundles to ESX and ESXi systems Refer to Software installation and driver packages on page 81 for a description of driver packages and download instructions Before performing the following steps ensure that you have deployed VMA to an ESX ho
86. systems HBAs are shipped with a low profile bracket installed and a standard bracket included for mounting in your host system These HBAs contain either one or two external ports for connecting to Fibre Channel switches via fiber optic cable Table 5 14 provides the dimensions for the two bracket types Table 5 14 Mounting brackets for stand up HBAs Bracket Type Dimensions Low Profile 1 84 cm by 8 01 cm 73 in by 3 15 in Standard 1 84 cm by 12 08 cm 73 in by 4 76 in The mezzanine type HBAs are smaller cards For example the BR 804 adapter measures approximately 10 16 cm by 11 43 cm 4 in by 4 5 in Mezzanine adapters mount on server blades or compute nodes that install in supported blade system enclosures or chassis Refer to Hardware compatibility on page 25 for references to HBA compatibility intormation Note that mezzanine adapters do not have external port connectors with optics such as stand up HBAs but internal ports that connect to the switch and interconnect modules installed in the enclosure or chassis through high speed links in the internal enclosure backplane PCI Express interface Install QLogic BR Series stand up HBAs in PCI Express computer systems with an Industry Standard Architecture Extended Industry Standard Architecture ISA EISA bracket type Install QLogic BR Series mezzanine HBAs in supported blade servers that install in supported blade system enclosures or chassis Multiple HBAs may be mou
87. the receiver until it clicks into place 101 BR0054504 00 A 2 Hardware Installation Mezzanine adapters Replacing an adapter If you are replacing an adapter perform the following steps 1 Make a backup of your system data 2 Power down the host Unplug all power cords and network cables 3 Remove all covers necessary from the system to access the PCle slot where you want to install the adapter Refer to documentation provided with your system to locate PCle slots and cover removal procedures 4 Unlatch the mounting bracket for the installed adapter or remove the screw if applicable securing it to the case 5 Pull the adapter gently from PCle connectors 6 Install the new adapter following the appropriate steps for your adapter under Stand up adapters on page 96 All configuration settings for the old adapter in the slot will automatically apply to the new adapter Mezzanine adapters Mezzanine adapters are smaller modules than stand up models that mount on server blades that install in blade system enclosures Instead of connecting fiber optic cables between stand up adapters ports in traditional servers and switches mezzanine adapters connect to switch or I O modules installed in the blade system enclosure through the enclosure midplane Use information in this section as a guideline to install these adapters in compatible blade servers from supported manufacturers BR 804 host bus adapter To install the BR 80
88. their health status Driver Health The platform is Healthy Driver Controller Statu POST fittempts Driver All managed control lers devices Healthy Brocade Fibre Channel Adapter Driver All managed control lers devices Healthy LSI EFI SAS Driver ServeRAID H5110e Healthy Intel R PRO 1006 5 6 14 PCI E Tl Move Highlight 264 BR0054504 00 A 5 Specifications Fabric Adapters The BR 1860 stand up Fabric Adapters are low profile MD2 form factor PCI Express PCle cards measuring 16 751 cm by 6 878 cm 6 595 in by 2 708 in One and two port models are available Ports support 10 GbE 8 Gbps FC or 16 FC small form factor pluggable SFP transceiver optics With the appropriate optic installed ports can be configured for HBA CNA or NIC operation using the AnylO feature Fabric Adapters are shipped with two sizes of brackets for mounting in your host system Table 5 1 lists the two bracket types and dimensions Table 5 1 Fabric Adapter mounting brackets Bracket Type Dimensions Low Profile 1 84 cm by 8 01 cm 73 in by 3 15 in Standard 1 84 cm by 12 08 cm 73 in by 4 76 in PCI Express interface Install QLogic stand up adapters in PCI Express PCle computer systems with an Industry Standard Architecture Extended Industry Standard Architecture ISA EISA bracket type Following are some of the features of the PCle interface B PCI Gen 2 system interface W On board flash memory provides BIOS su
89. then click Go Click the Boot Code link at the top of the page to direct you to the boot code packages Locate the boot code package for your adapter in the table click on it and then follow the directions 88 BR0054504 00 A 1 Product Overview Boot installation packages The following boot installation packages are available W Driver update disk dud ISO files containing the appropriate driver and necessary directory structure to install with the host operating system on remote LUNs for boot over SAN operations ISO images are available for Linux Solaris and VMware systems When installing the operating system to the remote boot LUN you must use the driver update disk DUD appropriate for the host operating system and platform or installation will fail Also note that two separate DUDs are available for each operating system to provide appropriate storage and network files for your adapter model For Microsoft Windows operating systems the driver update disk does not verify prerequisite checks as part of installation Please review the operating system prerequisites and install the necessary hotfixes after the operating system installation is complete W A LiveCD ISO image live cd iso containing the adapter driver boot code and minimum operating system to allow you to boot BIOS based host systems that do not have installed operating systems or local drives Once you boot the system you can update the boot image
90. to Fabric Adapter ports from one to eight functions can be supported per port on the PCI bus These physical functions PFs can be seen as multiple adapters by the host operating system or hypervisor Factory default PF configurations For each type of adapter each port has a set base or default physical function PF as follows W For host bus adapter models each port has one Fibre Channel FC function W For CNA models each port has one FCoE function and one Ethernet function W For Fabric Adapters the default number of PFs depends on the mode configured for the port Refer to Table 1 6 Table 1 6 Factory default physical function PF configurations for Fabric Adapter ports PFs configured per port PF configuration per port FC Ethernet and FCoE Ethernet 28 BR0054504 00 A 1 Product Overview Adapter features vHBA vNIC Virtual HBAs vHBAs are virtual port partitions that appear as virtual or logical host bus adapters to the host operating system vHBA is the default PF associated with an host bus adapter port the FCoE function on a CNA port or Fabric Adapter port configured in CNA mode or a Fabric Adapter port configured in HBA mode Additional vHBAs cannot be configured and you cannot create or delete the default vHBA HCM discovers and displays all vHBAs as FC For Fabric Adapter ports set in CNA mode vHBAs display as FCoE The following are limitations of vHBAs B Multiple
91. version You can use HCM or BCU commands For HCM perform the following steps a Select an adapter in the device tree b Click the Properties tab in the right pane to display the adapter Properties pane For BCU enter the following commands a Enterthe following command to list the QLogic BR Series Adapters installed in the system and their adapter IDs bcu adapter list b Enterthe following command to display information about an adapter with a specific adapter ID The installed BIOS version displays in the Flash Information section of the display bcu adapter query adapter id Verify that the latest adapter driver is installed on your host system using information under Confirming driver package installation on page 171 For information on minimum operating system support for drivers refer to Software installation and driver packages on page 81 and Host operating system support on page 70 Install the latest adapter boot code and driver using the following steps a Download the latest boot code and driver package from the QLogic Web Site using the following steps 1 Go to the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 213 BR0054504 00 A 4 Boot Code Boot over SAN 3 Click the driver or boot code
92. with the BIOS Configuration Utility 1 Power on the host system 2 Watch the screen as the system boots When BIOS configuration utility displays press ALT B or CTRL B The BIOS Configuration Menu displays a list of installed adapter ports similar to the screen in Figure 4 6 Brocade BIOS Config Menu Select the Adapter Ad No Model No PCI Bus Dev Fn PHHN 1 8 8 Brocade 1828 24 08 88 16 B8 6 5 1E 54 CD 58 APA Brocade 1828 24 88 81 16 B8 8 5 1E 54 CD 51 lt ESC gt Go back lt ENTER gt Select and configure lt Up Down gt Navigate lt Alt O gt Exit lt Alt S gt Save and exit lt Left Right gt Change values Figure 4 6 BIOS Configuration Menu Select the Adapter Under the Ad No column 1 0 and 1 1 are the first port and second port respectively on the first installed adapter while 2 0 and 2 1 are the first and second port on the second installed adapter A maximum of 8 ports can display on a screen and a maximum of 16 ports are supported by the BIOS Configuration Utility Select Page Up to go to a previous screen or Page Down to go to the next screen To bypass functions and stop loading BIOS for a specific port you must to press x for the port to bypass functions and stop loading BIOS on all ports press X Press x or X within 5 seconds to bypass execution of functions displayed on screens If you press after 5 seconds the next function instead of the current function will be bypas
93. 0 FPMA and SPMA type FIP fabric login B FCoE protocols FCP 3 initiator mode only FC SP FC LS FC GS FC FS2 FC FDMI FC CT FCP FCP 2 FCP 3 FC BB 5 FCoE checksum offload SCSI SBC 3 NPIV IP over FC IPoFC Target rate limiting Boot Over SAN Fabric Based Boot LUN Discovery 3j B Ej b mb D D B 5 B H Persistent binding I O interrupt coalescing and moderation Class 3 Class 2 control frames VHBA 281 BR0054504 00 A 5 Specifications Converged Network Adapters Table 5 8 CNA hardware specifications Continued Feature Description Other features BW ASIC Flip flops Parity Protected B 10 Data CRC m ECC Memory Parity Protected For stand up adapters use only Brocade branded SFP laser transceivers supplied with the adapters Cabling stand up adapters Table 5 9 lists the supported cabling for adapter transceiver types Table 5 9 Transceiver and cable specifications Minimum Transceiver Cable Length Maximum Length Ethernet 10 Gbps SR OM1 6 25 125 multimode NA 33m 104 98 ft short range SFP 1490 OM2 50 125 multimode 82m 269 ft nm OMS 50 125 multimode 300m 984 25 ft OMA 50 125 multimode 550 m 1804 ft Ethernet 10 Gbps LR Single mode media 9 microns NA 10 km 6 2 mi long reach SFP 10 km 1310 nm 1m direct attached SFP Copper active Twinaxial cable 1m 3 2 ft 1m 3 2 ft copper cable 3m SFP direct attached Copper
94. 00 A 4 Boot Code Boot code updates By default BIOS and UEFI are enabled on adapter ports for boot over SAN Boot code updates The adapter boot code contains the following PCI BIOS 2 1 and PCI firmware 3 0 or later for QLogic Fabric Adapters and CNAs BIOS Boot code for x86 and x86 x64 platforms Compliant with PCI BIOS 2 1 or later and PCI Firmware 3 0 or later Unified Extensible Firmware Interface UEFI Boot code for UEFI systems Adapter firmware Update the adapter with the latest boot code image for installed BR Series Adapters from the QLogic Web Site using the following steps 1 Go to the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model In the table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go Click the Boot Code link at the top of the page to direct you to the boot code packages Locate the boot code package for your adapter in the table click on it and then follow the directions Update the boot code image file to the adapter installed on your host system using the Host Connectivity Manager HCM and BCU commands Although BCU updates the file from the host s local drive you can use HCM to update from a remote system 189 BR0054504 00 A 4 Boot Code Boot code updates Starting with Adapters v3 2 3 0 and later that patch versions of adapter driver
95. 00 A 4 Boot Code Boot over SAN Set one of the following modes depending on your system Following are some examples WB Dell 11G or 12G systems set UEFI boot mode B BM 3000 series M2 systems move boot option Legacy only below UEFI boot entries in the boot options menu Insert the SLES 11 product CD 1 into your host system s drive and follow your system procedures to boot from the CD Proceed with the SLES 11 installation During installation at the first opportunity choose to abort the installation The Expert Mode menu should display From the Expert Mode menu select Kernel Settings and then the option to load a driver update disk Insert the CD or USB drive with driver update that you created in Step 3 You must load the QLogic BR Series Adapter driver at this stage so that the system can access the boot LUN for Linux installation Select the appropriate disk drive with the driver update disk then press Enter The driver loads to the system If the driver update was successful a Driver Update OK or similar message displays Press Enter If the system prompts you to update another driver select BACK and then press Enter When prompted to insert the SLES 11 product CD 1 insert the CD into the drive and select OK Continue responding to on screen instructions and refer to your system documentation as necessary to format and complete installation on the target boot LUN After SLES i
96. 00 or 9600 byte jumbo frames These frames allow data to be transferred with less effort reduce CPU utilization and increase throughput Mini jumbo frames 2500 bytes are required to encapsulate FCoE frames on DCB Network administrators can change the jumbo packet size from the default setting using host operating system commands as described in A Adapter Configuration Note that the MTU size refers to the MTU for network configuration only Internally hardware will always be configured to support FCoE frames that require mini jumbo size frames The jumbo frame size set for the network driver cannot be greater than the setting on the attached switch that supports Data Center Bridging DCB or the switch cannot accept jumbo frames W Brocade Network Intermediate Driver BNI This provides support for multiple VLANs on ports and teams on 2008 R2 systems This driver is installed with the adapter software For Windows Server 2012 the BNI driver is not installed because VLANS are natively supported by the Windows 2012 operating system WB Checksum CRC offloads for FCoE packets IPv4 IPv6 TCP and UDP packets and IPv4 header The checksum offload supports Checksum offloads for TCP and UDP packets and the IPv4 header This enables the CNA to compute the checksum which saves host CPU cycles The CPU utilization savings for TCP checksum offload can range from a few percent with an MTU of 1500 and up to 10 15 percent for
97. 020 cee 114 Software installation using Software Installer commands 120 Software removal using Adapter Software Uninstaller 130 Software upgrade using the QLogic Adapter Software Installer 135 Software downgrade using the QLogic Adapter Software Installer 137 Installer Og 443 3 Se eee RR reU ICE ea eae ERR Kx Gor RR es 138 Using software installation scripts and system tools 138 Software installation and removal notes 0 000 eae 139 Driver installation and removal on Windows systems 140 Driver installation and removal on Linux systems 146 Installing and removing driver packages on Citrix XenServer SySteMS 6 ce ees 150 Driver installation and removal on Solaris systems 154 Driver installation and removal on VMware systems 157 V BR0054504 00 A Installation Guide BR Series Adapters Confirming driver package installation llle 171 Confirming driver installation with HCM 0 05 171 Confirming driver installation with Windows tools 172 Confirming driver installation with Solaris tools 174 Confirming driver installation with VMware tools 176 Verifying adapter installation lslssellleessereese 177 Installing SNMP subagent s ansaan aana 180 Windows systemS 24 cues e EREREERRARERR RARE OR ER ERR RR 180 LiliX SYSTEMS 2
98. 12ft SWL 8Gbps 21m 68ft 50m 164ft 150m 492ft 190m 623ft N A LWL 2Gbps N A N A N A N A 10km 6 2mi LWL 4Gbps N A N A N A N A 10 km 6 2mi LWL 8Gbps N A N A N A N A 10km 6 2mi 292 BR0054504 00 A 5 Specifications Host Bus Adapters Adapter LED operation stand up adapters Figure 5 3 illustrates LED indicator locations on a BR 825 and a BR 815 LED indicators for each port are visible through the mounting brackets Since the BR 825 operates at speeds up to 8 Gbps each port has a 1 2 4 and 8 Gbps LED 1 2 ES is e OV PORT A1 PORT VO a i ar E Il fe i oll Li i 5 ds E E 12 4 8 12 4 8 O00 OOO Figure 5 3 LED locations for BR 825 HBA A and BR 815 B 293 BR0054504 00 A 5 Specifications Host Bus Adapters Table 5 17 provides the meanings for LED operation on a specific port Table 5 17 LED operation LED Operation Meaning LED is steady green Depending on the LED illuminated link is active at 1 2 4 or 8 Gbps Port is online connected to an external device but has no traffic Note that only one of these LEDs will be steady green to indicate speed LED flickering green Activity such as data transfers is occurring on the active lin
99. 138 removing with software uninstaller 130 removing with software uninstaller commands 133 selectively install 138 storage 76 upgrading 138 driver update disk dud 89 driver update for booting over SAN 243 361 BR0054504 00 A Installation Guide BR Series Adapters drivers install manually using VMware COS or DCUI 168 using VMware update manager 169 using VMware VMA 167 install and remove with install script on Solaris 154 install and remove with QASI 113 install using vMA 161 intermediate 38 IPFC 35 update with HCM 181 E electrostatic discharge precautions 96 enhanced hibernation support 53 enhanced transmission selection 39 environmental and power requirements HBAs 295 mezzanine CNAs 286 mezzanine HBAs 295 stand up CNAs 276 285 stand up Fabric Adapters 276 stand up HBAs 295 environmental and safety compliance EPUP disclaimer 302 RoHS statement 303 errata kernel update 111 ESX systems BCU commands 93 ESXi BNA and HCM support 75 ESXi management feature 75 Ethernet flow control 39 Ethernet management BCU 66 HCM 66 Ethernet mode 3 event logs 81 event message files 81 extended SRB support 32 F Fabric Adapter hardware and software compatibility 5 hardware specifications 266 LED operation 274 management BCU 65 HCM 65 PCI system values 266 PCle interface 265 PCle support 8 physical characteristics 265 SFP transceivers 5 storage support 8 fabric based boot LUN discovery 234 configuring Brocade fabrics 23
100. 1500 9000 Size must not be greater than size set on the switch that supports Data Center Bridging DCB Reload the driver Enter the following command based on your operating system W Solaris 10 ifconfig bna instance number mtu MTU size set in Step 1 W Enter the following command for Solaris 11 dladm set linkprop p mtu MTU size set in Step 1 bna lt instance number 352 BR0054504 00 A B MIB Reference Table B 1 provides information on the MIB groups and objects that support the Simple Network Management Protocol for CNA adapters and Fabric Adapter ports configured in CNA mode For more information on adapter SNMP support refer to Simple Network Management Protocol on page 67 Table B 1 Supported MIB groups and objects for SNMP Group MIB Objects Function Product productIDDisplayName Name of this product Identification Group productlDDescription Short description of the product productID Vendor Manufacturer productID Version Firmware version produtIDBuildNumber Build version productIDURL URL of WEB based application to manage this product productIDDeviceNetworkName Operating system specific computer name Product Status productStatusGlobalStatus Current status of the product Group productStatusLastGlobalStatus Other Unknown OK Non Critical Critical Non recoverable productStatusTimestamp The status before the current status Physical Group adapterlndex Index of the adapter Adapter Attribute
101. 1828 24 00 82 BB 85 1E 54 CD 54 1 173 Brocade 1828 24 00 83 BB 85 1E 54 CD 55 lt ESC gt Go back lt ENTER gt Select and configure lt Up Down gt Navigate lt Alt 0 gt Exit lt Alt S gt Save and exit lt Left Right gt Change values Figure 4 1 PXE BIOS Configuration Menu Select the Adapter Under the Ad No column 1 0 2 and 1 1 3 are the first port and second port respectively on the first installed adapter Note that 2 0 2 and 2 1 3 would be the first and second ports on a second installed adapter The Configuration Utility supports a maximum of 16 ports and 8 ports can display on a screen at a time Select Page Up to go to a previous screen or Page Down to go to the next screen 197 BR0054504 00 A 4 Boot Code Network boot To bypass functions and stop loading BIOS you must to press X or x for each port Press X within 5 seconds to bypass execution of functions displayed on screens If you press X after 5 seconds the next function instead of current function will be bypassed X skips the whole BIOS option ROM whereas x skips a specific function s option ROM 3 Select a CNA port or and Fabric Adapter port configured in CNA or NIC mode that you want to configure A screen similar to Figure 4 2 displays showing the port s current BIOS version MAC address and BIOS settings 73 10 37 4141 Avocent Session Vi LE X j File View Macros Tools Help fk A y g amp Agapter Selected Rdapter Me
102. 1e 41 9a cb r 50 00 00 05 1e 41 9a ca 1 O9AABBCCDDEEFFOO The command output will contain the proper encoding for the zone name and member commands As an example refer to the following output BFA 100000051E419ACB BLUN 00 00 00 00 50 00 00 05 00 00 00 01 1e 41 9a ca 00 00 00 02 DD EE FF 00 00 00 00 03 09 AA BB CC 238 BR0054504 00 A 4 Boot Code Fabric based boot LUN discovery 3 Enterthe following command to launch configuration mode switch config t 4 Enter the following command to name the zone for a specific VSAN for example VSAN 8 switch config zone name name where name Use the output from the boot blunZone command For example from the output example shown in Step 3 you would use switch config f zone name BFA 100000051E419ACB BLUN vsan 8 5 Enter the following command to add the zone members switch config 4 member pwwn value where pwwn Port World Wide Name value Use the output from the boot blunZone command For example from the output example shown in Step 3 you would use the following commands switch config zone member pwwn 00 00 00 00 50 00 00 05 switch config zone member pwwn 00 00 00 01 1e 41 9a ca switch config zone member pwwn 00 00 00 02 DD EE FF 00 switch config zone member pwwn 00 00 00 03 09 AA BB CC 6 Save the zone configuration The zone created is only an entity to store boot LUN data Th
103. 2 x64 Windows Server 2012 R2 x64 Windows SBS 2011 x64 Microsoft Hypervisor refer to Table 1 8 on page 71 Linux RHEL 5 7 5 8 5 9 5 10 6 2 6 3 6 4 and 6 5 x86 and x64 Linux SLES 10 3 10 4 11 1 and 11 2 x86 and x64 and 11 3 Citrix XenServer 5 6 6 0 and 6 1 x64 Solaris 10 11 x86 x64 and SPARC ESXi 5 0 5 1 x64 and 5 5 Drivers and BCU are supported on the VMware ESX platforms HCM is supported only on the guest system on VMware 73 BR0054504 00 A 1 Product Overview Host operating system support a Oracle Linux OL 5 9 5 10 6 4 and 6 5 x86 and x64 Ethernet support The following operating systems support Ethernet operation for QLogic CNAs and Fabric Adapter ports configured in CNA or NIC modes Windows 2008 SP2 x86 and x64 Windows 2008 R2 SP1 x64 Windows Server 2012 x64 Windows SBS 2011 x64 Microsoft Hypervisor refer to Table 1 8 on page 71 Linux RHEL 5 7 5 8 5 9 5 10 6 2 6 3 6 4 and 6 5 x86 and x64 Linux SLES 10 3 10 4 11 1 and 11 2 x86 and x64 Citrix XenServer 5 6 6 0 and 6 1 x64 Solaris 10 11 x86 x64 and SPARC Xen Hypervisor x86 and x64 Refer to Host operating system support on page 70 ESXi 5 0 and 5 1 x64 Oracle Linux OL 5 9 5 10 6 4 and 6 5 x86 and x64 Host Connectivity Manager HCM The following operating systems support HCM management for adapters Windows Server 2008 SP2 x86 and x64 Windows Server 2008 R2 SP1 x64 W
104. 22 c ss epe TESLEFOCSIERAR Te E MRICPEIQ 554 Has 180 Updating drivers with HCM 0 00 eee II 181 Installing HCM to a host from the HCM Agent 20 00 182 HCM Agent operations i5sbas ke nii bu E ReRS SIT CERIS GP REESE 183 HCM agent restart conditions 000 e eee eee 183 HCM agent commands soos eb ER eee eee ees 183 HCM configuration data 2232229 xp9 244 bs digateieateeedasd Ee fada 186 Backing up configuration data llle 186 Restoring configuration data llle 186 Setting IP address and subnet mask on CNAS suusun 187 igo rp Acer 187 LINUX cv Sawa Ae Re Ae a a eA 187 VNIWBIG osc orse oai ain ma eos bende a e a a Ga tou ges 187 4 Boot Code BOOtSUpPPO osceni egla EAEE a ai 188 Boot code updales ossa a EROGO ER RRSER ERA YEREARAAO URS 189 Updating boot code with HCM 020 cee e reeves ke 191 Updating boot code with BCU commands 05 192 Updating older boot code on HBAS 0000 0c eee eee 192 Network DOO Lu odes solides RS e e ae eee tes E Gentetesseseas 193 BIOS support for network boot i rb RE sheds ves 194 Driver support for network boot llle sellers 195 Host system requirements for network boot lllsssus 196 Configuring network boot n sasaaa 0c eee eee 196 OPAE DOOL 642k cue Gla eeke es ee Erde gea deque aoe iUd Acad eee 202 vi BR0054504 00 A Installation Guide BR Series Adapters
105. 4 10 2 4 4 5 Gbps m vNIC3 0 10 2 4 4 1 Gbps m vNIC4 0 10 2 4 4 1 Gbps vHBA and vNIC BCU commands Whether a port is configured for a single function or in the case of vNICs multiple functions each PF is assigned a PCI function ID pcfid This pcfid is used as a parameter in BCU commands to configure additional features or display information for that specific PF For example pcfid can be used in certain BCU debug authentication diagnostic Ethernet port Iport rport VLAN and FCP initiator mode commands Specific vNIC and vHBA BCU commands are available for configuring vHBAs and vNICs Examples of these commands follow W vhba query lt pcifn gt Queries information about the virtual HBA B vhba enable lt pcifn gt Enables a vHBA on a specified adapter port for a specified PF B vhba disable lt pcifn gt Disables a VHBA on a specified adapter port for a specified PCI function 30 BR0054504 00 A 1 Product Overview Adapter features vhba stats lt pcifn gt Displays statistics for the virtual HBA vhba statsclr lt pcifn gt Resets statistics for the virtual HBA For details on using these commands refer to the QLogic BR Series Adapter Administrator s Guide Following are available vNIC commands vnic create port id bmin min bandwidth bmax max bandwidth Creates a new vNIC instance for a given adapter port You can specify the maximum bandwidth all
106. 4 00 A 5 Specifications Converged Network Adapters BR 1741 CNA Table 5 13 lists environmental and power specifications for the BR 1741 CNA Table 5 13 Environmental and power requirements for BR 1741 CNA mezzanine card Property Requirement Airflow Provided by blade system enclosure Operating altitude 3 048 meters 10 000 ft Nonoperating altitude 10 600 meters 35 000 ft Operating temperature 0 to 35 C 32 to 95 F Nonoperating temperature 40 C to 65 C 40 F to 149 F Operating humidity 35 C 95 F at 20 to 80 Nonoperating humidity 65 C 149 F at 5 to 95 Power consumption 15 W required 12 W measured Operating voltage Per PCle 2 0 specifications Dimensions 9 144 cm by 3 81 cm by 8 382 cm 3 6 in by 1 5 in by 3 3 in The BR 1741 mezzanine adapter conforms to environmental and power specifications for the supported server blades and blade system enclosures in which they install Refer to the documentation provided for these products for more information Also refer to Server blades and system enclosures mezzanine adapters on page 16 for references to CNA compatibility information 287 BR0054504 00 A 5 Specifications Host Bus Adapters Host Bus Adapters Two types of HBAs are available BH Stand up Mezzanine The stand up HBAs are low profile MD2 form factor PCI Express PCle cards measuring 16 76 cm by 6 89 cm 6 6 in by 2 71 in that install in standard host computer
107. 4 mezzanine host bus adapter into the server blade refer to the installation instructions shipped with the adapter Also refer to the setup and installation guide and user guide for the blade system enclosure for the following information W Instructions for removing and installing the server blade in the enclosure B Details about the association between the mezzanine bay and interconnect bays in the blade system enclosure The location where you install the mezzanine adapter determines where you install the interconnect modules W X Instructions for accessing the server blade through a console or workstation to install adapter drivers and software 102 BR0054504 00 A 2 Hardware Installation Mezzanine adapters For details on other devices that install in the blade system enclosure refer to the installation and user guides that came with the device For details on compatibility with blade servers switch modules I O modules and other devices that install in the blade system enclosure refer to Server blades and system enclosures mezzanine adapters on page 16 What you need for installation Have the following available before installing the adapter Mezzanine card shipping carton which includes the mezzanine card and necessary documentation Fully operational blade server Access to a blade server through a local or remote console connection for installing adapter drivers and software Blade server installation and
108. 5 configuring Cisco fabrics 237 FA PWWN using for boot LUN 215 FC trunking 58 FC AL support 54 FCC warning 1741 adapters 306 stand up adapters 298 FCoE features of CNAs 34 FCP IM I O profiling 54 FC SP 35 55 FDMI enable parameter Linux and VMware 325 Windows 328 features of adapters 27 operating system limitations and considerations 61 features of HBA 49 fiber optic cable recommendations CNAs 282 Fabric Adapters 273 HBA 292 Fibre Channel arbitrated loop support 54 Fibre Channel mode 3 Fibre Channel standards compliance 297 FIP support 35 54 firewall issue 111 139 BR0054504 00 A Installation Guide BR Series Adapters firmware for adapter CPU 75 flow control 45 G gPXE 39 gPXE boot 202 243 H hardware and software requirements for HCM 64 hardware installation switch and storage connection 100 what you need 96 hardware specifications CNA 278 Fabric Adapter 266 HBA 289 HBA boot image 89 driver packages 75 features 49 firmware 75 hardware specifications 289 host and fabric support 59 illustration 14 21 installing driver package with software installer 114 IOPs per port 49 LED operation 293 low profile bracket 14 21 management applications 63 68 management with BCU 77 PCI system values 289 PCle interface 288 PCle support 27 physical characteristics 288 product overview 18 PWWN 311 serial number 310 software downloading from website 92 installation options 87 installation packages 81 overvie
109. 6 file usr bin bfa supportsave from install of brocade bfautil noioctl 3 2 1 0 0 noarch conflicts with file from package brocade bfautil 3 1 0 0 0 1386 file usr bin bfa supportshow from install of brocade bfautil noioctl 3 2 1 0 0 noarch conflicts with file from package brocade bfautil 3 1 0 0 0 1386 If this error occurs use the following steps to uninstall the existing utilities and install the current utilities that you extracted from the tar gz file 1 List QLogic drivers and utilities on the system conflicting utility is highlighted in red root xenserver my dir rpm qa grep brocade bfautil brocade bfa modules kdump 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 0 0 brocade bfautil noioctl 3 2 1 00506 0 brocade bfa modules xen 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 0 0 2 Remove the currently installed bfa utility package root xenserver my dir rpm e brocade bfautil 3 1 0 0 0 3 Install the correct bfa utility package root xenserver my dir rpm ivh brocade bfautil noioctl 3 2 1 00801 0 noarch rpm Preparing i dtd tt RE TH E E EHE EE EE EE ERE EE ERE EE ERE E E ER 100 1 brocade bfautil noioctl ifdd ddd ggg d gg EHH E EHH EH HEHE Hat HH FEEFFE 100 Install cli done Install HBAAPI library done
110. 76 BR0054504 00 A 1 Product Overview Adapter software Intermediate driver CNAs and Fabric Adapters only For Windows Server 2008 R2 systems only this provides support for multiple VLANs on ports and teams This driver applies to CNAs and to Fabric Adapter ports configured in CNA or NIC mode Note that installing this driver changes the behavior of the network driver because it alters the binding of the driver and protocols in the network stack Before installing the intermediate driver network traffic goes from the protocols layer to the network driver directly After installation virtual LANs created by BCU commands or HCM options are directly bound to upper protocols All traffic goes from the protocols layer to the VLANs and then to the network driver You should not enable TCP IPV4 or other protocols or services for the network driver after installing the intermediate driver For Windows Server 2012 the BNI driver is not installed because teaming and VLAN are natively supported by the Windows 2012 operating system Installing the wrong firmware or adapter driver update might cause the adapter or switch to malfunction Before you install a firmware or update the driver refer to all readme and change history files that are provided with the driver or firmware These files contain important information about the update and the procedure for installing the update including any special procedure for updating from an earlier
111. 86 dud version iso x86 brocade unified adapter rhel63 i386 dud version iso brocade unified adapter rhel64 i386 dud version iso Linux brocade unified adapter rhelb7 x86 64 dud version iso live cd brocade adapt RHEL brocade unified adapter rhelb8 x86 64 dud version iso3 lt version er boot fw v and OL T iso ersion brocade unified adapter rhelb9 x86 64 dud version iso 5 9 5 10 M f 6d and brocade unified adapter rhel62 x86 64 dud version iso 6 5 brocade unified adapter rhel63 x86 64 dud version iso X86 64 brocade unified adapter rhel64 x86 64 dud version iso Linux brocade adapter sles10sp3 dud version iso live cd brocade adapt SLES brocade adapter slestO0sp4 dud version iso version er boot fw v 10 3 m gt iso ersion gt 10 4 brocade_adapter_sles11sp1_dud_ lt version gt iso 11 1 and brocade_adapter_sles11 sp2_dud_ lt version gt iso 11 2 x86 x86 64 VMware bfa esx50 version iso live cd brocade adapt ESX ESX pna esx50 lt version gt iso4 version er boot fw v i5 0 i i iso ersion gt 91 BR0054504 00 A 1 Product Overview Downloading software and publications Table 1 11 Boot installation packages Continued Operatin g System Driver Update Disk Image LiveCD Boot Code Platfor m VMware bfa esx51 version zip live cd brocade adapt ESX ESX bna esx51 version zip version
112. A 1 Product Overview Adapter features Support for Windows Preinstallation Environment WinPE a minimal operating system with limited services for Windows Server or Windows Vista used for unattended deployment of workstations and servers WinPE is designed for use as a standalone preinstallation environment and as a component of other setup and recovery technologies WinPE is supported by QLogic Windows Server 2008 R2 adapter drivers Support for Windows Server Core a minimal server option for Windows Server 2008 R2 operating systems that provides a low maintenance server environment with limited functionality All configuration and maintenance is done through command line interface windows or by connecting to a system remotely through a management application Windows Server Core is supported by Windows Server 2008 R2 adapter drivers Support for MSI X an extended version of Message Signaled Interrupts MSI defined in the PCI 3 0 specification MSI X helps improve overall system performance by contributing to lower interrupt latency and improved utilization of the host CPU MSI X is supported by Linux RHEL 5 RHEL 6 SLES 10 SLES 11 and ESX Server 5 0 and 5 5 Target rate limiting You can enable or disable this feature on specific ports Target rate limiting relies on the storage driver to determine the speed capability of a discovered remote ports and then uses this information to throttle FCP traffic rates to slow draining tar
113. A 4 Boot Code Boot over SAN 10 11 12 13 14 15 Follow system prompts to load the driver and continue with operating system installation Refer to your system documentation as necessary to format and complete installation on the target boot LUN Reboot the system On Oracle images the system will default to the Unbreakable Kernel The following message may display No root device found Boot has failed sleeping forever This error occurs because QLogic BR Series Adapter drivers do not support this kernel for boot over SAN You must switch to the Red Hat Compatible Kernel using Step 11 through Step 14 Reboot the system again When the following messages display press any key Press any key to enter the menu Booting Oracle Linus Server uek 2 6 32 100 28 5 e16 x86 604 in 1 seconds When the screen displays for selecting the Oracle Linux Server uek or Oracle Linux Server base kernels select the base kernel When the operating system successfully boots make the base kernel the default boot option using the following steps a Log in as root b Right click the screen and select Open Terminal from the menu c Edit the boot grub menu Ist file and change default 0 to default 1 Also comment out the hiddenmenu line hiddenmenu d Change the timeout to 15 seconds instead of the default 5 recommended e Save the file and reboot The RHEL compatible kernel sho
114. A Yes No No Windows SBS 2011 N A Yes No N A Windows 7 Yes Yes No No Windows Server 2012 N A Yes N A N A Windows Server 2012 R2 N A Yes N A N A Microsoft WinPE 3 x for Windows Yes Yes No No Server 2012 Linux Red Hat Enterprise Linux RHEL 5 7 Yes Yes No No 5 8 5 9 5 10 6 2 6 3 6 4 6 5 SUSE Linux Enterprise Server SLES Yes Yes No No 10 3 10 4 11 1 11 22 Citrix XenServer 5 6 6 0 6 1 No Yes No No Solaris Solaris 10 11 Yes Yes No No VMware ESX ESXi 70 BR0054504 00 A 1 Product Overview Host operating system support Table 1 7 Operating system support for network and storage drivers Continued Operating System x86 x64 1A 64 SPARC ESXi 5 x N A Yes N A N A Oracle Linux OL 5 9 5 10 6 4 6 5 Yes Yes N A N A Oracle VM 3 0 Storage N A N A N A driver support ed 32b 1 Supported by Windows Server 2008 R2 drivers 2 If updating the errata kernel on SLES 11 SP1 systems after installing the driver refer the Linux section under Installation notes on page 108 for instructions Hypervisor support Table 1 8 lists Hypervisor support in various operating systems and platforms N A indicates that support is not available in the OS architecture Table 1 8 Hypervisor support for QLogic BR Series Adapters System x86 x64 Intel A64 SPARC VMware ESXi 5 0 N A Yes N A N A VMware ESXi 5 1 N A Yes N A N A VMware ESXi 5 5 N A Yes N A N A Windows Server 2008 R2 N A Yes N A N A
115. Adapter software You can download driver packages to configure boot LUNs and boot images for adapters installed in systems without operating systems or hard drives Refer to Boot code updates on page 189 for complete information CIM Provider CIM Provider allows third party SMI S and CIM based adapter management software to manage QLogic BR Series Adapters installed on a host system The CIM Provider files do not load when you use the QLogic Adapter Software Installer The CIM Provider software is available at htto driverdownloads glogic com under the adapter type adapter model and operating system For more information on CIM Provider including operating systems supported and available installation packages refer to the C M Provider for QLogic BR Series Adapters Installation Guide Although SMI S Provider and CIM Provider may be used interchangeably CIM is the more generic term SMI S is storage specific Adapter event messages When applicable events occur during adapter operation the adapter driver generates event messages These messages are captured in your host system logs and also display in the HCM master log All of these event log messages are contained in HTML files that load to your system when you install adapter drivers You can view these HTML files using any Internet browser application For details on event messages event log locations on supported operating systems and where adapter event messa
116. BCU enter the bfa_supportsave command For VMware ESXi 5 0 and later systems BCU commands are integrated with the esxcli infrastructure To initiate Support Save on an ESX system enter esxcli brocade supportsave Through your Internet browser Internet Explorer 6 or later or Firefox 2 0 or later you can collect Support Save output if you do not have root access do not have access to file transfer methods such as File Transfer Protocol FTP and Secure Copy SCP or do not have access to the Host Connectivity Manager HCM A Support Save collection can also occur automatically for a heartbeat failure To occur through HCM HCM must be running This feature supported on Linux Windows and Solaris It is not supported on ESXi5 x Launching Support Save through BCU HCM and during a heartbeat failure saves the following information Adapter model and serial number Adapter firmware version Host model and hardware revision All support information Adapter configuration data All operating system and adapter information needed to diagnose field issues Information about all adapters in the system Firmware and driver traces Syslog message logs Windows System Event log evt file HCM GuUl related engineering logs 313 BR0054504 00 A 6 Adapter Support Using Support Save Events Adapter configuration data Operating system environmental information Data xml file Vital CPU memory network resources HCM Agent logs
117. BIOS is disabled L Enter a VLAN ID between 0 through 4094 for the port to be used during network boot 5 Click OK to exit and save values All configuration values are stored to adapter flash memory For details in using HCM options to enable BIOS for network boot refer to the instructions for configuring PXE boot support using HCM in the Host Configuration chapter of the QLogic BH Series Adapter Administrator s Guide Configuring PXE BIOS using BCU commands You can use BCU commands to configure PXE BIOS for the following m CNA port W X Fabric Adapter port configured in CNA or NIC mode Use BCU commands for the following tasks W Enable BIOS for PXE boot You must enable BIOS to support network boot for an adapter port If disabled the host system cannot boot from network systems The default setting for the adapter boot BIOS is disabled We recommend to only enable one adapter port per host to boot over the network bcu ethboot enable port id where port id Specifies the ID of the port for which you want to set network boot attributes This could be the adapter id port id port PWWN port name or port hardware path a Disable BIOS for PXE boot bcu ethboot disable port id where port id Specifies the ID of the port for which you want to set network boot attributes This could be the adapter id port id port PWWN port name or port hardware path 201 BR0054504 00 A 4 Boot Code Network boot
118. Both stand up CNAs also support direct attached SFP transceiver copper cables The following illustration is representative and may have minor physical differences from the card that you purchased 1 LEDs for port 1 SFP transceiver 2 Cable connectors for port 1 and port 0 SFP transceivers Fiber optic SFP transceiver illustrated 3 LEDs for port 0 SFP transceiver 4 Low profile mounting bracket Note The CNA ships with the low profile mounting bracket installed 5 PCle x8 connector 6 ASIC Figure 1 2 BR 1020 stand up CNA with low profile mounting bracket heat sink removed 10 BR0054504 00 A 1 Product Overview Converged Network Adapters Use only QLogic branded SFP laser transceivers supplied with stand up CNAs Mezzanine adapters Mezzanine adapters are smaller modules than stand up models These mount on server blades that install in blade system enclosures BR 1007 CNA Figure 1 3 illustrates major components of the BR 1007 which is an IBM combo form factor horizontal CFFh CNA containing two ports operating at 10 Gbps The following illustration is representative and may have minor physical differences from the card that you purchased 11 BR0054504 00 A 1 Product Overview Converged Network Adapters 1 ASIC with heat sink 2 3 4 5 6 x8 PCle interface connector Release lever Pull to release adapter from blade server Holes for guiding card onto blade server syst
119. CNA or Fabric Adapter port configured in CNA or NIC mode if driver packages have correctly loaded Ismod This command displays information about all loaded modules If bfa appears in the list the storage driver is loaded to the system If bna appears in the list the network driver is loaded to the system dmesg This command prints kernel boot messages Entries for bfa storage driver and bna network driver should display to indicate driver activity if the hardware and driver are installed successfully 173 BR0054504 00 A 3 Software Installation Confirming driver package installation Confirming driver installation with Solaris tools Verify if the driver packages installed successfully using the following commands BR 804 and BR 1007 adapters are not supported on Solaris systems so commands in this section do not apply to these adapters BH These commands display information about loaded kernel modules modinfo grep bfa modinfo grep bna If the storage driver package is installed bfa QLogic Fibre Channel Adapter Driver should display If the network driver package is installed bna QLogic Fibre Channel Adapter Driver should display B These commands check for and lists the installed storage and network driver package files pkgchk nv bfa pkgchk nv bna W X Thiscommand displays all available information about software packages or sets that are installed on the system pkginfo 1 The storage driver
120. Channel devices connected through the adapter and associated FCoE or Fibre Channel switch are correctly connected powered up and operating correctly If not powered up devices will be unavailable Verify host system storage switch and operating system compatibility Verify the following for stand up adapters only CL Observe LED operation on adapter and refer to the Adapter LED operation stand up adapters on page 274 for Fabric Adapters Adapter LED operation stand up adapters on page 293 for CNAs and Adapter LED operation stand up adapters on page 283 for host bus adapters LEDs are visible through the adapter s mounting bracket 178 BR0054504 00 A 3 Software Installation Verifying adapter installation m If LEDs indicate that the link between the adapter and switch is not operational this could mean that a problem on the link between the switch and adapter or that the driver is not loaded and communicating with the switch The adapter is installed in the appropriate connector in the host system All small form factor pluggable SFP optic transceivers are correctly installed seated and latched in adapter SFP transceiver receiver slots Cables are properly connected to the appropriate adapter port and seated in the SFP transceiver connector Correct options are configured for the slot where the adapter is installed W Verify the following for mezzanine adapters only a d Th
121. Choose Install Set Product Name v Choose Install Folder Brocade Adapter Software 3 0 0 1205 v Package PE Install Set Pre Installation Summary Storage and Network Drivers Management Utilities and metalima Install ormplete InstallAnywhere by Macrovision Cancel Previous F Figure 3 5 Preinstallation Summary screen The adapter software version displayed in the preceding screen will vary according to the version you are installing A progress bar displays showing installation progress for the various software components 118 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer For Windows systems a Force Driver Installation message box displays if a better driver is already installed for the adapter If message displays select OK to overwrite the existing driver or Cancel to quit installation After software installs the Install Complete screen displays listing installed drivers and other components Figure 3 6 YP Brocade Adapter Software Installer Pile x B Install Complete ly Introduction Brocade Adapter Software 3 0 0 1205 installation completed v License Agreement Driver components status y Choose Install Set 1 HBA Driver installation v Choose Install Folder a Driver has been successfully installed J 2 CMA Driver installation v Package Location a FCoEJBNA drivers Driver has been successfully installed v Pre Installation Summary b IM driver Driver h
122. Custom advanced When the Where do you want to Install Windows screen displays select the Load Driver option at the bottom of the screen 218 BR0054504 00 A 4 Boot Code Boot over SAN 10 11 12 13 14 The Load Driver dialog box displays prompting you to insert the installation media containing the driver files You must load the QLogic BR Series Adapter driver at this stage so that the system can access the boot LUN for Windows Server 2008 R2 Server installation Insert the media containing the QLogic BR Series Adapter driver update files that you created in Step 3 Select Browse on the Load Driver dialog box and select the adapter driver update disk Click OK If Hide drivers that are not compatible with hardware on this computer is selected only drivers for installed adapter models will display on the Select the drive to be installed screen If not selected drivers for all adapter models display Select the driver for the adapter that you are configuring for boot over SAN and click Next After the driver loads remote LUNs display on the Where do you want to install Windows screen that are visible to the adapter port Replace the driver update disk with the Windows Server 2008 R2 DVD Select the LUN that you have identified as the boot device for the adapter port and click Next Selecting Drive options advanced provides other options for editing the destination disk such a
123. Device Settings in the BIOS Configuration Utility or BCU B If BCU or HOM is used to configure a boot LUN a reboot is required to enable the change 210 BR0054504 00 A 4 Boot Code Boot over SAN Configuring boot over SAN You must configure boot over SAN on the adapter as well as the storage device Use this section to guide you through other sections in this chapter that contain complete procedures for configuring the adapter to boot from a SAN device Instructions are provided in this section for configuring boot over SAN on UEFI based systems using the system s UEFI setup screens and on Legacy BIOS systems using the BIOS Configuration Utility BCU commands and HCM Instructions are provided in this section for configuring boot over SAN on UEFI based systems that support EFI shell commands Configuring QLogic BR Series Adapters in UEFI mode may not be supported on some host systems However since QLogic BR Series Adapters ship with all ports enabled and auto negotiated speed enabled by default adapters should work in most systems 211 BR0054504 00 A 4 Boot Code Boot over SAN Overview Figure 4 3 provides a flow chart for the Procedures on page 213 and information elsewhere in this chapter to configure your adapter host system and remote boot device for booting over SAN Note Step numbers reference procedures on the following page ey Step 1 Install adapter hardware in host system Insta
124. E n 288 Hardware specifications s seo xr RR RR Rh 289 Cabling stand up adapters 000 cece eee eee 292 Adapter LED operation stand up adapters 293 Environmental and power requirements 2000e eee 295 Fibre Channel standards compliance 000 cee eee eee eee 297 Regulatory compliance iiis v dienur ade cewebetibeude sti Seiaes 297 Stand up adaplere d025ci0 pease xe ERE RE epe Geen bales 298 Mezzanine adapters 000 cece ee 306 6 Adapter Support Providing details for support i sour sac ER RR yeh ces 310 Using Support Save sees d Reap poe shee eed e pb Pl pu lodos 313 Initiating Support Save through HOM ilslssssssssss 315 Initiating Support Save through BCU commands 316 Initiating Support Save through the Internet browser 317 Initiating Support Save through a heartbeat failure 317 Support Save differences anann aaae 317 A Adapter Configuration Irrreera ires jro MERECE a a e a 319 Storage instance specific persistent parameters liiis 319 Managing instance specific persistent parameters 323 viii BR0054504 00 A Installation Guide BR Series Adapters Storage driver level parameters llis 324 Linux and VMware driver configuration parameters 324 Windows driver configuration parameters 00 005 328 Solaris driver configuration parame
125. For example if two two port CNAs total of four ports are installed four instances of the adapter model display two under SCSI and RAID controllers and two under Network adapters As another example if only one port on a Fabric Adapter is configured in CNA or NIC mode two instances of the adapter model display one under SCSI and RAID controllers and one under Network adapters Right click an instance of your adapter displayed under Device Manager Select Properties to display the Properties dialog box 172 BR0054504 00 A 3 Software Installation Confirming driver package installation Linux Click the Driver tab to display the driver date and version Click Driver Details for more information If driver is not installed try re installing the driver or re installing the adapter hardware and then the driver Verify that the adapter driver installed successfully using the following commands rpm qalgrep i bfa This command prints the names of the QLogic adapter storage driver package bfa if installed rpm qalgrep i bna This command prints the names of the QLogic adapter network driver package bna if installed Ispci This utility displays information about all PCI buses in the system and all devices connected to them Fibre Channel QLogic Corporation displays for an host bus adapter or Fabric Adapter port configured in HBA mode Fibre Channel QLogic Corporation and Ethernet Controller display for a
126. HCM 2 0 and earlier you can only restore data that you backed up during software removal when you are prompted to restore data during software installation W X For HCM 2 0 and later you can restore data when prompted to do so during software installation or by using the HCM Restore Data dialog box 186 BR0054504 00 A 3 Software Installation Setting IP address and subnet mask on CNAs Setting IP address and subnet mask on CNAs After installing a CNA or Fabric Adapter with ports configured in CNA or NIC mode you must assign an IP address and subnet mask to function on a DCB network Work with your network administrator to obtain the correct address and mask for your network Windows 1 From Control Panel select Network Connections 2 Right click the installed QLogic Ethernet XX Network Adapter Interface instance and click Properties 3 Inthe This connection uses the following items box click Internet Protocol TCP IP and then click Properties 4 Select Use following IP address radio button and configure the IP address and subnet mask 5 Click OK to apply the configuration Linux Following is an example for using the ifconfig command to set the IP address and subnet mask Note that a CNA and a Fabric Adapter with ports configured in CNA or NIC mode are typically named ethO ifconfig ethO 193 164 1 10 netmask 255 255 255 0 up VMware Please refer to ESX ESXi configuration guide on network configuration for V
127. HEL is registered trademark of Red Hat Inc Firefox is a registered trademark of Mozilla Corporation SUSE Linux Enterprise Server SLES is registered trademark of Novell Inc ESX Server is a registered trademark of VMware Inc SPARC is a registered trademark of SPARC International Inc BladeSystem is a registered trademark of Hewlett Packard Corp BladeCenter Flex System and Unified Configuration Manager are trademarks or registered trademarks of the International Business Machines Corporation PowerEdge is registered trademark of Dell Citrix and XenServer are registered trademarks of Citrix Systems Inc All other brand and product names are trademarks or registered trademarks of their respective owners Information supplied by QLogic Corporation is believed to be accurate and reliable QLogic Corporation assumes no responsibility for any errors in this brochure QLogic Corporation reserves the right without notice to make changes in product design or specifications
128. II 199 255 driver support 195 general requirements 196 network boot introduction 193 network driver 76 configuring parameters 332 network driver configuration parameters Linux 338 VMware 344 Windows systems 333 network driver teaming parameters for Windows systems 337 network priority 44 NIC management using HCM 68 NIC mode 3 NPIV 37 58 O OEL installing OEL 6 x on boot LUN 224 operating system support adapter drivers 72 considerations for features 61 Ethernet 74 FCoE 73 Fibre Channel 73 HCM 74 limitations for features 61 P PCI boot code adapters 80 189 BR0054504 00 A Installation Guide BR Series Adapters PCI system values CNA 278 Fabric Adapter 266 HBA 289 PCle interface 33 CNA 277 Fabric Adapter 265 HBA 288 PCle support CNA 17 Fabric Adapter 8 HBA 27 persistent binding 37 PHY firmware updating 105 PHY module firmware determining firmware version 105 updating 106 physical characteristics of CNAs 277 physical characteristics of Fabric Adapters 265 physical characteristics of HBAs 288 PowerPC support 59 preinstall option 142 product overview 9 18 publications download 92 PWWN of adapter 311 PXE boot 44 building a custom image for auto deployment 244 Q QLogic Adapter Software Installer QASI using 113 quality of service QoS 59 NCID 359 NDIS 44 R receive side scaling RSS 46 regulatory compliance 306 1741 adapters Canadian requirements 307 CE statement 307
129. ION iria Ebor Pe drei ea etaed ebke de ee aui EA 5 6 Environmental and power requirements 0000 eee ee eee 5 7 CNA mounting brackets naaa kEektextireG tb oe tss FE Edo REF eee 5 8 CNA hardware specifications 1 0 2 2 0 00 tee 5 9 Transceiver and cable specifications 02 2 ee 5 10 LED perati cies auta en Bate eee eee Pah RA UR Ide tas qusc ee Saneds aes 5 11 Environmental and power requirements 0 00 eee eee eee 5 12 Environmental and power requirements for BR 1007 CNA mezzanine card 5 13 Environmental and power requirements for BR 1741 CNA mezzanine card 5 14 Mounting brackets for stand up HBAS 0 0 0 ee 5 15 Supported Fibre Channel features 0 eee 5 16 Fibre Channel transceiver and cable specifications 0000 eee 95 17 LED ODCdON lt sicveheten hie 93er ch ees REGE EE aan UE da e ac fae ees 5 18 Environmental and power requirements 000 ee 5 19 Environmental and power requirements for BR 1867 mezzanine card 5 20 Environmental and power requirements for BR 1869 mezzanine card 5 21 Regulatory certifications and standards 2220000000000 00s 5 22 Hazardous Substances Toxic Substances HS TS concentration chart 5 23 Regulatory certifications and standards 000 cece eee A 1 Adapter instance specific parameters llle A 2 Linux and VMware driver configuration parameters
130. IOS with the BIOS Configuration Utility 6 Change any parameters by following the instructions at the bottom of the BIOS Configuration Utility screen For example use the following keys to select and change information Up and Down keys Scroll to a different field ENTER Select a field and configure values Left and Right arrow keys Change a value ALT S Save configuration values to adapter flash memory ALT Q Exit the utility ESC Go back a screen Page Up or Page Down Go to preceding or next screen To restore factory default settings press R 7 To configure boot devices select Boot Device Settings from the initial menu screen for the adapter port Step 4 and press Enter to designate a discovered LUN as a boot device A list of up to four boot devices displays showing the PWWN of the storage port and the LUN number designated as a boot LUN The first device listed is the primary boot device The host first tries to boot from the primary device and then the succeeding devices in the list Figure 4 9 shows an example of the Boot Devices settings Brocade BIOS Config Menu Adapter Selected Adapter Model PCI Bus Dev Fn BR 1020 6C 706788 19 00 00 05 1E 55 27 68 Boot Device Settings ID PWWN LUN 8 68 00 00 00 66 66 80 80 HHHEHEHEHEH80808 OB EIS CIS CETT 0000000000000009 1 2 86 00 00 00 00 00 80 88 0000000000000000 3 BB 88 88 88 88 00 08 G9 gogagagaeaeaaaap
131. In this case you must analyze the log file to decode any failures during driver installation uninstallation or preinstallation operations m W2K3 HOTFIX W2K8 HOTFIX If INSTALL OP INSTALL use this option to override the installed hot fix with a new hot fix or to avoid checking for a hot fix To specify a new hot fix for override use the format lt KBnnnnnn gt lt Required Optional gt lt Description gt For example W2K8 HOTFIX KB9987654 Required newer hotfix To avoid checking for hot fix use the value For example W2K3_HOTFIX mW SNMP TRUE If management utilities containing SNMP files were installed this installs the SNMP subagent drivers and other utilities mW SNMP ONLY TRUE If management utilities containing SNMP files were installed this installs the SNMP subagent only After entering options to install the software a message box may display indicating that the target existing driver is newer than the source upgrade driver Depending on the number of adapters installed this message box may display more than once 143 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 10 11 You can also use the brocade_install bat command to install the SNMP subagent For details refer to Installing SNMP subagent on page 180 for details Click Continue Anyway each time the message box displays to continue As installation c
132. Installers link at the top of the page to direct you to the adapter software installer packages 114 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer 4 Locate the adapter software installer package for your adapter in the table click on it and then follow the directions 5 Execute the appropriate Adapter Software Installer program exe or bin file depending on your host s operating system and platform A progress bar displays as files are extracted Figure 3 1 InstallAnywhere InstallAnywhere is preparing to install w 70 C 1997 2008 Macrovision Europe Ltd and or Macrovision Corporation Figure 3 1 Installer progress bar When all files are extracted a QLogic Adapter Software title window appears 6 When the QLogic Software Installer Introduction screen displays Figure 3 2 read the recommendations and instructions and then click Next 2 Brocade Adapter Software Installer B Introduction Q Introduction Installer will guide you through the installation of Brocade Adapter Software 3 0 0 25 on Microsoft Windows XP 32 bit Service Pack 3 Itis strongly recommended that you quit all programs before continuing with this installation Click the Next button to proceed to the next screen If you want to change something on a previous screen click the Previous button You may cancel this installation at any time by clicking the Cancel button Inst
133. Manager Device Manager Device Manager Device Manager HCM BCU commands Device Manager HCM BCU commands Enables Windows Network Driver Interface Specification NDIS QoS Enables hardware assisted VLAN tagging Tunes receive buffer value Supported on Windows Server 2008 R2 Supported on Windows Server 2008 R2 for IPv4 traffic Supported on Windows Server 2008 R2 for IPv6 traffic Creates team of adapter ports of following types E Failover and failback E 802 3ad based link aggregation W Create a single port VLAN with Device Manager W Creates multiple VLANs using BCU commands or HCM Disable VLANs in Device Manager W Supported by Windows Server 2008 R2 334 BR0054504 00 A A Adapter Configuration Network driver parameters Table A 5 Network driver configuration parameters Continued Default Method to Function value Possible values configure Notes VMQ Enabled Enabled 1 Device Manager B Virtual Machine Queue 1 Virtual machine m VMQ is only available ueue capabilit oM Heus k y Configuring the when 2008 R2 driver is T VM to use VMQ aiaee on a 2008 R2 Hee canbe done operating system i i through SCVMM I Unless the administrator D saluo 0 or hyper V configures a VM to use Virtual machine manager VMQ through SCVMM queue capability is not published to the operating system or hyper V manager it will not be used by the operating system
134. Menu Configuring devices 7 Press 5 to select Apply Driver Updates 228 e example in BR0054504 00 A 4 Boot Code Boot over SAN 10 11 Replace the Solaris installation DVD with the install time update CD or USB drive that you created in Step 3 You must load the QLogic storage driver at this stage so that the system can access the boot LUN for Solaris installation When the update completes eject the install time update CD or USB drive containing the driver update Insert the Solaris installation CD DVD Continue responding to on screen instructions and refer to your system documentation as necessary to format and complete installation on the target boot LUN Installing VMware and the driver Use the following steps to install VMware and the adapter driver on an unformatted Fibre Channel disk that you that you configured as a bootable device when setting up the adapter BIOS or UEFI on the host system If the LUN you have targeted for booting over SAN already has an operating system installed be sure to use options for reformatting the LUN during VMware installation Refer to your operating system documentation for details For boot over SAN on VMware 4 0 and later systems if driver installation or updates are done for CNAs and Fabric Adapter ports configured in CNA mode using the ISO image update the storage drivers using the bfa DUD For HBAs and Fabric Adapter ports configured in HBA mode
135. Mware ESX ESXi 4 1 and 5 0 187 BR0054504 00 A 4 Boot Code Boot support Boot support is provided for QLogic BR Series Adapters installed on your host To note changes to boot support and procedures detailed in this chapter please download the current release notes for your adapter software version from the QLogic Web Site using the following steps 1 Go to the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model In the table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go Click the Drivers link at the top of the page to direct you to the driver packages Locate the driver for your adapter in the table and then click on the release notes link The following system BIOS and platforms support QLogic BR Series Adapters PCI BIOS 3 1 and PCI firmware 3 0 or later for QLogic Fabric Adapters and CNAs BIOS Boot code for x86 and x86_ x64 platforms Compliant with PCI BIOS 3 1 or later and PCI Firmware 3 0 or later Unified Extensible Firmware Interface UEFI Boot code for UEFI systems PXE preboot execution environment and UNDI universal network device interface Network boot support for x86 and x86 x64 platforms A single updatable boot code image stored in the adapter option read only memory option ROM memory contains all boot code for supported host platforms 188 BR0054504
136. Mware systems refer to Driver installation and removal on VMware systems on page 157 For instructions on using the QLogic installation scripts and installation commands that are native to your host operating system refer to Using software installation scripts and system tools on page 138 For details on HCM driver packages and other adapter software components for each supported host system refer to Adapter software on page 75 Two installation options are available when using the QLogic Adapter Software Installer W Installation using a GUI based installer Refer to Using the GUI based installer on page 114 W X Installation using commands This method completely installs the driver package HCM or all components without user interaction Refer to Software installation using Software Installer commands on page 120 The storage driver will claim all installed QLogic BR Series Adapter ports configured in HBA or CNA mode installed in a host system 113 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Using the GUI based installer The QLogic Adapter Software Installer QASI GUI based application or commands are the preferred methods to install the following components on your host system W Storage and network drivers B Management Utilities including the HCM agent BCU installation scripts and SNMP agent files m HCM only This applicatio
137. N from direct attached storage follow these steps 1 Verify the adapter is using the appropriate boot code level and update if required using procedures under Boot code updates on page 189 B For loop topology verify that the adapter boot code is 3 1 0 0 or later Use version 3 1 0 0 or later boot installation packages driver update disks or LiveCD to install drivers B For point to point topology verify that the adapter boot code is 3 0 0 0 or later Use version 3 0 0 0 or later boot installation packages driver update disks or LiveCD to install drivers Verify the adapter port topology using the bcu query port id command and change if required W f configuring boot over SAN in a loop topology use the bcu port topology port id loop command to set loop topology Default is point to point p2p M f configuring to boot over SAN in a point to point topology use the bcu port topology port id p2p command to set loop topology Default is point to point p2p Configure boot over SAN using steps under Configuring boot over SAN on page 211 During steps to configure the BIOS using the BIOS Configuration Utility the BCU bios commands or UEFI setup screens set the adapter port to the appropriate topology for the direct attach storage loop or P2P Host system requirements for boot over SAN Consider these requirements for your host system when configuring boot over SAN You may need to disconnect internal IDE
138. P implementation PTP is an IEEE protocol 1588 used to synchronize the clocks in the computer network The precision granularity is in the order of nanoseconds A master is selected as part of PTP initialization to which all the nodes synchronizes their clocks The master periodically broadcasts the time updates Clients use this information along with the delay calculated using the PTP exchanges and adjusts their clocks There are two variants of PTP implementations L Hardware Need hardware support phy module for the NIC Hardware does the actual time stamping for the PTP packets L Software NIC driver need to timestamp the tx PTP packets The Linux BNA driver currently supports only the software PTP implementation 45 BR0054504 00 A 1 Product Overview Adapter features UEFI Health Check Protocol Driver Health Protocol produces a collection of services that allow the UEFI driver to report health status to the platform This protocol provides warning or error messages to the user performs length repair operations and requests that the user to make hardware or software configuration changes This protocol is required only for devices potentially in a bad state and recoverable either through a repair operation or a configuration change The UEFI Boot Manager uses the services of the Driver Health Protocol to determine the health status of a device and display that status information on a UEFI console The UEFI Boot
139. QLOGIC Ultimate in Performance Installation Guide BR Series Adapters Converged Network Adapter Models BR 1007 1741 1020 Fibre Channel Adapter Models BR 804 815 825 1867 1869 Fabric Adapter Model BR 1860 BR0054504 00 A Installation Guide BR Series Adapters Information furnished in this manual is believed to be accurate and reliable However QLogic Corporation assumes no responsibility for its use nor for any infringements of patents or other rights of third parties which may result from its use QLogic Corporation reserves the right to change product specifications at any time without notice Applications described in this document for any of these products are for illustrative purposes only QLogic Corporation makes no representation nor warranty that such applications are suitable for the specified use without further testing or modification QLogic Corporation assumes no responsibility for any errors that may appear in this document Document Revision History Revision A April 30 2014 Changes Sections Affected Initial release ii BR0054504 00 A Table of Contents Preface Intended Audience 22 0 0 ee XV What Is in this Guide ic 63260 coe edi din ph do Re Id XV License Agreements 2000 c eee eee Xix Technical Support 3c xe Ee er ru ERO ERAS E GT EARN RUE XX Downloading Updates lilslssssllssslsslllleess XX RN D ssc ones Cae ted ay be veShe Ieee
140. R Series Adapters found on the host Note that the adapter identification ad id should not be specified if the a option is specified Updating older boot code on HBAs If updating v1 1 x x or v2 x boot code installed on BR 825 BR 815 and BR 804 HBAs to v3 0 or later download and use a LiveCD image to update boot code If you do not do this a version mismatch error may display after you reboot the server with 3 x drivers installed Follow instructions under Using a LiveCD image on page 241 through the step to update the adapter boot code 192 BR0054504 00 A 4 Boot Code Network boot Network boot The Network or the preboot execution environment PXE boot feature allows a host to boot its operating system from a system located somewhere on the Ethernet LAN instead of the host s local disk or over the SAN Booting from a remote LAN location provides the obvious advantage of recovering quickly from a host or adapter malfunction With PXE BIOS enabled on the CNA ports or Fabric Adapter ports configured in CNA or NIC mode replacing an old host with a new one involves installing the adapter from the old host into the new one with the same configuration and then booting the new host The host s operating system automatically boots from the remote LAN device Although fast recovery from a malfunction is a big advantage following are considerations for the host and adapter depending on the replacement situation B Even though
141. SP1 NOTE PowerPC is not currently supported for boot over SAN applications Quality of Service QoS feature working in conjunction with the QoS feature on Brocade switches to assign high medium default or low traffic priority to a given source or destination traffic flow Default bandwidth settings for QoS priority levels are 60 for high 30 for medium and 10 for low You can use BCU commands to change these percentages Refer to the QLogic BR Series Adapter Administrator s Guide for more information Note that set percentages are the percentage of the available link speed Therefore setting 25 for an 8 Gb link would be 2 Gb You also can change the percentages for high medium and low bandwidth for a port using UEFI screens Refer to Using Storage menu options on page 257 Server Application Optimization SAO When used with Brocade storage fabrics with enabled SAO licensing QLogic BR Series host bus adapters and Fabric Adapter ports configured in HBA mode can use advanced Adaptive Networking features such as QoS designed to ensure Service Level Agreements SLAs in dynamic or unpredictable enterprise class virtual server environments with mixed SLA workloads Support for Hyper V Hyper V consolidates multiple server roles as separate virtual machines VMs using the Windows Server 2008 R2 operating system and provides integrated management tools to manage both physical and virtual resources 59 BR0054504 00
142. SXi 5 0 and later systems BCU commands are integrated with the esxcli infrastructure To run a BCU command use the following syntax esxcli brocade bcu command command where command BCU command such as port list For example esxcli brocade bcu command port list 93 BR0054504 00 A 1 Product Overview Items shipped with your adapter Items shipped with your adapter This section describes items shipped with your adapter Stand up adapters The following items may be included with stand up adapters for installation W X Adapter with the following PCI mounting bracket installed depending on your adapter model CQ Low profile PCI mounting bracket Standard full height PCI mounting bracket B Additional bracket packaged with adapter depending on your adapter model Standard full height PCI mounting bracket Low profile PCI mounting bracket WB X One SFP transceiver or two SFP transceivers depending on your adapter model Note that for CNAs and Fabric Adapters SFP transceivers and copper cables may be purchased separately or shipped with the switch that supports Data Center Bridging DCB Adapter installation instructions Instructions for downloading software Mezzanine adapters The following items may be shipped with mezzanine adapters for installation depending on the adapter model B Adapter M Adapter installation instructions M important notices document and war
143. Select Uninstall HCM data is backed up in the background and HCM is un installed Restore data Use the following steps to restore HCM data 1 Install the earlier version software using steps under Using the QLogic Adapter Software Installer on page 113 If a backup a message displays prompting you to restore the data directory select the restore configuration option and continue with the installation Backup data for the previous later software successfully restores 137 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Downgrading driver only 1 Uninstall existing drivers using the procedures under Software removal using Adapter Software Uninstaller on page 130 2 Install new drivers using the procedures under Using the QLogic Adapter Software Installer on page 113 Installer log A status log is available after installation that provides complete status of installed software components The name of the installed component version and location in file system are provided The Installation Status log is in the following locations B Windows user home brocade W Linux and Solaris var log brocade When installing software in silent mode using installer commands always refer to the status log for reboot requirements as messages are not output to the screen Using software installation scripts and system tools This section provides instruct
144. Solaris Refer to Table 1 10 on page 83 for brocade_install sh tar gz file Oracle Linux Refer to Table 1 10 on page 83 for brocade_install sh tar gz file 1 After installing software you must reboot Solaris systems B HCM agent The agent provides an interface for managing adapters installed on the host through the HCM application The HCM agent is supported on VMware ESX systems Through the ESXi Management feature ESXi servers can be managed by HCM remotely if CIM Provider is installed on the server 78 BR0054504 00 A 1 Product Overview Adapter software CIM Provider CIM Provider packages installed on your host system allow any standard Common Information Model CIM and SMI S based management software to manage installed QLogic BR Series Adapters The CIM Provider files do not load when you use the QLogic Adapter Software Installer QASI to install driver packages If you want to integrate the provider with Common Information Model Object Manager CIM OM install the SMI S Provider packages using instructions in the C M Provider for QLogic BR Series Adapters Installation Guide Although SMI S Provider and CIM Provider may be used interchangeably CIM is the more generic term while SMI S is storage specific SNMP subagent Simple Network Management Protocol SNMP is an industry standard method of monitoring and managing network devices SNMP is supported by CNAs and by Fabric Adapt
145. The BR 1860 Adapter may be ordered with Fibre Channel or 10GbE transceivers Depending on the transceiver installed the port function may be set to a specific operating mode such as HBA NIC or CNA In some cases the adapter may only support a specific operating mode and cannot be changed Refer to your adapter provider for details Hardware compatibility This section outlines important compatibility information SFP transceivers stand up adapters Use only the QLogic branded small form factor pluggable SFP transceivers described in this section for stand up QLogic Fabric Adapters 5 BR0054504 00 A 1 Product Overview Fabric Adapters Ports configured in CNA or NIC mode Table 1 1 provides the type description and switch compatibility information for supported SFP transceivers that can be installed in ports configured in CNA or NIC mode Table 1 1 Compatible SFP transceivers for ports configured in CNA SFP transceiver type 10 Gbps SR short range SFP transceiver 1490 NM 10 Gbps LR long range SFP transceiver 10 km 1310 NM 1 meter direct attached SFP transceiver copper cable 3 meter direct attached SFP transceiver copper cable 5 meter direct attached SFP transceiver copper cable or NIC mode Description Optical short range SFP transceiver Distance depends on cable type Refer to Cabling stand up adapters on page 272 Optical long range SFP transceiver for
146. This action can run diagnostics execute firmware update utilities or boot an entire operating system over the network The PXE boot client is implemented in the adapter firmware It supports legacy BIOS for servers that do not support UEFI or UEFI for the newer servers The Client PXE code provides the following services for use by BIOS or a downloaded NBP W X Preboot Services API This provides several global control and information functions B TFTP API The TFTP Trivial File Transfer Protocol API enables opening and closing of TFP connections and reading packets from and writing packets to a TFTP connection The PXE client downloads the PXE boot loader from an TFTP server m UDP API The User Datagram Protocol UDP API enables opening and closing of UDP connections and reading packets from and writing packets to a UDP connection 194 BR0054504 00 A 4 Boot Code Network boot m UNDI API The Universal Network Device Interface UNDI API enables basic control of I O through the adapter This allows the use of universal protocol drivers that can be used on any network interface that implements this API UNDI is used by the PXE protocol to enable basic control of I O and performs other administrative chores like setting up the MAC address and retrieving statistics through the adapter The PXE BIOS Configuration Utility embedded with the adapter boot code for legacy BIOS support UEFI setup screens BCU commands and HCM al
147. Use image profiles with auto deploy For details refer to Using VMware Auto Deployment to boot QLogic custom images on page 243 Using vCLI to install drivers from offline bundles Use the following steps to install driver packages from VMware offline bundles to ESX and ESXi systems using vCLI Refer to Software installation and driver packages on page 81 for a description of driver packages and download instructions Before performing the following steps ensure that you have download and installed vCLI Refer to the VMware vCLI documentation of instructions 1 Download the adapter driver CD from downloads vmware com Search for VMware ESXi 5 x driver for Brocade HBAs version 3 2 4 The driver offline bundle zip file is included in the CD contents as BCD bfa bna release ver offline bundle build number zip 2 Copy the offline bundle zip file to the vCLI host s tmp directory 3 Make sure the host to which you are installing drivers is in maintenance mode 4 To install the QLogic Adapter software using one of the following methods m For ESX and ESXi 4 1 hosts use the following command to install an offline bundle vihostupdate i b BCD bfa bna release ver offline bundle build numer zip server 165 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools For ESXi 5 0 hosts use the following command to install an offline bundle esxcli Server server name
148. Using QLogic CNAs you can connect a server host system to a Fibre Channel SAN through connection with a compatible switch that supports Data Center Bridging DCB The CNA can connect with a network switch and perform NIC functions for network traffic 17 BR0054504 00 A 1 Product Overview Host Bus Adapters Host Bus Adapters Table 1 5 provides the model number port speed number of ports and adapter type for the current QLogic Fibre Channel PCle host bus adapters These adapters provide reliable high performance host connectivity for mission critical SAN environments Table 1 5 Host bus adapter model information Model number Port speed Number of ports Adapter type BR 804 8 Gbps maximum 2 Mezzanine BR 815 8 Gbps maximum 1 Stand up BR 825 8 Gbps maximum 2 Stand up BR 1867 16 Gbps maximum 2 Mezzanine BR 1869 16 Gbps maximum 4 Mezzanine 1 A4 Gbps SFP transceiver installed in BR 815 or BR 825 host bus adapters allows 4 2 or 1 Gbps Two types of host bus adapters are available W Stand up adapters These are low profile MD2 form factor PCI Express PCle cards measuring 16 76 cm by 6 89 cm 6 6 in by 2 71 in that install in PCle connectors in standard host systems B Mezzanine adapters These are smaller cards that mount on server blades that install in blade system chassis Fibre Channel communications are routed through the adapter ports on the blade server to the blade system enclos
149. VERO KORR 62 Oracle LINUX qp CEPIT 62 Adapter management features 0 000 c cece eee eee eens 63 HCM hardware and software requirements 200 64 General adapter management liliis eee eee eee 64 Fabric Adapter management llli leeren 65 CNA management 2225999520 2 0 rie SITDULGe SG er rGT ei 65 NIC management 000 cee ere 68 Host bus adapter management 00 0c eee eee eee 68 Host operating system support 000 000 e eee eee 70 Adapter drivers llle 70 Adapters and network technology llle e eee eee eee 72 Host Connectivity Manager HCM isses sees 74 Adapter software 000 eee 75 Driver packages sad eso k RERO RR REOR ER SOROR ER RR shaves 75 Management utilities uz ies ceries R eR RR RIDERRVREE vans 77 Host Connectivity Manager l l 79 BOOLCOUG osse Susp ERE pee Os send Edo ugok d eq alode a ed 80 CIM Provider 2 scia rar err d ipa ERE cities ta eda ides 81 Adapter event messages 0 ee 81 Software installation and driver packages 0 00 81 Software installation options 0 0 0 eee 87 Boot installation packages sssaaa aaan 88 Downloading software and publications 002 eee eee 92 Using BCU COmmMandScicsn bree ees Rathi See sh we Sed SR reis 93 VMware ESXi 5 0 and later systems 00000 eee eee 93 Items shipped with your adapter
150. VMware ESX ESXi in the third column and then click Go In the Drivers table click the VMware ESXi Driver Offline Bundle link and save the offline bundle zip file to a directory on your system Initialize PowerCLI on your system Add the software depot to image profiles as in the following example Add EsxSoftwareDepot c dir location offline bundle zip Create a clone of the existing profile as in the following example new esximageprofile cloneprofile ESXi 5 0 0 469512 standard Brocade version Add the software packages to the new profile as in the following example add esxsoftwarepackage imageprofile Brocade version GA softwarepackage scsi bfa net bna brocade esx bcu plugin hostprofile bfaConfig Perform one of the following steps 164 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools W Export the image profiles to ISO files as in the following example Export EsxImageProfile ImageProfile Brocade version FilePath C vsphere5 customimage iso ExportToIso W Add auto deploy rules as in the following example New DeployRule Name Brocade version GA Boot Item Brocade version GA AllHosts Add DeployRule DeployRule Brocade version GA Boot Errors will result in attempts to install the QLogic ESXCLI BCU plugin on ESXi 5 x systems if the systems acceptance level is set higher than Partner Supported
151. WWN FA PWWN feature will acquire the PWWN from the switch when it logs into the fabric Access control lists ACLs can also be predefined in the targets so that switch ports can be configured for booting operating systems supported by QLogic BR Series Adapters Although FA PWWN is enabled by default on the HBA port you must enable this feature on the switch port so that the HBA can acquire the PWWN For details on the FA PWWN feature including configuration requirements and limitations refer to the Brocade Fabric OS Aaministrator s Guide For Legacy BIOS systems use one of the following sections to enable the adapter and boot devices for booting over SAN W Configuring BIOS with the BIOS Configuration Utility on page 246 B Configuring BIOS with HCM or BCU commands on page 254 For UEFI systems use one of the following sections to enable the adapter and boot devices for booting over SAN W Configuring UEFI on page 255 B IBM Agentless Inventory Manager AIM support on page 259 Configure the LUN for booting your host system Refer to procedures required by your host platform and operating system Install boot image on the boot LUN The boot image consists of the adapter driver host operating system and other necessary files to allow the host to boot from the boot device Refer to Operating system and driver installation on boot LUNs on page 217 215 BR0054504 00 A 4 Boot Code Boot over SAN Fo
152. Windows installation the Driver Verifier and Device Manager Driver Verifier Manager Verify that the adapter storage driver bfa is loaded for host bus adapters CNAs Fabric Adapters and that the storage driver and network driver bna are loaded for CNAs and Fabric Adapters with ports configured in CNA or NIC mode using the Driver Verifier Manager tool Verifier exe The verifier exe command is located in the Windows System32 folder in Windows Server 2003 systems Select the option to display the following information about currently installed drivers Device Manager Loaded The driver is currently loaded and verified Unloaded The driver is not currently loaded but it was loaded at least once since you restarted the system Never Loaded The driver was never loaded This status can indicate that the driver s image file is corrupted or that you specified a driver name that is missing from the system Verify if the driver is installed and Windows is recognizing the adapter using the following steps 1 Open the Device Manager m For CNAs host bus adapters and Fabric Adapters when you expand the list of SCSI and RAID controllers or Storage controllers an instance of the adapter model should display for adapter port installed B For CNAs and Fabric Adapter ports configured in CNA or NIC mode when you expand Network adapters an instance of QLogic 10G Ethernet Adapter should also display for each port installed
153. a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column Solaris x86 or Solaris SPARC in the third column and then click Go c Click the Driver Update Disks link at the top of the page to direct you to the DUD zip file d Locate the DUD link for your adapter in the table click on it and following the instructions Create an install time update CD or USB drive from the ISO image Power up the host system Insert the Solaris installation DVD into the system DVD drive 227 BR0054504 00 A 4 Boot Code Boot over SAN 6 Select Solaris installation at the GRUB boot menu as shown in Figure 4 4 5 1BM3755 RHELv5 Avocent Session Viewer n x GNU GRUB version 8 95 688K louer 3668776K upper memoru Solaris Serial Console ttya Solaris Serial Console ttyb for 1x50 v6 x and v65x Figure 4 4 GRUB Boot Menu Solaris selected If devices are configured a menu should display such as th Figure 4 5 EJ IBM3755 RHELY5 Avocent Session Viewer jo x Use is subject to license terms Configuring devices Solaris Interactive default Custom JumpStart Solaris Interactive Text Desktop session solaris Interactive Text Console Apply driver updates Single user shell Enter the number of your choice Selected 5 fipply driver updates Figure 4 5 GRUB Boot
154. able 4 1 explains options available for BIOS port speed and boot LUN settings Brocade pIUS VLONTIG Menu Adapter Selected Adapter Model PCI Bus Dev Fn PHHN Brocade 1828 24 08 08 18 88 88 85 1E 54 CD 58 fidapter Settings BIOS Version 3 2 8 8 beta bld88 28121188 8785 NHHN 28 88 88 85 1E 54 CD 58 PHHN 10 06 08 5 1E 54 CD 58 ENode HAC 66 05 1E 54 CD 52 BIOS Enabled Port Speed Auto Boot LUN Fabric Discovered Bootup Delay L Anin Topo logy P2P LUN Hask I Disabled Press R to restore factory defaults lt ESC gt Go back lt ENTER gt Select and configure lt Up Down gt Navigate lt Alt N gt Fxit lt Alt S gt Saue and exit lt Left Riaht gt Chanae values Figure 4 8 BIOS Configuration Menu Adapter Settings 249 BR0054504 00 A 4 Boot Code Configuring BIOS with the BIOS Configuration Utility Table 4 1 BIOS Configuration Utility field descriptions Field Description BIOS The value of BIOS must be Enable for the selected adapter port to support boot over SAN If this setting is set to Disable the system will not boot from the Fibre Channel disk drives that are connected to the selected adapter port NOTE The default setting for all adapter ports is Enable BIOS Version Displays the BIOS boot code version installed on the card Boot LUN W Fabric Discovered When enabled LUN information such as the location of the boot LUN is provided by the fabric ref
155. abled in the system BIOS if they correctly support the bootstrap protocol W X Typically the boot order must be CD ROM diskette and then remote boot system After the operating system installs you can change this order if desired Due to the variety of configurations and variables in a LAN installations your specific environment must determine any additional requirements to guide installation and configuration for best results Configuring network boot Configure network or PXE Boot on the adapter using the following methods W Using the PXE BIOS Configuration Utility on page 197 m Using UEFI setup screens on page 199 W Using HCM or BCU commands on page 200 196 BR0054504 00 A 4 Boot Code Network boot Using the PXE BIOS Configuration Utility When using legacy BIOS systems or boot mode use the following procedures to configure network boot using the PXE BIOS Configuration Menu When you change a setting on a BIOS Configuration Utility screen the setting is saved to the adapter whenever you change to a new screen or close the utility 1 Power on the host system 2 Watch the screen as the system boots When PXE 2 1 BIOS 2010 11 All rights reserved displays press ALT B or CTRL B The PXE BIOS Configuration Menu displays a list of installed adapter ports similar to that shown in Figure 4 1 Brocade PXE BIOS Config Menu Select the fidapter Ad No Model No PCI Bus Dev Fn HAC 1 8 2 Brocade
156. ackets that the adapter receives using the destination MAC address and then routing the packets to different receive queues Packets can be directly transferred to a virtual machine s shared memory using direct memory access DMA This allows scaling to multiple processors by processing packets for different virtual machines in on different processors VMQ support provides the following features Q Improves network throughput by distributing processing of network traffic for multiple virtual machines VMs among multiple processors LJ Reduces CPU utilization by offloading receive packet filtering to NIC hardware QO Avoids network data copy by using DMA to transfer data directly to VM memory Q Splits network data to provide a secure environment LC Supports live migration VLAN IEEE 802 1Q standard A Virtual LAN VLAN is a way to provide segmentation of an Ethernet network A VLAN is a group of hosts with a common set of requirements that communicate as if they were attached to the same LAN segment regardless of their physical location A VLAN has the same attributes as a physical LAN but it allows end stations to be logically grouped together For Windows Server 2012 the BNI driver is not installed because VLANs are natively supported by the Windows 2012 operating system VLANs are supported on Linux Solaris and VMware but are implemented by the specific operating system vendor VLANs on teams Specific VLANs can be
157. adapter firmware provides the ability to boot the host operating system from a system located on the LAN instead of over the SAN or from the host s local disk Universal network device interface UNDI is an application program interface API used by the PXE protocol to enable basic control of I O and performs other administrative chores such as setting up the MAC address and retrieving statistics through the adapter UNDI drivers are embedded in the adapter firmware Network Priority The CNA and Fabric Adapter port configured in CNA mode support this feature which provides a mechanism to enable DCB flow control IEEE 802 1Qbb Priority based Flow Control standard and Pause 802 1p standard on network traffic In addition it guarantees mutual exclusion of FCoE and network priorities to ensure proper enhanced transmission selection ETS This feature is not supported on host bus adapters or Fabric Adapter ports configured in HBA mode This feature does not need to be enabled on the CNA port the Fabric Adapter port configured in CNA mode or the switch Specific DCB attributes including priorities for FCoE traffic are configured on the switch that supports Data Center Bridging DCB These attributes propagate to the CNA DCB port through the DCBCXP Adapter firmware processes this information and derives priorities for network traffic The network driver is notified of the network priority and tags both FCoE and network frames with their prio
158. age 77 for more information accessing installer scripts VMware vSphere Virtual CLI vCLI Refer to your VMware vCLI documentation to download and install vCLI Image Builder with PowerCLI Refer to the appropriate VMware documentation for more details VMware vSphere Management Assistant VMA Download vMA from the VMware website Once vMA is downloaded please refer to the vSphere Management Assistant Guide for instructions on how to deploy vMA VMware vSphere Update Manager Refer to your VMware vSphere Update Manager documentation for instructions on installing and using this application 157 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools VMware Console Operating System COS or Direct Console User Interface DCUI Refer to your VMware documentation for background on these systems Installation Notes Refer to these important notes before installation on VMware systems The HCM agent that installs with the driver package is not supported on VMware ESXi systems HCM access to HCM is available for these systems through CIM Provider using the ESXi Management feature Refer to HCM and BNA support on ESXi systems on page 75 Because some versions of ESX and ESXi do not enforce maintenance mode during driver installation it is recommended that you put the host in maintenance mode as a system reboot is required after installation You can use the VMware Image Builder PowerCLI to
159. ages for boot support that you can download for each supported operating system The table provides the operating system the driver update disk DUD image the LiveCD and the boot code Although Table 1 11 lists all boot packages that you can download for specific operating systems and platforms your adapter release may not be supported some of these operating systems and platforms Refer to Host operating system support on page 70 and the latest release notes for your adapter for more information For the BR 1867 Fabric Adapter you must use release 3 0 3 0 or later DUD and drivers 90 BR0054504 00 A 1 Product Overview Boot installation packages Table 1 11 Boot installation packages Operatin g System Driver Update Disk Image LiveCD Boot Code Platfor m Windows brocade adapter fc w2k8 r2 x64 dud version zip NA brocade adapt 2008 R2 procage adapter fcoe w2k8 r2 x64 dud version zip er boot fw v x86 64 ersion gt Windows brocade adapter fc w2k8 r2 x64 dud version zip NA brocade adapt 2012 brocade adapter fcoe w2k8 r2 x64 dud version zip er boot fw v ersion Linux brocade unified adapter rhel57 i386 dud version iso live cd brocade adapt RHEL brocade unified adapter rhel58 i386 dud version iso version er boot fw v and OL on aa gt iSo ersion gt 59 5 10 brocade_unified_adapter_rhel59_i386_dud_ lt version gt iso 6 4 6 5 brocade unified adapter rhel62 i3
160. al features on page 31 Target rate limiting You can enable or disable this feature on specific ports Target rate limiting relies on the storage driver to determine the speed capability of discovered remote ports and then uses this information to throttle the FCP traffic rate to slow draining targets This reduces or eliminates network congestion and alleviates I O slowdowns at faster targets Target rate limiting is enforced on all targets that are operating at a speed lower than that of the target with the highest speed If the driver is unable to determine a remote port s speed 1 Gbps is assumed You can change default speed using BCU commands Target rate limiting protects only FCP write traffic VHBA Virtual HBAs VHBAs are virtual port partitions that appear as virtual or logical HBAs to the host operating system Multiple VHBAs are not supported so you cannot create or delete them from an adapter For more information refer to l O virtualization on page 28 37 BR0054504 00 A 1 Product Overview Adapter features Data Center Bridging and Ethernet features QLogic CNAs and Fabric Adapter ports configured in CNA or NIC mode support the following Data Center Bridging DCB and Ethernet networking features For limitations and considerations for feature support for specific operating systems refer to Operating system considerations and limitations on page 61 B 10 Gbps throughput per port full duplex a 15
161. all nywhere by Macrovision Cancel Figure 3 2 QLogic Adapter Installer Introduction screen The adapter software version in the preceding screen will vary according to the version you are installing 115 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer 7 When the License Agreement screen displays select accept the terms of the License Agreement and then click Next to continue 8 If a backup directory exists for previously installed software a Found Backed up data message displays prompting you to restore old configurations Select either to restore or not to restore and continue installation Refer to HCM configuration data on page 186 for more information If this message does not display go on to Step 9 9 Ifa screen such as the one in Figure 3 3 on page 116 displays listing software components already installed on your system select one of the following options click Continue and then skip to Step 13 B install with existing configuration The installer compares each configured property and keeps the original value if different than the default value B Install with default configuration The installer upgrades the software and loads with default configurations Existing versions of the adapter s software components will be overwritten with the current versions you are installing if you continue If this window does not display go on to Step 10 Br
162. amMemberStatus teamMemberMACAddress ethStatsAdapterlndex ethStatsPortIndex ethStatsPCIFnIndex ethRxPackets ethTxPackets ethRxBytes ethTxBytes Function Unique Identifier of the team Unique team name Team mode such as none failback 802 2ad Index of the primary member Current primary member index MAC Address of the team Number of members of the team Team IP Address Index of the team Index of the team member Index of the interface Index of the adapter Index of the port Type of the team member Status of the member MAC address of the member Interface adapter index Interface port index Interface PCI function number Number of packets received Number of packets transmitted Number of bytes received Number of bytes transmitted 356 BR0054504 00 A B MIB Reference Table B 1 Supported MIB groups and objects for SNMP Continued Group Statistics Group VLAN Statistics MIB Objects ethRxErrors ethTxErrors ethRxDroppped ethTxDropped ethRxMulticast ethRxBrodcast ethLinkToggle ethmacRxDrop ethmacTxDrop ethmacRxBytes ethmacRxPackets ethmacTxBytes ethmacTxPackets ethRxCRCErrors ethTxHeartbeatErrors vLanAdapterlndex vLanPortlndex vsVLanPCIFnIndex vLANId vLANTxPackets vLANRxPackets vLANTxErrors vLANRxErrors Function Number of receive errors Number of transmission errors Number of packets dropped Number of packets not transmitted Number of mu
163. an be connected to the host system in a switched fabric or direct attached point to point or Fibre Channel Arbitrated Loop FC AL topology FC AL is supported in Windows Linux and VMware environments only Disabling N Port trunking The Fibre Channel N Port Trunking feature works in conjunction with the trunking feature on Brocade switches whereby the Fabric Operating System Fabric OS provides a mechanism to trunk different switch ports of the same port group into one Disabling the N Port trunking feature on the adapter when using boot over SAN requires specific procedures that are included in the QLogic BR Series Adapter Administrator s Guide Refer to that guide for details N Port Trunking is not supported on QLogic mezzanine adapters Important notes for configuring boot over SAN Consider the following points when configuring boot over SAN on HBAs or Fabric Adapter ports configured in HBA mode B BIOS must be enabled on all adapter port instances that can see the boot LUN m The same discovery mechanism configured through the BIOS Configuration Utility BCU or HCM such as First LUN Fabric Discovered Auto or Flash Values should be used for all adapter port instances exposed to the boot LUN W f multiple storage ports with unique PWWNS are configured to access the same boot LUN in the storage array and all PWWNS are zoned to a specific adapter port instance then all of these PWWNs must be listed under Boot
164. anager BOFM and the BR 1867 adapter supports Open Fabric Manager OFM For more information refer to BladeCenter Open Fabric Manager BOFM on page 66 This section describes the features associated with all models of the following types of QLogic BR Series Adapters W Fabric Adapters Refer to the following subsections depending on your configured port mode and SFP transceiver configurations C General adapter management on page 64 LJ CNA management on page 65 for ports configured in CNA or NIC modes C Host bus adapter management on page 68 for ports configured in HBA mode NIC management on page 68 for ports configured in NIC mode QO Fabric Adapter management on page 65 WB CNAs Refer to the following subsections C General adapter management on page 64 C CNA management on page 65 W Host bus adapters Refer to the following subsections C General adapter management on page 64 63 BR0054504 00 A 1 Product Overview Adapter management features QO Host bus adapter management on page 68 HCM hardware and software requirements Following are the minimum requirements to support HCM W Single processor or multiprocessor server or workstation W Pentium III with 450 MHz or equivalent or greater for Windows Linux Red Hat Novell Solaris x86 Sun Ultra 60 for Solaris SPARC At least 256 Mb of physical RAM 512 Mb recommended Video card capable o
165. and press Enter When the Please choose the driver update medium prompt displays install the CD or USB drive containing the driver update disk that you created in Step 3 You must load the QLogic BR Series Adapter driver at this stage so that the system can access the boot LUN for Linux installation If you are installing SLES 11 drivers for HBAs and Fabric Adapter ports configured in HBA mode only drivers are located on the SLES product CD You do not have to use the SLES driver update disk to install drivers unless the appropriate driver is not detected on the product CD Select the drive where the driver update disk is loaded then press Enter The driver update loads to the system If the driver update was successful a Driver Update OK message displays 223 BR0054504 00 A 4 Boot Code Boot over SAN 10 11 Press Enter If the system prompts you to update another driver select BACK and then press Enter When the Make sure that CD number 1 message displays insert the SLES product CD 1 into the drive and select OK Continue responding to on screen instructions and refer to your system documentation as necessary to format and complete installation on the target boot LUN After SLES installs on the remote LUN the system should automatically reboot from the LUN Installing RHEL 6 x or Oracle Linux OL 6 x and the driver Use the following steps to install RHEL 6 x or OL 6 x and the adapte
166. and up adapters These are low profile MD2 form factor PCI Express PCle cards measuring 16 76 cm by 6 89 cm 6 6 in by 2 71 in that install in PCle connectors in standard host systems B Mezzanine adapters These are smaller cards that mount on server blades that install in blade system enclosures The enclosures contain other system blades such as switch and pass through modules CNA ports connect to a switch that supports Data Center Bridging DCB CNAs combine the functions of a host bus adapter and Network Interface Card NIC on one PCle x8 card The CNAs even appear as network interface cards NICs and Fibre Channel adapters to the host These CNAs fully support FCoE protocols and allow Fibre Channel traffic to converge onto 10 Gbps Data Center Bridging DCB networks FCoE and 10 Gbps DCB operations run simultaneously The combined high performance and proven reliability of a single ASIC design makes these CNAs ideal for connecting host systems on Ethernet networks to SAN fabrics based on QLogic Fabric or M Enterprise operating systems 9 BR0054504 00 A 1 Product Overview Converged Network Adapters Stand up adapters Stand up type CNAs such as the BR 1020 are low profile MD2 form factor PCI Express PCle cards that install in standard host computer systems Figure 1 2 on page 10 illustrates major components of the BR 1020 stand up CNA with two fiber optic small form factor pluggable SFP transceivers installed
167. ands 133 software installation options 87 scripts 78 software installation options 81 software installation packages 83 software installer 77 81 87 command options 124 command overview 121 software installer commands examples 127 important notes 125 using 120 software installer script 87 software ISO file 82 89 software packages 81 software uninstaller commands 134 software utilities 77 SoL support 13 Solaris systems enabling jumbo frames 352 install and remove software with install script 154 installing on boot LUN 227 manually removing driver 156 modifying agent operation 184 storage driver configuration parameters 331 upgrading driver 157 SRB 32 stand up adapters installation 96 stand up adapters replacing 102 safety information 305 stateless boot with ESXi 202 storage driver 76 configuration parameters 324 instance specific persistent parameters 319 storage driver configuration parameters Linux and VMware 324 Solaris 331 Windows 328 storage support CNA 17 Fabric Adapter 8 HBA 27 support save differences between HCM BCU and browser 317 using BCU 316 using BCU on ESX systems 316 using the feature 313 using through browser 317 using through HCM 315 using through heartbeat failure 317 synthetic Fibre Channel ports 34 T target rate limiting 37 target rate limiting TRL 37 60 TCP segmentation offload 46 BR0054504 00 A Installation Guide BR Series Adapters team VMQ support 46 teaming 41 teamin
168. ansceivers W Single port model 16 Gbps Fibre Channel SFP transceiver 10GbE SFP transceiver or without optics W Dual port model Two 16 Gbps Fibre Channel SFP transceiver two 10GbE SFP transceivers or without optics Although adapters may ship with specific optics or no optics installed you can replace with compatible optics such as 8 Gbps FC SFP transceivers long wave SFP transceivers and SFP direct attach copper cables Refer to Hardware compatibility on page 5 for more information Note that the following illustration is representative and may have minor physical differences from the card that you purchased 1 BR0054504 00 A 1 Product Overview Fabric Adapters 1 LEDs for port 1 SFP transceiver 2 Cable connectors for port 1 and port 0 SFP transceiver Fiber optic SFP illustrated 3 LEDs for port 0 SFP transceiver 4 Low profile mounting bracket Note The adapter ships with the standard full height mounting bracket installed 5 PCle x8 connector 6 ASIC Figure 1 1 BR 1860 Fabric Adapter heat sink removed Use only Brocade branded SFP laser transceivers supplied with stand up Fabric Adapters 2 BR0054504 00 A 1 Product Overview Fabric Adapters AnylO technology Although the BR 1860 can be shipped in a variety of SFP transceiver configurations you can change the port function to the following modes using the QLogic AnylO technology provided the c
169. apter C Linux and Solaris systems opt brocade adapter W X To launch the installer in silent mode you must use and provide values for the following parameters CQ DCHOSEN INSTALL SET L i silent B lomake sure that the drivers and adapter boot code are synchronized be sure to update your adapter with the latest boot image from after you install or update adapter driver packages using the following steps 1 Go to the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 3 Click the Boot Code link at the top of the page to direct you to the boot code packages 4 Locate the boot code package for your adapter in the table click on it and then follow the directions 5 Refer to Boot code updates on page 189 for instructions to install the boot code image 126 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Windows systems The following installation notes pertain to Windows systems only On Windows XP Vista and NT 2000 and Server 2003 only the GUI will install for all DCHOSEN INSTALL SET values DRIVER GUI or BOTH For Windows systems installing the management utilities creates a QLogic BCU desktop shortcut on your system desktop Select this to open a Command Prompt window
170. apter with the latest boot code image To download boot code use the following steps 1 Go to the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 3 Click the driver or boot code link at the top of the page to direct you to the driver or boot code packages 4 Locate the driver or boot code package for your adapter in the table click on it and then follow the directions 72 BR0054504 00 A 1 Product Overview Host operating system support Fibre Channel support The following operating systems support Fibre Channel operation for host bus adapters and for Fabric Adapter ports configured in HBA mode Windows Server 2008 R2 SP1 x64 Windows Server 2012 x64 Windows Server 2012 R2 x64 Windows SBS 2011 x64 Microsoft Hypervisor refer to Table 1 8 Linux RHEL 5 7 5 8 5 9 5 10 6 2 6 3 6 4 and 6 5 x86 and x64 Linux SLES 10 3 10 4 11 1 and 11 2 x86 and x64 and 11 3 Citrix XenServer 5 6 6 0 and 6 1 x64 Solaris 11 x64 and SPARC ESXi 5 0 5 1 x64 and 5 5 Oracle Linux OL 5 9 5 10 6 4 and 6 5 x86 and x64 Oracle VM 3 0 FCoE support The following operating systems support FCoE operation for QLogic CNAs and Fabric Adapter ports configured in CNA mode Windows Server 2008 R2 SP1 x64 Windows Server 201
171. apters that you can install on a compute node or in the system chassis varies according to the type of chassis that you are using because each type of chassis may support a different number of compute nodes For additional compatibility information see the installation user and interoperability guides provided for the compute node and the system chassis m Use only driver update disk version 3 0 3 0 or later for compute nodes with the BR 1867 Fabric Adapter installed m Use only driver update disk version 3 2 1 0 or later for compute nodes with the BR 1869 Fabric Adapter installed 26 BR0054504 00 A 1 Product Overview Adapter features PCI express connections The QLogic Fibre Channel host bus adapters are compatible in PCI express PCle connectors with the following specifications x8 lane or greater transfer interface Gen1 PCI Base Specification 1 0 1 01a and 1 1 Gen2 PCI Express Base Specification 2 0 Gen3 PCI Express Base Specification 3 0 Install host bus adapters in PCI express PCle connectors with an x8 lane transfer interface or greater for best performance You cannot install host bus adapters in PCI or PCIx slots Storage systems Using QLogic host bus adapters you can connect a server host system to a Fibre Channel SAN in a switched fabric and point to point topology or directly to a storage array in a point to point topology Adapter features QLogic BR Series Adapters support the followin
172. ard Ethernet LAN switch m Ports configured in HBA mode support Fabric OS and connect to SANs through fabric switches or connect directly to Fibre Channel storage arrays W Ports configured in NIC mode fully support the Ethernet protocol and connect directly to the Ethernet LAN Storage systems Using Fabric Adapter ports configured in HBA mode you can connect a server host system to a Fibre Channel SAN in a switched fabric and point to point topology or directly to a storage array in a point to point or Fibre Channel Arbitrated Loop FC AL topology Using Fabric Adapter ports configured in CNA mode you can connect a server host system to a Fibre Channel SAN through connection with a switch that supports Data Center Bridging DCB 8 BR0054504 00 A 1 Product Overview Converged Network Adapters Converged Network Adapters Table 1 3 describes available QLogic FCoE PCle Converged Network Adapters CNAs for PCle x8 host bus interfaces hereafter referred to as QLogic CNAs These adapters provide reliable high performance host connectivity for mission critical SAN environments Provided in the table are the model number port speed number of ports and adapter type for each CNA Table 1 3 QLogic Fibre Channel CNAs Model number Port speed Number of ports Adapter type BR 1007 10 Gbps maximum 2 Mezzanine BR 1020 10 Gbps maximum 2 Stand up BR 1741 10 Gbps maximum 2 Mezzanine Two types of CNAs are available m St
173. as been successfully installed v Installing Driver location Q Install Complete CiWindowslsystem32Ydrivers Driver installation log location C Users Administrator brocade brocade_install log VLAN Team configuration save SUCCESSFUL BCU installation SUCCESSFUL HCM Agent installation SUCCESSFUL xl InstallAnywhere by Macrovision Cancel Previous Figure 3 6 Install Complete screen The adapter software version displayed in the preceding screen will vary according to the version you are installing 15 Confirm that all software installed successfully If the screen instructs you to restart or reboot the system select any options that apply 16 Select Done 17 Verify installation using tools available on your host system Refer to Confirming driver package installation on page 171 for details 119 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer 18 To make sure that the drivers and adapter boot code are synchronized be sure to update your adapter with the latest boot image from the QLogic Web Site at http driverdownloads glogic com whenever you install or update adapter driver packages Refer to Boot code updates on page 189 for instructions to install the boot image Installing adapter software creates a QLogic BCU CLI desktop shortcut on your system desktop Use this shortcut instead of other methods to launch the BCU gt command prompt and en
174. ating in HBA mode connected to 16 Gbps Brocade switches running FOS 7 1 and later CQ FEC is not supported when on host bus adapter ports operating in loop mode or in direct attach configurations Interrupt Coalescing This feature provides a method to delay generation of host interrupts and thereby combines coalesce processing of multiple events This reduces the interrupt processing rate and reduces the time that the CPU spends on context switching You can configure the following parameters per port to adjust interrupt coalescing Q Interrupt time delay There is a time delay during which the host generates interrupts You can increase this delay time and thereby coalesce multiple interrupts events into one This results in fewer interrupts for interrupt events Q Interrupt latency timer An interrupt is generated when no new reply message requests occur after a specific time period You can adjust this time period and thereby minimize I O latency 56 BR0054504 00 A 1 Product Overview Adapter features I O Execution Throttle This feature allows you to set maximum Fibre Channel Protocol FCP exchanges for a port to reduce the number of exchanges on the link and prevent a queue full error status back to the initiator Use this feature in cases where target devices have a known small queue depth value to prevent SCSI queue full conditions You can configure clear and query FCP exchange values for a specific PCI function o
175. ation method select the graphical mode Installation messages display followed by a welcome screen Follow on screen prompts to continue and accept the license agreement If prompted for Installation Options select Complete Server install formatting installation hard disks Select your keyboard type when prompted When prompted to load custom drivers insert the Fibre Channel Driver CD or USB drive into the host system You must load the QLogic BR Series Adapter driver at this stage so that the system can access the boot LUN for VMware installation After adding drivers to the list you are prompted to reinsert the ESX 5 1 OS disk into the host system Reinsert the ESX disk and follow prompts to load the drivers Continue responding to on screen instructions to configure the system for installing ESX For detailed instructions refer to the Server Installation and Upgrade Guide for your operating system version 230 BR0054504 00 A 4 Boot Code Boot over SAN 12 13 14 When prompted for a location to install ESX be sure to select the boot LUN that you have configured as a bootable device from the list of discovered storage targets Continue responding to system prompts complete configuration and installation on the boot LUN When you reboot the system be sure to set up BIOS to boot from the LUN where you installed ESX Installation on systems supporting UEFI The newer IBM and Dell systems can ope
176. ation utility m To save the configuration press the Alt and S keys B To exit without saving press the Alt and Q keys Using UEFI setup screens When using UEFI systems or boot mode use these general steps to configure PXE boot using your system UEFI setup screens Note that this section only provides general steps for configuring network boot Refer to your system s documentation or online help for details on using your system s UEFI setup utility When you change a setting on a UEFI setup screen the setting is saved to the adapter whenever you change to a new screen within the adapter configuration or close the utility Changes are effective even before you explicitly save them Power on the host system Access your system setup hardware setup or hardware management menus Depending on your system you may access these menus by booting the system and pressing the F2 key Dell systems or F1 key IBM systems when prompted for configuration or setup 199 BR0054504 00 A 4 Boot Code Network boot g Access screens for system setup Dell systems or system settings IBM systems Select the QLogic CNA or Fabric Adapter with port configured in CNA or NIC mode that you want to configure Access the Port Configuration screen for the port Note the following OnIBM systems port selection and port configuration will be available under a Network menu option B QLogic CNA ports or Fabric Adapter ports configure
177. atistics display Historical statistics Data Center Bridging management HCM and BCU provide the provides the following functions for CNAs and for Fabric Adapter ports configured in CNA mode DCB port statistics DCB statistics FCP IM Module statistics Historical statistics Ethernet management HCM and BCU commands provide the provide the following functions for CNAs and for Fabric Adapter ports configured in CNA or NIC modes Teaming configuration Ethernet port statistics display VNIC statistics display VLAN configuration VLAN statistics display Ethernet logging level configuration VLANs over teaming configuration Persistent binding configuration NIC teaming and VLAN statistics monitoring Preboot eXecution Environment PXE boot configuration BladeCenter Open Fabric Manager BOFM The BR 1007 CNA and BR 1867 host bus adapter BIOS and UEFI boot code support Advanced Management Module AMM connectivity for configuring SAN and LAN connections SAN target selection and WWN virtualization The BR 1007 CNA also supports BladeCenter Open Fabric Manager BOFM and the BR 1867 adapter supports Open Fabric Manager OFM For more information refer to the User s Guide shipped with your adapter 66 BR0054504 00 A 1 Product Overview Adapter management features For CNAs BOFM support in the QLogic BR Series Adapter Option ROM expects non zero values for both PWWN and NWWN for the FCoE port If any of these values ar
178. bling BIOS When enabled the system BIOS can execute the BIOS code to boot over SAN W X Setting port speed on HBAs and Fabric Adapter ports configured in HBA mode If saved on the adapter during legacy BIOS configuration enabling or disabling BIOS and setting the port speed will apply if UEFI is enabled on the system 204 BR0054504 00 A 4 Boot Code Boot over SAN Review adapter properties such as the following QO Port speed PWWN O NWWN OY BIOS version Select a boot device from discovered targets Enable one of the following boot LUN options These legacy BIOS options configured on the adapter when using the BIOS Configuration Utility CLI or HCM are only applicable when configured in Legacy BIOS mode on a UEFI capable or non UEFI capable system Q Fabric Discovered also known as fabric based boot LUN Discovery When enabled boot information such as the location of the boot LUN is provided by the fabric refer to Fabric based boot LUN discovery on page 234 for more information Fabric Discovered is not supported for booting from direct attached Fibre Channel targets C First LUN The host boots from the first LUN visible to the adapter that is discovered in the fabric C Flash Values Boot LUN information will be obtained from flash memory Note that values are saved to flash when you configure and save them through the BIOS Configuration Utility and BCU To boot from direc
179. bout the adapter and makes it available to an SNMP network management station When active the management station can get information or set information when it queries the agent The agent uses variables also known as managed or MIB objects to report data such as the following Model number Type of adapter Serial number Current status Hardware version Port statistics VLAN attributes and statistics 67 BR0054504 00 A 1 Product Overview Adapter management features H Team attributes and statistics The SNMP master agent also sends unsolicited messages called traps to the manager These traps generated by the QLogic SNMP subagent are for network adapter conditions that require administrative attention Adapter traps included notification of VLANs added or removed team members added or removed team failover failback team added and team removed and port link up and link down events All managed objects are contained in the MIB provided by the adapter For details on MIB groups and objects supported by QLogic BR Series Adapters refer to B MIB Reference NIC management Ports on Fabric Adapters only can be set to operate in NIC mode These ports appear as 10 GbE NICs to the host operating system BCU commands and HOM provide features for configuring troubleshooting and monitoring NIC connections to the Ethernet LAN For an overview refer to Ethernet management on page 66 For details refer to the QLogic BR Se
180. c based boot LUN discovery if needed Boot host systems without operating systems or remote drives if needed Appendix A Optional instructions for expert users Configure instance specific and driver level parameters to control adapter operation Figure i Installing adapters using this document Related Materials For information about downloading documentation from the QLogic Web site see Downloading Updates on page xx xvii BR0054504 00 A Installation Guide BR Series Adapters Preface What Is in this Guide Documentation Conventions This guide uses the following documentation conventions NOTE provides additional information CAUTION without an alert symbol indicates the presence of a hazard that could cause damage to equipment or loss of data Text in blue font indicates a hyperlink jump to a figure table or section in this guide and links to Web sites are shown in underlined blue For example Q Table 9 2 lists problems related to the user interface and remote agent Q See Installation Checklist on page 6 Q For more information visit www glogic com Text in bold font indicates user interface elements such as command names keywords operands and text to enter in the GUI or CLI For example C Click the Start button point to Programs point to Accessories and then click Command Prompt CQ Under Notification Options select the Warning Alarms check box Te
181. cast MAC addresses to be added to the UCAM filter in ASIC This allows the driver to receive packets with these addresses as destination MAC addresses The new MACVLAN virtual interface is created using the ip command This interface can be used like any other interface on the system to configure IP and run network traffic Link aggregation NIC teaming A network interface team is a collection of physical Ethernet interfaces CNA ports and the Fabric Adapter port configured in CNA or NIC mode acting as a single interface Teaming overcomes problems with bandwidth limitation and redundancy often associated with Ethernet connections Combining aggregating ports can increase the link speed beyond the limits of one port and provide redundancy For Windows Server 2012 the BNI driver is not installed because teaming and VLAN are natively supported by the Windows 2012 operating system 41 BR0054504 00 A 1 Product Overview Adapter features For Windows systems you can team up to eight ports across multiple CNAs and Fabric Adapter ports configured in CNA or NIC mode in three modes failover failback or 802 3ad using BCU commands and HCM dialog boxes To determine the maximum ports that you can team with other systems refer to your operating system documentation Note that HCM only supports teaming configuration for Windows systems m Failover mode provides fault tolerance Only one port in a team is active at a time prima
182. cation InstallAnywhere by Macrovision Cancel Previous i Figure 3 4 Choose Install Set screen 11 Select which software you want to install and then select Next If you are installing the management utilities and warnings display that the HCM Agent requires storage and network driver installation or does not match the current driver installation click OK and select the Management Utilities and Storage and Network Drivers options 117 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer 12 Ifthe Choose Install Folder screen displays prompting you to choose a destination folder for the software select one of the following options If this screen does not display proceed to Step 13 W Enter a location for installing the software where the default installation folder displays W Select Choose to browse to a location on your file system B Select Restore Default Folder to enter the default installation folder 13 When the Package Location Information screen displays listing the installed software components and their locations on your system select Next to continue 14 When the Pre Installation Summary screen displays Figure 3 5 review the information and select Install to confirm and begin the installation X2 Brocade Ad oter Software Installer Ci xj 23 Pre Installation Summary v Introduction Please Review the Following Before Continuing v License Agreement v
183. cation Not supported FDMI Not supported Only the Leadville based storage driver supported Oracle Linux B BR 1867 adapter Supported B BR 1007 adapter Not supported 62 BR0054504 00 A 1 Product Overview Adapter management features Adapter management features The Host Connectivity Manager HCM and QLogic Command Line Utility BCU are the primary management tools for host bus adapters CNAs and Fabric Adapters You can install HCM as an optional application through the QLogic Adapter Software Installer QASI BCU automatically installs with the driver package This section summarizes some of the features available with these tools for managing CNAs host bus adapters and Fabric Adapters The Brocade Network Advisor also provides management features for adapters such as adapter discovery in context launch of HCM authentication and other features Refer to the Brocade Network Advisor SAN User Manual for more details Simple Network Management Protocol provides an industry standard method of monitoring and managing CNAs and Fabric Adapter ports configured in CNA or NIC mode Refer to Simple Network Management Protocol on page 67 for details For the BR 1007 CNA and the BR 1867 host bus adapter BIOS and UEFI boot code support Advanced Management Module AMM connectivity for configuring SAN and LAN connections SAN target selection and WWN virtualization The BR 1007 CNA also supports BladeCenter Open Fabric M
184. compliance This section provides international environmental and safety compliance notices for QLogic BR Series Adapters Environmental Protection Use Period EPUP Disclaimer In no event do the EPUP logos shown on the product and FRUs alter or expand that warranty that QLogic provides with respect to its products as set forth in the applicable contract between QLogic and its customer QLogic hereby disclaims all other warranties and representations with respect to the information contained on this CD including the implied warranties of merchantability fitness for a particular purposes and non infringement The EPUP assumes that the product will be used under normal conditions in accordance with the operating manual of the product IEE HAPE EPUP 46 50 75 HA EPUP a EP A FRU OA CEP th ASS Brocade Brie HP th PERAK CRTR E AR AE Brocade A HUS P fa ET x H3 Ale PE METTRE GET IG CD Et BHO WERE FDSPROEHDR TSIH PEAR PERS PRUE Br ocade 1E JC E FS HY As Zr Rp T 5 EXSfe ASS BS PEE ECT DRSUEARI ESSE A f vi o EPUP BRE PERE FAL PEIE IAE FEH A m o 302 BR0054504 00 A 5 Specifications Regulatory compliance China RoHS The contents included in this section are per the requirements of the People s Republic of China Management Methods for Controlling Pollution by Electronic Information products AS SE AER HF RoHS A8 rpm B A ARES T RAE BSE AER CH ee BNE BK
185. configured to communicate over specific teams using BCU commands and HCM The function of the VLAN over a team is the same as a VLAN on a single port A team can support up to 64 VLANs and the VLANs should have the same MAC address as the team Changing a team s MAC address changes the address of VLANs over the team Changing the team name adds the name to the prefix of the VLAN s display name For Windows Server 2012 the BNI driver is not installed because teaming and VLANs are natively supported by the Windows 2012 VLANs on teams are supported on Linux Solaris and VMware but are implemented by the specific operating system vendor For more details on teaming refer to Link aggregation NIC teaming in this section For more information on VLANs refer to VLAN IEEE 802 1Q standard in this section 47 BR0054504 00 A 1 Product Overview Adapter features VLAN and Teaming Configuration Persistence VLAN and teaming configurations can be maintained when updating drivers Configurations are automatically saved during upgrade and can be restored using BCU commands or HCM VMware NetQueue This feature improves performance in 10 GbE virtualized environments by providing multiple receive and transmit queues which allows processing to be scaled to multiple CPUs The QLogic BR Series Adapter network driver CNAs only supports receive Rx as well as transmit Tx NetQueues This feature requires MSI X support on host syst
186. covery from a malfunction is a big advantage following are considerations for the host and adapter depending on the replacement situation B Even though you install a similar host the new host may require unique System BIOS options and other settings or internal IDE drives may need to be disconnected or disabled to boot over SAN W lIfreplacing the QLogic BR Series Adapter in a host with a similar QLogic BR Series Adapter you will need to reconfigure the adapter and storage to boot from the appropriate remote boot device You must also update access on storage device ports to reflect the adapter PWWN Finally you must update the single initiator target zone created for the adapter port and storage device port with the new adapter PWWN W f replacing a host with a different model you may be prompted to install the adapter driver for the existing adapter Booting servers from SAN attached storage can significantly streamline server administration and facilitate server deployment Instead of manually configuring each individual server boot images on SAN attached storage can be cloned and assigned to groups of servers at the same time This not only simplifies initial configuration but makes ongoing software updates and maintenance much easier to administer When boot images are centrally managed on the SAN server security integrity and ability to recover data are also enhanced Following are additional benefits of boot over SAN W
187. ct to the following two conditions 1 this device may not cause harmful interference and 2 this device must accept any interference received including interference that may cause undesired operation Changes or modifications not expressly approved by QLogic for compliance could void the user s authority to operate the equipment This equipment has been tested and found to comply with the limits for a Class B digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference in a residential installation This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not occur in a particular installation If this equipment does cause harmful interference to radio or television reception which can be determined by turning the equipment off and on the user is encouraged to try and correct the interference by one or more of the following measures W X Heorient or locate the receiving antenna B increase the separation between the equipment and receiver B Connect the equipment into an outlet on a circuit different from that to which the receiver is connected W Consult the dealer or an experienced radio TV technician for help 298 BR0054504 00 A 5 Specifications Regu
188. d FCoE activity 1 1 second on 1 second off 2 50 msec on 50 msec off 275 BR0054504 00 A 5 Specifications Fabric Adapters Environmental and power requirements This section provides environmental and power specifications for BR 1860 standup Fabric Adapters These are low profile MD2 form factor PCI Express PCle cards measuring 16 751 cm by 6 878 cm 6 595 in by 2 708 in that install in PCle connectors in standard host systems Table 5 11 lists environmental and power specifications for the stand up type Fabric Adapters Table 5 6 Environmental and power requirements Property Requirement Airflow 45 LFM Operating altitude 3 048 meters 10 000 ft at 40 C 104 F Nonoperating altitude 12 192 meters 40 000 ft at 25 C 77 F Operating temperature 0 C to 55 32 F to 131 F dry bulb Nonoperating temperature 42 C to 73 C 40 F to 163 F Operating humidity 5 to 93 relative noncondensing Nonoperating humidity 5 to 95 relative noncondensing Power consumption 9 W typical with SFP transceiver running 16 adapter and optics Gbps traffic Operating voltage 12V 276 BR0054504 00 A 5 Specifications Converged Network Adapters Converged Network Adapters Two types of CNAs are available m Stand up adapter B Mezzanine adapter The QLogic stand up CNAs are low profile MD2 form factor PCI Express PCle cards measuring 6 60 in by 2 71 in 16 77 cm by 6 89 cm CNAs are
189. d VMware it is implemented by the specific operating system vendor Configuration is also required on the switch for NIC teaming to function Refer to the Brocade Fabric OS Administrator s Guide for details 42 BR0054504 00 A 1 Product Overview Adapter features MAC and VLAN filtering and tagging A mechanism that allows multiple networks to transparently share the same physical network link without leakage of information between networks Adapter hardware filters data frames from devices on a LAN so that only frames that match the MAC and VLAN for the configured LAN are forwarded to that LAN Multiple transmit Tx priority queues Support for multiple transmit priority queues in the network driver allows the driver to establish multiple transmit queues and specific priorities in the ASIC This feature enables QLogic CNAs and Fabric Adapter ports configured in CNA mode to pass link layer traffic using multiple transmit priorities without interfering with the assigned priority for the FCoE or iSCSI traffic on the same port This also allows handling of FCoE or iSCSI priority changes propagated from the DCB switch Multiple traffic priorities are used to ensure that Quality of Service QoS is guaranteed across different traffic classes The driver supports one transmit queue on CNAs and eight on Fabric Adapters If multiple vNICs are configured on a Fabric Adapter each vNIC instance has its own set of eight Tx queues To configure mu
190. d as a component of other setup and recovery technologies WinPE is supported by QLogic Windows Server 2008 R2 network and storage drivers Windows Server 2008 R2 and later Red Hat Enterprise Linux RHEL SUSE Linux Enterprise Server SLES VMware ESX Server Solaris and Oracle Linux OL For more details refer to Host operating system support on page 70 Windows Server Core a minimal server option for Windows Server 2008 R2 operating systems that provides a low maintenance server environment with limited functionality All configuration and maintenance is done through command line interface windows or by connecting to a system remotely through a management application Windows 7 Windows 7 x86 is supported by Windows Server 2008 R2 x86 drivers Windows 7 x64 is supported by Windows Server 2008 R2 x64 drivers Windows Server 2012 FCoE features CNAs and Fabric Adapter ports configured in CNA mode support the following Fibre Channel over Ethernet FCoE features For limitations and considerations for feature support for specific operating systems refer to Operating system considerations and limitations on page 61 500 000 IOPS per port for maximum Il O transfer rates 10 Gbps throughput per port full duplex Boot over SAN 34 BR0054504 00 A 1 Product Overview Adapter features This feature provides the ability to boot the host operating system from a boot device located somewhere on the SAN instead o
191. d column and then click Go 3 Clickthe link at the top of the page to direct you to the software package that you want 4 Locate the software package for your adapter in the table click on it and then follow the directions 92 BR0054504 00 A 1 Product Overview Using BCU commands Using BCU commands Some procedures in this manual reference BCU commands for adapter monitoring and configuration To use BCU commands enter commands at the BCU command prompt For Windows systems installing the management utilities creates a QLogic BCU desktop shortcut on your system desktop Select this to open a Command Prompt window in the folder where the BCU commands reside You then run enter full BCU commands such as bcu adapter list or enter bcu shell to get a bcu gt prompt where only the command adapter list is required Launching BCU on Windows systems through methods other than through the desktop shortcut is not recommended and may result in display of inconsistent information To list all the commands and subcommands type the following command bcu help To check the CLI and Driver version number type the following command bcu version To launch a BCU command at the BCU gt prompt enter the command as in the following example BCU gt port list For complete details on BCU commands refer to the QLogic BR Series Adapter Administrator s Guide VMware ESXi 5 0 and later systems For VMware E
192. d in CNA or NIC mode appear as individual network interface cards NIC to your host system Access NIC Configuration options Configure the following options m Enable PXE boot W Enter a VLAN ID for the port to be used during network boot Enter a value from 0 through 4094 If you wish to display and configure settings such as IP address and subnet mask access the network settings page for the port NIC device Save your settings and exit the setup utility Using HCM or BCU commands You can enable or disable PXE BIOS on a specific adapter port for booting over the network and configure a VLAN ID for the port to be used during network boot using HCM dialog box options and BCU commands Configuring PXE BIOS using HCM To configure BIOS using HOM perform the following steps 1 Select one of the following in the device tree m CNA m CNA port W Fabric Adapter port configured in CNA or NIC mode Select Configure gt Basic Port Configuration to display the Basic Port Configuration dialog box Select the PXE Boot tab to display network boot parameters 200 BR0054504 00 A 4 Boot Code Network boot 4 Perform any or all of the following actions as appropriate for your needs B Click the PXE Boot enable check box to enable or disable BIOS You must enable BIOS to support network boot for an adapter port If disabled the host system cannot boot from network systems The default setting for the adapter boot
193. d on the installed adapter The Auto Select option allows the adapter port to automatically negotiate link speed with the connected port Port speed options are only applicable to HBAs or Fabric Adapter ports configured in HBA mode CNAs or Fabric Adapter ports configured in CNA or NIC mode are set to Auto Select Set the Port Topology to one of the following B Loop for Fibre Channel Arbitrated Loop FC AL topology m P2P for point to point P2P topology Determine LUN Mask state LUN Mask displays the enabled or disabled status of LUN masking for the port Enable or disable LUN masking using BCU commands or HCM For more information on LUN masking refer to the LUN Masking paragraph under Host bus adapter features on page 49 Enable or disable the QOS State This option is only applicable to Fabric Adapter ports configured in HBA mode When enabled you can set bandwidth percentages for high medium and low priority The sum of all bandwidths must be equal to 100 percent Also high priority bandwidth must be greater than medium priority bandwidth settings and medium priority bandwidth must be greater than low priority bandwidth settings For more information on QoS for HBA ports refer to the Quality of Service QoS paragraph under Host bus adapter features on page 49 258 BR0054504 00 A 4 Boot Code Configuring UEFI Fabric Adapter configuration support Options to configure the port mode and create and ma
194. daag Press C to clear the selection Press M to Manually edit the values lt ESC gt Go back lt ENTER gt Select and configure Down Nauigate _ lt Alt O gt Exit lt Alt S gt Save and exit iat tARI SRL CER igo va Tubo Figure 4 9 BIOS Configuration Menu Boot Device Settlings 251 BR0054504 00 A 4 Boot Code Configuring BIOS with the BIOS Configuration Utility 8 Use the Up and Down arrow keys to select a boot device and then use one of the following options to configure boot device settings ES Press C to clear a selected boot device from the list WB Press M to manually edit boot device information and then enter the PWWN and LUN values for the boot device Press M to exit When editing boot device information you must complete the entire value before pressing M or the configuration will reset to the previous value For example if you edit part of a PWWN and then press M the PWWN will return to the previous value W Select a device and press Enter This displays additional screens that allow you to select discovered LUNs as boot devices If you select a device under Boot Device Settings and press Enter a screen similar to the one in Figure 4 10 displays listing all discovered boot targets Select Boot Target DID UendorID Product ID 1 21 60 00 20 37 DE C3 2E 0102EF NETAPP X225 ST3367084FC 2 50 06 GE 860 10 03 4A 96 810800 HITACHI DF6G0F lt ESC gt Go back lt ENTER gt Select and config
195. dapter lt version gt the application version such as v3 0 131 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer b Enter the following command to launch the QLogic Adapter Software Uninstaller sh Uninstall sh 2 When an Introduction message displays about the uninstall click Next 3 Ifa message displays prompting you to close HCM close the application if it is running and then click OK on the message box 4 When the Uninstall Options screen displays Figure 3 7 with uninstall options select an option W Select Complete Uninstall to remove the driver packages and all other installed QLogic BR Series Adapter software components W Select Uninstall Specific Features to selectively uninstall specific software components X2 Uninstall BROCADE Adapter Software CE x1 2 Uninstall Options Q Introduction Please select one of the following options Complete Uninstall Completely remove all features and components of Brocade Adapter Software that were installed by InstallAnywhere Files and folders created after the installation will not be affected A Uninstall Specific Features e Choose specific features of Brocade Adapter Software that were installed by InstallAnywhere to be uninstalled Install nywhere by Macrovision i i Cancel Previous Fi
196. dapter Support Using Support Save 318 BR0054504 00 A A Adapter Configuration Introduction Information in this appendix is optional for power users who want to modify values for adapter instance specific persistent and driver level configuration parameters Rely on your operating system or storage vendor for guidance Storage driver parameters can be modified for HBA CNA and Fabric Adapter in HBA CNA or NIC port modes Network driver parameters can be modified only for CNA or Fabric Adapter in HBA CNA or NIC port modes Storage instance specific persistent parameters Instance specific persistent configuration parameters for storage drivers with valid value ranges are listed in Table A 1 You can change these values using the BCU commands provided in the table These parameters are stored in the following locations on your system m Linux and VMware etc bfa conf m Solaris kernel drv bfa conf m Windows Windows registry under the following registry hives For the HBA FC driver Windows registry is HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services bfad Para meters Device For the CNA FCoE driver Windows registry is HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services bfadfcoe Parameters Device Values for these parameters should not be changed in the repository directly instead use the corresponding BCU commands listed in Table A 1 319 BR0054504 00 A A Adapter Configuration Storage instance specific persiste
197. dapter hardware specifications Feature Description Port speeds W 10 312 Gbps for installed 10GbE SFP transceiver W 16 8 or 4 Gbps and auto negotiated speeds per port for installed 16 Gbps Fibre Channel SFP transceivers E 8 4 2 Gbps and auto negotiated speeds per port for installed 8 Gbps Fibre Channel SFP transceivers SFP transceivers stand up Ethernet adapters M Multimode and single mode fiber optic small form factor pluggable plus SFP transceivers E Copper SFP transceiver Fibre Channel B Multimode and single mode fibre optic SFP transceiver Connectivity E Stand up adapters LC cable connectors 266 BR0054504 00 A 5 Specifications Fabric Adapters Table 5 2 Fabric Adapter hardware specifications Continued Feature Description ASIC B Provides the Fibre Channel FCoE and DCB functionality for the adapter B Two on board processors each operating at 400 MHz which coordinate and process data in both directions B Hardware acceleration for network and FCoE functions E AnylO technology for setting port operating modes to HBA Fibre Channel CNA or NIC Ethernet External serial FLASH E Stores firmware and adapter BIOS code mamony m 4 MB capacity Fibre Channel performance 500 000 IOPs maximum 1 000 000 IOPs per dual port adapter Data rate W 14 025 Gbps 1600 MB sec B 8 5 Gbps 800 MB sec W 4 25 Gbps 400 MB sec W 2 125 Gbps 200 MB sec Auto sensing per port full
198. date Manager gt Administration view 6 Attach the upgrade or patch baselines to the host you want to remediate Note the following when performing this task a Attach baselines at the data center folder cluster or host level for remediating multiple hosts at once B Attach baselines and baseline groups to objects from the Update Manager Compliance view 7 Scan the container object to view the compliance state of the hosts in the container 8 Optional Stage the extensions from the attached baselines to the ESX ESXi hosts 9 Remediate the hosts in the container object against the extension baselines During remediation phase the Update Manager will first place the host into maintenance mode so you must manually migrate or shut down virtual managers if cluster services are not capable of automated VMware placement The host will reboot and after successful installation the extension or patch should display as compliant 170 BR0054504 00 A 3 Software Installation Confirming driver package installation Upgrading drivers on VMware systems To update the driver package simply install the new driver using steps under Driver installation and removal on VMware systems on page 157 When upgrading the driver for VMware systems you must reboot the host system The new driver is effective after system reboot Confirming driver package installation Adapter driver packages from QLogic contain the current dr
199. dded Team removed Port link up event Port link down event 358 BR0054504 00 A Index A adapter boot code 80 189 event message files 81 management BCU 93 CIM Provider 81 HCM 79 software downgrading 137 upgrading 135 software installer 113 adapters 306 configuring 319 connecting to switch or storage 100 general features 27 management HCM 64 management using BCU 64 AnylO mode changing 4 description 3 arbitrated loop support 54 bandwidth minimum and maximum for vNICs 30 BCU 63 64 68 77 BCU commands using 93 using for ESX systems 93 beaconing end to end 53 359 BIOS 80 189 configuring with BIOS Utility 246 configuring with HCM and BCU 200 254 support for network boot 194 BIOS configuration utility field descriptions 250 boot code 188 189 updating 189 updating older boot code on HBAs 192 updating with BCU commands 192 updating with HCM 191 boot image 89 boot installation packages 91 boot LUN discovery 35 54 boot LUNs installing for IBM 3xxx M2 and Dell 11G systems 231 installing full driver package 233 installing image on boot LUNs 233 installing Linux RHEL 4 x and 5 x 220 installing Linux SLES 10 and 11 222 installing Linux 6 x 224 installing OEL 6 x 224 installing operating system and driver 217 installing Solaris 227 installing VMware 229 installing Windows 2008 217 BR0054504 00 A Installation Guide BR Series Adapters boot over SAN 50 configuring 211 configurin
200. del POL Bas BeurPa Mal Brocade 1828 95 8882 98 95 1E 7 kapter Settiugs BiGS Version 3 2 8 8 Mal MEC OEC SQ ESTEE LEE BIBS t Bisabled 1 IUE DH t S i to restore factory defauits s M to Maanaliy edit the valves lt ES 3 Ga back lt EMTER gt Select and conf igara lt fip Bawun gt Mavigate lt Rit Go Exit lt hit 3 gt Save and exit lt Left Right gt Change values Figure 4 2 PXE BIOS Configuration Menu Adapter Settings Change any parameters by following the instructions at the bottom of the BIOS Configuration Utility screen For example use the following keys to select and change information B Up and Down keys Scroll to a different field B ENTER Selecta field and configure values B Leftand Right arrow keys Change a value 198 BR0054504 00 A 4 Boot Code Network boot ALT S Save configuration values to adapter flash memory ALT Q Exit the utility ESC Go back a screen Page Up or Page Down Go to preceding or next screen To restore factory default settings press R Configure the following settings as required W Enable or disable BIOS to support network boot You must enable BIOS to support network boot for an adapter port If disabled the host system cannot boot from a network system The default state for Adapter ports is disabled W Enter a VLAN ID for the port to be used during network boot Enter a value from 0 through 4094 Save or exit the configur
201. depends on cable type Refer to Cabling stand up adapters on page 272 SFP transceiver for fiber optic cable Distance depends on cable type Refer to Cabling stand up adapters on page 272 SFP transceiver for fiber optic cable Distance depends on cable type Refer to Cabling stand up adapters on page 272 Switch Compatibility Any switch compatible with the adapter Any switch compatible with the adapter Any switch compatible with the adapter Any switch compatible with the adapter BR0054504 00 A 1 Product Overview Fabric Adapters PCI express connections QLogic Fabric Adapters are compatible with PCI express PCle connections that have the following specifications B x8lane or greater transfer interface Gen1 PCI Base Specification 1 0 1 01a and 1 1 Gen2 PCI Express Base Specification 2 0 Gen3 PCI Express Base Specification 3 0 Install adapters in PCI express connectors with an x8 lane transfer interface or greater for best performance You cannot install Fabric Adapters in PCI or PCI X connectors Host systems and switches Support for Fabric Adapter ports depends on the mode CNA HBA or NIC in which they are configured W X Ports on Fabric Adapters configured in CNA mode can connect to Fibre Channel SANs and Ethernet data networks through a compatible switch that supports Data Center Bridging DCB These ports can also connect to a stand
202. deployment are supported only on CNA and NIC only I O Device Management IODM For VMware events such as RSCN or link state changes are reported to the operating system for diagnoses of various storage protocol issues MultiQueue support ESXi 5 5 driver supports performance scalability features like MultiQueue This allows ESX to distribute incoming I O on these queues based on CPU affinity The use of multiple queues to send requests and get responses has the following advantages C Reduces CPU cost per I O Q Enhance the performance of storage adapter Extended storage request block SRB Windows Server 2012 uses the small computer system interface SCSI request block or SRB to relay information related to SCSI commands Windows versions prior to Windows 2012 have the following limitations C Only 16 byte command descriptor blocks CDB are supported Q There is no support for bi directional CDBs For Windows 2012 and later support is available for the following J 16 byte CDBs and greater Q Bi directional CDBs Q More than 254 I Os per LUN Q New addressing scheme Human Interface Infrastructure HII menu support These menus are integrated into the UEFI configuration browser Options in these menus allow you to enable disable and set port speed for adapter ports It supports IBM Agentless Inventory Manager AIM framework which queries some of the host bus adapter properties using a new
203. discovery is the default setting for the QLogic BIOS Boot LUN option The feature does not apply to UEFI as the UEFI stack implemented by the server vendor does not support boot LUN discovery from the fabric This automated feature requires that the connected SAN fabric switch support the Get Zone Member List GZME command Fabric Based Boot LUN Discovery has been tested with Brocade switches Fabric OS 6 2 and above and Cisco SAN switches SAN OS 3 2 x and 4 1 x Example configuration procedures are provided for Brocade fabrics following and Cisco fabrics on page 237 Fabric based boot LUN discovery is not supported for booting from direct attached targets 234 BR0054504 00 A 4 Boot Code Fabric based boot LUN discovery Configuring fabric based boot LUN discovery Brocade fabrics For Brocade fabrics the following methods are available to store the boot LUN information in the fabric zone database W Using the Fabric OS bootluncfg command to transparently configure the boot LUN W Using the BCU boot blunZone command to provide the zone name and zone members to use as operands in the Fabric OS zoneCreate command Using Fabric OS bootluncfg command Fabric based boot LUN discovery allows the host s boot LUN information to be stored in the fabric zone database by using a zone name that contains the PWWN of an HBA port The zone members consist of storage target PWWN and LUN ID The bootluncfg command provides a simp
204. dministrator s Guide for details C HOM Basic Port Configuration dialog box C BCU port bbcr enable port bbcr disable port stats and port bbcr query Boot over SAN This feature provides the ability to boot the host operating system from a boot device located somewhere on the SAN instead of the host s local disk or direct attached Fibre Channel storage Specifically this boot device is a logical unit number LUN located on a storage device For booting over SAN from direct attached storage both Fibre Channel Arbitrated Loop FC AL and point to point P2P topologies are supported Diagnostic port D Port When a switch or adapter port is enabled as a Diagnostic D Port electrical loopback optical loopback and link traffic diagnostic tests initiate on the link between the adapter and the connected switch port Results can be viewed from the switch using Fabric OS commands Results can be viewed from the adapter using BCU commands and HCM Once an adapter port is enabled as aD Port the port does not participate in fabric operations log in to a remote device or run data traffic D Port testing is supported only on BR 1860 Fabric Adapter ports operating in HBA mode with a 16 Gbps SFP and on Brocade 16 Gbps switches running Fabric OS v7 1 0 or later AD Port can be initiated in one of two modes Q Dynamic mode If the D Port is enabled on the switch only it enables the connected adapter port as a D Port
205. dows the shortcut is located under Start menu gt Brocade gt Host Connectivity Manager For Solaris launch HCM from the command prompt using the following command sh opt brocade fchba client Host Connectivity Manager 182 BR0054504 00 A 3 Software Installation HCM Agent operations HCM Agent operations This section outlines the conditions requiring you to restart the HCM Agent describes host operating system commands for controlling agent operation HCM agent restart conditions The following conditions require that you restart the HCM Agent if HCM is already active B An adapter is installed in the system when no adapters are currently installed and HCM is active m The PCI hot plug feature is activated when adding new adapters and HCM is active m For Windows systems the Adapter is disabled through Device Manager while HCM is active and then the device is enabled through Device Manager HCM agent commands Commands for controlling HCM operation are grouped in the following categories under the host operating system Verifying that the HCM Agent is running B Starting the agent B Stopping the agent E Changing the agent s default communication port The HCM Agent will not start automatically if it stops unexpectedly during operation You must restart the agent Linux and VMware systems Adapter management through the HCM Agent is only supported on ESX 4 1 systems For ESXi 4 1 5 0 and 5 1 syst
206. dth for vNICs Using BCU commands you can specify both minimum and maximum bandwidths for vNICs that guarantees that the bandwidth is available from a port for the vNICs Note that the sum of bandwidths assigned to vNICs cannot exceed the link speed For more information on configuring bandwidths for Virtual Fabric support refer to the QLogic BR Series Adapter Administrator s Guide Interrupt coalescing Interrupt coalescing keeps the host system from flooding with too many interrupts This allows the system to reduce the number of interrupts generated by generating a single interrupt for multiple packets Increasing the coalescing timer should lower the interrupt count and lessen CPU utilization Interrupt moderation Interrupt moderation implements dynamic selection interrupt coalescing values based on traffic and system load profiles Traffic is continuously monitored to place in categories between high throughput sensitive and high latency sensitive Similarly the host system is monitored regularly to place it in categories between highly loaded and minimally loaded The driver dynamically selects interrupt coalescing values based on this profiling Internet Small Computer System Interface iSCSI over DCB This feature leverages pre priority based flow control PFC and enhanced transmission selection ETS features provided by Data Center Bridging DCB to Ethernet to enable more lossless delivery of iSCSI traffic in data ce
207. e Installer automatically starts the HCM Agent You can manually start and stop the agent using the instructions under HCM Agent operations on page 183 When downgrading HCM using QASI refer to Using software installation scripts and system tools on page 138 When using the QLogic Adapter Software Installer to install HCM a Found Backed up data message displays if a backup directory exists for previously installed software This message prompts you to restore or not to restore old configuration data Refer to HCM configuration data on page 186 for more information Only one driver installation is required for all QLogic BR Series Adapters host bus adapters CNAs or Fabric Adapters installed in a host system Root or administrator privileges are required for installing the driver package The procedures in this section assume that the host s operating system has been installed and is functioning normally 109 BR0054504 00 A 3 Software Installation Installation notes Linux Following are notes that you should be aware of when installing adapter software on Linux systems After installing drivers on a Linux system you must reboot the system to enable the drivers Starting with SLES 11 SP2 the Brocade KMP packages are digitally signed by Novell with a PLDP Signing Key If your system doesn t have the public PLDP key installed RPM installation will generate a warning similar to the following warning
208. e VMware driver package from the QLogic Web Site Refer to Software installation and driver packages on page 81 for details on driver packages and download instructions 1s Copy the package to your system s tmp directory scp brocade driver esxversion driverversion tar gz path tmp From the temporary directory extract the file using the following command tar zxvf brocade driver esxversion driverversion tar gz Enter one of the following command to run the installer For ESX 4 1 systems use the following command brocade install sh u h n t where u uninstalls driver all packages utilities and HCM Agent h displays help for install script n Installs all packages without prompting t installs tools only utilities and HCM agent For ESXi 4 1 and ESXi 5 0 systems use the following command brocade install esxi sh u h n where u uninstalls driver all packages utilities and HCM Agent h displays help for install script n Installs all packages without prompting Examples To install network and storage RPMs with utilities enter one of the following commands based on your operating system brocade install sh brocade install esxi sh 159 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools B To remove the storage and network RPM and utilities enter one of the following commands based on your operating sy
209. e adapter configuration or when you close the utility Changes are effective even before you explicitly save them Using Network menu options Use the following steps to configure adapter functions using UEFI network menu options Options to configure the port mode and create and manage VNICs are only supported on QLogic Fabric Adapters for specific ports 0 or 1 when configuring from UEFI setup storage and network menus Refer to Table 12 for details Appropriate SFP FC or 10 GbE transceiver and driver packages must be installed to operate the port in the selected mode 255 BR0054504 00 A 4 Boot Code Configuring UEFI Power on the host system Access your system setup hardware setup or hardware management menus Depending on your system you may access these menus by booting the system and pressing the F2 key Dell systems or F1 key IBM systems when prompted for configuration or setup Access network screens to configure installed devices BW Forexample for IBM systems access the Network menu option on the System Settings screen B For example for Dell systems access the Network Settings screen from the Lifecycle Controller LC Settings gt Network Settings screen From the list of installed network devices select and adapter and port that you want to configure QLogic CNA ports or Fabric Adapter ports configured in CNA or NIC mode appear as individual network interface cards NIC to y
210. e blade server or server blade is turned on The adapter is installed in the appropriate connector On some blade servers or server blades connectors may only support a specific adapter type Refer to your blade sever documentation for help Whether the blade server or server blade on which the adapter is installed is correctly configured and installed in the blade system enclosure Refer to your blade server and blade system enclosure documentation for help Any modules or blades in that support adapter operation are installed in the appropriate enclosure bays and correctly configured Refer to the documentation for your blade system enclosure for help The blade system enclosure is configured for adapter operation Refer to your blade system enclosure and documentation for blade system enclosure components for help You are using the latest device drivers firmware and BIOS for the blade server or server blade and other components in the blade system enclosure that support adapter operation 179 BR0054504 00 A 3 Software Installation Installing SNMP subagent Installing SNMP subagent Simple Network Management Protocol SNMP is supported by CNAs and by Fabric Adapters for ports configured in CNA or NIC mode For more information refer to Simple Network Management Protocol on page 67 QLogic BR Series Adapter SNMP is supported through an extension to the SNMP master agent called the subagent which processes SNMP querie
211. e host and log on with Root privileges Download the appropriate tar gz file for your Linux distribution Refer to Software installation and driver packages on page 81 for a description of Linux driver packages For XenServer v6 1 download the following file brocade_driver_linux_xen61_ lt version gt tar gz Extract the driver package root xenserver my dir tar zxvf brocade driver linux xen61 v3 2 1 0 tar gz brocade bfa 3 2 1 00801 xen 6 1 0 iso brocade bfautil noioctl 3 2 1 0 0 noarch rpm brocade bna 3 2 1 00801 xen 6 1 0 iso driver bld info xml Mount the storage driver iso file root xenserver my dir mkdir iso root xenserver my dir mount o loop brocade bfa 3 2 1 0 xen 6 1 0 iso iso Change to the mount point directory root xenserver my dir cd iso List the files in the iso root xenserver my dir ls brocade bfa modules kdump 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 0 0 i1386 rpm brocade bfa modules xen 2 6 32 43 0 4 1 xs1 6 10 734 170748 3 2 1 0 0 1386 rpm install install sh XS PACK 150 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 7 10 Install the storage bfa driver root xenserver my iso install sh Installing Brocade FC HBA driver Preparing ttttt tt ttt 100 1 brocade bfa modules kdu HHtHHE 50 2 brocade bfa modules xen dESSSSS 1005
212. e installed using the following commands pkginfo grep bfa pkginfo grep bna pkginfo grep brcd util 3 Determine if the HCM Agent is running using procedures under HCM Agent operations on page 183 If it is stop the agent using steps under the same heading 156 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 4 From any directory enter the following commands to remove installed packages pkgrm bfa pkgrm bna pkgrm brcd util Respond to prompts Do you want to remove this package by entering y Respond to prompts Do you want to continue with the removal of this package by entering y After a series of messages the following confirms removal Removal of bfa was successful Removal of bna was successful Removal of brcd util was successful Upgrading driver on Solaris systems To update driver packages simply install new packages using steps under Installing driver packages on Solaris systems on page 154 When upgrading the drivers for Solaris systems you must reboot the host system The new drivers are not effective until after system reboot Driver installation and removal on VMware systems Examples are provided in this section to install adapter drivers on ESX and ESXi systems using the following methods The QLogic installer script Refer to Management utilities on p
213. e upgrades existing software installed on the host system Downgrades are not supported W During installation dialog boxes validate installation success Since the Solaris and VMware ESX Server operating systems require a reboot for the driver update to take effect successful installation is not validated in the dialog boxes W itis recommended that you put VMware ESX hosts in maintenance mode during installation procedures as since a system reboot is required after installation Driver upgrade using HCM is not supported for VMware ESXi servers Refer to Using software installation scripts and system tools on page 138 for VMware procedures Installing HCM to a host from the HCM Agent You can install HCM to any host system from a functioning HCM Agent on a server system The following are prerequisites for the server system B The adapter and driver package must be installed m The HCM agent must be running Use the following steps to install HCM 1 Enter the following URL into your host system s web browser https server host 34568 index html where server host ls the IP address of a server system with the QLogic adapter and driver installed and HCM Agent running 34568 the TCP IP port where the HCM Agent communicates with HCM 2 Respond to prompts as required during HCM installation and the HCM GUI will launch 3 Login to HCM when prompted To launch HOM in the future use the HCM shortcut icon On Win
214. e zero the FCoE link will not come up and the port status will display as Linkdown Be sure to configure valid non zero values for PWWN NWWN when using BOFM Simple Network Management Protocol Simple Network Management Protocol SNMP is supported by CNAs and by Fabric Adapter for ports configured in CNA or NIC mode SNMP is an industry standard method of monitoring and managing network devices This protocol promotes interoperability because SNMP capable systems must adhere to a common set of framework and language rules SNMP is based on manager agent model consisting of an SNMP manager an SNMP master agent a database of management information MIB managed SNMP devices and the SNMP protocol QLogic CNA and Fabric Adapters provide the agent and management information base MIB The SNMP master agent provides an interface between the manager and the managed physical device s and uses the SNMP protocol to exchange information defined in the MIB QLogic BR Series Adapter SNMP support is through an extension to the master agent called the subagent which processes SNMP queries for QLogic BR Series Adapters The subagent is only supported on Linux and Windows systems SNMP subagent files are copied to your host system when you install adapter software through HCM and the QLogic Adapter Software Installer QASI You can then elect to install the subagent using QLogic Windows or Linux installer scripts The agent accesses information a
215. ecification RFC 791 IPv6 Specification RFC 2460 TCP UDP Specification RFC 793 768 ARP Specification RFC 826 Data Center Bridging DCB Capability DCB Exchange Protocol DCBXP 1 0 and 1 1 Dell iSCSI 279 BR0054504 00 A 5 Specifications Converged Network Adapters Table 5 8 CNA hardware specifications Continued Feature Description Supported Ethernet W Flexible MAC addressing protocols and features M RSS with support for IPVATCP IPV4 IPVeTCP IPV6 continued hash types Syslog Jumbo frames Interrupt coalescing Interrupt moderation Multiple transmit queues for Windows and Linux Multiple transmit priority queues Network Priority Large and small receive buffers SNMP Windows and Linux TCP Large Segment Offload Team VM queues NetQueues with multiple priority levels for VMware Unicast MAC address MAC filtering Multicast MAC addresses VLAN Discovery using proprietary logic VLAN discovery for untagged priority tagged FIP frames VLAN filtering m VMware NetQueues v3 VMware 4 1 and above 280 BR0054504 00 A 5 Specifications Converged Network Adapters Table 5 8 CNA hardware specifications Continued Feature Description Supported FCoE protocols VMware NetlOC and features Look ahead data split LKA Link Keep Alive protocol preFIP FIP 1 03 and FIP 2 0 FC BB5 rev 2 compliant Q FIP discovery protocol for dynamic FCF discovery and FCoE link management
216. eckbox for VMkernel Boot netNetqueueDisabled and then click OK 6 Reboot the server For more information on using this command refer to your VMware system documentation on enabling NetQueue in VMware 4 0 Managing the number of NetQueues and filters with cfg For the QLogic driver you cannot directly configure the number of NetQueues and filters per NetQueue By default these values are based on the number of receive queue sets used which are calculated from the number of CPUs in the system In general NetQueues and filters per NetQueue are calculated according to the following guidelines W Including the default NetQueue the number of NetQueues equals the number of CPUs in the system or a maximum of 8 When Jumbo frames are enabled the maximum is 4 m The number of filters per receive NetQueue is calculated so that hardware resources are distributed equally to the non default NetQueues Table A 8 summarizes NetQueues and Receive Filters per NetQueue values per number of CPUs for CNA models Table A 8 NetQueues and filters per NetQueue for CNAs CPUs b n iis NetQueues jumbo ee per 1 0 0 0 2 1 1 63 4 3 3 21 8 7 3 9 16 i 3 9 350 BR0054504 00 A A Adapter Configuration Network driver parameters Table A 8 NetQueues and filters per NetQueue for CNAs Continued NetQueues NetQueues jumbo Receive Filters per no default NetQueue 64 7 3 9 128 7 3 9 Table A 9 summari
217. ed registry 329 BR0054504 00 A A Adapter Configuration Storage driver level parameters a Quiesce all application access to disks that are connected through the adapter b Stop the QLogic HCM Agent Service refer to HCM Agent operations on page 183 for instructions c Open the Windows Device Manager devmgmt msc and navigate to SCSI and RAID controllers For CNAs also navigate to Ethernet controllers d Tounload the driver disable all QLogic BR Series host bus adapter or CNA devices each port has a device entry NL LLLI For CNAs you need to unload both the storage and network driver so disable the CNA instances under SCSI and RAID controllers and Ethernet controllers e Toreload the driver enable all QLogic host bus adapter or CNA devices Configuration using BCU commands Use the following format for changing parameter values with the BCU drvconf key command bcu drvconf key key name val value Following is an example for disabling FDMI bcu drvconf key fdmi enable val 0 Following are possible key names and value ranges for driver configuration parameters B key bfa ioc queue depth value range 0 2048 default 2048 W key bfa lun queue depth value range 0 32 default 32 m q key ioc auto recover value range 0 1 default 1 B key rport del timeout value range 0 90 default 90 m key rport max logins value range 1 1024 default 1024 m key
218. eded for installation Refer to Boot installation packages on page 88 Remove the adapter from its packaging and check for damage If it appears to be damaged or if any component is missing contact QLogic or your reseller support representative Make a backup of your system data Power down the host Unplug all power cords and network cables Remove all covers necessary from the system to access the PCle slot where you want to install the adapter Refer to documentation provided with your system to locate PCle slots and cover removal procedures Remove the blank bracket panel from the system that covers the PCle slot where you want to install the adapter If the panel is secured with a screw remove the screw and save it for securing the adapter s bracket panel back in the slot NOTE For best performance install the adapter into a PCle slot with an x8 lane or greater transfer interface Also do not install this adapter in a PCI slot PCle slots are shorter than PCI slots Remove all SFP transceivers from the adapter if clearances inside your system case prohibit you from installing the adapter with transceivers installed Follow the instructions under Removing and installing SFP transceivers on page 100 Otherwise go on to the next step 97 BR0054504 00 A 2 Hardware Installation Stand up adapters 8 Use the following steps to change brackets if the installed bracket does not fit your system enclosure If the installed
219. edures load the operating system adapter drivers and utilities to the designated boot LUN to allow adapter operation and booting your host system from the LUN However the HCM Agent and full range of QLogic Command Line Utilities such as bfa supportsave are not installed To install the complete driver package with HCM Agent and full range of utilities refer to Installing the full driver package on boot LUNs on page 233 after completing the following steps Installing Windows and the driver Use the following steps to install Windows Server 2008 R2 and the adapter driver on an unformatted disk that you configured as a bootable device when setting up the adapter BIOS or UEFI on the host system If the LUN you have targeted for booting over SAN already has an operating system installed be sure to use options for reformatting the LUN during Windows Server 2008 R2 installation Refer to your operating system documentation for details 217 BR0054504 00 A 4 Boot Code Boot over SAN For HBAs and Fabric Adapter ports configured in HBA mode you will need the fc dud file brocade_adapter_fc_operating system_platform_dud_version zip For CNAs and Fabric Adapter ports configured in CNA mode you will need the fcoe dud file brocade adapter fcoe w2k8 x86 dud version zip For Microsoft Windows operating systems the driver update disk does not verify prerequisite checks as part of installation Please review the operating system prere
220. eeees Rees See aks xxi Contact Information n a naana aaa xxi Knowledge Database nnana so a xxi Product Overview Fabric Adapters eerste ko sa ds ek on qe De ned Pen dex E e QU Nae 1 AnylO technology rs im re Ree hr RR 3 Hardware compatibility llle 5 Converged Network Adapters 0 00 e eee eee eee 9 Stand up adapters 0 0 0 cc cece eee 10 Mezzanine adapters scs siens e he be dia ERROR ERA 11 Hardware compatibility 0000 ee 15 Host Bus Adapters ese 18 Stand up adapters cpe dcs E Poeddi ee Ka PGCR E a cs oid 19 Mezzanine adapters soc VSP has es he ESS Yes Se Ge ce SS bee Pedes 20 Hardware compatibility 2 000 ee ee 25 Adapter features xau wwe NCC a RR ue eked eben eee edad 27 VO vimalzatiBni as og xa ver ur e x YR REOR Sb i 9 C3 QUE Malo 28 Additional general features 0 0 0 0c cee eee 31 FOOE TISdtf8S 533 ak ooa o mdp pcd aos dodi does dee d dO RR OP 34 Data Center Bridging and Ethernet features 38 Host bus adapter features 0 cc eee 49 iii BR0054504 00 A Installation Guide BR Series Adapters Operating system considerations and limitations 61 WINdOWS 5 isi RR RR ER Xu AUREOS REOR ee Mae OR Ren RE RAD CAO RR RR n 61 LINUX quer TEDET Tc E 62 Citrix XenServer 0 0 0 0 eee eens 62 VMMWAaIG ack ee exceed ehe OR e QUA Kae RG aia aed ald 62 Solas y sos acces gandia fo S Cd haan os
221. efaultInstall properties Install software in silent mode using default installation properties file Note that this is recommended for silent mode sh brocade_adapter_software_installer_solaris_sparc_ lt version gt bin i silent f HCMDefaultInstall properties 123 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Command options Following are the options that you can modify and include in command strings You can also edit these fields in the properties file to change the default install set INSTALLER_Ul silent Specifies that the installation mode should be silent CHOSEN_INSTALL_SET BOTH Specifies to install either the network and storage driver packages the GUI HCM or all components C BOTH This parameter installs both the GUI and the driver The HCM Agent starts automatically after installation J DRIVER This parameter installs only the driver The HCM Agent starts automatically after installation CQ GUI This parameter installs only HCM CONT NOARCH DRIVER 2 NO YES Use for installing non specific architecture drivers when kernel specific driver is not available If set to YES installs the noarch driver on Linux systems NO is the default value if you do not specify the parameter as an argument FORCE WIN DRIVER INSTALLATION 1 Be sure to uncomment the FORCE WIN DRIVER INSTALLATION 1 to overwrite the existing driver on Windows platform Note that this may
222. eiver generates a PAUSE frame this halts transmission for a specified period of time Traffic resumes when time specified in the frame expires or PAUSE zero is received Flexible MAC address Flexible MAC address based classification of inbound packets for virtualization functions This provides security for these functions by isolating virtual machines from each other and controlling the resources they access gPXE This is an open source feature that allows systems without network PXE support to boot over the network It enhances existing PXE environments using Trivial File Transfer Protocol TFTP with additional protocols such as Domain Name System DNS Hypertext Transfer Protocol HTTP and Internet Small Computer System Interface iSCSI VLAN tagging is also enabled For more information refer to gPXE boot on page 202 39 BR0054504 00 A 1 Product Overview Adapter features Hypervisor Hypervisor Hyper V is a processor specific virtualization platform that allows multiple operating systems to share a single server platform Refer to Host operating system support on page 70 for a list of operating systems that support hypervisor operation for QLogic BR Series Adapters IBM Virtual Fabric support IBM Virtual Fabric or vNIC is supported on QLogic CNAs and Fabric Adapter ports configured in CNA or NIC mode IBM Virtual Fabric is a switch agnostic NIC partitioning feature that enforces a minimum guaranteed bandwi
223. em board mounting posts Holes for guiding card onto blade server system board mounting posts Midplane connectors Figure 1 3 BR 1007 CNA Labels showing the part number PWWNs port MAC addresses model number and serial number for the BR 1007 CNA are on the reverse top side of the card 12 BR0054504 00 A 1 Product Overview Converged Network Adapters The BR 1007 mounts on a server blade that installs in an IBM BladeCenter enclosure The adapter uses FCoE to converge standard networking and storage data onto a shared Ethernet link Ethernet and Fibre Channel communications are routed through the DCB ports on the adapter to the blade system enclosure midplane and then onto switch modules installed in the enclosure For information on installing the BR 1007 CNA on a server blade refer to 2 Hardware Installation For additional information related to the supported blade server blade system enclosure and other devices installed in the enclosure such as I O modules and switch modules refer to the installation instructions provided with these products WoL and SoL limitations The following describes limitations of support for Wake on LAN WoL and Serial over LAN SoL for the BR 1007 adapter BM WoL The adapter does not support WoL over its 10 GbE links WoL is supported using the IBM BladeCenter 1 GbE NIC included on the IBM server blades WB SoL The adapter does not support SoL over its 10 GbE links SoL
224. emoval on Windows systems Use the following procedures to install remove and update driver packages on a Windows system Only one driver installation is required for all adapters CNAs host bus adapters or Fabric Adapters installed in a host system Installation Notes Before installing the driver on Windows systems install the following hot fixes from the Microsoft Help and Support website and then reboot the System L Windows 2008 R2 KB977977 is recommended for CNAs and Fabric Adapter ports configured in CNA mode KB2490742 is recommended when installing storage drivers to avoid a Ox000000B8 stop error when shutting down or hibernating a system running Windows 7 or Windows Server 2008 R2 140 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Although you can install the driver using the Windows Device Manager use the driver installer script brocade installer bat or use the GUI or command based Adapter Software Installer brocade adapter software installer windows platform version exe instead for installing removing and upgrading the driver The QLogic installer programs provide these advantages C Automatically updates all QLogic BR Series adapters in one step With Device Manager you will need to update each adapter instance 1 Enables the driver to register the symbolic names for the adapter ports with the switch With Device Manager the driver canno
225. ems VMware Network IO Control or NetlOC also known as NetlORM Network IO Resource Management is a QoS mechanism that allows different traffic types to coexist on a single physical NIC in a predictable manner A primary benefit of NetIOC is that it ensures that adaptive transmit coalescing settings are not lost during data path or device reset VMware VMdirect Path I O This allows guest operating systems to directly access an I O device bypassing the virtualization layer This can improve performance for ESX systems that use high speed I O devices such as 10 Gbps Ethernet vNICs Virtual Network Interface Cards vNICs are virtual partitions that appear as virtual or logical NICs to the host operating system vNICs are supported on QLogic CNAs and on Fabric Adapter 10 GbE ports configured in CNA or NIC mode Multiple vNICs are only supported on Fabric Adapter ports Using BCU commands you can create up to four vNICs per Fabric Adapter port configured in CNA or NIC mode You can configure features such as vNIC teaming for individual vNICs For a two port Fabric Adapter 16 total vNICs are possible For more information refer to I O virtualization on page 28 Windows Hyper V VMQ look ahead data split Windows Hyper V virtual machine queue VMQ look ahead split is a security feature for using virtual machine shared memory for a virtual machine queue where the adapter splits the data packet so that look ahead data and post lo
226. ems HCM management is through the ESXi Management Feature when CIM Provider is installed on these systems Refer to HCM and BNA support on ESXi systems on page 75 Use the following commands W Determining agent operation usr bin hcmagentservice status 183 BR0054504 00 A 3 Software Installation HCM Agent operations W X Starting the agent agent will not restart if system reboots or agent stops unexpectealy usr bin hcmagentservice start W X Starting the agent agent restarts if system reboots chkconfig add hcmagentservice B Stopping the agent usr bin hcmagentservice stop W Stopping the agent from restart after system reboots chkconfig del hcmagentservice B Changing the default communication port Use the following steps 1 Change to the agent installation directory default is opt brocade adapter hbaagent conf 2 Edit abyss conf to change the entry SecurePort 34568 to any other nonconflicting TCP IP port for example SecurePort 4430 Solaris systems Use the following commands B Determining agent operation svcs hcmagentservice W X Starting the agent agent will not restart if system reboots or agent stops unexpectedly svcadm enable t hcmagentservice W Starting the agent agent restarts if system reboots svcadm enable hcmagentservice B Stopping the agent svcadm disable t hcmagentservice W Stopping the agent from restart after system reboots svcad
227. er ports configured in CNA or NIC mode SNMP support is provided through an extension to the SNMP master agent called the subagent which processes SNMP queries for QLogic BR Series Adapters The subagent is only supported on Linux and Windows systems For more information on SNMP support refer to Simple Network Management Protocol on page 67 SNMP subagent files are copied to your host system when you install adapter software through HCM and the QLogic Adapter Software Installer QASI You can elect to install the subagent using QLogic Windows or Linux installation scripts Refer to Installing SNMP subagent on page 180 Host Connectivity Manager Host Connectivity Manager HCM is a graphical user interface GUI based management software for installing configuring monitoring and troubleshooting installed adapters HCM performs the client function for the management software You can only install HCM using the QLogic Adapter Software Installer The HCM agent is installed with the driver package on systems where adapters are installed 79 BR0054504 00 A 1 Product Overview Adapter software Install HCM on the host system containing QLogic BR Series Adapters for local management or install on a network attached system for remote management of these adapters Refer to CNA management on page 65 or Host bus adapter management on page 68 for more information HCM is available for all commonly used operating syste
228. er software in staller solaris sparc versio n bin Installs HCM and appropriate driver package for operating system and platform Note Use appropriate QLogic Adapter Software Installer listed in this column to install HCM on applicable guest operating system only The software installer is not supported on ESX systems The HCM agent is not supported on ESXi platforms brocade_driver_solaris11_ lt version gt tar Leadville based storage driver with user applications such as HCM Agent QLogic Adapter Software Installer and BCU for x86 platforms brocade_driver_solaris11_ lt version gt tar Leadville based storage driver with user applications such as HCM Agent QLogic Adapter Software Installer and BCU for x86 platforms brocade_driver_esx50_ lt versison gt tar gz 5 0 storage and network drivers with user applications such as HCM Agent QLogic Adapter Software Installer and BCU for x86 EM64T and AMD64 platforms This package is the source based RPM for all RHEL and SLES Linux driver distributions as well as user applications such as HCM Agent QLogic Adapter Software Installer and BCU The driver module is compiled on the system during the RPM installation An installer program is available for use when you untar this package To install this package the appropriate distribution kernel development packages must be installed for the currently running kernel which include the gcc
229. er to Fabric based boot LUN discovery on page 234 E Flash Values Boot LUN information will be obtained from flash memory Note that values are saved to flash when you configure and save them through the BIOS Configuration Utility and BCU W First LUN The host boots from the first LUN visible to the adapter that is discovered in the fabric NOTE To boot from direct attached Fibre Channel targets you must use the First LUN or Flash Values options NOTE Fabric based boot LUN discovery Fabric Discovered is not supported for booting from direct attached targets Bootup Delay You can configure values of 1 2 5 and 10 minutes This adds a delay in discovering the boot LUN to help compensate for the time it takes storage systems to boot up During storage system boot boot LUNs are not visible to servers that are also booting up NWWN Displays the port s Node World Wide Name PWWN Displays the port s unique Port World Wide Name MAC Displays the port s Media Access Control MAC address for CNAs and Fabric Adapter ports configured in CNA or NIC mode Port Speed Sets the speed for the adapter port NOTE Auto allows the adapter port to automatically negotiate link speed with the connected port Port Topology Set Loop if the port is connecting to storage in a Fibre Channel Arbitrated Loop FC AL and P2P if the port is connecting to storage in a point to point topology 250 BR0054504 00 A 4 Boot Code Configuring B
230. ere is no zone enforcement by the fabric You must create a separate zone containing the adapter port and storage target port to ensure that the adapter port is able to see the target For additional details on configuring zones and zone sets refer the configuration guide for your Cisco switch 239 BR0054504 00 A 4 Boot Code Boot systems over SAN without operating system or local drive Boot systems over SAN without operating system or local drive This section provides generic procedures for using ISO 9660 iso optical disk images to boot host systems that do not have an installed operating system or local drive Once you boot the host system you can use BCU commands to update the boot code on installed adapters if necessary configure BIOS to boot over SAN and install the operating system and driver to a remote boot LUN Use one of the following ISO images for your system m LiveCD live cd iso that you can download from the QLogic Web Site using the following steps 1 Go to the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 3 Click the Boot Code link at the top of the page to direct you to the boot code files 4 Locate the Multi Boot Firmware LiveCD link for your adapter in the table click on it and following the ins
231. ers for enhanced serviceability stand up adapters only Storage Management Initiative Specification SMI S Specification supporting the Common Information Model CIM Provider which allows any standard Common Information Model CIM and SMI S based management software to manage installed QLogic BR Series Adapters Although SMI S Provider and CIM Provider may be used interchangeably CIM is the more generic term while SMI S is storage specific Switch fabric topology CNAs and Fabric Adapter ports configured in CNA mode can connect to a switch that supports Data Center Bridging DCB through 10 GbE ports Synthetic Fibre Channel Ports 33 BR0054504 00 A 1 Product Overview Adapter features For Windows 2012 Server guest operating systems virtual machines running on Hyper V can detect and manage Fibre Channel ports The host bus adapters or Fabric adapter ports configured in HBA mode that are presented to the virtual machines VMs are called synthetic FC ports This feature is configured through Hyper V UCM compliance QLogic BR Series Adapters are compliant with IBM Unified Configuration Manager UCM Windows Management Instrumentation WMI Windows Preinstallation Environment WinPE a minimal operating system with limited services for Windows Server or Windows Vista used for unattended deployment of workstations and servers WinPE is designed for use as a Standalone preinstallation environment an
232. erview of using the Support Save feature to collect debug information from the driver internal libraries and firmware so that you can pass this to your provider for more efficient problem resolution W Appendix A Adapter Configuration is optional for expert network administrators who need to modify values for adapter instance specific persistent and driver level configuration parameters W Appendix B MIB Reference provides information on the MIB groups and objects that support the Simple Network Management Protocol SNMP for CNAs and Fabric Adapter ports configured in CNA mode xvi BR0054504 00 A Installation Guide BR Series Adapters Preface What Is in this Guide Figure i illustrates a flowchart of how to use chapters in this manual to install and configure adapters Chapter 1 Determine host system compatibility required hardware and required software packages for installation Chapter 2 Install adapter hardware in host system connect to switch and verify installation Chapter 3 Install adapter drivers utilities and other software in host system Verify software and hardware installation Configure HCM agent operation as necessary Configure network addressing CNA only Booting from external boot device Chapter 4 Configure boot over SAN on BIOS or UEFI based systems Install operating system adapter drivers utilities and other software on boot devices Configure fabri
233. es although non Brocade cables have not been tested and are not supported Table 5 4 summarizes maximum distances supported on fiber optic cable types for Fibre Channel transceivers This table assumes a 1 5 dB connection loss and an 850 nm laser source Table 5 4 Fibre Channel transceiver cable specifications Transceiver type Speed SWL 2 Gbps SWL 4 Gbps SWL 8Gbps SWL 16Gbps LWL 2Gbps LWL 4Gbps LWL 8Gbps LWL 16Gbps OM1 M6 62 5 125 micron 150m 492ft 70m 229ft 21m 68ft 15m 49ft N A N A N A N A OM2 M5 50 125 micron 300m 984ft 150m 492ft 50m 164ft 35m 115ft N A N A N A N A OM3 M5E 50 125 micron 500m 1640ft 380m 1 264ft 150m 492ft 100m 328ft N A N A N A N A OM4 M5F 50 125 micron N A 400m 1 312ft 190m 623ft 125m 410ft N A N A N A N A Single Mode Media 9 microns N A N A N A NA 10km 6 2mi 10km 6 2mi 10km 6 2mi 10km 6 2 mi Cables are not shipped with the stand up Fabric Adapter For stand up adapters use only Brocade branded SFP laser transceivers supplied with the adapters 273 BR0054504 00 A 5 Specifications Fabric Adapters Adapter LED operation stand up adapters Figure 5 1 illustrates LED indicator locations on a QLogic dual port BR 1860 A and a QLogic single port B stand up Fabric Adapters LED indicators for each port are visible thr
234. es panel Look for the FCoE MAC field W Enter the port query port id BCU command Look for the FCoE MAC field MAC addresses assigned during FCoE initialization operations cannot be changed using device management applications The FCoE Forwarder FCF MAC address is the address of the attached switch that supports Data Center Bridging DCB Select an FCoE port in the HOM device tree and then click the Properties tab in the right pane to display the port Properties panel Look for the FCF MAC field You can also determine port MAC addresses using the following BCU commands B port query port id Displays port information including the MAC addresses The port id parameter is the port number B port list Lists all the physical ports on the adapter along with the adapter Ethernet and FCoE MAC addresses For details on using HCM and BCU commands refer to the QLogic BR Series Adapter Administrator s Guide 312 BR0054504 00 A 6 Adapter Support Using Support Save Using Support Save The Support Save feature is an important tool for collecting debug information from the driver internal libraries and firmware You can save this information to the local file system and send it to support personnel for further investigation Use one of the following options to launch this feature In HCM launch Support Save through the Tools menu In Management applications use the Technical SupportSave dialog box For
235. es procedures to install adapter hardware and connect to the fabric or switch Also included are procedures to verify hardware and software installation Chapter 3 Software Installation provides procedures to install software such as the QLogic Host Connectivity Manager HCM and driver packages Also included are instructions to verify software and hardware installation Use this chapter to install software on the host system where you have installed the adapter Chapter 4 Boot Code describes host boot support available on the adapter and provides an introduction to boot over SAN It also includes procedures to update adapter boot code configure boot over SAN and configure fabric based boot over SAN Use this chapter when configuring a host to boot its operating system from a boot device located somewhere on the SAN instead of the host s local disk or direct attached storage Chapter 5 Specifications includes details on adapter physical characteristics LED operation environmental requirements and power requirements Also included are Fibre Channel standards regulatory and safety compliance information XV BR0054504 00 A Installation Guide BR Series Adapters Preface What Is in this Guide W Chapter 6 Adapter Support provides details on information to provide your QLogic adapter support provider for hardware firmware and software support including product repairs and part ordering This chapter also provides an ov
236. exists a dialog box displays with its current location and allows you to overwrite the file not overwrite the file or quit 110 BR0054504 00 A 3 Software Installation Installation notes m After installing the adapter driver and software on an SLES11 SP1 system use one of the following methods if updating the errata kernel Q Upgrade the kernel using the rpm ivh filename command LC Upgrade the kernel using the rpm Uvh command or YaST with these steps a Upgrade the kernel using rpm Uvh or YaST b Use the QLogic Adapter Software Installer QASI to install the driver c Ensure the boot order in boot grub menu Ist is set to boot from the newly installed kernel d Reboot the server Solaris Following are notes that you should be aware of when installing adapter software on Solaris systems B BR 804 and BR 1007 adapters are not supported on Solaris systems so Solaris commands in this section do not apply W X After installing drivers on a Solaris system you must reboot the system to enable the drivers Windows Following are notes that you should be aware of when installing adapter software on Windows systems B For Windows systems installing the management utilities creates a QLogic BCU desktop shortcut on your system desktop Select this to open a Command Prompt window in the folder where the BCU commands reside You can then run enter full BCU commands such as bcu adapter list or enter bcu
237. ey html Installing driver packages on Linux systems 1 Boot the host and log on with Administrator privileges 2 Create an installation directory such as opt CNA or opt HBA depending on your adapter 3 Download the appropriate tar gz file for your Linux distribution Refer to Software installation and driver packages on page 81 for a description of Linux driver packages 4 Extract the driver packages to the directory you created in Step 2 using the following steps 146 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools a Entera path or browse to the driver directory where you want to install the extracted files when prompted for example opt CNA or opt HBA Note that you can specify a directory other than the default directory b To untar the source based RPM for all Linux distributions tar zxvf brocade driver linux version tar gz c Tountar the precompiled RPMs for RHEL and OL distributions tar zxvf brocade driver linux rhel version tar gz d Tountar the precompiled RPMs for SLES distributions tar zxvf brocade driver linux sles version tar gz 5 Change to the directory where extracted the driver packages if you are not there already 6 Enterthe following command to run the installer on RHEL and SLES systems while you are in the directory where you extracted brocade install rhel sh u h update add rm initrd f
238. f a VHBA using BCU fcpim commands The configuration persists with system reboots For configuration details refer to the QLogic BR Series Adapter Administrator s Guide LUN masking LUN masking establishes access control to shared storage to isolate traffic between different initiators that are zoned in with the same storage target LUN masking is similar to zoning where a device in a specific zone can communicate only with other devices connected to the fabric within the same zone With LUN masking an initiator port is allowed to only access those LUNs identified for a specific target Enable LUN masking on an adapter physical port through the HCM Basic Port Configuration dialog box and the BCU fcpim lunmaskadd command to identify the logical port initiator and remote WWN target for the LUN number Refer to the QLogic BR Series Adapter Administrator s Guide for more information on configuration You can also enable LUN masking using your systems UEFI HII Refer to Configuring UEFI on page 255 for details This feature has following limitations C Only 16 LUN masking entries are allowed per physical port CQ Multiple BCU instances for adding and deleting LUN masking are not supported C This feature is only supported on QLogic host bus adapters and on Fabric Adapter ports configured in HBA mode You can configure LUN masking for a particular target even without the actual devices being present in the network When
239. f any component cannot be detected D Port configuration is not supported on mezzanine cards 52 BR0054504 00 A 1 Product Overview Adapter features For additional details on the D_Port feature especially switch and adapter configuration procedures refer to the Brocade Fabric OS Troubleshooting and Diagnostics Guide For details on adapter configuration commands and feature limitations and considerations refer to the QLogic BR Series Adapter Administrator s Guide End to end link beaconing between an adapter port and a switch port to which it connects Requires Brocade Fabric OS 6 3x or later Enhanced Hibernation support Before Windows Server 2012 the driver used proprietary logic to pass on special LUN details through the adapter flash memory With Windows Server 2012 the driver can reliably identify the LUN used for booting the operating system and storing the paging file The paging file can also reside on a non boot LUN spanning different adapter ports Fabric Assigned Port World Wide Name FA PWWN This is a feature of Dynamic Fabric Provisioning DFP that is supported on QLogic host bus adapters and Fabric Adapter ports configured in HBA mode FA PWWN allows the adapter port to acquire its port world wide name PWWN from the switch port when it logs into the fabric An FA PWWN is a virtual port WWN that can be used instead of the physical PWWN to create zoning and LUN mapping and masking This feature offer
240. f at least 256 colors and a screen resolution of 800 x 600 pixels At least 150 Mb disk space Internet Explorer 7 0 or later Firefox 3 0 or greater is required for Webstart W TCP IP protocol stack for communications to management agents on hosts containing a supported QLogic BR Series Adapter General adapter management Use BCU commands and HOM for installing configuring troubleshooting and monitoring the adapter and device connections General host bus adapter CNA and Fabric Adapter management functions include the following Discovery of adapters and connected storage devices Adapter diagnostics Event notifications for adapter conditions and problems Supportsave Port statistics Host security authentication Port logging level configuration Port configuration Virtual port configuration Virtual port statistics display Logical port statistics display Interrupt control coalescing Performance monitoring 64 BR0054504 00 A 1 Product Overview Adapter management features Fabric Adapter management Use BCU commands HCM UEFI HII and Simple Network Management Protocol SNMP to manage Fabric Adapter ports For a summary of available management features using HCM and BCU refer to one of the following sections depending on whether the Fabric Adapter port is configured in CNA host bus adapter or NIC modes m Port set to CNA mode CNA management on page 65 B Port set to HBA mode Host bus ada
241. f the host s local disk or directly attached Fibre Channel storage Specifically this boot device is a logical unit number LUN located on a storage device Fabric based boot LUN discovery is a feature that allows the host to obtain boot LUN information from the fabric zone database Fabric based boot LUN discovery is not available for direct attached targets Fibre Channel Security Protocol FC SP provides device authentication through key management FCoE Initialization Protocol FIP support for the following OQ FIP 2 0 Q preFIP and FIP 1 03 CL FIP Discovery protocol for dynamic FCF discovery and FCoE link management FPMA type FIP fabric login VLAN discovery for untagged and priority tagged FIP frames FIP discovery solicitation and FCP discovery Login FIP and FCoE FIP link down handling FIP version compatibility FIP keep alive Oooovoovoovo so FIP clear virtual links The CNA FIP logic automatically adapts to the adequate FIP version and preFIP to enable backward compatibility Interrupt coalescing 35 BR0054504 00 A 1 Product Overview Adapter features This feature provides a method to delay generation of host interrupts and thereby combine coalesce processing of multiple events This reduces the interrupt processing rate and reduces the time that the CPU spends on context switching You can configure the following parameters per port to adjust interrupt coalescing Q Interrupt
242. fabric OS support 16 FCoE features 34 firmware 75 hardware specifications 278 host compatibility 8 16 installing driver package with software installer 114 LED operation 283 MAC addressing 311 management BCU 65 77 BOFM support 66 HCM 65 PCI system values 278 PCle interface 277 PCle support 17 physical characteristics 277 product overview 9 PWWN 311 serial number 310 software downloading from website 92 installation options 87 installation packages 81 installer 77 87 overview 75 storage support 16 17 switch compatibility 8 16 switch support 16 throughput per port 34 38 transfer rate 34 CNA stand up environmental and power requirements 285 CNA mode 3 38 CNA software installer 81 CNAs hardware and software compatibility 15 SFP transceivers 15 command line utility 63 64 68 77 communications port firewall issue 139 compliance Fibre Channel standards 297 laser 300 configuring adapters 319 connecting adapters to switch or storage 100 crash dump file on remote LUN 216 D D Port feature 50 DCB management BCU 66 HCM 66 DCBCXP 39 direct attach boot over SAN 207 downgrade software 137 downgrading HCM with QASI 137 driver packages 75 components 75 confirming in Linux 173 174 downgrading 137 install with RPM commands 149 installing HCM 107 installing to boot LUN 233 installing with scripts and commands 138 installing with software installer 114 intermediate 77 network 76 removal with scripts and commands
243. fiber optic cable 10 km 6 2 mi SFP transceiver with twinaxial copper cable 1 meter 3 2 feet maximum SFP transceiver for twinaxial copper cable 3 meters 9 8 feet maximum SFP transceiver for twinaxial copper cable 5 meters 16 4 feet maximum Switch compatibility Any switch compatible with the adapter Any switch compatible with the adapter Any switch compatible with the cable Any switch compatible with the cable Any switch compatible with the cable For adapters releases 3 0 3 0 and later QLogic BR Series Adapters allow non Brocade active twinaxial cables based on supported switches although non Brocade cables have not been tested BR0054504 00 A 1 Product Overview Fabric Adapters Ports configured in HBA mode Table 1 2 provides the type description and switch compatibility information for supported SFP transceivers that can be installed in ports configured in HBA mode Table 1 2 Compatible SFP transceivers for ports configured in HBA Type 8 Gbps SWL short wave laser SFP transceiver 8 Gbps LWL long wave laser 10 km SFP transceiver 16 Gbps SWL short wave laser SFP transceiver 16 Gbps LWL long wave laser 10 km SFP transceiver mode Description SFP transceiver for fiber optic cable Distance depends on cable type Refer to Cabling stand up adapters on page 272 SFP transceiver for fiber optic cable Distance
244. firmware or driver version Management utilities The following management Utilities are included with all driver packages QLogic BCU CLI BCU An application from which you can enter commands to monitor install and configure QLogic BR Series Adapters QLogic Adapter Software Installer QASI This includes a GUI based installer and command line installer that provides options for installing all adapter drivers all adapter drivers and HCM or HOM only for a specific operating system and platform 77 BR0054504 00 A 1 Product Overview Adapter software W Installer scripts These allow you to install drivers the HCM agent and utilities to your host system without using the Adapter Software Installer First download and extract the appropriate driver package for your system from http driverdownloads glogic com then run the script Refer to Table 1 9 for the installer script commands for Windows Linux and VMware systems Table 1 9 Installer script commands Operating Download file Script command system Windows Refer to Table 1 10 on page 83 for brocade_installer bat exe file RHEL Refer to Table 1 10 on page 83 for brocade_install_rhel sh tar gz file SLES Refer to Table 1 10 on page 83 for brocade_install_sles sh tar gz file Citrix XenServer Refer to Table 1 10 on page 83 for install sh tar gz file VmWare ESXi 5 X Refer to Table 1 10 on page 83 for brocade_install_esxi sh tar gz file
245. fter installing hardware and software to avoid possible problems You can use the list to verify proper installation and make corrections as necessary BR 1007 CNA For details on installing the BR 1007 mezzanine CNA in a blade server refer to the installation and user guides that ship with the blade server and blade system enclosure To support each I O module that you install in the blade system enclosure you may also need to install a compatible CNA in each blade server that you want to communicate with the I O module Refer to the documentation for your blade system enclosure for details For references to compatibility information on blade servers switch modules I O modules and other devices that install in the blade system enclosure refer to Server blades and system enclosures mezzanine adapters on page 16 What you need for installation Have the following available for installing the adapter W Adapter shipping carton which includes the adapter and necessary documentation Fully operational blade server Access to a blade server through a local or remote console connection Blade server or storage expansion unit installation and user guides Blade system enclosure installation and user guides I O module installation guide for the blade system enclosure Verifying adapter installation on page 177 provides a list of general items to verify during and after installing hardware and software to avoid possible p
246. g Configure an adapter port using the drvcfg s command in the following format drvcfg s driver handle controller handle Following is an example of how to use this command with the driver and controller handles from the previous steps a Toconfigure one of the adapter ports enter the following drvcfg s 25 27 261 BR0054504 00 A 4 Boot Code Alternate methods for configuring UEFI The s option for drvcfg provides prompts for setting adapter options You can use the v option drvcfg v 25 27 to check that options currently set on the adapter are valid b When you are prompted to enable the adapter port press the Y or N key to enable or disable the port c When prompted enter a port speed HBAs and Fabric Adapter ports configured in HBA mode only d Toterminate and not save values that you have selected press ESC and go to the next step Following is example output from the drvcfg command using driver handle 25 and controller handle 27 Note that for a CNA and Fabric Adapter ports configured in CNA mode an option to set the port speed will not display as it does for an HBA or Fabric Adapter port configured in HBA mode Set Configuration Options Drv 25 Ctr1 27 Lang eng Bfa Fibre Channel Driver Configuration Port nwwn 200000051E301492 Port pwwn 100000051E301492 Enable Brocade Fibre Channel adapter port 1 0 Y N Y Y Set Brocade Fibre Channel Adapter Port Speed 1 0 0 2 4 8
247. g BIOS with HCM 254 configuring UEFI 260 configuring with BIOS utility 246 definition 34 direct attach requirements 207 general requirements 208 host requirements 196 208 important notes for configuring 210 installing image on boot LUNs 217 introduction 203 storage requirements 209 updating Windows 2008 driver 243 boot support for adapters 188 booting from direct attach storage 207 booting without local drive 240 booting without operating system 240 BR 1007 adapters description 11 regulatory statements 306 specifications 286 BR 1010 adapters description 10 BR 1020 adapters description 10 regulatory statements 298 specifications 277 BR 1741 adapters description 14 BR 1860 adapters description 1 regulatory statements 298 specifications 265 BR 1867 adapters description 18 22 24 regulatory statements 296 306 specifications 289 BR 804 adapters description 21 regulatory statements 306 specifications 289 295 360 BR 815 adapters description 18 LED operation 293 regulatory statements 298 specifications 289 BR 825 adapters description 18 LED operation 293 regulatory statements 298 BSMI warning 299 C Canadian requirements 1741 adapters 307 stand up adapters 300 CE statement 1741 adapters 307 checksum offloads 38 CIM Provider 79 81 BR0054504 00 A Installation Guide BR Series Adapters CNA boot image 89 DCB features 38 driver packages 75 environmental and power requirements 276 Ethernet features 38
248. g configuration persistence 48 technical help for product 310 transmit priority queues 43 trunking 58 trunking requirements 58 U UEFI 80 189 configuring 260 UEFI HII 206 UEFI support 206 UEFI support for boot over SAN 206 UNDI 44 update drivers with HCM 181 updating boot code 189 upgrade software 135 upgrading driver package 138 Upgrading Linux drivers 149 utilities 77 V VCCI statement 1741 adapter 307 stand up adapters 299 verifying HBA installation 178 VHBA 29 virtual channels per port 49 virtual fabric support 40 virtual port persistency 31 VLAN 47 VLAN configuration persistence 48 VLAN filtering 43 VLAN tagging 43 VMware installation on boot LUN 229 368 VMware systems auto deployment 243 244 building a custom image for auto deployment 244 downloading adapter software 87 firewall issue 111 139 installing HCM 108 manually install drivers from offline bundles using COS or DCUI 168 modifying agent operation 183 network driver configuration parameters 344 storage driver configuration parameters 324 upgrading driver 171 using driver install script for ESX 4 X and ESXi 5 0 158 using installer script 158 using the QLogic installer script for ESXi 4 0 and 4 1 systems 161 using VMA to install drivers from offline bundles 167 using VMware Update Manager to install drivers 169 vNIC 29 vNIC minimum and maximum bandwidth 30 W Windows installing HCM on Windows Vista 108 installing HCM on Windows XP 108 W
249. g general features for enhanced performance and connectivity in the SAN and Ethernet networks For limitations and considerations for feature support for specific operating systems refer to Operating system considerations and limitations on page 61 W X Fabric Adapters Also refer to the following subsections depending on the port mode and SFP transceiver configurations Q I O virtualization on page 28 Q Additional general features on page 31 C FCoE features on page 34 for ports configured in CNA mode d Data Center Bridging and Ethernet features on page 38 for ports configured in CNA or NIC modes m Host bus adapter features on page 49 for ports configured in HBA mode 27 BR0054504 00 A 1 Product Overview Adapter features WB CNAs Also refer to the following subsections Q I O virtualization on page 28 C Additional general features on page 31 OQ FCoE features on page 34 C Data Center Bridging and Ethernet features on page 38 W X Host bus adapters Also refer the following subsections Q I O virtualization on page 28 C Additional general features on page 31 C Host bus adapter features on page 49 I O virtualization QLogic BR Series Adapters support physical function based I O virtualization to provide data isolation and sharing of the bandwidth resources Depending on the adapter model or the operating mode CNA HBA or NIC assigned
250. g system in the third column and then click Go Click the driver or boot code link at the top of the page to direct you to the driver or boot code packages Locate the driver or boot code package for your adapter in the table click on it and then follow the directions In the package name lt version gt indicates the software version number for example v2 0 0 which will change for each release The lt platform gt indicates the host processor type such as x86 or x86_64 Network drivers are not supported on host bus adapters and Fabric Adapter ports configured in HBA mode Although Table 1 10 lists all adapter software packages that you can download for specific operating systems and platforms your adapter release may not be supported some of these operating systems and platforms Refer to Host operating system support on page 70 and the latest release notes for your adapter for more information BR 804 and BR 1007 adapters are not supported on Solaris systems 82 BR0054504 00 A 1 Product Overview Adapter software Table 1 10 Supported software installation packages Operating System and Platform QLogic Adapter Software Installer Driver Package Windows Server 2008 R2 x64 Windows Server 2012 x64 Windows Server 2012 R2 Linux RHEL and OL 5 9 5 10 x86 Linux RHEL and OL 5 9 5 10 x86 64 brocade adapter software in staller windows version e xe Installs HCM and a
251. ge 246 and Configuring UEFI on page 255 This feature has the following limitations CQ Only 16 LUN masking entries are allowed per physical port CQ Multiple BCU instances for adding and deleting LUN masking are not supported C This feature is only supported on QLogic host bus adapters and Fabric Adapters 36 BR0054504 00 A 1 Product Overview Adapter features You can configure LUN masking for a particular target even without the actual devices being present in the network When configuring boot over SAN mask the boot LUN so that the initiator has exclusive access to the boot LUN Refer to the QLogic BR Series Adapter Administrator s Guide for more information N_Port ID Virtualization NPIV This allows multiple N_Ports to share a single physical N_Port This allows multiple Fibre Channel initiators to occupy a single physical port and reduce SAN hardware requirements Persistent binding enables you to permanently assign a system SCSI target ID to a specific Fibre Channel device This is applicable for Windows operating systems only Simple Network Management Protocol SNMP SNMP is an industry standard method of monitoring and managing network devices QLogic CNA adapters and Fabric Adapter ports configured in CNA mode provide agent and MIB support for SNMP For more information refer to Simple Network Management Protocol on page 67 SRB support Refer to SRB support under Additional gener
252. ge HTML files are loaded to your host system refer to the Tools for Collecting Data chapter in the QLogic BR Series Adapters Troubleshooting Guide In addition you can view all event messages in the Message Reference appendix of the same guide Software installation and driver packages Table 1 10 on page 83 describes the software installation packages that you can download for each supported host platform The table provides the package name host system supported and package description Using the table you can select the following to download for your specific host platform B The QLogic Adapter Software Installer exe application to install the driver package HCM or driver package and HCM Installation instructions are provided under Using the QLogic Adapter Software Installer on page 113 81 BR0054504 00 A 1 Product Overview Adapter software A driver package that you can install using an installation script or native procedures for your host s operating system Installation procedures are provided under Using software installation scripts and system tools on page 138 Download the driver package and boot image for your host system operating system and platform using the following steps 1 Go to the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model In the table select the adapter type in first column the adapter model in the second column the operatin
253. gets This reduces or eliminates network congestion and alleviates I O slowdowns at faster targets Target rate limiting is enforced on all targets that are operating at a speed lower than that of the target with the highest speed If the driver is unable to determine a remote port s speed 1 Gbps is assumed You can change the default speed using BCU commands Target rate limiting protects only FCP write traffic Target Reset Control As part of error recovery for I O requests operating systems rely on logical unit reset target reset and bus reset in that order While logical unit reset affects the logical unit where the I O request encountered an error target reset affects all logical units configured for the specified target In configurations with a tape target a target reset issued while a backup job is running can cause the job to abort on all logical units created for the target Target Reset Control allows you to specifically disable resets for specific targets thereby preventing effects on other logical units 60 BR0054504 00 A 1 Product Overview Operating system considerations and limitations The BCU command fcpim trs disable port id rpwwn lt jowwn gt disables target reset for a remote port specified by the rowwn parameter By default the base port is considered the initiator unless the logical port is specified with the option If target reset is disabled on an I T initiator target nexus a target reset will
254. guration Adapter port target and Fibre Channel Protocol FCP operation monitoring Security features for adapter access Event notifications for adapter conditions and problems Monitor and analyze traffic between N_Port pairs through a mirrored port on the switch HBA Analyzer Virtual FC ports creation VHBA statistics display FCP IM Module statistics display FCP IM IOP statistics Target statistics Fabric statistics display Port configuration LUN masking configuration Historical statistics HCM and BCU commands provide the following features for QLogic Fabric Adapter ports configured in HBA and CNA mode VHBA discovery and display in HCM VHBA enable and disable VHBA data query VHBA statistics display 69 BR0054504 00 A 1 Product Overview Host operating system support Host operating system support This section provides details on host operating system support for features adapters adapter drivers and HCM Adapter drivers Table 1 7 provides general information on compatible software operating systems and environments for QLogic BR Series Adapter network and storage drivers In the following table detailing driver support in various operating systems and platforms N A indicates that support is not available in the OS architecture Table 1 7 Operating system support for network and storage drivers Operating System x86 x64 IA 64 SPARC Windows Windows Server 2008 R2 SP1 N
255. gure 3 7 Uninstall Options screen 5 Select Next W f you selected Complete Uninstall a screen displays showing software removal progress W f you selected Uninstall Specific Features a Choose Product Features screen displays from which you can select features for removal Remove check marks by features that you wish to uninstall and then select Uninstall to continue with software removal 6 If a message box displays asking if you want to back up HCM configurations click Yes or No 132 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer If you select Yes a dialog box displays prompting you to select a backup directory Use the default directory or browse to another location Select Uninstall to perform backup and remove software A screen eventually displays notifying you of a successful uninstall If a message displays on this screen notifying you of leftover files in the installation path make sure that you delete these manually after removal completes Click Done If a message for rebooting the system displays select the reboot option to complete the software removal process Using Software Uninstaller commands The following steps explain how to use the Adapter Software Uninstaller commands to remove the network and storage driver packages and HCM from Windows Linux and Solaris systems These commands automatically remove software that you specify without using a GUI based progra
256. hard drives to disable them in the system BIOS and allow the adapter boot BIOS to boot from the remote boot device Some systems may allow these drives to be enabled in the system BIOS if they correctly support the bootstrap protocol Typically the boot order must be CD ROM Fibre Channel drive and then diskette After the operating system installs you can change this order if desired Due to the variety of configurations and variables in a SAN installations your specific environment must determine any additional requirements to guide installation and configuration for best results 208 BR0054504 00 A 4 Boot Code Boot over SAN Storage system requirements for boot over SAN Consider these requirements for your storage system for booting over SAN The SAN must be properly installed so that the location on the SAN containing the boot image is visible to the host Verify links between the adapter and storage are working properly before attempting a boot over SAN The boot LUN must contain the appropriate operating system for the host and the adapter driver For information on minimum operating system support for drivers refer to Boot installation packages on page 88 and Host operating system support on page 70 Refer to Operating system and driver installation on boot LUNs on page 217 for installation details Some storage devices need the appropriate host type associated with the logical drive configured for t
257. hat is appropriate for booting your host s operating system Determine which adapter port you want to use for booting from SAN and note its PWWN To locate the PWWN for an installed adapter port refer to the discussion on PWWN on page 311 To find the PWWN for the port using the BIOS Configuration Utility refer to Configuring BIOS with the BIOS Configuration Utility on page 246 Configure the storage system so that the adapter port has exclusive access to the LUN Consider using the following methods a Using an appropriate storage management or configuration utility bind the adapter port s PWWN to the selected LUN 214 BR0054504 00 A 4 Boot Code Boot over SAN B Maskthe boot LUN for exclusive access by the adapter port and avoid boot failures using the BCU fcpim lunmaskadd command and the LUN Masking tab on the HCM Basic Port Configuration dialog box Refer to the QLogic BR Series Adapter Administrator s Guide for more information on configuring the LUN Masking feature Create a new single initiator target zone in the SAN fabric where the adapter and storage device are attached The zone should contain only the PWWN of the storage system port where the boot LUN is located and the PWWN of the adapter port Refer to the Brocade Fabric OS Administrator s Guide for zoning procedures The boot LUN zone can be precreated with a virtual PWWN for a storage system port that is bound to a switch port The fabric assigned P
258. he release notes link Note that on systems without a configured GUI using the installer command without parameters as outlined in Using the GUI based installer on page 114 may generate errors and the installer program will fail Using the installer command with parameters outlined in this section will allow you to install all or individual adapter software components 120 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Following are the commands you can use for supported operating systems m Windows systems possible commands m Install drivers HCM GUI or both Overwrites the existing driver installed on the system brocade_adapter_software_installer_windows_ lt version gt exe Install drivers and HCM GUI in silent mode no interaction required brocade_adapter_software_installer_windows_ lt version gt exe i silent Install drivers and the HCM GUI using a default installation properties file brocade_adapter_software_installer_windows_ lt version gt exe f HCMDefaultInstall properties Install software in silent mode using default installation properties file Note that this is recommended for silent mode brocade_adapter_software_installer_windows_ lt version gt exe i silent f HCMDefaultInstall properties m linux systems possible commands m x_86 and x_86_64 platforms Install drivers HCM GUI or both Overwrites the existing driver installed on syste
259. he correct operating system This is necessary so that the storage device can send the correct format of inquiry data to the host Refer to your storage system documentation for specific requirements Configure the storage system so that the adapter port has exclusive access to the LUN Accomplish this by binding an adapter port PWWN to a LUN You can easily find an adapter port PWWN using the BIOS Configuration Utility refer to Configuring BIOS with the BIOS Configuration Utility on page 246 Exclusive access to the LUN can also be assured by using a LUN management feature such as LUN masking zoning or a combination of these You should use LUN masking to avoid boot failures You can enable or disable the LUN masking feature using BIOS Configuration Utility or UEFI screens Only one path to the boot LUN must be visible to the operating system during the host s boot process If the storage device has multiple controller ports only one port can be enabled or connected to the SAN during the operating system boot process Create a specific zone containing the adapter port world wide name PWWN and the target PWWN to keep RSCN interruptions from other hosts to a minimum 209 BR0054504 00 A 4 Boot Code Boot over SAN W f trunking is enabled use the PWWN of Adapter Port 0 when configuring Fabric Zones and LUN Masking for storage N Port Trunking is not supported on QLogic mezzanine adapters m The SAN c
260. he existing driver until this occurs This is useful in mass deployment of operating systems when adapters have not been installed Please note that preinstallation will not automatically be attempted when the installer does not find the corresponding hardware DRIVER_TYPE HBA The operation as specified by INSTALL_OP will be performed for Fibre Channel drivers only CNA The operation as specified by INSTALL_OP will be performed for network drivers only ETH The operation as specified by INSTALL_OP will be performed for network drivers for NIC operation only AUTO The operation as specified by INSTALL_OP will be performed for the drivers for adapters that are present in the system 142 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools M LOG FILE PATH Specify path to installer log Quote marks need to enclose the path needs when it contains a space You can also specify system environmental variables for the path component For example LOG_FILE_PATH ProgramFiles Brocade Adapter Driver util myi nstal log B FORCED INSTALL TRUE Use this option to force driver installation when the operating system displays messages such as The existing driver on this system is already better than the new one you are trying to install B SILENT_INSTALL TRUE Use this in automated script environments to avoid displaying any Windows dialog boxes during installation failure scenarios
261. he following command sxcfg modul S bnad ioc auto recover 0 bna C To disable IOC auto recovery for the storage BFA driver across reboots use the following command sxcfg modul S ioc auto recover 0 bfa For Windows use the Registry Edit tool regedt32 or the BCU drvconf key command Following is the drvconf key command bcu drvconf key ioc auto recover val 0 For Solaris edit kernel drv bfa conf using the following command ioc auto recover 0 The BR 804 and BR 1007 adapters are not supported on Solaris Systems Initiating Support Save through HCM Launching the Support Save feature in HCM collects HCM application data Launch Support Save by selecting Tools Support Save Messages display during the Support Save operation that provide the location of the directory where data is saved If you are initiating Support Save from a remote management station and receive a warning message that support files and Agent logs could not be collected the HCM Agent is unavailable on the remote host Select Tools gt Backup to back up data and configuration files manually For more information and additional options for using this feature refer to the QLogic BR Series Adapter Administrator s Guide 315 BR0054504 00 A 6 Adapter Support Using Support Save Initiating Support Save through BCU commands Use the bfa_supportsave command to initiate Support Save through the BCU B bfa supportsave C
262. humb and forefinger to unlatch the bail from the side of the cable connector Using the bail or pull tab as a handle pull the SFP transceiver straight out of the receiver Refer to the left illustration in Figure 2 3 For 16 Gbps optical transceivers a pull tab may be available for pulling the SFP transceiver out of the receiver W For copper SFP transceivers with attached cables use your thumb and forefinger to pull the tab on the cable to release the SFP transceiver latch and then pull the SFP transceiver straight out of the receiver Refer to the right illustration in Figure 2 3 100 BR0054504 00 A 2 Hardware Installation Stand up adapters In the following figure the fiber optic SFP transceivers are shown in illustration A and the copper SFP transceivers with attached cable are shown in illustration B lt lt gt FTT f Lues lt 900 Figure 2 3 Removing or installing fiber optic and copper SFP transceivers Installing transceivers 1 Orient the SFP transceiver in front of its slot on the adapter so that it can slide into the adapter receiver slot The SFP transceiver can only be oriented one way into the slot 2 Carefully guide the SFP transceiver into the adapter s receiver until it seats W For optical SFP transceivers close the bail to latch the SFP transceiver into the receiver W Forcopper SFP transceivers push the SFP transceiver into
263. ies and HCM Agent installed with the full package For Linux systems install the latest version of brocade driver linux version tar gz using instructions under Driver installation and removal on Linux systems on page 146 This will install all package utilities without updating the driver You do not need to reboot the system If the driver that you install and the driver already installed on the LUN do not match reboot the system to initialize the new driver 233 BR0054504 00 A 4 Boot Code Fabric based boot LUN discovery Fabric based boot LUN discovery This feature allows the QLogic BR Series Adapter to automatically discover and boot from LUN information retrieved from the SAN fabric zone database and therefore not require the typical server boot interrupt and BIOS setup This feature is only supported on host systems operating in Legacy BIOS mode When QLogic s Fabric based boot LUN discovery is enabled the host s boot LUN information is stored in a SAN fabric zone This zone contains zone members that include the PWWN of the adapter port and PWWN and LUN WWN of the storage target The adapter boot code will query the zone member list for the zone name that matches the adapter PWWN to determine the boot target and LUN Fabric based boot LUN discovery auto discovery from fabric is only applicable when configured in legacy BIOS mode for either UEFI capable or non UEFI capable system Fabric based boot LUN
264. in the folder where the BCU commands reside You can then run enter full BCU commands such as bcu adapter list or enter bcu shell to get a bcu gt prompt where only the command adapter list is required The BCU shortcut provides quick access to the installation folder where you can perform the following tasks CQ Run the Support Save feature L Reinstall drivers Q Run adapter utilities Launching BCU on Windows systems through methods other than through the desktop shortcut is not recommended and may result in display of inconsistent information Linux systems By default the initrd file will backed up automatically during Linux installations During installation a dialog box displays with the location of the file If a file exists a dialog box displays with its current location and allows you to overwrite the file not overwrite the file or quit VMware systems Because some versions of ESX and ESXi do not enforce maintenance mode during driver installation it is recommended that you put the host in maintenance mode as a system reboot is required after installation Installation examples Following are some examples of using commands and parameters to install adapter software To install the storage and network drivers in silent mode and start the HCM Agent automatically by default Windows systems brocade_adapter_software_installer_windows_ lt version gt exe DCHOSEN INSTALL SET DRIVER i silent
265. indows 7 driver support 34 Windows crash dump file on remote LUN 216 Windows Server 2012 driver support 34 Windows Server Core 34 60 Windows systems firewall issue 111 139 installing driver with script 140 installing Windows 2008 on boot LUN 217 modifying agent operation 185 network driver configuration parameters 333 network driver teaming parameters 337 removing software with uninstaller commands 134 storage driver configuration parameters 328 BR0054504 00 A Installation Guide BR Series Adapters WinPE 34 60 creating ISO image 242 ISO image 240 WMI support 34 WoL support 13 369 BR0054504 00 A Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway Aliso Viejo CA 92656 949 389 6000 www qlogic com QLOGIC International Offices UK Ireland Germany France India Japan China Hong Kong Singapore Taiwan 2014 QLogic Corporation Specifications are subject to change without notice All rights reserved worldwide QLogic the QLogic logo and AnylO are trademarks or registered trademarks of QLogic Corporation Brocade Fabric OS Pentium is a registered trademark of Intel Corporation Windows Windows Server 2003 Windows Server 2008 R2 Vista XP PE for Windows Hyper V for Windows Windows Automated Installation Kit WAIK and Windows 7 Internet Explorer are trademarks or registered trademarks of Microsoft Corporation Solaris is registered trademark of Oracle Corporation Red Hat Enterprise Linux R
266. indows SBS 2011 x64 Windows XP Windows Vista Windows Server 2012 x64 Linux RHEL 5 7 5 8 5 10 6 2 6 3 6 4 and 6 5 x86 and x64 Be sure to use the x64 software installer for Linux x64 systems Linux SLES 10 3 10 4 11 1 and 11 2 x86 and x64 Solaris 10 11 except Open Solaris x86 x64 and SPARC 74 BR0054504 00 A 1 Product Overview Adapter software B ESXi 5 0 and 5 1 x64 a Oracle Linux OL 5 9 5 10 6 4 and 6 5 x86 and x64 Specific operating system service patch levels and other patch requirements are detailed in the current release notes for your adapter software version HCM and BNA support on ESXi systems Through the QLogic BR Series Adapters ESXi Management feature ESXi systems can support HCM and the Brocade Network Advisor BNA when CIM Provider is installed on these systems This feature will not support collecting Support Save data or updating boot code through HCM or BNA The following options are available to update boot code W Use the Live CD ISO file that you can download from the QLogic Web Site at http driverdownloads glogic com For instructions on using the LiveCD refer to Boot systems over SAN without operating system or local drive on page 240 W Update boot code through the CIM Provider software update subprofile For installation and other information on CIM Provider reference the following publications W CIM Provider for QLogic BR Series Adapte
267. ing options with your system s UEFI setup screens refer to Using UEFI setup screens on page 199 For general configuration procedures for booting over SAN refer to Configuring boot over SAN on page 211 The BR 804 Adapter is not supported on UEFI systems Booting from direct attach storage You can use QLogic HBAs and Fabric Adapter ports configured in HBA mode to boot a host s operating system Windows Linux or VMware from a remote boot device directly attached to the host system instead of the host s local disk Specifically this boot device is a logical unit number LUN located on a storage device The QLogic BR Series Adapter provides boot support in loop and point to point topology for QLogic BR Series Adapters installed in x86 and x64 host platforms The default topology on the adapter port is set to point to point The Fabric Discovered Auto discovery mechanism and 16 Gbps speed to the loop are not supported QLogic supports the following topologies in direct attach configuration for boot over SAN W Fiber channel arbitrated loop FC AL B Point to point p2p QLogic supports FC AL with driver version 3 1 0 0 and higher Point to point direct attach topology has been supported since version 2 0 0 0 QLogic supports the following adapters m BR 825 and BR 815 HBAs BW BR 1860 Fabric Adapter ports configured in HBA mode 207 BR0054504 00 A 4 Boot Code Boot over SAN To configure boot over SA
268. ing the port mode through UEFI is only supported on Fabric Adapters For more information on using BCU commands and HOM refer to the QLogic BR Series Adapter Administrator s Guide For more information on using UEFI setup screens for the QLogic BR Series Adapter refer to Configuring UEFI on page 255 As general steps to change a port s operating mode perform the following steps 1 2 Change the mode using BCU commands HCM or UEFI setup screens Make sure the appropriate SFP FC or 10 GbE transceiver and driver packages are installed to operate the port in the selected mode if they are not already installed Refer to Table 1 10 on page 83 for information on drivers Power cycle the host system Dynamically changing the port mode is equivalent to plugging in a new device in the system so the system must be power cycled for this configuration change to take effect 4 BR0054504 00 A 1 Product Overview Fabric Adapters For Windows systems you must install the drivers for the new mode after the system is power cycled This is not required if the appropriate driver is already preinstalled in the system When you change the port mode the port resets to factory defaults for physical functions PFs associated with the mode refer to Factory default PF configurations on page 28 For details on configuring ports for different operating modes refer to the QLogic BR Series Adapter Administrator s Guide
269. inux driver configuration with ethtool Following are examples of using the ethtool K commands to change adapter settings for driver parameters TCP UDP Checksum Offload To enable or disable TCP UDP checksum offload enter the following command ethtool K offload ethX rx on off tx on off where ethx Adapter position in server For example ethO is the first Ethernet interface found in the system eth1 is the second eth2 is the third and so on Use appropriate name for the adapter rx Heceive tx Transmit TCP Segmentation Offload TSO ethtool K ethX tso on off where ethx Adapter position in server For example ethO is the first Ethernet interface found in the system eth1 is the second eth2 is the third and so on tso TCP Segmentation Offload Display current offload settings enter the following command ethtool k ethX where ethx Adapter position in server For example ethO is the first Ethernet interface found in the system eth1 is the second eth2 is the third and so on 341 BR0054504 00 A A Adapter Configuration Network driver parameters Interrupt Moderation ethtool C vmnicX adaptive rx onl off where ethx Adapter position in server For example ethO is the first Ethernet interface in the system eth1 is the second eth2 is the third and so on For more information on using the ethtool command refer to your Linux system documentation or ethtool man pages
270. ions to use QLogic installation scripts and host operating system commands and tools to install remove and upgrade individual driver package components described under Driver packages on page 75 You can use these steps for installing software on your system instead of using the QLogic Adapter Software Installer To upgrade existing software using the QLogic Adapter Software Installer refer to Using the GUl based installer on page 114 Instructions are provided in this section for the following tasks B Selectively installing network drivers storage drivers and utilities to Windows Linux and VMware systems using QLogic installation scripts W Installing driver packages on Solaris systems using native system installer commands 138 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Software installation and removal notes The following steps assume that the host s operating system is functioning normally and that all adapters have been installed in the system When upgrading Windows drivers install the new driver without first removing the existing driver This is the is recommended procedure Software installation or upgrade on a host system with a large number of adapters could take much longer than normal Download the driver package for your host system operating system and platform from the QLogic Web Site at http driverdownloads qlogic com Refer to S
271. isabling the devices will disrupt adapter connectivity W To find out if the driver has unloaded successfully after disabling the host bus adapter or CNA devices in the Device Manager run any BCU command This should result in an Error No QLogic HBA Found or Error No QLogic CNA Found message If the driver did not unload for some reason the BCU command should complete normally W lf the device icon display in Device Manager does not change to indicate that each HBA port device is disabled and if a message displays when you attempt to disable the devices that your hardware settings have changed and you must restart your computer for changes to take effect confirm that the hcmagent exe QLogic HCM Agent Service is not running on the host and that there are no open handles to file systems on disks accessed through the adapter Configuration using Registry Edit tool Following are example steps to modify the rport del timeout parameter using the rport del timeout parameter 1 Pak WD Navigate to the following location For HBA FC the registry is HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services bfad Para meters Device For CNA FCoE the registry is HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services bfadfcoe Parameters Device Click rport del timeout Click Edit Modify For Value data enter 60 Click OK Use the following steps to reload the driver and reinitialize the driver parameters from the modifi
272. its O indicates that no such substances are used or that the concentration is within the aforementioned limits 304 BR0054504 00 A 5 Specifications Regulatory compliance Safety ARSASMARASHAHRER 18 33 P E BS lt lt F 5 BT 7 Ri il BBD gt gt SBP WBS 39 58 RORRAAP ARE mPUREANASWR HS HAMREBKTH ES CHINA ROHS HEB ISI H S S REIR ESB E 8 B 5 V S oS 8 E E ACME BRR 2iR CEB Pb Hg Cd CR6 PBB PBDE HEPES VAL X o O o O O RU 8104 3E X E e 2 ii 9 A ERAS SBE 9 9 a 9 9 MARENE X 9 o 9 P Q HBA USB NTA o o o 9 o o BA X O O O O O O SFP XF X o o o o 9 x G4 X Oo O Oo Oo O HER X o o o o O WRR BB P 2 2 iu JE 1828 7e VI X o O 0 O O Lp 5 3 X Oo O Oo Oo O NAE O O O O O Oo oe oe DAPA O O O Oo O O 4 UT X o O O O O PE SHE o o O 9 o O X SR HESS BEDA 3 EUER SERE RESET SJ 11363 2006 HRE ZR 0 RAAB Rice np e EC SKF EXRIR EE SER Because these boards are installed in a PCle bus slot all voltages are below the SELV 42 4 V limit The adapters are recognized per Bi Nat UL CSA 60950 1 1st Ed or later for use in the US and Canada They also comply with IEC 60950 1 and EN60950 1 A CB Scheme certificate is available upon request 305 BR0054504 00 A 5 Specifications Regulatory compliance Mezzanin BR 804 HBA e adapters The regulatory information in this section pertains to the following mezzanine adapters M
273. iver firmware and HCM agent for specific operating systems Make sure the correct package is installed for your operating system Current driver packages are listed under Software installation and driver packages on page 81 An out of date driver may cause the following problems W Storage devices and targets not being discovered by device manager or appearing incorrectly in the host s device manager B Improper or erratic behavior of HOM installed driver package may not support HCM version Host operating system not recognizing adapter installation Operating system errors blue screen If the driver is not installed try re installing the driver or re installing the adapter hardware and then the driver You can use HCM and tools available through your host s operating system to obtain information such as driver name driver version adapter WWN adapter PWWNS firmware name and version and current BIOS version Confirming driver installation with HCM Following is the HCM procedure to display adapter information 1 Launch HOM 2 Select the adapter in the device tree 3 Select the Properties tab in the right pane to display the Properties dialog box The dialog box displays adapter properties 171 BR0054504 00 A 3 Software Installation Confirming driver package installation Confirming driver installation with Windows tools You can use two methods to determine driver installation depending on your
274. just use the bfa ISO image Note that you can use the VMware Image Builder PowerCLI to create a brocade esx50 version zip offline bundle and brocade esx50 version iso ESXi 5 0 installation image that includes QLogic drivers and utilities Refer to your Image Builder documentation for details on using Image Builder PowerCLI Refer to Boot installation packages on page 88 for a list of driver update files and the operating systems that support these files Also refer to Host operating system support on page 70 for information on operating system support for adapter drivers 229 BR0054504 00 A 4 Boot Code Boot over SAN 10 11 Download the QLogic BR Series Adapter driver update iso file appropriate for your system from the QLogic Web Site using the following steps a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column VMware ESX ESXi in the third column and then click Go c Click the Driver Update Disks link at the top of the page to direct you to the DUD zip file d Locate the DUD link for your adapter in the table click on it and following the instructions Create a Fibre Channel driver CD or USB drive from the ISO image This will contain the appropriate VMware drivers for the system Insert the ESX OS disk into the host system When prompted for an upgrade or install
275. k All LEDs flashing green Beaconing is enabled on the port 1 sec on 250 msec off All LEDs flashing green End to end beaconing is enabled for connected switch 50 msec on and HBA port 50 msec off 350 msec off 4 Gbps LED flashes amber Unsupported SFP transceiver Appropriate Brocade branded SFP transceiver is not installed 294 BR0054504 00 A 5 Specifications Host Bus Adapters Environmental and power requirements This section provides environmental and power specifications for the stand up and mezzanine HBAs Stand up HBAs Table 5 18 provides environmental and power specifications for the stand up HBAs Table 5 18 Environmental and power requirements Property Requirement Airflow None required Operating temperature dry bulb 0 C to 55 C 32 F to 131 F Nonoperating temperature dry bulb 43 C to 73 C 40 F to 163 F Operating humidity 5 to 93 relative noncondensing Nonoperating humidity 5 to 95 relative noncondensing Power dissipation 6 3W Maximum not including SFP transceiver Operating voltage Per PCle 2 0 specifications Mezzanine HBAs This section includes specifications for the mezzanine HBA models BR 804 Adapter The BR 804 mezzanine adapter conforms to environmental and power specifications for the supported blade servers and blade system enclosures in which they install Refer to the documentation provided for these products for information A
276. latory compliance Communications Commission KCC statement This is the Republic of Korea Communications Commission KCC regulatory compliance statement for Class B products Class B device Broadcasting Communication Device for Home Use This device obtained EMC registration mainly for home use Class B and may be used in all areas BS JZS SSSA ol FIVIE 73863 AAUHHSSS HITZ FZ 7L HAMA Sse RS Sez SH SE ASHMASSE WSU VCCI statement Japan This is Class B product based on the standard of the Voluntary Control Council For Interference by Information Technology Equipment VCCI If this equipment is used near a radio or television receiver in a domestic environment it may cause radio interference Install and use the equipment according to the instruction manual CORB FRUBRESRRREAERHM BRS VCCI OY CHOC VO ABRREMRATCT CORBI ERATEN EAWELTHIETM COBBMIVACFTL EV a VRR T ERNAL BRE SSARCTCEMSVETF RR AB iio CIEL 3 OdRU URL CF EU BSMI warning Republic of Taiwan Bates jae HERBES CENA PRES ERITA FR TERRAN T SRA SREKRRRL ESR Bir 299 BR0054504 00 A 5 Specifications Regulatory compliance CE statement This is a Class B product In a domestic environment this product might cause radio interference and the user might be required to take corrective measures The standards compliance label on the adapter contains the CE mark which indicates that this system conforms to the provisions
277. lified and transparent procedure for configuring the boot LUN Once configured the HBA boot code queries the zone member list for the zone name matching the HBA PWWN to determine the boot target and LUN For details on this command and additional parameters refer to the Fabric OS Command Reference Guide Using BCU boot blunZone command Use the Fabric OS zoneCreate command to create a zone on the switch where the adapter is connected zonecreate zonename member member WB The zonename operand will be BFA_ adapter port WWN BLUN For example if the adapter PWWN is 01 00 05 1E 01 02 03 04 the zone name will be the following BFA 0100051E01020304 BLUN m The zone member operands must be specially coded values for the target PWWN and LUN identification for example 06 00 00 02 DD EE FF 00 To obtain the zoneCreate operand values you will run the BCU boot blunZone command from your host system s command line Use the following steps to configure fabric based boot LUN discovery 1 Set the adapter s BIOS configuration to fabric discovered using one of the following interfaces B BIOS Configuration Utility Adapter Settings gt Boot LUN gt Fabric Discovered 235 BR0054504 00 A 4 Boot Code Fabric based boot LUN discovery B HCM Basic Port Configuration gt Boot over SAN gt Fabric Discovered m BCU bios enable port_id o auto Enter the following BCU command to provide the
278. link at the top of the page to direct you to the driver or boot code packages 4 Locate the driver or boot code package for your adapter in the table click on it and then follow the directions b Upgrade your adapter and boot code if necessary using the following steps 1 Driver package Refer to Using software installation scripts and system tools on page 138 2 Boot code Refer to Boot code updates on page 189 Use your host system s boot menu to enable the system to boot from the CD DVD diskette and then the appropriate adapter If multiple adapters are installed on your system be sure to configure the system to boot from the appropriate adapter first in the boot order Booting from the CD DVD and diskette first allows you to install the host operating system and adapter driver on the boot LUN but you may change this after installation Depending on your host system you may need to enable booting from the adapter in your system boot menu or you may need to disable the host s hard drive to boot from the adapter If you need to disable the system s hard drive to allow booting from the adapter and wish to utilize both the boot from SAN feature and your system s hard drive refer to your system documentation Procedures for this configuration are beyond the scope of this publication Verify that the appropriate storage device is connected to the fabric and functioning This device must have at least one LUN available t
279. ll adapter software in host system Step 2 3 Verify latest adapter driver installed in host system Y Verify latest BIOS version on installed adapter Step 4 Install latest boot code and adapter driver if needed Y Y Step 5 Configure host system to boot from adapter Step 6 8 for boot over SAN Y Bind adapter PWWN to available LUN Step 9 Create target zone in fabric containi adapter port PWWN and LUN storage Are you installing adapter in UEFI based host system Step 10 Configure BIOS for booting over SAN Step 12 Configure LUN for booting from host system ng port Configure UEFI for booting over SAN Step 11 Y Step 13 and necessary files on boot LUN Step 14 Optional Install full driver package on boot LUN Install adapter drivers host operating system Step 15 Boot host system from storage boot device Figure 4 3 Configuring boot over SAN 212 BR0054504 00 A 4 Boot Code Boot over SAN Procedures The following procedures are illustrated in the flow chart in Figure 4 3 on page 212 You may be referenced to more detailed sections of this chapter to complete some of these steps 1 4 Install the adapter and software into the host system using instructions in 2 Hardware Installation and 3 Software Installation Verify that the adapter contains the latest BIOS
280. llowing information when installing and using QLogic host bus adapter mezzanine adapters 25 BR0054504 00 A 1 Product Overview Host Bus Adapters BR 804 host bus adapters The BR 804 mezzanine host bus adapter is compatible with blade servers switch modules interconnect modules and other components that install in supported blade system enclosures For details on blade servers and system enclosures that are compatible with this adapter refer to the following B Manufacturer web sites for these products W Your blade server or blade system enclosure marketing representative or authorized reseller Documentation provided for your blade server blade system enclosure and enclosure components BR 1867 and BR 1869 host bus adapter Consider the following points when installing these mezzanine adapters in compute nodes and Flex System chassis B X Visitthe manufacturer web sites for these products In addition you can also contact your compute node or system chassis marketing representative or authorized reseller m These mezzanine adapters are compatible with the devices that install in the supported system chassis such as the following C Compute nodes Q Pass thru modules Q I O modules m Switch modules NOTE For detailed information about these modules see the installation and user guides and interoperability guides provided for these modules and the blade system enclosure m The maximum number of ad
281. low you to perform the following tasks a Enable or disable BIOS When enabled the system BIOS can execute the BIOS code for a specific adapter port for PXE boot over the network m Seta VLAN ID to be used during network boot for the specific port Refer to Configuring network boot on page 196 for details Driver support for network boot Refer to Boot installation packages on page 88 Table 1 11 on page 91 for applicable DUDs for supported operating systems Notes following the table identify DUDs that support network boot Consider the following about network driver support for different operating systems m Linux RHEL For supported versions earlier than RHEL 5 7 the nw network drivers ISO file supports network PXE boot Install these drivers after the fc Fibre Channel storage ISO file For RHEL 5 7 and later network drivers and storage drivers are part of a single unified ISO package m Linux SLES Network and storage drivers are part of a single ISO package B VMware ESX Network and storage drivers are part of a single ISO package 195 BR0054504 00 A 4 Boot Code Network boot Host system requirements for network boot Consider these requirements for your host system when configuring network boot B You may need to disconnect internal IDE hard drives to disable them in the system BIOS and allow the adapter boot BIOS to boot from the remote system Some systems may allow these drives to be en
282. lso refer to Server blades and system enclosures mezzanine adapters on page 16 295 BR0054504 00 A 5 Specifications Host Bus Adapters BR 1867 Adapter Table 5 19 lists environmental power and other specifications for the BR 1867 HBA Table 5 19 Environmental and power requirements for BR 1867 mezzanine card Property Requirement Airflow Provided by blade system enclosure Operating altitude 3 050 meters 10 000 ft Operating temperature 10 to 35 C 50 to 95 F Nonoperating temperature 5 to 45 C 41 F to 113 F Operating humidity 20 to 80 Nonoperating humidity 8 to 80 Power dissipation 8 5 W maximum 8 W nominal Operating voltage Per PCle 2 0 specifications Dimensions Approximate height 4 16 cm 1 64 in Approximate width 8 48 cm 3 34 in Approximate depth 10 64 cm 4 19 in Weight 240 grams 31 Ib The BR 1867 adapter conforms to environmental and power specifications for the supported compute node and chassis where the adapters install Refer to the documentation provided for these products for information Also refer to Server blades and system enclosures mezzanine adapters on page 16 for references to adapter compatibility information 296 BR0054504 00 A 5 Specifications Fibre Channel standards compliance BR 1869 Adapter Table Table 5 20 lists environmental power and other specifications for the BR 1869 Adapter Table 5 20 Environmental and power re
283. lticast packets received Number of broadcast packets received Link Toggle count Number of packets dropped Number of packets not transmitted Number of bytes received Number of packets received Number of bytes transmitted Number of packets transmitted Number of packets received with CRC errors Number of heartbeat errors VLAN adapter Index VLAN port Index Index of the interface VLAN identification Number of packets transmitted Number of packets received Number of transmission errors Number of receive errors 357 BR0054504 00 A B MIB Reference Table B 1 Supported MIB groups and objects for SNMP Continued Group Statistics Group Team Statistics Traps and Events Group MIB Objects tsTeamld teamTxPackets teamRxPackets teamTxErrors teamRxErrors vLANAddedTrap vLANRemovedTrap teamMemberAddedTrap teamMemberRemovedTrap teamFailoverTrap teamFailbackTrap teamvLanAddedTrap teamvLanRemovedTrap teamAddedTrap teamRemovedTrap LinkUp supported by native SNMP service LinkDown supported by native SNMP service Function Index of the team member Number of packets transmitted Number of packets received Number of transmission errors Number of receive errors VLAN added VLAN removed Team member added Team member removed Team failover Team failback Sends the trap when a VLAN is added to a team Sends the trap when a VLAN is removed from a team Team a
284. ltimode fiber stand up adapters Topology Fibre Channel Point to Point N Port Fibre Channel Switched Fabric N Port Fibre Channel Arbitrated Loop FC AL standup adapters only Protocols W SCSI over FC FCP W FCP3 initiator mode only W FC SP Authentication W NPIV 290 BR0054504 00 A 5 Specifications Host Bus Adapters Table 5 15 Supported Fibre Channel features Continued Feature Description Other features ASIC Flip flops Parity Protected ECC Memory Parity Protected Quality of Service QoS Target rate limiting Boot over SAN Fabric Based Boot LUN Discovery I O Interrupt Coalescing T10 Data CRC Multiple Priority VC_RDY Frame Level Load Balancing Persistent Binding Fabric Based Configuration For stand up HBAs use only Brocade branded SFP laser transceivers supplied with this product 291 BR0054504 00 A 5 Specifications Host Bus Adapters Cabling stand up adapters Table 5 16 summarizes maximum distances supported for different fiber optic cable types This table assumes a 1 5 dB connection loss and an 850 nm laser source Table 5 16 Fibre Channel transceiver and cable specifications OM1 M6 OM2 M5 OMS3 M5E OM4 M5F Single Eo 62 5 125 50 125 50 125 50 125 Mode Media micron micron micron micron 9 microns SWL 2Gbps 150m 492ft 300m 984ft 500m 1640ft N A N A SWL 4Gbps 70m 229ft 150m 492ft 380m 1 264ft 400m N A 1 3
285. ltiple queues for sending priority tagged packets refer to Network driver parameters on page 332 Transmit NetQueues with multiple priorities allow VMware v4 1 or later to assign different priorities to transmit NetQueues to ensure QoS for different classes of traffic on an ESX host Multiple transmit priorities are supported in the following ways on QLogic BR Series Adapters C On CNAs and Fabric Adapter ports configured in NIC mode all eight priorities can be assigned to transmit NetQueues by VMware CQ On CNAs only every request to assign a priority different from the default network priority will be denied If a storage priority is reserved one non default priority could be assigned to a transmit NetQueue J On Fabric Adapter ports configured in CNA mode only allowed priorities can be assigned to transmit NetQueues by VMware Requests for a priority are denied if the priority matches a reserved storage priority MSI X This is an extended version of Message Signaled Interrupts MSI defined in the PCI 3 0 specification MSI X helps improve overall system performance by contributing to lower interrupt latency and improved utilization of the host CPU MSI X is supported by Linux RHEL5 RHEL 6 SLES 10 and 11 Windows Server 2008 R2 and later ESX 5 0 and ESX 5 5 43 BR0054504 00 A 1 Product Overview Adapter features Network Boot PXE and UNDI The preboot execution environment PXE mechanism embedded in the
286. m sh brocade_adapter_software_installer_linux_ lt version gt bin Install drivers and HCM GUI in silent mode no interaction required sh brocade_adapter_software_installer_linux_ lt version gt exe i silent Install drivers and the HCM GUI using a default installation properties file sh brocade adapter software installer linux version bin f HCMDefaultInstall properties 121 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Install software in silent mode using default installation properties file Note that this is recommended for silent mode shbrocade adapter software installer linux version bin i silent f HCMDefaultInstall properties Install noarch driver in silent mode when kernel specific driver is not available and select to install HCM GUI or both sh brocade adapter software installer linux version bin DCHOSEN INSTALL SET DRIVER GUI BOTH DCONT NOARCH DRIVER NO YES i silent Install drivers HCM GUI or both Overwrites the backed up initrd file sh brocade adapter software installer linux version bin DCHOSEN INSTALL SET DRIVER GUI BOTH DFORCE INITRD BACKUP NO YES i silent W Solaris systems m x_86 platforms Install drivers HCM GUI or both Overwrites the existing driver installed on system sh brocade_adapter_software_installer_solaris_x86_ lt version gt bin Install drivers and HCM
287. m disable hcmagentservice 184 BR0054504 00 A 3 Software Installation HCM Agent operations Changing the default communication port 1 Change to the agent installation directory default is opt brocade adapter hbaagent conf 2 Edit abyss conf to change the entry SecurePort 34568 to any other nonconflicting TCP IP port for example SecurePort 4430 Windows systems Use the following options Determining agent operation 1 Runthe services msc command to display the Services window 2 Right click Brocade HCM Agent Service and select Status Starting the agent agent will not restart if system reboots or agent stops unexpectedly 1 Runthe services msc command to display the Services window 2 Right click Brocade HCM Agent Service and select Start Starting the agent agent restarts if system reboots 1 Runthe services msc command to display the Services window 2 Right click Brocade HCM Agent Service and select Start 3 Right click Brocade HCM Agent Service and select Properties 4 Select the Automatic option in Startup type 5 Click OK Stopping the agent 1 Runthe services msc command to display the Services window 2 Right click Brocade HCM Agent Service and select Stop Stopping the agent from restart after system reboots 1 Runthe services msc command to display the Services window 2 Right click Brocade HCM Agent Service and select Stop 3 Right click Brocade HCM Agent Service and select Properties 4
288. m number of FCP IO requests num rports 1024 Limits the number of logins to targets on a port includes physical port and logical ports num sgpgs 2048 Maximum number of scatter gather pages num tms 128 Maximum number of task management commands num ufbufs 64 Maximum number of unsolicited Fibre Channel receive buffers os name NULL OS name os patch NULL OS patch level pcie max read re 0 Wait time for the port to be online 0 indicates use qsz system setting reqq_size 256 Number of elements in each request queue used for driver to firmware communication rport del timeout 90 Delay in seconds after which an offline remote seconds port will be deleted rspq size 64 Number of elements in each request queue used for firmware to driver communication vmklnx multiq 1 Module parameter provided to enable 1 or disable 0 the MultiQueue feature 326 BR0054504 00 A A Adapter Configuration Storage driver level parameters Managing Linux driver configuration Either the driver configuration parameter values can be loaded with the driver or can be set in etc modprobe conf before loading the driver Display current driver configuration settings using the following command cat sys module bfa parameters parameter Examples Following are examples to set the LUN queue depth W Load driver with the parameter value modprobe bfa bfa lun queue depth 40 B Add the following entry in e
289. m that requires user interaction Executing the following commands without parameters will launch the GUI based uninstaller described under Using the QLogic Software Uninstaller on page 130 Windows systems Uninstall bat Linux and Solaris systems sh Uninstall sh Execute these same commands on the host system s command line with various parameters to automatically remove the network and storage driver packages HCM application or both without requiring further user interaction Windows systems Uninstall bat DCHOSEN INSTALL SET DRIVER GUI BOTH DEBUG true false i silent Linux and Solaris systems sh Uninstall sh DCHOSEN INSTALL SET DRIVER GUI BOTH DEBUG true false i silent where 133 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer DCHOSEN INSTALL SET specifies to remove either the network and storage driver packages the GUI HCM or all components DEBUG specifies whether the debug log messages are needed Possible values are true or false i silent specifies that the uninstallation mode is silent Important notes Review these notes before using the software uninstaller commands If you choose to remove the driver both the storage and network drivers are removed Parameters are case sensitive To enter uninstaller commands first change to the directory where the adapter software is installed cd
290. m the QLogic Web Site at http driverdownloads glogic com whenever you install or update adapter driver packages Refer to Boot code updates on page 189 for update instructions 136 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Software downgrade using the QLogic Adapter Software Installer Although driver and HCM downgrades are not supported the following procedures are recommended for downgrading between versions 3 2 3 0 2 3 2 2 2 1 2 0 and 1 1 Downgrading the driver is not supported when downgrading from 3 2 1 to earlier versions However it is possible to restore the v3 2 1 configuration for v2 3 if you explicitly save the configuration before removing 3 2 1 and installing v2 3 Downgrading HCM only or HCM and driver Use the following procedure to successfully downgrade HCM since its configuration is not automatically persisted during a downgrade using the QLogic Adapter Software Installer QASI Back up data Use the following steps to back up HCM data 1 Uninstall the existing higher version of HCM using instructions under Software removal using Adapter Software Uninstaller on page 130 When the message displays prompting you to back up the HCM configuration refer to HCM configuration data on page 186 select Backup to continue When the default backup directory location displays you can select a different location for the backup data
291. mage for your system using steps under Creating a WinPE image on page 242 Create a bootable CD or USB drive using the ISO image Refer to the documentation for your CD or USB drive burning software for details As an example of open source USB burning software for bootable Live USB drives refer to http unetbootin sourceforge net Install the CD into the CD DVD ROM drive or USB drive into a USB port and boot the system When self testing completes access you system s boot manager menu and select the option to boot from the appropriate CD or USB drive Follow on screen prompts and instructions to boot from the CD or USB drive Access your system s command shell so that you can use BCU commands Refer to Using BCU commands on page 93 for more information To update adapter boot code refer to steps under Updating boot code with BCU commands on page 192 To configure boot from SAN on an installed adapter refer to Configuring boot over SAN on page 211 and Configuring BIOS with HCM or BCU commands on page 254 241 BR0054504 00 A 4 Boot Code Boot systems over SAN without operating system or local drive 9 To install the operating system and driver to a remote boot LUN refer to Configuring boot over SAN on page 211 and Operating system and driver installation on boot LUNs on page 217 Creating a WinPE image Microsoft Windows Preinstallation Environment Windows PE is a bootable tool that pr
292. mentation page http driverdownloads glogic com Type the QLogic model name in the search box In the search results list locate and select the firmware software or documentation for your product 4 View the product details Web page to ensure that you have the correct firmware software or documentation For additional information click Read Me and Release Notes under Support Files 5 Click Download Now Save the file to your computer If you have downloaded firmware software drivers or boot code follow the installation instructions in the Readme file Instead of typing a model name in the search box you can perform a guided search as follows 1 Click the product type tab Adapters Switches Routers or ASICs 2 Click the corresponding button to search by model or operating system 3 Click an item in each selection column to define the search and then click Go 4 Locate the firmware software or document you need and then click the item s name to download or open the item XX BR0054504 00 A Installation Guide BR Series Adapters Preface Training Technical Support QLogic Global Training maintains a Web site at www glogictraining com offering Online and instructor led training for all QLogic products In addition sales and technical professionals may obtain Associate and Specialist level certifications to qualify for additional benefits from QLogic Contact Information QLogic Technical Su
293. meters 16 4 feet maximum Any switch compatible with the adapter Any switch compatible with the adapter Any switch compatible with the cable Any switch compatible with the cable Any switch compatible with the cable For adapters releases 3 0 3 0 and later active twin axial copper cables supplied by vendors other than QLogic can be used but the cables are not supported 15 BR0054504 00 A 1 Product Overview Converged Network Adapters Host systems and switches stand up adapters QLogic CNAs must connect to Fibre Channel SANs and Ethernet data networks through a compatible switch that supports Data Center Bridging DCB Server blades and system enclosures mezzanine adapters Consider the following points when installing mezzanine adapters in blade servers and system enclosures or chassis W For information about the system enclosures and enclosure components such as server blades I O modules switch modules and optional devices that are compatible with the adapter visit the manufacturer websites for these products You can also contact your server blades or system enclosure marketing representative or authorized reseller B To support each I O module that you install in the system enclosure you may also need to install a compatible adapter in each server blade that you want to communicate with the I O module Also the adapter may only support switch modules or blades in specific I O bay
294. moderation 40 IPFC driver 35 iSCSI over CEE 40 ISO file adapter software 82 89 driver update disk 89 LiveCD 89 J jumbo frame enable for Solaris 352 jumbo frames 38 K KCC statement 1741 adapters 307 stand up adapters 299 L laser compliance 300 LED operation CNA 283 Fabric Adapter 274 HBA 293 Legacy BIOS support 204 Legacy BIOS support for boot over SAN 204 BR0054504 00 A Installation Guide BR Series Adapters Linux installing Linux 6 x on boot LUN 224 installing RHEL 4 x and 5 x on boot LUN 220 installing SLES 10 and 11 on boot LUN 222 Linux systems 324 modifying agent operation 183 network driver configuration parameters 338 removing software with uninstaller commands 135 storage driver configuration parameters 324 upgrading drivers 149 LiveCD image 241 LiveCD ISO file 89 240 LLDP 43 look ahead split 48 LUN masking 36 59 MAC addressing 39 311 MAC filtering 43 MAC tagging 43 managing adapters 64 managing HBAs 68 managing NICs 68 mounting bracket CNA 277 Fabric Adapter standard 265 HBA low profile 14 21 install or remove 98 replacing 98 MSI X 43 60 multiple transmit priority queues 43 N N_ Port trunking 58 requirements 58 NDIS QoS 44 NetQueues 48 NetQueues and filters CNAs 350 Fabric Adapters 351 NetQueues configuring 349 network boot 44 configuring BIOS with BCU commands 201 configuring BIOS with HCM 200 configuring with BIOS utility 196 197 configuring with UEFI H
295. ms such as Windows Solaris and Linux platforms HCM is supported on VMware but only when installed on the guest operating system HCM is not supported on VMware ESXi systems HCM is compatible with any version of the driver package HCM can also manage the current version as well as all previous versions of the HCM agent The HCM agent is not supported on VMware ESXi systems but is supported on VMware ESX systems Boot code The adapter boot code supports the following WB PCI BIOS 3 1 or later Boot code for PCI system B SMBIOS specification version 2 4 or later System Management BIOS B BIOS Boot code for x86 and x64 platforms W Unified Extensible Firmware Interface UEFI Boot code for UEFI systems M Adapter firmware The adapter boot code loads from adapter memory into system memory and integrates with the host system server BIOS during system boot to facilitate booting from LUNs which are also referred to as virtual drives boot disks and boot devices To keep drivers and boot code synchronized be sure to update your adapter with the latest boot code image To download boot code go to http driverdownloads glogic com locate the boot code package by adapter type adapter model and operating system Starting with Adapters v3 2 3 0 and later patch versions of adapter driver firmware will be available in boot code for updating installed adapters 80 BR0054504 00 A 1 Product Overview
296. msix disable value range 0 1 default 0 B key f dmi enable value range 0 1 default 1 330 BR0054504 00 A A Adapter Configuration Storage driver level parameters Solaris driver configuration parameters Table A 4 describes the Solaris configuration parameters BR 804 BR 1007 and BR 1867 adapters are not supported on Solaris systems Table A 4 Solaris driver configuration parameters Parameter Detauit Notes value ioc auto recover 1 Auto recover IOC IO controller on heartbeat failure msix disable 1 Disable MSIx interrupt and use INTx num fcxps 64 Maximum number of unassisted Fibre Channel exchanges num ios 512 Maximum number of FCP IO requests num rports 512 Maximum number of remote ports num sgpgs 512 Maximum number of scatter gather pages num tms 128 Maximum number of task management commands num ufbufs 64 Maximum number of unsolicited Fibre Channel receive buffers reqq size 256 Number of elements in each request queue used for driver to firmware communication rspq size 64 Number of elements in completion queues used for firmware to driver communication 331 BR0054504 00 A A Adapter Configuration Network driver parameters Managing Solaris driver configuration parameters To modify any driver parameter values use the following steps 1 Edit kernel drv bfa conf For example to set the number of FCP IO requests use the following num ios 600 2 When y
297. n Using the QLogic Software Uninstaller Use the following steps to remove software that was installed with the GUI based QLogic Adapter Software Installer native system scripts and system commands Instructions are provided for Windows Linux and Solaris systems 130 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Also use these procedures if HCM is installed on VMware and VMware operates as a guest on your Windows system 1 Perform one of the following steps depending on your host operating system For Windows systems perform one of the following steps Select QLogic Adapter Software from the Windows Start menu and then select Uninstall QLogic Adapter Software To use the command line use the following steps a Atthe command line change to the directory where the installer is located cd install directory NUninstallBrocade Adapter Software version The default install directory is C Program FilesiBROCADE Adapter b Enterthe following command to launch the QLogic Adapter Software Uninstaller Uninstall bat For Linux and Solaris systems perform the following steps a Change to the directory where the Adapter Software Installer application is installed using the following command cd install directory UninstallBrocade Adapter Software version where install directory gt default install directory is lopt brocade a
298. n installed adapter you can download Linux LiveCD ISO images or create WinPE ISO images to boot the server and then use BCU commands to update the boot code For instructions on using these ISO images refer to Boot systems over SAN without operating system or local drive on page 240 190 BR0054504 00 A 4 Boot Code Boot code updates Updating boot code with HCM Follow these steps to upgrade adapter flash memory with the latest boot code Updating boot code through HCM is not supported on VMware ESXi servers Use the BCU boot update command instead Refer to Updating boot code with BCU commands on page 192 1 Download the boot code image zip file brocade adapter boot fw version zip from the QLogic Web Site using the following steps a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go c Click the Boot Code link at the top of the page to direct you to the boot code packages d Locate the boot code package for your adapter in the table click on it and then follow the directions 2 Extract the boot code image file Launch HCM 4 Selecta host on the device tree and then select Adapter Software from the Configure menu The Adapter Software dialog box displays 5 Enter the filename of the boot image i
299. n operates on systems specified under Table 1 10 on page 83 To use the command line version of this application refer to Software installation using Software Installer commands on page 120 The Adapter Software Installer installs HCM all driver packages and management utilities based on your host operating system The HCM Agent starts automatically after installation You can also install software components using software installer scripts and native system commands refer to Using software installation scripts and system tools on page 138 The QLogic Adapter Software Installer QASI is not supported on VMware ESX platforms However you can use the appropriate QLogic Adapter Software Installer to install HCM to a guest system Windows Linux or Solaris To install adapter drivers on VMware systems refer to Using software installation scripts and system tools on page 138 Use the following steps to install all software required for QLogic BR Series Adapters with the GUI based installer program It is strongly recommended that you shut down the HCM application if it is running on your system To download the Adapter Software Installer 1 Goto the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 3 Click the Software
300. n the Boot Image File text box OR Click the Browse button and navigate to the location of the file to update 6 Click Start Update The selected file downloads If an error occurs during the downloading process an error message displays 7 Review the installation progress details that display in the dialog box to determine if the files install successfully 8 Reboot the system 191 BR0054504 00 A 4 Boot Code Boot code updates Updating boot code with BCU commands Use the following procedure to update boot code using BCU commands 1 Download the boot code image zip file brocade_adapter_boot_fw_version zip from the QLogic Web Site to a folder on your local drive using the following steps a Goto the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go c Click the Boot Code link at the top of the page to direct you to the boot code packages d Locate the boot code package for your adapter in the table click on it and then follow the directions Extract the boot code image file Enter the following BCU command bcu boot update image file a where ad id lD of the adapter adapter image file Name of firmware image file a Indicates that the boot code should be updated on all installed QLogic B
301. nada European Union Austria Belgium Cyprus Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta Poland Portugal Slovakia Slovenia Spain Sweden The Netherlands and United Kingdom Japan Republic of Korea Russia Bi Nat UL CSA 60950 1 2nd Ed or latest cCSAus EN 60950 1 or latest TUV IEC60950 1 or latest GOST Mark EN55022 or CISPR22 or AS NZS CISPR22 C Tick Mark ICES 003 Class B CE EN55022 2006 Class B EN 55024 Immunity EN 61000 4 2 Electrostatic Discharge EN 61000 4 3 Radiated Fields EN 61000 4 4 Electrical Fast Transients EN 61000 4 5 Surge Voltage EN 61000 4 8 Magnetic Fields N A EN 61000 4 11 Voltage Dips and Interruptions EN 61000 3 2 Limits for Harmonic Current Emissions EN 61000 3 3 Voltage Fluctuations CISPR22 and JEIDA Harmonics VCCI B and Statement KN24 KN22 KCC Mark Class B 51318 22 99 Class B and 51318 24 99 or latest GOST Mark 301 BR0054504 00 A 5 Specifications Regulatory compliance Table 5 21 Regulatory certifications and standards Continued Country Safety specification ENC specification Taiwan United States CNS14336 94 Class B or latest BSMI Mark Bi Nat UL CSA 60950 1 2nd Ed CNS13438 95 Class B or latest BSMI Mark ANSI C63 4 or latest cCSAus FCC Class B and Statement Environmental and safety
302. nage VNICs on QLogic Fabric Adapter ports are supported on specific ports 0 or 1 when configuring from UEFI storage and network menus Refer to Table 4 2 for details Table 4 2 Fabric Adapter configuration support Port 0 Port 1 Mode Mode Storage Menu Network Menu Change Port Change Port VNIC Mode Mode Management PortO Porti oo O Port 1 Port0 Port1 HBA HBA Yes Yes N A N A N A8 N A HBA NIC Yes N A8 N A8 No N A8 No HBA CNA Yes Yes N A No N A No NIC HBA N A No Yes N A Yes N A NIC NIC N A N A Yes Yes Yes Yes NIC CNA N A8 No Yes Yes Yes Yes CNA HBA Yes Yes Yes N A Yes N A CNA NIC Yes N A Yes Yes Yes Yes CNA CNA Yes Yes Yes Yes Yes Yes 1 Adapter configuration is not supported in UEFI setup screens IBM Agentless Inventory Manager AIM support The IBM AIM framework queries updates the current HBA properties after the BOFM UCM phase The inventory information extracted from the HII database is translated to XML format by the AIM and the XML data is stored on the IMM The information retrieved includes the QLogic BR Series Adapter information about boot code firmware versions and supported characteristics PCI generic information network physical and logical port 259 BR0054504 00 A 4 Boot Code Alternate methods for configuring UEFI Alternate methods for configuring UEFI Depending on your UEFI based host system different tools may be available to
303. nding bar code are provided on the serial number label illustrated below This label is located on the adapter card INNA UA FTOOX0054E9 310 BR0054504 00 A 6 Adapter Support Providing details for support You can also display the serial number through the following HCM dialog boxes and BCU commands B q Adapter Properties tab in HCM Select an adapter in the device tree and then click the Properties tab in the right pane B BCU adapter list command This command lists all QLogic BR Series Adapters in the system and information such as model and serial numbers Port World Wide Name PWWN Determine the PWWN through the following resources W Label on the adapter card contains the PWWN for each port W BIOS Configuration Utility Select the appropriate adapter port from the initial configuration utility screen and then select Adapter Settings to display the WNN and PWWN for the port For details refer to Configuring BIOS with the BIOS Configuration Utility on page 246 B Port Properties tab in HCM Select a port for a specific adapter in the device tree and then click the Properties tab in the right pane m The following BCU commands LC port query port_id Displays port information including the PWWN for the FCoE port The port id parameter is the port number L port list Lists all the physical ports on the adapter along with their basic attributes such as the PWWN Media
304. nfiguring UEFI For detailed information on using BCU commands refer to the bios section of the QLogic BCU CLI appendix in the QLogic BR Series Adapter Administrator s Guide For detailed information on using HCM refer to the Boot Over SAN section of the Adapter Configuration chapter in the QLogic BR Series Adapter Administrator s Guide Configuring UEFI For UEFI systems or UEFI boot mode use general steps in this section to configure boot over SAN and other adapter functions using your system s UEFI setup screens Note that this section provides general steps for adapter configuration options on storage and network menus however location of these options vary depending on your host system On some systems options to configure HBA ports or Fabric Adapter ports configured in HBA mode my be on UEFI storage configuration screens Options to configure CNA ports or Fabric Adapter ports configured in NIC or CNA mode may be located on UEFI network configuration screens On some systems options may be located in locations other than storage or network configuration screens Refer to your system s documentation or online help for details on using your UEFI setup screens For instructions on configuring PXE boot with your system s UEFI setup screens refer to Configuring network boot on page 196 When you change a setting on a UEFI setup screen the setting is saved to the adapter whenever you change to a new screen within th
305. ng strap connected to chassis ground if system chassis is plugged in or a bench ground Store the adapter in antistatic packaging Stand up adapters Use information in this section to install stand up adapter hardware on your host system What you need for installation Have the following items available for installing the adapter hardware Phillips 1 screwdriver Adapter with appropriate mounting bracket attached Appropriate cable with appropriate connectors to connect the adapter to the switch J For Fabric Adapter cable and SFP transceiver specifications refer to Cabling stand up adapters on page 272 J For CNA cable and SFP transceiver specifications refer to Cabling stand up adapters on page 282 C For host bus adapter and Fabric Adapter port cable and SFP transceiver specifications refer to Cabling stand up adapters on page 292 Fully operational host Access to a host from your user workstation either through LAN connection or direct attachment 96 BR0054504 00 A 2 Hardware Installation Stand up adapters Installing an adapter To install an adapter The adapter can be damaged by static electricity Before handling use standard procedures to discharge static electricity such as touching a metal surface and wearing a static ground strap Handle the adapter by the edge and not the board components or gold connector contacts Check that you have received all items ne
306. ng the following steps VUM and the VSphere Client Update Manager plugin must be installed and enabled Refer to Software installation and driver packages on page 81 for a description of driver packages and download instructions 1 Download the adapter driver CD from downloads vmware com Search for VMware ESXi 5 x driver for Brocade HBAs version 3 2 4 The driver offline bundle zip file is included in the CD contents as BCD bfa bna release ver offline bundle build number zip 169 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 2 Copy the offline bundle zip file to the vCLI host s tmp directory If loading the zip file locally from a CDROM use the following command mount dev cdrom mnt 3 Make sure the host to which you are installing drivers is in maintenance mode 4 Import the offline driver bundle to the Update Manager server using the Configuration tab of the Update Manager Administration view Update Manager client plug in must be installed 5 Create a baseline that contains the driver that you are installing on an ESX host Note the following W Forinitial installation of an extension you must use an extension baseline After installing the extension on the host you can update the extension module with either upgrade or patch baselines B You can create host extension patch and upgrade baselines from the Baselines and Groups tabs in the Up
307. ns Increased host reliability Improved security 193 BR0054504 00 A 4 Boot Code Network boot BIOS support for network boot The PXE mechanism embedded in the adapter firmware provides the ability to boot the host operating system from a remote system located on the Ethernet LAN instead of the over the SAN or from the host s local disk UNDI universal network device interface is an application program interface API used by the PXE protocol to enable basic control of I O It performs other administrative chores like setting up the MAC address and retrieving statistics through the adapter UNDI drivers are embedded in the adapter firmware When PXE boot or PXE BIOS is enabled the following occurs to execute the system boot process W The PXE client or adapter uses the Dynamic Host Configuration Protocol DHCP protocol to obtain information on available PXE boot servers on the network such as the IP addresses from a DHCP server B The client contacts the appropriate boot server and obtains the file path for a network bootstrap program NBP B The client downloads the NBP into the system s RAM using Trivial File Transfer TFTP verifies it and finally executes it B The PXE protocol sets the proper execution environment such as availability of basic network IO services and areas of client memory and then transfer control to the NBP B The NBP loads other files such as configuration files and executable files
308. nstalls on the remote LUN the system should automatically reboot from the LUN 232 BR0054504 00 A 4 Boot Code Boot over SAN Installing the full driver package on boot LUNs The preceding procedures for each operating system under Operating system and driver installation on boot LUNs on page 217 do not install the HCM Agent and the full range of QLogic BCU CLI To install the full driver package with adapter agent and all BCU commands including bfa supportsave perform these additional steps For information available driver packages and operating system support for drivers refer to Software installation and driver packages on page 81 and Host operating system support on page 70 1 Compare the version of the full driver package that you wish to install with the version of the driver already installed on the boot LUN There are a variety of methods to determine the driver version installed on your operating system Refer to Confirming driver package installation on page 171 for more information If the versions do not match you will perform additional steps to initialize the new package on your system 2 Install the full driver package using steps for your operating system under Using the QLogic Adapter Software Installer on page 113 If the driver that you install and the driver already installed on the LUN match perform steps as normal to complete installation You will be able to use the additional utilit
309. nt parameters Table A 1 Adapter instance specific parameters i Default Possible BCU Function Parameter value values command authorizatio bfa auth algo 1 1 MD5 auth algo Not supported n algorithm 2 SHA1 in Solaris 3 MS 4 SM authorizatio bfa auth policy off 0 on auth policy Not supported n policy 1 off in Solaris authorizatio bfa auth secret NA min chars 0 auth secret Not supported n secret max chars in Solaris 256 Adapter bfa adapter serial NA min chars 0 adapter name name num name max chars 64 VHBA bfa coalesce 1 0 Off vhba intr interrupt 1 On coalesce vHBA bfa delay 1125 min 1 ms vhba intr interrupt BR 1860 max 1125 ms delay BR 1867 5 or 75 ms 75 BR 815 BR 815 25 BR 804 BR 1007 BR 1020 BR 1741 320 BR0054504 00 A A Adapter Configuration Storage instance specific persistent parameters Table A 1 Adapter instance specific parameters Continued BCU command Function Parameter paruit Feet value values VHBA bfa latency 225 min 1 ms interrupt BR 1860 max 225 ms latency BR 1867 1 or 15 ms 15 BR 815 BR 815 BR 825 BR 825 5 BR 804 BR 1007 BR 1020 BR 1741 log level bfa log level 3 1 Critical 2 Error 3 Warning 4 Info path time bfa pathtov 30 min 1 out value max 90 TOV PCle bfa 512 128 maximum pcie max read req 256 readrequest sz size 1024 2048 port bfa maxfrsize 2112 512 maximum 1024 frame
310. nted in connectors located at different locations in the blade server Following are some of the features of the PCle interface W Supports PCI Express specifications Gen2 PCI Base Specification 2 0 and Gen1 PCI Base Specification 1 0 1 1a and 1 1 W Operates as an x8 lane DMA bus master at 2 5 GHz full duplex 288 BR0054504 00 A 5 Specifications Host Bus Adapters W Effective data rate on Gen2 systems is 32 Gbps and on Gen1 systems is 16 Gbps W On board flash memory provides BIOS support over the PCI bus PCI system values All QLogic BR Series HBAs share a common PCI Vendor ID VID value to allow drivers and BIOS to recognize them as supported Fibre Channel products HBAs are also assigned PCI subsystem vendor IDs SVIDs and subsystem IDs SSIDs to allow drivers and BIOS to distinguish between individual host adapter variants You can locate PCI device vendor and subsystem IDs for the installed Fibre Channel HBA through your host s operating system tools For example if using Windows use the following steps 1 Access the Device Manager 2 Open the Properties dialog box for the HBA by right clicking the HBA and selecting Properties from the shortcut menu 3 Selectthe Details and Driver tabs to locate specific values Hardware specifications The Fibre Channel interface supports features outlined in Table 5 15 Table 5 15 Supported Fibre Channel features Feature Description Port Speeds BR 804 W I
311. nter environments This feature enables fabric wide configuration of the iSCSI traffic This is achieved by configuring the iSCSI traffic parameters on the switches which distribute those parameters to directly attached DCB capable iSCSI servers and targets The adapter firmware obtains the iSCSI configuration from the switch through the DCB Exchange Protocol DCBX and applies the configuration to the network driver to classify the iSCSI traffic The adapter will use this as a priority for all network traffic 40 BR0054504 00 A 1 Product Overview Adapter features Note the following for the different adapter models CY OnCNaA adapters and the Fabric Adapter port configured in CNA mode ETS will only be supported either between network and FCoE priority or one network and iSCSI priority C On Fabric Adapters a separate transmit queue will be available for iSCSI traffic This will allow iSCSI traffic to be sent on a separate queue and priority and not compete with network traffic This feature is not supported on Solaris systems Linux BNA MCVLAN MACVLAN provides multiple logical Ethernet network interface cards to be attached to the same LAN segment This allows the user to create virtual interfaces that map packets to or from specific MAC addresses to the base BNA network interface The kernel supports this using module called macvlan BNA driver as part of the set rx mode entry point is modified to traverse the list of new uni
312. nternal ports allow user selectable or auto negotiated speeds of 8 4 2 or 1 Gbps per port BR 1867 and BR 1869 W internal ports allow 16 or 8 Gbps per port BR 825 and BR 815 W An installed 8 Gbps SFP transceiver allows user selectable or auto negotiated speeds of 8 4 or 2 Gbps per port E An installed 4 Gbps SFP transceiver allows user selectable or auto negotiated speeds of 4 2 or 1 Gbps per port NOTE 8 Gbps adapters support 1 Gbps at the driver level but not in a BIOS or boot over SAN configuration SFP transceivers Multimode small form factor pluggable SFP transceiver stand up adapters 289 BR0054504 00 A 5 Specifications Host Bus Adapters Table 5 15 Supported Fibre Channel features Continued Feature Description Cable connector E Stand up adapters LC connectors W Mezzanine adapters Interfaces with enclosure midplane for connection to switch I O and other modules are built on the card surface ASIC W Provides the Fibre Channel functionality for all HBA models W Two on board processors each operating at 400 MHz generate signal timing and link protocol in compliance with Fibre Channel standards External serial W Stores firmware and HBA BIOS code FLASH memory B 4MB capacity Data rate BR 1867 and BR 1869 Per Port Full W 1600 MB sec at 16Gbps duplex M 800 MB sec at 8Gbps Performance per 500 000 IOPs maximum port Distance support 50 m at 8 Gbps with 62 5 125 micron mu
313. ocade Adapter Software Installer xi i o The following component s are installed in your system C AProgram Files BROCADE Adapter HCM Agent 3 0 0 0 CAProgram Files BROCADE Adapter driver util hbaagent FC HBA driver 3 0 0 1205 CAWindows System32 drivers HCM Agent configuration Preference Install with existing configuration Install with default configuration Continue Exit Figure 3 3 Existing software components installed screen 116 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer The versions of software components displayed in the preceding screen will vary according to the adapter software version that is currently installed 10 If a message box displays prompting you to close all HCM applications close all applications if they are still running and then click OK The Choose Install Set screen displays Figure 3 4 X3 Brocade Adapter Software Installer mfe x v Introduction v License Agreement Choose Install Set CHOG A Storage and Network Drivers This option will install the Storage Network IM drivers Se Install holder Packaoe location Rrelnetallanon Surminary es inetd YA Management Utilities Staite This option will install the BCU HCM Agent and copies the SNMP Su etal Gorplete Agent specific files to the installation directory pA Host Connectivity Manager HCM This option will install the Host Connectivity Manager HCM appli
314. oftware installation and driver packages on page 81 and Host operating system support on page 70 for details on driver packages and operating system support Also download the latest release notes on the QLogic Web Site at http driverdownloads glogic com There are firewall issues with HCM Agent on VMware systems When installing the driver package on these systems open TCP IP port 34568 to allow agent communication with HCM Q For VMware use the following commands to open port 34568 usr sbin esxcfg firewall o 34568 tcp in https usr sbin esxcfg firewall o 34568 udp in https C For Windows use Windows Firewall and Advanced Service WFAS to open port 34568 The storage driver will claim all QLogic BR Series Adapters with ports configured in HBA and CNA mode installed in a system Installing a driver package or other adapter software does not automatically start the HCM Agent You must manually start the agent using instructions under HCM Agent operations on page 183 If removing a driver package or other adapter software first exit the HCM application and stop the HCM Agent Stop the agent using instructions under HCM Agent operations on page 183 Removing driver packages with system commands is not recommended since this only removes the driver from the operating system stack and does not clean up the driver and utility directories Use the QLogic Adapter Software Uninstaller program instead
315. ok ahead data are transmitted to the shared memory allocated for this data In addition to VM data separation from HyperV it also enables better performance due to less data movement 48 BR0054504 00 A 1 Product Overview Adapter features Host bus adapter features QLogic Fibre Channel host bus adapters and Fabric Adapter ports configured in HBA mode provide the following features for enhanced performance and connectivity in the SAN For limitations and considerations for feature support for specific operating systems refer to Operating system considerations and limitations on page 61 m 500 000 IOPS per port for maximum IO transfer rates a 1 600 Mbps throughput per port full duplex B 16 Virtual Channels VCs per port VC RDY flow control can use these multiple channels for Quality of Service QoS and traffic prioritization in physical and virtualized network environments B BB Credit Recovery Buffer to buffer credit primitives R_RDY and VC RDY exchanged at the link level can get corrupted and become unrecognizable at the receivers This will lead to depletion of BB Credits that were exchanged between the adapter and switch ports during fabric login FLOGI Similarly if the start of frame gets corrupted the receiving port will not send the corresponding R_RDY to the port at the other end of the link and will result in loss of credit for that port This will cause the ports to operate with few buffer credits and impact th
316. on installed adapters and configure boot from SAN using BCU commands To boot UEFI based host systems you can create a WinPE ISO image using steps under Configuring fabric based boot LUN discovery Brocade fabrics on page 235 This image contains the adapter driver boot code and minimum operating system to boot systems without installed operating systems or local drives W Adapter boot code image This contains BIOS and UEFI boot code and firmware used by the boot code to boot from the adapter Load this code to option ROM on the adapter using the BCU boot update command Download this image from the QLogic Web Site using the following steps a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 89 BR0054504 00 A 1 Product Overview Boot installation packages c Click the Boot Code link at the top of the page to direct you to the boot code packages d Locate the boot code package for your adapter in the table click on it and then follow the directions To keep drivers and boot code synchronized be sure to update your adapter with the latest boot image whenever you install or update adapter driver packages Refer to Boot code updates on page 189 for instructions Table 1 11 describes the installation pack
317. on parameters are global parameters used by all storage driver instances The default values for the driver configuration parameters are compiled into the driver These parameters should only be changed by power users with great caution Linux and VMware driver configuration parameters The driver level configuration values in Table A 2 are in the following locations on your system W Linux etc modprobe conf You can add driver level configuration parameters to etc modprobe conf so they will be persistent but they are not listed in this file by default H VMware etc vmware esx conf Table A 2 describes the Linux and VMware configuration parameters Parameter Table A 2 Linux and VMware driver configuration parameters Default value Notes bfa io max sge SG ALL Maximum scatter gather elements supported per I O request The max sge is passed to SCSI during SCSI host template registration The default is set to SG ALL SG ALL as defined by the kernel This can be either 255 or 128 depending on kernel version 324 BR0054504 00 A A Adapter Configuration Storage driver level parameters Table A 2 Linux and VMware driver configuration parameters Continued Parameter Default value bfa_lun_queue_de 32 Maximum SCSI requests per LUN This parameter pth is passed to the SCSI layer during SCSI transport attach During SCSI transport attach this value is specified as 3 and
318. on your system you may access these menus by booting the system and pressing the F2 key Dell systems or F1 key IBM systems when prompted for configuration or setup Access storage screens to configure installed devices WB For example for IBM systems access the Storage menu option on the System Settings screen W For example on Dell servers after pressing F2 to display the System Setup Main Menu access the Device Settings menu to configure adapter functions From the list of installed network devices select the QLogic BR Series Adapter and port that you want to configure To enable UEFI for boot over SAN select Port Enabled You can then select the installation boot file using the Boot Manager screens Change the port mode by clicking the Configured Port Mode and selecting HBA CNA or NIC The Active Port Mode displays the current mode as CNA HBA or NIC and will display the configured port mode after you power cycle the host system 257 BR0054504 00 A 4 Boot Code Configuring UEFI 10 Options to configure the port mode are only supported on QLogic Fabric Adapters for specific ports 0 or 1 Refer to Table 4 2 on page 259 for details Appropriate SFP FC or 10 GbE transceiver and driver packages must be installed to configure and operate the port in a specific mode Depending on your host system you may be able to change only supported port operating modes Set the Port Speed Available options depen
319. onfigured in CNA or NIC mode port enable bfa port enable True True port enable False port disable Managing instance specific persistent parameters Use BCU commands to modify instance specific persistent parameters for storage drivers For details on using these commands refer to the QLogic BR Series Adapter Administrator s Guide VHBA Interrupt parameters Following is an example of modifying the vHBA interrupt parameters bcu vhba intr pcifn id coalesce c on off lt l usecs d usecs gt where pcifn id PCI function number for the port where you want to set the log level coalesce c Sets the coalesce flag Possible values are on or off 1 latency Sets the latency monitor timeout value Latency can be from 0 through 225 microseconds A latency value of 0 disables latency monitor timeout interrupt d delay Sets the delay timeout interrupt value A delay can be from 0 through 1125 microseconds A delay value of 0 disables the delay timeout interrupt You can also modify vHBA Interrupt Coalescing parameters through HCM Refer to the QLogic BR Series Adapter Administrator s Guide for details 323 BR0054504 00 A A Adapter Configuration Storage driver level parameters Modifying PCle max read request size Refer to the comment section in the kernel drv bfa conf file on your system for an example Storage driver level parameters The driver level configurati
320. ontinues a series of screens may display The Command Prompt should return when installation completes If required by your Windows system reboot the host VMware Linux and Solaris require rebooting after installation Verify installation by launching the Device Manager to display all installed devices W For CNAs host bus adapters and Fabric Adapters when you expand the list of SCSI and RAID controllers or Storage controllers an instance of the adapter model should display for adapter port installed L For CNAs and Fabric Adapter ports configured in CNA or NIC mode when you expand Network adapters an instance of QLogic 10G Ethernet Adapter should also display for each port installed For example if two two port CNAs total of four ports are installed four instances of the adapter model display two under SCSI and RAID controllers and two under Network adapters As another example if only one port on a Fabric Adapter is configured in CNA or NIC mode two instances of the adapter model display one under SCSI and RAID controllers and one under Network adapters If device instances do not display and instead instances display with yellow question marks under Other Devices scan the Device Manager for hardware changes To scan right click on any device in the list and select Scan for hardware changes After you scan for changes the adapter should display in the Device Manager as described under Step 9 If necessary star
321. orce uninstall snmp snmp only brocade install sles sh u h update add rm initrd force uninstall where u uninstalls driver RPM packages h displays help for install script Initial RAM disk options update initrd Updates or adds the storage driver bfa to initrd Note that you should only update the initrd if you are intending to use the boot from SAN feature If the storage driver bfa is listed under etc sysconfig kernel SUSE and etc modprobe conf RHEL RPM installation automatically updates the initrd add initrd Adds the driver to initrd and rebuilds rm initrd Removes the driver from initrd and rebuilds 147 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools force uninstall Removes all installed drivers network storage and utilities Reboot may be required if removal of bna or bfa driver fails snmp If management utilities containing SNMP files were installed this installs the SNMP subagent drivers and other utilities snmp only If management utilities containing SNMP files were installed this installs the SNMP subagent only Examples W To install all RPMs network storage and utilities enter one of the following commands brocade_install_rhel sh brocade_install_sles sh W To install all RPMs and add storage bfa driver to initrd enter one of the following commands brocade_ins
322. ork adapter message signaled interrupts 1 Disables MSI X and enables INTx mode instead NL I ZZLLLLLLLLLI II MSI X is enabled in the network driver by default and must remain enabled for NetQueue to function Enabling NetQueue in VMware system also enables MSI X in the system by default If enabling NetQueue make sure that bnad msix disablez1 is not listed in VMware module parameters because that would disable NetQueue W Display current driver configuration settings using the following command sxcfg modul g bna B Following is an example of using the esxcfg command to set the Jumbo Packet MTU size First set the MTU size on a virtual switch using the following command esxcfg vswitch m MTU size vSwitch ID where MTU size MTU size 1514 9014 kb vSwitch 1ID Virtual switch identification such as vSwitchO Display a list of virtual switches on the host system and their configurations using the following command esxcfg vswitch 1 347 BR0054504 00 A A Adapter Configuration Network driver parameters Next create VMkernal interface with the MTU setting esxcfg vmknic a VM Kernel i IP address n subnet mask m MIU size where VM Kernel VMkernal name IP address IP address for VMkernel NIC subnet mask Subnet mask for VMkernel NIC MTU size MTU size 1500 9000 kb W X Following is an example to configure a VLAN ID for a port group on a specific virtual switch esxcfg v
323. orrect SFP transceiver is installed for the port HBA or Fibre Channel mode This mode utilizes the QLogic Fibre Channel storage driver An 8 or 16 Gbps Fibre Channel SFP transceiver can be installed for the port The port provides host bus adapter functions on a single port so that you can connect your host system to devices on the Fibre Channel SAN Ports with 8 Gbps SFP transceivers configured in HBA mode can operate at 2 4 or 8 Gbps Ports with 16 Gbps SFP transceivers configured in HBA mode can operate at 4 8 or 16 Gbps Fabric Adapter ports configured in HBA mode appear as FC ports when discovered in HCM They appear as FC HBA to the operating system NOTE The terms Fibre Channel mode and HBA mode may be used interchangeably in this document Ethernet or NIC mode This mode utilizes the QLogic network driver A 10 GbE SFP transceivers or direct attach SFP transceiver copper cable must be installed for the port This mode supports basic Ethernet Data Center Bridging DCB and other protocols that operate over DCB to provide functions on a single port that are traditionally provided by an Ethernet Network Interface Card NIC Ports configured in this mode can operate at up to 10 Gbps Fabric Adapters that ship from the factory with 10GbE SFP transceivers installed or no SFP transceivers installed are configured for Ethernet mode by default Fabric Adapter ports set in NIC mode appear as Ethernet ports
324. otiate from x8 to x4 x2 and x1 lanes Following are transfer and data rate specifications for operation in PCle Gen 2 and Gen 1 connectors W PCle Gen 2 connector Transfer rate of 5 Gigatransfers per second per lane Data rate of 500 MBps per lane B PCle Gen 1 connector Transfer rate of 2 5 Gigatransfers per second per lane Data rate of 250 MBps per lane 277 BR0054504 00 A 5 Specifications Converged Network Adapters PCI system values All QLogic BR Series FCoE CNAs share a common PCI Vendor ID VID value to allow drivers and BIOS to recognize them as supported Fibre Channel and network devices CNAs are also assigned PCI subsystem vendor IDs SVIDs and subsystem IDs SSIDs to allow drivers and BIOS to distinguish between individual host adapter variants You can locate PCI device vendor and subsystem IDs for the installed FCoE CNAs through your host s operating system tools For example if using Windows use the following steps 1 Access the Device Manager The CNA appears as a Fibre Channel adapter and as an Ethernet controller or adapter 2 Open the Properties dialog box for the CNA by right clicking the CNA and selecting Properties from the shortcut menu 3 Selectthe Details and Driver tabs to locate specific values Hardware specifications The CNA supports features outlined in Table 5 8 Table 5 8 CNA hardware specifications Feature Description Port speeds 10 312 Gbps SFP transceivers stand up
325. ou have set all desired parameters reboot the system Network driver parameters The driver configuration parameters are global parameters used by all network driver instances The default values for the driver configuration parameters are compiled into the driver Network drivers are only used for CNAs and for Fabric Adapter ports configured in CNA or NIC mode The driver level configuration values discussed in this section are in the following locations on your system B Linux etc modprobe conf H VMware etc vmware esx conf B Windows Device Manager These parameters should only be changed from the default values by power users with great caution 332 BR0054504 00 A A Adapter Configuration Network driver parameters Windows Table A 5 describes the instance specific network configuration parameters available for Windows hosts Function Table A 5 Network driver configuration parameters Default value Possible values Method to configure Notes FlowControl Receive Rx Interrupt Moderation IPv4 Checksum Offload Jumbo Packet Size Large Segmentation Offload V1 IPv4 LSOv1 Large Segmentation Offload V2 IPv4 LSOv2 Large Segmentation Offload V2 IPv6 LSOv2 Locally Administered Address Transmit Tx and Disable Enable Enable 1514 Enable Enable Enable N A Enable Disable Enable Disable Rx Enable Tx Enabled Tx amp
326. ough the mounting brackets A B LED Function Icons OO e CS zAG gs X i FC Ethernet Storage Functions Functions Functions a FA 4 zi on Omm O f Figure 5 1 LED locations for dual port A and single port B BR 1860 Fabric Adapters Table 5 5 describes operation for the following LEDs visible on the CNA Table 5 5 LED operation Slow flashing Slow flashing Slow flashing Beaconing green green green Slow flashing Slow flashing Off Invalid optic green green 274 BR0054504 00 A 5 Specifications Fabric Adapters Table 5 5 LED operation Continued Slow flashing Off Off green On Off Off On Off Fast flashing green Off Slow flashing Off green Off On Off Off On Fast flashing green Off Fast flashing Off green Off Fast flashing Fast flashing green green Power on Port in FC mode No Link Power on FC link established No activity Power on Link established Receive and Transmit FC activity Power on Port in Ethernet mode No link Power on Ethernet link established No activity Power on Link established Receive and Transmit FCoE activity Power on Link established Receive and Transmit Ethernet activity only Power on Link established Receive and Transmit Ethernet an
327. our host system Access the port configuration screen for the port and configure the following options W To enable UEFI for boot over SAN enable FCoE Offline Mode You can then select the installation boot file using the Boot Manager screens B Change the port mode by selecting Configured Port Mode and selecting HBA CNA or NIC The Active Port Mode is a read only field which displays current port mode as CNA HBA or NIC and will display configured port mode after power cycle the host system Depending on your host system you may be able to change only supported port operating modes 256 BR0054504 00 A 4 Boot Code Configuring UEFI 7 Access the VNIC configuration screen for the port to perform the following tasks W Create VNICs Allows you to create a VNIC with specified bandwidth Make sure that the sum of all minimum bandwidth across a port is less than or equal to 100 percent m Manage VNICs Select an existing VNIC to change the minimum and maximum bandwidth and display the VNIC s MAC address and PCI device ID For more information on VNICs and creating VNICs refer to I O virtualization on page 28 Save your settings and exit the utility Using Storage menu options Use the following steps to configure adapter functions using UEFI setup utility Storage menu options 1 2 Power on the host system Access your system setup hardware setup or hardware management menus Depending
328. ovided for your system To use HCM options or BCU commands refer to Configuring BIOS with HCM or BCU commands on page 254 The following procedures provide an example for configuring adapter values on systems that support EFI shell commands 1 Power on the host system 2 When the EFI Boot Manager menu displays select EFI Shell 260 BR0054504 00 A 4 Boot Code Alternate methods for D R V VERSION configuring UEFI Enter the following EFI shell command to display the device or driver handle number for each driver loaded on the system drivers b Output displays one screen at a time and includes the two digit driver handle number version and driver name Look for entries labeled QLogic Fibre Channel Adapter In the following example the QLogic BR Series Adapter has a driver handle of 25 D C DRIVER NAME IMAGE NAME 25 0000000A 4 D X 2 QLogic Fibre Channel Adapter Bus D PciROM 03 00 00 003 Enter the following command to display all drivers and controllers that support the driver configuration protocol drvcfg c Once the driver initializes look for entries for the QLogic BR Series Adapter driver handle that you found in the previous step In the following example two controller handles 27 and 28 display for driver handle 25 Each controller represents a port on the adapter Configurable Components Drv 1F Ctrl 20 Child 67 Lang eng Drv 25 Ctr1 27 Lang eng Drv 25 Ctr1 28 Lang en
329. ovides minimal operating system features for installation troubleshooting and recovery Please refer to the Microsoft Preinstallation Environment User s Guide for more information about Windows PE You can customize WinPE to boot a diskless host system system without a hard disk or operating system that contains QLogic BR Series Fibre Channel adapters and accomplish the following tasks Update the firmware and BIOS EFI images in the adapter The adapter tools and utilities bundled in the driver aid in updating the adapter flash Install preconfigured Windows system images from a network share onto new computers that access the storage through QLogic BR Series Adapters Use the following procedures to create a WinPE image that includes the QLogic driver package and utilities for your system 1 Download Windows Automated Installation Kit WAIK for Windows 79 from the Microsoft Web Site This kit is in SO format Create a bootable CD or USB drive from this image using appropriate burning software and install WAIK on your local system where you will create the WinPE image Determine the appropriate adapter driver package for your operating system and host platform using information in Software installation and driver packages on page 81 The WinPE image creation is based on the Vista kernel Therefore use the driver package for Windows Server 2008 R2 or later Download the latest Windows Server 2008 R2 driver package for you
330. owable for this vNIC vnic delete lt pcifn gt Removes the specified vNIC instance vnic query lt pcifn gt Queries information about the virtual NIC vnic enable lt pcifn gt Enables a vNIC on a specified adapter port for a specified PCI function vnic disable lt pcifn gt Disables a vNIC on a specified adapter port for a specified PCI function vnic stats lt pcifn gt Displays statistics for the virtual NIC vnic statsclr lt pcifn gt Resets vNIC statistics vnic bw lt pcifn gt bmin min bandwidth bmax max bandwidth per Modifies the maximum allowable bandwidth for a vNIC For details on using these commands refer to the QLogic BR Series Adapter Administrator s Guide Virtual port persistency Virtual port configurations for Linux and Windows systems will persist after the system reboots or after driver upgrades Additional general features Following are brief descriptions of additional general features supported on all QLogic BR Series Adapters BIOS and UEFI support x86 and x64 Basic Input Output System BIOS Unified Extensible Firmware Interface UEFI PCI BIOS 3 1 or later SMBIOS specification version 2 4 or later Fabric based boot LUN discovery Network boot PXE UEFI d d d a d d 31 BR0054504 00 A 1 Product Overview Adapter features J gPXE support for VMware ESXi 5 x auto deployment Network boot and gPXE support for VMware ESXi 5 x auto
331. ows systems To update the drivers follow procedures under Installing and removing drivers on Windows systems on page 141 When upgrading the driver for Windows systems you do not need to reboot the host system as the driver upgrades immediately The upgrade reloads the adapter firmware and reinitializes the link Driver installation and removal on Linux systems Use the install script to selectively install storage driver packages network driver packages and utilities to Linux systems The driver package is provided as an RPM package If you are using a supported Linux driver package and standard host configuration you can use these RPMs Refer to Software installation and driver packages on page 81 for a description of packages and kernel versions that they support Installation Notes Starting with SLES 11 SP2 the Brocade KMP packages are digitally signed by Novell with a PLDP Signing Key If your system doesn t have the public PLDP key installed RPM installation will generate a warning similar to the following warning brocade bna kmp default 3 0 3 3 3 0 13 0 27 0 x86 64 rpm Header V3 RSA SHA256 signature NOKEY key ID c2bea7e6 To ensure authenticity and integrity of the driver package we recommend that you install the public PLDP key if not already installed before installing the driver package The PLDP key and installation instructions can be found at http drivers suse com doc pldp signing k
332. ows systems brocade_adapter_software_installer_windows_ lt version gt exe Q Linux systems brocade adapter software installer linux version bin C Solaris systems brocade_adapter_software_installer_Solaris_ lt platform gt _ lt ve rsion gt bin 108 BR0054504 00 A 3 Software Installation Installation notes The lt platform gt variable in the installer commands is the host system architecture such as SPARC x86 or x64 You must use the QLogic Adapter Software Installer application to install HCM to the host system where the adapter is installed or to a separate remote management platform You cannot install HCM using the QLogic provided installation scripts or your system s native installation commands After installation an HCM desktop shortcut is available on Windows Linux and Solaris systems Software installation or upgrade could take much longer than normal under the following conditions QO Ona host system with a large number of adapters C Ona host system where large number of LUNs are exposed through different paths to the multi path software If you receive errors when launching the GUI based QLogic Adapter Software Installer such as InvocationTargetException errors your system may not be able to run a GUI based application Instead use the instructions under Software installation using Software Installer commands on page 120 Installing software with the QLogic Adapter Softwar
333. package is installed bfa pkg should display with a complete install status in the list of installed packages 174 BR0054504 00 A 3 Software Installation Confirming driver package installation Following is an example for Solaris 10 systems PKGINST bfa NAME QLogic Fibre Channel Adapter Driver CATEGORY system ARCH sparc amp i386 VERSION alpha_b1d31_20080502_1205 BASEDIR VENDOR QLogic DESC 32 bit amp 64 bit Device driver for QLogic Fibre Channel adapters PSTAMP 20080115150824 INSTDATE May 02 2008 18 22 GI LH HOTLINE Please contact your local service provider STATUS completely installed Following is an example for Solaris 11 systems bash 4 14 pkginfo i bfa system bfa QLogic Fibre Channel Adapter Driver bash 4 14 pkgchk nv bfa opt opt brocade opt brocade adapter opt brocade adapter bfa opt brocade adapter bfa bfa drv arc tar bash 4 14 pkginfo i bna system bna Brocade Network Adapter Driver bash 4 14 pkgchk nv bna opt opt brocade opt brocade adapter opt brocade adapter bna opt brocade adapter bna bna drv arc tar bash 4 14 175 BR0054504 00 A 3 Software Installation Confirming driver package installation Confirming driver installation with VMware tools Verify if the driver installed successfully using the following commands The following commands print the names of the Brocade storage driver bfa if installed
334. pport for products under warranty is available during local standard working hours excluding QLogic Observed Holidays For customers with extended service consult your plan for available hours For Support phone numbers see the Contact Support link at support glogic com Support Headquarters QLogic Corporation 4601 Dean Lakes Blvd Shakopee MN 55379 USA QLogic Web Site www glogic com Technical Support Web Site http support glogic com Technical Support E mail support glogic com Technical Training E mail training qlogic com Knowledge Database The QLogic knowledge database is an extensive collection of QLogic product information that you can search for specific solutions QLogic is constantly adding to the collection of information in the database to provide answers to your most urgent questions Access the database from the QLogic Support Center http support qlogic com xxi BR0054504 00 A Installation Guide BR Series Adapters Preface Technical Support xxii BR0054504 00 A 1 Product Overview Fabric Adapters The BR 1860 stand up Fabric Adapter is a low profile MD2 form factor PCI Express PCle card measuring 16 751 cm by 6 878 cm 6 595 in by 2 708 in that installs in standard host computer systems Figure 1 1 illustrates major components of the dual port BR 1860 Fabric Adapter BR 1860 single or dual port adapter models can ship with the following configurations of small form factor pluggable SFP tr
335. pport over the PCle bus W The adapter is designed to operate on an x8 lane DMA bus master at 250 GMhz Operation can negotiate from x8 to x4 x2 and x1 lanes Effective data rate of 32 Gbps for Gen 2 and 16 Gbps for Gen 1 Eight physical functions supported per port 265 BR0054504 00 A 5 Specifications Fabric Adapters W Single Root I O Virtualization SRIOV which provides a total of 256 functions This includes a maximum of 16 Physical Functions PFs and 255 Virtual Functions VFs for a dual port adapter Support for 2 000 MSI X interrupt vectors Support for INT X PCI system values All QLogic Fabric Adapters share a common PCI Vendor ID VID value to allow drivers and BIOS to recognize them as supported Fibre Channel and network devices Adapters are also assigned PCI subsystem vendor IDs SVIDs and subsystem IDs SSIDs to allow drivers and BIOS to distinguish between individual host adapter variants You can locate PCI device vendor and subsystem IDs for the installed Fabric Adapters through your host s operating system tools For example if using Windows use the following steps 1 Access the Device Manager 2 Open the Properties dialog box for the adapter by right clicking the adapter and selecting Properties from the shortcut menu 3 Select the Details and Driver tabs to locate specific values Hardware specifications The adapter supports features and standards outlined in Table 5 2 Table 5 2 Fabric A
336. ppropriate driver package brocade adapter software in staller windows version e xe Installs HCM and appropriate driver package brocade adapter software in staller windows version e xe Installs HCM and appropriate driver package brocade adapter software in staller linux version bin Installs HCM and appropriate driver package brocade adapter software in staller linux x64 version b in Installs HCM and appropriate driver package brocade driver win2008 R2 x64 versio n exe Storport miniport storage and network drivers with HCM Agent for Standard Enterprise Server on EM64T and AMD64 platforms This package also contains installer script brocade_installer bat brocade driver win2012 x64 version e xe Storport miniport storage and network drivers with HCM Agent for Standard Enterprise Server on EM64T and AMD64 platforms This package also contains installer script brocade_installer bat brocade driver win2012 R2 x64 versio n exe Storport miniport storage and network drivers with HCM Agent for Standard Enterprise Server on EM64T and AMD64 platforms This package also contains installer script brocade installer bat E brocade driver linux version tar gz B brocade driver linux rhel5 version ta r gz brocade driver linux version tar gz E brocade driver linux rhelb lt version gt ta r gz4 83 BR0054504 00 A 1 Product Overvie
337. pter management on page 68 B Port setto NIC mode NIC management on page 68 In addition to features summarized in the preceding list of sections there are some unique management features for Fabric Adapters not available for host bus adapters and CNAs including the following Configure port modes CNA HBA NIC Create delete enable and disable vNICs Query for information display statistics and set bandwidth for vNICs Discover and display vNICs Discover and display vHBAs Enable and disable vHBAs Query for information and display statistics for VHBAs CNA management Use BCU commands and HCM to manage CNAs and Fabric Adapter ports configured in CNA mode Other available management tools include Simple Network Management Protocol SNMP and BladeCenter Open Fabric Manager BR 1007 adapter only FCoE management HCM and BCU provide the provides the following functions for CNAs and for Fabric Adapter ports configured in CNA mode W CNA port statistics display FCoE ports configuration Fibre Channel Security Protocol FC SP configuration Enabling target rate limiting VHBA statistics monitoring Port target and Fibre Channel Protocol FCP operation monitoring Security features for FCoE access FC SP configuration 65 BR0054504 00 A 1 Product Overview Adapter management features Virtual FCoE ports creation FCoE statistics display VNIC statistics display Fabric statistics display FCP IM Module st
338. pter on a compute node refer to 2 Hardware Installation For additional information related to the supported compute node and other devices installed in the system chassis such as I O modules and switch modules refer to the installation instructions provided with these products 23 BR0054504 00 A 1 Product Overview Host Bus Adapters BR 1869 host bus adapter Figure 1 8 illustrates major components of the BR 1869 The adapter measures 157 9 mm 6 22 inches deep 107 8 mm 4 24 inches wide and 36 4 mm 1 43 inches high The following illustration is representative and may have minor physical differences from the card that you purchased 1 ASIC with heat sink x8 PCle interface connector ASIC with heat sink gt Cc I Midplane connector Figure 1 8 BR 1869 Host bus adapter bottom view Labels showing the part number PWWNs model number and serial number for the BR 1869 host bus adapter are on the top side of the card reverse from side shown in previous illustration 24 BR0054504 00 A 1 Product Overview Host Bus Adapters The BR 1869 Adapter provides four Fibre Channel connections capable of providing 8 Gbps or 16 Gbps to devices on Fibre Channel FC SANs Depending on the system configuration the adapter provides up to 16 Gbps of full duplex line rate bandwidth per port The BR 1869 mounts on a compute node that installs in an IBM Flex System chassis Mezzanine adapters do not ha
339. quirements for BR 1869 mezzanine card Property Requirement Operating environment Provided by blade system enclosure Nonoperating altitude 12 192 meters 40 000 ft Nonoperating temperature 40 C 40 F maximum Power dissipation 17 W maximum 16 W nominal Operating voltage Per PCle 2 0 specifications Dimensions Approximate height 36 4 mm 1 43 in Approximate width 107 8 mm 4 24 in Approximate depth 157 9 mm 6 22 in Weight 230 grams 51 Ib The BR 1869 adapter conforms to environmental and power specifications for the supported compute node and chassis where the adapters install Refer to the documentation provided for these products for information Also refer to Server blades and system enclosures mezzanine adapters on page 16 for references to adapter compatibility information Fibre Channel standards compliance QLogic BR Series Adapters meet or exceed the Fibre Channel standards for compliance performance and feature capabilities Regulatory compliance This section provides international regulatory compliance notices for the QLogic BR Series Adapters 297 BR0054504 00 A 5 Specifications Regulatory compliance Stand up adapters The regulatory statements in this section pertain to the following stand up adapters B BR 815 HBA B BR 825 HBA B BR 1020 CNA B BR 1860 Fabric Adapter FCC warning US only This device complies with Part 15 of the FCC Rules Operation is subje
340. quisites and install the necessary hotfixes after the operating system installation is complete Driver update disk files are provided for x86 and x64 systems Refer to Boot installation packages on page 88 for a list of driver update disk files and the operating systems that support these files Also refer to Host operating system support on page 70 for information on operating system support for adapter drivers Download the Windows Server 2008 R2 adapter driver update disk DUD zip file for your host platform from the QLogic Web Site a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column Windows Server 2008 R2 in the third column and then click Go c Click the Driver Update Disks link at the top of the page to direct you to the DUD zip file d Locate the DUD link for your adapter in the table click on it and following the instructions Unzip the file and copy to a CD USB drive or formatted floppy disk to create the adapter driver update disk Insert the Windows Server 2008 R2 operating system installation DVD into the system drive and boot from the DVD Respond to prompts that display on the Windows installer screens Be sure to select a Standard Full Installation and accept the software license When the Which type of installation do you want screen displays select
341. r driver on an unformatted disk that you configured as a bootable device when setting up the adapter BIOS or UEFI on the host system If the LUN you have targeted for booting the host system already has an operating system installed be sure to use options for reformatting the LUN during Linux installation Refer to your operating system documentation for details The following instructions apply to QLogic adapter models BR 815 BR 825 BR 1020 BR 1007 BR 1741 and BR 1860 If using another adapter you can install RHEL drivers as usual refer to Installing Linux RHEL 4 x or 5 x and the driver on page 220 This installs the noarch version of the adapter drivers The following procedures load the operating system adapter driver and utilities to the designated boot LUN to allow adapter operation and booting your host system from the LUN However the HCM Agent and full range of QLogic Command Line Utilities such as bfa_supportsave are not installed To install the complete driver package with HCM Agent and full range of utilities refer to Installing the full driver package on boot LUNs on page 233 after completing the following steps Refer to Boot installation packages on page 88 for a list of driver update disk files and the operating systems that support these files Also refer to Host operating system support on page 70 for information on operating 224 BR0054504 00 A 4 Boot Code Boot over SAN system s
342. r host platform from the QLogic Web Site using the following steps a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column Windows 2008 R2 or later and then click Go c Click the Drivers link at the top of the page to direct you to the boot code files 242 BR0054504 00 A 4 Boot Code Updating Windows driver on adapter used for boot over SAN d Locate the Multi Boot Firmware LiveCD link for your adapter in the table click on it and following the instructions This package contains the script build winpe bat which you will use to create the customized WinPE image 5 Double click the driver package and extract to a folder such as C temp on your local system The build winpe bat script will be located under the util sub directory 6 Goto C temp util and enter the following command to create the WinPE iso image build winpe bat 7 Burn the ISO image into a CD or USB drive using appropriate software Updating Windows driver on adapter used for boot over SAN When updating the driver on Windows Server 2008 R2 systems where the adapter is used for booting over SAN install the new adapter driver without removing the existing driver This is the recommended procedure to update drivers If you remove the adapter driver which requires a sys
343. r information on minimum operating system support for drivers refer to Boot installation packages on page 88 and Host operating system support on page 70 Install full driver package drivers utilities HCM agent to boot LUN Refer to Installing the full driver package on boot LUNs on page 233 Boot the host from the SAN storage boot device using procedures required by your host system As the system boots information about successful BIOS installation should display In addition information should display about the QLogic BR Series Adapter and boot LUN in the systems boot device menu Providing Windows crash dump on remote LUN When configuring boot over SAN on Windows systems make sure that the following steps are completed to assure that the crash dump file is posted to the remote LUN BIOS must be enabled on all HBA port instances that can access the boot LUN Select the same discovery mechanism for the boot LUN for all adapter port instances for which the boot LUN is exposed C If configuring boot over SAN using the BIOS Configuration Utility select Fabric Discovered Flash Values or First LUN Q If configuring boot over SAN using BNA commands select Fabric Discovered First Visible LUN or User Configured LUNs If multiple storage ports with unique PWWNs are configured to access the same boot LUN in the storage array and all PWWNS are zoned to a specific HBA port instance then all such PWWNs must be
344. ranty card a CD containing documentation for installing removing configuring and troubleshooting the adapter 94 BR0054504 00 A 2 Hardware Installation Introduction This chapter provides instructions for installing and replacing the following types of QLogic BR Series Adapters W Stand up host bus adapter CNA and Fabric Adapters Instructions are also provided for removing and installing small form factor pluggable SFP transceivers Use only Brocade branded SFP laser transceivers supplied for stand up adapters Host bus mezzanine adapter CNA mezzanine adapter Fabric mezzanine adapter NOTE 000000 When installing Fabric Adapters with ports configured in CNA or NIC mode and CNAs on VMware systems it is advisable to install the driver before the adapter so that the NICs will be properly numbered in the system Perform the appropriate steps in 3 Software Installation and then return to this chapter To troubleshoot problems after installation refer to the QLogic BR Series Adapters Troubleshooting Guide For details in items shipped with various adapter models for installation refer to Boot installation packages on page 88 95 BR0054504 00 A 2 Hardware Installation ESD precautions ESD precautions When handling the adapter use correct electrostatic discharge ESD procedures Be sure that you are properly grounded before beginning any installation When possible wear a wrist groundi
345. rate an interrupt immediately after it receives a packet but waits for more packets or a time out to expire Sets MTU size Size must not be greater than size set on switch that supports Data Center Bridging DCB Enable or disable transmit and receive checksum offload Parameter is only supported on 2 6 kernels that support MSI Overrides the burned in MAC address 339 BR0054504 00 A A Adapter Configuration Network driver parameters Table A 6 Network driver configuration parameters Continued Function zin zi Possible Values Sonate Interrupt 60 rx usecs 1 1280 8 bits ethtool C Coalescing 100 tx usecs 0 1280 8 bits command 32 tx frames 0 256 8 bits coalescing ethX 6 rx frames 0 256 8 bits Legacy Ethernet NA autoneg off on ethtool A Flow control mechanism pause rx off on command for Ethernet tx off on VEB 0 1 enable bna_veb_enable Only supported as 0 disable technology preview and not yet officially supported Applicable to VMware and Linux Xen and Linux KVM as they support PCI pass through 1 The default values are optimized for this feature and should only be modified by expert users with knowledge of how values change operation 2 Modifying rx frame values have no effect at this time as the inter pkt mechanism is not enabled for the receive side 340 BR0054504 00 A A Adapter Configuration Network driver parameters Managing L
346. rate in either UEFI mode or Legacy BIOS mode The following is an example procedure for these systems Since installation on your system may vary be sure to consult your system s documentation as you follow these steps These procedures are for SLES 11 SLES 11 SP1 and SLES 11 SP2 only If the LUN you have targeted for booting over SAN already has an operating system installed be sure to use options for reformatting the LUN operating system installation Refer to your operating system documentation for details 1 Refer to Boot installation packages on page 88 for a list of these files and the operating systems that support these files Also refer to Host operating system support on page 70 for information on operating system support for adapter drivers Download the QLogic BR Series Adapter driver update iso file appropriate for your system from the QLogic website using the following steps a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column Linux SUSE SLES in the third column and then click Go c Click the Driver Update Disks link at the top of the page to direct you to the DUD zip file d Locate the DUD link for your adapter in the table click on it and following the instructions Create a driver update disk CD or USB drive from the ISO image 231 BR0054504
347. re components installed screen 000 eee 3 4 Choose Install Set screen 4 00 tivaceaed beds eS eGo ER DA obi ERE REG beds 3 5 Preinstallation Summary screen 00 cee 3 6 Install Complete Screen 2 0 0 eee es 3 7 Uninstall Options screen 2 cscenteeracddees haps REOR ERR REPRE PER er 4 1 PXE BIOS Configuration Menu Select the Adapter 00 00 4 2 PXE BIOS Configuration Menu Adapter Settings 00000e 4 3 Configuring boot over SAN ssllelleeell ens 4 4 GRUB Boot Menu Solaris selected nnn nannaa 4 5 GRUB Boot Menu Configuring devices lslseles else 4 6 BIOS Configuration Menu Select the Adapter llli elles 4 7 BIOS Configuration Menu Adapter Configuration 000 eee 4 8 BIOS Configuration Menu Adapter Settings liliis 4 9 BIOS Configuration Menu Boot Device Settlings 20 00 eee 4 10 BIOS Configuration Menu Select Port Target 00 ee eee eee 4 11 BIOS Configuration Menu Select Boot LUN 0 0 00 4 12 BIOS Configuration Menu Boot Device Settings 20 0 eee eee 4 13 UEFI Driver Health Menu 02 0 ee 5 1 LED locations for dual port A and single port B BR 1860 Fabric Adapters 5 2 LED locations for BR 1020 CNA 0 2 eee eee 5 8 LED locations for BR 825 HBA A and BR 815 B 0002 eee eee A 1 Properties dialog box for
348. red by all installed packages 587202560 Current target 780140544 greater skipping Pack installation successful Unmount the network bna driver iso file root xenserver my dir umount iso List files in the directory root xenserver umfzwtyv test ls 1 brocade bfa 3 2 1 00801 xen 6 1 0 iso brocade bfautil noioct1 3 2 1 0 0 noarch rpm brocade bna 3 2 1 00801 xen 6 1 0 iso brocade driver linux xen61 v3 2 1 0 tar gz driver bld info xml Install the bfa utilities root xenserver my dir rpm ivh brocade bfautil noioctl 3 2 1 0 0 noarch rpm Preparing daa IE IF AE AE AE a aA aA AE AE E HE TT RT T aE aE EE EEE 100 1 brocade bfautil_noioct 1 tis itt 4AE at dE aE aE EE aE EEE EEE H HEH Hat HH teeettt 100 Install cli done Install HBAAPI library done 152 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Installing utilities when they conflict with inbox utilities After you install the bfa utilities a warning message such as the following may display if using the driver on a server running XenServer v6 1 with the inbox driver Preparing Ha T PETE EEE dd d dg TEE TEE TEE ETE EEE EEE HE 1003 file opt brocade adapter bfa bfa_cfg sh from install of brocade bfautil noioctl 3 2 1 0 0 noarch conflicts with file from package brocade bfautil 3 1 0 0 0 138
349. require system reboot For Linux or Solaris systems use the standard DCHOSEN INSTALL SET command to overwrite existing software FORCE INITRD BACKUPZYES For Linux systems a YES value overwrites the backed up initrd file All parameters are case sensitive and make sure to spell the parameters correctly Complete details on editing and executing the properties file are available under the Guidelines for silent installation section located in the HCMDefaultproperties file 124 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Important notes Review these notes before using QLogic Adapter Software Installer QASI commands General notes The following notes pertain to all operating systems For notes pertaining to specific operating systems refer to Windows systems on page 127 Linux systems on page 127 and VMware systems on page 127 B Executing the following commands without parameters will launch the GUl based installer described under Using the GUI based installer on page 114 Q Windows systems brocade_adapter_software_installer_windows_ lt version gt exe Q Linux systems shbrocade adapter software installer linux version bin C Solaris systems sh brocade_adapter_software_installer_solaris_ lt x86_ lt version gt bin sh brocade adapter software installer solaris sparc version gt bin B Complete details on editing and executing the proper
350. ries Adapter Administrator s Guide for full information In addition BCU commands and HCM provide the following features specifically for NIC management when Fabric Adapter ports configured in NIC or CNA mode W X vNIC configuration only available using BCU commands W vNIC teaming configuration W vNIC statistics m vNIC discovery and display in HCM W vNIC enable and disable SNMP provides an industry standard method of monitoring and managing Fabric Adapters with ports configured in NIC mode For details refer to Simple Network Management Protocol on page 67 Management applications such as Network Advisor provides management support for NICs including host and NIC discovery in context launch of HCM statistics display port and adapter property display and other features Refer to the Brocade Network Advisor SAN User Manual Host bus adapter management BCU commands and HCM provide the following features for host bus adapters and for Fabric Adapter ports configured in HBA mode B Port statistics W X logical port statistics 68 BR0054504 00 A 1 Product Overview Adapter management features Firmware statistics QoS statistics Discovery of adapters and connected storage devices in your SAN Adapter configuration Persistent binding End to end QoS Target rate limiting Performance monitoring such as port and target statistics Supportsave operation Adapter diagnostics display N_Port trunking confi
351. rities NDIS QoS This feature is only supported on the QLogic Fabric Adapters operating with Windows Server 2012 Network Data Interface Specification NDIS QoS provides the following benefits C Enables collaboration between QoS defined by the end user and network configured Data Center Bridging DCB J Enables transmit egress traffic priority over DCB networks Allows prepriority based flow control PFC and enhanced transmission selection ETS 44 BR0054504 00 A 1 Product Overview Adapter features Disable and enable this feature through the QLogic 10G Ethernet Adapter Advanced Property sheet Refer to Network driver parameters on page 332 Once enabled you can use DCB PowerShell to perform the following tasks Create a new traffic class for iSCSI traffic Create a policy to associate traffic to the traffic class Query the operational QoS settings on the adapter Query the configured traffic classes Enable or disable PFC Refer to your Windows PowerShell Guide for more information Priority based flow control IEEE 802 1Qbb standard This feature defines eight priority levels to allow eight independent lossless virtual lanes Priority based flow control pauses traffic based on the priority levels and restarts traffic through a high level pause algorithm Oooo Precision Time Protocol PTP All QLogic standup and mezzanine adapter ports with NIC personality provides support for software PT
352. river to the LUN UEFI Driver Health Check Driver Health Protocol requires the following two services implemented GetHealthStatus The GetHealthStatus service retrieves the health status for a controller that a driver is managing or a child that a driver produced This service is not allowed to use any of the console I O related protocols Instead the health status information is returned to the caller The caller may choose to log or display the health status information Repair The Repair service attempts repair operations on a driver managed controller or a child that the driver produced This service is not allowed to use any of the console l O related protocols Instead the status of the repair operation is returned to the caller The caller may choose to log or display the progress of the repair operation and the final results of the repair operation The Driver Health Protocol module will be implemented in the UEFI bfa driver and UEFI bna driver 263 BR0054504 00 A 4 Boot Code UEFI Driver Health Check Accessing UEFI driver health screen through IBM server 1 Enter the IBM server Setup 2 Select the System Settings menu from the System Configuration and Boot Management screen 3 From the menu displayed in the System Settings screen select Driver Health option to display the Driver Health menu Figure 4 13 is an example of a driver health menu displaying a list of the drivers installed on the system and
353. river linux slestOsp3 versio n tar gz brocade driver linux version tar gz3 E brocade driver linux slestOsp3 versio n tar gz E brocade driver linux version tar gz3 E brocade driver linux slestOsp4 versio n tar gz E brocade driver linux version tar gz E brocade driver linux slestOsp4 versio n tar gz E brocade driver linux version tar gz3 E brocade driver linux slestispi versio n tar gz 84 BR0054504 00 A 1 Product Overview Adapter software Table 1 10 Supported software installation packages Continued Operating System and Platform QLogic Adapter Software Installer Driver Package Linux SLES 11 SP1 x86_64 Linux SLES 11 SP2 x86 Linux SLES 11 SP2 x86_64 Citrix XenServer 5 6 x64 Citrix XenServer 6 0 x64 Citrix XenServer 6 0 x64 Solaris 10 0 x86 Solaris 10 0 SPARC x86_64 brocade_adapter_software_in staller linux x64 version b in Installs HCM and appropriate driver package brocade_adapter_software_in staller linux version bin Installs HCM and appropriate driver package brocade adapter software in staller linux x64 version b in Installs HCM and appropriate driver package Not supported Not supported Not supported brocade_adapter_software_in staller solaris x86 version bin Installs HCM and appropriate driver package for operating system and platform
354. roblems You can use the list to verify proper installation and make corrections as necessary 104 BR0054504 00 A 2 Hardware Installation Mezzanine adapters BR 1741 CNA For details on installing the BR 1741 mezzanine CNA on a blade server refer to the Dell PowerEdge M1000e modular blade system hardware owner s manual Refer to that manual for the following information B Full details on installing and removing blades from the blade enclosure and installing and removing mezzanine cards from blades B Guidelines for installing mezzanine cards Before installing the mezzanine card review the installation guidelines especially to identify blade slots for installing mezzanine cards and enclosure bays for installing supported I O modules B Guidelines for installing I O modules To support each I O module that you install in the blade enclosure you may also need to install a compatible mezzanine card in each blade server that you want to communicate with the I O module W Instructions for accessing the blade server through a console or workstation to install adapter drivers and software What you need for installation Have the following available for installing the adapter m Mezzanine card shipping carton which includes the adapter and necessary documentation B Fully operational blade server B Access to the blade server through local or remote console connection m The blade enclosure s hardware owner s manual
355. rotocol PTP This is applicable only to RHEL 6 4 systems and systems with kernel version 2 6 32 358 el6 and higher Only software time stamping is supported Enable debugfs 1 1 Enable bnaa debugfs ena 2 Disable ble Disable LRO 0 1 Enable bnad lro disable 0 Disable Disable GRO 0 1 Enable bnad gro disable 0 Disable Log Level 4 0 EMERG Module parameter Linux log level 3 Warning bnad_log_level 4 INFO 7 DEBUG 338 BR0054504 00 A A Adapter Configuration Network driver parameters Table A 6 Network driver configuration parameters Continued Function Default VELT Possible Values Method to Configure Notes Interrupt Moderation Set for receive interrupts Jumbo Packet Size TCP UDP Checksum Offload instance specifi c parameter TCP Segmentation Offload TSO instance specifi c parameter MSI X Message Signaled Interrupts Extended Locally Administered Address MAC On 1500 Enable Enable NA On Off 1514 9014 bytes Enable Disable Enable Disable 0 Enable 12 Disable Hexadecimal digits for MAC address ethtool C command ifconfig command ethtool K command offload K ethX ethtool K command ethtool K ethX Module parameter bnad msix disabl e ifconfig hw ether command Reduces context switching and CPU utilization When enabled the hardware will not gene
356. roughput until a link reset or link offline event To avoid this problem the credit loss recovery feature enables ports to recover the lost credits Following are feature limitations J The feature is only supported on Brocade switches running Fabric OS 7 1 and later Q The feature only works at the maximum supported speed of the port 8 Gbps or 16 Gbps depending on the adapter model C The feature only works in R RDY mode and not in VC RDY mode therefore it is enabled with FA PWWN and forward error correction FEC but not supported when N Port trunking or QoS are enabled Note that FEC is supported on 16 Gbps ports only Q The feature is not supported when a port is in D Port mode Q Lost credits are recovered during a link reset 49 BR0054504 00 A 1 Product Overview Adapter features BCU commands and HCM options are available to enable and disable the feature When enabling BB Credit Recovery you provide a buffer to buffer state change number BB_SCN which specifies the number of frames to send and R_RDYs to return from the receiver before the receiver will detect lost credits and initiate credit recovery BCU commands are also available to query for such information as credit recovery state offline or online and offline reasons In addition commands are available to display port statistics for BB_Credit recovery credit recovery frames lost R_RDYs lost and link resets Refer to the QLogic BR Series Adapter A
357. rs Developer s Guide W CIM Provider for QLogic BR Series Adapters Installation Guide Adapter software QLogic BR Series Adapter software includes the appropriate driver package for your host system management utilities and the HCM application You can install all of these components or individual components using the QLogic Adapter Software Installer QASI GUI based application or commands Driver packages A single adapter driver package is available for installing to each supported host operation system and platform Refer to Software installation and driver packages on page 81 for a list of packages for each support host systems Each driver package contains the following components m Driver for your host system In most cases both the required storage and network drivers are included in installation packages For systems not supporting network drivers only the storage driver is included a Firmware 75 BR0054504 00 A 1 Product Overview Adapter software Firmware is installed in the adapter s on board flash memory and operates on the adapter s CPU It provides an interface to the host device driver and off loads many low level hardware specific programming tasks typically performed by the device driver The firmware provides appropriate support for both the storage and network drivers to manage the hardware Depending on the adapter model it also provides the following functions C For CNAs and for Fabric Adapter
358. rsion 1 IP Large Send Offload Version 2 IP Large Send Offload Version 2 IPvt Locally Administered Address Receive Side Scalin TCP UDP Checksum Offload IPY TCP UDP Checksum Offload IP v Figure A 2 Advanced Properties dialog box for team An instance of a physical port that is part of a team displays in the Device Manager as Team Team Name followed by the physical adapter name for example Team Failover QLogic 10G Ethernet Adapter Right clicking this instance displays a Properties dialog box labeled Team Failover QLogic 10G Ethernet Adapter The Advanced tab contains the same parameters as shown in Figure A 1 on page 336 for the physical port Note that you cannot configure the parameters in this dialog box that are configured for a team without removing the port as a member of the team However you can configure other parameters such as VLAN ID or Receive Buffers as they are not team parameters 337 BR0054504 00 A A Adapter Configuration Network driver parameters Linux Table A 6 describes the instance specific network configuration parameters available for Linux hosts Table A 6 Network driver configuration parameters s Default Method to Function Value Possible Values Configure Notes IOC auto 1 1 Enable bna ioc auto reco Auto recovery of IOC IO recovery 2 Disable ver Controller on heartbeat failure ethtool T ethtool T command Display timestamp capabilities of Precision Time P
359. rule with the image profile The following command creates a rule that assigns the image profile to all hosts New DeployRule Name Brocade version 03 Boot Item Brocade version 03 AllHosts The following command adds the deploy rule to the rule set Add DeployRule DeployRule Brocade version 03 Boot 8 Ifyou are going to export the image to an ISO image use the following command Export EsxlImageProfile ImageProfile Brocade version FilePath C vsphere5 customimage iso ExportToIso 245 BR0054504 00 A 4 Boot Code Configuring BIOS with the BIOS Configuration Utility 9 To further customize your to deployment refer to vSphere Installation and Setup for vSphere and ESXi 5 0 Configuring BIOS with the BIOS Configuration Utility Use the BIOS Configuration Utility on Legacy BIOS systems or UEFI capable systems in Legacy BIOS mode to configure boot over SAN options port speed and boot delay and to display adapter properties such as the BIOS version PWWN and NWWN BIOS configuration utility and BIOS configuration menu are used interchangeably in this manual To configure BIOS parameters using the BIOS Configuration Utility use the following steps When you change a setting on a BIOS Configuration Utility screen the setting is saved to the adapter whenever you change to a new screen or close the utility 246 BR0054504 00 A 4 Boot Code Configuring BIOS
360. rver to allow communication between the server and agent C For HOM open port 34568 C For CIM Provider open port 5989 Following is an example for opening port 34568 usr sbin esxcfg firewall o 34568 tcp in https usr sbin esxcfg firewall o 34568 udp in https Note that you can change the default communication port for the HCM Agent using the procedures under HCM Agent operations on page 183 Because some versions of ESX and ESXi do not enforce maintenance mode during driver installation it is recommended that you put the host in maintenance mode as a system reboot is required after installation 112 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer Using the QLogic Adapter Software Installer Use information in this section to install the Host Connectivity Manager HCM and driver packages for your host platform using the QLogic Adapter Software Installer QASI application Instructions for using the GUI based installer and command line installer are provided The QLogic Adapter Software Installer application allows you to install all software or to selectively install the HCM or driver packages or management utilities The QLogic Adapter Software Installer is available for Windows Linux and Solaris operating systems For VMware systems it will only operate on guest operating systems for installing the HCM application To install the driver and utilities package for V
361. ry port and the others are in standby mode If the primary port goes down a secondary port is chosen using a round robin algorithm as the next primary This port continues to be primary even if the original primary port returns Failback mode is an extension of the Failover mode In addition to the events that occur during a normal failover if the original primary port comes back up that port again becomes the primary port 802 3ad is an IEEE specification that includes Link Aggregation Control Protocol LACP as a method to control how several physical ports bundle to form a single logical channel LACP allows a network device to negotiate automatic bundling of links by sending LACP packets to the peer a device directly connected to a device that also implements LACP This mode provides larger bandwidth in fault tolerance Consider the following when configuring teaming m m Converged FCoE and network traffic is not supported on ports that participate in an IEEE 802 3ad based team If you are using Windows Hypervisor to create VMs and configuring teaming you should create VLANs using Hyper V Manager instead of using BCU commands or HCM If VLANs were created using BCU commands or HCM before using Hypervisor you should delete those VLANs For Windows Server 2012 the BNI driver is not installed because teaming is natively supported by the Windows 2012 operating system Although teaming is supported on Linux Solaris an
362. s 353 BR0054504 00 A B MIB Reference Table B 1 Supported MIB groups and objects for SNMP Continued Group Physical Group Port Attributes Physical Group Interface Attributes MIB Objects adapterName adapterType adapterSerialNumber adapterModellnfo adapterCardType adapterOEMInfo adapterPClVendorld adapterPClDeviceld adapterPCISsvld adapterHWVersion adapterPortCount portAdapterlndex portlIndex portLinkStatus portDuplexMode portAutonegotiateMode portMaxSpeed portPCIFnCount ethAdapterlndex ethPortIndex ethPCIFnIndex ethName 354 Function Name of the adapter Type of adapter Serial Number Model information for the adapter Adapter card type such as mezzanine non mezzanine An OEM specific information if applicable PCI Vendor ID PCI Device ID PCI Subsystem Vendor ID Hardware version Number of ports on the adapter Adapter index of the port Port Index Port link status Port duplex mode Port autonegotiate mode enabled or disabled Maximum speed of the port Function number of PCI functions of port Adapter Index of the interface Interface port index interface PCI function number interface name BR0054504 00 A B MIB Reference Table B 1 Supported MIB groups and objects for SNMP Continued Group Logical Group VLAN Attributes MIB Objects ethLargeReceiveOffload ethLargeSendOffloadv4 ethLargeSendOffload
363. s for QLogic BR Series Adapters The subagent is only supported on Linux and Windows systems SNMP subagent files are copied to your host system when you install adapter management utilities through HCM and the QLogic Adapter Software Installer QASI Windows systems For Windows systems use the following steps 1 Go to the following directory where the SNMP files are installed c program files brocade adapter Enter one of the following commands brocade install bat SNMPZTRUE Installs the SNMP subagent drivers and other utilities a brocade install bat SNMP_ONLY TRUE Installs only the SNMP subagent Start SNMP services using the following steps a Open Services typically Start gt Control Panel gt Administrative Tools gt Services b Right click SNMP and select Start Linux systems 1 Go to the following directory where the subagent files are installed opt brocade adapter For RHEL OL and SLES systems enter one of the following commands B Enter Linux driver install sh snmp to install the SNMP subagent drivers and other utilities W Enter Linux driver install sh snmp only to install the SNMP subagent only Start SNMP services using the following commands B service lt snmpd gt start 180 BR0054504 00 A 3 Software Installation Updating drivers with HCM This starts the master agent snmpd service if it is not already running WI service lt bnasd gt start This starts the subagent
364. s formatting a partition when the operating system already installed and creating a new partition Continue responding to on screen instructions and refer to your system documentation as necessary to format and complete installation on the target boot LUN After Windows installs on the remote LUN the system should automatically reboot from the LUN 219 BR0054504 00 A 4 Boot Code Boot over SAN Messages should display on the host system as the QLogic BIOS or UEFI loads successfully System boot setup screens should also display a hard drive entry containing the QLogic BR Series Adapter boot LUN number and target storage device Installing Linux RHEL 4 x or 5 x and the driver Use the following steps to install RHEL and the adapter driver on an unformatted disk that you configured as a bootable device when setting up the adapter BIOS or UEFI on the host system If the LUN you have targeted for booting the host system already has an operating system installed be sure to use options for reformatting the LUN during Linux installation Refer to your operating system documentation for details The following procedures load the operating system adapter driver and utilities to the designated boot LUN to allow adapter operation and booting your host system from the LUN However the HCM Agent and full range of QLogic Command Line Utilities such as bfa supportsave are not installed To install the complete driver package with
365. s of the enclosure For additional information refer to installation and user guides and the interoperability guides provided for the blade server and system enclosure B The QLogic mezzanine adapter is compatible with the following types of modules that install in the supported blade system enclosure L Pass thru modules m I O modules 0 Switch modules For detailed information about these modules see the installation and user guides and interoperability guides provided for these modules and the blade system enclosure B The maximum number of adapters that you can install in the system enclosure varies according to the type of enclosure that you are using because each type may support a different number of server blades For additional compatibility information see the installation user and interoperability guides provided for the blade server and the system enclosure 16 BR0054504 00 A 1 Product Overview Converged Network Adapters PCI express connections QLogic CNAs are compatible with PCI express PCle connections that have the following specifications m x8 lane or greater transfer interface Gen1 PCI Base Specification 1 0 1 01a and 1 1 Gen2 PCI Express Base Specification 2 0 Gen3 PCI Express Base Specification 3 0 Install CNAs in PCI express connectors with an x8 lane transfer interface or greater for best performance You cannot install CNAs in PCI or PCI X connectors Storage systems
366. s the following benefits J You can pre create zones with the Virtual PWWN before servers are connected to the fabric For boot LUN creation you can create a zone with a virtual PWWN for a storage system port that is bound to a switch port With FA WWN enabled on the adapter port it will acquire the PWWN from the switch when it logs into the fabric L You can use the FA PWWN to represent a server in boot LUN zone configurations so that any physical server that is mapped to this FA PWWN can boot from that LUN thus simplifying boot over SAN configuration C You can pre define access control lists ACLs in the targets of the boot LUNS so that switch ports can be configured for booting Solaris Linux or other systems BR 804 mezzanine cards connecting to a Brocade Fibre Channel switch through a Brocade 5480 switch or pass through module must meet the following requirements to support FA PWWN C The Brocade 5480 switch functioning in Access Gateway mode must be running Fabric OS 7 0 or later 53 BR0054504 00 A 1 Product Overview Adapter features CQ The end switch must be running Fabric OS 7 0 or later and support the FA PWWN feature Oh The FA PWWN feature must be enabled on the Brocade 5480 switch and the end switch using the Fabric OS fapwwn enable ag AG WWN port port command FA PWWN is only supported on switches running Fabric OS 7 0 and later For detailed configuration procedures and additional informa
367. s with ports configured in CNA mode it manages the physical Ethernet link to present an Ethernet interface to the network driver and a virtual FCoE link to the storage driver once DCB compliance is established for the link J For Fabric Adapters with ports configured in NIC mode it manages the physical Ethernet link to present an Ethernet interface to the network driver The LLDP DCBCXP engine is implemented in the firmware Therefore any other instance of LLDP agent or software must not be used with a CNA or Fabric Adapter port configured in CNA mode Management utilities For more information refer to Management utilities on page 77 Three types of adapter drivers are provided in installation packages Storage driver all adapters This driver provides Fibre Channel frame transport for QLogic host bus adapters and Fabric Adapter ports configured in HBA mode as well as FCoE transport for QLogic CNAs The installer logic detects either a FCoE or Fibre Channel network and the appropriate driver support is provided automatically The storage driver will claim all installed QLogic BR Series Adapters installed in a system This driver will be used instead of the driver originally installed for these adapters Network driver CNAs and Fabric Adapters only Driver for frame transport over Ethernet and basic Ethernet services This driver only applies to CNAs and Fabric Adapter ports configured in CNA mode only
368. same physical port 29 BR0054504 00 A 1 Product Overview Adapter features For each vNIC you can configure bandwidth in increments of 100 Mbps using BCU commands HCM and BIOS UEFI setup screens The maximum bandwidth per vNIC is 10 000 Mbps The maximum bandwidth per port is also 10 000 Mbps Therefore you can divide the 10 000 Mbps among all PFs configured For example if you configure four Ethernet PFs for a Fabric Adapter port you can assign 2 500 Mbps per PF to reach the 10 000 Mbps maximum You can configure a minimum available bandwidth per vNIC partition This bandwidth is guaranteed to be available on a port when other vNICs are contending for bandwidth on the port Note the following for this feature WB A zero value for the minimum bandwidth implies no guaranteed minimum bandwidth for the vNIC B Ihesum of minimum bandwidths for all vNICs on a port should be no more than the port s bandwidth ul The minimum bandwidth should be no more than the maximum bandwidth for the vNIC As an example of minimum bandwidth configuration vNIC1 is configured at 2 Gbps vNIC2 at 4 Gbps vNIC3 at 0 Gbps and vNIC4 at 0 Gbps In this case vNIC1 and vNIC2 are guaranteed a minimum of 2 and 4 Gbps respectively but no minimum is guaranteed for vNIC 3 and 4 When all four vNICs are trying to send data the following is approximate what you can expect for minimum bandwidth in the steady state B vNIC1 2 10 2 4 4 3 Gbps m vNIC2
369. sed 247 BR0054504 00 A 4 Boot Code Configuring BIOS with the BIOS Configuration Utility 3 Select a port that you want to configure A screen similar to the one in Figure 4 7 displays In the following illustration port O on the BR 1020 CNA was selected Brocade BIOS Config Menu Adapter Selected Adapter Model PCI Bus Dev Fn PWWN BR 1020 8c 88 88 10 00 00 05 1E 55 27 68 Adapter Configuration Adapter Settings Boot Device Settings lt ESC gt Go back lt ENTER gt S configure lt Up Doun gt Navigate lt Alt 0 gt Exit ieee es Pag exit lt Left Right gt Change values Figure 4 7 BIOS Configuration Menu Adapter Configuration 4 Select one of the following B q Adapter Settings Use the Adapter Settings screen to enable BIOS adapter port speed HBAs and Fabric Adapter ports configured in HBA mode only and discovery of boot LUN information from the fabric You can determine adapter N and PWWN Proceed to Step 5 B Boot Device Settings Use the Device Settings screen to select the boot target and LUN for booting the host system Proceed to Step 7 248 BR0054504 00 A 4 Boot Code Configuring BIOS with the BIOS Configuration Utility 5 Select Adapter Settings and press Enter to begin adapter configuration A screen similar to that shown in Figure 4 8 displays showing the port s current BIOS version NWWN PWWN and MAC CNAs and Fabric Adapter ports configured in CNA mode only T
370. selected as boot devices through the BIOS Configuration Utility or BCU If using BCU or HCM to configure boot over SAN a reboot is required for the change to be effective 216 BR0054504 00 A 4 Boot Code Boot over SAN Operating system and driver installation on boot LUNs Use the procedures in this section to install the host operating system and adapter drivers on an unformatted disk that you configured as a bootable device when setting up the adapter BIOS or UEFI on the host system Instructions are provided for the following W Installing Windows and the driver Installing Linux RHEL 4 x or 5 x and the driver Installing Linux SLES 10 and later and the driver Installing RHEL 6 x or Oracle Linux OL 6 x and the driver Installing Solaris and the driver Installing VMware and the driver Installation on systems supporting UEFI For information on operating system support for drivers refer to Boot installation packages on page 88 and Host operating system support on page 70 Before installing the operating system and adapter drivers be sure you have bound the PWWN of the appropriate adapter port to the designated boot LUN and have configured the BIOS or UEFI on your host system for booting over SAN Refer to Configuring boot over SAN on page 211 Configuring BIOS with the BIOS Configuration Utility on page 246 and IBM Agentless Inventory Manager AIM support on page 259 for instructions The following proc
371. sion For ESXi 4 1 use the following steps for offline bundles a Install the software using the esxupdate command as follows esxupdate bundle Mount DIR BCD bfa bna release ver offline bundle build numer zip update b Verify installation using the esxupdate command as follows esxupdate query 168 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools For ESXi 5 X use one of the following steps to install the software depending on your ESXi version from where you want to obtain a VIB or offline bundle a Extract the VIB file from the offline bundle and install from a local file system using the following commands esxcli software vib install d directory path VIB file name W Use the following command to install an offline bundle from an online depot esxcli Server server name software vib install d online depot URL W Use the following command to install a VIB from an online depot esxcli Server server name software vib install v online depot URL To verify ESXI 5 X installation use the following command esxcli s u p software vib list Exit maintenance mode Reboot the host Verify the new driver is installed and loaded using the following commands esxupdate query vmkload mod 1 Using VMware Update Manager to install Adapter software driver CD You can install adapter drivers using VMware VSphere Update Manager VUM 4 1 and later Before usi
372. size 2048 2112 vhba intr log level fcpim pathtov Supported in release 2 0 and later A value of 0 forces an immediate failover 1 60 sets a delay in seconds Not available This parameter determines the maximum size of aDMA read through PCle port dfsize 321 BR0054504 00 A A Adapter Configuration Storage instance specific persistent parameters Table A 1 Adapter instance specific parameters Continued F Default Possible BCU unction Parameter value values command port name bfa port name NA min chars 0 port name max chars 64 port speed bfa port speed 0 0 auto select port speed BR 825 and 1 1 Gbps BR 815 HBAs support port speeds 2 4 USES and 8 Gbps HBAs 4 4 Gbps HBAs pica supports po S speeds 1 2 4 BAR and 8 Gbps 16 16 Gbps HBAs l BR 1860 and 10710 ceps BR 1867 HGA ENAS ports support port speeds 2 4 8 and 16 Gbps 8 Gbps HBAs support port speeds 1 Gbps at the driver level but notin a BIOS or boot over SAN configuration 322 BR0054504 00 A A Adapter Configuration Storage instance specific persistent parameters Table A 1 Adapter instance specific parameters Continued Default Possible 21610 Function Parameter value values command Notes port bfa port topology p2p p2p port topology Port topology topology loop is not supported on auto CNAs or Fabric Adapter ports c
373. so download ESXi offline bundles from the following location http driverdownloads glogic com 2 Connect to the vSphere Virtual Center Connect VIServer Server server name User administrator Password password 244 BR0054504 00 A 4 Boot Code Using VMware Auto Deployment to boot QLogic custom images 3 Add the VMware ESX software depot Use the command format of Add EsxSoftware Depot lt directory location gt lt zip file name gt and add the storage driver bfa network driver bna host profile and BCU plugin Refer to the following examples Add EsxSoftwareDepot C MBCD bfa version 00000 offline bundle 564849 zip Add EsxSoftwareDepot C MBCD bna version 00000 offline bundle 564849 zip Add ESXSoftwareDepotC VMBrocade esx 5 0 0 0 bfaConfig version offline bundle 563502 zip Add EsxSoftwareDepot C MBcu esx50 version zip 4 Create a new image profile by cloning the standard ESXi 5 0 image profile new esximageprofile cloneprofile ESXi 5 0 0 469512 standard name Brocade version 5 Add the QLogic software to the cloned image add esxsoftwarepackage imageprofile Brocade version 03 softwarepackage scsi bfa net bna brocade esx bcu plugin hostprofile bfaConfig 6 Verify VIBs are added to the image profile get esximageprofile Brocade_ lt version gt VibList 7 Ifyou are going to auto deploy the image use the following commands to associate a deploy
374. st other than the one where you are installing driver packages Refer to you VMware VMA documentation for instructions 1 Download the QLogic adapter driver CD from downloads vmware com Search for VMware ESXi 5 x driver for Brocade HBAs version 3 2 4 The driver offline bundle zip file is included in the CD contents as BCD bfa bna release ver offline bundle build number zip Copy the offline bundle zip file to the vCLI host s tmp directory or if loading the zip file locally from a CDROM use the following command mount dev cdrom mnt Make sure the host to which you are installing drivers is in maintenance mode Go to directory with the offline bundles or if mounting the VMA CDROM execute the mount dev cdrom mnt command Install the QLogic Adapter software using one of the following steps B For ESX and ESXi 4 1 hosts use the following command vihostupdate i b BCD bfa bna release ver offline bundle build numer zip server m For ESXi 5 0 hosts use the following command esxcli Server server name software vib install d BCD bfa bna release ver offline bundle build numer zip Verify the installation was successful E For ESX and ESXi 4 1 hosts use the following command vihostupdate q server IP or hostname W For ESXi 5 0 hosts use the following command esxcli s u p software vib list Exit maintenance mode 167 BR0054504 00 A 3 Software Installation Using sof
375. stallation scripts and system tools on page 138 Only one driver installation is required for all types of adapters CNA host bus adapter or Fabric Adapter installed in a host system Refer to Software installation and driver packages on page 81 for a complete list of driver and software installer packages that are available at http driverdownloads glogic com To keep drivers and boot code synchronized be sure to update your adapter with the latest boot code image To download boot code perform the following steps T Go to the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model In the table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go Click the Boot Code link at the top of the page to direct you to the boot code packages Locate the boot code package for your adapter in the table click on it and then follow the directions Boot installation packages Download boot installation packages to support boot operations such as boot from SAN network boot and updating adapter boot code from the QLogic Web Site using the following steps 1 Go to the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model In the table select the adapter type in first column the adapter model in the second column the operating system in the third column and
376. stem brocade install sh u brocade install esxi sh u B To display help enter one of the following commands based on your operating system brocade install sh h brocade install esxi sh h 5 Reboot the system Using the vSphere client exit maintenance mode 7 Determine if the driver package is installed using the following command sxcfg modul 1 This lists loaded module names Verify that an entry for bfa exists for the storage driver and an entry for bna exists for the network driver 8 Display the latest versions of installed drivers using the following commands Look for bfa storage driver and bna network driver entries and related build number a For ESX 4 1 enter the following command cat proc vmware version Bi For ESXi 5 0 enter the following command esxcli software vib list Ex For ESXi 4 1 use the following commands sxcfg modul S bfa sxcfg modul s bna 9 Start the HCM Agent by using steps under HCM Agent operations on page 183 Manually installing the driver package does not automatically start the HCM Agent 160 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 10 When the driver is installed and host is connected to the fabric turn on the host system and verify adapter operation Verify proper LED operation for stand up adapters by referring to one of the following locations
377. steps 1 2 At the command line change to the directory where the installer is located Use the following commands to initiate silent installation using the properties file u Windows systems brocade adapter software installer windows version exe f HCMDefaultInstall properties Linux systems brocade adapter software installer linux version bin f HCMDefaultInstall properties Solaris systems brocade adapter software installer solaris x86 version bin f HCMDefaultInstall properties brocade adapter software installer solaris sparc version gt bin f HCMDefaultInstall properties Software removal using Adapter Software Uninstaller Use the following steps to remove the adapter driver packages and HCM Instructions are provided for using the GUI based or command based QLogic Adapter Software Installer Instructions are provided for Windows Solaris and Linux systems Important notes Review these notes for removing the QLogic BR Series Adapter software from your system Use steps in this section to remove HCM Before removing adapter software It is strongly recommended that you stop the HCM agent and shut down the HCM application if it is running on your system For instructions on stopping the HCM Agent refer to HCM Agent operations on page 183 When removing HCM you may be prompted to backup existing configuration data Refer to HCM configuration data on page 186 for more informatio
378. steps to install driver and utility packages to Solaris systems Driver packages install as the following W Storage drivers bf a driver operating system version pkg W X Network drivers bna driver operating system version pkg W X User utilities brcd util operating system version pkg Refer to Software installation and driver packages on page 81 for a description of host systems that this driver package supports 154 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Root access is required to install or remove the driver package 1 Logon to the Solaris system as a super user 2 Copy the brocade driver operating system version tar to your system s tmp directory brocade driver operating system version tar contains all drivers for specific Solaris distributions For example brocade driver solaris version tar contains all storage drivers for Solaris systems where version is the version number of the driver release 3 Using the change directory cd command change to the directory where you copied the driver package tar file 4 Perform the following steps a Enterthe following command and press Enter to untar the file f tar xvf brocade driver operating system version tar This extracts the driver packages utilities packages and installation script W Storage drivers b a driver operating sys
379. switch v VLAN ID p port group name virtual switch name where VLAN ID ID of 0 4094 A value of 0 disables VLANs port group name Name of port group you have configured for virtual switch virtual switch name Name of virtual switch containing port group For more information on using the esxcfg commands refer to your VMware system documentation or man pages B Following is an example to enable or disable Ethernet pause ethtool A eth X autoneg on off rx on off tx on off where ethx Adapter position in server For example ethO is the first Ethernet interface found in the system eth1 is the second eth2 is the third and so on autoneg Autonegotiate on or off rx Receive on or off tx Transmit on or off 348 BR0054504 00 A A Adapter Configuration Network driver parameters Managing VMware driver configuration with ethtool To enable or disable interrupt moderation use the following command ethtool C ethX adaptive rx on off where ethx Adapter position in server For example ethO is the first Ethernet interface found in the system eth1 is the second eth2 is the third and so on Configuring NetQueue NetQueue improves performance on servers in 10 Gigabit Ethernet virtualized environments NetQueue provides multiple receive and transmit queues on the CNA which allows processing on multiple CPUs to improve network performance MSI X is enabled in the network driver b
380. system If bna appears in the list the network driver is loaded to the system dmesg This command prints kernel boot messages Entries for bfa storage driver and bna network driver should display to indicate driver activity if the hardware and driver are installed successfully 8 Start the HCM Agent by using steps under HCM Agent operations on page 183 Manually installing the driver package with installation scripts does not automatically start the HCM Agent 9 When the driver is installed and the system is connected to the fabric verify adapter operation Verify LED operation for stand up adapters by referring to Adapter LED operation stand up adapters on page 283 Upgrading driver on Linux systems To update the driver package simply install the new driver and HCM package using steps under Driver installation and removal on Linux systems on page 146 When upgrading the driver for Linux systems you do not need to reboot the host system The new driver is effective after system reboot 149 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Installing and removing driver packages on Citrix XenServer systems The following procedures install drivers and utilities supporting Citrix XenServer version 6 1 as an example Installing packages for other Citrix XenServer versions is similar Installing driver packages on Citrix XenServer systems 1 2 Boot th
381. t Assistant Guide to set DHCP and the password Log in as vi admin using the password from Step 4 Copy the adapter driver ISO files appropriate for your adapter to a temporary directory tmp on your vMA system Following are general command formats for using Putty secure copy pscp from windows and secure copy scp W pscsp exe c downloads driver ISO user host tmp W scp source filename user host destination target 161 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 7 10 11 12 Run the following command for superuser privileges sudo s When prompted for the password enter the superuser account password same as from Step 4 Add the ESXi server IP Address to vMA using the following command vifp addserver lt ESXi address gt where lt ESXi address gt is the ESXi server s IP Address where driver is to be installed Run the following command to make sure that the added ESXi server is listed in the vMA vifp listservers Execute the following command on the vMA terminal vifptarget set ESXi IP address hostname gt where set is the Server option lt ESXi address is the ESXi server s IP entered at Step 9 Mount the adapter driver iso file on a temporary directory such as ISO Create this directory if does not exist mkdir p ISO mount o loop Brocade Driver ISO file ISO
382. t attached Fibre Channel targets you must use the First LUN or Flash Values options Flash Values is recommended For more information For details on using the BIOS Configuration Utility refer to Configuring BIOS with the BIOS Configuration Utility on page 246 For information on using BCU commands and HCM refer to Configuring BIOS with HCM or BCU commands on page 254 For more information and configuration procedures for booting over SAN refer to Configuring boot over SAN on page 211 205 BR0054504 00 A 4 Boot Code Boot over SAN QLogic UEFI support Unified Extensible Firmware Interface UEFI boot code for QLogic BR Series Adapters allows boot support on UEFI based platforms The UEFI boot code can discover 256 storage targets such as RAID units and logical unit numbers LUNs when the LUNs are bound to adapter ports The UEFI boot code loads from adapter option ROM into system memory and integrates with the host system server UEFI during system boot to facilitate booting from target LUNs which are also referred to as virtual drives and boot devices LUNs targeted as boot devices must contain the boot image for the host which consists of the adapter driver host operating system and other files that allow the host to boot from the LUN For more information and configuration procedures for booting over SAN refer to Configuring boot over SAN on page 211 After the QLogic UEFI boot code integrates with
383. t configured in CNA or NIC mode if driver packages have correctly loaded lspci W X This command displays information about all loaded modules If bfa appears in the list the storage driver is loaded to the system If bna appears in the list the network driver is loaded to the system lsmod B X This command prints kernel boot messages Entries for bfa storage driver and bna network driver should display to indicate driver activity if the hardware and driver are installed successfully dmesg WB These commands display the location of the driver modules if loaded to the system The following command displays the storage driver module location The module will have a bfa prefix modprobe 1 bfa The following command displays the network driver module location The module will have a bna prefix modprobe 1 bna Verifying adapter installation Problems with adapter operation may be due to improper hardware or software installation incompatibility between the adapter and your host system improper configuration of the host system unsupported SFP transceivers installed stand up adapters only an improper cable connected from adapter to the switch stand up adapters only or an adapter is not operating within specifications Determine if problems exist because of these factors by verifying your installation with information located in the following chapters in this manual 177 BR0054504 00 A 3 Software
384. t obtain the operating system information to register these names with the switch C Avoids errors that can occur from removing software with the Device Manager that was originally installed with the QLogic installer programs and then attempting future updates or removals If removing driver packages or the HCM agent determine if the HCM Agent is running using procedures under HCM Agent operations on page 183 If it is stop the agent using steps under the same heading Installing and removing drivers on Windows systems Use these steps to install storage and network driver packages on Windows systems Refer to Software installation and driver packages on page 81 for a description of Windows driver packages 1 2 Boot the host and log on with Administrator privileges Create a CNA Drivers or HBA Drivers directory in your host s file system depending on your installed adapter or mode configurations for installed Fabric Adapter ports Download the appropriate exe driver package for your system Refer to Software installation and driver packages on page 81 for a description of Windows driver packages Extract the driver packages to the folder you created in Step 2 using the following steps a Double click the package file for example brocade driver win2008 r2 x64 version exe to extract the driver files b Enter a path or browse to the driver directory where you want to install the extracted files
385. t the HCM Agent using steps under HCM Agent operations on page 183 Manually installing the driver package does not automatically start the HCM Agent 144 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 12 When the driver is installed and the host system is connected to the fabric turn on host power and verify adapter operation Verify proper LED operation for stand up adapters by referring to Adapter LED operation stand up adapters on page 283 Command examples Following are examples of using the brocade_install bat command to install driver packages on Windows systems m Install all drivers brocade install bat ul Install all drivers in silent mode brocade install bat SILENT INSTALL TRUE zl Uninstall all drivers brocade install bat INSTALL OP UNINSTALL W Install the Fibre Channel storage driver only brocade install bat DRIVER TYPE HBA B To uninstall FC driver only brocade install bat INSTALL OP UNINSTALL DRIVER TYPE HBA W X Forcefully install the drivers brocade install bat FORCED INSTALL TRUE E Override the installed hotfix with a new hotfix brocade install bat W2K8 HOTFIX KB9987654 Required newer hotfix W X Avoid checking for hot fix brocade install bat W2K3 HOTFIX 145 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools Upgrading driver on Wind
386. ta Center Bridging DCB Capability DCB Exchange Protocol DCBXP 1 0 and 1 1 RSS with support for IPV4TCP IPV4 IPVGTCP IPV6 hash types Syslog mH SRIOV 268 BR0054504 00 A 5 Specifications Fabric Adapters Table 5 2 Fabric Adapter hardware specifications Continued Feature Description Supported Ethernet Jumbo frames features and standards continued Interrupt coalescing Interrupt moderation Multiple transmit priority queues Network Priority Large and small receive buffers TCP Large Segment Offload Unicast MAC address MAC filtering Multicast MAC addresses Multiple transmit queues for Windows and Linux SNMP Windows and Linux Team VM queues IEEE Virtual Bridged Local Area Networks VLAN VLAN discovery using proprietary logic and for untagged priority tagged FIP frames VLAN filtering VMware NetlOC VMware NetQueues v3 VMware 4 1 and later VMware multiple priority levels VNIC DCB Capability Exchange Protocol Base Specification 269 BR0054504 00 A 5 Specifications Fabric Adapters Table 5 2 Fabric Adapter hardware specifications Continued Feature Description Supported FCoE features W LKA Link Keep Alive protocol and standards M Look ahead split E preFIP FIP 1 03 and FIP 2 0 FC BB5 rev 2 compliant Q FIP discovery protocol for dynamic FCF discovery and FCoE link management C FPMA and SPMA type FIP fabric login B FCoE protocols FC SP FC LS
387. tall_rhel sh update initrd brocade_install_sles sh update initrd a To remove all RPMs enter one of the following commands brocade_install_rhel sh u brocade install sles sh u Hi To force removal of all RPMs enter one of the following commands brocade install rhel sh force uninstal l brocade install sles sh force uninstal l B To display help enter one of the following commands brocade install rhel sh h brocade install sles sh h Verify if a network or storage driver package is loaded to the system with the following commands rpm qal grep bfa This command prints the names of the storage driver package bfa if installed rpm qal grep bna 148 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools This command prints the names of the network driver package bna if installed lspci This utility displays information about all PCI buses in the system and all devices connected to them Fibre Channel QLogic Corporation displays for an host bus adapter or Fabric Adapter port configured in HBA mode Fibre Channel QLogic Corporation and Ethernet Controller display for a CNA or Fabric Adapter port configured in CNA or NIC mode if driver packages have correctly loaded lsmod This command displays information about all loaded modules If bfa appears in the list the storage driver is loaded to the
388. tc modprobe conf and then load the driver bfa options bfa lun queue depth 40 Following are examples to disable IOC auto recovery W Load driver with the parameter value modprobe bna bnad ioc auto recover 0 B Add the following entry in etc modprobe conf and then load the driver bfa options ioc auto recover 0 Following are examples for disabling FDMI W Load driver with the parameter value modprobe bfa fdmi enable 0 B Add the following entry in etc modprobe conf and then load the driver modprobe bfa fdmi enable 0 Managing VMware driver configuration To set a configuration parameter use the following steps 1 Enter the following command sxcfg modul s param_name param_value bfa 2 When you have set all desired parameters reboot the system Examples Following is an example to set the LUN queue depth esxcfg module s bfa lun queue depth 1l bfa 327 BR0054504 00 A A Adapter Configuration Storage driver level parameters Following is an example to disable FDMI sxcfg module s fdmi enable 0 bfa bfa Important notes Observe these notes when modifying driver configuration parameters B The esxcfg module reads and updates from the file etc vmware esx conf M Editing this file directly is not recommended WB Be careful not to overwrite the existing options Always query the existing configuration parameter value before changing it using the following command sxcfg modul q
389. tch command Notes E Maximum number of Rx NetQueues W One Rx NetQueue Minimum W Zero Rx NetQueue Disabled E Maximum number of Tx NetQueues E One Tx NetQueue Minimum W Zero Tx NetQueues Disabled W Sets MTU size W Size must not be greater than size set on switch that supports Data Center Bridging DCB W You must enable the MTU size for each vswitch or VMkernal interface Assign a VLAN ID to a port group on a specific vswitch 344 BR0054504 00 A A Adapter Configuration Network driver parameters Table A 7 Network driver module parameters Continued Default Possible Method to Parameter VELU values configure Motes MSI X Enable 0 1 Disable cfg module W Advanced user Message 0 Enable parameter configuration Signaled bnad msix disable m This parameter is Interrupts used to disable Extended MSI X W The parameter is enabled by default in the network driver However the NetQueue feature of VMware must be enabled in the VMware system to enable MSI X in the system W Driver will attempt to enable but use INTx in case MSI X is not supported or NetQueue is not enabled Interrupt On On ethtool C command Reduces context Moderation Of switching and CPU Set for receive utilization When enabled interrupts the hardware will not generate an interrupt immediately after it receives a packet but waits for more packets or a time out to expire
390. tem version pkg W Network drivers bna driver operating system version pkg W User utilities brcd util operating system version pkg H Installation script brocade install sh b Enter the following command to remove all old packages if installed and install new ones 4 brocade install sh 5 Enter the following to restart load the driver and reconfigure the system reboot r 155 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 6 Verify if the driver packages are loaded to the system with the following commands pkginfo grep bfa pkginfo grep bna pkginfo grep brcd util You can use the pkginfo I command to display details about installed drivers 7 Start the HCM Agent by using steps under HCM Agent operations on page 183 Manually installing the driver package does not automatically start the HCM Agent 8 When adriver is installed and the host system is connected to the fabric turn on host power and verify adapter operation Verify proper LED operation for stand up adapters by referring to Adapter LED operation stand up adapters on page 283 Removing driver packages from Solaris systems Use the following steps to remove driver and utility packages Root access is required to remove the packages 1 Log on to your system as root user 2 Determine if the driver and utility packages ar
391. tem reboot because the adapter was modified then reinstall the driver installation will fail because the operating system cannot update the driver while a system reboot is pending However if you reboot the system after removing the driver the operating system will not come up because the driver accessing the operating system was removed Using VMware Auto Deployment to boot QLogic custom images VMware Auto Deployment for ESXi 5 0 leverages the default boot ROM to chain load gPXE which will then use HTTP to transfer the ESXi 5 0 image and host profile data from the auto deploy server gPXE formerly Etherboot is an open source Preboot Execution Environment PXE implementation and bootloader The traditional PXE clients use TFTP to transfer data but gPXE adds the ability to retrieve data through other protocols like HTTP iSCSI and ATA over Ethernet AoE You can configure PXE boot from QLogic CNAs and Fabric Adapter ports for CNA or NIC mode using Network boot on page 193 243 BR0054504 00 A 4 Boot Code Using VMware Auto Deployment to boot QLogic custom images For additional information on gPXE and on configuring and installing VMware Auto Deployment refer to following resources W http etherboot org wiki index php W Instructions for installing ESXi and using vSphere Auto Deploy on the vSphere 5 Documentation Center For procedures to build custom images from QLogic BR Series Adapter online and offline software b
392. ter BCU commands Select this to open a Command Prompt window in the folder where the BCU commands reside You can also enter full BCU commands such as bcu adapter list or enter bcu shell to get a bcu gt prompt where only the command adapter list is required Software installation using Software Installer commands Execute QLogic Adapter Software Installer commands detailed in this section on the host system s command line with your choice of parameters to step through the installation or automatically install network and storage driver packages the HCM application or both without requiring further user interaction The HCM Agent starts automatically after installation For details on operating system requirements for installing adapter drivers refer to Host operating system support on page 70 and Software installation and driver packages on page 81 Also download the latest release notes from the QLogic Web Site whenever you install or update adapter driver packages using the following steps 1 Go to the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 3 Click the Drivers link at the top of the page to direct you to the driver packages 4 Locate the driver package for your adapter in the table and then click on t
393. ter the host updates successfully exit from maintenance mode Using the vSphere Client right click ESXi and choose the Exit Maintenance Mode option Reboot ESXi Right click the ESXi server and select Reboot Be sure to reboot ESXi server where we are installing the driver and not the vMA 163 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 19 After the ESXi server has rebooted run the following command to make sure the driver is installed The QLogic driver should appear in the list vihostupdate q Using Image Builder for ESXi 5 0 You can use VMware Image Builder with PowerCLI to customize ESXi 5 0 installations You can perform the following tasks Add an offline bundle to the image profile Add an online bundle to the image profile Export image profiles to an ISO Use image profiles with auto deploy Add an offline bundle to image profile You can use Image Builder through PowerCLI to add a downloaded offline bundle to an image profile that can be exported to an installation ISO file or deployed to an online depot Use the following general steps For detailed steps refer to procedures on using vSphere ESXi Image Builder CLI in the vSphere documentation 1 Go to the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model In the table select the adapter type in first column the adapter model in the second column
394. ters llis llsusss 331 Network driver parameters llle 332 WiridOWS 52 056 oh eaoveeGn0uu LEE SIE E Xa eee EG Fu ward 333 Blu CCP 338 VMWare Ed bat oe Ya ERROR EE ERE Ck ee OSG EE Re d 344 Enabling jumbo frames for Solaris 00 00 0 eee eee eee 352 B MIB Reference Index ix BR0054504 00 A Installation Guide BR Series Adapters x BR0054504 00 A Installation Guide BR Series Adapters List of Figures Installing adapters using this document llle seil 1 1 BR 1860 Fabric Adapter heat sink removed illis ee eee ee eee 1 2 BR 1020 stand up CNA with low profile mounting bracket heat sink removed 1 3 BR 1007 CNA EIL 1 4 BR 1741 mezzanine card eva e er S nrnna ROSS SE ERS EER Laas 1 5 BR 825 Host bus adapter with low profile mounting bracket heat sink removed ac acsi b RE itn CRICKET CRT EO ra 1 6 BR 804 mezzanine host bus adapter 0 0 ee 1 7 BR 1867 host bus adapter bottom view llli elles 1 8 BR 1869 Host bus adapter bottom view 0 cee eee ee 2 1 Removing or installing adapter mounting bracket 000 0 eee eee 2 2 Installing adapter in system ChasSiS 0 0 00 cece ee 2 3 Removing or installing fiber optic and copper SFP transceivers 3 1 Installer progress bat sss ek ru 044 S44 Ged Rm eek om RR RRS 3 2 QLogic Adapter Installer Introduction screen llli eee ee 3 3 Existing softwa
395. the system UEFI during system boot use your system s UEFI setup screens to enable or disable BIOS on the adapter port When enabled available Fibre Channel devices attach as UEFI devices and obtain UEFI device names Once the Fibre Channel devices have UEFI device names you can select them using the host s Boot Configuration menu or setup screens as boot devices Use the system s UEFI setup screens to configure the following options W Boot over SAN for HBAs and Fabric Adapter ports configured in HBA mode m Port operating mode HBA CNA NIC for Fabric Adapters Depending on your host system you may be able to change only supported port operating modes Port speed for HBAs and Fabric Adapter ports set in HBA mode LUN masking for HBAs and Fabric Adapter ports set in HBA mode QoS for HBAs and Fabric Adapter ports set in HBA mode VNICs for Fabric Adapter ports configured in CNA or NIC modes You can also display port information such as the following MAC address Link status WWPN Port topology P2P or loop Option ROM version Adapter firmware version 206 BR0054504 00 A 4 Boot Code Boot over SAN W Configured port mode for QLogic Fabric Adapters Depending on your host system you may be able to change only supported port operating modes B Minimum and maximum bandwidths for configured VNICs for QLogic Fabric Adapter ports configured in NIC or CNA modes For more information For general steps on configur
396. ties file are available under the Guidelines for silent installation section located in the HCMDefaultproperties file m f you choose to install the driver both the storage and network drivers will be installed W X Software installation or upgrade on a host system with a large number of adapters could take much longer than normal Parameters are case sensitive Find the installer program for your server s operating system and platform under Software installation and driver packages on page 81 Before using any commands described in this section use the following steps to download the Adapter Software Installer to your system 125 BR0054504 00 A 3 Software Installation Using the QLogic Adapter Software Installer 1 Go to the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model 2 Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go 3 Clickthe Software Installers link at the top of the page to direct you to the adapter software installer packages 4 Locate the adapter software installer package for your adapter in the table click on it and then follow the directions m To enter these commands first change to the directory where the adapter software is installed cd install directory Default install directories are the following Q Windows systems C Program Files BROCADE Ad
397. time delay There is a time delay during which the host generates interrupts You can increase this delay time and thereby coalesce multiple interrupts events into one This results in fewer interrupts for interrupt events Q Interrupt latency timer An interrupt is generated when no new reply message requests occur after a specific time period You can adjust this time period and thereby minimize I O latency I O execution throttle Refer to I O execution throttle under Host bus adapter features on page 49 LUN masking LUN masking establishes access control to shared storage to isolate traffic between different initiators that are zoned in with the same storage target LUN masking is similar to zoning where a device in a specific zone can communicate only with other devices connected to the fabric within the same zone With LUN masking an initiator port is allowed to access only those LUNs identified for a specific target Enable LUN masking on an adapter physical port through the HCM Basic Port Configuration dialog box and the BCU fcpim lunmaskadd command to identify the logical port initiator and remote WWN target for the LUN number Refer to the QLogic BR Series Adapter Administrator s Guide for more information on configuration You can also enable LUN masking through the QLogic BIOS Configuration Utility and your system s UEFI setup screens Refer to Configuring BIOS with the BIOS Configuration Utility on pa
398. tion on supported products and configurations For Brocade switches refer to the Brocade Fabric OS Administrator s Guide Fabric based boot LUN discovery a feature that allows the host to obtain boot LUN information from the fabric zone database This feature is not available for direct attached targets FCP IM I O Profiling and LUN level Statistics This feature available through HCM or BCU commands can be configured at both initiator target and initiator target LUN levels When enabled the driver firmware separates I O latency statistics for the configured flows into five separate categories based on I O size The latency information along with a number of other I O related statistics can then be queried Use this feature to analyze traffic patterns and help tune host bus adapters Fabric Adapter ports configured in HBA mode fabrics and targets for better performance Note that enabling this feature impacts I O performance It is disabled by default and does not persist across driver reloads and system reboots Fibre Channel Arbitrated Loop FC AL support FC AL allows Fibre Channel devices to be connected in a loop topology and establish communication without switches Devices connect to the loop through L Ports Ports that can communicate on the loop are Fabric Loop ports FL Port or node loop ports NL Port An arbitrated loop with an FL Port called a public loop allows fabric connectivity for multiple NL Por
399. to 95 relative noncondensing Power consumption 12 W maximum CNA and optics Operating voltage Per PCle 2 0 specifications 285 BR0054504 00 A 5 Specifications Converged Network Adapters Mezzanine CNAs This section provides specifications for mezzanine CNAs BR 1007 CNA Table 5 12 lists environmental and power specifications for the BR 1007 CNA Table 5 12 Environmental and power requirements for BR 1007 CNA mezzanine card Property Requirement Airflow Provided by blade system enclosure Operating altitude 3 048 meters 10 000 ft Nonoperating altitude 12 193 meters 40 000 ft Operating temperature 0 to 50 C 32 to 122 F Nonoperating temperature 40 C to 73 C to 40 F to 163 F Operating humidity 50 C 122 F at 10 to 9396 Nonoperating humidity 60 C 140 F at 10 to 93 Power dissipation 9 5 W maximum 8 5 W nominal Operating voltage Per PCle 2 0 specifications Dimensions Approximate height 13 mm 0 5 in Approximate width 160 mm 6 3 in Approximate depth 124 mm 4 9 in Approximate weight 127 g 0 28 Ib The BR 1007 adapter conforms to environmental and power specifications for the supported blade servers and blade system enclosures in which they install Refer to the documentation provided for these products for information Also refer to Server blades and system enclosures mezzanine adapters on page 16 for references to CNA compatibility information 286 BR005450
400. tructions B WinPE ISO image that you can create for x86 and x64 platform You can use a WinPE image to boot UEFI based systems To create these images refer to Creating a WinPE image on page 242 For more detailed procedures to create a bootable CD or USB drive from the ISO image refer to documentation for your CD or USB drive burning software As an example of open source USB burning software for bootable Live USB drives refer to http unetbootin sourceforge net For details on booting your operating system from a CD DVD or USB drive refer to your host system documentation and online help 240 BR0054504 00 A 4 Boot Code Boot systems over SAN without operating system or local drive Using a LiveCD image The following procedures assume that the QLogic BR Series Adapter has been installed in the host system 1 For BIOS based systems obtain the LiveCD image from the QLogic Web Site using the following steps a Goto the QLogic Web Site at http driverdownloads qlogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column the operating system in the third column and then click Go c Click the Boot Code link at the top of the page to direct you to the boot code files d Locate the Multi Boot Firmware LiveCD link for your adapter in the table click on it and following the instructions For UEFI based systems create a WinPE i
401. ts A loop topology with only NL Ports is a private loop Devices in a public loop can remain private by not logging into the fabric FC AL is a blocking topology and a circuit must be established before two L Ports can communicate The loop supports only one point to point circuit at a time so when two L Ports communicate all other L Ports are either monitoring or arbitrating for access to the loop 54 BR0054504 00 A 1 Product Overview Adapter features You can configure the adapter connection for loop or point to point P2P topology through BCU commands and HCM The auto option is not supported For configuration details refer to the QLogic BR Series Adapter Administrator s Guide Following are aspects of FC AL support m m d a m L Supported on all standup host bus adapters and Fabric Adapter ports configured in HBA mode Supported at port speeds of 2 4 or 8 Gbps Although there is no support at 16 Gbps FC AL will function in autonegotiation mode at other speeds Supported on Windows Linux and VMware systems only BIOS and UEFI boot supported from all FC AL targets Following are limitations of FC AL support You cannot set FC AL or loop configuration if QoS rate limiting virtual port or trunking features are enabled More than one vHBA default is not allowed Hubs are not supported Multiple initiators are not supported only supported for direct attach to a single array
402. tware installation scripts and system tools 8 Reboot the host 9 Verify that the new driver is installed and loaded a For ESX and ESXi 4 1 hosts use the following command vihostupdate q server IP or hostname W For ESXi 5 0 hosts use the following command esxcli software vib list grep bfal bna Manually install drivers from offline bundles using COS or DCUI Use the following steps to install drivers from the driver offline bundle to your host system using the VMware Console Operating System COS or Direct Console User Interface DCUI Refer to Software installation and driver packages on page 81 for a description of driver packages and download instructions Before performing these steps be sure to enable SSH for remote ESX installations and ESXi installations For local ESX installations you can mount the CDROM containing the adapter driver CD files 1 Download the adapter driver CD from downloads vmware com Search for VMware ESXi 5 x driver for Brocade HBAs version 3 2 4 The driver offline bundle zip file is included in the CD contents as BCD bfa bna release ver offline bundle build number zip 2 Copy the offline bundle zip file to the vCLI host s tmp directory If loading the zip file locally from a CDROM use the following command mount dev cdrom mnt 3 Make sure the host to which you are installing drivers is in maintenance mode 4 Usethe following instructions according to your ESXi ver
403. uld now boot by default 226 BR0054504 00 A 4 Boot Code Boot over SAN Installing Solaris and the driver Use the following steps to install Solaris and drivers on an unformatted Fibre Channel disk that you that you configured as a bootable device when setting up the adapter BIOS or UEFI on the host system Installation notes Read through these important notes before installing Solaris and adapter drivers on the LUN If the LUN you have targeted for booting over SAN already has an operating system installed be sure to use options for reformatting the LUN during Solaris installation Refer to your operating system documentation for details Before proceeding with these steps detach or disable any existing local hard disks on your host system since the installation will pick the local disk by default for installation You can reconnect or enable this drive after installing these procedures Boot over SAN is not supported on Solaris SPARC systems BR 804 and BR 1007 adapters are not supported on Solaris systems Installation procedure 1 Refer to Boot installation packages on page 88 for a list of these files and the operating systems that support these files Also refer to Host operating system support on page 70 for information on operating system support for adapter drivers Download the QLogic BR Series Adapter driver update iso file appropriate for your system from the QLogic Web Site using the following steps
404. undles for auto deployment refer to Building a custom image for auto deployment or ISO image Building a custom image for auto deployment or ISO image Use the following information to build a custom image from the QLogic BR Series Adapter online and offline bundles for auto deployment to export to an ISO image For information on VMware auto deployment refer to Using VMware Auto Deployment to boot QLogic custom images Note that the following procedure employs host profiles Although they are not needed to boot ESX through auto deployment they help maintain consistent configuration settings for ESX hosts and are a necessary part of auto deploy or stateless ESX because settings need persisted across reboots Host profiles are required if you are changing adapter driver configuration settings from the default QLogic s ESXi 5 0 host profile plug in support is documented in the following VMware Knowledge Base article http kb vmware com selfservice microsites search do language en_US amp cmd d isplayKC amp externalld 2001844 1 Obtain the online or offline bundle using one of the following methods B X Download the QLogic adapter driver CD from downloads vmware com Search for VMware ESXi 5 x driver for Brocade HBAs version 3 2 4 The driver offline bundle zip file is included in the CD contents as BCD bfa bna release ver offline bundle build number zip Save the file into a directory on your system You can al
405. upport for adapter drivers Install the fc dud for an HBA Fabric Adapter port configured in HBA mode CNA or Fabric Adapter port configured in CNA mode The fc file format is brocade fc adapter operating system platform dud version iso Download the RHEL 6 x adapter driver update disk DUD iso file for your host platform from the QLogic Web Site a Goto the QLogic Web Site at http driverdownloads glogic com and select Adapters by Model b Inthe table select the adapter type in first column the adapter model in the second column Linux Red Hat in the third column and then click Go c Click the Driver Update Disks link at the top of the page to direct you to the DUD zip file d Locate the DUD link for your adapter in the table click on it and following the instructions Create a driver update disk CD or USB drive from the ISO image Insert the operating system CD or USB drive into the host system s CD drive depending on the operating system you are installing Boot the system When the Welcome screen displays with a message to Press Tab to edit options press the Tab key For UEFI mode press any key to edit options Press a to modify kernel arguments and then append linux dd to the following line vmlinuz initrd initrd img linux dd When prompted to load the driver insert the driver update disk dud that you created in Step 3 into the CD DVD or USB drive 225 BR0054504 00
406. ur host system s command line Use the following steps to configure fabric based boot LUN discovery 1 Set the adapter s BIOS configuration to automatic discovery of the boot LUN from the fabric using one of the following interfaces W BIOS Configuration Utility Adapter Settings gt Boot LUN gt Fabric Discovered 237 BR0054504 00 A 4 Boot Code Fabric based boot LUN discovery B HCM Basic Port Configuration gt Boot over SAN gt Fabric Discovered m BCU bios enable port_id o auto The command output will contain the proper encoding and be in the exact format for the zone name and member commands Enter the following BCU command to provide the zone name and member for the switch commands bcu boot blunZzone c cfg p port wwn r rport wwn l lun id lun where c cfg Specifies boot LUN use c BLUN p port WWN The hexadecimal WWN of the adapter port connecting to the boot LUN For example 10 00 00 05 1e 41 9a cb r rport_wwN The hexadecimal WWN of the remote storage target s port For example 50 00 00 05 1e 41 9a ca 1 lun id lun The hexadecimal LUN identification You can provide this as a hexadecimal one Byte value or an eight Byte value four level LUN addressing For example an eight Byte value could be O9AABBCCDDEEFFOO Enter boot blunZone without operands to display the command format For example enter the following bcu boot blunZone c BLUN p 10 00 00 05
407. ure lt Up Down gt Navigate filt Q Exit without saving lt Left Right gt Change values Figure 4 10 BIOS Configuration Menu Select Port Target 252 BR0054504 00 A 4 Boot Code Configuring BIOS with the BIOS Configuration Utility 9 Select a target on which you want to designate a boot LUN and press Enter A screen similar to the one in Figure 4 11 displays listing device information and LUNs visible to the adapter Brocade BIOS Config Menu Adapter Selected Adapter Model PCI Bus Dev Fn PWWN BR 1828 8c 88 88 10 00 00 05 1E 55 27 68 ID PWUWN DID Vendor ID Product ID Rev 2 50 06 GE 89 10 03 4A 90 810800 HITACHI DF60OF 0000 Select Boot LUN ID LUN Capacity 1 000000000008008008 16 GB 2 0001000000000000 16 GB 3 0005000000000000 25 GB lt ESC gt Go back lt ENTER gt Select and configure lt Up Down gt Navigate lt Alt Q gt Exit without saving lt Left Right gt Cha va lues Figure 4 11 BIOS Configuration Menu Select Boot LUN 10 Select the LUN on the target device that you want to designate as the boot LUN for the host This must be the same LUN that you bound to the adapter port using the storage system s management or configuration utility refer to Step 6 under Procedures on page 213 You only need to select the bootable LUN once After the first boot the same LUN will be used until changed through the BIOS Configuration Utility 253 BR0054504 00 A 4 Boot
408. ure midplane and onto the installed switch modules installed in the chassis Using QLogic host bus adapters you can connect your host system to devices on the Fibre Channel SAN The combined high performance and proven reliability of a single ASIC design makes these host bus adapters ideal for connecting hosts to SAN fabrics based on QLogic Fabric or M Enterprise operating systems 18 BR0054504 00 A 1 Product Overview Host Bus Adapters Stand up adapters Figure 1 5 illustrates major components of the BR 825 stand up model host bus adapter The following illustration is representative and may have minor physical differences from the host bus adapter that you purchased p Au D j n 1 LEDs for port 1 SFP transceiver Fiber optic cable connectors for port 1 and port 0 SFP transceivers LEDs for port 0 SFP transceivers A OO Imm Low profile mounting bracket Note The host bus adapter ships with the low profile mounting bracket installed PCle x8 PCle connector ASIC Serial number label c N O C Label showing PWWN for each port Figure 1 5 BR 825 Host bus adapter with low profile mounting bracket heat sink removed 19 BR0054504 00 A 1 Product Overview Host Bus Adapters Use only Brocade branded SFP laser transceivers supplied with stand up adapters Mezzanine adapters Mezzanine Fabric Adapters are smaller than stand up modules For example the BR 804 adapter measures approximately
409. ures 12 Replace the system s case or cover and tighten all screws 99 BR0054504 00 A 2 Hardware Installation Stand up adapters Connecting an adapter to switch or direct attached storage Use multimode fiber optic cable or twinaxial copper cable CNAs or Fabric Adapters ports configured in CNA or NIC mode with appropriate connectors when connecting the adapter to the switch Use multimode fiber optic cable when connecting an host bus adapter or Fabric Adapter port configured in HBA mode to a switch or direct attached storage Refer to Cabling stand up adapters on page 282 for cable specifications 1 Pull out the protective rubber inserts from fiber optic SFP transceiver connectors if installed in adapters or the switch 2 Connect the cable from the switch to the appropriate SFP transceiver connector on the adapter Removing and installing SFP transceivers Use the following procedures to remove and install fiber optic SFP transceivers Use only the Brocade branded small form factor pluggable SFP transceivers in the QLogic BR Series Adapters Refer to Hardware compatibility on page 15 Removing transceivers If you need to remove SFP transceivers from the adapter to provide clearance for installing into the server cabinet use the following steps 1 Pull out the protective rubber plug from the SFP transceiver connector 2 Remove the SFP transceiver W For SFP transceivers with optical transceivers use your t
410. user guides Blade system enclosure installation and user guides Interconnect and switch module installation guides for the blade system enclosure Verifying adapter installation on page 177 provides a list of general items to verify during and after installing hardware and software to avoid possible problems You can use the list to verify proper installation and make corrections as necessary BR 1867 and BR 1869 host bus adapters For details on installing the BR 1867 or BR 1869 mezzanine host bus adapter in an IBM Flex System compute node refer to the IBM Flex System Installation and Service Guide provided for the compute node For references to compatibility information for adapters compute nodes switch modules and other devices that install in the blade system chassis refer to Server blades and system enclosures mezzanine adapters on page 16 What you need for installation Have the following available for installing the adapter Adapter shipping carton which includes the adapter and necessary documentation Fully operational blade server Access to a blade server through a local or remote console connection 103 BR0054504 00 A 2 Hardware Installation Mezzanine adapters B Blade server or storage expansion unit installation and user guides m X Blade system enclosure installation and user guides Verifying adapter installation on page 177 provides a list of general items to verify during and a
411. utually exclusive options select one option only For example a on off E 1 2 3 4 ellipsis indicates that the preceding item may be repeated For example a x means one or more instances of x a x means zero or more instances of x parentheses and braces are used to avoid logical ambiguity For example B alb cis ambiguous alb c means a or b followed by c a b c meanseither a or b c License Agreements Refer to the QLogic Software End User License Agreement for a complete listing of all license agreements affecting this product xix BR0054504 00 A Installation Guide BR Series Adapters Preface Technical Support Technical Support Customers should contact their authorized maintenance provider for technical support of their QLogic products QLogic direct customers may contact QLogic Technical Support others will be redirected to their authorized maintenance provider Visit the QLogic support Web site listed in Contact Information for the latest firmware and software updates For details about available service plans or for information about renewing and extending your service visit the Service Program Web page at http Awww glogic com Support Pages ServicePrograms aspx Downloading Updates The QLogic Web site provides periodic updates to product firmware software and documentation To download firmware software and documentation 1 Go to the QLogic Downloads and Docu
412. v6 ethlIPv4ChecksumOffload ethlIPv6ChecksumOffload ethMode ethMTU ethMacAddress vLanAdapterlndex vLanPortlndex vsVLanPCIFnIndex vLANId vLANName vLANInterfaceName vLANEnabled vLANStatus Function Enabled or disabled state of large receive offload Enabled or disabled state of large send offload for IPv4 Enabled or disabled state of large send offload for IPv6 Enabled or disabled state of IPv4 checksum offload Enabled or disabled state of IPv6 checksum offload Loopback promiscuous or normal mode Maximum transmission unit configured Interface MAC address VLAN adapter Index VLAN port index Function index of the interface VLAN index Name of the device as it appears in device manager for example QLogic 10G advanced virtual miniport 1 Name of the interface as it appears in network connections list for example local area connection X VLAN state enabled 1 disabled 0 Connected or disconnected 355 BR0054504 00 A B MIB Reference Table B 1 Supported MIB groups and objects for SNMP Continued Group Logical Group Team Attributes Logical Group Team Members Statistics Group Interface Statistics MIB Objects teamld teamName teamMode teamPreferredPrimaryIndex teamCurrentPrimaryIndex teamMACAddress teamNumberOfMembers teamlPAddress tmTeamld tmTeamMemberld tmTeamPCIFnindex teamAdapterlndex teamPortIndex teamMemberType te
413. vHBAs per port are not supported W Target rate limiting TRL and Quality of Service QoS are not supported at the vHBA level only at the physical port level W Boot over SAN is not supported at the vHBA level only at the physical port level Virtual Network Interface Cards vNICs are virtual port partitions that appear as virtual or logical NICs to the host operating system HCM discovers and displays all vNICs for a physical port as Eth Following are limitations and considerations for vNICs W vNICs are supported on QLogic CNAs and on Fabric Adapter 10 GbE ports configured in CNA or NIC mode W You can create up to four vNICs on each Fabric Adapter port configured in NIC mode using the BCU vnic create command and through HCM options You can delete vNICs using the vnic delete command or through HCM For each Fabric Adapter port configured in CNA mode you can only create up to three Ethernet PFs since the fourth PF must be used for FCoE m You cannot create or delete vNICs for QLogic CNA models such as the BR 1020 Multiple vNICs are not supported on these models W Due to ESX memory limitations a total of 4 vNICs in a VMware ESX system is supported vNICs are not supported on QLogic host bus adapter modules vNICs are not supported on Solaris SPARC systems Multiple vNICs are not supported on QLogic CNA models such as the BR 1020 a For Windows teaming is not supported between vNICs configured on the
414. ve external SFP transceivers and port connectors Fibre Channel communications are routed through the internal ports on the adapter to the chassis midplane and then onto switch modules installed in the chassis The adapter contains two ASICs each controlling two FC ports These ports are split between two different compute nodes to provide dual redundant paths between two switch elements Adapter properties on a specific compute node will list only two available ports For information on installing the BR 1869 host bus adapter on a compute node refer to Chapter 2 Hardware Installation For additional information related to the supported compute node and other devices installed in the system chassis such as I O modules and switch modules refer to the installation instructions provided with these products Hardware compatibility This section outlines important compatibility information SFP transceivers stand up adapters Use only QLogic branded small form factor pluggable SFP fiber optic 4 Gbps and 8 Gbps transceivers in the QLogic Fibre Channel stand up host bus adapters All BR 815 and BR 825 host bus adapters ship with the 8 Gbps SFP transceivers Host systems and switches stand up adapters QLogic host bus adapters connect to Fibre Channel SANs through compatible fabric switches or connect directly to Fibre Channel storage arrays Server blades and system enclosures and chassis mezzanine adapters Consider the fo
415. veControll er do In this URL localhost is the IP address of the server from which you want to collect the bfa supportsave information 2 Login using the factory default user name admin and password password Use the current user name and password if they have changed from the default The File Download dialog box displays prompting you to save the SupportSaveController do file Click Save and navigate to the location where you want to save the file 4 Save the file but rename it with a zip extension for example supportSaveController zip 5 Open the file and extract contents using any compression utility program Initiating Support Save through a heartbeat failure If a heartbeat failure occurs Support Save data is collected at a system wide level and an Application Log message is generated You can view the details of these failures in the Master Log and Application Log tables in HCM Support Save differences Following are differences in data collection for the HCM BCU and browser applications of bfa supportsave m BCU Collects driver related logs HCM Agent information and configuration files a Browser Collects driver related and HCM Agent logs and configuration files a HCM Collects HCM application data driver information HCM Agent logs and configuration files Master and Application logs are saved when Support Save is initiated through HCM but not through BCU 317 BR0054504 00 A 6 A
416. w Adapter software Table 1 10 Supported software installation packages Continued Operating System and Platform QLogic Adapter Software Installer Driver Package Linux RHEL and OL 6 2 6 3 6 4 6 5 x86 Linux RHEL and OL 6 2 6 3 6 4 6 5 x86_x64 Linux SLES 10 SP3 x86 Linux SLES 10 SP3 x86_64 Linux SLES 10 SP4 x86 Linux SLES 10 SP4 x86_64 Linux SLES 11 SP1 x86 brocade_adapter_software_in staller linux version bin Installs HCM and appropriate driver package brocade adapter software in staller linux x64 version b in Installs HCM and appropriate driver package brocade adapter software in staller linux version bin Installs HCM and appropriate driver package brocade adapter software in staller linux x64 version b in Installs HCM and appropriate driver package brocade_adapter_software_in staller linux version bin Installs HCM and appropriate driver package brocade adapter software in staller linux x64 version b in Installs HCM and appropriate driver package brocade_adapter_software_in staller linux version bin Installs HCM and appropriate driver package E brocade driver linux version tar gz E brocade driver linux rhel6 version ta rez E brocade driver linux version tar gz E brocade driver linux rhel6 lt version gt ta Raz WI brocade driver linux version tar gz E brocade d
417. w 75 software installer 77 81 87 storage support 27 throughput per port 49 verifying installation 178 HBA stand up environmental and power requirements 295 HBA management BCU 63 68 HCM 68 HBA mezzanine adapters 20 HBA mode 3 HBAs hardware and software compatibility 25 SFP transceivers 25 BR0054504 00 A Installation Guide BR Series Adapters HCM configuration data 186 data backup 186 downgrading when using QASI 137 hardware and software requirements 64 removal 130 HCM agent 78 controlling operation 183 starting 183 starting and stopping 183 stopping 183 verifying operation 183 when to restart 183 HCM agent communications port changing 183 firewall issue 111 139 HCM and BNA support on ESXi systems 75 Host Connectivity Manager HCM agent 78 installing 108 removing with software uninstaller commands 135 host connectivity manager HCM description 79 host operating system support adapter drivers 72 HCM 74 human interaction interface 32 Hyper V 33 59 Hypervisor support for adapters 71 I O execution throttle 57 IBM 3xxx M2 and Dell 11G systems setting up boot LUNs 231 IBM virtual fabric support 40 important notes for configuring boot over SAN 210 installation confirming driver package in Linux 173 174 software 113 stand up adapters 96 verifying 177 installer log 138 installing driver package with software installer 114 intermediate driver 38 77 interrupt coalescing FCoE 35 56 network 40 interrupt
418. when discovered in HCM These ports appear as 10 GbE NIC to the operating system The terms Ethernet mode and NIC mode may be used interchangeably in this document CNA mode This mode provides all the functions of Ethernet or NIC mode and adds support for FCoE features by utilizing the QLogic FCoE storage driver A 10 GbE SFP transceivers or direct attach SFP transceiver copper cable must be installed for the port Ports configured in CNA mode connect to a switch that supports Data Center Bridging DCB These ports provide 3 BR0054504 00 A 1 Product Overview Fabric Adapters all traditional CNA functions for allowing Fibre Channel traffic to converge onto 10 Gbps DCB networks The ports even appear as network interface cards NICs and Fibre Channel adapters to the host FCoE and 10 Gbps data center bridging DCB operations run simultaneously Fabric Adapter ports set in CNA mode appear as FCoE ports when discovered in HCM These ports appear as 10 GbE NIC to the operating system Changing the port mode You can change the mode of individual ports on an adapter using the following methods BCU commands Q The bcu port mode command allows you to change the mode of individual ports on the adapter Q The bcu adapter mode command allows you to change all ports on the adapter to a specific mode HCM Fabric Adapter port menu UEFI setup screens for the QLogic BR Series Adapter Chang
419. when prompted for example C Adapter Drivers Note that you can specify a directory other than the default directory Go to the command prompt and change directories cd to the path where you extracted files in Step 4 141 BR0054504 00 A 3 Software Installation Using software installation scripts and system tools 6 Enter the following command using appropriate parameters to install or uninstall the driver package brocade install bat INSTALL OP INSTALL UNINSTALL PREINSTALL gt DRIVER TYPE HBA CNA ETH AUTO LOG_FILE_PATH lt path to installer log gt FORCED_INSTALL TRUE SILENT_INSTALL TRUE SNMP TRUE SNMP_ONLY TRUE W2K8_HOTFIX lt lt KBnnnnnn gt lt Required Optional gt lt Descriptio n gt gt W2K3_HOTFIX lt lt KBnnnnnn gt lt Required Optional gt lt Descriptio n gt gt where a INSTALL_OP INSTALL Installs the storage and network drivers This is the default behavior no options are used with brocade_install bat UNINSTALL Removes all drivers corresponding to the DRIVER_TYPE option PREINSTALL Depending on the DRIVER_TYPE option used either the host bus adapter CNA or both driver will install to the driver store on the host system However this driver is only used when a new adapter is installed into an empty slot or an existing adapter is replaced The operating system will continue to load t
420. xt in Courier font indicates a file name directory path or command line text For example C Toreturn to the root directory from anywhere in the file structure Type cd root and press ENTER J Enter the following command sh install bin Key names and key strokes are indicated with UPPERCASE OY Press CTRL P C Press the UP ARROW key Text in italics indicates terms emphasis variables or document titles For example C Fora complete listing of license agreements refer to the QLogic Software End User License Agreement C What are shortcut keys Q To enter the date type mm dd yyyy where mm is the month dd is the day and yyyy is the year xviii BR0054504 00 A Installation Guide BR Series Adapters Preface License Agreements W Topic titles between quotation marks identify related topics either within this manual or in the online help which is also referred to as the help system throughout this document B Command line interface CLI command syntax conventions include the following m lt gt angle brackets indicate a variable whose value you must specify For example a lt serial_number gt For CLI commands only variable names are always indicated using angle brackets instead of italics square brackets indicate an optional parameter For example a lt file_name gt means specify a file name or omit it to select the default file name vertical bar indicates m
421. y default and must remain enabled for NetQueue to function Enabling NetQueue in VMware system also enables MSI X in the system Please make sure that bnad msix disable 1 is not listed in VMware module parameters because that would disable NetQueue You can use ethtool to obtain hardware statistics to verify traffic over different receive and transmit queues You can also use the VMware vsish utility to display current NetQueue information such as maximum number of queues number of active queues and default queue identification Use the following example procedures to enable or disable NetQueue change the number of NetQueues and filters and to set system heap values appropriately for using NetQueue and jumbo frames Enable or disable NetQueue with VI Client screens Following is an example of using VI Client configuration screens to enable and disable NetQueue Enable NetQueue in VMkernel using the VI Client as follows 1 Login to the VI Client 2 Click the Configuration tab for the Server host 3 Click Advanced Settings 4 Click VMkernel 5 Select the check box for VMkernel Boot netNetqueueEnabled and then click OK 6 Reboot the server 349 BR0054504 00 A A Adapter Configuration Network driver parameters Disable NetQueue in VMkernel using the VI Client as follows 1 Login to the VI Client 2 Click the Configuration tab for the Server host 3 Click Advanced Settings 4 Click VMkernel 5 Select the ch
422. you install a similar host the new host may require unique System BIOS options and other settings or internal IDE drives may need to be disconnected or disabled to initiate a network boot W lI replacing the QLogic BR Series Adapter in a host with a similar QLogic BR Series Adapter you will need to reconfigure the adapter to boot from the appropriate remote boot device W f replacing a host with a different model you may be prompted to install the adapter driver for the existing adapter Booting servers over the network can significantly streamline server administration and facilitate server deployment Instead of manually configuring each individual server boot images on LAN based systems can be cloned and assigned to groups of servers at the same time This not only simplifies initial configuration but makes ongoing software updates and maintenance much easier to administer When boot images are centrally managed on the network server security integrity and ability to recover data are also enhanced Following are additional benefits of booting over the network Disaster recovery More control and efficiency for software distribution Booting diskless systems such as thin clients and dedicated systems Automating system maintenance such as backups Automating system checking such as virus scanning Ensuring security where a guaranteed secure system is needed Centralized storage management and administration of client workstatio
423. zes NetQueues and Receive Filters per NetQueue values per number of CPUs for Fabric Adapter ports configured in CNA mode Table A 9 NetQueues and filters per NetQueue for Fabric Adapter ports in CNA mode NetQueues no Receive Filters per CPUs default NetQueues jumbo NetQueue 1 0 0 0 2 1 1 31 4 3 3 10 8 7 3 4 16 7 3 4 32 7 3 4 64 7 3 4 128 7 3 4 Setting heap size Enabling NetQueue and using jumbo frames can cause the network stack to run out of heap when default values are set for netPktHeapMaxSize and netPktHeapMinSize To set heap values to appropriate values use the following steps 1 Login to the VI Client 2 Click the Configuration tab for the Server host 3 Click Advanced Settings 4 Click VMkernel 351 BR0054504 00 A A Adapter Configuration Network driver parameters te 8 Find the corresponding value field for VMkernel Boot netPktHeapMaxSize and enter 128 Find the corresponding value field for VMkernel Boot netPktHeapMinSize and enter 32 Click OK to save the changes Reboot the system Enabling jumbo frames for Solaris For Solaris 10 and 11 you can enable support for jumbo packet frames and set the MTU size for these frames up to 9014 Use the following steps 1 Add the following line to the bna conf file This file is located in kernel drv bna conf bna lt x gt port mtu mtu_size where x BNA Brocade Network Adapter driver instance number mtu_size
424. zone name and zone members to use as operands in the Fabric OS zoneCreate command bcu boot blunZone c cfg p port wwn r rport wwn l lun id lun where c cfg Specifies boot LUN use c BLUN p port WWN The hexadecimal WWN of the adapter port connecting to the boot LUN For example 10 00 00 05 1e 41 9a cb r rport_wwN The hexadecimal WWN of the remote storage target s port For example 50 00 00 05 1e 41 9a ca 1 lun_id lun The hexadecimal LUN identification You can provide this as a hexadecimal one Byte value or an eight Byte value four level LUN addressing For example an eight Byte value could be O9AABBCCDDEEFFOO Enter boot blunZone without operands to display the command format For example enter the following bcu boot blunzone c BLUN p 10 00 00 05 1e 41 9a cb r 50 00 00 05 1e 41 9a ca 1 O9AABBCCDDEEFFOO The command output will contain the proper encoding and be in the exact format for the FOS OS zoneCreate command Configure the zone on the switch using the Fabric OS zoneCreate command Use the displayed output from the BCU boot blunZone command as the zonename and member operands zonecreate zonename member member 236 BR0054504 00 A 4 Boot Code Fabric based boot LUN discovery For example if the output from boot blunZone is the following you simply enter this for the zoneCreate command operands on the switch BFA 100000051E419ACB BLUN 00
Download Pdf Manuals
Related Search
Related Contents
VRC PRO USER MANUAL イントラレース FS レーザー LND712 ガイガーカウンタ取扱説明書 En imagen y sonido, todos bien Mut-3 Mitsubishi user guide Turbo Powerline Networking Kit (GHPB42W6) Manual de instrucciones Copyright © All rights reserved.
Failed to retrieve file