Home

Broadcom NetXtreme II Network Adapter User Guide

1. Broadcom Corporation Page 232 Starting Broadcom Advanced Control Suite Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 BACS INTERFACE The BACS interface is comprised of the following regions e Explorer View pane e Context View selector e Context View pane e Menu bar e Description pane By default the Explorer View pane is docked and pinned on the left side of the main window the Context View pane on the right the Context View selector below the menu bar and the Description pane below the Context View pane Drag the splitter between any two panes to vary the size of the panes ee Broadcom Corporation Document INGSRVT710 CDUM100 R BACS Interface Page 233 NetXtreme II User Guide March 2014 EXPLORER VIEW PANE You can dock and pin the Explorer View pane on the left side right side top or bottom of the main window The Explorer View pane lists the objects that can be viewed analyzed tested or configured by BACS When an item is selected in the Explorer View pane the tabs showing the information and options that are available for the item appear in the Context View pane The organization of this panel is designed to present the manageable objects in the same hierarchical manner as drivers and its subcomponents This simplifies the management of various elements of the converged network interface controller C NIC The top level of the hierarchy is the Host container which lists al
2. rere Broadcom Corporation Document INGSRVT710 CDUM100 R Detailed Procedures Page 127 NetXtreme II User Guide March 2014 e Source Network 0 0 means all e Protocol TCP e Destination Port 5988 5989 e Source Port Leave blank WS MAN AND CIM XML LINUX CLIENT No special software components are required on the Linux client system to use the HTTP except installing the BACS management application However for WS MAN installations you can optionally configure the HTTPS protocol for use with BACS Configure HTTPS on Linux Client Import Self Signed Certificate on Linux Client 1 On Linux distributions make note the following certificate directory e For all SuSE versions the certificate directory is etc ssl certs e For RedHat the certificate directory can be different for each version For some versions it is etc ssl certs or etc pki tls certs For other versions find out the certificate directory 2 Copy hostname pem which you created in Generate a Self Signed Certificate for Windows Linux Server into the certificate directory of the Linux client For example if the certificate directory is etc ssl certs copy hostname pem to etc ssl certs a Change directory to etc ssl certs b Create a hash value by running the following command openssl x509 noout hash in hostname pem A value such as the following will be returned 100940db c Create a symbolic link to the hash value by running the followin
3. Learn more about certificate properties 16 Ensure that only Server Authentication is enabled as shown in the figure 17 Open Trusted Root Certification Authorities and then open Certificates 18 Follow the instructions from Step 11 to Step 17 KL NOTE See Perform HTTPS Configuration if you plan to use HTTPS for instructions on importing the self signed certificate on a client Configure WinRM HTTPS SSL on the Server 1 Create WinRM Listener as follows a Click Start or press the Windows logo key and select Run b Enter MMC and click OK c Select the self signed certificate from the Personal store For example if the certificate is created with a host name the host name will appear d Double click the certificate to open it p Broadcom Corporation Document INGSRVT710 CDUM100 R Detailed Procedures Page 119 NetXtreme Il User Guide 2 March 2014 Click the Details tab Scroll down and select the Thumbprint field Select and copy the thumbprint in the Details window so you can insert it in the next step 20729 Return to the command prompt Enter the following command winrm create winrm config Listener Address Transport HTTPS Hostname lt HostName or IPAddress gt CertificateThumbprint lt paste from the previous step and remove the spaces gt NOTES e lf the certificate was generated using the host name enter the host name If it was generated using the IP address enter t
4. VLAN OVERVIEW Virtual LANs VLANs allow you to split your physical LAN into logical parts to create logical segmentation of workgroups and to enforce security policies for each logical segment Each defined VLAN behaves as its own separate network with its traffic and broadcasts isolated from the others increasing bandwidth efficiency within each logical group Up to 64 VLANs 63 tagged and 1 untagged can be defined for each Broadcom adapter on your server depending on the amount of memory available in your system VLANs can be added to a team to allow multiple VLANs with different VLAN IDs A virtual adapter is created for each VLAN added Although VLANs are commonly used to create individual broadcast domains and or separate IP subnets it is sometimes useful for a server to have a presence on more than one VLAN simultaneously Broadcom adapters support multiple VLANs on a per port or per team basis allowing very flexible network configurations Figure 1 Example of Servers Supporting Multiple VLANs with Tagging Accounting Server VLAN 1 a Main Server TS eee eee All VLANs VLAN 2 p Broadcom Gigabit BHgENMINEMENENMINEENSN VLAN Tagged VLAN 2 Shared Media Segment PU 1 PG 2 C 83 Software Dept Software Dept Engineering Accounting Engineering Software VLAN 2 VLAN 2 VLAN 1 VLAN 3 VLAN 1 amp 2 Broadcom Gigabit VLAN Tagged Figure 1 shows an example network that uses VLANs In this exa
5. DHCP Vendor ID Controls how the iSCSI boot host software interprets the Vendor Class ID field used during DHCP If the Vendor Class ID field in the DHCP Offer packet matches the value in the field the iSCSI boot host software looks into the DHCP Option 43 fields for the required iSCSI boot extensions If DHCP is disabled this value does not need to be set Link Up Delay Time Controls how long the iSCSI boot host software waits in seconds after an Ethernet link is established before sending any data over the network The valid values are 0 to 255 As an example a user may need to set a value for this option if a network protocol such as Spanning Tree is enabled on the switch interface to the client system Use TCP Timestamp Controls if the TCP Timestamp option is enabled or disabled Target as First HDD Allows specifying that the iSCSI target drive will appear as the first hard drive in the system LUN Busy Retry Count Controls the number of connection retries the iSCSI Boot initiator will attempt if the iSCSI target LUN is busy IP Version This option specific to IPv6 Toggles between the IPv4 or IPv6 protocol All IP settings will be lost when switching from one protocol version to another HBA Boot Mode Set to disable when the host OS is configured for software initiator mode and to enable for HBA mode This option is available on NetXtreme II adapters Note This parameter cannot be changed
6. 19 Error Data Digest is required by the initiator but target did not offer it 20 Error Connection to the target was lost The initiator will attempt to retry the connection 21 Error Data Segment Length given in the header exceeds MaxRecvDataSegmentLength declared by the target 22 Error Header digest error was detected for the given PDU Dump data contains the header and digest 23 Error Target sent an invalid iSCSI PDU Dump data contains the entire iSCSI header MM EE Broadcom Corporation Page 108 iSCSI Offload in Windows Server Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Table 5 Offload iSCSI OIS Driver Event Log Messages TESSIE Severity Message Number 24 Error Target sent an iSCSI PDU with an invalid opcode Dump data contains the entire iSCSI header 25 Error Data digest error was detected Dump data contains the calculated checksum followed by the given checksum 26 Error Target trying to send more data than requested by the initiator 27 Error Initiator could not find a match for the initiator task tag in the received PDU Dump data contains the entire iSCSI header 28 Error Initiator received an invalid R2T packet Dump data contains the entire iSCSI header 29 Error Target rejected an iSCSI PDU sent by the initiator Dump data contains the rejected PDU 30 Error Initiator could not allocate a work it
7. Broadcom Corporation Page 242 Managing Ethernet Controller Port Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 When the Ethernet controller is selected in the Object Explorer panel following four tabs will be displayed in the context view panel e Information Tab e Configuration tab e Statistics Tab e Diagnostic Tab VIEWING PORT LEVEL INFORMATION Selecting Ethernet controller in the object explorer will allow user to view various types of information at the port level 1 Select PortX where X is either O or 1 below Adapter in the object explorer 2 Various components of the port will be displayed below port in the object explorer You can click on the icon near Port to expand or collapse the tree below 3 Select Information tab in the context view panel on the right side VIEWING VITAL SIGNS The Vital Signs section of the Information tab has useful information about the network adapters that are installed in your system such as the link status of the adapter and general network connectivity To view Vital Signs information for any installed network adapter select the name of the adapter listed in the Explorer View pane then click the Information tab E ons e Information about Broadcom network adapters may be more comprehensive than information about network adapters made by others e Some information may not be available for all Broadcom network adapters MAC Address A physical M
8. SLB Auto Fallback Disable This type of team is identical to the Smart Load Balance and Failover type of team with the following exception when the standby member is active if a primary member comes back on line the team continues using the standby member rather than switching back to the primary member This type of team is supported only for situations in which the network cable is disconnected and reconnected to the network adapter It is not supported for situations in which the adapter is removed installed through Device Manager or Hot Plug PCI p Broadcom Corporation Document INGSRVT710 CDUM100 R Executive Summary Page 19 NetXtreme II User Guide March 2014 lf any primary adapter assigned to a team is disabled the team functions as a Smart Load Balancing and Failover type of team in which auto fallback occurs TOE Teaming All four basic teaming modes support failover of traffic from a failed adapter to other working adapters All four teaming modes also support bidirectional load balancing of TCP IP traffic A primary difference between the modes is that the SLB modes use a Broadcom proprietary algorithm to control how both inbound and outbound traffic is balanced across the network interfaces in the team This has several advantages First with Generic Trunking or Link Aggregation modes the team of network adapters must be connected to a switch that is specifically configured to support that particular mode of teaming Sin
9. standby interface can be designated per SLB team If traffic is not identified on any of the adapter team member connections due to failure of the adapter cable switch port or switch where the teamed adapters are attached to separate switches the load distribution is reevaluated and reassigned among the remaining team members In the event that all of the primary adapters are down the hot standby adapter becomes active Existing sessions are maintained and there is no impact on the user K NOTE Although a team can be created with one adapter it is not recommended since this defeats the purpose of teaming A team consisting of one adapter is automatically created when setting up VLANs on a single adapter and this should be the only time when creating a team with one adapter TYPES OF TEAMS The available types of teams for the Windows family of operating systems are e Smart Load Balancing and Failover e Link Aggregation 802 3ad TOE is not applicable e Generic Trunking FEC GEC 802 3ad Draft Static TOE is not applicable e SLB Auto Fallback Disable SMART LOAD BALANCING AND FAILOVER Smart Load Balancing and Failover is the Broadcom implementation of load balancing based on IP flow This feature supports balancing IP traffic across multiple adapters team members in a bidirectional manner In this type of team all adapters in the team have separate MAC addresses This type of team provides automatic fault detectio
10. tlvid00000001 info 04BC305B017B73 s tlvid00000002 info 03BC305B017B73 s p 13 Restart lldpad service to apply new settings For SLES11 SP1 RHEL 6 4 and legacy versions service lldpad restart For SLES11 SP2 rclldpad restart 14 Restart fcoe service to apply new settings For SLES11 SP1 RHEL 6 4 and legacy versions service fcoe restart For SLES11 SP2 E Broadcom Corporation Document INGSRVT710 CDUM100 R Installing Linux Driver Software Page 147 NetXtreme II User Guide March 2014 rcfcoe restart INSTALLING THE KMP PACKAGE 1 Install the KMP package rpm ivh lt file gt rmmod bnx2x 2 Load the driver NOTE The examples in this procedure refer to the bnx2x driver but also apply to the bnx2 and bnx2i drivers BUILDING THE DRIVER FROM THE SOURCE TAR FILE 1 Create a directory and extract the TAR files to the directory tar xvzf netxtreme2 version tar gz NOTE The examples used in this procedure refer to the bnx2 driver but also apply to the bnx2x driver 2 Build the driver bnx2 ko or bnx2 o as a loadable module for the running kernel cd netxtreme2 version make 3 Test the driver by loading it first unload the existing driver if necessary rmmod bnx2 insmod bnx2 0 modprobe crc32 amp amp insmod bnx2 0 or for Linux 2 6 kernels rmmod bnx2 insmod bnx2 ko Verify that your network adapter supports iSCSI by checking the message log If the message bnx2i dev ethO does not
11. 73 23 EEB emos tampos duektyva 85 336 EEB elektromagnetmio sudermanmme direktyva r Europos Sajungos pataisas Atitikties deklaracija pagal visas galiojan ias direktyvas ir standartus yra sudaryta ir saugoma wasyta faile Broadcom Corporation 190 Mathilda Place Sunnyvale Califorma 94086 USA Europos Sajunga B klas 515 Broadcom prietaisas yra klasifikuotas naudoti iprastose B klas s gyvenamosiose aplinkose Europos Sajunga A klas ISPEJIMAS Tai yra A klas s produktas Gyvenamosiose aplmkose 15 produktas gah kelti radijo dazniu trikdzius Tokm atveju naudotopu gali reik t imtis at itinkann priemoniu CS ee Broadcom Corporation Page 298 CE Notice Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Maltese sre stabbilit li dam il prodott hu konform ma 2006 95 KE Direttiva dwar il Vultagg Baxx 2004 108 KE Direttiva EMC u emendi ta Umom Ewropea Sarat Dikjarazzjomi ta Konformuta b konformuta mad direttivi u ma l istandards imsemmijin gabel u dm tmsab iffajljata g and Broadcom Corporation 190 Mathilda Place Sunnyvale Califomia 94086 USA Unjoni Ewropea Klassi B Dan t tag mir Broadcom hu kklassifikat g all u u f ambjent residenzjali tipiku ta Klass B Unjom Ewropea Klassi A TWISSIJA Dan huwa prodott ta Klas A F ambjent domestiku dan il prodott jista jikkaw a interferenza tal frekwenza tar radju RF fliema ka l utent jista jkun me tieg li jie u muzun ad
12. List all drives active in the system fdisk 1 ue Broadcom Corporation Document INGSRVT710 CDUM100 R Linux iSCSI Offload Page 163 NetXtreme II User Guide March 2014 MAXIMUM OFFLOAD ISCSI CONNECTIONS With default driver parameters set which includes 128 outstanding commands bnx2i can offload the following number of connections BCM5706 BCM5708 28 BCM5709 43 BCM5771x 128 This is not a hard limit but just a simple on chip resource allocation math bnx2i will be able to offload gt 28 connections on 1G devices by reducing the shared queue size which in turn limits the maximum outstanding tasks on a connection See Setting Values for Optional Properties for information on sq_size and rq_size The driver logs the following message to syslog when the maximum allowed connection offload limit is reached bnx2i unable to allocate iSCSI context resources LINUX ISCSI OFFLOAD FAQ e Not all Broadcom NetXtreme ll adapters support iSCSI offload e The iSCSI session will not recover after a hot remove and hot plug e For MPIO to work properly iSCSI nopout should be enabled on each iSCSI session Refer to open iscsi documentation for procedures on setting up noop out interval and noop out timeout values e n the scenario where multiple CNIC devices are in the system and the system is booted via Broadcom s iSCSI boot solution ensure that the iscsi node under etc iscsi nodes for the boot target is bound to the NIC that is used for
13. downloadcenter intel com SearchResult aspx lang eng amp ProductFamily Network Connectivity amp ProductLine Boot Agent Software amp ProductProdu ct Intel amp c2 ae Boot Agent MM EE Broadcom Corporation Page 78 Setting Up MBA in a Server Environment Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 iSCSI Protocol Broadcom NetXtreme II9 Network Adapter User Guide e iSCSI Boot e iSCSI Crash Dump iSCSI Offload in Windows Server ISCSI BOOT Broadcom NetXtreme ll Gigabit Ethernet adapters support iSCSI boot to enable network boot of operating systems to diskless systems iSCSI boot allows a Windows Linux or VMware operating system boot from an iSCSI target machine located remotely over a standard IP network For both Windows and Linux operating systems iSCSI boot can be configured to boot with two distinctive paths non offload also known as Microsoft Open iSCSl initiator and offload Broadcom s offload iSCSI driver or HBA Configuration of the path is set with the HBA Boot Mode option located on the General Parameters screen of the iSCSI Configuration utility See Table 1 for more information on all General Parameters screen configuration options SUPPORTED OPERATING SYSTEMS FOR ISCSI BOOT The Broadcom NetXtreme II Gigabit Ethernet adapters support iSCSI boot on the following operating systems e Windows Server 2008 and later 32 bit and 64 bit supports offload and non offload paths e Linux RHEL 5 5 a
14. eVBD driver Dism image c WinPEx64 mount Add Driver Driver c Drivers x64 evbd inf NetXtreme NDIS 5 1 driver Dism image c WinPEx64 mount Add Driver Driver c Drivers x64 b57amd64 inf NetXtreme ll NDIS driver Dism image c WinPEx64 mount Add Driver Driver c Drivers x64 bxnd inf p Broadcom Corporation Document INGSRVT710 CDUM100 R Inserting the NetXtreme II Monolithic Driver in a WinPE 2 0 or 3 1 Image Page 185 NetXtreme II User Guide March 2014 NetXtreme NDIS 6 0 driver Dism image c NWinPEx64Nmount Add Driver Driver c Drivers x64 b57nd60a inf NetXtreme II VBD driver Dism image c WinPEx64 mount Add Driver Driver c Drivers x64 bxvbd inf 3 Close the WinPE image and unmount it Dism unmount wim Mountdir c NWinPEx64Nmount commit CONFIGURING THE SPEED DUPLEX SETTING FOR THE NETXTREME II MONOLITHIC DRIVER Since the typical environment where the NetXtreme ll monolithic driver is used does not provide the means to configure advanced network adapter properties the driver file bDO6nd inf was modified to include a section that allows it to be configured for a specific speed and or duplex This provides a more robust connection to the network as it allows the adapter to match the settings of its link partner e g a switch router etc To manually configure the speed and duplex 1 Open the bO6nd inf file with a text editor like Microsoft Notepad or WordPad 2 Perform a search on the file for
15. 82 83 Eth 2 4909 Eth 4 5E C9 Eth 24 82 82 Eth 24 49 8 Eth 24 5E C ARP Table PEZb 0 CAM Table Eth 1 82 82 Eth 2 43 C8 Eth 4 SECA Eth 24 87 83 Eth 24 49 C9 Eth 24 5E C9 1012 82 82 W2K 102 SE CA Red Bottom Switch Port 24 Ad RR Top Switch Port 24 MAC Address EE MAC Address Eth 24 AZ TZ Eth 24 B0 30 MGE FEMME Broadcom Corporation Page 40 General Network Considerations Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Figure 5 represents a failover event in which the cable is unplugged on the Top Switch port 4 This is a successful failover with all stations pinging each other without loss of connectivity Figure 5 Failover Event PEZDSD VW7K Blue SLB Team 192 168 1 101 FE2650 W2K3 Gray SLB Team 182 168 1 102 ARP Table 100 49 C9 102 5E CA ARP Table 100 49 C9 101 82 82 82 82 P 9 ECA P 2 Bottom Switch CAM Table CAM Table Eth 1 82 83 Eth 2 49 09 Eth 24 82 82 Eth 24 43 C8 Eth 24 5E CA Eth 24 A2 12 Bottom Switch Port 24 NIAC Address 49 C9 P ARP Table PE2550 101 2 82 32 Wok 102 5E CA Red SLB Team 182 158 1 100 Eth 1 82 22 Eth Z 4a C8 Eth 4 5E CLA Eth 24 82 83 Eth 24 428 Eth 24 BO 3a0 Top Switch Port 24 MAC Address Uu Broadcom Corporation Document INGSRVT710 CDUM100 R General Network Considerations Page 41 NetXtreme II User Guide March 2014
16. DID SVID and SSID from the image file with device IDs Used only with fnvm lt raw_image gt uediag log lt logfile gt Logs the tests results to a specified log file uediag mba lt 1 0 gt Enables disables Multiple Boot Agent MBA protocol 1 Enable 0 Disable uediag mbap lt n gt Sets the MBA boot protocol 0 PXE 1 RPL 2 BOOTP 3 iSCSI_Boot uediag mbav lt 1 0 gt Enables disables MBA VLAN 1 Enable 0 Disable uediag mbavval lt n gt Sets MBA VLAN lt 65536 uediag mfw lt 1 0 gt Enables disables management firmware 1 Enable 0 Disable uediag t lt groups tests gt Disables certain groups tests uediag T lt groups tests gt Enables certain groups tests uediag ver Displays the version of Broadcom NetXtreme Il User Diagnostics uediag and all installed adapters P E Page 308 Performing Diagnostics Broadcom Corporation Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Table 2 uediag Command Options Cont Command Options Description uediag wol lt 1 0 gt Enables disable Magic Packet WOL 1 Enable 0 Disable uM Broadcom Corporation Document INGSRVT710 CDUM100 R Performing Diagnostics Page 309 NetXtreme Il User Guide March 2014 DIAGNOSTIC TEST DESCRIPTIONS The diagnostic tests are divided into four groups Basic Functional Tests Group A
17. Enabled if supported by 2 6 kernel TSO Enabled a Broadcom Corporation Document INGSRVT710 CDUM100 R Drivers Page 173 NetXtreme II User Guide March 2014 WoL Disabled UNLOADING AND REMOVING DRIVER To unload the driver type the following vmkload mod u bnx2x DRIVER MESSAGES The following are the most common sample messages that may be logged in the file var log messages Use dmesg n level to control the level at which messages will appear on the console Most systems are set to level 6 by default To see all messages set the level higher Driver Sign On Broadcom NetXtreme II 5771x 10Gigabit Ethernet Driver bnx2x 0 40 15 DateTime 2007 11 22 05 32 40 NIC Detected etho Broadcom NetXtreme II BCM57710 XGb A1 PCI E x8 2 5GHz found at mem e8800000 IRQ 16 node addr 001018360012 MSI X Enabled Successfully bnx2x eth0 using MSI X Link Up and Speed Indication bnx2x ethO NIC Link is Up 10000 Mbps full duplex receive amp transmit flow control ON Link Down Indication bnx2x ethO NIC Link is Down Memory Limitation If you see messages in the log file that look like the following then the ESX host is severely strained To relieve this disable NetQueue Dec 2 18 24 20 ESX4 vmkernel 0 00 00 32 342 cpu2 4142 WARNING Heap 1435 Heap bnx2x already at its maximumSize Cannot expand Dec 2 18 24 20 ESX4 vmkernel 0 00 00 32 342 cpu2 4142 WARNING Heap 1645 Heap Align bnx2x 4096 4096 by
18. MRDSL violation bnx2i iscsi_error F bit not set bnx2i iscsi_error invalid TTT p Broadcom Corporation Document INGSRVT710 CDUM100 R Driver Messages NetXtreme Il User Guide March 2014 bnx2i iscsi error invalid DataSN bnx2i 215051 _ error burst len violation bnx2i 18081 error buf offset violation bnx2i iscsi error invalid LUN field bnx2i iscsi error invalid R2TSN field bnx2i iscsi error invalid cmd lenl bnx2i ISCSI error invalid cmd len2 bnx2i iscsi error pend r2t exceeds MaxOutstandingR2T value bnx2i 18081 error TTT is rsvd bnx2i iscsi error MBL violation Dnx2as 16091 error data seg len 0 bnx2i iscsi error reject pdu len error bnx2i iscsi error async pdu len error bnx2i iscsi _ error nopin pdu len error bnx2i iscsi error pend r2t in cleanup bnx2i iscsi error IP fragments rcvd bnx2i iscsi error IP options error bnx2i iscsi error urgent flag error CNIC detects iSCSI protocol violation non FATAL warning bnx2i iscsi warning invalid TTT bnx2i iscsi warning invalid DataSN bnx2i iscsi warning invalid LUN field r NOTE The driver needs to be configured to consider certain violation to treat as warning and not as a critical error Driver puts a session through recovery conn err hostho 3 conn 03Ebcd00 iscsi cid 2 cid 21300 Reject iSCSI PDU received from the target bnx2i printing rejected PDU contents 0 1 ffffffa10 000200 8 07 000000 10 0 0 40 24 0 0 ff
19. Registry parameters to locate the section that will allow you to configure the adapter speed duplex 3 Once located notice the following information shown params utp hkr req medium 25 MOM params fiber hkr req medium 2 65283 These make up two separate sections that can be configured one for standard RJ 45 copper interfaces params_utp and one for fiber devices params_fiber 4 As described in the file replace the value above in quotation marks under the correct section depending upon the network adapter in your system The available values are shown below Options for copper interfaces e Auto 1 Gbps is enabled when that speed is supported 0 e 10 Mbps Half Duplex 65794 e 10 Mbps Full Duplex 258 e 100 Mbps Half Duplex 66050 e 100 Mbps Full Duplex 514 Options for fiber interfaces e Auto 1 Gbps is enabled when that speed is supported 0 e 1 Gbps Full Duplex 771 e Auto with 1 Gbps Fallback 33539 e Hardware default 65283 An example is provided in the file showing how to configure a copper interface for a 10 Mbps Full Duplex connection The example is shown below hkr req medium 2 258 GENIS UE Broadcom Corporation Page 186 Configuring the Speed Duplex Setting for the NetXtreme II Monolithic Driver Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 VIEWING OR CHANGING THE PROPERTIES OF THE ADAPTER To view or change the propert
20. SR IOV E MM Broadcom Corporation Page 256 Managing the LAN Device Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 VIEWING RESOURCE INFORMATION The Resources section of the Information tab displays information about connections and other essential functions for the selected network adapter k Information Tab Resources NOTE Some information may not be available for all Broadcom network adapters Bus Type The type of input output I O interconnect used by the adapter CONFIGURING SYSTEM SETTINGS System Management on the Configurations tab allow you to view and change the values of the available properties for the system The potentially available properties and their respective settings are described below Chimney Offload State Enables TCP Offload Engine TOE for the entire system On Windows Server 2008 operating systems the options are Enable default and Disable For Windows Server 2008 R2 the options are Enable Disable and Auto default If Chimney Offload State is configured for Auto then a 10 Gbps network adapter will have TOE enabled but not for a 1 Gbps network adapter To enable TOE for individual network adapters configure Chimney Offload State to Enable and also enable TCP Connection Offload IPv4 or TCP Connection Offload IPv6 from the Advanced area of the Configuration tab O Broadcom Corporation Document INGSRVT710 CDUM100 R Viewing Resource Information Page 257
21. User Guide NetXtreme Il March 2014 7 Configure the VLAN on VMKernel iscsi Properties EY vSwibch1 Properties General IP Settings Sec Traffic Shaping NIC Teamin I Proper 5 Network Label is csi wiMotion Enabled Faulk Tolerance Logging Enabled Management Traffic Enabled iSCSI Port Binding IV Enabled NIC Settings MTU 1500 172 15 24 255 255 0 Uu Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Support Page 177 NetXtreme Il ENABLING FCOE To enable FCoE hardware offload on the C NIC 1 Determine the ports that are FCoE capable esxcli fcoe nic list Output example vmnic4 User Priority 3 Source MAC FF FF FF FF FF FF Active false Priority Settable false Source MAC Settable false VLAN Range Settable false 2 Enable the FCoE interface d esxcli fcoe nic discover n vmnicX Where x is the interface number gained from esxcli fcoe nic list 3 Verify that the interface is working 4 esxcli fcoe adapter list Output example vmhba34 Source MAC bc 30 5b 01 82 39 FCF MAC 00 05 73 cf 20 6a VNPort MAC 0e fc 00 47 04 04 Physical NIC vmnic7 User Priority 3 VLAN id 2008 The output of this command should show valid FCF MAC VNPort MAC Priority and VLAN id for the Fabric that is connected to the C NIC The following command can also be used to verify that the interface is working properly esxcfg scsidevs a Outp
22. configured for 10Gb full manually configured for the duplex link selected line speed and duplex settings 22 Error Network controller failed Insufficient system memory Increase system memory initialization because it prevented the initialization of cannot allocate system the driver memory 23 Error Network controller failed to The driver and the bus driver Update to the latest driver set exchange the interface with the bus driver are not compatible ensuring the major and minor versions for both NDIS and the bus driver are the same MM Broadcom Corporation Page 58 Appendix A Event Log Messages Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 INTERMEDIATE DRIVER VIRTUAL ADAPTER TEAM The intermediate driver is identified by source BLFM regardless of the base driver revision Table 9 lists the event log messages supported by the intermediate driver explains the cause for the message and provides the recommended action Table 9 Intermediate Driver Event Log Messages System as Severity Message Cause Corrective Action Message Number 1 Informational Event logging enabled for No action is required Broadcom Advanced Server Program driver 2 Error Unable to register with The driver cannot register Unload other NDIS drivers NDIS with the NDIS interface 3 Error Unable to instantiate the The driver cannot create a Reboot the operating managemen
23. e Windows 8 e Windows 8 1 e Windows Server 2008 R2 e Windows Server 2012 e Windows 2012 R2 For Windows XP and Windows Server 2008 install Windows Management Framework Core which includes WinRM 2 0 and Windows Powershell 2 0 from the following link http www microsoft com download en details aspx displaylang en amp id 1 1829 Perform Basic Configuration on the Server The Windows firewall must be enabled for WinRM to work properly For detailed information about firewall configuration see Additional Server Configuration After the firewall is configured open a command prompt and run the following command to enable the remote management on the Windows server winrm quickconfig You can use the following command to view the configuration information for the service winrm get winrm config Perform User Configuration on the Server To connect to WinRM the account must be a member of the local administrators group on the local or remote computer The output of the get winrm config command will be as follows ROOtSDDL O NSG BAD P A iGA BA S P AU FA GA WD AU SA GWGX WD BA stands for BUILTIN Administrators To add another user group to the WinRM allowed connect list you can modify the RootSDDL to include the new user group You will need the SSDL ID for the new group For example the following command adds the new user group with SDDL ID S 1 5 21 1866529496 2433358402 1775838904 1021 winrm set winrm config
24. ethtool is mandatory to successfully wake the system To determine the silicon revision of your Broadcom NetXtreme II device use the 1spci command where 10 revision BO 11 revision B1 and 12 revision B2 BNX2X DRIVER The current version of the driver has been tested on 2 6 x kernels starting from 2 6 9 The driver may not compile on kernels older than 2 6 9 Testing is concentrated on i386 and x86 64 architectures Only limited testing has been done on some other architectures Minor changes to some source files and Makefile may be needed on some kernels BNX2I DRIVER The current version of the driver has been tested on 2 6 x kernels starting from 2 6 18 kernel The driver may not compile on older kernels Testing is concentrated on i386 and x86 64 architectures Red Hat EL5 and SUSE 11 SP1 distributions MENU EE Broadcom Corporation Page 144 Limitations Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 PACKAGING The Linux drivers are released in the following packaging formats DKMS Packages e netxtreme2 version dkms noarch rpm e netxtreme2 version dkms src rpm KMP Packages e SLES e broadcom netxtreme2 kmp kernel version i586 rom e broadcom netxtreme2 kmp kernel version x86_64 rpm e Red Hat e kmod kmp netxtreme2 kernel version i686 rom e kmod kmp netxtreme2 kernel version x86_64 rom The Broadcom Advanced Control Suite management utility is also distributed as an RPM
25. member SLB team allowed with latest Failover SLB team type BASP6 version Note VM MAC is not presented to external switches Link Aggregation IEEE Yes Yes Yes 802 3ad LACP team type Generic Trunking FEC GEC Yes Yes Yes 802 3ad Draft Static team type Failover Yes Yes Yes LiveLink Yes Yes Yes Large Send Offload LSO Limited Yes Yes Conforms to miniport limitations outlines in Table 1 Checksum Offload CO Limited Yes Yes Conforms to miniport limitations outlines in Table 1 TCP Offload Engine TOE No No No Hyper V VLAN over an Yes Yes Yes adapter Hyper V VLAN overateamed Yes Yes Yes adapter Hyper V VLAN over a VLAN Limited Limited Limited Only an untagged VLAN Hyper V virtual switch overan Yes Yes Yes adapter Hyper V virtual switch overa Yes Yes Yes teamed adapter Hyper V virtual switch overa Yes Yes Yes VLAN iSCSI boot No No No Hemote boot to SAN is supported Virtual Machine Queue VMQ No Yes Yes See Configuring VMQ with SLB Teaming RSC No No Yes p Document INGSRVT710 CDUM100 R Broadcom Corporation Microsoft Virtualization with Hyper V Page 331 NetXtreme II User Guide March 2014 Windows Server 2008 When configuring a team of NetXtreme II network adapters on a Hyper V system be aware of the following e Create the team prior to binding the team to the Hyper V virtual network e Create a team only with an adapter that is not already assi
26. physical virtual VLAN team adapter IDs physical virtual VLAN team adapter descriptions and MAC addresses of the adapters The statistics include detailed information such as data packets transmitted and received for the physical virtual VLAN team adapters The alarm trap forwards information about the changes in configuration of the physical adapters participating in a team such as physical adapter link up down and adapter installed removed events To monitor this information an SNMP manager must load the Broadcom BASP MIB database files to allow monitoring of the information described above These files which are shown below are included with the driver source media e baspcfg mib e baspstat mib e basptrap mib HBA API Broadcom supports the Storage Networking Industry Association SNIA Common HBA API on Windows and Linux operating systems The Common HBA API is an application program interface for the management of Fibre Channel Host Bus Adapters E MM Broadcom Corporation Page 68 SNMP Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 BASP EXTENSIBLE AGENT The Broadcom NetXtreme II Gigabit Ethernet Controller Extended Information SNMP extensible agent bcmif dll is designed for Windows Server 2008 SNMP service The extensible agent allows the SNMP manager software to actively monitor the configurations of the Broadcom NetXtreme I adapter It is intended to supplement the information already prov
27. too long frame check sequence FCS length or alignment errors nor frames lost due to internal MAC sublayer errors This counter is incremented when the receive status is reported as Receive OK Directed Frames Tx A count of directed data frames that were successfully transmitted Multicast Frames Tx A count of frames that were successfully transmitted as indicated by the status value Transmit OK to a group destination address other than a broadcast address Broadcast Frames Tx A count of frames that were successfully transmitted as indicated by the transmit status Transmit OK to the broadcast address Frames transmitted to multicast addresses are not broadcast frames and are excluded Directed Frames Rx A count of directed data frames that were successfully received Multicast Frames Rx A count of frames that were successfully received and are directed to an active nonbroadcast group address This does not include frames received with frame too long FCS length or alignment errors nor frames lost because of internal MAC sublayer errors This counter is incremented as indicated by the Receive OK status Broadcast Frames Rx A count of frames that were successfully received and are directed to a broadcast group address This count does not include frames received with frame too long FCS length or alignment errors nor frames lost because of internal MAC sublayer errors This counter is incremented as indicated by the Receive OK statu
28. 00 Kernel 3 8 13 8 9 dcfaan1t iit Searching for storage devices 3 Once the driver update is complete select Next to continue with OS installation 4 When requested click Configure FCoE Interfaces uu Broadcom Corporation Page 206 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 k CPE Disk Activation SUSE Linux Enterprise Mreparation Fr W eionmsa E Disk Activation t Sy Tn Araya iz 1 ium um Jome installation it eric I i inetallation Surmmar ry Perform bertallestion Configuration 5 Ensure FCoE Enable is set to yes on the 10GbE Broadcom initiator ports you wish to use as the SAN boot path s EPE 9 Fibre Channel over Ethernet Configuration SUSE Linux Interfaces Configuration Enterprise See turra wows cs vue FCoE ndi m Bireadcorn Sth oroia ret configured n ama Broadcom Ethernet controller net configured yii a7 Weto em Broadcom Ethernet controllar mak are dail eal em froadoorn Ethernet controlar rack av ual ble popl O25 Tae Gigab Ethernet Controller E opp r ngt avadabla Preparation E Disk Activation EE LII LIES EE p zig Time done Bnet ab Eae iens PIJEU NEIN IE in ingt allatinn 5urrnrnar Y Perform installation Configuration Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 207 NetXtreme Il User Guide March 2014 6 For each interface to be enabled for F
29. 15 Enter the following command from the command prompt to test locally winrm id Perform HTTPS Configuration on the Server to use HTTPS rather than HTTP This step consists of two distinct processes generating a self signed certificate if certificate does not exist and importing it to a Windows server If one does not already exist you must configure a self signed certificate on the Windows server to enable HTTPS SSL communication with the BACS GUI on the Windows or Linux client The Windows and Linux client also must be configured with the self signed certificate See Perform HTTPS Configuration if you plan to use HTTPS to configure Windows and Configure HTTPS on Linux Client to configure Linux client K NOTE The self signed certificate can be created on any Windows or Linux server The server does not require BACS to be installed The self signed certificate generated on any Windows Linux server should be copied on the local drive of client 1 Click Start or press the Windows logo key and select Run Enter gpedit msc to open the local Group Policy editor 3 Under Computer Configuration open the Administrative Templates folder and then open the Windows Components folder uu Broadcom Corporation Page 116 Detailed Procedures Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Select Windows Remote Management WinRM Under Windows Remote Management WinRM select WinRm Client Under WinRM Client doubl
30. 952 B WBRAHEETS CORES RRA CHAT SCLERMELTOETA CORBA SUFOF LED 3 DREMEL CRM SNSL MEEIEdRIOTICABUES BURR Gt TE LUBY RUE LCT SU ELM Broadcom Corporation Page 294 VCCI Notice Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 CLASS A Broadcom NetXtreme ll Gigabit Ethernet Controller Broadcom NetXtreme II 10 Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA This equipment is a Class A product based on the standard of the Voluntary Control Council for interference by Information Technology Equipment VCCI If used in a domestic environment radio disturbance may arise Install and use the equipment according to the instruction manual VCCI Class A Statement Japan TORE WURR EMEA TEMAS VCC O3EXI 422A A Mi8iRdEEN CY CORE RARURHCEHT2CWENEESIERI SU d COISI IHERHEDUBUGRUR EHE S amp S BRANSCEMHVES CE NOTICE CLASS C CLAss B Broadcom NetXtreme II Gigabit Ethernet Controller CLASS A Broadcom NetXtreme II Gigabit Ethernet Controller Broadcom NetXtreme II 10 Gigabit Ethernet Controller M Broadcom Corporation Document INGSRVT710 CDUM100 R CE Notice Page 295 NetXtreme II User Guide March 2014 BBIITAPCKM Toss npoxykr otrozaps ga 2006 93 EC Hacxosonrtora gepextusa 2004108 EC Tmpextuea Bulgarian 33 ENORTPOMATHHTHa CLEMECTHMOCT H HIMEHEHHATA Ha EBponeHcxm cama Harorsena e lexzapazEz 32 CBOTBeTCIEH2 CODED TOpemoOCoWeHETe IHpexTEEE H C
31. Advanced Control Suite BACS utility BASP provides support for TOE teaming only for NetXtreme Il adapters BASP supports four types of teams for Layer 2 teaming e Smart Load Balancing and Failover e Link Aggregation 802 3ad e Generic Trunking FEC GEC 802 3ad Draft Static e SLB Auto Fallback Disable BASP supports two types of teams for TOE teaming e Smart Load Balancing and Failover e SLB Auto Fallback Disable For more information on network adapter teaming concepts see Broadcom Gigabit Ethernet Teaming Services ra NOTE Windows Server 2012 provides built in teaming support called NIC Teaming It is not recommended that users enable teams through NIC Teaming and BASP at the same time on the same adapters LOAD BALANCING AND FAULT TOLERANCE Teaming provides traffic load balancing and fault tolerance redundant adapter operation in the event that a network connection fails When multiple Gigabit Ethernet network adapters are installed in the same system they can be grouped into teams creating a virtual adapter A team can consist of two to eight network interfaces and each interface can be designated as a primary interface or a standby interface standby interfaces can be used only in a Smart Load Balancing and Failover type of team and only one MENU EE Broadcom Corporation Page 8 Configuring Teaming in Windows Server Broadcom NetXtreme I Network Adapter User Guide User Guide NetXtreme Il March 2014
32. Balance and Failover with the following exception when the standby member is active if a primary member comes back online the team continues using the standby member rather than switching back to the primary member This type of team is supported only for situations in which the network cable is disconnected and reconnected to the network adapter It is not supported for situations in which the adapter is removed installed through uu Broadcom Corporation Page 264 Configuring Teaming Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Device Manager or Hot Plug PCI If any primary adapter assigned to a team is disabled the team functions as a Smart Load Balancing and Failover type of team in which auto fallback occurs The LiveLink feature is supported for this type of team STANDBY TEAM MEMBER AND AUTO FALLBACK DisABLE MODE You can designate one team member in an SLB type of team to be the standby member The standby member does not actively send and receive normal network traffic while other adapters on the team are active If all of the active adapters on the team fail or are disconnected the standby member takes over the handling of the network activities In Auto Fallback Disable mode if a load balance member returns on line the team continues using the standby member rather than switching back to using the load balance member Consequently the adapter that was initially designated a load balance member remains in an i
33. Broadcom iSCSl firmware hardware Bnx2i functions under the open iscsi framework VLAN CONFIGURATION FOR ISCSI OFFLOAD LINUX iSCSI traffic on the network may be isolated in a VLAN to segregate it from other traffic When this is the case you must make the iSCSI interface on the adapter a member of that VLAN To configure the VLAN using the V Sphere client GUI Click the ESXi ESX host Click the Configuration tab Click the Networking link and click Properties Click the virtual switch portgroups in the Ports tab and click Edit Click the General tab Assign a VLAN number in VLAN ID optional pow mo momo zi M Network 2 Properties EE cecal securty Trattic shaping NIC Teig Ports Network Adapters Port Group Properties omer aaa oa VM Network 2 Network Label M Newek Tn 20 Pc l virtual Machine VLAN ID None D LAN ID Optional oreo e 6 iscsi vMotion and IP Effective Policies Security Promiscuous Mode Reject MAC Address Changes Accept Forged Transmits Accept Traffic Shaping Average Bandvadkth Peak Bandwidth Burst Size Failover and Load Balancing Load Balancing Port ID Network Failure Detection Link stabus only Notify Switches Yes Failack Ves Active Adapters vinnicz vmnic3 Standby Adapters Hone Add Unused Adapters None Broadcom Corporation Page 176 iSCSI Support Document INGSRVT710 CDUM100 R
34. CDUM100 R iSCSI Boot Page 91 NetXtreme II User Guide March 2014 fi Pi echo Usage 0 start stop status restart reload exit 1 esac PG exit Removing Inbox Drivers from Windows OS Image 1 Create a temporary folder such as D temp 2 Create the following two subfolders in the temporary folder e Win2008R2Copy e Win2008R2Mod 3 Copy all the contents from the DVD installation media into the Win2008R2Copy folder 4 Open the Windows AIK command prompt in elevated mode from All program and then run the following command attrib r D Temp Win2008R2Copy sources boot wim 5 Run the following command to mount the boot wim image dism Mount WIM WimFile D Temp Win2008R2Copy sources boot wim index 1 MountDir D NTempNWin2008R2Mod 6 The Boot wim image was mounted in the Win2008R2Mod folder Find all the instances of the files listed below in the subfolders of the Win2008R2Mod folder and then delete them List of files to be deleted e netevbda inf e netevbda pnf e evbda sys e netbxnda inf e netbxnda pnf e bxnd60a sys e bxvbda sys e netbvbda inf e netbvbda pnf To easily find all the instances of the files to be deleted run the following command dir s D Temp Win2008R2Mod filename 7 Run the following command to unmount the Boot wim image dism unmount wim Mountdir D Temp Win2008R2Mod commit 8 Repeat steps 5 to 7 but set the index 2 for the command in step 5 In this example i
35. Corporation CoE Boot vb 4 20 Starting DCBX process with interface 00 10 18 6F D5 0F Succeeded Discovering FC Fabric with interface 00 10 18 5F D5 0F Succeeded orld Wide Node Name 10 00 00 10 18 6F D5 6F orld Wide Port Mame 20 00 00 109 18 6F D5 0F abric Name 16 00 SO G5 1E BO so be CF MAC Address OO O5 1E 86 38 95 FP MAC Address OE FC 09 01 1D 01 WLAN ID 1003 abric Login via interface 00 10 18 6F D5 0F Succeeded Login to target 56001438004C83BBD 600000 LUN O001 Succeeded FC Target Drive HP HSVU300 Rey 0005 Press lt Ctrl D gt within 4s to stop booting from the target DRIVER UPGRADE ON LINUX BOOT FROM SAN SYSTEMS 1 Remove the existing installed NetXtreme Il package Log in as root Query for the existing NetXtreme Il package and remove it using the following commands rpm e NetXtreme II package name gt For example rpm e netxtreme2 Or rpm e netxtreme2 x y z 1 X86 64 2 Install the binary RPM containing the new driver version Refer to the linux nx2 package README for instructions on how to prepare a binary driver RPM 3 Use the following command to update the ramdisk e On RHEL 6 x systems execute dracut force e On SLES11spX systems execute mkinitrd 4 Ifyou are using different name for the initrd under boot be sure to overwrite it with the default as dracut mkinitrd updates uu Broadcom Corporation Page 222 Booting from SAN After Install
36. Finish Click Close then click OK Open the Certificates Local Computer folder and then open the Personal folder of eof Se PS 10 Right click Certificates select All Tasks and then click Import 11 Click Next to begin the Certificate Import Wizard MENU EE Broadcom Corporation Page 118 Detailed Procedures Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 12 Browse to select hostname pfx 13 When you are prompted for the password for the private key enter the same password you created in Generate a Self Signed Certificate for Windows Linux Server 14 Follow the instructions select the defaults and continue The certificate is shown as installed on the right side of the window The name will be the name you specified while creating a self signed certificate 15 Right click on the certificate and select Properties A dialog box displays as follows MGMTAPP LAB3 Properties General Cross Certificates DSF Extended validation Friendlv name Description Certificate purposes C Enable all purposes for this certificate C Disable all purposes For this certificate Enable only the following purposes Note You may only edit certificate purposes that are allowed by the certification path Server Authentication C Client Authentication L Code Signing L Secure Email L Time Stamping L Microsoft Trust List Signing _ Microsoft Time Stamping ap k Add Purpose
37. For WS MAN Support add the following environment variable ME EEUU Broadcom Corporation Page 124 Detailed Procedures Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 e export PEGASUS ENABLE PROTOCOL WSMANc true CIM XML and WSMAN in OpenPegasus use the same ports for HTTP or HTTPs The default port numbers for HTTP and HTTPS are 5989 and 5988 respectively k NOTE You can add these exports at the end of the bash_profile This file is located in the root directory e The environment variables will be set when a user logs in using PuTTY e On the Linux system itself for each terminal where the environment variables are not set run the following command source root bash profile e When you logout and login the environment variables will be set Build and install OpenPegasus From PEGASUS ROOT the location of the Pegasus source root directory run the following make clean make make repository k NOTE Whenever OpenPegasus is built from source all configurations are reset to the default values If you are rebuilding OpenPegasus you must redo the configuration as described in Configure OpenPegasus on the Server Start CIM Server on the Server Use the cimserver command to start CIM server To stop CIM server use the command cimserver s To check whether OpenPegasus has been installed properly enter the following command cimcli ei n root PG_Interop PG ProviderModule r4 NOTE
38. II BCM5708 1000Base T BO PCI X 64 bit 133MHz found at mem 6000000 IRQ 16 node addr 0010180476ae cnic Added CNIC device ethO Link Up and Speed Indication bnx2 eth NIC Link is Up 1000 Mbps full duplex Link Down Indication bnx2 eth NIC Link is Down MSI enabled successfully bnx2 only bnx2 eth0 using MSI MSI X enabled successfully bnx2x only bnx2x eth0 using MSI X BNX2I DRIVER BNX2I Driver signon Broadcom NetXtreme II iSCSI Driver bnx2i v2 1 1D May 12 2010 Network port to iSCSI transport name binding bnx2i netif eth2 iscsi bcm570x 050000 bnx2i netif ethl iscsi bcm570x 030c00 Driver completes handshake with iSCSI offload enabled CNIC device bnx2i 05 00 00 ISCSI INIT passed K Driver detects iSCSI offload is not enabled on the CNIC device uu Broadcom Corporation Page 158 Driver Messages Document INGSRVT710 CDUM 100 R NOTE This message is displayed only when the user attempts to make an iSCSI connection User Guide NetXtreme II March 2014 bnx2i iSCSI not supported dev eth3 bnx21 bnx2i LOM is not enabled to offload iSCSI connections dev etho bnx2i dev ethO does not support iSCSI Exceeds maximum allowed iSCSI connection offload limit bnx21s alloc ep unable to allocate iscsi cid bnx2i unable to allocate iSCSI context resources Network route to target node and transport name binding are two different devices bnx2i conn bind ep 0x SROUTE HBA does not b
39. INGSRVT710 CDUM100 R NDIS2 Driver Software Broadcom NetXtreme II Network Adapter User Guide Page 135 NetXtreme II User Guide March 2014 e Windows NT Server 4 0 users When running Setup for Microsoft Network Client v3 0 for MS DOS click any network card from the list NE2000 Compatible for example to create the startup disk e After creating the startup disk follow the instructions in Modifying the Startup Disk To create a startup disk 1 Create a folder called NCADMIN in the root of the C drive 2 Copy the NCADMIN CN_ NCADMIN EX and NCADMIN HL_ files from the 1386 folder on the Windows NT Server 4 0 CD ROM 3 Open a command prompt window and change the directory to C NCADMIN 4 Type expand r ncadmin and press ENTER 5 Close the command prompt window by typing exit and then pressing ENTER 6 Start Windows Explorer 7 Open the NCADMIN folder and double click ncadmin exe 8 Follow the on screen instructions to make the network startup disk choose NE2000 Compatible from the list of adapters Modifying the Startup Disk To modify the startup disk 1 Edit A Net Protocol ini with Notepad or a similar text editor a Change DriverName to DriverName BXND20XS b Remove all other parameter entries under the MS NE2CLONE or equivalent section such as IOBASE 0x300 or INTERRUPTS 23 and so on Example Protocol ini file for IP network setup version 0x3110 netcard ms Sne2clone 1 MSSNE2CLONE 1 transpor
40. If upgrading an earlier version of the installer use setup s v qn as listed above To perform a GUI reinstall of the same installer Type the following setup V REINSTALL ALL If performing a silent upgrade or uninstall ensure to do a manual reboot afterwards to avoid leaving the system in an inconsistent state During silent upgrade or uninstall your system may reboot automatically If you wish to suppress the reboot please append REBOOT ReallySuppress to the end of the corresponding upgrade or uninstall command listed above In some circumstances reboot is required before uninstallation can continue If you used REBOOT ReallySuppress to suppress the reboot the uninstallation may be suspended You will need to reboot manually for the uninstallation to continue To perform a silent install and create a log file at f 1testlog txt setup s v qn L f ltestlog txt REMOVING THE DEVICE DRIVERS KL NOTE Windows Server 2008 and Windows Server 2008 R2 provide the Device Driver Rollback feature to replace a device driver with one that was previously installed However the complex software architecture of the NetXtreme II device may present problems if the rollback feature is used on one of the individual components Therefore we recommend that changes to driver versions be made only through the use of a driver installer To remove the device drivers 1 In Control Panel double click Add or Remove Programs 2 Click B
41. It allows the device to interact with other STP compliant devices in your network to ensure that only one path exists between any two stations on the network After a stable network topology has been established all bridges listen for hello BPDUs Bridge Protocol Data Units transmitted from the root bridge If a bridge does not get a hello BPDU after a predefined interval Max Age the bridge assumes that the link to the root bridge is down This bridge then initiates negotiations with other bridges to reconfigure the network to re establish a valid network topology The process to create a new topology can take up to 50 seconds During this time end to end communications are interrupted The use of Spanning Tree is not recommended for ports that are connected to end stations because by definition an end station does not create a loop within an Ethernet segment Additionally when a teamed adapter is connected to a port with Spanning Tree enabled users may experience unexpected connectivity problems For example consider a teamed adapter that has a lost link on one of its physical adapters If the physical adapter were to be reconnected also known as fallback the intermediate driver would detect that the link has been reestablished and would begin to pass traffic through the port Traffic would be lost if the port was temporarily blocked by the Spanning Tree Protocol Topology Change Notice TCN A bridge switch creates a forwarding table of
42. MAC Address No e Outbound Load Balancing using IP Address Yes e Multivendor teaming Supported Must include at least one Broadcom Ethernet adapter as a team member Applications Generic trunking works with switches that support Cisco Fast EtherChannel Cisco Gigabit EtherChannel Extreme Networks Load Sharing and Bay Networks or IEEE 802 3ad Link Aggregation static mode Since load balancing is implemented on Layer 2 addresses all higher protocols such as IP IPX and NetBEUI are supported Therefore this is the recommended teaming mode when the switch supports generic trunking modes over SLB Configuration Recommendations Static trunking supports connecting the teamed ports to switches if they are on the same broadcast domain and support generic trunking It does not support connecting to a router or Layer 3 switches since the ports must be on the same subnet MM Broadcom Corporation Document INGSRVT710 CDUM100 R Teaming Mechanisms Page 31 NetXtreme II User Guide March 2014 Dynamic Trunking IEEE 802 3ad Link Aggregation This mode supports link aggregation through static and dynamic configuration via the Link Aggregation Control Protocol LACP With this mode all adapters in the team are configured to receive packets for the same MAC address The MAC address of the first adapter in the team is used and cannot be substituted for a different MAC address The BASP driver determines the load balancing scheme for outbound pac
43. Memory Tests Group B Block Tests Group C and Ethernet Traffic Tests Group D The diagnostic tests are listed and described in Table 3 Table 3 Diagnostic Tests Test Number Name Description Group A Basic Functional Tests A1 Register Verifies that registers accessible through the PCI PCle interface implement the expected read only or read write attributes by attempting to modify those registers A2 PCI Configuration Checks the functionality of the PCI Base Address Register BAR by varying the amount of memory requested by the BAR and verifying that the BAR actually requests the correct amount of memory without actually mapping the BAR into system memory Refer to PCI or PCI E specifications for details on the BAR and its addressing space A3 Interrupt Generates a PCI interrupt and verifies that the system receives the interrupt and invokes the correct ISR A negative test is also performed to verify that a masked interrupt does not invoke the ISR A5 MSI Verifies that a Message Signaled Interrupt MSI causes an MSI message to be DMA d to host memory A negative test is also performed to verify that when an MSI is masked it does not write an MSI message to host memory A6 Memory BIST Invokes the internal chip Built In Self Test BIST command to test internal memory Group B Memory Tests B
44. NetXtreme II User Guide March 2014 VIEWING STATISTICS The information provided on the Statistics tab allows you to view traffic statistics for both Broadcom network adapters and network adapters made by others Statistical information and coverage are more comprehensive for Broadcom adapters To view Statistics information for any installed network adapter click the name of the adapter listed in the Explorer View pane then click the Statistics tab If any of the sections described below is not visible then from the Context View tab on the right side of the window select Statistics and then select the name of the missing section Click Refresh to get the most recent values for each statistic Click Reset to change all values to zero for the current BACS session NOTES e Team statistics are not compiled for a Broadcom network adapter if it is disabled e Some statistics may not be available for all Broadcom network adapters E MM Broadcom Corporation Page 258 Viewing Resource Information Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 General Statistics General Statistics show the transmitted and received statistics to and from the adapter Frames Tx OK A count of the frames that were successfully transmitted This counter is incremented when the transmit status is reported as Transmit OK Frames Rx OK A count of the frames that were successfully received This does not include frames received with frame
45. OK Figure 1 Launch and Activation Permission Launch and Activation Permission Security Limits Group or user names E Eyverone X bacs B122 bacs B Administrators B 1 22 dministrators Be Performance Log Users B122 Performance Log Users 52 Distributed COM Users B122 Distributed COM Users Add Remove Permissions for Everyone Allow Deny Local Launch Remote Launch Local Activation Remote Activation Learn about access control and permissions Cancel For more information see Securing a Remote WMI Connection on the Microsoft Developer Network site Special Configuration for WMI on Different Systems e On a Windows XP Pro or Windows 2003 Server computer ensure that remote logons are not being coerced to the GUEST account referred to as ForceGuest which is enabled by default on computers that are not attached to a domain Open the Local Security Policy editor by clicking Start Run and entering secpol msc Open the Local Policies node and select Security Options Then scroll down to the setting titled Network access Sharing and security model for local accounts If this is set to Guest only change it to Classic and restart the computer e n Windows Vista and Windows 7 in order to let all users in the administrator group connect using the WMI namespace the user might need to change the LocalAccountTokenFilterPolicy as needed uu Broadcom Corporation Page 130 Detailed P
46. Page 95 NetXtreme II User Guide March 2014 TROUBLESHOOTING ISCSI Boor The following troubleshooting tips are useful for iSCSI boot Problem A system blue screen occurs when iSCSI boots Windows Server 2008 R2 through the adapter s NDIS path with the initiator configured using a link local IPv6 address and the target configured using a router configured IPv6 address Solution This is a known Windows TCP IP stack issue Problem The Broadcom iSCSI Crash Dump utility will not work properly to capture a memory dump when the link speed for iSCSI boot is configured for 10 Mbps or 100 Mbps Solution The iSCSI Crash Dump utility is supported when the link speed for iSCSI boot is configured for 1 Gbps or 10 Gbps 10 Mbps or 100 Mbps is not supported Problem An iSCSl target is not recognized as an installation target when you try to install Windows Server 2008 by using an IPv6 connection Solution This is a known third party issue See Microsoft Knowledge Base KB 971443 http support microsoft com kb 971443 Problem When switching iSCSI boot from the Microsoft standard path to Broadcom iSCSI offload the booting fails to complete Solution Install or upgrade the Broadcom Virtual Bus Device VBD driver to 5 0 x along with the OIS driver prior to switching the iSCSI boot path Problem The iSCSI configuration utility will not run Solution Ensure that the iSCSI Boot firmware is installed in the NVRAM Problem A system blue screen o
47. RE uf e Configure LiveLink Yes Na i LiveLink detects loss of network connectivity beyond Ehe switch and routes traffic anl through team members that have a live link stack met ME 11 Select the probe interval the number of seconds between each retransmission of a link packet to the probe target and the maximum number of probe retries the number of consecutively missed responses from a probe target before a failover is triggered 12 Set the Probe VLAN ID to allow for connectivity with probe targets residing on a tagged VLAN The number set must match the VLAN ID of the probe targets as well as the port s on the switch to which the team is connected k NOTE Each LiveLink enabled team can only communicate with Probe Targets on a single VLAN Also VLAN ID 0 is equivalent to an untagged network If the Probe VLAN ID is set to a value other than 0 then a VLAN must be created with an identical VLAN tag value see Step 18 13 Click the probe target at the top of the list click Edit Target IP Address type the target IP address in the IP Address box for one or all probe targets and then click OK Click Next KL NOTE Only the first probe target is required You can specify up to three additional probe targets to serve as backups by assigning IP addresses to the other probe targets 14 Select a listed team member click Edit Member IP Address and then type the member IP address in the IP Address box Repe
48. SPANNING TREE ALGORITHM e Topology Change Notice TCN e Port Fast Edge Port In Ethernet networks only one active path may exist between any two bridges or switches Multiple active paths between switches can cause loops in the network When loops occur some switches recognize stations on both sides of the switch This situation causes the forwarding algorithm to malfunction allowing duplicate frames to be forwarded Spanning tree algorithms provide path redundancy by defining a tree that spans all of the switches in an extended network and then forces certain redundant data paths into a standby blocked state At regular intervals the switches in the network send and receive spanning tree packets that they use to identify the path If one network segment becomes unreachable or if spanning tree costs change the spanning tree algorithm reconfigures the spanning tree topology and re establishes the link by activating the standby path Spanning tree operation is transparent to end stations which do not detect whether they are connected to a single LAN segment or a switched LAN of multiple segments Spanning Tree Protocol STP is a Layer 2 protocol designed to run on bridges and switches The specification for STP is defined in IEEE 802 1d The main purpose of STP is to ensure that you do not run into a loop situation when you have redundant paths in your network STP detects disables network loops and provides backup links between switches or bridges
49. Specification NDIS driver is able to receive interrupts from the adapter Loopback MAC and Loopback PHY These tests verify that the NDIS driver is able to send packets to and receive packets from the adapter Broadcom Corporation Document INGSRVT710 CDUM100 R Managing Ethernet Controller Port Page 247 NetXtreme II User Guide March 2014 Test LED This test causes all of the port LEDs to blink 5 times for the purpose of identifying the adapter To run the diagnostic tests using the BACS CLI You can use the following CLI command to run diagnostics tests on a specified target This command is available for physical device ports only BACScli t lt target type gt f lt target format gt i lt target ID gt diag c REG c MII c EEP c MEM c CPU c INT c MACLB c PHYLB c LED c ALL l cnt v lt LEDIntv gt Examples 1 The following command displays all the diagnostics tests available for the current selected target BACScli t PHYPORTS f bdf i 01 00 00 diag 2 The following command runs the MII and LED tests for the selected target BACScli t PHYPORTS f bdf i 01 00 00 diag c MII c LED 3 The following command runs all the tests five times with an LED test interval of 8 ms for the selected target BACScli t PHYPORTS f bdf i 01 00 00 diag c all 1 5 v 8 In Interactive mode use the list lt view gt and select lt idx gt commands to select the
50. To verify the MAC address was configured exiting the program will be necessary followed by either disabling and enabling the adapter or rebooting the System e Windows restorenvram c Document and Settings Mbackup bin config mac e linux restorenvram tmp backup bin config mac e The following command upgrades the boot code for a BCM5755 adapter upgrade bc ee5755c3 19 backup5755 bin e The following command displays the version of Firmware Upgrade utility version e The following command enables the WOL setting on the current adapter w 1 e The following command programs a blank NVRAM or overwrite NVRAM with the specified bootcode Windows only prg bc C tmp new bootcode e The following command configures MAC address for the selected qualified adapter cfg mac 0010181a2b3c e The following command disables ump firmware if the UMP firmware is present in the selected adapter cfg ump 0 e The following command deletes the MBA firmware from NVRAM dir delete MBA e The following command deletes APE UPDATE firmware from NVRAM dir delete APEUPDATE M Broadcom Corporation Page 324 Examples Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Troubleshooting Broadcom NetXtreme II Network Adapter User Guide e Hardware Diagnostics e Checking Port LEDs e Troubleshooting Checklist e Checking if Current Drivers are Loaded e Running a Cable Length Test e Testing Network Connectivity e Microsoft Virtualizat
51. User Guide NetXtreme Il March 2014 KOREA COMMUNICATIONS COMMISSION KCC NOTICE REPUBLIC OF KOREA ONLY B CLASS DEVICE 0 212 2H EZB BAUMPEES FF IDEM e ABUA A30 AS s422 oH Sl ASIA At 22 m ASU Be 2 OE FSAI Broadcom NetXtreme II Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA Note that this device has been approved for non business purposes and may be used in any environment including residential areas MM Broadcom Corporation Document INGSRVT710 CDUM100 R Korea Communications Commission KCC Notice Republic of Korea Only Page 303 NetXtreme II User Guide March 2014 A CLASS DEVICE 0 WE AFSASILS ANWABSSS FF 2 2 0 2U SOHAL FES ASAS OD AS CSI HREHH AA 9 ASA ABE AS SASS HUC Broadcom NetXtreme II Gigabit Ethernet Controller Broadcom NetXtreme II 10 Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA MM Broadcom Corporation Page 304 Korea Communications Commission KCC Notice Republic of Korea Only Document INGSRVT710 CDUM100 R User Guide NetXtreme II User Diagnostics in DOS Broadcom NetXtreme II Network Adapter User Guide e Introduction e System Requirements e Performing Diagnostics e Diagnostic Test Descriptions INTRODUCTION Broadcom NetXtreme II User Diagnostics is an MS DOS based application that runs a series of diagnostic tests see Table 3 on the Broadcom N
52. VFs per PF field 2 n Virtual Switch Manager create a virtual NIC Ensure that Allow Management operating system to share the network adapter is selected as you create the NIC 3 In Virtual Switch Manager select the virtual adapter and select Hardware Acceleration in the navigation pane In the Single root I O virtualization section select Enable SR IOV 4 Install the Broadcom drivers for the adapters detected in the VM Use the latest drivers available from your vendor for the host OS do not use the inbox drivers The same driver version must be installed on the host and the VM To verify that SR IOV is operational 1 Start the VM 2 In Hyper V Manager select the adapter and select the VM in the Virtual Machines list 3 Select the Networking tab at the bottom of the window and view the adapter status SR IOV AND STORAGE FUNCTIONALITY Storage functionality FCoE or iSCSI can be enabled on an SR IOV enabled adapter However if storage is used on an NPAR enabled physical function PF then the number of virtual functions for that PF is set to zero therefore SR IOV is disabled on that PF This limitation applies only when the adapter is configured in NPAR mode It is not relevant when the adapter is configured in single function mode SR IOV AND JUMBO PACKETS If SR IOV is enabled on a virtual function VF on the adapter ensure that the same jumbo packet settings is configured on both the VF and the Microsoft synthetic a
53. Verifies the RX buffer RBUF allocation interface by allocating and releasing buffers and checking that the RBUF block maintains an accurate count of the allocated and free buffers C3 CAM Access Verifies the content addressable memory CAM block by performing read write add modify and cache hit tests on the CAM associative memory C4 TPAT Cracker Verifies the packet cracking logic block i e the ability to parse TCP IP and UDP headers within an Ethernet frame as well as the checksum CRC offload logic In this test packets are submitted to the chip as if they were received over Ethernet and the TPAT block cracks the frame identifying the TCP IP and UDP header data structures and calculates the checksum CRC The TPAT block results are compared with the values expected by Broadcom NetXtreme II User Diagnostics and any errors are displayed C5 FIO Register The Fast IO FIO verifies the register interface that is exposed to the internal CPUs C6 NVM Access and Reset Corruption Verifies non volatile memory NVM accesses both read and write initiated by one of the internal CPUs It tests for appropriate access arbitration among multiple entities CPUs It also checks for possible NVM corruption by issuing a chip reset while the NVM block is servicing data C7 Core Reset Integrity Verifies that the chip performs its reset operation correctly by resetting the chip multiple times checking
54. When moving from a nonproduction network to a production network it is strongly recommended to test again for failover uu Broadcom Corporation Page 52 Troubleshooting Teaming Problems Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 and fallback 15 Test the performance behavior of the team before placing into a production environment 16 Network teaming is not supported when running iSCSI traffic via Microsoft iSCSI initiator or iSCSI offload MPIO should be used instead of Broadcom network teaming for these ports 17 For information on iSCSI boot and iSCSI offload restrictions see iSCSI Protocol TROUBLESHOOTING GUIDELINES Before you call for support make sure you have completed the following steps for troubleshooting network connectivity problems when the server is using adapter teaming 1 Make sure the link light is ON for every adapter and all the cables are attached 2 Check that the matching base and intermediate drivers belong to the same release and are loaded correctly 3 Check for a valid IP Address using the Windows ipconfig command 4 Check that STP is disabled or Edge Port Port Fast is enabled on the switch ports connected to the team or that LiveLink is being used e Check that the adapters and the switch are configured identically for link speed and duplex If possible break the team and check for connectivity to each adapter independently to confirm that the problem is directly a
55. You must have administrator privileges to create or modify a team e The load balance algorithm in a team environment in which members are connected at different speeds favors members connected with a Gigabit Ethernet link over members connected at lower speed links 100 Mbps or 10 Mbps until a threshold is met This is normal behavior MM Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 263 NetXtreme II User Guide March 2014 TEAM TYPES You can create four types of load balance teams e Smart Load Balance and Failover e Link Aggregation 802 3ad TOE is not applicable e Generic Trunking FEC GEC 802 3ad Draft Static TOE is not applicable e SLB Auto Fallback Disable The Auto Fallback Disable feature is configured for Smart Load Balance and Failover type teams in the Teaming Wizard K Smart Load Balance and Failover NOTE NetXtreme II network adapters with iSCSI enabled is supported only in an SLB team type In this type of team a standby member handles the traffic if all of the load balance members fail a failover event All load balance members have to fail before the standby member takes over When one or more of the load balance members is restored fallback the restored team member s resumes the handling of the traffic The LiveLink feature is supported for this type of team Link Aggregation 802 3ad In this type of team you can dynamically configure the network adapters
56. a system that operates with voltages that can be lethal Before you open the case of your system observe the following precautions to protect yourself and to prevent damage to the system components e Remove any metallic objects or jewelry from your hands and wrists e Make sure to use only insulated or nonconducting tools e Verify that the system is powered OFF and is unplugged before you touch internal components e Install or remove adapters in a static free environment The use of a properly grounded wrist strap or other personal antistatic devices and an antistatic mat is strongly recommended PREINSTALLATION CHECKLIST 1 Verify that your system meets the hardware and software requirements listed under System Requirements 2 Verify that your system is using the latest BIOS ra If your system is active shut it down NOTE If you acquired the adapter software on a disk verify the path to the adapter driver files When system shutdown is complete turn off the power and unplug the power cord Remove the adapter from its shipping package and place it on an antistatic surface Dow ge xt Check the adapter for visible signs of damage particularly on the edge connector Never attempt to install a damaged p Broadcom Corporation Document INGSRVT710 CDUM100 R Safety Precautions Page 71 NetXtreme II User Guide March 2014 adapter PSS Broadcom Corporation Page 72 Preinstallation Checklist Document INGSRVT710 CDU
57. activity is indicated by a single LED located adjacent to the port connector as described in Table 2 Broadcom Advanced Control Suite also provides information about the status of the network link and activity see Viewing Vital Signs Table 1 Network Link and Activity Indicated by the RJ 45 Port LEDs Port LED LED Appearance Network State Link LED Off No link cable disconnected Continuously illuminated Link Activity LED Off No network activity Blinking Network activity Table 2 Network Link and Activity Indicated by the Port LED LED Appearance Network State Off No link cable disconnected Continuously illuminated Link Blinking Network activity N Broadcom Corporation Document INGSRVT710 CDUM100 R Supported Operating Environments Page 7 NetXtreme II User Guide March 2014 Configuring Teaming in Windows Server Broadcom NetXtreme II Network Adapter User Guide e Broadcom Advanced Server Program Overview e Load Balancing and Fault Tolerance KL NOTE This chapter describes teaming for adapters in Windows Server systems For more information on a similar technology on Linux operating systems called Channel Bonding refer to your operating system documentation BROADCOM ADVANCED SERVER PROGRAM OVERVIEW Broadcom Advanced Server Program BASP is the Broadcom teaming software for the Windows family of operating systems BASP settings are configured by Broadcom
58. an iSCSI boot OS the VolMgr error The system could not successfully load the crash dump driver appears in the event log Solution Enable iSCSI Crash Dump from the Advanced section of the BACS Configuration tab Problem The Broadcom NetXtreme ll adapter may not perform at optimal level on some systems if it is added after the system has booted Solution The system BIOS in some systems does not set the cache line size and the latency timer if the adapter is added after the system has booted Reboot the system after the adapter has been added Problem Although the Broadcom 5708S SerDes adapter is capable of connecting at speeds up to 2 5 Gbps when licensed and configured Windows Task Manager incorrectly reports the speed at 2 Gbps Solution This reporting error is a known Microsoft issue Locate the actual link speed from Viewing Vital Signs in BACS Problem Cannot configure Resource Reservations in BACS after SNP is uninstalled Solution Reinstall SNP Prior to uninstalling SNP from the system ensure that NDIS is enabled via the checkbox on the Resource Configuration screen available from the Resource Reservations section of the Configurations tab see Viewing Resource Reservations If NDIS is disabled and SNP is removed there is no access to re enable the device Problem TOE performance is more susceptible to packet loss when flow control is disabled Solution Enable flow control to reduce the number of packets lost Proble
59. bnx2i driver is loaded and the Linux kernel is updated the driver module must be recompiled if the driver module was installed using the source RPM or the TAR package INSTALLING THE SOURCE RPM PACKAGE The following are guidelines for installing the driver source RPM Package Prerequisites e Linux kernel source e C compiler Procedure 1 Install the source RPM package rpm ivh netxtreme2 lt version gt src rpm 2 Change the directory to the RPM path and build the binary RPM for your kernel For RHEL cd rpmbuild rpmbuild bb SPECS netxtreme2 spec For SLES cd usr src packages rpmbuild bb SPECS netxtreme2 spec 3 Install the newly compiled RPM rpm ivh RPMS lt arch gt netxtreme2 lt version gt lt arch gt rpm Note that the force option may be needed on some Linux distributions if conflicts are reported 4 Install the open fcoe utility For RHEL 6 4 and legacy versions either of the following yum install fcoe utils version rhel 64 brcm subver arch rpm Or rpm ivh fcoe utils version rhel 64 brcm subver arch rpm For SLES11 SP2 rpm ivh open fcoe version sles sp2 brcm subver arch rpm For RHEL 6 4 and SLES11 SP2 and legacy versions the version of fcoe utils open fcoe included in your distribution is sufficient and no out of box upgrades are provided Where available installation with yum will automatically resolve dependencies Otherwise required dependencies can b
60. booting ELM Broadcom Corporation Page 164 Linux iSCSI Offload Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Solaris Driver Software Broadcom NetXtreme II Network Adapter User Guide e Overview e Installing the Driver e Upgrading the Driver e Uninstalling Driver e Configuring the Driver e Memory Usage e Interrupt Management e FCoE Support OVERVIEW This file describes how to install the Solaris driver for Broadcom s NetXtreme ll 10 Gigabit Ethernet network adapters Refer to the bnxe manual page for details on how to configure the driver The Solaris driver is released in two formats e BRCMbnxe version pkg Datastream format e BROMbnxe version tar Z Compressed TAR file system format K NOTE A DU image does not exist at this time because of driver size limitations Solaris DU diskettes can be used to install the driver into the system both during system installation and or after the system has been installed and booted This driver only works with the GLDv3 Streams interface as it appears in Solaris 10 Update 4 and later INSTALLING THE DRIVER 1 Change directory to where BRCMbnxe version pkg resides 2 pkgadd d BRCMbnxe version pkg or 1 Copy BRCMbnxe X Y Z tar Z to tmp 2 cd tmp uncompress BRCMbnxe version tar Z p Broadcom Corporation Document INGSRVT710 CDUM100 R Solaris Driver Software Broadcom NetXtreme II9 Network Adapter User Guide Pa
61. desired target device Use the following command to run diagnostic tests for the selected target diag c REG c MII c EEP c MEM c CPU c INT c MACLB c PHYLB c LED c ALL 1 cnt v lt LEDIntv gt Examples 1 The following command displays all the diagnostics tests available for the current selected target diag 2 The following command runs the MII and LED test for the selected target diag se MIT c LED 3 The following command runs all the tests five times with an LED test interval of 8 ms for the selected target diag c all 1 5 v 8 ANALYZING CABLES IN WINDOWS The Cable Analysis option on the Diagnostics tab lets you monitor the conditions of each wire pair in an Ethernet Category 5 cable connection within an Ethernet network The analysis measures the cable quality and compares it against the IEEE 802 3ab specification for compliance CS Oe Broadcom Corporation Page 248 Managing Ethernet Controller Port Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 NOTES e This feature can be used with Windows Server managed hosts only It is not available for hosts operating on Linux or other OSes You can however use BACS on a Linux client to connect to a Windows Server host and run the cable analysis utility e You must have administrator privileges to run the cable analysis test e The network connection is temporarily lost during an analysis e This option i
62. driver rather than the load balancing features or it may operate more efficiently over a single physical adapter that provides a particular hardware feature such as Large Send Offload TYPES OF TEAMS Switch Independent The Broadcom Smart Load Balancing type of team allows two to eight physical adapters to operate as a single virtual adapter The greatest benefit of the SLB type of team is that it operates on any IEEE compliant switch and requires no special configuration Smart Load Balancing and Failover SLB provides for switch independent bidirectional fault tolerant teaming and load balancing Switch independence implies that there is no specific support for this function required in the switch allowing SLB to be compatible with all switches Under SLB all adapters in the team have separate MAC addresses The load balancing algorithm operates on Layer 3 addresses of the source and destination nodes which enables SLB to load balance both incoming and outgoing traffic p Broadcom Corporation Document INGSRVT710 CDUM100 R Teaming Mechanisms Page 29 NetXtreme II User Guide March 2014 The BASP intermediate driver continually monitors the physical ports in a team for link loss In the event of link loss on any port traffic is automatically diverted to other ports in the team The SLB teaming mode supports switch fault tolerance by allowing teaming across different switches provided the switches are on the same physical network or bro
63. e TOE is only supported on SLB type teams e Each virtual BASP device advertises 1024 offload connections If the number of virtual BASP devices in a team exceeds the number of active physical members the maximum offload connections for each virtual device may be lower SOFTWARE COMPONENTS Teaming is implemented via an NDIS intermediate driver in the Windows Operating System environment This software component works with the miniport driver the NDIS layer and the protocol stack to enable the teaming architecture see Figure 2 The miniport driver controls the host LAN controller directly to enable functions such as sends receives and uu Broadcom Corporation Page 20 Executive Summary Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 interrupt processing The intermediate driver fits between the miniport driver and the protocol layer multiplexing several miniport driver instances and creating a virtual adapter that looks like a single adapter to the NDIS layer NDIS provides a set of library functions to enable the communications between either miniport drivers or intermediate drivers and the protocol stack The protocol stack implements IP IPX and ARP A protocol address such as an IP address is assigned to each miniport device instance but when an Intermediate driver is installed the protocol address is assigned to the virtual team adapter and not to the individual miniport devices that make up the team The Broadc
64. e The Power Management tab is available only for servers that support power management e To enable Wake on LAN WOL when the computer is on standby click Allow the device to bring the computer out of standby box e f you select Only allow management stations to bring the computer out of standby the computer can be brought out of standby only by Magic Packet AN CAUTION Do not select Allow the computer to turn off the device to save power for any adapter that is a member of a team uu Broadcom Corporation Page 188 Setting Power Management Options Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 hs Broadcom Corporation Document INGSRVT710 CDUM100 R Setting Power Management Options Page 189 NetXtreme II User Guide March 2014 NIC Partitioning Broadcom NetXtreme II Network Adapter User Guide Overview e Configuring for NIC Partitioning OVERVIEW NIC partitioning NPAR also known as vNIC or Virtual NIC by IBM divides a Broadcom NetXtreme II 10 Gigabit Ethernet NIC into multiple virtual NICs by having multiple PCI physical functions per port Each PCI function is associated with a different virtual NIC To the OS and the network each physical function appears as a separate NIC port K The number of partitions for each port is from one to four thus making a dual port NIC capable of a maximum of eight partitions Each partition behaves as if it is an independent NIC port r4 NOT
65. far vidtaza lampliza atzarder TURK Bu r n n J006 95 EC D k Vola Daektifi 2004 108 EC EMC Direktifi ve Avrupa Turkish Birligi nm ilavelerme uygun oldugu belirlenmi tir Yukanda belirtilen direktifler ve standarlara uygan olarak bir Uygunluk Beyam hazirlannustr ve Broadcom Corporation 190 Mathilda Place Sunnyvale Califoruua 93086 USA Avrupa Birligi B Smif Bu Broadcom cihaz tipik bar B samafi ev igi ortamda kullambmak zere s mfland lnu t r Avrupa Birligi A S n f UYARI Bu bir A simi imim d r Bu r n mahalli b r evrede vada ev iginde radyo frekans kansmasma sebep olabilir bu durumda 15e kullamemm gerekli onlemlen almas zorunlu olab l r Ee Broadcom Corporation Page 300 CE Notice Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 CANADIAN REGULATORY INFORMATION CANADA ONLY INDUSTRY CANADA CLAss B Broadcom NetXtreme II Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA This Class B digital apparatus complies with Canadian ICES 003 Notice The Industry Canada regulations provide that changes or modifications not expressly approved by Broadcom could void your authority to operate this equipment INDUSTRY CANADA CLASS A Broadcom NetXtreme II Gigabit Ethernet Controller Broadcom NetXtreme II 10 Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA This
66. fiber optic Ethernet network port ME Broadcom Corporation Page 74 Installation of the Add In NIC Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Broadcom Boot Agent Driver Software Broadcom NetXtreme II Network Adapter User Guide e Overview e Setting Up MBA in a Client Environment e Setting Up MBA in a Server Environment OVERVIEW Broadcom NetXtreme II adapters support Preboot Execution Environment PXE Remote Program Load RPL iSCSI and Bootstrap Protocol BootP Multi Boot Agent MBA is a software module that allows your network computer to boot with the images provided by remote servers across the network The Broadcom MBA driver complies with the PXE 2 1 specification and is released with both monolithic and split binary images This provides flexibility to users in different environments where the motherboard may or may not have built in base code The MBA module operates in a client server environment A network consists of one or more boot servers that provide boot images to multiple computers through the network The Broadcom implementation of the MBA module has been tested successfully in the following environments e Linux Red Hat PXE Server Broadcom PXE clients are able to remotely boot and use network resources NFS mount and so forth and to perform Linux installations In the case of a remote boot the Linux universal driver binds seamlessly with the Broadcom Universal Network Driver
67. from crt to pkcs12 format as follows For a Windows server the certificate should be in pkcs12 format Enter the following command openssl pkcs12 export in server crt inkey server key out hostname pfx You will be prompted for the following Enter Export Password Verifying Enter Export Password Enter the password and be sure to remember it The password is required when importing the certificate on the Windows server and client 8 Make a copy of the certificate file server crt and place it on the server where BACS will be installed so that it can be imported If you plan to use a Windows or Linux client to connect to the server running BACS then the certificate also needs to be transferred copied and pasted to the client system In Linux the certificate should have the extension pem The extension crt and pem are the same so there is no need to use the openss1 command to convert from crt to pem You can simply copy the file as is Gg Install the Self Signed Certificate on Windows Server NOTE A separate certificate must be generated for an IPv4 address IPv6 address and Hostname Transfer the file hostname pfx you generated on the Windows server before you install the certificate Click Start or press the Windows logo key and select Run Enter MMC and click OK Click File gt Add Remove Snap in Click Add Select Certificates and click Add Select Computer account Click Next and then click
68. in the ifconfig utility then use 001018001199 as an input parameter to select the NIC Commands The following is the list of available commands These are described in detail in Command Descriptions e cfg Configure NVRAM e crc Check update NVRAM checksum dev Select an adapter or list available adapters e dir Display file directory in NVRAM dumpnvram Save entire NVRAM contents to a file help Show a list of available commands prg Program NVRAM with specified firmware image This command is designated to facilitate the manufacture operation e q Exit the program restorenvram Restore entire NVRAM contents from a file upgrade Upgrade the firmware or bootcode version Display the version of this program e w Enable disable WOL deprecated Instaed use cfg wol value S Broadcom Corporation Document INGSRVT710 CDUM100 R Invoking the Utility Page 317 NetXtreme Il User Guide March 2014 COMMAND DESCRIPTIONS The following commands can be used with the winfwupg and 1nxfwupg utilities CFG Syntax cfg noreset mac MAC address to be programmed for current selected device mba value asf value ump value setman lt t p m gt mgmt value wol value aspm value tph value vpdv0 version string show Description Programs the specified configuration into NVRAM Parameters e noreset Skips the
69. information regarding See Table 2 for configuration the partition s on port 1 Select to configure options Reset Configuration to Resets the NIC partition configuration to the factory Default default settings Table 2 describes the functions available from the PF X screen pS Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring for NIC Partitioning Page 191 NetXtreme Il User Guide March 2014 Table 2 Function Description Function Description Option Ethernet Protocol Enables disables Ethernet protocol e Enable e Disable iSCSI Offload Protocol Enables disables iSCSI protocol e Enable e Disable FCoE Offload protocol Enables disables FCoE protocol e Enable e Disable Bandwidth Weight Configures the weight or importance of a particular The sum of all weights for the function There are four functions per port and the weight four functions are either O or is used to arbitrate between the functions in case of 100 congestion Maximum Bandwidth Configures the maximum bandwidth in percentage of the physical port link Network MAC Address Displays the network MAC address iSCSI MAC Address Displays the iSCSI MAC address FCoE FIP MAC Address Displays the FCoE MAC address FCoE WWPN FCoE World Wide Port Name FCoE WWNN FCoE World Wide Node Name Note Ensure that the Network MAC Address and the iSCSI MAC Address are not the same Configuring equal Bandwidth Weight values for all fu
70. iscsiuio version tar gz 2 CD to the directory where iscsiuio is extracted cd iscsiuio version 3 Compile and install OonEidgure make make install 4 Check the iscsiuio version matches with the source package brcm iscsiuio v 5 Start brcm iscsiuio brcm iscsiuio E Broadcom Corporation Document INGSRVT710 CDUM100 R Teaming with Channel Bonding Page 161 NetXtreme II User Guide March 2014 BIND ISCSI TARGET TO BROADCOM NX2 ISCSI TRANSPORT NAME By default the open iscsi daemon connects to discovered targets using software initiator transport name tcp Users who wish to offload iSCSI connection onto CNIC device should explicitly change transport binding of the iSCSI iface This can be done using the iscsiadm CLI utility as follows iscsiadm m iface I iface file name gt n iface transport name v bnx2i o update where the iface file includes the following information for RHEL 5 4 RHEL 5 5 and SLES 11 SP1 iface net ifacename ethX iface iscsi ifacename name of the iface file gt iface hwaddress XX XX XX XX XX XX iface ipaddress XX XX XX XX iface transport name bnx2i Ensure that the iface hwaddress is in lower case format If you wish to switch back to use the software initiator use the following iscsiadm m iface I iface file name n iface transport name v tcp o update where the iface file includes the following information iface net ifacename ethX iface is
71. licensing you can configure your iSCSI capable NetXtreme Il network adapter to offload iSCSI processing from the host processor The following process enables your system to take advantage of Broadcom s iSCSI offload feature e Installing Broadcom Drivers and Management Applications e Installing the Microsoft iSCSI Initiator e Configuring Broadcom iSCSI Using BACS e Configure Microsoft Initiator to Use Broadcom s iSCSI Offload Installing Broadcom Drivers and Management Applications 1 Install the Windows drivers See Windows Driver Software 2 Install the management applications See Installing Management Applications Installing the Microsoft iSCSI Initiator For Windows Server 2008 and later the iSCSI initiator is included inbox To download the iSCSI initiator from Microsoft go to http www microsoft com en us download details aspx displaylang en amp id 18986 and locate the direct link for your system Configuring Broadcom iSCSI Using BACS The Broadcom Advanced Control Suite BACS is used to manage all of Broadcom s network adapters and advanced features For more information see Using Broadcom Advanced Control Suite 4 1 Open BACS 2 Select the Broadcom NetXtreme II C NIC iSCSI adapter If the C NIC iSCSI adapter is not present then select the VBD device and enable iSCSI offload by selecting iSCSI Offload Engine from the Resource Reservations area of the Configuration tab See Viewing Resource Reservations 3 Se
72. must be between 1 and 4094 VLAM tag values must match a VLAN tag on the connected switch Uu Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 275 NetXtreme II User Guide March 2014 19 Select Yes to add or manage another VLAN and then click Next Repeat until you do not want to add or manage any additional VLANs k NOTE You can define up to 64 VLANs per team 63 VLANs that are tagged and 1 VLAN that is not tagged Adding several VLANS may slow down the reaction time of the Windows interface due to memory and processor time usage for each VLAN The degree to which Windows performance may suffer depends on system configuration E Broadcom Teaming Wizard Creating Modifying a VLAM Additional LANs fl Create additional LANs if required BROADCOM SJ A Do vou wank bo manage more vLAM Yes No 4 maximum af 64 VLAMs can be created 63 tagged and 1 untagged Cancel lt Back next gt Preview ima ELM Broadcom Corporation Page 276 Configuring Teaming Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 20 To apply and commit the changes to the team select Commit changes to system and Exit the wizard To apply your changes but continue using the wizard select Save changes and continue to manage more teams Click Finish Uti Broadcom Teaming Wizard eE Congratulations The Teaming Wizard has finished A collecting information How would you like to BROAD
73. new bootcode tmp oldBoot e The following command upgrades PXE for the adapter with MAC 00 10 18 00 11 99 Windows winfwupg 001018001199 upgrade mba b57mmbae nic c backup oldPXE bin Linux 1nxfwupg 001018001199 upgrade mba b57mmbae nic backup oldPXE bin e The following command upgrades ASF for the adapter with the specified GUID Windows winfwupg 8580CDDC 961B 4829 A80C 478D22DB7B3E upgrade F asf asfv55 old image Linux 1nxfwupg 8580CDDC 961B 4829 A80C 478D22DB7B3E upgrade F asf asfv55 e The following command forces a downgrade for all the adapters with existing UMP support When multiple applicable adapters are present the MAC address of the adapter is appended to the backup NVRAM image parameter filename Windows winfwupg all upgrade F ump c tmp ump114 backupUMP Linux 1nxfwupg all upgrade F ump tmp ump114 backupUMP e The following command reads a complete NVRAM image from file backup bin and writes the image to NVRAM along with its configurations If the config parameter is left out only the image is written This restores NVRAM images to those with matching FW only Windows winfwupg all restorenvram c Documents and Settings backup bin config Linux 1nxfwupg all restorenvram tmp backup bin config e The following command programs bootcode for the ONLY qualified adapter found The adapter parameter can be omitted if ONLY ONE qualified adapter is found This command is available only for Windows Windows winfwu
74. node Changes may affect access ko SC SI targets Initiator node name 4 Select the Discovery tab and click Add to add a target portal uu Broadcom Corporation Page 100 iSCSI Offload in Windows Server Document INGSRVT710 CDUM100 R User Guide March 2014 iSCSI Initiator Properties a X General Discovery Targets Persistent Targets Bound Volumes Devices Target Portals Address Pot Adapter IP Address Remove Refresh ISHS Servers MH ame Remove Refresh es ms 5 Enter the IP address of the target and click Advanced add Target Portal 34 Type the IP address or DNS name and socket number of the portal you want to add Click Adwanced to select specific settings For the discovery session bo the portal IP address or DNS name 192 168 2 250 6 From the General tab select Broadcom NetXtreme II C NIC iSCSI Adapter from Local adapter NetXtreme Il M Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Offload in Windows Server Page 101 NetXtreme ll User Guide March 2014 Advanced Settings BL x D ak 1 y y O Default Broadcom Mebstreme C NIC iSCSI Adapter on PCI bus 3 i Microsoft IS C5 Initiator m PRAT neps errare data security bY prowamng autientication Ere HATTE r s Sean e mmh obi r Iur 1 Fr F be um ERE um mg d Lz 8 ei ania zT THU ee ol Pett Ju estamen Se A rj P et TM Specie same tanget EnS secet inal
75. of congestion the FCoE traffic will be able to use at least 60 of the link bandwidth and iSCSI to use 40 See additional references at http www ieee802 org 1 pages 802 1az html PRIORITY FLOW CONTROL PFC Priority Flow Control PFC provides a link level flow control mechanism that can be controlled independently for each traffic type The goal of this mechanism is to ensure zero loss due to congestion in DCB networks Traditional IEEE 802 3 Ethernet does not guarantee that a packet transmitted on the network will reach its intended destination Upper level protocols are responsible to maintain the reliability by way of acknowledgement and retransmission In a network with multiple traffic classes it becomes very difficult to maintain the reliability of traffic in the absence of feedback This is traditionally tackled with the help of link level Flow Control When PFC is used in a network with multiple traffic types each traffic type can be encoded with a different priority value and a pause frame can refer to this priority value while instructing the transmitter to stop and restart the traffic The value range for the priority field is from O to 7 allowing eight distinct types of traffic that can be individually stopped and started See additional references at http www ieee802 org 1 pages 802 1bb html DATA CENTER BRIDGING EXCHANGE DCBX Data Center Bridging eXchange DCBX is a discovery and capability exchange protocol that is used fo
76. once it has been selected by BIOS as the chosen boot device This is different from other implementations that will connect to the boot device even if another device has been selected by the system BIOS For OS installation over the FCoE path it is necessary to instruct the Option ROM to bypass FCoE and skip to CD DVD installation media As instructed earlier the boot order must be configured with Broadcom boot first and installation media second Furthermore during OS installation it is required to bypass the FCoE boot and pass through to the installation media for boot It is required to do this by one time disabling the FCoE boot ROM from booting and not by simply allowing the FCoE ROM to attempt to boot and allowing the BIOS to fail through and boot the installation media Finally it is required that the FCoE ROM successfully discover and test the readiness of the desired boot LUN in order for installation to proceed successfully Failure to allow the boot ROM to discover the LUN and do a coordinated bypass will result in a failure to properly install the O S to the LUN In order to affect this coordinated bypass there are two choices e Once the FCoE boot ROM discovers a ready target LUN it will prompt you to press CTRL D within 4 seconds to Stop booting from the target Press CTRL D and proceed to boot from the installation media e From COM set the Option ROM setting under MBA settings to One Time Disabled With this setting the FCoE ROM wi
77. only The Accounting Server is isolated from all traffic on VLANs 1 and 2 The switch port connected to the server has tagging turned off PCs 1 and 2 Attached to a shared media hub that is then connected to the switch PCs 1 and 2 belong to VLAN 2 only and are logically in the same IP subnet as the Main Server and PC 5 The switch port connected to this segment has tagging turned off PC 3 A member of VLAN 1 PC 3 can communicate only with the Main Server and PC 5 Tagging is not enabled on PC 3 switch port PC 4 A member of VLAN 3 PC 4 can only communicate with the servers Tagging is not enabled on PC 4 switch port PC 5 A member of both VLANs 1 and 2 PC 5 has an Broadcom adapter installed It is connected to switch port 10 Both the adapter and the switch port are configured for VLANs 1 and 2 and have tagging enabled KL NOTE VLAN tagging is only required to be enabled on switch ports that create trunk links to other switches or on ports connected to tag capable end stations such as servers or workstations with Broadcom adapters E MM Page 64 VLAN Overview Broadcom Corporation Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 ADDING VLANs TO TEAMS Each team supports up to 64 VLANs 63 tagged and 1 untagged Note that only Broadcom adapters and Alteon AceNIC adapters can be part of a team with VLANs With multiple VLANs on an adapter a server with a sin
78. packets and the periodic load balancing There is no per packet reference to the Inbound Flow Entries Even though the link lists are not bounded the overhead in processing each non ARP packet is always a constant The processing of ARP packets both inbound and outbound however depends on the number of links inside the corresponding link list On the inbound processing path filtering is also employed to prevent broadcast packets from looping back through the system from other physical adapters Protocol Support ARP and IP TCP UDP flows are load balanced If the packet is an IP protocol only such as ICMP or IGMP then all data flowing to a particular IP address will go out through the same physical adapter If the packet uses TCP or UDP for the L4 protocol then the port number is added to the hashing algorithm so two separate L4 flows can go out through two separate physical adapters to the same IP address For example assume the client has an IP address of 10 0 0 1 All IGMP and ICMP traffic will go out the same physical adapter because only the IP address is used for the hash The flow would look something like this IGMP gt PhysAdapter1 gt 10 0 0 1 MM Broadcom Corporation Page 28 Teaming Mechanisms Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 ICMP gt PhysAdapter1 gt 10 0 0 1 If the server also sends an TCP and UDP flow to the same 10 0 0 1 address they can be on the sa
79. reboot type the following setup s v qn REBOOT ReallySuppress To perform a silent install and create a log file Type the following setup s v qn L Xi1a32Xl1testlog txt The 1testlog txt log file will be created at f ia32 To perform a silent uninstall from any folder on the hard drive msiexec x 26ELIBFBO E87E 4696 9F89 BA467FO1F81E5 qn KL NOTES e The hexadecimal number above may differ from your current installer Check the Key name corresponding with the Broadcom Advanced Control Suite BACS application in HKLM Software Microsoft Windows CurrentVersion Uninstall for the correct hexadecimal number e After performing a silent uninstall it is necessary to reboot the system before reinstalling this installer If a reboot is not performed BASP will not install correctly To perform a silent install by feature on IA32 platforms Use ADDSOURCE to include any of the features listed below setup s v qn ADDSOURCE BACSi32 CHM32 BASPi32 SNMPi32 CIMi32 NOTE CHM32 or CHM64 installs the BACS help file and must be included when installing the BACS feature To perform a silent install by feature on AMD64 EM64T platforms Type the following setup s v qn ADDSOURCE BACSa64 HMa64 BASPa64 SNMPa64 MEM EE Broadcom Corporation Page 132 Installing the Broadcom Advanced Control Suite and Related Management Applications Document INGSRVT710 User Guide NetXtreme Il March 2014 To perform a silent install f
80. receipt or transmission of PAUSE frames PAUSE frames allow the network adapter and a switch to control the transmit rate The side that is receiving the PAUSE frame momentarily stops transmitting By enabling TOE network performance improves but with the increased performance TOE performance is more susceptible to packet loss when flow control is disabled Enable flow control to reduce the number of packets lost K NOTE If Jumbo Packet is set to 5000 bytes or greater on network adapters that support 10 Gbps link speed ensure that Flow Control is set to Auto to prevent the system performance from performing at less than optimal levels This limitation exists on a per port basis e Auto default Receive and transmit PAUSE frame functionality are optimized This option indicates that the adapter automatically adjusts the flow control settings for optimal performance and its purpose is not enabling auto negotiation of the flow control parameters e Disable Receive and transmit PAUSE frame functionality are disabled e Rx Enabled Receive PAUSE frame is enabled e Rx amp Tx Enabled Receive and transmit PAUSE frame are enabled e Tx Enabled Transmit PAUSE frame is enabled IPv4 Checksum Offload Normally the checksum function is computed by the protocol stack When you select one of the Checksum Offload property values other than None the checksum can be computed by the network adapter e Rx Enabled Enables receive TCP IP UDP che
81. requirements HARDWARE REQUIREMENTS e A32 or EMT64 based computer that meets operating system requirements e One open PCI Express slot Depending on the PCI Express support on your adapter the slot may be of type PCI Express 1 0a x1 PCI Express 1 0a x4 or PCI Express Gen2 x8 e 128 MB RAM minimum OPERATING SYSTEM REQUIREMENTS General e PCI Express v1 0a x1 or greater Host Interface Microsoft Windows One of the following versions of Microsoft Windows e Windows Server 2008 family e Windows Server 2008 R2 family uu Broadcom Corporation Page 70 Installing the Hardware Broadcom NetXtreme I9 Network Adapter User Guide Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 e Windows Server 2012 family Linux Although the adapter driver should work with many Linux kernel versions and distributions it has only been tested on 2 4x kernels starting from 2 4 24 and 2 6 x kernels The driver may not compile on kernels older than 2 4 24 Testing is concentrated on i386 and x86_64 architectures Only limited testing has been done on other architectures Minor changes to some source files and Makefile may be needed on some kernels ra VMware ESX e VMware ESX e VMware ESX 3 5 e VMware ESX 4 0 e VMware ESX 4 1 e VMware ESXi 5 0 e VMware ESXi 5 1 NOTE Support for the 2 4 21 kernels is provided in Red Hat Enterprise Linux 3 SAFETY PRECAUTIONS AN CAUTION The adapter is being installed in
82. supported configuration However the VLAN tagging capability of BASP cannot be combined with the VLAN capability of Hyper V In order to use the VLAN capability of Hyper V the BASP team must be untagged e When making changes to a team or removing a team remove the team s binding from all guest OSs that use any of the VNICs in the team change the configuration and then rebind the team s VNICs to the guest OS This can be done in the Hyper V Manager Configuring VMQ with SLB Teaming When Hyper V server is installed on a system configured to use Smart Load Balance and Failover SLB type teaming you can enable Virtual Machine Queueing VMQ to improve overall network performance VMQ enables delivering packets from an external virtual network directly to virtual machines defined in the SLB team eliminating the need to route these packets and thereby reducing overhead To create a VMQ capable SLB team 1 Create an SLB team If using the Teaming Wizard when you select the SLB team type also select Enable HyperV Mode If using Expert mode enable the property in the Create Team or Edit Team tabs See Configuring Teaming for additional instructions on creating a team 2 Follow these instructions to add the required registry entries in Windows http technet microsoft com en us library gg162696 28v ws 10 29 aspx 3 For each team member on which you want to enable VMQ modify the following registry entry and configure a unique instance
83. team Problem A system containing an 802 3ad team causes a Netlogon service failure in the system event log and prevents it from communicating with the domain controller during boot up Solution Microsoft Knowledge Base Article 326152 http support microsoft com kb 326152 en us indicates that Gigabit Ethernet adapters may experience problems with connectivity to a domain controller due to link fluctuation while the driver initializes and negotiates link with the network infrastructure The link negotiation is further affected when the Gigabit adapters are participating in an 802 3ad team due to the additional negotiation with a switch required for this team type As suggested in the Knowledge Base Article above disabling media sense as described in a separate Knowledge Base Article 938449 http support microsoft com kb 938449 has shown to be a valid workaround when this problem occurs Problem The 802 3ad team member links disconnect and reconnect continuously applies to all operating systems Solution This is a third party issue It is seen only when configuring an 802 3ad team with greater than two members on the server and connecting an HP2524 switch with LACP enabled as passive or active The HP switch shows an LACP channel being brought up successfully with only two team members All other team member links disconnect and reconnect This does not occur with a Cisco Catalyst 6500 Problem A Generic Trunking GEC FEC 802 3ad Draft S
84. that the OS and system are functional and can pass traffic by pinging a remote system s IP etc Windows Server 2012 iSCSI Boot Setup Windows Server 2012 supports booting as well as installing in either the offload or non offload paths Broadcom requires the use of a slipstream DVD with the latest Broadcom drivers injected See Injecting Slipstreaming Broadcom Drivers into Windows Image Files Also refer to the Microsoft knowledge base topic KB974072 at support microsoft com k NOTE The Microsoft procedure injects only the eVBD and NDIS drivers Broadcom recommends that all drivers eVBD VBD BXND OIS FCoE and NetXtreme NDIS be injected The following procedure prepares the image for installation and booting in either the offload or non offload path 1 Remove any local hard drives on the system to be booted the remote system Load the latest Broadcom MBA and iSCSI boot images into the NVRAM of the adapter 3 Configure the BIOS on the remote system to have the Broadcom MBA as the first bootable device and the CDROM as the second device 4 Configure the iSCSI target to allow a connection from the remote device Ensure that the target has sufficient disk space to hold the new O S installation 5 Boot up the remote system When the Preboot Execution Environment PXE banner displays press Ctrl S to enter the PXE menu 6 Atthe PXE menu set Boot Protocol to iSCSI Enter the iSCSI target parameters 8 Set HBA
85. that the bootcode and the internal uxdiag driver loads unloads correctly C8 DMA Engine Verifies the functionality of the DMA engine block by performing numerous DMA read and write operations to various system and internal memory locations and byte boundaries with varying lengths from 1 byte to over 4 KB crossing the physical page boundary and different data patterns incremental fixed and random CRC checks are performed to ensure data integrity The DMA write test also verifies that DMA writes do not corrupt the neighboring host memory C9 VPD Exercises the Vital Product Data VPD interface using PCI configuration cycles and requires a proper bootcode to be programmed into the non volatile memory If no VPD data is present i e the VPD NVM area is all Os the test first initializes the VPD data area with non zero data before starting the test and restores the original data after the test completes C11 FIO Events Verifies that the event bits in the CPU s Fast IO FIO interface are triggering correctly when a particular chip events occur such as a VPD request initiated by the host an expansion ROM request initiated by the host a timer event generated internally toggling any GPIO bits or accessing NVM Group D Ethernet Traffic Tests D1 MAC Loopback Enables MAC loopback mode in the adapter and transmits 5000 Layer 2 packets of various sizes As the packets are received back by
86. the first or last octet To configure LiveLink From the Teams menu select Edit Team Click Expert Mode to configure LiveLink using the Teaming Wizard see Using the Broadcom Teaming Wizard In the Manage Teams window click the Edit Team tab Select Enable LiveLink The LiveLink Configuration options appear below Te qw YS It is recommended to accept the default values for Probe interval the number of seconds between each retransmission of a link packet to the probe target and Probe maximum retries the number of consecutively missed responses from a probe target before a failover is triggered To specify different values click the desired probe interval in the Probe interval Seconds list and click the desired maximum number of probe retries in the Probe maximum retries list 6 Set the Probe VLAN ID to correspond with the VLAN where the probe target s resides This will apply the appropriate VLAN tag to the link packet based on the shared configuration of the attached switch port s KL NOTE Each LiveLink enabled team can only communicate with Probe Targets on a single VLAN Also VLAN ID 0 is equivalent to an untagged network 7 Select Probe Target 1 and type the target IP address for one or all probe targets r4 NOTE Only the first probe target is required You can specify up to 3 additional probe targets to serve as backups by assigning IP addresses to the other probe targets 8 Select one of the listed team membe
87. the importance of the interconnect link The diagrams show the secondary team member sending the ICMP echo requests yellow arrows while the primary team member receives the respective ICMP echo replies blue arrows This illustrates a key characteristic of the teaming software The load balancing algorithms do not synchronize how frames are load balanced when sent or received In other words frames for a given conversation can go out and be received on different interfaces in the team This is true for all uu Broadcom Corporation Page 38 General Network Considerations Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 types of teaming supported by Broadcom Therefore an interconnect link must be provided between the switches that connect to ports in the same team In the configuration without the interconnect an ICMP Request from Blue to Gray goes out port 82 83 destined for Gray port 5E CA but the Top Switch has no way to send it there because it cannot go along the 5E C9 port on Gray A similar scenario occurs when Gray attempts to ping Blue An ICMP Request goes out on 5E C9 destined for Blue 82 82 but cannot get there Top Switch does not have an entry for 82 82 in its CAM table because there is no interconnect between the two switches Pings however flow between Red and Blue and between Red and Gray Furthermore a failover event would cause additional loss of connectivity Consider a cable disconnect on the Top Swi
88. the parameter type The available tabs are Information Configuration Diagnostics and Statistics Because the BACS interface is context sensitive only the parameters that apply to the selected object can be viewed or configured in the Context View pane a Broadcom Corporation Page 234 BACS Interface Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 MENU BAR The following appear on the menu bar but because the menu items are context sensitive not all items will be available at all times File menu e Team Save As Saves the current team configurations to a file e Team Restore Restores any saved team configuration from a file Action menu e Remove Host Removes the selected host e Refresh Host Refreshes the selected host View menu e Explorer View Displays hides the Explorer View pane e Tool Bar Displays hides the tool bar e Status Bar Displays hides the status bar e Broadcom Logo Displays hides the Broadcom Logo on BACS to optimize the maximum viewable space Tools menu e Options Used for configuring BACS preferences Teams Windows only e Create Teams Creates new teams with either the Teaming Wizard or in Advanced mode e Manage Teams Manages existing teams with either the Teaming Wizard or in Advanced mode ISCSI menu e Discovery Wizard Locates targets and helps to configure the HBA e Manage Targets Wizard Manages targets e Manage iSNS Servers Manages Internet Storage N
89. the team IP Address in the sender physical and protocol address This G ARP is unicast with the MAC and IP Address of a client machine in the target physical and protocol address respectively This causes the target client to update its ARP cache with a new MAC address map to the team IP address G ARPs are not broadcast because this would cause all clients to send their traffic to the same port As a result the benefits achieved through client load balancing would be eliminated and could cause out of order frame delivery This receive load balancing scheme works as long as all clients and the teamed system are on the same subnet or broadcast domain When the clients and the system are on different subnets and incoming traffic has to traverse a router the received traffic destined for the system is not load balanced The physical adapter that the intermediate driver has selected to carry the IP flow carries all of the traffic When the router sends a frame to the team IP address it broadcasts an ARP request if not in the ARP cache The server software stack generates an ARP reply with the team MAC address but the intermediate driver modifies the ARP reply and sends it over a particular physical adapter establishing the flow for that session The reason is that ARP is not a routable protocol It does not have an IP header and therefore is not sent to the router or default gateway ARP is only a local subnet protocol In addition since the G ARP is
90. through BRCM NetworkAdapter and BRCM ExtraCapacityGroup classes BRCM NetworkAdapter class provides network adapter information pertaining to a group of adapters including Broadcom and other vendors controllers BRCM ExtraCapacityGroup class provides team configuration for the Broadcom Advanced Server Program Current implementation will provide team information and information of physical network adapters in the team Broadcom Advanced Server Program provides events through event logs Users can use the Event Viewer provided by Windows server platforms or use CIM to inspect or monitor these events Broadcom CIM provider will also provide event information through the CIM generic event model These events are InstanceCreationEvent InstanceDeletionEvent and InstanceModificationEvent and are defined by CIM CIM requires the client application to register the events from the client application using queries as examples shown below in order to receive events properly SELECT FROM InstanceModificationEvent where TargetInstance ISA BRCM NetworkAdapter SELECT FROM InstanceModificationEvent where TargetInstance ISA BRCM ExtraCapacityGroup SELECT FROM _InstanceCreationEvent where TargetInstance ISA BRCM NetworkAdapter SELECT FROM J InstanceDeletionEvent where TargetInstance ISA BRCM NetworkAdapter SELECT FROM InstanceCreationEvent where TargetInstance ISA BRCM ActsAsSpare SELECT FROM _InstanceDeletionEv
91. to the DHCP client For iSCSI boot Broadcom adapters support the following DHCP configurations e DHCP Option 17 Root Path e DHCP Option 43 Vendor Specific Information DHCP Option 17 Root Path Option 17 is used to pass the iSCSI target information to the iSCSI client The format of the root path as defined in IETC RFC 4173 is iscsi lt servername gt lt protocols lt port gt lt LUN gt lt targetname gt The parameters are defined below Table 2 DHCP Option 17 Parameter Definition Parameter Definition isosis A literal string ME Broadcom Corporation Page 84 iSCSI Boot Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Table 2 DHCP Option 17 Parameter Definition Parameter Definition lt servername gt The IP address or FQDN of the iSCSI target eM Separator lt protocol gt The IP protocol used to access the iSCSI target Currently only TCP is supported so the protocol is 6 lt port gt The port number associated with the protocol The standard port number for iSCSI is 3260 lt LUN gt The Logical Unit Number to use on the iSCSI target The value of the LUN must be represented in hexadecimal format A LUN with an ID OF 64 would have to be configured as 40 within the option 17 parameter on the DHCP server lt targetname gt The target name in either IQN or EUI format refer to RFC 3720 for details on both IQN and EUI formats An example IQN name w
92. to the same port in the team When a port is selected to carry all the frames of a given socket the unique MAC address of the physical adapter is included in the frame and not the team MAC address This is required to comply with the IEEE 802 3 standard If two adapters transmit using the same MAC address then a duplicate MAC address situation would occur that the switch could not handle KL Receive load balancing is achieved through an intermediate driver by sending gratuitous ARPs on a client by client basis using the unicast address of each client as the destination address of the ARP request also known as a directed ARP This is considered client load balancing and not traffic load balancing When the intermediate driver detects a significant load imbalance between the physical adapters in an SLB team it will generate G ARPs in an effort to redistribute incoming frames The intermediate driver BASP does not answer ARP requests only the software protocol stack provides the required ARP Reply It is important to understand that receive load balancing is a function of the number of clients that are connecting to the system through the team interface NOTE IPv6 addressed traffic will not be load balanced by SLB because ARP is not a feature of IPv6 SLB receive load balancing attempts to load balance incoming traffic for client machines across physical ports in the team It uses a modified gratuitous ARP to advertise a different MAC address for
93. with clients or the application layer above the database layer Figure 8 Clustering With Teaming Across Two Switches T 71 aptop computer L1 T m Desktop Workstation GE Switch eee CER MIC Team O Fibre Channel Switches External Storage MM EE Broadcom Corporation Page 48 Application Considerations Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 TEAMING AND NETWORK BACKUP e Load Balancing and Failover e Fault Tolerance When you perform network backups in a nonteamed environment overall throughput on a backup server adapter can be easily impacted due to excessive traffic and adapter overloading Depending on the number of backup servers data streams and tape drive speed backup traffic can easily consume a high percentage of the network link bandwidth thus impacting production data and tape backup performance Network backups usually consist of a dedicated backup server running with tape backup software such as NetBackup Galaxy or Backup Exec Attached to the backup server is either a direct SCSI tape backup unit or a tape library connected through a fiber channel storage area network SAN Systems that are backed up over the network are typically called clients or remote servers and usually have a tape backup software agent installed Figure 9 shows a typical 1 Gbps nonteamed network environment with tape backup implementation Figure 9 Network Backup without
94. with the PIC option config no threads fPIC This installs openssl and the include files to usr local ssl Set the OPENSSL HOME path to usr local ssl and continue with the OpenPegasus installation Set the Environment Variable Set the environment variables for building OpenPegasus as follows Environment Variable Description PEGASUS ROOT The location of the Pegasus source tree PEGASUS HOME The location for the built executable repository e g PEGASUS HOME bin PEGASUS HOMEB lib PEGAUS HOME repository and PEGASUS HOME mof subdirectories PATH PATH PEGASUS_HOME bin PEGASUS_ENABLE_CMPI_PROVIDER_MANAGER True PEGASUS CIM SCHEMA CIM222 PEGASUS PLATFORM For Linux 32 bit systems LINUX IX86 GNU For Linux 64 bit systems LINUX X86 64 GNU PEGASUS HAS SSL Optional Set to true for HTTPS support PEGASUS ENABLE PROTOCOL WSMAN Optional Set to true for WSMAN protocol support Additional Settings The PEGASUS HOME variable must be set up in the shell environment and PEGASUS HOME bin needs to be appended to the PATH environment Examples e export PEGASUS PLATFORM LINUX X86 64 GNU e export PEGASUS CIM SCHEMA CIM222 e export PEGASUS ENABLE CMPI PROVIDER MANAGER true e export PEGASUS ROOT share pegasus 2 10 src e export PEGASUS HOME pegasus e export PATH PATH PEGASUS_HOME bin For SSL Support add the following environment variable e export PEGASUS HAS SSL true
95. 0 GB fer Booting Boot Loader Type GRUB Lecation dairmapperi 3560060160993026000 Sachong SUSE Lr Enterproe Server 11 5P2 dafauit Fadsafa SUSE Lux Enterprise Server 11 992 User Guide March 2014 Chan Lip Add On Products Release Motes Me add on product selected for installation Hardee Contigua 12 Select the Boot Loader Installation tab and then select Boot Loader Installation Details make sure you have one boot loader entry here Delete all redundant entries Ee L Boot Loader Device Map SUSE Linux Enterprise Preparation Diak Orah b inetallation Surnmary Pertorm bectalltion Configuration Check Installation Horiname SA Puen Center Qnline Lhpdate 13 Click OK to proceed and complete installation uu Broadcom Corporation Page 210 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 RHELG6 Installation 1 Boot from the installation medium 2 For RHEL6 3 an updated Anaconda image is required for FCoE BFS That updated image is provided by Red Hat at the following URL http rvykydal fedorapeople org updates 823086 fcoe img 3 For RHEL6 3 on the installation splash screen press Tab and add the options dd updates URL TO ANACONDA UPDATE IMAGE to the boot command line Please refer to the RedHat Installation Guide Section 28 1 3 http docs redhat com docs en US Red Hat Enterprise Linux 6 html Installation Guide ap a
96. 1 TXP Scratchpad B2 TPAT Scratchpad B3 RXP Scratchpad B4 COM Scratchpad B5 CP Scratchpad B6 MCP Scratchpad B7 TAS Header Buffer B8 TAS Payload Buffer B9 RBUF via GRC B10 RBUF via Indirect Access B11 RBUF Cluster List B12 TSCH List B13 CSCH List B14 RV2P Scratchpads B15 TBDC Memory B16 RBDC Memory B17 CTX Page Table B18 CTX Memory The Group B tests verify all memory blocks of the Broadcom NetXtreme II adapter by writing various data patterns 0x55aa55aa 0xaa55aa55 walking zeroes walking ones address etc to each memory location reading back the data and then comparing it to the value written The fixed data patterns are used to ensure that no memory bit is stuck high or low while the walking zeroes ones and address tests are used to ensure that memory writes do not corrupt adjacent memory locations E Page 310 Diagnostic Test Descriptions Broadcom Corporation Document INGSRVT710 CDUM100 R User Guide March 2014 NetXtreme Il Table 3 Diagnostic Tests Cont Test Number Name Description Group C Block Tests C1 CPU Logic and DMA Interface Verifies the basic logic functionality of all the on chip CPUs It also exercises the DMA interface exposed to those CPUs The internal CPU tries to initiate DMA activities both read and write to system memory and then compares the values to confirm that the DMA operation completed successfully C2 RBUF Allocation
97. 100 R User Guide March 2014 APPLICATION CONSIDERATIONS e Teaming and Clustering e Teaming and Network Backup TEAMING AND CLUSTERING e Microsoft Cluster Software e High Performance Computing Cluster Oracle Microsoft Cluster Software NetXtreme Il In each cluster node it is strongly recommended that customers install at least two network adapters on board adapters are acceptable These interfaces serve two purposes One adapter is used exclusively for intra cluster heartbeat communications This is referred to as the private adapter and usually resides on a separate private subnetwork The other adapter is used for client communications and is referred to as the public adapter Multiple adapters may be used for each of these purposes private intracluster communications and public external client communications All Broadcom teaming modes are supported with Microsoft Cluster Software for the public adapter only Private network adapter teaming is not supported Microsoft indicates that the use of teaming on the private interconnect of a server cluster is not supported because of delays that could possibly occur in the transmission and receipt of heartbeat packets between the nodes For best results when you want redundancy for the private interconnect disable teaming and use the available ports to form a second private interconnect This achieves the same end result and provides dual robust communication paths for the n
98. 11 Repeat steps 8 through 10 for all initiator ports 12 Confirm all FCoE visible disks are visible under Multipath Devices and or Other SAN Devices E Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 215 NetXtreme II User Guide March 2014 Fiir wel the aris werd iis 8S biel Ire Geen en ono iri we ak ey es youd bine Do gubomabccaly mous 1p your vysberm beha Enik Devices Amase RUD Multipath Oeir Osher SAM Dees Search Pitter Ay hh Oey Deor Ur w berger Tap iy MI price rerio T El1eES32402 86 111 4 Seon d ge X ee Lee ee ell 51200 m Drar Opt m Ard Any nicer Eat I devices 1O0Td0O Fil selected oot o 7 dence 152405 MB toc Tips Selecting a drive pn Eh s screen does nof neces saniy mean it wit bs wiped Ey the 7 THILO oea ADS monk That posae ace yes meg fees nv ases veu del ior Meert bene Ing rocityira ya Bebo ea Pie m EL a ne 13 Click Next to proceed 14 Click Next and complete installation as usual Upon completion of installation the system will reboot 15 Once booted ensure all boot path devices are set to start on boot Set onboot yes under each network interface config file in etc sysconfig network scripts 16 On RHEL 6 4 only edit boot grub menu lIst a Delete all fcoe lt INTERFACE gt nodcb parameters from the kernel vmlinuz line There should be as many fcoe parameters as there were FCoE interfaces configured during installation b Insert fcoe edd nodc
99. 14 Functionality and Features Broadcom NetXtreme II Network Adapter User Guide e Functional Description Features FUNCTIONAL DESCRIPTION The Broadcom NetXtreme Il adapter is a new class of Gigabit Ethernet GbE and 10 GbE converged network interface controller C NIC that can simultaneously perform accelerated data networking and storage networking on a standard Ethernet network The C NIC offers acceleration for popular protocols used in the data center such as e TCP Offload Engine TOE for accelerating TCP over 1 GbE 2 5 GbE and 10 GbE e Internet Small Computer Systems Interface iSCSI offload for accelerating network storage access featuring centralized boot functionality iSCSI boot e Fibre Channel over Ethernet FCoE offload and acceleration for fibre channel block storage k NOTE Not all adapters support each listed protocol Refer to the specific product data sheet for protocol support NOTE Separate licences are required for all offloading technologies Enterprise networks that use multiple protocols and multiple network fabrics benefit from the C NICs ability to combine data communications storage and clustering over a single Ethernet fabric by boosting server CPU processing performance and memory utilization while alleviating I O bottlenecks The Broadcom NetXtreme ll adapter includes a 10 100 1000 Mbps or 10 Gbps Ethernet MAC with both half duplex and full duplex capability and a 10 100 1000 Mbps
100. 14 KL NOTE Ensure that Integrated Services which is a component of Hyper V is installed in the guest operating system child partition for full functionality Es e Broadcom Corporation Document INGSRVT710 CDUM100 R Microsoft Virtualization with Hyper V Page 329 NetXtreme II User Guide March 2014 SINGLE NETWORK ADAPTER Windows Server 2008 When configuring a NetXtreme II network adapter on a Hyper V system be aware of the following e An adapter that is to be bound to a virtual network should not be configured for VLAN tagging through the driver s advanced properties Instead Hyper V should manage VLAN tagging exclusively e Since Hyper V does not support Jumbo Frames it is recommended that this feature not be used or connectivity issues may occur with the child partition e The Locally Administered Address LAA set by Hyper V takes precedence over the address set in the adapter s advanced properties e A TOE enabled network adapter that is bound to a Hyper V virtual network will report TOE as an offload capability in BACS however TOE will not work This is a limitation of Hyper V Hyper V does not support TOE e n an IPv6 network a team that supports CO and or LSO and is bound to a Hyper V virtual network will report CO and LSO as an offload capability in BACS however CO and LSO will not work This is a limitation of Hyper V Hyper V does not support CO and LSO in an IPv6 network Windows Server 2008 R2 and 2012 W
101. 193 NetXtreme II User Guide March 2014 PSS Broadcom Corporation Page 194 Configuring for NIC Partitioning Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Fibre Channel Over Ethernet Broadcom NetXtreme II Network Adapter User Guide e Overview FCoE Boot from SAN e Configuring FCoE OVERVIEW In today s data center multiple networks including network attached storage NAS management IPC and storage are used to achieve the desired performance and versatility In addition to iSCSI for storage solutions Fibre Channel over Ethernet FCoE can now be used with capable Broadcom C NICs FCoE is a standard that allows Fibre Channel protocol to be transferred over Ethernet by preserving existing Fibre Channel infrastructures and capital investments by classifying received FCoE and FCoE Initialization Protocol FIP frames The following FCoE features are supported e Receiver classification of FCoE and FIP frames FIP is the FCoE Initialization Protocol used to establish and maintain connections e Receiver CRC offload e Transmitter CRC offload e Dedicated queue set for Fibre Channel traffic e Data Center Bridging DCB provides lossless behavior with Priority Flow Control PFC e DCB allocates a share of link bandwidth to FCoE traffic with Enhanced Transmission Selection ETS DCB supports storage management computing and communications fabrics onto a single physical fabric that is simpler to dep
102. 27 the driver will allocate on both receive and transmit sides one queue per CPU In any case the number of allocated queues will be limited by number of queues supported by hardware The multi mode optional parameter can also be used to enable SAFC Service Aware Flow Control by differentiating the traffic to up to 3 CoS Class of Service in the hardware according to the VLAN PHI value or according to the IP DSCP value least 3 bits num queues The optional parameter num queues may be used to set the number of queues when multi mode is set to 1 and interrupt mode is MSI X If interrupt mode is different than MSI X see int mode the number of queues will be set to 1 discarding the value of this parameter pri map The optional parameter pri map is used to map the VLAN PHI value or the IP DSCP value to a different or same CoS in the hardware This 32 bit parameter is evaluated by the driver as an 8 value of 4 bits each Each nibble sets the desired hardware queue number for that priority For example set pri map to 0x11110000 to map priority O to 3 to CoS 0 and map priority 4 to 7 to CoS 1 qs per cos Broadcom Corporation Document INGSRVT710 CDUM100 R Setting Values for Optional Properties Page 153 NetXtreme II User Guide March 2014 The optional parameter qs_per_cos is used to specify how many queues will share the same CoS This parameter is evaluated by the driver up to 3 values of 8 bits each Each byte sets t
103. 4 TCP protocols are processed in software L4 Layer 4 Used to describe network traffic that is heavily offloaded to the hardware where much of the Layer 3 IP and Layer 4 TCP processing is done in the hardware to improve performance LACP Link Aggregation Control Protocol Link Aggregation 802 3ad Switch dependent load balancing and failover type of team with LACP in which the intermediate driver manages outgoing traffic and the switch manages incoming traffic LOM LAN on Motherboard MAC media access control NDIS Network Driver Interface Specification NLB Network Load Balancing Microsoft PXE Preboot Execution Environment RAID redundant array of inexpensive disks Smart Load Balancing and Failover Switch independent failover type of team in which the primary team member handles all incoming and outgoing traffic while the standby team member is idle until a failover event for example loss of link occurs The intermediate driver BASP manages incoming outgoing traffic Smart Load Balancing SLB Switch independent load balancing and failover type of team in which the intermediate driver manages outgoing incoming traffic TCP Transmission Control Protocol E MM Broadcom Corporation Page 14 Executive Summary Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Table 1 Glossary Cont Item Definition TOE TCP Offload Engine This is
104. 59 GB Primary 4 Continue with the rest of the installation After installation is complete and booted to SAN execute the provided Windows driver installer and reboot Installation is now complete K NOTE The boot initiator must be configured to point at the desired installation LUN and the boot initiator must have successfully logged and determined the readiness of the LUN prior to starting installation If these requirements are not met the devices will still show up in the drive list above but upon proceeding with installation Read Write errors will occur WINDOWS SERVER 2012 FCoE BOOT INSTALLATION For Windows Server 2012 Boot from SAN installation Broadcom requires the use of a slipstream DVD or iso image with the latest Broadcom drivers injected See Injecting Slipstreaming Broadcom Drivers into Windows Image Files in the iSCSI chapter Also refer to the Microsoft Knowledge Base topic KB974072 at support microsoft com which is helpful for Windows Server 2012 FCoE Boot from SAN also Microsoft s procedure injects only the eVBD and NDIS drivers Broadcom strongly recommends that all drivers especially those bolded are injected e eVBD e VBD e BXND e OIS e FCoE e NetXtreme NDIS Once you have a properly slipstreamed iso you can use that iso for normal Windows Server 2012 installation without needing USB provided drivers ce CC Broadcom Corporation Page 204 FCoE B
105. 8 CE Direttiva CEM e a rettifiche da parte dell Unione Europea Una Dichiarazione di conformita seconde gli standard e le direttive precedenti stata emessa e registrata presso Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA Unione Europea Classe B Il presente dispositivo Broadcom classificato per lusco nel tipico ambiente domestico di Classe B Unione Europea Classe A AVVERTENZA Questo prodotto classificato come Classe A In un ambiente domestico il presente prodotto potrebbe provocare interferenze di radiofequezza nel qual caso potrebbe essere richiesto all utente di adottare misure adeguate LATVISKS Sis izstradapums attilst direktivam 200693 EK Durektra par zemspnreguma iekartam Latvian 2004 108 EK Direkt va par elektromagnetsko saderibu un to laboyammem Eiopas Savienibas letvaros Atbilsttbas deklar cija kas ir saska ar iepriekimunetajam direktivam un standartiem ir sastadita un trek glab ta firma Broadcom Corporation 190 Mathilda Place Sunnyvale Caltforma 04086 USA Eiropas Savieniba klase B 51 firmas Broadcom ra ot 1erice ir atz ta par derigu darbam B klasei atbilsto os m jas apst klos Eiropas Savieniba A klase BR DIN JUMS Sis A klases izstr d jums Izmantojot o izstr d jumu m jas apst klos tas var radit radiotraucejumus aj zadguma letot jam var bit nepiecie ams veikt atbilsto us pasakumus Lithuanian Buvo mastatyta kad i1 produktas atitnka direktyv
106. AC media access control address that is assigned to the adapter by the manufacturer The physical address is never all Os Permanent MAC Address The unique hardware address assigned to the network adapter iSCSI MAC Address If an iSCSI network adapter is loaded onto the system this parameter will display the iSCSI MAC address IPv4 DHCP The IP address is from a DHCP server if the value is Enable IP Address The network address associated with the adapter If the IP address is all Os the associated driver has not been bound with Internet Protocol IP IPv6 DHCP The IP address is from a DHCP server if the value is Enable IPv6 IP Address The IPv6 network address associated with the adapter a Broadcom Corporation Document INGSRVT710 CDUM100 R Managing Ethernet Controller Port Page 243 NetXtreme II User Guide March 2014 IPv6 Scope Id Since local use addresses can be reused the Scope ID for link local addresses specifies the link where the destination is located The Scope ID for site local addresses specifies the site where the destination is located The Scope ID is relative to the sending host IPv6 Flow Info The non zero Flow Info is used to classify traffic flows If Flow Info equals zero then the packets are not a part of any flow Default Gateway The default gateway value is the network address of the gateway that will be used by the management firmware for packets destined for hosts external to the local netwo
107. AN is a suitable choice If Linux is the only OS installed on the servers then CIM XML is an option If the network includes only Windows servers and clients WMI is an option WMI is very simple to configure but is supported only on the Windows OS INSTALLATION TASKS BACS installation includes installing the provider component on the managed host and the client software on the management station The installation process differs based on the combination of operating systems installed on the client and managed host and on the selected communication protocol The following sections list each task in the overall process and provide links to the specific steps for each task as found in Detailed Procedures WS MAN The following steps install the WS MAN protocol for communication between the client and managed host server WS MAN is supported on both Windows and Linux clients and servers Windows Server On Windows servers configure the WinRM service as follows Install the WinRM Software Component on Server Perform Basic Configuration on the Server Perform User Configuration on the Server Perform HTTP Configuration on the Server Perform HTTPS Configuration on the Server to use HTTPS rather than HTTP a Generate a Self Signed Certificate for Windows Linux Server do od 9 I I b Install the Self Signed Certificate on Windows Server 6 Configure WinRM HTTPS SSL on the Server Perform Additional Server Configuration if require
108. Boot Mode to Enabled or Disabled Note This parameter cannot be changed when the adapter is in Multi Function mode 9 Save the settings and reboot the system The remote system should connect to the iSCSI target and then boot from the DVDROM device 10 Boot from DVD and begin installation 11 Answer all the installation questions appropriately specify the Operating System you want to install accept the license terms etc When the Where do you want to install Windows window appears the target drive should be visible This is a drive connected via the iSCSI boot protocol located in the remote iSCSI target ME Broadcom Corporation Page 88 iSCSI Boot Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 12 Select Next to proceed with Windows Server 2012 installation A few minutes after the Windows Server 2012 DVD installation process starts a system reboot will occur After the reboot the Windows Server 2012 installation routine should resume and complete the installation 13 Following another system restart check and verify that the remote system is able to boot to the desktop 14 After Windows Server 2012 boots to the OS Broadcom recommends running the driver installer to complete the Broadcom drivers and application installation Linux iSCSI Boot Setup Linux iSCSI boot is supported on Red Hat Enterprise Linux 5 5 and later and SUSE Linux Enterprise Server 11 SP1 and later in both the offload and
109. Broadcom NetXtreme II User Diagnostics they are checked for errors Packets are returned through the MAC receive path and never reach the PHY The adapter should not be connected to a network eS Document INGSRVT710 CDUM100 R Broadcom Corporation Diagnostic Test Descriptions Page 311 NetXtreme Il User Guide March 2014 Table 3 Diagnostic Tests Cont Test Description Number Name D2 PHY Loopback Enables PHY loopback mode in the adapter and transmits 5000 Layer 2 packets of various sizes As the packets are received back by Broadcom NetXtreme II User Diagnostics they are checked for errors Packets are returned through the PHY receive path and never reach the wire The adapter should not be connected to a network D4 LSO Verifies the functionality of the adapter s Large Send Offload LSO support by enabling MAC loopback mode and transmitting large TCP packets As the packets are received back by Broadcom NetXtreme II User Diagnostics they are checked for proper segmentation according to the selected MSS size and any other errors The adapter should not be connected to a network D5 EMAC Statistics Verifies that the basic statistics information maintained by the chip is correct by enabling MAC loopback mode and sending Layer 2 packets of various sizes The adapter should not be connected to a network D6 RPC Verifies the Receive Path Catch up RPC block by sending packets to different transmit chain
110. CATION PROTOCOLS A communication protocol enables exchanging information between provider and the client software These are proprietary or open source implementations of the Web Based Enterprise Management WBEM and Common Information Model CIM standards from the Distributed Management Task Force DMTF Network administrators can choose the best option based on the prevailing standard on their network The following table shows the available options based on the operating systems installed on the managed host and the client If the client uses And the managed host uses BACS can use these communication protocols Windows Windows WMI WS MAN WinRM Windows Linux CIM XML OpenPegasus WS MAN OpenPegasus Linux Windows WS MAN WinRM Linux Linux CIM XML OpenPegasus WS MAN OpenPegasus Broadcom Corporation Document INGSRVT710 CDUM100 Rinstalling Management Applications Broadcom NetXtreme I9 Network Adapter User Guide Page NetXtreme II User Guide March 2014 If the client uses And the managed host uses BACS can use these communication protocols e WMI Windows Management Instrumentation e WS MAN Web Service Management WinRM is a Windows based implementation and OpenPegasus is an open source implementation of the that operates on Linux e CIM XML An XML based version of OpenPegasus If your network includes a mix of Windows and Linux clients accessing Windows and Linux servers then WS M
111. CD uxdiag mba 0 disable 1 enable c devnum where devnum is the specific device s number 0 1 2 to be programmed CONFIGURING THE MBA DRIVER This section pertains to configuring the MBA driver on add in NIC models of the Broadcom network adapter For configuring the MBA driver on LOM models of the Broadcom network adapter check your system documentation 1 Insert the installation CD in the CD ROM drive and boot up in DOS mode ra NOTE You can use Broadcom s Comprehensive Configuration Management CCM utility or the uEFI to configure the MBA driver one adapter at a time as described below Or you can use the MS DOS based User Diagnostics application to simultaneously configure the MBA driver for multiple adapters Using CCM 1 Restart your system 2 Press CTRL s within 4 seconds after you are prompted to do so A list of adapters displays a Select the adapter to configure and press Enter The Main Menu displays b Select MBA Configuration to display the MBA Configuration menu uu Broadcom Corporation Page 76 Setting Up MBA in a Client Environment Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Use the UP ARROW and DOWN ARROW keys to move to the Boot Protocol menu item Then use the RIGHT ARROW or LEFT ARROW key to select the boot protocol of choice if other boot protocols besides Preboot Execution Environment PXE are available If available other boot protocols include Remote Pro
112. COM proceed 4BHEOADCON Commit changes amp Commit changes to system and Exit the wizard Save changes and continue to manage more beans i Applving the changes will temporarily interrupt the network connection The process may take several minutes and the ad connection will resume afterwards Cancel lt Back Preview ta ee Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 277 NetXtreme Il K H H BACS WINT Teams E fii Team 1 E BASP Virtual Adapters aa VLAN 1 Sb Primary Adapters sm 0007 Broadcom MetXtreme Gigabit Ethernet Sl Standby Adapters So 0014 Broadcom MetXtreme Gigabit Ethernet 2 Unassigned Adapters sw 0016 Broadcom Netktreme Gigabit Ethernet 4 sm 0015 Broadcom Netktreme Gigabit Ethernet 3 User Guide March 2014 NOTE At any point in the Broadcom Teaming Wizard procedure click Preview to get a visual representation of what the team will look like before committing any changes Mu Page 278 Broadcom Corporation Configuring Teaming INGSRVT710 CDUM 100 R User Guide NetXtreme ll March 2014 21 Click the team name in the Team Management pane to view the team s properties in the Information tab transfer and receive data in the Statistics tab and team customization options in the Configurations tab Broadcom Advanced Control Suite 4 File View Action Filter Context Tools Teams iSCSI H
113. Class A digital apparatus complies with Canadian ICES 003 Notice The Industry Canada regulations provide that changes or modifications not expressly approved by Broadcom could void your authority to operate this equipment e Broadcom Corporation Document INGSRVT710 CDUM100 R Canadian Regulatory Information Canada Only Page 301 NetXtreme II User Guide March 2014 INDUSTRY CANADA CLASSE B Broadcom NetXtreme II Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA Cet appareil num rique de la classe B est conforme a la norme canadienne ICES 003 Avis Dans le cadre des r glementations d Industry Canada vos droits d utilisation de cet equipement peuvent tre annul s si des changements ou modifications non express ment approuv s par Broadcom y sont apport s INDUSTRY CANADA CLASSE A Broadcom NetXtreme II Gigabit Ethernet Controller Broadcom NetXtreme II 10 Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA Cet appareil num rique de classe A est conforme la norme canadienne ICES 003 Avis Dans le cadre des r glementations d Industry Canada vos droits d utilisation de cet equipement peuvent tre annul s si des changements ou modifications non express ment approuv s par Broadcom y sont apport s E MM Broadcom Corporation Page 302 Canadian Regulatory Information Canada Only Document INGSRVT710 CDUM100 R
114. CoE boot click Change Settings and ensure FCoE Enable and AUTO_VLAN are set to yes and DCB required is set to no Se f Change FCoE Settings SUSE Linux Enterprise Preparation T aid LL ELS 4 pu Conhqur abon of Interface em 2014 b Disk Activation LI a yr irm A nay ic Time fone installation See Sei IE HL PC of E i installation 5urnrrr y yar aa Perform TS RIT Tii Tonfiguar atien DEB Required L hec k in r allat ion ram Hostname 7 For each interface to be enabled for FCoE boot click on Create FCoE VLAN Interface The VLAN interface creation dialog will launch Click Yes to confirm This will trigger automatic FIP VLAN discovery If successful the VLAN will be displayed under FCoE VLAN Interface If no VLAN is visible check your connectivity and switch configuration 8 Once complete with configuration of all interface click OK to proceed E Broadcom Corporation Page 208 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 RE m Fibre Channel over Ethernet Configuration SUSE Linux o ameaces adi Enterprise aaa Be hieni Harra Preparation rz NE TUUEITT acria readcorm Ethernet controller 1 ani llrasdeorm Ethernet controller xu So er Dresden Ethernet controller mot xv alabla meret ppl 82572 Gigab Ethernet Controler Copper not avalable ty zen Fray zig T irt TE JUD Installation r T IE 8 1 iria bn Dnaztal
115. Delay Time 0 e Use TCP Timestamp Enabled e Target as First HDD Disabled e LUN Busy Retry Count 0 e IP Version IPv6 For IPv6 non offload e HBA Boot Mode Disabled Note This parameter cannot be changed when the adapter is in Multi Function mode 2 Select ESC to return to the Main menu From the Main menu select Initiator Parameters From the Initiator Parameters screen type values for the following e IP Address unspecified IPv4 and IPv6 addresses should be 0 0 0 0 and respectively e Subnet Mask Prefix e Default Gateway e Primary DNS e Secondary DNS e iSCSI Name corresponds to the iSCSI initiator name to be used by the client system KL NOTE Carefully enter the IP address There is no error checking performed against the IP address to check for duplicates or incorrect segment network assignment 5 Select ESC to return to the Main menu From the Main menu select 1st Target Parameters From the 1st Target Parameters screen enable Connect to connect to the iSCSI target Type values for the following using the values used when configuring the iSCSI target e IP Address e TCP Port e Boot LUN e iSCSI Name 8 Select ESC to return to the Main menu 9 Select ESC and select Exit and Save Configuration 10 Select F4 to save your MBA configuration 11 If necessary return to the iSCSI Boot Configuration Utility to configure a second iSCSI target MEM Broadcom Corporation Page 82 iSCSI B
116. E Link speed cannot be configured for 1 Gbps when NPAR is enabled NOTE On dual port adapters e The 1G ports do not support NPAR e On 10G ports only two functions per port are supported Benefits of a partitioned 10G NIC include e Reduced cabling and ports when used to replace many 1G NICs e Server segmentation with separate subnets VLANSs e High server availability with NIC failover and NIC link bandwidth aggregation e Server I O virtualization with a virtual OS and monolithic OS support e Changes to the OS is not required e SLB type teaming is supported SUPPORTED OPERATING SYSTEMS FOR NIC PARTITIONING The Broadcom NetXtreme II 10 Gigabit Ethernet adapters support NIC partitioning on the following operating systems e Windows Server 2008 family e Windows Server 2012 family e Linux 64 bit RHEL 5 5 and later SLES11 SP1 and later e VMware ESX ESXi 4 1 ESXi 5 0 and ESXi 5 1 ce CC Broadcom Corporation Page 190 NIC Partitioning Broadcom NetXtreme I9 Network Adapter User Guide Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 k NOTE 32 bit Linux operating systems have a limited amount of memory space available for Kernel data structures Therefore it is recommended that only 64 bit Linux be used when configuring NPAR CONFIGURING FOR NIC PARTITIONING When NIC partitioning is enabled on an adapter by default only TCP Offload Engine TOE offloads are configured on each physical fun
117. E offload e Receiver classification of FCoE and FIP frames FIP is the FCoE Initialization Protocol used to establish and maintain connections e Receiver CRC offload e Transmitter CRC offload e Dedicated queue set for Fibre Channel traffic e Data Center Bridging DCB provides lossless behavior with Priority Flow Control PFC e DCB allocates a share of link bandwidth to FCoE traffic with Enhanced Transmission Selection ETS K NOTES FCoE is not available for all Broadcom network adapters POWER MANAGEMENT The adapter speed setting will link at the configured speed for WOL when the system is powered down r4 NOTES e For specific systems see your system documentation for WOL support e WOL is supported in Broadcom NetXtreme Il BCM5708 devices with silicon revisions of B2 or later For more information see Limitations ADAPTIVE INTERRUPT FREQUENCY The adapter driver intelligently adjusts host interrupt frequency based on traffic conditions to increase overall application throughput When traffic is light the adapter driver interrupts the host for each received packet minimizing latency When traffic is heavy the adapter issues one host interrupt for multiple back to back incoming packets preserving host CPU cycles ASIC wiTH EMBEDDED RISC PROCESSOR The core control for Broadcom NetXtreme ll adapters resides in a tightly integrated high performance ASIC The ASIC includes a RISC processor This functionality pr
118. Explorer View pane and then select the Information tab to view host level information INFORMATION TAB HOST INFORMATION Host Name Displays the name of the host OS Version Info Displays the operating system including the version Platform Displays the hardware architecture platform for example 32 bit or 64 bit INFORMATION TAB ISCSI INITIATOR The iSCSI Initiator section of the Information tab is available if iSCSI is enabled on the host Name Displays the iSCSI initiator name in IQN format Portal List Displays all iSCSI portal IP addresses configured on the selected host To configure the host NOTE Some information may not be available for all Broadcom network adapters Select the host in the Explorer View pane and then select the Configuration tab to configure host level parameters CONFIGURATION TAB SYSTEM MANAGEMENT Chimney Offload State Enable or disable chimney offload at the host level rather than at the device level and then click Apply Configuration Tab iSCSI Initiator Name The current IQN name is displayed Click the IQN name to modify the host s iSCSI initiator name and then click Apply p Broadcom Corporation Document INGSRVT710 CDUM100 R Managing the Host Page 239 NetXtreme II User Guide March 2014 MANAGING THE NETWORK ADAPTER The installed network adapters appear one level below the host in the hierarchical tree in the Explorer View pane At the adapter level you can view inform
119. Express 1 0a x4 Gigabit Ethernet e PCI Express Gen2 x8 10 Gigabit Ethernet e Full fast path TCP offload e Zero copy capable hardware e Other performance features e TCP IR UDP checksum e TCP segmentation e Adaptive interrupts e Receive Side Scaling RSS e Manageability e Broadcom Advanced Control Suite diagnostic and configuration software suite e Supports PXE 2 0 specification Linux Red Hat PXE Server SUSE Linux Enterprise Server Windows Server 2008 Windows Server 2008 R2 Windows Server 2012 Intel APITEST DOS UNDI e Wake on LAN support e Universal Management Port UMP support e Statistics for SNMP MIB Il Ethernet like MIB and Ethernet MIB IEEE Std 802 3z Clause 30 e SMBus controller e ACPI 1 1a compliant multiple power modes e PMI support e Advanced network features e Jumbo frames up to 9 KB The OS and the link partner must support jumbo frames e Virtual LANs e IEEE Std 802 3ad Teaming e Smart Load Balancing Teaming e Smart Load Balancing TOE Teaming with the correct configuration e Flow Control IEEE Std 802 3x e Livelink supported in both the 32 bit and 64 bit Windows operating systems uc Broadcom Corporation Page 4 Features Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 e Logical Link Control IEEE Std 802 2 e Layer 2 Priority Encoding IEEE Std 802 1p e High speed on chip RISC processor e Up to 4 classes of service CoS e Up to 4 send rings and receive rings
120. Follow the on screen instructions UsiNG SILENT INSTALLATION k NOTES e All commands are case sensitive e User must Run as Administrator for Vista when using msiexec for silent install uninstall s e For detailed instructions and information about unattended installs refer to the silent txt file in the DrvlInst folder To perform a silent install from within the installer source folder Type the following setup s v qn or msiexec i BDrv5706 msi qn To perform a silent upgrade from within the installer source folder Type the following setup s v qn To perform a silent uninstall from within the installer source folder Type the following msiexec x BDrv5706 msi qn To perform a silent uninstall from any folder msiexec x FODA8A3F 1457 419E 96F4 235DD3EF41E1 qn KL NOTE The hexidecimal number above may differ from your current installer Check the Key name corresponding pS Broadcom Corporation Document INGSRVT710 CDUM100 R Installing the Driver Software Page 181 NetXtreme II User Guide March 2014 with the Broadcom Advanced Control Suite 3 BACS application in HKLM Software Mictrosoft Windows CurrentVersion Uninstall for the correct hexidecimal number To perform a silent reinstall of the same installer Type the following setup s v qn REINSTALL ALL KL NOTE The REINSTALL switch should only be used if the same installer is already installed on the system
121. For OpenPegasus compiled from source PEGASUS HOME must be defined when you start CIM server Otherwise CIM server will not load the repository properly Consider setting PEGASUS HOME in the bash profile file Configure OpenPegasus on the Server Use the cimconfig command to configure OpenPegasus as shown in the following table Command Description cimconfig 1 List all valid property names cimconfig 1 c List all valid property names and its value cimconfig g lt property name gt Query a particular property cimconfig s lt property name gt lt value gt p Seta particular property cimconfig help Find out more about the command CIM server must be started before running cimconfig and must be restarted for configuration changes to take effect S Broadcom Corporation Document INGSRVT710 CDUM100 R Detailed Procedures Page 125 NetXtreme II User Guide March 2014 Enable Authentication The following OpenPegasus properties have to be set as described in this section Otherwise the Broadcom CIM Provider will not work properly Ensure the following are set before launching BACS and connecting to the provider Start CIM server if it is not already started Then set the following e cimconfig s enableAuthentication true p e cimconfig s enableNamespaceAuthorization false p e cimconfig s httpAuthType Basic p e cimconfig s passwordFilePath cimserver passwd p e cimconfig s forceProviderPr
122. G FILE Source LSB init functions etc rc status C e Broadcom Corporation Page 90 iSCSI Boot Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 H This service is run right after booting So all targets activated during mkinitrd run should not be removed when the open iscsi service is stopped H iscsi load iscsiuio TRANSPORT ISCSIADM m session 2 dev null grep bnx2i Ir STRANSPORT J 3 then echo n Launch iscsiuio startproc SISCSTUIO Lr iscsi mark root nodes SISCSIADM m session 2 gt dev null while read t num i target do ip i STARTUP ISCSIADM m node p ip T target 2 dev null grep node conn 0 startup cut d 3 gt if STARTUP a STARTUP t onboot then SISCSIADM m node p Sip T target o update n node conn 0 startup v onboot IX done Reset status of this service rc reset We only need to start this for root on iSCSI if grep q iscsi tcp proc modules then if grep q bnx2i proc modules then ro failed 6 rc exit fi fi case 1 in start echo n Starting iSCSI initiator for the root device iscsi load iscsiuio startproc SDAEMON SARGS rc status v iscsi mark root nodes stop restart reload rc failed O0 status echo n Checking for iSCSI initiator service if checkproc SDAEMON then ro Status y else rc failed 3 ro stat s ev EE Broadcom Corporation Document INGSRVT710
123. HE et i 44 MIHI Lae Fo EE a HHE Z2 LL Oru Dae ALERTE LN au ELE SE RETI E y 1 l l LE A pv l 1 mtu l 4 Tii er e L l PIgnus regeserued Device List gt Jj FPE w AE us TOOL C HO FL DO gF a Os AD PS DIN Mara DP tore AUTE M b zs BLE arogl Us 1 Ab HI a Jda St MDA DIU OUI l Lt InNIM r i In 01 00 01 BCH5709C 00 26 B9 32 94 42 MBA BIOS Built in 02 00 00 BCHM5709C 00 76 09 392 94 44 MBA BIOS Built in 02 00 01 BCHM5789C 00 26 09 32 94 46 ABA BIOS Built in 07 00 00 BCM57712 080 10 18 6F D5 80C MBA ub 4 19 CCHM u6 4 21 07 00 01 gt BCH5S771i2Z 00 i0 1 6F 15 0E Mf vb 4 19 CCH v6 4 Z1 Select Device to Conf igure Wa rr IEnteri Enter iTi 1 Mext Entry LESUI Quit Menu 3 Ensure DCB DCBX is enabled on the device FCoE boot is only supported on DCBX capable configurations As such DCB DCBX must be enabled and the directly attached link peer must also be DCBX capable with parameters that allow for full DCBX synchronization O Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 197 User Guide March 2014 NetXtreme Il Lomprehensive Lonriguration Management vo F i Copyright C 2000 2011 Broadcom Corporation All rights reserved Device Hardware Configuration Multi Funct ion Mode i3 DCE Protocol Enabled Configure NIC Hardware Mode Read Only i Enter Space Scroll V
124. IB vmware esx drivers net bnx2x version x86 64 vib NETWORKING SUPPORT This section describes the bnx2x VMware ESX driver for the Broadcom NetXtreme Il PCIE 10 GbE network adapters DRIVERS DOWNLOAD INSTALL AND UPDATE DRIVERS To download install or update the VMware ESX ESXi driver for NetXtreme Il 10 GbE network adapters see http www vmware com support DRIVER PARAMETERS Several optional parameters can be supplied as a command line argument to the vmkload mod command These parameters can also be set via the esxcfg module command See the man page for more information int mode a Broadcom Corporation Document INGSRVT710 CDUM100 R VMware Driver Software Broadcom NetXtreme II9 Network Adapter User Guide Page 171 NetXtreme II User Guide March 2014 The optional parameter int_mode is used to force using an interrupt mode other than MSI X By default the driver will try to enable MSI X if it is supported by the kernel If MSI X is not attainable then the driver will try to enable MSI if it is supported by the kernel If MSI is not attainable then the driver will use the legacy INTx mode Set the int mode parameter to 1 as shown below to force using the legacy INTx mode on all NetXtreme II network adapters in the system vmkload mod bnx2x int mode 1 Set the int mode parameter to 2 as shown below to force using MSI mode on all NetXtreme II network adapters in the System vmkload mod bnx2x int mode 2 disabl
125. IE C MIC iS CSI Adapter on PCI bus 3 i Microsoft SCSI Initiator Target Portal CAC Checksum Data digest Header digest CHAF logon information EHAE helps ensure date securi by providing authentication between a target and an initiator tiing ta establish a connector To ee it speci the same target EHAR secret that was coniaured on the target hor thie mitrata Username iorinitiator d380 win2k3 farget secret erar mutual authentication To use mutual EHAR pec an initiator secret on the Initiator settings page and configure that secret on the target 13 Click OK to close the Microsoft Initiator 14 To format your iSCSI partition use Disk Manager NOTES e Teaming does not support iSCSI adapters e Teaming does not support NDIS adapters that are in the boot path e Teaming supports NDIS adapters that are not in the iSCSI boot path but only for the SLB team type VENE FEM Broadcom Corporation Page 106 iSCSI Offload in Windows Server Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 ISCSI OFFLOAD FAQS Q How do I assign an IP address for iSCSI offload A Use the Configurations tab in Broadcom Advanced Control Suite BACS Q What tools should be used to create the connection to the target A Use Microsoft iSCSI Software Initiator version 2 08 or later Q How do know that the connection is offloaded A Use Microsoft iSCSI Software Initiator From a command line type iscsicli
126. II User Guide March 2014 e Internet Small Computer Systems Interface iSCSI offload for accelerating network storage access featuring centralized boot functionality iSCSI boot You can also view the number of unlicensed resources and unallocated resources TOE and iSCSI can only be configured on certain adapters and require a license key License keys are preprogrammed in the hardware To view resource reservations 1 Click the name of the Broadcom NetXtreme ll system device in the Explorer View pane 2 From the Resource Reservations section select the property you want to set 3 Click Apply to confirm the changes to all properties Click Reset to return the properties to their original values Configuring the IP Address for iSCSI Offload For iSCSI booted adapters the Configurations tab is not available and you will not be able to perform this procedure To set the IP address of the iSCSI HBA for iSCSI offload The iSCSI Management section of the Configurations tab allows you to set the IP address of the iSCSI HBA when using iSCSI protocol to offload network processing from the CPU to the Broadcom network adapter 1 Click the name of the Broadcom NetXtreme ll iSCSI device in the SCSI controller section of the Explorer View pane 2 Depending on the protocol you will be using for IPv4 DHCP or IPv6 DHCP select Enable not available for iSCSI booted adapters to set the IP address dynamically using a DHCP server Or select Disable t
127. INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 NDIS2 Driver Software Broadcom NetXtreme II9 Network Adapter User Guide e Overview e Preinstallation Requirements e Installing the NDIS2 Driver Software for Use on MS DOS Platforms e Using Keywords for the Drivers OVERVIEW Two drivers are discussed in this section e BXND20X Broadcom NetXtreme II Gigabit Ethernet driver e BNX2EV Broadcom NetXtreme II 10 Gigabit Ethernet driver The examples used in this section refer to the BKND20X driver but also apply to the BNX2EV driver PREINSTALLATION REQUIREMENTS Before you can successfully install the NDIS2 driver software the Broadcom network adapter must be physically installed in the server Networking software that is appropriate to the operating system such as Microsoft LAN Manager 2 2 for MS DOS must already be running on your server INSTALLING THE NDIS2 DRIVER SOFTWARE FOR USE ON MS DOS PLATFORMS The NDIS2 driver software can be run from an MS DOS startup disk using Microsoft Network Client 3 0 or from the hard disk using Microsoft LAN Manager 2 2 CREATING A STARTUP DISK TO RUN MICROSOFT NETWORK CLIENT To perform this installation you must have the following items e Windows NT Server 4 0 CD ROM e A blank MS DOS system disk 3 5 high density floppy disk e Access to the Broadcom NDIS2 driver file BXND20X dos This file is located on the driver source media s O Broadcom Corporation Document
128. If the physical adapter supports PXE then it can be used as a PXE client whether or not it is part of a virtual adapter when the operating system loads PXE servers may operate over a virtual adapter Question Can WOL work over a virtual adapter team Answer Wake on LAN functionality operates in an environment before the operating system is loaded WOL occurs when the system is off or in standby so no team is configured Question What is the maximum number of ports that can be teamed together Answer Up to eight ports can be assigned to a team Question What is the maximum number of teams that can be configured on the same server Answer Up to 16teams can be configured on the same server Question Why does my team loose connectivity for the first 30 to 50 seconds after the Primary adapter is restored fallback Answer Because Spanning Tree Protocol is bringing the port from blocking to forwarding You must enable Port Fast or Edge Port on the switch ports connected to the team or use LiveLink to account for the STP delay Question Can connect a team across multiple switches Answer Smart Load Balancing can be used with multiple switches because each physical adapter in the system uses a unique Ethernet MAC address Link Aggregation and Generic Trunking cannot operate across switches because they require all physical adapters to share the same Ethernet MAC address Question How do upgrade the intermediate driver BASP Answ
129. If you delete a team any VLANs configured for that team are also deleted Configuring LiveLink for a Smart Load Balancing and Failover and SLB Auto Fallback Disable Team LiveLink is a feature of BASP that is available for the Smart Load Balancing SLB and SLB Auto Fallback Disable type of teaming The purpose of LiveLink is to detect link loss beyond the switch and to route traffic only through team members that have a live link p Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 283 NetXtreme II User Guide March 2014 Read the following notes before you attempt to configure LiveLink NOTES e Before you begin configuring LiveLink review the description of LiveLink Also verify that each probe target you plan to specify is available and working If the IP address of the probe target changes for any reason LiveLink must be reconfigured If the MAC address of the probe target changes for any reason you must restart the team see the Troubleshooting topic in the NetXtreme Il Network Adapter User Guide e Aprobe target must be on the same subnet as the team have a valid not a broadcast multicast or unchaste statically assigned IP address and be highly available always on e To ensure network connectivity to the probe target ping the probe target from the team e You can specify up to four probe targets e The IP address assigned to either a probe target or team member cannot have a zero as
130. Interface UNDI and provides a network interface in the Linux remotely booted client environment e Intel APITEST The Broadcom PXE driver passes all API compliance test suites e MS DOS UNDI The MS DOS Universal Network Driver Interface UNDI seamlessly binds with the Broadcom UNDI to provide a network adapter driver interface specification NDIS2 interface to the upper layer protocol stack This allows computers to connect to network resources in an MS DOS environment e Windows Deployment Service WDS To extend functionalities beyond basic network connectivity when loading an operating system through WDS see Using the NetXtreme II Monolithic Driver e Automated Deployment Service ADS To extend functionalities beyond basic network connectivity when loading an operating system through ADS see Using the NetXtreme Il Monolithic Driver pS Broadcom Corporation Document INGSRVT710 CDUM100 RBroadcom Boot Agent Driver Software Broadcom NetXtreme I9 Network Adapter User Guide NetXtreme II User Guide March 2014 SETTING UP MBA IN A CLIENT ENVIRONMENT Setting up MBA in a client environment involves the following steps 1 Enabling the MBA driver 2 Configuring the MBA driver 3 Setting up the BIOS for the boot order ENABLING THE MBA DRIVER To enable or disable the MBA driver 1 Insert the installation CD in the CD ROM drive and boot up in DOS mode K 2 Type NOTE The uxdiag exe file is on the installation
131. M100 R User Guide NetXtreme Il March 2014 INSTALLATION OF THE ADD IN NIC The following instructions apply to installing the Broadcom NetXtreme II adapter add in NIC in most systems Refer to the manuals that were supplied with your system for details about performing these tasks on your particular system INSTALLING THE ADD IN NIC 1 Review Safety Precautions and Preinstallation Checklist Before you install the adapter ensure that the system power is OFF the power cord is unplugged from the power outlet and that you are following proper electrical grounding procedures 2 Open the system case and select the slot based on the adapter which may be of type PCle 1 0a x1 PCle 1 0a x4 PCle Gen2 x8 or other appropriate slot A lesser width adapter can be seated into a greater width slot x1 in a x4 but a greater width adapter cannot be seated into a lesser width slot x4 in a x1 If you do not know how to identify a PCI Express slot refer to your system documentation Remove the blank cover plate from the slot that you selected 4 Align the adapter connector edge with the PCI Express connector slot in the system 5 Applying even pressure at both corners of the card push the adapter card into the slot until it is firmly seated When the adapter is properly seated the adapter port connectors are aligned with the slot opening and the adapter faceplate is flush against the system chassis AN CAUTION Do not use excessive force w
132. MAC addresses and port numbers by learning the source MAC address that received on a particular port The table is used to forward frames to a specific port rather than flooding the frame to all ports The typical maximum aging time of entries in the table is 5 minutes Only when a host has been silent for 5 minutes would its entry be removed from the table It is sometimes beneficial to reduce the aging time One example is when a forwarding link goes to blocking and a different link goes from blocking to forwarding This change could take up to 50 seconds At the end of the STP re calculation a new path would be available for communications between end stations However because the forwarding table would still have entries based on the old topology communications may not be reestablished until after 5 minutes when the affected ports entries are removed from the table Traffic would then be flooded to all ports and re learned In this case it is beneficial to reduce the aging time This is the purpose of a topology change notice TCN BPDU The TCN is sent from the affected bridge switch to the root bridge switch As soon as a bridge switch detects a topology change a link going down or a port going to forwarding it sends a TCN to the root bridge via its root port The root bridge then advertises a BPDU with a Topology Change to the entire network This causes every bridge to reduce the MAC table aging time to 15 seconds for a specified amount of time This
133. MS DOS Platforms Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 lastdrive z INSTALLING THE DOS NDIS2 DRIVER SOFTWARE ON THE HARD DISK To install the DOS NDIS2 Driver Software on the hard disk 1 2 Verify that the system has Microsoft LAN Manager 2 2 installed with a protocol such as NetBEUI configured Create a folder on your hard disk to store the NDIS 2 01 driver Example C LANMAN Copy the BXND20X dos file to this folder Edit the Config sys file by adding the following lines DEVICE C LANMAN PROTMAN DOS DEVICE C LANMAN BXND20X DOS DEVICE C LANMAN NETBEUI DOS Edit the Autoexec bat file by adding the following lines C LANMAN NETBIND EXE C LANMAN NET START WORKSTATION C LANMAN NET USE drive letter server name resource name Edit the Protocol ini file located in CALANMAN to configure the driver to bind with NetBEUI or any other protocols Example PROTOCOL MANAGER DriverName PROTMANS NETBEUI XIF DriverName netbeuis BINDINGS BXND20X BXND2 0X DriverName BXND20XS Restart the computer to complete the installation K NOTE The driver loads during system configuration and displays the Broadcom banner controller name MAC address IRQ number detected line speed and the controller BusNum and DevNum If the driver fails to load an initialization fail message is displayed M Broadcom Corporation Document INGSRVT710 CDUM100 R Installing the NDIS2 Dr
134. MTU 1500 Cancel z Back Mexk Preview rj 8 If you want to designate one of the adapters as a standby member optional select Use the following member as a standby member then choose the standby member from the list of adapters 9 The Auto Fallback Disable mode feature allows the team to continue using the standby member rather than switching back to the primary member if the primary member comes back online To enable this feature select Enable Auto Fallback Disable mode Click Next O Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 269 NetXtreme II User Guide March 2014 VE Broadcom Teaming Wizard Creating Modifying a Team Designating a Standby Member A Do you want to designate an available adapter as a standby member BROADCOM Y g p Y i n Optionally select if you want a standby member for the team 3 Do not configure a standby member Use the following member as a standby member 0014 Broadcom Netktreme Gigabit Ethernet 2 T Enable Auto Fallback Disable mode z Back Mexk Preview ta Mu Broadcom Corporation Page 270 Configuring Teaming Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 10 If you want to configure LiveLink select Yes otherwise select No then click Next TH Broadcom Teaming Wizard Creating Madifying a Team Configuring LiveLink fl Do you want to configure LiveLink BROADCOM g L a
135. March 2014 Este producto se ha fabricado de conformidad con la Directiva para bajo voltaje 2006 95 EC Low Voltage Directive la Directiva para compatibilidad electromagn tica 2004 108 EC EMC Directive y las enmendas de la Union Europea Se ha realizado una Declaraci n de comformudad de acuerdo con las directivas y estandares anteriores y esta archivada en Broadcom Corporation 190 Mathilda Place Sunnyvale California 24086 USA Union Europea Claze B Este dispositive Broadcom esta clasificado para ser utilizado en un entomo domestico convencional de Clase B Union Europea Clase A ADVERTENCIA ste es un producto de Clase A En un entomo domestico este producto puede causar interferencia de radio frecuencia en cuyo caso el uzuario debe tomar las medidas oportunas SVENSK Denna produkt verensst mmer med EU direktivet 2006 95 EC l g p mningsdirektivet Swedish 2004 108 EC EMC direktivet och andra andrmegar enligt den Europeiska unicnen En F rsakran om verensst mmelse i enlighet med de f regaende direktiven och standardema har framst llts och finns registrerad hos Broadcom Corporation 190 Mathilda Place Sunnyvale Califorma 94086 USA Europet ka unionen klass B Den har Broadeom enheten r klassificerad f r anvandning 1 vanlig klass B bostadsmulya Europeiska unionen klass A VARNING Detta ar en klass A produkt I en bostadzmiljo kan denna produkt orsaka stomimear 1 radiofrekvenser s att anv ndaren
136. Mode K NOTE If you want to always use Expert Mode to create a team click Default to Expert Mode on next start O Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 279 NetXtreme II User Guide March 2014 3 Click the Create Team tab L7 Manage Teams Property Team Name Team Type Smart Load Balancing TM and Failover E Load Balance Members ES Manage Members 0007 Broadcom MetXtreme Gigabit Ethernet 0014 Broadcom MetXtreme Gigabit Ethernet 2 0015 Broadcom Metxtreme Gigabit Ethernet 3 0016 Broadcom NetXtreme Gigabit Ethernet 4 Standby Member not configured gt Team Offload Capabilities LSO CO RSS Team MTU 1500 VLAN Configuration Enable LrveLink 7 No Team Name The team name cannot exceed 39 characters cannot begin with spaces and cannot contain any special characters K 4 Click the Team Name field to enter a team name NOTE The Create Team tab appears only if there are teamable adapters available 5 Click the Team Type field to select a team type 6 Click Hyper V Mode if you want to enable Windows virtualization services See Microsoft Virtualization with Hyper V in the Troubleshooting topic in the NetXtreme II Network Adapter User Guide for more information about this feature 7 Assign any available adapter or adapters to the team by moving the adapter from the Available Adapters list to the Load Balance Members list There must be at leas
137. NGSRVT710 CDUM100 R Installing the NDIS2 Driver Software for Use on MS DOS Platforms Page 137 NetXtreme II User Guide March 2014 2 Edit A Net System ini a Change netcard to netcard BXND20X dos b Check for references to CANET and change C NET to A NET if necessary Example System ini file network Ssizworkbuf 1498 filesharing no printsharing no autologon yes computername MYPC lanroot A NET username USER1 workgroup WORKGROUP reconnect yes dospophotkey N Imlogon 0 logondomain preferredredir basic autostart basic maxconnections 8 network drivers netcard BXND20X dos transport ndishlp sys netbeui devdirzA NNET LoadRMDrivers yes Copy BXND20X dos to A Net Create the appropriate Autoexec bat file in drive A for the chosen protocol as shown below For TCP IP path a net net net initialize net netbind com net umb com net tcptsr exe net tinyrfc exe net nmtsr exe net emsbfr exe net net start basic net use z NNSERVERNAMENSHARENAME For IPX SET PATH A NNET A NNETMnet initialize A NET nwlink A NET NET START BASIC net use z SERVERNAME SHARENAME For NetBEUI SET PATH A NET A NET NET START BASIC net use z SERVERNAME SHARENAME oo ooo ov ow 5 Create a Config sys file on the startup disk in drive A as shown below files 30 device a net ifshlp sys ee EIE Broadcom Corporation Page 138 Installing the NDIS2 Driver Software for Use on
138. NIC 3 3V Current Draw A NIC Power W Idle no link 0 60 0 28 8 12 Low power mode 0 50 0 35 7 16 10GBASE T link 1 23 1 79 20 67 10GBASE T traffic 1 24 1 95 21 32 a Power measured in watts W is a direct calculation of total current draw A multiplied by voltage V The maximum power consumption for the adapter will not exceed 30W uc Broadcom Corporation Page 290 NIC Physical Characteristics Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 WAKE ON LAN POWER REQUIREMENTS The tables below show the Wake On LAN power requirements for 1G adapters Table 10 BCM5708C Wake On LAN Power Requirements Nominal Conditions 100 Mbit Link 10 Mbit Link NIC 3 3V Current mA NIC Power W NIC 3 3V Current mA NIC Power W 236 0 78 150 0 5 Table 11 BCM5709C and BCM5716 Wake On LAN Power Requirements Nominal Conditions 100 Mbit Link 10 Mbit Link NIC 3 3V Current mA NIC Power W NIC 3 3V Current mA NIC Power W 0 0 87 0 0 85 ENVIRONMENTAL SPECIFICATIONS Table 12 BCM5708 Environmental Specifications Condition Operating Specification Storage Specification Temperature 0 C to 55 C 32 F to 131 F 40 C to 85 C 40 F to 185 F Relative humidity 5 to 85 noncondensing 596 to 9596 noncondensing 40 C 16 hour dwells at extremes 10 C hour Altitude Up to 10 000 ft Up to 35 000 ft Shock 10g 1 2 sine wave 11 ms 60g 1 2 sine wave 11
139. O Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Boot Page 83 NetXtreme II User Guide March 2014 Enabling CHAP Authentication Ensure that CHAP authentication is enabled on the target To enable CHAP authentication 1 From the General Parameters screen set CHAP Authentication to Enabled 2 From the Initiator Parameters screen type values for the following e CHAP ID up to 128 bytes e CHAP Secret if authentication is required and must be 12 characters in length or longer 3 Select ESC to return to the Main menu From the Main menu select 1st Target Parameters From the 1st Target Parameters screen type values for the following using the values used when configuring the iSCSI target e CHAP ID optional if two way CHAP e CHAP Secret optional if two way CHAP and must be 12 characters in length or longer 6 Select ESC to return to the Main menu 7 Select ESC and select Exit and Save Configuration Configuring the DHCP Server to Support iSCSI Boot The DHCP server is an optional component and it is only necessary if you will be doing a dynamic iSCSI Boot configuration setup see Dynamic iSCSI Boot Configuration Configuring the DHCP server to support iSCSI boot is different for IPv4 and IPv6 e DHCP iSCSI Boot Configurations for IPv4 e DHCP iSCSI Boot Configuration for IPv6 DHCP iSCSI Boot Configurations for IPv4 The DHCP protocol includes a number of options that provide configuration information
140. OU ARE AUTHORIZED TO LEGALLY BIND SUCH ORGANIZATION YOU CONCLUDE THE AGREEMENT ON BEHALF OF SUCH ORGANIZATION AMD YOU PERSONALLY AGREE NOT TO ACT CONTRARY OR ALLOH OTHERS TO ACT CONTRARY TO THIS AGREEMENT IN THE Use the arrow keys to scroll the EULA text 4 Select the boot LUN for installation and press Enter to continue uu Broadcom Corporation Page 218 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme ll March 2014 Esc Cancel Fl Details F5 Refresh Enter Continue 5 Select the desired installation method Esc Cancel Enter OK 6 Select the keyboard layout Esc Cancel F3 Back EnterJ Continue 7 Enter a password MM Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 219 NetXtreme Il User Guide March 2014 Esc Cancel F9 Back Enter Continue 8 Press F11 to confirm the install Esc Cancel F3 Back FILLY Install 9 Press Enter to reboot after installation Enter Reboot 10 On 57800 and 57810 boards the management network is not vmnicO After booting open the GUI console and display the configure management network network adapters screen to select the NIC to be used as the management network device Eu Broadcom Corporation Page 220 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Network Adapters Select the adapters for this host s default management network con
141. Other teaming modes Generic Trunking or Link Aggregation can still be used on TOE capable devices but if those other modes are enabled the TOE feature is disabled Since the TOE offloaded state is stored in only one member of a team it might not be intuitive as to how BASP can support failover on TOE teams When a TOE connection has been offloaded to a given adapter and if that network interface fails in some way that is it loses its network link due to a cable disconnection then BASP will detect the error and force an upload of the offloaded TCP state for each previously offloaded TCP connection on that adapter to the host Once all of the previously offloaded state has been uploaded BASP will rebalance the recently uploaded TCP connections and offload those connections evenly to the remaining members of the team Basically if there is a failure on a TOE enabled adapter any TCP connections that had been offloaded to that adapter are migrated to the remaining nonfailed members in the team For Broadcom NetXtreme ll adapters there are no specific setup requirements in order for TCP Offload Engine TOE to work with BASP Once the individual adapters are configured to enable TOE they can be added to a team and the offload is transparent to BASP For information on configuring TOE see Viewing Resource Reservations Limitations of Teaming with Offloading e TOE is enabled for a team only when all of the members support and are configured for TOE
142. P IP LiveLink functionality is supported in both 32 bit and 64 bit Windows operating systems For similar functionality in Linux operating systems see the Channel Bonding information in your Red Hat documentation uc Broadcom Corporation Page 32 Teaming Mechanisms Document INGSRVT710 CDUM100 R User Guide March 2014 NetXtreme Il ATTRIBUTES OF THE FEATURES ASSOCIATED WITH EACH TYPE OF TEAM The attributes of the features associated with each type of team are summarized in Table 5 Table 5 Attributes Feature Attribute Smart Load Balancing User interface Broadcom Advanced Control Suite BACS Number of teams Maximum 16 Number of adapters per team Maximum 8 Hot replace Yes Hot add Yes Hot remove Yes Link speed support Different speeds Frame protocol IP Incoming packet management BASP Outgoing packet management BASP LiveLink support Yes Failover event Loss of link Failover time lt 500 ms Fallback time 1 5 s approximate MAC address Different Multivendor teaming Yes Generic Trunking User interface Broadcom Advanced Control Suite BACS Number of teams Maximum 16 Number of adapters per team Maximum 8 Hot replace Yes Hot add Yes Hot remove Yes Link speed support Different speeds Frame protocol All Incoming packet management Switch Outgoing packet manageme
143. RIPTION PANE The Description pane provides information configuration instructions and options for the selected parameter in the Context View pane E S Broadcom Corporation Page 236 BACS Interface Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 CONFIGURING PREFERENCES IN WINDOWS To enable or disable the BACS tray icon in Windows On Windows systems BACS places an icon in the Windows taskbar when the program is installed Use the Options window to turn this icon on or off 1 From the Tools menu select Options 2 Select or clear Enable BACSTray the option is enabled by default 3 Click OK Setting the teaming mode in Windows 1 From the Tools menu select Options 2 Select Expert Mode if you do not need the assistance of the teaming wizard to create teams otherwise select Wizard Mode 3 Click OK Setting the Explorer View refresh time in Windows 1 From the Tools menu select Options 2 Select Auto to set the Explorer View refresh time to 5 seconds Otherwise select Custom and select a time in seconds 3 Click OK MM Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Preferences in Windows Page 237 NetXtreme II User Guide March 2014 CONNECTING TO A HOST You can add one or more Windows or Linux hosts to manage from BACS To add a local host 1 From the Action menu click Add Host 2 For both Windows and Linux hosts do not change the default settings T
144. ROVISIONING STORAGE ACCESS IN THE SAN Storage access consists of zone provisioning and storage selective LUN presentation each of which is commonly provisioned per initiator WWPN Two main paths are available for approaching storage access e Pre Provisioning e CTRL R Method Pre Provisioning With pre provisioning note the initiator WWPN and manually modify fabric zoning and storage selective LUN presentation to allow the appropriate access for the initiator The initiator WWPN can be seen at the bottom of the screen in the FCoE boot target configuration window The initiator WWPN can also be directly inferred from the FIP MAC address associated with the interface s planned for boot Two MAC addresses are printed on stickers attached to the SFP cage on your adapter The FIP MAC ends in an odd digit The WWPN is 20 00 lt FIP MAC gt For example if the FIP MAC is 00 10 18 11 22 33 then the WWPN will be 20 00 00 10 18 11 22 33 CTRL R Method The CTRL R method allows you to use the boot initiator to bring up the link and login into all available fabrics and targets Using this method you can ensure that the initiator is logged into the fabric target before making provisioning changes and as such can provision without manually typing in WWPNs 1 Configure at least one boot target through CCM as described above 2 Allow the system to attempt to boot through the selected initiator Once the initiator boot starts it will commen
145. S management utility for iSCSI boot via the offload and NDIS paths Virtual LANs Virtual LAN VLAN tagging is not supported for iSCSI boot with the Microsoft iSCSI Software Initiator The dd method of creating an iSCSI boot image In the case when installation directly to a remote iSCSI target is not an option an alternate way to create such an image is to use the dd method With this method you install the image directly to a local hard drive and then create an iSCSI boot image for the subsequent boot 1 Install Linux OS on your local hard drive and ensure that the Open iSCSl initiator is up to date 2 Ensure that all Runlevels of network service are on 3 Ensure that the 2 3 and 5 Runlevels of iSCSI service are on 4 Update iscsiuio You can get the iscsiuio package from the Broadcom CD This step is not needed for SuSE 10 5 Install the linux nx2 package on your Linux system You can get this package from Broadcom CD 6 Install bibt package on you Linux system You can get this package from Broadcom CD 7 Delete all ifcfg eth files 8 Configure one port of the network adapter to connect to iSCSI Target for instructions see Configuring the iSCSI Target 9 Connect to the iSCSI Target 10 Use the DD command to copy from the local hard drive to iSCSI Target 11 When DD is done execute the sync command a couple of times log out and then log in to iSCSI Target again 12 Run the fsck command on all partitions create
146. SCSI connections Defaults TCP out of order feature is ENABLED For example insmod bnx2i ko ooo enable 1 or modprobe bnx2i ooo enable 1 DRIVER DEFAULTS e bnx2 Driver e bnx2x Driver BNX2 DRIVER Speed Autonegotiation with all soeeds advertised Flow Control Autonegotiation with RX and TX advertised MTU 1500 range is 46 9000 RX Ring Size 255 range is 0 4080 RX Jumbo Ring Size 0 range 0 16320 adjusted by the driver based on MTU and RX Ring Size TX Ring Size 255 range is MAX SKB FRAGS 41 255 MAX SKB FHRAGS varies on different kernels and different architectures On a 2 6 kernel for x86 MAX SKB FRAGS is 18 Coalesce RX Microseconds 18 range is 0 1023 Coalesce RX Microseconds IRQ 18 range is 0 1023 Coalesce RX Frames 6 range is 0 255 Coalesce RX Frames IRQ 6 range is 0 255 Coalesce TX Microseconds 80 range is 0 1023 uu Broadcom Corporation Page 156 Driver Defaults Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 Coalesce TX Microseconds IRQ 80 range is 0 1023 Coalesce TX Frames 20 range is 0 255 Coalesce TX Frames IRQ 20 range is 0 255 Coalesce Statistics Microseconds 999936 approximately 1 second range is 0 16776960 in increments of 256 MSI Enabled if supported by the 2 6 kernel and the interrupt test passes TSO Enabled on 2 6 kernels WoL Initial setting based on NVRAM s setting BNX2X DRIVER Speed Autonegotia
147. Self Signed Certificate for Windows Linux Server are completed including copying hostname pfx at the location from where client can access it before you proceed with the following steps Click Start or press the Windows logo key and select Run Enter MMC and click OK Click File and select Add Remove Snap in Click Add Select Certificates and click Add Select Computer account and click Next Click Finish Click Close and then click OK Under Certificates Local Computer right click on Trusted Root Certification Authorities select All Tasks and select Import So IL o9 Oro e YS qe SS 10 Click Next to begin the Certificate Import Wizard 11 Browse to select the pfx file you generated in Generate a Self Signed Certificate for Windows Linux Server Change the selection in the Files of type list to Personal Information Exchange pfxas p12 select the hostname pfx file and click Open 12 Enter the password you assigned to the private key and click Next Configure WinRM HTTPS SSL You can run winrm from a client to retrieve information from the server using WinRM HTTPS connection Use the following steps to test the WinRM HTTPS SSL connection from client MM EE Broadcom Corporation Page 122 Detailed Procedures Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 1 To retrieve the server operating system information enter the following command winrm e wmi root cimv2 Win32 OperatingSystem r http
148. Service RootSDDL 0 NSG BAD P A GA BA A GA 1 5 21 1866529496 2433358402 1775838904 1021 S P AU FA GA WD AU SA GWGX WD p Broadcom Corporation Document INGSRVT710 CDUM100 R Detailed Procedures Page 115 NetXtreme II User Guide March 2014 Perform HTTP Configuration on the Server To use the BACS GUI you must configure the HTTP protocol as follows 1 Click Start or press the Windows logo key and select Run NOTE The default HTTP port is 5985 for WinRM 2 0 Enter gpedit msc to open the local Group Policy editor aa Under Computer Configuration open the Administrative Templates folder and then open the Windows Components folder Select Windows Remote Management WinRM Under Windows Remote Management WinRM select WinRm Client Under WinRM Client double click Trusted Hosts In the TrustedHostsList enter the host names of the clients If all clients are trusted then enter an asterisk only Select WinRM Service E D YS S E Enable Allow Basic Authentication 10 Enable Allow unencrypted traffic 11 Close the Group Policy window 12 From the command prompt run the following command to configure WinRM with default settings winrm qc or winrm quickconfig 13 When the tool displays Make these changes y n enter y 14 Enter one of the following commands to check whether an HTTP listener is created winrm enumerate winrm confg listener Or winrm e winrm config Listener
149. TAHIAPTH EOSTO ce cBxpauazsa E Broadcom Corporation 190 Mathilda Place Sunnyvale Califomia 94085 USA Esponentcren cewa Kiar B losa verpoHcrso Ha Broadcom e xzmacHdunzzpazo ia HiHod3bE3He B THEE Haza3 3a Kaac B AMEA pena Esponentcren cema Koar A BHHMAHHE Tosa e mpomyer or Enac A B xarmmmma cpeza TOH npodyxr Moxe Ta CHIAN Dazro ecTOTEE CMYIIGHHS E KOHTO CIyUaE MOTPSONTemar Mle TpXo03a Da s2exe CLOTEETHHTE Bylo ustanoveno ze tento produkt spliwje m rmcei 2006 95 EC nizkonap tfova sm rmice smerniei 2004 108 EC smermce EMC a dodatky Evropsk ume Prohlazeni o shod amp v souladu s vy e uveden mi zmernicem a normam bylo zpracov no a je ulo eno v archivu spole nosti Broadcom Corporation 190 Mathilda Place Sunnyvale California O4086 USA Evropsk unie t ida B Tote zafizent spole nosti Broadcom je klasifikov no pro pouzitl v obvyklem prostredi domacnosti tida B Evropska unie trida A VAROVANI Toto je produkt tidy A V domacim prostfedi mize tento produkt zp sobovat ru eni radvovych frekvenci a v takovem pripad se od uzivatele vy aduje aby u amp mil odpovidajici opatreni Dette produkt er fundet i overensstemmelse med 2006 95 EC Lavvoltedirektivet 200p 108 ET EMC direktivet og den Europ iske Unions ndrmeer En Owerensstemmelseserklering som er i henhold til forezaende direktiver og standarder er udfort og arkiveret hos Broadcom Corporation 190 Mathilda Place Sunnyvale Californ
150. Table 2 Broadcom NetXtreme Il FCoE Drivers Driver Description bnx2x This driver manages all PCI device resources registers host interface queues etc and also acts as the Layer 2 VMware low level network driver for Broadcom s NetXtreme Il 10G device This driver directly controls the hardware and is responsible for sending and receiving Ethernet packets on behalf of the VMware host networking stack The bnx2x driver also receives and processes device interrupts both on behalf of itself for L2 networking and on behalf of the bnx2fc FCoE protocol and CNIC drivers bnx2fc The Broadcom VMware FCoE driver is a kernel mode driver used to provide a translation layer between the VMware SCSI stack and the Broadcom FCoE firmware hardware In addition the driver interfaces with the networking layer to transmit and receive encapsulated FCoE frames on behalf of open fcoe s libfc lib coe for FIP device discovery SUPPORTED DISTRIBUTIONS The FCoE DCB feature set is supported on VMware ESXi 5 0 and above O E Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Support Page 175 NetXtreme Il User Guide March 2014 ISCSI SUPPORT This following driver is provided to support iSCSI Table 3 Broadcom NetXtreme I iSCSI Driver Driver Description bnx2i The bnx2i driver is Broadcom VMware iSCSI HBA driver Similar to bnx2fc bnx2i is a kernel mode driver used to provide a translation layer between the VMware SCSI stack and the
151. Teaming Tape Backup FC Backup Server 1 Client Server Blue A GE Switch 1 eee ee ee GE Switch 2 A A A Client Server Red Client Server Green Client Server Yellow eM Broadcom Corporation Document INGSRVT710 CDUM100 R Application Considerations Page 49 NetXtreme II User Guide March 2014 Because there are four client servers the backup server can simultaneously stream four backup jobs one per client to a multidrive autoloader Because of the single link between the switch and the backup server however a 4 stream backup can easily saturate the adapter and link If the adapter on the backup server operates at 1 Gbps 125 MB s and each client is able to stream data at 20 MB s during tape backup the throughput between the backup server and switch will be at 80 MB s 20 MB s x 4 which is equivalent to 64 of the network bandwidth Although this is well within the network bandwidth range the 64 constitutes a high percentage especially if other applications share the same link Load Balancing and Failover As the number of backup streams increases the overall throughput increases Each data stream however may not be able to maintain the same performance as a single backup stream of 25 MB s In other words even though a backup server can stream data from a single client at 25 MB s it is not expected that four simultaneously running backup jobs will stream at 100 MB s 25 MB s x 4 streams Although overall throug
152. The exception to this would be when used for the Windows Preinstallation Environment WinPE For WDS this driver is used similarly to any other network adapter driver for supporting network connectivity after the PXE boot to the WDS server When placed in the 1386 or AMD64 directory depending on the version of the operating system being deployed the monolithic driver is called to establish that there is driver support for the NetXtreme Il adapter included in the WDS legacy image For ADS the driver is placed in the PreSystem directory on the server running ADS to establish connectivity with the deployment agent on remote systems with NetXtreme II adapters when booting from PXE While Windows PE 2005 natively supports the VBD architecture it was found that using the minint switch in the startnet cmd file does not The minint switch performs a limited scan of the system bus to identify network devices only and therefore does not support the VBD architecture Since only network connectivity is required in Windows PE the only supported driver is the monolithic driver for the NetXtreme Il adapter in this environment as well Place the bO6nd inf file in the INF directory within the Windows PE image and place the appropriate driver file b06nd51a sys for x64 based builds or bO6nd51 sys for x86 based builds in the driver s directory If Windows PE is deployed as a flat image from a RIS or WDS server you must also place both the bO6nd inf and the app
153. The number of login failures likely caused by the initiator Initiator Instance Statistics The statistics in this area pertain to all sessions Session digest errors The number of sessions with errors due to an invalid payload or header Session connection timeout error The number of sessions that were terminated due to any of the many timeout errors Session format error The number of sessions with errors due to inconsistent fields reserved fields not 0 non existent LUN etc Sessions failed The number of failed sessions Custom Custom statistics Total Offload iSCSI Connections The total number of offloaded iSCSI connections Session Statistics The statistics in this area only pertain to the named session Session Name The name used for the session between the initiator and the target Session Id The identifier used for the session between the initiator and the target Bytes sent The number of bytes sent for the named session Bytes received The number of bytes received for the named session PDU sent The number of iSCSI PDUs sent for the named session PDU received The number of iSCSI PDUs received for the named session Digest errors The number of errors due to an invalid payload or header for the named session Connection Timeout errors The number of connection timeout errors for the named session Format errors The number of errors due to inconsistent fields reserved fields not 0 non existent LUN etc for the
154. UM100 R iSCSI Support Page 179 NetXtreme II User Guide March 2014 Windows Driver Software Broadcom NetXtreme II Network Adapter User Guide e Installing the Driver Software e Removing the Device Drivers e Using the NetXtreme II Monolithic Driver e Inserting the NetXtreme II Monolithic Driver in a WinPE 2 0 or 3 1 Image e Viewing or Changing the Properties of the Adapter e Setting Power Management Options INSTALLING THE DRIVER SOFTWARE K NOTE These instructions are based on the assumption that your Broadcom NetXtreme II adapter was not factory installed If your controller was installed at the factory the driver software has been installed for you When Windows first starts after a hardware device such as a Broadcom NetXtreme ll Adapter has been installed or after the existing device driver has been removed the operating system automatically detects the hardware and prompts you to install the driver software for that device Both a graphical interactive installation mode see Using the Installer and a command line silent mode for unattended installation see Using Silent Installation are available NOTES e Before installing the driver software verify that the Windows operating system has been upgraded to the latest version with the latest service pack applied e Anetwork device driver must be physically installed before the Broadcom NetXtreme II Controller can be used with your Windows operating system Driv
155. URPOSES ONLY e Hub Usage in Teaming Network Configurations e SLB Teams e SLB Team Connected to a Single Hub e Generic and Dynamic Trunking FEC GEC IEEE 802 3ad SLB teaming can be used with 10 100 hubs but it is only recommended for troubleshooting purposes such as connecting a network analyzer in the event that switch port mirroring is not an option Hub Usage in Teaming Network Configurations Although the use of hubs in network topologies is functional in some situations it is important to consider the throughput ramifications when doing so Network hubs have a maximum of 100 Mbps half duplex link speed which severely degrades performance in either a Gigabit or 100 Mbps switched network configuration Hub bandwidth is shared among all connected devices as a result when more devices are connected to the hub the bandwidth available to any single device connected to the hub is reduced in direct proportion to the number of devices connected to the hub It is not recommended to connect team members to hubs only switches should be used to connect to teamed ports An SLB team however can be connected directly to a hub for troubleshooting purposes Other team types can result in a loss of connectivity if specific failures occur and should not be used with hubs SLB Teams SLB teams are the only teaming type not dependant on switch configuration The server intermediate driver handles the load balancing and fault tolerance mechanisms with no
156. User Guide NetXtreme Il March 2014 Broadcom NetXtreme II Network Adapter User Guide Introduction e Functionality and Features e Teaming e Virtual LANs VLANs e Manageability e Installing the Hardware e Installing the Driver Software e Broadcom Boot Agent Driver Software e NDIS2 Driver Software e Linux Driver Software e Solaris Driver Software e VMware Driver Software e Windows Driver Software e Installing Management Applications e iSCSI e Advanced Teaming Concepts e NIC Partitioning e Fibre Channel Over Ethernet e Data Center Bridging e SR IOV e Using Broadcom Advanced Control Suite e User Diagnostics e Firwmware Upgrade Utility e Specifications e Regulatory Information e Troubleshooting Information in this document is subject to change without notice 2013 Broadcom Corporation All rights reserved D a Broadcom Corporation Document INGSRVT710 CDUM100 R Broadcom NetXtreme II9 Network Adapter User Guide Page 1 NetXtreme II User Guide March 2014 This document is protected by copyright and is distributed under licenses restricting its use copying distribution and decompilation No part of this document may be reproduced in any form by any means without prior written authorization of Broadcom Corporation Documentation is provided as is without warranty of any kind either express or implied including any kind of implied or express warranty of non infringement or the implie
157. V ensure that e The adapter hardware supports SR IOV e SR IOV is supported and enabled in the system BIOS To enable SR IOV 1 Enable the feature on the adapter In If using BACS a Select the network adapter in the Explorer View pane Select the Configuration tab and select SR IOV Global Enable b In the SR IOV VFs per PF field configure the number of SRIOV Virtual Functions VFs that the adapter can support per physical function from O to 64 in increments of 8 default 16 c In the SR IOV Max Chains per VF field configure the maximum number of transmit and receive queues such as receive side scaling RSS queues that can be used for each virtual function The maximum is 16 If using CCM a Select the SR lOV capable adapter from the Device List On the Main Menu select Device Hardware Configuration then select SR IOV Enabled b To configure the number of VFs that the adapter can support If Multi Function Mode to is set to SF Single Function then the Number of VFs per PF field displays which you can set from 0 to 64 in increments of 8 default 16 p Broadcom Corporation Document INGSRVT710 CDUM100 R SR IOV Broadcom NetXtreme II Network Adapter User Guide Page 229 NetXtreme II User Guide March 2014 If Multi Function Mode is set to NPAR then display the Main Menu and select NIC Partition Configuration Then select the NPAR Function to configure and enter the appropriate value in the Number of
158. V Mode if you want to enable Windows virtualization services See Microsoft Virtualization with Hyper V in the Troubleshooting topic in the NetXtreme II Network Adapter User Guide for more information about this feature 6 If the team type is an SLB type team click Next If the team type is not an SLB type team then a dialog box appears Verify that the network switch connected to the team members is configured correctly for the team type click OK and continue K NOTE NetXtreme II network adapters with iSCSI enabled is supported only in an SLB team type To continue with the creation of non SLB team types first disable iSCSI by deselecting iSCSI Offload Engine from the Resource Reservations area of the Configurations tab G00 Broadcom Teaming Wizard Creating Modifying a Team Team Type Select the type of team you want to create E j A A Team Type Smart Load Balancingi TM and Failover SLB 802 3ad Link Aggregation using Link Aggregation Control Protocol L4CP FEC GEC Generic Trunking TCP Offload Engine TOE support is supported only on a SLB beam type IF a team type other than SLB is selected no TCP connections will be offloaded lt Back Next gt Preview rl Eu Broadcom Corporation Page 268 Configuring Teaming Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 7 From the Available Adapters list click the adapter you want to add to the team and then click Add Remov
159. X So for adv autoneg cap you would use the following bnxeO adv autoneg cap 1 bnxel adv autoneg cap 0 bnxe2 adv autoneg cap 1 bnxe3 adv autoneg cap 1 ME EE Broadcom Corporation Page 166 Upgrading the Driver Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 If a configuration item is not specified for a specific instance then the default value will be used The default value used by all instances can be overridden using default config item X For boolean values 1 TRUE and 0 FALSE MEMORY USAGE The number of RX TX buffer descriptors specified in the configuration file can have a detrimental affect on memory usage If the counts are too high DMA allocations can fail thereby affecting other drivers loaded on the system If DMA allocations fail during system initialization and or boot then there is a chance the system will not boot This behavior is an implementation constraint of the Solaris OS Additionally it has been seen that the amount of DMA allocation space available on a system running in 32 bit mode is less than when running as 64 bit For a single RX descriptor the following is allocated e 1 DMA handle e 1 DMA memory buffer that is MTU in size e 1K memory overhead For a single TX descriptor the following is allocated e 9 DMA handles for sending chained mblks e 1 DMA memory buffer that is MTU in size e iK memory overhead k NOTE The number of DMA handles available i
160. a MBA firmware e ccm CCM firmware new image A mandatory parameter to specify the input binary file e c Force to program iSCSI configuration This option is valid only if the ib option is used e p Force to program iSCSI configuration utility program This option is valid only if the ib option is used e mac Force to program MAC address This option is valid only if the bc option is used and is only available for Windows RESET Syntax reset Description Resets the selected NIC This command is valid only in Command Line Mode Eu Broadcom Corporation Page 320 Command Descriptions Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 RESTORENVRAM Syntax restorenvram filename idmatch config mac Description This command reads complete NVRAM image from a file and writes the image to NVRAM Before writing the NVRAM image to adapter verifications against source NVRAM image will be performed If any verification fails the image will not be written to adapter Parameters e lt filename gt The file name of NVRAM image that was dumped from the NIC lt filenames gt is a mandatory parameter e idmatch Requests the Firmware Upgrade Tool to restore the NVRAM image only after the four IDs vendor id device id subsystem vendor id subsystem device id in the image file match those in the device This is in addition to all previous criteria that must be met config The config
161. ace The device driver cannot Remove other adapters from allocate memory mapped I O the system reduce the amount to access driver registers of physical memory installed and replace the adapter 16 Informational Driver initialized The driver has successfully No action is required successfully loaded 17 Informational NDIS is resetting the The NDIS layer has detecteda Run Broadcom Advanced miniport driver problem sending receiving Control Suite diagnostics packets and is resetting the check that the network cable is driver to resolve the problem good 18 Error Unknown PHY detected The driver could not read the Replace the adapter Using a default PHY initialization routine PHY ID a Broadcom Corporation Document INGSRVT710 CDUM100 R Appendix A Event Log Messages Page 57 NetXtreme Il Table 8 Base Driver Event Log Messages Cont User Guide March 2014 Message NUBE Severity Message Cause Corrective Action 19 Error This driver does not The driver does not recognize Upgrade to a driver version support this device the installed adapter that supports this adapter Upgrade to the latest driver 20 Error Driver initialization failed Unspecified failure during Reinstall the driver update to a driver initialization newer driver run Broadcom Advanced Control Suite diagnostics or replace the adapter 21 Informational Network controller The adapter has been No action is required
162. adapter this information is not available for adapters made by others Bootcode Version The version of the boot code This information is only available for Broadcom NetXtreme II adapters Family Firmware Version The global firmware version that represents all firmware on the device Management Firmware The firmware version installed on the system Vendor ID The vendor ID Device ID The adapter ID Subsystem Vendor ID The subsystem vendor ID Subsystem ID The subsystem ID External PHY Firmware Version The external PHY firmware version CONFIGURING ADAPTER PARAMETERS Select the network adapter in the Explorer View pane and then select the Configuration tab to configure adapter level parameters HARDWARE AND RESOURCE CONFIGURATION WIZARD PORT CONFIGURATION Select a port to configure and then click Next Flow Control The possible values are Auto Tx Pause Rx Pause Tx Rx pause and Disable The configuration is done at the port level and applies to all functions under the port The flow control value is a default value for the port The effective configuration can be different based on the switch port configuration and whether or not DCB DCBX is enabled Link Speed Configure the link speed The default speed is 1Gb for 1Gb adapters and 10Gb for 10Gb adapters MANAGING ETHERNET CONTROLLER PORT From BACS you can group various traffic classes in to priority group and allocate bandwidth to each priority group MENU EE
163. adcast domain Network Communications The following are the key attributes of SLB e Failover mechanism Link loss detection e Load Balancing Algorithm Inbound and outbound traffic are balanced through a Broadcom proprietary mechanism based on L4 flows e Outbound Load Balancing using MAC Address No e Outbound Load Balancing using IP Address Yes e Multivendor Teaming Supported must include at least one Broadcom Ethernet adapter as a team member Applications The SLB algorithm is most appropriate in home and small business environments where cost is a concern or with commodity switching equipment SLB teaming works with unmanaged Layer 2 switches and is a cost effective way of getting redundancy and link aggregation at the server Smart Load Balancing also supports teaming physical adapters with differing link capabilities In addition SLB is recommended when switch fault tolerance with teaming is required Configuration Recommendations SLB supports connecting the teamed ports to hubs and switches if they are on the same broadcast domain It does not support connecting to a router or Layer 3 switches because the ports must be on the same subnet E MM Broadcom Corporation Page 30 Teaming Mechanisms Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Switch Dependent Generic Static Trunking This mode supports a variety of environments where the adapter link partners are statically configured to
164. adcom Net treme m Je 2 16 Remove Refresh ISHS Servers MH ame Remove Refresh ze tint User Guide March 2014 9 From the Targets tab select the target and click Log On to log into your iSCSI target using the Broadcom iSCSI adapter Mu Broadcom Corporation Page 104 iSCSI Offload in Windows Server INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 iSCSI Initiator Properties xX General Discover Targets Persistent Targets Bound Volumes Devices Select a target and click Log On to access the storage devices for that target Click details to see information about the sessions connections and devices for that target Targets ign Pan E Beilisa Details Log Un Refresh 10 Click on Advanced LogOntoTaret ES Target name iqn target das0z Automatically restore this connection when the system boots Enable multi path A Only select this option if 57 multi path software is already installed on your computer OK Cancel 11 On the General tab select the Broadcom NetXtreme li C NIC iSCSI adapter from Local adapter 12 Click OK to close Advanced settings M Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Offload in Windows Server Page 105 NetXtreme Il User Guide March 2014 General IPSec Connect by using Local adapter Default summa TENE Source IF Broadcom Netstreme
165. age 23 NetXtreme Il Table 4 Comparison of Team Types Cont User Guide March 2014 Switch Dependent Switch Independent Dynamic Link Type of Team Fault Tolerance Load Balancing Static Trunking Aggregation IEEE 802 3ad Function SLB with Standby SLB Generic Trunking Link Aggregation Mixed speeds Yes Yes No No adapters that do not support a common speed s but can operate at different speeds Mixed speeds Yes Yes No mustbethesame Yes adapters that support speed a common speed s but can operate at different speeds Load balances TCP No Yes Yes Yes IP Mixed vendor teaming Yeg Yes Yes Yes Load balances non IP No Yes IPX outbound Yes Yes traffic only Same MAC address No No Yes Yes for all team members Same IP address for Yes Yes Yes Yes all team members Load balancing by IP No Yes Yes Yes address Load balancing by No Yes used for no IP Yes Yes MAC address IPX Allows TOE Yes Yes No No functionality to co exist when all team members support TOE SLB with one primary and one standby member 7 Requires at least one Broadcom adapter in the team c TOE functionality can only be achieved with SLB teams that consist of all Broadcom TOE enabled adapters E e Broadcom Corporation Page 24 Executive Summary Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 SELECTING A TEAM TYPE The following flow chart provides the decision flow wh
166. allows the switch to re learn the MAC addresses as soon as STP re converges MENU EE Broadcom Corporation Page 42 General Network Considerations Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Topology Change Notice BPDUs are sent when a port that was forwarding changes to blocking or transitions to forwarding A TCN BPDU does not initiate an STP recalculation It only affects the aging time of the forwarding table entries in the switch It will not change the topology of the network or create loops End nodes such as servers or clients trigger a topology change when they power off and then power back on Port Fast Edge Port To reduce the effect of TCNs on the network for example increasing flooding on switch ports end nodes that are powered on off often should use the Port Fast or Edge Port setting on the switch port they are attached to Port Fast or Edge Port is a command that is applied to specific ports and has the following effects e Ports coming from link down to link up will be put in the forwarding STP mode instead of going from listening to learning and then to forwarding STP is still running on these ports e The switch does not generate a Topology Change Notice when the port is going up or down LAYER 3 ROUTING SWITCHING The switch that the teamed ports are connected to must not be a Layer 3 switch or router The ports in the team must be in the same network TEAMING WITH HUBS FOR TROUBLESHOOTING P
167. alue Tit Next Entry CESC Quit Current fidapter Primary Hus 07 Device 00 Func 06 HhC 00 180 18 6F D5 0C 4 Onsome platforms you may need to set the boot protocol through system BIOS configuration in the integrated devices pane as described above For all other devices set the Boot Protocol field to FCoE in the MBA Configuration Menu through CCM Lomprehensive Cont igura anaj ement Copyright C 4000 26011 Broadcom Corporation All rights reserved MBA Configuration Menu Option ROR 280 Enabled Boot Protocol Boot otrap Type Hide setup Prompt setup key stroke Hanner Message imeout Link opeed Pre boot Wake Un LAR WLAN Mode ULAN ID Hoot Retry Count Auto Disabled SMS amp SECON 1OGbps Disabled Disabled iat 0 select Hoot Protocol i EwterI Spacel Scroll Value Cftilt MNext Entry TESC Quit Current Adapter Primary Bus 0 Deuice 608 Func 80 MAC 00 10 18 6F 05 0C 5 Configure the desired boot target and LUN From the Target Information Menu select the first available path Broadcom Corporation Page 198 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 LOMprehensive Cont iguration Management vo 4 Copyright C 2000 2011 Broadcom Corporation All rights reserved Target Information Disabled Denies LUA gt target Disabled WHPN Target Disabled WWPN Target Disabled HWP 0 5 Target Disabled HHEN Target Disabled HHPH T
168. alue Assigns a unique node address for the adapter e Not Present default Uses the factory assigned node address on the adapter The appropriate assigned ranges and exceptions for the locally administered address include the following e The range is 00 00 00 00 00 01 to FF FF FF FF FF FD e Do not use a multicast address least significant bit of the high byte 1 e Do not use all Os or all Fs Receive Side Scaling Allows configuring network load balancing across multiple CPUs The default setting for this property is Enabled p Broadcom Corporation Document INGSRVT710 CDUM100 R Managing the LAN Device Page 253 NetXtreme II User Guide March 2014 Switch Configuration Allows configuring of the connected switch for the network adapters NOTE Switch Configuration only applies to blade configurations e SW Config 10G default Sets the switch speed to 10 Gbit s e SW Config 1G Sets the switch speed to 1 Gbit s Speed amp Duplex The Speed amp Duplex property sets the connection speed and mode to that of the network Note that Full Duplex mode allows the adapter to transmit and receive network data simultaneously e 10 Mb Full Sets the speed at 10 Mbit s and the mode to Full Duplex e 10 Mb Half Sets the speed at 10 Mbit s and the mode to Half Duplex e 100 Mb Full Sets the speed at 100 Mbit s and the mode to Full Duplex e 100 Mb Half Sets the speed at 100 Mbit s and the mode to Half Duplex e 1 Gb Full Sets the s
169. ame Service iSNS servers to allow discovery management and configuration of iSCSI devices e Manage Discovery Portals Manages iSCSI discovery portals Discovery Wizard The Discovery Wizard is available from the iSCSI menu Follow the prompts in the wizard to discover iSCSI targets via the SendTargets method or the Internet Storage Name Service iSNS server Manage Targets Wizard The Manage Targets Wizard is available from the iSCSI menu Follow the prompts in the wizard to add and remove targets and to login or logout of a target Manage iSNS Servers The Manage iSNS Servers window is available from the iSCSI menu From this window you can add or remove Internet Storage Name Service iSNS servers EE ee Broadcom Corporation Document INGSRVT710 CDUM100 R BACS Interface Page 235 NetXtreme II User Guide March 2014 Manage Discovery Portals The Manage Discovery Portals window is available from the iSCSI menu From this window you can add or remove iSCSI discovery portals Boot Configuration Wizard The Boot Configuration Wizard is available by right clicking a port Follow the prompts in the wizard to configure the iSCSI boot parameters Hardware and Resource Configuration Wizard The Hardware and Resource Configuration Wizard is used to configure properties for hardware resources Follow the prompts in the wizard to configure hardware resources You can preview the configuration before committing the changes DESC
170. and receive oversized Ethernet frames that are greater than 1514 bytes but less than or equal to 9000 bytes in length 9600 bytes for network adapters that operate at 10 Gbps This property requires the presence of a switch that is able to process jumbo frames This property is only available for Broadcom NetXtreme II adapters Frame size is set at 1500 bytes by default To increase the size of the received frames raise the byte quantity in 500 byte increments K NOTE If Jumbo Packet is set to 5000 bytes or greater on network adapters that support 10 Gbps link speed ensure that Flow Control is set to Auto to prevent the system performance from performing at less than optimal levels This limitation exists on a per port basis ra NOTE If SR IOV is enabled on a virtual function VF on the adapter ensure that the same jumbo packet settings is configured on both the VF and the Microsoft synthetic adapter You can configure these values using Windows Device Manager Advanced properties If there is a mismatch in the values the SRIOV function will be shown the the Degraded state in Hyper V gt Networking Status Locally Administered Address The Locally Administered Address is a user defined MAC address that is used in place of the MAC address originally assigned to the network adapter Every adapter in the network must have its own unique MAC address This locally administered address consists of a 12 digit hexadecimal number e V
171. andwidth sharing at its core allowing multiple fabrics to coexist on the same physical fabric The various capabilities of DCB allow for LAN traffic large number of flows and not latency sensitive SAN traffic large packet sizes and requires lossless performance and IPC latency sensitive messages to bandwidth share the same physical converged connection and achieve the desired individual traffic performance DCB includes the following capabilities e Enhanced Transmission Selection ETS e Priority based Flow Control PFC e Data Center Bridging Capability eXchange Protocol DCBX ON Broadcom Corporation Document INGSRVT710 CDUM100 R Data Center Bridging DCB Broadcom NetXtreme I9 Network Adapter User Guide Page 225 NetXtreme II User Guide March 2014 DCB CAPABILITIES ENHANCED TRANSMISSION SELECTION ETS Enhanced Transmission Selection ETS provides a common management framework for assignment of bandwidth to traffic classes Each traffic class or priority can be grouped in a Priority Group PG and it can be considered as a virtual link or virtual interface queue The transmission scheduler in the peer is responsible for maintaining the allocated bandwidth for each PG For example a user can configure FCoE traffic to be in PG 0 and iSCSI traffic in PG 1 The user can then allocate each group a certain bandwidth For example 60 to FCoE and 40 to iSCSI The transmission scheduler in the peer will ensure that in the event
172. arget Disabled WWPH Target Disabled WWPN Lea beds Information summary LEnter Enter ITill Mext Entry LESCI Quit Menu Buzz Deuice 080 Func an WWPN Z6008G10186F D500 WWAN 10888010186 FD5en 6 Enable the Connect field Enter the target WWPN and Boot LUN information for the target to be used for boot ATA eet amp Ea akis 2011 Hroadcom Gere nine ba cin All rights reserved Ho 3 Target Paramcters Connect SEE na NIE Td 5AG14 30004 CRIRRE Boot LUH 1 Enable Disable Target Establishment f i Enter Space Toggle Value Tid Next Entry ESCI Quit Bus O Device 08 Func 90 WHUPH ZzOGOOOIOISB5FD5SO0D WHAN 10060010186 FD500 ee O Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 199 NetXtreme II User Guide March 2014 LOMpPrehensivVe Loni iguration Management vo 4 2 Copyright C 2060 2011 Broadcom Corporation All rights reserved Target Information l Target Enabled WHPN S6014398004c83bb8 LUN 2 Target Enabled i UWPH 3 Target Disabled WWPH 4 Target Disabled WHER 3 5 Target Disabled WWPN GE 1 6 Target Disabled WPA 4 Target Disabled WHPH Target Disabled i WHPA Target Information Summary LEnterd Enter Titi Aext Entry LEst Quit Menu levice 66 Func 60 WWEA 200086101 B6FD500 WWNHN 100600010186 F Press ESC until prompted to exit and save changes Proceed to OS installation once storage access has been provisioned in the SAN P
173. assistance from the switch These elements of SLB make it the only team type that maintains failover and fallback characteristics when team ports are connected directly to a hub p Broadcom Corporation Document INGSRVT710 CDUM100 R General Network Considerations Page 43 NetXtreme II User Guide March 2014 SLB Team Connected to a Single Hub SLB teams configured as shown in Figure 6 maintain their fault tolerance properties Either server connection could potentially fail and network functionality is maintained Clients could be connected directly to the hub and fault tolerance would still be maintained server performance however would be degraded Figure 6 Team Connected to a Single Hub L aptop computer mm um m s s Switch T NIC Team Server Generic and Dynamic Trunking FEC GEC IEEE 802 3ad FEC GEC and IEEE 802 3ad teams cannot be connected to any hub configuration These team types must be connected to a switch that has also been configured for this team type TEAMING WITH MICROSOFT NLB Teaming does not work in Microsoft s Network Load Balancing NLB unicast mode only in multicast mode Due to the mechanism used by the NLB service the recommended teaming configuration in this environment is Failover SLB with a standby NIC as load balancing is managed by NLB The TOE functionality in teaming will not operate in NLB uu Broadcom Corporation Page 44 General Network Considerations Document INGSRVT710 CDUM
174. at for all listed team members and then click OK Click Next KL NOTE All of the member IP addresses must be in the same subnet as the subnet of the probe targets 15 If you want to create a VLAN on the team select Add VLAN or if you want to change the settings of an existing VLAN select Edit VLAN then click Next If you do not want to create or edit a VLAN select Skip Manage VLAN then click p Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 271 NetXtreme II User Guide March 2014 Next and continue with the wizard from the Finish screen see Step 20 of this procedure VLANs enable you to add multiple virtual adapters that are on different subnets The benefit of this is that your system can have one network adapter that can belong to multiple subnets K NOTE VLANs can only be created when all team members are Broadcom adapters l Broadcom Teaming Wizard 8 mm Creating Modifying a VLAM Configure VLAN Support A Specify whether you want to create or delete a LAN BHOADCOM disi r Lm Manage vLAIM Add VLAM Edit vLAM J Skip Manage VLAN z Back a Mexk Preview rj ELM Broadcom Corporation Page 272 Configuring Teaming Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 16 Type the VLAN name and then click Next k NOTE The team name cannot exceed 39 characters cannot begin with spaces and cannot contain any of the following cha
175. ation Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 the ramdisk with the default original name Also verify that your appropriate entry for the boot from SAN setup uses the correct or updated intrd name in boot grub menu lst 5 To complete your driver upgrade reboot the system and select the modified grub boot entry that contains the updated initrd ERRORS DURING WINDOWS FCoE Boot FROM SAN INSTALLATION If any USB flash drive is connected while Windows setup is loading files for installation an error message will appear when you provide the drivers and then select the SAN disk for the installation The most common error message that Windows OS installer reports is We couldn t create a new partition or locate an existing one For more information see the Setup log files m Total size Free space Type Drive 0 Unallocated Space 30 0 GB 30 0 GB Drive 1 Unallocated Space DM D OMB Offline Drive 2 Unallocated Space 0 0 GB J Offline Drive 3 Unallocated Space 0 0 MB D Offline Refresh Drive options advanced 1 5 Load driver A We couldn t create a new partition or locate an existing one For more information see the Setup log files In other cases the error message may indicate a need to ensure that the disk s controller is enabled in the computer s BIOS menu To avoid any of the above error messages it is necessary to ensure that there is no USB flash drive attached until the setup asks
176. ation and configure parameters from the following tabs e Information e Configuration VIEWING ADAPTER INFORMATION Select the network adapter in the Explorer View pane and then select the Information tab to view adapter level information VIEWING RESOURCE INFORMATION The Resources section of the Information tab displays information about connections and other essential functions for the selected network adapter K Information Tab Resources NOTE Some information may not be available for all Broadcom network adapters Bus Type The type of input output I O interconnect used by the adapter Bridge The bridge type which is the PCI E to PCI X bridge This information is only available for Broadcom NetXtreme II adapters Bridge Lanes The number of PCI E lanes connected to the bridge This information is only available for Broadcom NetXtreme II adapters Bridge Speed The clock speed on PCI E bus This information is only available for Broadcom NetXtreme II adapters Slot Number The slot number on the system board occupied by the adapter This item is not available for PCI Express type adapters Bus Speed The bus clock signal frequency used by the adapter This item is not available for PCI Express type adapters Bus Width The number of bits that the bus can transfer at a single time to and from the adapter This item is not available for PCI Express type adapters Bus Number Indicates the number of the bus where th
177. b iSCSI boot firmware to support IPv4 e ib ipv 6 iSCSI boot firmware to support IPv6 e ib ipv4ne6 iSCSI boot firmware to support IPv4 and IPv6 e vpd Extended VPD e usr User block e ccm CCM firmware c p These options are valid only when the ib option is specified e c Upgrades the iSCSI configuration along with iSCSI boot code The ib ib ipve and ib ipv4n6 commands add upgrade the iSCSI configuration automatically Therefore this option is no longer needed e p Upgrades the iSCSI configuration program along with iSCSI boot code S EEE Broadcom Corporation Document INGSRVT710 CDUM100 R Command Descriptions Page 321 NetXtreme Il User Guide March 2014 VERSION Syntax version Description Shows the version of this utility W Syntax w lt value gt Description Enables or disables WOL Parameters lt value gt e Set to 1 to enable WOL e Set to 0 to disable WOL PSS Broadcom Corporation Page 322 Command Descriptions Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 EXAMPLES COMMAND LINE MODE EXAMPLES For each example the Windows syntax is listed first followed by the Linux syntax e The following command upgrades bootcode for the ONLY qualified adapter found The adapter parameter can be omitted if ONLY ONE qualified adapter is found Windows winfwupg upgrade bc C tmp new bootcode c oldBoot Linux 1nxfwupg upgrade bc tmp
178. b to the kernel vmlinuz line Linux Adding Additional Boot Paths Both RHEL and SLES require updates to the network configuration when adding new boot through an FCoE initiator that was not configured during installation The following sections describe this procedure for each supported operating system RHEL6 2 and Above On RHEL6 2 and above if the system is configured to boot through an initiator port that has not previously been configured in the OS the system automatically boots successfully but will encounter problems during shutdown All new boot path initiator ports must be configured in the OS before updating pre boot FCoE boot parameters 1 Identify the network interface names for the newly added interfaces through ifconfig a 2 Edit boot grub menu Ist a Add ifname lt INTERFACE gt lt MAC ADDRESS gt tothe line kernel vmlinuz for each new interface The MAC address must be all lower case and separated by a colon e g ifname em1 00 00 00 00 00 00 MM EE Broadcom Corporation Page 216 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 3 Create a etc fcoe cfg INTERFACE file for each new FCoE initiator by duplicating the etc fcoe cfg lt INTERFACE gt file that was already configured during initial installation 4 Execute nm connection editor a Open Network Connection and choose each new interface b Configure each interface as desired including DHCP settin
179. care utilizatorul trebuie sa ia masunle necesare SLOVENSKY lento v robok vyhovwje po iadavk m smemice 2006 93 EC smemica o nizkom nap tl Slovakian 2004 108 EC smemica o elektromagneticke kompatiuilite a neskorsmm zmen m a doplnkom Eur pskej V yhlaseme o zhode vydane v sulade s predchadzajucim smernicam a tandardmi sa nachadza v spolo nosti Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA Eur pska unia Trieda B Tote zariadenie Broadcom triedy B ja ur ene pre domace prosiredie Eur pska unia Trieda A VAROVANIE Toto je zanademe tnedy A V dom com prostredi moze tento produkt sp sobova rusenie r diovej frekvencie V takom pripade musi pou ivate prijaf prislusne opatrenta Slovenian Ta izdelek je v sklada z 2006 93 ES Direktiva o nizki napetosti 2004 108 ES Direktiva o elekiromagneim zdru ljivosti m dopoluili Evropske mye lzjava o skladnostm je bila sprejeta v skladu s predhodnmm direktivami im standardi m je shranjena na naslova Broadcom Corporation 190 Mathilda Place Sunnyvale Califorma 94086 Evropska unija razred B Ta Broadcomova naprawa je razvricena za uporabo v znacilnem bivalnem okolju razreda B Evropska unija razred A OPOZORILO To je izdelek razreda A V doma em ckolju lahko ta izdelek povzro a motme radijskih frekvenc v tem primera mora uporabnik ustrezno ukrepati p E Broadcom Corporation Document INGSRVT710 CDUM100 R CE Notice Page 299 NetXtreme II User Guide
180. ccurs when installing the Broadcom drivers through Windows Plug and Play PnP Solution Install the drivers through the Setup installer Problem For static IP configuration when switching from Layer 2 iSCSI boot to Broadcom iSCSI HBA then you will receive an IP address conflict Solution Change the IP address of the network property in the OS Problem After configuring the iSCSI boot LUN to 255 a system blue screen appears when performing iSCSI boot Solution Although Broadcom s iSCSI solution supports a LUN range from O to 255 the Microsoft iSCSI software initiator does not support a LUN of 255 Configure a LUN value from O to 254 Problem NDIS miniports with Code 31 yellow bang after L2 iSCSI boot install Solution Run the T7 4 installer Problem Unable to update inbox driver if a non inbox hardware ID present Solution Create a custom slipstream DVD image with supported drivers present on the install media MENU EE Broadcom Corporation Page 96 iSCSI Boot Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 Problem In Windows Server 2012 toggling between iSCSI HBA offload mode and iSCSI software initiator boot can leave the machine in a state where the HBA offload miniport bxois will not load Solution Manually edit HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services bxois StartOverride from 3 to O Modify the registry key before toggling back from NDIS to HBA path in CCM k NOTE Microsoft reco
181. ce there is a dependency between the switch and the host team configuration when Generic Trunking or Link Aggregation is used it can often lead to configuration difficulties because both ends must be configured correctly and be synchronized Second with Generic Trunking or Link Aggregation modes the switch decides how inbound traffic to the team is balanced across the adapters while BASP only controls the balancing of outbound traffic This is problematic for TOE environments because in order for TOE to work state information about a given TCP connection is stored in the hardware on a given offloaded adapter but it is not stored in the hardware on every member of the team So teaming and TOE cannot co exist if the teaming software cannot steer incoming TCP IP traffic to the adapter that contains and updates the state information for a given TCP connection Because Broadcom s SLB modes can control how both outbound and inbound packets are balanced across the adapters the SLB modes are capable of ensuring that all offloaded TCP traffic for a given TCP connection goes in and out of a particular adapter This architectural feature allows the SLB modes to also support load balancing on adapters that have TOE enabled since BASP is able to steer traffic on a particular TCP connection to the adapter hardware that contains offloaded state information for that TCP connection BASP can simultaneously use TCP offload in conjunction with the SLB modes of teaming
182. ce with DCBX sync FIP Discovery Fabric Login Target Login and LUN readiness checks As each of these phases completes if the initiator is unable to proceed to the next phase MBA will uu Broadcom Corporation Page 200 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 present the option to press CTRL R 4 Once CTRL R has been activated the boot initiator will maintain a link in whatever phase has most recently succeeded and allow you time to make the necessary provisioning corrections to proceed to the next phase 5 f the initiator logs into the fabric but is unable to log into the target a CTRL R will pause the boot process and allow you to configure fabric zoning 6 Once zoning is complete the initiator will automatically log into all visible targets If the initiator is unable to discover the designated LUN on the designated target as provisioned in step 1 CTRL R will pause the boot process and allow you to configure selective LUN presentation 7 The boot initiator will periodically poll the LUN for readiness and once the user has provisioned access to the LUN the boot process will automatically proceed K NOTE This does not preclude the need to put the boot initiator into one time disabled mode as described in One Time Disabled ONE TIME DISABLED Broadcom s FCoE ROM is implemented as Boot Entry Vector BEV In this implementation the Option ROM only connects to the target
183. ced Server Program BASP software For a comprehensive description of the technology and implementation considerations of the teaming software refer to the Broadcom Gigabit Ethernet Teaming Services section of your Broadcom network adapter user guide Teaming can be accomplished by either of the following methods e Using the Broadcom Teaming Wizard e Using Expert Mode K NOTES e For further information regarding teaming protocols see Teaming in your Broadcom network adapter user guide e f you do not enable LiveLink when configuring teams disabling Spanning Tree Protocol STP at the switch is recommended This minimizes the downtime due to spanning tree loop determination when failing over LiveLink mitigates such issues e BASP is available only if a system has one or more Broadcom network adapters installed e The TCP Offload Engine TOE Large Send Offload LSO and Checksum Offload properties are enabled for a team only when all of the members support and are configured for the feature e To physically remove a teamed NIC from a system you must first delete the NIC from the team Not doing this before shutting down the system could result in breaking the team on a subsequent reboot which may result in unexpected team behavior e lf an adapter is included as a member of a team and you change any advanced property then you must rebuild the team to ensure that the team s advanced properties are properly set e
184. cksum offload e Tx Enabled Enables transmit TCP IP UDP checksum offload e Tx Rx Enabled default Enables transmit and receive TCP IP UDP checksum offload e None Disables checksum offload MENU EE Broadcom Corporation Page 252 Managing the LAN Device Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 IPv4 Large Send Offload Normally the TCP segmentation is done by the protocol stack When you enable the Large Send Offload property the TCP segmentation can be done by the network adapter The default setting for this property is Enabled This property is only available for Broadcom NetXtreme ll adapters IPv6 Checksum Offload Normally the checksum function is computed by the protocol stack When you select one of the Checksum Offload property values other than None the checksum can be computed by the network adapter e Rx Enabled Enables receive TCP IP UDP checksum offload e Tx Enabled Enables transmit TCP IP UDP checksum offload e TX Rx Enabled default Enables transmit and receive TCP IP UDP checksum offload e None Disables checksum offload IPv6 Large Send Offload Normally the TCP segmentation is done by the protocol stack When you enable the Large Send Offload property the TCP segmentation can be done by the network adapter The default setting for this property is Enabled This property is only available for Broadcom NetXtreme ll adapters Jumbo Packet Enables the network adapter to transmit
185. com Corporation 190 Mathilda Place Sunnyvale Califorma 94086 USA Euroopan unioni luokka B Tama Broadcom laite on luakiteltu kaytettavaks tyypillisess luokan B kotwmpanst ssi Euroopan unioni Luokka A VAROITUS Tama on Luokan A tote Asmmymparist ssa tama larte saattaa aiheuttaa radiotaayush mi rt muka saattaa edellytta toma laitteen kayttajalta Ce produit a ete d clare conforme aux directives 2006 95 EC Directive sur la faible tension 2004 108 EC Directive EMC et aux amendements de l Union europ enne Une Declaration de Confommute relative aux normes et directives precedentes a ete redigee et est enreg str e aupres de Broadcom Corporation 190 Mathilda Place Sunnyvale Calforma 94086 USA Union europ enne classe B Cet appareil Broadcom est classe pour une utilisation dans un environnement residentiel classique classe B Union europ enne classe A AVERTISSEMENT Ce produit est un produit de classe A Dans un environnement r sidentiel ce produit peut provoquer des perturbations rachoelectriques auquel cas luthzateur peut se vou oblige de prendre les mesures appropmees Es ist befunden worden dass dieses Produkt Niederspannungs Richtluue 2004 108 EC Europ ischen Union steht Eine Konformit tserklirung in Uberemstummung mit den oben angef hrten Normen ist abgegeben worden und kann bei Broadcom Corporation 190 Mathilda Place Sunnyvale Califorma 94086 USA Europaizche Union Klasse B Diese
186. coming outgoing Same speed GEC 1000 Incoming outgoing Same speed IEEE 802 3ad 10 100 1000 10000 Incoming outgoing Mixed speed E Broadcom Corporation Page 34 Teaming Mechanisms Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 TEAMING AND OTHER ADVANCED NETWORKING PROPERTIES e Checksum Offload e IEEE 802 1p QoS Tagging e Large Send Offload e TCP Offload Engine TOE e Jumbo Frames e EEE 802 1Q VLANs e Wake On LAN Preboot Execution Environment Before creating a team adding or removing team members or changing advanced settings of a team member make sure each team member has been configured similarly Settings to check include VLANs and QoS Packet Tagging Jumbo Frames and the various offloads Advanced adapter properties and teaming support are listed in Table 7 Table 7 Advanced Adapter Properties and Teaming Support Adapter Properties Supported by Teaming Virtual Adapter Checksum Offload Yes IEEE 802 1p QoS Tagging No Large Send Offload Yes TCP Offload Engine TOE YesP Jumbo Frames Yes IEEE 802 1Q VLANs Yes Wake on LAN Nod Preboot Execution environment PXE Yes a All adapters on the team must support this feature Some adapters may not support this feature if ASF IPMI is also enabled Must be supported by all adapters in the team e Only for Broadcom adapters d See Wake On LAN As a PXE sever only not as a client A team does
187. comply with the limits for a Class B digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference in a residential installation The equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not occur in a particular installation If the equipment does cause harmful interference to radio or television reception which can be determined by turning the equipment off and on the user is encouraged to try to correct the interference by one or more of the following measures e Reorient or relocate the receiving antenna e Increase the separation between the equipment and the receiver e Connect the equipment into an outlet on a circuit different from that to which the receiver is connected e Consult the dealer or an experienced radio TV technician for assistance Do not make mechanical or electrical modifications to the equipment KL NOTE If the device is changed or modified without permission of Broadcom the user may void his or her authority to operate the equipment MEM Broadcom Corporation Page 292 Regulatory Information Broadcom NetXtreme I Network Adapter User Guide Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 FCC CLASS A Broadcom NetXtreme ll G
188. csi ifacename name of the iface file gt iface transport name tcp VLAN CONFIGURATION FOR ISCSI OFFLOAD LINUX iSCSI traffic on the network may be isolated in a VLAN to segregate it from other traffic When this is the case you must make the iSCSI interface on the adapter a member of that VLAN Modifying the iSCSI iface File To configure the iSCSI VLAN add the VLAN ID in the iface file for iSCSI In the following example the VLAN ID is set to 100 Begin Record 6 2 0 873 2 e16 Iface iscsi ifacefile name lt gt Iface ipaddress 0 0 0 0 Iface hwaddress lt gt Iface trasport name bnx2i Iface vlan id 100 Irace vlan priority 0 Iface iface num 100 Iface mtu 0 Iface port 0 END Record K NOTE Although not strictly required Broadcom recommends configuring the same VLAN ID on the iface iface_num field for iface file identification purposes MEM EE Broadcom Corporation Page 162 Linux iSCSI Offload Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Setting the VLAN ID on the Ethernet Interface If using RHEL5 X versions of Linux it is recommended that you configure the iSCSI VLAN on the Ethernet interface In RHEL6 3 and sles11sp3 it is not necessary to set the VLAN on the Ethernet driver Execute the following commands to set the VLAN ID Vconfig add ethx vlan number Creates an L2 VLAN interface Ifconfig eth VLANID static ip up Assigns and IP address
189. ction PF You must explicitly configure storage offloads on a PF to use FCoE and iSCSI offload functionality on an adapter NIC partitioning can be configured using Broadcom s Comprehensive Configuration Management CCM utility Some vendors provide a proprietary utility to configure NPAR If this is the case refer to the vendor provided documentation for information on configuring NPAR on Broadcom NetXtreme Il 10 Gigabit Ethernet adapters KL NOTE In NPAR mode SR IOV cannot be enabled on any PF on which storage offload FCoE or iSCSI is configured This does not apply to adapters in Single Function SF mode To configure a NIC for partitioning using the CCM utility Select the NIC from Device List From the Main Menu select Device Hardware Configuration Change the Multi Function Mode to NPAR m o pa Configure the NIC parameters for your configuration based on the options shown in Table 1 Table 1 lists the configuration parameters available from the NIC Partitioning Configuration screen Table 1 Configuration Options Parameter Description Options Flow Control Configures the Flow Control mode for this port e Auto e TX Flow Control e RX Flow Control e TX RX Flow Control e None PF O PF 2 PF 4 PF 6 Displays the physical function PF information regarding See Table 2 for configuration the partition s on port 0 Select to configure options PF 1 PF 3 PF 5 PF 7 Displays the physical function PF
190. d Follow the procedure for Installing the Broadcom Advanced Control Suite and Related Management Applications Windows Client On the Windows client perform following configuration steps Perform HTTP Configuration if you plan to use HTTP Perform HTTPS Configuration if you plan to use HTTPS Configure WinRM HTTPS SSL Following the procedure for Installing the Broadcom Advanced Control Suite and Related Management Applications uu Broadcom Corporation Page 112 Installation Tasks Document INGSRVT710 CDUM100 R P od YS User Guide NetXtreme Il March 2014 Linux Server On Linux server use the following steps to install OpenPegasus There are two options available with respect to OpenPegasus installing from the Inbox RPM or installing from source The Inbox OpenPegasus is only available on the Red Hat OS For SLES11 the only option is to use the source RPM WS MAN is not supported with the Inbox RPM If you plan to use WS MAN then you must install OpenPegasus from source Install OpenPegasus From the Inbox RPM Red Hat Only or Install OpenPegasus From Source Red Hat and SuSE Start CIM Server on the Server Configure OpenPegasus on the Server Install Broadcom CMPI Provider Ce SS I9 x Perform additional configuration if required such as firewall configuration See Perform Linux Firewall Configuration If Required 6 Follow the procedure for Installing the Broadcom Advanced Control Suite and Related Management Ap
191. d IPX and appears as a virtual adapter This virtual adapter inherits the MAC Address of the first port initialized in the team A Layer 3 address must also be configured for the virtual adapter The primary function of BASP is to balance inbound for SLB and outbound traffic for all teaming modes among the physical adapters installed on the system selected for teaming The inbound and outbound algorithms are independent and orthogonal to each other The outbound traffic for a particular session can be assigned to a given port while its corresponding inbound traffic can be assigned to a different port Figure 2 Intermediate Driver ELM Broadcom Corporation Page 26 Teaming Mechanisms Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 TCP IP Physica NIC Inoarface 22 Miniport Driver Instance 1 Miniport Driver Instance 2 Virtual Bus Driver NIC 1 NIC 2 Outbound Traffic Flow The Broadcom Intermediate Driver manages the outbound traffic flow for all teaming modes For outbound traffic every packet is first classified into a flow and then distributed to the selected physical adapter for transmission The flow classification involves an efficient hash computation over known protocol fields The resulting hash value is used to index into an Outbound Flow Hash Table The selected Outbound Flow Hash Entry contains the index of the selected physical adapter responsible for transmitting this flow The source MAC address of
192. d on the iSCSI Target 13 Change to the OPT bcm bibt folder and run the iscsi setup sh script to create the initrd images Option O will create a non offload image and option 1 will create an offload image The Iscsi_script sh script will create the non offload image only on SuSE 10 as offload is not supported on SuSE 10 14 Mount the boot partition on the iSCSI Target 15 Copy the initrd images you created in step 13 from your local hard drive to the partition mounted in step 14 16 On the partition mounted in step 14 edit the grub menu to point to the new initrd images 17 Unmount the boot partition on the iSCSI Target 18 Red Hat Only To enable CHAP you need to modify the CHAP section of the iscsid conf file on the iSCSI Target Edit the iscsid conf file with one way or two way CHAP information as desired 19 Shut down the system and disconnect the local hard drive Now you are ready to iSCSI boot the iSCSI Target 20 Configure iSCSI Boot Parameters including CHAP parameters if desired see Configuring the iSCSI Target 21 Continue booting into the iSCSI Boot image and choose one of the images you created non offload or offload Your choice should correspond with your choice in the iSCSI Boot parameters section If HBA Boot Mode was enabled in the iSCSI Boot Parameters section you have to boot the offload image SuSE 10 x and SLES 11 do not support offload p Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Boot
193. d to enter IP information for iscsi initiator 12 RHEL Choose to skip media testing 13 Continue installation as desired A drive will be available at this point After file copying is done remove CD DVD and reboot the system 14 When the system reboots enable boot from target in iSCSI Boot Parameters and continue with installation until it is done At this stage the initial installation phase is complete The rest of the procedure pertains to creating a new customized initrd for any new components update 15 Update iscsi initiator if desired You will first need to remove the existing initiator using rpm e 16 Make sure all runlevels of network service are on chkconfig network on 17 Make sure 2 3 and 5 runlevels of iscsi service are on chkconfig level 235 iscsi on 18 For Red Hat 6 0 make sure Network Manager service is stopped and disabled EE eee Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Boot Page 89 NetXtreme II User Guide March 2014 19 Install iscsiuio if desired not required for SUSE 10 20 Install linux nx2 package if desired 21 Install bibt package 22 Remove ifcfg eth 23 Reboot 24 For SUSE 11 1 follow the remote DVD installation workaround shown below 25 After the system reboots log in change to the opt bcm bibt folder and run iscsi_setup sh script to create the offload and or the non offload initrd image 26 Copy the initrd image s offload and or non of
194. d warranties of merchantability or fitness for a particular purpose Broadcom Corporation reserves the right to make changes without further notice to any products or data herein to improve reliability function or design Information furnished by Broadcom Corporation is believed to be accurate and reliable However Broadcom Corporation does not assume any liability arising out of the application or use of this information nor the application or use of any product or circuit described herein neither does it convey any license under its patent rights or the rights of others Broadcom the pulse logo Connecting everything the Connecting everything logo NetXtreme Ethernet Wirespeed LiveLink and Smart Load Balancing are among the trademarks of Broadcom Corporation and or its affiliates in the United States certain other countries and or the EU Microsoft and Windows are trademarks of Microsoft Corporation Linux is a trademark of Linus Torvalds Intel is a trademark of Intel Corporation Magic Packet is a trademark of Advanced Micro Devices Inc Red Hat is a trademark of Red Hat Inc PCI Express is a trademark of PCI SIG Any other trademarks or trade names mentioned are the property of their respective owners Initial release December 2005 Last revised March 2014 INGSRVT710 CDUM100 R E MM Broadcom Corporation Page 2 Broadcom NetXtreme II Network Adapter User Guide Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 20
195. dapter You can configure these values using Windows Device Manager Advanced properties If there is a mismatch in the values the SRIOV function will be shown the the Degraded state in Hyper V gt Networking Status E MM Broadcom Corporation Page 230 Enabling SR IOV Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Using Broadcom Advanced Control Suite 4 Broadcom NetXtreme II Network Adapter User Guide e Broadcom Advanced Control Suite Overview e Managing Ethernet Controller Port e Starting Broadcom Advanced Control Suite e Analyzing Cables in Windows e BACS Interface e Managing the LAN Device e Configuring Preferences in Windows e Viewing Resource Information e Connecting to a Host e Configuring Teaming e Managing the Host e Configuring With the Command Line Interface Utility e Managing the Network Adapter e Troubleshooting BACS BROADCOM ADVANCED CONTROL SUITE OVERVIEW Broadcom Advanced Control Suite BACS is an integrated utility that provides useful information about each network adapter that is installed in your system BACS also enables you to perform detailed tests diagnostics and analyses on each adapter as well as to view and modify property values and view traffic statistics for network objects BACS operates on Windows and Linux operating systems Broadcom Advanced Server Program BASP which runs within Broadcom Advanced Control Suite is used to configure teams for load balancing fau
196. dapter interface on Client Server Red will be used to transmit the data The Broadcom intermediate driver outbound load balancing algorithm determines this see Outbound Traffic Flow and Inbound Traffic Flow SLB Only The teamed interface on the backup server transmits a gratuitous address resolution protocol G ARP to Client Server Red which in turn causes the client server ARP cache to get updated with the Backup Server MAC address The load balancing mechanism within the teamed interface determines the MAC address embedded in the G ARP The selected MAC address is essentially the destination for data transfer from the client server On Client Server Red the SLB teaming algorithm will determine which of the two adapter interfaces will be used to transmit data In this example data from Client Server Red is received on the backup server Adapter A interface To demonstrate the SLB mechanisms when additional load is placed on the teamed interface consider the scenario when the backup server initiates a second backup operation one to Client Server Red and one to Client Server Blue The route that Client Server Blue uses to send data to the backup server is dependant on its ARP cache which points to the backup server MAC address Because Adapter A of the backup server is already under load from its backup operation with Client Sever Red the Backup Server invokes its SLB algorithm to inform Client Server Blue through an G ARP to update its ARP cache t
197. dapters bnx2fc Linux FCoE kernel mode driver used to provide a translation layer between the Linux SCSI stack and the Broadcom FCoE firmware hardware In addition the driver interfaces with the networking layer to transmit and receive encapsulated FCoE frames on behalf of open fcoe s libfc libfcoe for FIP device discovery M E Broadcom Corporation Document INGSRVT710 CDUM100 R Introduction Page 143 NetXtreme II User Guide March 2014 LIMITATIONS e bnx2 Driver e bnx2x Driver e bnx2i Driver BNX2 DRIVER The current version of the driver has been tested on 2 4 x kernels starting from 2 4 24 and all 2 6 x kernels The driver may not compile on kernels older than 2 4 24 ra Testing is concentrated on i386 and x86 64 architectures Only limited testing has been done on other architectures Minor changes to some source files and Makefile may be needed on some kernels Additionally the Makefile will not compile the cnic driver on kernels older than 2 6 16 iSCSI offload is only supported on 2 6 16 and newer kernels Gg NOTE Support for the 2 4 21 kernels is provided in Red Hat Enterprise Linux 3 NOTE For Broadcom NetXtreme Il BCM5708 devices with a silicon revision prior to B2 the open source bnx2 driver does not support the reporting and configuration of NetXtreme Il WOL settings via ethtool For silicon revisions of B2 or later the bnx2 driver reports support for Magic Packet WOL via ethtool Enabling support via
198. dcom Corporation Page 212 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Vh Dye el eric wil your salate irrebherT Batic Storage Devices FALAH 4 opib E pph a pui i Ul Ris Chua OH ques dh Pub diss meFusc bja HR Os ques Iri ch poets H Specialized Storage Devices E Pun pp Eha pee deysp buch an oordege de Gere Clk The ees acd ee pesi um ede FOE cle AC cain ani bn Pe cet cece ore ee recede a uh a Back pe Next 8 Click Add Advanced Target Pisa fuent Thee ino yeu d Eros B5 iria Dae ipe abre Leen en ari vest an arm direi you d lite Do automabDcaly mount n your vysbem beloar ask Device firmaa RAD Multipath Devices Other SAN Devices Search fal races Capacity OBI Iean Seer ad hiiit ber inn i Decor Spa oj Anda Aachen Eyrgel 6 devices 0 MB malected cut of D devore s O MB total d Tiga Selecting a drive on Gls screen does nog neorssanby mean it wi br wiped Ey mae PL BL ADS Pte ThaE PSL ye fring Sharon Sed yen ond iut select here by modifying voor ieicfoeab file n pack me nest Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 213 NetXtreme II User Guide March 2014 9 Select Add FCoE SAN and select Add drive Par r te Sari woa d like 82 PAEA ee ee Sen en an ee wi ary Se you d le bo uhm a Dy Pu n your vysberni beka Bark Devine Finer RUD Multipath Deyoes Other GEN Devices Search B ichs Lapeeciby OH FORCHE Send Alera er et E Lar DESDE Options Hoey we
199. ded by Windows PowerShell Cmdlets e The ability to tag specific types of L2 networking traffic such as SMB traffic so that hardware bandwidth can be managed using ETS All Broadcom Converged Network Adapters that support DCB are capable of interoperating with Windows QoS To enable the QoS Windows feature ensure that the Broadcom device is DCB capable Using either CCM or BACS4 1 Enable Data Center Bridging 2 Select the NDIS driver display Advanced properties and enable the Quality of Service property When QoS is enabled administrative control over DCB related settings is relinquished to the operating system that is BACSA can no longer be used for administrative control of the DCB You can use PowerShell to configure and manage the QoS feature Using PowerShell Cmdlets you can configure various QoS related parameters such as traffic classification priority flow control and traffic class throughput scheduling For more information on using PowerShell Cmdlets see the DCB Windows PowerShell User Scripting Guide in the Microsoft Technet Library To revert to standard BACS control over the Broadcom DCB feature set uninstall the Microsoft QOS feature or disable Quality of Service in the NDIS advance properties page K NOTE Broadcom recommends that you do not install the DCB feature if SR IOV will be used If you install the DCB feature be aware that selecting Enable single root I O virtualization SR IOV in Virtual Sw
200. ding Removing the Linux Driver e Patching PCI Files Optional e Network Installations e Setting Values for Optional Properties e Driver Defaults e Driver Messages e Teaming with Channel Bonding e Statistics e Linux iSCSI Offload SS Broadcom Corporation Page 142 Linux Driver Software Broadcom NetXtreme II Network Adapter User Guide Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 INTRODUCTION This section discusses the Linux drivers for the Broadcom NetXtreme II network adapters Table 1 Broadcom NetXtreme ll Linux Drivers Linux Driver Description bnx2 Linux driver for the NetXtreme Il 1 Gb network adapters bnx2x Linux driver for the NetXtreme Il 10 Gb network adapters This driver directly controls the hardware and is responsible for sending and receiving Ethernet packets on behalf of the Linux host networking stack This driver also receives and processes device interrupts both on behalf of itself for L2 networking and on behalf of the bnx2fc FCoE and cnic drivers cnic The cnic driver provides the interface between Broadcom s upper layer protocol e g storage drivers and Broadcom s NetXtreme II 1 Gb and 10 Gb network adapters The CNIC module works with the bnx2 and bnx2x network drives in the downstream and the bnx2fc FCoE and bnx2i iSCSI drivers in the upstream bnx2i Linux iSCSI HBA driver to enable iSCSI offload on the NetXtreme II 1 Gb and 10 Gb network a
201. dmin options htmlz sn boot options update for details about installing the Anaconda update image Press Enter to proceed 4 For RHEL6 4 and above no updated Anaconda is required On the installation splash screen press Tab and add the option dd to the boot command line as shown in the following screen Press Enter to proceed Welcome to Red Hat Enterprise Linux 6 4 Install or upgrade an existing system Install system with basic video driver Rescue installed system Boot from local drive Memory test unlinuz initrd initrd img xdriver vesa nomodeset dd RED HAT ENTERPRISE LINUX 6 Copyright 2003 2010 Red Hat Inc and others All rights reserved u 5 When prompted Do you have a driver disk enter Yes Note RHEL does not allow driver update media to be loaded via the network when installing driver updates for network devices Use local media MM Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 211 NetXtreme II User Guide March 2014 Welcome to Red Hat Enterprise Linux for xB8b b Tabi cAlt Tah between elements 1 apace selects i lt Fid gt Welcome to Red Hat Enterprise Linux for xti 64 Select driver disk image Select the file which is your driver disk image me txtremee r a Tabs cAlt Tah beteen elements 6 Once drivers are loaded proceed with installation 7 Select Specialized Storage Devices when prompted Mu Broa
202. dow 13 Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted r4 NOTES e The team name cannot exceed 39 characters cannot begin with spaces and cannot contain any of the following characters amp lt gt e Team names must be unique If you attempt to use a team name more than once an error message is displayed indicating that the name already exists e he maximum number of team members is 8 e When team configuration has been correctly performed a virtual team adapter driver is created for each configured team e f you disable a virtual team and later want to reenable it you must first disable and reenable all team members before you reenable the virtual team e When you create Generic Trunking and Link Aggregation teams you cannot designate a standby member Standby members work only with Smart Load Balancing and Failover and SLB Auto Fallback Disable types of teams e For an SLB Auto Fallback Disable team to restore traffic to the load balance members from the standby member click the Fallback button on the Team Properties tab e When configuring an SLB team although connecting team members to a hub is supported for testing it is recommended to connect team members to a switch e Not all network adapters made by others are supported or fully certified for teaming 14 Configure the team IP address a From Control Panel double click Network C
203. driver restart of the selected NIC after the firmware upgrade is completed This option is only valid in Command Line Mode It is not supported on all NICs For NICs on which it is not supported APE must be suspended before the parameter can be configured in NVRAM since the SMASH firmware might access the NVRAM during the configuring process e mac MAC address to be programmed for current selected device A12 digit HEX MAC address e g 0010181a2b3c e mba Set value to 1 to enable MBA firmware Set value to 0 to disable mba firmware e asf Set value to 1 to enable ASF firmware Set value to 0 to disable asf firmware e ump Set value to 1 to enable UMP firmware Set value to 0 to disable ump firmware setman Set APE active management firmware e t Toggle APE active management firmware e p Activate Inactive APE management firmware if it is PASSTHRU e m Activate Inactive APE management firmware if is TruManage e mgmt Set value to 1 to enable management firmware Set value to 0 to disable management firmware e wol Set value to 1 to enable the WOL feature Set value to 0 to disable WOL feature e aspm Set value to 1 to enable the L1 ASPM debounce feature Set value to 0 to disable the L1 ASPM debounce feature e tph Set value to 2 to advertise TPH with ST mode Set value to 1 to advertise TPH without ST mode Set value to 0 to disable TPH fea
204. e The files included in the SDK package are e Inxfwupg This upgrade utility program e Readme txt A text file with additional user instructions and a full list of exist codes e Release txt Release information and fixes ME EE Broadcom Corporation Page 314 Firmware Upgrade Utility Broadcom NetXtreme I9 Network Adapter User Guide Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 To install BMAPI library SDK package Enter tar zxvf bmapilnx version sdk tgz to untar the package in the same directory The files included in the SDK package are e bcmtype h e BMAPI h e brcm pci ids e BMAPILNX library For x86 platforms e libbmapi so version BMAPI 32 bit shared library For x86_64 platforms e libomapi_x64 so version BMAPI 64 bit shared library e libbmapi so version BMAPI 32 bit shared library For PPC64 platforms e l ibbmapi ppc64 so version BMAPI 64 bit shared library for PPC ee Broadcom Corporation Document INGSRVT710 CDUM100 R Installing the Firmware Upgrade Utility Page 315 NetXtreme II User Guide March 2014 INVOKING THE UTILITY Use the winfwupg command in Windows or the 1nxfwupg command in Linux to invoke the upgrade utility and access all of its commands You can type winfwupg or 1nxfwupg followed by any of the available command parameters Or you can the command and press Enter to access interactive mode where you can enter additi
205. e Integrated 96 KB frame buffer memory e Quality of Service QoS e GMII MII Management Interface e Four unique MAC unicast addresses e Support for multicast addresses via 128 bits hashing hardware function e Serial flash NVRAM memory e JTAG support e PCI Power Management Interface v1 1 e 64 bit BAR support e EM64T processor support e AMD 64 processor support e 1 2 V core voltage 0 13 um process e iSCSI Boot support e Virtualization e Microsoft e VMware e Single Root I O Virtualization SRIOV TCP OFFLOAD ENGINE TOE The TCP IP protocol suite is used to provide transport services for a wide range of applications for the Internet LAN and for file transfer Without the TCP Offload Engine the TCP IP protocol suite runs on the host CPU consuming a very high percentage of its resources and leaving little resources for the applications With the use of the Broadcom NetXtreme II adapter the TCP IP processing can be moved to hardware freeing the CPU for more important tasks such as application processing The Broadcom NetXtreme ll adapters TOE functionality allows simultaneous operation of up to 1024 fully offloaded TCP connections for 1 Gbps network adapters and 1880 fully offloaded TCP connections for 10 Gbps network adapters The TOE support on the adapter significantly reduces the host CPU utilization while preserving the implementation of the operating system stack INTERNET SMALL COMPUTER SYSTEMS INTERFACE ISCSI The IETF has s
206. e Option 60 The value of Option 60 should match the DHCP Vendor ID value The DHCP Vendor ID value is BRCM ISAN as shown in General Parameters of the iSCSI Boot Configuration menu pS Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Boot Page 85 NetXtreme II User Guide March 2014 DHCP iSCSI Boot Configuration for IPv6 The DHCPV6 server can provide a number of options including stateless or stateful IP configuration as well s information to the DHCPv6 client For iSCSI boot Broadcom adapters support the following DHCP configurations e DHCPv6 Option 16 Vendor Class Option e DHCPv6 Option 17 Vendor Specific Information KL NOTE The DHCPv6 standard Root Path option is not yet available Broadcom suggests using Option 16 or Option 17 for dynamic iSCSI Boot IPv6 support DHCPv6 Option 16 Vendor Class Option DHCPv6 Option 16 vendor class option must be present and must contain a string that matches your configured DHCP Vendor ID parameter The DHCP Vendor ID value is BRCM ISAN as shown in General Parameters of the iSCSI Boot Configuration menu The content of Option 16 should be 2 byte length DHCP Vendor ID DHCPv6 Option 17 Vendor Specific Information DHCPv6 Option 17 vendor specific information provides more configuration options to the iSCSI client In this configuration three additional suboptions are provided that assign the initiator IQN to the iSCSI boot client along with two iSCSI target IQNs t
207. e Swapfile Location Security Profile Host Cache Configuration Standard Switch vSwitch1 Remove Properties System Resource Allocation VMkemel Port Physical Adapters Agent VM Settings L3 vMkernel MN e TE s vinei 10000 Full 5A Advanced Settings vmkl 172 18 100 101 Lx ER vmnico K NOTE ESXi 5 1 has a limitation in that a VLAN ID change for a boot device is not possible It works only for non boot devices Configuring FCoE Boot from SAN on VMware Note that each host must have access only to its own boot LUN not to the boot LUNs of other hosts Use storage system software to ensure that the host accesses only the designated LUNs Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 221 NetXtreme II User Guide March 2014 BOOTING FROM SAN AFTER INSTALLATION Now that boot configuration and OS installation are complete you can reboot and test the installation On this and all future reboots no other user interactivity is required Ignore the CTRL D prompt and allow the system to boot through to the FCoE SAN LUN At this time if additional redundant failover paths are desired you can configure those paths through CCM and the MBA will automatically failover to secondary paths if the first path is not available Further the redundant boot paths will yield redundant paths visible through host MPIO software allowing for a fault tolerant configuration opyright C 26000 2011 Broadcom
208. e adapter is installed Device Number The number assigned to the adapter by the operating system Function Number The port number of the adapter For a single port adapter the function number is 0 For a two port adapter the function number for the first port is 0 and the function number for the second port is 1 MENU EE Broadcom Corporation Page 240 Managing the Network Adapter Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Interrupt Request The interrupt line number that is associated with the adapter Valid numbers range from 2 to 25 Memory Address The memory mapped address that is assigned to the adapter This value can never be 0 MSI Version This is the Message Signaled Interrupts MSI version being used The option MSI corresponds to the PCI 2 2 specification that supports 32 messages and a single MSI address value The option MSI X corresponds to the PCI 3 0 specification that supports 2 048 messages and an independent message address for each message O E Broadcom Corporation Document INGSRVT710 CDUM100 R Managing the Network Adapter Page 241 NetXtreme II User Guide March 2014 VIEWING HARDWARE INFORMATION The Hardware section of the Information tab displays information about the hardware settings for the selected network adapter k Information Tab Hardware NOTE Some information may not be available for all Broadcom network adapters ASIC Version The chip version of the Broadcom
209. e broken into multiple collision domains The switch is responsible for forwarding Ethernet packets between hosts based solely on Ethernet MAC addresses A physical network adapter that is attached to a switch may operate in half duplex or full duplex mode To support Generic Trunking and 802 3ad Link Aggregation a switch must specifically support such functionality If the switch does not support these protocols it may still be used for Smart Load Balancing k Router NOTE All modes of network teaming are supported across switches when operating as a stackable switch A router is designed to route network traffic based on Layer 3 or higher protocols although it often also works as a Layer 2 device with switching capabilities The teaming of ports connected directly to a router is not supported MEM EE Broadcom Corporation Page 22 Executive Summary Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 TEAMING SUPPORT BY PROCESSOR All team types are supported by the IA 32 AMD 64 and EM64T processors CONFIGURING TEAMING The Broadcom Advanced Control Suite utility is used to configure teaming in the supported operating system environments The Broadcom Advanced Control Suite BACS utility is designed to run on 32 bit and 64 bit Windows family of operating systems BACS is used to configure load balancing and fault tolerance teaming and VLANs In addition it displays the MAC address driver version and statu
210. e click Trusted Hosts In the TrustedHostsList enter the host names of the clients If all clients are trusted then enter an asterisk only Select WinRM Service Ue IO SL Enable Allow Basic Authentication Generate a Self Signed Certificate for Windows Linux Server Openssl on Linux or Windows can be used to generate the self signed certificate as follows 1 Enter the following command to generate a private key openssl genrsa des3 out server key 1024 2 You are prompted to enter a passphrase Be sure to remember the passphrase Use the following steps to generate a Certificate Signing Request CSR During the generation of the CSR you are prompted for several pieces of information When prompted for the Common Name enter the Windows Server host name or IP address Enter the following command sample responses are shown openssl req new key server key out server csr If this command does not work try the following openssl req new key server key out server csr config openssl cnf The openssl cnf file should be placed in the same directory where openssl is placed Openssl cnf is located in the folder C Program Files x86 GnuWin32 share The following information is requested e Country Name 2 letter code US e State or Province Name full name California e Locality Name e g city Irvine e Organization Name e g company Broadcom Corporation e Organizational Unit Name e g secti
211. e following command to start Pegasus etc init d tog pegasus start k NOTE If your system has Red Hat Security Enhancement for tog pegasus enabled disable it before connecting to BACS See usr share doc tog pegasus 2 5 2 README RedHat Security for details To disable it remove the line from etc pam d wbem k NOTE On SuSE Linux the Inbox OpenPegasus RPM is not available OpenPegasus must be installed from source as described in the following section Note that in inbox Pegasus HTTP is not enabled by default After Inbox OpenPegasus is installed successfully if no further configuration is required then follow the instructions in Install Broadcom CMPI Provider To enable HTTP see Enable HTTP KL NOTE After the server is rebooted the CIM server must be manually restarted to enable the client to reconnect to the server This is a known limitation of Red Hat v6 2 Inbox RPM E Broadcom Corporation Document INGSRVT710 CDUM100 R Detailed Procedures Page 123 NetXtreme II User Guide March 2014 Install OpenPegasus From Source Red Hat and SuSE The OpenPegasus source can be downloaded from www openpegasus org k NOTES e f not already installed download and install the openssl and libopenssl devel rom This step is optional and required only if you are planning to use HTTPS to connect the client to the managed host e n some cases if OpenPegasus installation fails openssl must be installed
212. e located on your O S installation media uu Broadcom Corporation Page 146 Installing Linux Driver Software Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 5 For SLES turn on the fcoe and lldpad services For SLES11 SP1 chkconfig lldpad on chkconfig fcoe on For SLES11 SP2 chkconfig boot lldpad on chkconfig boot fcoe on 6 Inbox drivers are included with all of the supported operating systems The simplest means to ensure the newly installed drivers are loaded is to reboot 7 After rebooting create configuration files for all FCoE ethX interfaces cd etc fcoe cp cfg ethx cfg ethX FCoE interface name gt Go NOTE Note that your distribution might have a different naming scheme for Ethernet devices i e pXpX or emX instead of ethX Modify etc fcoe cfg lt interface gt by setting DCB_REQUIRED yes to DCB_REQUIRED no 9 Turn on all ethX interfaces ifconfig ethX up 10 For SLES use YaST to configure your Ethernet interfaces to automatically start at boot by setting a static IP address or enabling DHCP on the interface 11 Disable lldpad on Broadcom CNA interfaces This is required because Broadcom utilizes an offloaded DCBX client lldptool set lldp i ethX adminStatus disasbled 12 Make sure var lib lldpad lldpad conf is created and each lt ethX gt block does not specify adminStatus or if specified it is set to O adminStatus 0 as below Lidp 3 eth5
213. e loop E Broadcom Corporation Document INGSRVT710 CDUM100 R Load Balancing and Fault Tolerance Page 11 NetXtreme II User Guide March 2014 determination when failing over LiveLink mitigates such issues TEAMING AND LARGE SEND OFFLOAD CHECKSUM OFFLOAD SUPPORT Large Send Offload LSO and Checksum Offload are enabled for a team only when all of the members support and are configured for the feature E e Broadcom Corporation Page 12 Load Balancing and Fault Tolerance Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Broadcom Teaming Services Broadcom NetXtreme II Network Adapter User Guide NOTE This chapter describes teaming for adapters in Windows Server systems For more information on a similar technologies on other operating systems for example Linux Channel Bonding refer to your operating system documentation e Executive Summary e Teaming Mechanisms e Teaming and Other Advanced Networking Properties e General Network Considerations e Application Considerations e Troubleshooting Teaming Problems e Frequently Asked Questions e Appendix A Event Log Messages EXECUTIVE SUMMARY e Glossary e Teaming Concepts e Software Components e Hardware Requirements e Teaming Support by Processor e Configuring Teaming e Supported Features by Team Type e Selecting a Team Type This section describes the technology and implementation considerations when working with the network teaming service
214. e team members from the Team Members list by clicking the adapter and then clicking Remove Click Next NOTE There must be at least one Broadcom network adapter assigned to the team The TCP Offload Engine TOE Large Send Offload LSO and Checksum Offload CO columns indicate if the TOE LSO Jumbo MTU and or the CO properties are supported for the adapter The TOE LSO Jumbo MTU and CO properties are enabled for a team only when all of the members support and are configured for the feature If this is the case then the team offload capabilities appear on the bottom of the screen NOTES e Adding a network adapter to a team where its driver is disabled may negatively affect the offloading capabilities of the team This may have an impact on the team s performance Therefore it is recommended that only driver enabled network adapters be added as members to a team Ul Broadcom Teaming Wizard Lreating Madilying a Team Assigning Team Members fl Specify which adapters to include in the team BROADCOM Include adapters that you wish to set for the standby role P Available Adapters Res Teamable NDIS MTU 0015 Broadcom HetEtreme Gigabit Ethernet 3 Yes amp 20 S00 0018 Broadcom HetEtreme Gigabit Ethernet 4 Yes 6 20 1500 Team Members Teamable MDIS 0014 Broadeom Hetztreme Gigabit Ethernet 2 Yes 6 20 0007 Broadcom Hetztreme Gigabit Ethernet Yes 620 Team Offload Capabilities L5O CO R55 Team
215. e tpa The optional parameter disable tpa can be used to disable the Transparent Packet Aggregation TPA feature By default the driver will aggregate TCP packets but if you would like to disable this advanced feature it can be done Set the disable tpa parameter to 1 as shown below to disable the TPA feature on all NetXtreme Il network adapters in the system vmkload mod bnx2x ko disable tpa 1 Use ethtool to disable TPA LRO for a specific network adapter num rx queues The optional parameter num rx queues may be used to set the number of Rx queues on kernels starting from 2 6 24 when multi mode is set to 1 and interrupt mode is MSI X Number of Rx queues must be equal to or greater than the number of Tx queues see num tx queues parameter If the interrupt mode is different than MSI X see int mode parameter then then the number of Rx queues will be set to 1 discarding the value of this parameter num tx queues The optional parameter num tx queues may be used to set the number of Tx queues on kernels starting from 2 6 27 when multi mode is set to 1 and interrupt mode is MSI X The number of Rx queues must be equal to or greater than the number of Tx queues see num rx queues parameter If the interrupt mode is different than MSI X see int mode parameter then the number of Tx queues will be set to 1 discarding the value of this parameter pri map The optional parameter pri map is used to map the VLAN PHI value or the IP DSCP val
216. e virtual adapter created by a team Directly binding a Guest operating system to a team virtual adapter may not render the desired results K NOTE As of this writing Windows Server 2008 is not a supported operating system for Microsoft Virtual Server 2005 thus teaming may not function as expected with this combination TEAMING ACROSS SWITCHES SLB teaming can be configured across switches The switches however must be connected together Generic Trunking and Link Aggregation do not work across switches because each of these implementations requires that all physical adapters in a team share the same Ethernet MAC address It is important to note that SLB can only detect the loss of link between the ports in the team and their immediate link partner SLB has no way of reacting to other hardware failures in the switches and cannot detect loss of link on other ports Switch Link Fault Tolerance The diagrams below describe the operation of an SLB team in a switch fault tolerant configuration We show the mapping of the ping request and ping replies in an SLB team with two active members All servers Blue Gray and Red have a continuous ping to each other Figure 3 is a setup without the interconnect cable in place between the two switches Figure 4 has the interconnect cable in place and Figure 5 is an example of a failover event with the Interconnect cable in place These scenarios describe the behavior of teaming across the two switches and
217. een bound with Internet Protocol IP IPv6 IP Address The IPv6 network address associated with the adapter MAC Address A physical MAC media access control address that is assigned to the adapter by the manufacturer The physical address is never all Os Permanent MAC Address The unique hardware address assigned to the network adapter Offload Capabilities The offload capabilities supported by the adapter This information is only available for Broadcom NetXtreme II adapters e TOE TCP Offload Engine TOE allows simultaneous operation of up to 1024 fully offloaded TCP connections for 1 Gbps network adapters and 1880 fully offloaded TCP connections for 10 Gbps network adapters to the hardware e iSCSI iSCSI offload for block level transfer of data e LSO Large Send Offload LSO prevents an upper level protocol such as TCP from breaking a large data packet into a series of smaller packets with headers appended to them e CO Checksum Offload CO allows the TCP IP UDP checksums for send and receive traffic to be calculated by the adapter hardware rather than by the host CPU Information Tab SR IOV Switch Information Number of HW Available Configure the number of available HW Number of Available VFs Configure the number of available Virtual Functions VF Max VF Chains Per VFs Enter the number of maximum chains per Virtual Function VF VF Chains Pool Size Enter the pool size of Virtual Function VF chains Switch Fr
218. egasus is installed properly before installing CMPI Provider Install Enter following command to install Broadcom CMPI Provider rpm i BRCM CMPIProvider version arch rpm Uninstall Enter following command to uninstall Broadcom CMPI Provider rpm e BRCM CMPIProvider Perform Linux Firewall Configuration If Required Follow these procedures to open the appropriate ports in the firewall RedHat Click System select Administration and then select Firewall Select Other Ports In the Port and Protocol Dialog box select User Defined In the Port Port Range field add the port number In the Protocol field add the protocol as TCP or UDP etc Sy EU ee qu urs Click Apply for the firewall rules to take effect Example e For CIM XML over HTTP the port number is 5988 and protocol is TCP e For CIM XML over HTTPs the port number is 5989 and protocol is TCP SuSE Click Compute and then click YaST Select Security amp Users on the left pane On the right pane double click Firewall Select Custom Rules on the left pane On the right pane click Add OP MN um Ge ucc Enter the following values e Source Network 0 0 means all e Protocol TCP or the appropriate protocol e Destination Port Port Number or Hange of Port Numbers e Source Port Leave blank 7 Click Next and then click Finish for the firewall rules to take effect Example For CIM XML use the following values E
219. egwati POLSKI Mimejszy produkt zostal okreslony jako zgodny z dyrektywa miskonameciowa 2006 95 WE 1 Polish dyrektyw zgodno ci elektramagnetyczne 2004 108 WE oraz poprawkami do mech Zgodme ze stosownymi dyrektywami 1 normami zostala sporz dzona Deklaracja zgodnosc ktora jest dostepna w aktach Army Broadcom Corporation 190 Mathilda Place Sunnyvale Cahfomia 94086 USA Unia Europejska klasa B Nimejsze urzadzenie firmy Broadcom zostalo zakwalifikowane do klasy B do u ytku w typowych srodowiskach domowych Umia Europejska klasa A OSTRZE ENIE Urz dzenie to jest urzadzeniem klasy A W wanmkach domowych urz dzenie to mo e wywo ywa zak cenia o czestotliwosci radiowaj wymagaj ce od u ytkownika podj cia dpowiedmch dzialan zaradezych ROMAN S a stabili ca acest produs respecta cenntele Directwer 2006 93 CE puvimd echipamentele de Romanian joasi tensiune ale Directivei 2004 108 CE Directiva EMC privind compatibilitatea electromagzetic 31 ale amendamentelor Unnum Europene Conform directivelor 51 standardelor de mai sus a fost emusa o Declaratie de Conformitate arhivat la sediul Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA Uniunea Europeana Clasa B Acest echipament Broadcom este clasificat pentru utilizare mtr un medii casmic tipice de Clasa B Uniunea Europeana Clasa A f AVERTISMENT Acesta este un produs din Clasa A In medml casnic acest produs poate cauza interferente radio caz 1n
220. elcome to the Broadcom Teaming Wizard BROADCOM The Broadcom Teaming Wizard will quide vau through the process of creating and modifying teams and or VLANs To continue click Next To Work without the wizard click Expert Mode Expert Mode Mote Current work in the Teaming Wizard will be lost when Expert Mode is clicked To always start in Expert Mode check the Default to Expert Mode on next start checkbox Default to Expert Mode on next start z Back Next gt Preview ina Mu Broadcom Corporation Page 266 Configuring Teaming Document INGSRVT710 CDUM 100 R User Guide NetXtreme II March 2014 3 Type the team name and then click Next If you want to review or change any of your settings click Back Click Cancel to discard your settings and exit the wizard NOTE The team name cannot exceed 39 characters cannot begin with spaces and cannot contain any of the following characters amp lt gt G60 Broadcom Teaming Wizard Creating Modifying a Team Team Name You must assign your team a unique name BROADCOM gn y q aN RE ub i Enter the name For the Eeam Team 1 i 4 team name has a maximum length of 39 characters The name can use any symbolic character except d To tre Goa Lema Ge rn O Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 267 NetXtreme II User Guide March 2014 Select the type of team you want to create Select Enable Hyper
221. elong to hba SUSER CHOSEN HBA where ROUTE HBA gt net device on which connection was offloaded based on route information USER CHOSEN _ HBA gt HBA to which target node is bound using iscsi transport name Target cannot be reached on any of the CNIC devices bnx2i check route cannot connect using cnic Network route is assigned to network interface which is down bnx2i check route hba not found Attempting to offload iSCSI connection onto a Jumbo Frame enabled device eth network i f mtu is set to mtu iSCSI HBA can support mtu of 1500 bnx21i bnx21i K SCSI ML initiated host reset session recovery NOTE Change mtu to 1500 using ifconfig and restart the interface in order to offload iSCSI connections bnx2i attempting to reset host 3 CNIC detects iSCSI protocol violation Fatal errors bnx2i iscsi error wrong StatSN rcvd bnx2i J9S051 error hdr digest err bnx2i 90851 error data digest err bnx2i iscsi error wrong opcode rcvd bnx2i iscsi error AHS len gt 0 rcvd bnx2i 185081 error invalid ITT reve bnx2i iscsi_error wrong StatSN rcvd bnx2i iscsi error wrong DataSN rcvd bnx2i 15081 error pend R2T violation bnx2i iscsi error ERLO UO bnx21 iscsi error ERLO Ul bnx2i iscsi error ERLO U2 bnx2i 18081 rror ERLO U3 bnx2i iscsi error ERLO U4 bnx2i iscsi error ERLO U5 bnx2i iscsi error ERLO U bnx2i iscsi_error invalid resi len bnx2i iscsi_error
222. elp Filter TEAM VIEW Explorer View S B88 Hosts S ff BACS WIN7 g CI Teams iii Team 1 Team Type Smart Load Balancing TM and Failover E f BASP Virtual Adapters Team Offload Capabilities L50 CO RSS 777 VLANI 0019 BAS Team MTU 1500 E Primary Adapters Driver Name Basp sys IAS Unassigned Adapters Driver Version 1 4 10 Driver Date 4 12 2011 Information Team Properties E Team Properties H Team Name Team 1 Team Properties Displays information about the team USING EXPERT MODE Use Expert Mode to create a team modify a team add a VLAN and configure LiveLink for a Smart Load Balance and Failover and SLB Auto Fallback Disable team To create a team using the wizard see Using the Broadcom Teaming Wizard To set the default Teaming Mode select Options from the Tools menu In the Options window click the General tab then select Expert Mode or Wizard Mode the default is Wizard Mode Creating a Team r4 NOTE Enabling Dynamic Host Configuration Protocol DHCP is not recommended for members of an SLB type of team 1 From the Teams menu select Create a Team or right click one of the devices in the Unassigned Adapters section and select Create a Team This option is not available if there are no devices listed in the Unassigned Adapters sections which means all adapters are already assigned to teams 2 Click Expert
223. em for processing a request 31 Error Initiator could not allocate resource for processing a request 32 Information Initiator received an asynchronous logout message The Target name is given in the dump data 33 Error Challenge size given by the target exceeds the maximum specified in iSCSI specification 34 Information A connection to the target was lost but Initiator successfully reconnected to the target Dump data contains the target name 35 Error Target CHAP secret is smaller than the minimum size 12 bytes required by the specification 36 Error Initiator CHAP secret is smaller than the minimum size 12 bytes required by the specification Dump data contains the given CHAP secret 37 Error FIPS service could not be initialized Persistent logons will not be processed 38 Error Initiator requires CHAP for logon authentication but target did not offer CHAP 39 Error Initiator sent a task management command to reset the target The target name is given in the dump data 40 Error Target requires logon authentication via CHAP but Initiator is not configured to perform CHAP 41 Error Target did not send AuthMethod key during security negotiation phase 42 Error Target sent an invalid status sequence number for a connection Dump data contains Expected Status Sequence number followed by the given status sequence number 43 Error Target failed to respond in time for a login request 44 Error Target failed to respond in time for a logo
224. en planning for Layer 2 teaming For TOE teaming only Smart Load Balancing and Failover type team is supported The primary rationale for teaming is the need for additional network bandwidth and fault tolerance Teaming offers link aggregation and fault tolerance to meet both of these requirements Preference teaming should be selected in the following order Link Aggregation as the first choice Generic Trunking as the second choice and SLB teaming as the third choice when using unmanaged switches or switches that do not support the first two options if switch fault tolerance is a requirement then SLB is the only choice see Figure 1 Figure 1 Process for Selecting a Team Type Do you need additiana Mo network bandwidth or fault tolerance Do you need switch fault tolerance 7 Are You Using a switch that supports IEEE B02 Sad LACP Set Up a Dynamic Trunking Tearn Are you using a Set up a Generic switch that supports Static Trunking Team Trnking FECIGEC Set up an SLE Team O Broadcom Corporation Document INGSRVT710 CDUM100 R Executive Summary Page 25 NetXtreme II User Guide March 2014 TEAMING MECHANISMS e Architecture e Types of Teams e Attributes of the Features Associated with Each Type of Team e Speeds Supported for Each Type of Team ARCHITECTURE The Broadcom Advanced Server Program is implemented as an NDIS intermediate driver see Figure 2 It operates below protocol stacks such as TCP IP an
225. ent where TargetInstance ISA BRCM ActsAsSpare MM EE Broadcom Corporation Page 66 Manageability Broadcom NetXtreme I9 Network Adapter User Guide Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 For detailed information about these events see the CIM documentation at http www dmtf org sites default files standards documents DSP0004V2 3 final pdf Broadcom also implements the Storage Management Initiative Specification SMI S which defines CIM management profiles for storage systems EF VENUE Broadcom Corporation Document INGSRVT710 CDUM100 R CIM Page 67 NetXtreme II User Guide March 2014 SNMP BASP SUBAGENT The BASP subagent baspmgnt dll is designed for the Windows Server 2008 and Windows Server 2008 R2 SNMP service It is required to install the SNMP service before installing the BASP subagent The BASP subagent allows an SNMP manager software to actively monitor the configurations and performance of the Broadcom Advanced Server features The subagent also provides an alarm trap to an SNMP manager to inform the manager of any changes to the conditions of the BASP component The BASP subagent allows monitoring of the configurations and statistics for the BASP teams the physical NIC adapters participating in a team and the virtual NIC adapters created as the result of teaming Non teamed NIC adapters are not monitored at this time The BASP configuration data includes information such as team IDs
226. er The intermediate driver cannot be upgraded through the Local Area Connection Properties It must be upgraded using the Setup installer Question How can determine the performance statistics on a virtual adapter team Answer In Broadcom Advanced Control Suite click the Statistics tab for the virtual adapter Question Can configure NLB and teaming concurrently Answer Yes but only when running NLB in a multicast mode NLB is not supported with MS Cluster Services Question Should both the backup server and client servers that are backed up be teamed Answer Because the backup server is under the most data load it should always be teamed for link aggregation and failover A fully redundant network however requires that both the switches and the backup clients be teamed for fault tolerance and link aggregation MM Broadcom Corporation Page 54 Frequently Asked Questions Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Question During backup operations does the adapter teaming algorithm load balance data at a byte level or a session level Answer When using adapter teaming data is only load balanced at a session level and not a byte level to prevent out of order frames Adapter teaming load balancing does not work the same way as other storage load balancing mechanisms such as EMC PowerPath Question Is there any special configuration required in the tape backup software or hardware to work with adap
227. er Guide NetXtreme Il March 2014 team must use a unique MAC address to be IEEE compliant It is important to note that ARP cache entries are not learned from received frames but only from ARP requests and ARP replies Description of Teaming Types e Smart Load Balancing and Failover e Generic Trunking e Link Aggregation IEEE 802 3ad LACP e SLB Auto Fallback Disable There are three methods for classifying the supported teaming types e One is based on whether the switch port configuration must also match the adapter teaming type e The second is based on the functionality of the team whether it supports load balancing and failover or just failover e The third is based on whether the Link Aggregation Control Protocol is used or not Table 2 shows a summary of the teaming types and their classification Table 2 Available Teaming Types Switch Dependent Link Aggregation a Control Protocol Teaming Type Switch must support Support Required on Load Balancing Failover specific type of team the Switch Smart Load Balancing and Failover with two to eight load balance v team members SLB Auto Fallback Disable Link Aggregation 802 3ad Generic Trunking FEC GEC 802 3ad Draft Static zi zi zi Smart Load Balancing and Failover The Smart Load Balancing and Failover type of team provides both load balancing and failover when configured for load balancing and only failover when configured for fa
228. er enables MSI if it is supported by the kernel It runs an interrupt test during initialization to determine if MSI is working If the test passes the driver enables MSI Otherwise it uses legacy INTx mode insmod bnx2 ko disable msi 1 or modprobe bnx2 disable msi 1 BNX2X DRIVER disable tpa The disable tpa parameter can be supplied as a command line argument to disable the Transparent Packet Aggregation TPA feature By default the driver will aggregate TCP packets Use disable tpa to disable the advanced TPA feature Set the disable tpa parameter to 1 as shown below to disable the TPA feature on all NetXtreme ll network adapters in the system The parameter can also be set in modprobe conf See the man page for more information insmod bnx2x ko disable tpa 1 or modprobe bnx2x disable tpa 1 int_mode The int_mode parameter is used to force using an interrupt mode Set the int mode parameter to 1 to force using the legacy INTx mode on all NetXtreme II adapters in the system insmod bnx2x ko int mode 1 or modprobe bnx2x int mode 1 Set the int mode parameter to 2 to force using MSI mode on all NetXtreme ll adapters in the system insmod bnx2x ko int mode 2 or modprobe bnx2x int mode 2 Set the int mode parameter to 3 to force using MSI X mode on all NetXtreme II adapters in the system ME EEUU Broadcom Corporation Page 152 Setting Values for Optional Properties Document INGSRVT710 CDUM100 R User Guide NetX
229. ers are located on the installation CD e To use the TCP IP Offload Engine TOE you must have Windows Server 2008 or Windows Server 2008 R2 You must also have a license key preprogrammed in the hardware If supported for iSCSI you only need a license key e BACS is not supported on the Server Core installation option for Microsoft Windows Server 2008 R2 USING THE INSTALLER If supported and if you will use the Broadcom iSCSI Crash Dump utility it is important to follow the installation sequence e Run the installer e Install the Microsoft iSCSI Software Initiator along with the patch MENU EE Broadcom Corporation Page 180 Windows Driver Software Broadcom NetXtreme II9 Network Adapter User Guide Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 To install the Broadcom NetXtreme ll drivers 1 When the Found New Hardware Wizard appears click Cancel Insert the installation CD into the CD or DVD drive 3 On the installation CD open the folder for your operating system open the Drvinst folder and then double click Setup exe to open the InstallShield Wizard Click Next to continue 5 After you review the license agreement click accept the terms in the license agreement and then click Next to continue Select how you want to install the NetXtreme II drivers and then click Next Click Install Click Finish to close the wizard o oND The installer will determine if a system restart is necessary
230. et to a value of 1000 K Duplex Specifies the duplex mode of the network adapter Requires a setting of either Half or Full When this keyword is used the LineSpeed keyword must also be used If neither keyword is used the network adapter defaults to auto negotiation mode K NodeAddress Specifies the network address used by the network adapter If a multicast address or a broadcast address is specified the adapter uses the default MAC address NOTE LineSpeed is not available with the Broadcom NetXtreme II 10 Gigabit Ethernet driver NOTE LineSpeed is not available with the Broadcom NetXtreme II 10 Gigabit Ethernet driver Example BXND2 0X DriverName BXND20X BusNum 3 DevNum 14 PortNum 2 LineSpeed 1000 Duplex Full NodeAddress 001020304050 FixCheckSumOff Turns off the driver s workaround for the TCP IP stack to recognize the 1s complemented version of the checksum uu Broadcom Corporation Page 140 Using Keywords for the Drivers Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 AcceptAIIMC Informs the driver to deliver all multicast packets to the upper protocol M Broadcom Corporation Document INGSRVT710 CDUM100 R Using Keywords for the Drivers Page 141 NetXtreme II User Guide March 2014 Linux Driver Software Broadcom NetXtreme II9 Network Adapter User Guide e Introduction e Limitations e Packaging e Installing Linux Driver Software e Unloa
231. etXtreme II network adapters in your system Broadcom NetXtreme Il User Diagnostics also allows you to update device firmware and to view and change settings for available adapter properties There are two versions of the Broadcom NetXtreme II User Diagnostics uxdiag exe for BCM5706 BCM5708 BCM5709 network adapters and uediag exe for BCM57710 network adapters To run Broadcom NetXtreme ll User Diagnostics create an MS DOS 6 22 bootable disk containing the uxdiag exe or uediag exe file Next start the system with the boot disk in drive A See Performing Diagnostics for further instructions on running diagnostic tests on Broadcom network adapters SYSTEM REQUIREMENTS Operating System MS DOS 6 22 Software uxdiag exe BCM5706 BCM5708 BCM5709 or uediag exe BCM57710 Eu Broadcom Corporation Document INGSRVT710 CDUM100 R User Diagnostics in DOS Broadcom NetXtreme I9 Network Adapter User Guide Page 305 User Guide March 2014 NetXtreme Il PERFORMING DIAGNOSTICS At the MS DOS prompt type uxdiag for BCM5706 BCM5708 BCM5709 network adapters or uediag for BCM577XX and BCM578XX network adapters followed by the command options The uxdiag command options are shown in Table 1 and the uediag command options are shown in Table 2 For example to run all diagnostic tests on adapter 1 except Group B tests C gt uxdiag c 1 t b ra NOTE You must include uxdiag or uediag at the beginning of the command string each time y
232. etting for revision 1 6 x and newer has been changed to Rx Off and Tx Off because SFP devices do not support Autonegotiation for Flow Control Problem On kernels older than 2 6 16 when 16 partitions are created on a server containing two BCM57711 network adapters not all partitions would come up and an error indicating a shortage of space would display Solution On architectures where the default vmalloc size is relatively small and not sufficient to load many interfaces use vmalloc size during boot to increase the size Problem Routing does not work for NetXtreme Il 10 GbE network adapters installed in Linux systems Solution For NetXtreme Il 10 GbE network adapters installed in systems with Linux kernels older than 2 6 26 disable TPA with either ethtool if available or with the driver parameter see disable tpa Use ethtool to disable TPA LRO for a specific NetXtreme Il 10 GbE network adapter Problem On a NetXtreme Il 1 GbE network adapter in a CNIC environment flow control does not work Solution Flow control is working but in a CNIC environment it has the appearance that it is not The network adapter is capable of sending pause frames when the on chip buffers are depleted but the adapter also prevents the head of line blocking of other receive queues Since the head of line blocking causes the on chip firmware to discard packets inside the on chip receive buffers in the case a particular host queue is depleted the on ch
233. etwork test are displayed in the Status field To run the network test using the BACS CLI You can use the following CLI command to perform a network diagnostic test for the specified target This command is available for NDIS and virtual adapters BACScli t target type f target format i target ID networkdiag p IP address gt Examples 1 The following command runs the network test for the current selected NDIS adapter BACScli t NDIS f mac i 0010181alb1c networkdiag p 192 168 1 5 2 The following command runs the network test for the current selected virtual adapter Since there is no IP address specified BACScli will use gateway address for the test BACScli t VNIC f mac i 0010181albl1c networkdiag In Interactive mode use the 1ist view and select idx commands to select the desired target device Use networkdiag p IP address torun the network diagnostics test for the selected target Examples 1 The following command runs the network test for the currently selected NDIS adapter networkdiag p 192 168 1 5 2 The following command runs the network test for the current selected virtual adapter networkdiag MENU EE Broadcom Corporation Page 246 Managing Ethernet Controller Port Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 RUNNING DIAGNOSTIC TESTS IN WINDOWS The Diagnostic Tests option on the Diagnostics tab lets you check the state of the physical co
234. feet twisted pairs UTP 100 1000BASE T HJ 45 Category 5 UTP 100m 328 feet 1000BASE T signaling requires four twisted pairs of Category 5 balanced cabling as specified in ISO IEC 11801 2002 and ANSI EIA TIA 568 B Category 5 is the minimum requirement Category 5e and Category 6 are fully supported Table 2 10GBASE T Cable Specifications Port Type Connector Media Maximum Distance Category 6A UTP 100m 328 feet 10GBASE T signaling requires four twisted pairs of Category 6 or Category 6A augmented Category 6 balanced cabling as specified in ISO IEC 11801 2002 and ANSI TIA EIA 568 B ME Broadcom Corporation Page 288 Specifications Broadcom NetXtreme I9 Network Adapter User Guide Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 1000 2500BASE X FIBER OPTIC SPECIFICATIONS Table 3 1000 2500BASE X Fiber Optic Specifications Port Type Connector Media Maximum Distance 1000BASE X Small form factor pluggable Multimode fiber MMF 550m 1804 feet SFP transceiver with LC System optimized for 62 5 connection system 50 um graded index fiber Infineon p n V23818 K305 L57 2500BASE X Small form factor pluggable Multimode fiber MMF 550m 1804 feet SFP transceiver with LC System optimized for 62 5 connection system 50 um graded index fiber Finisar p n FTLF8542E2KNV Electricals leveraged from IEEE 802 3ae 2002 XAUI 2500BASE X is term used by Br
235. ffff80 O 18 00 3 ffffff88 0 0 3 4b 20 2a 0 0 2 ffffffcs5 14 0 O 28 400000000 Open iSCSI daemon handing over session to driver bnx2i conn update MBL 0x800 FBL 0x800MRDSL I 0x800 MRDSL T 0x2000 ME EE Broadcom Corporation Page 160 Driver Messages Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 TEAMING WITH CHANNEL BONDING With the Linux drivers you can team adapters together using the bonding kernel module and a channel bonding interface For more information see the Channel Bonding information in your operating system documentation STATISTICS Detailed statistics and configuration information can be viewed using the ethtool utility See the ethtool man page for more information LINUX ISCSI OFFLOAD e Open iSCSI User Applications e User Application brcm iscsiuio e Bind iSCSI Target to Broadcom NX2 iSCSI Transport Name e VLAN Configuration for iSCSI Offload Linux e Making Connections to iSCSI Targets e Maximum Offload iSCSI Connections e Linux iSCSI Offload FAQ OPEN ISCSI USER APPLICATIONS Install and run the inbox open iscsi initiator programs from the DVD Refer to Packaging for details USER APPLICATION BRCM_ISCSIUIO Install and run the brcm_iscsiuio daemon before attempting to create iSCSI connections The driver will not be able to establish connections to the iSCSI target without the daemon s assistance 1 Install the brcm iscsiuio source package tar xvzf
236. figured for the duplex link selected line speed and duplex settings 8 Informational Network controller The adapter has been No action is required configured for 100Mb half manually configured for the duplex link selected line speed and duplex settings 9 Informational Network controller The adapter has been No action is required configured for 100Mb full manually configured for the duplex link selected line speed and duplex settings 10 Informational Network controller The adapter has been No action is required configured for 1Gb half manually configured for the duplex link selected line speed and duplex settings 11 Informational Network controller The adapter has been No action is required configured for 1Gb full manually configured for the duplex link selected line speed and duplex settings 12 Informational Network controller The adapter has been No action is required configured for 2 5Gb full manually configured for the duplex link selected line speed and duplex settings 13 Error Medium not supported The operating system does Reboot the operating system not support the IEEE 802 3 run a virus check run a disk medium check chkdsk and reinstall the operating system 14 Error Unable to register the The device driver cannot Reboot the operating system interrupt service routine install the interrupt handler remove other device drivers that may be sharing the same IRQ 15 Error Unable to map IO sp
237. fload to the boot folder 27 Change the grub menu to point to the new initrd image 28 To enable CHAP you need to modify iscsid conf Red Hat only 29 Reboot and change CHAP parameters if desired 30 Continue booting into the iSCSI Boot image and select one of the images you created non offload or offload Your choice should correspond with your choice in the iSCSI Boot parameters section If HBA Boot Mode was enabled in the iSCSI Boot Parameters section you have to boot the offload image SLES 10 x and SLES 11 do not support offload 31 For IPv6 you can now change the IP address for both the initiator and the target to the desired IPv6 address in the NVRAM configuration SUSE 11 1 Remote DVD installation workaround 1 Create a new file called boot open iscsi with the content shown below 2 Copy the file you just created to etc init d folder and overwrite the existing one Content of the new boot open iscsi file bin bash H Wm eto umnrtid i8Scsr H BEGIN INIT INFO Provides iscsiboot Required Start Should Start boot multipath Required Stop Should Stop Snull Default Start B Default Stop Short Description iSCSI initiator daemon root fs support Description Starts the iSCSI initiator daemon if the root filesystem is on an iSCSI device H END INIT INFO ISCSIADM sbin iscsiadm ISCSIUIO sbin iscsiuio CONFIG FILE etc iscsid conf DAEMON sbin iscsid ARGS c SCONFI
238. for HTTP or 5986 for HTTPS Click Next On the Action screen select Allow the connection and click Next For Profile you can select all three profiles if your server is in a workgroup Specify a name for the rule and click Finish Ensure that the new rule and is enabled the green check box is selected MM EE Broadcom Corporation Page 120 Detailed Procedures Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Windows XP Click Start gt Control Panel and then double click Windows Firewall Click the Exceptions tab Click Add Port Enter a meaningful Name for example WinRM rule and port number for example 5985 for HTTP or 5986 for HTTPS Click OK PS m gt Useful WinRM Commands Command Description winrm quickconfig or winrm qc Configures WinRM with default settings winrm enumerate winrm config Listener or Helps to check which service listener are enabled and listening on winrm e winrm config Listener which port and IP Address winrm get winrm config Service Checks WinRM Service Configuration winrm delete winrm config Deletes a Listener in this case deleting a HTTPS listener Listener Address Transport HTTPS Useful WinRM Websites e http msdn microsoft com en us library aa384372 28v vs 85 29 aspx e http support microsoft com kb 968929 e http blogs technet com b jonjor archive 2009 01 09 winrm windows remote management troubleshooting aspx e http sup
239. for the drivers Once you load the drivers and see your SAN disk s detach or disconnect the USB flash drive immediately before selecting the disk for further installation CONFIGURING FCOE By default DCB is enabled on Broadcom NetXtreme Il FCoE DCB compatible C NICs Broadcom NetXtreme Il FCoE requires a DCB enabled interface For Windows operating systems use either Broadcom Advanced Control Suite BACS or Broadcom s Comprehensive Configuration Management CCM utility to configure the DCB parameters See Using Broadcom Advanced Control Suite for more information on BACS e Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring FCoE Page 223 NetXtreme II User Guide March 2014 PSS Broadcom Corporation Page 224 Configuring FCoE Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Data Center Bridging DCB Broadcom NetXtreme II Network Adapter User Guide e Overview e DCB Capabilities e Configuring DCB e DCB Conditions e Data Center Bridging in Windows Server 2012 OVERVIEW Data Center Bridging DCB is a collection of IEEE specified standard extensions to Ethernet to provide lossless data delivery low latency and standards based bandwidth sharing of data center physical links DCB supports storage management computing and communications fabrics onto a single physical fabric that is simpler to deploy upgrade and maintain than in standard Ethernet networks DCB has a standards based b
240. formance This feature does not work well when jumbo frame is enabled on any of the client devices Enable_cu_rate_limiter should be set to disabled when jumbo frame is enabled Problem When using a BCM57840 4 port adapter in a blade server ports 3 and 4 show no link Solution The I O switch module must support 32 internal ports If it does not ports 3 and 4 cannot establish a link Problem When using a BCM57840 4 port adapter in a blade server ports 3 and 4 show no link Solution The I O switch module must support 32 internal ports If it does not ports 3 and 4 cannot establish a link ELM Broadcom Corporation Page 338 Miscellaneous Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 dfi m ro BG Broadcom Corporation Document INGSRVT710 CDUM100 R Miscelaneous Page 339 NetXtreme II User Guide March 2014 PSS Broadcom Corporation Page 340 Miscellaneous Document INGSRVT710 CDUM100 R
241. four twisted pairs of Category 5 balanced cabling as specified in ISO IEC 11801 2002 and ANSI EIA TIA 568 B Category 5 is the minimum requirement Category 5e and Category 6 are fully supported 10GBASE T signaling requires four twisted pairs of Category 6 or Category 6A augmented Category 6 balanced cabling as specified in ISO IEC 11801 2002 and ANSI TIA EIA 568 B 2 Connect one end of the cable to the RJ 45 connector on the adapter 3 Connect the other end of the cable to an RJ 45 Ethernet network port Fiber Optic 1 Select an appropriate cable Table 2 lists the fiber optic cable requirements for connecting to 1000 2500BASE X ports Table 2 1000 2500BASE X Fiber Optic Specifications Port Type Connector Media Maximum Distance 1000BASE X omall form factor SFF Multimode fiber MMF 550m 1804 ft transceiver with LC System optimized for 62 5 connection system 50 um graded index fiber Infineon p n V23818 K305 L57 2500BASE X omall form factor SFF Multimode fiber MMF 550m 1804 ft transceiver with LO System optimized for 62 5 connection system 50 um graded index fiber Finisar p n FTLF8542E2KNV Electricals leveraged from IEEE 802 3ae 2002 XAUI 2500BASE X is term used by Broadcom to describe 2 5 Gbit s 3 125GBd operation LC is a trademark of Lucent Technologies 2 Connect one end of the cable to the fiber optic connector on the adapter 3 Connect the other end of the cable to an
242. function on the network e f DCB is enabled on the interface DCBX is automatically enabled and carried out automatically once a link is established e f DCBX fails to synchronize with a compatible peer the adapter will automatically fall back to default NIC behavior no priority tagging no PFC no ETS e By default the port will advertise itself as willing and as such will accept all DCB settings as advertised by the switch e f PFC is operational PFC settings supersede link level flow control settings If PFC is not operational link level flow control settings prevail e n NIC Partitioned enabled configurations ETS if operational overrides the Bandwidth Weights assigned to each function Transmission selection weights are per protocol per ETS settings instead Maximum bandwidths per function are still honored in the presence of ETS e n the absence of an iSCSI or FCoE application TLV advertised through the DCBX peer the adapter will use the settings taken from the local Admin MIB O Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring DCB Page 227 NetXtreme II User Guide March 2014 DATA CENTER BRIDGING IN WINDOWS SERVER 2012 Windows Server 2012 introduces a new way of managing Quality Of Service QoS at the OS level There are two main aspects of Windows QoS e Avendor independent method for managing DCB settings on NICs both individually and across an entire domain The management interface is provi
243. g command In s hostname pem 100940db 0 Test HTTPS SSL Connection from Linux Client Use the following command to test whether the certificate is installed correctly on Linux curl v capath etc ssl certs https Hostname or IPAddress 5986 wsman If this fails then the certificate is not installed correctly and an error message displays indicating to take corrective action Install BACS Management Application 1 Download the latest BACS management application RPM package 2 Install the RPM package as rpm i BACS version arch rpm To uninstall BACS management application issue following command rpm e BACS ME Broadcom Corporation Page 128 Detailed Procedures Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 WMI WINDOWS Perform the steps in the following two sections only to configure WMI on the Windows server Set up Namespace Security Using WMI Control The WMI Control provides one way to manage namespace security You can start the WMI Control from the command prompt using this command wmimgmt On Windows 9x or Windows NT4 computers that have WMI installed use this command instead wbemcntl exe Alternatively you can access the WMI Control and the Security tab as follows Right click on My Computer and click Manage Double click Services and Applications and then double click WMI Control Right click WMI Control and then click Properties In WMI Control Properties click the Sec
244. ge 165 NetXtreme II User Guide March 2014 tar xvf BRCMbnxe version tar pkgadd d tmp 3 Execute prtconf to determine instance numbers of the NIC 4 ifconfig bnxe instance number plumb 5 ifconfig bnxe instance number ip address netmask up To make these changes permanent 1 Use your favorite text editor and create a file named hostname bnxe instance number in the etc directory Add the IP address of the interface to this file save and exit 2 Add a proper subnet mask to the file etc netmasks UPGRADING THE DRIVER To upgrade the Broadcom driver package to the current version you must first uninstall the previous driver version from the system See Uninstalling Driver Once the previous driver has been removed you can follow any of the installation methods in this document to install the new driver version KL NOTE Do not install multiple instances of the driver on a single system UNINSTALLING DRIVER 1 ifconfig bnxe instance_number down 2 ifconfig bnxe instance number unplumb 3 pkgrm BRCMbnxe CONFIGURING THE DRIVER The bnxe driver can be configured via the bnxe conf file installed under kernel drv When this config file is modified the system must be either rebooted or the driver unloaded and reconfigured using the update drv admin command All configuration can be specified per instance The format used is as follows and each line must end with a semicolon bnxe tt config item
245. ged to try to correct the interference by one or more of the following measures e Reorient the receiving antenna e Relocate the system with respect to the receiver e Move the system away from the receiver e Plug the system into a different outlet so that the system and receiver are on different branch circuits Do not make mechanical or electrical modifications to the equipment ra NOTE If the device is changed or modified without permission of Broadcom the user may void his or her authority to operate the equipment VCCI NOTICE CLAss B Broadcom NetXtreme ll Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA S o Broadcom Corporation Document INGSRVT710 CDUM100 R VCCI Notice Page 293 NetXtreme II User Guide March 2014 The equipment is a Class B product based on the standard of the Voluntary Control Council for Interference from Information Technology Equipment VCCI If used near a radio or television receiver in a domestic environment it may cause radio interference Install and use the equipment according to the instruction manual AN CAUTION The potential exists for this equipment to become impaired in the presence of conducted radio frequency energy between the frequency range of 59 66 MHz Normal operation will return upon removal of the RF energy source VCCI Class B Statement Japan OEIL HMUUEEES ERAS TRA VCC OAEI
246. gle adapter can have a logical presence on multiple IP subnets With multiple VLANs in a team a server can have a logical presence on multiple IP subnets and benefit from load balancing and failover For instructions on adding a VLAN to a team see Adding a VLAN for Windows operating systems k NOTE Adapters that are members of a failover team can also be configured to support VLANs Because VLANs are not supported for an Intel LOM if an Intel LOM is a member of a failover team VLANs cannot be configured for that team O Broadcom Corporation Document INGSRVT710 CDUM100 R Adding VLANs to Teams Page 65 NetXtreme II User Guide March 2014 Manageability Broadcom NetXtreme II Network Adapter User Guide e CIM e SNMP e HBA API CIM The Common Information Model CIM is an industry standard defined by the Distributed Management Task Force DMTF Microsoft implements CIM on Windows server platforms Broadcom support CIM on Windows Server and Linux platforms ra NOTE For information on installing a CIM provider on Linux based systems see Linux Management Application Installation Broadcom s implementation of CIM will provide various classes to provide information to users through CIM client applications Note that Broadcom CIM data provider will provide data only and users can choose their preferred CIM client software to browse the information exposed by Broadcom CIM provider Broadcom CIM provider provides information
247. gned to a Hyper V virtual network e A TOE enabled team that is bound to a Hyper V virtual network will report TOE as an offload capability in BACS however TOE will not work This is a limitation of Hyper V Hyper V does not support TOE e n an IPv6 network a team that supports CO and or LSO and is bound to a Hyper V virtual network will report CO and LSO as an offload capability in BACS however CO and LSO will not work This is a limitation of Hyper V Hyper V does not support CO and LSO in an IPv6 network e To successfully perform VLAN tagging for both the host parent partition and the guest child partition with the BASP teaming software you must configure the team for tagging Unlike VLAN tagging with a single adapter tagging cannot be managed by Hyper V when using BASP software e When making changes to a team or removing a team remove the team s binding from all guest OSs that use any of the VNICs in the team change the configuration and then rebind the team s VNICs to the guest OS This can be done in the Hyper V Manager Windows Server 2008 R2 When configuring a team of NetXtreme Il network adapters on a Hyper V system be aware of the following e Create the team prior to binding the team to the Hyper V virtual network e Create a team only with an adapter that is not already assigned to a Hyper V virtual network e A BASP virtual adapter configured for VLAN tagging can be bound to a Hyper V virtual network and is a
248. gram Load RPL iSCSI and Bootstrap Protocol BOOTP K NOTE For iSCSI boot capable LOMs the boot protocol is set via the BIOS See your system documentation for more information ra NOTE If you have multiple adapters in your system and you are unsure which adapter you are configuring press CTRL F6 which causes the port LEDs on the adapter to start blinking Use the UP ARROW DOWN ARROW LEFT ARROW and RIGHT ARROW keys to move to and change the values for other menu items as desired Press F4 to save your settings Press ESC when you are finished Using uEFI 1 e x TJI9 Restart your system Enter the System Setup or Device Setting configuration menu Select the device on which you want to change MBA settings Select MBA Configuration Menu Use the drop down menu to select the boot protocol of choice if boot protocols other than Preboot Execution Environment PXE are available If available other boot protocols include iSCSI FCoE and Bootstrap Protocol BOOTP a Broadcom Corporation Document INGSRVT710 CDUM100 R Setting Up MBA in a Client Environment Page 77 NetXtreme II User Guide March 2014 k NOTE For iSCSI boot capable LOMs the boot protocol is set via the BIOS See your system documentation for more information 6 Use the UP ARROW DOWN ARROW LEFT ARROW and RIGHT ARROW keys to move to and change the values for other menu items as desired 7 Select Back to go to Main me
249. gs c Click Apply to save 5 For each new interface edit etc sysconfig network scripts ifcfg lt INTERFACE gt to add the line NM CONTROLLED no Modifying these files automatically causes a restart to the network service This may cause the system to appear to hang briefly It is best to ensure that redundant multipath paths are available before performing this operation SLES 11 SP2 and Above On SLES11 SP2 if the system boots through an initiator that has not been configured as an FCoE interface during installation the system will fail to boot To add new boot paths the system must boot up through the configured FCoE interface 1 Configure a new FCoE interface that will be added as a new path so it can discover the boot LUN a Create a etc fcoe cfg lt INTERFACE gt file for each new FCoE initiator by duplicating the etc fcoe cfg lt INTERFACE gt file that was already configured during initial installation b Bring up the new interfaces ifconfig lt INTERFACE gt up c Restart FCoE service d rcfcoe restart Run multipath 1 to make sure the system has a correct number of multipaths to the boot LUN including new paths Create a etc sysconfig network ifcfg lt INTERFACE gt file for each new interface by duplicating the etc sysconfig network ifcfg INTERFACE file that was already configured during initial installation 4 Create a new ramdisk to update changes mkinitrd MM Broadcom Corporation Docume
250. gured each team should be on a separate network Do not assign a Locally Administered Address on any physical adapter that is a member of a team Verify that power management is disabled on all physical members of any team Remove any static IP address from the individual physical team members before the team is built A team that requires maximum throughput should use LACP or GEC FEC In these cases the intermediate driver is only responsible for the outbound load balancing while the switch performs the inbound load balancing Aggregated teams 802 3ad LACP and GEC FEC must be connected to only a single switch that supports IEEE 802 3a LACP or GEC FEC It is not recommended to connect any team to a hub as hubs only support half duplex Hubs should be connected to a team for troubleshooting purposes only Disabling the device driver of a network adapter participating in an LACP or GEC FEC team may have adverse affects with network connectivity Broadcom recommends that the adapter first be physically disconnected from the switch before disabling the device driver in order to avoid a network connection loss Verify the base Miniport and team intermediate drivers are from the same release package The mixing of base and teaming drivers from different releases is not supported Test the connectivity to each physical adapter prior to teaming Test the failover and fallback behavior of the team before placing into a production environment
251. hardware architecture and destination location copype cmd arch destination For example copype x86 c NVistaPEx86 K 3 Mount the base image to a local directory so that you can add or remove packages by typing imagex mountrw c VistaPEx86 winpe wim 1 c VistaPEx86 mount MM EE Broadcom Corporation Page 184 Inserting the NetXtreme Il Monolithic Driver in a WinPE 2 0 or 3 1 Image Document INGSRVT710 CDUM100 R NOTE The directory structure c VistaPEx86 is used throughout this procedure User Guide NetXtreme Il March 2014 4 Place the monolithic driver and inf file in c drivers x32 by typing peimg inf c Drivers x32 b06nd inf c VistaPEx86 mount windows AIK inserts the driver into the WinPE 2 0 image 5 To complete the customization of the image prepare the image for deployment type peimg prep c VistaPEx86 mount windows 6 When asked to continue and have the program prepare the image for deployment type yes 7 To commit the changes to the original image file Winpe wim type imagex unmount c VistaPEx86 mount commit 8 To replace the default Boot wim file in the ISO directory with your new custom image type copy c VistaPex86 winpe wim c VistaPEx86 ISO sources boot wim To add a device driver to an offline Windows PE image Windows Server 2008 R2 This procedure demonstrates how to use the Deployment Image Servicing and Management DISM tool to add a device driver inf to an offline Windo
252. hat can be used for booting The suboptions are listed below Table 4 DHCP Option 17 Suboption Definition Suboption Definition 201 First iSCSI target information in the standard root path format iscsi lt servername gt lt protocols lt port gt lt LUN gt lt targetname gt 202 Second iSCSI target information in the standard root path format iscsi lt servername gt lt protocols lt port gt lt LUN gt lt targetname gt 203 iSCSI initiator IQN KL The content of option 17 should be 2 byte Option Number 20112021203 2 byte length data NOTE In Table 4 the brackets are required for the IPv6 addresses Configuring the DHCP Server Configure the DHCP server to support Option 16 and Option 17 KL NOTE The format of DHCPv6 Option 16 and Option 17 are fully defined in RFC 3315 ME Broadcom Corporation Page 86 iSCSI Boot Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Preparing the iSCSI Boot Image e Windows Server 2008 R2 and SP2 iSCSI Boot Setup e Windows Server 2012 iSCSI Boot Setup e Linux iSCSI Boot Setup e Injecting Slipstreaming Broadcom Drivers into Windows Image Files Windows Server 2008 R2 and SP2 iSCSI Boot Setup Windows Server 2008 R2 and Windows Server 2008 SP2 support booting as well as installing in either the offload or non offload paths The following procedure prepares the image for installation and booting in eit
253. he IP address For an IPv6 address use brackets around the address e If HTTPS is configured in your system the listener must be deleted before creating a new HTTPS listener Use the following command winrm delete winrm config Listener Address Transport HTTPS j The above command creates a listener on the HTTPS port 5986 using any all network address of the server and my SelfSSL generated certificate k You can use the winrm command to modify or set the HTTPS listener as WinRM listeners can be configured on any user defined port l From command prompt run the following command to verify that the listener s that have been configured winrm e winrm config listener Test HTTPS SSL connection on the server a Atthe command prompt on the server enter the following command winrs r https yourserver 5986 u username p password hostname b If setup correctly the output of the command shows the server host name c To check WinRM Service Configuration run the following command winrm get winrm config service Additional Server Configuration If necessary modify the firewall rules as follows Windows Server 2008 H2 1 2 gt o OND HT From the Administrative Tools menu open Windows Firewall with Advanced Security Right click Inbound Rules and select New Rule The new rule wizard opens Select Port and click Next On the Protocol and Ports screen select TCP and enter the specific port for example 5985
254. he MAC address shown in the transmitted frames may not be correct The analyzer does not show the frames as constructed by BASP and shows the MAC address of the team and not the MAC address of the interface transmitting the frame It is suggested to use the following process to monitor a team Mirror all uplink ports from the team at the switch If the team spans two switches mirror the interlink trunk as well Sample all mirror ports independently On the analyzer use an adapter and driver that does not filter QOS and VLAN information TEAMING CONFIGURATION TIPS When troubleshooting network connectivity or teaming functionality issues ensure that the following information is true for your configuration 1 O ui mom 10 11 12 13 14 Although mixed speed SLB teaming is supported it is recommended that all adapters in a team be the same speed either all Gigabit Ethernet or all Fast Ethernet For speeds of 10 Gbps it is highly recommended that all adapters in a team be the same speed If LiveLink is not enabled disable Spanning Tree Protocol or enable an STP mode that bypasses the initial phases for example Port Fast Edge Port for the switch ports connected to a team All switches that the team is directly connected to must have the same hardware revision firmware revision and software revision to be supported To be teamed adapters should be members of the same VLAN In the event that multiple teams are confi
255. he User name and Password are not required while connecting to the local host 3 Select Persist if you want BACS to save the information for this host 4 Click Ok BACS can now be used to view information and manage the host To add a remote host 1 From the Action menu click Add Host 2 Type the remote host s name or IP address in the Host box 3 Select the protocol from the Protocol list The protocol options for Windows are WMI WSMan or Try All The protocol options for Linux are CimXML WSMan or Try All The Try All option forces the GUI client to try all options 4 Select the HTTP scheme or the HTTPS scheme for added security 5 Type the Port Number value you used to configure the host if it is different than the default value of 5985 6 Type the User name and Password 7 Select Persist if you want BACS to save the information for this host The host will appear in the Explorer Pane whenever you reopen BACS and you will not need to enter the host IP address or host name when connecting to the host For security reasons you must enter the User name and Password every time 8 Click OK E S Broadcom Corporation Page 238 Connecting to a Host Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 MANAGING THE HOST At the host level you can view host information and configure parameters from the following tabs e Information e Configuration To view host information Select the host in the
256. he desired number of queues for that CoS The total number of queues is limited by the hardware limit For example set qs_per_cos to 0x10101 to create a total of three queues one per CoS In another example set qs_per_cos to 0x404 to create a total of 8 queues divided into 2 CoS 4 queues in each Cos cos min rate The optional parameter cos min rate is used to determine the weight of each CoS for round robin scheduling in transmission This parameter is evaluated by the driver as up to 3 values of 8 bits each Each byte sets the desired weight for that CoS The weight ranges from 0 to 100 For example set cos min rate to 0x101 for fair transmission rate between 2 CoS In another example set the cos min rate to 0x30201 to give CoS the higher rate of transmission To avoid using the fairness algorithm omit setting cos min rate or set it to O Set the multi mode parameter to 2 as shown below to differentiate the traffic according to the VLAN PHI value insmod bnx2x ko multi mode 2 pri map 0x11110000 qs per cos 0x404 or modprobe bnx2x multi mode 2 pri map 0x11110000 qs per cos 0x404 Set the multi mode parameter to 4 as shown below to differentiate the traffic according to the IP DSCP value insmod bnx2x ko multi mode 4 pri map 0x22221100 qs per cos 0x10101 cos min rate 0x30201 or modprobe bnx2x multi mode 4 pri_map 0x22221100 qs per cos 0x10101 cos min rate 0x30201 BNX2I DRIVER Optional parameters en tcp dack error mask1 and err
257. hecksum dev Select an adapter or List available adapters e dir Display file directory in NVRAM dumpnvram Save entire NVRAM contents to a file help Show a list of available commands otpchk Check OTP content against the specified file prg Program NVRAM with specified firmware image This command is designated to facilitate the manufacture operation e q Exits the program restorenvram Restore entire NVRAM contents from a file upgrade Upgrade the firmware or bootcode version Display version of this program e w Enable disable WOL deprecated Instaed use cfg wol value ME Broadcom Corporation Page 316 Invoking the Utility Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 Linux Syntax lnxfwupg all ID MAC Commands Parameters Parameter Description all ID MAC The a11 command applies to the upgrade and restorenvram commands only The ID MAC parameter is optional for the help version and dev commands but it is required for all other commands Note the following e When a11 is specified neither ID nor MAC can be specified Both the upgrade and the restorenvram commands use the device information in the image to apply to all NICs with a matching device ID e n Linux ID is the interface name i e ethx MAC is the MAC address name of the NIC in the system For example if 00 10 18 00 11 99 is a valid MAC address as shown
258. hen configuring a NetXtreme II network adapter on a Hyper V system be aware of the following e An adapter that is to be bound to a virtual network should not be configured for VLAN tagging through the driver s advanced properties Instead Hyper V should manage VLAN tagging exclusively e The Locally Administered Address LAA set by Hyper V takes precedence over the address set in the adapters advanced properties e The LSO and CO features in the guest OS are independent of the network adapter properties e To allow jumbo frame functionality from the guest OS both the network adapter and the virtual adapter must have jumbo frames enabled The Jumbo MTU property for the network adapter must be set to allow traffic of large MTU from within the guest OS The jumbo packet of the virtual adapter must be set in order to segment the sent and received packets Ec Broadcom Corporation Page 330 Microsoft Virtualization with Hyper V Document INGSRVT710 CDUM100 R User Guide March 2014 TEAMED NETWORK ADAPTERS NetXtreme Il Table 2 identifies Hyper V supported features that are configurable for NetXtreme Il teamed network adapters This table is not an all inclusive list of Hyper V features Table 2 Configurable Teamed Network Adapter Hyper V Features Supported in Windows Server Version Feature Comments Limitation 2008 2008 R2 2012 Smart Load Balancing and Yes Yes Yes Multi
259. hen seating the card as this may damage the system or the adapter If you have difficulty seating the adapter remove it realign it and try again 6 Secure the adapter with the adapter clip or screw 7 Close the system case and disconnect any personal antistatic devices CONNECTING THE NETWORK CABLES The Broadcom NetXtreme II adapter has either an RJ 45 connector used for attaching the system to an Ethernet copper wire segment or a fiber optic connector for attaching the system to an Ethernet fiber optic segment K Copper Wire r4 NOTE This section does not apply to blade servers NOTE The Broadcom NetXtreme ll adapter supports Automatic MDI Crossover MDIX which eliminates the need for crossover cables when connecting machines back to back A straight through Category 5 cable allows the machines to communicate when connected directly together 1 Select an appropriate cable Table 1 lists the copper cable requirements for connecting to 10 100 1000BASE T and 10GBASE T ports E Broadcom Corporation Document INGSRVT710 CDUM100 R Installation of the Add In NIC Page 73 NetXtreme Il User Guide March 2014 Table 1 10 100 1000BASE T and 10GBASE T Cable Specifications Port Type Connector Media Maximum Distance 10BASE T RJ 45 Category 3 4 or 5 unshielded 100m 328 ft twisted pairs UTP 100 1000BASE T HJ 45 Category 5 UTP 100m 328 ft Category 6A UTP 100m 328 ft 1000BASE T signaling requires
260. her the offload or non offload path The following procedure references Windows Server 2008 R2 but is common to both the Windows Server 2008 R2 and SP2 Required CD ISO image e Windows Server 2008 R2 x64 with the Broadcom drivers injected See Injecting Slipstreaming Broadcom Drivers into Windows Image Files Also refer to the Microsoft knowledge base topic KB974072 at support microsoft com k NOTES e The Microsoft procedure injects only the eVBD and NDIS drivers Broadcom recommends that all drivers eVBD VBD BXND OIS FCoE and NetXtreme NDIS be injected e Refer to the silent txt file for the specific driver installer application for instructions on how to extract the individual Windows NetXtreme ll drivers Other software required e Bindview exe Windows Server 2008 R2 only see KB976042 Procedure 1 Remove any local hard drives on the system to be booted the remote system Load the latest Broadcom MBA and iSCSI boot images onto NVRAM of the adapter 3 Configure the BIOS on the remote system to have the Broadcom MBA as the first bootable device and the CDROM as the second device 4 Configure the iSCSI target to allow a connection from the remote device Ensure that the target has sufficient disk space to hold the new O S installation 5 Boot up the remote system When the Preboot Execution Environment PXE banner displays press Ctrl S to enter the PXE menu 6 Atthe PXE menu set Boot Protocol to
261. his procedure refer to the bnx2 driver but also apply to the bnx2x and bnx2i drivers UNINSTALLING BACS RPM Package Use the following command rpm e BACS MENU EE Broadcom Corporation Page 150 Unloading Removing the Linux Driver Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 PATCHING PCI FILES OPTIONAL ra NOTE The examples used in this procedure refer to the bnx2 driver but also apply to the bnx2x and bnx2i drivers For hardware detection utilities such as Red Hat kudzu to properly identify bnx2 supported devices a number of files containing PCI vendor and device information may need to be updated Apply the updates by running the scripts provided in the supplemental tar file For example on Red Hat Enterprise Linux apply the updates by doing the following patch pcitbl sh usr share hwdata pcitable pci updates usr share hwdata pcitable new bnx2 patch pciids sh usr share hwdata pci ids pci updates usr share hwdata pci ids new Next the old files can be backed up and the new files can be renamed for use cp usr share hwdata pci ids usr share hwdata old pci ids cp usr share hwdata pci ids new usr share hwdata pci ids cp usr share hwdata pcitable usr share hwdata old pcitable cp usr share hwdata pcitable new usr share hwdata pcitable NETWORK INSTALLATIONS For network installations through NFS FTP or HTTP using a network boot disk or PXE a driver disk that contai
262. hput increases as the number of backup streams increases each backup stream can be impacted by tape software or network stack limitations For a tape backup server to reliably use adapter performance and network bandwidth when backing up clients a network infrastructure must implement teaming such as load balancing and fault tolerance Data centers will incorporate redundant switches link aggregation and trunking as part of their fault tolerant solution Although teaming device drivers will manipulate the way data flows through teamed interfaces and failover paths this is transparent to tape backup applications and does not interrupt any tape backup process when backing up remote systems over the network Figure 10 shows a network topology that demonstrates tape backup in a Broadcom teamed environment and how smart load balancing can load balance tape backup data across teamed adapters There are four paths that the client server can use to send data to the backup server but only one of these paths will be designated during data transfer One possible path that Client Server Red can use to send data to the backup server is Example Path Client Server Red sends data through Adapter A Switch 1 Backup Server Adapter A The designated path is determined by two factors e Client Server ARP cache which points to the backup server MAC address This is determined by the Broadcom intermediate driver inbound load balancing algorithm e The physical a
263. iSCSI Enter the iSCSI target parameters 8 Set HBA Boot Mode to Enabled or Disabled Note This parameter cannot be changed when the adapter is in Multi Function mode 9 Save the settings and reboot the system The remote system should connect to the iSCSI target and then boot from the DVDROM device 10 Boot to DVD and begin installation E Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Boot Page 87 NetXtreme II User Guide March 2014 11 Answer all the installation questions appropriately specify the Operating System you want to install accept the license terms etc When the Where do you want to install Windows window appears the target drive should be visible This is a drive connected via the iSCSI boot protocol located in the remote iSCSI target 12 Select Next to proceed with Windows Server 2008 R2 installation A few minutes after the Windows Server 2008 R2 DVD installation process starts a system reboot will follow After the reboot the Windows Server 2008 R2 installation routine should resume and complete the installation 13 Following another system restart check and verify that the remote system is able to boot to the desktop 14 After Windows Server 2008 R2 is booted up load all drivers and run Bindview exe a Select All Services b Under WFP Lightweight Filter you should see Binding paths for the AUT Right click and disable them When done close out of the application 15 Verify
264. ia 94086 USA Den Europ iske Union Klasse B Denne Brcadcom enhed er klassificeret til anvendelse 1 et typisk Klasse B hjemhzt milj Europzi ke Union Klasse A ADVARSEL Dette er et Klasse A produkt I et hjemligt milo kan dette produkt medfere forstyirelse af radiofrekvens oz 1 det tilf lde m brugeren fortaze passende foranstaltninger NEDERLANDS Dit product is m overeenstemmme bevonden met J006 95 EC Laagspannmesnechtiin Dutch 2004 108 EC EMC nchtlijn en amendementen van de Europese Unie Fen Verklannz van conformitert in overeen temnung met de voorgenoemde rnchihjsen en standaarden 1s beschikbaar by Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA Europese Unle Klasse B Dit Broadeom apparaat 15 geclassificeerd voor gebruk in een typische klasse B woonomzevinz Europese Unie Klasse A VOORZICHTIG Dit is een Klasse A product Binnen een woonomgeving kan dit product radiofrequente stommzen veroorzaken m welk geval de zebrnuker passende maatregelen dient te nemen This product has been determined to be mm compliance with 2006 95 EC Low Voltage Directive 2004 108 EC EMC Directive and amendment of the European Union A Declaration of Confornut m accordance with the preceding directives and standards has been made and is on file at Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA European Union Class This Broadcom device 15 classified for use m a typ
265. ical Class B domestic environment European Union Class A WARNING This 15 a Class A product In a domestic environment this product may cause radio Tequencvy interference im which case the user mav be required to take adequate measures su Broadcom Corporation Page 296 CE Notice Document INGSRVT710 CDUM100 R User Guide March 2014 EESTLANE Estonian Finnish FRANCAIS French DEUTSCH German EAAHNIEK Ox Greek Document Antud toode vastab direktividele 2006 95 EU Madalpinge direktiv 2004 108 EU EMC direktiv ja ELi parandustele Vastavalt laltoodud direktiividele ja standarditele on koostatud Vastavusdeklaratzioon mis on arvel ettevottes Broadcom Corporation 190 MathildaPlace Sunnyvale California 94086 USA Euroopa Lut Klass B Antud Broadcom toode on klassiftseentud kasutamuseks tintpilises B klassi koduses keskkonnas Union europ enne classe A AVERTISSEMENT Ce produit est un produit de classe A Dans un environnement r sidentiel ce produit peut provoquer des perturbations rachoelectiques auquel cas l utilisateur peut se vou oblige de prendre les mesures appropme lama tuote tayttaa Euroopan umonm direktivin 2006 25 EY prieryannitedirekti ja divektiwin 2004 108 EY sahk marneettisesta yhteensoprvuudesta annettu direktivi sellaisma kuin ne ovat niuutettuma vaatimukset Yll mamittujen direktiivien ja standardien mukamen vaatmustenmukaisuusvakuutus on tehty ja sit s ilytt Broad
266. ided by the standard SNMP Management Network Interface information The extensible agent provides in depth information about a Broadcom NetXtreme Il adapter such as e MAC address e Bound IP address e IP subnet mask e Physical link status e Adapter state e Line speed e Duplex mode e Memory range e Interrupt setting e Bus number e Device number e Function number To monitor this information a SNMP manager needs to load the Broadcom Extended information MIB file to allow monitoring of the information described above This file bcmif mib is included on the installation CD The monitored workstation requires the installation of the Broadcom Extended Information SNMP extensible agent bcmif dll and requires the Microsoft Windows Server 2008 SNMP service to be installed and loaded MM Broadcom Corporation Document INGSRVT710 CDUM100 R HBA API Page 69 NetXtreme Il User Guide Installing the Hardware Broadcom NetXtreme II Network Adapter User Guide e Overview e System Requirements e Safety Precautions e Preinstallation Checklist Installation of the Add In NIC NOTE Service Personnel This product is intended only for installation in a Restricted Access Location RAL OVERVIEW This section applies to Broadcom NetXtreme II add in network interface cards SYSTEM REQUIREMENTS Before you install a Broadcom NetXtreme II adapter verify that your system meets the following hardware and operating system
267. iendly Name Enter the switch friendly name O EEE Broadcom Corporation Document INGSRVT710 CDUM100 R Managing the LAN Device Page 251 NetXtreme II User Guide March 2014 CONFIGURING THE NDIS DRIVER Select the NDIS driver in the Explorer View pane and then select the Configuration tab to configure NDIS level parameters After making changes click Apply to confirm the changes to all properties Click Reset to return the properties to their original values Click Defaults to restore all settings to their default values NOTES e Clicking Reset after clicking Defaults but before clicking Apply will purge all values e Apply must be clicked to make changes go into effect e Any changes to existing settings will be lost upon clicking Defaults rA NOTES e You must have administrator privileges to change the values for a property e The list of available properties for your particular adapter may be different e Some properties may not be available for all Broadcom network adapters e fan adapter is included as a member of a team and you change any advanced property then you must rebuild the team to ensure that the team s advanced properties are properly set Configuration Tab Advanced Ethernet Wirespeed Enables a Gigabit Ethernet adapter to establish a link at a lower speed when only two pairs of wires are available in the cabling plant The default setting for this property is Enabled Flow Control Enables or disables the
268. ies of the Broadcom network adapter 1 In Control Panel click Broadcom Control Suite 4 2 Click the Advanced section of the Configurations tab SETTING POWER MANAGEMENT OPTIONS You can set power management options to allow the operating system to turn off the controller to save power or to allow the controller to wake up the computer If the device is busy doing something servicing a call for example however the operating system will not shut down the device The operating system attempts to shut down every possible device only when the computer attempts to go into hibernation To have the controller stay on at all times do not click the Allow the computer to turn off the device to save power check box ra NOTE Power management options are not available on blade servers N Broadcom Corporation Document INGSRVT710 CDUM100 R Viewing or Changing the Properties of the Adapter Page 187 NetXtreme II User Guide March 2014 Broadcom BCMS O8C NetAtreme Il GigE NDIS VBD Cli General Advanced Driver Power Management Broadcom BLMS UBL Melstreme Il GigE HD TS VBD Client 3 Warning Allowing this device to bring the computer out af standby may cause this computer to periadically wakeup to refresh its network state If vau travel with this computer or run iE an a battery vou should not turn en this Feature as the machine may awaken at inappartune times or consume the battery Cancel K NOTES
269. igabit Ethernet Controller Broadcom NetXtreme II 10 Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA This device complies with Part 15 of the FCC Rules Operations is subject to the following two conditions 1 This device may not cause harmful interference and 2 This device must accept any interference received including interference that may cause undesired operation This product has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This product generates uses and can radiate radio frequency energy and if not installed and used in accordance with the manufacturer s instruction manual may cause harmful interference with radio communications Operation of this product in a residential area is likely to cause harmful interference in which case you will be required to correct the interference at your own expense These limits are designed to provide reasonable protection against harmful interference in a non residential installation However there is no guarantee that interference will not occur in a particular installation If this equipment does cause harmful interference with radio or television reception which can be determined by turning the equipment off and on you are encoura
270. ing Operating System Failover Fallback All Broadcom Failover Fallback Multivendor Protocol IP IPv6 IPX NetBEUI IP IPv6 IPX NetBEUI Windows Server 2008 Y Y Y N S Y Y N N S Windows Server 2008 R2 Y Y Y N S Y Y N N S Operating System Load Balance All Broadcom Load Balance Multivendor Protocol IP IPv6 IPX NetBEUI IP IPv6 IPX NetBEUI Windows Server 2008 Y Y Y N S Y Y N N S Windows Server 2008 R2 Y Y Y N S Y Y N N S Legend Y yes N no N S not supported The Smart Load Balancing type of team works with all Ethernet switches without having to configure the switch ports to any special trunking mode Only IP traffic is load balanced in both inbound and outbound directions IPX traffic is load balanced in the outbound direction only Other protocol packets are sent and received through one primary interface only Failover for non IP traffic is supported only for Broadcom network adapters The Generic Trunking type of team requires the Ethernet switch to support some form of port trunking mode for example Cisco s Gigabit EtherChannel or other switch vendor s Link Aggregation mode The Generic Trunking type of team is protocol independent and all traffic should be load balanced and fault tolerant k NOTE If you do not enable LiveLink when configuring SLB teams disabling Spanning Tree Protocol STP or enabling Port Fast at the switch is recommended This minimizes the downtime due to the spanning tre
271. ing scheme is determined by our BASP driver The team link partner determines the load balancing scheme for inbound packets In this mode at least one of the link partners must be in active mode ra NOTE Link Aggregation team type is not supported for TOE teaming GENERIC TRUNKING FEC GEC 802 3AD DRAFT STATIC The Generic Trunking FEC GEC 802 3ad Draft Static type of team is very similar to the Link Aggregation 802 3ad type of team in that all adapters in the team are configured to receive packets for the same MAC address The Generic Trunking FEC GEC 802 3ad Draft Static type of team however does not provide LACP or marker protocol support This type of team supports a variety of environments in which the adapter link partners are statically configured to support a proprietary trunking mechanism For instance this type of team could be used to support Lucent s OpenTrunk or Cisco s Fast EtherChannel FEC Basically this type of team is a light version of the Link Aggregation 802 3ad type of team This approach is much simpler in that there is not a formalized link aggregation control protocol LACP As with the other types of teams the creation of teams and the allocation of physical adapters to various teams is done statically through user configuration software The Generic Trunking FEC GEC 802 3ad Draft Static type of team supports load balancing and failover for both outbound and inbound traffic K NOTE Generic Trun
272. ion Can team a fiber adapter with a copper Gigabit Ethernet adapter Answer Yes with SLB and yes if the switch allows for it in FEC GEC and 802 3ad Question What is the difference between adapter load balancing and Microsoft s Network Load Balancing NLB Answer Adapter load balancing is done at a network session level whereas NLB is done at the server application level a Broadcom Corporation Document INGSRVT710 CDUM100 R Frequently Asked Questions Page 53 NetXtreme II User Guide March 2014 Question Can connect the teamed adapters to a hub Answer Teamed ports can be connected to a hub for troubleshooting purposes only However this practice is not recommended for normal operation because the performance would be degraded due to hub limitations Connect the teamed ports to a switch instead Question Can connect the teamed adapters to ports in a router Answer No All ports in a team must be on the same network in a router however each port is a separate network by definition All teaming modes require that the link partner be a Layer 2 switch Question Can use teaming with Microsoft Cluster Services Answer Yes Teaming is supported on the public network only not on the private network used for the heartbeat link Question Can PXE work over a virtual adapter team Answer A PXE client operates in an environment before the operating system is loaded as a result virtual adapters have not been enabled yet
273. ion with Hyper V e Removing the Broadcom NetXtreme II Device Drivers e Upgrading Windows Operating Systems e Broadcom Boot Agent e Broadcom Advanced Server Program BASP e Linux e NPAR e Kernel Debugging over Ethernet Miscellaneous HARDWARE DIAGNOSTICS Loopback diagnostic tests are available for testing the adapter hardware These tests provide access to the adapter internal external diagnostics where packet information is transmitted across the physical link for instructions and information on running tests in an MS DOS environment see User Diagnostics for Windows environments see Running Diagnostic Tests in Windows CHECKING PoRT LEDS See Network Link and Activity Indication to check the state of the network link and activity p Broadcom Corporation Document INGSRVT710 CDUM100 R Troubleshooting Broadcom NetXtreme I9 Network Adapter User Guide Page 325 NetXtreme II User Guide March 2014 TROUBLESHOOTING CHECKLIST AN CAUTION Before you open the cabinet of your server to add or remove the adapter review Safety Precautions The following checklist provides recommended actions to take to resolve problems installing the Broadcom NetXtreme II adapter or running it in your system e Inspect all cables and connections Verify that the cable connections at the network adapter and the switch are attached properly Verify that the cable length and rating comply with the requirements listed in Connecting
274. ip receive buffers will rarely be depleted therefore it may appear that flow control is not functioning Problem Errors appear when compiling driver source code Solution Some installations of Linux distributions do not install the development tools by default Ensure the development tools for the Linux distribution you are using are installed before compiling driver source code NPAR Problem The following error message displays if the storage configurations are not consistent for all four ports of the device in NPAR mode PXE M1234 NPAR block contains invalid configuration during boot A software defect can cause the system to be unable to BFS boot to an iSCSI or FCoE target if an iSCSI personality is enabled on the first partition of one port whereas an FCoE personality is enabled on the first partition of another port The MBA driver performs a check for this configuration and prompts the user when it is found Solution If using the 7 6 x firmware and driver to workaround this error configure the NPAR block such that if iSCSI or FCoE is enabled on the first partition the same must be enabled on all partitions of all four ports of that device p Broadcom Corporation Document INGSRVT710 CDUM100 R Linux Page 335 NetXtreme II User Guide March 2014 KERNEL DEBUGGING OVER ETHERNET Problem When attempting to perform kernel debugging over an Ethernet network on a Windows 8 0 or Windows Server 2012 system the system wi
275. isolated from the others thus increasing bandwidth efficiency within each logical group VLANs also enable the administrator to enforce appropriate security and quality of service QoS policies The BASP supports the creation of 64 VLANs per team or adapter 63 tagged and 1 untagged The operating system and system resources however limit the actual number of VLANs VLAN support is provided according to IEEE 802 1Q and is supported in a teaming environment as well as on a single adapter Note that VLANs are supported only with homogeneous teaming and not in a multivendor teaming environment The BASP intermediate driver supports VLAN tagging One or more VLANs may be bound to a single instance of the intermediate driver WAKE ON LAN Wake on LAN WOL is a feature that allows a system to be awakened from a sleep state by the arrival of a specific packet over the Ethernet interface Because a Virtual Adapter is implemented as a software only device it lacks the hardware features to implement Wake on LAN and cannot be enabled to wake the system from a sleeping state via the Virtual Adapter The physical adapters however support this property even when the adapter is part of a team PREBOOT EXECUTION ENVIRONMENT The Preboot Execution Environment PXE allows a system to boot from an operating system image over the network By definition PXE is invoked before an operating system is loaded so there is no opportunity for the BASP intermediate driver
276. itch Manager will force the underlying adapter into a DCB state in which OS DCB configuration will be ignored and DCB configuration from BACS will be in effect with the exception that the user configured Networking Priority value non zero will not take effect even though it appears that it is from BACS Eu Broadcom Corporation Page 228 Data Center Bridging in Windows Server 2012 Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 SR IOV Broadcom NetXtreme II Network Adapter User Guide Overview e Enabling SR IOV OVERVIEW Virtualization of network controllers allows users to consolidate their networking hardware resources and run multiple virtual machines concurrently on consolidated hardware Virtualization also provides the user a rich set of features such as I O sharing consolidation isolation and migration and simplified management with provisions for teaming and failover Virtualization can come at the cost of reduced performance due to hypervisor overhead The PCI SIG introduced the Single Root I O Virtualization SR IOV specification to address these performance issues by creating a virtual function VF a lightweight PCle function that can be directly assigned to a virtual machine VM bypassing the hypervisor layer for the main data movement Not all Broadcom adapters support SR IOV refer to your product documentation for details ENABLING SR IOV Before attempting to enable SR IO
277. iver Software for Use on MS DOS Platforms Page 139 NetXtreme II User Guide March 2014 USING KEYWORDS FOR THE DRIVERS The Protocol ini file contains certain keywords that are used by the BXND20X dos AND BXND20X dos drivers These keywords are listed below BusNum Specifies the number of the PCI bus on which the network adapter is located Requires a decimal number having a value ranging from 0 to 255 DevNum Specifies the device number assigned to the network adapter when it is configured by the PCI BIOS Requires a decimal number having a value ranging from O to 255 FuncNum or PortNum Specifies the PCI function or port number assigned to the network controller Requires a decimal number having a value ranging from O to 7 K NOTE These keywords BusNum DevNum and FuncNum or PortNum are needed when multiple adapters are installed in the server and when a specific controller must be loaded in a certain order These keywords are used concurrently and are included for manufacturing purposes Do not use them unless you are familiar with how to configure PCI devices A PCI device scan utility is needed to find this information LineSpeed Specifies the speed of the network connection in Mbit s Requires the decimal number 10 100 or 1000 Technically a line speed of 1000 Mbit s cannot be forced and is achievable only through auto negotiation For the sake of simplicity the driver performs auto negotiation when the line speed is s
278. ization The BASP intermediate driver does not support IEEE 802 1p QoS tagging LARGE SEND OFFLOAD Large Send Offload LSO is a feature provided by Broadcom network adapters that prevents an upper level protocol such as TCP from breaking a large data packet into a series of smaller packets with headers appended to them The protocol stack need only generate a single header for a data packet as large as 64 KB and the adapter hardware breaks the data buffer into appropriately sized Ethernet frames with the correctly sequenced header based on the single header originally provided TCP OFFLOAD ENGINE TOE The TCP IP protocol suite is used to provide transport services for a wide range of applications for the Internet LAN and for file transfer Without the TCP Offload Engine the TCP IP protocol suite runs on the host CPU consuming a very high percentage of its resources and leaving little resources for the applications With the use of the Broadcom NetXtreme II adapter the TCP IP processing can be moved to hardware freeing the CPU for more important tasks such as application processing The Broadcom NetXtreme II adapters TOE functionality allows simultaneous operation of up to 1024 fully offloaded TCP connections for 1 Gbps network adapters and 1880 fully offloaded TCP connections for 10 Gbps network adapters The TOE support on the adapter significantly reduces the host CPU utilization while preserving the implementation of the operating syste
279. ization and VLAN tagging e Priority Enabled Allows packet prioritization only e VLAN Enabled Allows VLAN tagging only k NOTE If an intermediate driver is managing the network adapter for VLAN tagging the Priority amp VLAN Disabled and Priority Enabled settings should not be used Use the Priority amp VLAN Enabled setting and change the VLAN ID to O zero VLAN ID Enables VLAN tagging and configures the VLAN ID when Priority amp VLAN Enabled is selected as the Priority amp VLAN setting The range for the VLAN ID is 1 to 4094 and must match the VLAN tag value on the connected switch A value of O default in this field disables VLAN tagging Risk Assessment of VLAN Tagging through the NDIS Miniport Driver Broadcom s NDIS 6 0 miniport driver provides the means to allow a system containing a Broadcom adapter to connect to a tagged VLAN On Windows XP systems this support was only provided through the use of an intermediate driver e g Broadcom Advanced Server Program BASP Unlike BASP however the NDIS 6 driver s support for VLAN participation is only for a single VLAN ID Also unlike BASP the NDIS 6 0 driver only provides VLAN tagging of the outbound packet but does not provide filtering of incoming packets based on VLAN ID membership This is the default behavior of all miniport drivers While the lack of filtering packets based on VLAN membership may present a security issue the following provides a risk assessmen
280. kets using Layer 4 protocols previously discussed whereas the team s link partner determines the load balancing scheme for inbound packets Because the load balancing is implemented on Layer 2 all higher protocols such as IP IPX and NetBEUI are supported The attached switch must support the 802 3ad Link Aggregation standard for this mode of operation The switch manages the inbound traffic to the adapter while the BASP manages the outbound traffic Both the BASP and the switch continually monitor their ports for link loss In the event of link loss on any port traffic is automatically diverted to other ports in the team Network Communications The following are the key attributes of Dynamic Trunking e Failover mechanism Link loss detection e Load Balancing Algorithm Outbound traffic is balanced through a Broadcom proprietary mechanism based on L4 flows Inbound traffic is balanced according to a switch specific mechanism e Outbound Load Balancing using MAC Address No e Outbound Load Balancing using IP Address Yes e Multivendor teaming Supported Must include at least one Broadcom Ethernet adapter as a team member Applications Dynamic trunking works with switches that support IEEE 802 3ad Link Aggregation dynamic mode using LACP Inbound load balancing is switch dependent In general the switch traffic is load balanced based on L2 addresses In this case all network protocols such as IP IPX and NetBEUI are load bala
281. king FEC GEC 802 3ad Draft Static team type is not supported for TOE teaming SS Broadcom Corporation Page 10 Load Balancing and Fault Tolerance Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 SLB AuTO FALLBACK DISABLE The SLB Auto Fallback Disable type of team is identical to the Smart Load Balancing and Failover type of team with the following exception when the standby member is active if a primary member comes back on line the team continues using the standby member rather than switching back to the primary member All primary interfaces in a team participate in load balancing operations by sending and receiving a portion of the total traffic Standby interfaces take over in the event that all primary interfaces have lost their links Failover teaming provides redundant adapter operation fault tolerance in the event that a network connection fails If the primary adapter in a team is disconnected because of failure of the adapter cable or switch port the secondary team member becomes active redirecting both inbound and outbound traffic originally assigned to the primary adapter Sessions will be maintained causing no impact to the user LIMITATIONS OF SMART LOAD BALANCING AND FAILOVER SLB AUTO FALLBACK DISABLE TYPES OF TEAMS Smart Load Balancing SLB is a protocol specific scheme The level of support for IP IPX and NetBEUI protocols is listed in Table 1 Table 1 Smart Load Balanc
282. l 10 GbE network adapters TESTING NETWORK CONNECTIVITY k NOTE When using forced link speeds verify that both the adapter and the switch are forced to the same speed WINDOWS Network connectivity can be tested using the Testing the Network feature in Broadcom Advanced Control Suite An alternate method is to use the ping command to determine if the network connection is working 1 Click Start and then click Run 2 Type cmd in the Open box and then click OK 3 Type ipconfig al11 to view the network connection to be tested p Broadcom Corporation Document INGSRVT710 CDUM100 R Running a Cable Length Test Page 327 NetXtreme II User Guide March 2014 4 Type ping IP address and then press ENTER The ping statistics that are displayed indicate whether the network connection is working or not LINUX To verify that the Ethernet interface is up and running run ifconfig to check the status of the Ethernet interface It is possible to use netstat i to check the statistics on the Ethernet interface See Linux Driver Software for information on ifconfig and netstat Ping an IP host on the network to verify connection has been established From the command line type ping IP address and then press ENTER The ping statistics that are displayed indicate whether or not the network connection is working MICROSOFT VIRTUALIZATION WITH HYPER V Microsoft Virtualization is a hypervisor virtualization system for Wi
283. l hosts managed by BACS Below the hosts are the installed network adapters with the manageable elements such as physical port VBD NDIS FCoE and iSCSI below the adapters The icon next to each device in the Explorer View pane shows its status An icon next to a device name that appears normal means the device is connected and working e X A red xX that appears on the device s icon indicates the device is currently not connected to the network e Greyed out A device icon that appears greyed out indicates the device is currently disabled CONTEXT VIEW SELECTOR The Context View selector appears below the menu bar and includes the filter and tab categories Although you can expand and collapse the categories that appear on tabs in the Context View pane you can alternatively display a category by selecting the box next to the category name Filter View In a multiple host environment using several C NICs there can be a large number of manageable elements per adapter that can be difficult and cumbersome to view configure and manage all elements Use the filter to select a particular device function Possible filter views include e All e Team view e NDIS view e iSCSI view e FCoE view e iSCSI Target view e FCoE Target view CONTEXT VIEW PANE The Context View pane displays all the parameters that you can view for the object selected in the Explorer View pane The parameters are grouped by tabs and categories depending on
284. l procedures for OS installation When no disk devices are found Windows will prompt you to load additional drivers At this point connect a USB flash drive containing the full contents of the provided EVBD and OFC boot driver folders After all appropriate drivers are loaded the setup show the target disk s Disconnect the USB flash drive before selecting the disk for installation 1 Load the EVBD driver first ELM Broadcom Corporation Page 202 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 G 9 Install Windows Select the driver to be installed M Bro d che or Ta Y CERE TIT 10 GigE D ual Port SF P Ad pter CA beemievbd SATA ey bd inf I Hide drivers that are not compatible with hardware on this computer Browse Rem 2 Then load the bxfcoe OFC driver Q E instali windows Select the driver to be installed Broad om NetXtreme I C MIC FCoE Adapter C brom otc Fb 6023 xf coe inf FY Hide drivers that are not compatible with hardware on this computer Browse Bescan 3 Select the boot LUN to be installed MEN NM PENNE Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 203 NetXtreme II User Guide March 2014 Install Windews Gr Where do you want to install Windows Name Total Size Free Space Type Disk 2 Partition 1 System Reserved 100 0 MB 20 0 MB System Me y Disk 2 Partition 2 20
285. lat cn Surma y I TEL m inet all at T T Configuration Check Installation 1 t bloctnarne H i hiet wok 9 Click Next to continue installation YaST2 will prompt to activate multipath Answer as appropriate e Disk Activation SUSE Linux Enterprise Preparathon tai A D WITEL E Disk Activation SIS uu rai 1 imis s COT beet allatiogn Sener Bremar bn t inrit allati 1 SUNE Y A The partem seen to hano rrultipath harndeaee FK De you want te simae rriuibpatk Perform bectalletion Conmiquration 10 Continue installation as usual 11 Under the Expert tab on the Installation Settings screen select Booting M Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 209 NetXtreme Il que SUSE Linux Enterprise Preparation dMatu F inet alata T SEWE DOELE E installation Surimary Perform bvetalistion Configur stica Check installation Tdi aar hetmork CEuemftoneer tenter milime Lge ante JT lau J Installation Settings Chek the a haedina te make changes or usa tha Change mana bale Qvervirem E pert system bystermr Dalinc PowerEdge 8720 Procespor 16x Intelif eoni A CPU ES 2660 0 m 2 Z0GH Maan Menon 188 38 Keyboard Layout Fna US Partitioning Create mubipath partition 360 f vath gti Create map rridipath partibon 36005016095302 000664a8281567a111 part2 10 00 am alli partl 40 0
286. lect the Configuration tab DHCP is the default for IP address assignment but this can be changed to static IP address assignment if this is the preferred method of IP address assignment NOTE The IP address assignment method cannot be changed if the adapter was used for boot 5 Select Apply and close BACS E Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Offload in Windows Server Page 99 NetXtreme II User Guide March 2014 Configure Microsoft Initiator to Use Broadcom s iSCSI Offload Now that the IP address has been configured for the iSCSI adapter you need to use Microsoft Initiator to configure and add a connection to the iSCSI target using Broadcom iSCSI adapter See Microsoft s user guide for more details on Microsoft Initiator 1 Open Microsoft Initiator 2 Configure the initiator IQN name according to your setup To change click on Change iSCSI Initiator Properties General Discovery Targets Persistent Targets Bound Volumes Devices The iSCSI protecel uses the Tollowang informaben te uriguely i identify thes instiator and authenticate targets niato Node Name i9n 1991 05 com microsottd3a0 To rename the indistor node click Change To authenticate targets uting CHAP click Secret to speciy a zacat Secret To configure IPSec Tunnel Mode addresses cick 3 Enter the initiator IQN name Initiator Node Name Change x You can change the name of this initiator
287. ll load once and automatically bypass once the ready LUN is discovered On the subsequent reboot after installation the option ROM will automatically revert to Enabled Wait through all option ROM banners Once FCoE Boot is invoked it will connect to the target and provide a 4 second window to press CTRL D to invoke the bypass Press CTRL D to proceed to installation a Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 201 NetXtreme II User Guide March 2014 Copyright C 2000 26011 Broadcom Corporation FCoE Boot vb 4 20 Starting DCBX process with interface 00 10 18 6F D5 0F Succeeded liscovering FC Fabric with interface 00 10 1B8 6F D5 0F Succeeded un Jorld Wide Mode Mame 10 00 00 10 18 6F Jorld Wide Port Mame c0 00 00 10 16 6F abric Name gt 10 00 00 05 1E be CF MAC Address 00 05 1E B0 38 95 FP MAC Address BE FC 80 61 10 01 ULAN ID 1003 OF OF ut T pem Mg LL Ea Ln i abric Login via interface 060 180 18 6F D5 0F Succeeded Login to target 500143B8004CB83BBD 600000 LUN 0011 succeeded FC Target Drive HP HSV360 Rev 6005 Press lt Ctrl D gt within 4s to stop booting from the target WINDOWS SERVER 2008 R2 AND WINDOWS SERVER 2008 SP2 FCOE BOOT INSTALLATION Ensure that no USB flash drive is attached before starting the OS installer The EVBD and OFC BXFOE drivers need to be loaded during installation Go through the norma
288. ll not boot This problem may occur with some adapters on systems where the Windows 8 0 or Windows Server 2012 OS is configured for UEFI mode You may see a firmware error on screen indicating that a Non Maskable Interrupt exception was encountered during the UEFI pre boot environment Solution Refer to the Microsoft knowledge base topic number 2920163 Non Maskable Interrupt error during boot on a system which has been configured for kernel debugging over Ethernet Mu Broadcom Corporation Page 336 Kernel Debugging over Ethernet Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 MISCELLANEOUS Problem The BCM57810 10 GbE NIC does not support 10 Gbps or 1 Gbps WOL link speed Solution The BCM57810 10 GbE NIC can only support 100 Mbps WOL link speed due to power consumption limitations Problem When setting the Jumbo MTU property to 5000 bytes or greater and forcing Flow Control on network adapters that support a link speed of 10 Gbps the system performance performs at less than optimal levels Solution If Jumbo MTU is set to 5000 bytes or greater ensure that Flow Control is set to Auto Problem iSCSI Crash Dump is not working in Windows Solution After upgrading the device drivers using the installer the iSCSI crash dump driver is also upgraded and iSCSI Crash Dump must be re enabled from the Advanced section of the BACS Configuration tab Problem In Windows Server 2008 R2 if the OS is running as
289. loaded connections and SQ size determines the maximum SCSI commands that can be queued SQ size also has a bearing on the number of connections that can be offloaded as QP size increases the number of connections supported will decrease With the default values the BCM5706 BCM5708 adapter can offload 28 connections Defaults 128 Range 32 to 128 Note that Broadcom validation is limited to a power of 2 for example 32 64 128 rq size Configure RQ size used to choose the size of asynchronous buffer queue size per offloaded connections RQ size is not required greater than 16 as it is used to place iSCSI ASYNC NOP REJECT messages and SCSI sense data Defaults 16 Range 16 to 32 Note that Broadcom validation is limited to a power of 2 for example 16 32 event coal div Event Coalescing Divide Factor performance tuning parameter used to moderate the rate of interrupt generation by the iscsi firmware Defaults 1 Valid values 1 2 4 8 last active tcp port O EE Broadcom Corporation Document INGSRVT710 CDUM100 R Setting Values for Optional Properties Page 155 NetXtreme II User Guide March 2014 Last active TCP port used status parameter used to indicate the last TCP port number used in the iSCSI offload connection Defaults N A Valid values N A Note This is a read only parameter ooo enable Enable TCP out of order feature enables disables TCP out of order rx handling feature on offloaded i
290. loy upgrade and maintain than in standard Ethernet networks DCB technology allows the capable Broadcom C NICs to provide lossless data delivery lower latency and standards based bandwidth sharing of data center physical links The DCB supports FCoE iSCSI Network Attached Storage NAS Management and IPC traffic flows For more information on DCB see Using Data Center Bridging DCB MM Broadcom Corporation Document INGSRVT710 CDUM100 RFibre Channel Over Ethernet Broadcom NetXtreme II Network Adapter User Guide Page 195 NetXtreme II User Guide March 2014 FCoE Boor FROM SAN This section describes the install and boot procedures for the Windows Linux ESX and Solaris operating systems K NOTE FCoE Boot from SAN is not supported on ESXi 5 0 ESX Boot from SAN is supported on ESXi 5 1 and above The following section details the BIOS setup and configuration of the boot environment prior to the OS install PREPARING SYSTEM BIOS FOR FCoE BUILD AND BOOT Modify System Boot Order The Broadcom initiator must be the first entry in the system boot order The second entry must be the OS installation media It is important that the boot order be set correctly or else the installation will not proceed correctly Either the desired boot LUN will not be discovered or it will be discovered but marked offline Specify BIOS Boot Protocol if required On some platforms the The boot protocol must be configured through system BIOS co
291. lt tolerance and virtual local area networks VLANs BASP functionality is available only on systems that use at least one Broadcom network adapter BASP operates on Windows operating systems only ra NOTE Some features of BACS are relevant only to particular adapters or adapter families such as NetXtreme l or NetXtreme Il adapters Because a single instance of BACS can be used to communicate with multiple hosts and adapter types this document describes all BACS features The BACS application includes a graphical user interface and a command line interface BACSCLI BACS GUI and BACS CLI can operate on the following operating system families e Windows e Windows Server e Linux Server For information on the latest supported OS versions refer to the release documentation provided with your software distribution a Broadcom Corporation Document INGSRVT710 CDUM100 RUsing Broadcom Advanced Control Suite 4 Broadcom NetXtreme I Network Adapter User Guide NetXtreme II User Guide March 2014 STARTING BROADCOM ADVANCED CONTROL SUITE In Control Panel click Broadcom Control Suite 4 or click the BACS icon in the taskbar located at the bottom of the Windows or Windows Server desktop On Linux systems you can double click the BACS4 desktop icon or access the BACS program from the task bar under System Tools If you are having difficulty launching BACS on a Linux system see the related topic in Troubleshooting BACS Mu
292. ly Asked Questions Page 55 User Guide March 2014 NetXtreme Il APPENDIX A EVENT LOG MESSAGES e Windows System Event Log Messages e Base Driver Physical Adapter Miniport e Intermediate Driver Virtual Adapter Team e Virtual Bus Driver VBD WINDOWS SYSTEM EVENT LOG MESSAGES The known base and intermediate Windows System Event Log status messages for the Broadcom NetXtreme ll adapters are listed in Table 8 and Table 9 As a Broadcom adapter driver loads Windows places a status code in the system event viewer There may be up to two classes of entries for these event codes depending on whether both drivers are loaded one set for the base or miniport driver and one set for the intermediate or teaming driver BASE DRIVER PHYSICAL ADAPTER MINIPORT The base driver is identified by source L2ND Table 8 lists the event log messages supported by the base driver explains the cause for the message and provides the recommended action K Note In Table 8 message numbers 1 through 17 apply to both NDIS 5 x and NDIS 6 x drivers message numbers 18 through 23 apply only to the NDIS 6 x driver Table 8 Base Driver Event Log Messages Message NUI BOE Severity Message Cause Corrective Action 1 Error Failed to allocate memory The driver cannot allocate Close running applications to for the device block Check memory from the operating free memory system memory resource system usage 2 Error Failed t
293. ly unique Layer 3 address Layer 2 is the Data Link Layer and Layer 3 is the Network layer as defined in the OSI model The Layer 2 address is assigned to the hardware and is often referred to as the MAC address or physical address This address is pre programmed at the factory and stored in NVRAM on a network interface card or on the system motherboard for an embedded LAN interface The Layer 3 addresses are referred to as the protocol or logical address assigned to the software stack IP and IPX are examples of Layer 3 protocols In addition Layer 4 Transport Layer uses port numbers for each network upper level protocol such as Telnet or FTP These port numbers are used to differentiate traffic flows across applications Layer 4 protocols such as TCP or UDP are most commonly used in today s networks The combination of the IP address and the TCP port number is called a socket Ethernet devices communicate with other Ethernet devices using the MAC address not the IP address However most applications work with a host name that is translated to an IP address by a Naming Service such as WINS and DNS Therefore a method of identifying the MAC address assigned to the IP address is required The Address Resolution Protocol for an IP network provides this mechanism For IPX the MAC address is part of the network address and ARP is not required ARP is implemented using an ARP Request and ARP Reply frame ARP Requests are typically sent to a broadcast addre
294. m 18 Informational Network adapter is de The driver does not No action is required activated and is no longer recognize the installed participating in network adapter traffic 19 Informational The LiveLink feature in The connection with the No action is required BASP connected the link for remote target s for the the network adapter LiveLink enabled team member has been established or restored 20 Informational The LiveLink feature in The LiveLink enabled team No action is required BASP disconnected the link for the network adapter member is unable to connect with the remote target s E S Broadcom Corporation Page 60 Appendix A Event Log Messages Document INGSRVT710 CDUM100 R User Guide March 2014 VIRTUAL Bus DRIVER VBD Table 10 Virtual Bus Driver VBD Event Log Messages NetXtreme Il Message NUmber Severity Message Cause Corrective Action 1 Error Failed to allocate memory The driver cannot allocate Close running applications for the device block Check memory from the operating to free memory system memory resource system usage 2 Informational The network link is down The adapter has lost its Check that the network Check to make sure the connection with its link cable is connected verify network cable is properly partner that the network cable is the connected right type and verify that the link partner for example switch or hub is w
295. m A DCOM error message event ID 10016 appears in the System Even Log during the installation of the Broadcom adapter drivers Solution This is a Microsoft issue For more information see Microsoft knowledge base KB913119 at http support microsoft com kb 9131 19 Problem Performance is degraded when multiple BCM57710 network adapters are used in a system p a Broadcom Corporation Document INGSRVT710 CDUM100 R Miscellaneous Page 337 NetXtreme II User Guide March 2014 Solution Ensure that the system has at least 2 GB of main memory when using up to four network adapters and 4 GB of main memory when using four or more network adapters Problem Remote installation of Windows Server 2008 to an iSCSI target via iSCSI offload fails to complete and the computer restarts repeatedly Solution This is a Microsoft issue For more information on applying the Microsoft hotfix see Microsoft knowledge base article KB952942 at http support microsoft com kb 952942 Problem Performance drops when a BCM5709C network adapter is connected back to back to a switch MTU 9000 and Tx and Rx Flow Control are enabled Solution When enable_cu_rate_limiter is enabled the device performs flow control in the catchup path to prevent catchup frames from dropping The catchup path is used in processing iSCSI out of order PDUs When enable cu rate limiter is disabled there is a potential for some drops of iSCSI out of order PDUs which reduces per
296. m stack JUMBO FRAMES The use of jumbo frames was originally proposed by Alteon Networks Inc in 1998 and increased the maximum size of an Ethernet frame to a maximum size of 9000 bytes Though never formally adopted by the IEEE 802 3 Working Group support for jumbo frames has been implemented in Broadcom NetXtreme ll adapters The BASP intermediate driver supports jumbo frames provided that all of the physical adapters in the team also support jumbo frames and the same size is set on all adapters in the team IEEE 802 1Q VLANs In 1998 the IEEE approved the 802 3ac standard which defines frame format extensions to support Virtual Bridged Local Area Network tagging on Ethernet networks as specified in the IEEE 802 1Q specification The VLAN protocol permits MM Broadcom Corporation Page 36 Teaming and Other Advanced Networking Properties Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 insertion of a tag into an Ethernet frame to identify the VLAN to which a frame belongs If present the 4 byte VLAN tag is inserted into the Ethernet frame between the source MAC address and the length type field The first 2 bytes of the VLAN tag consist of the IEEE 802 1Q tag type whereas the second 2 bytes include a user priority field and the VLAN identifier VID Virtual LANs VLANs allow the user to split the physical LAN into logical subparts Each defined VLAN behaves as its own separate network with its traffic and broadcasts
297. me physical adapter as IGMP and ICMP or on completely different physical adapters from ICMP and IGMP The stream may look like this IGMP gt PhysAdapter1 gt 10 0 0 1 ICMP gt PhysAdapter1 gt 10 0 0 1 TCP gt PhysAdapter1 gt 10 0 0 1 UDP gt PhysAdatperl1 gt 10 0 0 1 Or the streams may look like this IGMP gt PhysAdapter1 gt 10 0 0 1 ICMP gt PhysAdapter1 gt 10 0 0 1 TCP gt PhysAdaptere gt 10 0 0 1 UDP gt PhysAdatpers gt 10 0 0 1 The actual assignment between adapters may change over time but any protocol that is not TCP UDP based goes over the same physical adapter because only the IP address is used in the hash Performance Modern network interface cards provide many hardware features that reduce CPU utilization by offloading certain CPU intensive operations see Teaming and Other Advanced Networking Properties In contrast the BASP intermediate driver is a purely software function that must examine every packet received from the protocol stacks and react to its contents before sending it out through a particular physical interface Though the BASP driver can process each outgoing packet in near constant time some applications that may already be CPU bound may suffer if operated over a teamed interface Such an application may be better suited to take advantage of the failover capabilities of the intermediate
298. memory The range of valid transmit buffers is O to 5000 in increments of 1 with 250 transmit buffers as the default value TCP Connection Offload IPv4 Enables and disables TOE offload when using the IPv4 protocol The default is Enabled TCP Connection Offload IPv6 Enables and disables TOE offload when using the IPv6 protocol The default is Enabled Pause on Exhausted Host Ring For BCM57711 and BCM57712 network adapters there are two possible scenarios that can trigger pause frames to be generated a host ring buffer is exhausted or the on chip buffers are depleted With RSS enabled inside the system it is possible to achieve better Ethernet throughput if no pause frames are being generated in a case where a host ring buffer of multiple RSS rings is exhausted The default is Disabled Quality of Service Enables Quality of Service QoS to provide different priorities to different applications Recv Segment Coalescing IPv4 Enable Receive Segment Coalescing IPv4 Receive Segment Coalescing is an offload technology that reduces CPU utilization for network processing on the receive side by offloading tasks from the CPU to a network adapter Recv Segment Coalescing IPv6 Enable Receive Segment Coalescing IPv6 Receive Segment Coalescing is an offload technology that reduces CPU utilization for network processing on the receive side by offloading tasks from the CPU to a network adapter SR IOV Enables Single Root I O Virtualization
299. mmends against this method Toggling the boot path from NDIS to HBA or vice versa after installation is completed is not recommended Problem Installing Windows onto an iSCSI target via iSCSI boot fails when connecting to a 1 Gbps switch port Solution This is a limitation relating to adapters that use SFP as the physical connection SFP defaults to 10 Gbps operation and does not support autonegotiation ISCSI CRASH DUMP If you will use the Broadcom iSCSI Crash Dump utility it is important to follow the installation procedure to install the iSCSI Crash Dump driver See Using the Installer for more information N Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Crash Dump Page 97 NetXtreme II User Guide March 2014 ISCSI OFFLOAD IN WINDOWS SERVER iSCSI traffic may be segregated offload is a technology that offloads iSCSI protocol processing overhead from host processors to the iSCSI host bus adapter to increase network performance and throughput while helping to optimize server processor utilization This section covers Windows iSCSI offload for the NetXtreme II family of network adapters For Linux iSCSI offload see Linux iSCSI Offload ISCSI OFFLOAD LIMITATIONS The bnx2i driver for iSCSI does not operate on a stand alone PCI device It shares the same PCI device with the networking driver bnx2 and bnx2x The networking driver alone supports layer 2 networking traffic Offloaded iSCSI operations require both
300. mple network the physical LAN consists of a switch two servers and five clients The LAN is logically organized into three different VLANs each representing a different IP subnet The features of this network are described in Table 1 Broadcom Corporation Document INGSRVT710 CDUM100 R Virtual LANs in Windows Broadcom NetXtreme II Network Adapter User Guide Page 63 NetXtreme Il User Guide March 2014 Table 1 Example VLAN Network Topology Component Description VLAN 1 An IP subnet consisting of the Main Server PC 3 and PC 5 This subnet represents an engineering group VLAN 2 Includes the Main Server PCs 1 and 2 via shared media segment and PC 5 This VLAN is a software development group VLAN 3 Includes the Main Server the Accounting Server and PC 4 This VLAN is an accounting group Main Server A high use server that needs to be accessed from all VLANs and IP subnets The Main Server has a Broadcom adapter installed All three IP subnets are accessed via the single physical adapter interface The server is attached to one of the switch ports which is configured for VLANs 1 2 and 3 Both the adapter and the connected switch port have tagging turned on Because of the tagging VLAN capabilities of both devices the server is able to communicate on all three IP subnets in this network but continues to maintain broadcast separation between all of them Accounting Server Available to VLAN 3
301. mponents on a Broadcom network adapter You can trigger the tests manually or choose to have BACS continuously perform them If the test are performed continuously then the number of passes and fails in the Result field for each test increments every time the tests are performed For example if a test is performed four times and there are no fails the value in the Result field for that test is 4 0 However if there were 3 passes and 1 fail the value in the Result field is 3 1 K NOTES e This feature can be used with Windows Server managed hosts only It is not available for hosts operating on Linux or other OSes You can however use BACS on a Linux client to connect to a Windows Server host and run the diagnostic test utility e You must have administrator privileges to run diagnostic tests e The network connection is temporarily lost while these tests are running e Some tests are not supported on all Broadcom adapters To run the diagnostic tests once using the BACS GUI Click the name of the adapter to test in the Explorer View pane and select the Diagnostics tab From the Select a test to run list select Diagnostic Tests Select the diagnostic tests you want to run Click Select All to select all tests or Clear All to clear all test selections Select the number of times to run the tests from Number of loops Click Run test s ps m B 9 ge c In the error message window that warns of the network connection being temporaril
302. ms Vibration peak to peak displacement 0 005 in max 5 Hz to 32 Hz 0 1 in max 5 Hz to 17 Hz Vibration peak acceleration 0 25g 5 Hz to 500 Hz 0 25g 5 Hz to 500 Hz Sweep Rate 1 octave min Sweep Rate 1 octave min Table 13 BCM5709 and BCM5716 Environmental Specifications Parameter Condition Operating Temperature 0 C to 55 C Air Flow Requirement LFM 0 Storage Temperature 40 C to 65 C Storage Humidity 5 to 95 condensing Vibration and Shock IEC 68 FCC Part 68 302 NSTA 1A Electrostatic Electromagnetic Susceptibility EN 61000 4 2 EN 55024 ES eee Broadcom Corporation Document INGSRVT710 CDUM100 R Wake On LAN Power Requirements Page 291 NetXtreme Il User Guide March 2014 Regulatory Information Broadcom NetXtreme II Network Adapter User Guide e FCC Notice e VCCI Notice e CE Notice e Canadian Regulatory Information Canada Only e Korea Communications Commission KCC Notice Republic of Korea Only FCC NOTICE FCC CLAss B Broadcom NetXtreme ll Gigabit Ethernet Controller Broadcom Corporation 190 Mathilda Place Sunnyvale California 94086 USA The equipment complies with Part 15 of the FCC Rules Operation is subject to the following two conditions 1 The device may not cause harmful interference and 2 This equipment must accept any interference received including interference that may cause undesired operation The equipment has been tested and found to
303. n and dynamic failover to other team member or to a hot standby member This is done independently of Layer 3 protocol IP IPX NetBEUI rather it works with existing Layer 2 and 3 switches No switch configuration such as trunk link aggregation is necessary for this type of team to work K NOTES e f you do not enable LiveLink when configuring SLB teams disabling Spanning Tree Protocol STP or enabling Port Fast at the switch or port is recommended This minimizes the downtime due to spanning tree loop determination when failing over LiveLink mitigates such issues e TCP IP is fully balanced and IPX balances only on the transmit side of the team other protocols are limited to the primary adapter e fateam member is linked at a higher speed than another most of the traffic is handled by the adapter with the higher speed rate M Broadcom Corporation Document INGSRVT710 CDUM100 R Load Balancing and Fault Tolerance Page 9 NetXtreme II User Guide March 2014 LINK AGGREGATION 802 3AD This mode supports link aggregation and conforms to the IEEE 802 3ad LACP specification Configuration software allows you to dynamically configure which adapters you want to participate in a given team If the link partner is not correctly configured for 802 3ad link configuration errors are detected and noted With this mode all adapters in the team are configured to receive packets for the same MAC address The outbound load balanc
304. n recovery upon receiving the request Dump data contains the error status 72 Error Unexpected target portal IP types Dump data contains the expected IP type M Page 110 iSCSI Offload in Windows Server Broadcom Corporation Document INGSRVT710 CDUM100 R User Guide NetXtreme II Installing Management Applications Broadcom NetXtreme II Network Adapter User Guide e Overview e Installation Tasks e Detailed Procedures e Installing the Broadcom Advanced Control Suite and Related Management Applications e Managing Management Applications Windows OVERVIEW The Broadcom Advanced Control Suite version 4 BACS4 is a management application for configuring the NetXtreme Il family of adapters also known as Converge Network Adapters CNAs BACS4 software operates on Windows and Linux server and client operating systems This chapter describes how to install the BACS4 management application There are two main components of the BACS4 utility the provider component and the client software A provider is installed on a server or managed host that contains one or more CNAs The provider collects information on the CNAs and makes it available for retrieval from a management PC on which the client software is installed The client software enables viewing information from the providers and configuring the CNAs The BACS client software includes a graphical user interface GUI and a command line interface CLI COMMUNI
305. n the system scales with the amount of RAM With more RAM the descriptor counts can be safely increased The default number of RX TX buffer descriptors is 2048 for each When using a Broadcom BCM57711 network adapter in multifunction mode the number of configured descriptors is divided by four ending up at 512 This is to keep the number of DMA allocations at a minimum After installation it is suggested these descriptor counts be increased until stability is guaranteed and the desired performance is reached For example using the default setting of 2048 for the number of both RX and TX descriptors the approximate amount of memory a single interface would consume is Single Function Mode e RX 2048 DMA handles and 5M MTU 1500 or 21M MTU 9216 of memory e TX 20480 DMA handles and 5M MTU 1500 or 21M MTU 9216 of memory e Total 22528 DMA handles and 10M MTU 1500 or 42M MTU 9216 of memory Multifunction Mode descs 4 e RX 512 DMA handles and 1M MTU 1500 or 5M MTU 9216 of memory e TX 5120 DMA handles and 1M MTU 1500 or 5M MTU 9216 of memory e Total 5335 DMA handles and 2M MTU 1500 or 10M MTU 9216 of memory Broadcom Corporation Document INGSRVT710 CDUM100 R Memory Usage Page 167 NetXtreme II User Guide March 2014 INTERRUPT MANAGEMENT If you have a system with many interfaces it is possible to reach the allocation limit of MSIX interrupts By default Solaris limits each driver to 2 MSIX allocatio
306. na ves Eke bo modiy your drive configuration Add SEU met a Ack FCH SAM Cancel Add drive Deco Opie opm add Ache ancexd Carpet E devices 0 MB malacted cut of D deyore s 0 MB otal d Tips Selecting a driye on Gis screen does no neoessaniy mean it wil ber wiped Ey the irrita FU Deus precem Ap iube Tha pes eiot asd a esu fring treten hn uses esu ro nw select here by morihyirg pour iebcTebab Pie im Back ab Nest 10 For each interface intended for FCoE boot select the interface deselect Use DCB select Use auto vlan and then click Add FCoE Disk s ELM Broadcom Corporation Page 214 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 Peas sete ther Sherk year d Lies B5 mabal Due Ge amp ydberm en ark wd ab am drers yard ke Do automabccaly mari 10 your vysbem belcey Back Teves Amase RAND Multipath Devies Other GEN Deos Search Bost Lapeciny WG Titres Sena Alara kelentifher T Comfigure FCoE Parameters Pleats tien Ehe network interface whch ir connexbed pa your Fone sanctis MCS eral Metuek Interface BC 30 38 01 78 46 T pe DCB ak Add Foo Dido Descr opponi sie Aki Ach rex Earpest daewiceis 0 MB melaxtedi cag of D deyscelzs i MB total P Tipo Selecting a diee on is screen dose nor oey een it wil De wiped E the inatallaticn pretties Ade mote that pesb irnstadlarien you ma een eres yaw didi nor select here Eg madiing ya ieicTo5ab fie in Back albe net
307. nactive state and becomes the new standby member LIVELINK LiveLink is a feature of BASP that is available for the Smart Load Balancing SLB and SLB Auto Fallback Disable type of teaming The purpose of LiveLink is to detect link loss beyond the switch and to route traffic only through team members that have a live link USING THE BROADCOM TEAMING WIZARD You can use the Broadcom Teaming Wizard to create a team configure an existing team if a team has already been created or create a VLAN 1 Create or edit a team To create a new team select Create a Team from the Team menu or right click one of the devices in the Unassigned Adapters section and select Create a Team This option is not available if there are no devices listed in the Unassigned Adapters sections which means all adapters are already assigned to teams To configure an existing team right click one of the teams in the list and select Edit Team This option is only available if a team has already been created and is listed in the Team Management pane IZ NOTE If you prefer to work without the wizard for now click Expert Mode If you want to always use Expert Mode to create a team select Default to Expert Mode on next start See Using Expert Mode 2 To continue using the wizard click Next p Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 265 NetXtreme II User Guide March 2014 vtt Broadcom Teaming Wizard W
308. named session IEEE 802 3 Statistics Frames Rx with Alignment Error A count of the frames that were not an integral number of octets in length and do not pass the FCS check This counter is incremented when the receive status is reported as Alignment Error Frames Tx with one Collision A count of the frames that were involved in a single collision and were subsequently transmitted successfully This counter is incremented when the result of a transmission is reported as Transmit OK and the attempt value is 2 Broadcom Corporation Page 260 Viewing Resource Information Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Frames Tx with more than one Collision A count of the frames that were involved in more than one collision and were subsequently transmitted successfully This counter is incremented when the transmit status is reported as Transmit OK and the value of the attempts variable is greater than 2 and less than or equal to the attempt limit Frames Tx after Deferral A count of the frames that were delayed being transmitted on the first attempt because the medium was busy The frames involved in any collision are not counted Custom Statistics KL NOTE Custom statistics are available only for an enabled Broadcom network adapter Out of Recv Buffer The number of times the adapter ran out of Receive Buffer Descriptors This information is only available for Broadcom NetXtreme ll adapters Frames si
309. nced Therefore this is the recommended teaming mode when the switch supports LACP except when switch fault tolerance is required SLB is the only teaming mode that supports switch fault tolerance Configuration Recommendations Dynamic trunking supports connecting the teamed ports to switches as long as they are on the same broadcast domain and supports IEEE 802 3ad LACP trunking It does not support connecting to a router or Layer 3 switches since the ports must be on the same subnet LiveLink LiveLink is a feature of BASP that is available for the Smart Load Balancing SLB and SLB Auto Fallback Disable types of teaming The purpose of LiveLink is to detect link loss beyond the switch and to route traffic only through team members that have a live link This function is accomplished though the teaming software The teaming software periodically probes issues a link packet from each team member one or more specified target network device s The probe target s responds when it receives the link packet If a team member does not detect the response within a specified amount of time this indicates that the link has been lost and the teaming software discontinues passing traffic through that team member Later if that team member begins to detect a response from a probe target this indicates that the link has been restored and the teaming software automatically resumes passing traffic through that team member LiveLink works only with TC
310. nctions has different effects depending on the actual values used for configuration For example when all functions are configured as O or 25 offloads configured on these functions exhibit different bandwidth settings even though logically they would be expected to have the same effect Consider the following example Assume that four functions are configured with total six offloads as follows Function 0 e Ethernet e FCoE Function 1 e Ethernet Function 2 e Ethernet Function 3 e Ethernet e iSCSI 1 If Bandwidth Weight is configured as O for all four PFs then all six offloads will share the bandwidth equally In this case each offload will be assigned roughly 16 67 of the total bandwidth 2 If Bandwidth Weight is configured as 25 for all four PFs then Ethernet amp FCoE offloads on function O and Ethernet amp ME EE Broadcom Corporation Page 192 Configuring for NIC Partitioning Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 iSCSI offloads on function 3 will be assigned roughly 12 5 of the total bandwidth Ethernet offloads on function 1 and function 2 on the other hand will be assigned roughly 25 of the total bandwidth k NOTE Some vendors put restriction on minimum Bandwidth Weight that can be configured for each function Please refer vendor specific documentation for details OS Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring for NIC Partitioning Page
311. nd later SLES 11 1 and later supports offload and non offload paths e SLES 10 x and SLES 11 only supports non offload path O Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Protocol Broadcom NetXtreme II Network Adapter User Guide Page 79 NetXtreme II User Guide March 2014 ISCSI BOOT SETUP The iSCSI boot setup consists of e Configuring the iSCSI Target e Configuring iSCSI Boot Parameters e Preparing the iSCSI Boot Image e Booting Configuring the iSCSI Target Configuring the iSCSI target varies by target vendors For information on configuring the iSCSI target refer to the documentation provided by the vendor The general steps include Create an iSCSI target Create a virtual disk Map the virtual disk to the iSCSI target created in step 1 Associate an iSCSI initiator with the iSCSI target mod moz Record the iSCSI target name TCP port number iSCSI Logical Unit Number LUN initiator Internet Qualified Name IQN and CHAP authentication details 6 After configuring the iSCSI target obtain the following e Target IQN e Target IP address e Target TCP port number e Target LUN e Initiator IQN e CHAP ID and secret Configuring iSCSI Boot Parameters Configure the Broadcom iSCSI boot software for either static or dynamic configuration Refer to Table 1 for configuration options available from the General Parameters screen Table 1 lists parameters for both IPv4 and IPv6 Parameters specific t
312. ndex 2 is specified for the standard edition For other editions change the index accordingly ME Broadcom Corporation Page 92 iSCSI Boot Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 Injecting Slipstreaming Broadcom Drivers into Windows Image Files To inject Broadcom drivers into the Windows image files you must obtain the following correct Broadcom driver packages for the applicable Windows Server version 2008R2 2008SP2 2012 or 2012R2 from the following location http www broadcom com support ethernet nic netxtremeii10 php K NOTE Refer to the silent txt file for the specific driver installer application for instructions on how to extract the individual Windows NetXtreme II drivers e EVBDa e BXND60a e BXOIS e BXFCOE Then you place these driver packages to a working directory For example copy the driver packages to the following directories e C Temp evbda e C Temp bxnd60a e C Temp bxois e C Temp bxfcoe Finally you inject these drivers into the Windows Image WIM files and install the applicable Windows Server version from the updated images The detailed steps are provided below K NOTE The file and folder names used in this procedure are examples only You can specify your own file and folder names for your slipstream project 1 For Windows Server 2008 R2 and SP2 install the Windows Automated Installation Kit AIK For Windows Server 2012 and 2012 R2 in
313. ndows Server 2008 and Windows Server 2008 R2 This section is intended for those who are familiar with Hyper V and it addresses issues that affect the configuration of NetXtreme II network adapters and teamed network adapters when Hyper V is used For more information on Hyper V see http www microsoft com windowsserver2008 en us hyperv aspx Table 1 identifies Hyper V supported features that are configurable for NetXtreme II network adapters This table is not an all inclusive list of Hyper V features Table 1 Configurable Network Adapter Hyper V Features Supported in Windows Server Feature Comments Limitation 2008 2008 H2 2012 IPv4 Yes Yes Yes IPv6 Yes Yes Yes IPv4 Large Send Offload LSO Yes Yes Yes parent and child partition IPv4 Checksum Offload CO parent Yes Yes Yes and child partition IPv4 TCP Offload Engine TOE No No No OS limitation IPv6 LSO parent and child partition No Yes Yes When bound to a virtual network OS limitation IPv6 CO parent and child partition No Yes Yes When bound to a virtual network OS limitation IPv6 TOE No No No OS limitation Jumbo frames No Yes Yes OS limitation RSS No No Yes OS limitation RSC No No Yes OS limitation SRIOV No No Yes OS limitation ME Broadcom Corporation Page 328 Microsoft Virtualization with Hyper V Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 20
314. nection Use tuo or more adapters for fault tolerance and load balancing L 1 Bul L OC i MI lumich Integrated 81 7b 80 Disconnected _onnected 11 For BCM57800 and BCM57810 boards the FCoE boot devices need to have a separate vSwitch other than vSwithO This allows DHCP to assign the IP address to the management network rather than to the FCoE boot device To create a vSwitch for the FCoE boot devices add the boot device vmnics in vSphere Client under Networking 10 13 249 217 Mware ESXi 5 1 0 732143 Evaluation 37 days remaining Getting Started Summary Virtual Machines Resource Allocation Performance flea eam Tasks amp Events Alarms Permissions Maps Storage Views Hardware Status Hardware View vSphere Standard Switch vSphere Distributed Switch Processors Networking Refresh Add Networking Properties Memory Storage Standard Switch vSwitchO Remove Properties Networking Virtual Machine Port Group Physical Adapters a ee L3 VM Network e EH vmnics 1000 Ful 53 Network Adapters parr E 5 4 4 E 6 virtual machines A Setti vanced Settings ine 5 1 Power Management vm3 E Software vm2 B vmi Licensed Features i vm6 eu Time Configuration vm5 E DNS and Routing Piers j VMkemel Port Authentication Services D Management Network e POMPE MEOE vmkD 10 13 249 217 Virtual Machine Startup Shutdown fe80 a236 9fff Fe07 4d18 Virtual Machin
315. net 3 00186 Broadcom NetXtreme Gigabit Ethernet 4 Standby Member znot configured gt Team Offload Capabilities Team MTU N A VLAN Configuration ala Manage VLAN s Enable LiveLink E Mo Team Name The team name cannot exceed 39 characters cannot begin with spaces and cannot contain any special characters wizard Mode Update 4 Make the desired changes and then click Update The changes have not yet been applied click the Preview tab to view the updated team structure before applying the changes 5 Click Apply Exit to apply the updates and exit the Manage Teams window 6 Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted Adding a VLAN You can add virtual LANs VLANs to a team This enables you to add multiple virtual adapters that are on different subnets The benefit of this is that your system can have one network adapter that can belong to multiple subnets With a VLAN you can couple the functionality of load balancing for the load balance members and you can employ a failover adapter S Broadcom Corporation Page 282 Configuring Teaming Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 You can define up to 64 VLANs per team 63 VLANs that are tagged and 1 VLAN that is not tagged VLANs can only be created when all teams members are Broadcom adapters If you try to create a VLAN with a non Broadcom adapter an error message is displa
316. net can be used for file sharing and serving the data to the compute nodes This can be done simply using an NFS server or using parallel file systems such as PVFS e Management amp Administration Ethernet is used for out of band ERA and in band OMSA management of the nodes in the cluster It can also be used for job scheduling and monitoring In our current HPCC offerings only one of the on board adapters is used If Myrinet or IB is present this adapter serves l O and administration purposes otherwise it is also responsible for IPC In case of an adapter failure the administrator can use the Felix package to easily configure adapter 2 Adapter teaming on the host side is neither tested nor supported in HPCC Advanced Features PXE is used extensively for the deployment of the cluster installation and recovery of compute nodes Teaming is typically not used on the host side and it is not a part of our standard offering Link aggregation is commonly used between switches especially for large configurations Jumbo frames although not a part of our standard offering may provide performance improvement for some applications due to reduced CPU overhead ee Broadcom Corporation Document INGSRVT710 CDUM100 R Application Considerations Page 47 NetXtreme II User Guide March 2014 Oracle In our Oracle Solution Stacks we support adapter teaming in both the private network interconnect between RAC nodes and public network
317. nfiguration On all other systems the boot protocol is specified through the Broadcom Comprehensive Configuration Management CCM and for those systems this step is not required ELM Broadcom Corporation Page 196 FCoE Boot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 PREPARE BROADCOM MULTIPLE BOOT AGENT FOR FCOE BOOT 1 During POST press CTRL S at the Broadcom NetXtreme Ethernet Boot Agent banner to invoke the CCM utility Press Ctrl S to Configure Device MAC Address ATBADB4FF178 11 of the disks from your previous configuration are gone If this is n unexpected message then please power off your system and check your cables to ensure all disks are present ress any key to continue or C to load the configuration utility 9 Virtual Drivels found on the host adapter 9 Virtual Drivels handled by BIOS roadcom Netxtreme Ethernet Boot Agent npuright C 2000 2010 Broadcom Corporation ll rights reserved ress Ctrl 5 to enter Configuration Menu 2 Select the device through which boot is to be configured og IMPORTANT When running in NIC Partitioning NPAR mode FCoE boot is supported only when the first function on each port is assigned an FCoE personality FCoE boot is not supported when the FCoE personality is assigned to any other function g eme Eum E r J En qe ig E mpm re ret lal F TT Lomprehensies Configuration Management vb urna mh f ES 7 P4778 TTE Wy pP
318. non offload paths Note that SLES 10 x and SLES 11 have support only for the non offload path 1 For driver update obtain the latest Broadcom Linux driver CD 2 Configure the iSCSI Boot Parameters for DVD direct install to target by disabling the Boot from target option on the network adapter 3 Configure to install via the non offload path by setting HBA Boot Mode to Disabled in the NVRAM Configuration Note This parameter cannot be changed when the adapter is in Multi Function mode Note that for RHEL6 2 and SLES11SP2 and newer installation via the offload path is supported For this case set the HBA Boot Mode to Enabled in the NVRAM Configuration 4 Change the boot order as follows a Boot from the network adapter b Boot from the CD DVD driver Reboot the system 6 System will connect to iSCSI target then will boot from CD DVD drive Follow the corresponding OS instructions a RHEL 5 5 Type linux dd at boot prompt and press enter b SuSE 11 X Choose installation and type withiscsi 1 netsetup 1 at the boot option If driver update is desired choose YES for the F6 driver option If driver update is desired follow the instructions to load the driver CD otherwise skip this step 9 Atthe networking device prompt choose the desired network adapter port and press OK 10 At configure TCP IP prompt configure the way the system acquire IP address and press OK 11 If static IP was chosen you nee
319. not a broadcast packet the router will not process it and will not update its own ARP cache The only way that the router would process an ARP that is intended for another network device is if it has Proxy ARP enabled and the host has no default gateway This is very rare and not recommended for most applications Transmit traffic through a router will be load balanced as transmit load balancing is based on the source and destination IP address and TCP UDP port number Since routers do not alter the source and destination IP address the load balancing algorithm works as intended Configuring routers for Hot Standby Routing Protocol HSRP does not allow for receive load balancing to occur in the adapter team In general HSRP allows for two routers to act as one router advertising a virtual IP and virtual MAC address One physical router is the active interface while the other is standby Although HSRP can also load share nodes using MENU EE Broadcom Corporation Page 18 Executive Summary Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 different default gateways on the host nodes across multiple routers in HSRP groups it always points to the primary MAC address of the team Generic Trunking Generic Trunking is a switch assisted teaming mode and requires configuring ports at both ends of the link server interfaces and switch ports This is often referred to as Cisco Fast EtherChannel or Gigabit EtherChannel In additi
320. not necessarily inherit adapter properties rather various properties depend on the specific capability For instance an example would be flow control which is a physical adapter property and has nothing to do with BASP and will be enabled on a particular adapter if the miniport driver for that adapter has flow control enabled KL NOTE All adapters on the team must support the property listed in Table 7 in order for the team to support the property p Broadcom Corporation Document INGSRVT710 CDUM100 R Teaming and Other Advanced Networking Properties Page 35 NetXtreme II User Guide March 2014 CHECKSUM OFFLOAD Checksum Offload is a property of the Broadcom network adapters that allows the TCP IP UDP checksums for send and receive traffic to be calculated by the adapter hardware rather than by the host CPU In high traffic situations this can allow a system to handle more connections more efficiently than if the host CPU were forced to calculate the checksums This property is inherently a hardware property and would not benefit from a software only implementation An adapter that supports Checksum Offload advertises this capability to the operating system so that the checksum does not need to be calculated in the protocol stack Checksum Offload is only supported for IPv4 at this time IEEE 802 1P QoS TAGGING The IEEE 802 1p standard includes a 3 bit field supporting a maximum of 8 priority levels which allows for traffic priorit
321. ns and there is an issue with the pcplusmp module where only a maximum of 31 MSIX interrupts are available per interrupt priority level If your system has four Broadcom BCM57711 network adapter ports each running in multifunction mode Solaris will enumerate 16 bnxe interfaces The last interface attached will fail to allocate its second MSIX interrupt and revert to Fixed This in turn can eventually expose an issue in the system regarding interrupt management resulting in interrupts never being received on the interface that reverted back to Fixed To ensure all interfaces are able to allocate their two MSIX interrupts the workaround is to change the priority levels of specific interfaces Network drivers are automatically assigned an interrupt priority level of 6 so changing an interface s priority level to 5 is common 1 First read the driver conf man page for a background primer 2 Find out the driver instance paths assigned on your system grep bnxe etc path to inst pci80 0 pci8086 277981 pcil4e4 165080 0 bnxe pcie0 0 pci8086 2779801 pcil4e4 165080 1 1 bnxe 3 Normally the name of the driver is the last portion of the path but you should use the most appropriate PCI ID found in etc driver_aliases Depending on how the hardware is layered there are cases where the name identified in path_to_inst will not work To figure out which name to use examine the output from prtconf v and match against the IDs specified in the d
322. ns the bnx2 bnx2x driver may be needed The driver disk images for the most recent Red Hat and SuSE versions are included Boot drivers for other Linux versions can be compiled by modifying the Makefile and the make environment Further information is available from the Red Hat website http www redhat com SETTING VALUES FOR OPTIONAL PROPERTIES Optional properties exist for the different drivers e bnx2 Driver e bnx2x Driver e bnx2i Driver BNX2 DRIVER disable msi The disable msi optional property can be supplied as a command line argument to the insmod or modprobe command The property can also be set in modprobe conf See the man page for more information All other driver settings can be queried and changed using the ethtool utility See the ethtool man page for more information The ethtool settings do not p Broadcom Corporation Document INGSRVT710 CDUM100 R Patching PCI Files Optional Page 151 NetXtreme II User Guide March 2014 persist across a reboot or module reload The ethtool commands can be put in a startup script such as etc rc local to preserve the settings across a reboot ra NOTE Some combinations of property values may conflict and result in failures The driver cannot detect all such conflicting combinations This property is used to disable Message Signal Interrupts MSI and the property is valid only on 2 6 kernels that support MSI On 2 4 kernels this property cannot be used By default the driv
323. nsult the driver release Program Features Driver is the operating system on notes and install the driver not designed to run on this which it is installed on a supported operating version of Operating system or update the driver System 13 Informational Hot standby adapter is A standby adapter has been Replace the failed physical selected as the primary adapter for a team without a load balancing adapter activated adapter p Broadcom Corporation Document INGSRVT710 CDUM100 R Appendix A Event Log Messages Page 59 NetXtreme Il User Guide March 2014 Table 9 Intermediate Driver Event Log Messages Cont System sveni Severity Message Cause Corrective Action Message Number 14 Informational Network adapter does not The physical adapter does Replace the adapter with support Advanced Failover not support the Broadcom one that does support NICE NIC Extension NICE 15 Informational Network adapter is enabled The driver has successfully No action is required via management interface enabled a physical adapter through the management interface 16 Warning Network adapter is disabled The driver has successfully No action is required via management interface disabled a physical adapter through the management interface 17 Informational Network adapter is activated A physical adapter has been No action is required and is participating in added to or activated in a network traffic tea
324. nt BASP Failover event Loss of link only Failover time 500 ms Fallback time 1 5 s approximate MAC address Same for all adapters Multivendor teaming Yes Dynamic Trunking User interface Broadcom Advanced Control Suite BACS Number of teams Maximum 16 Number of adapters per team Maximum 8 e Document INGSRVT710 CDUM100 R Broadcom Corporation Teaming Mechanisms Page 33 NetXtreme Il User Guide March 2014 Table 5 Attributes Cont Feature Attribute Hot replace Yes Hot add Yes Hot remove Yes Link speed support Different speeds Frame protocol All Incoming packet management Switch Outgoing packet management BASP Failover event Loss of link only Failover time lt 500 ms Fallback time 1 5 s approximate MAC address Same for all adapters Multivendor teaming Yes a Some switches require matching link speeds to correctly negotiate between trunk connections b Make sure that Port Fast or Edge Port is enabled SPEEDS SUPPORTED FOR EACH TYPE OF TEAM The various link speeds that are supported for each type of team are listed in Table 6 Mixed speed refers to the capability of teaming adapters that are running at different link speeds Table 6 Link Speeds in Teaming Type of Team Link Speed Traffic Direction Speed Support SLB 10 100 1000 10000 Incoming outgoing Mixed speed FEC 100 In
325. nt INGSRVT710 CDUM100 R FCoE Boot from SAN Page 217 NetXtreme II User Guide March 2014 VMware ESXi 5 1 FCOE BOOT INSTALLATION FCoE Boot from SAN requires that the latest Broadcom NetXtreme II async drivers be included into the ESXi 5 1 install image Refer to mage builder doc pdf from VMware on how to slipstream drivers 1 Boot from the updated ESXi 5 1 installation image and select ESXi 5 1 installer when prompted pow x Tai bai Eo5 13 1 hntL amp Gr ESxi5 1 HC 732143 Installer Boot from local disk 2 Press Enter to continue Helcome to the VMware ESXi 5 1 0 Installation VHuare ESXi 5 1 0 installs on most systems but only systems on VMuare s Compatibility Guide are supported Consult the VMuare Compatibilitu Guide at http uuai vmnuaare comn resources conpat ibility Select the operation to perforn 3 Press F11 to accept the agreement and continue End User License Agreement EULA VHHARE INC MASTER SOFTHARE BETA TEST AGREEMENT Note BY CLICKING I AGREE ACCESSING DOWNLOADING INSTALLING UPLOADING COPYING OR USING THE BETA SOFTWARE YOU CONCLUDE THIS MASTER SOFTWARE BETA TEST AGREEMENT AGREEMENT IM A LEGALLY BINDING MANNER WHITH VMHARE INC 3401 HILLVIEW AVENUE PALO ALTO CA 94304 USA C VHuare IF YOU HAVE SPECIFIED IN CONNECTION WITH THE REGISTRATION PROCESS FOR THIS SOFTHARE BETA TEST PROGRAM THAT YOU ARE ACTING ON BEHALF OF A COMPANY OR OTHER ORGANIZATION YOU REPRESENT THAT Y
326. ntext of Tx but not Rx TESTING THE NETWORK The Network Test option on the Diagnostics tab lets you verify IP network connectivity This test verifies if the driver is installed correctly and tests connectivity to a gateway or other specified IP address on the same subnet The network test uses TCP IP to send ICMP packets to remote systems then waits for a response If a gateway is configured the test automatically sends packets to that system If a gateway is not configured or if the gateway is unreachable the test prompts for a destination IP address K NOTES O Broadcom Corporation Document INGSRVT710 CDUM100 R Managing Ethernet Controller Port Page 245 NetXtreme II User Guide March 2014 e The network test option is not available on adapters that are grouped into a team see Configuring Teaming e This feature can be used with Windows Server managed hosts only It is not available for hosts operating on Linux or other OSes You can however use BACS on a Linux client to connect to a Windows Server host and run the network test utility To run the network test using the BACS GUI 1 Click the name of the adapter to test in the Explorer View pane From the Select a test to run list select Network Test 3 To change the destination IP address select IP address to ping then click the browse button In the Network Test window enter a Destination IP address then click OK 4 Click Run The results of the n
327. nu 8 Select Finish to save and exit SETTING UP THE BIOS To boot from the network with the MBA make the MBA enabled adapter the first bootable device under the BIOS This procedure depends on the system BIOS implementation Refer to the user manual for the system for instructions SETTING UP MBA IN A SERVER ENVIRONMENT RED HAT LINUX PXE SERVER The Red Hat Enterprise Linux distribution has PXE Server support It allows users to remotely perform a complete Linux installation over the network The distribution comes with the boot images boot kernel vmlinuz and initial ram disk initrd which are located on the Red Hat disk 1 images pxeboot vmlinuz images pxeboot initrd img Refer to the Red Hat documentation for instructions on how to install PXE Server on Linux The Initrd img file distributed with Red Hat Enterprise Linux however does not have a Linux network driver for the Broadcom NetXtreme ll adapters This version requires a driver disk for drivers that are not part of the standard distribution You can create a driver disk for the Broadcom NetXtreme ll adapter from the image distributed with the installation CD Refer to the Linux Readme txt file for more information MS DOS UNDI INTEL APITEST To boot in MS DOS mode and connect to a network for the MS DOS environment download the Intel PXE PDK from the Intel website This PXE PDK comes with a TFTP ProxyDHCP Boot server The PXE PDK can be downloaded from Intel at http
328. number in the following example it is set to 0026 HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Control Class 4D36E972 E325 1 1CE BFC1 08002BE10318 0026 RssOrVmaPreference uu Broadcom Corporation Page 332 Microsoft Virtualization with Hyper V Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 REMOVING THE BROADCOM NETXTREME ll DEVICE DRIVERS Uninstall the Broadcom NetXtreme II device drivers from your system only through the InstallShield wizard Uninstalling the device drivers with Device Manager or any other means may not provide a clean uninstall and may cause the system to become unstable For information on uninstalling Broadcom NetXtreme ll device drivers see Removing the Device Drivers UPGRADING WINDOWS OPERATING SYSTEMS This section covers Windows upgrades for the following e From Windows Server 2003 to Windows Server 2008 e From Windows Server 2008 to Windows Server 2008 R2 e From Windows Server 2008 R2 to Windows Server 2012 Prior to performing an OS upgrade when a Broadcom NetXtreme ll adapter is installed on your system Broadcom recommends the procedure below Save all team and adapter IP information Uninstall all Broadcom drivers using the installer Perform the Windows upgrade B owe m5 ol Reinstall the latest Broadcom adapter drivers and the BACS application BROADCOM BOOT AGENT Problem Unable to obtain network settings through DHCP using PXE Solution For p
329. o allocate map The driver cannot allocate Unload other drivers that may registers map registers from the allocate map registers operating system 3 Error Failed to access The driver cannot access PCI For add in adapters reseat the configuration information configuration space registers adapter in the slot move the Reinstall the network on the adapter adapter to another PCI slot or driver replace the adapter 4 Warning The network link is down The adapter has lost its Check that the network cable is Check to make sure the connection with its link partner connected verify that the network cable is properly network cable is the right type connected and verify that the link partner for example switch or hub is working correctly 5 Informational The network link is up The adapter has establisheda No action is required link uu Broadcom Corporation Page 56 Appendix A Event Log Messages Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Table 8 Base Driver Event Log Messages Cont Message Number 2 Verity Message Cause Corrective Action 6 Informational Network controller The adapter has been No action is required configured for 10Mb half manually configured for the duplex link selected line speed and duplex settings 7 Informational Network controller The adapter has been No action is required configured for 10Mb full manually con
330. o either IPv4 or IPv6 are noted K NOTE Availability of IPv6 iSCSI boot is platform device dependent Table 1 Configuration Options Option Description TCP IP parameters via DHCP This option is specific to IPv4 Controls whether the iSCSI boot host software acquires the IP address information using DHCP Enabled or use a static IP configuration Disabled IP Autoconfiguration This option is specific to IPv6 Controls whether the iSCSI boot host software will configure a stateless link local address and or stateful address if DHCPv6 is present and used Enabled Router Solicit packets are sent out up to three times with 4 second intervals in between each retry Or use a static IP configuration Disabled ME EE Broadcom Corporation Page 80 iSCSI Boot Document INGSRVT710 CDUM 100 R User Guide March 2014 NetXtreme Il Table 1 Configuration Options Option Description iSCSI parameters via DHCP Controls whether the iSCSI boot host software acquires its iSCSI target parameters using DHCP Enabled or through a static configuration Disabled The static information is entered through the iSCSI Initiator Parameters Configuration screen CHAP Authentication Controls whether the iSCSI boot host software uses CHAP authentication when connecting to the iSCSI target If CHAP Authentication is enabled the CHAP ID and CHAP Secret are entered through the iSCSI Initiator Parameters Configuration screen
331. o reflect the backup server Adapter B MAC address When Client Server Blue needs to transmit data it uses either one of its adapter interfaces which is determined by its own SLB algorithm What is important is that data from Client Server Blue is received by the Backup Server Adapter B interface and not by its Adapter A interface This is important because with both backup streams running simultaneously the backup server must oad balance data streams from different clients With both backup streams running each adapter interface on the backup server is processing an equal load thus load balancing data across both adapter interfaces MM EE Broadcom Corporation Page 50 Application Considerations Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 The same algorithm applies if a third and fourth backup operation is initiated from the backup server The teamed interface on the backup server transmits a unicast G ARP to backup clients to inform them to update their ARP cache Each client then transmits backup data along a route to the target MAC address on the backup server Fault Tolerance If a network link fails during tape backup operations all traffic between the backup server and client stops and backup jobs fail If however the network topology was configured for both Broadcom SLB and switch fault tolerance then this would allow tape backup operations to continue without interruption during the link failure All failover p
332. o set the IP address using a static IP address Enter the IP Address Subnet Mask and Default Gateway 3 Configure the VLAN ID for the iSCSI HBA by entering a number for VLAN ID The value must be between 1 and 4094 4 After the configurations are complete click Apply to save the settings or click Reset to revert back to the previous settings VIEWING LICENSES K NOTES e The Licenses section of the Configurations tab is only available for Broadcom NetXtreme II adapters and VBD drivers e Not all offload technologies are available with all adapters The Licenses section shows the number of connections available for TOE and iSCSI offload technologies To view licenses 1 Click the name of the Broadcom NetXtreme ll system device in the Explorer View pane uu Broadcom Corporation Page 262 Viewing Resource Information Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 CONFIGURING TEAMING ra NOTE BACS does not support teaming on Linux systems Linux provides a similar built in functionality called Channel Bonding Refer to the Linux OS documentation for more information The teaming function allows you to group any available network adapters together to function as a team Teaming is a method of creating a virtual NIC a group of multiple adapters that functions as a single adapter The benefit of this approach is that it enables load balancing and failover Teaming is done through the Broadcom Advan
333. oadcom to describe 2 5 Gbit s 3 125 GB4Q operation LC is a trademark of Lucent Technologies INTERFACE SPECIFICATIONS Table 4 10 100 1000BASE T Performance Specifications Feature Specification PCI Express Interface x4 link width 10 100 1000BASE T 10 100 1000 Mbps Table 5 10GBASE T Performance Specifications Feature Specification PCI Express Interface x8 link width 10GBASE T 10 Gbps M E Broadcom Corporation Document INGSRVT710 CDUM100 R 1000 2500BASE X Fiber Optic Specifications Page 289 NetXtreme II User Guide March 2014 NIC PHYSICAL CHARACTERISTICS Table 6 NIC Physical Characteristics NIC Type NIC Length NIC Width BCM5708 PCI Express 14 7 cm 5 79 inches 6 4 cm 2 52 inches BCM5709 BCM5716 PCI Express x4 low profile 11 9 cm 4 7 inches 6 9 cm 2 7 inches BCM57710 BCM57711 BCM57712 PCI Express 16 8 cm 6 6 inches 5 1 cm 2 0 inches x8 low profile NIC PowER REQUIREMENTS Table 7 BCM5708C NIC Power Requirements Link NIC 3 3V Current Draw A NIC Power W Idle no link 1 44 4 75 1 Gbit 1 97 6 50 100 Mbit 1 60 5 28 10 Mbit 1 62 5 35 Table 8 BCM5709C BCM5716 NIC Power Requirements Link NIC 3 3V Current Draw A NIC Power W Idle no link 1 01 3 32 1 Gbit 1 43 4 71 100 Mbit 1 16 3 81 10 Mbit 1 12 3 71 Table 9 BCM57710 BCM57711 BCM57712 NIC Power Requirements Link NIC 12V Current Draw A
334. object explorer panel The available tabs for the NDIS function are as follows At the NDIS level you can view parameters configure parameters and run tests from the following tabs e Information e Configuration e Diagnostics e Statistics VIEWING NDIS INFORMATION Select the NDIS driver in the Explorer View pane and then select the Information tab to view NDIS level information E oc e Information about Broadcom network adapters may be more comprehensive than information about network adapters made by others e Some information may not be available for all Broadcom network adapters Viewing Driver Information Information Tab Driver Information MM EE Broadcom Corporation Page 250 Managing the LAN Device Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Driver Status The status of the adapter driver e Loaded Normal operating mode The adapter driver has been loaded by the OS and is functioning e Not Loaded The driver associated with the adapter has not been loaded by the OS e Information Not Available The value is not obtainable from the driver that is associated with the adapter Driver Name The file name of the adapter driver Driver Version The current version of the adapter driver Driver Date The creation date of the adapter driver Information Tab Vital Signs IP Address The network address associated with the adapter If the IP address is all Os the associated driver has not b
335. ocesses false p If you want root user to connect remotely e cimconfig s enableRemotePrivilegedUserAccess true p User configuration with privilege The Linux system users are used for OpenPegasus authentication The systems users have to be added to OpenPegasus using cimuser to connect via BACS e cimuser a u lt username gt w lt password gt Example cimuser a u root w linuxl Enable HTTP 1 If CIM server is not started start it 2 Use the following command to set up an HTTP port optional cimconfig s httpPort 5988 p This property is not available for Inbox OpenPegasus 3 Use the following command to enable HTTP connection cimconfig s enableHttpConnection true p 4 Use the cimserver s and cimserver commands respectively to stop and restart CIM server for the new configuration to take effect Enable HTTPS 1 If CIM server is not started start it 2 Set up HTTPS port with the following command optional cimconfig s httpsPort 5989 p This property is not available for inbox OpenPegasus 3 Enable HTTPS connection with the following command cimconfig s enableHttpsConnection true p 4 Use the cimserver s and cimserver commands respectively to stop and restart CIM server for the new configuration to take effect uc Broadcom Corporation Page 126 Detailed Procedures Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Install Broadcom CMPI Provider Ensure that OpenP
336. ode Speed amp Duplex SerDes e 1 Gb Full Forces the speed to 1 Gb Full based on a matching setting for its link partner e Auto default Sets the speed to auto negotiate with its link partner at the highest matching speed e Auto with 1Gb Fallback Full Sets the speed to auto negotiate with its link partner but if the attached link partner is forced at 1 Gbit s it will fall back to this mode e Hardware Default Sets the speed to negotiate according to the setting specified by the manufacturer see manufacturer documentation for more information ra NOTE The following properties pertain to Windows Vista operating systems TCP UDP Checksum Offload IPv4 Allows configuring checksum offload for the IPv4 protocol e Disable Disables checksum offload e Rx Enabled Enables receive TCP IP UDP checksum offload ME Broadcom Corporation Page 254 Managing the LAN Device Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 e Tx Enabled Enables transmit TCP IP UDP checksum offload e TX amp Rx Enabled default Enables transmit and receive TCP IP UDP checksum offload Priority amp VLAN Allows enabling both the prioritization of network traffic and VLAN tagging VLAN tagging only occurs when the VLAN ID setting is configured with a value other than O zero Priority amp VLAN Enabled default Allows for packet prioritization and VLAN tagging e Priority amp VLAN Disabled Prevents packet priorit
337. odes to communicate over For teaming in a clustered environment customers are recommended to use the same brand of adapters Uu Broadcom Corporation Document INGSRVT710 CDUM100 R Application Considerations Page 45 NetXtreme II User Guide March 2014 Figure 7 shows a 2 node Fibre Channel cluster with three network interfaces per cluster node one private and two public On each node the two public adapters are teamed and the private adapter is not Teaming is supported across the same switch or across two switches Figure 8 shows the same 2 node Fibre Channel cluster in this configuration Figure 7 Clustering With Teaming Across One Switch L aptop computer r1 E Sone Desktop Workstation GE Switch CX MO NIC Team E Fibre Channel switches External Storage K NOTE Microsoft Network Load Balancing is not supported with Microsoft Cluster Software MENU EE Broadcom Corporation Page 46 Application Considerations Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 High Performance Computing Cluster Gigabit Ethernet is typically used for the following three purposes in high performance computing cluster HPCC applications e nter Process Communications IPC For applications that do not require low latency high bandwidth interconnects such as Myrinet InfiniBand Gigabit Ethernet can be used for communication between the compute nodes e O Ether
338. of the link 802 3ad provides a manual aggregation that only requires both ends of the link to be in a link up state Because manual aggregation provides for the activation of a member link without performing the LACP message exchanges it should not be considered as reliable and robust as an LACP negotiated link LACP automatically determines which member links can be aggregated and then aggregates them It provides for the controlled addition and removal of physical links for the link aggregation so that no frames are lost or duplicated The removal of aggregate link members is provided by the marker protocol that can be optionally enabled for Link Aggregation Control Protocol LACP enabled aggregate links The Link Aggregation group advertises a single MAC address for all the ports in the trunk The MAC address of the Aggregator can be the MAC addresses of one of the MACs that make up the group LACP and marker protocols use a multicast destination address The Link Aggregation control function determines which links may be aggregated and then binds the ports to an Aggregator function in the system and monitors conditions to determine if a change in the aggregation group is required Link aggregation combines the individual capacity of multiple links to form a high performance virtual link The failure or replacement of a link in an LACP trunk will not cause loss of connectivity The traffic will simply be failed over to the remaining links in the trunk
339. om supplied teaming support is provided by three individual software components that work together and are supported as a package When one component is upgraded all the other components must be upgraded to the supported versions Table 3 describes the four software components and their associated files for supported operating systems Table 3 Broadcom Teaming Software Component Ai Broadcom Name Network Adapter Operating System p hid fre MONS ANE Virtual Bus Driver BCM5706 BCM5708 BCM5709 32 bit bxvbdx sys VBD BCM5706 BCM5708 BCM5709 64 bit bxvbda sys BCM57710 BCM57711 BCM57712 32 bit evbdx sys BCM57840 BCM57710 BCM57711 BCM57712 64 bit evbda sys BCM57840 Windows Server 2012 64 bit bxnd60a sys Miniport Driver Broadcom Base Driver Windows Server 2008 NDIS 6 0 32 bit bxnd60x sys Windows Server 2008 NDIS 6 0 64 bit bxnd60a sys Windows Server 2008 R2 NDIS 6 0 64 bit bxnd60a sys Windows Server 2012 64 bit basp sys Intermediate Broadcom Advanced Windows Server 2008 32 bit 64 bit basp sys Driver oo Windows Server 2008 R2 64 bit basp sys Configuration Broadcom Advanced Windows Server 2008 bacs exe User Interface Control Suite BACS Windows Server 2008 R2 B boss Windows Server 2012 bacs exe Broadcom Corporation Document INGSRVT710 CDUM100 R Executive Summary Page 21 NetXtreme II User Guide March 2014 HARDWARE REQUIREMENTS e Repeater Hub e Switching Hub e Rou
340. on Engineering e Common Name e g YOUR name Enter the host name or IP address of the Windows server For iPv6 enter the e Optional Email Address Enter the following additional attributes to be sent with your certificate request e Achallenge password linux1 e An optional company name 4 Remove the passphrase from the key Enter the following commands cp server key server key org openssl rsa in server key org out server key 5 Generate a self signed certificate To generate a self signed certificate which is active for 365 days enter the following command openssl x509 req days 365 in server csr signkey server key out server crt The following output displays EE eee Broadcom Corporation Document INGSRVT710 CDUM100 R Detailed Procedures Page 117 NetXtreme II User Guide March 2014 Signature ok subject C US ST California L Irvine O Broadcom Corporation OU Engineering CN MGMTAPP LAB3 emailAddress Getting Private key 6 Enter the following command to verify the generated self signed certificate openssl verify server crt The following output displays server crt C US ST California L Irvine O Broadcom Corporation OU Engineering CN MGMTAPP LAB3 emailAddress error 18 at 0 depth lookup self signed certificate OK Ignore the error message error 18 at O depth lookup self signed certificate This error indicates that this is a self signed certificate 7 Convert the certificate
341. on generic trunking supports similar implementations by other switch OEMs such as Extreme Networks Load Sharing and Bay Networks or IEEE 802 3ad Link Aggregation static mode In this mode the team advertises one MAC Address and one IP Address when the protocol stack responds to ARP Requests In addition each physical adapter in the team uses the same team MAC address when transmitting frames This is possible since the switch at the other end of the link is aware of the teaming mode and will handle the use of a single MAC address by every port in the team The forwarding table in the switch will reflect the trunk as a single virtual port In this teaming mode the intermediate driver controls load balancing and failover for outgoing traffic only while incoming traffic is controlled by the switch firmware and hardware As is the case for Smart Load Balancing the BASP intermediate driver uses the IP TCP UDP source and destination addresses to load balance the transmit traffic from the server Most switches implement an XOR hashing of the source and destination MAC address k Link Aggregation IEEE 802 3ad LACP NOTE Generic Trunking is not supported on iSCSI offload adapters Link Aggregation is similar to Generic Trunking except that it uses the Link Aggregation Control Protocol to negotiate the ports that will make up the team LACP must be enabled at both ends of the link for the team to be operational If LACP is not available at both ends
342. onal commands Windows Syntax winfwupg all service name MAC Commands Parameters Parameter Description all service name The a11 command applies to the upgrade and restorenvram commands only MAC The service name MAC parameter is optional for the help version and dev commands but it is required for all other commands Note the following e When a11 is specified neither service name nor MAC can be specified Both the upgrade and the restorenvram commands use the device information in the image to apply to all NICs with a matching device ID e On Windows service name is the service GUID in the form XXXXXXXX XXXX XXXX XXXX XXXXXXXXXXXX For example 4D36E972 E325 11CE BFC1 08002bE10318 refers to the series of numbers that Windows uses to identify the adapter This can be obtained based on the value in the registry NetCfglnstanceld string located at HKEY_LOCAL_MACHINE System CurrentControlSet Control Class 4D36E972 E325 11CE BFC1 08002BE 10318 where reflects the enumeration number of the Broadcom adapter e MAC is the MAC address name of the NIC in the system For example if 00 10 18 00 11 99 is a valid MAC address as shown in the ipconfig utility then use 001018001199 as an input parameter to select the NIC Commands The following is the list of available commands These are described in detail in Command Descriptions cfg Configure NVRAM e crc Check update NVRAM c
343. onnections b Right click the name of the team to be configured and then click Properties c Onthe General tab click Internet Protocol TCP IP and then click Properties d Configure the IP address and any other necessary TCP IP configuration for the team and then click OK when finished Modifying a Team After you have created a team you can modify the team in the following ways e Change the type of team e Change the members assigned to the team e Add a VLAN e Modify a VLAN using Expert Mode e Remove a team or a VLAN using Expert Mode To modify a team e Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 281 NetXtreme II User Guide March 2014 1 From the Team menu click Edit Team or right click one of the teams in the list and select Edit Team This option is only available if a team has already been created and is listed in the Team Management pane 2 The wizard Welcome screen appears Click Next to continue modifying a team using the wizard or click Expert Mode to work in Expert Mode NOTE The Edit Team tab in Expert Mode appears only if there are teams configured on the system 3 Click the Edit Team tab Cul Manage Teams Edit Team Team 1 Property Team Type Smart Load Balancing TM and Failover E Load Balance Members E Manage Members E 0007 Broadcom MetXtreme Gigabit Ethernet E 0014 Broadcom NetXtreme Gigabit Ethernet 2 0015 Broadcom Metxtreme Gigabit Ether
344. oot Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Dynamic iSCSI Boot Configuration In a dynamic configuration you only need to specify that the system s IP address and target initiator information are provided by a DHCP server see IPv4 and IPv6 configurations in Configuring the DHCP Server to Support iSCSI Boot For IPv4 with the exception of the initiator iSCSI name any settings on the Initiator Parameters 1st Target Parameters or 2nd Target Parameters screens are ignored and do not need to be cleared For IPv6 with the exception of the CHAP ID and Secret any settings on the Initiator Parameters 1st Target Parameters or 2nd Target Parameters screens are ignored and do not need to be cleared For information on configuration options see Table 1 K NOTE When using a DHCP server the DNS server entries are overwritten by the values provided by the DHCP server This occurs even if the locally provided values are valid and the DHCP server provides no DNS server information When the DHCP server provides no DNS server information both the primary and secondary DNS server values are set to 0 0 0 0 When the Windows OS takes over the Microsoft iSCSI initiator retrieves the iSCSI Initiator parameters and configures the appropriate registries statically It will overwrite whatever is configured Since the DHCP daemon runs in the Windows environment as a user process all TCP IP parameters have to be statically configu
345. oot from SAN Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 K Refer to the silent txt file for the specific driver installer application for instructions on how to extract the individual Windows NetXtreme II drivers LINUX FCOE Boor INSTALLATION Configure the adapter boot parameters and Target Information press CTRL S and enter the CCM utility as detailed in Then use the guidelines in the following sections for FCoE boot installation with the appropriate Linux version SLES11 SP2 Installation 1 Boot from the SLES11 SP2 installation medium and on the installation splash screen press F6 for driver update disk Select Yes In boot options type withfcoe 1 Select Installation to proceed ee SUSE Linux Enterprise Server Boot from Hard Disk Installation Repair Installed System Rescue System Check Installation Media Firmware Test Memory Test Boot Options withfcoe I Help F2 Language F3 Video Mode F4 Source FS Kernel F Driver English US 800 x 600 CD ROM Default No 2 Follow the on screen instructions to choose the Driver Update medium and load drivers M Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Boot from SAN Page 205 NetXtreme II User Guide March 2014 HOMI TAS v3 3 80 Kernel 3 0 13 0 9 default lt lt lt Please choose the Driver Update mediun sr USB CD ROM Raritan Virtual Disc 7 ada Disk Raritan Virtual Disc 8 gt gt gt Limuixrc v3 3
346. or 10 Gbps PHY The transceiver is fully compatible with the IEEE 802 3 standard for auto negotiation of speed Using the Broadcom teaming software you can split your network into virtual LANs VLANs as well as group multiple network adapters together into teams to provide network load balancing and fault tolerance functionality See Configuring Teaming and Broadcom Gigabit Ethernet Teaming Services for detailed information about teaming See Virtual LANs for a description of VLANs See Configuring Teaming for instructions on configuring teaming and creating VLANs on Windows operating systems E Broadcom Corporation Document INGSRVT710 CDUM100 R Functionality and Features Broadcom NetXtreme I9 Network Adapter User Guide Page 3 NetXtreme II User Guide March 2014 FEATURES The following is a list of the Broadcom NetXtreme ll adapter features Some features may not be available on all adapters e TCP Offload Engine TOE e Internet Small Computer Systems Interface iSCSI offload e Fibre Channel over Ethernet FCoE e NIC Partitioning e Data Center Bridging DCB e Enhanced Transmission Selection ETS IEEE 802 1Qaz e Priority based Flow Control PFC IEEE 802 1Qbb e Data Center Bridging Capability eXchange Protocol DCBX CEE version 1 01 e Single chip solution e Integrated 10 100 1000BASE T transceivers e Integrated 10GBASE T transceivers e 10 100 1000 triple speed MAC e SerDes interface for optical transceiver connection e PCI
347. or Unable to map IO space The device driver cannot Remove other adapters from allocate memory mapped the system reduce the I O to access driver amount of physical memory registers installed and replace the adapter 12 Informational Driver initialized The driver has successfully No action is required successfully loaded S Broadcom Corporation Document INGSRVT710 CDUM100 R Appendix A Event Log Messages Page 61 NetXtreme Il User Guide March 2014 Table 10 Virtual Bus Driver VBD Event Log Messages Message Number Severity Message Cause Corrective Action 13 Error Driver initialization failed Unspecified failure during Reinstall the driver update driver initialization to a newer driver run Broadcom Advanced Control Suite diagnostics or replace the adapter 14 Error This driver does not support The driver does not Upgrade to a driver version this device Upgrade to the recognize the installed that supports this adapter latest driver adapter 15 Error This driver fails initialization Insufficient system memory Increase system memory because the system is prevented the initialization of running out of memory the driver E S Broadcom Corporation Page 62 Appendix A Event Log Messages Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Virtual LANs in Windows Broadcom NetXtreme II Network Adapter User Guide VLAN Overview e Adding VLANs to Teams
348. or mask2 can be supplied as command line arguments to the insmod or modprobe command for bnx2i error mask and error mask2 Config FW iSCSI Error Mask use to configure certain iSCSI protocol violation to be treated either as a warning or a fatal error All fatal iSCSI protocol violations will result in session recovery ERL 0 These are bit masks Defaults All violations will be treated as errors CAUTION Do not use error mask if you are not sure about the consequences These values are to be discussed with Broadcom development team on a case by case basis This is just a mechanism to work around iSCSI implementation issues on the target side and without proper knowledge of iSCSI protocol details users are advised not to experiment with these parameters en tcp dack Enable TCP Delayed ACK enables disables TCP delayed ACK feature on offloaded iSCSI connections Defaults TCP delayed ACK is ENABLED For example MENU EE Broadcom Corporation Page 154 Setting Values for Optional Properties Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 insmod bnx2i ko en tcp dack 0 or modprobe bnx2i en tcp dack 0 time_stamps Enable TCP TimeStamps enables disables TCP time stamp feature on offloaded iSCSI connections Defaults TCP time stamp option is DISABLED For example insmod bnx2i ko time stamps 1 or modprobe bnx2i time stamps 1 sq size Configure SQ size used to choose send queue size for off
349. or port 2 e ISCSICFG3 iSCSI CFG for port 3 e ccm CCM firmware DUMPNVRAM Syntax dumpnvram lt filename gt Description Dumps the NVRAM contents to the specified file Parameters filename is a mandatory parameter On Linux use a forward slash instead of a backslash when specifying lt f ilename gt Alternatively you can use two backslashes in the file path M Broadcom Corporation Document INGSRVT710 CDUM100 R Command Descriptions Page 319 NetXtreme Il User Guide March 2014 OTPCHK This command is available in Windows only Syntax otpchk mac lt filename gt Description Compares the OTP content to the content of the specified file By default it compares all the patches in the OTP and the patches in the specified file Parameters mac The compare function will include the MAC address and the configuration e filename The file to compare to the OTP content PRG Syntax prg bc ib mba ccm new image c p mac Description Programs NVRAM with the specified firmware image Parameters Note Not all adapters support the prg command e bc Bootcode The image file for the prg bce command must contain ONLY valid bootcode without other firmware directories This option is avaiable for Windows and is not available on all adapters e ib iSCSI boot firmware The image file for the prg ib command must contain ONLY valid iSCSI boot without other firmware directories e mb
350. orking correctly 3 Informational The network link is up The adapter has established No action is required a link 4 Informational Network controller The adapter has been No action is required configured for 10Mb half manually configured for the duplex link selected line speed and duplex settings 5 Informational Network controller The adapter has been No action is required configured for 10Mb full manually configured for the duplex link selected line speed and duplex settings 6 Informational Network controller The adapter has been No action is required configured for 100Mb half manually configured for the duplex link selected line speed and duplex settings 7 Informational Network controller The adapter has been No action is required configured for 100Mb full manually configured for the duplex link selected line speed and duplex settings 8 Informational Network controller The adapter has been No action is required configured for 1Gb half manually configured for the duplex link selected line speed and duplex settings 9 Informational Network controller The adapter has been No action is required configured for 1Gb full manually configured for the duplex link selected line speed and duplex settings 10 Error Unable to register the The device driver cannot Reboot the operating interrupt service routine install the interrupt handler system remove other device drivers that may be sharing the same IRQ 11 Err
351. ortal Error status is given in the dump data 6 Error The initiator could not allocate resources for an iSCSI connection 7 Error The initiator could not send an iSCSI PDU Error status is given in the dump data 8 Error Target or discovery service did not respond in time for an iSCSI request sent by the initiator iSCSI Function code is given in the dump data For details about iSCSI Function code please refer to iSCSI User s Guide 9 Error Target did not respond in time for a SCSI request The CDB is given in the dump data 10 Error Login request failed The login response packet is given in the dump data 11 Error Target returned an invalid login response packet The login response packet is given in the dump data 12 Error Target provided invalid data for login redirect Dump data contains the data returned by the target 13 Error Target offered an unknown AuthMethod Dump data contains the data returned by the target 14 Error Target offered an unknown digest algorithm for CHAP Dump data contains the data returned by the target 15 Error CHAP challenge given by the target contains invalid characters Dump data contains the challenge given 16 Error An invalid key was received during CHAP negotiation The key value pair is given in the dump data 17 Error CHAP Response given by the target did not match the expected one Dump data contains the CHAP response 18 Error Header Digest is required by the initiator but target did not offer it
352. ou type a command Table 1 uxdiag Command Options Command Options Description uxdiag Performs all tests on all Broadcom NetXtreme ll adapters in your system uxdiag c lt devnum gt Specifies the adapter devnum to test Use all in place of a specific device number to test all adapters uxdiag cof Allows tests to continue after detecting a failure uxdiag F Forces an upgrade of the image without checking the version uxdiag fbc bc image Specifies the bin file to update the bootcode uxdiag fib ib image Specifies the bin file for iSCSI boot uxdiag fibc Programs the iSCSI configuration block Used only with fib ib image uxdiag fibp Programs the iSCSI configuration software Used only with fib ib image uxdiag fmba mba image Specifies the bin file to update the MBA uxdiag fncsi ncsi image Specifies the bin file to update the NCSI firmware uxdiag fnvm raw image Programs the raw image into NVM uxdiag fump ump image Specifies the bin file to update UMP firmware uxdiag help Displays the Broadcom NetXtreme II User Diagnostics uxdiag command options uxdiag I iteration num Specifies the number of iterations to run on the selected tests uxdiag idmatch Enables matching of VID DID SVID and SSID from the image file with device IDs Used only with fnvm raw image
353. ould be iqn 1995 05 com broadcom iscsi target DHCP Option 43 Vendor Specific Information DHCP option 43 vendor specific information provides more configuration options to the iSCSI client than DHCP option 17 In this configuration three additional suboptions are provided that assign the initiator IQN to the iSCSI boot client along with two iSCSI target IQNs that can be used for booting The format for the iSCSI target IQN is the same as that of DHCP option 17 while the iSCSI initiator IQN is simply the initiator s IQN KL The suboptions are listed below NOTE DHCP Option 43 is supported on IPv4 only Table 3 DHCP Option 43 Suboption Definition Suboption Definition 201 First iSCSI target information in the standard root path format iscsi lt servername gt lt protocol gt lt port gt lt LUN gt lt targetname gt 202 Second iSCSI target information in the standard root path format iscsi lt servername gt lt protocol gt lt port gt lt LUN gt lt targetname gt 203 iSCSI initiator IQN Using DHCP option 43 requires more configuration than DHCP option 17 but it provides a richer environment and provides more configuration options Broadcom recommends that customers use DHCP option 43 when performing dynamic iSCSI boot configuration Configuring the DHCP Server Configure the DHCP server to support option 17 or option 43 r4 NOTE If using Option 43 you also need to configur
354. our system uediag c devices Specifies the adapter device to test Similar to dev for backward compatibility uediag cof Allows tests to continue after detecting a failure uediag dev devices Specifies the adapter device to test uediag F Forces an upgrade of the image without checking the version uediag fbc bc image Specifies the bin file to update the bootcode uediag fbc1 bc1 image Specifies the bin file to update bootcode 1 uediag fbc2 bc2 image Specifies the bin file to update bootcode 2 uediag fl2b l2b image Specifies the bin file for L2B firmware uediag fib ib image Specifies the bin file for iSCSI boot uediag fibc Programs iSCSI configuration block 0 Used only with fib ib image uediag fibc2 Programs iSCSI configuration block 1 Used only with fib ib image uediag fibp Programs iSCSI configuration software Used only with fib ib image uediag fmba mba image Specifies the bin file to update the MBA uediag fnvm raw image Programs the raw image into NVM uediag fump ump image Specifies the bin file to update UMP firmware uediag help Displays the Broadcom NetXtreme II User Diagnostics uediag command options uediag I lt iteration gt Specifies the number of iterations to run on the selected tests uediag idmatch Enables matching of VID
355. ovides the flexibility to add new features to the card and adapts it to future network requirements through software downloads This functionality also enables the adapter drivers to exploit the built in host offload functions on the adapter as host operating systems are enhanced to take advantage of these functions uu Broadcom Corporation Page 6 Features Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 BROADCOM ADVANCED CONTROL SUITE Broadcom Advanced Control Suite BACS is an integrated utility that provides useful information about each network adapter that is installed in your system The BACS utility also enables you to perform detailed tests diagnostics and analyses on each adapter as well as to modify property values and view traffic statistics for each adapter SUPPORTED OPERATING ENVIRONMENTS The Broadcom NetXtreme II adapter has software support for the following operating systems e Microsoft Windows 32 bit and 64 bit extended e Microsoft Windows Vista 32 bit and 64 bit extended e Linux 32 bit and 64 bit extended e MS DOS e ESX and ESXi Server VMware e Oracle Solaris e SCO UnixWare e SCO OpenServer NETWORK LINK AND ACTIVITY INDICATION For copper wire Ethernet connections the state of the network link and activity is indicated by the LEDs on the RJ 45 connector as described in Table 1 For fiber optic Ethernet connections and SFP the state of the network link and
356. owing configuration steps 1 Configure HTTPS on Linux Client 2 Follow the procedure for Installing the Broadcom Advanced Control Suite and Related Management Applications E Broadcom Corporation Document INGSRVT710 CDUM100 R Installation Tasks Page 113 NetXtreme II User Guide March 2014 WMI The WMI protocol is only supported on Windows OSs If servers and clients both are running Windows then WMI can be used Windows Server 1 Set up Namespace Security Using WMI Control 2 Grant DCOM Remote Launch and Activate Permission for a user or group 3 Perform special configuration if necessary See Special Configuration for WMI on Different Systems Windows Client No special configuration is required on the Windows client except installing the BACS management application See Installing the Broadcom Advanced Control Suite and Related Management Applications ELM Broadcom Corporation Page 114 Installation Tasks Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 DETAILED PROCEDURES This section provides the step by step instructions for each installation task The required tasks for each communication protocol differ as listed in Installation Tasks Refer to the appropriate task list to ensure you complete all necessary tasks for the chosen protocol WS MAN on WINDOWS SERVER Install the WinRM Software Component on Server On the following operating systems WinRM 2 0 is preinstalled e Windows 7
357. package BACS version arch rpm See Installing on a Linux System for information on installing Linux BACS Source Packages Identical source files to build the driver are included in both RPM and TAR source packages The supplemental tar file contains additional utilities such as patches and driver diskette images for network installation The following is a list of included files e netxtreme2 version src rpm RPM package with NetXtreme Il bnx2 bnx2x cnic bnx2fc bnxailibfc lib coe driver source e netxtreme2 version tar gz tar zipped package with NetXtreme II bnx2 bnx2x cnic bnx2fc bnxai libfc lib coe driver source e iscsiuio version tar gz iSCSI user space management tool binary e open fcoe brcm subvert arch rpm open fcoe userspace management tool binary RPM for SLES11 SP2 and legacy versions e fcoe utils brcm subver arch rpm open fcoe userspace management tool binary RPM for RHEL 6 4 and legacy versions The Linux driver has a dependency on open fcoe userspace management tools as the front end to control FCoE interfaces The package name of the open fcoe tool is fcoe utils for RHEL 6 4 and open fcoe for SLES11 SP2 and legacy versions p Broadcom Corporation Document INGSRVT710 CDUM100 R Packaging Page 145 NetXtreme II User Guide March 2014 INSTALLING LINUX DRIVER SOFTWARE e Installing the Source RPM Package e Building the Driver from the Source TAR File K NOTE If a bnx2 bnx2x
358. partitioning feature is available on Broadcom NetXtreme II adapters only The NIC Partitioning section of the Information tab displays information about the partitions for the selected network adapter To view NIC Partitioning for any installed network adapter click the name of the adapter listed in the Explorer View pane then click the Information tab MEM EE Broadcom Corporation Page 244 Managing Ethernet Controller Port Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 K NIC partitioning divides a Broadcom NetXtreme II 10 Gigabit Ethernet NIC into multiple virtual NICs by having multiple PCI physical functions per port Each PCI function is associated with a different virtual NIC To the OS and the network each physical function appears as a separate NIC port For more information see the NIC Partitioning topic in the Broadcom NetXtreme Il Network Adapter User Guide NOTE Some information may not be available for all Broadcom network adapters Number of Partitions The number of partitions for the port Each port can have from one to four partitions with each partition behaving as if it is an independent NIC port Network MAC Address The MAC address of the port iSCSI MAC Address If an iSCSI adapter is loaded onto the system the iSCSI MAC address will appear Flow Control The flow control setting of the port Physical Link Speed The physical link speed of the port either 1G or 10G Relative Bandwid
359. peed at 1000 Mb Full Duplex mode only Not available for 1 Gb ports e 2 5 Gb Full Sets the speed at 2 5 e 10 GB Full Sets the speed to 10 Gbit s and the mode to Full Duplex Not available for 1 Gb ports e Auto default Sets the speed and mode for optimum network connection recommended sg NOTES e Auto is the recommended setting This setting allows the network adapter to dynamically detect the line speed of the network Whenever the network capability changes the network adapter automatically detects and adjusts to the new line speed and duplex mode A speed of 1 Gbit s is enabled by selecting Auto when that speed is supported e 1 Gb Full Auto must be attached to a link partner that is also capable of a 1 Gb connection Since the connection is limited to a 1 Gb connection only the Ethernet 9 Wirespeed feature will be disabled If the link partner supports a 1 Gb connection only the Wake on LAN feature may not work Additionally management traffic IPMI or UMP in the absence of an operating system may also be affected e 10 Mb Half and 100 Mb Half settings force the network adapter to connect to the network in Half Duplex mode Note that the network adapter may not function if the network is not configured to operate at the same mode e 10 Mb Full and 100 Mb Full settings force the network adapter to connect to the network in Full Duplex mode The network adapter may not function if the network is not configured to operate at the same m
360. pg prg bc C tmp fresh bootcode e The following command configures the selected adapter whose current MAC address is 00 10 18 1a 1b 1c to be the new MAC address 00 10 18 9d 9e 9f Windows winfwupg 001018lalbic cfg mac 0010189d9e9f Linux 1nxfwupg 001018lalbic cfg mac 0010189d9e9f e The following command enables asf firmware if the ASF firmware is present in the selected adapter whose current MAC address is 00 10 18 9a 9b 9c Windows winfwupg 0010189a9b9c cfg asf 1 Linux 1nxfwupg 0010189a9b9c cfg asf 1 M ns M 0 Broadcom Corporation Document INGSRVT710 CDUM100 R Examples Page 323 NetXtreme II User Guide March 2014 INTERACTIVE MODE EXAMPLES Type winfwupg Windows or 1nxfwupg Linux and press Enter to access interactive mode e The following command displays a list and descriptions of available commands help e Exits the utility q e The following command displays a list of upgradeable devices dev e The following command selects device 0 dev 0 e The following command displays a listing of the firmware programmed in NVRAM dir e The following command checks the integrity of the NVRAM CRC CIC e The following command includes all configurations including the MAC address and saves the dump file to the c drive e Windows dumpnvram c backup bin config mac e linux dumpnvram tmp backup bin config mac e The following command includes all configurations including the MAC address
361. plications Linux Client To use HTTP no special configuration is required on the Linux client system Only the BACS management application must be installed Perform the following configuration steps 1 Configure HTTPS on Linux Client 2 Follow the procedure for Installing the Broadcom Advanced Control Suite and Related Management Applications CIM XML CIM XML is supported only when the server uses the Linux OS Note that for CIM XML on the Red Hat Linux OS two installation options are available with respect to OpenPegasus installing from the Inbox RPM or installing from source The Inbox OpenPegasus is only available on the Red Hat OS For SLES11 the only option is to use the source RPM WS MAN is not supported with the Inbox RPM If you plan to use WS MAN then you must install OpenPegasus from source Install OpenPegasus From the Inbox RPM Red Hat Only or Install OpenPegasus From Source Red Hat and SuSE Start CIM Server on the Server Configure OpenPegasus on the Server Install Broadcom CMPI Provider 9r og 9 qwe c Perform additional configuration if required such as firewall configuration See Perform Linux Firewall Configuration If Required 6 Follow the procedure for Installing the Broadcom Advanced Control Suite and Related Management Applications Linux Client To use HTTP no special configuration is required on the Linux client system Only the BACS management application must be installed Perform the foll
362. plications Page NetXtreme II User Guide March 2014 MANAGING MANAGEMENT APPLICATIONS WINDOWS MODIFYING THE MANAGEMENT APPLICATION To modify the management applications In Control Panel double click Add or Remove Programs Click Broadcom Management Programs and then click Change Click Next to continue Click Modify to change program features Click Next to continue Click on an icon to change how a feature is installed Click Next Click Install Oe MEL OO CUP de co IIS SS Click Finish to close the wizard 10 Reboot your system to complete the modification of the management applications REPAIRING MANAGEMENT APPLICATIONS To repair the management applications In Control Panel double click Add or Remove Programs Click Broadcom Management Programs and then click Change Click Next to continue Click Repair to repair errors in installed applications Click Next to continue Click Install DU 09 Sh ee cO IV c Click Finish to close the wizard REMOVING MANAGEMENT APPLICATIONS To remove all management applications 1 In Control panel double click Add or Remove Programs 2 Click Broadcom Management Programs and then click Remove 3 Reboot your system to complete the removal of management applications To remove the management application using the CLI Enter following command rpm e BACS MM e Broadcom Corporation Page 134 Managing Management Applications Windows Document
363. port microsoft com kb 201 9527 e http technet microsoft com en us library cc782312 28WS 10 29 aspx e http msdn microsoft com en us library aa384295 28v VS 85 29 aspx O Broadcom Corporation Document INGSRVT710 CDUM100 R Detailed Procedures Page 121 NetXtreme II User Guide March 2014 WS MAN WINDOWS CLIENT Perform HTTP Configuration if you plan to use HTTP 1 Click Start or press the Windows logo key and select Run Enter gpedit msc to open the local Group Policy editor 3 Under Computer Configuration open the Administrative Templates folder and then open the Windows Components folder 4 Select Windows Remote Management WinRM 5 Under Windows Remote Management WinRM select WinRm Client 6 Under WinRM Client double click Trusted Hosts 7 Inthe TrustedHostsList enter the host names of the clients and click OK If all clients are trusted then enter an asterisk only 8 Select WinRM Service 9 Enable Allow Basic Authentication and click OK 10 Run the following command from the command prompt to test the connection winrm id remote lt remote machine Hostname or IP Address Perform HTTPS Configuration if you plan to use HTTPS After you generate a self signed certificate as described in Generate a Self Signed Certificate for Windows Linux Server you can import the certificate on the client to facilitate a connection between server and client Ensure that all steps mentioned in section Generate a
364. r conveying capabilities and configuration of ETS and PFC between link partners to ensure consistent configuration across the network fabric In order for two devices to exchange information one device must be willing to adopt network configuration from the other device For example if a C NIC is configured to willingly adopt ETS and PFC configuration information from a connected switch and the switch acknowledges the C NIC s willingness then the switch will send the C NIC the recommended ETS and PFC parameter settings The DCBX protocol uses the Link Level Discovery Protocol LLDP to exchange PFC and ETS configurations between link partners MENU EE Broadcom Corporation Page 226 DCB Capabilities Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 CONFIGURING DCB By default DCB is enabled on Broadcom NetXtreme Il DCB compatible C NICs DCB configuration is rarely required as the default configuration should satisfy most scenarios DCB parameters can be configured through BACS See Using Broadcom Advanced Control Suite for more information on BACS KL NOTE FCoE operation depends on successful VLAN discovery All switches that support FCoE support VLAN discovery but some switches may require specific configuration Refer to the switch configuration guides for information on how to configure a port for successful VLAN discovery DCB CONDITIONS The following is a list of conditions that allow DCB technology to
365. racters amp lt gt iti Broadcom Teaming Wizard P ae Lreating Madilying a VLAN Naming fl You must assign your VLAN a unique name BROADCOM gn y q E cag qc ums Enter a name For the VLAM YLAR 1 i 4 single member SLB team will be created on instances when YLAN tagging is desired on ene physical interface VLAMN lt 7 name has a maximum length of 39 characters The name can use any symbolic character except Baji trean Coa Ga Ga EF VENUE Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 273 NetXtreme II User Guide March 2014 17 To tag the VLAN select Tagged and then click Next Otherwise click Untagged click Next and continue with the wizard to add additional VLANs see Step 19 of this procedure Bl Broadcom Teaming Wizard Creating Modifying a VLAM Tagging A The VLAM type must be specified BROADCOM What is the VLAM Type Untagged Tagged i IF tagged VLAN is selected be sure the switch supports tagged VLONs To use YLAN ID 0 select untagged radio button s option lt Back hia Mexk Preview ta Mu Broadcom Corporation Page 274 Configuring Teaming Document INGSRVT710 CDUM100 R User Guide NetXtreme ll March 2014 18 Type the VLAN tag value and then click Next The value must be between 1 and 4094 Creating Modifying a VLAM Tag Value A Assign a YLAN tag value BROADCOM Enter the VLAN tag value J VLAN tag values
366. rameter to Ox101 for fair transmission rate between two CoS In another example set the cos min rate parameter to 0x30201 to give the higher CoS the higher rate of transmission To avoid using the fairness algorithm omit setting the optional parameter cos min rate or set it to O dropless fc The optional parameter dropless fc can be used to enable a complementary flow control mechanism on Broadcom network adapters The default flow control mechanism is to send pause frames when the on chip buffer BRB is reaching a certain level of occupancy This is a performance targeted flow control mechanism On Broadcom network adapters you can enable another flow control mechanism to send pause frames if one of the host buffers when in RSS mode is exhausted This is a zero packet drop targeted flow control mechanism Set the dropless fc parameter to 1 as shown below to enable the dropless flow control mechanism feature on all Broadcom network adapters in the system vmkload mod bnx2x dropless fc 1 DRIVER DEFAULTS Speed Autonegotiation with all speeds advertised Flow Control Autonegotiation with rx and tx advertised MTU 1500 range 46 9000 Rx Ring Size 4078 range 0 4078 Tx Ring Size 4078 range MAX SKB FRAGS 44 4078 MAX SKB FRAGS varies on different kernels and different architectures On a 2 6 kernel for x86 MAX SKB FRAGS is 18 Coalesce RX Microseconds 25 range 0 3000 Coalesce TX Microseconds 50 range 0 12288 MSI X
367. red before the stack comes up in the iSCSI Boot environment If DHCP Option 17 is used the target information is provided by the DHCP server and the initiator iSCSI name is retrieved from the value programmed from the Initiator Parameters screen If no value was selected then the controller defaults to the name iqn 1995 05 com broadcom 11 22 33 44 55 66 i1sScsiboot where the string 11 22 33 44 55 66 corresponds to the controllers MAC address If DHCP option 43 IPv4 only is used then any settings on the Initiator Parameters 1st Target Parameters or 2nd Target Parameters screens are ignored and do not need to be cleared To configure the iSCSI boot parameters using dynamic configuration 1 From the General Parameters Menu screen set the following e TCP IP parameters via DHCP Enabled For IPv4 e IP Autoconfiguration Enabled For IPv6 non offload e iSCSI parameters via DHCP Enabled e CHAP Authentication Disabled e DHCP Vendor ID BRCM ISAN e Link Up Delay Time 0 Use TCP Timestamp Enabled e Target as First HDD Disabled e LUN Busy Retry Count 0 e IP Version IPv6 For IPv6 non offload HBA Boot Mode Disabled Note This parameter cannot be changed when the adapter is in Multi Function mode 2 Select ESC to return to the Main menu K NOTE Information on the Initiator Parameters and 1st Target Parameters screens are ignored and do not need to be cleared 3 Select Exit and Save Configurations
368. river is not included in the boot wim and install wim files that come with the Microsoft Windows Server 2008 Vista CD Microsofts Windows Automated Installation Kit AIK allows you to modify the default boot wim and install wim files and create WinPE 2 0 images to include the NetXtreme Il monolithic driver in the Windows Server 2008 Vista installation K NOTE Refer to the silent txt file for the specific driver installer application for instructions on how to extract the individual Windows NetXtreme II drivers The NetXtreme II monolithic or RIS driver is located at the following location http www broadcom com support ethernet_nic netxtremeii10 php legacy 1 evnd for the BCM5771x BCM578xx and http www broadcom com support ethernet_nic netxtremeii php legacy 1 bO6nd for the BCM5706 BCM5708 BCM5709 BCM5716 To insert the monolithic driver into a WinPE 2 0 boot image Windows Server 2008 To insert Broadcom s NetXtreme II monolithic driver in a WinPE 2 0 image download AIK from http www microsoft com downloads en default aspx and install After installing AIK copy the latest monolithic driver to a directory on the local hard drive of the system you installed the AIK Follow the procedure below to insert the monolithic driver into a WinPE 2 0 boot image 1 From All Programs open Windows AIK and select Windows PE Tools Command prompt 2 At the command prompt run the copype cmd script The script requires two arguments
369. river_aliases file grep bnxe etc driver aliases bnxe pcil4e4 164e bnxe pcil4e4 164f bnxe pcil4e4 1650 bnxe pciexl4e4 164e bnxe pciexi14e4 164f bnxe pciex14e4 1650 4 The parent of the driver is the entire path leading up to the name 5 Theunit address is located after the final amp in the path 6 Therefore change both of the bnxe interfaces found in path to inst to interrupt priority 5 and use the following config lines to bnxe conf name pciex14e4 1650 parent pci 0 0 pci8086 2779 1 unit address 0 interrupt priorities 5 name pciex14e4 1650 parent pci 0 0 pci8086 2779 1 unit address 0 1 interrupt priorities 5 7 After modifying the config either reboot the system or unplumb all interfaces and run the update_drv command 8 When the system has been reconfigured and the interfaces plumbed back up verify the new interrupt priority settings by running the following command as root echo interrupts d mdb k uc Broadcom Corporation Page 168 Interrupt Management Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 FCOE SUPPORT OVERVIEW FCoE is supported on Solaris 11 with limited support on Solaris 10 Update 9 The following features are the differences in Solaris 10 Update 9 when compared to Solaris 11 e Support does not exist for NPIV in the Solaris 10 Update 9 e Some of the fcinfo 1M options which are available in Solaris 11 are no
370. rk segment Link Status The status of the network link e Up A link is established e Down A link is not established Duplex The adapter is operating in the indicated duplex mode Speed The link speed of the adapter in megabits per second Offload Capabilities The offload capabilities supported by the adapter This information is only available for Broadcom NetXtreme II adapters e TOE TCP Offload Engine TOE allows simultaneous operation of up to 1024 fully offloaded TCP connections for 1 Gbps network adapters and 1880 fully offloaded TCP connections for 10 Gbps network adapters to the hardware e iSCSI iSCSI offload for block level transfer of data e LSO Large Send Offload LSO prevents an upper level protocol such as TCP from breaking a large data packet into a series of smaller packets with headers appended to them e CO Checksum Offload CO allows the TCP IP UDP checksums for send and receive traffic to be calculated by the adapter hardware rather than by the host CPU LiveLink IP Address The network address of the LiveLink enabled adapter Local Connection Identifies the module to which the blade server is attached e Chassis SW Chassis switch module e Chassis PHY Pass through module e None No modules attached BASP State Information about the status of the BASP application This information is displayed only when there is a team see Configuring Teaming ViEWING NIC PARTITIONING INFORMATION The NIC
371. rmmod bnx2i 2 Load the iSCSI driver Manual insmod bnx2i ko Or modprobe bnx2i oM Broadcom Corporation Document INGSRVT710 CDUM100 R Load and Run Necessary iSCSI Software Components Page 149 NetXtreme II User Guide March 2014 UNLOADING REMOVING THE LINUX DRIVER e Unloading Removing the Driver from an RPM Installation e Removing the Driver from a TAR Installation UNLOADING REMOVING THE DRIVER FROM AN RPM INSTALLATION KL NOTES e The examples used in this procedure refer to the bnx2 driver but also apply to the bnx2x driver e On 2 6 kernels it is not necessary to bring down the eth interfaces before unloading the driver module e Ifthe cnic driver is loaded unload the cnic driver before unloading the bnx2 driver e Prior to unloading the bnx2i driver disconnect all active iSCSI sessions to targets To unload the driver use ifconfig to bring down all eth interfaces opened by the driver and then type the following rmmod bnx2 KL If the driver was installed using RPM do the following to remove it NOTE The above command will also remove bnx2 bnx2x and cnic modules rpm e netxtreme2 REMOVING THE DRIVER FROM A TAR INSTALLATION ra If the driver was installed using make install from the tar file the bnx2 o or bnx2 ko driver file has to be manually deleted from the operating system See Installing the Source RPM Package for the location of the installed driver NOTE The examples used in t
372. roadcom Corporation Document INGSRVT710 CDUM100 R Configuring Teaming Page 285 NetXtreme II User Guide March 2014 VIEWING BASP STATISTICS The Statistics section shows performance information about the network adapters that are on a team To view BASP Statistics information for any team member adapter or the team as a whole click the name of the adapter or team listed in the Team Management pane then click the Statistics tab Click Refresh to get the most recent values for each statistic Click Reset to change all values to zero E e Broadcom Corporation Page 286 Configuring Teaming Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 CONFIGURING WITH THE COMMAND LINE INTERFACE UTILITY An alternate method to BACS for configuring Broadcom network adapters is with BACSCLI which is a Broadcom utility that allows you to view information and configure network adapters using a console in either a non interactive command line interface CLI mode or an interactive mode As with BACS BACSCLI provides information about each network adapter and enables you to perform detailed tests run diagnostics view statistics and modify property values BACSCLI also allows you the ability to team network adapters together for load balancing and failover For a complete list of available commands and examples see the BACSCLI_ReadMe txt file on the installation CD On a system with Broadcom NetXtreme and NetXtreme II network adapte
373. roadcom NetXtreme ll GigE Driver Installer and then click Remove Follow the onscreen prompts 3 Click Yes to restart your system Or 4 Click No to restart your system at a later time Click OK to acknowledge that the installation has been suspended The uninstallation of the driver is postponed until the next restart of your system MEM EE Broadcom Corporation Page 182 Removing the Device Drivers Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 USING THE NETXTREME II MONOLITHIC DRIVER The NetXtreme ll based on its advanced functionalities uses a software architecture that includes a Virtual Bus Device VBD to extend functionalities beyond basic network connectivity Microsoft however does not currently support this architecture when loading an operating system through its Windows Deployment Services WDS which was previously known as Remote Installation Services RIS or for the deployment agent used in the Automated Deployment Services ADS Therefore a separate driver was created to accommodate these Microsoft deficiencies This driver is known as the NetXtreme ll monolithic driver but it is sometimes referred to as the RIS driver The NetXtreme II monolithic driver was developed to work only for the text mode portion of a WDS legacy installation and to establish connectivity with a deployment agent for ADS It is not intended to be used as a driver loaded in the running state of an operating system
374. rocedures Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 INSTALLING THE BROADCOM ADVANCED CONTROL SUITE AND RELATED MANAGEMENT APPLICATIONS e Installing on a Windows System e Installing on a Linux System INSTALLING ON A WINDOWS SYSTEM The Broadcom Advanced Control Suite BACS software and related management applications can be installed from the installation CD or by using the silent install option The following are installed when running the installer e Control Suite Broadcom Advanced Control Suite BACS If selected a GUI and a CLI client are installed e BASP Broadcom Advanced Server Program This is a Broadcom intermediate NDIS driver to configure VLAN Team Load Balancing etc e SNMP The Simple Network Management Protocol subagent This feature allows the SNMP manager to monitor the Broadcom Network Adapters e CIM Provider Common Information Model provider This component presents the network adapter information to WMI based management applications Select this component on a host which has Broadcom adapter installed and which you want to manage using the GUI client NOTES e Ensure that the Broadcom network adapter s is physically installed in the system before installing BACS e Before you begin the installation close all applications windows or dialog boxes e To use the TCP IP Offload Engine TOE you must have Windows Server 2008 or Windows Server 2008 R2 You must also have a licen
375. rocesses within the network are transparent to tape backup software applications To understand how backup data streams are directed during network failover process consider the topology in Figure 10 Client Server Red is transmitting data to the backup server through Path 1 but a link failure occurs between the backup server and the switch Because the data can no longer be sent from Switch 1 to the Adapter A interface on the backup server the data is redirected from Switch 1 through Switch 2 to the Adapter B interface on the backup server This occurs without the knowledge of the backup application because all fault tolerant operations are handled by the adapter team interface and trunk settings on the switches From the client server perspective it still operates as if it is transmitting data through the original path Figure 10 Network Backup With SLB Teaming Across Two Switches Tape Backup FC Backup Server 1 Client Server Blue NCTemC gt C NIC Team Al TB B GE Switch 1 aaa SES SSE eee GE Switch 2 AL B AB NCTeamC gt lt a 5b NIC Team Client Server Red Client Server Green Client Server Yellow Broadcom Corporation Document INGSRVT710 CDUM100 R Application Considerations Page 51 NetXtreme Il User Guide March 2014 TROUBLESHOOTING TEAMING PROBLEMS e Teaming Configuration Tips e Troubleshooting Guidelines When running a protocol analyzer over a virtual adapter teamed interface t
376. rom within a batch file To perform a silent install from within a batch file and wait for the install to complete before continuing with the next command line type the following start wait setup s w v qn INSTALLING ON A LINUX SYSTEM The Broadcom Advanced Control Suite BACS software can be installed on a Linux system using the Linux RPM package This installation includes a BACS GUI and a CLI client Before you begin e Ensure that the Broadcom network adapter s is physically installed and the appropriate device driver for the NIC is installed on the system to be managed by this utility e Ensure that the CIM provider is installed properly on the system that is to be managed by this utility See e For managing iSCSI on Linux hosts ensure that the open iscsi and sg utilities are installed on the Linux host To install BACS 1 Download the latest BACS management application RPM package 2 Install the RPM package using the following command rpm i BACS version arch rpm To Use BACS e To use the GUI on XWindow double click the BACS4 desktop icon or access the BACS program from the task bar under System Tools e To use BACS CLI refer to the file BACSCLI_Readme txt provided with the release files To remove BACS To uninstall the RPM package use the following command rpm e BACS O E Broadcom Corporation Document INGSRVT710 CDUM100 RInstalling the Broadcom Advanced Control Suite and Related Management Ap
377. roper operation make sure that the Spanning Tree Protocol STP is disabled or that portfast mode for Cisco is enabled on the port to which the PXE client is connected For instance set spantree portfast 4 12 enable BROADCOM ADVANCED SERVER PROGRAM BASP Problem After physically removing a NIC that was part of a team and then rebooting the team did not perform as expected Solution To physically remove a teamed NIC from a system you must first delete the NIC from the team Not doing this before shutting down could result in breaking the team on a subsequent reboot which may result in unexpected team behavior Problem After deleting a team that uses IPv6 addresses and then re creating the team the IPv6 addresses from the old team are used for the re created team pS a Broadcom Corporation Document INGSRVT710 CDUM100 R Removing the Broadcom NetXtreme II Device Drivers Page 333 NetXtreme II User Guide March 2014 Solution This is a third party issue To remove the old team s IPv6 addresses locate the General tab for the team s TCP IP properties from your system s Network Connections Either delete the old addresses and type in new IPv6 addresses or select the option to automatically obtain IP addresses Problem Adding an NLB enabled NetXtreme Il adapter to a team may cause unpredictable results Solution Prior to creating the team unbind NLB from the NetXtreme ll adapter create the team and then bind NLB to the
378. ropriate driver file in the I386 or AMD64 directory containing the image If the RIS or WDS server is running Windows 2000 Server and deploying an x86 WinPE image you may need to include the Windows 2000 monolithic driver file b06nd50x sys in the 1386 directory In cases where adding the Windows 2000 monolithic driver still does not work apply the following modification to the bO6nd inf file located in the 1386 directory as follows 1 Locate Manufacturer header within the file Review the line below it which reads brcm broadcom ntx86 ntamd64 ntia64 or equivalent 3 Modify that line to read brcm broadcom ntx86 ntamd64 ntia64 The change made replaces the comma and space after broadcom with a period 4 Savethe file Restart the RIS service binlsvc or WDS services wdsserver MM E Broadcom Corporation Document INGSRVT710 CDUM100 R Using the NetXtreme II Monolithic Driver Page 183 NetXtreme II User Guide March 2014 INSERTING THE NETXTREME II MONOLITHIC DRIVER IN A WINPE 2 0 OR 3 1 IMAGE Follow these procedures for inserting the NeXtreme Il monolithic driver into WinPE images The instructions differ depending on the WinPE version and the Windows Server OS version system being used WINPE 2 0 The Microsoft Windows Server 2008 method of inserting the NetXtreme Il monolithic driver in a WinPe 2 0 image is different from the Windows Server 2008 R2 method as discussed below By default the monolithic d
379. rs BACSCLI is installed when BACS is installed with the installer TROUBLESHOOTING BACS Problem When attempting to open BACS on a Linux System the following error message displays Another instance of the BACS client appears to be running on this system Only one instance of the BACS client can be running at a time If you are sure that no other BACS client is running then a previous instance may have quit unexpectedly Solution This message displays if you try to run a second instance of BACS If you receive this message but are certain that no instance of BACS is currently running a previous instance of BACS may have quit unexpectedly To clear that instance remove the file dev shm sem Global BACS C50398EE 84A7 Abc3 9F6E 25A69603B9C0 MM Broadcom Corporation Document INGSRVT710 CDUM100 R Configuring With the Command Line Interface Utility Page 287 NetXtreme II User Guide March 2014 Specifications Broadcom NetXtreme i Network Adapter User Guide e 10 100 1000BASE T and 10GBASE T Cable Specifications e 1000 2500BASE X Fiber Optic Specifications e Interface Specifications e NIC Physical Characteristics e NIC Power Requirements e Wake On LAN Power Requirements e Environmental Specifications 10 100 1000BASE T AND 10GBASE T CABLE SPECIFICATIONS Table 1 10 100 1000BASE T Cable Specifications Port Type Connector Media Maximum Distance 10BASE T RJ 45 Category 3 4 or 5 unshielded 100m 328
380. rs and type the member IP address KL 9 Click Update Repeat these steps for each of the other listed team members 10 Click Apply Exit NOTE All of the member IP addresses must be in the same subnet as the probe targets ME Broadcom Corporation Page 284 Configuring Teaming Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Saving and Restoring a Team Configuration To save a configuration 1 From the File menu select Team Save As 2 Type the path and file name of the new configuration file and then click Save The configuration file is a text file that can be viewed by any text editor The file contains information about both the adapter and the team configuration To restore a configuration 1 From the File menu select Team Restore 2 Click the name of the file to be restored and then click Open 3 Click Apply NOTE If necessary go to the folder where the file is located 4 Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted If a configuration is already loaded a message is displayed that asks if you want to save your current configuration Click Yes to save the current configuration Otherwise the configuration data that is currently loaded is lost go Note The team may take a very long time to restore if the team is configured with multiple VLANs and each VLAN is configured with one or more static IP addresses O B
381. rtetett ir nyelvek s szabv nyok szellemeben Megfelel ezi nyilatkozat kezz lt amely az irorszag Broadcom Corporation 190 Mathilda Place Sunnyvale California O46 USA Eur pai Unio B oszt ly Ez a Broadcom eszk z B osztalyu besorolast kapott tipikus lakossaz k myezetben val hasznalatra alkalmas Eur pai Unio osztaly FIGYELEM A oszt lyba sorolt term k Lak helyi k myezetben ez a termek radiofrekvencias RF mterferenciat okozhat ebben az esetben a felha znalonak gondoskodmia kell a sz ks ges ellenmtezkedesekral PORTUGUES Este produto esta em conformidade com J008 93 EC Directiva de baixa tens o com Iberian 2004 108 EC Directiva de compatibilidade electromagnetica e com as altera es da Umino Portuguese Europeia Foi elaborada uma declara o de conformmidade de acordo com as normas e directivas anteriores encontrando se arquivada na Broadcom Corporation 190 Mathilda Place Sunnyvale Califorma 94086 USA Uni o Europeia Classe B Este dispositive Broadcom esta classificado para utiliza o num ambiente domestico tipico Classe B Uni o Europea Classe A ADVERTENCIA Este um produto Classe A Mum ambiente domestico este produto pode provocar interfer ncias de frequencia de radio podendo ser necess rio que o utilizador adopte as medidas adequadas ITALIANO Il presente prodotto stato determmato essere conforme alla 2006 95 CE Direttiva Bassa Italian Tensione alla 2004 10
382. rver Inbound load balancing exploits a unique characteristic of Address Resolution Protocol RFC0826 in which each IP host uses its own ARP cache to encapsulate the IP Datagram into an Ethernet frame BASP carefully manipulates the ARP response to direct each IP host to send the inbound IP packet to the desired physical adapter Therefore inbound load balancing is a plan ahead scheme based on statistical history of the inbound flows New connections from a client to the server will always occur over the primary physical adapter because the ARP Reply generated by the operating system protocol stack will always associate the logical IP address with the MAC address of the primary physical adapter Like the outbound case there is an Inbound Flow Head Hash Table Each entry inside this table has a singly linked list and each link Inbound Flow Entries represents an IP host located in the same subnet When an inbound IP Datagram arrives the appropriate Inbound Flow Head Entry is located by hashing the source IP address of the IP Datagram Two statistics counters stored in the selected entry are also updated These counters are used in the same fashion as the outbound counters by the load balancing engine periodically to reassign the flows to the physical adapter On the inbound code path the Inbound Flow Head Hash Table is also designed to allow concurrent access The link lists of Inbound Flow Entries are only referenced in the event of processing ARP
383. rver OS version 2012 2008R2 2008SP2 15 Using a DVD burning application burn the iso file you created to a DVD 16 Use the DVD that you created in step 15 to install the applicable Windows Server version Booting After that the system has been prepared for an iSCSI boot and the operating system is present on the iSCSI target the last step is to perform the actual boot The system will boot to Windows or Linux over the network and operate as if it were a local disk drive 1 Reboot the server Select CTRL S 3 To boot through an offload path set the HBA Boot Mode to Enabled To boot through a non offload path set the HBA Boot Mode to Disabled Note This parameter cannot be changed when the adapter is in Multi Function mode If CHAP authentication is needed enable CHAP authentication after determining that booting is successful see Enabling CHAP Authentication MEM Broadcom Corporation Page 94 iSCSI Boot Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 OTHER ISCSI BooT CONSIDERATIONS There are several other factors that should be considered when configuring a system for iSCSI boot Changing the Speed amp Duplex Settings in Windows Environments Changing the Speed amp Duplex settings on the boot port using Windows Device Manager when performing iSCSI boot via the offload path is not supported Booting via the NDIS path is supported The Speed amp Duplex settings can be changed using the BAC
384. s Frames Rx with CRC Error The number of frames received with CRC errors Initiator Login Statistics iSCSI login enables a connection for iSCSI use between the initiator and the target and is used to authenticate parties negotiate the session s parameters open security association protocol and mark the connection as belonging to an iSCSI session Login Accept Responses The number of login requests accepted by the target Login other failed Responses The number of login requests that were not accepted by the target Login Redirect Responses The number of responses that required further action by the initiator Login Authentication Failed Responses The number of login requests that failed due to party authentication failure Login target authentication failure The number of instances where the login could not authenticate the target Login target negotiation failure The number of instances where the login could not negotiate the sessions parameters Normal logout command PDU The number of normal logout commands issued by the initiator to remove a connection from a session or to close a session Other logout command PDU The number of logout commands issued by the initiator for reasons other than to remove a connection from a session or to close a session o Broadcom Corporation Document INGSRVT710 CDUM100 R Viewing Resource Information Page 259 NetXtreme II User Guide March 2014 Local Initiator login failures
385. s offered by the Broadcom software shipped with servers and storage products The goal of Broadcom teaming services is to provide fault tolerance and link aggregation across a team of two or more adapters The information in this document is p Broadcom Corporation Document INGSRVT710 CDUM100 RBroadcom Teaming Services Broadcom NetXtreme I9 Network Adapter User Guide Page 13 NetXtreme Il User Guide March 2014 provided to assist IT professionals during the deployment and troubleshooting of system applications that require network fault tolerance and load balancing GLOSSARY Table 1 Glossary Item Definition ARP Address Resolution Protocol BACS Broadcom Advanced Control Suite BASP Broadcom Advanced Server Program intermediate driver DNS domain name service G ARP Gratuitous Address Resolution Protocol Generic Trunking FEC GEC 802 3ad Draft Static Switch dependent load balancing and failover type of team in which the intermediate driver manages outgoing traffic and the switch manages incoming traffic HSRP Hot Standby Router Protocol ICMP Internet Control Message Protocol IGMP Internet Group Management Protocol IP Internet Protocol IPv6 Version 6 of the IP Protocol iSCSI Internet Small Computer Systems Interface L2 Layer 2 Used to describe network traffic that is not offloaded and where hardware only performs Layer 2 operations on the traffic Layer 3 IP and Layer
386. s yourservername u username p password skipCAcheck 2 Toretrieve the server WinRM identity information enter the following command winrm id r https yourservername u username p password skipCAcheck 3 To enumerate Windows services on the server enter the following command winrm e wmicimv2 Win32 service r https yourservername u username p password skipCAcheck KL NOTE It is important to use skipCAcheck switch in the winrm command line testing as the certificate is self generated and not imported on the client Otherwise the following error message displays WSManFault The next section explains how to export and import the self signed certificate WS MAN AND CIM XML LINUX SERVER There are two options available for installing OpenPegasus install from an Inbox RPM or install from the source The Inbox OpenPegasus is available only on the Red Hat Linux OS For the SUSE Linux Enterprise Server 11 SLES11 OS you must use the source RPM If you plan to use WS MAN then you must install OpenPegasus from source ra NOTE The Inbox RPM does not support the WS MAN communication protocol To use WS MAN you must install OpenPegasus from source Install OpenPegasus From the Inbox RPM Red Hat Only In Red Hat Linux an Inbox OpenPegasus HPM is available as tog pegasus version arch rpm 1 Use the following command to install tog pegasus rpm ivh tog openpegasus lt version gt lt arch gt rpm 2 Use th
387. s The packets traverse the RPC logic though not the entire MAC block and return to the receive buffers as received packets This is another loopback path that is used by Layer 4 and Layer 5 traffic within the MAC block As packets are received back by Broadcom NetXtreme II User Diagnostics they are checked for errors The adapter should not be connected to a network E e Broadcom Corporation Page 312 Diagnostic Test Descriptions Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 dfi m ro BG Broadcom Corporation Document INGSRVT710 CDUM100 R Diagnostic Test Descriptions Page 313 NetXtreme II User Guide Firmware Upgrade Utility Broadcom NetXtreme II Network Adapter User Guide e Overview e Installing the Firmware Upgrade Utility e Invoking the Utility e Command Descriptions e Examples OVERVIEW Broadcom provides a utility for upgrading adapter firmware and bootcode The utility is implemented as a console application that can be run from a Windows or Linux command prompt INSTALLING THE FIRMWARE UPGRADE UTILITY WINDOWS The files are preinstalled in the appropriate folders and ready for use LINUX You can install the firmware upgrade utility from the Inxfwupg SDK package and the BMAPI SDK package Both packages must be installed To install Inxfwupg SDK package Enter tar zxvf Inxfwupg arch sdk tgz to untar the packag
388. s Ger t von Broadcom ist fir die Verwendung m emer typisch haushchen Umgebung der Klasse B vorgesehen Europai che Union Klasse A WARNUNG Dies ist em Produkt der Elasse A In emer hauslichen Umgebung kann dieses Produkt Hochfrequenz torungen verursachen In diesem Fall muss der Benutzer die entsprechenden Wafnahmen treffen lo zpoiov avro conpopqovsro ps Tw o npsz JOO6 95 EE Obmyt mepi yaning taons 2004 108 EE Odeypio mepi nAcetpopoyy yes evpBarergraz xot Tpomomonposig roug axo TH Eupeatotkr Even Mia AnAccy Xonp pgecnaze cipara us Tig mponyoopsevsz obec Koi XDOTUZU EXPEL Kot EDO apys erusin cro Broadcom Corporation 190 Mathilda Place Sunnyvale California O4086 USA Evpomoun Eroon EKanmropi B Avm n comer Broadcom sive kardiinin yir ypryon ce amp va oovrnosc ommoxo zzpiDolkov karm vopiaz B Evporaua Evocn Kontmropi A IIPOEIAOIIOIHEH Auto ctv eva zpoiov Kotyypopiag A Xe oncoxo zspipaAlov avro to xpoiov Loops va xpoxaAscs mapsupolsez pudwoouyvotytoayv RF ony ozota nmepinteacy propsi va exei n Are ETERA Aco LETEO qao rov ypnom m Uberenstunmung mit 20056 95 EC und Erg nzungen der EMWV Richtlinie Broadcom Corporation INGSRVT710 CDUM 100 R NetXtreme Il CE Notice Page 297 NetXtreme II User Guide March 2014 MAGYAR A termek megfelel a 2006 95 EGK alacsony fezz ltzegu eszk z kre vonatkoz ir nyelv a Hungaran 2004 108 EGK EMC iranyelv s az Eur pai Unio ajanlasamak Az el bbiekben isme
389. s created across the various bnxe instances 1 Delete all the NPIV ports created before deleting FCoE ports 2 brcmfcoeadm delete fcoe port bnxe lt instance_number gt 3 modinfo grep bnxef The first column for the above command will give the module ID for the bnxef driver 4 modunload i lt module id gt The procedure should unload the driver However if there are many instances of the FCoE ports created all the FCoE ports must be deleted before the unload can be attempted CONFIGURING THE FCOE DRIVER The bnxef driver can be configured via the bnxef conf file installed under kernel drv When this config file is modified the system must be either rebooted or use the update_drv 1M command to update the driver configuration sss ee Broadcom Corporation Document INGSRVT710 CDUM100 R FCoE Support Page 169 NetXtreme II User Guide March 2014 The details of the configurations parameters are detailed in the bnxef 7D man page The default parameters should work for all conditions PSS Broadcom Corporation Page 170 FCoE Support Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 VMware Driver Software Broadcom NetXtreme II Network Adapter User Guide e Packaging e Networking Support e Drivers e FCoE Support PACKAGING The VMware driver is released in the packaging formats shown in Table 1 Table 1 VMware Driver Packaging Format Drivers Compressed tar bnx2x version tar gz VMware V
390. s information about each network adapter BACS also includes a number of diagnostics tools such as hardware diagnostics cable testing and a network topology test SUPPORTED FEATURES BY TEAM TYPE Table 4 provides a feature comparison across the team types Use this table to determine the best type of team for your application The teaming software supports up to eight ports in a single team and up to 16 teams in a single system These teams can be any combination of the supported teaming types but each team must be on a separate network or subnet Table 4 Comparison of Team Types Switch Dependent Switch Independent Dynamic Link Type of Team Fault Tolerance Load Balancing Static Trunking Aggregation IEEE 802 3ad Function SLB with Standby SLB Generic Trunking Link Aggregation Number of ports per 2 8 2 8 2 8 2 8 team same broadcast domain Number of teams 16 16 16 16 Adapter fault Yes Yes Yes Yes tolerance Switch link fault Yes Yes Switch dependent Switch dependent tolerance same broadcast domain TX load balancing No Yes Yes Yes RX load balancing No Yes Yes performed bythe Yes performed by the switch switch Requires compatible No No Yes Yes switch Heartbeats to check No No No No connectivity Mixed media Yes Yes Yes switch Yes adapters with dependent different media p Document INGSRVT710 CDUM100 R Broadcom Corporation Executive Summary P
391. s not available for NetXtreme Il 10 GbE network adapters This option is not available for all Broadcom network adapters e This option is available for Broadcom NetXtreme II VBD drivers To run a cable analysis using BACS GUI 1 Connect the cable to a port on a switch where the port is set to Auto and the Speed amp Duplex driver settings are also set to Auto 2 Click the name of the adapter to test in the Explorer View pane K 3 From the Select a test to run list select Cable Analysis 4 Click Run 5 n the error message window that warns of the network connection being temporarily interrupted click Yes NOTE For Broadcom NetXtreme ll adapters select a VBD driver for other adapters select an NDIS driver Distance The valid cable length in meters except when the Noise result is returned Status The result of the analysis for the indicated pair e Good Good cable PCB signal paths but no gigabit link e Crossed Pin short or crosstalk along two or more cable PCB signal paths e Open One or both pins are open for a twisted pair e Short Two pins from the same twisted pair are shorted together e Noise Persistent noise present most likely caused by Forced 10 100 e GB Link Gigabit link is up and running e N A Algorithm failed to reach a conclusion Link The link connection speed and mode Status The status after the test is run either completed or failed There are several factors that could ha
392. s the drivers loaded for the bnx2 module root test1 lsmod grep i bnx2 bnx2 199238 0 bnx2fc 133775 0 libfcoe 39764 2 bnx2fc fcoe libre 108727 3 bnx2fc fcoe libfcoe scsi transport fc 55235 3 bux2fc tcos libre bnx2 1 53488 11 cnic 86401 6 bnx2fc bnx2i libiscsi 47617 8 ME Broadcom Corporation Page 326 Troubleshooting Checklist Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 be2iscsi bnx2i cxgb4i cxgb3i libcxgbi ib iser iscsi_ tcp libiscsi_tcp scsi transport iscsi 53047 8 be2iscsi bnx2i libcxgbi ib iser iscsi tcp libiscsi bnx2x 1417947 0 Liberc32c 1246 1 bnx2x mdio 4732 2 cxgb3 bnx2x If you reboot after loading a new driver you can use the following command to verify that the currently loaded driver is the correct version modinfo bnx2 root test1 Ismod grep i bnx2 bnx2 199238 0 Or you can use the following command root testl1 ethtool i eth2 driver bnx2x version 1 78 07 firmware version bc 7 8 6 bus info 0000 04 00 2 if you loaded a new driver but have not yet booted the modinfo command will not show the updated driver information Instead you can view the logs to verify that the proper driver is loaded and will be active upon reboot dmesg grep i Broadcom grep i bnx2 RUNNING A CABLE LENGTH TEST For Windows operating systems see Analyzing Cables in Windows for information on running a cable length test Cable analysis is not available for NetXtreme I
393. se however a user who is accessing the local or remote host using the BACSA client GUI may not always have the domain administrator account privilege It is necessary to configure WMI security access on the remote host to allow the user to connect to it using the BACSA client GUI This configuration can be easily done using the following procedure If you do not have sufficient privileges to configure security for WMI access contact your Network Administrator 1 Click Start or press the Windows logo key and select Run 2 Enter DCOMCNFG and then click OK 3 The Component Services dialogue box displays p Broadcom Corporation Document INGSRVT710 CDUM100 R Detailed Procedures Page 129 NetXtreme II User Guide March 2014 Open Component Services and then open Computers Right click My Computer and click Properties In My Computer Properties click the COM Security tab Under Launch and Activation Permissions click Edit Limits oN So eS Follow these steps if your name or your group does not appear in the Groups or user names list a Inthe Launch Permission dialog box click Add b Inthe Select Users Computers or Groups dialog box add your name and the group in the Enter the object names to select box and then click OK c Inthe Launch Permission dialog box select your user and group in the Group or user names list d Inthe Permissions for User area select Allow for Remote Launch and Remote Activation and then click
394. se key preprogrammed in the hardware If supported for iSCSI you only need a license key e BASP is not available on Windows Small Business Server SBS 2008 Using the Installer To install the management applications 1 Insert the installation CD into the CD or DVD drive 2 On the installation CD open the MgmtApps folder select IA32 or x64 and then double click Setup exe to open the InstallShield Wizard 3 Click Next to continue A After you review the license agreement click accept the terms in the license agreement and then click Next to continue Select the features you want installed Click Next Click Install Click Finish to close the wizard ONO After successful installation you can start the GUI from Windows Start menu p Broadcom Corporation Document INGSRVT710 CDUM100 RInstalling the Broadcom Advanced Control Suite and Related Management Applications Page NetXtreme II User Guide March 2014 Using Silent Installation ra NOTES e All commands are case sensitive User must Run as Administrator for Vista when using msiexec for silent install uninstall s e For detailed instructions and information about unattended installs refer to the silent txt file in the MgmtApps folder To perform a silent install or upgrade from within the installer source folder Type the following setup s v qn If performing a silent upgrade your system may reboot automatically To suppress the
395. sessionlist From Initiator Name an iSCSI offloaded connection will display an entry beginning with BOGBDRV A non offloaded connection will display an entry beginning with Root Q What configurations should be avoided A The IP address should not be the same as the LAN Q Why does the install fail when attempting to complete an iSCSI offload install using Windows Server 2008 R2 for BCM5709 1 GbE adapters A There is a conflict with the internal inbox driver MM Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Offload in Windows Server Page 107 NetXtreme Il User Guide March 2014 EVENT LOG MESSAGES Table 5 lists the offload iSCSI driver event log messages OFFLOAD ISCSI OIS DRIVER Table 5 Offload iSCSI OIS Driver Event Log Messages WIESE Severity Message Number 1 Error Initiator failed to connect to the target Target IP address and TCP Port number are given in dump data 2 Error The initiator could not allocate resources for an iSCSI session 3 Error Maximum command sequence number is not serially greater than expected command sequence number in login response Dump data contains Expected Command Sequence number followed by Maximum Command Sequence number 4 Error MaxBurstLength is not serially greater than FirstBurstLength Dump data contains FirstBurstLength followed by MaxBurstLength 5 Error Failed to setup initiator p
396. ss while the ARP Reply is typically sent as unicast traffic A unicast address corresponds to a single MAC address or a single IP address A broadcast address is sent to all devices on a network Teaming and Network Addresses A team of adapters function as a single virtual network interface and does not appear any different to other network devices than a non teamed adapter A virtual network adapter advertises a single Layer 2 and one or more Layer 3 addresses When the teaming driver initializes it selects one MAC address from one of the physical adapters that make up the team to be the Team MAC address This address is typically taken from the first adapter that gets initialized by the driver When the system hosting the team receives an ARP request it selects one MAC address from among the physical adapters in the team to use as the source MAC address in the ARP Reply In Windows operating systems the IPCONFIG all command shows the IP and MAC address of the virtual adapter and not the individual physical adapters The protocol IP address is assigned to the virtual network interface and not to the individual physical adapters For switch independent teaming modes all physical adapters that make up a virtual adapter must use the unique MAC address assigned to them when transmitting data That is the frames that are sent by each of the physical adapters in the uu Broadcom Corporation Page 16 Executive Summary Document INGSRVT710 CDUM100 R Us
397. ssociated with teaming 7 Check that all switch ports connected to the team are on the same VLAN 8 Check that the switch ports are configured properly for Generic Trunking FEC GEC 802 3ad Draft Static type of teaming and that it matches the adapter teaming type If the system is configured for an SLB type of team make sure the corresponding switch ports are not configured for Generic Trunking FEC GEC 802 3ad Draft Static types of teams FREQUENTLY ASKED QUESTIONS Question Under what circumstances is traffic not load balanced Why is all traffic not load balanced evenly across the team members Answer The bulk of traffic does not use IP TCP UDP or the bulk of the clients are in a different network The receive load balancing is not a function of traffic load but a function of the number of clients that are connected to the server Question What network protocols are load balanced when in a team Answer Broadcom s teaming software only supports IP TCP UDP traffic All other traffic is forwarded to the primary adapter Question Which protocols are load balanced with SLB and which ones are not Answer Only IP TCP UDP protocols are load balanced in both directions send and receive IPX is load balanced on the transmit traffic only Question Can team a port running at 100 Mbps with a port running at 1000 Mbps Answer Mixing link speeds within a team is only supported for Smart Load Balancing teams and 802 3ad teams Quest
398. stall the Windows Assessment and Deployment Kit ADK 2 Use the following commands to create a temporary directory and set it as the current directory for all later steps md C Temp x cd d C Temp x 3 Use the following commands to create two subdirectories md src md mnt 4 Use the following command to copy the original DVD into the src subdirectory xcopy N sre Je JG Ji f jh JE 7y fg Note that in this example the installation DVD is in the N drive 5 Open a Deployment and Imaging Tools command prompt in elevated mode Then set c Temp x as the current directory Note that you will use this command prompt window in all subsequent steps 6 Enter the following commands e Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Boot Page 93 NetXtreme II User Guide March 2014 attrib r src sources boot wim attrib r src sources install wim 7 Enter run the following command to mount the boot wim image dism mount wim wimfile src sources boot wim index 2 mountdir mnt Note that you must always use 2 for the index value 8 Enter the following commands to add the below drivers to the currently mounted image dism image mnt add driver driver C Temp evbda evbda inf dism image mnt add driver driver C Temp bxnd60a bxnd60a inf dism image mnt add driver driver C NTempMoxfcoeNbxfcoe inf dism image mnt add driver driver C Temp bxois bxois inf 9 Enter the following command to unmoun
399. support a proprietary trunking mechanism This mode could be used to support Lucent s Open Trunk Cisco s Fast EtherChannel FEC and Cisco s Gigabit EtherChannel GEC In the static mode as in generic link aggregation the switch administrator needs to assign the ports to the team and this assignment cannot be altered by the BASP as there is no exchange of the Link Aggregation Control Protocol LACP frame With this mode all adapters in the team are configured to receive packets for the same MAC address Trunking operates on Layer 2 addresses and supports load balancing and failover for both inbound and outbound traffic The BASP driver determines the load balancing scheme for outbound packets using Layer 4 protocols previously discussed whereas the team link partner determines the load balancing scheme for inbound packets The attached switch must support the appropriate trunking scheme for this mode of operation Both the BASP and the switch continually monitor their ports for link loss In the event of link loss on any port traffic is automatically diverted to other ports in the team Network Communications The following are the key attributes of Generic Static Trunking e Failover mechanism Link loss detection Load Balancing Algorithm Outbound traffic is balanced through Broadcom proprietary mechanism based L4 flows Inbound traffic is balanced according to a switch specific mechanism e Outbound Load Balancing using
400. support iSCSI appears in the message log after loading the bnx2i driver then iSCSI is not supported This message may not appear until the interface is opened as with ifconfig eth0 up 4 Load the cnic driver if applicable insmod cnic ko 5 Install the driver and man page make install K 6 Install the user daemon brcm_iscsiuio NOTE See the RPM instructions above for the location of the installed driver Refer to Load and Run Necessary iSCSI Software Components for instructions on loading the software components required to use the Broadcom iSCSI offload feature uu Broadcom Corporation Page 148 Installing Linux Driver Software Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 To configure the network protocol and address after building the driver refer to the manuals supplied with your operating System Verify that your network adapter supports iSCSI by checking the message log If the message bnx2i dev ethO does not support iSCSI appears in the message log after loading the bnx2i driver then iSCSI is not supported This message may not appear until the interface is opened as with ifconfig eth0 up LOAD AND RUN NECESSARY ISCSI SOFTWARE COMPONENTS The Broadcom iSCSI Offload software suite consists of three kernel modules and a user daemon Required software components can be loaded either manually or through system services 1 Unload the existing driver if necessary Manual
401. t based on this driver limitation for an IPv4 network A properly configured network that has multiple VLANs should maintain separate IP segments for each VLAN This is necessary since outbound traffic relies on the routing table to identify which adapter virtual or physical to pass traffic through and does not determine which adapter based on VLAN membership Since support for VLAN tagging on Broadcom s NDIS 6 0 driver is limited to transmit Tx traffic only there is a risk of inbound traffic Rx from a different VLAN being passed up to the operating system However based on the premise of a properly configured network above the IP segmentation and or the switch VLAN configuration may provide additional filtration to limit the risk In a back to back connection scenario two computers on the same IP segment may be able to communicate regardless of their VLAN configuration since no filtration of VLAN membership is occurring However this scenario assumes that the security may already be breached since this connection type is not typical in a VLAN environment If the risk above is not desirable and filtering of VLAN ID membership is required then support through an intermediate driver would be necessary iSCSI Crash Dump Crash dump is used to collect information on adapters that were booted remotely using iSCSI To enable crash dump set to Enable and reboot the system If you perform an upgrade of the device drivers re enable iSCSI Crash D
402. t be available in Solaris 10 Update 9 For more information read the man page fcinfo 1M e brcmfcoeadm 1M feature is supported in both Solaris 10 Update 9 and Solaris 11 However when delete fcoe port is complete you need to issue the following two commands to unload the bnxef driver before you can re issue create fcoe port There is a reaper thread in Solaris 11 that aggressively looks for unused driver modules and unloads the driver That thread does not exist in Solaris 10 Update 9 Therefore you have to explicitly look for the driver module ID of the bnxef driver by issuing the following command modinfo grep bnxef 249 fffffffff8d63000 486b8 54 1 bnxef 6 4 13 Then issue the modunload command to unload the module before create fcoe port is issued to create a new FCoE port d modunload i 249 Any time create fcoe port needs to be issued the driver must be unloaded if it is already loaded If not the create fcoe port will fail indicating the driver is busy This is true when you have two or more instances of bnxef loaded in which case you should first delete all FCoE ports and then unload the driver Unloading will occur only when all the instances are deleted SUPPORTED FC FCOE DEVICES The bnxef Broadcom 10 Gb FCoE driver works with all the major FCoE fabric devices It is also compatible with all known FC disk devices and tape devices working through the FCoE fabric UNLOADING FCOE DRIVER Delete all FCoE port
403. t interface device instance system 4 Error Unable to create symbolic Another driver has createda Unload the conflicting device link for the management conflicting device name driver that uses the name interface Bif 5 Informational Broadcom Advanced Server The driver has started No action is required Program Driver has started 6 Informational Broadcom Advanced Server The driver has stopped No action is required Program Driver has stopped 7 Error Could not allocate memory The driver cannot allocate Close running applications for internal data structures memory from the operating to free memory system 8 Warning Could not bind to adapter The driver could not open Unload and reload the one of the team physical physical adapter driver adapters install an updated physical adapter driver or replace the physical adapter 9 Informational Successfully bind to The driver successfully No action is required adapter opened the physical adapter 10 Warning Network adapter is The physical adapter is not Check that the network disconnected connected to the network it cable is connected verify has not established link that the network cable is the right type and verify that the link partner switch or hub is working correctly 11 Informational Network adapter is The physical adapter is No action is required connected connected to the network it has established link 12 Error Broadcom Advanced The driver does not support Co
404. t one adapter in the Load Balance Members list 8 You can assign any other available adapter to be a standby member by selecting it from the Standby Member list NOTE There must be at least one Broadcom network adapter assigned to the team The TCP Offload Engine TOE Large Send Offload LSO and Checksum Offload CO columns indicate if the TOE LSO and or the CO properties are supported for the adapter The TOE L SO and CO properties are enabled for a team only when all of the members support and are configured for the feature If this is the case then the team offload capabilities appear on the bottom of the screen MEM EE Broadcom Corporation Page 280 Configuring Teaming Document INGSRVT710 CDUM 100 R User Guide NetXtreme Il March 2014 k NOTE Adding a network adapter to a team where its driver is disabled may negatively affect the offloading capabilities of the team This may have an impact on the team s performance Therefore it is recommended that only driver enabled network adapters be added as members to a team 9 Type the value for Team MTU 10 Click Create to save the team information 11 Repeat steps 4 through 10 to define additional teams As teams are defined they can be selected from the team list but they have not yet been created Click the Preview tab to view the team structure before applying the changes 12 Click Apply Exit to create all the teams you have defined and exit the Manage Teams win
405. t tcpip TCPIP lanaO msSne2clone 1 tcpip MSSNE2CLONE DriverName BXND20XS protman DriverName PROTMANS PRIORITY MSSNDISHLP tcpip NBSessions 6 DefaultGateway 0 SubNetMask 255 0 0 0 IPAddress 192 168 0 1 DisableDHCP 0 DriverName TCPIPS BINDINGS MSSNE2 CLONE LANABAS Ei 0 C Broadcom Corporation Page 136 Installing the NDIS2 Driver Software for Use on MS DOS Platforms Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Example Protocol ini file for IPX network setup version 0x3110 netcard ms Sne2clone 1 MSSNE2CLONE 1 transport msSndishlp MSSNDISHLP transport msSnwlink MSSNWLINK lanaO msSne2clone 1 msSnwlink lanal ms ne2clone 1 ms ndishlp MSSNE2CLONE DriverName BXND20XS protman DriverName PROTMANS PRIORITY MSSNDISHLP MSSNDISHLP DriverName ndishlp BINDINGS msSne2clone msSnwlink DriverName nwlinks FRAME Ethernet 802 2 BINDINGS MSSNE2 CLONE LANABAS E 0 Example Protocol ini file for NetBEUI network setup version 0x3110 netcard ms Sne2clone 1 MSSNE2CLONE 1 transport msSndishlp MSSNDISHLP transport ms netbeui MSS NETBEUI lana0 2ms ne2clone 1 ms ndishlp lanal msSne2clone 1 msSnetbeul MSSNE2CLONE DriverName BXND20XS protman DriverName PROTMANS PRIORITY MSSNDISHLP MSSNDISHLP DriverName ndishlp BINDINGS MSSNE2 CLONE MSSNETBEUI DriverName netbeuis SESSTONS 10 NCBS 12 BINDINGS MSSNE2 CLONE LANABAS E 0 sh M MP Broadcom Corporation Document I
406. t the boot wim image dism unmount wim mountdir Nmnt commit 10 Enter the following command to determine the index of the desired SKU in the install wim image dism get wiminfo wimfile src sources install wim For example in Windows Server 2012 index 2 is identified as Windows Server 2012 SERVERSTANDARD 11 Enter the following command to mount the install wim image dism mount wim wimfile src sources install wim index X mountdir mnt Note that X is a placeholder for the index value that you obtained in step 10 12 Enter the following commands to add these drivers to the currently mounted image dism image mnt add driver driver C Temp evbd evbd inf dism image mnt add driver driver C Temp bxnd60a bxnd60a inf dism image mnt add driver driver C Temp bxfcoe bxfcoe inf dism image mnt add driver driver C Temp bxois bxois inf 13 Enter the following command to unmount the install wim image dism unmount wim mountdir mnt commit 14 Enter the following command to create an iso file oscdimg e h m n lslipstream bootdata 2 p0 e b c Program Files Windows AIK Tools PETools amd64 boot etfsboot com pEF e b c Program Files Windows AIK Tools PETools amd64 boot efisys bin c temp x sre c temp Win20xxMOD iso Note that Platform is a placeholder for the architecture of the operating system that you want to install such as amd64 or x86 Also xx in the file names is a placeholder for the Windows Se
407. tandardized the Internet Small Computer Systems Interface iSCSI SCSI is a popular protocol that enables systems to communicate with storage devices using block level transfer i e address data stored on a storage device that is not a whole file iSCSI maps the SCSI request response application protocols and its standardized command set over TCP IP networks As iSCSI utilizes TCP as its sole transport protocol it greatly benefits from hardware acceleration of the TCP processing i e use of a TOE However iSCSI as a Layer 5 protocol has additional mechanisms beyond the TCP layer iSCSI processing can also be offloaded thereby reducing CPU utilization even further MM o Broadcom Corporation Document INGSRVT710 CDUM100 R Features Page 5 NetXtreme II User Guide March 2014 The Broadcom NetXtreme Il adapter targets best system performance maintains system flexibility to changes and supports current and future OS convergence and integration Therefore the adapter s iSCSI offload architecture is unique as evident by the split between hardware and host processing K NOTES The iSCSI offload feature is not available for all Broadcom network adapters FIBRE CHANNEL OVER ETHERNET FCoE Fibre Channel Backbone 5 FC BB 5 allows Fibre Channel protocol to be transferred over Ethernet FCoE preserves existing Fibre Channel infrastructure and capital investments The following FCoE features are supported e Full stateful hardware FCo
408. tatic type of team may lose some network connectivity if the driver to a team member is disabled Solution f a team member supports underlying management software ASF UMP or Wake On LAN the link may be maintained on the switch for the adapter despite its driver being disabled This may result in the switch continuing to pass traffic to the attached port rather than route the traffic to an active team member port Disconnecting the disabled adapter from the switch will allow traffic to resume to the other active team members Problem Large Send Offload LSO and Checksum Offload are not working on my team Solution If one of the adapters on a team does not support LSO LSO does not function for the team Remove the adapter that does not support LSO from the team or replace it with one that does The same applies to Checksum Offload Problem The advanced properties of a team do not change after changing the advanced properties of an adapter that is a member of the team Solution If an adapter is included as a member of a team and you change any advanced property then you must rebuild the team to ensure that the team s advanced properties are properly set MENU EE Broadcom Corporation Page 334 Broadcom Advanced Server Program BASP Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 LINUX Problem BCM5771x devices with SFP Flow Control default to Off rather than Rx Tx Enable Solution The Flow Control default s
409. tch port 4 In this case Gray would send the ICMP Request to Red 49 C9 but because the Bottom switch has no entry for 49 C9 in its CAM Table the frame is flooded to all its ports but cannot find a way to get to 49 C9 Figure 3 Teaming Across Switches Without an Interswitch Link PE2650 am PE2650 W2K e T W2K3 ARP Table Blue Gray ARP Table 100 49 C9 SLE Team SLB Team 100 49 C9 1022 5ECA 19241681101 192 168 1 102 101 82 82 SECA P Top Switch Bottom Switch CAM Table E CAM Table Eth 1 82 83 i Eth 1 82 82 Eth 2 42 C9 T Eth 2 43 C8 Eth 4 5E C9 E Eth 4 5SE CA ARP Table PE2650 1012 82 82 WK 102 5ECA Red SLE Team 182 168 1 100 MM Broadcom Corporation Document INGSRVT710 CDUM100 R General Network Considerations Page 39 User Guide March 2014 NetXtreme Il The addition of a link between the switches allows traffic from to Blue and Gray to reach each other without any problems Note the additional entries in the CAM table for both switches The link interconnect is critical for the proper operation of the team As a result it is highly advisable to have a link aggregation trunk to interconnect the two switches to ensure high availability for the connection Figure 4 Teaming Across Switches With Interconnect PE2650 PE2650 W2K W2K3 100 49 C3 SLB Team SLB Team 100 49 C9 1022 5E CA 492 168 1 101 192 168 1 102 101 82 82 SECA F Top Switch 2 BottomSwitch CAM Table Eth 1
410. ter The various teaming modes described in this document place certain restrictions on the networking equipment used to connect clients to teamed systems Each type of network interconnect technology has an effect on teaming as described in the following sections Repeater Hub A Repeater Hub allows a network administrator to extend an Ethernet network beyond the limits of an individual segment The repeater regenerates the input signal received on one port onto all other connected ports forming a single collision domain This means that when a station attached to a repeater sends an Ethernet frame to another station every station within the same collision domain will also receive that message If two stations begin transmitting at the same time a collision occurs and each transmitting station must retransmit its data after waiting a random amount of time The use of a repeater requires that each station participating within the collision domain operate in half duplex mode Although half duplex mode is supported for Gigabit Ethernet adapters in the IEEE 802 3 specification half duplex mode is not supported by the majority of Gigabit Ethernet adapter manufacturers Therefore half duplex mode is not considered here Teaming across hubs is supported for troubleshooting purposes such as connecting a network analyzer for SLB teams only Switching Hub Unlike a repeater hub a switching hub or more simply a switch allows an Ethernet network to b
411. ter teaming Answer No special configuration is required in the tape software to work with teaming Teaming is transparent to tape backup applications Question How do know what driver am currently using Answer In all operating systems the most accurate method for checking the driver revision is to physically locate the driver file and check the properties Question Can SLB detect a switch failure in a Switch Fault Tolerance configuration Answer No SLB can only detect the loss of link between the teamed port and its immediate link partner SLB cannot detect link failures on other ports Question Why does my team lose connectivity for the first 30 to 50 seconds after the primary adapter is restored fall back after a failover Answer During a fall back event link is restored causing Spanning Tree Protocol to configure the port for blocking until it determines that it can move to the forwarding state You must enable Port Fast or Edge Port on the switch ports connected to the team to prevent the loss of communications caused by STP Question Where do monitor real time statistics for an adapter team in a Windows server Answer Use the Broadcom Advanced Control Suite BACS to monitor general IEEE 802 3 and custom counters Question What features are not supported on a multivendor team Answer TOE VLAN tagging and RSS are not supported on a multivendor team MM Broadcom Corporation Document INGSRVT710 CDUM100 R Frequent
412. tes 4096 align failed caller 0x41800187d654 Dec 2 18 24 20 ESX4 vmkernel 0 00 00 32 342 cpu2 4142 WARNING vmklinux26 alloc pages Out of memory Disable NetQueue by manually loading the bnx2x vmkernel module via the command vmkload mod bnx2x multi mode O0 or to persist the settings across reboots via the command esxcfg module s multi mode 0 bnx2x MM Broadcom Corporation Page 174 Drivers Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Reboot the machine for the settings to take place MultiQueue NetQueue The optional parameter num_queues may be used to set the number of Rx and Tx queues when multi_mode is set to 1 and interrupt mode is MSI X If interrupt mode is different than MSI X see int_mode parameter the number of Rx and Tx queues will be set to 1 discarding the value of this parameter If you would like the use of more then 1 queue force the number of NetQueues to use via the following command esxcfg module s multi mode 1 num queues num of queues gt bnx2x Otherwise allow the bnx2x driver to select the number of NetQueues to use via the following command esxcfg module s multi mode 1 num queues 0 bnx2x The optimal number is to have the number of NetQueues match the number of CPUs on the machine FCoE SUPPORT This section describes the contents and procedures associated with installation of the VMware software package for supporting Broadcom FCoE C NICs DRIVERS
413. th Weight 96 e The relative bandwidth setting represents a weight or importance of a particular function There are up to four functions per port The weight is used to arbitrate between the functions in the event of congestion e The sum of all weights for the functions on a single port is either O or 100 A value of 0 for all functions means that each function will be able to transmit at 25 of the physical link speed not to exceed the Maximum Bandwidth setting A value for a function between 1 and 100 represent a percentage of the physical link speed and is used by an internal arbitration logic as a input value weight A higher value will cause this function to transmit relatively more data compared to a function on the same port that has defined a lower value Maximum Bandwidth 96 e The maximum bandwidth setting defines an upper threshold value ensuring that this limit will not be exceeded during transmission The valid range for this value is between 1 and 100 The maximum bandwidth value is defined as a percentage of the physical link speed e t is possible for the sum of all maximum bandwidth values across the four functions of a single port to exceed the physical link speed value of either 10 Gbps or 1 Gbps This case is considered as oversubscription In a case where oversubscription congestion occurs on transmit the Relative Bandwidth Weight value comes into effect e he Maximum Bandwidth setting is only valid in the co
414. that have been selected to participate in a given team If the link partner is not correctly configured for IEEE 802 3ad link configuration errors are detected and noted All adapters in the team are configured to receive packets for the same MAC address The outbound load balancing scheme is determined by the BASP driver The link partner of the team determines the load balancing scheme for inbound packets In this mode at least one of the link partners must be in active mode r4 NOTE TOE is not applicable for Link Aggregation team type NetXtreme II network adapters with iSCSI enabled is not supported for Link Aggregation team type Generic Trunking FEC GEC 802 3ad Draft Static This type of team is very similar to the link aggregation type in that all adapters in the team must be configured to receive packets for the same MAC address This mode does not provide link aggregation control protocol LACP or marker protocol support This mode supports a variety of environments where the link partners are statically configured to support a proprietary trunking mechanism Trunking supports load balancing and failover for both outbound and inbound traffic K NOTE TOE is not applicable for Generic Trunking FEC GEC 802 3ad Draft Static team type NetXtreme II network adapters with iSCSI enabled is not supported for Generic Trunking FEC GEC 802 3ad Draft Static team type SLB Auto Fallback Disable This team is identical to Smart Load
415. the Network Cables e Check the adapter installation by reviewing Installation of the Add In NIC Verify that the adapter is properly seated in the slot Check for specific hardware problems such as obvious damage to board components or the PCI edge connector e Check the configuration settings and change them if they are in conflict with another device e Verify that your server is using the latest BIOS e Try inserting the adapter in another slot If the new position works the original slot in your system may be defective e Replace the failed adapter with one that is known to work properly If the second adapter works in the slot where the first one failed the original adapter is probably defective e Install the adapter in another functioning system and run the tests again If the adapter passed the tests in the new system the original system may be defective e Remove all other adapters from the system and run the tests again If the adapter passes the tests the other adapters may be causing contention CHECKING IF CURRENT DRIVERS ARE LOADED WINDOWS See Viewing Vital Signs to view vital information about the adapter link status and network connectivity LINUX To verify that the bnx2 o driver is loaded properly run lsmod grep i module name gt If the driver is loaded the output of this command shows the size of the driver in bytes and the number of adapters configured and their names The following example show
416. the hardware that is capable of handling stateful fastpath offloading of TCP and IP processing UDP User Datagram Protocol WINS Windows name service WLBS Windows Load Balancing Service MM Broadcom Corporation Document INGSRVT710 CDUM100 R Executive Summary Page 15 NetXtreme II User Guide March 2014 TEAMING CONCEPTS e Network Addressing e Teaming and Network Addresses e Description of Teaming Types e TOE Teaming The concept of grouping multiple physical devices to provide fault tolerance and load balancing is not new It has been around for years Storage devices use RAID technology to group individual hard drives Switch ports can be grouped together using technologies such as Cisco Gigabit EtherChannel IEEE 802 3ad Link Aggregation Bay Network Multilink Trunking and Extreme Network Load Sharing Network interfaces on servers can be grouped together into a team of physical ports called a virtual adapter Network Addressing To understand how teaming works it is important to understand how node communications work in an Ethernet network This document is based on the assumption that the reader is familiar with the basics of IP and Ethernet network communications The following information provides a high level overview of the concepts of network addressing used in an Ethernet network Every Ethernet network interface in a host platform such as a computer system requires a globally unique Layer 2 address and at least one global
417. the networking driver and the bnx2i driver iSCSI operations will be interrupted when the networking driver brings down or resets the device This scenario requires proper handling by the networking and bnx2i drivers as well as the userspace iscsid daemon that keeps track of all iSCSI sessions Offloaded iSCSI connections take up system and on chip resources that must be freed up before the device can be reset iscsid running in userspace is generally less predictable as it can run slowly and take a long time to disconnect and reconnect iSCSI sessions during network reset especially when the number of connections is large Broadcom cannot guarantee that iSCSI sessions will always recover in every conceivable scenario when the networking device is repeatedly being reset Broadcom recommends that administrator administered network device resets such as MTU change ring size change device shutdown hot unplug and so forth be kept at a minimum while there are active offloaded iSCSI sessions running on that shared device On the other hand link related changes do not require device reset and are safe to be performed at any time To help alleviate some of the above issues install the latest open iscsi utilities by upgrading your Red Hat Network subscription ELM Broadcom Corporation Page 98 iSCSI Offload in Windows Server Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 CONFIGURING ISCSI OFFLOAD With the proper iSCSI offload
418. the packets will then be modified to the MAC address of the selected physical adapter The modified packet is then passed to the selected physical adapter for transmission p Broadcom Corporation Document INGSRVT710 CDUM100 R Teaming Mechanisms Page 27 NetXtreme II User Guide March 2014 The outbound TCP and UDP packets are classified using Layer 3 and Layer 4 header information This scheme improves the load distributions for popular Internet protocol services using well known ports such as HTTP and FTP Therefore BASP performs load balancing on a TCP session basis and not on a packet by packet basis In the Outbound Flow Hash Entries statistics counters are also updated after classification The load balancing engine uses these counters to periodically distribute the flows across teamed ports The outbound code path has been designed to achieve best possible concurrency where multiple concurrent accesses to the Outbound Flow Hash Table are allowed For protocols other than TCP IP the first physical adapter will always be selected for outbound packets The exception is Address Resolution Protocol ARP which is handled differently to achieve inbound load balancing Inbound Traffic Flow SLB Only The Broadcom intermediate driver manages the inbound traffic flow for the SLB teaming mode Unlike outbound load balancing inbound load balancing can only be applied to IP addresses that are located in the same subnet as the load balancing se
419. tion with all speeds advertised Flow control Autonegotiation with RX and TX advertised MTU 1500 range is 46 9000 RX Ring Size 4078 range is 0 4078 TX Ring Size 4078 range is MAX SKB FRAGS 4 4078 MAX SKB FRAGS varies on different kernels and different architectures On a 2 6 kernel for x86 MAX SKB FRAGS is 18 Coalesce RX Microseconds 25 range is 0 3000 Coalesce TX Microseconds 50 range is 0 12288 Coalesce Statistics Microseconds 999936 approximately 1 second range is 0 16776960 in increments of 256 MSI X Enabled if supported by the 2 6 kernel and the interrupt test passes TSO Enabled WoL Disabled DRIVER MESSAGES The following are the most common sample messages that may be logged in the var log messages file Use dmesg n level to control the level at which messages appear on the console Most systems are set to level 6 by default To see all messages set the level higher e bnx2 and bnx2x Driver e bnx2i Driver p Broadcom Corporation Document INGSRVT710 CDUM100 R Driver Messages Page 157 NetXtreme II User Guide March 2014 BNX2 AND BNX2X DRIVER K Driver Sign on NOTE The examples used in this procedure refer to the bnx2 driver but also apply to the bnx2x driver Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v1 6 30 July 23 2007 CNIC Driver Sign on bnx2 only Broadcom NetXtreme II cnic v1 1 19 Sep 25 2007 NIC Detected eth Broadcom NetXtreme
420. to load and enable a team As a result teaming is not supported as a PXE client though a physical adapter that participates in a team when the operating system is loaded may be used as a PXE client Whereas a teamed adapter cannot be used as a PXE client it can be used for a PXE server which provides operating system images to PXE clients using a combination of Dynamic Host Control Protocol DHCP and the Trivial File Transfer Protocol TFTP Both of these protocols operate over IP and are supported by all teaming modes ue Broadcom Corporation Document INGSRVT710 CDUM100 R Teaming and Other Advanced Networking Properties Page 37 NetXtreme II User Guide March 2014 GENERAL NETWORK CONSIDERATIONS e Teaming with Microsoft Virtual Server 2005 e Teaming Across Switches e Spanning Tree Algorithm e Layer 3 Routing Switching e Teaming with Hubs for troubleshooting purposes only e Teaming with Microsoft NLB TEAMING WITH MICROSOFT VIRTUAL SERVER 2005 The only supported BASP team configuration when using Microsoft Virtual Server 2005 is with a Smart Load Balancing TM team type consisting of a single primary Broadcom adapter and a standby Broadcom adapter Make sure to unbind or deselect Virtual Machine Network Services from each team member prior to creating a team and prior to creating Virtual networks with Microsoft Virtual Server Additionally a virtual network should be created in this software and subsequently bound to th
421. to the VLAN interface Use the following command to get detailed information about VLAN interface cat proc net vlan ethx vlanid Preserve the VLAN configuration across reboots by adding it to configuration files Configure the VLAN interface configuration in etc sysconfig network scripts The configuration filename has a specific format that includes the physical interface a character and the VLAN ID For example if the VLAN ID is 100 and the physical interface is ethO then the configuration filename should be ifcfg ethO 100 The following are example settings in the configuration file DEVICE ethx 100 BOOTPROTO static ONBOOT yes TPADDR lt gt NETMASK lt gt USERCTL no NETWORK lt gt VLAN yes Restart the networking service in order for the changes to take effect as follows Service network restart MAKING CONNECTIONS TO ISCSI TARGETS Refer to open iscsi documentation for a comprehensive list of iscsiadm commands This is a sample list of commands to discovery targets and to create iscsi connections to a target Add static entry iscsiadm m node p ipaddr port T ign 2007 05 com broadcom targetl o new I iface file name gt ISCSI target discovery using SendTargets iscsiadm m discovery type sendtargets p ipaddr port I iface file name gt Login to target using iscsiadm command iscsiadm mode node targetname lt ign targetname gt portal ipaddr port login
422. treme Il March 2014 dropless_fc The dropless fc parameter can be used to enable a complementary flow control mechanism on BCM57711 BCM57712 adapters The default flow control mechanism is to send pause frames when the on chip buffer BRB is reaching a certain level of occupancy This is a performance targeted flow control mechanism On BCM57711 BCM57712 adapters one can enable another flow control mechanism to send pause frames where one of the host buffers when in RSS mode are exhausted This is a zero packet drop targeted flow control mechanism Set the dropless fc parameter to 1 to enable the dropless flow control mechanism feature on all BCM57711 BCM57712 NetXtreme II adapters in the system insmod bnx2x ko dropless fc 1 or modprobe bnx2x dropless_fc 1 disable_iscsi_ooo The disable_iscsi_ooo parameter is to disable the allocation of the iSCSI TCP Out of Order OOO reception resources specifically for VMware for low memory systems multi mode The optional parameter multi mode is for use on systems that support multi queue networking Multi queue networking on the receive side depends only on MSI X capability of the system multi queue networking on the transmit side is supported only on kernels starting from 2 6 27 By default multi mode parameter is set to 1 Thus on kernels up to 2 6 26 the driver will allocate on the receive side one queue per CPU and on the transmit side only one queue On kernels starting from 2 6
423. ture e vpdv0 Set value to VPD VO tag version string can be put inside quotes to include the space character show Shows the settings of the current configuration CRC Syntax Cre Description Checks the integrity of the NVRAM CRC DEV Syntax dev lt number gt Description Selects the target device Parameters lt number gt The number of the adapter to be selected as target device GEN Broadcom Corporation Page 318 Command Descriptions Document INGSRVT710 CDUM100 R User Guide NetXtreme II March 2014 DIR Syntax dir delete lt type gt Description Displays a listing of the firmware programmed in NVRAM Parameters e delete Delete the specified type in the directory and its firmware from NVRAM The Firmware Upgrade tool will return successfully if the firmware does not exist e type The type of firmware to be deleted The keyword strings used for type are as follows e MBA MBA PXE e ASFINIT ASF Init e ASFCPUA ASF CPUA e ASFCPUB ASF CPUB e ASFCFG ASF CFG e ISCSICFG iSCSI CFG for port O e ISCSIPRG iSCSI CFG Program e ISCSIBOOT iSCSI Boot e ISCSICFG1 iSCSI CFG for port 1 e APECFG APE CFG e APECODE APE firmware e APECODENA Inactive APE firmware e APEUPDATE APE update firmware e APEDATA APE data e APEWEBDATA APE Web data e APEWORKAROUND APE Workaround e EXTVPD Extended VPD e APEAUDITLOG APE Audit Log e APEEVENTLOG APE Event Log e ISCSICFG2 iSCSI CFG f
424. ue to a different or the same CoS in the hardware This 32 bit parameter is evaluated by the driver as 8 values of 4 bits each Each nibble sets the desired hardware queue number for that priority For example set the pri map parameter to 0x22221100 to map priority O and 1 to CoS O map priority 2 and 3 to CoS 1 and map priority 4 to 7 to CoS 2 In another example set the pri map parameter to Ox11110000 to map priority O to 3 to CoS 0 and map priority 4 to 7 to CoS 1 qs per cos su Broadcom Corporation Page 172 Drivers Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 The optional parameter qs_per_cos is used to specify the number of queues that will share the same CoS This parameter is evaluated by the driver up to 3 values of 8 bits each Each byte sets the desired number of queues for that CoS The total number of queues is limited by the hardware limit For example set the qs per cos parameter to 0x10101 to create a total of three queues one per CoS In another example set the qs per cos parameter to Ox404 to create a total of 8 queues divided into only 2 CoS 4 queues in each CoS cos min rate The optional parameter cos min rate is used to determine the weight of each CoS for Round robin scheduling in transmission This parameter is evaluated by the driver up to 3 values of 8 bits each Each byte sets the desired weight for that CoS The weight ranges from O to 100 For example set the cos min rate pa
425. ult tolerance This type of team works with any Ethernet switch and requires no trunking configuration on the switch The team advertises multiple MAC addresses and one or more IP addresses when using secondary IP addresses The team MAC address is selected from the list of load balance members When the system receives an ARP request the software networking stack will always send an ARP Reply with the team MAC address To begin the load balancing process the teaming driver will modify this ARP Reply by changing the source MAC address to match one of the physical adapters e Broadcom Corporation Document INGSRVT710 CDUM100 R Executive Summary Page 17 NetXtreme II User Guide March 2014 Smart Load Balancing enables both transmit and receive load balancing based on the Layer 3 Layer 4 IP address and TCP UDP port number In other words the load balancing is not done at a byte or frame level but on a TCP UDP session basis This methodology is required to maintain in order delivery of frames that belong to the same socket conversation Load balancing is supported on 2 to 8 ports These ports can include any combination of add in adapters and LAN on Motherboard LOM devices Transmit load balancing is achieved by creating a hashing table using the source and destination IP addresses and TCP UDP port numbers The same combination of source and destination IP addresses and TCP UDP port numbers will generally yield the same hash index and therefore point
426. ulting in I O failure 57 Error Initiator could not allocate required resources for processing a request resulting in I O failure 58 Error Initiator could not allocate a tag for processing a request resulting in I O failure 59 Error Target dropped the connection before the initiator could transition to Full Feature Phase 60 Error Target sent data in SCSI Response PDU instead of Data IN PDU Only Sense Data can be sent in SCSI Response 61 Error Target set DataPdulnOrder to NO when initiator requested YES Login will be failed 62 Error Target set DataSequencelnOrder to NO when initiator requested YES Login will be failed 63 Error Cannot reset the target or LUN Will attempt session recovery 64 Information Attempt to bootstrap Windows using iSCSI NIC Boot iBF 65 Error Booting from iSCSI but could not set any NIC in Paging Path 66 Error Attempt to disable the Nagle Algorithm for iSCSI connection failed 67 Information If Digest support selected for iSCSI Session will use Processor support for Digest computation 68 Error After receiving an async logout from the target attempt to relogin the session failed Error status is given in the dump data 69 Error Attempt to recover an unexpected terminated session failed Error status is given in the dump data 70 Error Error occurred when processing iSCSI logon request The request was not retried Error status is given in the dump data 71 Information Initiator did not start a sessio
427. ump If iSCSI Boot is configured to boot in the HBA path then this parameter cannot be changed Interrupt Moderation Enables interrupt moderation which limits the rate of interrupt to the CPU during packet transmission and packet reception The disabled option allows one interrupt for every packet transmission and packet reception Enable is the default option Number of RSS Queues Allows configuring RSS queues For 1 Gbps network adapters the RSS queue options are Auto default 2 4 and 8 For 10 Gbps network adapters the RSS queue options are Auto default 2 4 8 and 16 p Broadcom Corporation Document INGSRVT710 CDUM100 R Managing the LAN Device Page 255 NetXtreme II User Guide March 2014 Receive Buffers The number of receive buffers Receive buffers are data segments that allow the network adapter to allocate receive packets to memory For 1 Gbps adapters the range of valid receive buffers is 50 to 5000 in increments of 1 with 750 receive buffers as the default value Receive Buffers 0O Auto The number of receive buffers Receive buffers are data segments that allow the network adapter to allocate receive packets to memory For 10 Gbps adapters the range of valid receive buffers is O to 3000 in increments of 50 with O receive buffers as the default value Transmit Buffers O Auto The number of transmit buffers Transmit buffers are data segments that allow the network adapter to monitor transmit packets in the system
428. uration area will copy from source image except MAC address Configuration area includes MAC address and various options mac Applies only when config is specified When mac is specified all configuration are copied including MAC address UPGRADE Syntax upgrade noreset F bc mba asf ump mgmt mgmt ia ib ib ipv6 ib ipv4n6 vpd usr ccm c p lt filename gt lt savefile gt Description This command upgrades the firmware or bootcode for the NetXtreme II controller The lt ilename gt specifies the name of the file that contains the appropriate image The lt savefile gt specifies the name of the file to which the current NVRAM contents will be saved If lt savefile gt is not specified the current NVRAM contents will not be saved Both lt filename gt and lt savefile gt are mandatory parameters In Linux use a forward slash instead of backslash when specifying the file path Alternatively you can also use two backslashes in the file path If the upgrade version is same or older than the version in NVRAM the upgrade will be aborted The noreset option skips the driver restart of the selected NIC after the firmware upgrade is completed This option is valid only in Command Line Mode Parameters e F Forces the upgrade without checking version e mba MBA PXE firmware e ump UMP firmware e asf ASF firmware e mgmt management firmware SMASH e mgmt_ia Inactive Management firmware e i
429. urity tab Ur oe Oe Te x A folder named Root with a plus sign next to it should now be visible Expand this tree as necessary to locate the namespace for which you want to set permissions 6 Click Security A list of users and their permissions appears If the user is on the list modify the permissions as appropriate If the user is not on the list click Add and add the user from the location local machine domain etc where the account resides KL NOTES You can add these exports at the end of the bash_profile This file is located in the root directory e To view and set namespace security the user must have Read Security and Edit Security permissions Administrators have these permissions by default and can assign the permissions to other user accounts as required e lf this user needs to access the namespace remotely you must select the Remote Enable permission e By default user permissions set on a namespace apply only to that namespace If you want the user to have access to a namespace and all subnamespaces in the tree below it or in subnamespaces only click Advanced Click Edit and specify the scope of access in the dialog box that displays Grant DCOM Remote Launch and Activate Permission In the Windows domain environment the Domain Administrator account has the necessary privilege level to access the WMI component for BACS management and therefore no special configuration is needed In a large enterpri
430. ut example vmhba34 bnx2fc link up fcoe 1000 mac address gt 2000 lt mac address gt vmhba35 bnx2fc link up fcoe 1000 mac address gt 2000 lt mac address gt KL User Guide March 2014 Software FCoE Software FCoE NOTE The label Software FCoE is a VMware term used to describe initiators that depend on the inbox FCoE libraries and utilities Broadcom s FCoE solution is a fully state connection based hardware offload solution designed to significantly reduce the CPU burden encumbered by a non offload software initiator MEM Broadcom Corporation Page 178 iSCSI Support Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 INSTALLATION CHECK To verify the correct installation of the driver and to ensure that the host port is seen by the switch follow the procedure below To verify the correct installation of the driver 1 Verify the host port shows up in the switch FLOGI database using the show flogi database command for the case of a Cisco FCF and fcoe loginshow command for the case of a Brocade FCF 2 Ifthe Host WWPN does not appear in the FLOGI database then provide driver log messages for review LIMITATIONS e NPIV is not currently supported with this release on ESX due to lack of supporting inbox components e Non offload FCoE is not supported with offload capable Broadcom devices Only the full hardware offload path is supported MM Broadcom Corporation Document INGSRVT710 CD
431. ut request 45 Error Target failed to respond in time for a login request This login request was for adding a new connection to a session 46 Error Target failed to respond in time for a SendTargets command 47 Error Target failed to respond in time for a SCSI command sent through a WMI request 48 Error Target failed to respond in time to a NOP request 49 Error Target failed to respond in time to a Task Management request 50 Error Target failed to respond in time to a Text Command sent to renegotiate iSCSI parameters 51 Error Target failed to respond in time to a logout request sent in response to an asynchronous message from the target 52 Error Initiator Service failed to respond in time to a request to configure IPSec resources for an iSCSI connection Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Offload in Windows Server Page 109 NetXtreme Il User Guide March 2014 Table 5 Offload iSCSI OIS Driver Event Log Messages Message 2 NUBE Severity Message 53 Error Initiator Service failed to respond in time to a request to release IPSec resources allocated for an iSCSI connection 54 Error Initiator Service failed to respond in time to a request to encrypt or decrypt data 55 Error Initiator failed to allocate resources to send data to target 56 Error Initiator could not map an user virtual address to kernel virtual address res
432. uxdiag log lt file gt Logs the test results to a specified log file uxdiag mba 1 0 Enables disables Multiple Boot Agent MBA protocol 1 Enable 0 Disable uxdiag mbap lt n gt Sets the MBA boot protocol 0 2 PXE 1 RPL 2 BOOTP 3 iSCSI Boot ME PEE Page 306 Performing Diagnostics Broadcom Corporation Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Table 1 uxdiag Command Options Cont Command Options Description uxdiag mbas lt n gt Sets the MBA PXE speed 0 Auto 1 10H 2 10F 3 100H 4 100F 6 1000F uxdiag mbav 110 Enables disables MBA VLAN 1 Enable 0 Disable uxdiag mbavval lt n gt Sets MBA VLAN 65536 uxdiag mfw lt 1 0 gt Enables disables management firmware 1 Enable O Disable uxdiag t lt groups tests gt Disables certain groups tests uxdiag T lt groups tests gt Enables certain groups tests uxdiag ver Displays the version of Broadcom NetXtreme ll User Diagnostics uxdiag and all installed adapters uxdiag wol 1 0 Enables disables Magic Packet WOL 1 Enable 0 Disable ee in EE Broadcom Corporation Document INGSRVT710 CDUM100 R Performing Diagnostics Page 307 NetXtreme Il User Guide March 2014 Table 2 uediag Command Options Command Options Description uediag Performs all tests on all Broadcom NetXtreme ll adapters in y
433. ve an effect on the test results e Link partner Various switch and hub manufacturers implement different PHYs Some PHYs are not IEEE compliant e Cable quality Category 3 4 5 and 6 may affect the test results Electrical interference The testing environment may affect the test results To run a cable analysis using BACS CLI You can use the following CLI commands to run cable analysis for the specified target This command is available for physical device ports only E Broadcom Corporation Document INGSRVT710 CDUM100 R Managing Ethernet Controller Port Page 249 NetXtreme II User Guide March 2014 BACScli t target type f target format i target ID cablediag Example 1 The following command runs the cable diagnostics test for the current selected target BACScli t PHYPORTS f bdf i 01 00 00 cablediag In Interactive mode use the list view and select lt idx gt commands to select the desired target device Use the cablediag command to run the cable analysis test for the selected target Example 1 The following command runs the cable diagnostics test for the currently selected NDIS adapter cablediag MANAGING THE LAN DEVICE The LAN function represents the Ethernet NDIS functionality available under the PCI Function User can view current values of various NDIS driver parameters configure NDIS driver parameters view attached FCoE targets and LUN information by selecting FCoE object in
434. was canigured or tie target an bare titration SED Hane lagel secret m erom mutua authentication m em L I ru dl gb m PES us T pm b L ibi b Eb Jouse mutua A Speci arr HET atr secret on ire Ema atom setings page anad emnt ames tnat secret ar tre target 7 Select the IP address for the adapter from Source IP MEM FEMME Broadcom Corporation Page 102 iSCSI Offload in Windows Server Document INGSRVT710 CDUM100 R User Guide NetXtreme Il March 2014 Advanced Settings Broadcom Metstreme II C HIC SCSI Adapter on hd Defaut CC 132 165 1 1 E LOA nepe enue data secun by piowamng autnenicatian EIEE a target ama am fma arr ving ta es bern SETS Connection Io uset spec Ine same tagel Enea secret Errat was caniguredlom tre target an Gate TETTE EIEGIT ser name lranget secret r Herom mutua autnenticattor Ir ihis BEL F e pati ote mrt mm tec wh akar othe ma Jo use mutua EnS specii am imitato secret on E red Fra ata setings page aha emma tnat secret an tre target 8 Click OK to close Advanced setting and then OK to add the target portal Eu Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Offload in Windows Server Page 103 NetXtreme Il iSCSI Initiator Properties E X General Discovery Targets Persistent Targets Bound Volumes Devices Target Portals TUCHEMLTRIN E IN 7773 192 B8 25i 3260 EM Bro i
435. when the adapter is in Multi Function mode MBA Boot Protocol Configuration To configure the boot protocol 1 Restart your system From the PXE banner select CTRL S The MBA Configuration Menu appears see Broadcom Boot Agent 3 From the MBA Configuration Menu use the UP ARROW or DOWN ARROW to move to the Boot Protocol option Use the LEFT ARROW or RIGHT ARROW to change the Boot Protocol option to iSCSI 4 Select iSCSI Boot Configuration from Main Menu KL NOTE If iSCSI boot firmware is not programmed in the NetXtreme II network adapter selecting iSCSI Boot Configuration will not have any effect iSCSI Boot Configuration e Static iSCSI Boot Configuration e Dynamic iSCSI Boot Configuration pS Broadcom Corporation Document INGSRVT710 CDUM100 R iSCSI Boot Page 81 NetXtreme II User Guide March 2014 Static iSCSI Boot Configuration In a static configuration you must enter data for the system s IP address the system s initiator IQN and the target parameters obtained in Configuring the iSCSI Target For information on configuration options see Table 1 To configure the iSCSI boot parameters using static configuration 1 From the General Parameters Menu screen set the following e TCP IP parameters via DHCP Disabled For IPv4 e IP Autoconfiguration Disabled For IPv6 non offload e iSCSI parameters via DHCP Disabled e CHAP Authentication Disabled e DHCP Vendor ID BRCM ISAN e Link Up
436. ws PE image Before running a DISM command first mount the Windows PE image 1 Mount the base image by using the DISM tool to a local Windows PE directory For example Dism Mount WIM WimFile c winpe x86 winpe wim index 1 MountDir c winpe x86 mount KL 2 Add the inf file to the base image by using the dism command with the Add Driver option For example Driver inf is the Broadcom driver evnd inf is the driver for the 10 Gbps devices and bO6nd inf is the driver for the 1 Gbps devices Dism image path to image Add Driver Driver c winpe x86 mount Windows driver inf NOTE The directory structure c winpe x86 is used throughout this procedure 3 Repeat steps 1 and 2 for each additional device driver 4 Unmount the image after modifying it dism unmount wim Mountdir c winpe x86 mount commit 5 After unmounting the image burn it to the designated media To create a bootable CD ROM 1 On your technician computer at the command prompt create an iso file by typing oscdimg n bc VistaPEx86 etfsboot com c VistaPEx86 ISO C VistaPEx86 VistaPEx86 iso 2 Burn the iso image to a CD WINPE 3 1 To insert the NetXtreme II monolithic driver into a WinPE 3 1 boot image Windows server 2008 R2 SP1 1 Open the WinPE image and mount it Dism Mount WIM WimFile c NWinPEx64Nwinpe wim index 1 MountDir c WinPEx64 mount 2 Use the following commands to insert the Broadcom NetXtreme II drivers into the WinPE 3 1 image
437. y interrupted click Yes The results are displayed in the Result field for each test Control Registers This test verifies the read and write capabilities of the network adapter registers by writing various values to the registers and verifying the results The adapter driver uses these registers to perform network functions such as sending and receiving information A test failure indicates that the adapter may not be working properly MII Registers This test verifies the read and write capabilities of the registers of the physical layer PHY The physical layer is used to control the electrical signals on the wire and to configure network speeds such as 1000 Mbit s EEPROM This test verifies the content of the electrically erasable programmable read only memory EEPROM by reading a portion of the EEPROM and computing the checksum The test fails if the computed checksum is different from the checksum stored in the EEPROM An EEPROM image upgrade does not require a code change for this test Internal Memory This test verifies that the internal memory of the adapter is functioning properly The test writes patterned values to the memory and reads back the results The test fails if an erroneous value is read back The adapter cannot function if its internal memory is not functioning properly On Chip CPU This test verifies the operation of the internal CPUs in the adapter Interrupt This test verifies that the Network Device Driver Interface
438. yed To configure a team with a VLAN From the Teams menu select Add VLAN The Welcome screen appears Click Expert Mode On the Create Team tab of the Manage Teams window click Manage VLAN s Type the VLAN name then select the type and ID oa Fe N gt Click Create to save the VLAN information As VLANs are defined they can be selected from the Team Name list but they have not yet been created 7 Continue this process until all VLANs are defined then click OK to create them 8 Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted ra NOTE To maintain optimum adapter performance your system should have 64 MB of system memory for each of the eight VLANs created per adapter Viewing VLAN Properties and Statistics and Running VLAN Tests To view VLAN properties and statistics and to run VLAN tests Select one of the listed VLANs Click the Information tab to view the properties of the VLAN adapter Click the Statistics tab to view the statistics for the VLAN adapter Bw m Click the Diagnostics tab to run a network test on the VLAN adapter Deleting a VLAN The procedure below applies when you are in Expert Mode To delete a VLAN Select the VLAN to delete From the Teams menu select Remove VLAN Click Apply mof c Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted KL NOTE
439. ze less than 64 byte with bad FCS The number of frames with a size less than 64 bytes with bad FCS MAC Rx w Pause Command and Length z 0 MAC control frames with the pause command and a length equal to O MAC Rx w Pause Command and Length greater than 0 MAC control frames with the pause command and a length greater than O MAC Rx w no Pause Command MAC control frames with no pause command MAC Sent X on MAC Transmit with X on was on MAC Sent X off MAC Transmit with X on was off Large Send Offload Transmit Requests The number of times the adapter was requested to transmit a packet performing TCP segmentation Total Offload TCP Connections The total number of offloaded TCP connections SR IOV Switch Statistics This area shows the statistics for SR IOV switches Num of Active VFs This shows the number of active Virtual Functions VF ViEWING RESOURCE RESERVATIONS KL NOTES e Resource Reservation information is only available for Broadcom NetXtreme Il adapters and VBD drivers e Not all offload technologies are available with all adapters e Resource Reservation information is not available in BACS on Linux systems The Resource Reservations section shows the number of connections allocated to an offload technology TOE and iSCSI e TCP Offload Engine TOE for accelerating TCP over 1 GbE 2 5 GbE and 10 GbE p Broadcom Corporation Document INGSRVT710 CDUM100 R Viewing Resource Information Page 261 NetXtreme

Broadcom NetXtreme II Network Adapter User Guide

Contents

Download Pdf Manuals

Related Search

Related Contents