Home

Emulex Drivers for Solaris User Manual

1. Emulex Drivers for Solaris User Manual P009693 01B Rev A SG EMUL EX 7 FC FCoE Driver Console and Log Messages 66 Log Messages for the FC FCoE Driver MESSAG Es FCSP start ACTION No action needed informational 1720 DEBUG FCSP comp VERBOS E MASK LOG FCSP 0x00020000 ESCRI PTION This indicates that authentication is being stopped or ted to a specific node TY LEVEL Debug ESSAG Es FCSP comp ACTION No action needed informational FCF Events Message IDs 1800 1899 1800 DEBUG FCF VERBOSE MASK DESCRIPTION This provides general information about the driver s FCF interface SEVERITY LEVEL Debug MESSAGE FCE ACTION No action needed informational 1801 DEBUG FCF detail D EF SEVERI M ERBOS E MASK PTION This provides detailed information about the driver s terface TY LEVEL Debug ESSAG E FCF detail ACTION No action needed informational 1810 DEBUG FCF error ERBOS E MASK ESCRI EVERI PTION This indicates that an error was found while processing request TY LEVEL Debug ESSAG BE FCF error ACTION No action needed informational 1820 DEBUG FCF state V D S M PTION This indicates that an FCF object state is changing TY L
2. ACTION No action needed informational 1502 NOTICE Firmware Library VERBOSE MASK LOG DRIVER 0x00000002 DESCRIPTION This shows the versions of firmware contained in the driver s library 5 M EVERITY LEVEL Notice ESSAGE Firmware Library ACTION No action needed informational 1510 ERROR Bad firmware image VERBOSE MASK LOG FIRMWARE 0x00008000 ESCRIPTION This indicates that a bad firmware image was provided o the download function D jes SEVERITY LEVEL Error M ESSAGE Bad firmware image ACTION Obtain the proper image file If the problem persists report this error to your customer service representative 1511 ERROR Firmware image not compatible VERBOSE MASK LOG FIRMWARE 0x00008000 ESCRIPTION This indicates that the firmware image provided was not ompatible with the existing hardware D SEVERITY LEVEL Error M ESSAGE Firmware image not compatible ACTION Obtain the proper image file If the problem persists report this error to your customer service representative Emulex Drivers for Solaris User Manual P009693 01B Rev A 61 gt G EMULEX 1520 NOTICE Firmware download 0x00008000 VERBOSE MASK LOG FIRMWARE ESCRIPTION D image has occurred SEVERITY LEVEL MESSAGE ACTION No action needed
3. ccc cecccccccccccccccccccccsssseeseesssnsecscccceeccceccccccssssseesees 35 Types of Log Messages Logged in the System File cc cece eeeee eee eeeeeeeeeeaeees 35 Log Message Severity Levels sosssesssssecessssossssesosssecosssscossssccosessossseeoo 36 Emulex Drivers for Solaris User Manual P009693 01B Rev A D6 EMULEX Table of Contents 5 Log Message Example esssessosssescsssecoosssccesesecoseesossseccsssscossesocesesscssseeoo 36 Log Messages for the FC FCoE Driver cccssscccssscccccccscccccesssccccscssscsssssssees 37 Miscellaneous Events Message IDs 0001 0099 ccc cece cece cence eneeeeenaeees 37 Driver Events Message IDs 0100 0199 cece cee ec cece eee eee eeeeeeeeeeeeeeees 38 HBA Initialization Events Message IDs 0200 0299 ccc ecccce cence eee eeeeeeeeeees 40 Memory Management Events Message IDs 0300 0399 ceeeececeeeeeeeeeeeees 42 Service Level Interface Events Message IDs 0400 0499 cece ec eeee ee eee eee ees 43 Mailbox Events Message IDs 0500 0599 ccccccccceceeeeeeessessceeeeeeeeeeeeees 47 Node Events Message IDs 0600 0699 ccccccssscceeessccceesecssceeetssceeeseees 49 Link Events Message IDs 0700 0799 ssssnssnssesssesssesseessseosesserosessseessees 50 ELS Events Message IDs 0800 0899 2 0 0 c eee cee ccc e cece eeeee cece eee eeeeeeeeeeeeeeeees 51 General I O Packet Events Message IDs 0900
4. Log Message Recommended Action MOD_MASK Severity MAP FAILED Low System resources Repeat the MOD_TX CE_WARN operation that generated the log If the error log is generated again reboot the system OCE INITIATE DUMP failed Diagnostic Dump initiation by an MOD_CONFIG CE_WARN application failed Retry the Dump initiation OCE_ INITIATE DUMP failed due Device Recovery failed after MOD_CONFIG CE_WARN to recovery timeout Diagnostic Dump initiation Reboot the system OCE INITIATE DUMP Dump Image Diagnostic Dump image is not MOD_CONFIG CE_WARN not present present Retry the Dump initiation Could not reset firmware ERR Firmware reset failed Reset the MOD_CONFIG CE_WARN bit set pd_ctrl lt reg gt system Error recovery timed out Hardware Driver is not able to MOD_CONFIG CE_WARN recover from a serious hardware error Reset the system Error recovery failed timed Reset the system MOD_CONFIG_ CE_WARN out Emulex Drivers for Solaris User Manual P009693 01B Rev A
5. ldm create vf lt pf name gt For example ldm create vf SYS MB RISER1 PCIE4 IOVNET PF1 Note Refer to the ldm man page to set the VF properties After creation of the VF the system may prompt for a reboot if that occurs create the required number of VFs and then reboot 4 Add the new VF s to the logical domain by typing ldm add io lt bus device vf gt lt ldom gt For example ldm add io SYS MB RISER1 PCIE4 IOVNET PFO VF1 ldom_name Listing the VF Interface in OCM 1 Map the VF to the guest by typing ldm add io lt bus or device gt ldom 2 On the guest install the OCM package 3 In order to see the VF interface in OCM plumb the interface by typing ifconfig lt interface id gt plumb up For example ifconfig netO plumb up Notes e The bus or device is the direct I O assignable device or a PCIe bus This device can be specified in a device path format or as a pseudonym For a I O assignable device example the PCIE1 pseudonym matches the pci 400 pci 0 pci c device path The pseudonym is based on the ASCII label that is printed on the chassis to identify the corresponding I O card slot and is platform specific Use the device pseudonym instead of the device path name to specify the device e Fora PCIe bus example the pci_0 pseudonym matches the pci 400 device path e Idom specifies the logical domain where the bus or device is to be added Emulex Drivers for Solaris User Manual P009693 01B Re
6. ERITY LEVEL Error MESSAG E Packet transport error ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 0932 DEBUG Packet transport VERBOS E MASK LOG PKT 0x00000200 ESCRI EV PTION This provides additional information about a packet ERITY LEVEL Debug D being sent S M ESSAG E Packet transport ACTION No action needed informational 0940 DEBUG Packet completion error VERBOS ESCRI EVERI E MASK LOG PKT 0x00000200 PTION This indicates that an I O packet was completed with an rror status This can occur during normal operation TY LEVEL Debug D e S M ESSAG E Packet completion error ACTION persis FCP Traffic Events Message IDs 1000 1099 No action needed informational However if the problem ts report this error to your customer service representative 1000 DEBUG Stray FCP completion V D ng C S M A Pp ERBOS E MASK LOG FCP 0x00000400 ESCRI eceiv ould EVERI PTION This indicates that an FCP command completion was ed without issuing a corresponding FCP command This error indicate a driver or firmware problem TY LEVEL Debug ESSAG E Stray FCP completion CTION No action needed informational
7. Debug D by the S M ESSAGE Ring error ACTION No action needed informational 0432 DEBUG Ring reset VERBOSE_MASK LOG SLI 0x00000010 DESCRIPTION This indicates that an SLI ring is being reset SEVERITY LEVEL Debug MESSAGE Ring reset ACTION No action needed informational 0440 DEBUG Adapter msg VERBOSE MASK LOG SLI 0x00000010 ESCRI PTION This indicates that a message was sent to the driver rom the adapter D f SEVERITY LEVEL Debug M ESSAG E Adapter msg ACTION No action needed informational 0450 ERROR IOCB invalid VERBOS E MASK LOG SLI 0x00000010 ESCRI PTION This indicates that an IOCB was received from the dapter with an illegal value This error could indicate a driver or EVERITY LEVEL Error D a firmware problem S M ESSAG E IOCB invalid ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 0451 DEBUG IOCB queue full VERBOS E MASK LOG SLI 0x00000010 DESCRI occur SEVERI PTION This indicates that the IOCB queue is full This will during normal operation TY LEVEL Debug Emulex Drivers for Solaris U ser Manual P009693 01B Rev A gt EMULEX Emulex Dr
8. EVERITY LEVEL Error D t S M F ESSAGE Driver resume failed ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative HBA Initialization Events Message IDs 0200 0299 0200 NOTICE Adapter initialization V DI S M ERBOS ESCRI E MASK LOG INIT 0x00000004 PTION This indicates that the adapter is initializing EVERITY LEVEL Notice ESSAG Tie Adapter initialization ACTION No action needed informational 0201 ERROR Adapter initialization failed V D a S M E MASK LOG INIT 0x00000004 PTION This indicates that an attempt to initialize the ERBOS ESCRI dapter has failed EVERITY LEVEL Error ESSAGE Adapter initialization failed ACTION Check your hardware configuration If the problem persists report this error to your customer service representative Emulex Drivers for Solaris User Manual P009693 01B Rev A 7 FC FCoE Driver Console and Log Messages 41 gt G EMULEX Log Messages for the FC FCoE Driver 0202 DEBUG Adapter initialization V DI S M A ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that the adapter is initializing EVERITY LEVEL Debug ESSAGE Adapter initialization CTION No act
9. However if the problem ersis ts report this error to your customer service representative 1001 DEBUG FCP completion error V ERBOS E MASK LOG FCP 0x00000400 Emulex Drivers for Solaris User Manual P009693 01B Rev A SG EMULEX D e S M 7 FC FCoE Driver Console and Log Messages 56 Log Messages for the FC FCoE Driver ESCRIPTION This indicates that an FCP command completed with an rror status These errors can occur during normal operation EVERITY LEVEL Debug ESSAG E FCP completion error ACTION No action needed informational FCP Target Mode Events Message IDs 1100 1199 1100 DEBUG FCT detail E MASK LOG FCT DETAIL 0x00800000 PTION This provides detailed information about the driver s ERBOS ESCRI CT interface EVERITY LEVEL Debug ESSAG E FCT detail ACTION No action needed informational 1110 DEBUG FCT debug ERBOS E MASK LOG FCT 0x00000800 ESCRI PTION This provides general information about the driver s terface EVERITY LEVEL Debug ESSAG E FCT debug ACTION No action needed informational 1120 DEBUG FCT error V D d S M A P ERBOS E MASK LOG FCT 0x00000800 ESCRI river PTION This indicates that a general error has occurred in the s FCT interface EVERITY LE
10. Notice Firmware download informational 1521 NOTICE Firmware download complete 0x00008000 VERBOSE MASK LOG FIRMWARE DESCRIPTION image was successful SEVERITY LEVEL Notice MESSAGE ACTION No action needed Firmware download complete informational 1522 ERROR Firmware download failed 0x00008000 VERBOSE MASK LOG FIRMWARE DESCRIPTION image was failed SEVERITY LEVEL MESSAGE PeEOL Firmware download failed ACTION Check your hardware configuration 7 FC FCoE Driver Console and Log Messages 62 Log Messages for the FC FCoE Driver This indicates that an attempt to download a firmware This indicates that an attempt to download a firmware This indicates that an attempt to download a firmware If the problem persists report this error to your customer servic 1523 WARNING Firmware updated 0x00008000 VERBOSE MASK LOG FIRMWARE ESCRIPTION he adapter D t SEVERITY LEVEL MESSAGE Warning Firmware updated representative This indicates that new firmware has been updated on ACTION A reboot or adapter power cycle will be required to activate the new firmware 1530 DEBUG Firmware dump VERBOSE MASK LOG FIRMWARE 0x00008000 DESCRIPTION This indicates that a firmware core dump has oc
11. Table 5 1 Table 5 2 Table 5 3 Table 6 1 Table 7 1 Table 7 2 Table 7 3 Table 8 1 Table 8 2 Table 8 3 Table 8 4 Emulex Drivers for Solaris User Manual FC FCoE Configuration File Parameters ccccsscccccessccceeeeseccceeesees 19 NIC Configuration File Parameters ccccscccccssccceeeesccccesssseceeeeseees 24 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 10 27 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 11 28 Solaris 11 elxfc Driver Installation Situation and the Resolution 33 Setting Types of Console and Log Messages for the FC FCoE Driver 34 Log Message Types for the FC FCoE Driver ccccceesscccceessceeeesaces 35 Severity Levels of FC FCoE Driver Log Messages scccessccceceessccceeees 36 MOD_MASK Information for NIC Driver Log Messages ceeeeeceeeeeeeeeeees 68 Severity Level Information for NIC Driver Log Messages eceeeeeeeeeeees 68 Log Messages for the NIC Driver for Solaris 10 cccceeeececeeeeeeeeeeeees 69 Log Messages for the NIC Driver for Solaris 11 cccceeeseeceeeeeeeeeeenees 71 P009693 01B Rev A List of Tables 6 gt G EMULEX 1 Introduction 7 Prerequisites 1 Introduction This document provides information for using the Emulex Fibre Channel FC and Fibre Channel over Ethernet FCoE out of box drivers for Solaris StorE
12. VERBOSE MASK LOG MBOX 0x00000020 ESCRIPTION This indicates that an IOCB local error event is being DESCRIPTION This provides detailed information about an SLI event P009693 01B Rev A 47 gt G EMULEX 7 FC FCoE Driver Console and Log Messages 48 Log Messages for the FC FCoE Driver DESCRIPTION This indicates that a mailbox event has occurred SEVERITY LEVEL Debug MESSAGE Mailbox event ACTION No action needed informational 0501 DEBUG Mailbox detail VERBOSE MASK LOG MBOX DETAIL 0x40000000 ESCRIPTION This provides detailed information about a mailbox D e SEVERITY LEVEL Debug MESSAGE Mailbox detail ACTION No action needed informational 0510 DEBUG Stray mailbox interrupt VERBOSE MASK LOG MBOX 0x00000020 ESCRIPTION This indicates that a mailbox command completion nterrupt was received and the mailbox is not valid This error EVERITY LEVEL Debug D i could indicate a driver or firmware problem S M ESSAGE Stray mailbox interrupt ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 0520 DEBUG Mailbox error VERBOSE MASK LOG MBOX 0x00000020 ESCRI PTION This indicates that an unsupported or illegal mailbox ommand was completed Thi
13. a Create a local file to be used as a backing store for the LUN The following example creates a 100MB backing store at luns 1lun0 mkdir luns mkfile 100m luns lun0O b Create a LUN that uses the backing store from the previous step This command will return a GUID that will be used for the next step sbdadm create lu luns lun0 c Make LUN visible to the COMSTAR framework stmfadm add view lt GUID from sbdadm create lu output gt The system is now ready to support target mode adapters both normal and dynamic target mode Emulex Drivers for Solaris User Manual P009693 01B Rev A is 5 NIC Driver Configuration 23 gt lt EMULEX Using the NIC Configuration File elxnic conf 5 NIC Driver Configuration In Solaris 10 the driver exports certain parameters that can be configured by editing the Emulex NIC out of box driver for Solaris configuration file elxnic conf See NIC Configuration File Parameters on page 23 and Table 5 1 NIC Configuration File Parameters on page 24 In Solaris 11 while you can configure the driver using the elxnic conf file Emulex recommends using the dladm utility available by default on Solaris 11 systems For more information on using this Solaris NIC configuration utility see the dladm 1M man page Using the NIC Configuration File elxnic conf If the elxnic conf file is not present you can download it from the Downloads section of the Emulex website Changing Driver
14. gt G EMULEX Installing the Drivers for Solaris 11 5 elxfc_install Reboot the system reboot Manual Installation Log in as root Download the p5p tar file from the Emulex website Extract the p5p archive from the tar file tar xvf elxfc_p5p 2 xx x x sll tar Run the following command to install the package pfexec pkg install g elxfc_2 xx x x s11 p5p Reboot the system reboot Note The emlxdrv utility must be used to bind the HBA to the elxfc driver For more information on the emlxdrv utility see the latest Emulex Solaris FCA Utilities User Manual NIC Out of Box Driver elxnic You can install the NIC out of box driver using one of two options Remote Repository Installation or P5P Archive Installation Option 1 Remote Repository Installation 1 2 Log in as root Add the Emulex IPS repository to the publisher list For example pkg set publisher O lt Emulex provided URL gt emulex List all available versions of elxnic For example pkg list af elxnic NAME PUBLISHER VERSION IFO driver nic elxnic emulex 4 x xx x 0 i driver nic elxnic emulex 4 x xy x 0 Install the elxnic driver pfexec pkg install elxnic By default the latest version of elxnic that is compatible with the rest of the image will be installed To install a specific version of elxnic append the package version to the package name as follows pfexec pkg install elxnic 4
15. 10 The default value is 8 e 1 to 16 for OCe11102 on Solaris 11 The default value is 8 rss_key static Enables static RSS key generation The possible values are 0 disabled or 1 enabled The default value is 0 Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX 5 NIC Driver Configuration 25 Using the NIC Configuration File elxnic conf Table 5 1 NIC Configuration File Parameters Continued Parameter rx bcopy limit Definition Sets the receive buffer size threshold to use the copy mode The possible values are any values that are less than or equal to the default_mtu value The default value is 128 Note On Solaris 11 consider changing this value to fine tune the receive performance rx frag_size Sets the size of the pre allocated receive buffer A higher value results in better resource utilization The possible values are 2048 4096 and 8192 The default value is 2048 Note On Solaris 10 consider changing the value to 4096 or 8192 if the default_mtu value is 9000 rx max_ bufs Sets the maximum number of pre allocated receive buffers The possible values are 1024 8192 The default value is 2048 Note On Solaris 10 consider increasing the rx_max_bufs value if the rx_drops_no_frags_q x increments continuously in the kstat output max rx rings Sets the maximum number of receive queues Possible values are e 1 to 5 0Ce10102 and 0Ce11102 The default value
16. CE_WARN lt ret_code gt Device Unknown The device is not supported by the MOD_CONFIG CE_WARN driver PCI initialization failed Reset the adapter MOD_CONFIG CE_WARN HW initialization failed with Check for the faulty hardware using MOD_CONFIG CE_WARN ret_code fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Interrupt setup failed with Reload the driver MOD_CONFIG_ CE_WARN lt ret_code gt Failed to init rings Low system resources Reboot the MOD_CONFIG CE_WARN system to see if the problem resolves itself If possible add more memory kstat setup Failed with Reload the driver MOD_CONFIG CE_WARN lt ret_code gt MAC allocation Failed Unload and then reload the driver MOD_CONFIG CE_WARN MAC registration failed Unload and then reload the driver MOD_CONFIG CE_WARN x pending buffers on rq Reset the system MOD_CONFIG CE_WARN lt rq_address gt Failed to query fw config Check for the faulty hardware using MOD_CONFIG_ CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to get stats Check for the faulty hardware using MOD_CONFIG_ CE_WARN fmadm faulty If the hardware is faulty acquit the
17. D o SEVERITY LEVEL Debug MESSAGE Driver detach ACTION No action needed informational 0120 DEBUG Driver suspend VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver is performing a suspend peration D fe SEVERITY LEVEL Debug M ESSAGE Driver suspend ACTION No action needed informational Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX 7 FC FCoE Driver Console and Log Messages 40 Log Messages for the FC FCoE Driver 0121 ERROR Driver suspend failed E MASK LOG DRIVER 0x00000002 PTION This indicates that the driver was unable to suspend VERBOS DESCRI due to some issue SEVERITY LEVEL Error MESSAGE Driver suspend failed ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative 0130 DEBUG Driver resume VERBOSE MASK LOG DRIVER 0x00000002 DESCRIPTION This indicates that the driver is performing a resume operation SEVERITY LEVEL Debug MESSAGE Driver resume ACTION No action needed informational 0131 ERROR Driver resume failed V ERBOS ESCRI E MASK LOG DRIVER 0x00000002 PTION This indicates that the driver was unable to resume du o some issue
18. MASK LOG NODE 0x00000040 DESCRIPTION This indicates that a FCP2 device node has been found missing SEVERITY LEVEL Notice MESSAGE Node missing ACTION No action needed informational 0620 DEBUG Node not found VERBOS E MASK LOG NODE 0x00000040 ESCRI kt to PTION This indicates that there was an attempt to send an I O an unknown device node The driver maintains a node table ERITY LEVEL Debug D p entry for every device it needs to communicate with on the FC n S M ESSAGE Node not found ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 0621 DEBUG Node timeout VERBOSE MASK LOG NODE 0x00000040 DESCRIPTION This indicates that the node timer expired the node is ready to be opened or it has been offline too long and needs to be flushed SEVERITY LEVEL Debug MESSAGE Node timeout ACTION No action needed informational Link Events Message IDs 0700 0799 0700 DEBUG Link event V ERBOS E MASK LOG SLI 0x00000010 or LOG LINK 0x00000080 D ESCRI S EVERI PTION This indicates that a link event has occurred TY LEVEL Debug M ESSAG E Link event ACTION No action needed informational 0710 NOTICE Link down V E
19. OneCommand Manager Application 3 Utilities for Solaris Drivers Emulex provides three utilities to facilitate configuring and using the Solaris drivers e OneCommand Manager application e emlxadm utility included in the FCA utilities e emlxdrv utility included in the FCA utilities Note When you install the OneCommand Manager application also install the Solaris FCA Utilities OneCommand Manager Application The OneCommand Manager application provides the functions of the emlxadm utility plus additional functions allowing you to remotely manage multiple systems It offers a choice of a graphical user interface and a scriptable command line interface It is a direct user interface to the FCIO interface provided by the Oracle StorEdge SFS The FCIO interface provides an Oracle common ioctl interface to the FCTL which manages the FCA drivers for each FC FCoE adapter attached to the host system The OneCommand Manager application also directly interfaces with the Emulex network driver allowing you to manage the NIC function of Emulex UCNAs For more information see the OneCommand Manager Application User Manual which is available on the Emulex website emlxadm Utility The emlxadm utility changes driver parameters through a local interactive or CLI mode It can also update firmware on non Oracle branded devices For more information see the Solaris FCA Utilities User Manual emlxdrv Utility The emlxdrv utility is used for b
20. PKT PTION out wi ttempt EVERITY LEVEL ESSAGE ket flush ACTION persists to recove Notice Pac No action needed report this error to your customer servic 0x00000200 r by itself timeout informational 0930 NOTICE Packet transport failed 0x00000200 VERBOSE MASK LOG PKT DESCRIPTION failed SEVERITY LEVEL Notice Emulex Drivers for Solaris User Manual 54 Log Messages for the FC FCoE Driver are getting stale waiting on This indicates that an I O was found missing from the This indicates that an I O packet is being flushed This indicates that an I O packet has been flushed This indicates that an I O packet flush request has th some I O packets s still not completed The driver if the problem representative However This indicates that an attempt to send an I O packet The I O packet will be retried by the upper layer P009693 01B Rev A gt EMULEX 7 FC FCoE Driver Console and Log Messages 55 Log Messages for the FC FCoE Driver ME ISSAGE Packet transport failed ACTION No action needed informational 0931 ERROR Packet transport error VERBOSE MASK LOG PKT 0x00000200 DESCRI PTION This indicates that an error occurred while attempting to send an I O packet The I O packet will likely be failed back to the user application SEV
21. Parameters The configurable driver parameters are described in Table 5 1 NIC Configuration File Parameters on page 24 To edit the elxnic conf file 1 Open the file in a text editor 2 Change the parameters to the desired settings The syntax of single lines in the file lt variable gt lt value gt For example default mtu 9000 Comment lines must start with a character 3 Save the file 4 Ifthe driver is already loaded unload and reload it Changes to the configuration file require you to unload and reload the driver For more information see Installing and Uninstalling on page 9 NIC Configuration File Parameters For the Solaris 10 driver you can configure the elxnic driver parameters using either the elxnic conf file for driver parameters that are common to all the elxnic devices or the ndd utility for driver parameters that may need to be set with different values for different elxnic devices For the Solaris 11 driver use the dladm utility or the elxnic conf file Table 5 1 on page 24 lists the NIC configuration file parameters Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX 5 NIC Driver Configuration 24 Using the NIC Configuration File elxnic conf Table 5 1 NIC Configuration File Parameters Parameter default_mtu Definition Sets the default MTU for the driver The possible values are 1500 and 9000 The default value is 1500 flow_control Sets
22. cclsccccases arinaren Aen E E RNE AAEREN ERA REEERE TREENER 17 Using VPorts with Oracle VM Server for SPARC Solaris Containers or Oracle VM Server Tor 86 scrret siue an etree ETE ETENEE EEA AE 18 Configuring Target Mode Support for Solaris 11 sssssssssssssssseeosessseosssesseeese 18 FC FCoE Configuration File Parameters sccccssssccccccccccccsssscccccsscccsessssees 18 Configuring Dynamic Target Mode FC COMSTAR Ports Only ssssscessssccceeeees 22 5 NIC Driver Conme uration isc isscive cadduseatiuedausducseiv eee sesienaiiedsade adaudeaninesnents 23 Using the NIC Configuration File elxnic conf cscccesssccccccccccccccsccceessscces 23 Changing Driver P rametefSssisisccncsicrner incorr eresas indieni r ida nae r e e Ea 23 NIC Configuration File Parameters i sss 0 lt svscesssacssiarsevecceesesscnessiesseanessavesecses 23 Configuring the NIC Interface sssssssssessesssesssssosssscsssssesseseeesesesesssseees 25 Removing the NIC Interface using elxniC ssssssssesssssossssssssssessessesssseeessse 26 Multi ring Mode and the Effect of ddi_msix_alloc_limit 0 cccccceeeeeeeeeees 27 SOLAS 10 E E I E A E T E E 27 Solaris 11 gic ecdieeasthe cdi EEEE E e EAEE EEE EEIE EEEE EEES 27 Changing Interrupt Priorities sesssssssssessesesessecsossssesesssesssssossesessssserees 28 Using the dladm Utility for Solaris 11 essssssesssssscssssecosssecsseesoessecessscesssesoe 29 Configuring t
23. determined by the type of HBA link speed Sets the link speed for initializing the FC connection Link reset e 0O auto detect e 2 2 Gb s e 4 4Gb s e 8 8Gb s e 16 16 Gb s linkup delay Sets the driver wait period seconds for a link up after adapter Adapter initialization Possible values are 0 60 The default value is 10 reset log errors Verbose mask for driver error messages to the messages file Possible Dynamic values are 0xO0000000 OxFFFFFFFF The default value is OxFFFFFFFF log notices Verbose mask for driver notice messages to the messages file Dynamic Possible values are 0x0000000 OxFFFFFFFF The default value is OxFFFFFFFF log warnings Verbose mask for driver warning messages to the messages file Dynamic Possible values are 0x0000000 OxFFFFFFFF The default value is OxFFFFFFFF max xfer size This property is only used by the driver on i386 platforms The driver Reboot does not limit transfer size on SPARC platforms Sets the maximum SCSI transfer size in bytes per I O This property determines the scatter gather list buffer size A pool of buffers is reallocated by the driver during boot A larger transfer size requires a larger memory allocation The minimum value is 131072 The maximum value is 1388544 The default value is 339968 Note For OCe10100 FM series OCe11100 FM series and LPE16000 and LPe15000 series adapters the maximum transfer size is 1040384 bytes ne
24. faulty reset the adapter without issuing acquit Failed to Setup handlers Reload the driver MOD_CONFIG CE_WARN Hardware UE Detected Upgrade the firmware to the MOD_CONFIG_ CE_WARN correct version Failed to retrieve intr types Unload and then reload the driver MOD_CONFIG CE_WARN MSIX not available The system continues to work with MOD_CONFIG CE_WARN INTX Could not get supported intrs Reload the driver MOD_CONFIG_ CE_WARN Alloc intr failed Reload the driver MOD_CONFIG CE_WARN Unable to get intr priority Reload the driver MOD_CONFIG_ CE_WARN Failed to add interrupt Reload the driver MOD_CONFIG CE_WARN handler Interrupts block enable Reload the driver MOD_CONFIG CE_WARN failed Failed to enable ret lt ret Reload the driver MOD_CONFIG CE_WARN code gt interrupt lt int num gt type lt int type gt cnt lt num_vectors gt Interrupt block disable Reset the adapter MOD_CONFIG CE_WARN failed Failed to disable the Reset the adapter MOD_CONFIG CE_WARN interrupts mod install failed rval Reset the adapter MOD_CONFIG CE_WARN Emulex Drivers for Solaris User Manual P009693 01B Rev A 73 8 NIC Driver Log Messages Log Messages for the NIC Driver S EMULEX 74 Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued Log Message Recommended Action MOD_MASK Severity ap PCI config failed with Reset the adapter MOD_CONFIG
25. for Solaris 11 Log Message Recommended Action MOD_MASK_ Severity Ring buffer allocation failed Configure the server with more MOD_CONFIG CE_WARN lt code gt memory mcast ADD DEL failed Check for the faulty hardware using MOD_CONFIG_ CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Could not retrieve num bars Reset the adapter MOD_CONFIG CE_WARN Could not get size of bar Reset the adapter MOD_CONFIG CE_WARN Could not map bar Reset the adapter MOD_CONFIG CE_WARN soft_reset bit asserted 1 Check for the faulty hardware using MOD_CONFIG_ CE_WARN Reset failed fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message POST ERROR Recommended Action Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset
26. for the IP address change to take effect 5 Edit the etc netmasks file and add an entry with the IP address and desired subnet mask for the given interface See the netmasks 4 man page for more information 6 Restart the network service Run svcadm restart network physical or reboot the system Removing the NIC Interface using elxnic To remove the NIC interface 1 Remove all the elxnic entries from etc hosts 2 Remove all the entries from etc inet ipnodes that are related to elxnic interfaces 3 Remove all the elxnic netmask entries from etc netmasks 4 Unplumb the interface using the following command ifconfig elxnic lt xX gt down unplumb Solaris 10 driver ifconfig net lt X gt down unplumb Solaris 11 driver Where lt X gt is the interface number Alternatively you can use the sys unconfig 1M utility for Solaris 10 or sysconfig 1M utility for Solaris 11 to unconfigure a device These utilities can delete the configurations of IP address netmask hostname nfs mounts ldap and so on on the host The sys unconfig 1M sysconfig 1M utility reboots the system and clears the existing IP configuration so you must enter all the information again even for the Emulex Drivers for Solaris User Manual P009693 01B Rev A 5 NIC Driver Configuration 27 gt lt EMULEX Using the NIC Configuration File elxnic conf existing NICs already configured in the system The sys un
27. gt lt EMULEX Emulex Drivers for Solaris User Manual FC and FCoE Driver Version 2 95 12 0 NIC Driver Version 4 9 283 0 P009693 01B Rev A Emulex Connects Servers Storage and People gt G EMULEX Copyright 2003 2013 Emulex All rights reserved worldwide No part of this document may be reproduced by any means or translated to any electronic medium without the prior written consent of Emulex Information furnished by Emulex is believed to be accurate and reliable However no responsibility is assumed by Emulex for its use or for any infringements of patents or other rights of third parties which may result from its use No license is granted by implication or otherwise under any patent copyright or related rights of Emulex Emulex the Emulex logo AutoPilot Installer AutoPilot Manager BlockGuard Connectivity Continuum Convergenomics Emulex Connect Emulex Secure EZPilot FibreSpy HBAnyware InSpeed LightPulse MultiPulse OneCommand OneConnect One Network One Company SBOD SLI and VEngine are trademarks of Emulex All other brand or product names referenced herein are trademarks or registered trademarks of their respective companies or organizations Emulex provides this manual as is without any warranty of any kind either expressed or implied including but not limited to the implied warranties of merchantability or fitness for a particular purpose Emulex may make improvements and changes to the product described
28. has triggered a link ttention interrupt D a SEVERITY LEVEL Debug MESSAGE Link atten ACTION No action needed informational 0411 DEBUG State change VERBOSE MASK LOG SLI 0x00000010 DESCRIPTION This indicates that the adapter has changed state SEVERITY LEVEL Debug MESSAGE State change ACTION No action needed informational 0412 DEBUG Link Up atten VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that the adapter has triggered a link up ttention interrupt DI a SEVERITY LEVEL Debug MESSAGE Link Up atten ACTION No action needed informational 0413 DEBUG Link Down atten VERBOSE MASK LOG SLI 0x00000010 DESCRIPTION This indicates that the adapter has triggered a link down attention interrupt S M EVERITY LEVEL Debug ESSAGE Link Down atten ACTION No action needed informational 0420 ERROR Adapter hardware error VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that an interrupt has occurred and the tatus register indicates a nonrecoverable hardware error D s SEVERITY LEVEL Error M ESSAGE Adapter hardware error ACTION This error usually indicates a hardware problem with the adapter Try running adapter diagnostics Report these errors to custo
29. is 5 e 1 to 16 OCe11102 in advanced mode on Solaris 10 The default value is 8 e 1 to 16 OCe11102 in advanced mode on Solaris 11 The default value is 8 The actual number of transmit and receive queues that are created depends on the number of vectors allocated The actual number can be checked using the ndd 1m command on Solaris 10 or the dladm 1M command on Solaris 11 For more information run man ndd on Solaris 10 or man dladm on Solaris 11 On non IRM capable machines with FLEX10 or multi adapter setup some of the functions may fail to attach because of a lack of interrupts See Changing Interrupt Priorities on page 28 for more information tx_bcopy limit Sets the transmit buffer size threshold to use the copy mode The possible values are 128 256 512 1024 and 2048 The default value is 512 Note On Solaris 11 consider reducing this value if a wqb pool empty message is frequently observed Consider increasing the value if a wqm pool empty message is frequently observed For descriptions of these messages see page 77 in Table 8 4 Log Messages for the NIC Driver for Solaris 11 tx_intr_ enable Enables the handling of transmit completions in interrupt mode The possible values are 0 disabled or 1 enabled The default value is 0 Note Enable this parameter if you observe frequent frame loss Also consider using this in conjunction with rx_max_bufs Configuring the NIC Interfa
30. notices Verbose mask for driver error messages to the console log only when set to 0 Possible values are 0x0000000 OxFFFFFFFF log messages are logged The default value is 0x0000000 to the system log file and also printed on the console warnings Verbose mask for driver notice messages to the console console Possible values are 0x0000000 OxFFFFFFFF Default Disabled The default value is Ox0000000 console errors Verbose mask for driver warning messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 log notices Verbose mask for driver error messages to the messages log verbose when set to file Possible values are Ox0000000 OxFFFFFFFF non zero verbose The default value is OxFFFFFFFF messages are generated log warnings Verbose mask for driver notice messages to the messages Default Disabled file Possible values are OxO000000 OxFFFFFFFF The default value is OxFFFFFFFF log errors Verbose mask for driver warning messages to the messages file Possible values are 0Ox0000000 OxFFFFFFFF The default value is OxFFFFFFFF Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX Log Message Overview Types of Log Messages Logged in the System File 7 FC FCoE Driver Console and Log Messages Log Message Overview Log messages are logged to the var adm messages system file Table 7 2 lists the types of log messages that can be logged
31. the ethernet flow control The possible values are e 0 Flow control disabled e 1 Transmit only e 2 Receive only e 3 Both transmit and receive default Flow control cannot be disabled on NIC FCoE UCNAs fm_capability Sets the driver s device fault management capability to one of the values defined for Solaris fault management capability The fm_capability value is a bitmap of one or more of these values e 0x00000000 DDI_LFM_NOT_CAPABLE A value of zero indicates that the fm_capability is disabled e 0x00000001 DDI_FM_EREPORT_CAPABLE e 0x00000002 DDILFM_ACCCHK_CAPABLE e 0x00000004 DDI_FM_DMA_CHK_CAPABLE The default value is 0x00000007 DDI_FM_ACCCHK_CAPABLE DDI_FM_ACCCHK_CAPABLE and DDI_LFM_DMA_CHK_CAPABLE log_level Sets the driver s verbosity for logs in var adm messages The log_level parameter is comprised of MOD_MASK upper 16 bits and SEVERITY lower 16 bits The MOD_MASK value is a bitmap of one or more of these values e 0x10000 MOD_CONFIG e 0x20000 MOD_TX e 0x40000 MOD_RX e 0x80000 MOD_ISR The possible values for SEVERITY e 0x0 CE_CONT e 0x1 CE_NOTE e 0x2 CE_WARN e 0x3 CE_PANIC e 0x4 CE_IGNORE For details on MOD_MASK and SEVERITY see Setting MOD_MASK and SEVERITY on page 68 max tx rings Sets the maximum number of transmit queues The possible values are e 1 for OCe11102 in legacy mode e 1 to 8 for 0Ce11102 in advanced mode on Solaris
32. to the system file Table 7 2 Log Message Types for the FC FCoE Driver Verbose Bit Log Message Verbose Mask Verbose Description Pages 0x00000001 LOG_MISC Miscellaneous events 37 38 0x00000002 LOG_DRIVER Driver attach and detach events 38 40 0x00000004 LOG_INIT HBA initialization events 40 41 0x00000008 LOG_MEM Memory management events 42 43 0x00000010 LOG_SLI SLI events 43 47 0x00000020 LOG_MBOX Mailbox events 47 48 0x00000040 LOG_NODE Node events 49 50 0x00000080 LOG_LINK Link events 50 51 0x00000100 LOG_ELS ELS events 51 53 0x00000200 LOG_PKT General I O packet events 53 55 0x00000400 LOG_FCP FCP traffic events 55 0x00000800 LOG_FCT FCP target mode events 56 56 0x00001000 LOG_IP IP traffic events 57 58 0x00002000 LOG_SFS Solaris SFS events 58 59 0x00004000 LOG_IOCTL IOCTL events 60 60 0x00008000 LOG_FIRMWARE Firmware download events 61 62 0x00010000 LOG_CT Common transport events 63 64 0x00020000 LOG_FCSP FCSP events 64 66 0x00040000 LOG_FCF FCF events 66 67 0x007C0000 LOG_RESERVED Reserved 0x00800000 LOG_FCT_DETAIL Detailed FCT events 56 0x01000000 LOG_FCSP_DETAIL Detailed FCSP events 65 0x02000000 LOG_NODE_DETAIL Detailed node events 49 49 0x04000000 LOG_IOCTL_DETAIL Detailed IOCTL events 60 60 0x08000000 LOG_IP_DETAIL Detailed IP events 57 0x10000000 LOG_FIRMWARE_DETAIL Detailed Firmware events 61 0x20000000 LOG_SFS_DETAIL Detailed Solaris SFS events 5
33. version to another Log Messages for the FC FCoE Driver Miscellaneous Events Message IDs 0001 0099 0001 DEBUG VERBOSE MASK LOG MISC 0x00000001 DESCRIPTION This is a general purpose informational message SEVERITY LEVEL Debug M ESSAGE None ACTION No action needed informational 0002 NOTICE V D ERBOSE MASK LOG MISC 0x00000001 ESCRIPTION This is a general purpose informational message S EVERITY LEVEL Notice M ESSAGE None ACTION No action needed informational 0003 WARNING V D ERBOSE MASK LOG MISC 0x00000001 ESCRIPTION This is a general purpose warning message S EVERITY LEVEL Warning M ESSAGE None A CTION No action needed informational 0004 ERROR V D S M A ERBOSE MASK LOG MISC 0x00000001 ESCRIPTION This is a general purpose error message EVERITY LEVEL Error ESSAGE None CTION No action needed informational Emulex Drivers for Solaris User Manual P009693 01B Rev A gt EMULEX 7 FC FCoE Driver Console and Log Messages 38 Log Messages for the FC FCoE Driver 0005 PANIC VERBOS DESCRI SEV E MASK LOG MISC 0x00000001 PTION This is a general purpose panic message ERITY LEVEL Panic Severe MESSAG FE N
34. website to a convenient directory The file is a regular tar file 3 Extract the installation image from the tar file For example cd lt location of driver package gt tar xvf elxfc_kit 2 xx x x sl0 sparc tar 4 Install the driver kit For example cd lt location of driver package gt pkgadd d 5 Reboot the system Note The emlxdrv utility must be used to bind the HBA to the elxfc driver For more information on the emlxdrv utility see the latest Emulex Solaris FCA Utilities User Manual which is available on the Emulex website NIC Out of Box Driver elxnic To install the NIC out of box driver 1 Log in as root 2 Download the platform specific NIC out of box driver from the Emulex website to a convenient directory The file is a regular tar file 3 Extract the installation image from the tar file For example cd lt location of driver package gt tar xvf elxnic_kit 4 6 xxx x sl0 sparc tar 4 Install the driver kit For example cd lt location of driver package gt pkgadd d 5 Reboot the system Binding a Driver to a Device id Instance Because the out of box NIC driver elxnic and the inbox NIC driver oce support the same set of device ids only one driver can be attached to a device id instance By default the oce driver claims all the device ids Therefore when installing the elxnic Emulex Drivers for Solaris User Manual P009693 01B Rev A is 2 Installing and Uninstalling 10 gt lt EMULEX Un
35. x xy x 0 In instances where two publishers provide packages of the same name specify the publisher name as follows pfexec pkg install emulex elxnic Emulex Drivers for Solaris User Manual P009693 01B Rev A gt lt EMULEX 2 Installing and Uninstalling 13 Uninstalling the Drivers for Solaris 11 Following installation of elxnic Solaris must be configured to discover and bind the elxnic driver to Emulex adapters Use the Emulex utility emlxdrv to configure these device bindings See Utilities for Solaris Drivers on page 15 for more information 5 Reboot the system Option 2 P5P Archive Installation 1 Log in as root 2 Download the p5p tar file from the Emulex website 3 Untar the archive tar xvf elxnic p5p x x xx x sll tar 4 Run the installation script elxnic install 5 Reboot the system reboot Binding a Driver to a Device id Instance Because the out of box NIC driver elxnic and the inbox NIC driver oce support the same set of device ids only one driver can be attached to a device id instance By default the oce driver claims all of the device ids Therefore when installing the elxnic driver on top of the oce driver the elxnic driver installation fails To reestablish the device id to driver bindings 1 Unbind the oce driver using the emlxdrv utility For more information on the emlxdrv utility see the latest Emulex Solaris FCA Utilities User Manual which is available on t
36. 09693 01B Rev A is 4 FC FCoE Driver Configuration 22 DG EMULEX Configuring Dynamic Target Mode FC COMSTAR Ports Only Table 4 1 FC FCoE Configuration File Parameters Continued Parameter Description Activation vport restrict Sets the virtual port s behavior when discovering targets in the SAN Link reset login e 1 Prevents the VPort from logging into other initiator ports on the SAN Also rejects logins from other ports in the SAN because it assumes that all ports that send a PLOGI are initiators This is the default value e 0 The driver attempts to login to every port that it can access in the SAN and accept logins from all ports Note In a SAN that has other initiators this parameter greatly reduces the driver s use of hardware resources Configuring Dynamic Target Mode FC COMSTAR Ports Only Dynamic target mode enables you to instantly switch between initiator and target mode without a system reboot or a port reset Note Dynamic target mode is only supported on LightPulse FC HBA COMSTAR ports Before a target mode port can be enabled on a particular system you must configure the system To configure the system to support dynamic target mode 1 Install the COMSTAR support software Type pkg install storage server 2 Start the svc system stmf default service svcadm enable stmf 3 Create at least one LUN to be used by the COMSTAR device Perform the following three steps for each LUN
37. 0999 cece eee ee ece cece eeneeeees 53 FCP Traffic Events Message IDs 1000 1099 c cece cece cee e ence eeeeeeeeeeeees 55 FCP Target Mode Events Message IDs 1100 1199 ccc cee cece sence eee eeeeeeeeeees 56 IP Traffic Events Message IDs 1200 1299 00 cccccecscccsssecesscssscscsscsnacesceasaes 57 Solaris SFS Events Message IDs 1300 1399 cccccccscscssececvssecsecscccssecesseaees 58 IOCTL Events Message IDS 1400 1499 cece cece eeceeece cece eee eeeeeeeeeeeeeeeees 60 Firmware Download Events Message IDs 1500 1599 eee cce cece e eee eeeeeeeeees 61 Common Transport Events Message IDs 1600 1699 eee cccce eee eee eeeeeee 63 FCSP Events Message IDs 1700 1799 cccccc cece eee eeeeece cece eee eeeeeeeeeeeeeeeees 64 FCF Events Message IDs 1800 1899 0 cece cece cece ee eee cece eee eeeeeeeeeeeeeeeees 66 8 NIC Driver Log Messages essssesecececsocececceceseceesececocsecececoecececeesecesoe 68 Setting MOD_MASK and SEVERITY eessessesessesosoosssesssssessoosossesssssessossossessse 68 Log Messages for the NIC Driver cssssccccsccccccsscscccccscccccsssssccsccssesessssssees 69 For Solaris 10 cesiccassasnevenvavedetuauuidiuiudacetsauceuaveusaanedensavebiiditiadacadiewencsaes 69 For Solaris Tl orreri a E E TERE E EEE E REEE 71 Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX List of Tables Table 4 1
38. 1 DEBUG Abnormal IP completion catus VERBOSE MASK LOG IP 0x00001000 ESCRIPTION This indicates that an IP sequence completed with a error in the IOCB It could mean the Fibre Channel device on D S the network is not responding S M EVERITY LEVEL Debug ESSAGE Abnormal IP completion ACTION ts report this error to your system administrator persis No action needed informational However if the problem 1220 DEBUG Unsolicited IP dropped VERBOSE MASK LOG IP 0x00001000 ESCRI PTION This indicates that an unsolicited IP sequence was eceived but was dropped for some reason D SEVERITY LEVEL Debug M ESSAG ACTION E Unsolicited IP dropped No action needed informational 1221 DEBUG IP recvd VERBOS E MASK LOG IP 0x00001000 ESCRI eceived PTION This indicates that an unsolicited IP sequence was ESSAG D ic SEVERITY LEVEL Debug M E IP recvd ACTION Emulex Drivers for Solaris U No action needed informational ser Manual P009693 01B Rev A gt G EMULEX 7 FC FCoE Driver Console and Log Messages 58 Log Messages for the FC FCoE Driver 1230 ERROR Invalid IP sequence found VE ESCRI RBOSE MASK LOG IP 0x00001000 PTION This indicates that an IP sequence was found with an nvalid code W
39. 8 Emulex Drivers for Solaris User Manual P009693 01B Rev A 35 gt G EMULEX 7 FC FCoE Driver Console and Log Messages 36 Log Message Overview Table 7 2 Log Message Types for the FC FCoE Driver Continued Verbose Bit Log Message Verbose Mask Verbose Description Pages 0x40000000 LOG_MBOX_DETAIL Detailed Mailbox events 48 0x80000000 LOG_SLI_DETAIL Detailed HBA SLI events 47 OXFFFFFFFF LOG_ALL_MSG All logging on all events Log Message Severity Levels Table 7 3 lists the severity type of the FC FCoE driver log message in the order of severity Table 7 3 Severity Levels of FC FCoE Driver Log Messages Severity Level Description DEBUG Informational Message provides engineering debugging information NOTICE Informational Message provides general purpose information WARNING Message provides a general purpose warning ERROR Message indicates that a driver error has occurred PANIC Severe Message indicates that the driver has forced a system panic to occur Log Message Example The following is an example of a log message on the system console 5 0336 elxfcO NOTICE 720 Link up 8Gb fabric The following is an example of the same message in the system message log var adm messages file Jan 19 14 45 36 sunv240 elxfc ID 349649 kern info 5 0336 elxfc0 NOTICE 720 Link up 8Gb fabric In the above system log message Jan 19 14 45 36 the date
40. ASK LOG ELS 0x00000100 D unsolicited ELS command SEVERITY LEVEL Debug MESSAGE ELS reply ACTION No action needed informational 0830 ERROR Invalid ELS command found VERBOSE MASK LOG ELS 0x00000100 D invalid command code SEVERITY LEVEL Error M ESSAGE Invalid ELS command found ACTION No action needed informational 7 FC FCoE Driver Console and Log Messages 53 Log Messages for the FC FCoE Driver ESCRIPTION This indicates that a reply is being sent for an ESCRIPTION This indicates that an ELS command was found with an However if the problem persists report this error to your customer service representative General I O Packet Events Message IDs 0900 0999 0900 NOTICE Packet abort VERBOSE MASK LOG PKT 0x00000200 SEVERITY LEVEL Notice MESSAGE Packet abort ACTION No action needed informational 0901 WARNING Packet abort failed VERBOSE MASK LOG PKT 0x00000200 EVERITY LEVEL Warning ESSAGE Packet abort failed ACTION No action needed informational D has failed S M DESCRIPTION This indicates that an I O packet is being aborted ESCRIPTION This indicates that an attempt to abort an I O packet However if the problem persists report this error to your customer service repre
41. C FCoE Out of Box Driver elxfc essssssessesecsssesosssecoosesccoseseoeseesoseseeoso 9 NIC Out of Box Driver elxnic sssssesssesseesesscsssesosssscecsesccosessosssescseseeono 9 Uninstalling the Drivers for Solaris 10 sssssessssesssssecesssecccescessecesosssesoeseee 10 FC FCOE DiVeMicns cccaeceesccaciactetecduveeturocreut RER EGEE REE EEE AREER EEA RE 10 NIC DIVER seccercrisecicier eisereen n E E DEE E EEE E EE TEE lade E 10 Installing the Drivers for Solaris 11 essssssssssescssseccsosecessecssosssecosssecsseeeoe 11 FC FCoE Out of Box Driver elxfc sssssssssssssesesssesssssesssseseesseressesesesseee 11 Option 1 Remote Repository Installation sssssssssssesesesssessesssesseessessesssessess 11 Option 2 P5P Archive Installation sssssissrisidersscsserssrscsscriendserisinsiscirestevnssiieess 11 NIC Out of Box Driver elxnic ssesssessssssssssesesssessssseesssesesssseessssesseseee 12 Option 1 Remote Repository Installation sssssssssssseseseessessesesesseessessesssessess 12 Option 2 P5P Archive Installation sissssissnisiisriscssisisrdoisirinsioerssinaidieiaenisii as 13 Uninstalling the Drivers for Solaris 11 cccsccccssscccccccccccccssscccccccsssccesssscees 13 FC IR COE DIVET sii sane ireren oera Er AE ETE ie cae tautebe wei edeen E 13 Scripted REMOVAL sce ievciccsisesweecavdewinesae sedan Kiaan ENE EEEE EEEE NEKAS 13 Manual REMOVAal ss ccecc tesccswerecsettecebessden
42. Ce11102 Advanced xAPIC Default 2 Solaris and APIC in platform OCe11102 Advanced xAPIC 8 8 firmware and driver OCe11102 Advanced x2APIC Default 8 firmware and driver Changing Interrupt Priorities The Solaris operating system divides the available interrupts among multiple priority levels each priority level has a maximum of 31 vectors By default each function has a maximum of two MSI X vectors For example with three OCe11102 adapters in FLEX10 mode there are 24 functions and the driver needs at least two vectors per function for a total of 48 vectors If the MSI X allocation fails the driver reverts to the INTx allocation which results in suboptimal performance Normally the network drivers allocate vectors at level 6 but the requirement of 48 vectors is beyond the limit of 31 which causes issues A solution is to assign level 6 to 12 functions and level 5 to the remaining functions so that all functions can get two MSI X vectors for optimum performance It is not uncommon to assign level 5 or 6 on Solaris under these conditions The following example shows how the interrupt priority for a PCI function can be configured to a level 5 1 Type grep elxnic etc path to inst oci 0 0 pci8086 340d 6 pcilddf e743 0 0 elxnic pci 0 0 pci8086 340d 6 pcil0df e743 0 1 1 elxnic oci 0 0 pci8086 3410 9 pcilddf e742 0 2 elxnic pci 0 0 pci8086 3410 9 pcil0df e742 0 1 3 elxnic Emulex Drivers f
43. Driver attach failed Emulex Drivers for Solaris User Manual P009693 01B Rev A is 7 FC FCoE Driver Console and Log Messages 39 gt lt EMULEX Log Messages for the FC FCoE Driver ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative 0102 DEBUG Driver attach VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver is performing a attach D operation SEVERITY LEVEL Debug MESSAGE Driver attach ACTION No action needed informational 0110 NOTICE Driver detach VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver is performing a detach D operation SEVERITY LEVEL Notice MESSAGE Driver detach ACTION No action needed informational 0111 ERROR Driver detach failed VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver was unable to detach due D to some issue SEVERITY LEVEL Error MESSAGE Driver detach failed ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative 0112 DEBUG Driver detach VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver is performing a detach peration
44. ERBOSE MASK LOG CT 0x00010000 DESCRIPTION This indicates that a CT command completion was received without issuing a corresponding CT command This error could indicate a driver or firmware problem S M EVERITY LEVEL Error ESSAGE Stray CT completion ACTION No action needed informational However if the problem persists report this error to your customer service representative 1611 DEBUG Abnormal CT completion VERBOSE MASK LOG CT 0x00010000 ESCRIPTION This indicates that a CT command completed with a tatus error in the IOCB It could mean the Fibre Channel device on he network is not responding The driver will automatically retry his CT command if needed D S t ja SEVERITY LEVEL Debug M A 5 ESSAGE Abnormal CT completion CTION Check physical connections to Fibre Channel network and the tate the remote PortID is in Emulex Drivers for Solaris User Manual P009693 01B Rev A is 7 FC FCoE Driver Console and Log Messages 64 gt lt EMULEX Log Messages for the FC FCoE Driver 1620 DEBUG CT rcvd VERBOSE MASK LOG CT 0x00010000 ESCRIPTION This indicates that an unsolicited CT command was D r SEVERITY LEVEL Debug MESSAGE CT rcvd ACTION No action needed informational 1621 DEBUG Unsolicited CT dropped VERBOSE MASK LOG CT 0x00010000 ESCRI
45. ERTIY LEVEL Error G D i SEF M iISSAGE Invalid IP sequence found ACTION persis No action needed informational However if the problem ts report this error to your customer service representative Solaris SFS Events Message IDs 1300 1399 1300 DEBUG SFS VE RBOSE MASK LOG SFS 0x00002000 ESCRI PTION This provides general information about the driver s terface D S SEVERITY LEVEL Debug MESSAGE SFS ACTION No action needed informational 1301 DEBUG SFS detail VERBOS E MASK LOG SFS_DETAIL 0x20000000 PTION This provides detailed information about the driver s terface ERITY LEVEL Debug ESSAGE SFS detail ACTION No action needed informational 1310 WARNING Diagnostic error VERBOS E MASK LOG SFS 0x00002000 ESCRI PTION This indicates that a diagnostic request did not te because of some issue TY LEVEL Warning E Diagnostic error ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 1311 DEBUG ECHO diagnostic completed VERBOS E MASK LOG SFS 0x00002000 DESCRI S EVERI PTION This indicates that an ECHO diagnostic has completed TY LEVEL Debug M ESSAG E ECHO diagno
46. EVEL Debug ERBOSE MASK ESCRI EVERI ESSAGE FCF state ACTION No action needed informational Emulex Drivers for Solaris User Manual P009693 01B Rev A is 7 FC FCoE Driver Console and Log Messages 67 gt lt EMULEX Log Messages for the FC FCoE Driver 1830 DEBUG FCF event VERBOSE MASK DESCRIPTION This indicates that an FCF event has occurred SEVERITY LEVEL Debug MESSAGE FCF event ACTION No action needed informational Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX 8 NIC Driver Log Messages Setting MOD_MASK and SEVERITY 8 NIC Driver Log Messages This section describes the log messages you may see from the NIC driver Note To reset the adapter reboot the system or on DR capable SPARC machines use the Solaris cfgadm command for configuring system devices Setting MOD_MASK and SEVERITY Log messages are generated based on the settings of the Module Mask MOD_MASK and the Severity Level SEVERITY as indicated in the log_level parameter See the log_level parameter in Table 5 1 NIC Configuration File Parameters on page 24 Table 8 1 details the values and meanings of MOD_MASK in the log_level parameter Table 8 1 MOD_MASK Information for NIC Driver Log Messages Name MOD_MASK Meaning MOD_CONFIG 0x10000 Messages in the device configuration path are logged MOD_TX 0x20000 Messages in the transm
47. FCTL FW Gb s HBA HW INTx IOCB IRM LACP Ipfc MSI X MTU NIC NPIV PCI PF SFS SLI UCNA UMC VF vNIC Vport Emulex Drivers for Solaris User Manual P009693 01B Rev A 1 Introduction Abbreviations discover address advanced programmable interrupt controller command line interface converged network adapter Diffie Hellman Challenge Handshake Authentication Protocol dynamic reconfiguration Fibre Channel Fibre Channel adapter FC input output Fibre Channel over IP Fibre Channel over Ethernet FC transport library firmware gigabit per second host bus adapter hardware PCle legacy interrupts where x is variable Input Output Control Block interrupt resource management Link Aggregation Control Protocol LightPulse Fibre Channel message signaled interrupts extended maximum transmission unit network interface card N_Port ID Virtualization Peripheral Component Interconnect PCle physical function SAN Foundation Software service level interface universal converged network adapter universal multichannel PCle virtual function virtual NIC virtual port 8 gt lt EMULEX 2 Installing and Uninstalling Q Installing the Drivers for Solaris 10 2 Installing and Uninstalling Installing the Drivers for Solaris 10 FC FCoE Out of Box Driver elxfc To install the FC FCoE out of box driver 1 Log in as root 2 Download the platform specific FC FCoE out of box driver from the Emulex
48. ION This provides detailed information about the driver s CSP interface D F SEVERITY LEVEL Debug MESSAGE FCSP detail ACTION No action needed informational 1702 DEBUG FCSP error VERBOSE MASK LOG FCSP 0x00020000 ESCRIPTION This indicates that an error was found while processing D a DFC request SEVERITY LEVEL Debug MESSAGE FCSP error ACTION No action needed informational 1705 DEBUG FCSP state VERBOSE MASK LOG FCSP 0x00020000 ESCRIPTION This indicates that an authentication state is D changing SEVERITY LEVEL Debug MESSAGE FCSP state ACTION No action needed informational 1706 DEBUG FCSP event VERBOSE MASK LOG FCSP 0x00020000 DESCRIPTION This indicates that an authentication event has occurred SEVERITY LEVEL Debug MESSAGE FCSP event ACTION No action needed informational 1707 DEBUG FCSP status VERBOSE MASK LOG FCSP 0x00020000 ESCRIPTION This indicates that an authentication status is being D u SEVERITY LEVEL Debug MESSAGE FCSP status ACTION No action needed informational 1710 DEBUG FCSP start VERBOSE MASK LOG FCSP 0x00020000 DESCRIPTION This indicates that authentication is being started to a specific node SEVERITY LEVEL Debug
49. PTION This indicates that an unsolicited CT command was eceived and then dropped for some reason D a SEVERITY LEVEL Debug MESSAGE Unsolicited CT dropped ACTION No action needed informational 1622 DEBUG CT reply VERBOSE MASK LOG CT 0x00010000 ESCRIPTION This indicates that a reply is being sent for an nsolicited CT command D u SEVERITY LEVEL Debug MESSAGE CT reply ACTION No action needed informational 1630 ERROR Invalid CT command found VERBOSE MASK LOG CT 0x00010000 DESCRIPTION This indicates that a CT command was found with an invalid command code SEVERITY LEVEL Error MESSAGE Invalid CT command found ACTION No action needed informational However if the problem persists report this error to your customer service representative FCSP Events Message IDs 1700 1799 1700 DEBUG FCSP VERBOSE MASK LOG FCSP 0x00020000 DESCRIPTION This provides general information about the driver s FCSP interface SEVERITY LEVEL Debug MESSAGE FCSP ACTION No action needed informational Emulex Drivers for Solaris User Manual P009693 01B Rev A is 7 FC FCoE Driver Console and Log Messages 65 gt lt EMULEX Log Messages for the FC FCoE Driver 1701 DEBUG FCSP detail VERBOSE MASK LOG FCSP DETAIL 0x01000000 ESCRIPT
50. SAGE Memory pool alloc failed ACTION If the problem occurs frequently you may be able to configure more resources for that pool If this does not solve the problem report these errors to customer service 0312 DEBUG Memory pool detail VERBOSE MASK LOG MEM 0x00000008 DESCRIPTION This provides detailed information about memory bufferpool management S EVERITY LEVEL Debug 7 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver DESCRIPTION This indicates that the driver allocated system memory ESCRIPTION This indicates that the driver was unable to allocate ESCRIPTION This indicates that a problem has occurred with the ESCRIPTION This indicates that the driver was unable to allocate P009693 01B Rev A 42 gt lt EMULEX 7 FC FCoE Driver Console and Log Messages M Log Messages for the FC FCoE Driver ESSAGE Memory pool detail ACTION No action needed informational 0320 NOTICE No unsolicited buffer available V GI DI pool is exhausted The I O will be dropped and most likely retried by the remote devic S M ERBOSE MASK LOG MEM 0x00000008 ESCRIPTION This indicates that the driver s unsolicited buffer EVERITY LEVEL Notice ESSAGE No unsolicited buffer available ACTION If the problem occurs frequently you may be able to configure more resources for t
51. VEL Debug ESSAG E FCT error CTION ersis No action needed informational However if the problem ts report this error to your customer service representative 1130 DEBUG FCT API V D i S M ERBOS ESCRI nterface EVERITY LEVEL Debug E MASK PTION This provides an API trace with the driver s FCT ESSAG Es FCT API ACTION No action needed informational Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX 7 FC FCoE Driver Console and Log Messages 57 Log Messages for the FC FCoE Driver IP Traffic Events Message IDs 1200 1299 1200 DEBUG IP detail VERBOSE _MASK LOG IP DETAIL 0x08000000 ESCRIPTION This provides detailed information about the driver s P interface D I SEVERITY LEVEL Debug M ESSAGE IP detail ACTION No action needed informational 1210 ERROR Stray IP completion VERBOSE _MASK LOG IP 0x00001000 ESCRIPTION This indicates that an IP sequence completion was eceived without issuing a corresponding IP sequence This error EVERITY LEVEL Error ESSAGE D r could indicate a driver or firmware problem S M Stray IP completion ACTION No action needed informational However if the problem persists report this error to your customer service representative 121
52. adapter without issuing acquit MOD_CONFIG CE_WARN MQ ring alloc failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN MQ create failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Invalidqlength Must be 256 2000 Set the correct queue length using dladm MOD_CONFIG CE_WARN WQ Buffer Pool create failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN W MAP Handles Pool create failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN WQ Packet Desc Pool create failed Emulex Drivers for Solaris User Manual Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG P009693 01B Rev A CE_WARN gt G EMULEX Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Failed to create WQ rin
53. and time when the error or event occurred sunv240 the name of the host machine elxfc the module where the message originates In this case elxfc means that it is from Emulex SFS FCA out of box driver ID 349649 kern info a Solaris specific message ID and kernel message level This changes from one driver message to another 5 0336 the driver message context tag This may change from one driver version to another elxfc0 the module instance where the message originates In this case elxfcO means that it is from Emulex SFS FCA out of box driver instance of 0 This changes from one driver instance to another Emulex Drivers for Solaris User Manual P009693 01B Rev A 7 FC FCoE Driver Console and Log Messages 37 gt G EMULEX Log Messages for the FC FCoE Driver NOTICE identifies the driver message severity level This may change from one driver version to another For other severity information see Table 7 3 Severity Levels of FC FCoE Driver Log Messages on page 36 720 identifies the driver message identification number This number does change from one driver version to another T Link up identifies the actual error or event message This message does not change from one driver version to another 8 Gb s fabric identifies additional information specific to the error or event message This information is normally intended for technical support This may change from one driver
54. ault e 2 point to point only e 4 loop only e 6 point to point then loop ub bufs Sets the number of unsolicited buffers the driver should allocate Reboot Possible values are 40 16320 The default value is 1000 vport Note This property is applicable to Solaris 10 only Link reset Virtual port registration table The enable npiv must be set to 1 The virtual port registration table may have any number of comma delimited entries Each entry must be of the form PHYS WWPN VPORT WWNN VPORT_WWPN VPORT ID Where e PHYS_WWPN World Wide Port Name of adapter s physical port e VPORT_WWNN Desired World Wide Node Name of virtual port e VPORT_WWPN Desired World Wide Port Name of virtual port e VPORT_ID Desired virtual port ID 1 to maximum vports For entries with the same PHYS_WWPN VPORT_WWNN and VPORT_WWPN the VPORT_ID must start at 1 and increment by one sequentially without gaps in the number sequence The VPORT_ID 0 is reserved for the physical port For example vport 10000000c9123456 10000000c9123456 10000000c9123457 10000000c9123457 10000000c9123457 Emulex Drivers for Solaris User Manual 28010000c9123456 28020000C9123456 28010000c9123457 28020000c9123457 28030000c9123457 20010000c9123456 20020000c9123456 20010000c9123457 20020000c9123457 20030000c9123457 All entries are automatically created or removed by the OneCommand Manager application ai D J hee coy P0
55. c has completed SEVERITY LEVEL Debug MESSAGE POST diagnostic completed ACTION No action needed informational 1316 ERROR POST diagnostic failed VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This indicates that a POST diagnostic has failed to return a positive result This is usually caused by an adapter hardware problem S M EVERITY LEVEL Error ESSAGE POST diagnostic failed ACTION Contact your customer service representative Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX 7 FC FCoE Driver Console and Log Messages 60 Log Messages for the FC FCoE Driver IOCTL Events Message IDs 1400 1499 1400 DEBUG IOCTL V ERBOS ESCRI OCTL E MASK LOG IOCTL 0x00004000 PTION This provides general information about the driver s interface D I SEVERITY LEVEL Debug M ESSAG BE IOCTL ACTION No action needed informational 1401 DEBUG IOCTL detail V D I S M ERBOS E MASK LOG IOCTL DETAIL 0x04000000 ESCRI OCTL PTION This provides detailed information about the driver s interface EVERITY LEVEL Debug ESSAG Es IOCTL detail ACTION No action needed informational 1410 DEBUG DFC ERBOSE MASK LOG IOCTL 0x00004000 ESCRIPTION This provi
56. ce The NIC interface must be created before you can configure it You can verify that the driver is loaded on the system and the NIC interface is created with one of the following commands dladm show dev Solaris 10 driver dladm show phys Solaris 11 driver Emulex Drivers for Solaris User Manual P009693 01B Rev A is 5 NIC Driver Configuration 26 gt lt EMULEX Using the NIC Configuration File elxnic conf Once you have determined that the NIC interface has been created you can proceed to configure it To configure the NIC interface s 1 Plumb the interface ifconfig elxnic lt X gt plumb Solaris 10 driver ifconfig net lt X gt plumb Solaris 11 driver Where lt X gt is the interface number To see the interfaces created run dladm show link This command lists all the interfaces in the system 2 Assign a static IP address ifconfig elxnic lt X gt lt IP_Address gt netmask lt NetMask gt up Solaris 10 driver ifconfig net lt x gt lt IP_ Address gt netmask lt NetMask gt up Solaris 11 driver 3 Edit the etc hosts file a symlink to etc inet hosts and add the IP address and hostname that you wish to assign to the given NIC interface See the hosts 4 man page for more information 4 Edit the etc inet ipnodes file and add an entry for the IP address and hostname for the given interface The etc inet ipnodes file is primarily for IPv6 only but this step is necessary
57. config 1M sysconfig 1M utility must be executed from a console On reboot you are presented with a set of user interface based data entry forms that facilitate the required change in configuration Multi ring Mode and the Effect of ddi_msix_alloc_limit Solaris 10 The elxnic driver is enabled to work in the multi ring mode by default To check the number of active transmit and receive tx rx rings type the following ndd get dev elxnic lt xX gt rx rings ndd get dev elxnic lt X gt tx rings The variable lt X gt is the interface number of the elxnic driver The following table shows how the value of ddi_msix_alloc_limit affects receive traffic distribution across CPU cores for Solaris 10 Table 5 2 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 10 Value of CPU Cores ddi_msix_alloc_limit Participating in NIC Mode APIC in etc system RX Processing Limiting Factor 0Ce10102 N A xAPIC Default 2 Solaris and APIC in platform 0Ce10102 N A xAPIC 4 4 0Ce10102 0Ce10102 N A x2APIC Default 4 OCe10102 OCe11102 Legacy xAPIC Default 2 Solaris and APIC in platform OCe11102 Legacy xAPIC 4 4 firmware and driver OCe11102 Legacy x2APIC Default 4 firmware and driver OCe11102 Advanced xAPIC Default 2 Solaris and APIC in platform OCe11102 Advanced xAPIC 8 8 firmware and driver OCe11102 Advanced x2APIC Default 8 firmware and driver a APIC advanced programmable
58. curred SEVERITY LEVEL MESSAGE Debug Firmware dump ACTION Check your hardware configuration If the problem persists report this error to your customer servic 1540 WARNING Firmware update required 0x00008000 VERBOSE MASK LOG FIRMWARE Emulex Drivers for Solaris User Manual representative P009693 01B Rev A is 7 FC FCoE Driver Console and Log Messages 63 gt lt EMULEX Log Messages for the FC FCoE Driver ESCRIPTION This indicates that a firmware update is required on he adapter D SEVERITY LEVEL Warning M ESSAGE Firmware update required ACTION The user must perform a manual adapter reset or link reset once the host environment is stable to trigger an automatic firmware download Do not power cycle or reboot the system during the download operation Common Transport Events Message IDs 1600 1699 1600 DEBUG CT sent VERBOSE MASK LOG CT 0x00010000 DESCRIPTION This indicates that a CT command is being sent SEVERITY LEVEL Debug MESSAGE CT sent ACTION No action needed informational 1601 DEBUG CT comp VERBOSE MASK LOG CT 0x00010000 DESCRIPTION This indicates that a CT command completed normally SEVERITY LEVEL Debug MESSAGE CT comp ACTION No action needed informational 1610 ERROR Stray CT completion V
59. ddress MOD_CONFIG CE_WARN Failed to delete MAC lt mac_add gt Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN oce instance setup max adapters exceeded The driver supports a maximum of 16 adapters MOD_CONFIG CE_WARN oce rx no frags The system cannot receive data because the driver is low on resources Reload the driver If the same error recurs reset the adapter MOD_RX CE_WARN kstat creation failed Reload the driver MOD_CONFIG CE_WARN Could not allocate stats _dbuf Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN wqb pool empty The system cannot transmit data because the driver is low on resources Check for a process generating heavy traffic MOD_TX CE_WARN wqm pool empty Emulex Drivers for Solaris User Manual The system cannot transmit data because the driver is low on resources Check for a process generating heavy traffic MOD_TX P009693 01B Rev A CE_WARN 77 is 8 NIC Driver Log Messages 78 gt G EMULEX Log Messages for the NIC Driver Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued
60. des general information about the driver s FC interface EVERITY LEVEL Debug ESSAGE DFC ACTION No action needed informational 1411 DEBUG DFC detail E MASK LOG IOCTL DETAIL 0x04000000 PTION This provides detailed information about the driver s ERBOS ESCRI FC interface EVERITY LEVEL Debug ESSAG E DFC detail ACTION No action needed informational 1420 DEBUG DFC Error V D a S M E MASK LOG IOCTL 0x00004000 PTION This indicates that an error was found while processing ERBOS ESCRI DFC request EVERITY LEVEL Debug ESSAGE DFC Error ACTION No action needed informational Emulex Drivers for Solaris User Manual P009693 01B Rev A 7 FC FCoE Driver Console and Log Messages gt G EMULEX Log Messages for the FC FCoE Driver Firmware Download Events Message IDs 1500 1599 1500 DEBUG Firmware image VERBOSE MASK LOG FIRMWARE 0x00008000 DESCRIPTION This provides general information about the firmware image EVERITY LEVEL Debug S MESSAGE Firmware image ACTION No action needed informational 1501 DEBUG Firmware detail VERBOSE MASK LOG FIRMWARE DETAIL 0x10000000 ESCRIPTION This provides detailed information about the firmware D i SEVERITY LEVEL Debug MESSAGE Firmware detail
61. dge SAN Foundation Software SFS which is part of the SFS Leadville stack The module name for this FC FCoE driver is elxfc This document also provides information for using the Emulex network interface card NIC out of box driver for Solaris which operates the NIC function of the Emulex OneConnect universal converged network adapter UCNA The module name for this NIC driver is elxnic Prerequisites Supported Operating Systems One of the following operating systems must be installed e Solaris 10 SPARC e Solaris 10 x64 e Solaris 11 SPARC e Solaris 11 x64 e Solaris 11 1 SPARC e Solaris 11 1 x64 Notes e For the FC FCoE elxfc driver Solaris 11 1 is required For Solaris 11 use the earlier version of elxfc posted on the Emulex website e For the NIC elxnic driver Solaris 10 Solaris 11 and S11 1 are supported See the Emulex website for the latest supported operating systems Adapter Firmware and Stack Compatibility For adapters that are compatible with the Emulex FC FCoE and NIC drivers see the driver s Downloads page on the Emulex website For compatible firmware versions see the Downloads page for the specific adapter The NIC driver supports the Solaris Ethernet stack including NIC virtualization Crossbow vSwitch and vRouter Emulex Drivers for Solaris User Manual P009693 01B Rev A gt EMULEX Abbreviations ADISC APIC CLI CNA DHCHAP DR FC FCA FCIO FC IP FCoE
62. f an elxfc IPS package is installed and then removed using the older SVR4 method inconsistences may develop that could affect re installing or upgrading the driver IPS packages should be installed only after removing older SVR4 packages Emulex Drivers for Solaris User Manual P009693 01B Rev A 7 7 FC FCoE Driver Console and Log Messages gt lt EMULEX General Situations 7 FC FCoE Driver Console and Log Messages This section describes the situations console messages and log messages you may see from the FC FCoE driver General Situations FC Link Fails to Come Up on 8 Gb s or 16 Gb s Adapter An FC link may fail to come up if the adapter attempts to connect to a device running at a speed that the adapter does not support e For an 8 Gb s adapter or a 16 Gb s adapter using 8 Gb s optics verify it is not attempting to connect to a 1 Gb s device Only 2 Gb s 4 Gb s and 8 Gb s devices are supported on these adapters e Fora16 Gb s adapter using 16 Gb s optics verify it is not attempting to connect to a 1 Gb s device or 2 Gb s device Only 4 Gb s 8 Gb s and 16 Gb s devices are supported on this adapter Setting Notices Warning and Error Logging Levels Table 7 1 lists the types of notices warnings and error logging levels you may set using the appropriate FC FCoE driver parameters Table 7 1 Setting Types of Console and Log Messages for the FC FCoE Driver elxfc Parameter Description Ipfc Parameter console
63. failed lt code gt Hardware error Download the MOD_CONFIG_ CE_WARN same firmware image to the adapter and reboot and or replace the adapter OCE INITIATE DUMP failed Diagnostic Dump initiation by an MOD_CONFIG CE_WARN application failed Retry the Dump initiation Emulex Drivers for Solaris User Manual P009693 01B Rev A 70 is 8 NIC Driver Log Messages 71 gt G EMULEX Log Messages for the NIC Driver Table 8 3 Log Messages for the NIC Driver for Solaris 10 Continued Log Message Recommended Action MOD_MASK SEVERITY OCE INITIATE DUMP failed due Device Recovery failed after MOD_CONFIG_ CE_WARN to recovery timeout Diagnostic Dump initiation Reboot the system OCE INITIATE DUMP Dump Image Diagnostic Dump image is not MOD_CONFIG CE_WARN not present present Retry the Dump initiation Could not reset firmware ERR Firmware reset failed Reset the MOD_CONFIG CE_WARN bit set pd_ctrl lt reg gt system Error recovery timed out Hardware Driver is not able to MOD_CONFIG_ CE_WARN recover from a serious hardware error Reset the system Error recovery failed device Hardware Driver is not able to MOD_CONFIG_ CE_WARN is in error state recover from a serious hardware error Reset the system For Solaris 11 The following table details the log messages provided by the NIC driver for Solaris 11 operating systems Table 8 4 Log Messages for the NIC Driver
64. g Recommended Action Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_MASK MOD_CONFIG Severity CE_WARN WCCQ create failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN WQ create failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN RQ bdesc alloc failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN RQ shadow ring alloc failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN RQ ring create failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN RQ create failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acq
65. hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit EQ ring alloc failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system Emulex Drivers for Solaris User Manual P009693 01B Rev A 8 NIC Driver Log Messages Log Messages for the NIC Driver S EMULEX 75 Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued Log Message EQ create failed Recommended Action Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_MASK MOD_CONFIG Severity CE_WARN CQ allocation failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN CQ ring alloc failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN CQ create failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the
66. hat pool If this does not solve the problem report these errors to customer service 0330 ERROR Invalid access handle V D h S M A C ERBOSE MASK LOG MEM 0x00000008 ESCRIPTION This indicates that the driver had an invalid access andle assigned by the system EVERITY LEVEL Error ESSAGE Invalid access handle CTION If the problem occurs frequently report these errors to ustomer service 0331 ERROR Invalid DMA handle V D h S M A C ERBOSE MASK LOG MEM 0x00000008 ESCRIPTION This indicates that the driver had an invalid dma andle assigned by the system EVERITY LEVEL Error ESSAGE Invalid DMA handle CTION If the problem occurs frequently report these errors to ustomer service Service Level Interface Events Message IDs 0400 0499 0400 DEBUG Vital Product Data ERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This provides vendor specific information about the EVERITY LEVEL Debug ESSAGE Vital Product Data ACTION No action needed informational 0410 DEBUG Link atten V ERBOSE MASK LOG SLI 0x00000010 Emulex Drivers for Solaris User Manual P009693 01B Rev A 43 is 7 FC FCoE Driver Console and Log Messages 44 gt lt EMULEX Log Messages for the FC FCoE Driver ESCRIPTION This indicates that the adapter
67. he Emulex website 2 Retry the elxnic installation This will ensure a successful package installation and will automatically bind the NIC driver Uninstalling the Drivers for Solaris 11 FC FCoE Driver You can uninstall the FC FCoE out of box driver by using scripted removal or manual removal Scripted Removal 1 Log in as root 2 Run the following command to remove elxfc from the system elxfc_remove 3 Reboot the system Type reboot Emulex Drivers for Solaris User Manual P009693 01B Rev A 2 Installing and Uninstalling 14 gt G EMULEX Uninstalling the Drivers for Solaris 11 The script is included in the downloadable p5p tar file that can be retrieved from the Emulex website Using the scripted uninstall will also clean up the files in the installation directory Manual Removal 1 Log in as root 2 Run the following command to remove elxfc from the system pkg uninstall elxfc 3 Reboot the system reboot NIC Driver To uninstall the NIC out of box driver 1 Log in as root 2 Remove the out of box driver by typing pkg uninstall lt driver name gt For example pkg uninstall elxnic 3 Reboot the system Scripted Removal 1 Log in as root 2 Run the following command to remove elxnic driver by typing elxnic_remove 3 Reboot the system Emulex Drivers for Solaris User Manual P009693 01B Rev A gt lt EMULEX 3 Utilities for Solaris Drivers 15
68. he NIC Interface Using dladm ssesssssossssesesssesssssoesssessssesees 29 Tunable Parameters csacccesccaeees ccvieccedes NEEE EEE EEE EEEE SEEE Y 29 Private or Unlisted Parameters cccce cece cee eceeeeeeeeeeeeeeeeeeeeeeeteeeeteseeeeneaes 30 Creating a Virtual NIC Using dladm ssssssssssssesssssossssesesssessssssesseseesssseees 30 SR IOV Conmsuration 2 scccscsisscecsderccsetslenivudaxtidactocnctdacnidasetansinecsmestenecacdcens 31 INCFOGDUCTION sercssicirecrisiiisieri tited ras t ske cue is eee aaees gadis AETERNE ERK 31 Creating a VF on the elxnic Interface ssssssessssssssssesccccosssssssesossseseseeeoseeese 31 Listing the VF Interface in OCM cecccccenecccencceeseeeeeeeeeeseeeeeseetteasetesaeeesaaes 32 6 Troubleshooting o icticiwsicdnwsnisdnnnwsisndnaudenawaih dnawauhsadaeiunabendannaereuaasaeaancanaleay 33 Situations and their Resolutions cccscccccssccccccsscccccssssccecssscccessssssseessees 33 Solaris 11 elxfc Driver Installation Situation ccc cece sec eeeeeeeeeeeeeeeseseaees 33 7 FC FCoE Driver Console and Log M SSAgeS cssssccccccccscsccccccccecescsssees 34 General Situations ciscs tei deccucctiekctincsciiadeiienetecenenntecteccaiiccamesareccuceentiiiens 34 FC Link Fails to Come Up on 8 Gb s or 16 Gb s Adapter seceeeeeeee eee eeees 34 Setting Notices Warning and Error Logging Levels ssssccccssccccesscsceeeeees 34 Log Message Overview
69. ifconfig a Tunable Parameters Tunable parameters can be changed during runtime On Solaris 10 the ndd command can be used to change the value of tunable parameters On Solaris 11 these values can be changed using the dladm command The parameters on Solaris 11 are named differently They include a prefix of _ to each of the parameter names Through the dladm utility the following tunable parameters are provided by the driver along with their usage log_level gt dladm set linkprop p log level lt value gt lt interface gt Emulex Drivers for Solaris User Manual P009693 01B Rev A 5 NIC Driver Configuration 30 gt G EMULEX Using the dladm Utility for Solaris 11 Note See Setting MOD_MASK and SEVERITY on page 68 for log_level values rx_bcopy_limit gt dladm set linkprop p _rx bcopy limit lt value in bytes gt lt interface gt tx_bcopy_limit gt dladm set linkprop p _tx bcopy limit lt value in bytes gt lt interface gt tx_ring_size gt dladm set linkprop p tx ring size lt values between 256 and 2048 gt lt interface gt Or gt dladm set linkprop p tx ring size lt values less than tx ring size gt lt interface gt Private or Unlisted Parameters Private or unlisted parameters can be set during driver attach through dladm utility and also the elxnic conf file To see the value of private driver parameters using the dladm utility type gt dladm show linkp
70. iguration file You can also set individual paths to target mode elxfcX target mode 1 Where X is the specific numeric path For example when elxfcl target mode 1 then all other paths stay in initiator mode 3 Remove the comment for this line ddi forceattach 1 4 Reboot the system To configure targets see the Oracle COMSTAR Administration document FC FCoE Configuration File Parameters Notes e All parameters are adapter specific e All adapter specific parameters have an elxfcX prefix where X is the driver instance number For example setting elxfc0 link speed 4 makes 4 Gb s the link speed setting for the 0 instance of the elxfc driver e The OneCommand Manager application reflects the configuration file driver parameters For more information see the OneCommand Manager Application User Manual e If you want to override a driver parameter for a single driver loading session you can specify it as a parameter to the modload command The following example is for 64 bit platforms modload kernel drv sparcv9 elxfc automap 0 e The Activation column in Table 4 1 shows the requirement for the parameter change to take effect Activation requirements include adapter reset dynamic reset no reset is necessary link reset and reboot Emulex Drivers for Solaris User Manual P009693 01B Rev A 4 FC FCoE Driver Configuration FC FCoE Configuration File Parameters S EMULEX 19 The following
71. in this manual at any time and without any notice Emulex assumes no responsibility for its use nor for any infringements of patents or other rights of third parties that may result Periodic changes are made to information contained herein although these changes will be incorporated into new editions of this manual Emulex disclaims any undertaking to give notice of such changes Emulex 3333 Susan Street Costa Mesa CA 92626 Note References to OCe11100 series products also apply to OCe11100R series products Emulex Drivers for Solaris User Manual P009693 01B Rev A Table of Contents gt G EMULEX Table of Contents Listof Tables catacswctanncwidaantwndunansvanesiaverdansshacansacandarkwduvindstaasvebtanmadaagnnes 6 1 INCFOPUCEION acts nccessnandaceeuviabauase vectav wiaastacensssaianterancawiayshadaneddenaasdaunwe 7 PREPS QUISICOS siciiccsic a 5 5isiesis cdvouis e s we d sdlusine o d s 40 cigale s elbie culeuSin aisle i rneer r Tane 7 Supported Operating SYSlCIiS xc caves ivacavavesdvedacaxtstaeuseeieadass ici sccciassebinessaxcents 7 Adapter Firmware and Stack Compatibility ccc ccccce ee eee eee eeeeeeeeeeeeees 7 AD DIEVIALIGNIS cccconsidsacncasanuaeipenestincevonseciwensanenssneneanacekuuaseasiacebenscesseenetens 8 2 Installing and Uninstalling ssessessecsecsecsecsecosessecsecsececcosecsecsecseceeceecseo 9 Installing the Drivers for Solaris 10 ssssssescssssosssececsscesosssesosseccssesscssseseso 9 F
72. inding associating the Emulex Solaris FC FCoE and NIC drivers to the various models of Emulex adapters If the driver binding configuration is changed the host system must be rebooted for the new configuration to take effect The out of box drivers elxfc and elxnic and their respective inbox drivers emlxs and oce support the same set of Emulex adapter device ids Because only one driver can be bound to a specific device id the inbox driver initially binds to all device ids by default In order to install an out of box driver on top of an inbox driver you must use the emlxdrv utility to establish the device id to driver bindings For more information see the Solaris FCA Utilities User Manual Emulex Drivers for Solaris User Manual P009693 01B Rev A gt EMULEX 4 FC FCoE Driver Configuration 16 Editing the FC FCoE Configuration File elxfc conf 4 FC FCoE Driver Configuration The module name for the Emulex SFS FCA out of box driver is elxfc You can configure the Emulex SFS FCA driver parameters by e Editing the configuration file elxfc conf which is described in this section e Using the OneCommand Manager application For more information see the OneCommand Manager Application User Manual e Using the Emulex FCA utilities emlxadm and emlxdrv For more information see the Solaris FCA Utilities User Manual Editing the FC FCoE Configuration File elxfc conf The configuration file contains all the para
73. installing the Drivers for Solaris 10 driver on top of the oce driver the elxnic driver installation fails To reestablish the device id to driver bindings 1 Unbind the oce driver using the emlxdrv utility For more information on the emlxdrv utility see the latest Emulex Solaris FCA Utilities User Manual 2 Retry the elxnic installation This will ensure a successful package installation and will automatically bind the NIC driver Uninstalling the Drivers for Solaris 10 FC FCoE Driver To uninstall the FC FCoE out of box driver 1 Log in as root 2 Remove the out of box driver by typing pkgrm lt OOB pkg_name gt For example pkgrm EMLXelxfc 3 Reboot the system NIC Driver To uninstall the NIC out of box driver 1 Log in as root 2 Remove the out of box driver by typing pkgrm lt nic_ pkg name gt For example pkgrm EMLXelxnic 3 Reboot the system Emulex Drivers for Solaris User Manual P009693 01B Rev A is 2 Installing and Uninstalling 1 DG EMULEX Installing the Drivers for Solaris 11 Installing the Drivers for Solaris 11 FC FCoE Out of Box Driver elxfc You can install the FC FCoE out of box driver for S11 1 using one of two options Remote Repository Installation or P5P Archive Installation Option 1 Remote Repository Installation 1 Log in as root 2 Add the Emulex IPS repository to the publisher list For example S pkg set publisher O http l
74. interrupt controller Solaris 11 Solaris 11 is multi ring enabled by default It creates eight transmit rings and eight receive rings on OCe11102 devices in advanced mode To check the number of rx and tx rings use dladm show phys H In Table 5 3 the number 8 in column 5 is applicable only if the number of rx rings is increased to the maximum 16 Note On non IRM systems with multiple adapters the attach for few NIC functions may fail because of lack of interrupt vectors allowed at the default Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX 5 NIC Driver Configuration 28 Using the NIC Configuration File elxnic conf level To solve the problem use Table 5 3 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 11 on page 28 The following table shows how the value of ddi_msix_alloc_limit affects receive traffic distribution across CPU cores for Solaris 11 Table 5 3 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 11 Value of ddi_msix_alloc_limit CPU cores participating in NIC Mode APIC in etc system RX processing Limiting Factor 0Ce10102 N A xAPIC Default 2 Solaris and APIC in platform 0Ce10102 N A xAPIC 4 4 0Ce10102 0Ce10102 N A x2APIC Default 4 OCe10102 OCe11102 Legacy xAPIC Default 2 Solaris and APIC in platform OCe11102 Legacy xAPIC 4 4 firmware and driver OCe11102 Legacy x2APIC Default 4 firmware and driver O
75. ion needed informational 0210 DEBUG Adapter transition V DI S M A ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that the adapter is changing states EVERITY LEVEL Debug ESSAGE Adapter transition CTION No action needed informational 0220 DEBUG Adapter online V D C S M A ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that the adapter is online and ready to ommunicate EVERITY LEVEL Debug ESSAGE Adapter online CTION No action needed informational 0230 DEBUG Adapter offline V D t S M A ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that the adapter is offline and unable o communicate EVERITY LEVEL Debug ESSAGE Adapter offline CTION No action needed informational 0231 WARNING Adapter shutdown V D W S M A ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that the adapter has been shutdown and ill require a reboot to reinitialize EVERITY LEVEL Warning ESSAGE Adapter shutdown CTION Contact your customer service representative 0240 ERROR Adapter reset failed V D f S M ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that an attempt to reset the adapter has ailed EVERITY LEVEL Error ESSAGE Adap
76. it data path are logged MOD_RX 0x40000 Messages in the receive data path are logged MOD_ISR 0x80000 Messages in the interrupt path are logged a MOD_MASK is a bitmap of one or more of these values Table 8 2 details the values and meanings of SEVERITY in the log _level parameter Table 8 2 Severity Level Information for NIC Driver Log Messages Name SEVERITY Value Meaning CE_CONT 0x0 Continuation CE_NOTE 0x1 Information CE_WARN 0x2 Warning CE_PANIC 0x3 Causes the operating system to panic CE_IGNORE 0x4 No action Emulex Drivers for Solaris User Manual P009693 01B Rev A 68 gt G EMULEX Log Messages for the NIC Driver For Solaris 10 8 NIC Driver Log Messages Log Messages for the NIC Driver The following table details the log messages provided by the NIC driver for Solaris 10 operating systems Table 8 3 Log Messages for the NIC Driver for Solaris 10 Log Message Recommended Action MOD_MASK SEVERITY pci config setup failed Reset or replace the adapter MOD_CONFIG_ CE_WARN with rc lt code gt Device Unknown Driver does not have support for a MOD_CONFIG CE_WARN particular adapter Contact Emulex for further information PCI Initialization Failed Reset or replace the adapter or MOD_CONFIG_ CE_WARN move the adapter to different slot HW Initialization Failed Hardware error Download the MOD_CONFIG_ CE_WARN same firmware image t
77. ivers for Solaris User Manual 7 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver MESSAGE IOCB queue full ACTION No action needed informational 0452 DEBUG IOCB event VERBOSE MASK LOG SLI 0x00000010 D reported by the adapter SEVERITY LEVEL Debug MESSAGE IOCB event ACTION No action needed informational 0453 DEBUG IOCB stale VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that an IOCB completed after its ssociated packet completed D a SEVERITY LEVEL Debug MESSAGE IOCB stale ACTION No action needed informational 0460 DEBUG SLI VERBOSE MASK LOG SLI DETAIL 080000000 SEVERITY LEVEL Debug MESSAGE SLI detail ACTION No action needed informational 0461 ERROR SLI ERROR VERBOSE MASK LOG SLI 0x00000010 DESCRIPTION This error provides information about an SLI event SEVERITY LEVEL Error MESSAGE SLI ERROR ACTION No action needed informational 0462 DEBUG SLI DEBUG VERBOSE MASK LOG SLI 0x00000010 DESCRIPTION This provides debug information about an SLI event SEVERITY LEVEL Debug MESSAGE SLI DEBUG ACTION No action needed informational Mailbox Events Message IDs 0500 0599 0500 DEBUG Mailbox event
78. ly of adapters can support up to 100 virtual ports e The Emulex LightPulse LPe12000 family of adapters can support up to 255 virtual ports NPIV and OS Virtualization Solaris has several OS virtualization solutions including Oracle VM for SPARC Oracle VM for x86 and Solaris containers Devices configured to be seen on an Emulex FC or Ethernet port either a physical port or a virtual port can be used with any of these OS virtualization solutions It is recommended that you consult the latest document on these technologies to learn the best use of resources related to NPIV technology Emulex Drivers for Solaris User Manual P009693 01B Rev A is 4 FC FCoE Driver Configuration 18 gt lt EMULEX FC FCoE Configuration File Parameters Using VPorts with Oracle VM Server for SPARC Solaris Containers or Oracle VM Server for 86 To use NPIV with Oracle VM Server for SPARC formerly Logical Domains Solaris containers or Oracle VM Server for x86 formerly xVM user domains 1 Create virtual ports for the domains containers to which you want to present dedicated storage 2 Discover and attach the targets to the virtual ports 3 Assign the target to the domain or container The attachment runs through the virtual port that provides the path to the target Configuring Target Mode Support for Solaris 11 To configure target mode on Solaris 11 1 Login as root or su to root 2 Set target mode to 1 in the conf
79. mer service 0421 NOTICE Adapter temperature VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that the adapter has provided general nformation about the adapter s temperatur D i SEVERITY LEVEL Notice MESSAGE Adapter temperatur Emulex Drivers for Solaris User Manual P009693 01B Rev A 7 FC FCoE Driver Console and Log Messages 45 gt G EMULEX Log Messages for the FC FCoE Driver ACTION No action needed informational 0422 WARNING Adapter temperature VERBOSE MASK LOG SLI 0x00000010 DESCRIPTION This indicates that the adapter s temperature is too hot S M EVERITY LEVEL Warning ESSAGE Adapter temperatur ACTION Check hardware ventilation Reduce adapter usage Shutdown host system 0423 NOTICE Adapter notice VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that the adapter has provided general nformation about the adapter s condition D i SEVERITY LEVEL Notice MESSAGE Adapter notice ACTION No action needed informational 0424 WARNING Adapter warning VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that an interrupt has occurred indicating a recoverable adapter error D i SEVERITY LEVEL Warning M ESSAGE Adapter warning ACTION This error usually indicates a hardware
80. meters necessary to initialize the Emulex SFS FCA out of box driver Changing Driver Parameters The configurable driver parameters are defined in Table 4 1 FC FCoE Configuration File Parameters on page 19 To change driver parameters 1 Open the configuration file in a text editor Change the parameters to the desired settings 2 3 Save the file 4 If the driver is already loaded you must unload and reload the driver to implement your changes For more information see Installing and Uninstalling on page 9 To determine the requirement for the parameter change to take effect see the Activation column in Table 4 1 FC FCoE Configuration File Parameters on page 19 Configuring NPIV Support Enabling NPIV Support on Solaris 10 To enable NPIV support in the driver 1 Log in as root 2 Set enable npiv 1 in the configuration file or su to root 3 The FC port fp driver parameters are updated when the Emulex emlxu utilities package EMLXemlxu is installed Entries from 2 254 can be added to the kernel drv fp conf file For example name fp name fp name fp name fp name fp Emulex Drivers for Solaris User Manual class fibre channel class fibre channel class fibre channel class fibre channel class fibre channel port 0 port 1 port 2 port 3 port 4 P009693 01B Rev A 4 FC FCoE Driver Configuration gt lt EMULEX Editing the FC FCoE Config
81. mulex Drivers for Solaris User Manual ERBOS E MASK LOG LINK 0x00000080 P009693 01B Rev A 50 7 FC FCoE Driver Console and Log Messages 51 DG EMULEX Log Messages for the FC FCoE Driver DESCRIPTION This indicates that the Fibre Channel link is down to the adapter SEVERITY LEVEL Notice MESSAGE Link down ACTION Check your network connections If the problem persists report this error to your system administrator 0720 NOTICE Link up VERBOSE MASK LOG LINK 0x00000080 DESCRIPTION This indicates that the Fibre Channel link is up SEVERITY LEVEL Notice MESSAGE Link up ACTION No action needed informational 0721 NOTICE NPIV Link up VERBOSE MASK LOG LINK 0x00000080 ESCRIPTION This indicates that the Fibre Channel link is up for ll virtual ports D a SEVERITY LEVEL Notice MESSAGE NPIV Link up ACTION No action needed informational 0730 NOTICE Link reset VERBOSE MASK LOG LINK 0x00000080 or LOG SFS 0x00002000 ESCRIPTION This indicates that an issue has forced the Fibre hannel link to be reset D C SEVERITY LEVEL Notice MESSAGE Link reset ACTION No action needed informational 0731 ERROR Link reset failed VERBOSE MASK LOG LINK 0x00000080 or LOG SFS 0x00002000 DESCRIPTION This indicates that an at
82. o the adapter and reboot and or replace the adapter Failed to setup interrupts Reload the driver after changing MOD_CONFIG CE_WARN the interrupt priorities Failed to allocate Queue Increase the memory MOD_CONFIG CE_WARN memory oce rx no frags Malfunctioning hardware Check MOD_RX CE_WARN and or replace the SFP and or adapter ddi dma addr bind handle Increase the memory MOD_CONFIG_ CE_WARN failed rce lt code gt Ring buffer allocation failed Increase the memory MOD_CONFIG CE_WARN lt code gt POST ERROR Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot and or replace the adapter Insufficient Vectors Reload the driver after changing MOD_CONFIG CE_WARN the interrupt priorities EQ ring alloc failed Increase the memory MOD_CONFIG_ CE_WARN EQ create failed rc lt code gt Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot and or replace the adapter Emulex Drivers for Solaris User Manual P009693 01B Rev A 69 gt G EMULEX Table 8 3 Log Messages for the NIC Driver for Solaris 10 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Recommended Action MOD_MASK SEVERITY CQ create failed lt code gt Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot and
83. one ACTION Contact your customer service representative 0010 DEBUG Event VERBOS DESCRI SEV E MASK LOG MISC 0x00000001 PTION This is debug information about a driver event ERITY LEVEL Debug MESSAG E Event ACTION No action needed informational 0011 DEBUG Event queued VERBOS DESCRI SEV E MASK LOG MISC 0x00000001 PTION This indicates that a driver event is being queued ERITY LEVEL Debug MESSAGE Event queued ACTION No action needed informational 0012 DEBUG Event dequeued VERBOS DESCRI S EV E MASK LOG MISC 0x00000001 PTION This indicates that a driver event is being dequeued ERITY LEVEL Debug M ESSAG E Event dequeued ACTION No action needed informational Driver Events Message IDs 0100 0199 0100 NOTICE Driver attach VERBOSE MASK LOG DRIVER 0x00000002 DESCRIPTION This indicates that the driver is performing an attach operation SEVERITY LEVEL Notice MESSAGE Driver attach ACTION No action needed informational 0101 ERROR Driver attach failed E MASK LOG DRIVER 0x00000002 PTION This indicates that the driver was unable to attach due VERBOS DESCRI to some issue SEVERITY LEVEL Error MESSAG E
84. or replace the adapter Legacy MQ ring alloc failed Increase the memory MOD_CONFIG CE_WARN Legacy MQ create failed Hardware error Download the MOD_CONFIG CE_WARN rc lt code gt same firmware image to the adapter and reboot and or replace the adapter Q EXT ring alloc failed Increase the memory MOD_CONFIG CE_WARN Extended MQ create failed Hardware error Download the MOD_CONFIG CE_WARN rce lt code gt same firmware image to the adapter and reboot and or replace the adapter WQ Buffer Pool create failed Increase the memory MOD_CONFIG_ CE_WARN WQ MAP Handles Pool create Increase the memory MOD_CONFIG_ CE_WARN failed WQ Packet Desc Pool create Increase the memory MOD_CONFIG CE_WARN failed Failed to create WQ ring Increase the memory MOD_CONFIG_ CE_WARN WOCQ create failed Hardware error Download the MOD_CONFIG_ CE_WARN same firmware image to the adapter and reboot and or replace the adapter WQ create failed rc lt code gt Hardware error Download the MOD_CONFIG_ CE_WARN same firmware image to the adapter and reboot and or replace the adapter RQ bdesc alloc failed Increase the memory MOD_CONFIG_ CE_WARN RQ shadow ring alloc failed Increase the memory MOD_CONFIG CE_WARN RQ Buffer Pool create failed Increase the memory MOD_CONFIG_ CE_WARN RQ ring create failed Hardware error Download the MOD_CONFIG_ CE_WARN same firmware image to the adapter and reboot and or replace the adapter RQ create
85. or Solaris User Manual grep elxnic etc driver aliases P009693 01B Rev A is 5 NIC Driver Configuration 29 gt lt EMULEX Using the dladm Utility for Solaris 11 elxnic pciexl19a2 710 Note In the previous example pci n n pcinnnn nnnd n represents the parent of the PCI function the unit number follows the last symbol and pciexnnan nnn indicates the device name 2 Add the following entry to kernel drv elxnic conf name pciexl19a2 710 parent pci 0 0 pci8086 3410 9 unit address 0 interrupt priorities 5 Note The path and unit number may vary on your system 3 Reboot the system Interrupt priorities can be examined using the mdb command For example echo interrupts mdb k grep oce The third column shows the interrupt priority level of the vector in the following output IRQ Vect IPL Bus Trg Type CPU Share APIC INT ISR s 64 0x42 5 Edg MSI X 3 1 oce_isr 65 0x43 5 Edg MSI xX 0 1 oce isr Using the dladm Utility for Solaris 11 Configuring the NIC Interface Using dladm To configure the interface on Solaris 11 Use the dladm utility to configure the NIC interface and also perform a runtime update of the following driver parameter For example to change the MTU in Solaris 11 unplumb the interface and run gt dladm set linkprop p mtu 9000 lt interface gt where lt interface gt is net lt 0 1 2 gt To see the plumbed interfaces run gt
86. or firmware problem with the adapter Check and or update firmware levels Report these errors to customer service 0425 ERROR Adapter error VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that a recoverable adapter error has D occurred SEVERITY LEVEL Error M ESSAGE Adapter error ACTION This error usually indicates a hardware or firmware problem with the adapter Check and or update firmware levels Report these errors to customer service 0426 NOTICE Adapter Async Status VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that the adapter has provided general nformation about the adapter s async status D i SEVERITY LEVEL Notice M ESSAGE Adapter Async Status ACTION No action needed informational Emulex Drivers for Solaris User Manual P009693 01B Rev A gt EMULEX 7 FC FCoE Driver Console and Log Messages 46 Log Messages for the FC FCoE Driver 0430 DEBUG Ring event VERBOSE _MASK LOG SLI 0x00000010 DESCRIPTION This indicates that an SLI ring event has occurred SEVERITY LEVEL Debug MESSAGE Ring event ACTION No action needed informational 0431 DEBUG Ring error VERBOSE _MASK LOG SLI 0x00000010 ESCRIPTION This indicates that an SLI ring error is being reported adapter EVERITY LEVEL
87. ormational 0602 NOTICE Node create failed VERBOSE MASK LOG NODE 0x00000040 DESCRIPTION This indicates that a node create request for a remote device has failed S M EVERITY LEVEL Notice ESSAGE Node create failed ACTION No action needed informational 0603 DEBUG Node updated VERBOSE MASK LOG NODE 0x00000040 ESCRIPTION This indicates that a node has been updated for a emote device D E SEVERITY LEVEL Debug MESSAGE Node updated ACTION No action needed informational 0610 DEBUG Node destroy VERBOSE MASK LOG NODE 0x00000040 ESCRIPTION This indicates that a node has been destroyed for a emote device D ie SEVERITY LEVEL Debug MESSAGE Node destroy ACTION No action needed informational 0611 DEBUG Node closed VERBOSE MASK LOG NODE DETAIL 0x02000000 Emulex Drivers for Solaris User Manual P009693 01B Rev A 49 gt G EMULEX 7 FC FCoE Driver Console and Log Messages Log Messages for the FC FCoE Driver ESCRIPTION This indicates that a node has been temporarily closed or I O transport D f SE M VERITY LEVEL Debug F SSAGE Node closed ACTION No action needed informational 0612 NOTICE Node missing VERBOSE
88. rop p lt property name gt lt interface gt The driver provides the following private parameters e log_level e rx_bcopy_limit e rx_ring_size e rx_rings e rx_rings_per_group e tx_bcopy_limit e tx_reclaim_threshold e tx_ring_size e tx_rings_fw_version read only e fw_version Creating a Virtual NIC Using dladm To create a vNIC use the dladm utility with the create vnic option For example dladm create vnic 1 netO vnicl Once a vNIC is created it can be assigned to a zone using the zonecfg utility For example zonecfg z zonel zonecfg zonel No such zone configured Emulex Drivers for Solaris User Manual P009693 01B Rev A is 5 NIC Driver Configuration 34 gt lt EMULEX SR IOV Configuration zonecfg zonel gt create zonecfg zonel gt set zonepath export zonel zonecfg zonel gt create zonecfg zonel gt add net zonecfg zonel gt set physical vnicl zonecfg zonel gt set address 192 168 1 100 zonecfg zonel gt verify zonecfg zonel gt commit Up to 63 VLANs can be used with each UMC virtual channel For information on configuring UMC refer to the Emulex Universal Multichannel Reference Guide which is available on the Emulex website Considerations e UMC can be configured using the OCM application CLI For more information refer to the OneCommand Manager Command Line Interface User Manual which is available on the Emulex website e You cannot run LACP when UMC is enabled e Using UMC ina hypervi
89. s error could indicate a driver or EVERITY LEVEL Debug ESSAG D c firmware problem S M E Mailbox error ACTION No action needed informational However if the problem persis ts report this error to your customer service representative 0530 ERROR Mailbox timeout VERBOS E MASK LOG MBOX 0x00000020 ESCRI PTION The firmware did not response a mailbox command This rror could indicate a hardware or firmware problem ESSAG D e SEVERITY LEVEL Error M E Mailbox timeout ACTION persis Emulex Drivers for Solaris U No action needed informational However if the problem ts report this error to your customer service representative ser Manual P009693 01B Rev A 7 FC FCoE Driver Console and Log Messages gt G EMULEX Log Messages for the FC FCoE Driver Node Events Message IDs 0600 0699 0600 DEBUG Node create VERBOSE MASK LOG NODE 0x00000040 ESCRIPTION This indicates that a node has been created for a emote device D ig SEVERITY LEVEL Debug MESSAGE Node create ACTION No action needed informational 0601 DEBUG Node opened VERBOSE MASK LOG NODE DETAIL 0x02000000 ESCRIPTION This indicates that a node has been opened for I O ransport D t SEVERITY LEVEL Debug MESSAGE Node opened ACTION No action needed inf
90. se mask for driver warning messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 Dynamic cr count Specifies a count of I O completions after an interrupt response is generated The possible values are 1 255 The default value is 1 Note This property is disabled if cr delay 0 Link reset cr delay Specifies a count of milliseconds after which an interrupt response is generated if cr count has not been satisfied Possible values are 0 63 The default value is 0 Note When cr delay 0 the Coalesce Response parameter cr_count is disabled Link reset enable auth DHCHAP support in the driver e 0 Disabled default e 1 Enabled Link reset enable dtm Emulex Drivers for Solaris User Manual Enables dynamic target mode support in the driver e 0 Disabled default e 1 Enabled Note Dynamic target mode is only supported on LightPulse FC HBA COMSTAR ports Dynamic P009693 01B Rev A is 4 FC FCoE Driver Configuration 20 gt lt EMULEX FC FCoE Configuration File Parameters Table 4 1 FC FCoE Configuration File Parameters Continued Parameter Description Activation enable npiv NPIV support in the driver Adapter e 0 Disabled remove all vports first reset e 1 Enabled requires SLI 3 and later fct queue depth Queue depth of target mode port Possible values are 0 4096 When Reboot set to 0 it indicates that the maximum is
91. sentative 0910 DEBUG Packet timeout VERBOSE MASK LOG PKT 0x00000200 EVERITY LEVEL Debug ESSAGE Packet timeout D being aborted S M ACTION No action needed informational Emulex Drivers for Solaris User Manual ESCRIPTION This indicates that an I O packet has timed out and is P009693 01B Rev A gt G EMULEX 7 FC FCoE Driver Console and Log Messages 0911 DEBUG CHANNEL watchdog VERBOSE MASK LOG PKT DESCRI a I O channel tx queue SEVERITY LEVEL Debug M ESSAGE C PTION This indicates that I 0O s 0x00000200 HANNEL watchdog ACTION No action needed informational 0912 DEBUG TXQ watchdog VERBOS ESCRI ransmit que D SEVERITY LEVEL MESSAGE TXQ watchdog E MASK LOG PKT PTION ue Debug ACTION No action needed 0920 DEBUG Packet flus VERBOSE MASK LOG PKT DESCRIPTION SEVERITY LEVEL MESSAGE ket flush Debug Pac ACTION No action needed 0x00000200 informational h 0x00000200 informational 0921 DEBUG Packet flushed VERBOSE MASK LOG PKT DESCRIPTION SEVERITY LEVEL MESSAGE Packet flushe ACTION No action need Debug 0x00000200 d ed informational 0922 NOTICE Packet flush timeout VERBOS ESCRI E MASK LOG
92. sieweved ser EERE AEN EENE E TEERAA RES 14 NIC DIVER seccereesirecsieroiit eten E n CEE E ERE ETE ETE EEE EEE 14 Scripted REMOVAlscsciesciccinesvesesdevawadenesaccedecenesiienbeleicsess caleba duulbiews EEEE AEE ESE ESE 14 3 Utilities for Solaris Drivers scsisasscen esd iesanasenawssnaanwn assuduadsadeauss kss avannawnuas 15 OneCommand Manager Application ccccsssccccccscccccesscscccccsccccsesssssseeeeees 15 SM xa GM JUTE sc cdecceccscectids eckd voce wecddedse eee cebeccdeccdscceccswcdetwadsoeedsececcsvedeees 15 emlixdry Utility sccicccecccccc ci cciiidaiatececctchiiwceie cides ccc ccclecieed EE EEEE 15 4 FC FCOE Driver Configuration ca sicsssasedsesensaxcsedseseseasensatedsnseiedseiesedsctenens 16 Editing the FC FCoE Configuration File elxfc conf ccccccessscccccccsccccessscees 16 Changing Driver Parameters ssessosssesosesesocsseccosececsssesosssecosesecsssesocese 16 CONTICUFIMNG NPIV SUDDONE sc cisutsarennanehinaenetcedueatranatueeseenudaivaaaarneteuseacactiws 16 Emulex Drivers for Solaris User Manual P009693 01B Rev A 3 gt lt EMULEX Table of Contents 4 Enabling NPIV Support on Solaris 10 cece eee e eee e cece eee e eee eeeeeeee eee eeee eee eeeeeeeees 16 Enabling NPIV Support on Solaris 11 cece eee e eee e seen eee e ee eeee ence eeee tees eeeeeeeeeeees 17 NPIV LIMitations escran oi exe seaeys calle ouaevs celena NE EEEE E beetle eedewa sedge nun 17 NPIV and OS VirtualiZation iiss
93. sor environment is not advised if the UMC interface is going to be part of the hypervisor virtual switch This configuration may cause performance issues SR IOV Configuration Introduction The S11 elxnic driver supports SR IOV on aSPARC platform The elxnic driver can also be used in the hypervisor PF driver and the guest VF driver domain The S10 IOV driver is only supported in the guest domain VF driver Refer to the ldm man page for details on creating and using the logical domains Creating a VF on the elxnic Interface 1 Obtain the device path of elxnic instances by typing etc path_ to inst file For example cat etc path to inst grep elxnic pci 400 pci l pci 0 pci 0 oce 0 132 elxnic pci 400 pci l pci 0 pci 0 oce 0 1 133 elxnic 2 List the Emulex IOV supported device lt bus device fn gt name by typing ldm list io 1 The following information will be returned SYS MB RISER1 PCIE4 IOVNET PFO PF pci 400 pci l pci 0 pci 0 oce 0 Emulex Drivers for Solaris User Manual P009693 01B Rev A is 5 NIC Driver Configuration 32 gt lt EMULEX SR IOV Configuration maxvfs 64 SYS MB RISER1 PCIE4 IOVNET PF1 PF pci 400 pci l pci 0 pci 0 oce 0 1 maxvfs 64 If maxvfs 0 is displayed either the Emulex CNA does not support SR IOV or SR IOV is not enabled 3 To create a VF use the PF lt Bus device fn gt path that corresponds to the elxnic function
94. stic completed ACTION No action needed informational Emulex Drivers for Solaris User Manual P009693 01B Rev A is 7 FC FCoE Driver Console and Log Messages 59 gt lt EMULEX Log Messages for the FC FCoE Driver 1312 WARNING ECHO diagnostic failed VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This indicates that an ECHO diagnostic has failed to return a positive result This could indicate a connectivity problem with your FC network S M EVERITY LEVEL Warning ESSAGE ECHO diagnostic failed ACTION Check your network connections If the problem persists report this error to your system administrator 1313 DEBUG BIU diagnostic completed VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This indicates that a BIU diagnostic has completed SEVERITY LEVEL Debug MESSAGE BIU diagnostic completed ACTION No action needed informational 1314 ERROR BIU diagnostic failed VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This indicates that a BIU diagnostic has failed to return a positive result This usually caused by an adapter hardware problem SEVERITY LEVEL Error MESSAGE BIU diagnostic failed ACTION Contact your customer service representative 1315 DEBUG POST diagnostic completed VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This indicates that a POST diagnosti
95. t Emulex provided URL gt emulex 3 List all available versions of elxfc For example pkg list af elxfc NAME PUBLISHER VERSION IFO driver network elxfc emulex 2 xx x x 0 driver network elxfc emulex 2 xx y x 0 4 By default the newest version of elxfc that is compatible with the rest of the image will be installed On the system whose output was displayed in step 3 the following command will install version 2 xx y x 0 pfexec pkg install elxfc To install a specific version of elxfc append the package version to the package name as follows pfexec pkg install elxfc 2 xx x x 0 In instances where two publishers provide packages of the same name specify the publisher name as follows pfexec pkg install emulex elxfc Following installation of elxfc Solaris must be configured to discover and bind the elxfc driver to Emulex adapters Use the Emulex utility emlxdrv to configure these device bindings See Utilities for Solaris Drivers on page 15 for more information 5 Reboot the system reboot Option 2 P5P Archive Installation You can use a Scripted Installation or a Manual Installation Scripted Installation 1 Login as root 2 Download the p5p tar file from the Emulex website 3 Untar the archive tar xvf elxfc_p5p 2 xx x x sll tar 4 Run the installation script Emulex Drivers for Solaris User Manual P009693 01B Rev A 2 Installing and Uninstalling 12
96. t ret code gt Emulex Drivers for Solaris User Manual Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG P009693 01B Rev A CE_WARN 72 gt G EMULEX Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Recommended Action MOD_MASK Severity MAC address read failed with Check for the faulty hardware using MOD_CONFIG CE_WARN lt ret code gt fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit VPORT SRIOV interface Upgrade the firmware to the MOD_CONFIG CE_WARN creation failed rc correct version Ox lt return gt VPORT NORMAL interface creation failed rc Ox lt return gt Failed to get vlan list ret Check for the faulty hardware using MOD_CONFIG CE_WARN 0X lt return gt fmadm faulty If the hardware is Failed to configure vlan list faulty acquit the hardware using ret Ox lt return gt fmadm acquit lt dev_path gt and Failed to activate viam iist reset the adapter If the hardware Sn vf is not
97. table lists the FC FCoE configuration file parameters Table 4 1 FC FCoE Configuration File Parameters Parameter ack0 Description Indicates whether the adapter uses or attempts to use ACKO for Class 2 e 0 The adapter only uses ACK1 when running Class 2 traffic default e 1 The adapter attempts to use ACKO when running Class 2 traffic to a device If the device does not support ACKO then the adapter uses ACK1 Activation Adapter reset adisc support Sets the driver level support for the FC ADISC login I O recovery method e 0 No support Flushes active I Os for all FCP target devices at link down e 1 Partial support Flushes I Os for non FCP2 target devices at link down e 2 Full support Holds active I Os for all devices at link down Dynamic assign alpa If multiple adapter instances on the same host are on the same loop set this property differently for each adapter Possible values are 0x00 0x0ef A 0x00 setting default means no preference Note This property is only applicable if the topology is set to loop Link reset console errors Verbose mask for driver error messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 Dynamic console notices Verbose mask for driver notice messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 Dynamic console warnings Verbo
98. tempt to reset the Fibr Channel link has failed S M EVERITY LEVEL Error ESSAGE Link reset failed ACTION No action needed informational However if the problem persists report this error to your customer service representative ELS Events Message IDs 0800 0899 0800 DEBUG ELS sent VERBOSE MASK LOG ELS 0x00000100 DESCRIPTION This indicates that an ELS command is being sent SEVERITY LEVEL Debug Emulex Drivers for Solaris User Manual P009693 01B Rev A is 7 FC FCoE Driver Console and Log Messages 52 gt lt EMULEX Log Messages for the FC FCoE Driver MESSAGE ELS sent ACTION No action needed informational 0801 DEBUG ELS comp VERBOSE MASK LOG ELS 0x00000100 DESCRIPTION This indicates that an ELS command completed normally SEVERITY LEVEL Debug MESSAGE ELS comp ACTION No action needed informational 0810 ERROR Stray ELS completion VERBOSE MASK LOG ELS 0x00000100 DESCRIPTION This indicates that an ELS command completion was received without issuing a corresponding ELS command This error could indicate a driver or firmware problem S M EVERITY LEVEL Error ESSAGE Stray ELS completion ACTION No action needed informational However if the problem persists report this error
99. ter reset failed Emulex Drivers for Solaris User Manual P009693 01B Rev A gt EMULEX Emulex Drivers for Solaris User Manual ACTION Check your hardware configuration If the problem persists report this error to your customer service representative Memory Management Events Message IDs 0300 0399 0300 DEBUG Memory alloc M 0x00000008 VERBOSE MASK LOG MI CI SEVERITY LEVEL Debug MESSAGE Memory alloc ACTION No action needed informational 0301 ERROR Memory alloc failed M 0x00000008 VERBOSE MASK LOG MI ER D system memory The system is low on memory resources SEVERITY LEVEL Error MESSAGE Memory alloc failed ACTION No action needed informational However if the problem persists report this error to your system administrator 0310 ERROR Memory pool error M 0x00000008 VERBOSE MASK LOG MI GI D memory buffer pool management SEVERITY LEVEL Error M ESSAGE Memory pool error ACTION No action needed informational However if the problem persists report this error to your customer service representative 0311 DEBUG Memory pool alloc failed VERBOSE MASK LOG MEM 0x00000008 emory from one of its own memory pools D m SEVERITY LEVEL Debug M ES
100. the adapter without issuing acquit MOD_MASK MOD_CONFIG Severity CE_WARN HW POST1 FAILED Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Failed to allocate bmbx Reload the driver MOD_CONFIG CE_WARN FUNCTION RESET FAILED Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Mailbox initialization failed with lt ret code gt Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Firmaware version read failed with lt ret code gt Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Firmware configuration read failed with l
101. to your customer service representative 0811 DEBUG Abnormal ELS completion VERBOSE MASK LOG ELS 0x00000100 DESCRIPTION This indicates that an ELS command completed with a status error in the IOCB It could mean the Fibre Channel device on the network is not responding or the Fibre Channel device is not an FCP target The driver will automatically S M EVERITY LEVEL Debug ESSAGE Abnormal ELS completion ACTION retry this ELS command if needed If the command is a PLOGI or PRLI and the destination PortID is not an FCP Target no action is needed Otherwise check physical connections to Fibre Channel network and the state the remote PortID is in 0820 DEBUG ELS revd VERBOSE MASK LOG ELS 0x00000100 ESCRIPTION This indicates that an unsolicited ELS command was eceived D E SEVERITY LEVEL Debug MESSAGE ELS revd ACTION No action needed informational 0821 DEBUG Unsolicited ELS dropped VERBOSE MASK LOG ELS 0x00000100 DESCRIPTION This indicates that an unsolicited ELS command was received and then dropped for some reason S EVERITY LEVEL Debug Emulex Drivers for Solaris User Manual P009693 01B Rev A gt EMULEX MESSAGE Unsolicited ELS dropped ACTION No action needed informational 0822 DEBUG ELS reply VERBOSE M
102. twork on IP networking support in the driver Reboot e 0 Disabled e 1 Enabled default num iocbs The number of IOCB buffers to allocate Possible values are Adapter 128 10240 The default value is 1024 reset num nodes The number of remote FC nodes N_Ports the driver supports Adapter Possible values are 0 4096 The default value is 0 which means reset no_limit pci max read Sets the PCI X maximum memory read byte count Possible values Adapter are 512 1024 2048 or 4096 The default value is 2048 reset Emulex Drivers for Solaris User Manual P009693 01B Rev A gt G EMULEX 4 FC FCoE Driver Configuration 21 FC FCoE Configuration File Parameters Table 4 1 FC FCoE Configuration File Parameters Continued Parameter Description Activation pm support Power management support in the driver Reboot e 0 Disabled default e 1 Enabled target depth Sets the remote FCP target queue depth Possible values are 0 2048 Link reset The default value is 512 A value of 0 no_limit target mode COMSTAR target mode support Reboot e 0 Disabled default e 1 Enabled If target mode is enabled for a port then the SFS initiator mode is disabled for that port Note This property is only applicable if the topology is set to loop topology Sets the topology Set to point to point mode if you want to run as an Link reset N_Port Set to loop mode if you want to run as an NL_Port e 0 loop then point to point def
103. uit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Failed to del q Emulex Drivers for Solaris User Manual Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG P009693 01B Rev A CE_WARN 76 gt G EMULEX Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Failed to set EQ delay Recommended Action Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_MASK MOD_CONFIG Severity CE_WARN Failed to Configure RSS Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN MAC addition failed Reload the driver MOD_CONFIG CE_WARN Could not find the MAC lt mac addr gt Provide the correct MAC a
104. uration File elxfc conf name fp class fibre channel port 5 name fp class fibre channel port 6 name fp class fibre channel port 7 name fp class fibre channel port 8 name fp class fibre channel port 9 The first two lines are listed by default because ports 0 and 1 are required The above example shows that ports 2 9 have been added to support up to ten virtual ports The port number of each entry must increment by one in sequential order without gaps in the number sequence That is you cannot have name fp class fibre channel port 7 and then have the next line be name fp class fibre channel port 10 4 Reboot the system To create delete and list virtual ports after a system reboot see the OneCommand Manager Application User Manual Enabling NPIV Support on Solaris 11 To enable NPIV support in the driver 1 Login as root or su to root 2 The enable npiv parameter is set to 0 by default To enable NPIV set enable npiv to 1 in the configuration file 3 See Chapter 6 of the Solaris Express SAN Configuration and Multipathing Guide NPIV Limitations The following limitations apply to NPIV e There is no FC IP support on virtual ports e You cannot delete a virtual port with a mounted file system e Due to the limitation of the Solaris SFS stack deleting a virtual port causes that virtual port to go offline e The Emulex LightPulse LP11000 and LPe11000 fami
105. v A gt G EMULEX 6 Troubleshooti 6 Troubleshooting 33 Situations and their Resolutions ng Situations and their Resolutions This section explains some of the situations in which your system may operate in an unexpected manner and some possible resolutions Solaris 11 elxfc Driver Installation Situation Table 6 1 lists a Solaris 11 elxfc driver installation situation and the resolution Table 6 1 Solaris 11 elxfc Driver Installation Situation and the Resolution Situation An older elxfc SVR4 style package is installed on a system that is already running a different package version installed with IPS p5p Note See FC FCoE Out of Box Driver elxfc on page 9 for older installation instructions Resolution Confirm that the IPS and SVR4 packages differ If so remove the SVR4 package 1 View the IPS data to confirm that the versions do not match Type pkg list elxfc The system will display the following NAME PUBLISHER VERSION IFO driver network elxfc emulex version 1 i 3 2 View the version number for the loaded module Type modinfo grep elxfc The system will display 178 fffffffff7ee5000 e4ce8 40 1 elxfc elxfc FCA version 2 3 After confirming that the versions do not match type pkg uninstall elxfc 4 Reboot the system 5 Proceed with the p5p or remote repository installation of the elxfc driver See FC FCoE Out of Box Driver elxfc on page 11 Note I

Emulex Drivers for Solaris User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents