Home

Emulex Drivers Version 10.6 for Solaris User Manual

1. Log Message Recommended Action MOD_MASK SEVERITY Device in error state Check for the faulty hardware MOD_CONFIG_ CE_WARN using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit device is in Suspended state Resume the device MOD_CONFIG CE_WARN Device Unknown The driver does not support a MOD_CONFIG CE_WARN particular adapter Contact Emulex for further information EQ create failed status Hardware error Download the MOD_CONFIG CE_WARN lt code gt same firmware image to the adapter and reboot replace the adapter if necessary EQ ring alloc failed Increase the memory MOD_CONFIG_ CE_WARN Error recovery failed device The hardware or driver cannot MOD_CONFIG_ CE_WARN is in error state recover from a serious hardware error Reset the system Error recovery failed timed Reset the adapter MOD_CONFIG CE_WARN out Error recovery timed out The hardware or driver cannot MOD_CONFIG_ CE_WARN recover from a serious hardware error Reset the system Extended MQ create failed Hardware error Download the MOD_CONFIG CE_WARN status lt code gt same firmware image to the adapter and reboot replace the adapter if necessary Failed to Enable Interrupt Reload the driver MOD_CONFIG_ CE_WARN lt code gt Faile
2. 0430 DEBUG Ring event VERBOSE MASK LOG SLI 0x00000010 DESCRIPTION This indicates that an SLI ring event has occurred SEVERITY LEVEL Debug MESSAGE Ring event ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMUL An Avago Technologies C EX ompany 7 FCoE Driver Console and Log Messages 46 Log Messages for the FCoE Driver 0431 DEBUG Ring error VERBOSE MASK LOG SLI 0x00000010 DESCRIPTION This indicates that an SLI ring error is being reported by the adapter SEVERITY LEVEL Debug MESSAGE Ring error ACTION No action needed informational 0432 DEBUG Ring reset VERBOS E MASK LOG SLI 0x00000010 DESCRI SEV PTION This indicates that an SLI ring is being reset ERITY LEVEL Debug MESSAG E Ring reset ACTION No action needed informational 0440 DEBUG Adapter msg VERBOS E MASK LOG SLI 0x00000010 ESCRI rom the adapter EV PTION This indicates that a message was sent to the driver ERITY LEVEL Debug D f S M ESSAG E Adapter msg ACTION No action needed informational 0450 ERROR IOCB invalid V ERBOS E MASK LOG SLI 0x00000010 ESCRI PTION This indicates that an IOCB was r
3. ACTION No action needed informational 0101 ERROR Driver attach failed V ERBOS E MASK LOG DRIVER 0x00000002 ESCRI PTION This indicates that the driver was unable to attach due EVERITY LEVEL Error D to some issue S M ESSAG E Driver attach failed ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative 0102 DEBUG Driver attach V D 0 S M ERBOS E MASK LOG DRIVER 0x00000002 ESCRI perat EVERI PTION This indicates that the driver is performing a attach ion TY LEVEL Debug ESSAG E Driver attach ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SS EMULEX 7 FCoE Driver Console and Log Messages 39 An Avago Technologies Company Log Messages for the FCoE Driver 0110 NOTICE Driver detach VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver is performing a detach D operation SEVERITY LEVEL Notice MESSAGE Driver detach ACTION No action needed informational 0111 ERROR Driver detach failed VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver was unable to detach due D to some issue SEVERITY LEVEL Err
4. F PTION This provides additional information about a packet VERITY LEVEL Debug F D being sent S M iS SAG E Packet transport ACTION No action needed informational 0940 DEBUG Packet completion error VERBOS E MASK LOG PKT 0x00000200 ESCRI rror status This can occur during normal operation PTION This indicates that an I O packet was completed with an TY LEVEL Debug D e SEVERI MESSAG E Packet completion error ACTION persis FCP Traffic Events Message IDs 1000 1099 No action needed informational However if the problem ts report this error to your customer service representative 1000 DEBUG Stray FCP completion VERBOS E MASK LOG FCP 0x00000400 DESCRI received without issuing a corresponding FCP command This error could indicate a driver or firmware problem SEVERI PTION This indicates that an FCP command completion was TY LEVEL Debug MESSAG ACTION persis E Stray FCP completion No action needed informational However if the problem ts report this error to your customer service representative 1001 DEBUG FCP completion error V ERBOS ESCRI EVERI E MASK LOG FCP 0x00000400 PTION This indicates that an FCP command completed with an rror status These errors can occur during normal
5. pkg list af elxfc NAME PUBLISHER VERSION IFO driver network elxfc emulex 10 4 xx yy 0 oo driver network elxfc emulex 10 4 xx yy 0 4 On the system whose output was displayed in step 3 the following command will install version 10 4 xx y x 0 pfexec pkg install elxfc By default the newest version of elxfc that is compatible with the rest of the image will be installed To install a specific version of elxfc append the package version to the package name as follows pfexec pkg install elxfc 10 4 xx yy 0 In instances where two publishers provide packages of the same name specify the publisher name as follows pfexec pkg install emulex elxfc After the installation of elxfc has completed Solaris must be configured to discover and bind the elxfc driver to Emulex adapters Use the Emulex utility emlxdrv to configure these device bindings See Utilities for Solaris Drivers on page 16 for more information 5 Reboot the system reboot Option 2 P5P Archive Installation You can use a scripted installation or a manual installation Scripted Installation 1 Login as root 2 Download the p5p tar file from the Emulex website Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A XG EMULEX 2 Installing and Uninstalling 13 An Avago Technologies Company Installing the Drivers for Solaris 11 3 Untar the archive tar xvf elxfc_p5p 10 4 xx yy s11 tar
6. ACTION retry this ELS command if needed If the command is a PLOGI or PRLI and the destination PortID is not an FCP Target no action is needed Otherwise check physical connections to Fibre Channel network and the state the remote PortID is in 0820 DEBUG ELS revd VERBOSE MASK LOG ELS 0x00000100 ESCRIPTION This indicates that an unsolicited ELS command was eceived D r SEVERITY LEVEL Debug MESSAGE ELS revd ACTION No action needed informational 0821 DEBUG Unsolicited ELS dropped VERBOSE MASK LOG ELS 0x00000100 ESCRIPTION This indicates that an unsolicited ELS command was eceived and then dropped for some reason D X SEVERITY LEVEL Debug MESSAGE Unsolicited ELS dropped ACTION No action needed informational 0822 DEBUG ELS reply VERBOSE MASK LOG ELS 0x00000100 ESCRIPTION This indicates that a reply is being sent for an nsolicited ELS command D u SEVERITY LEVEL Debug MESSAGE ELS reply Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages 53 Log Messages for the FCoE Driver ACTION No action needed informational 0830 ERROR Invalid ELS command found V ERBOS E MASK LOG ELS 0x00000100 ESCRI
7. VERBOS E MASK LOG FCSP_ DETAIL 0x01000000 ESCRI CSP interface PTION This provides detailed information about the driver s ERITY LEVEL Debug D F SEV MESSAG E FCSP detail ACTION No action needed informational 1702 DEBUG FCSP error VERBOS E MASK LOG FCSP 0x00020000 ESCRI DFC request PTION This indicates that an error was found while processing ERITY LEVEL Debug D a SEV M ESSAG E FCSP error ACTION No action needed informational 1705 DEBUG FCSP state VERBOSE MASK LOG FCSP 0x00020000 DESCRIPTION This indicates that an authentication state is changing SEVERITY LEVEL Debug MESSAGE FCSP state ACTION No action needed informational 1706 DEBUG FCSP event V ERBOS E MASK LOG FCSP 0x00020000 D 0 S M ESCRI ccurr EVERI PTION This indicates that an authentication event has ed TY LEVEL Debug ESSAG E FCSP event ACTION No action needed informational 1707 DEBUG FCSP status VERBOSE MASK LOG FCSP 0x00020000 DESCRIPTION This indicates that an authentication status is being updated SEVERITY LEVEL Debug MESSAGE FCSP status ACTION No action needed informational 1710 DEBUG FCSP start V D a S ER
8. ESCRIPTION This indicates that the driver is performing a resume peration D O SEVERITY LEVEL Debug M ESSAGE Driver resume ACTION No action needed informational 0131 ERROR Driver resume failed VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver was unable to resume du o some issue D it SEVERITY LEVEL Error MESSAGE Driver resume failed ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative Adapter Initialization Events Message IDs 0200 0299 0200 NOTICE Adapter initialization VERBOSE MASK LOG INIT 0x00000004 DESCRIPTION This indicates that the adapter is initializing SEVERITY LEVEL Notice MESSAGE Adapter initialization ACTION No action needed informational 0201 ERROR Adapter initialization failed VERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that an attempt to initialize the dapter has failed D a SEVERITY LEVEL Error MESSAGE Adapter initialization failed ACTION Check your hardware configuration If the problem persists report this error to your customer service representative 0202 DEBUG Adapter initialization VERBOSE MASK LOG INIT 0x00000004 DESCRIPTION This indicate
9. PTION This indicates that an ELS command was found with an nvalid command code EVERITY LEVEL Error D i S M ESSAG E Invalid ELS command found ACTION No action needed informational However if the problem persis General I O Packet Events Message IDs 0900 0999 ts report this error to your customer service representative 0900 NOTICE Packet abort E MASK LOG PKT 0x00000200 PTION This indicates that an I O packet is being aborted VERBOS DESCRI SEVERITY LEVEL Notice MESSAGE Packet abort ACTION No action needed informational 0901 WARNING Packet abort failed V ERBOS E MASK LOG PKT 0x00000200 ESCRI PTION This indicates that an attempt to abort an I O packet iled EVERITY LEVEL Warning D has fa S M ESSAG E Packet abort failed A P CTION ersis No action needed informational However if the problem ts report this error to your customer service representative 0910 DEBUG Packet timeout V D b S M ERBOS E MASK LOG PKT 0x00000200 ESCRI eing EVERI PTION This indicates that an I O packet has timed out and is aborted TY LEVEL Debug ESSAG E Packet timeout ACTION No action needed informational 0911 DEBUG CHANNEL watchdog V D a S M ERBOS
10. and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to disable the interrupts Reset the adapter MOD_CONFIG CE_WARN Failed to enable interrupts Reboot the system MOD_CONFIG CE_WARN during IRM Failed to get controller Check for the faulty hardware using MOD_CONFIG CE_WARN attributes status lt code gt fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to get hardware stats Check for the faulty hardware using MOD_CONFIG CE_WARN version lt ver num gt status lt code gt fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Recommended Action MOD_MASK Severity Failed to get pport stats Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt
11. Debug ESSAG E Link Down atten ACTION No action needed informational 0420 ERROR Adapter hardware error VERBOS E MASK LOG SLI 0x00000010 ESCRI tatus PTION This indicates that an interrupt has occurred and the register indicates a nonrecoverable hardware error EVERITY LEVEL Error CTION D S S MESSAG A a e E Adapter hardware error This error usually indicates a hardware problem with the dapter Try running adapter diagnostics Report these errors to ustomer service 0421 NOTICE Adapter temperature VERBOS E MASK LOG SLI 0x00000010 ESCRI nform PTION This indicates that the adapter has provided general ation about the adapter s temperatur TY LEVEL Notice D i SEVERI MESSAG E Adapter temperatur ACTION No action needed informational 0422 WARNING Adapter temperature VERBOS E MASK LOG SLI 0x00000010 ESCRI EVERI PTION This indicates that the adapter s temperature is too TY LEVEL Warning ESSAG E Adapter temperatur Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 5E EMULEX 7 FCoE Driver Console and Log Messages 45 An Avago Technologies Company Log Messages for the FCoE Driver ACTION Check hardware ventilation Reduce adapter usage Shutdown host s
12. No action needed informational However if the problem persists report this error to your customer service representative 0621 DEBUG Node timeout VERBOSE_MASK LOG NODE 0x00000040 ESCRIPTION This indicates that the node timer expired the node is eady to be opened or it has been offline too long and needs to be EVERITY LEVEL Debug ESSAGE Node timeout ACTION No action needed informational Link Events Message IDs 0700 0799 0700 DEBUG Link event VERBOSE MASK LOG SLI 0x00000010 or LOG LINK 0x00000080 DESCRIPTION This indicates that a link event has occurred SEVERITY LEVEL Debug MESSAGE Link event ACTION No action needed informational 0710 NOTICE Link down VERBOSE MASK LOG LINK 0x00000080 DESCRIPTION This indicates that the Fibre Channel link is down to the adapter SEVERITY LEVEL Notice MESSAGE Link down ACTION Check your network connections If the problem persists report this error to your system administrator 0720 NOTICE Link up VERBOSE MASK LOG LINK 0x00000080 DESCRIPTION This indicates that the Fibre Channel link is up SEVERITY LEVEL Notice Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Compan
13. gt EMULEX 4 FCoE Driver Configuration 18 An Avago Technologies Company Editing the FCoE Configuration File elxfc conf name fp class fibre channel port 4 name fp class fibre channel port 5 name fp class fibre channel port 6 name fp class fibre channel port 7 name fp class fibre channel port 8 name fp class fibre channel port 9 The first two lines are listed by default because ports 0 and 1 are required The above example shows that ports 2 9 have been added to support up to 10 virtual ports The port number of each entry must increment by 1 in sequential order without gaps in the number sequence That is you cannot have name fp class fibre channel port 7 and then have the next line be name fp class fibre channel port 10 4 Reboot the system To create delete and list virtual ports after a system reboot see the OneCommand Manager Application User Manual Enabling NPIV Support on Solaris 11 To enable NPIV support in the driver 1 Login as root or su to root 2 The enable npiv parameter is set to 0 by default To enable NPIV set enable npiv to 1 in the configuration file See Chapter 6 of the Solaris Express SAN Configuration and Multipathing Guide which is available on the Oracle website NPIV Limitations The following limitations apply to NPIV e Due to the limitation of the Solaris SFS stack deleting a virtual port causes that vir
14. max xfer size Sets the maximum SCSI transfer size in bytes per I O This property Reboot determines the scatter gather list buffer size A pool of buffers is reallocated by the driver during boot A larger transfer size requires a larger memory allocation The minimum value is 131072 The maximum value is 1388544 The default value is 339968 Note For 0Ce11100 series and LPe16000 and LPe15000 series adapters the maximum transfer size is 1040384 bytes network on IP networking support in the driver Reboot e 0 Disabled e 1 Enabled default num iocbs The number of IOCB buffers to allocate Possible values are Adapter 128 10240 The default value is 1024 reset num nodes The number of remote FC nodes N_Ports the driver supports Adapter Possible values are 0 4096 The default value is 0 which means reset no_limit pci max read Sets the PCI X maximum memory read byte count Possible values Adapter are 512 1024 2048 or 4096 The default value is 2048 reset pm support Power management support in the driver Reboot e 0 Disabled default e 1 Enabled target depth Sets the remote FCP target queue depth Possible values are 0 2048 Link reset The default value is 512 A value of 0 no_limit topology Sets the topology Set to point to point mode if you want to run as an Link reset N_Port Set to loop mode if you want to run as an NL_Port e 0 loop then point to point default e 2 point to point only e 4 loop only e 6 poin
15. 10 or sysconfig 1M utility for Solaris 11 to remove a device configuration These utilities can delete the configurations of IP address netmask hostname nfs mounts ldap and so on on the host The sys unconfig 1M sysconfig 1M utility reboots the system and clears the existing IP configuration so you must enter all the information again even for the existing NICs already configured in the system The sys unconfig 1M sysconfig 1M utility must be executed from a console On reboot you are presented with a set of user interface based data entry forms that facilitate the required change in configuration Multi ring Mode and the Effect of ddi_msix_alloc_limit Solaris 10 The elxnic driver is enabled to work in the multi ring mode by default To check the number of active transmit and receive tx rx rings type ndd get dev elxnic lt xX gt rx rings ndd get dev elxnic lt X gt tx rings The variable lt X gt is the interface number of the elxnic driver Table 5 2 shows how the value of ddi_msix_alloc_limit affects receive traffic distribution across CPU cores for Solaris 10 Table 5 2 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 10 Value of CPU Cores ddi_msix_alloc_limit Participating in NIC Mode APIC in etc system RX Processing Limiting Factor 0Ce11102 Legacy XAPIC Default 2 Solaris and APIC in platform 0Ce11102 Legacy xAPIC 4 4 firmware and driver OCe11102 Legacy x2API
16. 4 4 firmware and driver 0Ce11102 Legacy x2APIC Default 4 firmware and driver OCe11102 Advanced xAPIC Default 2 Solaris and APIC in platform OCe11102 Advanced xAPIC 8 8 firmware and driver OCe11102 Advanced x2APIC Default 8 firmware and driver Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A gt lt EMULEX 5 NIC Driver Configuration 29 An Avago Technologies Company Using the NIC Configuration File elxnic conf Changing Interrupt Priorities The Solaris operating system divides the available interrupts among multiple priority levels each priority level has a maximum of 31 vectors By default each function has a maximum of two MSI X vectors For example with three 0Ce11102 adapters in FLEX10 mode there are 24 functions and the driver needs at least two vectors per function for a total of 48 vectors If the MSI X allocation fails the driver reverts to the INTx allocation which results in suboptimal performance Normally the network drivers allocate vectors at level 6 but the requirement of 48 vectors is beyond the limit of 31 which causes issues A solution is to assign level 6 to 12 functions and level 5 to the remaining functions so that all functions can get two MSI X vectors for optimum performance It is not uncommon to assign level 5 or 6 on Solaris under these conditions The following example shows how the interrupt priority for a PCI function can be configured to a level 5 1 Type
17. Company Table 8 3 Log Messages for the NIC Driver for Solaris 10 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Recommended Action MOD_MASK SEVERITY IRM Alloc intr failed ret Reboot the system MOD_CONFIG_ CE_WARN lt ret_code gt count lt code gt nallocd lt code gt lancer physdev reset failed Reset the adapter MOD_CONFIG CE_WARN lancer physdev_reset INP bit Reset the adapter MOD_CONFIG_ CE_WARN polling timedout lt timeout gt pd_ctrl lt code gt Legacy MQ create failed Hardware error Download the MOD_CONFIG_ CE_WARN status lt code gt same firmware image to the adapter and reboot replace the adapter if necessary Legacy MQ ring alloc failed Increase the memory MOD_CONFIG_ CE_WARN Mailbox initialization Failed Check for the faulty hardware MOD_CONFIG_ CE_WARN with re lt code gt using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit mod install failed Uninstall the driver try installing MOD_CONFIG CE_WARN the driver after a reboot MQ EXT ring alloc failed Increase the memory MOD_CONFIG_ CE_WARN No response from FW for Reset the adapter MOD_CONFIG CE_WARN Mailbox command Mailbox stalled till recovery oce detach Rx buffers Reboot
18. Failed to Setup handlers during Reboot the system MOD_CONFIG CE_WARN IRM Failed to setup interface during Reboot the system MOD_CONFIG CE_WARN IRM Failed to get firmware version Check for the faulty hardware using MOD_CONFIG CE_WARN status fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 76 SG EMULEX An Avago Technologies Company Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Recommended Action MOD_MASK Severity Failed to get firmware Check for the faulty hardware using MOD_CONFIG CE_WARN configuration status fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit FUNCTION RESET FAILED Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Hardware UE Detected Upgrade
19. LEVEL Warning ESSAGE Adapter shutdown CTION Contact your customer service representative 0240 ERROR Adapter reset failed A E ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that an attempt to reset the adapter has EVERITY LEVEL Error ESSAGE Adapter reset failed CTION Check your hardware configuration If the problem persists eport this error to your customer service representative Memory Management Events Message IDs 0300 0399 0300 DEBUG Memory alloc V GI ERBOSE MASK LOG MEM 0x00000008 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company DESCRI 7 FCoE Driver Console and Log Messages 42 Log Messages for the FCoE Driver PTION This indicates that the driver allocated system memory Emulex Drivers Version 10 6 for Solaris User Manual SEVERITY LEVEL Debug MESSAGE Memory alloc ACTION No action needed informational 0301 ERROR Memory alloc failed VERBOSE MASK LOG MEM 0x00000008 D system memory The system is low on memory resources SEVERITY LEVEL Error MESSAGE Memory alloc failed ACTION No action needed informational However if the problem persists report this error to your system administrator 0310 ERROR Memory p
20. MOD_CONFIG_ CE_WARN failed Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 72 SG EMULEX An Avago Technologies Company Table 8 3 Log Messages for the NIC Driver for Solaris 10 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message WOCQ create failed For Solaris 11 Recommended Action Hardware error Download the same firmware image to the adapter and reboot replace the adapter if necessary MOD_MASK MOD_CONFIG SEVERITY CE_WARN Table 8 4 details the log messages provided by the NIC driver for Solaris 11 operating systems Table 8 4 Log Messages for the NIC Driver for Solaris 11 Log Message Recommended Action MOD_MASK Severity Alloc intr failed Reload the driver MOD_CONFIG CE_WARN Could not allocate dbuf Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system Increase the memory Could not allocate dbuf for Low system resources Repeat the MOD_CONFIG CE_WARN getting mac list operation that generated the log If the error log is generated again reboot the system Increase the memory Could not allocate stats dbuf Low system resources Repeat the MOD_CONFIG_ CE_WARN operation that generated the log If the error log is generated again reboot the system Could not allocate vstats dbuf Check for the f
21. SEVERITY LEVEL Notice MESSAGE Firmware download ACTION No action needed informational 1521 NOTICE Firmware download complete VERBOSE MASK LOG FIRMWARE 0x00008000 DESCRIPTION This indicates that an attempt to download a firmware image was successful SEVERITY LEVEL Notice MESSAGE Firmware download complete ACTION No action needed informational 1522 ERROR Firmware download failed VERBOSE MASK LOG FIRMWARE 0x00008000 DESCRIPTION This indicates that an attempt to download a firmware image was failed SEVERITY LEVEL Error MESSAGE Firmware download failed ACTION Check your hardware configuration report this error to your customer servic If the problem persists representative 1523 WARNING Firmware updated VERBOSE MASK LOG FIRMWARE 0x00008000 DESCRIPTION This indicates that new firmware has been updated on the adapter SEVERITY LEVEL Warning MESSAGE Firmware updated ACTION A reboot or adapter power cycle will be required to activate the new firmware 1530 DEBUG Firmware dump VERBOSE MASK LOG FIRMWARE 0x00008000 DESCRIPTION This indicates that a firmware core dump has occurred SEVERITY LEVEL Debug MESSAGE Firmware dump ACTION Check your hardware configuration If the problem p
22. any warranty of any kind either expressed or implied including but not limited to the implied warranties of merchantability or fitness for a particular purpose Emulex may make improvements and changes to the product described in this manual at any time and without any notice Emulex assumes no responsibility for its use nor for any infringements of patents or other rights of third parties that may result Periodic changes are made to information contained herein although these changes will be incorporated into new editions of this manual Emulex disclaims any undertaking to give notice of such changes Emulex 3333 Susan Street Costa Mesa CA 92626 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A gt G EMULEX Table of Contents An Avago Technologies Company Table of Contents Listof Tables citacswatenntwidaantwciwransviwesasverdonsshacan sedans sanaa auiii eai 6 1e INCFOPU CEION accawncaasnmciareawcdiusaea se nesses ysaantacentacanantouaicaviayshadaneddanaaidaenawe 7 Supported Operating Systems eseseossssssssssoosocsssesessssoceossssessssseosessessessee 7 Supported Adapters and Firmware sesssssssessesecssscccosssesoeseccsosecosssesecsesesoee 7 Abbreviations ssssenisissruscissrcssner ostonani EEEE 8 2 Installing and Uninstalling essessesessecceeseececoecoesoecoesoecoecoecoecsecoecsecoe 10 Installing the Drivers for Solaris 10 sessssssssssesosssccsosecesoscesosesecosssessssesoe 1
23. create failed Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit WQ Buffer Pool create failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system W create failed status lt code gt Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit W MAP Handles Pool create failed Low system resources Repeat the MOD_CONFIG_ CE_WARN operation that generated the log If the error log is generated again reboot the system W Packet Desc Pool create failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system wqb pool empty The system cannot transmit data because MOD_TX CE_WARN the driver is low on resources Check for a process generating heavy traffic wqm pool empty The system cannot transmit data because MOD_TX CE_WARN the driver is low on resources Check for a process generating heavy traffic Emulex
24. dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to get vlan list Check for the faulty hardware using MOD_CONFIG CE_WARN status lt code gt fmadm faulty If the hardware is faulty Failed to configure vlan list acquit the hardware using fmadm acquit status lt code gt lt dev_path gt and reset the adapter If the paiied tocactivate aie ae Sa yf hardware is not faulty reset the adapter without issuing acquit Failed to get vport stats Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to init rings Low system resources Reboot the system MOD_CONFIG CE_WARN to see if the issue resolves itself If possible add more memory Failed to remove interrupt Reload the driver MOD_CONFIG CE_WARN Failed to retrieve intr types Unload and then reload the driver MOD_CONFIG CE_WARN Failed to set EQ delay Check for the faulty hardware using MOD_CONFIG CE_WARN status lt code gt fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to Setup handlers Reload the driver MOD_CONFIG CE_WARN
25. gt EMULEX An Avago Technologies Company Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A Connect Monitor Manage SG EMULEX An Avago Technologies Company Copyright 2003 2015 Emulex All rights reserved worldwide No part of this document may be reproduced by any means or translated to any electronic medium without the prior written consent of Emulex Information furnished by Emulex is believed to be accurate and reliable However no responsibility is assumed by Emulex for its use or for any infringements of patents or other rights of third parties which may result from its use No license is granted by implication or otherwise under any patent copyright or related rights of Emulex Emulex the Emulex logo Emulex BladeEngine Emulex InSpeed Emulex LightPulse Emulex OneCommand Emulex OneConnect and SLI are registered trademarks and Emulex Advanced 8 Emulex Connect Emulex CrossLink Emulex Engine Emulex Edge Emulex ExpressLane Emulex GreenState Network Xceleration Emulex OneCore Emulex Pilot Emulex SURF Emulex Universal Multi Channel Emulex vEngine Emulex Virtual Fabric Emulex Virtual Network Exceleration Emulex vPath Emulex vScale AutoPilot AutoPilot Installer and BlockGuard are trademarks of Emulex All other brands or product names referenced herein are trademarks or registered trademarks of their respective companies or organizations Emulex provides this manual as is without
26. report this error to your customer service representative VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This provides general information about the driver s SFS interface SEVERITY LEVEL Debug MESSAGE SFS ACTION No action needed informational 1301 DEBUG SFS detail ERBOS E MASK LOG SFS_ DETAIL 0x20000000 EVERI PTION This provides detailed information about the driver s terface TY LEVEL Debug ESSAG E SFS detail ACTION No action needed informational 1310 WARNING Diagnostic error A Pp ERBOS E MASK LOG SFS 0x00002000 ESCRI PTION This indicates that a diagnostic request did not te because of some issue TY LEVEL Warning E Diagnostic error CTION ersis No action needed informational However if the problem ts report this error to your customer service representative 1311 DEBUG ECHO diagnostic completed V D S M ERBOS E MASK LOG SFS 0x00002000 ESCRI EVERI PTION This indicates that an ECHO diagnostic has completed TY LEVEL Debug ESSAG E ECHO diagnostic completed ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SS EMULEX 7 FCoE Driver Console and Log Messages 58 An Avago Technologies Company Log Message
27. the driver instance number For example setting elxfc0 link speed 4 makes 4 Gbps the link speed setting for the 0 instance of the elxfc driver All parameters are adapter specific If you want to override a driver parameter for a single driver loading session you can specify it as a parameter to the modload command The following example is for 64 bit platforms modload kernel drv amd64 elxfc automap 0 The OneCommand Manager application reflects the configuration file driver parameters For more information see the OneCommand Manager Application User Manual The Activation column in Table 4 1 shows the requirement for the parameter change to take effect Activation requirements include adapter reset dynamic reset no reset is necessary link reset and reboot Table 4 1 lists the FCoE configuration file parameters Table 4 1 FCoE Configuration File Parameters Parameter Description Activation acko Indicates whether the adapter uses or attempts to use ACKO for Adapter Class 2 reset e 0 The adapter only uses ACK1 when running Class 2 traffic default e 1 The adapter attempts to use ACKO when running Class 2 traffic to a device If the device does not support ACKO then the adapter uses ACK1 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 4 FCoE Driver Configuration FCoE Configuration File Parameters DG EMULEX 20 An Avago Technologies Company Table 4 1 FCoE Con
28. the firmware to the correct MOD_CONFIG CE_WARN version HW initialization failed with Check for the faulty hardware using MOD_CONFIG CE_WARN ret_code fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit HW POST1 FAILED Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Interrupt block disable failed Reset the adapter MOD_CONFIG CE_WARN Interrupt setup failed with Reload the driver MOD_CONFIG CE_WARN lt ret_code gt Interrupts block enable failed Reload the driver MOD_CONFIG CE_WARN Invalid q length Must be Set the correct queue length using the MOD_CONFIG CE_WARN 256 2000 dladm utility IRM Alloc intr failed ret lt ret Reload the driver MOD_CONFIG CE_WARN code gt count lt code gt nallocd lt alloc_vectors gt kstat creation failed Reload the driver MOD_CONFIG CE_WARN kstat setup Failed with Reload the driver MOD_CONFIG CE_WARN lt ret_code gt lancer physdev_reset INP bit Reset the adapter MOD_CONFIG CE_WARN polling timedout lt timeout gt pd ctrl lt reg gt Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A R
29. the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MAP FAILED Low System resources Repeat the MOD_TX CE_WARN operation that generated the log If the error log is generated again reboot the system Map PCI config failed with Reset the adapter MOD_CONFIG_ CE_WARN lt ret_code gt mcast ADD DEL failed Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit mod install failed rval Reset the adapter MOD_CONFIG CE_WARN MSIX not available The system continues to work with INTx MOD_CONFIG CE_WARN oce detach Rx buffers pending Reboot the system MOD_CONFIG CE_WARN with stack OCE INITIATE DUMP Dump Image not Diagnostic Dump image is not present MOD_CONFIG_ CE_WARN present Retry the Dump initiation Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 78 SG EMULEX An Avago Technologies Company Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message OCE INITIATE DUMP failed Recommended Action Diagnostic Dump initiation by an application failed Retry the Dump initiation MOD
30. the same message in the system message log var adm messages file Jan 19 14 45 36 sunv240 elxfc ID 349649 kern info 5 0336 elxfc0O NOTICE 720 Link up 8Gb fabric In the above system log message Jan 19 14 45 36 the date and time when the error or event occurred sunv240 the name of the host machine elxfc the module where the message originates In this case elxfc means that it is from Emulex SFS FCA out of box driver ID 349649 kern info a Solaris specific message ID and kernel message level This changes from one driver message to another 5 0336 the driver message context tag This may change from one driver version to another elxfc0 the module or instance where the message originates In this case elxfc0 means that it is from Emulex SFS FCA out of box driver instance of 0 This changes from one driver instance to another NOTICE identifies the driver message severity level This may change from one driver version to another For other severity information see Table 7 3 Severity Levels of FCoE Driver Log Messages on page 35 720 identifies the driver message identification number This number does change from one driver version to another Link up identifies the actual error or event message This message does not change from one driver version to another 8 Gbps fabric identifies additional information specific to the error or event message This informa
31. the system MOD_CONFIG_ CE_WARN pending with stack OCE INITIATE DUMP Dump Image Diagnostic Dump image is not MOD_CONFIG_ CE_WARN not present present Retry the Dump initiation OCE INITIATE DUMP failed Diagnostic Dump initiation by an MOD_CONFIG CE_WARN application failed Retry the Dump initiation OCE_ INITIATE DUMP failed due Device Recovery failed after MOD_CONFIG_ CE_WARN to recovery timeout Diagnostic Dump initiation Reboot the system oce m unicast Factory mac Reboot the system MOD_CONFIG CE_WARN addition failed status lt status_code gt oce m unicast mac delete Reboot the system MOD_CONFIG CE_WARN failed status lt code gt Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 71 SG EMULEX An Avago Technologies Company Table 8 3 Log Messages for the NIC Driver for Solaris 10 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Recommended Action MOD_MASK SEVERITY oce m unicast ucast mac Reboot the system MOD_CONFIG CE_WARN addition failed staus lt status_code gt Resetting to Factory MAC oce rx no frags Malfunctioning hardware Check MOD_RX CE_WARN the SFP and the adapter replace them if necessary PCL Initialization Failed Reset or replace the adapter or MOD_CONFIG CE_WARN move the adapter to different slot pci config setup failed Reset or replace th
32. 0 FCoE Out of Box Driver elxfc ssssesssssssossssesesssssssseossesessssseeosssscsesseoe 10 NIC Out of Box Driver elxnic ssesssesssssessssesesssesssseeesssesesssseeesssesseseee 10 Uninstalling the Drivers for Solaris 10 sssssesscssssossecccsssescsessesssessosesesoeseee 11 FCOE DIVET sadnciic cus cesaas iat EE REE EEEN E EE NEEE 11 NIC DIVET cacti ctedscteevecaes ikuinen ATE ANEA EERE ETETE EEE EAEE REEERE 11 Installing the Drivers for Solaris 11 sessssessssscscosssescsosecessecssossseccssseessseeeoe 12 FCoE Out of Box Driver elxfe ates tecaroue Godan nl caiuleasendeiauaansnareadawsindindeeies 12 Option 1 Remote Repository Installation cece eee ee eee eee eee eee e eee eeeeeeeeeeees 12 Option 2 P5P Archive Installation cece cece cece cence cece eee eee inaa 12 NIC Out of Box Driver elxniC Siaccestsesassvsiereceueduituadseteduesendwbanesteswaieocaten 13 Option 1 Remote Repository Installation ssssssssssssesesesssessesesessesssessesssessess 13 Option 2 p5p Archive Installation sssesesssesscessssssesececessssssscscoesessseeeeeeeese 14 Uninstalling the Drivers for Solaris 11 sssssesssssccssseccsssccsceecesoseecosesesoeseeo 14 FCOE DIVET a sccce aieiwectscncnerecbveesiibesdueweres ed EIEEE SAE TEE ETARE ORERE ERE 14 Scripted Removal cacssecsiccswereasveaemitievelsowcede ects neagad clededsabeadeagendcsand ealdeasennneees 14 Manual Removal oseere e n
33. 001 This is a general purpose informational message informational 0x00000001 This is a general purpose warning message informational 0x00000001 general purpose error message informational 0x00000001 general purpose panic message Severe representative 0x00000001 This is debug information about a driver event P011396 01A Rev A 37 SG EMUL EX An Avago Technologies Company 7 FCoE Driver Console and Log Messages 38 Log Messages for the FCoE Driver MESSAG E Event ACTION No action needed informational 0011 DEBUG Event queued VERBOS E MASK LOG MISC 0x00000001 DESCRI SEV PTION This indicates that a driver event is being queued ERITY LEVEL Debug MESSAG E Event queued ACTION No action needed informational 0012 DEBUG Event dequeued VERBOS DESCRI SEV E MASK LOG MISC 0x00000001 PTION This indicates that a driver event is being dequeued ERITY LEVEL Debug MESSAG E Event dequeued ACTION No action needed informational Driver Events Message IDs 0100 0199 0100 NOTICE Driver attach VERBOS ESCRI peration E MASK LOG DRIVER 0x00000002 PTION This indicates that the driver is performing an attach ERITY LEVEL Notice D O SEV M ESSAG E Driver attach
34. 02000000 LOG_NODE_DETAIL Detailed node events 49 49 0x04000000 LOG_IOCTL_DETAIL Detailed IOCTL events 59 59 0x08000000 LOG_IP_DETAIL Detailed IP events 56 0x10000000 LOG_FIRMWARE_DETAIL Detailed firmware events 60 0x20000000 LOG_SFS_DETAIL Detailed Solaris SFS events 57 0x40000000 LOG_MBOX_DETAIL Detailed mailbox events 47 0x80000000 LOG_SLI_DETAIL Detailed adapter SLI events 47 OXFFFFFFFF LOG_ALL_MSG All logging on all events Log Message Severity Levels Table 7 3 lists the severity type of the FCoE driver log message in the order of severity Table 7 3 Severity Levels of FCoE Driver Log Messages Severity Level DEBUG Informational Description Message provides engineering debugging information NOTICE Informational Emulex Drivers Version 10 6 for Solaris User Manual Message provides general purpose information P011396 01A Rev A 35 SS EMULEX 7 FCoE Driver Console and Log Messages 36 An Avago Technologies Company Log Messages Table 7 3 Severity Levels of FCoE Driver Log Messages Severity Level Description WARNING Message provides a general purpose warning ERROR Message indicates that a driver error has occurred PANIC Severe Message indicates that the driver has forced a system panic to occur Log Message Example The following is an example of a log message on the system console 5 0336 elxfcO NOTICE 720 Link up 8Gb fabric The following is an example of
35. 2 10000000c9123457 28030000C9123457 20030000C9123457 3 All entries are automatically created or removed by the OneCommand Manager application vport restrict Sets the virtual port s behavior when discovering targets in the SAN Link reset login e 1 Prevents the vPort from logging into other initiator ports on the SAN Also rejects logins from other ports in the SAN because it assumes that all ports that send a PLOGI are initiators This is the default value e 0 The driver attempts to login to every port that it can access in the SAN and accept logins from all ports Note In a SAN that has other initiators this parameter greatly reduces the driver s use of hardware resources Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A gt lt EMULEX 5 NIC Driver Configuration 23 An Avago Technologies Company Using the NIC Configuration File elxnic conf 5 NIC Driver Configuration In Solaris 10 the driver exports certain parameters that can be configured by editing the Emulex NIC out of box driver for Solaris configuration file elxnic conf See NIC Configuration File Parameters on page 23 and Table 5 1 NIC Configuration File Parameters on page 24 In Solaris 11 while you can configure the driver using the elxnic conf file Emulex recommends using the dladm utility available by default on Solaris 11 systems For more information on using this Solaris NIC configuration utility see
36. 4 Run the installation script elxfc_ install 5 Reboot the system reboot Manual Installation 1 Log in as root 2 Download the p5p tar file from the Emulex website 3 Extract the p5p archive from the tar file tar xvf elxfc_p5p 2 10 4 x sll tar 4 Run the following command to install the package pfexec pkg install g elxfc_2 10 4 x sll p5p 5 Reboot the system reboot Note The emlxdrv utility must be used to bind the adapter to the elxfc driver For more information on the emlxdrv utility see the latest Emulex Solaris FCA Utilities User Manual NIC Out of Box Driver elxnic You can install the NIC out of box driver using one of two options e remote repository installation e pop archive installation Option 1 Remote Repository Installation 1 Log in as root 2 Add the Emulex IPS repository to the publisher list For example pkg set publisher O lt Emulex provided URL gt emulex 3 List all available versions of elxnic For example pkg list af elxnic NAME PUBLISHER VERSION IFO driver nic elxnic emulex 10 4 xx x 0 iss driver nic elxnic emulex 10 4 xy x 0 4 Install the elxnic driver pfexec pkg install elxnic By default the latest version of elxnic that is compatible with the rest of the image will be installed To install a specific version of elxnic append the package version to the package name as follows Emulex Drivers Version 10 6 for S
37. ASK LOG SFS 0x00002000 DESCRIPTION This indicates that a POST diagnostic has failed to return a positive result This is usually caused by an adapter hardware problem S M EVERITY LEVEL Error ESSAGE POST diagnostic failed ACTION Contact your customer service representative Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages 59 Log Messages for the FCoE Driver IOCTL Events Message IDs 1400 1499 1400 DEBUG IOCTL V ERBOS ESCRI OCTL E MASK LOG IOCTL 0x00004000 PTION This provides general information about the driver s interface D I SEVERITY LEVEL Debug M ESSAG BE IOCTL ACTION No action needed informational 1401 DEBUG IOCTL detail V D I S M ERBOS E MASK LOG IOCTL DETAIL 0x04000000 ESCRI OCTL PTION This provides detailed information about the driver s interface EVERITY LEVEL Debug ESSAG Es IOCTL detail ACTION No action needed informational 1410 DEBUG DFC ERBOSE MASK LOG IOCTL 0x00004000 ESCRIPTION This provides general information about the driver s FC interface EVERITY LEVEL Debug ESSAGE DFC ACTION No action needed informational 1411 DEBUG DFC det
38. BOSE MASK LOG FCSP 0x00020000 ESCRIPTION This indicates that authentication is being started to specific node EVERITY LEVEL Debug Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages 65 Log Messages for the FCoE Driver MESSAG Es FCSP start ACTION No action needed informational 1720 DEBUG FCSP comp VERBOS E MASK LOG FCSP 0x00020000 ESCRI PTION This indicates that authentication is being stopped or ted to a specific node TY LEVEL Debug ESSAG Es FCSP comp ACTION No action needed informational FCF Events Message IDs 1800 1899 1800 DEBUG FCF VERBOSE MASK DESCRIPTION This provides general information about the driver s FCF interface SEVERITY LEVEL Debug MESSAGE FCE ACTION No action needed informational 1801 DEBUG FCF detail D EF SEVERI M ERBOS E MASK PTION This provides detailed information about the driver s terface TY LEVEL Debug ESSAG E FCF detail ACTION No action needed informational 1810 DEBUG FCF error ERBOS E MASK ESCRI EVERI PTION This indicates that an error was found while processing request TY LEVEL Debug ESSA
39. C Default 4 firmware and driver OCe11102 Advanced xAPIC Default 2 Solaris and APIC in platform 0Ce11102 Advanced xAPIC 8 8 firmware and driver 0Ce11102 Advanced x2APIC Default 8 firmware and driver Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A An Avago Technologies Company Using the NIC Configuration File elxnic conf gt lt EMULEX 5 NIC Driver Configuration 28 Solaris 11 Solaris 11 is multi ring enabled by default It creates eight transmit rings and eight receive rings on OCe11102 devices in advanced mode To check the number of rx and tx rings use dladm show phys H In Table 5 3 the number 8 in column 5 is applicable only if the number of rx rings is increased to the maximum 16 Note On non IRM systems with multiple adapters the attach for few NIC functions may fail because of lack of interrupt vectors allowed at the default level To solve this issue use Table 5 3 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 11 on page 28 Table 5 3 shows how the value of ddi_msix_alloc_limit affects receive traffic distribution across CPU cores for Solaris 11 Table 5 3 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 11 Value of CPU cores ddi_msix_alloc_limit participating in NIC Mode APIC in etc system RX processing Limiting Factor 0Ce11102 Legacy XAPIC Default 2 Solaris and APIC in platform 0Ce11102 Legacy XAPIC
40. C Driver Log Messages Name MOD_MASK Meaning MOD_CONFIG 0x10000 Messages in the device configuration path are logged MOD_TX 0x20000 Messages in the transmit data path are logged MOD_RX 0x40000 Messages in the receive data path are logged MOD_ISR 0x80000 Messages in the interrupt path are logged a MOD_MASK is a bitmap of one or more of these values Table 8 2 details the values and meanings of SEVERITY in the log_level parameter Table 8 2 Severity Level Information for NIC Driver Log Messages Name SEVERITY Value Meaning CE_CONT 0x0 Continuation CE_NOTE 0x1 Information CE_WARN 0x2 Warning CE_PANIC 0x3 Causes the operating system to panic CE_IGNORE 0x4 No action Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 8 NIC Driver Log Messages Log Messages for the NIC Driver DG EMULEX 68 An Avago Technologies Company Log Messages for the NIC Driver For Solaris 10 Table 8 3details the log messages provided by the NIC driver for Solaris 10 operating systems Table 8 3 Log Messages for the NIC Driver for Solaris 10 Log Message Recommended Action MOD_MASK SEVERITY Insufficient Vectors Reload the driver after changing MOD_CONFIG CE_WARN the interrupt priorities lt code gt POST ERROR Hardware error Download the MOD_CONFIG_ CE_WARN same firmware image to the adapter and reboot replace the adap
41. D driver s library S M ACTION No action needed informational 1510 ERROR Bad firmware image VERBOSE MASK LOG FIRMWARE 0x00008000 D to the download function SEVERITY LEVEL Error M ESSAGE Bad firmware image ACTION Obtain the proper image file If the problem persists report this error to your customer service representative 1511 ERROR Firmware image not compatible VERBOSE MASK LOG FIRMWARE 0x00008000 D compatible with the existing hardware SEVERITY LEVEL Error M ESSAGE Firmware image not compatible ACTION Obtain the proper image file If the problem persists report this error to your customer service representative DESCRIPTION This provides general information about the firmware i ESCRIPTION This provides detailed information about the firmware ESCRIPTION This shows the versions of firmware contained in the ESCRIPTION This indicates that a bad firmware image was provided ESCRIPTION This indicates that the firmware image provided was not P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages Log Messages for the FCoE Driver 61 1520 NOTICE Firmware download VERBOSE MASK LOG FIRMWARE 0x00008000 DESCRIPTION This indicates that an attempt to download a firmware image has occurred
42. Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A
43. E For details on MOD_MASK and SEVERITY see Setting MOD_MASK and SEVERITY on page 67 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 5 NIC Driver Configuration 25 Using the NIC Configuration File elxnic conf Table 5 1 NIC Configuration File Parameters Continued Parameter max rx rings Definition Sets the maximum number of receive queues Possible values are e 1to 5 OCe11102 The default value is 5 e 1to 16 OCe11102 in advanced mode on Solaris 10 The default value is 8 e 1 to 16 OCe11102 in advanced mode on Solaris 11 The default value is 8 The actual number of transmit and receive queues that are created depends on the number of vectors allocated The actual number can be checked using the ndd 1m command on Solaris 10 or the dladm 1M command on Solaris 11 For more information run man ndd on Solaris 10 or man dladm on Solaris 11 On non IRM capable machines with FLEX10 or multi adapter setup some of the functions may fail to attach because of a lack of interrupts See Changing Interrupt Priorities on page 29 for more information max tx rings Sets the maximum number of transmit queues The possible values are e 1 for OCe11102 in legacy mode e 1 to 8 for OCe11102 in advanced mode on Solaris 10 The default value is 8 e 1 to 16 for OCe11102 on Solaris 11 The default value is 8 rss_key static Enable
44. E Parameters escclvsciccece viele suvemurciewsw LEELEE EEA dvs dee ewe 30 Private or Unlisted Parameters sssessesesssesesecsesososesecsessssessseseocsesessesooo 31 Creating a Virtual NIC Using dladm ssssssssesssesssssessssesesssessssesesssseesssseees 31 6 Troubleshooting ssitassissdanaciseasasiacedessdeunsasisuswaniorenand ieda ainnean i 33 Solaris 11 elxfc Driver Installation Situation ssssessssesesssssssssossssesesssessss 33 7 FCoE Driver Console and Log Messages ssesecsecsecsecsecsecsecsecsecsecoecsecoe 34 Setting Notices Warnings and Error Logging Levels csscccssssccccssssccecceces 34 Log MESSAGES viiciciveseccceciesiiedceciessveddiwtesseeucaeewesteudreiwesiencicewesveuteceedevencsetws 34 Types of Log Messages Logged in the System File sssssssssnssesesesssesossssesessse 34 Log Message Severity Levels ssssssssssssssseessesssesssssessssesreseereesesesesseee 35 Log MESSAGE EXAMPLES waded noun ners isese siniste ea senii nE E EEE EEEE EEN aa 36 Log Messages for the FCoE Driver ssscccsscccccssscccccccsccccesssscccscsssscsssesssees 37 Miscellaneous Events Message IDs 0001 0099 ssssssesssssssssessesesssssessssee 37 Driver Events Message IDs 0100 0199 ssssnsssnesssssssessssessssesesssseseesessssess 38 Adapter Initialization Events Message IDs 0200 0299 ssssssssssssssesssesssess 40 Memory Management Events Message IDs 0300 0399
45. ESCRI I O EVERI E MASK LOG PKT 0x00000200 PTION This indicates that I O s are getting stale waiting on channel tx queue TY LEVEL Debug ESSAG E CHANNEL watchdog ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 0912 DEBUG TXQ watchdog VERBOSE MASK LOG PKT ESCRIPTION ransmit queue D t SEVERITY LEVEL MESSAGE TXQ watchdog Debug ACTION No action needed 0x00000200 informational 0920 DEBUG Packet flush VERBOSE MASK LOG PKT DESCRIPTION SEVERITY LEVEL MESSAGE ket flush Debug Pac ACTION No action needed 0x00000200 informational 0921 DEBUG Packet flushed VERBOSE MASK LOG PKT DESCRIPTION SEVERITY LEVEL MESSAGE Debug Pac 0x00000200 ket flushed ACTION No action needed informational 0922 NOTICE Packet flush timeout VERBOSE MASK LOG PKT ESCRIPTION out wi ttempt EVERITY LEVEL ESSAGE Packet flush ACTION persists to recove Notice No action needed report this error to your customer servic 0x00000200 r by itself timeout 0930 NOTICE Packet transport failed ACTION No action n
46. Enables the handling of transmit completions in interrupt mode The possible values are 0 disabled or 1 enabled The default value is 0 Note Enable this parameter if you observe frequent frame loss Also consider using this in conjunction with rx_max_bufs Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A gt lt EMULEX 5 NIC Driver Configuration 26 An Avago Technologies Company Using the NIC Configuration File elxnic conf Configuring the NIC Interface The NIC interface must be created before you can configure it You can verify that the driver is loaded on the system and the NIC interface is created with one of the following commands dladm show dev Solaris 10 driver dladm show phys Solaris 11 driver After you have determined that the NIC interface has been created you can proceed to configure it To configure the NIC interface s 1 Plumb the interface ifconfig elxnic lt X gt plumb Solaris 10 driver ifconfig net lt X gt plumb Solaris 11 driver Where lt X gt is the interface number To see the created interfaces run dladm show link The dladm show link command lists all the interfaces in the system 2 Assign a static IP address ifconfig elxnic lt xX gt lt IP_Address gt netmask lt NetMask gt up Solaris 10 driver ifconfig net lt x gt lt IP Address gt netmask lt NetMask gt up Solaris 11 driver 3 Edit the etc hosts file a symlink to etc ine
47. FCA Utilities User Manual which is available on the Emulex website 2 Retry the elxnic installation This ensures a successful package installation and will automatically bind the NIC driver Uninstalling the Drivers for Solaris 11 FCoE Driver You can uninstall the FCoE out of box driver by using scripted removal or manual removal Scripted Removal 1 Log in as root Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A XG EMULEX 2 Installing and Uninstalling 15 An Avago Technologies Company Uninstalling the Drivers for Solaris 11 2 Run the following command to remove elxfc from the system elxfc_remove 3 Reboot the system Type reboot The script is included in the downloadable p5p tar file that can be retrieved from the Emulex website The scripted uninstall also cleans up the files in the installation directory Manual Removal 1 Log in as root 2 Run the following command to remove elxfc from the system pkg uninstall elxfc 3 Reboot the system reboot NIC Driver To uninstall the NIC out of box driver 1 Log in as root 2 Remove the out of box driver by typing pkg uninstall lt driver name gt For example pkg uninstall elxnic 3 Reboot the system Scripted Removal 1 Log in as root 2 Run the following command to remove elxnic driver by typing elxnic_remove 3 Reboot the system Emulex Drivers Version 10 6 for Solaris Us
48. G BE FCF error ACTION No action needed informational 1820 DEBUG FCF state V D S M PTION This indicates that an FCF object state is changing TY LEVEL Debug ERBOSE MASK ESCRI EVERI ESSAGE FCF state ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A DE EMULEX 7 FCoE Driver Console and Log Messages 66 An Avago Technologies Company Log Messages for the FCoE Driver 1830 DEBUG FCF event VERBOSE MASK DESCRIPTION This indicates that an FCF event has occurred SEVERITY LEVEL Debug MESSAGE FCF event ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 8 NIC Driver Log Messages 67 Setting MOD_MASK and SEVERITY 8 NIC Driver Log Messages This section describes the log messages you may see from the NIC driver Note To reset the adapter reboot the system Setting MOD_MASK and SEVERITY Log messages are generated based on the settings of the Module Mask MOD_MASK and the Severity Level SEVERITY as indicated in the log_level parameter See the log_level parameter in Table 5 1 NIC Configuration File Parameters on page 24 Table 8 1 details the values and meanings of MOD_MASK in the log_level parameter Table 8 1 MOD_MASK Information for NI
49. IC interface and also perform a runtime update of the following driver parameter For example to change the MTU in Solaris 11 unplumb the interface and run S gt dladm set linkprop p mtu 9000 lt interface gt where lt interface gt is net lt 0 1 2 gt To see the plumbed interfaces run S gt ifconfig a Tunable Parameters Tunable parameters can be changed during runtime On Solaris 10 the ndd command can be used to change the value of tunable parameters On Solaris 11 these values can be changed using the dladm command The parameters on Solaris 11 are named differently They include a prefix of _ to each of the parameter names Through the dladm utility the following tunable parameters are provided by the driver along with their usage log_level gt dladm set linkprop p log level lt value gt lt interface gt Note See Setting MOD_MASK and SEVERITY on page 67 for log_level values rx_bcopy_limit gt dladm set linkprop p rx bcopy limit lt value in bytes gt lt interface gt tx_bcopy_limit gt dladm set linkprop p tx _bcopy limit lt value in bytes gt lt interface gt tx_ring_size gt dladm set linkprop p tx ring size lt values between 256 and 2048 gt lt interface gt Or gt dladm set linkprop p tx ring size lt values less than tx ring size gt lt interface gt Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULE
50. MOD_CONFIG CE_WARN RQ ring create failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN RQ shadow ring alloc failed Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN soft _reset bit asserted 1 Reset failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Emulex Drivers Version 10 6 for Solaris User Manual MOD_CONFIG P011396 01A Rev A CE_WARN 79 gt lt EMULEX 8 NIC Driver Log Messages 80 An Avago Technologies Company Log Messages for the NIC Driver Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued Log Message Recommended Action MOD_MASK Severity UE Detected or FW Dump is Reboot the system MOD_CONFIG CE_WARN requested SLIPORT ERR1 lt code gt and SLIPORT ERR2 lt code gt Unable to get intr priority Reload the driver MOD_CONFIG_ CE_WARN Failed to create an interface Upgrade the firmware to the correct MOD_CONFIG CE_WARN VPORT_SRIOV staus lt code gt version Failed to create an interface VPORT NORMAL staus lt code gt WCCQ
51. RNA ER 18 NPIV and Operating System Virtualization sssssssssssssssssesessssssseesessssssseeeee 18 Using VPorts with Oracle VM Server for Solaris Containers or Oracle VM Seryer for 86 veviscaveescdvs sss E so renr EE EE EISE EEEE IEEE ES VEEE EE EEEE ENEE 19 FCoE Configuration File Parameters essssesesseseccssseccssseccceecesoseecosssesoeseee 19 5 NIC Driver COnMGULALION siciixendctensersecnapsendeaeeasedadanetiadeaweenneiaaneateadeewada 23 Using the NIC Configuration File elxnic conf sssssessssesessscscossseccosscesoseseo 23 Changing Driver ParametersS ssessesssescsesecocsssccesesecossesossseccsssscossesoeese 23 NIC Configuration File Parameters cccccccceeessccccessccceeetsccceesssseceeeeseees 23 Configuring the NIC Interface ssssssssessssssesssseessssesssssesserseesesesesssseees 26 Removing the NIC Interface using elxniC sssssesssesssssesssssossssesssssesssseerssse 26 Multi ring Mode and the Effect of ddi_msix_alloc_limit s nssesseessesssesseesseo 27 SOLAS 10 P A O A A E T E E teeaadeasamerseaneet 27 SOLAS 11 sersorrerss s rst nra EEEE ENEO adden EEE E SEENEN VEREN EEEE 28 Changing Interrupt Priorities sssssssssessesesesssesossesesessecessesosseseseeseesee 29 Using the dladm Utility for Solaris 11 ssssesessssssosssesosssesossesosssecessseesosesoe 30 Configuring the NIC Interface Using dladm nssssssnssssesesssessssseesssesesssseee 30 TUNABL
52. SPARC is not supported See the Emulex website for the latest supported operating systems Supported Adapters and Firmware For adapters that are compatible with the Emulex FCoE and NIC drivers see the driver s Downloads page on the Emulex website For compatible firmware versions see the Downloads page for the specific adapter The NIC driver supports the Solaris Ethernet stack including NIC virtualization Crossbow vSwitch and vRouter Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 7 SG EMULEX An Avago Technologies Company Abbreviations APIC ASCII CLI CNA CPU DHCHAP DR FC FCA FCIO FC IP FCoE FCTL FW Gbps GFC GUID HBA HW IOCTL IOV IPS IRM IRQ LACP MSI X MTU NIC NPIV OS PCI PF POST SCSI SFS Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 1 Introduction Abbreviations advanced programmable interrupt controller American Standard Code for Information Interchange command line interface Converged Network Adapter central processing unit Diffie Hellman Challenge Handshake Authentication Protocol dynamic reconfiguration Fibre Channel Fibre Channel adapter FC input output Fibre Channel over IP Fibre Channel over Ethernet FC transport library firmware gigabits per second gigabit Fibre Channel Globally Unique Identifier host bus adapter hardware input output control I O virtualization Solaris Image Packaging System inter
53. UNCTION RESET FAILED rc Check for the faulty hardware MOD_CONFIG_ CE_WARN lt code gt using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Hardware UE Detected lt code gt Check for the faulty hardware MOD_CONFIG CE_WARN using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit HW Initialization Failed Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot replace the adapter if necessary HW POST FAILED Reset the adapter MOD_CONFIG CE_WARN Insufficient Vectors Reload the driver after changing MOD_CONFIG CE_WARN the interrupt priorities Invalid q length Must be Correct the tx q length in the MOD_CONFIG CE_WARN 256 512 1024 2048 lt code gt elxnic conf file Invalid rx frag size lt code gt Correct the rx_frag_size in the MOD_CONFIG_ CE_WARN valid values are 2K 4K 8K _ elxnic conf file 16K only IRM action lt code gt count lt code gt Reboot the system MOD_CONFIG_ CE_WARN ddi_intr free failed re lt ret_code gt Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies
54. X An Avago Technologies Company 5 NIC Driver Configuration 34 Using the dladm Utility for Solaris 11 Private or Unlisted Parameters Private or unlisted parameters can be set during driver attach through the dladm utility and also the elxnic conf file To see the value of private driver parameters using the dladm utility type gt dladm show linkprop p lt property name gt lt interface gt The driver provides the following private parameters e fw_version e log_level e rx_bcopy_limit e rx_ring_size e rx_rings e rx_rings_per_group e tx_bcopy_limit e tx_reclaim_threshold e tx_ring_ size e tx_rings_fw_version read only Creating a Virtual NIC Using dladm To create a vNIC use the dladm utility with the create vnic option For example dladm create vnic 1 net0 vnicl After a vNIC is created it can be assigned to a zone using the zonecfg utility For example zonecfg z zonel zonecfg zonecfg zonecfg zonecfg zonecfg zonecfg zonecfg zonecfg zonecfg zonel zonel gt No such zone configured create zonel gt zonel gt zonel gt zonel gt zonel gt zonel gt zonel gt set zonepath export zonel create add net set physical vnicl set address 192 168 1 100 verify commit Up to 63 VLANs can be used with each UMC virtual channel For information on configuring UMC refer to the Emulex Universal Multi Channel Reference Guide which is availa
55. _MASK MOD_CONFIG Severity CE_WARN OCE INITIATE DUMP failed due to recovery timeout Device Recovery failed after Diagnostic Dump initiation Reboot the system MOD_CONFIG CE_WARN oce _ isr EQ Not started Unplumb and plumb the device If the error persists reload the driver MOD_CONFIG CE_WARN oce rx no frags The system cannot receive data because the driver is low on resources Reload the driver If the same error recurs reset the adapter MOD_RX CE_WARN PCI initialization failed Reset the adapter MOD_CONFIG CE_WARN POST ERROR Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MOD_CONFIG CE_WARN Ring buffer allocation failed lt code gt Configure the server with more memory MOD_CONFIG CE_WARN RQ bdesc alloc failed status lt code gt Low system resources Repeat the operation that generated the log If the error log is generated again reboot the system MOD_CONFIG CE_WARN RQ create failed Check for the faulty hardware using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit
56. ail E MASK LOG IOCTL DETAIL 0x04000000 PTION This provides detailed information about the driver s ERBOS ESCRI FC interface EVERITY LEVEL Debug ESSAG E DFC detail ACTION No action needed informational 1420 DEBUG DFC Error V D a S M E MASK LOG IOCTL 0x00004000 PTION This indicates that an error was found while processing ERBOS ESCRI DFC request EVERITY LEVEL Debug ESSAGE DFC Error ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages 60 Log Messages for the FCoE Driver Emulex Drivers Version 10 6 for Solaris User Manual Firmware Download Events Message IDs 1500 1599 1500 DEBUG Firmware image VERBOSE MASK LOG FIRMWARE 0x00008000 mage EVERITY LEVEL Debug S MESSAGE Firmware image ACTION No action needed informational 1501 DEBUG Firmware detail VERBOSE MASK LOG FIRMWARE DETAIL 0x10000000 D i SEVERITY LEVEL Debug MESSAGE Firmware detail ACTION No action needed informational 1502 NOTICE Firmware Library VERBOSE MASK LOG DRIVER 0x00000002 EVERITY LEVEL Notice ESSAGE Firmware Library
57. aulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Could not find the MAC lt mac addr gt Provide the correct MAC address MOD_CONFIG CE_WARN Could not get size of bar Reset the adapter MOD_CONFIG CE_WARN Could not get supported intrs Reload the driver MOD_CONFIG_ CE_WARN Could not map bar Reset the adapter MOD_CONFIG CE_WARN Could not retrieve num bars Reset the adapter MOD_CONFIG CE_WARN Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 73 SG EMULEX An Avago Technologies Company Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Recommended Action MOD_MASK Severity CQ allocation failed Low system resources Repeat the MOD_CONFIG_ CE_WARN operation that generated the log If the error log is generated again reboot the system CQ create failed status lt code gt Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit CQ ring alloc failed Low
58. ble on the Emulex website Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A gt lt 5 NIC Driver Configuration 32 EMULEX Using the dladm Utility for Solaris 11 An Avago Technologies Company Considerations e UMC can be configured using the OneCommand Manager application CLI For more information refer to the OneCommand Manager Command Line Interface User Manual which is available on the Emulex website e Using UMC in a hypervisor environment is not advised if the UMC interface is going to be part of the hypervisor virtual switch This configuration may cause performance issues e You cannot run LACP if UMC is enabled Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 6 Troubleshooti 6 Troubleshooting 33 ng This section explains some of the situations in which your system may operate in an unexpected manner and some possible resolutions to unexpected behavior Solaris 11 elxfc Driver Installation Situation Table 6 1 lists a Solaris 11 elxfc driver installation situation and the resolution Table 6 1 Solaris 11 elxfc Driver Installation Situation and the Resolution Situation An older elxfc SVR4 style package is installed on a system that is already running a different package version installed with IPS p5p Note See FCoE Out of Box Driver elxfc on page 10 for older installation instructions Resolut
59. ccescccceeessscceeeees 35 MOD_MASK Information for NIC Driver Log Messages ceeeeeceeeeeeeeeeees 67 Severity Level Information for NIC Driver Log Messages seceeeeeeeeeeees 67 Log Messages for the NIC Driver for Solaris 10 cccceeeececeeeeeeeeeeeeees 68 Log Messages for the NIC Driver for Solaris 11 cceceeeseeceeeeeeeeeeeeees 73 P011396 01A Rev A List of Tables 6 gt G EMULEX 1 Introduction 1 Introduction This document provides information for using the Emulex Fibre Channel over Ethernet FCoE out of box drivers for Solaris StorEdge SAN Foundation Software SFS which is part of the SFS Leadville stack The module name for this FCoE driver is elxfc This document also provides information for using the Emulex network interface card NIC out of box driver for Solaris which operates the NIC function of the Emulex OneConnect adapters The module name for this NIC driver is elxnic Supported Operating Systems One of the following operating systems must be installed e Solaris 10 x64 e Solaris 11 x64 Notes e For the FCoE elxfc driver Solaris 11 1 or 11 2 is required For earlier updates of Solaris 11 use the earlier version of elxfc posted on the Emulex website e For the most current FC driver see the latest Oracle updates e For the NIC elxnic driver Solaris 10 and Solaris 11 are supported Emulex recommends using the latest Oracle updates e
60. ceceecececeeeeeeeeeees 41 Service Level Interface Events Message IDs 0400 0499 cece cee eecee eee ee eee ees 43 Mailbox Events Message IDs 0500 0599 cscccessesccceesscccccesssceceeesacees 47 Node Events Message IDs 0600 0699 ceccccc ee ecee eect ects eeneeeeenseeeeeeees 48 Link Events Message IDs 0700 0799 cccccc cece eeecseeeeeeeeeeeeeeeeeesssaaaenenes 50 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A gt G EMULEX Table of Contents 5 An Avago Technologies Company ELS Events Message IDs 0800 0899 nsssssssssssssssssesssssssessesssessssseesssesss 51 General I O Packet Events Message IDs 0900 0999 cee eee cess eee eeneeeees 53 FCP Traffic Events Message IDs 1000 1099 ccccceesssccccessccceeessceeeeesees 55 IP Traffic Events Message IDs 1200 1299 cccccccccesescccceesceeeeeeescceeensees 56 Solaris SFS Events Message IDs 1300 1399 cece eccccceesceeeetsccceeeesseceeees 57 IOCTL Events Message IDS 1400 1499 sssssssssssssssesssssssssesosessesosesessesseeo 59 Firmware Download Events Message IDs 1500 1599 cece cece e eee eeeeeeeeees 60 Common Transport Events Message IDs 1600 1699 cece cece eee eee ee eeeeee 62 FCSP Events Message IDs 1700 1799 cccccc cece eee eeeeee ee eee eee eeeeeeeeeeeeeeeees 63 FCF Events Message IDs 1800 1899 0 occ cece cece e
61. d ACTION No action needed informational 0460 DEBUG SLI VERBOSE MASK LOG SLI DETAIL 0x80000000 DESCRIPTION This provides detailed information about an SLI event SEVERITY LEVEL Debug MESSAGE SLI detail ACTION No action needed 0461 ERROR SLI ERROR ERBOSE MASK LOG SLI ESCRIPTION SEVERITY LEVE MESSAGE SLI ACTION No ac V D This error BEPrOr ERROR tion neede 0462 DEBUG SLI DEBUG ERBOSE MASK LOG SLI ESCRIPTION SEVERITY LEV Debug MESSAGE SLI DEBUG ACTION No action neede V D This provi EL informational 0x00000010 provides information about an SLI event d informational 0x00000010 des debug information about an SLI event d informational Mailbox Events Message IDs 0500 0599 0500 DEBUG Mailbox event V D ERBOSE MASK LOG MBOX ESCRIPTION SEVERITY LEV MESSAGE ACTION No action neede This indic EL Debug Mailbox event 0x00000020 ates that a mailbox event has occurred d informational 0501 DEBUG Mailbox detail V ERBOS Emulex Drivers Version 10 6 for Solaris User Manual E MASK LOG MBOX_ D ETAIL 0x40000000 P011396 01A Rev A 5E EMULEX 7 FCoE Driver Console and Log Messages 48 An Avago Technologies Company Log Messages fo
62. d to add interrupt Reload the driver MOD_CONFIG_ CE_WARN handlers Failed to allocate bmbx size Reload the driver MOD_CONFIG_ CE_WARN lt code gt Failed to allocate Queue Increase the memory MOD_CONFIG CE_WARN memory Failed to Configure the Reboot the system MOD_CONFIG CE_WARN Adapter Failed to create WQ ring Increase the memory MOD_CONFIG CE_WARN Failed to del q status Reboot the system MOD_CONFIG_ CE_WARN lt status code gt Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 69 8 NIC Driver Log Messages Log Messages for the NIC Driver DG EMULEX 70 An Avago Technologies Company Table 8 3 Log Messages for the NIC Driver for Solaris 10 Continued Log Message Recommended Action MOD_MASK SEVERITY Failed to init stats Reboot the system MOD_CONFIG CE_WARN Failed to init tx rx rings Reboot the system MOD_CONFIG_ CE_WARN Failed to read MAC address Check for the faulty hardware MOD_CONFIG_ CE_WARN status lt status code gt using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to register mac Reboot the system MOD_CONFIG_ CE_WARN Failed to setup interrupts Reload the driver after changing MOD_CONFIG CE_WARN the interrupt priorities F
63. e adapter MOD_CONFIG CE_WARN with rc lt code gt Pending buffers lt code gt cannot Reboot the system MOD_CONFIG_ CE_WARN destroy RQ lt code gt cache Ring buffer allocation failed Increase the memory MOD_CONFIG CE_WARN RQ bdesc alloc failed Increase the memory MOD_CONFIG_ CE_WARN RQ Buffer Pool create failed Increase the memory MOD_CONFIG CE_WARN RQ create failed lt code gt Hardware error Download the MOD_CONFIG CE_WARN same firmware image to the adapter and reboot replace the adapter if necessary RQ ring create failed Hardware error Download the MOD_CONFIG_ CE_WARN same firmware image to the adapter and reboot replace the adapter if necessary RQ shadow ring alloc failed Increase the memory MOD_CONFIG_ CE_WARN SLIPORT Error Detected Check for the faulty hardware MOD_CONFIG_ CE_WARN SLIPORT ERROR1 lt code gt using fmadm faulty If the SLIPORT ERROR2 lt code gt hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit WQ Buffer Pool create failed Increase the memory MOD_CONFIG_ CE_WARN WQ create failed lt code gt Hardware error Download the MOD_CONFIG_ CE_WARN same firmware image to the adapter and reboot replace the adapter if necessary WQ MAP Handles Pool create Increase the memory MOD_CONFIG CE_WARN failed WQ Packet Desc Pool create Increase the memory
64. eceived from the dapter with an illegal value This error could indicate a driver or EVERITY LEVEL Error D a firmware problem S M ESSAG E IOCB invalid ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 0451 DEBUG IOCB queue full V D fe S M ERBOS E MASK LOG SLI 0x00000010 ESCRI EVERI PTION This indicates that the IOCB queue is full This will ccur during normal operation TY LEVEL Debug ESSAG EF IOCB queue full ACTION No action needed informational 0452 DEBUG IOCB event V D ERBOS E MASK LOG SLI 0x00000010 ESCRI PTION This indicates that an IOCB local error event is being reported by the adapter Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company S EL M Debug EVERITY LEV ESSAGE IOCB event ACTION No action needed 0453 DEBUG IOCB stale E MASK LOG SLI PTION VERBOS ESCRI ssociated EVERITY LEV ESSAGE IOCB stale EL Debug D a S M 7 FCoE Driver Console and Log Messages Log Messages for the FCoE Driver 47 informational 0x00000010 This indicates that an IOCB completed after its packet complete
65. ee eeee cece eee eeeeeeeeeeeeeeeees 65 8 NIC Driver Lod MeCSSAGES escsicosevsisisecsesrssoseissssinceoreisos susse otosi stines sdsdi 67 Setting MOD_MASK and SEVERITY swscssvicccessccusnceewsceuvnceesccenendencvececvaceevesesvessas s 67 Log Messages for the NIC Driver esssssesscsssecseseccssseccssseccceecesoseecosssesoeseeo 68 F r Solaris 10 croinn TEn EENE EO EE EEEE 68 For Solaris 1 csrirosircissnirisii uiris inke na Kika TiK ERNE GEESE EEKE EKEN is 73 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company List of Tables Table 4 1 Table 5 1 Table 5 2 Table 5 3 Table 6 1 Table 7 1 Table 7 2 Table 7 3 Table 8 1 Table 8 2 Table 8 3 Table 8 4 Emulex Drivers Version 10 6 for Solaris User Manual FCoE Configuration File Parameters sssssssssossssesessecsssssosseseseesserees 19 NIC Configuration File Parameters ccccsccccessccceeeesccceesssseceeeeseees 24 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 10 27 Effect of ddi_msix_alloc_limit across CPU Cores for Solaris 11 28 Solaris 11 elxfc Driver Installation Situation and the Resolution 33 Setting Types of Console and Log Messages for the FCoE Driver 34 Log Message Types for the FCoE Driver cccccsscccccceesccceeeescceeeeesees 34 Severity Levels of FCoE Driver Log Messages ccceescc
66. eeded VERBOSE MASK LOG PKT DESCRIPTION failed SEVERITY LEVEL Notice MESSAGE Pac 0x00000200 ket transport failed 0931 ERROR Packet transport error VERBOS DESCRI E MASK LOG PKT 0x00000200 informational informational 7 FCoE Driver Console and Log Messages Log Messages for the FCoE Driver 54 This indicates that an I O was found missing from the This indicates that an I O packet is being flushed This indicates that an I O packet has been flushed This indicates that an I O packet flush request has th some I O packets s still not completed The driver if the problem representative However This indicates that an attempt to send an I O packet The I O packet will be retried by the upper layer PTION This indicates that an error occurred while attempting to send an I O packet The I O packet will likely be failed back to the user application Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company SE 7 FCoE Driver Console and Log Messages 55 Log Messages for the FCoE Driver VERITY LEVEL Error ME iSSAGE Packet transport error ACTION persis No action needed informational However if the problem ts report this error to your customer service representative 0932 DEBUG Packet transport VERBOSE MASK LOG PKT 0x00000200 ESCRI
67. er Manual P011396 01A Rev A gt EMULEX 3 Utilities for Solaris Drivers 16 3 Utilities for Solaris Drivers Emulex provides three utilities to facilitate configuring and using the Solaris drivers e emlxdrv utility included in the FCA utilities e emlxadm utility included in the FCA utilities e OneCommand Manager application Note When you install the OneCommand Manager application also install the Solaris FCA Utilities OneCommand Manager Application The OneCommand Manager application provides the functionality of the emlxadm utility along with additional features allowing you to remotely manage multiple systems It offers a choice of a graphical user interface and a scriptable command line interface It is a direct user interface to the FCIO interface provided by the Oracle StorEdge SFS The FCIO interface provides an Oracle common IOCTL interface to the FCTL which manages the FCA drivers for each FCoE adapter attached to the host system The OneCommand Manager application also directly interfaces with the Emulex network driver allowing you to manage the NIC function of Emulex adapters For more information see the OneCommand Manager Application User Manual which is available on the Emulex website emlxadm Utility The emlxadm utility changes driver parameters through a local interactive or CLI mode It can also update firmware on non Oracle branded devices For more information see the Solaris FCA Utilities User Manua
68. ersists report this error to your customer servic 1540 WARNING Firmware update required 0x00008000 V ERBOS E MASK LOG FIRMWARE Emulex Drivers Version 10 6 for Solaris User Manual representative P011396 01A Rev A 5E EMULEX 7 FCoE Driver Console and Log Messages 62 An Avago Technologies Company Log Messages for the FCoE Driver ESCRIPTION This indicates that a firmware update is required on he adapter D SEVERITY LEVEL Warning M ESSAGE Firmware update required ACTION The user must perform a manual adapter reset or link reset once the host environment is stable to trigger an automatic firmware download Do not power cycle or reboot the system during the download operation Common Transport Events Message IDs 1600 1699 1600 DEBUG CT sent VERBOSE MASK LOG CT 0x00010000 DESCRIPTION This indicates that a CT command is being sent SEVERITY LEVEL Debug MESSAGE CT sent ACTION No action needed informational 1601 DEBUG CT comp VERBOSE MASK LOG CT 0x00010000 DESCRIPTION This indicates that a CT command completed normally SEVERITY LEVEL Debug MESSAGE CT comp ACTION No action needed informational 1610 ERROR Stray CT completion VERBOSE MASK LOG CT 0x00010000 DESCRIPTION This indicates that a CT command completion was received w
69. ev A 77 SG EMULEX An Avago Technologies Company Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver Log Message Recommended Action MOD_MASK Severity Legacy MQ create failed Check for the faulty hardware using MOD_CONFIG_ CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Legacy MQ ring alloc failed Low system resources Repeat the MOD_CONFIG_ CE_WARN operation that generated the log If the error log is generated again reboot the system Failed to read MAC address Check for the faulty hardware using MOD_CONFIG CE_WARN status fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit MAC allocation Failed Unload and then reload the driver MOD_CONFIG CE_WARN MAC registration failed Unload and then reload the driver MOD_CONFIG CE_WARN MAC unregister failed Detach Reboot the system MOD_CONFIG_ CE_WARN failed Mailbox initialization failed Check for the faulty hardware using MOD_CONFIG CE_WARN with lt ret code gt fmadm faulty If the hardware is faulty acquit
70. figuration File Parameters Continued Parameter adisc support Description Sets the driver level support for the FC ADISC login I O recovery method e 0 No support Flushes active I Os for all FCP target devices at link down e 1 Partial support Flushes I Os for non FCP2 target devices at link down e 2 Full support Holds active I Os for all devices at link down Activation Dynamic assign alpa If multiple adapter instances on the same host are on the same loop set this property differently for each adapter Possible values are 0x00 0x0ef A 0x00 setting default means no preference Note This property is only applicable if the topology is set to loop Link reset console errors Verbose mask for driver error messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 Dynamic console notices Verbose mask for driver notice messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 Dynamic console warnings Verbose mask for driver warning messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 Dynamic cr count Specifies a count of I O completions after an interrupt response is generated The possible values are 1 255 The default value is 1 Note This property is disabled if cr delay 0 Link reset cr delay Specifies a count in milliseco
71. g the emlxdrv utility For more information on the emlxdrv utility see the latest Emulex Solaris FCA Utilities User Manual 2 Retry the elxnic installation This ensures a successful package installation and will automatically bind the NIC driver Uninstalling the Drivers for Solaris 10 FCoE Driver To uninstall the FCoE out of box driver 1 Log in as root 2 Remove the out of box driver by typing pkgrm lt OOB pkg name gt For example pkgrm EMLXelxfc 3 Reboot the system NIC Driver To uninstall the NIC out of box driver 1 Log in as root 2 Remove the out of box driver by typing pkgrm lt nic_ pkg name gt For example pkgrm EMLXelxnic 3 Reboot the system Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A XG EMULEX 2 Installing and Uninstalling 12 An Avago Technologies Company Installing the Drivers for Solaris 11 Installing the Drivers for Solaris 11 This section details the procedures for installing the drivers for Solaris 11 FCoE Out of Box Driver elxfc You can install the FCoE out of box driver for S11 1 using one of two options e Remote Repository Installation e P5P Archive Installation Option 1 Remote Repository Installation 1 Log in as root 2 Add the Emulex IPS repository to the publisher list For example pkg set publisher O http lt Emulex provided URL gt emulex 3 List all available versions of elxfc For example
72. grep elxnic etc path to inst pci 0 0 pci8086 340d 6 pcil0df e743 0 0 elxnic pci 0 0 pci8086 340d 6 pcil0d f e743 0 1 1 elxnic pci 0 0 pci8086 3410 9 pcil0df e742 0 2 elxnic pci 0 0 pci8086 3410 9 pcil0df e742 0 1 3 elxnic grep elxnic etc driver aliases elxnic pciex19a2 710 Note In the previous example pci n n pcinnnn nnnd n represents the parent of the PCI function the unit number follows the last symbol and pciexnnan nnn indicates the device name 2 Add the following entry to kernel drv elxnic conf name pciexl9a2 710 parent pci 0 0 pci8086 34109 unit address 0 interrupt priorities 5 Note The path and unit number may vary on your system 3 Reboot the system Interrupt priorities can be examined using the mdb command For example echo interrupts mdb k grep oce The third column shows the interrupt priority level of the vector in the following output IRQ Vect IPL Bus Trg Type CPU Share APIC INT ISR s 64 0x42 5 Edg MSI X 3 1 oce_isr 65 0x43 5 Edg MSI X 0 1 oce_isr Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A gt lt EMULEX 5 NIC Driver Configuration 30 An Avago Technologies Company Using the dladm Utility for Solaris 11 Using the dladm Utility for Solaris 11 Configuring the NIC Interface Using dladm To configure the interface on Solaris 11 Use the dladm utility to configure the N
73. iguration File elxfc conf The configuration file contains all the parameters necessary to initialize the Emulex SFS FCA out of box driver Changing Driver Parameters The configurable driver parameters are defined in Table 4 1 FCoE Configuration File Parameters on page 19 To change driver parameters 1 Open the configuration file in a text editor 2 Change the parameters to the desired settings 3 Save the file 4 Ifthe driver is already loaded you must unload and reload the driver to implement your changes For more information see Installing and Uninstalling on page 10 To determine the requirement for the parameter change to take effect see the Activation column in Table 4 1 FCoE Configuration File Parameters on page 19 Configuring NPIV Support This section details the procedure for configuring NPIV support Enabling NPIV Support on Solaris 10 To enable NPIV support in the driver 1 Login as root or su to root 2 Set enable npiv 1 in the configuration file 3 The FC port fp driver parameters are updated when the Emulex emlxu utilities package EMLXemlxu is installed Entries from 2 254 can be added to the kernel drv fp conf file For example name fp class fibre channel port 0 name fp class fibre channel port 1 name fp class fibre channel port 2 name fp class fibre channel port 3 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A
74. indicates that an unsolicited CT command was ERITY LEVEL Debug D ta SEV M ESSAG E Unsolicited CT dropped ACTION No action needed informational 1622 DEBUG CT reply VERBOS ESCRI nsolicited CT command E MASK LOG CT 0x00010000 PTION This indicates that a reply is being sent for an ESSAG D u SEVERITY LEVEL Debug M E CT reply ACTION No action needed informational 1630 ERROR Invalid CT command found V ERBOS E MASK LOG CT 0x00010000 ESCRI EVERI PTION This indicates that a CT command was found with an nvalid command code TY LEVEL Error D i S M ESSAG E Invalid CT command found ACTION persis FCSP Events Message IDs 1700 1799 No action needed informational However if the problem ts report this error to your customer service representative 1700 DEBUG FCSP E MASK LOG FCSP 0x00020000 PTION This provides general information about the driver s TY LEVEL Debug VERBOS DESCRI FCSP interface SEVERI MESSAGE FCSP ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMUL An Avago Technologies C EX ompany 7 FCoE Driver Console and Log Messages 64 Log Messages for the FCoE Driver 1701 DEBUG FCSP detail
75. indicates that the driver was unable to allocate P011396 01A Rev A SG EMULEX An Avago Technologies Company S 7 FCoE Driver Console and Log Messages Log Messages for the FCoE Driver EVERITY LEVEL Notice M ESSAG E No unsolicited buffer available ACTION config problem report these errors to customer service If the problem occurs frequently you may be able to ure more resources for that pool If this does not solve the 0330 ERROR Invalid access handle V ERBOS GI ESCRI andle E MASK LOG MEM 0x00000008 PTION This indicates that the driver had an invalid access assigned by the system EVERITY LEVEL Error ESSAG E Invalid access handle D h S M A Cc CTION If the problem occurs frequently report these errors to ustomer service 0331 ERROR Invalid DMA handle V ERBOS GI D h S M A Cc ESCRI andle E MASK LOG MEM 0x00000008 PTION This indicates that the driver had an invalid dma assigned by the system EVERITY LEVEL Error ESSAG E Invalid DMA handle CTION If the problem occurs frequently report these errors to ustomer service Service Level Interface Events Message IDs 0400 0499 0400 DEBUG Vital Product Data ERBOS E MASK LOG SLI 0x00000010 ESCRI EVERI PTION Th
76. ion Confirm that the IPS and SVR4 packages differ If so remove the SVR4 package 1 View the IPS data to confirm that the versions do not match Type pkg list elxfc The system displays the following NAME PUBLISHER VERSION IFO driver network elxfc emulex version 1 i 3 2 View the version number for the loaded module Type modinfo lgrep elxfc The system displays 178 fffffffff7ee5000 e4ce8 40 1 elxfc elxfc FCA version 2 3 After confirming that the versions do not match type pkg uninstall elxfc 4 Reboot the system 5 Proceed with the p5p or remote repository installation of the elxfc driver See FCoE Out of Box Driver elxfc on page 12 Note If an elxfc IPS package is installed and then removed using the older SVR4 method inconsistences may develop that could affect re installing or upgrading the driver IPS packages should be installed only after removing older SVR4 packages Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages 34 Setting Notices Warnings and Error Logging Levels 7 FCoE Driver Console and Log Messages This section describes the situations console messages and log messages you may see from the FCoE driver Setting Notices Warnings and Error Logging Levels Table 7 1 lists the types of notices warnings and error logging levels you may set using the ap
77. is provides vendor specific information about the TY LEVEL Debug ESSAG E Vital Product Data ACTION No action needed informational 0410 DEBUG Link atten V D a S M E MASK LOG SLI 0x00000010 PTION This indicates that the adapter has triggered a link ion interrupt TY LEVEL Debug ERBOS ESCRI ttent EVERI ESSAG E Link atten ACTION No action needed informational 0411 DEBUG State change V D Emulex Drivers Version 10 6 for Solaris User Manual ERBOS E MASK LOG SLI 0x00000010 ESCRI PTION This indicates that the adapter has changed state P011396 01A Rev A 43 SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages 44 Log Messages for the FCoE Driver SEVERITY LEVEL Debug MESSAGE State change ACTION No action needed informational 0412 DEBUG Link Up atten VERBOSE MASK LOG SLI 0x00000010 ESCRI PTION This indicates that the adapter has triggered a link up ttention interrupt D a SEVERITY LEVEL Debug MESSAGE Link Up atten ACTION No action needed informational 0413 DEBUG Link Down atten VERBOS E MASK LOG SLI 0x00000010 ESCRI PTION This indicates that the adapter has triggered a link ttention interrupt EVERITY LEVEL
78. ists the NIC configuration file parameters Table 5 1 NIC Configuration File Parameters Parameter default_mtu Definition Sets the default MTU for the driver The possible values are 1500 and 9000 The default value is 1500 flow_control Sets the Ethernet flow control The possible values are e 0 Flow control disabled e 1 Transmit only e 2 Receive only e 3 Both transmit and receive default Flow control cannot be disabled on NIC FCoE adapters fm capability Sets the driver s device fault management capability to one of the values defined for Solaris fault management capability The fm_capability value is a bitmap of one or more of these values e 0x00000000 DDI_FM_NOT_CAPABLE A value of zero indicates that the fm_capability is disabled e 0x00000001 DDI_FM_EREPORT_CAPABLE e 0x00000002 DDI_FM_ACCCHK_CAPABLE e 0x00000004 DDI_FM_DMA_CHK_CAPABLE The default value is 0x00000007 DDI_FM_ACCCHK_CAPABLE DDI_FM_ACCCHK_CAPABLE and DDI_FM_DMA_CHK_CAPABLE log_level Sets the driver s verbosity for logs in var adm messages The log_level parameter is comprised of MOD_MASK upper 16 bits and SEVERITY lower 16 bits The MOD_MASK value is a bitmap of one or more of these values e 0x10000 MOD_CONFIG e 0x20000 MOD_TX e 0x40000 MOD_RX e 0x80000 MOD_ISR The possible values for SEVERITY e 0x0 CE_CONT e 0x1 CE_NOTE e 0x2 CE_WARN e 0x3 CE_PANIC e 0x4 CE_IGNOR
79. ithout issuing a corresponding CT command This error could indicate a driver or firmware problem S M EVERITY LEVEL Error ESSAGE Stray CT completion ACTION No action needed informational However if the problem persists report this error to your customer service representative 1611 DEBUG Abnormal CT completion VERBOSE MASK LOG CT 0x00010000 ESCRIPTION This indicates that a CT command completed with a tatus error in the IOCB It could mean the Fibre Channel device on he network is not responding The driver will automatically retry his CT command if needed D S t ja SEVERITY LEVEL Debug M A 5 ESSAGE Abnormal CT completion CTION Check physical connections to Fibre Channel network and the tate the remote PortID is in Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMUL An Avago Technologies C EX ompany 7 FCoE Driver Console and Log Messages 63 Log Messages for the FCoE Driver 1620 DEBUG CT rcvd VERBOS ESCRI E MASK LOG CT 0x00010000 PTION This indicates that an unsolicited CT command was ERITY LEVEL Debug ESSAG EB CT fevd ACTION No action needed informational 1621 DEBUG Unsolicited CT dropped VERBOS E MASK LOG CT 0x00010000 ESCRI eceived and then dropped for some reason PTION This
80. l emlxdrv Utility The emlxdrv utility is used for binding associating the Emulex Solaris FCoE and NIC drivers to the various models of Emulex adapters If the driver binding configuration is changed the host system must be rebooted for the new configuration to take effect The out of box drivers elxfc and elxnic and their respective inbox drivers emlxs and oce support the same set of Emulex adapter device ids Because only one driver can be bound to a specific device id the inbox driver initially binds to all device ids by default In order to install an out of box driver on top of an inbox driver you must use the emlxdrv utility to establish the device id to driver bindings For more information see the Solaris FCA Utilities User Manual Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX 4 FCoE Driver Configuration 17 An Avago Technologies Company Editing the FCoE Configuration File elxfc conf 4 FCoE Driver Configuration The module name for the Emulex SFS FCA out of box driver is elxfc You can configure the Emulex SFS FCA driver parameters by e Editing the configuration file elxfc conf which is described in this section e Using the Emulex FCA utilities emlxadm and emlxdrv For more information see the Solaris FCA Utilities User Manual e Using the OneCommand Manager application For more information see the OneCommand Manager Application User Manual Editing the FCoE Conf
81. l However if the problem persists report this error to your customer service representative Node Events Message IDs 0600 0699 0600 DEBUG Node create VERBOSE MASK LOG NODE 0x00000040 ESCRIPTION This indicates that a node has been created for a emote device D ic SEVERITY LEVEL Debug MESSAGE Node create ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages Log Messages for the FCoE Driver 49 Emulex Drivers Version 10 6 for Solaris User Manual 0601 DEBUG Node opened VERBOSE MASK LOG NODE DETAIL 0x02000000 DESCRIPTION This indicates that a node has been opened for I O transport SEVERITY LEVEL Debug MESSAGE Node opened ACTION No action needed informational 0602 NOTICE Node create failed VERBOSE MASK LOG NODE 0x00000040 DESCRIPTION This indicates that a nod device has failed S M create request for a remote EVERITY LEVEL Notice ESSAGE Nod failed ACTION No action needed creat informational 0603 DEBUG Node updated VERBOSE MASK LOG NODE 0x00000040 ESCRIPTION This indicates that a node has been updated for a emote device D SEVERITY LEVEL MESSAGE Node u
82. nds after which an interrupt response is generated if cr count has not been satisfied Possible values are 0 63 The default value is 0 Note If cr delay 0 the Coalesce Response parameter cr_count is disabled Link reset enable auth DHCHAP support in the driver e 0 Disabled default e 1 Enabled Link reset enable npiv NPIV support in the driver e 0 Disabled remove all vports first e 1 Enabled requires SLI 3 and later Adapter reset linkup delay Sets the driver wait period seconds for a link up after adapter initialization Possible values are 0 60 The default value is 10 Adapter reset log errors Verbose mask for driver error messages to the messages file Possible values are 0x0000000 0xFFFFFFFF The default value is OxFFFFFFFF Dynamic log notices Verbose mask for driver notice messages to the messages file Possible values are 0x0000000 OxFFFFFFFF The default value is OxFFFFFFFF Dynamic log warnings Emulex Drivers Version 10 6 for Solaris User Manual Verbose mask for driver warning messages to the messages file Possible values are 0x0000000 OxFFFFFFFF The default value is OxFFFFFFFF Dynamic P011396 01A Rev A 4 FCoE Driver Configuration 21 FCoE Configuration File Parameters SG EMULEX An Avago Technologies Company Table 4 1 FCoE Configuration File Parameters Continued Parameter Description Activation
83. olaris User Manual P011396 01A Rev A XG EMULEX 2 Installing and Uninstalling 14 An Avago Technologies Company Uninstalling the Drivers for Solaris 11 pfexec pkg install elxnic 10 4 xy x 0 In instances where two publishers provide packages of the same name specify the publisher name as follows pfexec pkg install emulex elxnic After the installation of elxnic has completed you must configure Solaris to discover and bind the elxnic driver to Emulex adapters Use the Emulex utility emlxdrv to configure these device bindings See Utilities for Solaris Drivers on page 16 for more information 5 Reboot the system Option 2 p5p Archive Installation 1 Log in as root 2 Download the p5p tar file from the Emulex website 3 Untar the archive tar xvf elxnic p5p 10 4 xx yy sll tar 4 Run the installation script elxnic install 5 Reboot the system reboot Binding a Driver to a Device id Instance Because the out of box NIC driver elxnic and the inbox NIC driver oce support the same set of device ids only one driver can be attached to a device id instance By default the oce driver claims all of the device ids Therefore when installing the elxnic driver on top of the oce driver the elxnic driver installation fails To re establish the device id to driver bindings 1 Unbind the oce driver using the emlxdrv utility For more information on the emlxdrv utility see the latest Emulex Solaris
84. omp Emulex Drivers Version 10 6 for Solaris User Manual informational or LOG SFS This indicates that an attempt to reset th report this error to your customer servic informational This indicates that an issue has forced the Fibre 0x00002000 Fibr if the problem representative However ELS command is being sent ELS command completed normally P011396 01A Rev A DE EMULEX 7 FCoE Driver Console and Log Messages 52 An Avago Technologies Company Log Messages for the FCoE Driver 0810 ERROR Stray ELS completion VERBOSE MASK LOG ELS 0x00000100 DESCRIPTION This indicates that an ELS command completion was received without issuing a corresponding ELS command This error could indicate a driver or firmware problem S M EVERITY LEVEL Error ESSAGE Stray ELS completion ACTION No action needed informational However if the problem persists report this error to your customer service representative 0811 DEBUG Abnormal ELS completion VERBOSE MASK LOG ELS 0x00000100 DESCRIPTION This indicates that an ELS command completed with a status error in the IOCB It could mean the Fibre Channel device on the network is not responding or the Fibre Channel device is not an FCP target The driver will automatically S M EVERITY LEVEL Debug ESSAGE Abnormal ELS completion
85. ool error M 0x00000008 Jy VERBOSE MASK LOG M D memory buffer pool management SEVERITY LEVEL Error M ESSAGE Memory pool error ACTION No action needed informational However if the problem persists report this error to your customer service representative 0311 DEBUG Memory pool alloc failed M 0x00000008 VERBOSE MASK LOG M GI emory from one of its own memory pools D m SEVERITY LEVEL Debug M ESSAGE Memory pool alloc failed ACTION If the problem occurs frequently you may be able to configure more resources for that pool If this does not solve the problem report these errors to customer service 0312 DEBUG Memory pool detail M 0x00000008 GI VERBOSE MASK LOG M DESCRIPTION This provides detailed information about memory bufferpool management S M EVERITY LEVEL Debug ESSAGE Memory pool detail ACTION No action needed informational 0320 NOTICE No unsolicited buffer available VERBOSE MASK LOG MEM 0x00000008 DESCRIPTION This indicates that the driver s unsolicited buffer pool is exhausted The I O will be dropped and most likely retried by the remote devic ESCRIPTION This indicates that the driver was unable to allocate ESCRIPTION This indicates that a problem has occurred with the ESCRIPTION This
86. operation TY LEVEL Debug D e S M ESSAGE FCP completion error ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages 56 Log Messages for the FCoE Driver IP Traffic Events Message IDs 1200 1299 1200 DEBUG IP detail VERBOSE _MASK LOG IP DETAIL 0x08000000 ESCRIPTION This provides detailed information about the driver s P interface D I SEVERITY LEVEL Debug MESSAGE IP detail ACTION No action needed informational 1210 ERROR Stray IP completion VERBOSE MASK LOG IP 0x00001000 ESCRIPTION This indicates that an IP sequence completion was eceived without issuing a corresponding IP sequence This error EVERITY LEVEL Error ESSAGE D r could indicate a driver or firmware problem S M Stray IP completion ACTION No action needed informational However if the problem persists report this error to your customer service representative 1211 DEBUG Abnormal IP completion VERBOSE MASK LOG IP 0x00001000 catus ESCRIPTION This indicates that an IP sequence completed with a error in the IOCB It could mean the Fibre Channel device on EVERITY LEVEL Debug D S the ne
87. or MESSAGE Driver detach failed ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative 0112 DEBUG Driver detach VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver is performing a detach peration D O SEVERITY LEVEL Debug MESSAGE Driver detach ACTION No action needed informational 0120 DEBUG Driver suspend VERBOSE MASK LOG DRIVER 0x00000002 ESCRIPTION This indicates that the driver is performing a suspend D operation SEVERITY LEVEL Debug M ESSAGE Driver suspend ACTION No action needed informational 0121 ERROR Driver suspend failed VERBOSE MASK LOG DRIVER 0x00000002 DESCRIPTION This indicates that the driver was unable to suspend due to some issue S M EVERITY LEVEL Error ESSAGE Driver suspend failed ACTION Check your hardware and software configuration If the problem persists report this error to your customer service representative Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SS EMULEX 7 FCoE Driver Console and Log Messages 40 An Avago Technologies Company Log Messages for the FCoE Driver 0130 DEBUG Driver resume VERBOSE MASK LOG DRIVER 0x00000002
88. otte E ccbveoctdiacchue cided stvceceseecbhie ecb ieaadbea cy 15 NIC Driver cscesctrwesdveiseacctdibediessteeee susan oteinabads eeetwatseecdiaiu beudedeewetageceeetaan 15 Scripted REMOVAL is aesiscaccesare diene tonin a E ENE EEE EEEE euldeaseanseieds 15 3 Utilities for Solaris Drivers sossssssosossssosssscsossessoosesesoossesesoosssoooe 16 OneCommand Manager Application eesssecssssseccssecssssesossseccsoseecsoeecessseeeoo 16 OM cane Utility ocasececdunewnudorsemerduwerduceenunsesinerdesdeuacpebuieadeteebeecedemmdueeaneene 16 emlixdiv Utility oicecccsscccie lecwinteecincescdesews veviasvevecssceelensesesessececuseusvensdeatedesees 16 4 FCoE Driver Configuration sssssscsecsecceccecsecseesecsecsecseeseesecseesecsecoeo 17 Editing the FCoE Configuration File elxfc conf sssessssesessscesosesecossscesoseseo 17 Changing Driver Parameters ssessesssesosesscosssecsosesecsssesoessecosesscsssseoeese 17 Configuring NPIV SUPDOF cvcisccveuenastceivdadexantaavevasvasnedangendeatdawersansdivaventeass 17 Enabling NPIV Support on Solaris 10 ssesssssessessssssssessessssssssssesssssssssssssssssessseo 17 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 3 DE E M U L EX Table of Contents 4 An Avago Technologies Company Enabling NPIV Support on Solaris 11 sssesssessesssssesssessesssssssssssssssssssssssessssessese 18 NPIV Limitations oreroraa ninenin dasaa cece EEEE EAEE EAEE A
89. pdated ACTION No action needed T Debug informational 0610 DEBUG Node destroy VERBOSE MASK LOG NODE 0x00000040 ESCRIPTION This indicates that a node has been destroyed for a emote device D ic SEVERITY LEVEL MESSAGE Node destroy ACTION No action needed Debug informational 0611 DEBUG Node closed VERBOSE MASK LOG NODE DETAIL 0x02000000 ESCRIPTION tes that a node has been temporarily closed or I O transport D f SEVERITY LEVEL MESSAGE ACTION No action needed This indica Debug Node closed informational 0612 NOTICE Node missing VERBOSE MASK LOG NODE 0x00000040 DESCRIPTION This indicates that a FCP2 device node has been found missing SEVERITY LEVEL Notice P011396 01A Rev A 5E EMULEX 7 FCoE Driver Console and Log Messages 50 An Avago Technologies Company Log Messages for the FCoE Driver MESSAGE Node missing ACTION No action needed informational 0620 DEBUG Node not found VERBOSE MASK LOG NODE 0x00000040 DESCRIPTION This indicates that there was an attempt to send an I O pkt to an unknown device node The driver maintains a node table entry for every device it needs to communicate with on the FC network SEVERITY LEVEL Debug MESSAGE Node not found ACTION
90. propriate FCoE driver parameters Table 7 1 Setting Types of Console and Log Messages for the FCoE Driver elxfc Parameter console notices Description Verbose mask for driver error messages to the console Possible values are 0x0000000 0xFFFFFFFF The default value is 0x0000000 console warnings Verbose mask for driver notice messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is 0x0000000 console errors Verbose mask for driver warning messages to the console Possible values are 0x0000000 OxFFFFFFFF The default value is Ox0000000 Ipfc Parameter log only if set to 0 log messages are logged to the system log file and also printed on the console Default Disabled log notices Verbose mask for driver error messages to the messages file Possible values are 0x0000000 OxFFFFFFFF The default value is OxXFFFFFFFF log warnings Verbose mask for driver notice messages to the messages file Possible values are 0x0000000 OxFFFFFFFF The default value is OxFFFFFFFF log errors Log Messages Verbose mask for driver warning messages to the messages file Possible values are 0Ox0000000 OxFFFFFFFF The default value is OxFFFFFFFF log verbose if set to non zero verbose messages are generated Default Disabled Types of Log Messages Logged in the System File Log messages are logged to the var adm messages system file Table 7 2 list
91. r Manual P011396 01A Rev A 74 gt lt EMULEX 8 NIC Driver Log Messages 75 An Avago Technologies Company Log Messages for the NIC Driver Table 8 4 Log Messages for the NIC Driver for Solaris 11 Continued Log Message Recommended Action MOD_MASK Severity Failed to allocate rings Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system Increase the memory Failed to Configure RSS Check for the faulty hardware using MOD_CONFIG CE_WARN status lt code gt fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to create WQ ring Low system resources Repeat the MOD_CONFIG_ CE_WARN operation that generated the log If the error log is generated again reboot the system Failed to del status lt code gt Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Failed to delete MAC lt mac_add gt Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt
92. r the FCoE Driver ESCRIPTION This provides detailed information about a mailbox vent D e SEVERITY LEVEL Debug MESSAGE Mailbox detail ACTION No action needed informational 0510 DEBUG Stray mailbox interrupt VERBOSE MASK LOG MBOX 0x00000020 DESCRIPTION This indicates that a mailbox command completion interrupt was received and the mailbox is not valid This error could indicate a driver or firmware problem S M EVERITY LEVEL Debug ESSAGE Stray mailbox interrupt ACTION No action needed informational However if the problem persists report this error to your customer service representative 0520 DEBUG Mailbox error VERBOSE MASK LOG MBOX 0x00000020 DESCRIPTION This indicates that an unsupported or illegal mailbox command was completed This error could indicate a driver or firmware problem S M EVERITY LEVEL Debug ESSAGE Mailbox error ACTION No action needed informational However if the problem persists report this error to your customer service representative 0530 ERROR Mailbox timeout VERBOSE MASK LOG MBOX 0x00000020 ESCRIPTION The firmware did not response a mailbox command This rror could indicate a hardware or firmware problem D e SEVERITY LEVEL Error MESSAGE Mailbox timeout ACTION No action needed informationa
93. river kit For example cd lt location of driver package gt pkgadd d 5 Reboot the system Note The emlxdrv utility must be used to bind the adapter to the elxfc driver For more information on the emlxdrv utility see the latest Emulex Solaris FCA Utilities User Manual which is available on the Emulex website NIC Out of Box Driver elxnic To install the NIC out of box driver 1 Log in as root 2 Download the platform specific NIC out of box driver from the Emulex website to a convenient directory The file is a regular tar file 3 Extract the installation image from the tar file For example cd lt location of driver package gt tar xvf elxnic kit 10 6 xx yy s10 i386 tar 4 Install the driver kit For example cd lt location of driver package gt pkgadd d 5 Reboot the system Binding a Driver to a Device id Instance Because the out of box NIC driver elxnic and the inbox NIC driver oce support the same set of device ids only one driver can be attached to a device id instance By default the oce driver claims all the device ids Therefore when installing the elxnic Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A XG EMULEX 2 Installing and Uninstalling 11 An Avago Technologies Company Uninstalling the Drivers for Solaris 10 driver on top of the oce driver the elxnic driver installation fails To re establish the device id to driver bindings 1 Unbind the oce driver usin
94. rupt resource management interrupt request Link Aggregation Control Protocol message signaled interrupts extended maximum transmission unit network interface card N_Port ID Virtualization operating system Peripheral Component Interconnect physical function power on self test Small Computer System Interface SAN Foundation Software 8 SG EMULEX An Avago Technologies Company SLI SR IOV tar UMC VF VLAN VM VPort vRouter vSwitch Service Level Interface single root I O virtualization tape archive universal multi channel virtual function virtual local area network virtual machine virtual port virtual router virtual switch Emulex Drivers Version 10 6 for Solaris User Manual 1 Introduction Abbreviations P011396 01A Rev A 9 XG EMULEX 2 Installing and Uninstalling 10 An Avago Technologies Company Installing the Drivers for Solaris 10 2 Installing and Uninstalling This section details the procedures for installing and uninstalling the Solaris drivers Installing the Drivers for Solaris 10 FCoE Out of Box Driver elxfc To install the FCoE out of box driver 1 Log in as root 2 Download the platform specific FCoE out of box driver from the Emulex website to a convenient directory The file is a regular tar file 3 Extract the installation image from the tar file For example cd lt location of driver package gt tar xvf elxfc_kit 10 6 xx yy s10 1386 tar 4 Install the d
95. s for the FCoE Driver 1312 WARNING ECHO diagnostic failed VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This indicates that an ECHO diagnostic has failed to return a positive result This could indicate a connectivity problem with your FC network S M EVERITY LEVEL Warning ESSAGE ECHO diagnostic failed ACTION Check your network connections If the problem persists report this error to your system administrator 1313 DEBUG BIU diagnostic completed VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This indicates that a BIU diagnostic has completed SEVERITY LEVEL Debug MESSAGE BIU diagnostic completed ACTION No action needed informational 1314 ERROR BIU diagnostic failed VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This indicates that a BIU diagnostic has failed to return a positive result This usually caused by an adapter hardware problem SEVERITY LEVEL Error MESSAGE BIU diagnostic failed ACTION Contact your customer service representative 1315 DEBUG POST diagnostic completed VERBOSE MASK LOG SFS 0x00002000 DESCRIPTION This indicates that a POST diagnostic has completed SEVERITY LEVEL Debug MESSAGE POST diagnostic completed ACTION No action needed informational 1316 ERROR POST diagnostic failed VERBOSE M
96. s static RSS key generation The possible values are 0 disabled or 1 enabled The default value is 0 rx bcopy limit Sets the receive buffer size threshold to use the copy mode The possible values are any values that are less than or equal to the default_mtu value The default value is 128 Note On Solaris 11 consider changing this value to fine tune the receive performance rx frag size Sets the size of the pre allocated receive buffer A higher value results in better resource utilization The possible values are 2048 4096 and 8192 The default value is 2048 Note On Solaris 10 consider changing the value to 4096 or 8192 if the default_mtu value is 9000 rx max bufs Sets the maximum number of pre allocated receive buffers The possible values are 1024 8192 The default value is 2048 Note On Solaris 10 consider increasing the rx_max_bufs value if the rx_drops_no_frags_q x increments continuously in the kstat output tx_bcopy_ limit Sets the transmit buffer size threshold to use the copy mode The possible values are 128 256 512 1024 and 2048 The default value is 512 Note On Solaris 11 consider reducing this value if a wqb pool empty message is frequently observed Consider increasing the value if a wqm pool empty message is frequently observed For descriptions of these messages see page 80 in Table 8 4 Log Messages for the NIC Driver for Solaris 11 tx_intr_ enable
97. s that the adapter is initializing SEVERITY LEVEL Debug MESSAGE Adapter initialization ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A 5E EMULEX 7 FCoE Driver Console and Log Messages 41 An Avago Technologies Log Messages for the FCoE Driver Company 0210 DEBUG Adapter transition V D S M A ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that the adapter is changing states EVERITY LEVEL Debug ESSAGE Adapter transition CTION No action needed informational 0220 DEBUG Adapter online V D C S M A ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that the adapter is online and ready to ommunicate EVERITY LEVEL Debug ESSAGE Adapter online CTION No action needed informational 0230 DEBUG Adapter offline V D S M A ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that the adapter is offline and unable o communicate EVERITY LEVEL Debug ESSAGE Adapter offline CTION No action needed informational 0231 WARNING Adapter shutdown V D W S M A ERBOSE MASK LOG INIT 0x00000004 ESCRIPTION This indicates that the adapter has been shutdown and ill require a reboot to reinitialize EVERITY
98. s the types of log messages that can be logged to the system file Table 7 2 Log Message Types for the FCoE Driver Verbose Bit Log Message Verbose Mask Verbose Description Pages 0x00000001 LOG_MISC Miscellaneous events 37 38 0x00000002 LOG_DRIVER Driver attach and detach events 38 40 0x00000004 LOG_INIT Adapter initialization events 40 41 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages Table 7 2 Log Message Types for the FCoE Driver Continued Log Messages Verbose Bit Log Message Verbose Mask Verbose Description Pages 0x00000008 LOG_MEM Memory management events 41 43 0x00000010 LOG_SLI SLI events 43 47 0x00000020 LOG_MBOX Mailbox events 47 48 0x00000040 LOG_NODE Node events 48 50 0x00000080 LOG_LINK Link events 50 51 0x00000100 LOG_ELS ELS events 51 53 0x00000200 LOG_PKT General I O packet events 53 55 0x00000400 LOG_FCP FCP traffic events 55 0x00001000 LOG_IP IP traffic events 56 57 0x00002000 LOG_SFS Solaris SFS events 57 58 0x00004000 LOG_IOCTL IOCTL events 59 59 0x00008000 LOG_FIRMWARE Firmware download events 60 61 0x00010000 LOG_CT Common transport events 62 63 0x00020000 LOG_FCSP FCSP events 63 65 0x00040000 LOG_FCF FCF events 65 66 0x007C0000 LOG_RESERVED Reserved 0x01000000 LOG_FCSP_DETAIL Detailed FCSP events 64 0x
99. system resources Repeat the MOD_CONFIG_ CE_WARN operation that generated the log If the error log is generated again reboot the system ddi_intr fr failed lt ret code gt Reboot the system MOD_CONFIG CE_WARN Device in error state Reboot the system MOD_CONFIG CE_WARN Device Unknown The device is not supported by the driver MOD_CONFIG CE_WARN EQ create failed status lt code gt Check for the faulty hardware using MOD_CONFIG CE_WARN fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit EQ ring alloc failed Low system resources Repeat the MOD_CONFIG CE_WARN operation that generated the log If the error log is generated again reboot the system error recovery failed device is Reboot the system MOD_CONFIG CE_WARN in suspended state Error recovery failed timed out Reset the system MOD_CONFIG CE_WARN Error recovery timed out The hardware or driver cannot recover MOD_CONFIG CE_WARN from a serious hardware error Reset the system Failed to enable interrupt lt int Reload the driver MOD_CONFIG CE_WARN num gt type lt int type gt cnt lt num_vectors gt ret lt ret code gt Failed to add interrupt handler Reload the driver MOD_CONFIG CE_WARN Failed to allocate bmbx Reload the driver MOD_CONFIG CE_WARN Emulex Drivers Version 10 6 for Solaris Use
100. t hosts and add the IP address and hostname that you wish to assign to the given NIC interface See the hosts 4 man page for more information 4 Edit the etc inet ipnodes file and add an entry for the IP address and hostname for the given interface The etc inet ipnodes file is primarily for IPv6 only but this step is necessary for the IP address change to take effect 5 Edit the etc netmasks file and add an entry with the IP address and desired subnet mask for the given interface See the netmasks 4 man page for more information 6 Restart the network service Run svcadm restart network physical or reboot the system Removing the NIC Interface using elxnic To remove the NIC interface 1 Remove all the elxnic entries from etc hosts 2 Remove all the entries from etc inet ipnodes that are related to elxnic interfaces 3 Remove all the elxnic netmask entries from etc netmasks 4 Unplumb the interface using the following command Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A gt lt EMULEX 5 NIC Driver Configuration 27 An Avago Technologies Company Using the NIC Configuration File elxnic conf For the Solaris 10 driver ifconfig elxnic lt X gt down unplumb For the Solaris 11 driver ifconfig net lt xX gt down unplumb where lt X gt is the interface number Alternatively you can use the sys unconfig 1M utility for Solaris
101. t to point then loop ub bufs Sets the number of unsolicited buffers the driver should allocate Reboot Possible values are 40 16320 The default value is 1000 Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX 4 FCoE Driver Configuration 22 An Avago Technologies Company FCoE Configuration File Parameters Table 4 1 FCoE Configuration File Parameters Continued Parameter Description Activation vport Note This property is applicable to Solaris 10 only Link reset Virtual port registration table The enable npiv parameter must be set to 1 The virtual port registration table can have any number of comma delimited entries Each entry must be of the form PHYS WWPN VPORT WWNN VPORT_WWPN VPORT_ ID Where e PHYS_WWPN World Wide Port Name of adapter s physical port e VPORT_WWNN Desired World Wide Node Name of virtual port e VPORT_WWPN Desired World Wide Port Name of virtual port e VPORT_ID Desired virtual port ID 1 to maximum vPorts For entries with the same PHYS_WWPN VPORT_WWNN and VPORT_WWPN the VPORT_ID must start at 1 and increment by one sequentially without gaps in the number sequence The VPORT_ID 0 is reserved for the physical port For example vport 10000000c9123456 28010000C9123456 20010000C9123456 1 10000000c9123456 28020000C9123456 20020000C9123456 2 10000000c9123457 28010000C9123457 20010000C9123457 1 10000000c9123457 28020000C9123457 20020000C9123457
102. ter if necessary lt code gt soft reset bit Check for the faulty hardware MOD_CONFIG_ CE_WARN asserted 1 Reset failed using fmadm faulty If the hardware is faulty acquit the hardware using fmadm acquit lt dev_path gt and reset the adapter If the hardware is not faulty reset the adapter without issuing acquit Alloc intr failed ret lt ret Reload the driver MOD_CONFIG CE_WARN code gt navail lt code gt nallocd lt code gt Block Enable Interrupts Reload the driver MOD_CONFIG_ CE_WARN Failed lt code gt Could not allocate Reload the driver MOD_CONFIG_ CE_WARN fn_config dbuf lt code gt Could not reset firmware ERR Reset the adapter MOD_CONFIG CE_WARN bit set pd_ctrl lt code gt Could not reset firmware ERR Firmware reset failed Reset the MOD_CONFIG CE_WARN bit set pd_ctrl lt reg gt system CQ create failed status Hardware error Download the MOD_CONFIG CE_WARN lt code gt same firmware image to the adapter and reboot replace the adapter if necessary ddi dma addr bind handle Increase the memory MOD_CONFIG_ CE_WARN failed rc lt code gt ddi_intr get pri failed Reboot the system MOD_CONFIG CE_WARN Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company Table 8 3 Log Messages for the NIC Driver for Solaris 10 Continued 8 NIC Driver Log Messages Log Messages for the NIC Driver
103. the dladm 1M man page Note man pages are available on the Oracle website Using the NIC Configuration File elxnic conf This section provides information on using and configuring the NIC driver parameters Changing Driver Parameters The configurable driver parameters are described in Table 5 1 NIC Configuration File Parameters on page 24 To edit the elxnic conf file 1 Open the file in a text editor 2 Change the parameters to the desired settings The syntax of single lines in the file lt variable gt lt value gt For example default mtu 9000 Comment lines must start with a character 3 Save the file If the driver is already loaded unload and reload it Changes to the configuration file require you to unload and reload the driver For more information see Installing and Uninstalling on page 10 NIC Configuration File Parameters For the Solaris 10 driver you can configure the elxnic driver parameters using either the elxnic conf file for driver parameters that are common to all the elxnic devices or the ndd utility for driver parameters that may need to be set with different values for different elxnic devices For the Solaris 11 driver use the dladm utility or the elxnic conf file Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 5 NIC Driver Configuration 24 Using the NIC Configuration File elxnic conf Table 5 1 l
104. tion is normally intended for technical support This may change from one driver version to another Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages Log Messages for the FCoE Driver Log Messages for the FCoE Driver Miscellaneous Events Message IDs 0001 0099 0001 DEBUG VERBOSE MASK LOG MISC DESCRIPTION SEVERITY LEVEL Debug MESSAGE None ACTION No action needed 0002 NOTICE VERBOSE MASK LOG MISC DESCRIPTION SEVERITY LEVEL Notice MESSAGE None ACTION No action needed 0003 WARNING VERBOSE MASK LOG MISC DESCRIPTION SEVERITY LEVEL Warning MESSAGE None ACTION No action needed 0004 ERROR VERBOSE MASK LOG MISC DESCRIPTION This is a SEVERITY LEVEL Error MESSAGE None ACTION No action needed 0005 PANIC ERBOSE MASK LOG MISC ESCRIPTION EVERITY LEV ESSAGE V D S M This is a Panic EL None ACTION Contact your customer servic 0010 DEBUG Event VERBOSE MASK LOG MISC DESCRIPTION SEVERITY LEVEL Debug Emulex Drivers Version 10 6 for Solaris User Manual 0x00000001 This is a general purpose informational message informational 0x00000
105. tual port to go offline e FC IP is not supported on virtual ports e The Emulex LightPulse LPe12000 family of adapters can support up to 255 virtual ports e You cannot delete a virtual port with a mounted file system NPIV and Operating System Virtualization Solaris has several operating system virtualization solutions including Oracle VM for x86 and Solaris containers Devices configured to be seen on an Emulex FCoE port either a physical port or a virtual port can be used with any of these operating system virtualization solutions It is recommended that you consult the latest document on these technologies to learn the best use of resources related to NPIV technology Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX 4 FCoE Driver Configuration 19 An Avago Technologies Company FCoE Configuration File Parameters Using VPorts with Oracle VM Server for Solaris Containers or Oracle VM Server for 86 To use NPIV with Solaris containers or Oracle VM Server for x86 formerly xVM user domains 1 Create virtual ports for the domains or containers to which you want to present dedicated storage 2 Discover and attach the targets to the virtual ports 3 Assign the target to the domain or container The attachment runs through the virtual port that provides the path to the target FCoE Configuration File Parameters Notes All adapter specific parameters have an elxfcX prefix where X is
106. twork is not responding S M ESSAGE Abnormal IP completion ACTION No action needed informational However if the problem persists report this error to your system administrator 1220 DEBUG Unsolicited IP dropped VERBOSE MASK LOG IP 0x00001000 ESCRI PTION This indicates that an unsolicited IP sequence was eceived but was dropped for some reason D xr SEVERITY LEVEL Debug MESSAGE Unsolicited IP dropped ACTION No action needed informational 1221 DEBUG IP recvd VERBOS E MASK LOG IP 0x00001000 ESCRI eceived PTION This indicates that an unsolicited IP sequence was ESSAG D ic SEVERITY LEVEL Debug M E IP recvd ACTION No action needed informational Emulex Drivers Version 10 6 for Solaris User Manual P011396 01A Rev A SG EMULEX An Avago Technologies Company 7 FCoE Driver Console and Log Messages 57 Log Messages for the FCoE Driver 1230 ERROR Invalid IP sequence found V ERBOS E MASK LOG IP 0x00001000 ESCRI EV PTION This indicates that an IP sequence was found with an nvalid code ERTIY LEVEL Error D i S M ESSAG EF Invalid IP sequence found ACTION No action needed informational However if the problem persis Solaris SFS Events Message IDs 1300 1399 1300 DEBUG SFS ts
107. y MESSAGE ACTION No action needed Link up informational 0721 NOTICE NPIV Link up 0x00000080 VERBOSE MASK LOG LINK ESCRIPTION ll virtual ports D a SEVERITY LEVEL MESSAGE NPIV Link up Notice 7 FCoE Driver Console and Log Messages Log Messages for the FCoE Driver 51 This indicates that the Fibre Channel link is up for ACTION No action needed informational 0730 NOTICE Link reset VERBOSE MASK LOG LINK 0x00000080 or LOG SFS 0x00002000 DESCRIPTION Channel link to be reset S M EVERITY LEVEL ESSAGE ACTION No action needed Notice ink reset 0731 ERROR Link reset failed 0x00000080 VERBOSE MASK LOG LINK DESCRIPTION Channel link has failed S M EVERITY LEVEL ESSAGE ACTION persists ELS Events Message IDs 0800 0899 0800 DEBUG ELS sent VERBOSE MASK LOG ELS mrror ink reset failed No action needed informational 0x00000100 DESCRIPTION This indicates that an SEVERITY LEVEL Debug MESSAGE ELS sent ACTION No action needed informational 0801 DEBUG ELS comp VERBOSE MASK LOG ELS 0x00000100 DESCRIPTION This indicates that an SEVERITY LEVEL MESSAGE E ACTION No action needed Debug iS c
108. ystem 0423 NOTICE Adapter notice VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that the adapter has provided general nformation about the adapter s condition D i SEVERITY LEVEL Notice MESSAGE Adapter notice ACTION No action needed informational 0424 WARNING Adapter warning VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that an interrupt has occurred indicating a recoverable adapter error D i SEVERITY LEVEL Warning M ESSAGE Adapter warning ACTION This error usually indicates a hardware or firmware problem with the adapter Check and or update firmware levels Report these errors to customer service 0425 ERROR Adapter error VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that a recoverable adapter error has D occurred SEVERITY LEVEL Error MESSAGE Adapter error ACTION This error usually indicates a hardware or firmware problem with the adapter Check and or update firmware levels Report these errors to customer service 0426 NOTICE Adapter Async Status VERBOSE MASK LOG SLI 0x00000010 ESCRIPTION This indicates that the adapter has provided general nformation about the adapter s async status D i SEVERITY LEVEL Notice MESSAGE Adapter Async Status ACTION No action needed informational

Emulex Drivers Version 10.6 for Solaris User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents