Home

Emulex Drivers Version 10.0 for VMware ESXi User Manual

1. elx_mes1427 Invalid PCI device group lt pci_dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None ACTION None required elx_mes1428 Invalid PCI device group lt pci_dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 102 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes1429 Invalid PCI device group lt pci_dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None ACTION None required elx_mes1430 Failed to initialize sgl list DESCRIPTION Failed to initialize SGL list DATA None ACTION None required elx_mes1431 Invalid HBA PCl device group lt dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None ACTION None required elx_mes1432 Failed to initialize rpi headers DESCRIPTION RPI headers required by the firmware failed to initialize DATA None ACTION None required elx_mes1476 Failed to allocate sysfs attr DESCRIPTION Failed to allocate sysfs attribute DATA None ACTION None required elx_mes1477 Failed to set up hba DESCRIPTION Failed to set up adapter DATA None ACTION None required IOCTL Events 1600 1699 None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 103 DG EMULEX Troubleshooting the FC FCoE
2. ic cec cece cece sees eee eee vee veeneenennnenanaas 73 FCP Traffic History 0700 0799 ccccc ccc cece cee e eats eee e eee eeeeeeateeaeeseteeeeeenenanegs 86 Node Table Events 0900 0999 oo ccc cece cece eee cesses teens seseee eens seeneneneneegs 88 Security Events 1000 1099 ccccccccce eee e eee e eee cess eee eeee eee e eae eseeeeeeeeanennteaaes 88 Miscellaneous and FCoE Events 1200 1299 cece cece ccc ee eects eee eeeeeaeeeeanees 93 Link Events 1300 1399 cironi annann nen a a e 97 Port Setup Events 1400 1499 ccc ec cee eee e sees eee eeeeeeateeeteseeeeneeenesategs 98 IOCTI Events 1600 1699 ucarana a able atiuudawia ateadanedears 102 VPort Events 1800 1832 oo ccc cece ccc eecc cece eee e essen eee estes neee a i nent ys 103 ELS Events 1833 2800 cisscacidvasnvradataais cunaamaaasaeetaeranwaaiaaa Maes AITINA 107 NeW EVENES sidsenisagaws saniwnindord aE E E E RA N a E 128 Troubleshooting the NIC Driver sssssssssunnnnnnnnunnunnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 143 NIC Event Error Logging for ESXi 5 0 and 5 1 cs este cvederdatebseeetesddceedatsavabiodendes 144 Retrieving ESXi Server NIC Error Log CodeS ssssssssssssssrsrererrererrrerrerrerrerrere 144 ESXi Server NIC Event Log Entri S ccccccceeeeeeeceeeceeeeeeseeeeaeeseeeeeeesenesateeas 144 NIC Adapter Firmware Error cccccccccecceceeeeeeeeaeeseeeereeeeesateseeeseeeeneeentngas 146 Troubleshooting the
3. DATA None ACTION None required elx_mes2540 Ring lt value gt handler unexpected Rctl lt value gt Type lt value gt received DESCRIPTION DATA None ACTION None required elx_mes2543 Mailbox command lt vpi gt lt mbxCommand gt cannot issue DESCRIPTION The mailbox command does not have all of the fields set correctly DATA 1 sli4_mbx_opcode 2 sli_flag 3 flag ACTION None required elx_mes2544 Mailbox command lt vpi gt lt mbxCommand gt cannot issue DESCRIPTION The adapter cannot be accessed on the PCI bus DATA 1 sli4_mbx_opcode 2 sli_flag 3 flag ACTION None required elx_mes2546 New FCF found index lt index gt tag lt event_tag gt DESCRIPTION A new FCF has been found DATA None ACTION None required elx_mes2547 Issue FCF scan read FCF mailbox command failed DESCRIPTION Could not read the FCF mailbox command from the firmware DATA None ACTION None required elx_mes2548 FCF Table full count lt count gt tag lt event_tag gt DESCRIPTION The FCF table is full Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 118 DG EMULEX Troubleshooting the FC FCoE Driver DATA None ACTION None required elx_mes2549 FCF disconnected from network index lt index gt tag lt event_tag gt DESCRIPTION The FCF has disconnected from the network DATA None ACTION None required elx_mes2550 UNREG_FCFI mbxStatus error lt u
4. DESCRIPTION A pending mailbox command was aborted because the thread received a signal DATA None ACTION The command is retried elx_mes1831 Create VPORT Interrupted DESCRIPTION The port creation process was unexpectedly interrupted at a critical time and the operation was unsuccessful DATA None ACTION The process was interrupted while creating a VPort Retry the command elx_mes1832 No pending MBOX command to handle DESCRIPTION DATA None ACTION None required ELS Events 1833 2800 elx_mes1835 Vport discovery quiesce failed state lt port_state gt fc_flags lt fc_flag gt wait msecs lt jiffies_to_msecs jiffies start_time gt DESCRIPTION Could not pause discovery on this VPort DATA None ACTION None required elx_mes1836 Could not issue unreg_login all_rpis status lt rc gt DESCRIPTION The unreg_login cannot be issued DATA None ACTION None required elx_mes1837 vport_delete failed Cannot delete static vport DESCRIPTION Static VPorts cannot be deleted DATA None ACTION None required elx_mes1838 Failed to INIT_ VPI on vpi lt vpi gt status lt rc gt DESCRIPTION Failed to INIT_VPI DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 108 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1839 Create VPORT failed vname allocation failed DESCRIPTION Driver failed to allocate buffer for
5. DESCRIPTION Initialization of VPI mailbox has failed DATA None ACTION None required elx_mes2610 FCF lt value gt reached driver s book keeping dimension lt value gt DESCRIPTION DATA None ACTION None required elx_mes2619 Config region 23 has bad signature DESCRIPTION Configuration region 23 has an invalid signature DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 123 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes2620 Config region 23 has bad version DESCRIPTION Configuration region 23 has an invalid version DATA None ACTION None required elx_mes2707 Ring lt Ring gt handler Failed to allocate iocb Rctl lt fh_rctl gt Type lt fh_type gt received DESCRIPTION Could not allocate an IOCB with which to associate this received frame DATA None ACTION None required elx_mes2710 PCI channel disable preparing for reset DESCRIPTION Driver is resetting the PCI slot for this port starting preparations DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2711 PCI channel permanent disable for failure DESCRIPTION Driver has detected a fatal port error disabling PCI channel DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2712 Ipfc_aer support attribut
6. Security Events 1000 1099 elx_mes1000 Authentication is enabled but authentication service is not running DESCRIPTION DATA None ACTION None required elx_mes1005 AUTHENTICATION_FAILURE Nport lt port gt DESCRIPTION DATA None ACTION None required elx_mes1006 Bad Name tag in auth message DESCRIPTION DATA None ACTION None required elx_mes1007 Bad Name length in auth message DESCRIPTION DATA None ACTION None required elx_mes1008 Bad Number of Protocols DESCRIPTION DATA None ACTION None required elx_mes1009 Bad param type DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 89 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1010 Bad Tag 1 DESCRIPTION DATA None ACTION None required elx_mes1011 Auth_neg no has function chosen DESCRIPTION DATA None ACTION None required elx_mes1012 Auth_negotiate Bad Tag 2 DESCRIPTION DATA None ACTION None required elx_mes1013 Auth_negotiate no DH_ group found DESCRIPTION DATA None ACTION None required elx_mes1014 dhchap challenge bad name tag DESCRIPTION DATA None ACTION None required elx_mes1015 dhchap challenge bad name length DESCRIPTION DATA None ACTION None required elx_mes1016 dhchap challenge Hash ID not Supported DESCRIPTION DATA None ACTION None required elx_mes10
7. elx_mes0137 No retry ELS command lt ELS_CMD gt to remote DESCRIPTION DATA 1 ulpStatus 2 ulpWord 4 ACTION None required elx_mes0138 ELS rsp Cannot issue reg_login for lt DID gt DESCRIPTION REG_LOGIN mailbox command failed DATA 1 nlp_DID 2 nlp_state 3 nlp_flag 4 nlp_rpi ACTION None required elx_mes0140 PLOGI Reject invalid nname DESCRIPTION Invalid node WWN provided DATA None ACTION None required elx_mes0141 PLOGI Reject invalid pname DESCRIPTION Invalid port WWN provided DATA None ACTION None required elx_mes0142 PLOGI RSP Invalid WWN DESCRIPTION The PLOGI sent to the port by a remote port had an invalid WWN DATA None ACTION None required elx_mes0144 Not a valid WCQE code lt Completion Code gt DESCRIPTION The completion queue handler detected an invalid type DATA None ACTION None required elx_mes0147 Failed to allocate memory for RSCN event DESCRIPTION Memory could not be allocated to send the RSCN event to the management application DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 54 SG EMULEX Troubleshooting the FC FCoE Driver elx_mes0148 Failed to allocate memory for LOGO event DESCRIPTION Memory could not be allocated to send the LOGO event to the FC transport DATA None ACTION None required elx_mes0154 Authentication not complete DESCRIPTION M
8. 0 For the native mode up initialization Min 0 driver 0x0 bring up link Max 2 Enable to assist with 0x1 do not bring up SAN issues during ESX link boot 0x2 never bring up link max_targets The maximum number of Def 256 For the native mode discovered targets allowed Min 0 driver Max 4096 Driver parameter to adjust supported target count disable_mq Disable MultiQueue MQ Def 0 For the native mode functionality Min 0 driver 0 MQ is enabled default Max 16 By default ESXi 5 0 gt 1 16 MQ is disabled also ESXi 5 5 has MQ defines the number of support and is the EQ CQ WQ tuples the default Change driver allocates reflects driver auto configuration feature If the value is nonzero it should match fcp_io_channel fcp_io_channel Set the number of FCP I O Def 1 For the native mode channels completion Min 1 driver queues for each adapter Max 16 Works in cooperation Emulex Drivers Version 10 0 for VMware ESXi User Manual with disable_mq parameter P009803 01A Rev A gt G EMULEX Table 2 1 FC and FCoE Driver Parameters Continued 2 Configuration 28 FC and FCoE Driver Configuration ESXi 5 0 5 1 ESXi 5 5 OP Legacy Native Mode Module Driver Model Driver Model Parameter Description Values Values Comments Ipfc_delay_ Delay NPort discovery when Def 0 Def 0 No changes discovery the Clean Address bit is Min 0 Min 0 desing Max 1 Max
9. Contact Emulex technical support elx_mes3176 Misconfigured Physical Port Port Name lt value gt DESCRIPTION The driver has detected an unknown firmware name DATA Detected firmware name ACTION Contact Emulex technical support elx_mes3177 Nport lt value gt DID lt value gt in wrong state for discovery to start Failing request Data lt value gt DESCRIPTION The driver is trying to restart SAN discovery and detected an NPort is in the wrong initial state DATA NPort ID FCID NPort state ACTION Reset link If this fails contact Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 140 SG EMULEX Troubleshooting the FC FCoE Driver elx_mes3249 Unable to allocate memory for QUERY_FW_CFG mailbox command DESCRIPTION DATA None ACTION None required elx_mes3250 QUERY_FW_CFG mailbox failed with status lt value gt add_ status lt value gt mbx status lt value gt DESCRIPTION DATA None ACTION None required elx_mes3252 WQ doorbell offset not supported DESCRIPTION DATA None ACTION None required elx_mes3262 RQ doorbell format not supported DESCRIPTION DATA None ACTION None required elx_mes3263 WQ failed to memmap pci barset lt value gt DESCRIPTION DATA None ACTION None required elx_mes3265 WQ doorbell format not supported lt value gt DESCRIPTION DATA None ACTION None required elx_mes3269
10. DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 143 SG EMULEX Troubleshooting the NIC Driver Troubleshooting the NIC Driver The following section includes NIC troubleshooting information Be sure to check the readme txt file located on CD1 for other troubleshooting issues The following table provides troubleshooting information for the NIC driver Table 3 4 Troubleshooting the NIC Driver Issue Resolution 1 When there is a great deal of This could be due to low configured value for network traffic in some VMs a few netPktHeapMaxSize Try increasing it to a higher value To VMs appear to have lost network read the current value run connectivity 2 Several alloc_skb failed messages appear in the log file proc vmware log esxcfg advcfg j netPktHeapMaxSize A value of 0 indicates default 64 MB To increase the size to for example 128 MB run esxcfg advcfg k 128 netPktHeapMaxSize netPktHeapMaxSize can also be configured through VI Client using Configuration gt Advanced Settings gt VMKernel After configuring the size reboot the system Unable to ping from one VM to another The NIC driver creates two vmnic interfaces one for each VM port If these interfaces are configured as uplinks in two separate vSwitches the VMs in each of these switches are in separate networks with no network pa
11. Def 256 Def 256 No changes LUNs allowed Min 1 Min 1 Max 65535 Max 65535 use_msi Use preferred MSI X Def 2 Def 2 No changes interrupt mode if possible Min 0 Min 0 0 MSI disabled Max 2 Max 2 1 MSI enabled 2 MSI X enabled Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration FC and FCoE Driver Configuration G EMULEX 31 Table 2 1 FC and FCoE Driver Parameters Continued ESXi 5 0 5 1 ESXi 5 5 OP Legacy Native Mode Module Driver Model Driver Model Parameter Description Values Values Comments enable_npiv Enable NPIV functionality Def 1 Def 1 No changes 0 NPIV functionality Min 0 Min 0 disabled Max 1 Max 1 1 NPIV functionality enabled fcf_failover_ FCF Fast failover 1 Def 1 Def 1 No changes policy Priority failover 2 Min 1 Min 1 Max 2 Max 2 enable_rrq Enable RRQ functionality Def 2 Def 0 The native mode driver Min 0 Min 0 will migrate to 2 0 2 Max 2 Max lt 1 in a future release 0x0 disabled XRI OXID use not tracked 0x1 XRI OXID reuse is timed with ratov RRQ sent 0x2 XRI OXID reuse is timed with ratov No RRQ sent enable_hba_ Enable HBA resets from the Def 1 Def 1 No changes reset driver Min 0 Min 0 Max 1 Max 1 enable_hba_ Enable HBA Heartbeat Def 1 Def 1 No changes heartbeat 0 HBA Heartbeat Min 0 Min 0 disabled Max 1 Max 1 1 HBA Heartbeat enabled sg_seg_cnt The maximum
12. Multipaths on the LUN are displayed Error Handling Under Multipath MPIO and Cluster Configurations In an MPIO or cluster configuration fault tolerant software is present on the system that makes the iSCSI driver error handling redundant These configurations also require that I O errors be reported as soon as they are detected so the software can failover to an alternate path or an alternative node as quickly as possible When the iSCSI driver is run under these configurations the error handling implemented in the iSCSI driver must be turned off by setting the default value of LDTO and ETO to 0 The changes will take effect during the next driver load Reading the Driver Statistics for a Specified Port You can read the iSCSI driver s statistics for a specific port on the adapter to diagnose potential performance issues To read the driver statistics for a particular port use the following command cat proc be2iscsi be2iscsi lt xXX gt driver_ stats where XX is the specific port number Setting the Log Level The log level setting enables the logging of debug information in system logs for a specific path or all paths in the driver There are two methods to set the log level 1 User configurable driver parameters use either of the following commands to set the log level Note The new log level value will take effect after the next reboot e esxcfg module s log level 0xff be2iscsi or e vmkload_mod be2is
13. None required elx_mes1057 Authentication transaction reject reason lt value gt exp lt value gt DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 903 DG EMULEX Troubleshooting the FC FCoE Driver Miscellaneous and FCoE Events 1200 1299 elx_mes1201 Failed to allocate dfc_ host DESCRIPTION Driver failed to allocate a DFC host and bind it to the management stack DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1209 C_CT Request error Data lt value gt lt value gt DESCRIPTION IOCTL CT response error driver is failing the IOCTL request DATA 1 response buffer flag 2 Data Size ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1210 Invalid cmd size lt cmd value gt lt cmdsz value gt lt rspsz value gt DESCRIPTION DATA None ACTION None required elx_mes1211 genreq alloc failed lt value gt DESCRIPTION DATA None ACTION None required elx_mes1213 FCoE cmd overflow lt off value gt lt cnt value gt gt lt cmdsz value gt DESCRIPTION DATA None ACTION None required elx_mes1214 Cannot issue FCoE cmd SLI not active lt off value gt rc EACCESS DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware E
14. elx_mes2529 Mailbox command lt vpi gt cannot issue DESCRIPTION DATA 1 mbxCommand 2 sli_flag 3 flag ACTION None required elx_mes2530 Mailbox command lt vpi gt cannot issue DESCRIPTION The SLI layer in the driver is inactive DATA 1 mb mbxCommand 2 sli_flag 3 flag ACTION None required elx_mes2531 Mailbox command lt cpi gt cannot issue DESCRIPTION DATA 1 mb mbxCommand 2 sli_flag 3 flag ACTION None required elx_mes2532 Mailbox command lt vpi gt lt mbxCommand gt cannot issue DESCRIPTION The mailbox bootstrap code detected that the SLI layer is active DATA 1 sli4_mbox_opcode 2 sli_flag 3 MBX_POLL ACTION None required elx_mes2533 Mailbox command lt vpi gt lt mbxCommand gt cannot issue DESCRIPTION DATA 1 sli4_mbox_opcode 2 sli_flag 3 MBX_NOWAIT ACTION None required elx_mes2535 Unsupported RQ count lt entry_count gt DESCRIPTION The receive queue ring can only be 512 1024 2048 or 4096 DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 117 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes2536 Unsupported RQ count lt entry_count gt DESCRIPTION The receive queue ring can only be 512 1024 2048 or 4096 DATA None ACTION None required elx_mes2537 Receive Frame Truncated DESCRIPTION The receive unsolicited handler detected a truncated frame
15. for the corresponding PF Note The driver currently supports a maximum of 16 VFs per PF for the OCe11100 and 32 VFs per PF for the OCe14000 series and LPe16202 OCe15100 adapters For multiple adapters use one of the following command ESXi 5 1 esxcfg module s max_vfs x1 yl1 x2 y2 x3 y3 be2net ESXi 5 5 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 14 1 Installation SG EMULEX Installing the NIC Driver 15 esxcfg module s max vfs x1 y1l x2 y2 x3 y3 elxnet Or esxcli system module parameters set p max _vfis x1 yl x2 y2 x3 y3 m elxnet where x1 is the number of VFs to be enabled on the first port of the first adapter y1 is the number of VFs to be enabled on the second port of the first adapter x2 is the number of VFs to be enabled on the first port of the second adapter y2 is the number of VFs to be enabled on the second port of the second adapter x3 is the number of VFs to be enabled on the first port of the third adapter y3 is the number of VFs to be enabled on the second port of the third adapter Note The command may be extended to enable more adapters 5 Reboot the host 6 To confirm the number of configured VFs run the following command esxcfg module g be2net 7 To list the SR IOV enabled pNICs run the following command esxcli network sriovnic list 8 To list the status of the VFs enabled on a PF run the following command
16. lt mbx status gt DESCRIPTION The READ_CONFIG mailbox command failed DATA None ACTION None required elx_mes2013 Could not manually add FCF record 0 status lt rc gt DESCRIPTION Could not add FCF record to the FCF list DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 112 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes2014 Invalid command lt iocb ulpCommand gt DESCRIPTION The IOCB command is invalid DATA None ACTION None required elx_mes2015 Invalid CT command lt iocb ulpCommand gt DESCRIPTION Invalid Command Type in the IOCB is not supported DATA None ACTION None required elx_mes2017 REG_FCFI mbxStatus error lt mbx status gt HBA state lt port_state gt DESCRIPTION The REG_FCFI mailbox command has failed DATA None ACTION None required elx_mes2018 REG_ VFI mbxStatus error lt mbx status gt HBA state lt port_state gt DESCRIPTION The REG_VFI mailbox command has failed DATA None ACTION None required elx_mes2022 INIT VPI Mailbox failed status lt status gt mbxStatus lt mbxStatus gt DESCRIPTION The INIT VPI mailbox command has failed DATA None ACTION None required elx_mes2400 Failed to allocate xri for ELS sgl DESCRIPTION Initialization failed to allocate XRI for the ELS SGL DATA None ACTION None required elx_mes2500 EQ_CREATE mailbox failed with status lt shdr_
17. mbxStatus lt mbxStatus gt DESCRIPTION Adapter initialization failed when issuing a READ_REV mailbox command DATA None ACTION This error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0440 Adapter failed to init READ_REV has missing revision information DESCRIPTION A firmware revision initialization error was detected DATA None ACTION This error could indicate a hardware or firmware issue Update the firmware If the issue persists report the error to Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 78 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0442 Adapter failed to init mbxCmd lt mbxCommand gt CONFIG_PORT mbxStatus lt mbxStatus gt DESCRIPTION Adapter initialization failed when issuing a CONFIG_PORT mailbox command DATA 1 hbainit ACTION This error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0443 Adapter failed to set maximum DMA length mbxStatus lt u mb mbxStatus gt DESCRIPTION Cannot set the maximum DMA length to reflect cfg_pci_max_read DATA None ACTION Set module parameter Ipfc_pci_max_read to 512 1024 2048 or 4096 elx_mes0445 Firmware initialization failed DESCRIPTION The driver was unable to initialize the hardware DATA None ACTION This
18. p paraml value param2 value m lpfc For ESXi 5 0 and 5 1 systems type esxcfg module s param value param2 value lt driver_name gt The lt driver_name gt is obtained from the vmkload_mod l call Look for the Ipfc prefix 2 To reboot the server type reboot Note VMware does not officially support unloading the driver via vmkload_mod u If you must unload the driver contact VMware technical support Note NPIV port creation and deletion are performed by the VMware vSphere client or Virtual Center service Refer to the VMware documentation for more information Example of Permanent Global Configuration The following example sets lun_queue_depth the maximum number of commands that can be sent to a single LUN to 20 default is 30 for all Emulex adapters in your system 1 Locate the parameter lpfc_lun_queue_depth in Table 2 1 on page 26 2 Set the permanent value using one of the following commands For ESXi 5 5 systems type esxcli system module parameters set p lpfc_lun_queue_depth 20 m lpfc For ESXi 5 0 and 5 1 systems type esxcfg module s lpfc_lun_queue_depth 20 lpfc820 3 To reboot the server type reboot The new setting is used when the driver reloads To verify the setting use one of the following commands For ESXi 5 5 systems type esxcli system module parameters list m lpfc For ESXi 5 0 and 5 1 systems type esxcfg module g lpfc820 Emulex Drivers Version 10
19. 10 0 for VMware ESXi User Manual P009803 01A Rev A 16 1 Installation 17 SG EMULEX Installing the NIC Driver Configuring Network Heap Size in ESXi Server 5 0 and 5 1 The amount of memory allocated by default for a network heap depends on the amount of memory configured in the system The ESXi Server network stack allocates a minimum of 64 MB to the network heap to handle network data Additional memory is allocated to the network heap if the system is configured with more memory If the network load requires more than 64 MB of memory the NIC driver cannot allocate it When this happens the driver logs messages in the file proc vmware log indicating that the alloc_skb call failed This impacts network performance considerably To read the current size of the network heap run the following command esxcfg advcfg j netPktHeapMaxSize netPktHeapMaxSize 0 If the default value of 64 MB is in effect this command shows the PktHeapMaxSize as 0 If any other value is in effect the command returns that value You can allocate more memory for the network heap using the esxcfg advcfg command For example to set the heap size to 128 MB run the following commands esxcfg advcfg k 128 netPktHeapMaxSize esxcfg advcfg j netPktHeapMaxSize netPktHeapMaxSize 128 The new value takes effect after a reboot Obtaining Information on the Installed NIC Driver To get information on the installed NIC driver on ESXi 5 0 and 5 1 s
20. ACTION None required elx_mes0349 rc should be MBX_SUCCESS DESCRIPTION The next mailbox command on the mailbox queue has failed DATA None ACTION None required elx_mes0350 rc should have been MBX_BUSY DESCRIPTION Attempting to unregister a default RPI from an interrupt context and the mailbox state is not busy DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 68 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0352 Config MSI mailbox command failed mbxCmd lt u mb mbxCommand gt mbxStatus lt u mb mbxStatus gt DESCRIPTION The mailbox command sent to the firmware to configure the adapter to use MSI X has failed DATA None ACTION Ensure the hardware platform supports MSI X elx_mes0359 Not a valid slow path completion event majorcode lt value gt minorcode lt value gt DESCRIPTION SLI 4 The EQE is not valid DATA None ACTION None required elx_mes0360 Unsupported EQ count lt entry_count gt DESCRIPTION Cannot create an event queue of this size DATA None ACTION None required elx_mes0361 Unsupported CQ count lt entry_count gt DESCRIPTION Cannot create a completion queue of this size DATA None ACTION None required elx_mes0362 Unsupported MQ count lt entry_count gt DESCRIPTION Cannot create MQ count of this size DATA None ACTION None required elx_mes0364 Invalid param DESCRIP
21. DEVNAME Restart N WAY negotiation Not implemented Not implemented esxcli network nic negotiate restart n vmnicx ethtool p identify DEVNAME Show visible port identification for example blinking esxcli does not support it ethtool t test Execute adapter self Not implemented Not implemented DEVNAME test esxcli network nic selftest run n vmnicXx ethtool Show adapter statistics v v The standard esxcli S statistics esxcli network Statistics only expose a DEVNAME limited set of statistic Emulex Drivers Version 10 0 for VMware ESXi User Manual nic stats get counters More extensive statistics are available through the esxcli plug in in the asynchronous driver esxcli elxnet stats get p lt pci dev name gt P009803 01A Rev A SXC EMULEX Appendix A Configuring iSCSI Through DHCP 157 Dynamic Host Configuration Protocol DHCP Recommendations Appendix A Configuring iSCSI Through DHCP Dynamic Host Configuration Protocol DHCP Recommendations If you are using a DHCP server to obtain an IP address for your iSCSI initiator Emulex recommends that you set up a reservation A reservation assigns a specific IP address based on the MAC address of your iSCSI function If you do not reserve an IP address through DHCP then you must set the lease length for the iSCSI initiator IP address to unlimited This allows the IP address lease not to expire Vendor Specif
22. Driver VPort Events 1800 1832 elx_mes1800 Could not issue unreg_vpi DESCRIPTION Driver attempt to unregister VPI failed DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1801 Create vport work array FAILED cannot do scsi_host_get DESCRIPTION Driver failed to create working list of VPorts DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1802 HBQ lt index gt local_hbqGetldx lt index gt is gt than hbqp gt entry_count lt count gt DESCRIPTION An error occurred when processing queue related to an adapter in a particular slot DATA 1 hbqno 2 local_hbqGetIdx 3 entry_count ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1803 Bad hbq tag Data lt tag gt lt count gt DESCRIPTION An error occurred when processing queue related tags for an adapter in a particular slot DATA 1 tag 2 buffer_count ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1804 Invalid asynchronous event code lt evt code gt DESCRIPTION The asynchronous event code that the firmware passed to the driver is invalid DATA None ACTION None required elx_mes1805 Adapter failed to init Data lt command gt lt status gt lt queue num gt D
23. ESXi 5 5 this is no longer true VMware recommends loading the drivers by default in native mode because this is the preferred driver model for all subsequent releases However because native mode is different than vmklinux and because there is no native mode in prior ESXi releases there is no driver parameter migration from vmklinux to native mode when migrating to ESXi 5 5 When you install ESXi 5 5 over your existing ESXi system you will notice after updating and rebooting the system that the driver parameter settings did not migrate For example if you set the lpfc_lun_queue_depth driver parameter to 8 on ESXi 5 1 and Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 1 Installation Q gt G EMULEX Driver Information then update from ESXi 5 1 to ESXi 5 5 you will see the following when the driver parameters are verified after the update esxcfg module g lpfc820 Unknown module name lpfc820 In summary when updating an existing ESXi system to ESXi 5 5 you must manually set all of the driver parameter values Preparing to Upgrade to ESXi 5 5 Upgrading your server to ESXi 5 5 now requires an additional planning step You must evaluate the initial ram disk for the server that will be upgraded and document the existing driver parameter values After the upgrade you must then manually reprogram those initial ram disk values FC and FCoE Driver Example The server administrator executes the fol
24. Emulex technical support elx_mes0113 A FLOGI ELS command lt elsCmd gt was received from DID lt did gt in Loop Mode DESCRIPTION While in Loop Mode an unknown or unsupported ELS command was received DATA None ACTION Check device DID elx_mes0115 Unknown ELS command lt elsCmd gt received from N_ Port lt did gt DESCRIPTION Received an unsupported ELS command from a remote N_Port DATA None ACTION Check remote N_Port for potential issue elx_mes0122 FDISC Failed value Fabric Detected Bad WWN DESCRIPTION The driver s FDISC failed The switch reported a bad WWN in the FLOGI request DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes0124 Retry illegal cmd lt value gt retry lt value gt delay lt value gt DESCRIPTION Port rejected ELS command as illegal Driver retrying DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 52 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0125 FDISC Failed value Fabric out of resources DESCRIPTION The fabric rejected an FDISC because the switch can not support any more virtual ports DATA None ACTION Reconfigure the switch to support more NPIV logins If this issue persists contact Emulex technical support elx_mes01
25. Event detected lt value gt DESCRIPTION DATA None ACTION None required elx_mes2897 The mboxq allocation failed DESCRIPTION DATA None ACTION None required elx_mes2898 The Ipfc_dmabuf allocation failed DESCRIPTION DATA None ACTION None required elx_mes2899 The mbuf allocation failed DESCRIPTION DATA None ACTION None required elx_mes2919 Failed to release resource extents for type lt value gt Status lt value gt Add l Status lt value gt Resource memory not released DESCRIPTION DATA None ACTION None required elx_mes2920 Failed to alloc Resource IDs rc lt value gt DESCRIPTION DATA None ACTION None required elx_mes2925 Failed to issue CT ABTS RSP lt value gt on xri lt value gt Data lt value gt DESCRIPTION The driver attempted and failed to issue a response to an unsolicited ABTS from the SAN DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 134 SG EMULEX Troubleshooting the FC FCoE Driver elx_mes2929 Resource Extent Opcode lt value gt is unsupported DESCRIPTION DATA None ACTION None required elx_mes2930 Failed to get resource extents Status lt value gt Add l Status lt value gt DESCRIPTION DATA None ACTION None required elx_mes2936 Could not find Vport mapped to vpi lt value gt DESCRIPTION DATA None ACTION None required elx_mes2945
26. Gigabaud Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt G EMULEX Table 2 1 FC and FCoE Driver Parameters Continued 2 Configuration 30 FC and FCoE Driver Configuration ESXi 5 0 5 1 ESXi 5 5 OP Legacy Native Mode Module Driver Model Driver Model Parameter Description Values Values Comments fcp_class Select FC class of service Def 3 Def 3 No changes for FCP sequences Min 2 Min 2 Max 3 Max 3 use_adisc Use ADISC on rediscovery to Def 0 Def 0 No changes authenticate FCP devices win 0 Min 0 instead of PLOGI Max 1 Max 1 max_scsicmpl_ Use SCSI command Def 0 Def 0 No changes time completion time to control Min 0 Min 0 queue depth to the device Max 60000 Max 60000 0 SCSI command Completion time is not used for controlling I O queue depth N I O queue depth is controlled to limit the I O completion time to N msecs ackO Enable ACKO support Def 0 Def 0 No changes Use ACKO instead of ACK1 Min 0 Min 0 for class 2 Max 1 Max 1 acknowledgement fdmi_on Enable FDMI support Def 0 Def 0 No changes 0 no FDMI support Min 0 Min 0 1 support FDMI without Max 2 Max 2 attribute of hostname 2 support FDMI with attribute of hostname discovery_ The maximum number of Def 32 Def 32 No changes threads ELS commands that can be yin 1 Min 1 outstanding during _ B discovery Max 64 Max 64 max_luns The maximum number of
27. If the issue persist contact Emulex technical support elx_mes1403 Failed to set up driver resource DESCRIPTION Driver resource initialization failed DATA None ACTION None required elx_mes1404 Failed to set up driver resource DESCRIPTION Driver resource initialization failed DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 99 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1405 Failed to initialize iocb list DESCRIPTION IOCB initialization failed DATA None ACTION None required elx_mes1406 Failed to set up driver resource DESCRIPTION Initialization failed to set up driver resource DATA None ACTION None required elx_mes1407 Failed to create scsi host DESCRIPTION Initialization failed to create SCSI host DATA None ACTION None required elx_mes1408 Port Failed POST portsmphr lt value gt perr lt port error gt sfi lt sfi reg gt nip lt nip reg gt ipc lt ipc reg gt scrl lt value gt scr2 lt value gt hscratch lt value gt pstatus lt port status gt DESCRIPTION The adapter s power on self test has failed DATA None ACTION Make sure the adapter firmware is up to date Contact Emulex technical support if the issue persists after system reboot elx_mes1410 Failed to set up pci memory space DESCRIPTION Initialization failed to set up PCI memory space DATA None ACTION None requ
28. Interrupt Moderation scheme that is based on the I O load and the interrupt rate The default setting for the Interrupt Moderation Policy attempts to vary the interrupt rate between 3500 to 10000 interrupts per second In addition the Emulex iSCSI driver allows other configuration settings which are listed in the following table Table 2 6 Interrupt Moderation Policy Settings Setting Parameter Description Disabled im_policy 0 Interrupt Moderation algorithm is turned off in the driver Aggressive im_policy 1 Achieves the highest interrupt rate among all available settings Moderate im_policy 2 This is the default value Conservative im_policy 3 Achieves a lower interrupt rate than Moderate Very Conservative im_policy 4 Achieves the minimum interrupt rate among all available settings While the default setting of Moderate may work for most configurations there are instances when the setting may need to be altered Changing the Interrupt Moderation Policy setting should be based on the initiator system configuration the number of iSCSI targets that will be connected the I O load and the throughput and latency offered by these iSCSI targets On systems capable of sustaining a higher interrupt rate and when the number of targets that will be connected is less up to 8 the more Aggressive setting will result in lower latency and higher values of I O operations per second IOPs But the higher interrupt rate could also resu
29. Native Mode Driver Support for ethtool Commands ESXi 5 5 Native Mode Driver Support for ethtool Commands Table 3 11 lists the ethtool support provided by the earlier vmklinux driver and the equivalent support provided through the esxcli plug in and the VmkMgmtKeyVal interface Table 3 11 ESXi 5 5 Native Mode Driver Support for ethtool Commands ethtool Command ethtool a show pause DEVNAME Description Show pause options ESXi 5 5 vmklinux Driver Support VmkMgmtKeyVal interface v ESXi 5 5 Native Mode Driver Support esxcli plug in esxcli does not support it J ustification for this option or parameter if missing and required This information is available through the following command esxcli network nic get n vmnico ethtool A pause Set pause options Not implemented esxcli does not DEVNAME support it ethtool Show coalesce options v v c show coalesce esxcli network DEVNAME nic coalesce get n vmnicx ethtool Set coalesce options v v C coalesce esxcli network DEVNAME nic coalesce set n vmnicx ethtool Query RX TX ring v esxcli does not This command is not very g show ring parameters support it useful since the driver DEVNAME does not support queue sizing ethtool G set ring Set RX TX ring Not implemented esxcli does not This command cannot be DEVNAME parameters support it implemented because the driver does not suppo
30. None ACTION None required elx_mes2581 Not enough WQs lt sli4_hba max_cfg_param max_wq gt from the pci function for supporting FCP WQs lt cfg_fcp_wq_count gt DESCRIPTION The driver was not configured with the minimum number of fast path work queues DATA None ACTION None required elx_mes2598 Adapter Link is disabled DESCRIPTION The adapter link is disabled DATA None ACTION None required elx_mes2599 Adapter failed to issue DOWN_LINK mbox command rc lt rc gt DESCRIPTION The adapter failed to issue a DOWN_LINK mailbox command DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 122 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2600 failed to allocate mailbox memory DESCRIPTION Failed to allocate mailbox memory DATA None ACTION None required elx_mes2605 Ipfc_dump_static_vport memory allocation failed DESCRIPTION Memory allocation failed DATA None ACTION None required elx_mes2606 No NPIV Fabric support DESCRIPTION No NPIV Fabric support DATA None ACTION None required elx_mes2607 Failed to allocate init_vpi mailbox DESCRIPTION Failed to allocate init_vpi mailbox DATA None ACTION None required elx_mes2608 Failed to issue init_vpi mailbox DESCRIPTION Failed to issue init_vpi mailbox DATA None ACTION None required elx_mes2609 Init VPI mailbox failed lt u mb mbxStatus gt
31. Parameter throttle_log_cnt Description Do not exceed this number of messages logged within throttle_log_time ESXi 5 0 5 1 Legacy Driver Model Values ESXi 5 5 OP Native Mode Driver Model Values Default Def 10 Minimum Min 1 Maximum Max 1000 Comments For the native mode driver Logging mechanism intended to speed up issue diagnosis by reducing the necessity to enable driver logging throttle_log_ Do not exceed Def 300 For the native mode time throttle_log_cnt number Min 5 driver of logs within this time Max 86400 Works with limit seconds Emulex Drivers Version 10 0 for VMware ESXi User Manual throttle_log_cnt P009803 01A Rev A gt G EMULEX Table 2 1 FC and FCoE Driver Parameters Continued 2 Configuration 27 FC and FCoE Driver Configuration ESXi 5 0 5 1 ESXi 5 5 OP Legacy Native Mode Module Driver Model Driver Model Parameter Description Values Values Comments compression_log Define how often the Def 300 For the native mode compression logs are Min 5 driver written in seconds Max 86400 _ The driver uses this parameter to periodically write status messages to the vmkernel log The messages provide state analysis on the paths targets and adapter It differs from throttle in that throttle stops the driver from spamming the logs on a very high frequency failure suppress link_ Suppress Link Up at Def
32. Ring lt ringno gt Cannot find buffer for an unsolicited iocb tag lt un ulpWord 3 gt DESCRIPTION There are no more pre allocated buffers available to handle unsolicited buffers DATA None ACTION None required elx_mes0344 Ring lt ringno gt Cannot find buffer for an unsolicited iocb tag lt unsli3 sli3Words 7 gt DESCRIPTION There are no more pre allocated buffers available to handle unsolicited buffers DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 67 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0345 Resetting board due to mailbox timeout DESCRIPTION A mailbox command failed to complete The driver is resetting the port DATA None ACTION If the mailbox command fails again set the lpfc_log_verbose to LOG_MBOX and retry elx_mes0346 Ring lt ring number gt handler unexpected ASYNC_ STATUS evt_code lt evtcode gt DESCRIPTION The adapter received an asynchronous event that was not a temperature event DATA None ACTION None required elx_mes0347 Adapter is very hot please take corrective action Temperature lt value gt Celsius DESCRIPTION Adapter temperature is above normal range DATA Temperature in Celsius ACTION Shutdown and remove the adapter Contact customer support elx_mes0348 NameServer login node freed DESCRIPTION The enable mode failed to free up the nameserver login DATA None
33. VLAN tag 1 Power off the VM before proceeding to the next step 2 Edit the lt vm name gt vmx file corresponding to the VM from the vmfs Datastore under vmfs volumes Datastore lt VM_DIR gt 3 Append the following line pciPassthru lt X gt defaultVlan lt vlan_id gt where lt vlan_id gt is the required VLAN ID value for the pass through VF lt X gt assigned to the VM 4 Power on the VM Virtual Guest Tagging When VGT is configured a guest operating system can configure any VLAN ID using the native VLAN configuration method in the guest operating system To enable VGT 1 Configure the special VLAN ID 4095 using the steps listed in Default VLAN Tagging on page 16 2 Use the native method in the guest operating system to configure the required VLAN ID for example vconfig in the Linux guest operating system Configuring a Static MAC for a VF A MAC address is automatically configured by ESXi for each VF This default MAC address may be modified using the following steps 1 Power off the VM before proceeding to the next step 2 Edit the lt vm name gt vmx file corresponding to a VM from the vmfs Datastore under vmfs volumes Datastore lt VM_DIR gt 3 To configure the MAC address 00 50 56 00 00 02 on the first VF assigned to this VM append the following lines peiPassthru0 MACAddressType static pciPassthru0 MACAddress 00 50 56 00 00 02 4 Power on the VM Emulex Drivers Version
34. Virtual Machine name DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1840 Delete VPORT cannot proceed at this time due to SCSI layer busy DESCRIPTION DATA None ACTION None required elx_mes1920 Exec format error Dropping Link state event DESCRIPTION No dfchba instance available for Link State event dropping DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1923 Exec format error Dropping rscn event DESCRIPTION No dfchba instance available for RSCN event dropping DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1926 Exec format error DESCRIPTION No dfchba instance available for IOCTL loopback test dropping DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1927 Exec format error Dropping temp event DESCRIPTION No dfchba instance available for Temperature event dropping DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1928 Exec format error Dropping dump event DESCRIPTION No dfchba instance available for Dump event dropping DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooti
35. a signed integer outside of the valid range The driver will return a number in the Warning message Any other messages will be returned in the following form be2iscsi FUNCTION_NAME LINE MESSAGE For example be2iscsi 1088 kmalloc failed You will be requested to find the function FUNCTION_NAME at line LINE in the source Description of Mandatory and Optional Parameters The following table describes the parameters used in the data string for option 43 Table 3 9 Data String Parameters for Option 43 Parameter Description Field Type lt TargetIP gt Replace it with a valid IPv4 address in dotted decimal Mandatory notation lt TargetT CPPort gt Replace it with a decimal number ranging from 1 to 65535 Optional inclusive The default TCP port 3260 is assumed if not specified lt LUN gt It is hexadecimal representation of Logical Unit number of Optional the boot device If not provided LUN 0 is assumed to be the boot LUN It is an eight byte number which should be specified as a hexadecimal number consisting of 16 digits with an appropriate number of 0 s padded to the left if required lt TargetName gt Replace it with a valid iSCSI target iqn name of up to 223 Mandatory characters Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 151 DG EMULEX Troubleshooting the iSCSI Driver Table 3 9 Data String Parameters for Option 43 Continued P
36. a transient condition If not contact Emulex technical support elx_mes2823 txq empty and txq_cnt is lt value gt DESCRIPTION The driver has detected a discrepancy between the elements queued to the txq and the counter tracking the number or items DATA None ACTION None required There is nothing for the driver to do except correct the counter the txq is empty elx_mes2824 Cannot re enable interrupt after slot reset DESCRIPTION The driver failed to re enable interrupts following a PCI slot reset command DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 129 DG EMULEX Troubleshooting the FC FCoE Driver ACTION A system reboot may be required to fully recover Contact Emulex technical support if issues persist elx_mes2825 Unknown PCI error state lt value gt DESCRIPTION The driver writes this message to the console when the PCI subsystem has detected an error on an Emulex port and called the driver The driver reacts by resetting the port DATA None ACTION None required The driver resets the device in an attempt to recover Contact Emulex technical support if issues persist elx_mes2826 PCI channel disable preparing for reset DESCRIPTION The driver writes this message to the console when it is preparing the port for a reset operation DATA None ACTION None required This message is notification of a corrective measure Contact Emulex
37. adapter can view elx_mes0249 Cannot issue Register Fabric login Err lt err gt DESCRIPTION Could not issue the fabric reg login the err value is unique for each possible failure DATA None ACTION None required elx_mes0251 NameServer login no memory DESCRIPTION Could not allocate memory for the NDLP structure DATA None ACTION None required elx_mes0252 Cannot issue NameServer login DESCRIPTION Could not issue an ELS PLOGI to the nameserver DID DATA None ACTION Check the port connection and switch configuration elx_mes0253 Register VPI Can t send mbox DESCRIPTION Could not issue the REG_LOGIN command for this VPort DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 58 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0254 Register VPI no memory goto mbox_err_exit DESCRIPTION Could not allocate memory for the REG_LOGIN mailbox command DATA None ACTION None required elx_mes0255 Issue FDISC no IOCB DESCRIPTION All of the pre allocated IOCBs are in use DATA None ACTION None required elx_mes0256 Issue FDISC Cannot send IOCB DESCRIPTION Unable to send the fabric IOCB DATA None ACTION Check the switch configuration elx_mes0257 GID_FT Query error lt ulpStatus gt lt fc_ns_retry gt DESCRIPTION The GID_FT CT request for the nameserver has failed DATA None ACTION Check the switch con
38. bus read access failure lt value gt DESCRIPTION A read to the adapter s PCI registers failed DATA Contents read from requested register ACTION Contact Emulex technical support elx_mes3152 Unrecoverable error bring the port offline DESCRIPTION Unable to recover the adapter port post hardware error Taking the port offline DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 139 DG EMULEX Troubleshooting the FC FCoE Driver ACTION Contact Emulex technical support elx_mes3153 Fail to perform the requested access lt value gt DESCRIPTION Driver failed to execute the requested management action DATA Register action ACTION Contact Emulex technical support elx_mes3154 BLS ABORT RSP failed data lt value value gt DESCRIPTION Driver issued BLS ABORT Response failed to complete DATA I O status and I O reason ACTION Contact Emulex technical support elx_mes3161 Failure to post els sgl to port DESCRIPTION Driver failed to port scatter gather list to the adapter DATA None ACTION Contact Emulex technical support elx_mes3172 SCSI layer issued Host Reset Data lt value gt DESCRIPTION SCSI layer issued a host reset request to the driver DATA Reset result ACTION Contact Emulex technical support elx_mes3175 Failed to enable interrupt DESCRIPTION The driver failed to get interrupts re enabled after an adapter reset DATA None ACTION
39. convenient elx_mes0264 No NPIV Fabric support DESCRIPTION The switch to which the port is connected does not support NPIV DATA None ACTION Check the switch configuration elx_mes0266 Issue NameServer Req lt cmdcode gt err lt rc gt Data lt fc_flag gt lt fc_rscn_id_cnt gt DESCRIPTION The driver was not able to send the nameserver CT command DATA 1 VPorts fe_flag 2 VPorts fc_rscn_id_cnt ACTION Check the switch and port configurations elx_mes0267 NameServer GFF Rsp lt did gt Error lt ulpStatus gt lt un ulpWord 4 gt Data lt fc_flag gt lt fc_rscn_id_cnt gt DESCRIPTION The nameServer GFF CT request failed DATA 1 VPorts fc_flag 2 VPorts fc_rscn_id_cnt ACTION Check the switch and port configurations elx_mes0268 NS cmd lt cmdcode gt Error lt ulpStatus gt lt un ulpWord 4 gt DESCRIPTION The nameServer CT request failed DATA None ACTION Check the switch and port configurations Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 60 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0271 Illegal State Transition node lt nip_DID gt event lt evt gt state lt nip_state gt Data lt nlp_rpi gt lt nlp_flag gt DESCRIPTION The current node state does not have a handler for this event DATA 1 nlp_rpi 2 nlp_flag ACTION Verify that all targets are still visible to the SCSI mid layer elx_mes0272 Illegal State Transitio
40. devices Installing the NIC Driver and Management Software For ESXi 5 0 and ESXi 5 1 systems the latest Emulex NIC driver is available out of box Refer to the operating system guide for installation instructions Note Before installing the OCM for VMware vCenter software plug in you must install the NIC driver from the VMware software website Note Before installing the driver and CIM Provider verify that the firmware version is correct If it is proceed with the installation If it is not you must update the firmware using the OCM for VMware vCenter software plug in See the OCM for VMware vCenter User Manual for additional information The installation requires that the CIM Provider be installed For more information on installing the CIM Provider see the appropriate CIM Provider Installation Guide Uninstalling the NIC Driver See the VMware Patch Download page for instructions Installing the Native Mode Ethernet Driver esxcli Plug in for ESXi 5 5 This section describes the installation and usage of the esxcli plug in for the native mode Ethernet elxnet driver on ESXi 5 5 systems Note You can download the esxcli plug in from the Emulex website To install the esxcli elxnet plug in 1 Copy the following file to the ESXi host vmware esx elxcli lt gt vib On the ESXi host install the vibs as follows esxcli software vib install no sig check v lt pathname gt vmware esx elxcli lt gt vib Restar
41. ei a i ii a a E 20 Ethernet Driver Examples sssssssssssssrrrrstsr artt tn rnr ti ttnn t rttr tn rn atarin unnn nrn runn nase 20 FC and FCoE Driver Configuration sssssssssssnnnnnnnnnnnnsnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 23 FC FCoE Driver Parameters Configuration MethodS cccccccccrrereceererereeeerr 23 Permanent FC FCoE Configuration Methods Using Native ESXi Tools see eee 23 Dynamically Adding LUNS ccceccee cece e erence eee e eee AEE E EEE SH EEE S EEE E EEE ES 25 Dynamically Adding TarOClScc swscivosleesicsdiinvreetebire meets biew seein tera seebavearyenes 25 FC FCoE Driver Configuration Parameters acaiescdxvaiavacdcnvasedendixedeisataccecainds 26 Creating an FC Remote Boot DISK winis icscccsceveiees seeds sstieisdavesteetveteesesaiiecesenes 32 Managing Devices through the CIM Interface ccccceeseeeeee eee esses eeeaeeeeaeeenas 32 Using the OneCommand Manager GUI cece eee eee ee netted 32 Using the OCM for VMware vCenter Application ccccccceeseeeeeeeeeeeeeeeeeeeneeatees 33 Installing the Emulex CIM Provider ivsiccrsccessievsantscieveeeieediiw dees decaaeess veer eee 33 Working with VPorts Virtual POUUS lt 2 cp ccacseniipeiaaneatiareaansetdpreminccttarcassgediates 33 Creating Deleting and Displaying VPOrts cccccceececeeeeeeeeteeeteseteeeeeenereneeaes 33 NIC Driver Configuration ssssssssssusnunnnnnnnnsnnunnnnnnnnnnnnnnnnnnnnnnnnnnnunnnnnnnnnnn 34 Co
42. elx_mes2511 POST_SGL mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to post the SGL pages to the firmware has failed DATA None ACTION None required elx_mes2512 MODIFY_EQ_ DELAY mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to modify the EQ delay in the firmware has failed DATA None ACTION None required elx_mes2513 POST_SGL_ BLOCK mailbox command failed status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to post the SGL pages to the firmware has failed DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 115 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2514 POST_RPI_HDR mailbox failed with status lt shdr_status gt add_status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to post the RPUI header pages to the firmware has failed DATA None ACTION None required elx_mes2515 ADD_FCF_RECORD mailbox failed with status lt rc gt DESCRIPTION The mailbox command to add the FCF record has failed DATA None ACTION None required elx_mes2521 READ_FCF_RECORD mailbox failed with status lt shdr_ status gt add_status lt shd
43. error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0446 Adapter failed to init mbxCmd lt mbxCommand gt CFG_RING mbxStatus lt mbxStatus gt ring lt num gt DESCRIPTION Adapter initialization failed when issuing a CFG_RING mailbox command DATA None ACTION This error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0448 Adapter failed to init mbxCmd lt mbxCommand gt READ_SPARM mbxStatus lt mbxStatus gt DESCRIPTION Adapter initialization failed when issuing a READ_SPARM mailbox command DATA None ACTION This error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0449 Phys attribute Instance Error Defaulting to Ipfc_ attr to lt value gt Allowed range is min max DESCRIPTION A physical device attribute has an out of range value The driver is correcting it DATA 1 value written 2 minimum value 3 maximum value Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 79 DG EMULEX Troubleshooting the FC FCoE Driver ACTION Write the default value elx_mes0450 Ipfc_ attr attribute cannot be set to lt value gt allowed range is Yamin max DESCRIPTION Sysfs attribute value written exceeds attribute range DATA 1 attribute na
44. events LOG_TEMP 0x100 Temperature sensor events LOG_MISC 0x400 Miscellaneous and FCoE events LOG_SLI 0x800 SLI events LOG_FCP_ERROR 0x1000 Selective FCP events LOG_LIBDFC 0x2000 IOCTL events LOG_VPORT 0x4000 NPIV events LOG_EVENT 0x10000 IOCTL event LOG_DAEMON 0x20000 IOCTL Daemon events LOG_FIP 0x40000 FIP event LOG_PROC 0x80000 Procfs events Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A xs 3 Troubleshooting 49 DG EMULEX Troubleshooting the FC FCoE Driver Table 3 2 Message Log Table for ESXi 5 0 and 5 1 Systems LOG Message Verbose Mask Definition Verbose Bit Verbose Description LOG_FCP_UNDERRUN 0x100000 FCP underruns LOG_TRC_NODE 0x00200000 Node Trace Events LOG_ALL_MSG ox7fffffff Log all messages Table 3 3 Message Log Table for ESXi 5 5 Systems LOG Message Verbose Mask Definition Verbose Bit Verbose Description LOG_ELS 0x1 ELS events LOG_DISCOVERY 0x2 Link discovery events LOG_MBOX 0x4 Mailbox events LOG_INIT 0x8 Initialization events LOG_LINK_EVENT 0x10 Link events LOG_MGMT_ERROR 0x20 IODM management error logging LOG_FCP 0x40 FCP traffic history LOG_NODE 0x80 Node table events LOG_TEMP 0x100 Temperature sensor events LOG_BG 0x200 BlockGuard events LOG_MISC 0x400 Miscellaneous and FCoE events LOG_SLI 0x800 SLI events LOG_FCP_ERROR 0x1000 Selective FCP events LOG_LIBDFC 0x2000 IOCTL events LOG_VPORT
45. gt G EMULEX Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A Emulex Connects Servers Storage and People gt EMULEX EMULEX CONFIDENTIAL Copyright 2003 2013 Emulex All rights reserved worldwide No part of this document may be reproduced by any means or translated to any electronic medium without the prior written consent of Emulex Information furnished by Emulex is believed to be accurate and reliable However no responsibility is assumed by Emulex for its use or for any infringements of patents or other rights of third parties which may result from its use No license is granted by implication or otherwise under any patent copyright or related rights of Emulex Emulex the Emulex logo AutoPilot Installer AutoPilot Manager BlockGuard Connectivity Continuum Convergenomics Emulex Connect Emulex Secure EZPilot FibreSpy HBAnyware InSpeed LightPulse MultiPulse OneCommand OneConnect One Network One Company SBOD SLI and VEngine are trademarks of Emulex All other brand or product names referenced herein are trademarks or registered trademarks of their respective companies or organizations Emulex provides this manual as is without any warranty of any kind either expressed or implied including but not limited to the implied warranties of merchantability or fitness for a particular purpose Emulex may make improvements and changes to the product described in this manual at any time
46. iSCSI Driver ssssssssnnnnnsnssnunnnnnnnnnnnnnnnnnnnnnnnnnunnnnnnnnn 147 Retrieving iSCSI Error Log Codes icciicccviviverenivien cesceetieuverears tea woratieerenst 147 iSCSI Error Log Code EM eS 22k 2 encsisendscnssnet iineri neri tine E EREE EAEE RE ERRENA EE TETES 147 Additional iSCSI Driver Messages ccuciscisccrecivereeigussteacssvemenseesstecdvsennentauees 150 Description of Mandatory and Optional ParameterS ssssssssssererrrerrerrrrrrerrrrer 150 ESXi 5 5 Native Mode Driver Troubleshooting Support sssssssssnnnnnnnnnnnnnnnnnnn 153 ESXi 5 5 Native Mode Driver Support for ethtool Commands ssssssssssssnnnnnnnnns 155 Appendix A Configuring iSCSI Through DHCP ssssceeeessceeeeeeseeeeueceeeeenaees 157 Dynamic Host Configuration Protocol DHCP Recommendations sceseeeseeeeee 157 Vendor Specific Option 43 cscsccsescscassnscccsccscscascesasessaseesasenstecasasessacensccaness 157 Format of Vendor Specific Option 43e ciscidecdieedaidersise tavtesdisacabewesbeentwtsey een 157 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 5 gt G EMULEX List of Tables Table 2 1 Table 2 2 Table 2 3 Table 2 4 Table 2 5 Table 2 6 Table 2 7 Table 2 8 Table 3 1 Table 3 2 Table 3 3 Table 3 4 Table 3 5 Table 3 6 Table 3 7 Table 3 8 Table 3 9 Table 3 10 Table 3 11 Emulex Drivers Version 10 0 for VMware ESXi User Manual FC and FCoE Driver Parameter siccccccvecstcdesantespedeanen
47. mb mbxStatus gt HBA state lt port_state gt DESCRIPTION The unregistered FCFI has failed DATA None ACTION None required elx_mes2551 UNREG_FCFI mbox allocation failed HBA state lt port_state gt DESCRIPTION The allocation for the UNREG_FCFI mailbox command has failed DATA None ACTION None required elx_mes2552 Unregister FCFI command failed rc lt rc gt HBA state lt port_state gt DESCRIPTION The unregister FCFI mailbox command has failed DATA None ACTION None required elx_mes2553 Ipfc_unregister_unused_fcf failed to read FCF record HBA state DESCRIPTION DATA None ACTION None required elx_mes2554 Could not allocate memory for fcf record DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 119 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2555 UNREG_VFI mbxStatus error lt u mb mbxStatus gt HBA state lt port_state gt DESCRIPTION The unregister VFI mailbox command has failed DATA None ACTION None required elx_mes2556 UNREG_VFI mbox allocation failed HBA state lt port_state gt DESCRIPTION Could not allocate memory for UNREG_VFI mailbox command DATA None ACTION None required elx_mes2557 UNREG_ VFI issue mbox failed rc lt rc gt HBA state lt port_state gt DESCRIPTION Could not issue the UNREG_VFI mailbox command DATA None ACTION None required elx_mes2558 ADD
48. path FCP CQ lt fcp_cqidx gt rc lt rc gt DESCRIPTION The fast path FCP CQ setup failed DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0528 Mailbox CQ not allocated DESCRIPTION The mailbox CQ is not allocated DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0529 Failed setup of slow path mailbox CQ rc lt value gt DESCRIPTION Driver failed to setup Completion Queue Failure code is reported DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 84 SG EMULEX Troubleshooting the FC FCoE Driver ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes0530 ELS CQ not allocated DESCRIPTION The ELS CQ is not allocated DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0531 Failed setup of slow path ELS CQ rc lt value gt DESCRIPTION The ELS CQ is allocated but failed initial setup DATA 1 status ACTION The driver fails to load Contact Emulex technical support elx_mes0534 Fast path FCP WQ lt fcp_eqidx gt not allocated DESCRIPTION The fast path FCP WQ is not allocated DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0535 Failed setup of fast path FCP WQ lt fcp_wqidx gt rc lt rc gt DESCRIPTION The fast path FCP WQ setup failed D
49. power management resume function could not start the worker thread DATA None ACTION Unload and reload the driver Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 77 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0435 Adapter failed to get Option ROM version status lt rc gt DESCRIPTION The driver could not read the adapter s option ROM DATA None ACTION Reset the adapter Ensure that the adapter s firmware is current elx_mes0436 Adapter failed to init timeout status reg lt status gt DESCRIPTION The adapter failed during power up diagnostics after it was reset DATA None ACTION This error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0437 Adapter failed to init chipset status reg lt status gt DESCRIPTION The adapter failed during power up diagnostics after it was reset DATA None ACTION This error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0438 Adapter failed to init chipset status reg lt status gt DESCRIPTION The adapter failed during power up diagnostics after it was reset DATA None ACTION This error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0439 Adapter failed to init mbxCmd lt mbxCommand gt READ_ REV
50. set between 0 19 the driver will assume a value of 20 internally No modifications will be seen in the registry im_policy Controls the rate of interrupts for the UCNA For more information see Interrupt Moderation Policy Settings on page 42 large I O 128 128 512 Maximum transfer size in a single I O request in kilobytes By default the iSCSI driver supports a maximum of 128 KB of dataina single I O request This option can be used to enable support for 512 KB of data in a single I O request log_level 0x00 Oxff Enables the logging of debug information in system logs for a specific path or all paths in the driver The following command line shows how to configure the driver with LDTO value as 25 seconds vmkload_mod be2iscsi ldto 25 To configure the ESXi Server to load the iSCSI driver with this value after each reboot run the following commands and reboot the system Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration 41 gt G EMULEX iSCSI Driver Configuration esxcfg module s ldto 25 be2iscsi usr sbin esxcfg boot r reboot The im_policy Interrupt Moderation policy parameter configures the Emulex iSCSI driver to use different settings for Interrupt Moderation An im_policy value of 1 achieves the highest interrupt rate whereas the value 4 provides the least interrupt rate The default value is 2 An im_
51. size in MTU be between 64 and 9000 bytes configuration IOCTL The MTU will not be changed Warning Invalid vlan priority labeled A request to set a VLAN priority tag Must be 0 7 was made with an invalid value Warning Failed to allocate memory for The memory allocation for a pass pass through command through command failed The driver will continue to function The configuration utility that issued the pass through IOCTL will fail Warning Pass through command failed The pass through firmware command opcode lt DDD gt status 0x lt XXX gt with the indicated opcode failed The driver should continue to function The configuration utility that issued the pass through IOCTL will fail Warning Command to modify EQ delay The firmware command to change failed the EQ delay failed The driver will continue to function Adaptive interrupt coalescing does not function correctly NIC Adapter Firmware Error The following POST message appears if you have loaded firmware on the adapter that the controller does not support POST Error Firmware halted This firmware does not support this controller Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 147 SG EMULEX Troubleshooting the iSCSI Driver Troubleshooting the iSCSI Driver The following table provides information on troubleshooting the iSCSI driver Table 3 6 Troubleshooting the iSCSI Driver Issue R
52. that the drives were lost If any I Os were in progress the system may see I O errors or failures Warning The be2iscsi driver received a Task The operating system version is not Management Function that is not supported supported and rejected this request The error log entry immediately following this entry will indicate the TMF function code that was rejected Warning The be2iscsi driver received a Task This message may indicate a slow Management Function Abort request connection to the target Check for an I O request that is not present network connectivity to the target for with the driver any errors Error The be2iscsi driver encountered a This failure indicates that the driver mismatched version of the firmware version that is running on the system running on the board This error may does not match the version of the be followed by more error codes firmware flashed on the board Fix this 0x31840001 or 0x31880001 indicating by installing the desired version that the be2iscsi driver failed to load Error The beZ2iscsi driver detected a failure This failure indicates that the in the hardware during initialization hardware has not been initialized or is This error may be followed by more malfunctioning This may also indicate error codes 0x31840001 or 0x31880001 that the firmware is not running indicating that the be2iscsi driver correctly failed to load Warning Both Port 0 and Port 1 links were down Check the li
53. the CLI enter the following command esxcfg vswitch m 9000 vSwitchl Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A XC EMULEX 2 Configuration 37 NIC Driver Configuration Setting the MTU Size for a Linux Guest Operating System To set the MTU size in each Linux guest operating system to 9000 run the following command ifconfig eth lt N gt mtu 9000 where lt N gt is the number of the Ethernet interface on which you are working Setting the MTU Size for a Windows Guest Operating System To set the MTU size in each Windows guest operating system 1 Go to the Start menu and select Control Panel gt System Select the Hardware tab and open Device Manager Expand the Network Adapters heading Right click the appropriate NIC and select Properties Select the Advanced tab and set the MTU value ae WN Using the Port Statistics Counters You can view all of the port statistics counters maintained by the adapter s Ethernet driver for potential performance issues Excessive drop or error counters are an indication of a bad link or defective hardware To view the statistics of the vmnics on the ESXi host run the following command vsish e get net pNics lt vmnicx gt stats where lt vmnicx gt is the corresponding interface To view the port statistics counters on Linux guest VMs on ESXi 5 0 and 5 1 run the following command ethtool S eth lt N gt where eth lt N gt is the name of
54. the Ethernet device you are working on for example eth0 Table 2 4 contains a list of ethtool S option port statistics counters and their descriptions To view the port statistics counters on ESXi 5 5 run the following command esxcli network nic stats get n vmnico Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt G EMULEX 2 Configuration NIC Driver Configuration The output should look similar to the following NIC statistics for vmnico0 Packets received 2795 Packets sent 0 Bytes received 346765 Bytes sent 0 Receive packets dropped 0 Transmit packets dropped Total receive errors 0 Receive length errors 0 Receive over errors 0 Receive CRC errors 0 Receive frame errors 0 Receive FIFO errors 0 Receive missed errors 0 Total transmit errors 0 Transmit aborted errors 0 Transmit carrier errors 0 Transmit FIFO errors 0 Transmit heartbeat errors Transmit window errors 0 Refer to Table 3 11 ESXi 5 5 Native Mode Driver Support for ethtool Commands on page 155 for the equivalent command to get driver priv stats Table 2 4 Port Statistics Counters Ethtool Statistics Counter Name Description rx_packets The number of packets received rx_ucast The number of unicast packets received rx_bcast The number of broadcast packets received rx_mcast The number of multicast packets received rx_bytes The total number of bytes received rx_errors The
55. the driver is exceeded DATA 1 max_vpi ACTION No Action The driver cannot create any more VPorts elx_mes1810 Create VPORT failed Cannot get instance number DESCRIPTION The driver failed to allocate resources for an adapter and could not assign an instance number DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1811 Create VPORT failed vpi x lt vpi gt DESCRIPTION The driver failed to create a port and had to eliminate all its resources DATA 1 vpi ACTION Software driver error If this issue persists report these errors to Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 105 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1812 vport_delete failed Cannot delete physical host DESCRIPTION An attempt to delete a port failed because it was to delete a physical port and not a virtual port Only VPorts on physical ports can be deleted on an NPIV system DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1813 Create VPORT failed Cannot get sparam DESCRIPTION The port could not be created because it could not be initialized possibly due to unavailable resources DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support el
56. the same way esxcfg nics 1l list recognized nics esxcfg vswitch 1 list available vswitches esxcfg vswitch a vSwitchoO create vSwitcho esxcfg vswitch A VMNet0O vSwitch0 create virtual machine network VMNetO and add it to vSwitcho esxcfg vswitch L vmnicO vSwitcho link vmnicO to vSwitcho The only difference being that in vNIC mode each of the four vNICs tied to a physical port shares the port s 1OGbE bandwidth Enabling SR IOV in ESXi 5 1 and 5 5 SR IOV capability can be enabled for OneConnect OCe11100 series OCe14000 series and LPe16202 O0Ce15100 adapters in ESXi 5 1 and 5 5 if your system BIOS supports SR IOV Note SR IOV cannot be enabled with other multichannel technologies like UMC or vNIC To enable SR IOV 1 2 3 4 Enable IOV capability in the system BIOS Press lt Ctrl p gt to enter the BIOS Enable SR IOV for each port of the adapter from the BIOS If you want to use a newer driver install the driver VIB after booting the ESXi host To load the Ethernet driver with options to enable SR IOV run one of the following commands ESXi 5 1 esxcfg module s max_vfs x y be2net ESXi 5 5 esxcfg module s max_vfs x y elxnet Or esxcli system module parameters set p max _vfs x y m elxnet eo where x and y are the number of virtual functions VFs to be enabled on each of the two NIC physical functions PFs A value of 0 indicates that there are no VFs
57. total number of error packets received rx_length_errors The number of packets received with length errors A length error occurs if an incoming packet is undersized less than 65 bytes or oversized greater than 1522 9216 bytes rx_over_errors Receiver ring buffer overflow errors rx_crc_errors The number of packets received with CRC errors rx_frame_errors The number of packets received with a frame alignment error rx_fifo_errors Emulex Drivers Version 10 0 for VMware ESXi User Manual The number of received packets dropped when FIFO entering the packet demux block overflows or an internal FIFO going into the main packet buffer tank PMEM overflows P009803 01A Rev A 38 gt EMULEX 2 Configuration 39 NIC Driver Configuration Table 2 4 Port Statistics Counters Continued Ethtool Statistics Counter Name rx_buf_post_fail Description The number of times the driver could not allocate a buffer to replenish the receive ring If this error is frequently observed you can increase the network heap size using the following command esxcfg advcfg j netPktHeapMaxSize Ensure that you reboot the host tx_packets The number of packets transmitted tx_bytes The total number of bytes transmitted tx_errors The total number of error packets transmitted tx_timeout_counter The number of times that a transmit timeout occurred tx_rate The total throughput tr
58. 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration n 25 gt G EMULEX FC and FCoE Driver Configuration Examples of Permanent Per Adapter Configuration The following example sets lun_queue_depth to 20 default is 30 for adapter 1 1 Set the adapter specific value using one of the following commands For ESXi 5 5 systems type esxcli system module parameters set p lpfcl_lun_queue_depth 20 m lpfc For ESXi 5 0 and 5 1 systems type esxcfg module s lpfcl_lun_queue_depth 20 lpfc820 2 To reboot the server type reboot The new setting is used when the driver is reloaded To verify the setting use one of the following commands For ESXi 5 5 systems type esxcli system module parameters list m lpfc For ESXi 5 0 and 5 1 systems type esxcfg module g lpfc820 The following example sets lun_queue_depth to 20 default is 30 for adapter 1 and lun_queue_depth to 10 default is 30 for adapter 2 1 Set the adapter specific value by typing esxcfg module s lpfcl_ lun _queue_depth 20 lpfc2_lun_queue_depth 10 lpfc820 Note Type the command all on one line without a carriage return 2 To reboot the server type reboot The new settings are used when the driver is reloaded To verify the settings type esxcfg module g lpfc820 Dynamically Adding LUNs For instructions on dynamically adding LUNs refer to the Using Rescan section of the VMware SAN Configuration documentation Dynamical
59. 009 04 com 1234567890 Initiator name Not specified Use the Initiator name already configured Use the default name if none was configured Header Digest Enabled Data digest Not specified Assume disabled Authentication Type 1 way CHAP The following is an example of Default TCP Port and Mutual CHAP Settings iscsi 192 168 0 2 000000000000000E iqn 2009 4 com 1234567890 il Pai pr M Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 152 DG EMULEX Troubleshooting the iSCSI Driver where the following is Target IP address 192 168 0 2 Target TCP port Use default from RFC 3720 3260 Target boot LUN 0x0E Target iqn name iqn 2009 04 com 1234567890 Initiator name Not specified Use the Initiator name already configured Use the default name if none was configured Header Digest Enabled Data digest Data Digest disabled Authentication Type Mutual CHAP Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 153 gt G EMULEX ESXi 5 5 Native Mode Driver Troubleshooting Support ESXi 5 5 Native Mode Driver Troubleshooting Support Table 3 10 lists the troubleshooting support provided by the earlier vmklinux driver in terms of the proc interface and the equivalent support provided by the native mode driver through either the esxcli plug in or the VmkMegmtKeyVal interface Table 3 10 ESXi 5 5 Native Mode D
60. 0405 Config Param lt value gt set to lt value gt DESCRIPTION Driver is setting a persistent VPort parameter to a different value DATA 1 New value ACTION None This message is notification only elx_mes0406 Adapter maximum temperature exceeded lt temperature gt taking this port offline DESCRIPTION The driver has received an error for the adapter indicating that the maximum allowable temperature has been exceeded DATA 1 work_hs 2 work_status 0 3 work_status 1 ACTION Ensure that the server fans are not blocked Shut down the server if the airflow is restricted Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 74 SG EMULEX Troubleshooting the FC FCoE Driver elx_mes0408 Cannot create debugfs root DESCRIPTION DATA None ACTION None required elx_mes0409 Cannot create debugfs nodelist DESCRIPTION DATA None ACTION None required elx_mes0410 Cannot find virtual addr for mapped buf on ring lt ringno gt DESCRIPTION The driver cannot find the specified buffer in its mapping table Thus it cannot find the virtual address needed to access the data DATA 1 phys 2 next 3 prev 4 postbufg_cnt ACTION This error could indicate a software driver or firmware issue If the issue persists report these errors to Emulex technical support elx_mes0411 Cannot create debugfs hbqinfo DESCRIPTION DATA None ACTION None required elx_mes
61. 0412 Cannot create debugfs hba DESCRIPTION DATA None ACTION None required elx_mes0413 Cannot create debugfs dumpHBASlim DESCRIPTION DATA None ACTION None required elx_mes0414 Cannot create debugfs dumpHostSlim DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 75 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0415 Cannot create debugfs slow_ring trace DESCRIPTION DATA None ACTION None required elx_mes0416 Cannot create debugfs slow_ring buffer DESCRIPTION DATA None ACTION None required elx_mes0417 Cannot create debugfs DESCRIPTION DATA None ACTION None required elx_mes0418 Cannot create debugfs disc trace buffer DESCRIPTION DATA None ACTION None required elx_mes0419 Cannot create debugfs discovery trace DESCRIPTION DATA None ACTION None required elx_mes0423 Vport Attribute Instance Error Defaulting Ipfc_ attr to lt value gt error value lt value gt allowed range is min max DESCRIPTION A VPort attribute was set out of range The driver reset the parameter to its default DATA None ACTION Set the module parameter between the minimum and maximum values elx_mes0424 Vport Attribute Count Exceeded Max lt value gt Actual lt value gt DESCRIPTION The total number of VPort attributes set exceeded the max allowed DATA None ACTION Reduce the
62. 0x4000 NPIV events LOG_SECURITY 0x8000 Security events LOG_EVENT 0x10000 IOCTL event LOG_FIP 0x20000 FIP event LOG_FCP_UNDER 0x40000 FCP underrun errors LOG_KVPAGE 0x80000 KV page verbose LOG_TASKMGMT 0x100000 Task management events LOG_MGMT_TRACE 0x200000 IODM management trace logging LOG_ALL_MSG ox7fffffff Log all messages Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A aw 3 Troubleshooting 50 gt G EMULEX Troubleshooting the FC FCoE Driver ESXi 5 5 Message Log Example The following is an example of a LOG message on ESXi 5 5 systems 2013 09 10T16 50 13 1372Z cpu7 33329 WARNING lpfc lpfc_mbx_ cmpl read_topology 3154 1 1305 Link Down Event x12 received Data x12 x20 x110 x0 In the above LOG message e Ipfc driver binary e lpfc_mbx_cmpl_read_topology function generating the log e 1 identifies Emulex HBA1 e 1305 identifies the LOG message number Note If the word Data is present ina LOG message any information to the right of Data is intended for Emulex technical support engineering use only Note Unless otherwise noted in the ACTION attribute report these errors to Emulex technical support Emulex requests that when reporting occurrences of these error messages you provide a tarball of all vmkernel files in var log ESXi 5 0 and 5 1 Message Log Example The following is an example of a LOG message on ESXi 5 0 and 5 1 systems Jul 2 04 23 34 daffy kernel lpfc 0000 0
63. 1 use_mq Use MQ Kernel API for ESXi Def 1 Deprecated in the 5 x operating systems Min 0 native mode driver 0 Disable MQ Max 1 Replaced with 1 Enable MQ disable_mq fcp_wq_count Set the number of fast path Def 8 Deprecated in the FCP work queues if Min 1 native mode driver possible Max 31 Replaced with fcp_io_channel fcp_eq_count Set the number of fast path Def 8 Deprecated in the FCP event queues if Min 1 native mode driver possible Max 31 Replaced with fcp_io_channel enable_fcp_ Enable 1 or disable 0 Def 0 Def 0 No changes priority FCP Priority Min 0 Min 0 Max 1 Max 1 iocb_cnt IOCBs allocated for ELS CT Def 1 Def 1 No changes and ABTS in 1024 Min 1 Min 1 increments Max lt 5 Max lt 5 sli_mode SLI mode selector Def 0 Deprecated in the 0 auto Min 0 native mode driver 2 SLI 2 Max 3 3 SLI 3 devloss_tmo The number of seconds the Def 10 Def 10 No changes driver holds I O waiting for Min 1 Min 1 a loss device to return Max 255 Max 255 log_verbose Verbose logging bit mask Def 0 Def 0 No changes Min 0 Min 0 Max Max Ox7fffffff Ox7fffffff enable_da_id De register nameserver Def 1 Def 1 No changes objects before LOGO Min 0 Min 0 Max 1 Max 1 lun_queue_ The maximum number of Def 30 Def 30 No changes depth FCP commands that can Min 1 Min 1 queue to a specific LUN Max 128 Max 128 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev
64. 17 dhchap challenge could not find DH Group DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting QQ DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1018 dhchap challenge No Public key for non NULL DH Group DESCRIPTION DATA None ACTION None required elx_mes1021 ERROR attempted to queue security work when no workqueue created DESCRIPTION DATA None ACTION None required elx_mes1028 Start Authentication No buffers DESCRIPTION DATA None ACTION None required elx_mes1029 Reauthentication Failure DESCRIPTION DATA None ACTION None required elx_mes1031 Start Authentication Get config failed DESCRIPTION DATA None ACTION None required elx_mes1032 Start Authentication get config timed out DESCRIPTION DATA None ACTION None required elx_mes1034 Not Expecting Challenge Rejecting Challenge DESCRIPTION DATA None ACTION None required elx_mes1035 Transport ID does not math Rejecting Challenge DESCRIPTION DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 91 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes1036 Authentication transaction reject re auth request reason lt value gt exp lt value gt DESCRIPTION DATA None ACTION None required elx_mes1037 Authentication tr
65. 26 FDISC failed ulpStatus ulpWord 4 n DESCRIPTION The ELS FDISC command has failed DATA None ACTION Check the port and switch configuration elx_mes0127 ELS timeout DESCRIPTION An ELS IOCB command was posted to a ring and did not complete within ULP timeout seconds DATA 1 elscmd 2 remote_id 3 ulpcommand 4 ulploTag ACTION If the ELS command is not going through the adapter reboot the system If this issue persists report the error to Emulex technical support elx_mes0133 PLOGI no memory for reg_login DESCRIPTION Memory allocation error DATA 1 nlp_DID 2 nlp_state 3 nlp_flag 4 nlp_rpi ACTION Memory allocation error Check system resources Unload unused modules elx_mes0134 PLOGI cannot issue reg_login DESCRIPTION The ELS PLOGI mailbox command has failed DATA 1 nlp_DID 2 nlp_state 3 nlp_flag 4 nlp_rpi ACTION Check the port and switch configuration elx_mes0135 cannot format reg_login DESCRIPTION Could not allocate an RPI or DMA buffer for the mailbox command DATA 1 nlp_DID 2 nlp_state 3 nlp_flag 4 nlp_rpi ACTION None required elx_mes0136 PLOGI completes to N_ Port lt DID gt completion DESCRIPTION A PLOGI has completed for which there is no NDLP DATA 1 ulpStatus 2 ulpWord 4 ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 53 DG EMULEX Troubleshooting the FC FCoE Driver
66. 3 06 0 0 1305 Link Down Event x2f2 received Data x2f2 x20 x110 In the above LOG message e Ipfc 0000 03 06 0 identifies the PCI location of the particular LPFC HW port e 0 identifies Emulex HBAO e 1305 identifies the LOG message number Note If the word Data is present ina LOG message any information to the right of Data is intended for Emulex technical support engineering use only Note Unless otherwise noted in the ACTION attribute report these errors to Emulex technical support Emulex requests that when reporting occurrences of these error messages you provide a tarball of all vmkernel files in var log Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 51 DG EMULEX Troubleshooting the FC FCoE Driver ELS Events 0100 0199 elx_mes0100 FLOGI failure Status lt status gt lt extended_status gt TMO lt timeout gt DESCRIPTION An ELS FLOGI command that was sent to the fabric failed DATA 1 ulpStatus 2 ulpWord 4 3 ulpTimeout ACTION This error could indicate a fabric configuration error or internal driver issue If this issue persists report the error to Emulex technical support elx_mes0111 Dropping received ELS cmd DESCRIPTION The driver decided to drop an ELS Response ring entry DATA 1 ulpStatus 2 ulpWord 4 3 ulpTimeout ACTION This error could indicate a software driver or firmware issue If this issue persists report the error to
67. A gt G EMULEX Table 2 1 FC and FCoE Driver Parameters Continued 2 Configuration 29 FC and FCoE Driver Configuration ESXi 5 0 5 1 ESXi 5 5 OP Legacy Native Mode Module Driver Model Driver Model Parameter Description Values Values Comments tgt_queue_ The maximum number of Def 8192 Def 65535 Default and maximum depth FCP commands queued to a Min 10 Min 10 values increased specific target port Max 8192 Max 65535 hba_queue_ The maximum number of Def 8192 Def 8192 No changes depth FCP commands queued to Min 32 Min 32 PEE Max 8192 Max 8192 peer_port_login Allow logins of peer ports Def 0 Def 0 No changes on same physical port Min 0 Min 0 Max 1 Max 1 restrict_login Restrict virtual ports login Def 0 Def 0 No changes to remote initiators Min 0 Min 0 Max 1 Max 1 scan_down Start scanning for devices Def 1 Def 1 No changes from highest ALPA to lowest Min 0 Min 0 Max 1 Max 1 topology Select Fibre Channel FC Def 0 Def 0 No changes topology Valid values are Min 0 Min 0 0x0 attempt loop Max 6 Max 6 mode then point to point 0x01 internal loopback mode 0x02 attempt point to point mode only 0x04 attempt loop mode only 0x06 attempt point to point mode then loop link_speed Select link speed Def 0 Def 0 No changes 0 auto select Min 0 Min 0 1 1 Gigabaud Max 16 Max 16 2 2 Gigabaud 4 4 Gigabaud 8 8 Gigabaud 10 10 Gigabaud 16 16
68. AL_PA 3 UlnkSpeed 4 alpa_map 0 ACTION None required elx_mes1308 Menlo Maint Mode Link up Event lt value gt rcvd Data lt value gt lt value gt lt value gt DESCRIPTION Link up notification in Menlo maintenance mode DATA 1 fc_eventTag 2 port_state 3 VPort fc_flag Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 98 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes1309 Link Down Event lt value gt received Data lt value gt lt value gt lt value gt DESCRIPTION The port generated a link down event to the host DATA 1 fc_eventTag 2 port_state 3 VPort fc_flag ACTION None required elx_mes1310 Link Up Event npiv not supported in loop topology DESCRIPTION Loop topologies are not supported when NPIV is enabled DATA None ACTION Put link into Fabric mode Port Setup Events 1400 1499 elx_mes1400 Failed to initialize sgl list DESCRIPTION Failed to initialize SGL list during initialization DATA None ACTION Reboot the server If the issue persist contact Emulex technical support elx_mes1401 Failed to enable pci device DESCRIPTION Failed to enable PCI device during initialization DATA None ACTION Reboot the server If the issue persist contact Emulex technical support elx_mes1402 Failed to set up pci memory space DESCRIPTION PCI initialization failed DATA None ACTION Reboot the server
69. ATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0536 Slow path ELS WQ not allocated DESCRIPTION The slow path ELS WQ is not allocated DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0537 Failed setup of slow path ELS WQ rc lt value gt DESCRIPTION Driver failed to setup Work Queue Failure code is reported DATA 1 2 3 ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes0538 Slow path MQ not allocated DESCRIPTION The slow path MQ is not allocated DATA None ACTION The driver fails to load Contact Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 85 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0539 Failed setup of slow path MQ rc lt value gt DESCRIPTION The slow path MQ is allocated but failed initial setup DATA 1 status ACTION The driver fails to load Contact Emulex technical support elx_mes0540 Receive Queue not allocated DESCRIPTION The Receive Queue is not allocated DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0541 Failed setup of Receive Queue rc lt value gt DESCRIPTION The Receive Queue is allocated but failed setup DATA 1 status ACTION The driver fails to load Contact Emulex technical support elx_mes0542 Ipfc_
70. DATA None ACTION None required elx_mes0721 Device Reset rport failure rdata lt rdata gt DESCRIPTION The reset of the Rport failed DATA None ACTION None required elx_mes0724 I O flush failure for context lt cntx gt on lt tgt lun gt cnt lt value gt DESCRIPTION The I O flush to the LUN TARGET or HOST has failed DATA 1 cnt of unrecovered I O ACTION None required The reset is retried elx_mes0727 TMF lt cmd gt to TGT lt TGT gt LUN lt LUN gt failed lt ulpStatus gt lt ulpWord 4 gt DESCRIPTION The task management command failed DATA None ACTION None required The TMF command gets retried elx_mes0748 Abort handler timed out waiting for abort to complete ret lt status gt ID lt target id gt LUN lt lun id gt snum lt serial number gt DESCRIPTION The abort handler timed out waiting for abort to complete DATA None ACTION None required elx_mes0798 Device Reset rport failure rdata lt value gt DESCRIPTION Driver failed a device reset no rdata buffer DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 88 DG EMULEX Troubleshooting the FC FCoE Driver Node Table Events 0900 0999 elx_mes0915 Register VPI failed lt mbxStatus gt DESCRIPTION Could not register the VPI DATA None ACTION None required
71. ESCRIPTION An error occurred when processing queue related tags for an adapter in a particular slot DATA 1 mbxCommand 2 mbxStatus 3 hbaqno Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 104 SG EMULEX Troubleshooting the FC FCoE Driver ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1806 Mbox lt command gt failed No vport DESCRIPTION A mailbox command could not be communicated because there was no VPort associated with the mailbox command DATA 1 mbxCommand ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1807 IOCB lt value gt failed No vport DESCRIPTION An IOCB command could not be communicated because there was no VPort associated with the mailbox command DATA 1 ulpCommand ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1808 Create VPORT failed NPIV is not enabled SLImode lt mode gt DESCRIPTION The driver failed to create a port because the adapter was in wrong mode or was not capable of NPIV DATA 1 sli_rev ACTION Load the driver with NPIV enabled on an adapter that supports SLI 3 elx_mes1809 Create VPORT failed Max VPORTs lt vpi gt exceeded DESCRIPTION The driver failed to create a port because the maximum number of port supported by
72. EX Driver Information 10 elxnet enabled 1 options The server administrator must then run the following command to set the driver module parameters esxcfg module s max_vfs 2 2 elxnet And to verify that the value has been reprogrammed esxcfg module g elxnet elxnet enabled 1 options max_vfs 2 2 Once verification has completed reboot the server to activate the command and burn the new driver parameters into the initial ram disk ESXi Compatibility For a list of adapters that are compatible with this driver see the driver Downloads page on the Emulex website For compatible firmware versions see the Downloads page for the specific adapter Supported Guest Operating Systems The Emulex driver supports the following guest operating systems e CentOS 5 x e CentOS 6 x e RHEL5 x e RHEL6 x e SLES 10 x e SLES 11 x e Windows 2008 R2 e Windows 2012 e Windows 2012 R2 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 1 Installation 11 SG EMULEX Installing the FC FCoE Driver Installing the FC FCoE Driver This section provides installation information for the driver and the Emulex CIM Provider using the FC FCoE interface on ESXi systems Before using this product you need a working knowledge of FC FCoE and network storage devices Installing the FC FCoE Driver and Management Software The Emulex driver is available through the VMware support site Refer to the VMware s
73. IOCB command DESCRIPTION Received an unknown IOCB command completion DATA 1 ulpCommand 2 ulpStatus 3 ulploTag 4 ulpContext ACTION This error could indicate a software driver or firmware issue If these issues persist report these errors to Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 66 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0338 IOCB wait timeout error no wake response Data lt value gt lt value gt DESCRIPTION Driver issued I O did not get a wake signal in polling mode DATA 1 wait time 2 wake value ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes0340 Adapter temperature is OK now DESCRIPTION Adapter temperature has reverted to normal range DATA Temperature in Celsius ACTION No action needed informational elx_mes0341 Ring lt ringno gt Cannot find buffer for an unsolicited iocb tag lt un ulpWord 3 gt DESCRIPTION There are no more pre allocated buffers available to handle unsolicited buffers DATA None ACTION Ensure this port is not being managed by multiple ports elx_mes0342 Ring lt ringno gt Cannot find buffer for an unsolicited iocb tag lt unsli3 sli3Words gt DESCRIPTION This is a multiple IOCB unsolicited command and sufficient buffer space cannot be allocated for it DATA None ACTION None required elx_mes0343
74. None required elx_mes0287 Ipfc_alloc_ bucket failed to allocate statistical data buffer lt nip_DID gt DESCRIPTION Memory allocation failed for node s statistical data DATA None ACTION None required elx_mes0288 Unknown FCoE event type lt event_type gt event tag lt event_tag gt DESCRIPTION The firmware has detected an unknown FCoE event DATA None ACTION Check the FCoE switch configuration and the adapter DCBX mode elx_mes0289 Issue Register VFI failed Err lt rc gt DESCRIPTION The driver could not register the Virtual Fabric Index for the FCFI DATA None ACTION Check the switch and port configurations elx_mes0290 The SLI4 DCBX asynchronous event is not handled yet DESCRIPTION The SLI 4 DCBX asynchronous event is not handled yet DATA None ACTION None required elx_mes0291 Allocated DMA memory size lt alloc_len gt is less than the requested DMA memorysize lt req_len gt DESCRIPTION The asynchronous DCBX events are not handled in the driver DATA None ACTION Check the switch configuration elx_mes0293 PM resume failed to start workerthread error lt error gt DESCRIPTION The PCI resume hotplug could not start the worker thread for the driver DATA None ACTION Unload and reload the driver elx_mes0294 PM resume Failed to enable interrupt DESCRIPTION The PCI resume hotplug could not get an interrupt vector DATA None ACTION Unload and reload the driver Emulex Drivers
75. RQ failed to memmap pci barset lt value gt DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 141 SG EMULEX Troubleshooting the FC FCoE Driver elx_mes3270 RQ doorbell format not supported lt value gt DESCRIPTION DATA None ACTION None required elx_mes3279 Invalid provisioning of rpi DESCRIPTION DATA None ACTION None required elx_mes3280 Invalid provisioning of vpi DESCRIPTION DATA None ACTION None required elx_mes3281 Invalid provisioning of xri DESCRIPTION DATA None ACTION None required elx_mes3282 Invalid provisioning of vfi DESCRIPTION DATA None ACTION None required elx_mes3300 In use FCF modified perform FCF rediscovery DESCRIPTION DATA None ACTION None required elx_mes3303 Failed to obtain vport vpi DESCRIPTION DATA None ACTION None required elx_mes3317 HBA not functional IP Reset Failed after lt value gt retries try echo fw_reset gt board_mode DESCRIPTION DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 142 SG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes3321 Recovered mailbox lt value gt DESCRIPTION DATA None ACTION None required elx_mes9000 Allocated DMA memory size lt value gt is less than the requested DMA memory size lt value gt
76. SLI_CONFIG mse rd ext_buf_cnt lt value gt out of range lt value gt DESCRIPTION DATA None ACTION None required elx_mes2946 SLI_CONFIG hbd rd ext_buf_cnt lt value gt out of range lt value gt DESCRIPTION DATA None ACTION None required elx_mes2950 Failed SLI_CONFIG hbd rd lt value gt DESCRIPTION DATA None ACTION None required elx_mes2953 SLI_CONFIG mse wr ext_buf_cnt lt value gt out of range lt value gt DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 135 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2954 SLI_CONFIG hbd wr to interface type lt value gt DESCRIPTION DATA None ACTION None required elx_mes2999 Unsupported SLI4 Parameters Extents and RPI headers enabled DESCRIPTION DATA None ACTION None required elx_mes3008 No available Resource Extents for resource type lt value gt Count lt value gt Size lt value gt DESCRIPTION DATA None ACTION None required elx_mes3010 Run link diag test mailbox failed with mbx_ status lt value gt status lt value gt add_ status lt value gt DESCRIPTION DATA None ACTION None required elx_mes3029 SLI_CONFIG hbd rd to interface type lt value gt DESCRIPTION DATA None ACTION None required elx_mes3042 Failed SLI CONFIG hbd wr lt value gt DESCRIPTION DATA None ACTION No
77. SXi User Manual P009803 01A Rev A 3 Troubleshooting 94 SG EMULEX Troubleshooting the FC FCoE Driver elx_mes1215 Cannot issue FCoE cmd not ready or not in maint mode lt off value gt lt rc value gt DESCRIPTION DATA None ACTION None required elx_mes1216 FCoE IOCB failed lt off value gt lt rc value gt DESCRIPTION DATA None ACTION None required elx_mes1223 menlo_write couldn t alloc genreq lt value gt DESCRIPTION DATA None ACTION None required elx_mes1230 Could not find buffer for FCoE cmd lt off value gt lt indmp value gt DESCRIPTION DATA None ACTION None required elx_mes1231 bad bpl DESCRIPTION DATA None ACTION None required elx_mes1235 Could not find buffer for FCoE cmd lt off value gt poff lt value gt cnt lt value gt mlastcnt lt value gt addl lt value gt addh lt value gt mdsz lt value gt DESCRIPTION DATA None ACTION None required elx_mes1238 FCoE IOCB failed lt off value gt lt rc value gt DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 905 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1240 Unable to allocate command buffer memory DESCRIPTION DATA None ACTION None required elx_mes1243 Menlo command error code lt value gt DESCRIPTION DATA None ACTION None required elx_mes1244 Unable to allocate r
78. Scatter Def 64 Def 64 The maximum was Gather Segment Count for Min 64 Min 64 increased to account DMA Max 256 Max 4096 for larger SCSI I O The maximum data allowed a in one SG element is 0x80000000 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt EMULEX Table 2 1 FC and FCoE Driver Parameters Continued 2 Configuration 32 FC and FCoE Driver Configuration ESXi 5 0 5 1 ESXi 5 5 OP Legacy Native Mode Module Driver Model Driver Model Parameter Description Values Values Comments pci_max_read The maximum DMA read Def 0 Def 0 No changes byte count Min 0 Min 0 Valid values are Max 4096 Max 4096 0 512 1024 2048 4096 nlp_slab_cnt NLP Slab entries Def 64 For the native mode Min 32 driver Max 1024 Controls the maximum nodes into which the port can be logged including VPorts rb_slb_cnt Receive Buffer slab entries Def 256 For the native mode Min 32 driver Max 256 Controls the maximum Creating an FC Remote Boot Disk For instructions on creating an FC remote boot disk refer to the VMware SAN Configuration documentation Managing Devices through the CIM Interface VMware on the Visor based ESXi platforms uses the CIM interface as the only standard management mechanism for device management Using the OneCommand Manager GUI number of Receive Buffers that will be posted to the adapter For VMware ESXi 5 0 5 1 a
79. TA None ACTION Check the switch configuration Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 81 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0492 Unable to allocate memory for issuing SLI_CONFIG_SPECIAL mailbox command DESCRIPTION A memory allocation fault occurred when issuing a mailbox DATA None ACTION This could be a transient error If this issue persists report these errors to Emulex technical support elx_mes0493 SLI_CONFIG_SPECIAL mailbox failed with status lt rc gt DESCRIPTION Mailbox command failed DATA None ACTION Ensure the adapter s firmware is current Unload and reload the driver elx_mes0494 Unable to allocate memory for issuing SLI_FUNCTION_ RESET mailbox command DESCRIPTION Mailbox memory pool allocation error DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0495 SLI FUNCTION_RESET mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION Mailbox command failed DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0496 Failed allocate slow path EQ DESCRIPTION The event queue for the slow path was not allocated DATA None ACTION Unload and reload the driver elx_mes0497 Failed allocate fast path EQ DESCRIPTION The event queue for the fast path was not allocated DATA None ACTION Unl
80. TION SLI 4 The post SGL function was passed an invalid XRI DATA None ACTION None required elx_mes0365 Slow path CQ identifier lt cqid gt does not exist DESCRIPTION The Completion Queue ID passed in the Event Queue entry does not reference a valid completion queue DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 69 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0366 Not a valid fast path completion event majorcode lt major code hex gt minorcode lt minor code hex gt DESCRIPTION The major or minor code in the Event Queue field is not valid DATA None ACTION None required elx_mes0367 Fast path completion queue does not exist DESCRIPTION The fast path completion queue referenced by the CQID does not exist DATA None ACTION None required elx_mes0368 Miss matched fast path completion queue identifier eqcqid lt cqid gt fcpcqid lt queue_id gt DESCRIPTION The CQID in the event queue entry does not match the fep_cqid that was passed into the routine DATA None ACTION None required elx_mes0369 No entry from fast path completion queue fcpcqid lt queue_id DESCRIPTION There were no completions in the completion queue referenced by fepeqid DATA None ACTION None required elx_mes0370 Invalid completion queue type lt type gt DESCRIPTION The event queue entry is not for a mailbox or a work queue
81. The vmkernel log file is automatically rotated as it gets larger and the rotated log files are named vmkernel x where x is an integer To search the log file for error messages at the command prompt type cd var log less vmkernel For example you might see the following message Sep 9 19 48 04 esx server vmkernel WARNING Found a OneConnect card in Gen 1 x8 PCI e slot Should be in Gen 2 x8 slot for best performance ESXi Server NIC Event Log Entries The following is a list of ESXi Server network event log error messages It includes the severity of the error the message displayed and the message description When reporting a problem with the adapter to Emulex check the message log proc vmware log and report any of these entries that may be present Note In the following table lt D gt lt DD gt or lt DDD gt in the Message Displayed column refers to decimal values that appear in the error messages Table 3 5 ESXi Server NIC Event Log Entries Severity Displayed Message Description Error OneConnect POST failed Power ON Self Test of the adapter failed This indicates either a hardware or a firmware problem Try rebooting the system after a reset Error OneConnect initialization Either the initialization of the failed adapter or the allocation of some resource for initializing the driver failed In most cases this message is accompanied by another more specific error message Try rebooting the sys
82. Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 62 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0297 invalid device group lt pci_dev_grp gt DESCRIPTION While unloading the driver the driver detect a PCI device that it should not have claimed DATA None ACTION None required elx_mes0299 Invalid SLI revision lt sli_rev gt DESCRIPTION While processing a host attention or unrecoverable error the driver detected an invalid SLI revision DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 63 DG EMULEX Troubleshooting the FC FCoE Driver Mailbox Events 0300 0339 elx_mes0300 LATT Cannot issue READ_LA Data lt rc gt DESCRIPTION The link attention handler could not issue a READ_LA mailbox command DATA None ACTION None required elx_mes0303 Ring lt ringno gt handler portRspPut lt portRspPut gt is bigger then rsp ring lt portRspMax gt DESCRIPTION The port rsp ring put index is larger than the size of the rsp ring DATA None ACTION This error could indicate a software driver firmware or hardware issue Report these errors to Emulex technical support elx_mes0304 Stray mailbox interrupt mbxCommand lt mbxcommand gt mbxStatus lt mbxstatus gt DESCRIPTION Received a mailbox completion interrupt and there are no outstanding mailbox commands DATA None ACTION This
83. You must modify the guest registry in order to achieve the maximum transfer rate set in the VMware kernel To do this use the registry editor to add or modify the following entry to change the maximum transfer size for the Windows guest HKEY LOCAL MACHINE SYSTEM CurrentControlSet Services Symmpi Paramet ers Device MaximumSGList The formula used to calculate the proper value for MaximumSGList is e Fora 32 bit Windows guest use the following formula MaximumSGList Maximum Transfer Size 4 1 e For a 64 bit Windows guest use the following formula MaximumSGList Maximum Transfer Size 8 1 For example to allow a 256 KB transfer size on a 32 bit guest this would be the formula to use 256 4 64 1 65 decimal or 0x41 hexadecimal Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt G 2 Configuration 42 EMULEX iSCSI Driver Configuration The maximum value allowed for MaximumSGList is 255 or OxFF For the particular value of OxFF the internal value passed to Windows is increased to 0x101 allowing support for a full 1 MB transfer 2 MB for 64 bit The MaximumSGList is 129 for a 512 KB transfer Other guest operating systems may also need to be tuned similarly Consult the tuning guides that accompany those operating systems Interrupt Moderation Policy Settings Interrupt Moderation Policy settings control the rate of interrupts for the adapter By default the driver implements an
84. _FCF_RECORD mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt DESCRIPTION The ADD_FCF_RECORD mailbox command has failed DATA None ACTION None required elx_mes2560 Failed to allocate xri for scsi buffer DESCRIPTION Failed to allocate an XRI for the SCSI buffer DATA None ACTION None required elx_mes2561 Allocated DMA memory size lt alloclen gt is less than the requested DMA memory size lt reqlen gt DESCRIPTION Could not get the memory required for the number of XRIs that are attempting to be posted DATA None ACTION None required elx_mes2562 Failure to allocate an ELS sgl entry lt value gt DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 120 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2563 Failure to allocate an ELS mbuf lt value gt DESCRIPTION DATA None ACTION None required elx_mes2564 POST_SGL_ BLOCK mailbox command failed status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The list of XRI SGEs failed to be registered with the firmware DATA None ACTION None required elx_mes2566 Failed to allocate connection table entry DESCRIPTION Failed to allocate connection table entry DATA None ACTION None required elx_mes2567 Config region 23 has bad signature DESCRIPTION Configuration region 23
85. al support elx_mes2754 PRLI failure DID lt DID gt Status lt Status gt lt Extended Status gt DESCRIPTION A PRLI to lt DID gt was failed either by the driver firmware or target The lt status gt and lt extended status gt indicates why the PRLI failed DATA None ACTION If the issue persists report the error to Emulex technical support elx_mes2755 ADISC failure DID lt DID gt Status lt Status gt lt Extended Status gt DESCRIPTION A ADISC to lt DID gt was failed either by the driver firmware or target The lt status gt and lt extended status gt indicates why the ADISC failed DATA None ACTION If the issue persists report the error to Emulex technical support elx_mes2756 LOGO failure DID lt DID gt Status lt Status gt lt Extended Status gt DESCRIPTION A LOGO to lt DID gt was failed either by the driver firmware or target The lt status gt and lt extended status gt indicates why the LOGO failed DATA None ACTION If the issue persists report the error to Emulex technical support elx_mes2757 Protocol failure detected during processing of FCP I O op tgt lt tgt ID gt lun lt LUN gt cmnd lt CMD gt rspInfo3 lt rspinfo3 gt DESCRIPTION The FCP response from a target indicated that the response length is valid but rspInfo3 indicates that there is no Failure This is a FCP specification violation by the target DATA None ACTION If the issue persists report the error t
86. and without any notice Emulex assumes no responsibility for its use nor for any infringements of patents or other rights of third parties that may result Periodic changes are made to information contained herein although these changes will be incorporated into new editions of this manual Emulex disclaims any undertaking to give notice of such changes US patent notice is given for one or more of the following 6226680 6247060 6334153 6389479 6393487 6427171 6427173 6434620 6591302 6658480 6697868 6751665 6757746 6941386 6965941 6687758 7042898 7133940 7124205 7089326 6938092 6996070 Emulex 3333 Susan Street Costa Mesa CA 92626 Note References to OCe11100 series products also apply to OCe11100R series products Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A DE EMULEX Table of Contents 3 Table of Contents List OF Tables ssccisssascncstersdtntcnsssbarsensnarienstisniseanademeantes csi sneienenseoraeianeaens 6 1 INStANAN ON ii iisccinitecsdecrntsinr neem nee nesieniennteteeenenRneteieRneN Eini ra E ia 7 Driver Informati n scsisscciscaivesecisnartenmoiiiiisacacdeaaieneesdsdeweasdseentenmeciadinerectanaee 7 ESXI 5 5 OVEIVICW v2 scents dr iawerens daew er nn eoni E EE EEEE EAEE Ea aN ees 7 Driver Parameters Migration When Upgrading to ESXi 5 5 cece c eect eesti eee 8 Preparing to Upgrade to ESXI 5 Sic ccssixerssdcscecetscisiatesedcasuaaxeessletiacetedeacesete 9 FC and FCoE D
87. ansaction reject restarting authentication reason lt value gt exp lt value gt DESCRIPTION DATA None ACTION None required elx_mes1039 Not Expecting Reply rejecting State lt value gt DESCRIPTION DATA None ACTION None required elx_mes1040 Bad Reply trans_id rejecting Trans_id lt value gt Expecting lt value gt DESCRIPTION DATA None ACTION None required elx_mes1043 Authentication LS RJ T DESCRIPTION DATA None ACTION None required elx_mes1045 Issue AUTH_NEG failed Status lt value gt DESCRIPTION DATA None ACTION None required elx_mes1048 Issue AUTH_REJ ECT failed DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 902 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1049 Authentication is enabled but authentication service is nor running DESCRIPTION DATA None ACTION None required elx_mes1050 Authentication mode is disabled but is required by the fabric DESCRIPTION DATA None ACTION None required elx_mes1053 Start Authentication Security service offline DESCRIPTION DATA None ACTION None required elx_mes1055 Authentication parameter is disabled but is required by the fabric DESCRIPTION DATA None ACTION None required elx_mes1056 Authentication mode is disabled but is required by the fabric DESCRIPTION DATA None ACTION
88. ansmitted from a vmnic interface in Mb s rx_rate The total throughput received by a vmnic interface in Mb s on_die_temperature The current temperature of the chip die in degrees Celsius link_down_reason A value indicating the reason for a link being down 0 The link is down for an unknown reason 1 The link is down due to device control channel DCC 2 The link is down due to FCoE Initialization Protocol FIP 3 The link is down due to vNIC configuration 4 The link is down due to a receive PAUSE flood ints netq lt N gt The number of interrupts on Netqueue lt N gt rx_events netq lt N gt The number of events received on Netqueue lt N gt rx_packets netq lt N gt The number of packets received on Netqueue N gt rx_bytes netq lt N gt The number of bytes received on Netqueue lt N gt tx_events netq lt N gt The number of events transmitted on Netqueue lt N gt tx_packets netq lt N gt The number of packets transmitted on Netqueue lt N gt tx_bytes netq lt N gt VxLAN Configuration The number of bytes transmitted on Netqueue lt N gt The elxnet driver supports hardware offloads for VxLAN on the OCe14000 series adapters These offloads are enabled by default and can be disabled using the module parameter vxlan_offload For more information on configuring VxLAN through VMware vCloud Networking and Security Manager and VMware vSphere Distr
89. arameter Description Field Type lt initiatorName gt Replace it with a valid iSCSI iqn name of up to 223 Optional characters If not provided the default Initiator name generated by the adapter based on the board s MAC address will be used lt HeaderDigest gt Replace it with either E or D Optional e E denotes header digest is enabled e D denotes that it is disabled lt DataDigest gt Replace it with either E or D Optional e E denotes data digest is enabled and e D denotes that it is disabled If not provided it is assumed that Data Digest is disabled by default lt AuthenticationType gt If applicable replace it with D E or M Optional e D denotes authentication is disabled e E denotes that one way CHAP is enabled the username and secret to be used for oneway CHAP must be specified by non DHCP means e M denotes that MutualCHAP is enabled user name and passwords required for mutual CHAP authentication must be specified by non DHCP means If not specified this field defaults to authentication disabled Examples The following is an example of Default Initiator name and Data Digest Settings iscsi 192 168 0 2 3261 000000000000000E ign 2009 4 com 12345 67890 r E ri E where the following is Target IP address 192 168 0 2 Target TCP port 3261 Target boot LUN 0x0E Target iqn name iqn 2
90. capeanchuve setanesanssseaes 26 ESXi 5 5 Ethernet Driver Parameters ccccccccceseeee sense sents seeeeneene renee es 34 User configurable NIC Driver Parameters cccccceseeeeee cease eeneteeneeeenaes 35 Port Statistics COUNTETS sie esse neue dadned seer expt Shpeneaualed ween caanpeepseesere teens 38 User configurable iSCSI Driver Options c cece eee e eee eee teeters 40 Interrupt Moderation Policy SettingS cccccecceseeee sense sees eeeeeesente renee es 42 LDTO and ETO Default Values on ESX Server cccecce cece eeee terete sents nennens 43 Log Level US es edocs ened scstey inne beecessaeandenes caees et es ates cteueneorne 46 General Driver Situations viccniiens tories civisirwstievictvewwmes nawediexeereivaabe esd 47 Message Log Table for ESXi 5 0 and 5 1 SySteEMS cccceseeeeeeee erste rene ees 48 Message Log Table for ESXi 5 5 SYSteMS cccceeeee eens erste renee sean enenn ees 49 Troubleshooting the NIC Driver ssssssssssrrrrrrerrerrrsrrrrrrrrrererrrrrrrrrerere 143 ESXi Server NIC Event Log Entries ssssssssrrrereresresrrrrrrrrererrrrrrrrrerere 144 Troubleshooting the iSCSI Driver ssssssssrsrseererssrsrrrrrrrrrererrsrrrrrrerere 147 iSCSI Error Log Code Entries crissiissedvadebeavioiasspearwindsbiexivinesbiaxedeceies 147 Additional iSCSI Driver Messages cccecceeee eee eee ene eeee eee eteeeeaeees 150 Data String Parameters for Option 43 ccccccceceeeeeeeeeeeeeeeeet
91. cate receive HRQ DESCRIPTION Failed to allocate receive HRQ DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0507 Failed allocate receive DRQ DESCRIPTION Failed to allocate receive DRQ DATA None ACTION The driver fails to load Contact Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 83 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0520 Slow path EQ not allocated DESCRIPTION The slow path EQ is not allocated DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0521 Failed setup of slow path EQ rc lt value gt DESCRIPTION The slow path EQ setup failed with status rc DATA 1 status code ACTION The driver fails to load Contact Emulex technical support elx_mes0522 Fast path EQ lt fcp_eqidx gt not allocated DESCRIPTION The fast path EQ is not allocated DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0523 Failed setup of fast path EQ lt fcp_eqidx gt rc lt rc gt DESCRIPTION The fast path EQ setup failed DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0526 Fast path FCP CQ lt fcp_cqidx gt not allocated DESCRIPTION The fast path FCP is not allocated DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0527 Failed setup of fast
92. command sent to delete the event queue has failed DATA None ACTION None required elx_mes2506 CQ_DESTROY mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to delete the completion queue has failed DATA None ACTION None required elx_mes2507 MQ_DESTROY mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to delete the mailbox queue has failed DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 114 SG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes2508 WQ_DESTROY mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to delete the work queue has failed DATA None ACTION None required elx_mes2509 RQ_ DESTROY mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to delete the receive queue has failed DATA None ACTION None required elx_mes2510 RQ_ DESTROY mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to delete the receive queue has failed DATA None ACTION None required
93. commands This section describes the transition to the esxcli commands Note Both sets of commands are supported in the ESXi 5 5 release ESXi 5 0 and 5 1 Implementation For ESXi 5 0 and 5 1 Emulex used the esxcfg series of native command line applications to mine data but the primary application used was the esxcfg module to set and get driver parameters FC and FCoE Driver Examples For the FC and FCoE driver esxcfg module s lpfc_log verbose 0x10c3 lpfc820 This command could also be used to retrieve the driver parameters set For example esxcfg module g lpfc820 lpfc820 enabled 1 options lpfc_log verbose 0x10c3 Ethernet Driver Examples For the Ethernet driver the following commands were also used to set and retrieve driver parameters e To retrieve the parameters set esxcfg module g elxnet be2net enabled 1 options max _vfs 2 2 e To set the module parameter that specify the number of virtual functions esxcfg module s max_vfs 2 2 elxnet e To set the module parameter that enables or disables MSI X esxcfg module s msix 0 elxnet Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration 2Q gt lt EMULEX ESXi 5 5 Command Line Tool Transition ESXi 5 5 Implementation With the ESXi 5 5 release Emulex has started using the esxcli version of the command sequence which uses a different command syntax For example The command syntax to list t
94. commended Resolution Error The beZ2iscsi driver failed to load This failure may be due to the because initialization failed during a __ firmware not being present or running power management boot up currently This failure may also indicate a hardware problem Error The be2iscsi driver was unable to map This failure may indicate a low one or more PCI Base Address Register memory condition or a hardware error and hence failed to load Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt EMULEX Table 3 7 iSCSI Error Log Code Entries Continued 3 Troubleshooting 148 Troubleshooting the iSCSI Driver Severity Message Recommended Resolution Error The beZiscsi driver ignored a Check the registry configuration for configuration entry since the entry any recent entries added for driver was invalid parameters The invalid entry must be removed or corrected Error The be2iscsi driver failed to load due This failure occurred due to a failed to memory allocation failure memory allocation in the driver Check low memory conditions Error The beZ2iscsi driver failed to load This failure may be due to the because initialization failed during firmware not being present or running normal boot up currently This failure may also indicate a hardware problem Error An internal API failed in be2iscsi driver This failure may indicate a low during initialization memory co
95. create_static_vport failed to allocate mailbox memory DESCRIPTION Failed to allocate mailbox memory for VPort creation DATA None ACTION Static VPorts does not load Contact Emulex technical support elx_mes0543 Ipfc_create_static_vport failed to allocate vport_info DESCRIPTION Failed to allocate VPort_info DATA None ACTION Static VPorts does not load Contact Emulex technical support elx_mes0545 Ipfc_create_static_vport bad information header lt value gt lt value gt le32_to_cpu vport_info gt signature le32_to_cpu vport_info gt rev amp VPORT_INFO_REV_ MASK DESCRIPTION Invalid information header the signature or revision is invalid DATA None ACTION Static VPorts does not load Contact Emulex technical support elx_mes0582 Error lt rc gt during sgl post operation DESCRIPTION The SGL post operation failed DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 86 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0602 Failed to allocate CQ_EVENT entry DESCRIPTION Failed to allocate a CQ_EVENT entry DATA None ACTION None required elx_mes0603 Invalid work queue CQE subtype lt subtype gt DESCRIPTION Invalid work queue CQE DATA None ACTION None required FCP Traffic History 0700 0799 elx_mes0700 Bus Reset on target lt i gt failed DESCRIPTION The bus reset for the specified target failed DATA N
96. csi log level 0xff 2 log_level proc entry setting use the following commands to read and write values to the log_level proc entry e cat proc be2iscsi log_level This command displays the current log level and help Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt G EMULEX 2 Configuration 46 iSCSI Driver Configuration e echo 0xff gt proc be2iscsi log_level This command sets the log_level value in the driver to enable the desired logging See Table 2 8 for a list of available log level values Table 2 8 Log Level Values log_level Value Description 0x01 Enables logging in the iSCSI driver initialization and unload path 0x02 Enables logging in the iSCSI driver I O path 0x04 Enables logging in the iSCSI driver error handling path 0x08 Enables logging in the iSCSI driver configuration path such as adding targets deleting targets and so on 0x10 Enables logging in the iSCSI driver IOCTL path Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A xs o 3 Troubleshooting 47 gt G EMULEX Troubleshooting the FC FCoE Driver 3 Troubleshooting There are several circumstances in which your system may operate in an unexpected manner This section explains many of these circumstances and offers one or more workarounds for each situation Troubleshooting the FC FCoE Driver General Situations Table 3 1 General Driver Situation
97. d elx_mes1421 Failed to set up hba DESCRIPTION Initialization failed to set up the adapter DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 101 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1422 Unrecoverable Error Detected during POST uerr_lo_reg lt ue lo gt uerr_hi_reg lt ue hi gt DESCRIPTION The adapter has notified the driver that it has encountered an unrecoverable error DATA None ACTION A dump from the OneCommand Manager application should be taken Then the driver should be unloaded and reloaded elx_mes1423 HBA Unrecoverable error uerr_lo_reg lt ue lo gt uerr_hi_reg lt ue hi gt ue_mask_lo_reg lt ue mask lo gt ue_mask_hi_reg lt ue mask hi gt DESCRIPTION The adapter has notified the driver that it has encountered an unrecoverable error DATA None ACTION A dump from the OneCommand Manager application should be taken Then unload and reload the driver elx_mes1424 Invalid PCI device group lt pci_dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None ACTION None required elx_mes1425 Invalid PCI device group lt pci_dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None ACTION None required elx_mes1426 Invalid PCI device group lt pci_dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None ACTION None required
98. d WWNN or WWPN format DATA None ACTION Provide a valid WWN when creating VPorts elx_mes1822 Invalid lt name gt lt XX XX XXi XX XX XX XXi XX gt DESCRIPTION An invalid WWN was used when creating a VPort DATA 1 type_name 2 wwn 1 3 wwn 3 3 wwn 5 4 wwn 7 ACTION When creating a VPort you must furnish a valid WWN elx_mes1823 Create VPORT failed Duplicate WWN on HBA DESCRIPTION The port could not be created because it would duplicate an existing WWNN adapter address The resources for the port had to be discarded DATA None ACTION Provide a WWN that is unique elx_mes1825 Vport Created DESCRIPTION This message is displayed to indicate that a port was created in the system It is displayed at this level to ensure it is always appears at all log levels DATA None ACTION No action informational elx_mes1826 Vport Disabled DESCRIPTION The port had to be disabled in the system DATA None ACTION No action informational elx_mes1827 Vport Enabled DESCRIPTION The port had to be enabled after possible recovery from some errors DATA None ACTION No action informational elx_mes1828 Vport Deleted DESCRIPTION A VPort was deleted DATA None ACTION No action informational Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 107 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1830 Signal aborted mbxCmd lt command gt
99. driver The server administrator must run the following command to disable MSI X esxcli system module parameters set p msix 0 m elxnet And to verify that the value has been reprogrammed esxcli system module parameters list m elxnet Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A f 2 Configuration 35 DG EMULEX NIC Driver Configuration The output should look similar to the following Name Type Value Description emi_canceller int Enable or disable the EMI Canceller max _vfs array of The number of virtual functions int 0 disable default 1 16 enable this many VFs msix int 0 Enable or disable MSI X vxlan_offload int Enable or disable vxlan_offload The server administrator must run the following command to disable vxlan_offload esxcli system module parameters set p vxlan_offload 0 m elxnet Note This parameter only applies to OCe14000 series adapters And to verify that the value has been reprogrammed esxcli system module parameters list m elxnet The output should look similar to the following Name Type Value Description emi_canceller int Enable or disable the EMI Canceller max_vfs array of The number of PCI virtual functions to int initialize 0 disable default 1 16 enable this many VFs msix int Enable or disable MSI X vxlan_offload int 0 Enable or disable vxlan_offload Configuring ESXi 5 0 and 5 1 NIC Driver Parameters The following tab
100. driver issued a FLOGI but never received any completion with the timeout period The driver is marking the FLOGI as failed and stops discovery DATA None ACTION Check your Fabric to ensure it is operating correctly Contact Emulex technical support if issues persist elx_mes2860 SLI authentication is required for INIT_ LINK but has not been done yet DESCRIPTION DATA None ACTION None required elx_mes2862 FCF lt value gt matches property of in use FCF lt value gt DESCRIPTION The driver has found an FCF record that matches the properties of the current FCF record except for the VLAN ID and Index The driver will attempt to use this FCF DATA None ACTION None required The driver is in its FCF discovery phase and is trying to recover a match to its in use FCF elx_mes2863 New FCF lt value gt matches property of in use FCF lt value gt DESCRIPTION The driver has found a new FCF record that matches the properties of the current FCF record but the record instance numbers do not match DATA None ACTION None required The driver is in its FCF discovery phase and is trying to recover a match to its in use FCF elx_mes2877 FCP XRI exchange busy wait time lt value gt seconds DESCRIPTION An FCP exchange cannot be released no port completion Driver is waiting DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support Emulex Drivers V
101. dump with hbacmd and then try reloading the driver elx_mes0383 Error lt error gt during scsi sgl post operation DESCRIPTION DATA None ACTION None required elx_mes0384 There is pending active mailbox cmd DESCRIPTION The mailbox commands have overlapped This command should have been added to the mailbox queue DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 71 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0385 rc should have been MBX_BUSY DESCRIPTION The completion handler for REG_LOGIN detected the IMMED_UNREG flag and tried to issue the unreg_login command from an interrupt level The mailbox status should still be busy DATA None ACTION None required elx_mes0387 Failed to allocate an iocbq DESCRIPTION Failed to get an IOCBQ from the list of available IOCBQs DATA None ACTION None required elx_mes0388 Not a valid WCQE code lt hex cqe_code gt DESCRIPTION The event code is invalid This event is dropped DATA None ACTION Ensure that the adapter s firmware is current elx_mes0391 Error during rpi post operation DESCRIPTION The driver was trying to post pages to the firmware to be used to keep target login information and encountered a failure DATA None ACTION Unload and reload the driver elx_mes0393 Error lt rc gt during rpi post operation DESCRIPTION The driver was trying to post pag
102. e ACTION None required elx_mes0399 Invalid link attention type lt hex link_type gt DESCRIPTION The READ_LA mailbox command has returned an invalid link type DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 73 DG EMULEX Troubleshooting the FC FCoE Driver Initialization Events 0400 0599 elx_mes0400 Phys Attribute Count Exceeded Max lt value gt Actual lt value gt DESCRIPTION Too many driver configuration parameters have been set The limit is given as Max DATA 1 Maximum number 2 Actual number ACTION Reduce the number of actual parameters elx_mes0402 Cannot find virtual addr for buffer tag on ring lt ringno gt DESCRIPTION A DMA buffer is not available for this unsolicited command DATA 1 tag 2 next 3 prev 4 postbufg_cnt ACTION None required elx_mes0403 Ipfc_nodev_tmo attribute cannot be set to lt val gt allowed range is lt LPFC_MIN_DEVLOSS_TMO gt lt LPFC_MAX_DEVLOSS TMO gt DESCRIPTION Attempt to set the nodev timeout value is outside the range of the devloss timeout range DATA None ACTION Set the nodev timeout between the minimum and maximum devloss timeout range elx_mes0404 Config Param lt value gt set to lt value gt DESCRIPTION Driver is setting a persistent VPort parameter to a different value DATA 1 New value ACTION None This message is notification only elx_mes
103. e value lt value gt out of range allowed values are 0 1 setting it to default value of 1 DESCRIPTION DATA None ACTION None required elx_mes2718 Clear Virtual Link Received for VPI lt index gt tag lt event_tag gt DESCRIPTION A Clear virtual link was received from the Fabric for this VPI DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 124 SG EMULEX Troubleshooting the FC FCoE Driver elx_mes2719 Invalid response length tgt lt TGT_ID gt lun lt LUN gt cmnd lt CMD gt rsplen lt RSPLEN gt DESCRIPTION The response length for this FCP command is not supported DATA None ACTION None required elx_mes2723 PCI channel I O abort preparing for recovery DESCRIPTION Driver is preparing port PCI channel for reset recovery after I O error DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2726 READ_FCF_RECORD Indicates empty FCF table DESCRIPTION The driver requested the firmware provide a list of FCF entries to connect to and the firmware responded that the FCF table is empty DATA None ACTION None required elx_mes2729 Unable to dma_map_ single request_ buffer lt value gt DESCRIPTION Driver unable to map SCSI command scatter gather buffer DATA 1 dma mapping error ACTION Software driver error If this issue persists report these errors
104. eeeenennaes 150 ESXi 5 5 Native Mode Driver Troubleshooting Support ceeeee eee 153 ESXi 5 5 Native Mode Driver Support for ethtool Commands 0045 155 P009803 01A Rev A List of Tables 6 gt EMULEX 1 Installation Driver Information 1 Installation Driver Information This product supports the Emulex OneConnect and LightPulse families of adapters The VMware ESXi drivers support the Fibre Channel FC FC over Ethernet FCoE Ethernet or network interface card NIC and Internet Small Computer System Interface iSCSI protocols This document explains how to install the VMware ESXi drivers on your system and configure the drivers capabilities based on the supported networking protocols e FC FCoE Q Q Q Q Q Q Adding LUNs and targets Configuring driver parameters Creating an FC remote boot disk Managing devices through the CIM interface Working with virtual ports VPorts Troubleshooting FC FCoE issues e NIC Q Q Q Q Configuring NIC driver parameters Improving driver performance Using vmxnet emulation including TSO and jumbo frames Troubleshooting NIC issues e iSCSI Q Q Q Q Configuring iSCSI driver parameters iSCSI error handling and LDTO and ETO Implementing Multipath I O MPIO support for non boot and boot targets Configuring iSCSI through Dynamic Host Configuration Protocol DHCP Troubleshooting iSCSI issues Ref
105. elete MAC address filter failed The firmware command to delete a MAC address filter failed The device should continue to work Warning Unable to get Firmware Version The command to get the firmware revision number failed The version number is not shown The device will continue to work Warning Did not receive completions for all TX requests While the driver was unloading some outstanding transmit requests were found This is an indication that the hardware is not functioning properly Warning Failed to register char device Could not create the char device used for certain management functions The driver will continue to work You may not be able to use HBACMD to interact with the device Warning alloc_skb failed Try increasing netPktHeapMaxSize Emulex Drivers Version 10 0 for VMware ESXi User Manual Could not allocate the skb structure to send a frame received from the network to the operating system This is a transient failure that can be ignored If this message appears continually you may need to allocate more memory to the network heap For example to increase the heap size to 128MB run esxcfg advcfg k 128 netPktHeapMaxSize P009803 01A Rev A 3 Troubleshooting 146 SG EMULEX Troubleshooting the NIC Driver Table 3 5 ESXi Server NIC Event Log Entries Continued Severity Displayed Message Description Warning Invalid MTU requested MTU must Invalid MTU
106. emory could not be allocated to send the LOGO event to the FC transport DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 55 DG EMULEX Troubleshooting the FC FCoE Driver Link Discovery Events 0200 0299 elx_mes0200 CONFIG_LINK bad hba state lt hba_state gt DESCRIPTION A CONFIG_LINK mailbox command completed and the driver was not in the right state DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes0203 Devioss timeout on WWPN lt address gt N_ Port lt nlp_DID gt DESCRIPTION A remote N_Port that was discovered by the driver disappeared for more than lpfc_devloss_tmo seconds DATA 1 nlp_flag 2 nlp_state 3 nlp_rpi ACTION If the device generating this message is not a target to which the adapter is connected this error does not affect the data integrity of the I O between the adapter and the attached storage and can be ignored elx_mes0206 Device discovery completion error DESCRIPTION This indicates that an uncorrectable error was encountered during device re discovery after a link up FC devices are not accessible if this message is displayed DATA None ACTION Reboot the system If the issue persists report the error to Emulex technical support Run with verbose mode on for more details elx_mes0207 Device lt DID gt lt WWN gt sent i
107. en Upgrading to ESXi 5 5 on page 8 for additional information e Command line tool transition For the ESXi 5 5 release and all subsequent operating system releases VMware is starting the transition from esxcfg commands to esxcli commands Both sets of commands are supported in the ESXi 5 5 release See ESXi 5 5 Command Line Tool Transition on page 19 for additional information e Native mode driver management support With the introduction of the new native mode driver ethtool is no longer supported Instead you may use either the esxcli commands or the VmkMegmtKeyVal interface to provide troubleshooting support See ESXi 5 5 Native Mode Driver Troubleshooting Support on page 153 and ESXi 5 5 Native Mode Driver Support for ethtool Commands on page 155 for additional information Driver Parameters Migration When Upgrading to ESXi 5 5 VMware s ESXi 5 5 release has two driver models e vmklinux the legacy driver model e native mode the new driver model vmklinux is a Linux compatibility layer for device drivers in all ESX releases from ESX 2 x to ESXi 5 1 This vmklinux layer allows independent hardware vendors IHVs to use their Linux drivers in ESXi with only a few modifications This consistent driver model usage along the ESXi release train ensures that upgrades automatically copy the initial ram disk driver parameters from the original operating system to the upgraded operating system With the introduction of
108. entry DATA None ACTION None required elx_mes0371 No entry from the CQ identifier lt queue_id gt type lt type gt DESCRIPTION There was no completion queue event for this event queue entry DATA None ACTION None required elx_mes0372 iotag lt iotag gt is out of range max iotag lt sli last_iotag gt DESCRIPTION The IOCB lookup cannot be performed because the iocb_tag is out of range DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 70 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0376 READ_REV Error SLI Level lt sli_rev gt FCoE enabled lt hba_flag amp HBA_FCOE_SUPPORT gt DESCRIPTION This SLI 4 only adapter setup function was called for a non SLI 4 device DATA None ACTION None required elx_mes0377 Error lt rc gt parsing vpd Using defaults DESCRIPTION Could not parse the VPD data so the driver is using the default values DATA None ACTION None required elx_mes0381 Error lt rc gt during queue setup DESCRIPTION Could not set up all the queues that driver requires to exchange I Os with the adapter DATA None ACTION Reload the driver elx_mes0382 READ_SPARAM command failed status lt issue status gt mbxStatus lt mailbox status gt DESCRIPTION The READ_SPARAM mailbox command has failed during initialization The adapter has been set to error state DATA None ACTION Take a
109. er to the OneCommand Manager User Manuals and OneCommand Manager for VMware vCenter User Manual for complete lists of supported technology ESXi 5 5 Overview With the release of ESXi 5 5 and vSphere 5 5 VMware has introduced a new driver model called native mode Emulex has endorsed the native mode driver model for ESXi 5 5 with the following drivers e For FC and FCoE functionality the out of box driver is the native mode Ipfc driver for OneConnect OCe10100 series OCe11100 series OCe14000 series LPe16202 OCe15100 LPe16000 series LPe12000 series and LPe11000 series adapters Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 7 SG EMULEX 1 Installation 8 Driver Information e For Ethernet NIC functionality the out of box driver for OCe10100 series OCe11100 series OCe14000 series and LPe16202 OCe15100 adapters is the native mode elxnet driver Note For iSCSI functionality on OCe10100 OCe11100 and OCe14000 series adapters the out of box driver continues to be the vmklinux based be2iscsi driver ESXi 5 5 also requires changes to the installation process and tools These changes include e Driver parameters migration When you upgrade to ESXi 5 5 you must document the existing driver parameter values for the initial ram disk for the server being upgraded After the upgrade you must then manually reprogram those initial ram disk values See Driver Parameters Migration Wh
110. error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0306 CONFIG_LINK mbxStatus error lt mbxStatus gt HBA state lt hba_state gt DESCRIPTION The driver issued a CONFIG_LINK mbox command to the adapter that failed DATA None ACTION This error could indicate a firmware or hardware issue Report these errors to Emulex technical support elx_mes0310 Mailbox command lt mbxcommand gt timeout DESCRIPTION A mailbox command was posted to the adapter and did not complete within 30 seconds DATA 1 hba_state 2 sli_flag 3 mbox_active ACTION This error could indicate a software driver or firmware issue If no I O is going through the adapter reboot the system If the issue persists report the error to Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 64 SG EMULEX Troubleshooting the FC FCoE Driver elx_mes0311 Mailbox command lt value gt cannot issue Data lt value gt lt value gt DESCRIPTION The driver detected an HBA error and can t issue the mailbox DATA 1 sli flags 2 hba flags ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes0312 Ring lt ringno gt handler portRspPut lt rspPutInx gt is bigger then rsp ring lt numRiocb gt DESCRIPTION The IOCB command rings put pointer is ahead of the g
111. ersion 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 131 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2878 ELS XRI exchange busy wait time lt value gt seconds DESCRIPTION An ELS exchange cannot be released no port completion Driver is waiting DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2881 RRQ failure DID lt value gt Status lt value gt lt value gt DESCRIPTION Driver RRQ request failed driver write target DID and status values DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2882 RRQ completes to NPort lt value gt with no ndlp Data lt value gt lt value gt lt value gt DESCRIPTION Driver completes a RRQ but there is no node association DATA 1 Status 2 Reason 3 loTag ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2884 Vport array allocation failed DESCRIPTION Driver could not create a buffer list of VPorts DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2885 Port Status Event port status reg lt value gt port smphr reg lt value gt error 1 lt value gt error 2 lt value gt DESCRIPTION DATA None ACTION None required elx_mes2886 HBA Error Attenti
112. es to the firmware to keep target login information and encountered a failure DATA None ACTION Unload and reload the driver elx_mes0394 Failed to allocate CQ EVENT entry DESCRIPTION The asynchronous event handler was not able to allocate an event queue entry to which to transfer the asynchronous event DATA None ACTION This could be a V LINK clear from the switch or a fatal error from the firmware Perform a dump from the OneCommand Manager application elx_mes0395 The mboxq allocation failed DESCRIPTION The asynchronous link event handler could not allocate a mailbox command to issue the READ_LA read link attention mailbox command DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 72 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes0396 The Ipfc_dmabuf allocation failed DESCRIPTION The asynchronous link event handler could not allocate a DMA buffer for the mailbox command to issue the READ_LA read link attention mailbox command DATA None ACTION None required elx_mes0397 The mbuf allocation failed DESCRIPTION The asynchronous link event handler could not allocate DMA able memory for the READ_LA mailbox command DATA None ACTION None required elx_mes0398 Invalid link fault code lt hex link_fault gt DESCRIPTION The attempt to read the link attention register has returned an unknown value DATA Non
113. escan the FCF tables and needed to unregister an old FCF record DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2749 Failed to prepare for unregistering HBA s FCF record rc lt value gt DESCRIPTION Driver encountered an initialization error when preparing to unregister an FCF and needed to prepare the command DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2751 Adapter failed to restart status reg lt status gt FW Data A8 lt 0xA8 gt AC lt 0xAC gt DESCRIPTION The adapter has failed to restart DATA None ACTION If the issue persists report the error to Emulex technical support elx_mes2752 KILL_BOARD command failed retval lt retval gt DESCRIPTION The KILL BOARD mailbox command failed to complete DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 126 DG EMULEX Troubleshooting the FC FCoE Driver ACTION If the issue persists report the error to Emulex technical support elx_mes2753 PLOGI failure DID lt DID gt Status lt Status gt lt Extended Status gt DESCRIPTION A PLOGI to lt DID gt was failed either by the driver firmware or target The lt status gt and lt extended status gt indicates why the PLOGI failed DATA None ACTION If the issue persists report the error to Emulex technic
114. esolution Mutual CHAP authentication cannot be One way CHAP is the only authentication method that can be configured with the vSphere client configured with the vSphere Client In order to set Mutual CHAP authentication you must use iSCSISelect IPV6 support is not available in vSphere In order to set the IPv6 address you must use iSCSISelect client for hardware iSCSI adapters Retrieving iSCSI Error Log Codes The iSCSI driver generates error codes to the var log vmkernel log file The vmkernel log file is an ASCII text file that can be viewed and searched with a text editor such as vim The vmkernel log file is automatically rotated as it gets larger and the rotated log files are named vmkernel x where x is an integer To search the log file for error messages at the command prompt type cd var log vim vmkernel log For example you may see the following message Sep 9 19 48 04 esx server vmkernel OneConnect iSCSI Driver The be2iscsi driver received a Task Management Function that is not supported and rejected this request The error log entry immediately following this entry will indicate the TMF function code that was rejected iSCSI Error Log Code Entries The following is a brief description of the error log codes generated by the iSCSI driver It includes the message displayed the meaning of the message and the recommended resolution Table 3 7 iSCSI Error Log Code Entries Severity Message Re
115. esponse buffer memory DESCRIPTION DATA None ACTION None required elx_mes1246 FCoE chip is running golden firmware Update FCoE chip firmware immediately DESCRIPTION DATA None ACTION None required elx_mes1247 FCoE chip is running diagnostic firmware Operational use suspended DESCRIPTION DATA None ACTION None required elx_mes1248 FCoE chip is running unknown firmware DESCRIPTION DATA None ACTION None required elx_mes1249 Invalid FRU data found on adapter Return adapter to Emulex for repair DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 96 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1250 Menlo command error code lt value gt DESCRIPTION DATA None ACTION None required elx_mes1251 Menlo command error code lt value gt DESCRIPTION DATA None ACTION None required elx_mes1252 Menlo command error code lt value gt DESCRIPTION DATA None ACTION None required elx_mes1262 Failed to allocate dfc_ host DESCRIPTION Could not allocate memory the dfc_host_struct DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 97 DG EMULEX Troubleshooting the FC FCoE Driver Link Events 1300 1399 elx_mes1300 Link Down Event in loop back mode DESCRIPTION Driver received a link down eve
116. esxcli network sriovnic vf list n vmnic lt X gt where vmnic lt X gt is the interface corresponding to the PF Note The vSphere Client option Configuration gt Advanced Settings also lists the VFs configured with the above command 9 To assign a VF to a virtual machine VM right click the VM in the vSphere Client and select Edit Settings Under the Hardware tab click Add and select PCI Device to attach a VF to the VM Note A maximum of six VFs can be assigned to a VM Configuring VLANs Virtual local area network VLAN filtering is supported in the hardware To configure VLANs create the vSwitch with the required VLAN ID and use this interface as an adapter to this vSwitch A native VLAN can also be configured in the guest operating system in VGT Virtual Guest Tagging mode For example using vconfig in the Linux guest operating system Up to 63 VLANs can be used with each universal multichannel UMC virtual channel Note You cannot run Link Aggregation Control Protocol LACP when UMC is enabled Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 1 Installation SG EMULEX Installing the NIC Driver Refer to the Emulex Universal Multichannel Reference Guide for additional information on UMC Default VLAN Tagging When default VLAN tagging is configured on a VF a VLAN ID is automatically added to and removed from every packet sent and received over the VF To configure a default
117. et pointer DATA None ACTION None required elx_mes0315 Ring lt ringno gt issue portCmdGet lt local_ getidx gt is bigger then cmd ring lt max_cmd_idx gt DESCRIPTION The port cmd ring get index is greater than the size of cmd ring DATA None ACTION This error could indicate a software driver firmware or hardware issue Report these errors to Emulex technical support elx_mes0317 iotag lt ulp_loTag gt is out of range max iotag lt max_iotag gt wd0 lt wd0 gt DESCRIPTION The IoTag in the completed IOCB is out of range DATA None ACTION This error could indicate a software driver firmware or hardware issue Report these errors to Emulex technical support elx_mes0319 READ_SPARAM mbxStatus error lt mbxStatus gt hba state lt hba_state gt DESCRIPTION The driver issued a READ_SPARAM mbox command to the adapter that failed DATA None ACTION This error could indicate a firmware or hardware issue Report these errors to Emulex technical support elx_mes0320 CLEAR_LA mbxStatus error lt mbxStatus gt hba state lt hba_state gt DESCRIPTION The driver issued a CLEAR_LA mbox command to the adapter that failed DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 65 DG EMULEX Troubleshooting the FC FCoE Driver ACTION This error could indicate a firmware or hardware issue Report these errors to Emulex technical support elx_mes0323 Unkno
118. figuration elx_mes0258 Register Fabric login error lt mbxStatus gt DESCRIPTION The REG_LOGIN for the fabric has failed DATA None ACTION Check the port and switch configuration elx_mes0259 No NPIVFabric support DESCRIPTION The switch to which the port is connected does not support NPIV DATA None ACTION Check the switch configuration elx_mes0260 Register NameServer error lt mbxStatus gt DESCRIPTION The REG_LOGIN mailbox command has failed for the nameserver DATA None ACTION Check the switch configuration elx_mes0261 Cannot Register NameServer login DESCRIPTION Either a memory allocation issue or an invalid parameter was sent to the REG_LOGIN DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 59 DG EMULEX Troubleshooting the FC FCoE Driver ACTION At least one message 0142 0121 0133 0134 0135 should precede this message elx_mes0262 No NPIV Fabric support DESCRIPTION The switch to which the port is connected does not support NPIV DATA None ACTION Check the switch configuration elx_mes0263 Discovery Mailbox error state lt port_state gt lt sparam_mbox gt lt cfglink_mbox gt DESCRIPTION Either the driver could not allocate resources or it could not send sparam_mbox or cfglink_mbox DATA 1 address of sparam_mbox command 2 address of cfglink_mbox command ACTION Attempt to unload and reload the driver when it is
119. has an invalid signature DATA None ACTION None required elx_mes2568 Config region 23 has bad version DESCRIPTION Configuration region 23 has an invalid version DATA None ACTION None required elx_mes2572 Failed allocate memory for fast path per EQ handle array DESCRIPTION Failed to allocate memory for the fast path per EQ handle array DATA None ACTION None required elx_mes2573 Failed allocate memory for msi x interrupt vector entries DESCRIPTION Failed to allocate memory for MSI X interrupt vector entries DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 121 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2574 Not enough EQs lt sli4_hba max_cfg_param max_eq gt from the pci function for supporting FCP EQs lt cfg_fcp_eq_count gt DESCRIPTION Failed to create the minimum fast path event queues DATA None ACTION None required elx_mes2576 Failed allocate memory for fast path EQ record array DESCRIPTION Failed to allocate memory for the fast path FQ record array DATA None ACTION None required elx_mes2577 Failed allocate memory for fast path CQ record array DESCRIPTION Failed to allocate memory for the fast path CQ record array DATA None ACTION None required elx_mes2578 Failed allocate memory for fast path WQ record array DESCRIPTION Failed to allocate memory for the fast path WQ record array DATA
120. he ETO value specified during insmod is the default ETO value that is applied to all targets The following command line shows how to configure the driver with LDTO value as 25 seconds Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration 44 DG EMULEX iSCSI Driver Configuration vmkload_mod be2iscsi ldto 25 To configure ESXi Server to load the iSCSI driver with this value after each reboot run the following commands and reboot the system esxcfg module s ldto 25 be2iscsi usr sbin esxcfg boot r reboot Multipath I O Support This section describes the installation and login processes for multipath I O support Configuring and Enabling Support for ESXi MPIO on Non boot Targets To configure and enable support for ESXi MPIO on non boot targets 1 2 Connect your configuration for multipath Log into your targets with all paths using vSphere Client or iSCSISelect For more information about using vSphere Client see Logging into Targets Using vSphere Client on page 44 For information about using iSCSISelect see the Boot Manual for Emulex OneConnect Adapters or the Boot Manual for Emulex LightPulse Adapters Configuring and Enabling Support for ESXi MPIO on Boot Targets To configure and enable support for ESXi MPIO on boot targets 1 Connect your configuration for multipath Multipath can be configured before or after installation Log into your targets wi
121. he supported parameters by a driver esxcli system module parameters list m lt driver binary name gt The command syntax for setting a parameter to a driver module esxcli system module parameters set p lt parameter _string gt m lt driver binary name gt FC and FCoE Driver Examples To set extended logging for the Emulex LPFC driver esxcli system module parameters set p lpfc_log_ verbose 0x10c3 m lpfc To list the parameter values assigned to a driver module esxcli system module parameters list m lpfc This command is the same as listing parameters The parameter set has the value column completed when applicable This command lists all instance and global parameters which makes it necessary to watch for any altered driver parameters Using the command above the output should look similar to the following Name Type Value Description lpfc_iocb cnt int IOCBs allocated for ELS CT ABTS in 1024 increments Default is 1 lpfc_link speed int Select link speed The valid values are 1 2 4 8 and 16 lpfc_log_ verbose int 0x10c3 Verbose logging bit mask lpfc_lun_que_ depth int The maximum number of FCP commands that can queue to a specific LUN Ethernet Driver Examples To list the module parameters supported by the elxnet driver esxcli system module parameters list m elxnet The output should look similar to the following Name Type Value Description emi_canceller int Enable or di
122. henticated DATA None ACTION None required The driver should recover from this event elx_mes0228 CLEAR LA timeout DESCRIPTION The driver issued a CLEAR_LA that never completed DATA None ACTION None required The driver should recover from this event elx_mes0230 Unexpected timeout hba linkstate lt link_state gt DESCRIPTION Discovery has timed out and the adapter state is not ready DATA None ACTION None required elx_mes0231 RSCN timeout DESCRIPTION The driver has lost track of what N_Ports have RSCNs pending DATA 1 fc_ns_retry 2 lpfc_max_ns_retry ACTION None required The driver should recover from this event elx_mes0233 Nodelist not empty DESCRIPTION Driver unloaded or hotplug detected a node still in use DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 57 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0237 Pending Link Event during Discovery State lt state gt DESCRIPTION DATA None ACTION None required elx_mes0241 NameServer Rsp Error Data lt data gt DESCRIPTION DATA None ACTION None required elx_mes0246 RegLogin failed DESCRIPTION The firmware returned a failure for the specified RegLogin DATA 1 Did 2 mbxStatus 3 hbaState ACTION This message indicates that the firmware could not perform a RegLogin for the specified DID There may be a limitation on how many nodes an
123. ibuted Switch vDS refer to the VMware VXLAN Deployment Guide available at http www vmware com files pdf techpaper VMware VXLAN Deployment Guide pdf Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration 40 DG EMULEX iSCSI Driver Configuration iSCSI Driver Configuration Configuring iSCSI Driver Options The following table lists the user configurable iSCSI driver options It includes a description of the parameters default values and the limits within which they can be configured Note Ifthe value given for a parameter is outside the supported range Minimum and Maximum values then the driver will log an error in the Event Log and continue to load using the default value of the parameter Table 2 5 User configurable iSCSI Driver Options Parameter LDTO Default Value 20 seconds Minimum Value 0 seconds Maximum Value 3600 seconds Description Link Down Timeout in seconds This determines the amount of time the initiator driver will wait for the controller s physical link to become available before reporting that the LUNs are unavailable to the operating system ETO 30 30 seconds 0 seconds 3600 seconds Extended Timeout in Seconds This determines the amount of time the initiator driver will wait for the target to become available once it has lost connection to the target during an I O operation Note If the minimum value is
124. ic Option 43 The following section describes the format for the data returned in DHCP vendor specific option 43 The method and format for specifying the Vendor ID is outside the scope of this document and is not included here The initiator offers this Vendor ID to the DHCP server to retrieve data in the format described in the following section Format of Vendor Specific Option 43 The data returned in DHCP vendor specific option 43 uses the following format iscsi lt TargetIP gt lt TargetTCPPort gt lt LUN gt lt TargetName gt lt Init iatorName gt lt HeaderDigest gt lt DataDigest gt lt AuthenticationType gt The guidelines for creating the data string include e Strings shown in quotes are part of the syntax and are therefore mandatory e Fields enclosed in angular brackets including the angular brackets should be replaced with their corresponding values Some of these fields are optional and may be skipped e Ifan optional field is skipped a colon must be used as a placeholder to indicate the default value for that field e When specified the value of each parameter should be enclosed in double quotes All options are case sensitive Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A
125. ired elx_mes1411 Failed to set up driver resource DESCRIPTION Initialization failed to set up driver resource DATA None ACTION None required elx_mes1412 Failed to set up driver resource DESCRIPTION Initialization failed to set up driver resource DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 100 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1413 Failed to initialize iocb list DESCRIPTION Initialization failed to initialize the IOCB list DATA None ACTION None required elx_mes1414 Failed to set up driver resource DESCRIPTION Initialization failed to set up driver resource DATA None ACTION None required elx_mes1415 Failed to create scsi host DESCRIPTION Initialization failed to create SCSI host DATA None ACTION None required elx_mes1416 Failed to allocate sysfs attr DESCRIPTION Initialization failed to sysfs attribute DATA None ACTION None required elx_mes1418 Invalid HBA PCI device group lt dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None ACTION None required elx_mes1419 Invalid HBA PCI device group lt dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None ACTION None required elx_mes1420 Invalid HBA PCI device group lt dev_grp gt DESCRIPTION Invalid adapter PCI device group detected DATA None ACTION None require
126. ired elx_mes2001 Unable to allocate memory for issuing SLI CONFIG_ SPECIAL mailbox command DESCRIPTION Unable to allocate memory for issuing the SLI CONFIG_SPECIAL mailbox command DATA None ACTION None required elx_mes2002 Error Could not grow rpi count DESCRIPTION An error occurred because the RPI count could not be increased DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 111 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes2007 Only Limited Edition cmd Format supported lt iocb ulpCommand gt DESCRIPTION SLI 4 only supports the Limited Edition command format DATA None ACTION None required elx_mes2008 Error lt rc gt posting all rpi headers DESCRIPTION The RPI headers could not be posted to the firmware DATA None ACTION None required elx_mes2009 Failed to allocate mbox for ADD_ FCF cmd DESCRIPTION Failed to allocate mailbox for ADD_FCF command DATA None ACTION None required elx_mes2010 Resume RPI Mailbox failed status lt status gt mbxStatus lt mbx status gt DESCRIPTION DATA None ACTION None required elx_mes2011 Unable to allocate memory for issuing SLI CONFIG_ SPECIAL mailbox command DESCRIPTION Unable to allocate memory for issuing SLIL CONFIG_SPECIAL mailbox command DATA None ACTION None required elx_mes2012 Mailbox failed mbxCmd lt mbx_cmd gt READ_CONFIG mbxStatus
127. lan_offload To enable emi_canceller for the Emulex elxnet driver 2 Configuration ESXi 5 5 Command Line Tool Transition esxcli system module parameters set p emi_canceller 1 m elxnet To verify the altered parameter value in the elxnet driver module esxcli system module parameters list m elxnet The output should look similar to the following Name Type Value Description emi_canceller int 1 Emulex Drivers Version 10 0 for VMware ESXi User Manual Enable or disable the EMI Canceller P009803 01A Rev A gt G EMULEX Name Type max _vfs array of int msix int vxlan_offload int Value 2 Configuration ESXi 5 5 Command Line Tool Transition 22 Description The number of virtual functions 0 disable default 1 16 enable this many VFs Enable or disable MSI X Enable or disable vxlan_offload To disable vxlan_offload for the Emulex elxnet driver esxcli system module parameters set p vxlan_offload 0 m elxnet Note This parameter only applies to OCe14000 series adapters To verify the altered parameter value in the elxnet driver module esxcli system module parameters list m elxnet The output should look similar to the following Name Type emi_canceller int max _vfs array of int msix int vxlan_offload int Emulex Drivers Version 10 0 for VMware ESXi User Manual Value Description Enable or disable the EMI Canceller The number of PCI virtual functions to ini
128. le lists the user configurable NIC driver parameters for ESXi 5 0 and 5 1 It includes a description of the parameter and its default value Table 2 3 User configurable NIC Driver Parameters Parameter Default Value Description heap_initial 32 MB The size of the memory heap in bytes that should be initially allocated for the driver heap_max 38 MB The maximum possible size to which the driver heap is allowed to grow The following command line shows how to load the driver with the initial heap size set to 40 MB vmkload_mod be2net heap _initial 41943040 To configure the NIC driver to load with this value as the initial heap size after each reboot run the following command and reboot the system esxcfg module s heap _initial 41943040 be2net Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration gt lt EMULEX NIC Driver Configuration 36 Performance Tuning Using vmxnet Emulation Using vmxnet3 or vmxnet2 as the emulation driver in guest operating systems is crucial for optimal network performance To configure vmxnet3 as the emulation driver in guest operating systems you must install VMware Tools in the guest operating systems For information on installing VMware Tools in a guest operating system refer to the appropriate VMware ESXi Server documentation After VMware Tools are installed when you add a network adapter for a guest operating system select vmxnet3
129. lowing commands on the server prior to the ESXi 5 5 upgrade esxcfg module g lpfc820 lpfc820 enabled 1 options lpfc_lun queue_depth 8 After upgrading to ESXi 5 5 the server administrator must run the following command Note The driver binary name is now the native mode Emulex LPFC driver esxcfg module s lpfc_lun _ queue_depth 8 lpfc And to verify that the value has been reprogrammed esxcfg module g lpfc lpfc enabled 1 options lpfc_lun_queue_depth 8 Once verification has completed reboot the server to activate the command and burn the new driver parameters into the initial ram disk Ethernet Driver Example This example assumes a single OCe10100 or OCe11100 series adapter in the host since the max_vfs parameter receives the number of virtual functions VFs for each physical function PF Before upgrading to ESXi 5 5 you would enter the following command esxcfg module g be2net be2net enabled 1 options max vfs 2 2 After upgrading to ESXi 5 5 when the server administrator runs this command for the out of box native mode Ethernet driver for the OCe10100 or OCe11100 series adapter there are no module parameters Note that the driver binary name is now elxnet for the native mode Emulex Ethernet driver for the OCe10100 and OCe11100 series adapter esxcfg module g elxnet Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 1 Installation gt lt EMUL
130. lt in system stalls and freezes especially during higher values of queue depth and smaller sized I O requests On a configuration that involves a large number of iSCSI targets more than 32 or 64 and higher values of queue depth the default setting may prove to be too aggressive and the Interrupt Moderation setting may need to be changed to Conservative or Very Conservative Though this will increase latency of an I O request the lower interrupt rate may allow the system to be functional under a high load Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration 43 gt G EMULEX iSCSI Driver Configuration iSCSI Error Handling The goal of iSCSI error handling is to be tolerant of link level and or target level failures up to configured timeout values so that I O errors are not seen by the application or operating system The error handling is triggered under the following conditions e Loss of immediate link to the initiator for example cable disconnect port failure The firmware detects and notifies the driver of a loss of the link When this happens the driver will queue the I O requests internally up to a configured timeout period so that the operating system does not see I O errors This timeout is known as Link Down Timeout LDTO e Loss of connection to the target due to target and or network disconnection at the target If the driver has I O requests pending with the target and the ta
131. ly Adding Targets VMware does not provide a native mechanism for this process After all target LUN configuration steps have been successfully completed add the target to the intended fabric zone Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt G EMULEX 2 Configuration 26 FC and FCoE Driver Configuration To get the driver to log into the target either the target or initiator link must be bounced If the target is configured with security ACLs the same link bounce requirement applies after the security ACLs are corrected To force the ESXi server to rescan all devices e Run the following command esxcfg rescan vmhbaxX Or e From the vSphere Client click Configuration Tab gt Storage Adapters and then click Rescan All FC FCoE Driver Configuration Parameters Table 2 1 FC and FCoE Driver Parameters lists the FC and FCoE driver module parameters their descriptions and their corresponding values in previous ESXi environments and in ESXi 5 5 native mode Note For ESXi 5 0 and 5 1 systems all adapter specific parameters must have an IpfcX_ prefix where X is the driver instance number For example setting IpfcO_lun_queue_depth 20 makes 20 the default maximum number of commands that can be sent to a single logical unit disk for lpfc instance 0 Dynamic parameters do not require a system reboot for changes to take effect Table 2 1 FC and FCoE Driver Parameters Module
132. ly been organized into logical groups based on code functionality in the FC driver With the introduction of the latest Emulex adapters that grouping is modified to account for additional behaviors The traditional grouping is maintained but recently added messages are no longer grouped together The messages provided in this section are unmaskable error conditions They are automatically added to the system console log You can examine the var log vmkernel file log to see any of these messages If you have concerns the best policy is to run a vm support dump and contact VMware or Emulex support staff Log messages are organized into logical groups based on code functionality within the driver Each group consists of a block of 100 log message numbers Most groups require a single block of 100 message numbers however some groups INIT FCP require two blocks Table 3 2 lists the groups and defines the associated number ranges for ESXi 5 0 and 5 1 systems Table 3 3 lists the groups and defines the associated number ranges for ESXi 5 5 systems Table 3 2 Message Log Table for ESXi 5 0 and 5 1 Systems LOG Message Verbose Mask Definition Verbose Bit Verbose Description LOG_ELS 0x1 ELS events LOG_DISCOVERY 0x2 Link discovery events LOG_MBOX 0x4 Mailbox events LOG_INIT 0x8 Initialization events LOG_LINK_EVENT 0x10 Link events LOG_FCP 0x40 FCP traffic history LOG_NODE 0x80 Node table
133. me 2 value written 3 minimum value 3 maximum value ACTION Write a value within the supported range elx_mes0451 Failed to enable interrupt DESCRIPTION DATA None ACTION None required elx_mes0453 Adapter failed to init mbxCmd lt mbxCommand gt READ_CONFIG mbxStatus lt mbxStatus gt DESCRIPTION Adapter initialization failed when issuing a READ_CONFIG mailbox command DATA None ACTION This error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0456 Adapter failed to issue ASYNCEVT_ENABLE mbox status lt rc gt DESCRIPTION The mailbox command to enable an asynchronous event notification failed DATA None ACTION Ensure the adapter firmware is current Reload the driver elx_mes0457 Adapter Hardware Error DESCRIPTION The driver received an interrupt indicating a possible hardware issue Data 1 status 2 status1 3 status2 ACTION This error could indicate a hardware or firmware issue If the issue persists report the error to Emulex technical support elx_mes0462 Too many cmd rsp ring entries in SLI2 SLIM Data lt values gt home pely svn_linux_Ipfc_upstream branches vmware 8 2 1 ucna kernel Ipfc Ipfc_sli c DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 80 DG EMULEX Troubleshooting the FC FCoE Driver elx_me
134. n Configuring ESXi 5 5 NIC Driver Parameters Table 2 2 ESXi 5 5 Ethernet Driver Parameters lists the Ethernet driver module parameters their descriptions and their corresponding values in previous ESXi environments and in ESXi 5 5 native mode Table 2 2 ESXi 5 5 Ethernet Driver Parameters 2 Configuration NIC Driver Configuration 34 ESXi 5 0 5 1 ESXi 5 5 OP Legacy Native Mode Module Driver Model Driver Model Parameter Description Values Values Comments emi_canceller Enable or disable the EMI Def 0 Def 0 No changes Canceller max_vfs The number of PCI VFsto Def 0 Def 0 No changes initialize Min 0 Min 0 0 disabled Max 16 Max 16 1 16 enable this many VFs msix Enable or disable MSI X Def 1 For the native mode driver vxlan_offload Enable or disable Def 1 For the native vxlan_offload mode driver vian_offload Enable or disable VLAN filtering by the hardware Deprecated Module Option The vlan_offload module parameter of the previous Ethernet driver be2net which provided control for hardware VLAN filtering is deprecated and no longer supported in the elxnet driver New Module Options In the elxnet driver there are two new module parameters 1 Enable or disable MSI X support The driver default is to have MSI X enabled 2 Enable or disable vxlan_offload support The driver default is to have vxlan_offload enabled Deprecated and not supported by the native mode
135. n node lt nip_DID gt event lt evt gt state lt nip_state gt Data lt nlp_rpi gt lt nlp_flag gt DESCRIPTION The driver is completing a PLOGI but do not have the rcv_plogi flag set DATA 1 nlp_rpi 2 nlp_flag ACTION Verify that all targets are still visible to the SCSI mid layer elx_mes0273 Unexpected discovery timeout vport State lt port_state gt DESCRIPTION The discovery process has timed out DATA None ACTION Ensure that all targets are visible elx_mes0282 did lt value gt ndlp lt value gt pusgmap lt value gt refcnt lt value gt ndlp gt nlp_ DID void ndlp Ipfc_init c ndlp gt nlp_usg_ map DESCRIPTION Driver clean up has found a node that is still on the node list during driver unload or PCI hotplug removal DATA None ACTION None required elx_mes0283 Failed to allocate mbox cmd memory DESCRIPTION Mailbox allocation error DATA None ACTION None required elx_mes0285 Allocated DMA memory size lt alloclen gt is less than the requested DMA memorysize lt reqlen gt DESCRIPTION Memory allocation was truncated DATA None ACTION None required elx_mes0286 Ipfc_nlp_state_cleanup failed to allocate statistical data buffer lt nlp_DID gt DESCRIPTION Memory allocation failed for node s statistical data DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 61 DG EMULEX Troubleshooting the FC FCoE Driver ACTION
136. n Non boot Targets s0seeees 44 Configuring and Enabling Support for ESXi MPIO on Boot Targets ccscceeeeeeeeeees 44 Logging into Targets Using vSphere Client ccceccceceeceeeeee eee eaeeseeeeeeeeene nates 44 Error Handling Under Multipath MPIO and Cluster Configurations e 45 Reading the Driver Statistics for a Specified Port ccecccseceeeeeeeeeeeeeeeeaeeenas 45 Setting the Log LOVE ccsactpucstaseretadseersiezadasaeiccantstasiasaudstensiiacstacateoit sash 45 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt G EMULEX Table of Contents 3 TTOUDIESNOOUNG kiitiiiriiti ONO AD Troubleshooting the FC FCOE Driver sssssssnrssssnnnnunnnnnnnnnnnnnnnnnnnnnanunnnnnnnnn 47 General SMUALIONG seve cedcn sav entccse cubed doactcvewntineed eaten ae dehtetrerteseeniid cutscene 47 LPFC Log Messages a2 ini ceunietianeiscitidisntunsdhitnnine adhd iminsnkseankisecadieiminenkGsaues 48 ESXi 5 5 Message Log Example cece cece terete 50 ESXi 5 0 and 5 1 Message Log Example c cece eee eee eee ee neni 50 ELS Events 0100 0199 4 atest eere cebatcieyae tices piveanidinissattsacnaipendidemessceteeunte 51 Link Discovery Events 0200 0299 cccccececee eects cee eeeeeeee eet eeeesaeteeeeeenenntegs 55 Mailbox Events 0300 0339 ccccccccccccce cece cesses eee eeeeeeee ene veteneeeseeanenenenenas 63 Initialization Events 0400 0599 oo
137. n or the OCM application on a Windows server See the OCM for VMware vCenter User Manual and the OneCommand Manager Application User Manual for additional information The installation requires that the CIM Provider be installed For more information on installing the CIM Provider see the appropriate CIM Provider Installation Guide Updating Drivers with VMware Offline Bundle Media VMware recommends using the offline bundle to update software on VMware ESXi 5 0 5 1 and 5 5 platforms Note For more information about the ESXi Patch Management activities refer to the VMware website To update a driver with the offline bundle media 1 Run the following command esxcli software vib install qd lt absolute_path_to_bundle gt lt driver_name gt lt driver version gt zip where lt driver_name gt represents the FC FCoE NIC or iSCSI driver For example to update the iSCSI driver type the following command esxcli software vib install d lt absolute_path_to_bundle gt esx 5 0 0 472629 be2iscsi 10 0 567 0 zip maintenance mode Reboot the VMware ESXi Server to activate the drivers Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A SXC EMULEX 2 Configuration 19 ESXi 5 5 Command Line Tool Transition 2 Configuration ESXi 5 5 Command Line Tool Transition For the ESXi 5 5 release and all subsequent operating system releases VMware is starting the transition from esxcfg commands to esxcli
138. nd 5 5 hosts you can manage adapters using the OneCommand Manager application on Windows but you must install and use the appropriate Emulex CIM Provider Note For VMware ESXi 5 0 5 1 and 5 5 hosts when advanced adapter management capabilities are required for example iSCSI Management and port disable use the OneCommand Manager for VMware vCenter application Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration 33 SC EMULEX FC and FCoE Driver Configuration Using the OCM for VMware vCenter Application The OCM for VMware vCenter plug in software uses the standard CIM interfaces to manage the adapters and supports CIM based device and adapter management The OCM for VMware vCenter plug in software also supports existing adapter management functionality based on its proprietary management stack and the standard HBAAPI interface To manage LightPulse and OneConnect adapters including updating the firmware on an ESXi 5 0 5 1 or 5 5 host using OCM for VMware vCenter you must install the out of box Emulex CIM Provider on the host For more information on installing the OCM Application for VMware vCenter software plugin and enabling the CIM Provider see the OneCommand Manager Application for VMware vCenter User Manual Installing the Emulex CIM Provider Refer to the CIM Provider Installation Guide for instructions on installing the Emulex CIM provider Working with VPorts Virtual Port
139. ndition Error There was an Unrecoverable Error This may be due to hardware errors or detected by the be2iscsi driver due to unhandled exceptions in the Following this error log entry the next hardware or firmware 3 entries will indicate the error codes Error The beZ2iscsi driver failed an IOCTL This error may indicate an incorrect request since the number of scatter configuration option for the iSCSI gather elements required for the driver It may also indicate a low IOCTL buffer exceeded the adapter s memory condition firmware limit Following this error log entry the next entry will indicate the IOCTL opcode and the payload length requested Error The be2iscsi driver detected an error This may indicate a target is in error or during offloading the iSCSI connection may point to transient network The operation will be retried again connectivity issues It may also Following this error log entry the next indicate a firmware error entry will indicate the session handle and the firmware error code Error The be2iscsi driver did not receive an Check for any errors reported at the iSCSI command window update upto target The iSCSI initiator is only 25 seconds during I O operations supported with certified targets Following this error log entry the next Check for the latest software at the entry will indicate the session handle target vendor s website Check for the where this error occurred The latest software at
140. ne required elx_mes3045 SLI_CONFIG hbd wr ext_buf_cnt lt value gt out of range lt value gt DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 136 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes3061 Last IDX lt value gt DESCRIPTION DATA None ACTION None required elx_mes3069 Clearing FCP rules DESCRIPTION DATA None ACTION None required elx_mes3070 Ipc_clir_ndlps_pri fcp_ priority sz lt value gt DESCRIPTION DATA None ACTION None required elx_mes3071 no memory for priority rules DESCRIPTION DATA None ACTION None required elx_mes3084 Allocated DMA memory size lt value gt is less than the requested DMA memory size lt value gt DESCRIPTION DATA None ACTION None required elx_mes3089 Failed to allocate queues DESCRIPTION DATA None ACTION None required elx_mes3103 Adapter Link is disabled DESCRIPTION DATA None ACTION None required elx_mes3104 Adapter failed to issue DESCRIPTION DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 137 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes3105 failed to allocate mailbox memory DESCRIPTION DATA None ACTION None required elx_mes3112 Ipfc_link_speed attribute cannot be set to lt value gt Speed is not sup
141. nfiguring ESXi 5 5 NIC Driver Parameters ssssssssrsresererrrrrrrrrerrrrrrrrrrrrrere 34 Deprecated Module Option sssssssssssssrrsisssrrrtin artritin ee ened 34 New Module OptionS ssssessssssssrrrsnsrnrtrn tnta trt rented 34 Configuring ESXi 5 0 and 5 1 NIC Driver Parameters ccccseceeeeeeeeeeeeeeaeeeenees 35 Performance UNING 2o s2nevsetsiasresscacisaxreivadsiearctswaceianidswisseeniceeasasaxitendssens 36 Using vmxnet Emulation cccceeccecee eee eens cnet sees sees eee EEEEEEEEEEEEEEEEEEEEEEEEEEEEE 36 Enabling TSO cei seis einn hearsay dead todas ve exe Rowdee aa dtegevne ca pend vb ene Che ees ape nee 36 Enabling UMbBO FrAMES iwc cetcveteeteatwias nies Gadde EEEE DAET RES 36 Using the Port Statistics COUNtErS 0 cece eee eter nee aed 37 VxXLAN ContiQuiratiOn ics cciaikivin tata nh andi diana a a e aai 39 iSCSI Driver CONTIGUIALION sacs sscasasdapaceanascamaienimenanassnnansenaseqaakinnsssmiaasensiewineen 40 Configuring iSCSI Driver OOUMINS ies Sars Avcrcseet essen a Siete phcnaiaces spemamineehceakandexenes 40 Interrupt Moderation Policy SettingS ccccccceeeeseeeeee esses esses eeeneeseneenenne eens 42 ISCSIErrOn Handling sas c cacn used tdadidandaetsatutnanhaeeiae AEEA EE AET AEE 43 Configuring LDTO and ETO on ESXi S rver vy i iy ch eve cetvactauedutemieeendeusetecioncdnasts 43 Multipath I O SUPPOrT aciri reece iin at inaa En EAE ENEE E AAA Aei 44 Configuring and Enabling Support for ESXi MPIO o
142. ng 109 DG EMULEX Troubleshooting the FC FCoE Driver ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1929 Exec format error DESCRIPTION No dfchba instance available for IOCTL loopback XRI read dropping DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1934 ENOMEM DMA coherent resource unavailable DESCRIPTION Driver failed to allocate a DMA buffer for an IOCTL request DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1935 Loopback test did receive any data DESCRIPTION Driver ran loopback test but did not receive a response DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1936 ENOMEM Kernel resource unavailable DESCRIPTION Driver failed to allocate DMA buffer during loopback test DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1944 ENOMEM kernel memory resource unavailable DESCRIPTION Driver failed to allocate kernel buffer for timed out I O request DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1949 ENOEXEC NULL parameter passed to function DESCRIPTION Driver tried to post receive buffe
143. nks to the adapter If the for a period exceeding the Link Down link is reestablished any sessions that Timeout LDTO If the initiator has existed previously will be connection to the target there will be reestablished and the devices will be event log entries from the disk available for I O subsystem indicating that the drives were lost If any I Os were in progress the system may see I O errors or failures Warning Both Port 0 and Port 1 links are down Check the links to the adapter Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 150 DG EMULEX Troubleshooting the iSCSI Driver Additional iSCSI Driver Messages The following iSCSI error messages are returned when you specify illegal options when loading the driver Table 3 8 Additional iSCSI Driver Messages Message WARNING dic value d out of range Valid Range is 0 1 Using Default Value 1 WARNING eto value d out of range Valid Range is 0 30 Using Default Value 30 WARNING Idto value d out of range Valid Range is 0 30 Using Default Value 20 WARNING ios_per_ctrl value d out of range Valid Range is 1 512 Using Default Value 512 WARNING max_io_size value d out of range Valid Range is 4 256 KByte Using Default Value 256 WARNING tmf_reset value out of range Valid Range is 1 3 Using Default Value 1 Note d represents
144. nt while in loopback mode unexpected event DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1302 Invalid speed for this board Reset link speed to auto lt value gt DESCRIPTION Driver detected an invalid link speed Resetting Link to Auto mode DATA 1 Invalid speed detected ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1303 Link Up Event lt eventTag gt received Data lt value gt lt value gt lt value gt lt value gt lt value gt lt value gt lt value gt DESCRIPTION A link up event was received It is also possible for multiple link events to be received together DATA 1 fc_eventTag 2 granted_AL_PA 3 UlnkSpeed 4 alpa_map 0 ACTION If numerous link events are occurring check the physical connections to the Fibre Channel network elx_mes1305 Link Down Event lt eventTag gt received Data lt value gt lt value gt lt value gt DESCRIPTION A link down event was received DATA 1 fc_eventTag 2 hba_state 3 fc_flag ACTION If numerous link events are occurring check the physical connections to the Fibre Channel network elx_mes1306 Link Up Event in loop back mode lt eventTag gt received Data lt value gt lt value gt lt value gt lt value gt DESCRIPTION Link up notification configured for loopback DATA 1 fc_eventTag 2 granted_
145. number set attributes below max Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 76 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0425 Ipfc_ attr attribute cannot be set to lt value gt allowed range is min max DESCRIPTION Driver attribute lpfc_ attr was defined with an out of range value DATA None ACTION Set the parameter between the minimum and maximum value elx_mes0426 Ipfc_enable_auth attribute cannot be set to lt value gt allowed range is lt min gt lt max gt DESCRIPTION DATA None ACTION None required elx_mes0427 Cannot re enable interrupt after slot reset DESCRIPTION The driver was not able to enable the interrupt after an adapter reset DATA None ACTION Unload and reload the driver elx_mes0430 PM resume Failed to enable interrupt DESCRIPTION The driver s power management resume function could not enable the interrupt DATA None ACTION Perform another PM suspend and resume or adapter reset elx_mes0431 Failed to enable interrupt DESCRIPTION The driver failed to start the interrupt DATA None ACTION Unload and reload the driver elx_mes0433 Wakeup on signal rc lt rc gt DESCRIPTION A signal other than the LPFC_DATA_READY was received on the worker thread DATA None ACTION Unload and reload the driver elx_mes0434 PM resume failed to start worker thread error lt error gt DESCRIPTION The driver s
146. nvalid service parameters Ignoring device DESCRIPTION Invalid service parameters were received from DID Ignoring this remote port DATA DID WWN ACTION Verify the remote port s configuration If the issue persists report the error to Emulex technical support Run with verbose mode on for more details elx_mes0222 Initial FLOGI FDISK timeout DESCRIPTION The driver sent the initial FLOGI or FDISK to the fabric and never gota response back DATA None ACTION Check Fabric configuration The driver recovers from this and continues with device discovery Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 56 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0223 Timeout while waiting for NameServer login DESCRIPTION Our login request to the NameServer was not acknowledged within RATOV DATA None ACTION Check the fabric configuration The driver recovers from this and continues with device discovery elx_mes0224 NameServer Query timeout DESCRIPTION Node authentication timeout node Discovery timeout A NameServer Query to the Fabric or discovery of reported remote N_Ports is not acknowledged within R_A_TOV DATA 1 fc_ns_retry 2 fe_max_ns_retry ACTION Check Fabric configuration The driver recovers from this and continues with device discovery elx_mes0227 Node Authentication timeout DESCRIPTION The driver has lost track of what N_Ports are being aut
147. o CVL event DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 128 DG EMULEX Troubleshooting the FC FCoE Driver New Events elx_mes2796 Mailbox memory allocation failed DESCRIPTION The driver failed to get memory resources to release an RPI DATA None ACTION None The driver s heap is exhausted A server reboot is required to fix the exhaustion Contact Emulex technical support if the issue persists elx_mes2798 Unreg_vpi failed vpi lt value gt mb status lt value gt DESCRIPTION The driver attempted to unregister a virtual port index and failed The failure status is printed DATA None ACTION This condition is not catastrophic but is unexpected If issues persist contact Emulex technical support elx_mes2813 Mgmt IO is Blocked lt value gt mbox cmd lt value gt still active DESCRIPTION The HBA s management interface is marked as blocked in preparation for an online or offline state transition All user space access to the HBA via libdfc interface will be blocked DATA None ACTION None Notification of a run state change only elx_mes2822 IOCB failed lt value gt iotag lt value gt xri lt value gt DESCRIPTION The driver is attempting to drain an internal queue and failed The failure reason and some state variables are written to the console DATA None ACTION None required This should be
148. o Emulex technical support elx_mes2758 Failed to allocate mbox for READ_ FCF command DESCRIPTION The driver failed to allocate memory from the mempool for issuing FCF read mailbox command during the round robin FCF bmask update DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 127 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2759 Failed to allocate memory for round robin FCF failover bmask DESCRIPTION The driver failed to allocate memory for the round robin FCF failover bmask DATA None ACTION Make sure system has enough kernel memory might need to reload the driver after memory issue resolved elx_mes2762 FCF lt value gt reached driver s book keeping dimension lt value gt DESCRIPTION DATA None ACTION Inform Emulex about this elx_mes2763 Failed to allocate mbox for READ_FCF cmd DESCRIPTION DATA None ACTION None required elx_mes2765 Mailbox command READ_FCF_RECORD failed to retrieve a FCF record DESCRIPTION Driver failed to find an FCF record when the FCF table scan completed DATA ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2772 Issue FCF rediscover mailbox command failed failt through to FCF dead event DESCRIPTION DATA None ACTION None required elx_mes2774 Issue FCF rediscover mailbox command failed through t
149. oad and reload the driver elx_mes0498 Adapter failed to init mbxCmd lt cmd gt INIT_ LINK mbxStatus lt status gt DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 82 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0499 Failed allocate fast path FCP CQ lt fcp_cqidx gt DESCRIPTION The completion queue event for the fast path could not be allocated DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0500 Failed allocate slow path mailbox CQ DESCRIPTION Failed to allocate slow path mailbox CQ DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0501 Failed allocate slow path ELS CQ DESCRIPTION Failed to allocate slow path ELS CQ DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0503 Failed allocate fast path FCP DESCRIPTION Failed to allocate fast path FCP DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0504 Failed allocate slow path ELS WQ DESCRIPTION Failed to allocate slow path ELS WQ DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0505 Failed allocate slow path MQ DESCRIPTION Failed to allocate slow path MQ DATA None ACTION The driver fails to load Contact Emulex technical support elx_mes0506 Failed allo
150. on on unsupported if type lt value gt DESCRIPTION DATA None ACTION None required elx_mes2887 Reset Needed Attempting Port Recovery DESCRIPTION DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 132 DG EMULEX Troubleshooting the FC FCoE Driver ACTION None required elx_mes2888 Unrecoverable port error following POST port status reg lt value gt port smphr reg lt value gt error 1 lt value gt error 2 lt value gt DESCRIPTION DATA None ACTION None required elx_mes2889 Port Overtemperature event taking port DESCRIPTION DATA None ACTION None required elx_mes2890 Port error detected during port reset wait_tmo lt value gt port status reg lt value gt error 1 lt value gt error 2 lt value gt DESCRIPTION DATA None ACTION None required elx_mes2891 Init VFI mailbox failed lt value gt DESCRIPTION DATA None ACTION None required elx_mes2892 Failed to allocate init_vfi mailbox DESCRIPTION DATA None ACTION None required elx_mes2893 Failed to issue init_vfi mailbox DESCRIPTION DATA None ACTION None required elx_mes2894 SLI_INTF reg contents invalid sli_intf reg lt value gt DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 133 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2895 Non FC link
151. one ACTION None required elx_mes0706 IOCB Abort failed outstanding lt value gt failed lt value gt DESCRIPTION The driver did not recover all I O following a reset task management command DATA 1 outstanding I O count 2 number of unrecovered I O ACTION Reset call fails to ESXi tries to recover elx_mes0713 SCSI layer issued Device Reset lt value gt lt value gt reset status lt value gt flush status lt value gt DESCRIPTION A device reset has completed on tgt lun Status values are displayed DATA 1 tgt 2 lun 3 task mgmt status 4 flush status ACTION None required elx_mes0714 SCSI layer issued bus reset DESCRIPTION The SCSI layer is requesting the driver to abort all I Os to all targets on this adapter DATA 1 ret ACTION Check the state of the targets in question elx_mes0717 FCP command lt value gt residual underrun converted to error Data lt values gt DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 87 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes0718 Unable to dma_map single request_ buffer lt value gt DESCRIPTION The driver could not map a single virtual address to a DMA address DATA 1 DMA mapping error ACTION None The driver fails the I O back to ESXi elx_mes0720 FCP command lt value gt residual overrun error Data lt values gt DESCRIPTION
152. or vmxnet2 as the adapter type Enabling TSO Some Emulex adapters support TSO TCP Segmentation Offload which is necessary to achieve optimal transmit throughput performance with low CPU utilization with the adapter TSO is enabled by default in ESXi 5 0 5 1 and 5 5 servers To view the current TSO configuration in the vSphere client 1 Select the Configuration tab 2 Under Software click Advanced Settings 3 Under Net Features view the current value of Net UseHwTSO e If the value is 1 TSO is enabled e If the value is 0 TSO is disabled Enabling J umbo Frames Enabling jumbo frames reduces CPU utilization and is a recommended practice To use jumbo frames you must increase the MTU Maximum Transmission Unit size in the vSwitch and also in the guest operating system Emulex adapters support MTU sizes between 64 bytes and 9000 bytes For optimal performance set the MTU size to the maximum value supported by your network environment The desired MTU size must be configured in the vSwitch as well as the guest operating systems Jumbo frames are not enabled by default in ESXi servers To configure the MTU size of a vSwitch using the vSphere client Select the Configuration tab Under Hardware click Networking Under Networking select Properties Select the vSwitch you wish to edit and click Edit Under vSwitch Properties on the General tab set the MTU value to 9000 de le Sa To configure the MTU size of a vSwitch using
153. policy of 0 turns off the Interrupt Moderation algorithm in the driver The large_io option can be used to modify the maximum transfer size in a single SCSI command By default the Emulex iSCSI driver in ESXi supports up to 128 KB and 32 Scatter Gather entries in a single SCSI command If applications issue I O requests that are larger than 128 KB or need more than 32 Scatter Gather entries the request will be split into multiple requests by the driver By specifying large_io 512 the iSCSI driver can support up to 512 KB of data and a total of 128 Scatter Gather entries in a single SCSI command Note By setting the option to 512 the amount of physical memory consumed by the driver increases Also though intermediate values between 64 and 512 will be accepted the memory used by the driver will be the same as what will be used for large_io 512 To set the large_io parameter in ESXi type the following commands esxcfg module s large io 512 be2iscsi gt to set the parameter esxcfg module g be2iscsi gt to view the parameter value esxcfg module i be2iscsi gt to view the options Even though the VMware operating system can be tuned to accept larger I O sizes from guest operating systems the guest operating systems will also often need to be tuned to create those larger I Os For example a Windows 2008 32 bit guest will by default have a maximum transfer size of 64 KB even if the VMware kernel is tuned to allow 512 KB I O transfers
154. ported in loop mode DESCRIPTION DATA None ACTION None required elx_mes3113 Loop mode not supported at speed lt value gt DESCRIPTION DATA None ACTION None required elx_mes3125 Not receiving unsolicited event DESCRIPTION DATA None ACTION None required elx_mes3141 Loopback mode lt value gt not supported DESCRIPTION DATA None ACTION None required elx_mes3142 Failed loopback test issue iocb lt value gt iocb_stat lt value gt DESCRIPTION DATA None ACTION None required elx_mes3143 Port Down Firmware Restarted DESCRIPTION DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 138 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes3144 Port Down Debug Dump DESCRIPTION DATA None ACTION None required elx_mes3145 Port Down Provisioning DESCRIPTION DATA None ACTION None required elx_mes3147 Fast path EQs not allocated DESCRIPTION DATA None ACTION None required elx_mes3148 Fast path FCP CQ array not allocated DESCRIPTION DATA None ACTION None required elx_mes3149 Fast path FCP WQ array not allocated DESCRIPTION DATA None ACTION None required elx_mes3150 No privilege to perform the requested access lt value gt DESCRIPTION Driver lacks privilege for requested action DATA Requested action ACTION Contact Emulex technical support elx_mes3151 PCI
155. r but no receive buffers available DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 110 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1950 ENOMEM IOCB resource not available DESCRIPTION Driver could not allocate IOCBs needed to post loopback receive buffers DATA 1 2 3 ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1951 ENOMEM MBUF resource not available DESCRIPTION Driver failed to get memory buffer needed for loopback test DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1952 ENOMEM DMA resource not available DESCRIPTION Driver failed to get DMA buffers needed for loopback test DATA 1 2 3 ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1957 EPERM Illegal BDE count lt value gt DESCRIPTION Driver received too many receive buffers for loopback operation DATA 1 receive buffer count ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2000 Failed to allocate mbox for READ_FCF cmd DESCRIPTION Failed to allocate mailbox for READ_FCF command DATA None ACTION None requ
156. r_add_status gt mbx DESCRIPTION The READ_FCF_RECORD mailbox command has failed DATA None ACTION None required elx_mes2522 Synchronous READ_FCF_RECORD mailbox failed with status lt value gt add_ status lt value gt DESCRIPTION Driver failed to read the active FCF Record on an FCoE link FCF may not be available DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2523 Allocated DMA memory size lt alloc_len gt is less than the requested DMA memory size lt req_len gt DESCRIPTION The ADD_FCF_RECORD mailbox command failed to retrieve the length required from the firmware DATA None ACTION None required elx_mes2524 Failed to get the non embedded SGE virtual address DESCRIPTION The READ_FCF_RECORD mailbox command could not retrieve the Scatter Gather Entry SGE that was requested DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 116 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2527 Failed to allocate non embedded SGE array DESCRIPTION Failed to allocate the non embedded SGE array DATA None ACTION None required elx_mes2528 Mailbox command lt vpi gt cannot issue DESCRIPTION The mailbox command could not be issued because the mailbox interrupt is disabled DATA 1 mbxCommand 2 sli_flag 3 flag ACTION None required
157. rget becomes unavailable due to target going down failing over or network issues at the target the driver queues up the I O request internally up to a configured timeout period This timeout is known as Extended Timeout ETO When the configured threshold for LDTO and ETO is reached and the initiator is still unable to connect to the target the driver fails all I O requests At this point I O errors will be seen by the application and operating system Note Following a link up switch ports can take a long time to initialize and go toa forwarding state Because of this additional time should be added to the ETO and LDTO settings to eliminate I O disruption and or target unavailability If the switch port is connected to a single host then PortFast mode can be enabled on the switch port to eliminate delays in transitioning to a forwarding state Configuring LDTO and ETO on ESXi Server The following table lists the default values of LDTO and ETO on ESXi Server and the limits within which they can be configured Table 2 7 LDTO and ETO Default Values on ESX Server Default Minimum Maximum Parameter Value Value Value LDTO 20 seconds 0 seconds 3600 seconds ETO 30 30 seconds 0 seconds 3600 seconds Note If the value of ETO is set to a number between 0 and 19 the driver will assume a value of 20 seconds internally You will not see any modification to the registry LDTO and ETO values are configurable during insmod time T
158. river Example cceccccecece eee eeeeeeeeeeseeeeeeeeeeeeeesatesateeeeeeeneentegs 9 Ethernet Driver Examples odeia r nenni raaa EEEE EAEE AREE EER AAA A TEENA TAREA 9 ESXi Compatibility 5c 2 geseucteestuseyecteancs et caccacnasdenatsqnessasasseeetdanataavesatuedees 10 supported Guest Operating Systems cccccec steers eirnieeedvesueeeiawenievenryeeusinees 10 installing the FC F COE Diver vevsncnssareiecanasanaennminaranaanedearmananeieereaaereneermacennsie 11 Installing the FC FCoE Driver and Management Software cccccceeeeeeeeeeeeeeeees 11 Uninstalling the FC FCoE DIVGl sine eiivesnesierbiarnniares tavctwvisbearooiwsteartousiviens 11 installing th NIC DNV OR sc cstitcncsnntaiesinapheteaimasnetessaneaesedeaneeseaneemeoerndeeete 12 Installing the NIC Driver and Management Software cccccceeeeeeeeeeeeeeeaeeenas 12 Uninstalling the NIC Driver sicvcisiscctssivtexnedveineawontace waver ur beavoor see verariaeas 12 Installing the Native Mode Ethernet Driver esxcli Plug in for ESXi 5 5 08 12 Virtualization SUDDOMcadestaisccnnethoticceces bevaneectessoienecenesessdetasegenccazicaniiaaets 13 NetQueue SUP DONE riir renren ereraa en EE NDEAN E EENDE an 13 How an ESXi Server Creates and Names Interfaces ereere 13 Enabling SR IOV in ESXi 5 1 and B D iscisccscapavessevespevastecnsoeeerictereetasenetieiaaews 14 Configuring VUANS icecrrprerarpreroini arenie e eren E E Ea E EEEa 15 Default VLAN Tagging seis ic sc sanacingaia
159. river Troubleshooting Support Troubleshooting Items from Earlier ESXi 5 5 vmklinux ESXi 5 5 Native vmklinux Driver Driver Support Mode Driver using the proc VmkMgmtKeyVal Support Usage in ESXi 5 5 Interface Description interface esxcli plug in Native Mode Driver csr_read Read the 32 bit v v usr lib vmware vmkm register value from the gmt_keyval vmkmgmt_ke CSR space at the offset aera eee ere vymnic0 KeyValue emu oe ex k CsrRead s lt offset 0x2d90 gt usr 1lib vmware vmkm gmt_keyval vmkmgmt_ke yval i vmnic0 KeyValue emul ex k CsrRead g Key CsrRead CSR Offset 0x2d90 gt 0x126 csr_write Set the CSR space v y usr lib vmware vmkm offset for csr_write gmt_keyval vmkmgmt_ke yval i vmnic0 KeyValue emul ex k CsrWrite s lt offset 0x2d90 gt lt value 3 gt drvr_stat Read the driver v v Available in custom statistics esxcli plug in in the asynchronous driver esxcli elxnet stats get p lt pci dev name gt eth_ring Get the various v Not implemented Ethernet ring properties misc_stat Read the miscellaneous v Partially Error stats available in a counters format them implemented custom esxcli plug in in with description the asynchronous driver These counters are esxcli elxnet stats clear on read get p lt pci dev name gt Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt EMULEX 3 Troubleshooting 154 ESXi 5 5 Na
160. rt queue sizing ethtool Get protocol offload v v k show offload information esxcli network DEVNAME nic sg tso cso get ethtool K offload DEVNAME Set protocol offload Not implemented Emulex Drivers Version 10 0 for VMware ESXi User Manual Not implemented esxcli network nic sg tso cso set n vmnicx Supported using vsish vsish e get net pNics vmic lt gt hwCapabilities vsish e set net pNics vmnic0 hwCapabilities lt CAP gt lt 1 0 gt P009803 01A Rev A gt G EMULEX 3 Troubleshooting 156 ESXi 5 5 Native Mode Driver Support for ethtool Commands Table 3 11 ESXi 5 5 Native Mode Driver Support for ethtool Commands Continued ESXi 5 5 vmklinux ESXi 5 5 Native J ustification for this Driver Support Mode Driver option or parameter VmkMgmtKeyVal Support if missing and ethtool Command Description interface esxcli plug in required ethtool i driver Show driver v v DEVNAME information esxcli network nic info get ethtool Dump device registers v v d register dump esxcli elxnet DEVNAME regdump get p lt pcidevname gt f lt filepath gt ethtool Dump device EEPROM v Not implemented e eeprom dump esxcli network DEVNAME nic eeprom dump n vmnicx ethtool Change bytes in device Not implemented Not implemented E change eeprom DEVNAME EEPROM esxcli network nic eeprom change n vmnicX ethtool r negotiate
161. s Creating Deleting and Displaying VPorts The Emulex driver for VMware supports NPIV by default The only management API for creating and deleting a VPort and creating an NPIV enabled virtual machine comes from ESXi VPorts in the driver discover the fabric just like physical ports do and are subject to the same SAN delays As the number of VPorts increases the amount of time it takes to complete remote port discovery increases This is because the VPorts are created sequentially and each VPort executes discovery synchronously If your NPIV enabled virtual machines power on automatically powering on could take longer than usual This is normal for NPIV virtual machines Note The following notes apply to VPorts e Ensure you are using the latest recommended firmware for VPort functionality Check the Emulex website for the latest firmware e Loop devices and NPIV are not supported on the same port at the same time If you are running a loop topology and you create a VPort the VPort s link state is offline VMware ESX supports only fabric mode e You can create VPorts only on 4 8 and 16 Gb s LightPulse adapters and on OneConnect adapters You cannot create VPorts on 1 Gb s or 2 Gb s adapters e The OneCommand Manager application sees all VPorts created by the driver but the application has read only access to them Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt EMULEX NIC Driver Configuratio
162. s identifies some of the common situations and their potential resolutions Table 3 1 General Driver Situations Situation Resolution Port link fails to come up If an FC link fails to come up verify that an 8 Gb s adapter is not attempting to connect to a 1 Gb s device Only 2 4 and 8 Gb s devices are supported on 8 Gb s adapters For OCe10100 series adapters ensure that the fabric port is enabled The Emulex driver is not loaded and all Use Ispci to determine if the Emulex ports are being paths are down properly identified If not find out if the driver iso was correctly installed You must have the correct driver for the installed adapter because the device PCI IDs are installed with the driver package Examine the var log vmkernel log file for pfc820 log messages indicating an error In this case contact Emulex support Ipfc driver fails to recognize an adapter Download and install the adapter firmware that and logs unknown IOCB messages in complies with the minimum supported revision or the system log during driver load The later listed on the Emulex website adapter is running outdated firmware System panics when booted with a Remove the failed adapter and reboot failed adapter installed Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 48 SG EMULEX Troubleshooting the FC FCoE Driver LPFC Log Messages Log messages have traditional
163. s netNetqueueEnabled FALSE NetQueue is disabled e To enable NetQueue run the following command esxcfg advcfg k TRUE netNetqueueEnabled Reboot the ESXi Server for the change to take effect How an ESXi Server Creates and Names Interfaces The NIC driver supports a maximum of four adapters per system For dual channel adapters running in standard operating mode the driver creates two interfaces one for each physical port The first and second interfaces are respectively named vmnic0 and vmnicl assuming there are no other network interfaces in your configuration The same applies to virtual NIC vNIC capable adapters when vNIC mode is disabled in the adapter BIOS for those boards that support vNIC When vNIC mode is enabled in the adapter BIOS and the adapter is in NIC only mode the driver creates eight interfaces four for each physical port The interfaces are labeled vmnic0 through vmnic7 assuming there are no other network interfaces in your configuration Note When vNIC mode is enabled in the adapter BIOS and the adapter is in FCoE or iSCSI mode the driver creates only six NIC interfaces The other two interfaces are reserved for FCoE and iSCSI Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt G EMULEX 1 Installation Installing the NIC Driver All vNICs are fully functional and support the same capabilities as a standard NIC The vNICs can also be linked to a virtual switch in
164. s0472 Unknown PCI error state lt value gt DESCRIPTION The PCI bus has detected an error DATA 1 state value ACTION Driver resets the adapter and attempts recovery If the issue persists contact Emulex technical support elx_mes0474 Unable to allocate memory for issuing MBOX_CONFIG_ MSI command DESCRIPTION Mailbox memory pool allocation error DATA None ACTION None required elx_mes0475 Not configured for supporting MSI X cfg_use_ msi lt cfg_use_msi gt DESCRIPTION The Ipfc_use_msi module parameter should have been set to 2 DATA None ACTION Set module parameter Ipfc_use_msi 2 elx_mes0476 HBA not supporting SLI 3 or later SLI Revision lt sli_rev gt DESCRIPTION The adapter does not support SLI 3 or SLI 4 DATA None ACTION This adapter does not support MSI Set lpfc_use_msi 0 elx_mes0479 Deferred Adapter Hardware Error DESCRIPTION An adapter hardware error was sent to the driver DATA 1 work_hs 2 work_status 0 3 work_status 1 ACTION Perform a dump using hbacmd elx_mes0482 Illegal interrupt mode DESCRIPTION Driver could not set MSI X MSI or INTX interrupt modes DATA None ACTION This could be a server issue Reboot If this issue persists report these errors to Emulex technical support elx_mes0483 Invalid link attention link speed lt value gt bf_get Ipfc_acqe_link_speed acqe_link DESCRIPTION The link speed reported in the link attention interrupt is invalid DA
165. sable the EMI Canceller Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt G EMULEX Name Type Value Description max _vfs array of The number of virtual functions int 0 disable default 1 16 enable this many VFs msix int Enable or disable MSI X vxlan_offload int Enable or disable vxlan_offload To set the number of virtual functions for the Emulex elxnet driver esxcli system module parameters set p max_vfs 2 2 m elxnet To verify the altered parameter value in the elxnet driver module esxcli system module parameters list m elxnet The output should look similar to the following Name Type Value Description emi_canceller int Enable or disable the EMI Canceller max _ vfs array of 2 2 The number of virtual functions int 0 disable default 1 16 enable this many VFs msix int Enable or disable MSI X vxlan_offload int Enable or disable vxlan_offload To disable MSI X support for the Emulex elxnet driver esxcli system module parameters set p msix 0 m elxnet To verify the altered parameter value in the elxnet driver module esxcli system module parameters list m elxnet The output should look similar to the following Name Type Value Description emi_canceller int Enable or disable the EMI Canceller max_vfs array of The number of virtual functions int 0 disable default 1 16 enable this many VFs msix int 0 Enable or disable MSI X vxlan_offload int Enable or disable vx
166. scsaaninanamnnaVsiee aeeie D oi a raine 16 Virtual Guest TaQQING viii cccsisceetin cela decay tienes ies A EE eka ee EE EE ee 16 Configuring a Static MAC for a VF ccc cceecee eee eee eect eee e sees eee eeat seat eeeeeenteeneennes 16 Configuring Network Heap Size in ESXi Server 5 0 and 5 1 ccceceeeeeeeeeeeeeenees 17 Obtaining Information on the Installed NIC Driver cccccceeeeeeeeeeeeeeeeeaeeeenees 17 Installing the iSCSI Driver sccccscsccscstcscsctscsvcssssssssrsssssescsectsssessessssestesessaneseenes 18 Installing the iSCSI Driver and Management Software ccccceeeeeeeeeeeeeeeenee ens 18 Updating Drivers with VMware Offline Bundle Media sccccsceccseeecceeeeeeeensanenaar 18 2 CONF QUIATION siciiiccsersersaticctecsiieseintennenernene Tete RRERMROTRRREROORREEERARERED 19 ESXi 5 5 Command Line Tool Transition ssssssssssssnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnn 19 ESXi 5 0 and 5 1 IMpl Me ntatiGn ccs ccsscieeserissis eds eeveeiarseniieer sewers er bew never 19 FC and FCoE Driver Examples ccccce cece cece eee eee eee 19 Ethernet Driver EXAMpleS x cictwsssedetorenehaed ative anraceewlanenwlandieiuwgeaeed dneaniaedeenenne 19 ESXI 5 5 Implementation mst chec ces clediece esac oea strn rrr rrt ttrt rnrn rnrn rttr rrr eeew eine 20 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A DE EMULEX Table of Contents 4 FC and FCoE Driver EXAMPleSisitscecnise ved ideda nated aati ni i
167. status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to create the event queue has failed DATA None ACTION None required Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 113 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2501 CQ_CREATE mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to create the completion queue has failed DATA None ACTION None required elx_mes2502 MQ_CREATE mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to create the mailbox queue has failed DATA None ACTION None required elx_mes2503 WQ_CREATE mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to create the work queue has failed DATA None ACTION None required elx_mes2504 RQ_CREATE mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox command sent to create the receive queue has failed DATA None ACTION None required elx_mes2505 EQ_DESTROY mailbox failed with status lt shdr_status gt add_ status lt shdr_add_status gt mbx status lt rc gt DESCRIPTION The mailbox
168. t hostd etc init d hostd restart Once restarted the elxnet namespace appears under elxnet The stats command is currently the only supported command using the esxcli plug in The stats command is invoked as follows esxcli elxnet stats get p lt pci dev name gt For example elxnet stats get p 0000 003 00 1 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 1 Installation 13 SG EMULEX Installing the NIC Driver Note The following command can be used to get the lt pci dev name gt value esxcli network nic list The output should look similar to the following Name PCI Device Driver Link Speed Duplex MAC Address MTU Description vmnic2 0000 003 00 0 elxnet Up 10000 Full 00 00 c9 bb 16 a6 1500 Emulex Corporation OneConnect 10Gb NIC be3 vmnic3 0000 003 00 1 elxnet Up 10000 Full 00 00 c9 bb 16 aa 1500 Emulex Corporation OneConnect 10Gb NIC be3 Virtualization Support For the best performance you must install VMware Tools in each guest operating system For information on installing VMware Tools in a Linux or Windows guest operating system refer to the appropriate VMware ESXi Server documentation NetQueue Support NetQueue enables support for multiple transmit and receive rings for improved performance NetQueue is enabled by default e To determine whether NetQueue is enabled run the following command from the ESXi Server console esxcfg advcfg j netNetqueueEnabled If it return
169. technical support if issues persist elx_mes2827 PCI channel permanent disable for failure DESCRIPTION The driver writes this message to the console when a recovery mechanism has failed and the driver wants to mark the port with a permanent failure DATA None ACTION A system reboot may correct the failure If not contact Emulex technical support elx_mes2828 PCI channel I O abort preparing for recovery DESCRIPTION The driver writes this message to the console when it is preparing the port for a recovery operation DATA None ACTION None required This is a notification message for the recovery action elx_mes2831 FLOGI response with cleared Fabric bit fcf_index lt value gt Switch Name lt value gt Fabric Name lt value gt DESCRIPTION When the driver completed a FLOGI the common service parameters did not indicate an FPort or NPort remote node The driver treats this as an error DATA None ACTION Validate the external cable connection and FPort Nport configuration Contact Emulex technical support if issues persist Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 130 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes2856 Config Port Security Crypto Error lt value gt pmb gt u mb un varCfgPort sec_err DESCRIPTION DATA None ACTION None required elx_mes2858 FLOGI failure Status lt value gt lt value gt TMO lt value gt DESCRIPTION The
170. tem after a power cycling If the problem persists this could indicate a hardware problem or corrupted firmware Warning Using INTx interrupts The driver could not allocate MSIx NetQueues feature will be vector for interrupt The driver may disabled continue to work but the performance may be impacted Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A gt G EMULEX Table 3 5 ESXi Server NIC Event Log Entries Continued 3 Troubleshooting 145 Troubleshooting the NIC Driver Severity Warning Displayed Message WARNING Found a OneConnect card in Gen lt D gt x lt D gt PCI e slot Should be in Gen 2 x8 slot for best performance Description The adapter is an x8 Gen2 PCl e device For best performance the adapter should be installed in a Gen2 PCl e slot 8 or 16 channels wide The driver displays this warning if it finds the device in a slower or narrower PCl e slot The device continues to work with reduced performance Warning Command to get pause frame settings failed The firmware command to get PAUSE settings failed Warning Command to set pause frame settings failed The firmware command to change PAUSE settings failed Warning Command to apply MAC address filter failed The driver could not set the MAC address filter on the hardware The device continues to work There may be an impact on the performance Warning Command to d
171. th all paths using vSphere Client or iSCSISelect For more information about using vSphere Client see Logging into Targets Using vSphere Client on page 44 For information about using iSCSISelect see the Boot Manual for Emulex OneConnect Adapters or the Boot Manual for Emulex LightPulse Adapters Logging into Targets Using vSphere Client To log into targets using the vSphere Client 1 NDP YN Log into the server that you would like to configure from the vSphere Client and select the Configuration tab In the Hardware section select the Storage Adapters link Select the OneConnect host adapter in the Storage Adapters list Select the initiator port and then click Properties From the iSCSI Initiator Properties screen click the Dynamic Discovery tab Click Add to display the Add Send Target Server menu Type in the IP address of the first target portal and click OK The initiator finds the target machines Click the Static Discovery tab to find all target portals Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration 45 DG EMULEX iSCSI Driver Configuration 9 Click Close 10 A dialog box indicates that a rescan is needed Click Yes The configured LUNs are displayed 11 Repeat the steps to log into the other target portal to set up MPIO 12 To check that both paths are connected to the same LUN follow these steps a Select the LUN and right click b Click Manage Paths
172. th between them Thus pinging between the VMs in the two groups fails If you want all these VMs in the same network configure them as teaming uplinks to one vSwitch option Each of the vmnics vmnicl to vmnic16 must be configured in a separate vSwitch In this configuration there is no network path between the vSwitches and pinging between these VMs does not work When inserting or removing a 1Gb There is no solution to this issue as the link status is not SFP RJ 45 module on an adapter reported due to a PHY limitation on the card without RJ 45 copper cables attached the operating system indicates link up or down status When inserting or removing copper cables attached to a switch to the module link up or down events are not reported to the operating system Flow control setting is not stored per With flow control there is no persistence across reboot It port after rebooting the system always starts with both RX and TX on For persistence run a config command from an RC file at reboot Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 144 SG EMULEX Troubleshooting the NIC Driver NIC Event Error Logging for ESXi 5 0 and 5 1 Retrieving ESXi Server NIC Error Log Codes For ESXi Server systems the NIC driver generates error codes to the var log vmkernel log file The vmkernel log file is an ASCII text file that can be viewed and searched with a text editor such as vim
173. the Emulex website be2iscsi driver will trigger a session If the above fails contact Emulex recovery on the session and continue technical support Warning The beZ2iscsi driver received an invalid Check for any errors reported at the iSCSI Command Sequence Number update from the target Following this error log entry the next three entries will indicate the session handle and the iSCSI parameters MaxCmdSN and ExpCmdsSN respectively Emulex Drivers Version 10 0 for VMware ESXi User Manual target The iSCSI initiator is only supported with certified targets Check for the latest software at the target vendor s website Check for the latest software at the Emulex website If the above fails contact Emulex technical support P009803 01A Rev A gt EMULEX Table 3 7 iSCSI Error Log Code Entries Continued 3 Troubleshooting 149 Troubleshooting the iSCSI Driver Severity Message Recommended Resolution Warning A connection to the target was lost for Check the connection to the target or a period exceeding the Extended the state of the target device If the Timeout ETO The error log entry target is made available any sessions immediately following this entry will that existed previously will be indicate the session ID of the target reestablished and the devices will be that lost the connection There will be available for I O event log entries from the disk subsystem indicating
174. tialize 0 disable 1 16 default enable this many VFs Enable or disable MSI X Enable or disable vxlan_offload P009803 01A Rev A 2 Configuration n 23 gt G EMULEX FC and FCoE Driver Configuration FC and FCoE Driver Configuration You can configure driver parameters using native ESXi tools the Emulex OneCommand Manager application for use in non lockdown mode only or the OneCommand Manager for VMware vCenter application for use in both lockdown and non lockdown modes This document describes how to configure parameters using native ESXi tools For a more comprehensive description of ESXi tools refer to VMware s public website If you have further questions contact a VMware technical support representative See the OneCommand Manager Application User Manual and the OneCommand Manager Command Line Interface User Manual for information about the OneCommand Manager application See the OneCommand Manager Application for VMware vCenter User Manual for information about the OneCommand Manager Application for VMware vCenter software plugin FC FCoE Driver Parameters Configuration Methods There are four ways to configure the driver parameters e Permanent global e Permanent per adapter global per adapter The OneCommand Manager application supports all four ways to configure driver parameters This is the preferred method of setting configuration parameters Refer to the OneCommand Manager Applica
175. tion User Manual or the OneCommand Manager for VMware vCenter User Manual for more information e Temporary e Temporary The native ESXi tools only support permanent configuration methods for the driver parameters The following section provides further information on permanent configuration methods Permanent FC FCoE Configuration Methods Using Native ESXi Tools Permanent configuration requires that the new values be saved in the ESXi environment These changes are considered permanent because they stay in effect across system reboots See FC FCoE Driver Configuration Parameters on page 26 for parameter names and values Parameter values are in both hexadecimal and decimal Note For ESXi systems the following steps must be executed from the Troubleshooting Administrative Shell environment If your configuration does not provide access to this shell refer to VMware s vSphere or VMware s vCenter server manual for enabling driver logging Alternatively refer to Emulex s CIM Provider Installation Guide for driver logging Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 2 Configuration DE 24 gt G EMULEX FC and FCoE Driver Configuration To make changes that impact all adapters in the system global changes 1 From the Troubleshooting Administrative Shell environment s terminal window use one of the following commands For ESXi 5 5 systems type esxcli system module parameters set
176. tive Mode Driver Troubleshooting Support Table 3 10 ESXi 5 5 Native Mode Driver Troubleshooting Support Continued Troubleshooting Items from Earlier ESXi 5 5 vmklinux ESXi 5 5 Native vmklinux Driver Driver Support Mode Driver using the proc VmkMgmtKeyVal Support Usage in ESXi 5 5 Interface Description interface esxcli plug in Native Mode Driver pci_read Read the 32 bit v v usr lib vmware vmkm register value from the gmt_keyval vmkmgmt_ke PCI space at the offset yval i set through the vmnic0 KeyValue emul unni gi ex k PciRead s pci_read file lt offset 0x1f0 gt usr lib vmware vmkm gmt_keyval vmkmgmt_ke yval i ymnic0 KeyValue emul ex k PciRead g pci_write Set the PCI space v v usr 1lib vmware vmkm offset for pci_write gmt_keyval vmkmgmt_ke yval i vmnic0 KeyValue emul ex k PciWrite s lt offset gt port_stat Read the counters for v Partially From vsish node port 0 and port 1 and implemented net pNics vmnicXx sta formats them with ts descriptions These Also available in a counters are custom esxcli plug in in clear on read the asynchronous driver esxcli elxnet stats get p lt pci dev name gt vlan_stat Get the driver specific y Not implemented Not relevant since the VLAN status Emulex Drivers Version 10 0 for VMware ESXi User Manual driver does not use VLAN filtering P009803 01A Rev A gt G EMULEX 3 Troubleshooting 155 ESXi 5 5
177. to Emulex technical support elx_mes2731 Cannot find fabric controller node DESCRIPTION Driver not able to find Fabric controller node in its data base DATA None ACTION None required elx_mes2732 Failed to issue INIT_VPI mailbox command DESCRIPTION The driver wanted to send a INIT_VPI mailbox command to initialize a VPort but failed to send the mailbox command due to state of the adapter DATA None ACTION None required elx_mes2745 Failed to allocate mbox for requesting FCF rediscover DESCRIPTION Driver is trying to rediscover FCF table but failed to allocate memory needed DATA None Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A o 3 Troubleshooting 125 DG EMULEX Troubleshooting the FC FCoE Driver ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes2746 Requesting for FCF rediscovery failed status lt value gt add_ status lt value gt DESCRIPTION DATA None ACTION None required elx_mes2747 Issue FCF scan read FCF mailbox command failed DESCRIPTION The driver wanted to send a read FCF record mailbox command to start fast FCF failover FCF scan but failed to send the mailbox command due to state of the adapter DATA None ACTION None required elx_mes2748 Failed to prepare for unregistering HBA s FCF record rc lt value gt DESCRIPTION Driver encountered an initialization error when preparing to r
178. upport website for further details For VMware ESXi 5 0 5 1 and 5 5 hosts you can manage adapters using the OneCommand Manager application on Windows or the OCM for VMware vCenter application but you must install and use the appropriate Emulex CIM Provider See the OneCommand Manager Application User Manual and OCM for VMware vCenter User Manual for instructions on installing the respective applications The installation requires that the CIM Provider be installed For more information on installing the CIM Provider see the appropriate CIM Provider Installation Guide Note Before installing the management application you must install the LPFC driver from the VMware website and then reboot the server Note Before installing the FC FCoE drivers and CIM Provider verify that the firmware version is correct If it is proceed with the installation If it is not update the firmware using the OneCommand Manager application from a Windows server or the OCM for VMware vCenter application and reboot the system before proceeding with the installation Uninstalling the FC FCoE Driver See the VMware Patch Download page for instructions Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 1 Installation 12 SG EMULEX Installing the NIC Driver Installing the NIC Driver This section provides installation information for the NIC driver Before using this product you need a working knowledge of NIC and network storage
179. wn Mailbox command lt mbxCommand gt Cmpl DESCRIPTION A unknown mailbox command completed DATA None ACTION This error could indicate a software driver firmware or hardware issue Report these errors to Emulex technical support elx_mes0324 Config port initialization error mbxCmd lt mbxCommand gt READ_NVPARM mbxStatus lt mbxStatus gt DESCRIPTION A read nvparams mailbox command failed during port configuration DATA None ACTION This error could indicate a software driver firmware or hardware issue Report these errors to Emulex technical support elx_mes0330 IOCB wake NOT set DESCRIPTION The completion handler associated with the IOCB was never called DATA 1 timeout 2 timeleft jiffies ACTION This error could indicate a software driver firmware or hardware issue If the issue persists report the error to Emulex technical support elx_mes0332 IOCB wait issue failed Data lt value gt DESCRIPTION Driver issued I O failed to complete in polling mode DATA 1 error value ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes0334 Unknown IOCB command DESCRIPTION Received an unknown IOCB command completion DATA 1 type 2 ulpCommand 3 ulpStatus 4 ulploTag 5 ulpContext ACTION This error could indicate a software driver or firmware issue If these issues persist report these errors to Emulex technical support elx_mes0335 Unknown
180. x_mes1814 Mbox lt u mb mbxCommand gt failed no vport DESCRIPTION The VPort field of this mailbox command was not completed DATA None ACTION None required elx_mes1815 Could not issue unreg_did default rpis DESCRIPTION Attempt to unregister RPI failed DATA None ACTION Software driver error If this issue persists report these errors to Emulex technical support elx_mes1818 VPort failed init mbxCmd lt mailbox command gt READ_SPARM mbxStatus lt mailbox status gt rc lt status gt DESCRIPTION A pending mailbox command issued to initialize port failed DATA 1 mbxCommand 2 mbxStatus 3 re ACTION Software driver error If this issue persists report these issues to Emulex technical support elx_mes1820 Unable to select SLI 3 Not supported by adapter DESCRIPTION The adapter is not capable of operating in a given mode DATA None ACTION This is an informational message SLI 3 mode is only available on some adapters Do not attempt to force an adapter to run in SLI mode 3 if that adapter does not support SLI 3 mode Adapters that do not support SLI 3 are configured to run in SLI 2 mode Nevertheless it is recommended to use the auto setting 0 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 3 Troubleshooting 106 DG EMULEX Troubleshooting the FC FCoE Driver elx_mes1821 Create VPORT failed Invalid WWN format DESCRIPTION The port could not be created due to an invali
181. ystems enter esxcli software vib list grep be2net This is a sample output esxcli software vib list grep be2net net be2net 4 0 227 1 10EM 369055 Emulex Community Supported 2011 05 31 To get information on the install NIC driver on ESXi 5 5 systems enter esxcli software vib list grep elxnet This is the sample output esxcli software vib list grep elxnet esxcli software vib list grep elxnet elxnet 10 0 575 9 10EM 550 0 0 1338210 Emulex VMware Certified 2013 09 24 Emulex Drivers Version 10 0 for VMware ESXi User Manual P009803 01A Rev A 1 Installation 18 SG EMULEX Installing the iSCSI Driver Installing the iSCSI Driver This section provides installation information for the Emulex iSCSI driver Before using this product you need a working knowledge of iSCSI and network storage devices Installing the iSCSI Driver and Management Software For ESXi 5 0 5 1 and 5 5 systems the Emulex iSCSI driver is available out of box A direct link to the iSCSI driver available for download from VMware is provided on the Downloads page on the Emulex website Note Before installing the OCM for VMware vCenter software plug in you must install the iSCSI driver from the VMware software website Note Before installing the driver and CIM Provider verify that the firmware version is correct If it is proceed with the installation If it is not you must update the firmware using the OCM for VMware vCenter software plug i

Emulex Drivers Version 10.0 for VMware ESXi User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents