Home

Mellanox Firmware Tools (MFT) User`s Manual

1. Added the following sections Section 1 1 Supported Operating Systems on page 8 Section 1 3 MFT Access to Hardware Devices on page 10 Section 1 2 Software Prerequisites on page 9 Section 1 4 MFT Installation on page 12 August 2005 0 10 First release Linux distribution only MFT version 0 5 0 6 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 1 Introduction The Mellanox Firmware Tools MFT package is a set of firmware management tools for a single InfiniBand node MFT can be used for Generating a standard or customized Mellanox firmware image Querying for firmware information Burning a firmware image to a single Mellanox device The following is a list of the available tools in the package together with a brief description of what each tool performs The tools apply to single Switch Systems or adapter cards but not to clusters Table 1 Mellanox Firmware Tools MFT Available Tools mixburn This tool provides the following functions e Generation of a standard or customized Mellanox firmware image for burning in bin binary or img format Burning an image to the Flash EEPROM attached to a Mellanox HCA or switch device Querying the firmware version loaded on an HCA board Displaying the VPD Vital Product Data of an HCA board flint This tool burns a firmware binary image or an expansion ROM image to the Flash device o
2. 3 To install the RPMs run 12 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 rpm i mstflint X X rpm rpm i mft X X Xvmware kernel version rpm 1 4 6 Uninstall MFT VMware ESX Server 3 5 Run rpm e mft rpm e mstflint 1 5 Reference Documents and Downloads To download firmware images and their release notes see http www mellanox com under Firmware downloads Mellanox OFED for Linux is a software stack that can be downloaded from http www mella nox com gt Products gt InfiniBand SW Drivers Mellanox WinOF for Windows is a software stack that can be downloaded from http www mellanox com gt Products gt InfiniBand SW Drivers e ibdiag tools run man ibdiagnet for details on a machine with OFED installed Mellanox Technologies 13 J Mellanox Technologies Confidential Rev 1 30 mlxburn FW Image Generator amp Burner 2 mlxburn FW Image Generator amp Burner 2 1 Overview mlxburn is a tool for firmware FW image generation and or for burning a firmware image to the Flash EEPROM attached to a Mellanox device Both functions or a single function of mlxburn can be activated by means of command line options see Section 2 3 mlxburn Synopsis It can also query for firmware attributes e g firmware version GUIDs etc and VPD info of adapter cards and switch systems mlxburn allows for cusomization of standard Mellano
3. Rom Info type PXE version 3 0 0 devid 25418 proto VPI Device ID 25418 Chip Revision A0 Description Node Portl Port2 Sys image GUIDs 0002c9000120d050 0002c9000120d051 0002c9000120d052 0002c9000120d053 ACS 02c90120d050 02c90120d051 Board ID VSD MT 04C0110002 VSD VSD PSID MT 04C0110002 3 2 3 4 Reading a Word from Flash To read one dword from Flash memory use the following command line flint d device rw addr where device is the device the dword is read from addr is the address of the word to read 32 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Example flint d dev mst mt23108 pci cr0 rw 0x20 3 2 3 5 Writing a Dword to Flash To write one dword to Flash memory use the following command line flint d device ww addr data where device is the device the dword is written to addr is the address of the word to write data is the value of the word Example flint d dev mst mt23108 pci conf01 ww 0x10008 0x5a445a44 3 2 3 6 Writing a dword to Flash Without Sector Erase To write one dword to Flash memory without sector erase use the following command line flint d device wwne addr data where device the device the dword is written to addr the address of the word to write data the value of the word Example flint d dev mst mt23108 pci cr0 wwne 0x10008 0x5a445a44 Note that the result may be dependent on the Flash type Usually
4. hh Prints an extended command help nofs Do not burn the firmware image in failsafe mode s ilent Print errors only Affected commands burn sim Simulates an EEPROM burn without actually writing the EEPROM Use this flag to compare the image currently on the EEPROM with the given image file Affected commands burn y es Non interactive mode Assume the answer to all questions is yes Affected commands All y Version information The commands of spark are b urn Burns the binary image to the EEPROM Parameters None Examples spark d dev mst mtusb 1 i image1 img burn spark d dev mst mtusb 1 guid 0x2c9000100d050 i image1 img b q uery Queries miscellaneous EEPROM and firmware characteristics Parameters None Example spark d dev mst mtusb 1 query v erify Verifies the entire EEPROM Parameters None Example spark d dev mst mtusb 1 v bb Burns the given image as is Burn Block No checks are performed on EEPROM or on the given image Also no fields e g BSN or GUIDs are read from the EEPROM Parameters None Example spark d dev mst mtusb 1 11magel img bb ri Reads the firmware image on the EEPROM and writes it to a file Mellanox Technologies 35 J Mellanox Technologies Confidential Rev 1 30 spark InfiniScale III Firmware Burning Tool Parameters filename to write the image to in img format Example spark d dev mst mtusb 1 ri file img rb Reads
5. 3 221 Buminga FW limage se bad thea a da a ee as 24 3 2 2 2 Querying the FW Image sinet oa PAE AE rE EA e 25 3 223 Verifying the FW Images i sinc cha gested senda deat sees asvass sud dd 26 3 2 2 4 Managing an Expansion ROM Image 00 runner eee eee 26 3 2 3 Additional Debug Production Commands 0 0 coc 27 3 2 3 1 Setting GUIDs and MACs 00 cette eens 27 3 2 3 2 Preparing a Binary Firmware Image for Pre assembly Burning 30 3 2 3 3 Setting th VSD oreraa hens ely Mele Oe As ee ieee RE ets 32 3 2 3 4 Reading a Word from Flash 0 ete 32 3 2 3 5 Writing a Dword to Flash 0 2 eee ene 33 3 2 3 6 Writing a dword to Flash Without Sector Erase eese 33 3 2 3 7 Erased Sectors doen telum dai dd te Mere 33 Chapter 4 spark InfiniScale III Firmware Burning Tool o ooooooooo o 34 4 1 Overview 34 4 2 spark 34 4 2 1 spark Synopsis onere bene er ied he eect AAA oe ete Pettey a pene s 34 Mellanox Technologies 3 Mellanox Technologies Confidential Rev 1 30 Appendix A PSID Assignment 37 A J PSID Field Structure qu 54ha t icr rip hd E HIS QURE IN OI doped 37 A 2 PSID Assignment and Integration Flow 0 0 rese rese era 37 Appendix A Flow Examples mlxburn 39 Appendix A Debug Utilities 41 AUI tease
6. 48437 For MT48436 InfiniScale IV based switch systems IB DDR 48438 For MT48436 InfiniScale IV based switch systems IB QDR 64102 64122 For MT64102 BridgeX based gateway systems 1016 For MT1016 PhyX devices 2 3 1 Additional mlxburn Options The following is a list of additional options Please see Chapter 3 flint Firmware Burner for the HCA options and Chapter 4 spark Switch Firmware Burning for the switch options Mellanox Technologies 17 Mellanox Technologies Confidential Rev 1 30 mlxburn FW Image Generator amp Burner For adapters bridges and InfiniScale IV switches byte mode use image ps skip is mac s guid s sysguid vsd qq For InfiniScale III switches guid sysguid ndesc bsn pe i2c se i2c is3_12c 2 4 Examples of mlxburn Usage 2 4 1 Host Channel Adapter Examples To update firmware on an MT25408 ConnectX adapter device with the configuration file ini auto detected enter mlxburn fw fw 25408 rel mlx dev dev mst mt25418 pci crO To generate a failsafe image file for the same adapter above without burning enter mlxburn fw fw 25408 rel mlx conf MHEH28 XTC Al ini wrimage fw 25418 bin To update firmware on the same adapter above with the configuration file ini explicitly speci fied enter mlxburn fw fw 25408 rel mlx dev dev mst mt25418 pci crO conf MHEH28 XTC Al ini 2 4 2 InfiniScale IV Switc
7. CORE Direct and FabricIT are trademarks of Mellanox Technologies Ltd All other marks and names mentioned herein may be trademarks of their respective companies 2 Mellanox Technologies Document Number 2329 Mellanox Technologies Confidential Rev 1 30 Table of Contents Table Of Contents o seek a wie ere es IRR Yer uER T Wis Tis eer E ews eva eid Revision HIStOEy castas a 088 ge S sie ie Wise p06 isla EA e RR TR COR E AN elie RI OS IIS I Chapter I Introduction osos ses opener hehehe teer yere ye uere pee aed ey 1 1 Supported Operating Systems 8 1 2 Software Prerequisites 9 1 21 OT Linux oer gins pais dae utra ag ba Ges oA ais bub PU EGO BM PI ae 5 elas Nees 9 1 2 2 On WandOWS 20 de x E hie he Bats GA GG Sd See ida BY e ev LIS 9 1 2 3 On VMware ESX SEVEN US GR d MERE 9 1 3 MFT Access to Hardware Devices 10 1 4 MFT Installation 12 1 4 1 Install MFT On Linux OS 12 1 42 Uninstal MET bmx jee se fe dates ea cis be dr ge eie A pes en e 12 1 4 3 Install MFT On Windows OS 0 00 cee een rer rr rr rr rr sa 12 1 4 4 Uninstall MFT Windows e e 0 0 eee cence tne e en en eee 12 1 4 5 Install MFT On VMware ESX Server 3 5 2 0 cc cc tence nee 12 1 4 6 Uninstall MFT VMware ESX Server 3 5 0 00
8. ConnectX2 rel mlx MHQH29B XTR_Al ini wrimage fw ConnectX2 rel bin striped image blank guids I Generating image I Image generation completed successfully 2 Burn the image to a flash using an external burner 3 Optional After assembly query the image on flash to verify there are no guids on the device gt flint d dev mst mt26428 pci cr0 q Image type ConnectX FW Version 2 8 0 Device ID 26428 Chip Revision BO Description Node Portl Port2 Sys image GUIDs fffftffffffffffft Iffffffftffftffff Ifftffftfftfifftfft LLEEELLELLELCCLLE ACs ffffffffffffffff ffffffffffffffff Board ID n a MT 0D80110009 VSD n a PSID MT 0D80110009 W GUIDs MACs values and their CRC are not set 4 Set the correct GUIDs Since the image is with blank GUIDs this operation takes less than 1 second gt flint d dev mst mt26428 pci cr0 guid 0x0002c9030abcdef0 mac 0x0002c9bcdefl sg 5 Query the image on flash to verify that the GUIDs are set correctly gt flint d dev mst mt26428 pci cr0 q Image type ConnectX FW Version 2 8 0 Device ID 26428 Chip Revision BO Description Node Portl Port2 Sys image GUIDs 0002c9030abcdef0 0002c9030abcdef1 0002c9030abcdef2 0002c9030abcdef3 MACs 0002c9bcdef1 0002c9bcdef2 Board ID n a MT 0D80110009 VSD n a PSID MT 0D80110009 Method 2 Pre burn an Image with Specific GUIDs MACs for Each Device In this method a base 1mage is generated with arbitrary default GUI
9. TOC se erede ee e ete edit Ea eoe p aeo a t kde e nt 41 LM Utility eiue sett ere ene RT de s UR De DIM 43 AGS omba2 c Uti ES soa se bs adt d recie Qd dp E A nd E perte d deo 43 Ad CD TEST sat eee o vacat le e puse Mp Ae HT f teat ve Pale RT KSR 45 Ac Met temp Utility eive d re ceo IA dee Eg s 46 Appendix A In Band Access to Multiple IB Subnets 48 Appendix A MTUSB 1 USB to I2C Adapter 51 MU iu PESE 51 A 2 Hardware Installation 24 ve sz soe s Noe Mew EOE ES A ORE ead Sind 52 AB Software Installation 255 acteurs iS 52 4 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Revision History Printed on January 13 2011 Table 1 Revision History Table Date Revision Description December 2010 1 30 Updated table in Section 2 MFT Software Dependencies on Linux Removed sw sys entries from the document Added device 25438 for MT26438 ConnectX 2 VPI w Virtualization e Added Section 3 2 3 2 Preparing a Binary Firmware Image for Pre assem bly Burning on page 30 e Added section On 4th Generation Devices on page 29 Updated sections Install MFT On Linux OS on page 12 and Uninstall MFT Linux on page 12 Removed section isw Utility e Added Preparing a Binary Firmware Image for Pre assembly Burning on page 30 Added the striped_image flag in sections mlxburn Synopsis on page 15 and Switch Descriptions on page 21 October 2009 1 20 e Added s
10. confX gt where X is the index of the adapter on the machine _crX devices access the adapter directly recommended if possible confX devices use configuration cycles to access the adapter For example mt25418 pci cr0 Via USB to I2C adapter For example mtusb 1 Via In Band lt string gt lid lt lid_number gt For example CA MT25418 sw005_HCA 1_lid 0x000c or simply lid 12 The mst ib add command adds devices in the format for adapters and bridges CA device id gt ib node description lid lt lid number for switches SW device id gt lid lid number See Step 3 in Appendix B Flow Examples mlxburn on page 38 for instructions on how to obtain the device LID Note See Appendix D In Band Access to Multiple IB Subnets on page 52 for details on how to access devices in multiple IB subnets Via PCI user level lt bus dev fn gt Note The mst device name obtained in this method can only be used with the m xburn tool with the ul flag For example if you run spci d 1553 Mellanox devices and PCI Device IDs will be displayed 1 Visit http www xdimax com to download this driver Mellanox Technologies 11 Mellanox Technologies Confidential Rev 1 30 Introduction gt sbin Ispci d 15b3 02 00 0 Ethernet controller Mellanox Technologies Unknown device 6368 rev a0 1 4 MFT Installation 1 4 1 Install MFT On Linux OS From MFT version 2 6 2 MFT
11. installation method on Linux OS is RPM based MFT applications are installed using a pre compiled binary RPM and Kernel modules are distributed as a source RPM and compiled by the installation script To install MFT perform the following 1 Download the Linux MFT package from the Mellanox Management Tools webpage http www mellanox com products management tools php Untar the downloaded package 3 Run install sh Start the mst driver by running mst start Note It 1s possible to customize some installation parameters such as the target installation path Run install sh help for details 1 4 2 Uninstall MFT Linux To uninstall MFT Linux run rpm e mft kernel mft 1 4 3 Install MFT On Windows OS Download the Windows MFT MSI from BHhttp www mellanox com products management tools php Double click the MSI and follow the instructions for installation 1 4 4 Uninstall MFT Windows To uninstall MFT perform one of the following 1 Activate the Add or Remove Programs utility of Windows and click the Remove button of the MFT tool entry 2 Click start gt Programs gt Mellanox gt WinMFT gt uninstall 1 4 5 Install MFT On VMware ESX Server 3 5 1 Download the mstflint for VMware ESX Server 3 5 RPM from the Mellanox Management Tools webpage http www mellanox com products management tools php 2 Download the MFT for VMware ESX Server 3 5 RPM from the Mellanox Management Tools webpage
12. is the iRISC for which traces are to be printed This can be specified once any where in the command line as a special option without the leading hyphen Run itrace h to get a list of iRISC names for each adapter device options can specify any of the following h help Displays help about itrace usage Mellanox Technologies 41 Mellanox Technologies Confidential Rev 1 30 spark InfiniScale III Firmware Burning Tool m mask TRACE MASK Sets the Trace Mask To enable generating trace messages for an iRISC the trace mask register must be set according to the specifications in the device s Programmer s Reference Manual Setting or clearing bits of the trace mask register enables or disables respectively the generation of specific types of trace messages The TRACE MASK parameter must be a hexadecimal or decimal number and its value will be written into the trace mask register Changing trace mask will not change or remove messages previously stored in the trace buffer so disabled types of messages can still be displayed by itrace 1f they were previously generated Example Note For Linux device names should be listed with the dev mst prefix For Windows no prefix is required pr trace d dev mst mt25204 pci_cr0 nomap m Oxffffffff tpt This generates output regarding the seque
13. no to all questions Affected commands all vsd lt vendor specific data gt A VSD string composed of up to 208 characters will be written to the VSD section in the flash If not specified the current VSD will be preserved use image ps Burn vsd as it appears in the given image Default Retain current vsd on Flash Affected commands burn use image guids Burn guids uids macs as appears in the given image Affected commands burn use image rom Do not save the ROM which exists in the device Affected commands burn dual image Make the burn process burn two images on flash previously default algo rithm Current default failsafe burn process burns a single image in alternating locations Affected commands burn banks lt banks gt Set the number of attached Flash devices banks log log file gt Print the burning status to the specified log file v Print version information 3 2 2 Command Descriptions The flint utility commands are b urn burn flash e rase erase sector q uery query for misc Flash firmware characteristics rw read one dword from flash v erify verify entire flash ww write one dword to flash bb burn Block Burns the given image as is No checks are done Mellanox Technologies 23 J Mellanox Technologies Confidential Rev 1 30 flint Firmware Burning Tools sg nocrc set GUIDs SV Set the VSD wwne write one dword to flash without se
14. specific GUID for example 0x00000006660abcd0 or LID the following are the recommended steps to update the device firmware Note For Linux device names should be listed with the dev mst prefix For Windows no prefix is required 1 Make sure all subnet ports are in the active state One way to check this is to run opensm the Subnet Manager root mymach gt etc init d opensmd start opensm start OK 2 Make sure the local ports are active by running ibv_devinfo 3 Obtain the device LID There are two ways to do that I Using the mst ib add command The mst ib add runs the ibdiagnet ibnetdiscover tool to discover the InfiniBand fabric and then lists the discovered IB nodes as an mst device These devices can be used for access by other MFT tools root mymach gt mst ib add I Discovering the fabric Running opt bin ibdiagnet skip all I Added 3 in band devices root mymach gt To list the discovered mst inband devices run mst status root mymach gt mst status MST modules MST PCI module loaded MST PCI configuration module loaded Inband devices dev mst CA MT25418 sw005 HCA 1 lid 0x0001 dev mst SW MT47396 lid 0x0011 dev mst SW MT48438 lid 0x0003 root mymach gt II Using the ibnetdiscover tool Run root mymach ibnetdiscover grep 00000006660abcd0 grep w Switch Switch 24 S 00000006660abcd0 MT47396 Infiniscale III Mellanox Technologies base port 0 li
15. 0d060 0 0 0002c9000100d060 b To generate an MT48436 image and perform an In Band update of the device with LID 0x18 enter mlxburn fw fw IS4 mlx dev lid 0x18 2 4 3 BridgeX Gateway Examples To update firmware on BridgeX device with the configuration file ini auto detected enter mlxburn d dev mst mt64102 pci crl fw fw BridgeX rel mlx To generate a failsafe image file for the same BridgeX above without burning enter mlxburn fw fw BridgeX rel mlx conf MTB4020 PCO Al ini wrimage fw BridgeX bin To update firmware on the same BridgeX above with the configuration file ini explicitly spec ified enter mlxburn fw fw BridgeX rel mlx dev dev mst mt64102 pci crl conf MTB4020 PCO AI ini To burn a firmware binary file for a BridgeX device enter mlxburn image fw BridgeX bin dev dev mst mt64102 pci crl 2 4 4 InfiniScale Ill Switch Examples To update firmware on an MT47396 InfiniScale III device enter mlxburn fw IS3FW BIN dev dev mst mtusb 1 Note This firmware update cannot be performed before initializing the MST device mtusb 1 to connect to the I2C compatible bus of the InfiniScale III and its EEPROM To generate an image for the InfiniScale III switch device enter mlxburn fw IS3FW BIN conf MTS2400 A00 INI wrimage IS3FW img Note The generated firmware image to be burnt to a switch device must have a img file name extension To update firmware on an MT43132 I
16. 27 Mellanox Technologies Confidential Rev 1 30 flint Firmware Burning Tools I Generating image I Image generation completed successfully 2 Query the image to verify that the GUIDs and MACS are blank flint i tmp fw 25408 rel 2 3 000 MHGH28 XTC Al noguids bin q Image type ConnectX FW Version 233 20 Device ID 25418 Chip Revision AO Description Node Portl Port2 Sys image GUIDs ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff ACs fffffffIfffftfffft ffftfffftftffftff Board ID n a MT 04A0110002 VSD n a PSID MT 04A0110002 Warning GUIDs MACs values and their CRC are not set gt 3 Bum the blank GUIDs image This image can be pre burnt on the flash in an early production phase In this example the flint bb command is used in order to burn the image as is gt flint d dev mst mt25418 pci cr0 i tmp fw 25408 rel 2 3 000 MHGH28 XTC Al nogu ids bin bb Block burn The given image will be burnt as is No fields such as GUIDS VSD are taken from current image on flash Burn process will not be failsafe No checks will be performed ALL flash including the Invariant Sector will be overwritten If this process fails computer may remain in an inoperable state Do you want to continue y n n y 100 4 Set the GUIDs and MACs using the flint sg command gt flint d dev mst mt25418 pci cr0 guid 0x0002c90001777050 mac 0x0002c9777051 sg 5 Qu
17. 5418 pci cr0 rrom example rom flint d dev mst mt25418 pci cr0 q Image type ConnectX FW Version 2 6 1410 Rom Info type GPXE version 2 0 100 devid 25418 proto IB Device ID 25418 Chip Revision AO Description Node Portl Port2 Sys image GUIDs 0002c9000100d050 0002c9000100d051 0002c9000100d052 0002c9000100d050 MACs 0002c9000001 0002c9000002 Board ID MT 04C0110002 VSD PSID MT 04C0110002 3 To remove the Expansion ROM use the following command flint d lt mst device gt drom Example flint d dev mst mt25418 pci cr0 drom Removing ROM image OK Restoring signature OK 3 2 3 Additional Debug Production Commands 3 2 3 4 Setting GUIDs and MACs To set GUIDs MACs UIDs for the given device use the sg set guids command with the guid s uid s and or mac s flags On pre ConnectX Devices Note On pre ConnectX devices the sg command is applicable only for images with blank Oxff GUID values and a blank CRC In other words the firmware image was generated using the blank_guids flag The following is an example of a complete flow where a blank GUIDs image is first generated and burnt to the Flash Then the GUIDs are set using the sg command 1 Generate the image with blank guids gt mlxburn fw fw 25408 rel mlx c MHGH28 XTC Al ini wrimage tmp fw 25408 rel 2 3 000 MHGH28 XTC Al noguids bin striped image blank guids Mellanox Technologies
18. Ds and then updated with the correct guids for each device Example Flow 1 Generate the base image with arbitrary default GUIDs gt mlxburn fw fw ConnectX2 rel mlx c MHOH29B XTR Al ini wrimage fw ConnectX2 rel bin striped image Mellanox Technologies 31 Mellanox Technologies Confidential Rev 1 30 flint Firmware Burning Tools 2 Per device set the device specific GUIDs in the image gt flint i fw ConnectX2 rel bin guid 0x0002c9030abcdef0 mac 0x0002c9bcdefl striped image sg 3 Optional Query the image to verify the GUIDs are set The striped image flag must be specified when querying a striped image gt flint i fw ConnectX2 rel bin striped image q Image type ConnectX FW Version 2 8 0 Device ID 26428 Chip Revision BO Description Node Portl Port2 Sys image GUIDs 0002c9030abcdef0 0002c9030abcdef1 0002c9030abcdef2 0002c9030abcdef3 ACs 0002c9bcdef1 0002c9bcdef2 Board ID n a MT 0D80110009 VSD n a PSID MT 0D80110009 Now the fw ConnectX2 rel bin image can be pre burned to the flash After the assembly the device would be fully functional 3 2 3 3 Setting the VSD To set the vsd for the given image device 4th generation use the sv command with vsd flag Example gt flint d dev mst mt25418 pci cr0 vsd VSD sv Setting the VSD OK Restoring signature OK gt flint d dev mst mt25418 pci cr0 q Image type ConnectX FW Version 2 7 9450
19. MAC addresses must be specified here one for each ConnectX EN port The first MAC address is assigned to Port 1 and the second MAC address to Port 2 Affected commands burn sg BridgeX only Derive and set the device UIDs GUIDs MACs WWNs UIDs are derived from the given base UID as per Mellanox s methodol ogy Affected commands burn sg BridgeX only 29 space separated UIDs must be specified here in the fol lowing order G0 MAC PIO GO MAC PI1 G0 MAC PD G0 MAC PEO0 G0 MAC PEl G0 MAC PE2 G0 MAC PE3 GO FC WWPN PO0 G0 FC WWPN P1 GO FC WWPN P2 G0 FC WWPN P3 G0 IB NODE GUID G0 IB PORT GUID G0 FC WWNN Gl MAC PIO G1 MAC PIl GI MAC PD GI MAC PEO0 Gl1 MAC PEl GI MAC PE2 G1 MAC PE3 GI FC WWPN PO Gl FC WWPN P1 GI FC WWPN P2 GI FC WWPN P3 GI IB NODE GUID G1 IB PORT GUID GI FC WWNN IB SYSTEM GUID Affected commands burn sg Burn the image with blank GUIDs and MACSs where applicable These values can be set later using the sg command see details below NOTE An image that is burnt with blank GUIDs MACS will fail to boot the machine as long as the GUIDs MACS are not set Affected commands burn Force the clearing of the Flash semaphore on the device This flag should come BEFORE the d evice flag in the command line No command is allowed when this flag is used NOTE Using this flag may result in an unstable behavior and flash image corruption 1f the device or another flash application is currently usi
20. Mellanox TECHNOLOGIES Mellanox Firmware Tools MFT User s Manual Rev 1 30 www mellanox com Mellanox Technologies Confidential Rev 1 30 NOTE THIS INFORMATION IS PROVIDED BY MELLANOX FOR INFORMATIONAL PURPOSES ONLY AND ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIM ITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIA BLE FOR ANY DIRECT INDIRECT INCIDENTAL SPECIAL EXEMPLARY OR CONSE QUENTIAL DAMAGES INCLUDING BUT NOT LIMITED TO PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY OUT OF THE USE OF THIS HARDWARE EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE Mellanox TECHNOLOGIES Mellanox Technologies Mellanox Technologies Ltd 350 Oakmead Parkway PO Box 586 Hermon Building Sunnyvale CA 94085 Yokneam 20692 U S A Israel www mellanox com Tel 972 4 909 7200 Tel 408 970 3400 Fax 972 4 959 3245 Fax 408 970 3403 Copyright 2011 Mellanox Technologies Inc All Rights Reserved Mellanox BridgeX ConnectX InfiniBlast InfiniBridge InfiniHost InfiniRISC InfiniScale InfiniPCI PhyX amp and Virtual Protocol Interconnect are registered trademarks of Mellanox Technologies Ltd
21. SD PSID ConnectX 2 7 9450 type PXE version 3 0 0 devid 25418 proto VPI 25418 AO Node Portl Port2 Sys image 0002c9000abcdef0 0002c9000abcdef1 0002c9000abcdef2 0002c9000abcdef3 02c90abcdef0 02c90abcdef1 VSD MT 04C0110002 VSD MT 04C0110002 3 2 3 2 Preparing a Binary Firmware Image for Pre assembly Burning In some cases OEMs may prefer to pre burn the flash before it is assembled on board To generate an image for pre burning for 4th generation devices ConnectX and newer use the mlxburn striped image flag The striped image file layout is identical to the image layout on the flash hence making it suitable for burning verbatim When pre burning the GUIDs MACS inside the image should be unique per device The following are two methods to pre burn an image You can choose the best method suitable for your needs Method 1 Pre burn an Image with Blank GUIDs MACs In this method the image is generated with blank GUIDs and CRCs The GUIDs are set after the device is assembled using the flint sg command To set GUIDs take less than 1 second when run ning on an image with blank GUIDs through a PCI device Note A device that is burnt with blank GUIDs MACS will not boot as a functional network device as long as the GUIDs MACS are not set Flow Example 1 Generate a striped image with blank guids 30 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 gt mlxburn fw fw
22. a block of data from a single eeprom to the given file Parameters eeprom address gt start offset data size output file name gt Example spark d dev mst mtusb 1 rb 0x56 0x0 0x1000 out img swreset SW resets the target switch device In response to this command the tar get switch device continues to transport packets to their destinations ignores management packets that are destined to the target switch device itself resets itself after about 15 seconds from receiving the command The 15 second delay is intended to allow for spark to reset other switches in the fabric Example spark d 0x13 swreset this command SW resets the switch device with LID 0x13 36 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Appendix A PSID Assignment In some cases OEMs or board manufacturers may wish to use a specific FW configuration not supplied by Mellanox After setting the new FW parameters in an INI file the user should assign a unique PSID Parameter Set ID to this new configuration The PSID is kept as part of the FW image on the device NVMEM The firmware burning tools use this field to retain FW settings while updating FW versions This appendix explains how to assign a new PSID for a user customized FW and how to indicate to the burning tools that a new PSID exists Note Please change FW parameters with caution A faulty setting of FW parameters may result in undefined behavior of th
23. age GUIDs respectively If only one GUID is provided guid flag it will be assigned as node GUID Its values 1 2 and 3 will be assigned as Port 1 Port 2 and system image GUID respectively If no guid guids flag is provided the current GUIDs will be preserved on the device Note For InfiniScale IV four GUIDs must be specified but Ports 1 and 2 GUIDs are ignored and should be set to 0 24 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Note A GUID is a 16 digit hexadecimal number If less than 16 digits are provided leading zeros will be inserted MAC s optional for Ethernet adapters only One or two MACs If 2 MACS are provided macs flag they will be assigned to Port 1 and Port 2 respectively If only one MAC is provided mac flag it will be assigned to Port 1 MAC 1 will be assigned to Port 2 If no mac macs flag is provided the current LIDs will be preserved on the device Note A MAC is a 12 digit hexadecimal number If less than 12 digits are provided leading zeros will be inserted Examples 1 Update the FW on the device keeping the current GUIDs and VSD Note This is the com mon way to use flint gt flint d dev mst mt25418 pci cr0 i fw 25408 2 1 000 MHGH28 XSC Al bin burn 2 Update the FW on the device specifying the GUIDs to burn gt flint d dev mst mt25418 pci cr0 i 25408 2 1 000 MHGH28 XSC Al bin guid 12345678deadbeef burn 3 Update the FW on
24. bitwise and between the speci fied word and the previous Flash contents will be written to the specified address 3 2 3 7 Erasing a Sector To erase a sector that contains a specified address use the following command line flint d device e addr where device is the device the sector is erased from and addr is the address of a word in the sector that you want to erase Example flint d dev mst mtusb 1 e 0x1000 Mellanox Technologies 33 J Mellanox Technologies Confidential Rev 1 30 spark InfiniScale III Firmware Burning Tool 4 spark InfiniScale Ill Firmware Burning Tool 4 1 Overview The spark tool enables burning a binary firmware image to the EEPROM device attached to an InfiniScale MT43132 or InfiniScale III MT47396 switch device via a direct I2C connection or via vendor specific MADs over the InfiniBand fabric This tool is described in Section 4 2 4 2 spark 4 2 1 spark Synopsis spark switches lt command gt parameters where switches are d evice device defines the Mellanox device to which the EEPROM is connected Affected commands All see the commands below i mage image Image file is in img format Affected commands burn verify query guid lt GUID gt Uses the given guid as the node guid of the burnt image By default the guid is taken from the image on the EEPROM Affected commands burn sysguid lt GUID gt Use the given guid as the system ima
25. ce It is not required for MFT software installation 2 WinOF is required only for In Band access The package can be downloaded from www mellanox com gt Products gt InfiniBand SW Drivers 1 2 3 On VMware ESX Server 3 5 Table 4 MFT Software Dependencies on VMware ESX Server 3 5 Software Package Required Version OFED s mstflint RPM OFED 1 1 or later 1 OFED s mstflint RPM can be downloaded from http www mellanox com products management_tools php Mellanox Technologies 9 J Mellanox Technologies Confidential Rev 1 30 Introduction 1 3 MFT Access to Hardware Devices Table 5 lists the Mellanox devices supported by MFT the supporting tools and the access methods to these devices Table 5 Supported Mellanox Devices HW Access Method Device Type Product Name Supporting Tools PCI DC vx Band HCA InfiniBand MT23108 InfiniHost mlxburn flint MT25208 InfiniHost III Ex MT25204 InfiniHost III V V Lx VPI Network Adapter MT25408 ConnectX mlxburn flint V V V MT25408 ConnectX 2 Ethernet Adapter NIC MT25408 ConnectX EN mlxburn flint V V MT25408 ConnectX 2 EN Switch MT48436 InfiniScale IV mlxburn flint vi V V MT47396 InfiniScale III mlxburn spark V V MT43132 InfiniScale mlxburn spark Bridge MT64102 BridgeX mlxburn flint y Page V V 10 1 For managed switch products only MFT tools access Mellanox de
26. cece tenn eee 13 1 5 Reference Documents and Downloads 13 Chapter 2 mlxburn FW Image Generator amp Burner ooo oooooooooommomomo 14 2 1 Overview 14 2 2 Firmware Generation and Burning with mlxbum 14 2 2 1 Firmware Customization fee bis BG kl cece s 15 2 3 mlxbum Synopsis 15 2 3 1 Additional mlxburn Options 0 ee cette eens 17 2 4 Examples of mlxburn Usage 18 2 4 1 Host Channel Adapter Examples ss ss asss scales als sale bald ved eek ee 18 2 4 2 InfiniScale IV Switch Examples sseoseeeeeeeerererrrrrr reser rr rr rr rr rer rr re es 18 2 4 3 BridgeX Gateway Examples 0 cece cece eee een tent eee 19 2 4 InfiniScale III Switch Examples 0 0 0 0 cece ect A 19 2 5 Exit Return Values 20 Chapter 3 flint Firmware Burning Tools oooooooooooomormomooPromsos 21 3 1 Overview 21 32 flint Synopsis 21 3 21 Switch Descriptions ss s vies xe rero e dee dae daw was x ed 21 3 2 2 Command Descriptions sss eseri eia iee a a eee eee ar kia 23
27. ctor erase wbne write a data block to flash without sector erase rb read a data block from flash ri read the fw image on the flash de dump Configuration print fw configuration file for the given image swreset SW reset the target InfniScale IV device This command is supported only in the In Band access method and applicable only on an un managed switch brom lt ROM file gt burn the specified ROM file to the Flash device rrom lt out file gt read the ROM section from the Flash device drom remove the ROM section from the Flash device The following sections provide the command line syntax for the following flint utility commands together with examples of usage Section 3 2 2 1 Burning a FW Image on page 24 Section 3 2 22 Querying the FW Image on page 25 Section 3 2 2 3 Venfying the FW Image on page 26 3 2 2 1 Burning a FW Image The FLINT utility enables you to burn the Flash from a binary image To burn the entire Flash from a raw binary image use the following command line flint d device i lt fw file gt guid lt GUID gt guids 4 GUIDS gt mac MAC macs 2 MACs gt burn where device Device on which the flash is burned fw file Binary firmware file GUID s optional for InfiniBand adapters and InfiniScale IV switches One or four GUIDs If 4 GUIDS are provided guids flag they will be assigned as node Port 1 Port 2 and system im
28. d VMware ESX Server 3 5 Please refer to the release notes of your version for supported platforms and kernels Note Unless explicitly specified the usage of the tools is identical for all operating systems 8 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 1 2 Software Prerequisites 1 2 1 On Linux Table 2 MFT Software Dependencies on Linux Software Package Required Version Kernel sources Machine s kernel version OFED MLNX OFED 2 1 1 or later Perl 5 6 or later zlib 1 1 4 or later 1 OFED can be downloaded from http www openfabrics org Note that install ing OFED is not required if you wish to install MFT without In Band capabili ties 2 For the mst ib add command to run one of the OFED packages ibutils or ibutils2 or infiniband diags should be installed and available in the PATH For details on OFED installation see the link in Section 1 5 Reference Doc uments and Downloads on page 13 1 2 2 On Windows Table 3 MFT Software Dependencies on Windows Software Package Required Version 12CBridge Dimax s Driver for USB to I2C Adapter 0 1 4 or later WinOF optional 2 0 0 or later NOTE The tools package must also be installed as part of the WinOF installa tion 1 Visit http www diolan com to download this driver This driver is required for the first use of the MTUSB 1 devi
29. d 17 Imc 0 Mellanox Technologies 39 J Mellanox Technologies Confidential Rev 1 30 spark InfiniScale III Firmware Burning Tool Note The resulting LID is given as a decimal number 1 Run mixburn with the LID retrieved in step 3 above to perform the In Band burning opera tion Burn the InfiniScale III switch root mymach gt mlxburn dev dev mst SW MT47396 lid 0x0011 fw IS3FW BIN I Reading PSID from board I Using auto detected configuration file MT34000LE A00 INI PSID MT 0070000001 I Generating image Checking primary image OK Current FW Version 1 0 0 New FW Version 1 0 0 Burning secondary image OK Verifying secondary image OK Burning primary image OK Verifying primary image OK I Image burn completed successfully Burn the InfiniScale IV switch root mymach gt mlxburn d dev mst SW MT48438 lid 0x0003 fw fw IS4 mlx qq I Querying device I Using auto detected configuration file MTS3600Q 1UNC Al ini PSID MT 0C20110003 I Generating image WARNING Running quick query Skipping full image integrity checks Current FW version on flash 7 0 135 New FW version 150 138 Burning second FW image without signatures OK Restoring second signature OK I Image burn completed successfully 40 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Appendix C Debug Utilities C 1 itrace Utility C 1 1 Overview The itrace u
30. d prints the reading in Celsius degrees C 5 1 Operation The MST driver must be started prior to running mget temp To start mget temp Start the MST driver mst start or mst restart Run mget temp with the following command line syntax mget temp OPTIONS where OPTIONS are h Print this message d lt dev gt mst device name i activate and initiate thermal diodes for temperature measurement intru sive 46 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 On some systems the thermal sensors are not activated by default To initiate the thermal sensors run mget temp i once after device power up Then wait for at least half a second before running mget temp for reading the temperature Examples The following steps show how to initialize and then read temperature sensors l Initiate thermal sensors mget temp d dev mst SW MT48438 lid 0x000F i 2 Wait half a second and then read the temperature by running mget temp d dev mst SW MT48438 lid 0x000F Mellanox Technologies 47 Mellanox Technologies Confidential Rev 1 30 spark InfiniScale III Firmware Burning Tool Appendix D In Band Access to Multiple IB Subnets In most cases an adapter is connected to a single InfiniBand subnet The LIDs Infiniband Local IDs on this subnet are unique In this state the device access MADs are sent to the target LID from the first active port on the first adapter on the mac
31. e 0 3m E 1 2 System Requirements The MTUSB 1 is a USB device which may be connected to any Personal Computer with a USB Host Adapter USB Standard 1 1 or later and having at least one USB connection port E 1 3 Supported Platforms MTUSB 1 supports the same platforms that are supported by the MFT tools package Mellanox Technologies 51 Mellanox Technologies Confidential Rev 1 30 spark InfiniScale Ill Firmware Burning Tool E 2 Hardware Installation To install the MTUSB 1 hardware please execute the following steps in the exact order 1 Connect one end of the USB cable to the MTUSB 1 and the other end to the PC 2 Connect one end of the I2C cable to the MTUSB 1 and the other end to the system board you wish to control via the I2C interface If the system board uses a 3 pin connector instead of a 9 pin connector connect the appropriate converter cable as an extension to the I2C cable on the 9 pin end then connect its 3 pin end to the system board E 3 Software Installation The MTUSB 1 device requires that the Mellanox Firmware Tools MFT package be installed on the machine to which MTUSB 1 is connected see Section 1 4 MFT Installation on page 12 of this manual for installation instructions For a Windows machine it is also required to install the MTUSB 1 driver visit http www dio lan com to download this driver This driver is required for the first use of the MTUSB 1 device Once you hav
32. e burnt device A 1 PSID Field Structure The PSID field is a 16 ascii byte character string If the assigned PSID length is less then 16 characters the remaining characters are filled with binary Os by the burning tool Table 6 provides the format of a PSID Table 6 PSID format Vendor symbol Board Type Symbol Board Version Symbol Parameter Set Number Reserved 3 characters 3 characters 3 characters 4 characters 3 characters filled with 0 Example A PSID for Mellanox s MHXL CF128 T HCA board is MT 0030000001 where MT Mellanox vendor symbol 003 MHXL CF128 T board symbol 000 Board version symbol 0001 Parameter Set Number A 2 PSID Assignment and Integration Flow To assign and integrate the new PSID to produce the new FW 1 Write the new FW configuration file in INI format 2 Assign it with a PSID in the format described above Use your own vendor symbol to assure PSID uniqueness If you do not know your vendor symbol please contact your local Mellanox FAE Mellanox Technologies 37 Mellanox Technologies Confidential Rev 1 30 spark InfiniScale Ill Firmware Burning Tool 3 Setthe PSID parameter in the new FW configuration file 38 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Appendix B Flow Examples mlxburn To update an MT47396 InfiniScale amp III and MT48436 InfiniScale IV switch devices having a
33. e the requirements installed you may verify that your MTUSB 1 device is detected by MFT software as described below 1 Start the mst driver Enter mst start or mst restart if mst start was run earlier 2 To obtain the list of mst devices enter mst status If MTUSB 1 has been correctly installed mst status should include the following device in the device list it generates On Linux dev mst mtusb 1 On Windows mtusb 1 52 Mellanox Technologies Mellanox Technologies Confidential
34. ery the image on the Flash to verify that the GUIDs and MACS were set correctly gt flint d dev mst mt25418 pci cr0 q Image type ConnectX FW Version 2 3 0 Device ID 25418 Chip Revision AO Description Node Portl Port2 Sys image GUIDs 0002c90001777050 0002c90001777051 0002c90001777052 0002c90001777053 MACs 0002c9777051 0002c9777052 28 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Board ID n a MT 04A0110002 VSD n a PSID MT 04A0110002 On 4th Generation Devices On 4th generation devices the sg command can operate on both the image file and the image on the flash When running the sg command on an image on the flash if the GUIDs MACs UIDs in the image are non blank the flint will re burn the current image using the given GUIDs MACs UIDs 1 Change the GUIDs MACS on a device gt flint d dev mst mt25418 pci cr0 qq q W Running quick query Skipping full image integrity checks Image type ConnectX FW Version 2 7 9450 Rom Info type PXE version 3 0 0 devid 25418 proto VPI Device ID 25418 Chip Revision AO Description Node Portl Port2 Sys image GUIDs 0002c9000120d050 0002c9000120d051 0002c9000120d052 0002c9000120d053 ACs 02c90120d050 02c90120d051 Board ID VSD MT 04C0110002 VSD VSD PSID MT 04C0110002 gt flint d dev mst mt25418 pci cr0 guid 0002c9000abcdef0 mac 02c90abcdef0 sg W GUIDs are already set re burining image with
35. fa Mellanox network adapter bridge switch device It includes query functions to the burnt firmware image and to the binary image file spark This tool burns a firmware binary image to the EEPROM s attached to an InfiniScalelII switch device It includes query functions to the burnt firmware image and to the binary image file The tool accesses the EEPROM and or switch device via an I2C compatible interface or via vendor specific MADs over the InfiniBand fabric In Band tool Debug utilities A set of debug utilities e g itrace mstdump mlxi2c and i2c Mellanox Technologies 7 Mellanox Technologies Confidential Rev 1 30 Introduction Figure 1 Mellanox Firmware Tools A Scheme of Operation Nellanox USB rs ee LLLLEEEL TO FC Adapter i x H b i q C Mel lanox Infini Scale III Mellanoxinfini Scale IV z i Based Switch S ystem i Based Switch System Es Pc gt Fc LI LJ LJ su A A R em i i I a mmmumirir ud 4 H l z ri H Li Mellanox IB Adap ter f I SY belle co imp ele epele A A sl IT BEES ra A i i i H InfiniBand 3 Fabric 01 i iia Edd om Nde In Band capabilities are not supported by MellanoxEthemetA dapters 1 4 Supported Operating Systems MFT distributions are available for the following operating systems Linux Windows an
36. file for a Mellanox InfiniScale III switch device the produced image file name must end with a img extension 2 2 4 Firmware Customization A Mellanox firmware image can be customized usually to fit a specific board type The custom ization is done by using a FW parameter set file in the image generation stage This file has a ini format Each parameter set file has a unique parameter set ID PSID which is kept in the device Flash EEPROM and allows retaining device configuration during future FW updates During a device FW update mlxburn reads the PSID from the device and uses the corresponding ini file when generating the FW image mlxburn searches for the files in the same directory of the FW release When mlxburn is used to generate an image file or when no corresponding parame ter set file is found the user should explicitly specify which parameter set file to use To produce an image file the user needs to provide the option wrimage lt target file gt To actually burn the image to the Flash EEPROM attached to a Mellanox adapter or switch device the user needs to specify the option dev mst device gt see the synopsis section below If run in burning mode mlxburn auto detects the firmware parameter set with which the device was previously burnt It locates and uses this parameter set file to generate the appropriate image for the device by merging the FW release with the specific parameter set required To inh
37. ge guid of the burnt image By default this value is taken from the current image on the EEPROM Affected commands burn bsn lt BSN gt Mellanox Board Serial Number BSN The vallid BSN format is MTxxxxx R xx ddmmyy nnn cc By default this value is taken from the current image on the EEPROM Affected commands burn ndesc Descr Use the given string max 64 characters as the node description By default this value is taken from the current image on the EEPROM Affected commands burn isl Indicate that the target EEPROM to be burnt is for an InfiniScale MT43132 device If this option is not specified the target EEPROM is for an InfiniScale III MT47396 device Not supported for In band access Affected commands burn is3 12c lt i2c_addr gt Provides the I2C address of the switch device If this flag is not specified then the the default address for Mellanox switch devices is Ox6c pe i2c lt i2c_addr gt Provides the I2C address of the primary EEPROM By default this address is read from the Mellanox switch device Use this flag only if the switch device is not accessible 34 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 se 12c lt i2c_addr gt Provides the I2C address of the secondary EEPROM By default this address is read from the Mellanox switch device Use this flag only if the switch device is not accessible h elp Prints this help message and exits
38. h Examples Burn an MTS3600 switch system via I2C Set the I2C network to access the InfiniScale IV switch mlxi2c d dev mst mtusb 1 p IS4 PRIM Burn with quick query qq to shorten burn time mlxburn dev dev mst mtusb 1 fw fw IS4 mlx qq Burn an MTS3600 switch system using the In Band access method mlxburn dev dev mst SW MT48438 lid 0x0003 fw fw IS4 mlx Generate and burn a new MTS3600 via I2C Set the I2C network to access the InfiniScaleIV switch mlxi2c d dev mst mtusb 1 p IS4 PRIM Burn the new image the flash is still blank specifying the Node and System GUIDs Note that 4 guids in quotes should be specified as an argument to the guids flag The 2 middle GUIDs are ignored by the InfiniScaleI V and should be set to 0 mlxburn dev dev mst mtusb 1 fw fw IS4 mlx conf MTS3600Q 1UNC Al ini guids 0002c9000100d060 0 0 0002c9000100d060 nofs 1 The arguments of the guids and macs flags must be provided within quotation marks for example mlxburn macs 0002c900001 0002c900002 2 The guid flag is supported by all Mellanox Technologies switch devices 18 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Generate and Burn a new MT3600 switch system via I2C in 2 steps Generate the image mlxburn fw fw IS4 mlx conf MTS3600Q 1UNC_Al ini wrimage fw is4 bin Burn using flint tool flint d dev mst mtusb 1 i tmp fw is4 bin nofs guids 0002c900010
39. hine In case that the different IB ports are connected to different IB subnets source IB port on the local host should be specified explicitly The device name would be in the format lt any string gt lid lt lid number gt source adapter name source IB port number For example On Linux lid 3 mlx4 0 1 On Windows lid 3 0 1 Say we have the following setup Host H1 InfiniScale IV i5 16 47 48 19 20 21 22 23 24 25 26 27 28 DEn n A AA I TE oe E sE m um 3 6 7 8 9 EH ER EE END OD NDS GS UND HE InfiniScale III Host H3 48 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 H1 host has 2 adapters Port 1 of the first adapter is conected to the InfiniScale III switch and port 2 of the second adapter is connected to the InfiniScale IV switch Since the 2 adapters on the H1 are not connected to the each other there are 2 seperate IB subnets in this setup Subnet nodes H1 IS3 switch and H2 Subnet nodes H1 IS4 switch and H3 Running ibv devinfo command on H1 would list the 2 adapter names For ConnectX adapters the names would be mlx4 0 and mlx4 1 Running mst ib add would add ib devices from the default port first active port on the first adapter only Subnet nodes would be listed To add the nodes of the second subnet the source adapter and port should be specified to the mst ib add command
40. ibit image generation the image lt pre generated image file gt should be used It instructs mlxburn to use the given file for burning the device 2 3 mlxburn Synopsis Note You must log in as root to run mlxburn mlxburn h v lt dev mst device wrimage fw image gt lt fw mellanox fw file image fw image gt conf fw conf file nofs nofs img format BINARY IMAGE dev type device type exp rom exp rom file exp rom dir exp rom dir force conf dir fw dir fwver vpd vpd rw vpd prog rw lt rw fields file gt query ul where h Display a short help text y Print version info and exit V lt INFORM WARNING DEBUG gt Set the verbosity level Default is WARNING Mellanox Technologies 15 J Mellanox Technologies Confidential Rev 1 30 mlxburn FW Image Generator amp Burner dev lt mst dev gt Burn the image using the given MST device wrimage lt fw image file gt Write the generated binary image to the provided file name fw lt mellanox fw file gt Specify the Mellanox firmware file to use file extension is mlx format lt BINARY IMAGE gt Specify which image format to use Can be used only with the wrimage flag Default is BINARY image lt fw image file gt Use the given firmware image to burn file extension is bin or img conf lt parameter set file gt Firmware configuration file ini Needed for image generation not using the dev flag or
41. if auto detection of configuration fails conf dir lt dir gt Instruct the burn operation to look for auto detected configuration files under the specified directory rather than under the firmware file directory fw_dir lt dir gt Instruct the burn operation to look for auto detected firmware files under the specified directory nofs When specified the burn process will not be failsafe A non failsafe burn is required on the rare occasion when a new firmware version has modi fications in the Invariant Sector nofs img When specified the generated image will not be failsafe If burning is also specified it will not be failsafe either exp rom lt exp rom file gt Integrate the given expansion rom file to the FW image The given file may be in img or bin rom raw binary format If the exp rom file is set to AUTO expansion rom file is auto detected from the files rom in the exp rom dir see below Note Exp rom auto detection is done for devices that are already burned with an exp rom image If exp rom AUTO is specified for a device with no exp rom it would be burnt with no exp rom To add exp rom to a device manually supply the exp rom file to use exp rom dir exp rom dir The directory in which to look for expansion rom file when exp rom AUTO is specified By default exp rom files are searched in fw file directory gt exp_rom fwver When a device is given Display current loaded firmwa
42. image in a file use the following command line flint i image file gt q where device Device on which the query is run image file Image file on which the query is run Examples 1 Query the FW on the device gt flint d dev mst mt25418 pciconf0 query 2 Query the FW image file flint i 25408 2 1 000 MHGH28 XSC Al bin query 3 2 2 3 Verifying the FW Image To verify the FW image on the Flash use the following command line flint d device v To verify the FW image in a file use the following command line flint i image file gt v where device is the Flash device to verify and image file is the image file to verify Examples flint d dev mst mt25418 pci cr0 v flint i image file bin v 3 2 2 4 Managing an Expansion ROM Image 1 To burn an Expansion ROM image use the following command flint d mst device brom image name gt rom The brom command installs the ROM image on the Flash device or replaces an already existing one Example flint d dev mst mt25418 pci cr0 brom example rom Current ROM info on flash N A New ROM info type GPXE version 2 0 100 devid 25418 proto IB 26 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Burning ROM image OK Restoring signature OK 2 To read an Expansion ROM image to a file use the following command flint d lt mst device gt rrom lt image name gt rom Example flint d dev mst mt2
43. in the following format mst ib add hca name hca port Example Add nodes of both subnets Run gt mst ib add mlx4 0 1 gt mst ib add mlx4 12 List the devices gt mst status dev mst CA MT25418 H1 HCA 1 lid 0x0001 mlx4 0 1 dev mst CA MT25418 H2 HCA 1 lid 0x0005 mlx4 0 1 dev mst SW MT47396 lid 0x0003 mlx4 0 1 Mellanox Technologies 49 J Mellanox Technologies Confidential Rev 1 30 spark InfiniScale III Firmware Burning Tool dev mst CA_MT25418 H1 HCA 1 lid 0x0010 mlx4 1 2 dev ms CA MT25418 H3 HCA 1 lid 0x0012 mlx4 1 2 dev mst SW MT48436 lid 0x0005 mlx4 1 2 You can use the above device names with the MFT tools 50 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Appendix E MTUSB 1 USB to I2C Adapter E 1 Overview The MTUSB 1 is a USB to IC bus adapter This chapter provides the user with hardware and soft ware installation instructions on machines running Linux or Windows operating systems Figure 3 MTUSB 1 Device MTUSB 1 Device I2C Cable USB I2C ADAPTER E 1 1 Package Contents Please make sure that your package contains the items listed in Table 7 and that they are in good condition Table 7 MTUSB 1 Package Contents Item Quantity Description MTUSB 1 device 1 USB to PC bus adapter USB cable 1 USB A to USB B 1 8m T2C cable 1 9 pin male to male cable 1 5m Converter cable 2 9 pin female to 3 pin small larg
44. is mutually exclusive with the d option The remaining parameters are device Valid MST device cmd Command May be r ead or w rite i2c addr gt 2C slave address lt addr gt Address of length addr width inside I2C target device to read write operation Note that the lt addr gt value is ignored if lt addr_witdh gt 0 lt data gt Data bytes of length data_width to write to target device Mellanox Technologies 45 J Mellanox Technologies Confidential Rev 1 30 spark InfiniScale III Firmware Burning Tool Note All parameters are interpreted as hexadecimal values Examples 1 Read two bytes from address 0 of target I2C device at address 0x56 i2c a 1 d 2 dev mst mtusb 1 r 0x56 0x00 0000 2 Write two bytes to the address above then read them gt i2c a 1 d 2 dev mst mtusb 1 w 0x56 0x00 0x1234 i2c a 1 d 2 dev mst mtusb 1 r 0x56 0x00 3412 3 Read as separate 16 bytes in hexadecimal format starting from address 0 of the target device above gt i2c a 1 x 16 dev mst mtusb 1 r 0x56 0x00 12340000000000000000000000000000 C 4 2 Exit Return Values The following exit values are returned 0 successful completion gt 0 an error occurred C 5 mget temp Utility The mget temperature utility reads the hardware temperature from Mellanox Technologies devices with temperature sensors ConnectX ConnectX 2 BridgeX and InfiniScale IV devices an
45. mode itrace will exit only if you press lt Ctrl C gt This is not the default behavior of itrace Without the w option itrace will exit if there have been no new traces in the last 0 5 seconds d d DEVICE Specifies the name of the MST device driver for accessing the cr space The default value is dev mst mt23108 pci crO To run itrace via the I2C interface use this option to specify the following d device where the device is an I2C device such as mtusb 1 nomap Sets itrace not to directly access memory via memory mapping for read ing the trace buffer but to use the adapter memory access Gateway instead By default itrace accesses the memory directly If the cr space 42 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 device specified by the d parameter is one of the I2C devices nomap is switched on no propel Sets itrace not to animate the propeller in wait mode w option By default animation is enabled v version Prints the MFT version and exits c color Enables color in trace output D dump Dumps the trace buffer and exits This option is useful for debugging itrace it dumps the contents of the trace buffer in row format Note Typing help at the command line displays manual pages describing the syntax of the itrace utility C 2 mstdump Utility The mstdump utility dumps device internal configuration data The data can be used by for hard ware tr
46. n Supported systems MTS3600 FJ SWITCH BX4020 BRIDGEX EVB BX4010 MTS3610 MTPDK24 IS5025 IS5030 IS5035 Affected commands all m Subsystem module name Affected commands show h Print this help information y Print version and exit lt command gt summary q lt i2c_component gt Query an i2c component Supported components Adm1024 LM075 PCA9555 PCA9505 ISMIC PCF8591 p lt i2c_component gt Route the i2c path to the indicated i2c component init gplo gpio name Configure the GPIO pins set gpio gpio name pin name gt value Set the output value of the given GPIO pin set fan fan name Tach num power persent gt Set the power percent of the given fan set power module name lt off on gt Power on off the specified module Supported modules MTS3610 LEAF MTS3610 SPINE set led led name color Change the color of the specify led to the given color scan Scan the i2c slave addresses show info type gt Show information about the system or specific subsystem module related to m flag The information types are devs v List the i2c components v adds detailed information to the list modules List the detachable subsystems modules temp The temperatures of the components ADM1024 LM075 PCF8591 volt The voltage values of ADM1024 PCF8591 ports The present qsfp ports on the system fans The speed of fans power The power voltage curre
47. nce numbers timestamps and records of oper ations such as the following IRISC Trace Viewer Mellanox InfiniHost V4 4 2 Jul 31 2007 16 56 59 FW Version 1 2 922 09 07 2007 20 36 53 00000001 clb59bd1 SCHD SQP 0x000402 exes super scheduler busy done 00000003 clb59e4e SCHD exeqpc valid2freed 0x0 vec busy valid 0x00000010 00000004 dda895e4 SCHD SQP 0x000400 exes super scheduler busy done 00000005 dda89760 SCHD writing QpState SQPSTATE GOOD IDLE 00000006 dda89868 SCHD exeqpc valid2freed 0x0 vec busy valid 0x00000010 00000007 dda97ccf SCHD SQP 0x000400 exes super scheduler busy _ 00000008 dda97e47 SCHD writing QpState SQPSTATE GOOD IDLE 00000009 dda97f4f SCHD exeqpc valid2freed 0x0 vec busy valid 0x00000010 0000000a dda9a8f6 SCHD SQP 0x000400 exes super scheduler busy 00000005 dda9aa6e SCHD writing QpState SQPSTATE GOOD IDLE 0000000c dda9ab79 SCHD exeqpc valid2freed 0x0 vec busy valid 0x00000010 0000000d ddaaadc1 SCHD SQP 0x000400 exes super scheduler busy _ 00000029 ddaee521 INFO IPCdata 00 20x01abcd0a 0000002a ddaee60c INFO IPCdata 01 0x00000014 0000002b ddaee8ce MAD exes mad QPN 0x000000 nda nds 0x7c58d014 0000002c ddaee9f2 SCHD SQP 0x000000 sqpc access db algorithm INC 0000002d ddaef0d5 SCHD exes scheduler try to insert 0000002e ddaef2d9 SCHD SQP 0x000000 exes scheduler chosen 0000002f ddaef6aa SCHD EXES GO 0x0 w wait Runs itrace in wait
48. nfiniScale device in a switch system such as Flextronics F X430066 Stallion 8 4X IB port switch enter mlxburn image Stallion 5 5 0 eeprom dev dev mst mtusb 1 dev type 43132 Mellanox Technologies 19 J Mellanox Technologies Confidential Rev 1 30 mlxburn FW Image Generator amp Burner Note This firmware update cannot be performed before initializing the MST device mtusb 1 to connect to the I2C compatible bus of the InfiniScale and its EEPROM To generate an MT47396 image and perform an In Band update of the device with LID Ox11 enter mlxburn dev lid 0x11 fw IS3FW BIN 2 5 Exit Return Values The following exit values are returned 0 successful completion gt 0 an error occurred 20 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 3 flint Firmware Burning Tools 3 4 Overview The flint Flash interface utility performs the following functions Burns a binary firmware image to the Flash device attached to an adapter bridge or switch device Burns an Expansion ROM image to the Flash device attached to a ConnectX ConnectX 2 adapter device Queries for firmware attributes version GUIDs UIDs MACS PSID etc Enables executing various operations on the Flash memory from the command line for debug production 3 2 flint Synopsis flint switches lt command gt parameters 3 2 1 Switch Descriptions d evice device The device to
49. ng the flash Handle with care Shift the address when accessing Flash internal registers May be required for burn write commands when accessing certain Flash types on Infini Host amp IIIEx HCAs Do not verify each write on the Flash device Use this flag to indicate that the given image file is in a striped image format See mlxburn Synopsis striped image flag for details Affected commands query verify Print this message and exit Print extended command help Do not burn image in failsafe mode 22 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 allow psid change Allow burning a FW image with a different PSID Parameter Set ID than the one currently on flash Note that changing a PSID may cause the device to malfunction Use only if you know what you are doing skip is Allow burning the FW image without updating the invariant sector to ensure failsafe burning even if the invariant sector of the image is differ ent from the one burnt on the Flash Note Some FW releases may include important changes to the invariant sector that must be included in the FW update process In these cases the skip is flag should not be used Please refer to the specific FW release notes for details s ilent Print errors only Affected commands burn y es Non interactive mode Assume the answer yes to all questions Affected commands all no Non interactive mode Assume the answer
50. nt values of the power supplies slot num The slot number of the system only for FJ SWITCH leds The current colors of the LEDs inventory The inventory of the present modules 44 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 Examples 1 Point to an InfiniScale IV device to enable accessing it directly by firmware utilities mlxi2c d dev mst mtusb 1 p IS4 PRIM 2 Display the temperature values of InfiniScale IV or BridgeX temperature sensors in the sys tem mlxi2c d dev mst mtusb 1 show temp 3 Display the addresses of all I2C accessible devices mlxi2c d dev mst mtusb 1 scan C 4 i2c Utility The i2c utility provides low level access to the I2C bus on any Mellanox switch platform enabling the user to read or write data C 4 1 Operation The MST driver must be started prior to running i2c tool To start i2c Start the MST driver mst start or mst restart Run i2c with the following command line syntax i2c OPTIONS device cmd i2c addr lt addr gt lt data gt where OPTIONS can be the following h Prints this message a addr width Sets address width in bytes to the specified value May be 0 1 2 or 4 Default 1 d data width Sets data width in bytes to the specified value May be 1 2 or 4 Default is 1 x data len gt Presents each byte of data as two hexadecimal digits such as 013C20343B Note that this option
51. oubleshooting It can be applied to all Mellanox adapter devices BridgeX device InfiniS cale III switch devices and InfiniScale IV switch devices C 2 1 Operation The MST driver must be started prior to running mstdump tool To start mstdump Start the MST driver mst start or mst restart Enter an mstdump command that complies with the following command syntax mstdump full lt mst device gt dump file gt where the full flag dumps all internal registers Note On BridgeX devices using the full flag may have undesired side effects and require resetting the device Example root mymach mstdump dev mst mt25408 pci cr0 gt mt25408 dmp This dumps the internal configuration data of the device into the file mt25408 dmp C 3 mlxi2c Utility The mlxi2c utility provides access via the I2C MST device to Mellanox fourth generation switch InfiniScale IV and bridge BridgeX devices C 3 1 Operation The MST driver must be started prior to running mlxi2c To start mlxi2c Start the MST driver mst start or mst restart Run mlxi2c with the following command line syntax Mellanox Technologies 43 J Mellanox Technologies Confidential Rev 1 30 spark InfiniScale III Firmware Burning Tool mlxi2c switches command parameters switches summary d device MST 12c device name default dev mst mtusb 1 Affected commands all s system System type default Auto Detectio
52. ox Technologies Confidential Rev 1 30 Table 1 Revision History Table Date Revision Description August 2007 0 60 Updated tool usage examples to use ConnectX devices Added Appendix C Debug Utilities June 2007 0 50 Added the mac flag to the flint and mlxburn tools to support the ConnectX EN 10GigE adapter e Added Section 4 3 ibspark on page 29 that describes ibspark the In Band firmware burning tool for InfiniScale III switches e Modified Chapter 2 mlxburn FW Image Generator amp Burner on page 18 to describe m xburn support for burning switch systems with multiple InfiniScale InfiniScale III switch devices e Added Appendix B Flow Examples mlxburn to describe burning switches In Band and via a direct I2C connection January 2007 0 40 MFT for Windows is now part of the WinIB software package therefore to install MFT on a Windows machine you need to install WinIB and enable MFT See Section 1 4 3 Install MFT On Windows OS on page 12 Added flint flag use image ps Removed flint flags crc bsn January 2006 0 30 MFT version 1 0 1 Added querying options for VPD for mlxburn Added examples to demonstrate support of MT43132 InfiniScale device by mlxburn and spark e Reorganized the flint Firmware Burner on page 26 chapter Added the Appendix PSID Assignment October 2005 0 20 Added Windows distribution to MFT MFT version 0 5 1
53. re version When a FW file is given fw flag Display the file FW version force Run mlxburn in non interactive mode vpd l on Linux only Display the Read Only section of the PCI VPD Vital Product Data of the given device vpd_rw I Display the Read Only and Read Write sections of the PCI VPD of the given device vpd prog rw I lt rw fields file gt Program the VPD W tag the writable section of the VPD with the data given in the rw fields file File lines format is FIELD VALUE White spaces before and after VALUE are trimmed A field name should have 2 letters exactly for example YA V1 The field name RW is reserved and should not be used query Query adapter or switch devices for firmware information 1 The VPD query may not be enabled on certain board types Also VPD operations are available only for devices with a PCI interface 16 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 ul on Linux only Use this flag to access hardware using the PCI user level method When using this flag the argument of the dev flag should be the PCI number of the target device in the format lt bus dev fn gt striped image For image generation only The striped image is used as its file layout is similar to the image layout on the flash The striped image can be used for pre burning using an external burner or flint bb command dev type lt Mellanox Device ID gt mlxburn m
54. the device specifying the MACS to burn gt flint d dev mst mt25448 pci cr0 i fw 25448 6 0 111 MNEH28 XTC Al bin mac 12345678beef burn 4 Burn the image on a blank Flash device This means that no GUIDs are currently burnt on the device therefore they must be supplied with guid guids by the burning command More over the burn process cannot be failsafe when burning a blank Flash therefore the nofs flag must be specified gt flint d dev mst mt25418 pci cr0 i 25408 2 1 000 MHGH28 XSC Al bin nofs guid 1234567812345678 burn 5 Read FW from the device and save it as an image file gt flint d dev mst mt25418 pci cr0 ri Flash Image Copy bin 6 MT48436 InfiniScale IV switch Burn the image on a blank Flash device This means that no GUIDs are currently burnt on the device therefore they must be supplied with guid guids by the burning command Moreover the burn pro cess cannot be failsafe when burning a blank Flash therefore the nofs flag must be specified flint d dev mst mtusb 1 i tmp fw is4 bin nofs guids 0002c9000100d060 0 0 0002c9000100d060 Db 7 MT48436 InfiniScale IV switch inband firmware update flint d lid 0x18 i tmp fw is4 bin b 3 2 2 2 Querying the FW Image To query the FW image on a device use the following command line Mellanox Technologies 25 J Mellanox Technologies Confidential Rev 1 30 flint Firmware Burning Tools flint d device q To query the FW
55. the new GUIDs Setting the GUIDs OK Restoring signature OK gt flint d dev mst mt25418 pci cr0 qq q W Running quick query Skipping full image integrity checks Image type ConnectX FW Version 2 7 9450 Rom Info type PXE version 3 0 0 devid 25418 proto VPI Device ID 25418 Chip Revision AO Description Node Portl Port2 Sys image GUIDs 0002c9000abcdef0 0002c9000abcdef1 0002c9000abcdef2 0002c9000abcdef3 ACs 02c90abcdef0 02c90abcdef1 Board ID VSD MT 04C0110002 VSD VSD PSID MT 04C0110002 2 Change the GUIDs MACS on an image file flint i tmp image bin qq q W Running quick query Skipping full image integrity checks Image type ConnectX Mellanox Technologies 29 J Mellanox Technologies Confidential Rev 1 30 flint Firmware Burning Tools FW Version Rom Info Device ID Chip Revision Description GUIDs ACS Board ID VSD PSID 2 7 9450 type PXE version 3 0 0 devid 25418 proto VPI 25418 AO Node Portl Port2 Sys image 0002c9000120d050 0002c9000120d051 0002c9000120d052 0002c9000120d053 02c90120d050 02c90120d051 VSD MT 04C0110002 VSD MT 04C0110002 gt flint i tmp image bin guid 0002c9000abcdef0 mac 02c90abcdef0 sg gt flint i tmp image bin qq q W Running quick query Skipping full image integrity checks Image type FW Version Rom Info Device ID Chip Revision Description GUIDs ACs Board ID V
56. tility extracts and prints trace messages generated by the embedded iRISC processors of Mellanox Technologies InfiniBand or Ethernet adapter devices These trace messages inform developers of software drivers about internal status events critical errors etc for each iRISC Trace messages generated by iRISCs are stored in the trace buffer The trace buffer is located in host memory for MemFree adapter cards i e without on board memory and in adapter memory for adapter cards with on board memory The utility is command line application controlled by command line parameters It prints trace messages in text format to the console For more details see the QUERY DEBUG MESSAGE command interface description in the device s Programmer 5 Reference Manual available via https docs mellanox com requires a cus tomer login account C 1 2 Operation In order to print the firmware traces it is required that Debug firmware is burnt and loaded to the device The driver is up Specifically this means that For adapters with on board memory The SYS ENABLE command has been executed For adapters without on board memory MemFree The RUN FW command has been exe cuted The desired trace mask is set see the m flag below The MST driver must be started prior to running itrace tool To start itrace Start the MST driver mst start or mst restart Enter the following command itrace options IRISC NAME where IRISC NAME
57. upport for Mellanox MT25408 ConnectX 2 MT25408 ConnectX 2 EN MT25458 ConnectX 2 ENt MT64102 BridgeX and MT1016 PhyX devices Removed ibspark text no longer supported Added the option fw dir to mlxburn e Added Section 2 4 3 BridgeX Gateway Examples e Added support for Expansion ROM images see Section 3 2 2 4 Managing an Expansion ROM Image e Added Section C 3 mlxi2c Utility Added Section C 5 mget temp Utility December 2008 1 10 e Added support for In Band device access for the Windows operating system See Section 1 2 and Section 1 3 Added Appendix E MTUSB 1 USB to I2C Adapter November 4 2008 1 01 e Added VMware ESX Server 3 5 support See Section 1 2 3 Section 1 3 Section 1 4 5 Section 1 4 6 and Section 2 1 Added the ul flag to m xburn see Section 2 3 August 2008 1 0 Added support for Mellanox InfiniScale IV switch device Expanded In Band support with the command mst ib add Modified the Windows MFT installation now it is a standalone installation Added the qq flag to flint April 2008 0 65 Added MFT installation instruction in Section 1 4 MFT Installation on page 12 mlxburn tool added Expansion ROM auto detection description e flint tool added the blank guids flag and the sg command e Added Section 3 2 3 1 describing how to set GUIDs MACS on a Flash device with blank GUIDs MACs Mellanox Technologies 5 Mellan
58. ust know the Mellanox device ID in order to work properly This option should be used if auto detection of the device type taken from the firmware file fails The following is the list of supported device IDs 23108 For MT23108 InfiniHost based HCA cards Cougar family 25208 For MT25208 InfiniHost III Ex in InfiniHost mode with local attached memory HCA cards Lion Cub family 25218 For MT25208 InfiniHost III Ex in MemFree mode HCA cards Lion Mini family 25204 For MT25204 InfiniHost III Lx HCA cards Tiger Cheetah fami lies 25408 For MT25408 ConnectX Dual 10Gb s InfiniBand VPI Port Adapter Cards 25418 For MT25408 ConnectX Dual 20Gb s InfiniBand VPI Port Adapter Cards 26418 For MT25408 ConnectX Dual 20Gb s InfiniBand VPI Port Adapter Cards with PCI Express Gen 2 26428 For MT25408 ConnectX IB Dual 40Gb s InfiniBand VPI Port Adapter Cards with PCI Express Gen 2 25448 For MT25408 ConnectX EN NIC cards 26448 26468 For MT25408 ConnectX EN 10GigE cards with PCI Express Gen 2 26478 For MT25408 ConnectX 2 EN 40GigE cards with PCI Express Gen 2 25458 For MT25458 ConnectX EN 10GBASE T cards 26458 For MT25458 ConnectX EN 10GBASE T cards with PCI Express Gen 2 25438 For MT26438 ConnectX 2 VPI w Virtualization 43132 For MT43132 InfiniScale based switch systems 47396 For MT47396 InfiniScale III based switch systems 48436 For MT48436 InfiniScale IV based switch systems IB SDR
59. vices via the PCI X PCI Express interface via a USB to I2C adapter Mellanox P N MTUSB 1 or via vendor specific MADs over the InfiniBand fabric In Band Note In Band device access requires installing the MFT package in the default method and requires the local IB port to be in the ACTIVE state and connected to an IB fabric All MFT tools address the target hardware device using an mst device name This name is assigned by running the command mst start for PCI and I2C access In Band devices can be assigned by running the mst ib add command To list the available mst device names on the local machine run mst status on Linux and Win dows only Notes for Windows 1 On Linux without specifying the disable inband flag 10 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 The mst service which provides PCI access to the target adapter is run automatically upon boot To access an adapter or switch device via the USB bus A USB to I2C Adapter should be used to connect the host USB port and the I2C port of the target device Upon the first usage of this interface you will be requested to install the USB to I2C Adapter driver I2CBridge Note for VMware ESX Server 3 5 Only PCI user level access to Mellanox devices is supported on VMware ESX Server 3 5 machines See below The format of an mst device name is as follows Via PCI mt lt dev id gt _pci lt _crX
60. which the Flash is connected Affected commands All i mage image Binary image file Affected commands burn verify qq Quick query the device for firmware information This operation can be specified when executing either a query or burn operation When speci fied flint will not perform full image integrity checks This may shorten execution time when running over slow interfaces e g 12C MTUSB 1 Affected commands burn query guid lt GUID gt Base value for up to 4 GUIDs which are automatically assigned the fol lowing values guid gt node GUID guid 1 gt portl guid 2 gt port2 guid 3 gt system image GUID Affected commands burn sg guids lt GUIDs gt 4 GUIDs must be specified here These GUIDs will be assigned to node portl port2 and system image GUID respectively Affected commands burn sg mac MAC MAC base address value Each of the two ConnectX EN ports is assigned a MAC address as follows MAC is assigned to Port 1 MAC 1 is assigned to Port 2 1 The mac and macs options are applicable only to Mellanox Technologies Ethenet adapter devices Mellanox Technologies 21 Mellanox Technologies Confidential Rev 1 30 flint Firmware Burning Tools macs lt MACs gt uid lt UID gt uids lt UIDs gt blank guids clear semaphore byte mode no flash verify striped image h elp hh nofs 1 Affected commands burn sg 2
61. x firmware for OEM specific needs e g a specific adapter board type See Section 2 2 1 Firmware Customization on page 15 Note On VMware ESX Server 3 5 you must use m xburn with the ul flag 2 2 Firmware Generation and Burning with mlxburn The mlxburn firmware update flow is composed of two separate stages image generation and image burning In the image generation stage a given Mellanox firmware release in mlx format for adapters bridges and InfiniScale IV switches and in BIN file format for InfiniScale III switches is processed together with a board specific configuration ini file to generate a burn able firmware image This image is burnt to the Flash EERPROM attached to a Mellanox device in the second stage The burning process retains device specific data such as GUIDs UIDs MACs VSD and BSN Also the burn process is failsafe by default Figure 2 FW Generation and Burning FW Fie mi SS Eames S 14 Mellanox Technologies Mellanox Technologies Confidential Rev 1 30 mlxburn runs both stages by default but it may perform only one by means of command options If the wrimage is specified see Section 2 3 mlxburn Synopsis only image generation is per formed Specifying the image option skips the image generation stage and loads the provided image generated in a previous run of mlxburn using the wrimage option Note When generating an image

Mellanox Firmware Tools (MFT) User`s Manual

Contents

Download Pdf Manuals

Related Search

Related Contents