InfiniHost PCI-X Low Profile RoHS HCA Adapter Cards User`s Manual
Contents
1. Card Interfaces I O Interfaces The HCA board includes the following interfaces e Two 4X InfiniBand Copper Connectors e PCI X 64 bit 66 133 MHz Edge Connector e I O Panel LEDs e RC 4 0 1 InfiniBand Interface The HCA provides two 4X InfiniBand v1 1 connectors to the MT23108 for external copper cables The MT23108 device is compliant with the IBTA specification 1 1 The MT23108 device has two 4X ports A and B which connect to 4X copper connectors 1 and 2 respectively The MT23108 has eight internal SerDes 4 0 2 PCI X Interface The PCI X bus is a PCI X version 1 0a compliant 64 bit 66 133MHz interface The MT23108 can be either a master initiating the PCI bus operations or a slave responding to PCI bus operations The PCI PCI X bus can connect to either a host CPU in an HCA application or to an I O device such as Gigabit Ethernet when used as a Target Chan nel Adapter 4 0 2 1 PCI X Board Features e Low profile short PCI expansion board 2 5 x 6 6 inches e 3 3V and 5V up to 133 MHz 4 0 3 LED Assignment The board has only four LEDs located on the I O panel The physical link illuminates once VAPI is started and a physical connection is made between two nodes The logical link yellow LED illuminates once the InfiniBand net work is discovered over the physical link If the LEDs are not active either the physical or the logical or both con nections have not been established Table 6 LEDs Port 1 LED Name2. E C2 x CE ol NI N pi i CULE zo St NAS a CSCA anana E SA l N gt IS a ale D oh EES P I a pe e j 2 e IB Te al SUSSEERSD SERAUOUUNE CTI LT pe X Bu SSRF Som SR eus x TTT lke z 6 a ES DUZ oe N de al 101682 8 pra H El asi 5 N EBE AEBS re La 5 S C99 1 s Ba Bei PE cal eo Jp gt ERS SS cc EE AL 15 01 10 J4 si z 5 384 10 Flash Present Not present Jumper ll i 854 10 35 394 10 50 84 10 115 604 10 163 09 10 ALL DIMENSIONS ARE IN MM Figure 3 shows the common I O panel of all the tall bracket HCA cards covered in this User s Manual Both IB ports are shown along with the physical and activity link LEDs Note Short brackets have the same port and LED footprints as tall brackets See Appendix C Instructions for Replacing a Tall Bracket with a Short Bracket on HCA Cards on page 30 Rev 1 2 Mellanox Technologies Figure 3 I O Panel with Dual Ports and LEDs Tall Bracket Port 1 Physical Link Green LED Port 1 Activity Logical Link Yellow LED Port 1 Port 2 Activity Logical Link Yellow LED Port 2 Physical Link Green LED Port 2 Mellanox Technologies Rev 1 2 18 Vital Product Data VPD Format The PCI VPD Vital Product Data layout for each of the described Mellanox Technologies HCA cards complies with the format defined in the PCI 2 3 Specification Appendix
3. F Fiber SDR S HCA IC T InfiniHost A InfiniHost III Ex S InfiniHost IN Lx T IB ports 1 1 2 2 A 10 B 11 lt limit to one character gt 2 I Interface X PCI X 4 PCle x4 8 PCle x8 X Separator X Memory Size X MenFree 1 128MB 2 256MB 3 512MB 2 B Bracket S Short T Tall N None T R RoHS lt blank gt non RoHS C RoHS w Exemption R RoHS Lead C Free Mellanox Technologies Rev 1 2 10 HCA Card Installation Installation Instructions The HCA cards listed in Table 3 on page 9 are standard PCI PCI X cards with a standard PCI X edge connector Please consult the host machine documentation for instructions on how to install a PCI PCI X card Rev 1 2 Mellanox Technologies Safety Warnings 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source 2 Over temperature This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended 55 C 131 F An air flow of 200LFM at this maximum ambient temperature is required To guaran tee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings gt 3 During Lightning Electrical Hazard During periods of lightning activity do not work on the equipment or connect or dis connect cables 4 Copper InfiniBand Cable Connecting Disconnecting Copper InfiniBand cables are heavy and not fle
4. MHET2X 1SC A Item Value Format Description 93 Length Ox1 94 Data Checksum 95 Large Resource Type VPD W Tag 0x11 0x91 96 Length 0x9D 98 VPD Keyword VI EFI Driver version 100 Length 0x6 101 Data N A Number 107 VPD Keyword YA Asset Tag 109 Length 0x20 110 Data N A Alphanumeric N A 142 VPD Keyword RW Remaining read write area 144 Length Ox6e 145 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 356 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHET2X 1TC Note A1 was used as the HCA card upper level revision Later revisions of the HCA card will have the same format Table 9 VPD Format for MHET2X 1TC Sert Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length OxA 3 Data Cougar cub Alphanumeric 13 Large Resource Type VPD R Tag 0x10 0x90 14 Length Ox4F 16 VPD Keyword PN Numbers Add in Card Part Num ber 18 Length Ox15 Mellanox Technologies Rev 1 2 20 Table 9 VPD Format for MHET2X 1TC A Item Value Format Description 19 Data MHET2X 1TC 40 VPD Keyword EC
5. Step 1 Remove connector clips Figure 7 shows a connector retention clip and the designated names of its sec tions Figure 7 Connector Retention Clip Clip Top Clip Center embraces the connector Clip Hook grips onto the connector Using a small flat head screwdriver gently push up one hook of a connector s clip toward the connector s top side as shown in Figure 8 a on page 31 Then push the other hook each of the two clip s hook towards the connector s top side see Figure 8 b Finally pull the clip away from its center see Figure 8 c Rev 1 2 Mellanox Technologies 31 Figure 8 Extracting Connector Clip a Gently Push One Hook of Clip b Gently Push Other Hook of Clip c Pull Clip Away Repeat the above actions for the second connector s clip Note The LED holes arrangement on the bracket photos appearing in this appendix may be different from their arrangement on the actual HCA cards brackets Nevertheless this difference bears no impact on the replacement instructions provided here Step 2 Unscrew bracket screws Unscrew both screws from the card using a torque screwdriver as shown in Figure 9 Figure 9 Unscrew Bracket Screws Step 3 Detach bracket Grip the bracket as shown in Figure 10 placing your thumb on the LED component In a rotating move toward the component side of the card slide the bracket out of the connectors Figure 10 c gt Gently hold your thumb on t
6. des cables InfiniBand en cuivre Les cables InfiniBand en cuivre sont lourds et ne sont pas flexibles il faut donc faire tr s attention en les branchant et en les d branchant des connecteurs Consultez le fab ricant des cables pour connaitre les mises en garde et les instructions sp ciales 7 Montage et entretien sur baie Lorsque ce produit est mont ou entretenu sur baie il faut prendre des pr cautions sp ciales pour s assurer que le syst me reste stable En g n ral il faut remplir la baie avec du mat riel de bas en haut Mellanox Technologies Rev 1 2 36 8 Installation du mat riel Ce mat riel ne doit tre install remplac ou entretenu que par du personnel form et qualifi 9 Elimination du mat riel L limination de ce mat riel doit s effectuer dans le respect de toutes les l gislations et r glementations nationales en vigueur 10 Codes lectriques locaux et nationaux Ce mat riel doit tre install dans le respect des codes lectriques locaux et nationaux Rev 1 2 Mellanox Technologies
7. per HCA card The file name of each such binary is composed by combin ing the firmware name the firmware release version and the card part number See Table 5 Table 5 Firmware Images for InfiniHost PCI X HCA Cards Firmware Image PCI Dev ID Example Name Decimal p fw 23108 23108 fw 23108_3_5_000 MHET2X 1SC_A1 bin zip is the firmware binary of firmware fw 23108 version 3 5 000 for the RoHS compliant HCA card MHET2X 1SC Rev Al HCA Card Firmware Update as Part of a Cluster Firmware Update If the HCA card is part of an InfiniBand cluster its firmware can be updated as part of the entire cluster firmware update using the ibfwmgr tool of the IB administration IBADM tools package IBADM is available for download as part of IB stack distributions such as IB Gold and OFED available via http www mellanox com See Firmware downloads under the same Web page for cluster update instructions Customized HCA Card Firmware Update OEM Only Note The procedure described in this section is normally not needed and applies to OEMs only To create a customized firmware binary the firmware image in MLX format needs to be downloaded along with the MFT tools package See http www mellanox com under Firmware Downloads for customized firmware update instructions 1 Currently only the Linux distributions support updating firmware for an entire InfiniBand cluster Rev 1 2 Mellanox Technologies Adapter
8. 11 VPD Format for MHET2X 2TC Table 12 HCA Cards EMC Certification Status Table 13 HCA Cards Specifications Table 14 I2C compatible Connector Pinout Table 15 InfiniBand 4X Connector Pinout Oo OND 13 15 18 19 21 22 24 27 28 28 Mellanox Technologies Rev 1 2 4 Revision History Table 1 Revision History Rev Date Comments Changes Replaced Safety warnings and added Safety warnings in French Removed watermark and changed footer gt August 2008 Added MIC BCC Cert to Cert Table Added Korean Certs Statements LU December 20 Added EMC VCCI statements to Appendix A Specifications on page 24 2006 1 10 November27 Added EMC Class B statements to Appendix A Specifications on page 24 2006 November 2 First version of the User s Manual 1 00 2006 Rev 1 2 Mellanox Technologies 7 About this Manual This card User s Manual describes Mellanox Technologies InfiniHost PCI PCI X RoHS compliant HCA cards It provides details as to the interfaces of the board specifications required software and firmware for operating the board and relevant documentation Intended Audience This manual is intended for the installer and user of these PCI PCI X HCA cards listed in Overview on page 8 The manual assumes basic familiarity with the InfiniBand architecture specification Related Documentation Table 2 Documents List Infi
9. Alphanumeric Engineering Change Level of the card rev 42 Length 0x2 43 Data AI Upper level revision 45 VPD Keyword SN Alphanumeric Serial Number 47 Length 0x18 48 Data MTYYWWF SSSSS 72 VPD Keyword V0 Currently not in use 74 Length 0x10 75 Data N A 91 VPD Keyword RV 93 Length 0x1 94 Data Checksum 95 Large Resource Type VPD W Tag 0x11 0x91 96 Length 0x9D 98 VPD Keyword V1 EFI Driver version 100 Length 0x6 101 Data N A Number 107 VPD Keyword YA Asset Tag 109 Length 0x20 110 Data N A Alphanumeric N A 142 VPD Keyword RW Remaining read write area 144 Length Ox6e 145 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 356 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers Rev 1 2 Mellanox Technologies PCI VPD Layout for MHET2X 2SC Note A1 was used as the HCA card upper level revision Later revisions of the HCA card will have the same format Table 10 VPD Format for MHET2X 2SC eee Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length OxA 3 Data Cougar cub Alphanumeric 13 Large Resource Type VPD R Tag 0x10 0x90 14 Length Ox4F 16 VPD Keyword PN Numbers Add in Card Part Num ber 18 Length 0x15 19 Da
10. C to 55 C max with active media adapter support On board Memory Size 128MB MHET2X 1SC 1TC 256MB MHET2X 2SC 2TC Protocol Support Regulatory InfiniBand IBTA v1 2 Auto Negotiation 10Gb s EMC FCC 47 CFR part 15 2005 subpart B class B 2 5Gb s QoS 8 InfiniBand Virtual Lanes for each port ICES 003 2004 Issue 4 class B RDMA Support Yes All Ports PCI 2 2 VCCI V 3 2005 04 class B PCI X 1 0 EN 55022 1998 A1 2000 A2 2003 class B EN 61000 3 2 2000 A2 2005 EN61000 3 3 1995 A 1 2000 EN 55024 1998 A1 2001 A2 2003 standards harmonized under EMC Directive 89 336 EEC Safety IEC EN 60950 1 2001 ETSI EN 300 019 2 2 Environmental IEC 60068 2 64 29 32 RoHS RoHS R5 Mellanox Technologies Rev 1 2 28 Appendix B Interface Connectors Pinout B 1 PC compatible Connector Pinout Figure 4 2C compatible Connector Table 14 I2C compatible Connector Pinout Connector Pin Number HCA Signal Name 1 SPSDA 2 SPSCL 3 GND 4 NC 5 NC B 2 InfiniBand Connector Pinout Figure 5 InfiniBand 4X Port Connector J2 Conn 4X 510 Iatxop 3 IBtxlp 2 IBtxOn 3 IBixIn 3 649 IBtxOp 2 IBixlp 2 S L iskono X iBixin 2 ais IBtxOp 1 IBixlp 1 SIZ IBtxon 1 IBtxin 1 Ga IBtxOp 0 IBtxlp 0 eqs 1BtxOn 0 IBixIn 0 Rev 1 2 Table 15 InfiniBand 4X Connector Pinout Sheet 1 of 2 Connector
11. I All HCA cards share the same PCI VPD layout i e have the same items however the Offset of each item and or its Value may be different from one card s VPD to another The PCI VPD layout for each HCA card is provided in the following sections e Section PCI VPD Layout for MHET2X 1SC on page 18 e Section PCI VPD Layout for MHET2X 1TC on page 19 e Section PCI VPD Layout for MHET2X 2SC on page 21 e Section PCI VPD Layout for MHET2X 2TC on page 22 PCI VPD Layout for MHET2X 1SC Note A1 was used as the HCA card upper level revision Later revisions of the HCA card will have the same format Table 8 VPD Format for MHET2X 1SC eRe Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length OxA 3 Data Cougar cub Alphanumeric 13 Large Resource Type VPD R Tag 0x10 0x90 14 Length Ox4F 16 VPD Keyword PN Numbers Add in Card Part Num ber 18 Length Ox15 19 Data MHET2X 1SC 40 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 42 Length 0x2 43 Data Al Upper level revision 45 VPD Keyword SN Alphanumeric Serial Number 47 Length 0x18 48 Data MTY YWWF SSSSS 72 VPD Keyword Vo Currently not in use 74 Length 0x10 75 Data N A 91 VPD Keyword RV Rev 1 2 Mellanox Technologies Table 8 VPD Format for
12. MI and susceptibility EMS Certified equipment is labeled with the MIC mark and certification number Class A Statement 0 WZ YF RLE AAMAS SS 4 71710 21 BHA EE Ae ol BE Fa ven ye AS pol TE 798318 ME 717822 MESA VEUT Translation Class A Device This device is registered for EMC requirements for industrial use The seller or buyer should be aware of this If this type was sold or purchased by mistake it should be replaced with a residential use type Mellanox Technologies Rev 1 2 26 Class B Statement CORES WHLBRESERRSAEMHMBRMS VCCI OB LET lt 772BRARMERETCT CORBIS RAR CHEATS RANELTUETD TOREIZ FLEVY a 2 SPRITE LT MA CHS SEBS t5SHOFCEPHVET PURE HAE ICE gt TELUMWRUSELTR SA Translation This is a Class B product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment VCCI If this is used near a radio or television receiver in a domestic environment it may cause radio interference Install and use the equipment according to instruction manual Rev 1 2 Mellanox Technologies A 2 HCA Cards Specifications Table 13 lists the specifications for the HCA cards Table 13 HCA Cards Specifications Physical Power and Environmental Size 2 5in x 6 6in 6 4cm x 16 8cm Voltage 5V 3 3V Air Flow 200LFM 55 C Maximum Power 12W 4X 10Gb s Connector InfiniBand Copper current rating 0 5A Temperature 0
13. Mellanox TECHNOLOGIES InfiniHost PCI X Low Profile ROHS HCA Adapter Cards User s Manual P N MHET2X 1SC MHET2X 1TC MHET2X 2SC MHET2X 2TC Rev 1 2 Mellanox Technologies 2 Copyright 2006 Mellanox Technologies Inc All Rights Reserved InfiniHost PCI X Low Profile ROHS HCA Adapter Cards User s Manual Document Number 2680 Mellanox Technologies Inc 2900 Stender Way Santa Clara CA 95054 U S A www Mellanox com Tel 408 970 3400 Fax 408 970 3403 Mellanox Technologies Ltd PO Box 586 Hermon Building Yokneam 20692 Israel Tel 972 4 909 7200 Fax 972 4 959 3245 Rev 1 2 Mellanox Technologies Contents Contents List of Tables Revision History About this Manual Chapter 1 Overview 1 1 List of HCA Cards 1 2 Mellanox HCA Cards Part Numbering Key Chapter 2 HCA Card Installation 2 1 Installation Instructions 2 2 Safety Warnings Chapter 3 Updating HCA Card Firmware 3 1 Single HCA Card Firmware Update 3 2 HCA Card Firmware Update as Part of a Cluster Firmware Update 3 3 Customized HCA Card Firmware Update OEM Only Chapter 4 Adapter Card Interfaces 4 1 TO Interfaces 4 1 1 InfiniBand Interface 4 1 2 PCI X Interface 4 1 2 1 PCI X Board Features 4 1 3 LED Assignment 4 1 4 I2C Interface 42 Power 4 3 Memory 43 1 DDR SDRAM 4 3 2 FLASH ROM 43 3 EEPROM 4 4 Jumper Configuration Chapter 5 Mechanical Information 5 1 Air Flow Requirement 5 2 Board Mechanical Drawing
14. Physical Link Green Logical Link Yellow Port 2 LED Name Physical Link Green Logical Link Yellow 4 0 4 I2C Interface A three pin header reference name J3 in Figure 2 on page 16 is provided as the I2C interface Mellanox Technologies Rev 1 2 14 Power The HCA board is a 3 3 V compliant design 3 3 V only The board receives 3 3V and 5V power from the PCI X Edge connector All other required power is generated by on board switch mode regulators For power consumption see Appendix A Specifications on page 24 Memory The HCA supports multiple memory devices on board through the DDR SDRAM Flash and I2C interfaces 4 0 5 DDR SDRAM The HCA board is designed with multiple memory configurations to be placed on the board The board is compliant with the JEDEC standard JESD79 Double Data Rate DDR SDRAM Specification The board is generally popu lated with unbuffered 128 256 or 512MB ECC 133 266 or 166 333 MHz memory configurations can vary Memory speed and size are encoded in the standard Mellanox Ordering Part Number OPN Custom part numbers may be different An example would be the MHXL CF128 T this is an HCA board with a 166MHz 128MB DDR memory 4 0 6 FLASH ROM The HCA board supports 4MB of FLASH ROM space via the CPU interface of the MT23108 The details of the FLASH supported are e 8 bit data e 19 bit address e Programming via the CPU bus The FLASH Am29L
15. Pin Connector Pin IB Port A Signal IB Port B Signal Number Name Name Name S1 IBtxIp 0 Rx_Al Rx BI S2 IBtxIn 0 Rx A0 Rx BO S3 IBtxlp 1 Rx_A3 Rx_B3 S4 IBtxIn 1 Rx_A2 Rx_B2 S5 IBtxlp 2 Rx_A5 Rx B5 S6 IBtxIn 2 Rx_A4 Rx_B4 S7 IBtxIp 3 Rx_A7 Rx_B7 S8 IBtxIn 3 Rx_A6 Rx_B6 S9 IBtxOn 3 Tx_A6 Tx_B6 S10 IBtxOp 3 Tx_A7 Tx_B7 S11 IBtxOn 2 Tx_A4 Tx_B4 S12 IBtxOp 2 Tx AS Tx B5 S13 IBtxOn 1 Tx_A2 Tx_B2 Mellanox Technologies Table 15 InfiniBand 4X Connector Pinout Sheet 2 of 2 Connector Pin Connector Pin IB Port A Signal IB Port B Signal Number Name Name Name S14 IBtxOp 1 Tx_A3 Tx_B3 S15 IBtxOn 0 Tx A0 Tx BO S16 IBtxOp 0 Tx_Al Tx BI G1 G6 G9 H1 H2 Signal Ground GND GND G7 Sense 3 3V SENSE Pl SENSE P2 G8 Vec MC POWER Pl MC POWER P2 a The Sense 3 3V signal is used to enable the Vcc power supply pin G8 used to provide power to the active media adapter B 3 PCI X Edge Connector Pinout The HCA card uses a standard PCI X 1 0 edge connector See http www pcisig com specifications Mellanox Technologies Rev 1 2 30 Appendix C Instructions for Replacing a Tall Bracket with a Short Bracket on HCA Cards This appendix provides instructions on how to remove a tall bracket of an HCA card such as the one shown in Figure 6 and replace it with a short one Figure 6 Tall Bracket of a Dual IB Port HCA Card C 1 Removing Tall Bracket
16. V033C provided in the HCA kit has the following characteristics e 32 Mb Uniform 4MB e 90 ns access time 4 0 7 EEPROM The board incorporates an EEPROM that is accessible through an I2C interface The EEPROM is used for storing the Vital Product Data VPD VPD format adheres to the PCI Local Bus specification rev 2 3 VPD definition see Chapter on page 18 EEPROM capacity is 64K Byte Rev 1 2 Mellanox Technologies Jumper Configuration Table 7 Jumper Configuration J4 FLASH FLASH Present Not present No Shorting Block Default FLASH Present Shorting Block present FLASH Not present FLASH_Present 2 J4 1 Ref Default 4 i Name Description Option Configurati Comments on No Shorting Header 1x2 Block Note See Figure 2 HCA Card Mechanical Drawing and Dimensions mm on page 16 for the Jumper location 15 Mellanox Technologies Rev 1 2 16 Mechanical Information Air Flow Reguirement Per the PCI PCI X specifications all the HCA cards covered in this User s Manual require an airflow of 200 LFM at 55 C ambient temperature Board Mechanical Drawings and Dimensions All the HCA cards covered in this User s Manual have the same mechanical drawing and share the same dimensions as depicted in Figure 2 except for the bracket length short or tall Figure 2 HCA Cards Mechanical Drawing and Dimensions mm OOO Si 4 jca amg
17. ble 12 HCA Cards EMC Certification Status EN Class ICES Class MIC BCC HCA Card P N FCC Class USA Oras Canada Korea MHET2X 1SC B B B wer MHET2X ITC B B B MHET2X 2SC B B B MHET2X 2TC B B B A 1 1 FCC Statements USA Class B Statements 15 21 Statement Warning Changes or modifications to this equipment not expressly approved by the party responsi ble for compliance Mellanox Technologies could void the user s authority to operate the equipment 15 105 Statement NOTE This equipment has been tested and found to comply with the limits for a Class B digital device pursuant to part 15 of the FCC Rules These limits are designed to provide reasonable protec tion against harmful interference in a residential installation This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not occur in a particular installation If this equipment does cause harmful interference to radio or television reception which can be determined by turning the equipment off and on the user is encour aged to try to correct the interference by one or more of the following measures e Reorient or relocate the receiving antenna e Increase the separation between the equipment and receiver Connect the equipment into an ou
18. c 13 Large Resource Type VPD R Tag 0x10 0x90 14 Length Ox4F 16 VPD Keyword PN Numbers Add in Card Part Number 18 Length 0x15 19 Data MHET2X 2TC VPD Keyword EC Alphanumeric Engineering Change 40 Level of the card rev 42 Length 0x2 43 Data AI Upper level revision 45 VPD Keyword SN Alphanumeric Serial Number 47 Length 0x18 48 Data MTY YWWF SSSSS 72 VPD Keyword V0 Currently not in use Rev 1 2 Mellanox Technologies Table 11 VPD Format for MHET2X 2TC Offset Decimal Item Value Format Description 74 Length 0x10 75 Data N A 91 VPD Keyword RV 93 Length 0x1 94 Data Checksum 95 Large Resource Type VPD W Tag 0x11 0x91 96 Length 0x9D 98 VPD Keyword V1 EFI Driver version 100 Length 0x6 101 Data N A Number 107 VPD Keyword YA Asset Tag 109 Length 0x20 110 Data N A Alphanumeric N A 142 VPD Keyword RW Remaining read write area 144 Length Ox6e 145 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 356 Mellanox Read Write Mask Ox1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers Mellanox Technologies Rev 1 2 24 Appendix A Specifications A 1 EMC Certification Statements Table 12 lists the approved EMC certification status per HCA card in different regions of the world Ta
19. he LED component gt At the same time extract the bracket as shown in image 18 Make sure to protect the LED while extracting the bracket Mellanox Technologies Rev 1 2 32 Figure 10 Detach the Bracket in a Rotating Move a Card without Clips and Screws b Grip the Card in Prep for Detachment c Detach the Bracket in Rotating Move toward Component Side C 2 Assembling Short Bracket The short bracket can now be assembled onto the HCA card See Figure 11 Figure 11 HCA Card Ready for Short Bracket Rev 1 2 Mellanox Technologies 33 Step 1 Place short bracket onto card Gently place the bracket onto the card fitting the connectors through the bracket connector holes Make sure the LEDs are aligned into their intended bracket holes Figure 12 Place Tall Bracket onto Card LED Holes Step 2 Attach short bracket to card Insert a screw along with a washer into each of the two holes on the card intended for holding the bracket Use a torque screwdriver to apply up to 2 Ibs in torque on each screw Figure 13 Attach Bracket onto Card using Screws Mellanox Technologies Rev 1 2 34 Step 3 Install Connector Clips Gently push one clip onto the connector Make sure to slide both clip hooks sides around the connector evenly as shown in Figure 14 Figure 14 Sliding Connector Clip Evenly Use a small flat head screwdriver to gently slide the clip s hook towards the con
20. nector s base side as shown in Figure 15 Figure 15 Fix Clip Hooks into Place Using Screwdriver Repeat this step for the second clip See Figure 16 Assembled Short Bracket View Figure 16 Assembled Short Bracket View Rev 1 2 Mellanox Technologies Appendix D Avertissements de s curit d installation 1 Instructions d installation Lisez toutes les instructions d installation avant de brancher le mat riel la source d alimentation lectrique 2 Temp rature excessive Ce mat riel ne doit pas fonctionner dans une zone avec une temp rature ambiante d p assant le maximum recommand de 55 C 131 F En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation 3 Empilage du ch ssis Le ch ssis ne doit pas tre empil sur un autre mat riel Si le ch ssis tombe il peut pro voquer des blessures corporelles et des d gradations de biens 4 Connection d Alimentation electrique excedentaire dangers lectriques Ce produit comporte un couvercle qui recouvre l emplacement de l alimentation electrique excedentaire Ne pas faire fonctionner le produit si le couvercle n est pas securise ou si il a ete retire 5 Orages dangers lectriques Pendant un orage il ne faut pas utiliser le mat riel et il ne faut pas brancher ou d b rancher les cables 6 Branchement d branchement
21. niHost Programmer s Reference Manual Reference describing the interface used by developers to write a driver Document no 2111PM for Mem free Mellanox InfiniHost devices InfiniHost MT23108 Hardware Reference Manual Reference for hardware engineers responsible for designing systems and Document no 2112HM boards incorporating InfiniHost components Mellanox Firmware Tools MFT User s Manual User s Manual describing the set of MFT firmware management tools Document no 2204UG for a single InfiniBand node See www mellanox com under Firmware downloads or Management Tools InfiniBand Administration IBADM Package User s Manual User s Manual describing the utilities included in the IBADM tools Document no 2130UM package for system administration of an InfiniBand cluster See www mellanox com under Management Tools Online Resources e Mellanox Technologies Web pages http www mellanox com e Mellanox Technologies Document Distribution System DDS http docs mellanox com requires a customer login account Document Conventions When discussing memory sizes MB and MBytes are used in this document to mean size in mega bytes The use of Mb small b indicates size in mega bits Mellanox Technologies Rev 1 2 8 Overview This document is a User s Manual for Mellanox Technologies host channel adapter HCA cards based on the MT23108 InfiniHost HCA IC device Each of the cards described has the foll
22. owing features e IBTA v1 2 compliant e Two 4X InfiniBand copper ports for connecting InfiniBand traffic 4X IB connectors e Each IB port supports a 10Gb s transmission rate Single Data Rate or SDR e Each IB port includes a media detect circuit supporting external InfiniBand fiber solutions e PCI 2 2 and PCI X 1 0 specifications compliant with a standard 3 3 Volt PCI X edge connector e On board DDR SDRAM memory 128MByte or 256MByte e EU Restriction of Hazardous Substances RoHS compliant Figure 1 MHET2X 1TC HCA Card AA Wel MT2310841 LBC 41003107 InfiniHost Rev 1 2 Mellanox Technologies List of HCA Cards Table 3 lists the HCA cards described in this manual Table 3 HCA Cards List Ordering Part IB Port Onboard Short RoHS Number OPN Speed Memory Tall Complian P Size Bracket ce MHET2X 1SC 10Gb s 128 Short RoHS RS SDR MByte MHET2X ITC Tall MHET2X 2SC 256 Short MByte MHET2X 2TC Tall Mellanox HCA Cards Part Numbering Key Table 4 describes the Mellanox Technologies HCA cards part numbering key Table 4 Mellanox HCA Cards Part Numbering Key Example HCA Card OPN Field Dec der MHET2X 2TC MHTS I XBR Tall Bracket w 256MB Memory M Mellanox Technolo M gies H HCA H HCA Card S Express Card SIOM H T Media C Cu SDR E Cu SDR Fiber Adapter G Cu DDR Fiber E Adapter currently SDR only
23. s and Dimensions Chapter 6 Vital Product Data VPD Format 6 1 PCI VPD Layout for MHET2X 1SC 6 2 PCI VPD Layout for MHET2X 1TC 6 3 PCI VPD Layout for MHET2X 2SC 6 4 PCI VPD Layout for MHET2X 2TC Appendix A Specifications A 1 EMC Certification Statements A 1 1 FCC Statements USA A 1 2 EN Statements Europe A 1 3 ICES Statements Canada A 1 4 VCCI Statements Japan A 1 5 MIC Statement Republic of Korea A 2 HCA Cards Specifications Appendix B Interface Connectors Pinout O a4 a U 10 11 12 12 12 12 13 13 13 13 13 13 13 14 14 14 14 14 15 16 16 16 18 18 19 21 22 24 24 24 25 25 25 25 27 28 Mellanox Technologies Rev 1 2 4 Appendix C Instructions for Replacing a Tall Bracket with a Short Bracket on HCA Cards B 1 12C compatible Connector Pinout B 2 InfiniBand Connector Pinout B 3 PCI X Edge Connector Pinout C 1 Removing Tall Bracket C 2 Assembling Short Bracket Appendix D Avertissements de s curit d installation Rev 1 2 Mellanox Technologies 28 28 29 30 32 35 List of Tables Table 1 Revision History Table 2 Documents List Table 3 HCA Cards List Table 4 Mellanox HCA Cards Part Numbering Key Table 5 Firmware Images for InfiniHostTM PCI X HCA Cards Table 6 LEDs Table 7 Jumper Configuration Table 8 VPD Format for MHET2X 1SC Table 9 VPD Format for MHET2X 1TC Table 10 VPD Format for MHET2X 2SC Table
24. ta MHET2X 2SC 40 VPD Keyword EC Alphanumeric Engineering Change Level of the card rev 42 Length 0x2 43 Data Al Upper level revision 45 VPD Keyword SN Alphanumeric Serial Number 47 Length 0x18 48 Data MTY YWWF SSSSS 72 VPD Keyword Vo Currently not in use 74 Length 0x10 75 Data N A 91 VPD Keyword RV 93 Length 0x1 94 Data Checksum 95 Large Resource Type VPD W Tag 0x11 0x91 96 Length 0x9D 98 VPD Keyword V1 EFI Driver version 100 Length 0x6 101 Data N A Number 107 VPD Keyword YA Asset Tag 109 Length 0x20 110 Data N A Alphanumeric N A Mellanox Technologies Rev 1 2 22 Table 10 VPD Format for MHET2X 2SC e Item Value Format Description 142 VPD Keyword RW Remaining read write area 144 Length Ox6e 145 Data Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 256 Mellanox Read Only Mask 0x0 0 Numbers 356 Mellanox Read Write Mask 0x1 1 Numbers 511 Mellanox Read Only Mask 0x0 Numbers PCI VPD Layout for MHET2X 2TC Note A1 was used as the HCA card upper level revision Later revisions of the HCA card will have the same format Table 11 VPD Format for MHET2X 2TC ni Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length OxA 3 Data Cougar cub Alphanumeri
25. tlet on a circuit different from that to which the receiver is con nected e Consult the dealer or an experienced radio TV technician for help Rev 1 2 Mellanox Technologies 25 A 1 2 EN Statements Europe EN55022 Class B Statement No statement is required for Class B products A 1 3 ICES Statements Canada Class B Statement This Class B digital apparatus complies with Canadian ICES 003 Cet appareil num rique de la classe B est conforme a la norme NMB 003 du Canada A 1 4 VCCI Statements Japan Class B Statement CORES PHLBRESERRSAEMAMBRS VCCI DEH LET lt 772BRBRMRE TT DRE RERA CHATSCC AYELTLEJ P DEEP YA PTLEY a SIEMIUMELT HASHSe SERRA LER K NANE CE TIE LUNU BL E LTFEL Translation This is a Class B product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment VCCI If this is used near a radio or television receiver in a domestic environment it may cause radio interference Install and use the equipment according to instruction manual 0 0 1 MIC Statement Republic of Korea Korea s Regulation for Certification of Information and Communication Equipment requires EMC testing and cer tification for many electronic products Korean EMC certifications are issued by Radio Research Laboratory RRL which is organized under the Ministry of Information and Communications MIC EMC testing includes electromag netic emissions E
26. xible as such they should be carefully attached to or detached from the connectors Refer to the cable manufacturer for spe cial warnings and instructions 5 Equipment Installation This equipment should be installed replaced or serviced only by trained and qualified personnel gt 6 Equipment Disposal Disposal of this equipment should be in accordance to all national laws and regula tions 7 Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes Mellanox Technologies Rev 1 2 11 12 Updating HCA Card Firmware Each HCA card is shipped with the latest version of qualified firmware at the time of manufacturing Firmware is updated occasionally and the most recent firmware can be obtained from http www mellanox com through the Firmware downloads link The HCA firmware download pages include the following firmware update options e Single HCA card firmware update e InfiniBand cluster firmware update e Customized firmware mIx ini firmware update OEMs Only Single HCA Card Firmware Update Firmware can be updated on the standalone single card using the flint tool of the Mellanox Firmware Tools MFT package This package is available for download along with its user s manual from the single HCA card firmware update page See http www mellanox com under Firmware A firmware binaries table lists a binary file
Download Pdf Manuals
Related Search