Mellanox Technologies MNPH29D-XTR
Contents
1. 26 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 Figure 9 Hardware Devices JO Computer Management m Fie Action View Window Help e Bas 2m mU Computer Management Local op E i System Tools 7 Computer EH fil Event Viewer H Disk drives Shared Folders E 2 Display adapters E Local Users and Groups 3 DVD CD ROM drives Performance Logs and Alert iy Human Interface Devices Device Manager 5 3 IDE ATA ATAPI controllers E Sy Storage Keyboards E Removable Storage G Mice and other pointing devices Disk Defragmenter E 3 Monitors Disk Management H S Network adapters de Services and Applications E e Other devices 4 PCI Deve amp i f Ports COM amp LPT FR Processors Sound video and game controllers System devices Universal Serial Bus controllers 3 Select a PCI Device InfiniBand Controller entry 4 Right click 5 Select Properties to display the PCI Device Properties window 6 Click the Details tab and select Device Instance Id Windows 2003 or Hardware Ids Windows 2008 R2 from the Property pull down menu DROES Mellanox Technologies 27 Rev 1 6 Ethernet Adapter Card Installation Figure 10 PCI Device PCI Device Properties IX General Driver Details Resources PLIMVEN 15B3 amp DEV B368 amp SUBSYS 535815B3 amp REV A 0 485335208C 7 7 In the Value display box check the fields VEN and DEV f2. Figure 5 Physical and Logical Link Indications Table 5 LEDs Port Number LED Name Port 1 Physical Link Green Constant on indicates a good physical link Blinking indicates a problem with the Physical link Data Activity Yellow Blinking indicates Data Transfer Port 1 Constant on indicates no Data Transfer Port 2 Physical Link Green Constant on indicates a good physical link Blinking indicates a problem with the Physical link Port 2 Data Activity Yellow Blinking indicates Data Transfer Constant on indicates no Data Transfer Mellanox Technologies 17 Rev 1 6 Adapter Card Interfaces 2 2 2 3 2 3 1 2 3 2 The short bracket has the same port and LED footprint as the tall bracket I C Compatible Interface A three pin header on the card is provided as the IC compatible interface See Appendix A Specifications on page 34 for the location on the board Figure 6 PC Connector Power All adapter cards receive 12V and 3 3V power from the PCI Express Edge connector All other required power voltages are generated by on board switch mode regulators See Specifications on page 34 Memory The adapter cards support multiple memory devices through the PCI Flash and I2C System Memory The card utilizes the PCI Express interface to store and access Ethernet fabric connection informa tion and packet data on the system memory Flash Each of the cards
3. LL lt o 4 j 5 S I D D 4 D U D 3 o D oO o o y m 7 3 m DD F ed GES Ss 4 d lt J xx 8 6 8 x D Y I op gt om a c gt D e gt O vv 0 n SFP Cage TX_Fault 2 Re EY S x E MOD_ABS Mellanox Technologies 41 Rev 1 6 Table 14 SFP Connector Pinout Pin Symbol Name Description 1 VeeT Transmitter Ground Common with Receiver Ground 2 TX Fault Transmitter Fault P 3 TX Disable Transmitter Disable Laser output disabled on high or open 4 SDA 2 wire Serial Interface Data Line 3 SCL 2 wire Serial Interface Clock Line 4 6 MOD ABS Module Absent Grounded within the module Y 7 RSO No connection required 8 RX LOS Loss of Signal indication Logic 0 indicates normal operation 9 RSI No connection required 10 VeeR Receiver Ground Common with Transmitter Ground 11 VeeR Receiver Ground Common with Transmitter Ground 12 RD Receiver Inverted DATA out AC Coupled 13 RD Receiver Non inverted DATA out AC Coupled 14 VeeR Receiver Ground Common with Transmitter Ground 15 VccR Receiver Power Supply 16 VecT Transmitter Power Supply 17 VeeT Transmitter Ground Common with Receiver Ground 18 TD Transmitter Non Inverted DATA in AC Coupled 19 TD Transmitter Inverted DATA in AC Coupled 20 VeeT Transmitter Ground Common with Receiver Ground a Circuit ground is
4. EAR MT 0BD0110004 PSID or OPN Identifying Adapter Cards PSID ConnectX EN ConnectX amp EN network interface card dual port 10GBASE SFP PCIe2 0 x8 2 5GT s mem free tall bracket RoHS R5 PH28B XTC A1 A2 bin z Browse for Product Support START OVER Select a Family Select a Line Select an OPN Select a PSID Rev Product Support Information Adapter Cards Select an Switches Gateweys Y lt gt 3 4 ConnectX EN PXE The Mellanox ConnectX EN PXE solution enables the booting of servers from an IP based LAN environment To enable or disable PXE use the following procedure The user must use the MFT tools To disable one must delete the PXE ROM image from the flash To enable one must place the PXE ROM image to the flash This software is based on the open source Etherboot gPXE project see www etherboot org For more details go to http www mellanox com Products gt Ethernet SW Drivers gt ConnectX EN PXE 24 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 4 Ethernet Adapter Card Installation 4 1 Hardware and Software Requirements Before installing the adapter card please make sure that the system meets the hardware and soft ware requirements listed in Table 9 Refer to Chapter 3 Driver Software and Firmware on page 22 for download and installation instructions Table 9 Hardware and Software Requirements Requirement Description Hardware PCI Express x8 or x16 slots
5. 0x10 0x90 18 Length 7 0 LSB Ox4F 19 Length 15 8 MSB 0x00 20 VPD Keyword PN STR Add in Card Part Number 22 Length 0x15 23 PN PN STR_SPC 44 VPD Keyword EC STR Engineering Change Level of the card rev 46 Length 0x2 47 Revision RV STR PCB revision 49 VPD Keyword SN STR Serial Number 51 Length 0x18 52 SerialNumber STR_SPC 00 00X XXX XX 20 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 Table 8 VPD Layout for MNPH29C X ST R Re Item Value Format Description 76 VPD Keyword VO STR Misc Information 78 Length 0x10 79 Data PCIe Gen2 x8 STR SPC 95 VPD Keyword RV STR 97 Length 0x1 98 Data 0 97 CSO 99 Large Resource Type VPD W Tag 0x11 0x91 100 Length 7 0 LSB 0x99 101 Length 15 8 MSB 0x00 102 VPD Keyword VI STR EFI Driver version 104 Length 0x6 105 Data N A STR SPC 111 VPD Keyword YA STR Asset Tag 113 Length 0x20 114 Data N A STR SPC N A 146 VPD Keyword RW STR Remaining read write area 148 Length Ox6A 149 Data STR_ZERO Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 Mellanox Technologies 21 Rev 1 6 Driver Software and Firmware 3 Driver Software and Firmware 3 4 Driver Software 3 1 1 Linux For Linux download and install the latest MLNX EN driver software package available via the Mellanox Web site at http www mellanox com gt Downloads gt Ethernet SW
6. 3 4 3 1 4 3 1 1 Any PCI slot with the proper configuration is acceptable for connection If the card is installed in a PCI slot with less lanes than the card requires then the adapter card will not provide the optimum data transfer Set Up This section is valid for InfiniBand Ethernet and VPI cards Disregard sections that are not relevant to your card The basic steps to embed Mellanox cards in your computer are 1 Identify the card in your system 2 Verify the computer is recognizing the new adapter 3 Install the adapter drivers 4 Update the adapter firmware if needed The configuration of the card is dependant upon your choice to use InfiniBand or Ethernet Identify the Card in Your System For instructions to identify your adapter card using specific tools see http www mellanox com content pages php pg firmware HCA FW identification Otherwise use the instructions below relevant to your particular card and OS Windows 1 Open Device Manager Click start gt Run and then enter devmgmt msc 2 Check the Device Manager under Other devices for PCI Device Windows 2003 or InfiniBand Controller Windows 2008 R2 If you cannot find any PCI device click Action gt Scan for hardware changes If no T PCI devices are detected check that the network adapter card s is correctly installed in er the PCI slot or try installing the adapter card into a different PCI slot
7. Drivers Follow the installation instruc tions included in the download package 3 1 2 Windows For Windows download the MLNX EN Ethernet driver Download this package from the Mel lanox Web site at http www mellanox com gt Downloads gt Ethernet SW Drivers Follow the installation instruc tions included in the download package 3 2 RDMA over Converged Ethernet RoCE ConnectX 2 EN with RoCE utilizes advances in Data Center Bridging DCB to enable efficient and low cost implementations of RDMA over Ethernet supporting the entire breadth of RDMA and low latency features This includes reliable connected service datagram service RDMA and send receive semantics atomic operations user level multicast user level I O access kernel bypass and zero copy ConnectX 2 EN with RoCE based network management is the same as that for any Ethernet and DCB based network management eliminating the need for IT managers to learn new technolo gies 3 2 1 Hardware and Software Requirements Software Operating System Mellanox OFED 1 5 1 or later Hardware ConnectX 2 EN Adapter Card To use RoCE you will need the following versions of firmware and software OFED 1 5 1 or later firmware version 2 7 700 or later 3 2 2 Installation For installation instructions visit www mellanox com gt Support gt Ethernet SW Driver 22 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 3 3 Up
8. Fah SERS e cafe S UL pa 8 Pri eva gt es eme LO lt lt B omg m s L7 8 E 64 40 O B O AE Ep SEE 68 90 56 9 Ga Emgesa UH g mHE sj si 56 12 gaga Lias rim B CI02 ac Les o m E FRE Lis E Bla N o ERE ne de IG Eg 25 U19282 P Eja a 202 3 ra a ESB a CE baa BE 15 00 3 65 1 90 33 35 43 17 a 2 96 30 gt A 4 EMC Certification Statements Table 12 lists the approved certification status per in different regions of the world Table 12 Adapter Cards Certification Status Adapter Card P N FCC VCCI cTUVus KCC MNPH29C XTR MNPH29C XSR MNPH29D XTR MNPH29D XSR Mellanox Technologies 37 Rev 1 6 A 4 1 FCC Statements USA Class A Statements 15 19 a 4 This device complies with Part 15 of the FCC Rules Operation is subject to the following two conditions 1 This device may not cause harmful interference and 2 This device must accept any interference received including interference that may cause undesired operation 15 21 Statement Warning Changes or modifications to this equipment not expressly approved by the party responsible for compliance Mellanox Technologies could void the user s authority to operate the equipment 15 105 a Statement NOTE This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Ru
9. Firmware and For the latest firmware available please check Software http www mellanox com gt Downloads gt Firmware Operating Systems Distributions Management Tools and Drivers Mellanox management tools can be found at http www mellanox com gt Downloads gt Firmware Tools Linux Driver for ConnectX EN Based Network Interface Cards with 10GigE Sup port can be found at http www mellanox com gt Downloads gt Ethernet SW Drivers Windows Driver for ConnectX EN Based Network Interface Cards with 10GigE Support can be found at http www mellanox com gt Downloads gt Ethernet SW Drivers Mellanox Ethernet Driver for Citrix XenServer 4 1 Mellanox ConnectX EN 10GbE Dual port NIC Support can be found at http www mellanox com gt Downloads gt Ethernet SW Drivers 4 2 Installation Instructions To change a tall bracket to a short bracket see Replacing a Tall Bracket With a Short Bracket on page 43 Read all installation instructions before connecting the equipment to the power source The adapter cards listed in Table 3 on page 11 are standard PCI Express cards each with a stan dard x8 edge connector Please consult the host machine documentation for instructions on how to install a PCI Express card When more than one PCI slot is available make sure to use the PCI slot with the proper configuration Mellanox Technologies 25 Rev 1 6 Ethernet Adapter Card Installation 4
10. Large Resource Type VPD R Tag 0x90 0x10 18 Length 7 0 LSB Ox4F 19 Length 15 8 MSB 0x00 20 VPD Keyword PN STR Add in Card Part Number 22 Length 0x15 23 PN PN STR_SPC 44 VPD Keyword EC STR Engineering Change Level ofthe card rev 46 Length 0x2 47 Revision RV STR PCB revision 49 VPD Keyword SN STR Serial Number 51 Length 0x18 52 SerialNumber STR_SPC 00 00XXXX XX Mellanox Technologies 19 Table 7 VPD Layout for MNPH29D X ST R Rev 1 6 Adapter Card Interfaces Offset Decimal Item Value Format Description 76 VPD Keyword VO STR Misc Information 78 Length 0x10 79 Data PCIe Gen2 x8 STR_SPC 95 VPD Keyword RV STR 97 Length 0x1 98 Data 0 97 CSO 99 Large Resource Type VPD W Tag 0x91 0x11 100 Length 7 0 LSB 0x99 101 Length 15 8 MSB 0x00 102 VPD Keyword VI STR EFI Driver version 104 Length 0x6 105 Data N A STR SPC 111 VPD Keyword YA STR Asset Tag 113 Length 0x20 114 Data N A STR SPC N A 146 VPD Keyword RW STR Remaining read write area 148 Length 0x6A 149 Data STR ZERO Reserved 0x00 255 Small Resource Type END Tag 0x11 0x78 Table 8 VPD Layout for MNPH29C X ST R uM Item Value Format Description 0 Large Resource Type ID String Tag 0x02 0x82 1 Length 7 0 LSB OxE 2 Length 15 8 MSB 0x0 3 Data Hawk Dual Port STR 17 Large Resource Type VPD R Tag
11. changes 2010 Nov 22nd 1 4 Added Generation D card Mini Form Factor 2010 Oct 28th 1 3 Added Technical Support and Firmware and Software Updates sections to the Pref 2010 ace section Added RoCE Added ConnectX EN PXE Added Set up section This is a sanity check after card installation Added KCC statement to Appendix A Added QSFP to SFP QSA adapter Removed Gen 1 cards Formatted EMC table Changed EN 60950 1 2001 to EN 60950 1 2006 Changed RDMA over Ethernet Added RDMA over Ethernet New template April 2010 1 2 New power numbers Feb 2010 1 1 Added Section on PXE boot Feb 2010 1 0 Initial Release Mellanox Technologies 7 Rev 1 6 About this Manual This User Manual describes Mellanox Technologies ConnectX 2 Dual Port 10Gigabit Ethernet PCI Express x8 adapter cards It provides details as to the interfaces of the board specifications required software and firmware for operating the board and relevant documentation Intended Audience This manual is intended for the installer and user of these cards The manual assumes basic familiarity with Ethernet networks and architecture specifications Related Documentation Table 2 Documents List Mellanox Firmware Tools MFT User Manual User Manual describing the set of MFT firmware management tools for a Document no 2204UG single node See http www mellanox com gt Firmware amp Downloads gt Download Firmware Tools Or http
12. include one SPI Flash device accessible via the Flash interface of theMT25408B0 ConnectX 2 EN device There is a jumper on each adapter card that indicates to the device whether an on board Flash device is to be used Table 6 provides information on this jumper See the schematic in Appendix A Specifications on page 34 for the jumper location 18 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 Table 6 Jumper Configuration not present connection shorted Flash not present Flash present AR Card Default Description Option utamur Comments Flash present connection open Flash present connection open Header 1x2 Figure 7 Flash Jumper CLOSED FLASH NOT PRESENT 2 3 3 EEPROM Each board incorporates an EEPROM that is accessible through the I2C The EEPROM is used for storing the Vital Product Data VPD The EEPROM capacity is 4Kb 2 4 VPD Layout The PCI VPD Vital Product Data layout for each of the described Mellanox Technologies Con nectX 2 adapter cards complies with the format defined in the PCI 2 3 Specification Appendix I All ConnectX 2 adapter cards have the same PCI VPD layout Table 7 VPD Layout for MNPH29D X ST R Offset Decimal Item Value Format Description 0 Large Resource Type ID String Tag 0x82 0x02 1 Length 7 0 LSB OxE 2 Length 15 8 MSB 0x0 3 Data Hawk Dual Port STR 17
13. internally isolated from chassis ground b Traurr is an open collector drain output which should be pulled up with a 4 7k 10k Ohms resistor on the host board if intended for use Pull up voltage should be between 2 0V to Vcc 0 3V A high output indicates a transmitter fault caused by either the TX bias current or the TX output power exceed ing the preset alarm thresholds A low output indicates normal operation In the low state the output is pulled to 0 8V c Laser output disabled on TDIS gt 2 0V or open enabled on TDIS 0 8V d Should be pulled up with 4 7kQ 10kQ on host board to a voltage between 2 0V and 3 6V MOD ABS pulls line low to indicate module is plugged in e LOS is open collector output Should be pulled up with 4 7kQ 10kO on host board to a voltage between 2 0V and 3 6V Logic 0 indicates normal operation logic 1 indicates loss of signal 4 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev16 Appendix C Replacing a Tall Bracket With a Short Bracket This section provides instructions on how to remove the tall bracket of a standard Mellanox Tech nologies adapter card and replace it with a short one It includes the following sections Removing a bracket Installing a new bracket C 1 Remove the Existing Bracket from the Adapter Card Figure 17 Remove the Bracket LEDs Once the screws are removed push here with equal pressure on each side Two screws with black fib
14. line should be added to the file etc modprobe conf options mlx4_en lt param_name gt lt value gt lt param_name gt lt value gt Ethernet Network Tuning To improve network perfomance by tuning your network see the Mellanox Performance Tuning Guide located at http www mellanox com related docs prod_software Performance Tuning Guide for Mellanox Network Adapters rev 1 0 pdf 4 4 Cables and Modules The SFP port can connect to the Ethernet through both direct attach cables and stand alone trans ceivers with optical cables SFP transceiver modules are available for both SR and LR protocols See www mellanox com gt Products gt Cables for certified and approved cable recommenda tions 4 4 1 Optical modules for SFP SFP transceiver modules can be used to connect fiber optic cables to the cards greatly increasing the cable reach Mellanox Technologies 31 Rev 1 6 Ethernet Adapter Card Installation The adapter cards are shipped without optical modules Mellanox 10GBASE SR MFMITO2A SR and 10GBASE LR MFMITO2A LR optical modules are recommended The figure below shows the Mellanox SFP module Inserting the Optical Transceiver Module To insert the module into the cage 1 Open the module s locking mechanism see Figure 11 and Figure 12 2 Make sure that the male connectors on the module will align with the female connectors inside of the cage Also check that there is no dirt or foreign matt
15. ofthe chassis before bending upward or downward in the rack To remove a cable disengage the locks and slowly pull the connector away from the port recepta cle Both LED indicators will turn off when the cable is unseated Cables especially long copper cables can weigh a substantial amount Make sure that the weight ofthe cable is supported on its own and is not hanging from the adapter card Mellanox Technologies 33 Rev 1 6 Appendix A Specifications A 1 MNPH29D X ST R Specifications Table 10 Specifications for MNPH29D X ST R Physical Power and Environmental Size Air Flow 10Gb s Connector 2 71in x5 60in 68 90mm x 142 25mm 200LFM SFP Voltage Typ Power Maximum Power 12V 3 3V Passive Cables 6 43W Active Cables 7 83W Passive Cables 7 08W Active Cables 8 48W Temperature 0 C to 55 C Protocol Support Regulatory Ethernet IEEE Std 802 3ae 10 Gigabit Ether EMC FCC 47 CFR part 15 2007 subpart B net class A IEEE Std 802 3ad Link Aggregation ICES 003 2004 issue 4 class A and Failover VCCI V 3 2008 04 class A IEEE Std 802 3x Pause AS NZ CISPR 22 2006 class A IEEE Std 802 1Q VLAN tags 1p EN 55022 1998 A1 2000 A2 priorities 2003 class A IEEE Std 802 1p Priorities EN 55024 1998 A1 2001 A2 IEEE P802 1au D2 0 Congestion 2003 Notification EN 61000 3 2 2006 IEEE P802 1az D0 2 Enhanced EN 61000 3 3 Transmission Selec
16. D OF THE POSSIBILITY OF SUCH DAMAGE Mellanox TECHNOLOGIES Mellanox Technologies Mellanox Technologies Ltd 350 Oakmead Parkway Suite 100 PO Box 586 Hermon Building Sunnyvale CA 94085 Yokneam 20692 U S A Israel www mellanox com Tel 972 4 909 7200 Tel 408 970 3400 Fax 972 4 959 3245 Fax 408 970 3403 Copyright 2011 Mellanox Technologies All rights reserved Mellanox BridgeX ConnectX InfiniBlast InfiniBridge InfiniHost InfiniRISC InfiniScale InfiniPCI PhyX and Virtual Protocol Interconnect are registered trademarks of Mellanox Technologies Ltd CORE Direct and FabricIT are trademarks of Mellanox Technologies Ltd All other marks and names mentioned herein may be trademarks of their respective companies ConnectX 2 Ethernet Card User Manual 2 Mellanox Technologies Document Number 3160 ConnectX 2 Ethernet Card User Manual Rev 1 6 Table of Contents Table of Contents 3 List of Figures 5 List of Tables 6 Revision History 7 About this Manual 8 Intended Audience 8 Related Documentation 8 Online Resources 8 Document Conventions 8 Technical Support 8 Firmware and Software Updates 9 Chapter 1 Overview 10 1 1 Adapter Cards Covered in this Manual 11 1 2 Mellanox Part Numbering Legend 13 1 3 Finding the MAC and Serial Number on the Adapter Cards 14 1 4 Safety Warnings 14 Chapter 2 Adapter Card Interfaces 16 2 1 VO Interfaces 16 2 2 Power 18 2 3 Memory 18 2 4 VPD La
17. Mellanox TECHNOLOGIES ConnectX 2 EN Dual Port SFP Ethernet Adapter Card User Manual MNPH29C XSR MNPH29C XTR MNPH29D XSR MNPH29D XTR Rev 1 6 www mellanox com Rev 1 6 NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE USE OF THE PRODUCT S AND RELATED DOCUMENTATION EVEN IF ADVISE
18. P to indicate IOGBASE SR LR field S H to indicate ConnectX e field 2 to indicate two ports e field I 9 to indicate PCI Express 2 0 x8 running at 5 0GT s field G C to indicate Generation C ConnectX 2 field X X to indicate no on board memory field B T to indicate a tall bracket and e field R R to indicate RoHS R6 compliance Mellanox Technologies 13 Rev 1 6 Overview 1 3 Finding the MAC and Serial Number on the Adapter Cards All Mellanox adapter cards have a label on the printed side of the adapter card that has the card serial number and the card MAC Figure 2 Card Product Label MT0744X000 il N LL Jr Dea P N MNPH29C XTR lif il un UL in BO i il T ii i Il ill Ill Made in IL Y Port 1 uses the GUID or MAC ID described on the label for port 2 GUID or MAC add ER 1 to port 1 s description 1 4 Safety Warnings For safety warnings in French see Avertissements de s curit d installation Warnings in French on page 45 For safety warnings in German see Sicherheitshinweise Warnings in German on page 46 For safety warnings in Spanish see Advertencias de seguridad para la instalaci n Warn ings in Spanish on page 47 1 Installation Instructions A 2 Over temperature This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended 55 C 131 F To guarantee proper air flow allow at
19. anox com gt Support or use the following link to go directly to the Mellanox Support Download Assistant page http www mellanox com supportdownloader Mellanox Technologies 9 Rev 1 6 Overview 1 Overview This document is a User Manual for Mellanox Technologies cards based on the ConnectX 2 ENintegrated circuit device The cards described in this manual have the following main features JEEE Std 802 3 compliant 10 Gb s Ethernet Dual SFP ports for connection Ethernet traffic PCI Express 2 0 1 1 compatible through an x8 edge connector up to 5GT s Fiber Channel encapsulation FCoE RDMA over Converged Ethernet RoCE RoHS R6 Two bracket heights short and tall 10 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 1 1 Adapter Cards Covered in this Manual Table 3 lists the Ethernet adapter cards described in this manual Table 3 Network Interface Cards 3 PCI Express Data Transmission rea SERDES Rate Al RoHS Adapter IC Part Number Number OPN Bracket Speed of ports MNPH29D XTR PCIe Gen2 10 10 Gb s Tall R 6 MT25408B0 FCCR TE 5 0 GT s Ethernet 2 ports MNPH29D XSR PCIe Gen2 10 10 Gb s Short R 6 MT25408B0 FCCR TE 5 0 GT s Ethernet 2 ports MNPH29C XTR PCIe Gen2 10 10 Gb s Tall R 6 MT25408B0 FCCR TE 5 0 GT s Ethernet 2 ports MNPH29C XSR PCIe Gen2 10 10 Gb s Short R 6 MT25408B0 FCCR TE 5 0 GT s Ethernet 2 ports Mellanox Techno
20. ced EN 61000 3 3 Transmission Selection 1995 A1 2001 A2 2005 IEEE P802 1bb D1 0 Priority based standards harmonized under EMC Flow ControlMulticast Directive 2004 108 EC Article 6 2 PCI Express 2 0 SerDes 5 0 GT s Safety UL EU IEC TUV and CB EN 60950 1 2006 EMI CLASS 1 LASER PRODUCT IEC 60 825 1 1993 A1 1997 A2 2001 EN 60825 1 1994 A1 1996 A2 2001 RoHS RoHS R6 a Air flow is measured 1 from the heat sink between the heat sink and the cooling air inlet A 3 Board Mechanical Drawing and Dimensions All of the cards covered in this User Manual have the same mechanical drawing and share the same dimensions as depicted in Figure 13 or Figure 14 Mellanox Technologies 35 Rev 1 6 All dimensions are in millimeters All the mechanical tolerances are 0 1mm Figure 13 Schematic of the ConnectX 2 Small Form Factor MNPH29D Adapter Card HB so IH sl Ov v9 GL 99 12 75 36 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 Figure 14 Schematic of the ConnectX 2 Card MNPH29C Adapter Card J2 I2C Connector J3 Flash Jumper 167 6 7 ol Bal DE Eg of er E Ema J2
21. dating Card Firmware Each card is shipped with the latest version of qualified firmware at the time of manufacturing Firmware is updated occasionally and the most recent firmware can be obtained from http www mellanox com gt Support gt Download Center Check that the firmware on your card is the latest found on the Mellanox site if not update to the latest version found on the Mellanox website Firmware can be updated on the stand alone single card using the flint tool of the Mellanox Firm ware Tools MFT package This package is available for download along with its user manual from the Mellanox Firmware Tools page See http www mellanox com gt Support gt Download Center A firmware binaries table lists a binary file per adapter card The file name of each such binary is composed by combining the firmware name the firmware release version and the card part num ber Please contact Mellanox system support if you cannot find the firmware binary for your adapter card To check the latest firmware 1 Go to Mellanox web site to check current firmware version Go to http www mellanox com supportdownloader 2 Enter your card PSID and compare the firmware versions Mellanox Technologies 23 Rev 1 6 Driver Software and Firmware Figure 8 Support Download Assistant Mellanox TECHNOLOGIES Mellanox Support Download Assistant Support Index Documentation Login Customer Support Returns Home
22. e 7 Flash Jumper 19 Figure 8 Support Download Assistant 24 Figure 9 Hardware Devices 27 Figure 10 PCI Device 28 Figure 11 Module With Locking Mechanism Closed 32 Figure 12 Module With Locking Mechanism Open 32 Figure 13 Schematic of the ConnectX 2 Small Form Factor MNPH29D Adapter Card 36 Figure 14 Schematic of the ConnectX 2 Card MNPH29C Adapter Card 37 Figure 15 Compatible Connector Plug and Pinout 40 Figure 16 Rear View of Module With Pin Placement 41 Figure 17 Remove the Bracket 43 Figure 18 Putting on the Bracket 44 Mellanox Technologies 5 Rev 1 6 List of Tables Table 1 Revision History Table 7 Table 2 Documents List 8 Table 3 Network Interface Cards 11 Table 4 Mellanox Cards Part Numbering Key 13 Table 5 LEDs 17 Table 6 Jumper Configuration 19 Table 7 VPD Layout for MNPH29D X ST R 19 Table 8 VPD Layout for MNPH29C X ST R 20 Table 9 Hardware and Software Requirements 25 Table 10 Specifications for MNPH29D X ST R 34 Table 11 Specifications for MNPH29C X ST R 35 Table 12 Adapter Cards Certification Status 37 Table 13 I2C Compatible Connector Pinout 40 Table 14 SFP Connector Pinout 42 6 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 Revision History This document was printed on 2 15 11 Table 1 Revision History Table Date Rev Comments Changes Jan 2011 1 6 Changed Air flow requirement Added to the Set up section Dec 19th 1 5 Minor formatting
23. er in the module or in the cage Figure 11 Module With Locking Mechanism Closed AA Mellanox gt G MFM1TO2A SN UDLO03JC v rexesrrosece sce DTD 000 3 Insert the module into the adapter card module cage 4 Close the locking Mechanism To remove the module from the cage 1 Unlock the locking mechanism by opening the handle 2 Pull the module out of the cage 4 4 2 Cable Installation All cables can be inserted or removed with the unit powered on To insert a cable press the con nector into the port receptacle until the connector is firmly seated The GREEN LED indicator will light when the physical connection is established that is when the unit is powered on and a cable 1s plugged into the port with the other end of the connector plugged into a functioning port After plugging in a cable lock the connector using the latching mechanism particular to the cable ven dor When a logical connection is made the YELLOW LED will come on When data is being transferred the yellow led will blink A When installing cables make sure that the latches engage 32 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 Always install and remove cables by pushing or pulling the cable and connector in a straight line with the card Care should be taken not to impede the air exhaust flow through the ventilation holes Cable lengths should be used which allow for routing horizontally around to the side
24. er washers 1 Remove the two screws holding the bracket in place 2 Push the bracket off using equal pressure at the top and bottom of the bracket See Figure 17 Be careful not to put stress on the LEDs 3 Save the two screws and the two fiber washers C 2 Installing the New Bracket 4 Place the bracket onto the card until the screw holes line up Do not force the bracket onto the card You may have to gently push the LEDs using a small screwdriver to align the LEDs with the holes in the bracket 5 Screw on the bracket using the screws and washers saved from the procedure above step 1 Mellanox Technologies 43 Rev 1 6 Figure 18 Putting on the Bracket 6 Make sure that the LEDs are aligned onto the bracket holes 7 Use a torque driver to apply up to 2 lbs in torque on the screws 44 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 u r r 9 LI LI Appendix D Avertissements de s curit d installation Warnings in French 1 Instructions d installation Lisez toutes les instructions d installation avant de brancher le mat riel la source d alimentation lectrique 2 Temp rature excessive Ce mat riel ne doit pas fonctionner dans une zone avec une temp rature ambiante d passant le maximum recommand de 55 C 131 F Un flux d air de 200LFM cette temp rature ambiante maximale est n cessaire En outre pour garantir un bon coulement de l air laissez au
25. fication Figure 3 Port Numbering Port 1 2 1 1 Ethernet SFP Interface The ConnectX 2 device is compliant with the IEEE Std 802 3 The SFP port has one Tx Rx pair of SerDes Ethernet NIC cards listed in Table 3 on page 11 based on this device provide access to the Ethernet ports by means of SFP connectors 2 1 2 PCI Express Interface The ConnectX 2 adapter cards support PCI Express 2 0 1 1 compatible through an x8 edge con nector The device can be either a master initiating the PCI Express bus operations or a slave responding to PCI bus operations 16 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 2 1 3 LED Assignment The board has I O LEDs located on the I O panel The green LED when lit indicates that the driver is running and a valid physical connection between nodes exists If the green LED is blink ing it indicates a problem with the physical link The yellow LED when lit indicates a valid data activity link this is the logical link The yellow LED lights up when the network is discovered over the physical link A valid data activity link without data transfer is designated by a constant yellow LED indication A valid data activity link with data transfer is designated by a blinking yel low LED indication If the LEDs are not active either the physical link or the logical link or both connections have not been established Figure 4 LED Port Association Port 1 cen Port 2
26. ields are separated by amp In the display example above notice the sub string PCINVEN 15B3 amp DEV 6368 VEN is equal to Ox15B3 this is the Vendor ID of Mellanox Technologies and DEV is equal to 0x6368 this is a valid Mellanox Technologies PCI Device ID The list of Mellanox Technologies PCI Device IDs can be found in the PCI ID reposi gt tory at http pci ids ucw cz read PC 15b3 8 Ifthe PCI device does not have a Mellanox adapter ID return to Step 3 to check another device 28 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 4 3 1 2 Linux Get the device location on the PCI bus by running Ispci and locating lines with the string Mel lanox Technologies gt lspci grep Mellanox 2 00 0 InfiniBand Mellanox Technologies MT26428 ConnectX VPI PCIe 2 0 5GT s IB QDR 10GigE rev b0 Make sure that either the MLNX_OFED driver or the MLNX_EN driver is loaded and configured Check the link status First check the network interface name by running the ifconfig a command To check the Ethernet link status for EN only and VPI cards run ethtool interface Host ethtool ethl Supported ports TP Supported link modes 10baseT Half 10baseT Full 100baseT Half 100baseT Full 1000baseT Half 1000baseT Full Supports auto negotiation Yes Advertised link modes 10baseT Half 10baseT Full 100baseT Half 100baseT Full 1000baseT Half 1000baseT Fu
27. iente superior a la maxima recomendada 55 C 131 F Adem s para garantizar una circu laci n de aire adecuada se debe dejar como minimo un espacio de 8 cm 3 pul gadas alrededor de las aberturas de ventilaci n gt 3 Cuando hay rayos peligro de descarga el ctrica No utilizar el equipo ni conectar o desconectar cables durante per odos de activ idad de rayos gt 4 Conexi n y desconexi n del cable Copper InfiniBand Dado que los cables de cobre InfiniBand son pesados y no son flexibles su con exi n a los conectores y su desconexi n se deben efectuar con mucho cuidado Para ver advertencias o instrucciones especiales consultar al fabricante del cable 5 Instalaci n de equipos La instalaci n el reemplazo y el mantenimiento de este equipo estar n a cargo nicamente de personal capacitado y competente gt 6 Eliminaci n de equipos La eliminaci n definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales gt Mellanox Technologies 47 Rev 1 6 C digos el ctricos locales y nacionales Este equipo se debe instalar conforme a los c digos el ctricos locales y nacio nales 48 Mellanox Technologies
28. least 8cm 3 inches of clearance around the ven tilation openings Read all installation instructions before connecting the equipment to the power source 14 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 3 During Lightning Electrical Hazard During periods of lightning activity do not work on the equipment or connect or dis connect cables 4 Copper Cable Connecting Disconnecting Some copper cables are heavy and not flexible as such they should be carefully attached to or detached from the connectors Refer to the cable manufacturer for spe cial warnings and instructions 5 Equipment Installation This equipment should be installed replaced or serviced only by trained and qualified personnel 6 Equipment Disposal Disposal of this equipment should be in accordance to all national laws and regula tions 7 Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes gt Mellanox Technologies 15 Rev 1 6 Adapter Card Interfaces 2 Adapter Card Interfaces 2 1 1 0 Interfaces Each card includes the following interfaces SFP ports I O panel LEDs PC compatible connector for debug For dual port cards port 1 connects to connector 1 of the device while port 2 connects to connec tor 2 of the device ConnectX 2 Ethernet Adapter Cards are compliant with the IEEE Std 802 3 Speci
29. les These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial envi ronment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense A 4 2 EN Statements Europe EN55022 Class A Statement Warning This is a class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures A 4 3 ICES Statements Canada Class A Statement This Class A digital apparatus complies with Canadian I CES 003 Cet appareil num rique de la classe A est conforme la norme NMB 003 du Canada 38 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 A 4 4 VCCI Statements Japan Class A Statement CORE FRAEREFERBER EAR EA VCCI OHS CX 24722AAT amp 8S8I XINIEIEB C CORE t RE CHEATS CBR HERZIEELTZLERBSNUEF OGmSltu feme 21359 iR ERT BLIRKENDSZLENBSNET Translation This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment VCCI If this equipment is used in a domestic e
30. ll Advertised auto negotiation Yes Speed Unknown 0 Duplex Half Port Twisted Pair PHYAD 1 Transceiver internal Auto negotiation on Supports Wake on g Wake on d Current message level 0x000000ff 255 Link detected yes To check the IB link status for IB and VPI cards run ibstat and focus on the Physical state attributes Example Host ibstat CA mlx4 0 CA type MT26428 Number of ports 1 Firmware version 2 7 616 Hardware version b0 Node GUID 0x0002c903000c8710 System image GUID 0x0002c903000c8713 Port 1 State Down Physical state Polling Mellanox Technologies 29 Rev 1 6 Ethernet Adapter Card Installation Rate 10 Base lid 6 LMC 0 SM lid 3 Capability mask 0x0251086a Port GUID 0x0002c903000c8711 Link layer IB Check the OFED version To get the version of the running Mellanox OFED BXOFED run the following command Host ofed_info head 1 BXOFED 1 5 1 1 3 7 rc19 Troubleshooting MLNX_OFED Installation For troubleshooting driver installation please check Mellanox OFED driver user manual http www mellanox com gt Support gt Adapter IB VPI SW If you need to update your card firmware download the new firmware Unzip the downloaded file and run flint mstflint command flint d device i fw file guid lt GUID gt guids 4 GUIDS gt mac MAC macs 2 MACs gt burn Check VPI setup Ethernet InfiniBand configurati
31. logies 11 Rev 1 6 Overview Figure 1 SFP NIC Component Side and Bracket Views MNPH29D Annan MNPH29C EET 12 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 1 2 Mellanox Part Numbering Legend Table 4 describes the Mellanox Technologies adapter cards part numbering legend Table 4 Mellanox Cards Part Numbering Key Adapter Card OPN Field Decoder MHTS I XBR M Mellanox Technologies H Adapter Type H InfiniBand Host Channel Adapter N Ethernet Network Interface Card Media P SFP S Adapter H ConnectX or ConnectX 2 Architecture ports 1 1 2 2 I Host Interface X PCI X 4 PCIe x4 8 PCIe Genl x8 9 PCIe Gen2 x8 G Generation lt blank gt Initial product generation B generation B C generation C Separator X Memory Size X MemFree 1 128MB 2 256MB 3 512MB B Bracket S Short T Tall N None R RoHS lt blank gt non RoHS C RoHS R 5 w Exemption R RoHS R 6 Lead Free For example the part number MNPH29C XTR describes Mellanox Technologies ConnectX EN adapter card with two SFP ports a PCIe2 0 x8 5 0GT s interface no on board memory mem free a tall bracket and ROHS R6 compliance Using the legend e field M M to indicate a Mellanox Technologies product field H N to indicate a Network Interface Card field T
32. moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation 3 Orages dangers lectriques Pendant un orage il ne faut pas utiliser le mat riel et il ne faut pas brancher ou d brancher les c bles 4 Branchement d branchement des c bles InfiniBand en cuivre Les c bles InfiniBand en cuivre sont lourds et ne sont pas flexibles il faut donc faire tr s attention en les branchant et en les d branchant des connecteurs Consultez le fab ricant des c bles pour connaitre les mises en garde et les instructions sp ciales 5 Installation du mat riel Ce mat riel ne doit tre install remplac ou entretenu que par du personnel form et qualifi 6 Elimination du mat riel L limination de ce mat riel doit s effectuer dans le respect de toutes les l gislations et r glementations nationales en vigueur 7 Codes lectriques locaux et nationaux Ce mat riel doit tre install dans le respect des codes lectriques locaux et AN nationaux Mellanox Technologies 45 Rev 1 6 Appendix E Sicherheitshinweise Warnings in German 1 Installationsanleitungen Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die Stromversorgung anschlie en gt D bertemperatur Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von 55 C 131 F betrieben werden Es ist ein Luft strom von 200 LFM bei maximaler Umgebungstemperatur erforde
33. nvironment radio interference may occur in which case the user may be required to take corrective actions A 4 5 KCC Certification Korea English Translation Device User s information Az 2171 L OS e AZ Ize s ol 7 7 e AF S Ag S z Mau Ae esRE E 7 7 o e L OHA EE ASAE 0 HS dera 73919 RIAA AFS EE AS CLASS A device d rd This device has been approved by EMC registration commercial broadcasting and Distributors or users pay attention to this point This device is communication equipmen usually aimed to be used in other area except at home e Remark Class A device operated in a commercial area Mellanox Technologies 39 Rev 1 6 Appendix B Interface Connectors Pinout B 1 12C Compatible Connector Pinout Figure 15 Compatible Connector Plug and Pinout Table 13 I2C Compatible Connector Connector Pin Number Signal Name 1 SPSDA 5 1 2 3 4 2 SPSCL wat al of 3 GND 4 NC 3 NC B 2 PCI Express x8Connector Pinout These cards use a standard PCI Express x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 2 0 specification 40 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 B 3 PCI Express Connector Pinout B 4 SFP Connector Pinout Figure 16 Rear View of Module With Pin Placement Top 13 70 8 50 O ee ri Sr i BS ue N 7 3
34. on For Example flint d dev mst mt26428 pci crO0 i fw 25408 2 7 000 MNPH28B XTC A1 A2 bin burn Loading the Ethernet Driver By default the Mellanox OFED stack loads mlx4 en Run lsmod to verify that the module is listed Example Hosts lsmod grep mlx4 en mlx4 en 109708 0 mlx4 core 136804 2 mlx4 en mlx4 ib If you don t see the mlx4 en driver run modprobe mlx4 en Another option is to use the command below to see which modules are active Edit etc infiniband openib conf which modules needs to loaded from a service For example Load MLX4 EN module MLX4 EN LOAD yes 30 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 The Usage openibd start stop restart status command to modify this file and thereby control the drivers Ethernet Driver Usage and Configuration To assign an IP address to the interface run gt ifconfig eth lt n gt lt ip gt where n is the OS assigned interface number To check driver and device information run gt ethtool i eth lt n gt Example gt ethtool i eth2 driver mlx4_en MT_04A0140005 version 1 5 1 March 2010 firmware version 2 7 000 bus info 0000 13 00 0 The mlx4 en parameters can be found under sys module mlx4 en or sys module mlx4 en parameters depending on the OS and can be listed using the command gt modinfo mlx4 en To set non default values to module parameters the following
35. rlich Au erdem sollten mindestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten 3 Bei Gewitter Elektrische Gefahr Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Kabel an oder ab gt 4 Anschlie en Trennen von InfiniBand Kupferkabel InfiniBand Kupferkabel sind schwer und nicht flexible Deshalb m ssen sie vorsichtig an die Anschl sse angebracht bzw davon getrennt werden Lesen Sie die speziellen Warnungen und Anleitungen des Kabelherstellers gt 5 Ger teinstallation Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert ausge tauscht oder gewartet werden 6 Ger teentsorgung Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationalen Gesetze Bestim mungen erfolgen gt 7 Regionale und nationale elektrische Bestimmungen Dieses Ger t sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden gt 46 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 Appendix F Advertencias de seguridad para la instalaci n Warnings in Spanish 1 Instrucciones de instalaci n Antes de conectar el equipo a la fuente de alimentaci n leer todas las instruc ciones de instalaci n gt 2 Sobrecalentamiento No se debe utilizar el equipo en un rea con una temperatura amb
36. tion 1995 A1 2001 A2 2005 IEEE P802 1bb D1 0 Priority based standards harmonized under EMC Flow ControlMulticast Directive 2004 108 EC Article 6 2 PCI Express 2 0 SerDes 5 0 GT s Safety UL EU IEC TUV and CB EN 60950 1 2006 EMI CLASS 1 LASER PRODUCT IEC 60 825 1 1993 A1 1997 A2 2001 EN 60825 1 1994 A1 1996 A2 2001 RoHS RoHS R6 a Air flow is measured 1 from the heat sink between the heat sink and the cooling air inlet 34 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 A 2 MNPH29C X ST R Specifications Table 11 Specifications for MNPH29C X ST R Physical Power and Environmental Size 2 71in x6 60in 68 90mm x Voltage 12V 3 3V 167 65mm Typ Power Passive Cables 6 43W Air Flow 200LFM Active Cables 7 83W 10Gb s Connector SFP Maximum Power Passive Cables 7 08W Active Cables 8 48W Temperature 0 C to 55 C Protocol Support Regulatory Ethernet IEEE Std 802 3ae 10 Gigabit Ether EMC FCC 47 CFR part 15 2007 subpart B net class A IEEE Std 802 3ad Link Aggregation ICES 003 2004 issue 4 class A and Failover VCCI V 3 2008 04 class A IEEE Std 802 3x Pause AS NZ CISPR 22 2006 class A IEEE Std 802 1Q VLAN tags 1p EN 55022 1998 A1 2000 A2 priorities 2003 class A IEEE Std 802 1p Priorities EN 55024 1998 A1 2001 A2 IEEE P802 1au D2 0 Congestion 2003 Notification EN 61000 3 2 2006 IEEE P802 1az D0 2 Enhan
37. www mellanox com gt Support gt Download Firmware Tools IEEE Std 802 3 Specification This is the IEEE Ethernet specification http standards ieee org getieee802 PCI Express 2 0 Specifications Industry Standard PCI Express 2 0 Card Electromechanical Specification Rev 1 3 Online Resources Mellanox Technologies Web pages http www mellanox com Mellanox Technologies Firmware download Web page http www mellanox com gt Document Conventions When discussing memory sizes MB and MBytes are used in this document to mean size in mega bytes The use of Mb or Mbits small b indicates size in mega bits Technical Support Customers who purchased Mellanox products directly from Mellanox are invited to contact us through the following methods URL http www mellanox com gt Support E mail support mellanox com 8 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 Tel 1 408 916 0055 Customers who purchased Mellanox M 1 Global Support Services please see your contract for details regarding Technical Support Customers who purchased Mellanox products through a Mellanox approved reseller should first seek assistance through their reseller Firmware and Software Updates The Mellanox support downloader contains software firmware and knowledge database informa tion for Mellanox products Access the data base from the Mellanox Support Web page http www mell
38. yout 19 Chapter 3 Driver Software and Firmware 22 3 1 Driver Software 22 3 2 RDMA over Converged Ethernet RoCE 22 3 3 Updating Card Firmware 23 3 4 ComnectX EN PXE 24 Chapter 4 Ethernet Adapter Card Installation 25 4 1 Hardware and Software Requirements 25 4 2 Installation Instructions 25 43 Set Up 26 4 4 Cables and Modules 31 Appendix A Specifications 34 A 1 MNPH29D X ST R Specifications 34 A 2 MNPH29C X ST R Specifications 35 A 3 Board Mechanical Drawing and Dimensions 35 A 4 EMC Certification Statements 37 Appendix B Interface Connectors Pinout 40 B 1 I2C Compatible Connector Pinout 40 B 2 PCI Express x8Connector Pinout 40 B 3 PCI Express Connector Pinout 41 B 4 SFP Connector Pinout 41 Appendix C Replacing a Tall Bracket With a Short Bracket 43 C 1 Remove the Existing Bracket from the Adapter Card 43 C 2 Installing the New Bracket 43 Appendix D Avertissements de securite d installation Warnings in French 45 Mellanox Technologies 3 Rev 1 6 Appendix E Sicherheitshinweise Warnings in German 46 Appendix F Advertencias de seguridad para la instalaci n Warnings in Spanish 47 4 Mellanox Technologies ConnectX 2 Ethernet Card User Manual Rev 1 6 List of Figures Figure 1 SFP NIC Component Side and Bracket Views 12 Figure 2 Card Product Label 14 Figure 3 Port Numbering 16 Figure 4 LED Port Association 17 Figure 5 Physical and Logical Link Indications 17 Figure 6 I2C Connector 18 Figur
Download Pdf Manuals
Related Search