Mellanox Technologies
Contents
1. gt 3 Empilage du ch ssis Le ch ssis ne doit pas tre empil sur un autre mat riel Si le ch ssis tombe il peut pro voquer des blessures corporelleset d s d gradations de biens gt 4 Connection d Alimentation electrique excedentaire dangers lectriques Ce produit comporte un couvercle transparent sur l espace pour l alimentation lec trique redondante Ne pas faire fonctionner le produit si le couvercle transparent n est pas solidement fixe ou s il estenlev gt 5 Orages dangers lectriques Pendant un orage il ne faut pas utiliser le mat riel et il ne faut pas brancher ou d brancher les cables 6 Branchement d branchement des cables InfiniBand en cuivre Les cables InfiniBand en cuivre sont lourds et ne sont pas flexibles il faut donc faire tr s attention en les branchant et en les d branchant des connecteurs Consultez le fab ricant des cables pour connaitre les mises en garde et les instructions sp ciales 7 Montage et entretien sur baie Lorsque ce produit est mont ou entretenu sur baie il faut prendre des pr cautions sp ciales pour s assurer que le syst me reste stable En g n ral il faut remplir la baie avec du mat riel de bas en haut gt Mellanox Technologies Rev 1 3 26 8 Installation du mat riel Ce mat riel ne doit tre install remplac ou entretenu que par du personnel form et qualifi 9 Elimination du mat riel L2. O OK The system is up and running Error A fault in the system most likely the firmware did not BOOT properly O O Off The system has no power Power Supply Status Indicators The MTS3600 36 Port Switch is available with one or two factory installed Power Supply Units For switches with only one unit installed a second Power Supply Unit can be added to increase security and to add redundancy Figure 4 MTS3600 QSFP Front Panel Place 1 secondary i Primary Power Power Supply Unit Fan Unit Supply Unit The primary power supply unit PSU1 is located on the right side of the front panel with PSU2 on the left side St tus indicators are located just to the left of the primary power supply unit Each PSU also has three status LEDs on the right side of the PSU that indicate the internal status of the unit AC This LED when lit indicates input voltage between 90 and 264 Volts This LED when lit indicates a fault in the power supply OK This LED when lit indicates that the output from the power supply is 12VDC The PSU status indicators are located just to the left of the primary power supply unit and labeled PSU1 and PSU2 The following status conditions are possible Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual 2 1 1 3 Fan Status Indicators 2 1 2 2 1 3 2 1 3 1 Table 5 PSU Status LED Configurations LED Configurati
3. 444mm X 605mm 41 45 Ibs 1 PSU 44 0 lbs 2 PSUs 19 Rack mount 70 5 CFM 10 or 20 Gb s per port QSFP Input Voltage Power Consumption Temperature Humidity Shock and Vibration 90 264 VAC 47 63Hz 316W Dissipated Power 190W Power through connector 126W 10 to 45 Celsius 10 90 non condensing ETSI EN 300 019 2 2 1999 09 Protocol Support Regulatory Compliance InfiniBand Auto Negotiation of 20Gb s or 10Gb s Safety US Canada cTUVus EU IEC60950 QoS 8 InfiniBand Virtual Lanes for all ports International CB Management Baseboard Performance and Device man EMC Emissions USA FCC Class A agement Agents for full InfiniBand In Band Canada ICES Class A Management EU EN55022 Class A EU EN55024 Class A Data Rate DDR EU EN61000 3 2 Class A Environmental Acoustic Sound power level EU EN61000 3 3 Class A Japan VCCI Class A EU IEC 60068 2 64 Random Vibration EU IEC 60068 2 29 Shocks Type I II EU IEC 60068 2 32 Fall Test ISO 7779 ETS 300 753 70 5 dB A or 7 1 Bel Scalability and Performance Features Reliability Availability and Serviceability Switching Performance Addressing Switching Capacity Simultaneous wire speed any port to any port 48K Unicast Addresses Max per Subnet 16K Multicast Addresses per Subnet 1 44Tb s Hot Swappable 1 1 Redundant Fan Module and Power Supplies Power Sup
4. Cable lengths should be used which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack Extracting and Inserting the Fan Unit Operation without a fan unit should not exceed two minutes During fan hot swap if both indicators are OFF then the fan unitis disconnected To extract a Fan Unit 1 Loosen the two thumb screws locking the fan tray in place One of the fan status indicators either green or yellow will remain on 2 Pull the fan unit out by pulling on the thumbscrews As the fan unseats the fan status indicator will turn off To insert a FAN Unit 1 Make sure the mating connector of the new unit is free of any dirt and or obstacles 2 Insert the fan unit by sliding it into the opening until slight resistance is felt Continue pressing the fan unit until it seats completely 3 Turn the two thumb screws to l ckithe fan unit in place Note The green fan status indicator should light and the yellow fan status should remain off If not extract the fan unit and re insert it After two unsuccessful attempts to install the fan unit power off the switch before attempting any system debug Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual 3 3 1 3 2 3 2 1 3 2 2 Management and Tools Overview Network Mangemant and Clustering Software Download and install on all nodes the Mellanox OpenFabric software package for
5. lid 2 in order to access the device 3 Program the MTS3600 firmware by running flint d lid 2 i fw IS4 rel 7 0 142 MTS3600Q Al bin b 4 Power cycle the switch by unplugging and replugging the power cord to load the new firmware Reprogramming the MT3600 Through The I2C Port Use the MTUSB 1 adapter available from Mellanox to reprogram the switch firmware using a server or PC running MFT Mellanox Technologies 15 Rev 1 3 16 3 2 2 1 Rev 1 3 Figure 7 MTUSB 1 with Cables TS The MTUSB adapter has two connections for cables One cable is a I2C cable with male connectors on both ends The other is a USB cable with one type A host connection to be connected to the server or PC and a type B connection to be connected to the MTUSB adapter Figure 8 I2C Cable Connected to MTS3600 With the switch connected to a computer through the MTUSB it is now possible to reprogram the SPI Flash memory Instructions for Reprogramming Through the I2C Port 1 Make sure that the MTUSB I2C cable is connected to the switch and USB cable is connected to a computer e MFT is running on the computer e mtusb 1 mst device appears in mst status 2 Set the MTS3600 I2C switch to allow access by running isw d dev mst mtusb 1 s shark p L1 3 Run the burn command flint d dev mst mtusb 1 i fw IS4 rel 7_0_142 MTS3600Q_Al bin qq b 4 Power cycle the switch by unplugging and re plugging the power cord to loa
6. limination de ce mat riel doit s effectuer dans le respect de toutes les l gislations et r glementations nationales en vigueur 10 Codes lectriques locaux et nationaux Ce mat riel doit tre install dans le respect des codes lectriques locaux et nationaux Rev 1 3 Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual Anhang F Installation Sicherheitshinweise German 1 Installationsanleitungen Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die Stromversorgung anschlie en 2 bertemperatur Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von 45 C 113 F betrieben werden Au erdem sollten mindestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten gt 3 Stapeln des Chassis Das Chassis sollte nicht auf andere Ger te gestapelt werden Wenn das Chassis herunt erf llt kann es zu Verletzungen und Besch digungen an Ger ten f hren gt 4 Redundanter Stromversorgungsanschluss Elektrische Gefahr Dieses Produkt verf gt ber eine Abdeckung ber dem Bereich f r die redundante Stromversorgung Betreiben Sie das Produkt nicht wenn diese Abdeckung nicht sicher festsitzt oder entfernt wurde 5 Bei Gewitter Elektrische Gefahr Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en S
7. Appendix D Replacement Parts Ordering Numbers Appendix E Avertissements de s curit d installation French Appendix F Installation Sicherheitshinweise German Appendix G Special Regulations Regarding Finland Sweden Denmark and Norway Mellanox Technologies Doou Na NQNuuuu us Q e ee BE D D ui Ben Annan D D D D D D e m eo BR D KA Rev 1 3 4 Revision History Rev 1 3 Table 1 Revision History Table Date Revision Description October 2008 Rev 1 3 Minor Formatting changes September 2008 Rev 1 2 Added Reprogramming the MT3600 Through The I2C Port section Added power cord OPNs to table 11 in Appendix D September 2008 Rev 1 1 Fixed link to Software package page September 2008 Rev 1 0 Initial release Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual 5 About this Manual This manual describes the installation and basic use of the Mellanox MTS3600 switch based on the InfiniScale IV InfiniBand switch device Intended Audience This manual is intended for users and system administrators responsible for installingsand setting up the switch platforms listed above The manual assumes familiarity with the InfiniBand Architecture Specification Related Documentation Additional Documentation available from Mellanox Table 2 Reference Documents Mellanox Firmware The MFT Mellanox Firmware To
8. Interface 20 GND enD 19 21 Rx2n Rxin 18 Table 10 InfiniBand QSFP Connector Pinout 22 17 23 ae ane 16 Connector Connector Signal Description pr Pin Number Pin Name Ban FE 1 GND Ground Rx4p Rx3p 2 Tx2n Transmitter Inverted Data Input 26 GND GND 3 Tx2p Transmitter Non Inverted Data Input 27 __ ModPrsL spa 4 GND Ground 2g IntL SCL 1 5 Tx4n Transmitter Inverted Data Input 29 VecTx Vcc Rx 18 6 Tx4p Transmitter Non Inverted Data Input 30 vet Reset 9 7 GND Ground 31 PMode ModSelLL 8 8 ModSelL ModuleSelect 32 GND GND 9 Reset Module Reset 33 Tx3p Tx4p 6 10 Vcc Rx 3 3 V Power supply receiver 34 Txan Tx4n 5 11 SCL 2 wire serial interface clock ei GND 4 12 SDA 2 wire serial interface data 7 Rip DER gt 13 GND Ground Zr pen 1 14 Rx3p Receiver Non Inverted Data Output 38 GND GND 15 Rx3n Receiver Inverted Data Output 16 GND Ground 17 Rxlp Receiver Non Inverted Data Output 18 RxIn Receiver Inverted Data Output 19 GND Ground 20 GND Ground 21 Rx2n Receiver Inverted Data Output 3 22 Rx2p Receiver Non Inverted Data Output 3 23 GND Ground 24 Rx4n Receiver Inverted Data Output 3 25 Rx4p Receiver Non Inverted Data Output 3 26 GND Ground 27 ModPrsL Module Present 28 IntL Interrupt 29 Vcc Tx 3 3 V Power supply transmitter 30 Vcc 1 3 3 V Power Supply 31 LPMode Low Power Mode 32 GND Ground 33 Tx3p Transmitter Non Inverted Data Input 34 Tx3n Transmitter Inverted Data Input 35 GND Ground 36 Tx1p Trans
9. Linux Win dows or other operating systems from the Mellanox software website http www mellanox com products software php This software package provides connectivity for server and storage systems utilizing High Perfor mance Computing HPC or enterprise data center EDC applications across n InfiniBand fabric It also provides a subnet manager for simple network configuration and network administration and diagnostic tools for network management Updating Firmware The switch is delivered with the latest Firmware available at the time of production New firmware versions will be posted on the Mellanox firmware download page http www mellanox com support firmware_tablealS4 php You will need the Mellanox Firmware Tools package available in the Mellanox OpenFabrics soft ware package to update firmware for this switch It can also be downloaded from http www mellanox com products management_tools php Instructions for Reprogramming Over the InfiniBand Network 1 Make sure that e aConnectX adapter is connected to the MTS3600 via an InfiniBand cable the InfiniBand link is active and e Opensm is running 2 Get the LID of the switch On the host with the ConnectX adapter run usr sbin ibnodes The command will return the following Ca 0x0002c903000587cc ports 2 adv028 HCA 1 Switch 0x0002c9000100d050 ports 36 base port 0 lid 2 Imc 0 In the example above the switch device has LID number 2 Use device name
10. Mellanox TECHNOLOGIES InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual P N MTS3600Q 1UNC MTS3600Q 2UNC MTS3600R 1UNC MTS3600R 2UNC Rev 1 3 Mellanox Technologies Rev 1 3 Copyright 2008 Mellanox Technologies All rights reserved Preliminary information Subject to change without notice Mellanox Technologies ConnectX InfiniBlast InfiniBridge InfiniHost InfiniRISC InfiniScale and InfiniPCI are registered trademarks of Mellanox Technologies Ltd Virtual Protocol Intercon nect is a trademark of Mellanox Technologies Ltd All other trademarks are property of their respective owners InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual Document Number 2983 Mellanox Technologies Inc 2900 Stender Way Santa Clara CA 95054 U S A www mellanox com Tel 408 970 3400 Fax 408 970 3403 Mellanox Technologies Ltd PO Box 586 Hermon Building Yokneam 20692 Israel Tel 972 4 909 7200 Fax 972 4 959 3245 NOTE THISINFORMATION IS PROVIDED BY MELLANOX FOR INFORMATIONAL PURPOSES ONLY AND ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTIC ULAR PURPOSE ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE FOR ANY DIRECT INDIRECT INCIDENTAL SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES INCLUDING BUT NOT LIMITED TO PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BU
11. N 300 019 2 2 1999 09 Connector Types QSFP Protocol Support Regulatory Compliance InfiniBand Auto Negotiation of 40Gb s 20Gb s 10Gb s Safety US Canada cTUVus EU IEC60950 QoS 8 InfiniBand Virtual Lanes for all ports International CB Management Baseboard Performance and Device man EMC Emissions USA FCC Class A agement Agents for full InfiniBand In Band Canada ICES Class A Management EU EN55022 Class A EU EN55024 Class A Data Rate QDR EU EN61000 3 2 Class A Environmental Acoustic Sound power level EU EN61000 3 3 Class A Japan VCCI Class A EU IEC 60068 2 64 Random Vibration EU IEC 60068 2 29 Shocks Type I II EU IEC 60068 2 32 Fall Test ISO 7779 ETS 300 753 70 5 dB A or 7 1 Bel Scalability and Performance Features Reliability Availability and Serviceability Switching Performance Addressing Switching Capacity Simultaneous wire speed any port to any port 48K Unicast Addresses Max per Subnet 16K Multicast Addresses per Subnet 2 88Tb s Hot Swappable 1 1 Redundant Fan Module and Power Supplies Power Supplies Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual Table 8 MTS3600R Specification Data Physical Power and Environmental Size Weight Mounting Air Flow SerDes Speeds Connector Types 1 73 1U H x 17 5 W x23 8 D 44mm X
12. SINESS INTERRUP TION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CON TRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY OUT OF THE USE OF THIS HARDWARE EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual Table of Contents Table of Contents Revision History About this Manual Intended Audience Related Documentation Conventions Switch Products Covered in this User s Manual Chapter 1 Overview 1 1 Serial Number and Product Version Information Chapter 2 Installation and Basic Operation 2 1 Switch Platform Hardware Overview 2 1 1 2 1 2 2 1 3 Status LEDs I2C Connector Optional Management Interfaces Advanced Management Only 2 2 Switch Platform Installation and Operation 2 2 1 2 2 2 2 2 3 2 2 4 2 2 5 2 2 6 Installation Safety Warnings Mechanical Installation Power Connections and Initial Power On Extracting and Inserting the Power Supply Unit InfiniBand Cable Installation Extracting and Inserting the Fan Unit Chapter 3 Management and Tools Overview 3 1 Network Mangemant and Clustering Software 3 2 Updating Firmware 3 2 1 3 2 2 Instructions f r Reprogramming Over the InfiniBand Network Reprogramming the MT3600 Through The I2C Port Chapter 4 Troubleshooting Appendix A Specification Appendix B Switch Hardware Components Appendix C QSFP Interface
13. XX PIN MTS36000 1UNC II GUID HHHHHHHHHHHHHHHH Made In IL Also on this label is the GUID identifier for the switch Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual 7 2 Installation and Basic Operation 2 1 Switch Platform Hardware Overview Figure 2 shows the front and rear panel views of the QSFP switch The figure shows port configu rations for the switch systems including the dual hot swap power supplies and hot swap fan mod ule I2C connector RJ45 connector USB connectors VGA port connector and various status LEDs Figure 2 QSFP Switch System Front and Back Panels All InfiniBand connectivity is via the fear panel All connectors can support active cables 2 1 1 Status LEDs Figure 3 Power and System LEDs STATUS S A Sys Fine pet COTE Handle System DC output from Status the PSU is OK Indicators STATUS There is a fault ED in the PSU Switch Fan Sys Status Fans neat Indicators s nput voltage PSU I is good PSU Status PSU2 Indicators 2 Mellanox Technologies Rev 1 3 8 2 1 1 1 System Status Indicators 2 1 1 2 Rev 1 3 The System Status Indicators are located just to the left of the primary power supply unit and labeled Sys The following status conditions are possible Table 4 System Status LED Configurations LED Configuration Status
14. d the new firm ware Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual 4 17 Troubleshooting As soon as a switch is plugged in make sure that the green power LEDs on the PSU are on Power supply unit 1 If the AC power LED is off check that the power cable is plugged into a working outlet Check that the power cable has a voltage within the range of 90 264 volts AC 2 Remove and reinstall the power cable 3 If the AC power LED is green but the OK power LED is off or the A LED is on Replace the PSU The Status green power LED for PSU1 or PSU2 does not comeon 1 If the OK LED on the PSU is on but the system LED is off remove and reinstall the PSU Make sure the mating connector of the new unit is free of any dirt and or obstacles 2 If the OK LED on the PSU is off check that OK LED on the PSU Unit is on 3 Remove and reinstall the power cable Check that the power outlet in the wall is working 4 Remove and reinstall the PSU Make sure the mating connector of the new unit is free of any dirt and or obstacles 5 Replace the PSU The power LED for the switch shuts off 1 Check that the there is adequate ventilation 2 Make sure that there is nothing blocking the front or rear of the chassis and that the fan modules and ventilation holes are not blocked especially dust over the holes 3 If you find dust blocking the holes it is recommended to clean the fan un
15. e Mellanox Technologies Rev 1 3 10 2 1 3 2 RJ 45 Ethernet Connector 2 1 3 3 2 2 2 2 1 Rev 1 3 The Ethernet connection provides access for remote management The MTS3600 can be connected to an Ethernet switch or the Ethernet port of a computer USB interface There are two USB ports for connecting a keyboard and mouse for local management operation Switch Platform Installation and Operation Installation and initialization of the switch platform are straightforward processes requiring atten tion to the normal mechanical power and thermal precautions for rack mounted equipment The switch platform does not require any programming or configuration tofoperate as a basic InfiniBand switch and includes all of the necessary functionality to operate with external standard InfiniBand Subnet Management software This section describes the installation process and basic operation of the switch platform Please first read the warnings sub section carefully before carrying on with installation procedures Installation Safety Warnings For Safety Warnings in French see Appendix Evon page 25 and for German see Appendix F on page 27 For Special Regulations Regarding Finland Sweden Denmark and Norway see Appendix G on page 29 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source gt 2 Over temperature This equipment should not be operated
16. ed only by trained and qualified personnel 9 Equipment Disposal Disposal of this equipment should be in accordance to all national laws and reg ulations 10 Local and National Electrical Codes This equipment should be installed in compliance with local and national elec trical codes 2 2 2 Mechanical Installation The switch platform uses a rack mounted switch designed for installation in a standard 19 rack with all InfiniBand ports on the rear of the enclosure The front of the switch includes a hot swap power supply module with an optional second PSU for redundancy hot swap fan tray and IO ports for an optional CPU advanced management board The hot swap fan module provides front to back air flow The switch platform contains auto sensing 90 264 VAC connections for all possible PSUs The installer should use a rack capable of supporting the mechanical and environmental character istics of a fully populated switch platform The rack mounting holes conform to the IEA 310 standard for 19 inch racks Take pre cautions to guarantee proper ventilation for air intake at the front of the chassis and exhaust at the rear in order to maintain good airflow at ambient temperature Cable routing in particular should not impede the air exhaust from the chassis Mellanox Technologies Rev 1 3 12 Note The switch platform can be either front or rear mounted The notion of front and back is arbitrary h
17. ent Warning This is a class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures Rev 1 3 Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual A 1 3 ICES Statements Canada Class A Statement This Class A digital apparatus complies with Canadian ICES 003 Cet appareil num rique de la classe A est conforme la norme NMB 003 du Canada A 1 4 VCCI Statements Japan Class A Statement CORB PHUBRES ES RRS ERMER VCCI D K DIIDTTZXMNFERH TRETT CORE t REM TEATS CBR HWERZIEELTZLERBSNEF TONGA ERE DN ED EET BEDFBRKENSCECPHVET A 1 5 Translation This is a Class A product based on the standard of the Voluntary Control Council for Interfer ence by Information Technology Equipment VCCI If this equipment is used in a domestic environment radio inter ference may occur in which case the user may be required to take corrective actions Mellanox Technologies Rev 1 3 22 Appendix B Switch Hardware Components Place for Optional Secondary Power Primary Power Supply Unit Fan Unit Supply Unit m D 1 Rev 1 3 Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual Appendix C QSFP
18. fully grounded outlet Do not connect this unit to any outlet that is not fully grounded gt e Finland Laite on liitett v suojamaadoituskoskettimilla varustettuun pistorasiaan gt Norway Apparatet m tilkoplesjordet stikkontakt Unit is intended for connection to IT power systems for Norway only e Sweden Apparaten skall anslutas till jordat uttag Mellanox Technologies Rev 1 3
19. generation InfiniScale IV InfiniBand switch device MTS3600 systems provide up to 40Gb s full bidirectional bandwidth per port With 36 ports these systems are among the densest switching sys tems available These stand alone switches are an ideal choice for top of rack leaf connectivity or for building small to medium size clusters The switch comes pre installed with all necessary firmware and configured for standard operation within an InfiniBand fabric and requires an InfiniBand compliant Subnet Manager running from one of the hosts All that is required for normal operation is to follow the usual precautions for installation and to connect the switch to the HCAs Once connected the Subnet Management soft ware automatically configures and begins utilizing the switch It is recommended that Mellanox OpenFabrics software package be installed on all nodes con nected to the MTS3600 The software package provides a subnet manager and network manage ment tools as well as connectivity software for servers nd storage and is available on the Mellanox web site See Chapter 3 for more information Basic installation hot swapping components and hardware maintenance is covered in Installa tion and Basic Operation on page 7 Serial Number and Product Version Information The serial number and product version information are found on the label seen in the figure below Figure 1 Generic Product label S N MTYYWWFSSSSS DIN Rev
20. ie keine Kabel an oder ab 6 Anschlie en Trennen von InfiniBand Kupferkabel InfiniBand Kupferkabel sind schwer und nicht flexible Deshalb m ssen sie vorsichtig an die Anschl sse angebracht bzw davon getrennt werden Lesen Sie die speziellen Warnungen und Anleitungen des Kabelherstellers 7 Rack Montage und Wartung Wenn dieses Produkt in einem Rack montiert oder gewartet wird sind besondere Vor sichtsma nahmen zu ergreifen um die Stabilit t des Systems zu gew hrleisten Im Allgemeinen sollten Sie das Gestell von unten nach oben mit Ger ten f llen Mellanox Technologies Rev 1 3 28 Rev 1 3 8 Ger teinstallation Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert ausge tauscht oder gewartet werden 9 Ger teentsorgung Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationalen Gesetze Bestim mungen erfolgen 10 Regionale und nationale elektrische Bestimmungen Dieses Ger t sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual 29 Appendix G Special Regulations Regarding Finland Sweden Denmark and Norway Denmark This unit is class I and must be connected with an AC cord compliant with all national electrical codes in Denmark The AC cord shall have an integral ground wire and can only be plugged into a
21. in an area with an ambient temperature exceeding the maximum recommended 45 C 113 F Moreover to guarantee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings gt 3 Stacking the Chassis The chassis should not be stacked on any other equipment If the chassis falls it can cause bodily injury and equipment damage gt 4 Redundant Power Supply Connection Electrical Hazard This product includes a blank cover over the space for the redundant power sup ply Do not operate the product if the blank cover is not securely fastened or if it is removed gt Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual 11 5 During Lightning Electrical Hazard During periods of lightning activity do not work on the equipment or connect or disconnect cables gt 6 Copper InfiniBand Cable Connecting Disconnecting Copper InfiniBand cables are heavy and not flexible as such they should be carefully attached to or detached from the connectors Refer to the cable manu facturer for special warnings and instructions 7 Rack Mounting and Servicing When this product is mounted or serviced in arack special precautions must be taken to ensure that the system remains stable In general yousshould fill the rack with equipment starting from the bottom to the top 8 Equipment Installation This equipment should be installed replaced or servic
22. it and remove the dust from the front and fear panels of the switch using a vacuum cleaner The green power LED for the fans does not come on 1 Check that the Power LEDs are on 2 Remove and reinstall the fan unit Make sure the mating connector of the new unit is free of any dirt and or obstacles See Section 2 2 6 Extracting and Inserting the Fan Unit on page 14 N Caution Do not run the switch if the System Status LED for the Fans is Yellow The link LED for the InfiniBand connector does not come on 1 Check that both ends of the cable are connected 2 Check that the locks on the ends are secured 3 Make sure that the latest FW version is installed on both the HCA and the switch 4 If media adapters are used check that the all connections are good tight and secure The activity LED does not come on Check that the Subnet Manager has been started Mellanox Technologies Rev 1 3 18 Appendix A Specification Rev 1 3 Table 7 MTS3600Q Specification Data Physical Power and Environmental Size 1 73 1U H x 17 5 W x23 8 D Input Voltage 90 264 VAC 47 63Hz 44mm X 444mm X 605mm Power Consumption 326W Weight 41 45 Ibs 1 PSU Dissipat d Power 200W 44 0 Ibs 2 PSUs Powertthrough connector 126W Mounting 19 Rack mount Temperature 109 to 45 Celsius Air Flow 70 5CFM Humidity 10 90 non condensing SerDes Speeds 10 20 or 40 Gb s per port Shock and Vibration ETSI E
23. mitter Non Inverted Data Input 37 Txin Transmitter Inverted Data Input 38 GND Ground Mellanox Technologies Rev 1 3 24 Appendix D Replacement Parts Ordering Numbers Table 11 Replacement Parts Ordering Numbers Part Description OPN Power Supply Unit PSU POW000018 This Replacement part is for both the PSU 1 and PSU 2 Fan Unit for QSFP MEC000960 Power cord Type B for USA Canada Mexico Taiwan ACC000204 Power cord Type H for Israel ACC000205 Power cord Type E F for Sweeden France Germany Neth ACC000207 erlands Russia Power cord Type G for UK ACC000208 Power cord Type D for India ACC000209 Power cord Type I for China ACC000210 Power cord Type J for Switzerland ACC000211 Power cord Type B for Japan ACC000212 Power cord Type I for Australia ACC000213 Rev 1 3 Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual Appendix E Avertissements de s curit d installation French 1 Instructions d installation Lisez toutes les instructions d installation avant de brancher le mat riel la source d alimentation lectrique 2 Temp rature excessive Ce mat riel ne doit pas fonctionner dans une zone avec une temp rature ambiante d passant le maximum recommand de 45 C 113 F En outre pour garantir un bon coulement de Nair laissez au moins 8 cm 3 poucesyid espace libre autour des ouver tures de ventilation
24. ols package is a set of firmware tools The man Tools MFT ual supplied with thispackage provides an overview of the firmware its installa User s Manual tion and replacement The MFT can be downloaded with its documentation at Document 2329 http www inellanox com under Firmware downloads Conventions Throughout this manual the name MTS3600 and the term switch are used to describe both the 36 port 40Gb s InfiniBand Switch and the 36 port QSFP 20Gb s InfiniBand Switch unless explicitly indicated otherwise Switch Products Covered in this User s Manual Table 3 Switch Products Covered by this User Manual Product Number Description MTS3600Q 1UNC 36 port Unmanaged QSFP 40Gb s InfiniBand switch with one power supply MTS3600Q 2UNC 36 port Unmanaged QSFP 40Gb s InfiniBand switch with two power supplies MTS3600R 1UNC 36 port Unmanaged QSFP 20Gb s InfiniBand switch with one power supply MTS3600R 2UNC 36 port Unmanaged QSFP 20Gb s InfiniBand switch with two power supplies Mellanox Technologies Rev 1 3 6 1 1 Rev 1 3 Overview Mellanox MTS3600 switch systems provide the highest performing fabric solution by delivering high bandwidth and low latency to Enterprise Data Centers High Performance Computing and Embedded environments Networks built with MTS3600 systems can carry converged traffic with the combination of assured bandwidth and granular quality of service Built with Mellanox s 4th
25. on Status o0 OK This power supply unit is delivering the correct DC supply Error This power supply unit is NOT deliver ing the correct DC supply Off This power supply unit is NOT receiving any input power The indicators labeled Fans are located just to the left of the primary power supply unit next to PSU 1 The following fan status conditions are possible Table 6 Fan Status LED Configurations LED Configuration Status OK All fans are operating Error One or more fans is not operating Repair or replace the fan unit 9 _ Off The fan unit is not receiving any power Check that the fan unit is properly and com pletely inserted LC Connector The MTS3600 supports an I2C compatible interface on the front panel This interface is used to pro gram firmware into the Flash Memory Firmware can also be programmed in band over the Infini All fans must be operating while the power supply is plugged in Power must be removed within two minutes of the fans failing to prevent damage to the switch Band network See Section 3 for more details Optional Management Interfaces Advanced Management Only The following interfaces allow access to the optional management module These interfaces have no function in unmanaged systems VGA Interface The VGA port is for video output from the management modul
26. on Notifications CAUTION ACHTUNG ATTENTION Risk of electrie shock and energy Gafahr des elektrischen Risque de choc et de danger hazard The two PSUs are inde Schocks Entferrnen des e lectriques Le de branch pendent Netzsteckers elnes Netz ment d une seule alimentation teils spannungsfrei Um stabilise e ne de branch Disconnect all power supplies to alle Einhieten spannungs uniquement qu un module ensure a powered down state frei zu machen sind die Alimentation Stabilise e inside of the switch platform Netzstecker aller Netzteile Pour isoler completement le zu entfernen module en cause Il faut de brancher toutes les ali mentations stabilise es 2 2 4 Extracting and Inserting the Power Supply Unit With both power supplies installed in the redundant configuration either PSU may be extracted without bringing down the system Rev 1 3 Mellanox Technologies InfiniScale IV 36 Port QSFP InfiniBand Switch User Manual 2 2 5 Note Make sure that the PSU that you are NOT replacing is showing all green for both the PSU and status indicators Figure 6 Power Supply Unit Extraction To extract a PSU 1 Remove the power cord fromithe power supply unit 2 Grasping the handle with your right hand push the green latch release with your thumb while pulling the handle outward As the PSU unseats the PSU status indicators will turn off 3 Remove the PSU To insert a PSU 1 Make sure the mating c
27. onnector of the new unit is free of any dirt and or obstacles 2 lns rt the PSU by sliding it into the opening until a slight resistance is felt 3 Continue pressing the PSU until it seats completely The latch will snap into place confirming the proper installation 4 Insert the power cord into the supply connector Note The green PSU indicator should light and the yellow indicator should remain off If not extract the PSU and re insert it again InfiniBand Cable Installation All cables can be inserted or removed with the unit powered on To insert a cable press the connec tor into the port receptacle until the connector is firmly seated The GREEN LED indicator below each QSFP port will light when the physical connection is established that is when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port After plugging in a cable lock the connector using the latching mechanism par Mellanox Technologies Rev 1 3 14 2 2 6 Rev 1 3 ticular to the cable vendor When a logical connection is made the yellow light will come on When data is being transferred the yellow light will blink To remove disengage the locks and slowly pull the connector away from the port receptacle Both LED indicators will turn off when the cable is unseated Care should be taken not to impede the air exhaust flow through the ventilation next to the Infini Band ports
28. owever rear is used consistently in this manual to refer to the side of the switch with the InfiniBand connectors 2 2 3 Power Connections and Initial Power On The switch platform ships with one or two Power Supply Units For switches with only one unit installed a second PSU may be installed at a later time Each supply has a separate AC receptacle The input voltage is auto adjusting for 90 264 VAC 47 63Hz power connections The power cords should be standard 3 wire AC power cords including a safety ground and rated for 15A or higher Caution The switch platform will automatically power on when AC power is applied There is no power switch Check all boards power supplies and fan tray modules for proper insertion before plugging in a power cable Caution After inserting a power cable and confirming the green system status LED light is on make sure that the Fan Status indicator shows green If the fan status indicator is not green then unplug the power connection and check that the fan module is inserted properly andthatithe mating connector of the fan unit is free of any dirt and or obstacles Caution When turning off the switch make sure ALL LEDS are off to ensure a pow ered down status Note Do not hot swap the power supply if your switch has only one power supply You must power down the system to replace the power supply unit when there is only one PSU in the switch Figure 5 Two Power Inlets Electric Cauti
29. plies Mellanox Technologies Rev 1 3 20 A 1 EMC Certification Statements Table 9 lists the approved certification status per switch in different regions of the world Table 9 Switch Certification Status FCC EN ICES VCCI C Tick Switch P N Class Class Class aan Australia IEC EN cTUVus CB USA Europe Canada p New Zealand MTS3600R 1UNC A A A A MTS3600Q 1UNC A A A A A 1 1 FCC Statements USA Class A Statements 15 21 Statement Warning Changes or modifications to this equipment not expressly approved by the party responsi ble for compliance Mellanox Technologies could void the user s authority to operate the equipment 15 105 a Statement NOTE This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equip ment generates uses land can radiate radio frequency energy and if not installed and used in accor dance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense A 1 2 EN Statements Europe EN55022 Class A Statem
Download Pdf Manuals
Related Search