Home

TX6100 User Manual

Contents

1. lt 55 China CCC Warning Statement 56 Appendix B QSFP Interface 57 Appendix RJ 45 CONSOLE and Ethernet interfaces 59 Appendix D Accessory and Replacement Parts 60 Appendix E Avertissements de s curit d installation French 61 Appendix F Installation Sicherheitshinweise German 65 Appendix Advertencias de seguridad para la instalaci n Spanish 69 4 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 List of Figures Figure 1 Connector Side View of the Switch 10 Figure 2 222 ae ee ae een a 11 Figure 3 QSFP Switch System Power and Connector Side Panels 12 Figure 4 System Status Indicators a ba 13 Figure 5 Fan Status LED Connector Side 14 Figure 6 Fan Status LED Power side 15 Figure 7 Power Status LED Connector Side 16 Figures Power Side Panel 16 Figure 9 PS Unt Status LEDS ers are a ea aa ee 16 Figure 10 Bad Port LED en ee ee een 17 Figures T Port LEDS A uter se eS OE Dad E 18 Figure 12 All Components Need t
2. 57 Fable 16 Ry AD PIQUE lt gt orrible 59 Table 17 Replacement Parts Ordering Numbers 60 6 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Revision History Table 1 Revision History Table Date Revision Description January 2013 1 1 Fixed 2 power supplies no wire bale December 2012 1 0 Initial release Mellanox Technologies 7 Rev 1 1 About this Manual This manual describes the installation and basic use of the Mellanox MetroX Long Haul switch which is based on the SwitchX 2 switch device Intended Audience This manual is intended for users and system administrators responsible for designing and testing switch platforms Related Documentation Additional Documentation available from Mellanox Table 2 Reference Documents and Web Sites Document Name Description InfiniBand Architecture Specifica The InfiniBand Architecture Specification that is provided by IBTA tion Volume 1 Release 1 2 1 Mellanox SwitchX 2 Switch Prod For possible hardware issues see the switch support product page This ucts Release Notes requires a customer support login Mellanox MLNX OS SwitchX 2 This document contains information regarding configuring and manag Software User Manual ing Mellanox Technologies SwitchX 2 Switch Platforms MLNX OS Software Command Refer Command Refere
3. e 4 GND Ground Rxin 2 22 a o 5 Tx4n Transmitter Inverted Data Input 23 GND 116 6 Tx4p Transmitter Non Inverted Data ern Rx4n Rx3n 4 nu 25 Rx4p Rx3p 14 7 GND Ground 36 ann enp 15 8 ModSelL Module Select 2227 ModPrsL spa 2 9 ResetL Module Reset m 21 10 Rx 3 3 V Power supply receiver vecTx Veo Rx 10 11 SCL 2 wire serial interface clock 30 9 nos 12 SDA 2 wire serial interface data 3 LPMode ModSelL 8 13 GND Ground _ 32 GND GND 7 Rx3p Receiver Non Inverted Data Out 38 Tx4p 14 put 34 ty3n Tx4n 5 35 RE anp 4 15 Rx3n Receiver Inverted Data Output Txip Tx2p 3 16 GND Ground EAT an 17 Rxlp Receiver Non Inverted Data Out put 18 Rxln Receiver Inverted Data Output 19 GND Ground 20 GND Ground 21 Rx2n Receiver Inverted Data Output 3 2 Rx2p Receiver Non Inverted Data Out put 3 23 GND Ground 24 Rx4n Receiver Inverted Data Output 3 25 Rx4p Receiver Non Inverted Data Out put 3 26 GND Ground 27 ModPrsL Module Present 28 IntL Interrupt 29 Tx 3 3 V Power supply transmitter 30 Vccl 3 3 V Power Supply 31 LPMode Low Power Mode 32 GND Ground Tx3n Transmitter Non Inverted Data Mellanox Technologies 57 Rev 1 1 lews QSFP Connector Male and Female Vi Figure 34 Top 18 35 View into Rear of Connector GND AX n GND TX3n TX3p
4. The Bad Port indicator is located on the left side of the connector side panel of the unit The fol lowing Bad Port conditions are possible Table 6 Bad Port LED Assignments LED Configuration Description Off OK No symbol errors have been received in last few seconds Flashing Orange Error One or possibly more ports have just received a symbol error This LED shows symbol errors Possible causes for this are e Bad cable e Bad connection e Bad connector This LED lights up when one or more ports is receiving a symbol error The LED immediately goes off until the next symbol error is received 2 1 1 5 UID LED Switch Identifier UID The UID LED is a debug feature that lights a blue LED on the switch connector side panel for ease in finding a particular switch Mellanox Technologies 17 Rev 1 1 Basic Operation 2 1 1 6 Port Connector LED Indicators Above the uplink ports are LEDs one for each port A The following table shows the port sta tus according to the LED indication Above the downlink ports are LEDs 1 per port A The following table shows the port status according to the LED indication Figure 11 Port LEDs Port LEDs Table 7 Connector Physical and Logical Link Assignments for IB LED Status LED Description Off No power to the port Solid Green Logical link up Flashing Green Data activity flashing speed is proportional to data transfer speed Solid Or
5. GUI e Subnet manager Remote logging e SSH telnet e Secured access in band and out band Pv4 IPv6 network stack 9 2 Switch Management The chassis management includes the following features Upgrading SwitchX 2 firmware Upgrading software Monitoring of AC power to the PSUs DC power out from the PSUs Board temperature Fan module status Mellanox Technologies 49 Rev 1 1 Management and Tools Overview Chassis failures Querying for switch serial numbers and their revisions software version and SwitchX 2 FW version 9 2 1 InfiniBand Subnet Manager The InfiniBand Subnet Manager SM is a centralized entity running in the switch It discovers and configures all the InfiniBand fabric devices to enable traffic flow between those devices The SM applies network traffic related configurations such as QoS routing partitioning to the fabric devices You can view and configure the Subnet Parameters SM via the CLI WebUI Each subnet needs one subnet manager to discover activate and manage the subnet Each network requires a Subnet Manager to be running in either the switch itself switch based or on one of the nodes which is connected to the fabric host based No more than two subnet managers are recommended for single fabric 9 3 Fabric Inspector Diagnostics Fabric Inspector is a plug amp play software for fee within MLNX OSTM displaying and filtering all identified system
6. Air Flow Direction Direction Label Description Designation Connector side inlet to power side R outlet Power side inlet to connector side outlet F 2 3 QSFP Cable Power Budget Classification AlMetroX downlink ports 1 SwitchX 2are designed for active cables with max power per module of 2W Typical power per port is 1 5W The MetroX uplink long haul ports are designed for active cables with a max power per module of 3 5W Typical power per port is 2 5W 2 4 Interfaces 2 4 1 Port Connector Interfaces The connector side of the switch has 12 QSFP ports The 6 on the left side numbered 1 6 are long haul ports that require 3 5W max power per port and can drive the signal up to 10 km The 6 ports on the right side numbered 7 12 are the downlink FDR ports Four of the six downlink ports can be split to 4 X 10 Gb s 20 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Figure 13 Port Numbering EXT 1 EXT2 EXT 3 EXT 4 EXT 5 EXT 6 Figure 14 Top and Bottom QSFP Port Orientation 2 42 Management and Firmware Updating Interfaces There are six interfaces to connect to the TX6100 2X 100M 1Gb Ethernet connectors labelled MGT e 1 USB port that is labelled This interface can be used to update software or firmware 1 connector that is labelled CONSOLE Use this connector to connect to the host PC 1
7. GND LPMode Vcc1 VccTx IntL ModPrsL GND RX4p RX4n GND 2 RX2n N N 28 GND TX2n TX2p GND TX4n TX4p GND ModSelL ResetL LO VecRx SCL SDA GND a E RX3p RX3n GND RX1p RX1n GND 8 50 View into Front of Cage 4 4 0 9 8 7 6 5 4 3 2 EF UND qo diXH AND UEXH dexu IND vas 105 XH99A Tieseu I9SPOWN aNd dpXL UpXL AND dzXL uZXL AND Mellanox Technologies 58 MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Appendix C RJ 45 CONSOLE and Ethernet interfaces The RJ 45 CONSOLE and Ethernet interfaces uses the 568A standard wiring color coding Ba CONSOLE Table 16 RJ 45 Pinout xp Pis Connection Signal Pin Color Dp RJA5 RTS amp pm RJ45_DTR SZ re TXD RJ 45_RTS 1 G W e TXD RJ 45_DTR 2 0 GND 2 5 GND GND Pin 8 RXD RJ 45_TXD 13 O W Looking into the Socket GND GND 4 Bl GND GND 5 BI W RXD RJ 45 RXD 6 O GND GND 7 Br W GND GND 8 Br 234 TXD 1 i p meme RJA5 SDA GND RI4S_SCL SND END Pin 8 Looking into the Socket Mellanox Technologies 59 Rev 1 1 Appendix Accessory Replacement Parts Table 17 Replacement Parts
8. Platform 3 8 1 Starting a Remote Connection to the Switch There are two ways to access the management CPU Via the Ethernet connector for remote access e SSH Telnet Web SNMP XML Via KVM connections locally MA For details on the SNMP commands and MIBs supported refer to the MLNX OS 7 Software Command Reference Guide 3 9 Starting an SSH Connection to the Switch CLI Step 1 Set up an Ethernet connection between the switch and a local network machine the remote machine henceforth using a standard RJ 45 connector Step 2 Connect to the remote machine rem_machl is used as an example Step3 Start a remote shell to the switch using the following command using lt switch_IP_address gt is the IP address of the switch rem machl gt ssh 1 username switch ip address gt Mellanox MLNX OS Switch Management Password Last login Thu Apr 28 11 24 13 2011 from 192 168 10 1 Mellanox Switch sx 43 standalone master gt Step4 You can enter any supported command now 40 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 4 Extracting and Inserting FRUs 4 1 Extracting and Inserting the Power Supply Unit With both power supplies installed in the redundant configuration either PS unit may be extracted without bringing down the system Make sure that the PS unit that you are NOT replacing is showing all green for both the PS unit a
9. Switch CLI 40 Chapter 4 Extracting and Inserting FRUS 41 4 1 Extracting and Inserting the Power Supply Unit 41 4 2 Extracting and Inserting the Fan 42 Chapter 5 Cabling ass ri E RSEN ee 44 Mellanox Technologies 3 Rev 1 1 5 1 Supported Approved 44 5 2 Splitting the Data Stream Using Breakout Fanout Cables 44 5 3 Cable Installations 553 use sms ana 45 Chapter 6 Switch Shut Down Procedure 46 Chapter 7 Disassembly of the Switch from the Rack 47 qr Disposal Zar io se Og id uk 47 Chapter 8 Resetting the Switch 48 Chapter 9 Management and Tools Overview 49 9 1 Switch Management Using the MLNX OS Software 49 9 2 Switch 49 9 2 1 InfiniBand Subnet Manager 50 9 3 Fabric Inspector 0 5 50 9 3 1 Upgrading Software 50 Chapter 10 Troubleshooting 51 Appendix A Specification 54 A 1 Approved 55 A EMC
10. guarantees high performance high vol ume data sharing between distant sites enabling existing data centers expansion disaster recov ery data mirroring and campus connectivity MetroX enables a campus network to assemble large aggregate clusters all connected and easily managed by an InfiniBand Subnet Manager an embedded manager OpenSM or using Mella nox s Unified Fabric Manager UFM MetroX extends InfiniBand protocol RDMA capabilities beyond the local cluster and ensures RDMA enhancements to both data centers and storage clusters alike The switch comes pre installed with all necessary firmware and is configured for standard oper ation within an InfiniBand fabric See Section 9 on page 49 for more information Installation hot swapping components and hardware maintenance is covered in Basic Opera tion on page 12 Figure 1 Connector Side View of the Switch 1 1 Features 1 1 1 Full Feature List e 6FDRIO 40Gb s QSFP Long haul ports aggregate data throughput up to 240Gb s e 6 FDR 56Gb s QSFP down link ports aggregate data throughput up to 336Gb s 10 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 e IBTA 1 3 and 1 21 compliant FDRIO supports 20 more bandwidth over QDR using the same cables connectors QoS 2 Virtual Lanes InfiniBand connectivity to up to 10km RDMA over long distance e 19 rack mountable chassis 1U w
11. it After two unsuccessful attempts to install the fan unit power off the switch before attempting any system debug Mellanox Technologies 43 Rev 1 1 Cabling 5 Cabling 5 1 Supported Approved Cables For a list of approved cables for this switch see http www mellanox com related docs user_manuals Mellanox_approved_cables pdf 5 2 Splitting the Data Stream Using Breakout Fanout Cables Specific ports can be split by using a QSFP 1X4 breakout cable to split one 40 GbE port into 4 lanes 4 SFP connectors 10GbE each These 4 lanes then go one lane to each of the 4 SFP connectors Figure 31 Breakout or Fanout Cable Figure 32 Port Splitting Options EXT 1 EXT 2 EXT 3 EXT 4 EXT 5 EXT 6 This port can be split into 4 10Gb s SFP The maximum 10 Gb s Ethernet ports configurable with this switch is 24 44 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 5 3 Cable Installation 56 40Gb s are only guaranteed to work with approved Mellanox Cables A All cables can be inserted or removed with the unit powered on To insert a cable press the con nector into the port receptacle until the connector is firmly seated The LED indicator corre sponding to each data port will light when the physical connection is established that is when the unit is powered on and a cable is plugged into the port with the other end of th
12. located to the left of the connectors on the connector side panel Figure 5 Fan Status LED Connector Side This is a two color LED EE Green OK yd PS1 Red Major fault PS2 Off No power to the fans UID RST The LED indicator on the Fan Module is on the right side of the module 14 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Figure 6 Fan Status LED Power side This is a two color LED Green OK Red Major fault Off No power to the fans Fan air flow indicator The following fan status conditions are possible Table 4 Fan Status LED Assignments LED Configuration FAN LED Solid Green OK fans are up and running Solid Red Error One or more fans is not operating properly The system should be powered down and troubleshoot the fan module Off Off The fan unit is not receiving any power Check that the fan unit is properly and completely inserted fans must be operating while the power supply is plugged in If the switch shuts down due to over temperature unplug the switch wait 5 minutes 4 N and replug in the switch For more information See Troubleshooting on page 51 2 1 1 3 Power Supply Status Indicators The indicator is located to the left of the connectors on the connector side panel Mellanox Technologies 15 Rev 1 1 Basic Operation
13. of the LEDs show status lights consistent with normal operation Figure 23 Status LEDs 5 Minutes After Power On Mellanox Mellanox DEN A BE 5 m PS1 PS1 PS2 PS2 O O UID RST RST Switch with 2 PSUs Switch with 1 PSU Warning Any yellow or red status LEDs are cause for concern and must be dealt with immediately It can take up to 5 minutes to boot up during which time the status LED may indicate red 15 You can start connecting all of the cables to the switch 3 4 Grounding the Switch Check to determine if your local or national electrical codes require an external ground to all IT components If so connect a ground wire to one of the casing screws and connect the other end to a valid ground If you choose to not use the ground screw make sure that the rack is properly grounded and that there is a valid ground connection between the chassis of the switch and the rack Test the ground using an Ohm meter Some national and or local codes may require IT components to be bonded and exter A nally grounded not including the power cord ground You must follow all national and local codes when installing this equipment 3 5 Power Connections and Initial Power On The switch platform ships with two power supply units Each supply has a separate AC recepta cle The input voltage is auto adjusting for 100 240VAC 50 60Hz power connections The 32 Mellanox Technologies MetroX 12 Port Q
14. peso e lt 40 lbs 40 70 lbs 70 121 lbs gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Lesi n corporal por peso 1 This equipment is very heavy and should be moved using a mechanical lift to avoid injuries 4 Sobrecalentamiento No se debe utilizar el equipo en un rea con una temperatura ambiente superior ala 7 m xima recomendada 45 C Adem s para garantizar una circulaci n de aire adec N uada se debe dejar como m nimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilaci n 5 Apilamiento del chasis Los chasis no se deben apilar sobre otros equipos caida del chasis podria causar lesiones corporales as como da os al equipo 6 Dos fusibles uno en el polo y otro en el neutro Dos fusibles uno en el polo otro en el neutro Quitar los cables de antes de A abrir la de este producto tocar cualquier componente interno A Mellanox Technologies 69 Rev 1 1 7 Cuando hay rayos peligro de descarga el ctrica No utilizar el equipo ni conectar o desconectar cables durante per odos de actividad de rayos 8 Conexi n y desconexi n del cable Copper Dado que los cables de cobre son pesados y no son flexibles su conexi n a los conec A A tores y su desconexi n se deben efectuar con mucho cuidado Para ver advertencias o instrucciones especiales consultar al fabricante del cable 9 Mon
15. reset button 112 banana connector on the power supply side for FAE use only Figure 15 Management Interfaces 2 4 2 1 RJ 45 Connector CONSOLE The port labelled CONSOLE is for a local host connection to the management module This is used the first time the switch is connected A harness is included in the package to connect to a DB connection on a host PC Connecting to a local host PC and following the instructions in the Installation Guide Configuring the Switch for the First Time must be done before any remote Mellanox Technologies 21 Rev 1 1 Basic Operation management is available For the Socket pinout see RJ 45 CONSOLE and Ethernet interfaces on page 59 2 4 2 2 RJ 45 Ethernet Connector MGT The Ethernet connection labelled MGT provides access for remote management The switch can be connected to any Ethernet port 2 Each Ethernet connector gets connected to Ethernet switches These switches must be configured to 100M 1G auto negotiation 5 2 4 2 3 USB Connector There is a single USB connector This connector can be used to install software and or firmware upgrades using a memory device that has a USB connector This connector is USB 2 0 compli ant USB 1 0 is not supported 5 2 4 2 4 12C Connector There is an I2C connector on the far left of the power side of the switch This interface is for Debug and Troubleshooting only This connector can be used to i
16. s reciente de los c digos el ctricos nacionales del pa s en cuesti n En Am rica del Norte el equipo se debe instalar de acuerdo con las disposiciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad 17 Directiva sobre RAEE Conforme a la Directiva 2002 96 CE sobre RAEE todos los residuos de equipos el c tricos y electr nicos EEE se deben recolectar por separado y no se deben eliminar junto con residuos dom sticos Al deshacerse de este producto y de todas sus partes h galo de una manera respon sable y respetuosa con el medio ambiente EEN dor Mellanox Technologies 71
17. the command configuration jump start you must be in Config mode 36 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Table 12 Configuration Wizard Session IP Zeroconf Configuration Wizard Session Display IP Zeroconf Configuration Example Mellanox configuration wizard Do you want to use the wizard for initial configuration y Step 1 Hostname switch 112126 Step 2 Use DHCP on mgmt0 interface yes no Step 3 Use zeroconf on mgmt0 interface no yes Step 4 Default gateway For example 192 168 10 1 Step 5 Primary DNS server Step 6 Domain name Step 7 Enable IPv6 yes yes Step 8 Enable IPv6 autoconfig SLAAC on mgmt0 interface no no Step 9 Admin password Enter to leave unchanged Step 9 Confirm admin password Enter to leave unchanged You have entered the following information 1 Hostname switch 112126 2 Use DHCP mgmt0 interface no 3 Use zeroconf on mgmt0 interface no yes 4 Default gateway 192 168 10 1 5 Primary DNS server 6 Domain name 7 Enable IPv6 yes 8 Enable IPv6 autoconfig SLAAC on mgmt0 interface 9 Admin password Enter to leave unchanged unchanged To change an answer enter the step number to return to Otherwise hit lt enter gt to save changes and exit Choice Configuration changes saved To return to the wizard from the CLI enter the configuration jump start comman
18. und nicht flexible Deshalb m ssen sie vorsichtig an die gen und Anleitungen des Kabelherstellers 7 Gafahr des elektrischen Schocks nungsfrei Um alle Einhieten spannungsfrei zu machen sind die Netzstecker aller Netz Gafahr des elektrischen Schocks Entferrnen des Netzsteckers elnes Netzteils span A teile zu entfernen Mellanox Technologies 65 Rev 1 1 Risk of electric shock and energy hazard The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform 8 Rack Montage und Wartung sichtsma nahmen zu ergreifen um die Stabilit t des Systems zu gew hrleisten Im Wenn dieses Produkt in einem Rack montiert oder gewartet wird sind besondere Vor Allgemeinen sollten Sie das Gestell von unten nach oben mit Ger ten f llen 9 Ger teinstallation Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert ausge tauscht oder gewartet werden 10 Ger teentsorgung Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationalen Gesetze Bestim mungen erfolgen gt 11 Regionale und nationale elektrische Bestimmungen Dieses Ger t sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden 12 Richtigen Schutz sicherstellen Geeigneter elekrischer mechanischer und Feuerschutz sind vom Hersteller des Endprodukts oder dem Endbenutzer bereitzustellen gt 13 Strahle
19. 028 Harness RS232 2M cable DB9 to RJ 45switches X Quick Start Guide e 1 X China RoHS statement If anything is damaged or missing contact your customer representative immediately For customer support go to www mellanox com gt Support gt Customer Support Portal Login Mellanox Technologies 27 Rev 1 1 Installation 3 3 Mechanical Installation Tools and Customer Supplied Parts Phillips Screwdrivers 1 and 2 Grounding screw ESD strap Grounding wire sufficient to reach a valid ground ESD mat For racks from 60cm to 80cm deep either use the standard depth switches with the long rail kit or the short switches with the long rail kit Parts included in the rail kit 2 rails 16 recessed flat head screws You will have extras 2 rail slides 10 caged nuts 2 switch slides 10 pan head screws M6 Figure 17 Rack Rail Kit Parts Switch slide x2 Rail x2 Rail slide x2 25222222 11111 1 Place ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Choose which side of the switch you want even with the rack vertical support Either the side with the power supply units or the side with the QSFP connectors can be even with one of the vertical rack supports 28 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul Syste
20. 3 Remove and reinstall the power cable 4 Remove and reinstall the PS unit The power LED for the switch shuts off 1 Check that the there is adequate ventilation Are the fan LEDs showing that the fans are all up and running 2 Make sure that there is nothing blocking the front or rear of the chassis and that the fan mod ules and ventilation holes are not blocked especially dust over the holes 3 If you find dust blocking the holes it is recommended to clean the fan unit and remove the dust from the front and rear panels of the switch using a vacuum cleaner The green power LED for the fans does not come on 1 Check that the Power LEDs are on 2 Remove and reinstall the fan unit Make sure the mating connector of the new unit is free of any dirt and or obstacles See Section 6 Switch Shut Down Procedure on page 46 3 Check that the mating connector pins are not bent YN Caution Do not run the switch if the System Status LED for the Fans is Red The link LED for the connector does not come on 1 Check that both ends of the cable are connected 2 Check that the locks on the ends are secured 3 Make sure that the latest firmware version is installed on all of the HCA cards and the switch 4 If media adapters are used check that the all connections are good tight and secure The activity LED does not come on When running IB check that the Subnet Manager has been started The switch is off 1 Unplug the sw
21. 4 Figure 32 Port Splitting Options cai asus re Poe 43 44 Figure 33 Reset Button u rennen en een ree eu b Ri P RE EE A 48 Figure 34 QSFP Connector Male and Female Views 58 Mellanox Technologies 5 Rev 1 1 List of Tables Table 1 Revision History Table 7 Table 2 Reference Documents and Web Sites 8 Table 3 System Status LED Assignments 14 Table 4 Fan Status LED Assignments 15 Table 5 PS Unit Status LED Assignments 17 Table 6 Bad Port LED Assignments ce eater TE ara ei ai 17 Table 7 Connector Physical and Logical Link Assignments for IB 18 Table 8 Air Flow Direction 20 Table 9 Installation Kit According to Rack Size 27 Table 10 Serial Terminal Program Configuration 34 Table 11 Configuration Wizard Session IP Configuration by DHCP 35 Table 12 Configuration Wizard Session IP Zeroconf Configuration 37 Table 13 Configuration Wizard Session Static IP Configuration 38 Table 14 TX6100 Specification Data 54 Table 15 InfiniBand QSFP Connector
22. 5 Rev 1 1 Installation 12 UL Approved AC Power Cords For North American power connection select apower supply cord that is UL Listed and CSA Certified 3 conductor 18 AWG terminated in a molded on plug cap rated at 125 V 15 A with a minimum length of 1 5m six feet but no longer than 4 5m For European connection select a power supply cord that is internationally harmonized and marked lt HAR gt 3 conductor minimum 0 75 mm2 wire rated at 300 V with a PVC insulated jacket The cord must have a molded on plug cap rated 250 V 10 A 13 Do Not Use the Switch as a Shelf or Work Space Caution Slide rail mounted equipment is not to be used as a shelf or a work space 14 WEEE Directive According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way 26 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 The switch platform can be rack mounted and is designed for installation in a standard 19 rack The power side of the switch includes hot swap power supply module blank cover for an optional second PS unit for redundancy and a hot swap fan tray There are two possible air flow directions Be sure that the switch air flow direction i
23. 994 A1 1996 A2 2001 Mellanox Technologies 63 Rev 1 1 6 4 19 S assurer que les enceintes sont appropri es Des enceintes lectriques m caniques et incendie adapt es doivent tre fournies par le fabricant du produit final ou par l utilisateur final 20 Cordons lectriques CA homologu s UL Pour les prises lectriques en Am rique du Nord choisissez un cordon lectrique homologu UL et certifi CSA 3 conducteurs 18 AWG termin par une fiche moul e d une tension nominale de 125 V 15 A avec une longueur minimale de 1 5 m 6 pieds et d une longueur maxi male de 4 5 m 18 pieds Pour les prises lectriques en Europe choisissez un cordon lectrique harmonis inter nationalement et marqu lt gt 3 conducteurs d un diam tre de fil minimum de 0 75 mm2 d une tension nominale de 300 V avec une gaine isol e en PVC Le cordon doit avoir une fiche moul e d une tension nominale de 250 V et d une intensit nominale de 10 A 21 40 lbs 40 70 lbs 70 121 lbs gt 121 los lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 22 Conform ment la Directive WEEE Conform ment la Directive WEEE 2002 96 EC les d chets d quipements lec triques et lectroniques EEE doivent tre tri s et ne peuvent tre limin s avec les d chets m nagers Veuillez disposer de ce produit et de tous ses composants de mani re responsable et SE respectueuse de l
24. E Mellanox TECHNOLOGIES Mellanox Technologies Mellanox Technologies Ltd 350 Oakmead Parkway Suite 100 Beit Mellanox Sunnyvale CA 94085 PO Box 586 Yokneam 20692 U S A Israel www mellanox com www mellanox com Tel 408 970 3400 Tel 972 0 74 723 7200 Fax 408 970 3403 Fax 972 0 4 959 3245 Copyright 2013 Mellanox Technologies All Rights Reserved Mellanox Mellanox logo BridgeX ConnectX CORE Direct InfiniBridge InfiniHost InfiniScale PhyX SwitchX Virtual Protocol Interconnect and Voltaire are registered trademarks of Mellanox Technologies Ltd Connect IB FabricIT MLNX OSTM MetroX ScalableHPC Unbreakable Link UFM and Unified Fabric Manager are trademarks of Mellanox Technologies Ltd All other trademarks are property of their respective owners 2 Mellanox Technologies Document Number 4067 MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Table of Contents Table of Contents 3 List of Figures 5 List of Tables 6 Revision History a ie ee 7 About this Manual zu a a 8 Intended Audience R3 ge ee ass Prada 8 Related Documentation 8 Conventions a 8 Abbreviations eism 2 ann a a aie gU MER AUS 5 9 Mellanox Part Numbering Legend 9 Chapter Overviews de 10 121 Features 2 5 ata
25. Figure 7 Power Status LED Connector Side AM These are two color LEDs yd PS1 Red Major fault 52 Off No power ES UID RST This switch comes with two power supply units for full N 1 redundancy Figure 8 Power Side Panel Fan status LED PS unit 1 status LED HOUR Fan Unit Primary Power Supply Unit The primary power supply unit PS1 is located on the right side of the power side panel with PS2 on the left side Each PS unit has a single 2 color LED on the right side of the PS unit that indicates the internal status of the unit Figure 9 PS Unit Status LEDs This is a two color LED u Green OK Red Major fault Off No power to the system Power supply fan air flow indicator 16 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Table 5 PS Unit Status LED Assignments LED Color Status Solid Green OK The Power supply is delivering the correct voltage 12VDC Solid Red Error The PS unit is not operational Off Off There is no power to the system neither PS unit is receiving power If one PS unit is showing green and the second PS unit is unplugged it will show a red indication 2 1 1 4 Bad Port LED Figure 10 Bad Port LED This is a one color LED Flashing Orange received symbol error
26. Mellanox TECHNOLOGIES MetroX InfiniBand Long Haul System Hardware User Manual P N MTX6100 2SFS Rev 1 1 www mellanox com Rev 1 1 NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE USE OF THE PRODUCT S AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAG
27. Ordering Numbers Part Description OPN DB9 or RJ 45 to USB Adapter MTUSB 1 Fan module with power supply side to connector side air flow MSX60 FF Fan module with connector side to power supply side air flow MSX60 FR 300W Power Supply w Power Supply Side to Connector side air flow MSX60 PF 300W Power Supply w Connector side to Power Supply side air flow MSX60 PR Power cord Type C13 C14 ACC000500 Installation Kit for short switches in racks 40 60 cm deep MSX60 BKIT Installation Kit for short or standard switches in racks 60 80 cm deep MSX60 SKIT 60 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Appendix E Avertissements de s curit d installation French 1 Instructions d installation Lisez toutes les instructions d installation avant de brancher le mat riel la source d alimentation lectrique 2 Temp rature excessive Ce mat riel ne doit pas fonctionner dans une zone avec une temp rature ambiante d passant le maximum recommand de 45 C 113 F Un flux d air de 200LFM cette temp rature ambiante maximale est n cessaire En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation 3 Empilage du ch ssis Le ch ssis ne doit pas tre empil sur un autre mat riel Si le ch ssis tombe il peut pro voquer des blessures corporelle
28. Re RS IR 10 1 14 Full Feature Listo zer a and 10 1 2 Serial Number and Product Version Information 11 Chapter 2 Basic Operation 12 2 1 Switch Platform Hardware Overview 12 21 1 Status EDS ra a A anche cates ana eer P Prem 12 2 2 AIM IOW En N end Rn a ee ED 18 2 3 Cable Power Budget 20 2 4 Inlerfaces oa e Seiser 20 2 4 1 Port Connector 20 2 4 2 Management and Firmware Updating Interfaces 21 2 4 3 Reset BUON id A 22 Chapter Installation 24 3 1 Installation Safety Warnings 24 3 11 Installation Kits caca Dp a 27 3 2 Package 27 3 3 Mechanical Installation 28 3 4 Grounding the Switch o Rep yp eu BY edt o EG E Rs 32 3 5 Power Connections and Initial Power On 32 3 6 Configuring the Switch the First 33 3 7 Rerunning the Wizard sic cos ir a RR Rees 39 3 8 Connecting to the Switch Platform 40 3 8 4 Starting a Remote Connection to the Switch 40 3 9 Starting an SSH Connection to the
29. SFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 power cords should be standard 3 wire AC power cords including a safety ground and rated for 15 or higher Caution The switch platform will automatically power on when AC power is applied There is no power switch Check all boards power supplies and fan tray modules for proper insertion before plugging in a power cable Caution After inserting a power cable and confirming the green system status LED light is on make sure that the Fan Status indicator shows green If the fan status indicator is not green then unplug the power connection and check that the fan module is inserted properly and that the mating connector of the fan unit is free of any dirt and or obstacles Caution When turning off the switch make sure ALL Connector LEDS are off to ensure a powered down status Do not hot swap the power supply if your switch has only one power supply You must power down the system to replace the power supply unit when there is only one PS unit in the switch Figure 24 Two Power Inlets Electric Caution Notifications CAUTION ACHTUNG ATTENTION Risk of electric shock and energy Gafahr des elektrischen Risque de choc et de danger hazard The two PS units are Schocks Entferrnen des e lectriques Le de branch independent Netzsteckers elnes Netz ment d une seule alimentation teils spannungsfrei Um stabilise e ne de branch Disconnect all power supp
30. ange Physical link up Flashing Orange A problem with the physical link The LED indicator corresponding to each data port will light orange when the physical connec tion is established that is when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port When a logical connection is made the LED will change to green When data is being transferred the light will blink green 2 2 Air Flow These switches can come with two air flow patterns The two patterns are Connector side inlet to power side outlet Power side inlet to connector side outlet 18 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 The air flow is specified in the product model number See Mellanox Part Numbering Legend on page 9 On the PS unit and fan modules the air flow direction can be seen on the power side panel PS units must have the same air flow as the fan module Figure 12 Components Need the Same Air Flow 1111111111111 H 11111111 25 CU LIN LE 7 These air flow labels must be the same Red is connector side inlet to power side outlet TNT HI al u 11111111 1 Blue is power side inlet to connector side outlet Mellanox Technologies 19 Rev 1 1 Basic Operation Table 8
31. ard The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform gt gt 9 Montage et entretien sur baie Lorsque ce produit est mont ou entretenu sur baie il faut prendre des pr cautions sp ciales pour s assurer que le systeme reste stable En g n ral il faut remplir la baie avec du mat riel de bas en haut gt 10 Fuite gt 3 5mA Leakage gt 3 5mA ATTENTION La connexion la terre des forts courants de fuite est essentielle avant le branchement de l alimentation Avant de brancher l appareil la conduite d alimentation les vis de protection la terre du terminal de l appareil doivent tre appliqu es l installation de protection la Terre du b timent 11 Forts Courants de Fuite High Leakage Current Attention Forts courants de fuite Il est essentiel de relier a la terre avant de brancher l alimentation 12 Ajouter une information de connexion la masse Connect a Valid Ground to this Device terre du terminal de l appareil doivent tre appliqu es l installation de protection la Avant de brancher l appareil la conduite d alimentation les vis de protection la Terre du b timent 62 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 13 Installation du mat riel h Ce mat riel ne doit tre install remplac ou entretenu que par du
32. ational Electrical Code F r Nordamerika m ssen in bereinstimmung mit den gel A tenden Vorschriften in der US amerikanischen National Electrical Code und dem Canadian Electrical Code 18 Zusammenschaltung von EINHEITEN Kabel f r den Anschluss an das Ger t RS232 und Ethernet Schnittstellen m ssen UL zertifiziert Typ DP 1 oder DP 2 Hinweis wenn nicht mit Wohnsitz in LPS Schal tung berstromschutz Eine leicht zug ngliche Auflistung Abzweigleitung berstrom Schutzeinrichtung 20 A bewertet werden m ssen in dem Geb ude Verkabelung 19 Zweipolige bzw Neutralleiter Sicherung im Netzteil Achtung Zweipolige bzw Neutralleiter Sicherung im Netzteil Netzstecker ziehen um sicher zustellen da keine Spannung am Ger t anliegt Entfernen Sie alle Netzkabel vor dem ffnen der Abdeckung dieses Produkts oder dem Ber hren der Innenteile Mellanox Technologies 67 Rev 1 1 20 Bodily Injury Due to Weight Use enough people to safely lift this product e lt 40 lbs 40 70 lbs 70 121 lbs gt 121 los lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 68 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Appendix G Advertencias de seguridad para la insta laci n Spanish 1 Instrucciones de instalaci n 8 Antes de conectar el equipo a la fuente de alimentaci n leer todas las instrucciones de A instalaci n 2 Lesi n corporal por
33. ch System Power and Connector Side Panels I Ms UL 111 ES Power Side Panel TX6100 CONSOLE y Wa mm gt ES Connector Side Panel All connectivity except for power cords is via the connector side panel All connectors can sup port active cables 2 1 1 Status LEDs 2 1 1 1 System Status Indicators The System Status Indicators are located to the left of the connectors on the connector side panel and on the power side at the far right Both of these LEDs give identical information 12 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Figure 4 System Status Indicators Green OK Yellow fault in the system These three symbols show the possible colors for the LED below Green Yellow and Red Red Major Fault or Fatal Error Both of these LEDs show the switch status One is on the 0 Power side and is the UID Connector side RST LED color shows the switch status Power side Connector side status LED status LED The system status indicators should display as follows When the switch is plugged in within five minutes the STATUS LED should light up green The PS1 LED for the plugged in PS unit should light up green The PS2 LED for the second PS unit should light up green only if a second PS unit is installed in the switch for redundancy and Hot Swap ability and
34. d from configure mode Launching CLI switch 1 gt Mellanox Technologies 37 Rev 1 1 Installation Table 13 Configuration Wizard Session Static IP Configuration Wizard Session Display Static IP Configuration Example Mellanox configuration wizard Do you want to use the wizard for initial configuration y Step 1 Hostname switch 112126 Step 2 Use DHCP on mgmt0 interface yes n Step 3 Use zeroconf on mgmt0 interface no Step 4 Primary IP address for example 192 168 10 4 Mask length may not be zero if address is not zero interface ethO Step 5 Netmask 0 0 0 0 255 255 255 0 Step 6 Default gateway for example 192 168 10 1 Step 7 Primary DNS server Step 8 Domain name Step 9 Enable IPv6 yes yes Step 10 Enable IPv6 autoconfig SLAAC on mgmt0 interface no no Step 11 Admin password Enter to leave unchanged You have entered the following information 1 Hostname switch 112126 2 Use DHCP on mgmt0 interface no 3 Use zeroconf mgmt0 interface 4 Primary IP address 192 168 10 4 5 Netmask 255 255 255 0 6 Default gateway 192 168 10 1 7 Primary DNS server 8 Domain name 9 Enable IPv6 yes 10 Enable IPv6 autoconfig SLAAC on mgmt0 interface no 11 Admin password Enter to leave unchanged unchanged To change an answer enter the step number to return to Otherwise hit enter to save changes and exit Choice Configuration changes sav
35. e connector plugged into a functioning port After plugging in a cable lock the connector using the latching mechanism particular to the cable vendor When a logical connection is made the LED will change to green When data is being transferred the light will blink green To remove disengage the locks and slowly pull the connector away from the port receptacle The LED indicator for that port will turn off when the cable is unseated Care should be taken not to impede the air flow through the ventilation holes next to the connec tor ports Cable lengths should be used which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack Mellanox Technologies 45 Rev 1 1 Switch Shut Down Procedure 6 Switch Shut Down Procedure To shut down the switch run the command Reload halt noconfirm The switch cannot be restarted remotely To restart the switch you must physically to the switch and unplug and plug in the power cord 46 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 7 Disassembly of the Switch from the Rack To disassemble the switch from the rack 1 Unplug and remove all connectors 2 Unplug all power cords 3 Remove the ground wire 4 Unscrew the 2 center bolts from the side of the switch with the bracket Support the weight of the switch when you remove the screws so that the switch does
36. ed To return to the wizard from the CLI enter the configuration jump start command from configure mode Launching CLI switch 1 gt Step5 Before attempting a remote for example SSH connection to the switch check the mgmt0 interface configuration Specifically verify the existence of an IP address To check the current mgmt0 configuration enter the following commands sx 43 standalone master gt enable sx 43 standalone master 4 show interfaces mgmt0 38 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 The following is an example of the output Interface mgmt0 state Admin up yes Link up yes IP address 192 168 10 43 Netmask 255 255 255 0 Speed 1000Mb s auto Duplex full auto Interface type ethernet Interface source physical MTU 1500 HW address 00 02 C9 11 2A AE Comment RX bytes 1343502058 TX bytes 313920869 RX packets 17589211 TX packets 992717 RX mcast packets 0 TX discards 0 RX discards 0 TX errors 0 RX errors 0 TX overruns 0 RX overruns 0 TX carrier 0 RX frame 0 TX collisions 0 TX queue len 1000 3 7 Rerunning the Wizard If you want to rerun the wizard run the following commands sx 43 standalone master gt enable sx 43 standalone master configure terminal sx 43 standalone master configuration jump start Mellanox Technologies 39 Rev 1 1 Installation 3 8 Connecting to the Switch
37. environnement Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Appendix F Installation Sicherheitshinweise German 1 Installationsanleitungen Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die Stromversorgung anschlie en 2 bertemperatur Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von 45 C 113 F betrieben werden Es ist ein Luft LA strom von 200 LFM bei maximaler Umgebungstemperatur erforderlich AuBerdem sollten mindestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten 3 Stapeln des Chassis Das Chassis sollte nicht auf andere Ger te gestapelt werden Wenn das Chassis herun terf llt kann es zu Verletzungen und Besch digungen an Ger ten f hren 4 Redundanter Stromversorgungsanschluss Elektrische Gefahr Stromversorgung Betreiben Sie das Produkt nicht wenn diese Abdeckung nicht sicher Dieses Produkt verf gt ber eine Abdeckung ber dem Bereich f r die redundante festsitzt oder entfernt wurde 5 Bei Gewitter Elektrische Gefahr Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Kabel an oder ab 6 Anschlie en Trennen von Kupferkabel Anschl sse angebracht bzw davon getrennt werden Lesen Sie die speziellen Warnun Kupferkabel sind schwer
38. f 56Gb s Managed using MLNX OS Management 40Gb s 10Gb s 1Gb s 54 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 A 1 A 2 Mellanox Technologies 55 Data Rate Data Rate S6Gb s Regulatory Compliance Safety US Canada cTUVus EMC USA FCC Class A EU IEC60950 Emissions Canada ICES Class A International CB EU EN55022 Class A Safety Russia GOST R EU EN55024 Class A EMC Argentina S mark DoC EU EN61000 3 2 Class A Emissions EU EN61000 3 3 Class A Japan VCCI Class A Australia New Zealand AS NZS CISPR 22 class A Environmental Acoustic EU IEC 60068 2 64 Random ISO 7779 Environmental Vibration ETS 300 753 Acoustic EU IEC 60068 2 29 Shocks 72 dBa Type I II EU IEC 60068 2 32 Fall Test Scalability and Performance Switching Switching Switching Performance Performance Simultaneous wire speed any port Capacity 240 Gb s long haul uplink Capacity to any port 336 Gb s down link Reliability Availability and Serviceability Features Hot Swappable Hot swapability Fan Module Redundancy 1 1 Redundant Power Supplies Approved Cables For a list of all approved cables see http www mellanox com related docs user_manuals Mellanox_approved_cables pdf EMC Certifications The list of approved certifications per switch in different regions of the world is located on the Mellanox Website at htt
39. f PSUs S Depth of the Unit S standard B short F Air Flow direction F forward air flow R Reverse air flow S Chip Generation S SwitchX 2 Mellanox Technologies 9 Rev 1 1 Overview 1 Overview The TX6100 MetroXTM series extends InfiniBand from a single location data center network to a high performance technology for local campus and even metro applications Data centers compute clusters and supercomputers are overwhelmed by unprecedented growth in data volume fueled by strong application and technology trends While InfiniBand products have been traditionally deployed for their high performance intercon nect benefits within the data center Mellanox MetroX switches implementing long haul Infini Band enable connecting between data centers deployed across multiple geographically distributed sites extending the same world leading interconnect benefits of InfiniBand beyond local data centers and storage clusters Mellanox s MetroX is the perfect cost effective low power easily managed and scalable solu tion that enables today s data centers and storage to run over local and distributed InfiniBand fab rics managed as a single unified network infrastructure MetroX switches which implement long haul InfiniBand can transfer data to distances of up to 10km The switches enable aggregate data and storage networking over a single consolidated InfiniBand fabric The long haul InfiniBand technology
40. he Same Air Flow 19 19 Port Numbering ey x E Reve AA 21 Figure 14 Top and Bottom QSFP Port Orientation 21 Figure 15 Management Interfaces 21 Figure Tb Reset ar Mas oec Rr RES she bute Red O 23 Figure 1 2 Rack Tall Parts ire 28 Figure 18 Placement of Switch in Rack 29 Figure 19 Mounting Options esses cba ae er RE eg dis 30 Figure 20 Screwing on the Rail 30 Figure 21 Inserting the Caged Nuts 31 Figure 22 Slide the Rail into the Rail Slide 31 Figure 23 Status LEDs 5 Minutes After Power On 32 Figure 24 Two Power Inlets Electric Caution Notifications 33 Figure 25 Console Pot ex ee ae ek Bier ne 34 Figure 26 Fan and PS unit Air Flow Direction 41 Figure 27 Power Supply Unit Extraction 41 Figure 28 PS Unit Pulled Out sod ee Br age ee 42 Figure 29 Air Flow Labels Arena aus tr es qr x kin 43 Figure 30 Fan Module Latches 43 Figure 31 Breakout or Fanout Cable 4
41. it is connected to a power source If two PS units are installed and only one PS unit is connected to a power supply the PS2 LED will be red If only one PS unit is installed in the switch the PS2 LED will be off The FAN LED should light up green As long as there is power to the switch one PS unit is connected and the switch is booted up and running the status LED should be green If the STATUS LED shows red after five minutes unplug the switch and call your Mellanox representative for assistance If the switch shuts down due to over temperature unplug the switch wait 5 minutes and replug in the switch For more information See Troubleshooting on page 51 If the PS LEDs are not green this indicates a problem with the power supplies The switch is operational only if at least one of the PS LEDs is green Mellanox Technologies 13 Rev 1 1 Basic Operation Power Fan and System LEDs Table 3 System Status LED Assignments LED Configuration STATUS System Health LED Solid Green OK The system is up and running Flashing Green The system is booting up This assignment is valid on managed systems only Solid Yellow To be implemented in a future SW release Solid Red Major Error Possible damage can result to the switch Turn off immediately e g bad firmware can t boot overheated Off Off The system has no power 2 1 1 2 Fan Status Indicators 5 The indicator is
42. itch 2 Wait 5 minutes 3 Plug in the switch Mellanox Technologies 51 Rev 1 1 Troubleshooting If the switch does not come on check the power supplies 5 Ifthe switch comes on Use the MLNX OS management CLI to determine the cause of the Shutdown 6 Check the temperature 7 Check the Fan status The switch is not working and unresponsive 1 Reset the switch If resetting the switch does not work 2 Unplug the switch Wait 5 minutes 3 4 Plug in the switch 5 If the switch does not come on check the power supplies 6 If the switch comes on use the MLNX OS management CLI to determine the cause of the shutdown The last software update did not succeed 1 Connect the RS232 connector CONSOLE to a laptop 2 Push the reset button on the switch or management module 3 You will have 5 seconds to stop the U Boot by pressing Control B 4 Choose the image to upload Only use image 1 or image 2 U Boot 2009 01 mlnx1 4 May 12 2010 14 08 15 CPU AMCC PowerPC 460EX Rev A at 1000 MHz PLB 200 OPB 100 EBC 100 MHz Security Kasumi support Bootstrap Option Boot ROM Location I2C Addr 0x52 Internal PCI arbiter disabled 32 kB I Cache 32 kB D Cache Board Mellanox PPC460EX Board FDEF No I2C ready DRAM 2 GB ECC enabled 400 MHz CL3 FLASH 16 MB NAND 1024 MiB PCI Bus Dev VenId DevId Class Int PCIEO link is not up 52 Mellanox Technologies MetroX 12 Port QSFP I
43. ith redundant power supplies and Fan units 6 Downlink QSFP non blocking ports with aggregate data throughput up to 336Gb s FDR 6 Uplink QSFP non blocking ports with aggregate data throughput up to 240Gb s Compliant with IBTA 1 2 1 and 1 3 e Virtual Lanes 2 data 1 management 1 2 Serial Number and Product Version Information The serial number and GUIDfor the switch is found on the pull out tab below the USB connector TheMAC for the Management PC is also on this tab This MAC is for the mgmt0 management interface the top Ethernet port The second interface mgmtl has the next consecutive MAC Figure 2 Pull out tab Pull out tab S N MT1117X00014 P N MTX6100 2SFS UIT OUI Rev A2 GUID 0002C9020040DDBO Made in Israel LEA 2032 f Mellanox Technologies 11 Rev 1 1 Basic Operation 2 Basic Operation 2 1 Switch Platform Hardware Overview Figure 3 shows the power side panel view of the switch The figure shows the hot swap power supply locations and the hot swap fan module and an I2C banana connector The figure also shows the connector side panel views of the managed switch The figure shows port configurations for the switch systems Managed systems have 2 Ethernet RJ 45 connectors for management 1 RJ 45 connector for connecting to a host PC 1 USB connector All switches have various status LEDs for on site switch status information Figure 3 QSFP Swit
44. lies to alle Einhieten spannungs uniquement qu un module ensure a powered down state frei zu machen sind die Alimentation Stabilise e inside of the switch platform Netzstecker aller Netzteile Pour isoler completement le zu entfernen module en cause Il faut de brancher toutes les alimen tations stabilise es 3 6 Configuring the Switch the First Time The procedures described in this chapter assume that you have already installed and powered on your switch according to the instructions in this document Step 1 Connect the host PC to the Console RJ 45 port of the switch system using the supplied cable The Console ports for systems are shown below as examples Mellanox Technologies 33 Rev 1 1 Installation Figure 25 Console Port Connect the host PC to here Make sure to connect to the Console RJ 45 port of the switch and not to the Ethernet port No remote IP connection is available at this stage Step 2 Configure a serial terminal program for example HyperTerminal minicom or Tera Term on your host PC with the settings described in Table 10 Table 10 Serial Terminal Program Configuration Parameter Setting Baud Rate 9600 Data bits 8 Stop bits 1 Parity None Flow Control None Step 3 Login from a serial terminal program as admin and use admin as password This starts the Mellanox configuration wizard Step 4 Go through the Mellanox configuratio
45. m Hardware User Manual Rev 1 1 Figure 18 Placement of Switch in Rack nn r Si Connector side Cable with recom mended bending radius 19 482 6mm Switch This edge of the switch is even with the rack vertical support Insufficient room for recommended bend ing radius b 4 Power Spine side Doors Things to consider before choosing where to mount the rails and rail slides The distance between the rack and the door can be as little as 4 cm on one side of the rack and as much as 18 cm on the other side of the rack Keep in mind that there can be as many as cables connected to the switch Do you want the connector side recessed in the rack to allow for a larger cable bending radius It is possible to recess the connector side by 5cm by optional placement of the switch rails See Figure 19 Mounting Options e Will the connector side be recessed past other equipment in the rack and will this be prob lematic e The installation kit allows for a 2 recess of the switch past the vertical support Mellanox Technologies 29 Rev 1 1 Installation Figure 19 Mounting Options 3 Decide which mounting option you want to use 4 Screw the switch slides onto the switch Use 5 flat head screws for short switches and 7 screws for standard depth switches to connect each switch slide Figure 20 Screwing on the Rail 5 screws per side are
46. n wizard Table 11 shows an example of a wizard session 34 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Table 11 Configuration Wizard Session IP Configuration by DHCP Sheet 1 of 2 Wizard Session Display Example Comments Mellanox configuration wizard Do you want to use the wizard for initial configura tion yes You must perform this configuration the first time you operate the switch or after resetting the switch Type y and then press lt Enter gt Stepl Hostname switch 1 If you wish to accept the default hostname then press lt Enter gt Otherwise type a different hostname and press lt Enter gt Step 2 Use DHCP mgmt0 interface no Perform this step to obtain an IP address for the switch ethO is the management port of the switch If you wish the DHCP server to assign the IP address type yes and press lt Enter gt If you type no no DHCP then you will be asked whether you wish to use the zeroconf configuration or not If you enter yes yes Zeroconf the session will continue as shown in Table 12 If you enter no no Zeroconf then you need to enter a static IP and the session will continue as shown in Table 13 Step 3 Enable IPv6 yes yes The management interface will be able to use IPv6 addresses Step 4 Enable IPv6 autoconfig SLAAC on mgmt0 interface n
47. nce Guide for MLNX OS listing all of the commands ence Guide available through MLNX OS with explanations and examples MLNX OS Software Configuration Configuration Guide for MLNX OS displaying different configuration Guide scenarios All ofthese documents can be found on the Mellanox Website They are available either through the product pages or through the support page with a login and password Conventions Throughout this manual the name TX6100 and the term switch are used to describe the switch unless explicitly indicated otherwise The following icons are used throughout this document to indicate information that is important to the user Y This icon makes recommendations to the user gt This icon indicates information that is helpful to the user 5 8 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 This icon indicates a situation that can potentially cause damage to hardware or soft ware BEWARE This icon indicates a situation that can potentially cause personal injury or damage to hardware or software Abbreviations FDR Fourteen Data Rate Mellanox Part Numbering Legend Place Field Decoder M Mellanox TX System Type MetroX based systems 6 Family generation 1 Data Transfer Protocol 1 IB 2 ETH 0 Height of box Height 0 1U 1 1 5U 2 2U 0 Switch generation Separator 2 Power Supplies o
48. nd status indicators Figure 26 Fan and PS unit Air Flow Direction 11 111155 w annnnunns unie Fan Air flow direction PS unit Air flow direction i Power supply units have directional air flows similar to the fan module The Fan mod ule airflow must coincide with the airflow of all of the PS units If the PS unit airflow direction is different from the fan module airflow direction the switch internal temper ature will be affected Figure 27 Power Supply Unit Extraction Push Here H Latch release Mellanox Technologies 41 Rev 1 1 Extracting and Inserting FRUs Figure 28 PS Unit Pulled Out To extract a PS unit 1 Remove the power cord from the power supply unit 2 Grasping the handle with your right hand push the latch release with your thumb while pull ing the handle outward As the PS unit unseats the PS unit status indicators will turn off 3 Remove the PS unit To insert a PS unit 1 Make sure the mating connector of the new unit is free of any dirt and or obstacles Do not attempt to insert a PS unit with a power cord connected to it 2 Insert the PS unit by sliding it into the opening until a slight resistance is felt 3 Continue pressing the PS unit until it seats completely The latch will snap into place confirm ing the proper installation 4 Insert the power cord into the supply connector 5 Insert the other end of the power cord int
49. needed for the short switch 7 screws per side are needed for the standard switch There are 16 screws in the kit you will have left over screws 30 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Figure 21 Inserting the Caged Nuts Side you will slide the switch into i Second side 5 Clip 6 caged nuts into the holes in the rack on the side of the rack you will be sliding the switch into Check that both sides of the switch power side and connector side are at the same level in the rack 6 Clip 4 more caged nuts into the holes on the opposite side of the rack Check that both sides of the switch left and right are the same level in the rack 7 Slide the rail into the rail slide 8 Using two of the bolts for each corner install the rails and rail slides in the rack Do not tighten the bolts yet Figure 22 Slide the Rail into the Rail Slide This side of the rail kit goes on the side of the rack you will slide the switch into This is the same side of the switch that will be next to the vertical support Mellanox Technologies 31 Rev 1 1 Installation 9 Slide the switch into the rails 10 Tighten the bolts to 9 2 Nm or 81 5 pound inches 11 Put the switch into place and screw the bolts into the nuts Tighten the bolts to 9 2 Nm or 81 5 pound inches 12 Ground the switch 13 Plug in the power cables 14 Check the Status LEDs and confirm that all
50. nes europeas seleccionar un cable de alimentaci n armonizado internacionalmente y marcado lt HAR gt de tres conductores hilo de 1 0 mm2 como m nimo 300 voltios nominal con cobertura protectora aislante de PVC El cable debe tener un enchufe moldeado con capuch n de 250 voltios nominal 10 A 15 A adir conexi n a tierra Antes de conectar el dispositivo a la l nea de alimentaci n los tornillos del terminal de la puesta a tierra de protecci n del dispositivo se deben conectar a la puesta a tierra de protecci n de la instalaci n del edificio Informaci n de conexi n a tierra La instalaci n del edificio deber prover un medio para la conexi n con la puesta a tierra de protecci n y un t cnico de servicio deber conectar permanentemente el equipo a dicho medio de conexi n Un T CNICO DE SERVICIO comprobar si la toma el ctrica de la que se suminis trar corriente al equipo provee una conexi n con la puesta a tierra de protecci n del edificio De no ser as el T CNICO DE SERVICIO se encargar de instalar un CON DUCTOR DE CONEXI N A TIERRA DE PROTECCI N del terminal de puesta a tierra de protecci n separado al conductor de tierra de protecci n del edificio El equipo se instalar en un rea donde haya conexi n equipotencial como por ejemplo un centro de telecomunicaciones o una sala de computadoras dedicada 16 C digos de instalaci n Este dispositivo se debe instalar conforme a la versi n m
51. nfiniBand Long Haul System Hardware User Manual Rev 1 1 5 Select the image to boot Mellanox Technologies 53 Table 14 TX6100 Specification Data Rev 1 1 Appendix A Specification Physical 10 Weight TX6100 1 71 Hx 16 85 W x24 75 Short 8 01 kg 1 PS unit Size Weight Standard 43 6mm X 427 5mm X 628 9 mm 8 75 kg 2 PS units Standard 8 95 kg 1 PS unit 9 69 kg 2 PS units Mounting Mounting 19 Rack mount SerDes Speeds Connector SerDes Speeds 10 20 40 or 56 Gb s per port Types QSFP Connector Types Can use QSFP to SFP adapter modules Air Flow Heat dissipa 62 tion 641 7 BTUs hr Heat dissipation Maximum Power and Environmental Input Voltage Input Voltage Management Management 100 240 VAC 50 60Hz CPU PowerPC 460EX CPU CPU Power Typ Typ Consumption PS unit fan is always at 80 56Gb s Active Cables 149 65 W Passive cables 119 W Power numbers Max Max QSFP Downlink Uplink 56Gb s Power Level 2 4 Active Cables 188 06 W Typ 1 5W 2 5W Passive cables 145 91 W Cabl QSFP Downlink Uplink Temperature er PN Power Level 2 4 Operating 0 to 45 Celsius 2 0W 3 5W Non operating 40 to 70 Celsius Shock and Shock and Humidity Vibration Vibration ETSI EN 300 019 2 2 1999 09 Operating 5 95 non condensing Humidity Protocol Support Speed protocol Management QoS Auto Negotiation o
52. ng periods of lightning activity do not work on the equipment or connect or dis connect cables 24 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 6 Copper Cable Connecting Disconnecting Copper cables are heavy and not flexible as such they should be carefully attached to or detached from the connectors Refer to the cable manufacturer for special warnings and instructions 7 Rack Mounting and Servicing When this product is mounted or serviced in a rack special precautions must be taken to ensure that the system remains stable In general you should fill the rack with equip ment starting from the bottom to the top 8 Equipment Installation This equipment should be installed replaced or serviced only by trained and qualified personnel 9 Equipment Disposal Disposal of this equipment should be accordance to all national laws regula tions 10 Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes 11 Hazardous Radiation Exposure Caution Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure CLASS 1 LASER PRODUCT and reference to the most recent laser standards 60 825 1 1993 A1 1997 A2 2001 and EN 60825 1 1994 A1 1996 A2 2001 Mellanox Technologies 2
53. nkontakt Achtung Nutzung von Steuerungen oder Einstellungen oder Ausf hrung von Proze duren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkontakt f hren Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards ICE 60 825 1 1993 A1 1997 A2 2001 und EN 60825 1 1994 A1 1996 A2 2001 66 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 14 UL und CSA Certified Netzkabel F r Nordamerika Stromanschluss w hlen Sie ein Netzkabel das UL und CSA Certi fied LA 3 Leiter 18 AWG mit einem angespritztem Stecker bewertet bei 125 V 15 mit einer Mindestl nge von 1 5 m Six Feet aber nicht mehr als 4 5 m F r die europ ischen Zusammenhang w hlen Sie ein Netzkabel das international harmonisiert und der Aufschrift lt HAR gt 3 Leiter mindestens 0 75 mm2 Draht bewertet mit 300 V mit einem PVC Mantel isoliert Das Kabel muss eine angespritztem Stecker bewertet bei 250 V 10 A 15 Ableitstrom gt 3 5mA LEAKAGE gt 3 5mA WARNUNG Hohe Ableitstrom Earth Verbindung bevor Sie die Verbindung von wesentlicher Bedeutung werden 16 Add GND Verbindung Informationen Bevor Sie dieses Ger t an das Stromnetz die Schutzerde Terminal Schrauben dieses Ger t muss an den Schutzleiter in der Geb udeinstallation 17 Installation Codes Dieses Ger t muss installiert sein entsprechend auf die neueste Version des Landes N
54. not fall 5 Slide the switch from the rack 6 Remove the rail slides from the rack 7 Remove the ten caged nuts 7 1 Disposal According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way gx Follow the instructions found in the Mellanox Web site at mellanox com for proper instructions to disassemble and dispose of the Switch according to the WEEE directive Mellanox Technologies 47 Rev 1 1 Resetting the Switch 8 Resetting the Switch On the connector side panel under the system LEDs is a reset button This reset button requires a tool to be pressed DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset button Sharp objects can cause damage use a flat object to push the reset button Figure 33 Reset Button Mellanox A 5 PS1 PS2 D UID O RST Press the reset button to reset the main and management CPUs and to delete the existing password This button resets both the CPU of the switch device and the CPU of the management module It thereby resets all of the ports by bringing them down and powering them up when the button is pushed A quick push of this button performs this reset When the button is held down for 15 sec onds the switch is reset and the passwo
55. nstall firmware upgrades should the firmware image be damaged and cannot be upgraded through a host PC or remotely This interface 1s for support personnel and advanced users only 2 4 3 Reset Button On the connector side panel under the system LEDs is a reset button This reset button requires a tool to be pressed DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset button Sharp objects can cause damage use a flat object to push the reset button 22 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Figure 16 Reset Button A Press the reset button to reset the main and amp management CPUs and to delete the existing re password PS2 0 UID RST This button resets both the CPU of the switch device and the CPU of the management module It thereby resets all of the ports by bringing them down and powering them up when the button is pushed A quick push of this button performs this reset When the button is held down for 15 sec onds the switch is reset and the password is deleted You will then be able to enter without a pass word and make a new password for the user admin Mellanox Technologies 23 Rev 1 1 Installation 3 Installation Installation and initialization of the switch platform are straightforward processes requiring attention to the normal mechanical power and thermal precautions for rack mounted equipmen
56. o no This turns on autoconfiguration of the IPv6 addresses This is unsuitable for DHCPv6 Mellanox Technologies 35 Rev 1 1 Installation Table 11 Configuration Wizard Session IP Configuration by DHCP Sheet 2 of 2 Wizard Session Display Example Comments Step 5 Admin password Press lt Enter gt to leave unchanged lt new_password gt Step 6 Confirm admin password lt new_password gt To avoid illegal access to the machine please type a password and then press lt Enter gt Then confirm the password by re entering it Note that password characters are not printed You have entered the following information 1 Hostname lt switch name gt 2 Use DHCP mgmtO interface yes 3 Enable IPv6 yes 4 Enable IPv6 autoconfig SLAAC on mgmt0 interface no 5 Admin password Enter to leave unchanged CHANGED To change an answer enter the step number to return to Otherwise hit lt enter gt to save changes and exit Choice lt Enter gt Configuration changes saved To return to the wizard from the CLI enter the con figuration jump start command from configuration mode Launching CLI lt switch name gt gt The wizard displays a summary of your choices and then asks you to confirm the choices or to re edit them Either press lt Enter gt to save changes and exit or enter the configuration step number that you wish to return to Note To run
57. o an outlet of the correct voltage The green PS unit indicator should light If not repeat the whole procedure to extract the PS unit and re insert it 4 2 Extracting and Inserting the Fan Unit This switch can operate indefinitely with less than a full compliment of fans in the fan module inoperable so long as the ambient temperature is below 45 Celsius Operation without a fan unit should not exceed two minutes During fan hot swap if the LED indicator is OFF then the fan unit is disconnected 42 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Figure 29 Air Flow Labels I 1681 These air flow labels must be same To extract aFan Unit 1 Using two fingers push both latch releases towards each other simultaneously while pulling the fan module out of the switch As the fan unseats the fan status indicator will turn off 2 Remove the fan unit Figure 30 Fan Module Latches BENE 2111 1 I These two latches must be pushed towards each other at the same time while the module is pulled out To insert a FAN Unit 1 Make sure the mating connector of the new unit is free of any dirt and or obstacles 2 Insert the fan unit by sliding it into the opening until slight resistance is felt Continue press ing the fan unit until it seats completely The green fan status indicator should light If not extract the fan unit and reinsert
58. p www mellanox com related docs user_manuals Regulatory_and Compliance Guide pdf EMC statements are also in the Regulatory and Compliance Guide Rev 1 1 China CCC Warning Statement cire ccc Warning statements EEEN EENAA English translation disconnect all power sources before service For non tropical use TRAE Aral xnl 8 886 1 Oen 8 etel Dan hab yungh youq gij dienheiq diuzgen mbouj dwg diegndat haenx ancienz sawjyungh gs ASAS ars 24315 GLLS lalo ue Hs pai Dan hab yungh youq gij digih haijbaz 2000m doxroengz haenx ancienz saw gg ASAS Gare Ms gl 55 2000 Warning for Class A T Jh A EET ARA ET ER HART TERROR TON English translation of above statement This is a Class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures 56 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 Appendix B QSFP Interface Table 15 InfiniBand QSFP Connector Pinout Connector Connecto Pin r Pin Signal Description Number Name 1 GND Ground 2 Tx2n Transmitter Inverted Data Input J3 and J6 3 Tx2p Transmitter Non Inverted Data Input 19
59. personnel form et qualifi 14 Elimination du mat riel L limination de ce mat riel doit s effectuer dans le respect de toutes les l gislations et r glementations nationales en vigueur 15 Codes lectriques locaux et nationaux Ce mat riel doit tre install dans le respect des codes lectriques locaux et nationaux 16 Codes d installation L appareil doit tre install selon l ancienne version des codes lectriques nationaux du pays Pour l Am rique du Nord l quipement doit tre install conform ment aux sp cifications du Code Electrique National Am ricain et du Code Electrique Canadien gt 17 Interconnexion des unites Les c bles de branchement l unit RS232 et les interfaces Ethernet doivent tre certi fies UL de type DP 1 ou DP 2 Note lorsqu il existe dans un circuit non LPS Protection contre la surintensit Un appareil de protection r pertori facilement accessible contre la surintensit du circuit de branchement et calibr a 20A doit tre incorpor dans le c blage lectrique du b timent 18 Exposition au rayonnement grave Mise en garde l utilisation de commandes ou de r glages ou l ex cution de proc dures autres que ce qui est sp cifi dans les pr sentes peut engendrer une exposition au rayonnement grave PRODUIT LASER DE CLASSE 1 et r f rences aux normes laser les plus r centes 60 825 1 1993 A1 1997 A2 2001 et NE 60825 1 1
60. rd is deleted You will then be able to enter without a pass word and make a new password for the user admin 48 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 9 Management and Tools Overview Using this switch as an InfiniBand switch you will need the MLNX OS package or Mellanox UFM to update firmware for this switch The MLNX OS package can be downloaded from http www mellanox com gt Products gt Management Software gt MLNX OS The switch can be managed either remotely or Out of Band using MLNX OS 9 1 Switch Management Using the MLNX OSTM Software The TX6100 switches come standard with a management software module for chassis manage ment called Mellanox Operating System MLNX OS MLNX OS is installed on all SwitchX 2 based managed switch systems MLNX OS includes a CLI WebUI SNMP and chassis manage ment software and IB management software OpenSM The Ethernet ports for remote management connect to Ethernet switches These switches must be configured to 100M 1G auto negotiation The IB Subnet Manager running on the TX6100 switches supports up to 648 nodes If the fabric includes more than 648 nodes you may need to purchase Mellanox s Unified Fabric Manager UFM software package The managed switch system includes the following software components Embedded OS e Chassis manager and system BIST SNMP agent 3rd party tool integration
61. s and nodes within the fabric Fabric Inspector includes a complete set of tools for fabric wide diagnostics to check node node and node switch connectivity and to verify routes within the fabric Advanced filtering allows creating filtering rules on a system wide basis between nodes or port connections based on traffic patterns and user assigned system names GUIDs 9 3 1 Upgrading Software Software and firmware updates are available from the Mellanox Support website Copy the update to a known location on a Remote server within the user s LAN Use the CLI or the GUI in order to perform Software upgrades For further information please refer to the MLNX OS User Manual Be sure to read and follow all of the instructions regarding the updating of the software on your switch system 50 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 10 Troubleshooting As soon as a switch is plugged in make sure that the green power LEDs on the PS units are on Status LED and or Status Health LED If either of these two LEDs is red unplug the switch and call your Mellanox representative Power supply unit If the LED on the PS unit is not lit or is red check that the power cable is plugged into a working outlet 1 Check that the power cable has a voltage within the range of 100 240 volts AC 2 Check that the air flow direction of the PS units are consistent with the Fan module air flow
62. s compatible with your system rack and PS units The connector side of the switch has the QSFP ports system LEDs and management con nection ports The switch platform contains auto sensing 100 240 VAC connections for all possible PS units The installer should use rack capable of supporting the mechanical and environmental charac teristics of a fully populated platform The rack mounting holes conform to the EIA 310 standard for 19 inch racks Take pre cautions to guarantee proper ventilation in order to maintain good airflow at ambient temperature Cable routing in particular should not impede the air exhaust from the chassis 3 1 1 Installation Kits There are two Installation kit options One long and one short Both the long and the short switches can be mounted using the long rail kit Table 9 Installation Kit According to Rack Size Kit OPN Rack Size MSX60 BKIT 40 60 cm deep MSX60 SKIT 60 80 cm deep 3 2 Package Contents Before you install your new TX6100switch unpack the system and check to make sure that all the parts have been sent check this against the parts list below Check the parts for visible dam age that may have occurred during shipping The switch comes packed with the following items e 1X switch e X installation kit 2X power cable one for each PS unit Type C13 C14 Asingle power cord for each power supply unit can be ordered at no extra charge 1 X Harness e HAR000
63. s et des d gradations de biens 4 Connection d Alimentation electrique excedentaire dangers lectriques Ce produit comporte un couvercle transparent sur l espace pour l alimentation lec trique redondante Ne pas faire fonctionner le produit si le couvercle transparent n est pas solidement fix ou s il est enlev 5 Systeme de fusible neutre double p le Avertissement Syst me de fusible neutre double p le Veuillez debrancher tous les cordons d alimentation avant d ouvrir le boitier de ce produit ou de toucher un de ses composants internes 6 Orages dangers lectriques Pendant un orage il ne faut pas utiliser le mat riel et il ne faut pas brancher ou d brancher les c bles Mellanox Technologies 61 Rev 1 1 7 Branchement d branchement des c bles en cuivre Les c bles InfiniBand en cuivre sont lourds et ne sont pas flexibles il faut donc faire tr s attention en les branchant et en les d branchant des connecteurs Consultez le fab ricant des c bles pour conna tre les mises en garde et les instructions sp ciales gt 8 Risque de choc et de danger Risque de choc et de danger e lectriques Le de branchment d une seule alimentation stabilise e ne de branch uniquement qu un module Alimentation Stabilise e Pour isoler completement le module en cause Il faut de brancher toutes les alimentations stabilise es Risk of electric shock and energy haz
64. t The managed switch platform requires initial configuration to operate as an InfiniBand switch internally managed switches come with an internal PPC based management board This board allows for internally managing the switch through a host PC or remotely through the Ether net 3 1 Installation Safety Warnings For Safety Warnings in French see Section E Avertissements de s curit d installation French on page 61 for German see Section F Installation Sicherheitshinweise German on page 65 and for Spanish see Section G Advertencias de seguridad para la instalaci n Span ish on page 69 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source 2 Over temperature ing the maximum recommended 45 C 113 F Moreover to guarantee proper air This equipment should not be operated in an area with an ambient temperature exceed 7 flow allow at least 8cm 3 inches of clearance around the ventilation openings 3 Stacking the Chassis The chassis should not be stacked on any other equipment If the chassis falls it can cause bodily injury and equipment damage 4 Redundant Power Supply Connection Electrical Hazard This product includes a blank cover over the space for the redundant power supply Do not operate the product if the blank cover is not securely fastened or if it is removed 5 During Lightning Electrical Hazard Duri
65. taje y mantenimiento de bastidores Al instalar o realizar el mantenimiento de este aparato en un bastidor es preciso adop tar precauciones especiales para garantizar que el sistema se mantenga estable En gen eral en un bastidor los equipos se deben instalar comenzando desde abajo hacia arriba 10 Instalaci n de equipos La instalaci n el reemplazo y el mantenimiento de este equipo estar n a cargo nica mente de personal capacitado y competente 11 Asegurar confinamientos adecuados El fabricante del producto final o el usuario final deber n suministrar La un confinamiento adecuado para componentes el ctricos y mec nicos y contra incen dio 12 Eliminaci n de equipos La eliminaci n definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales 13 C digos el ctricos locales y nacionales LA Este equipo se debe instalar conforme a los c digos el ctricos locales y nacio nales 70 Mellanox Technologies MetroX 12 Port QSFP InfiniBand Long Haul System Hardware User Manual Rev 1 1 14 Cable de alimentaci n homologado por UL y con certificaci n CSA En conexiones de Am rica del Norte seleccionar un cable de alimentaci n homologado por UL y con certificaci n CSA de tres conductores 16 AWG termi nado en un enchufe moldeado con capuch n de 125 voltios nominal 13 A con una longitud m nima de 1 5 metros pero no m s de 4 5 metros En conexio

Download Pdf Manuals

Related Search

Related Contents

Cypress Perform CY7C1576V18 User's Manual  Philips Clock Radio AJ3570  SCOTT DPX 1072 TV Lyell  SonicWALL 01-SSC-4618  The Aqua Sub Jr. Operation Instructions  eBOX620-831-FL-CAN User`s Manual VA1-20111115  Bedienungsanleitung PCE-HB-(M) Serie    Manuale d` uso  

Copyright © All rights reserved. Failed to retrieve file