Home

108-Port InfiniBand QDR SwitchX® Switch Platform Hardware User

Contents

1. 22
2. H 17
3. Mellanox Technologies 107 18 UL 4 LA 19 UL CSA UL
4. 26 27 WEEE 2002 96 WEEE G F7 Avertismente privind siguran
5. Mellanox Technologies 108 M 23 RS232 Ethernet DP 1 DP 2 UL 20 A 24 1 IEC 60 825 1 1993 A1 1997 A2 2001 u EN 60825 1 1994 1 1996 2 2001 25
6. 9 Ha H 10 Mellanox Technologies 106 11 BO InfiniBand
7. CHAT 6 45 113 F 8 3 7
8. 9 KARAA SG SBS HF 10 YN PSU HERKES LA RA Mellanox Technologies 88 Re 12 InfiniBand HEE RF InfiniBand BLZ UI IAE ES EUER LR RER I BANMANEH 13 14 16 A 17 L 18 UL
9. 4mA LA MUESTREN Mellanox Technologies 89 A EPA 19 UL FI EM CSA ERE UL CSA 8 8 888 16 AWG 125 V 13 A ERED 5 5 4 5 lt HAR gt TUE 185888 1 0 300 V PVC 250 V 10 A 20 21 GND RER E AE A RR GND KREZ ETE ie DOS SERERE JI ERRE MEIA A EIER MER NER EMT o REA Bin E 22 23
10. II WI rss MA Status The management module LEDs display the switch system operating conditions Mellanox Technologies 61 A m Table 9 LEDs Display for Normal Operation cas Normal LED Condition Description State STATUS Off No Power Green This LED Green System is up and running shows the sta Yellow System warning Attention needed such as overheating tus of the chas Red System not operational Diagnostics fail CPU hang sis HW fail Overheat critical Blinking green System booting Restore factory defaults in progress PSU STATUS Off No power Green Green Normal operational Red PS fault detected User should check individual power supplies for fault indications SPINE FANS Off No power to fan Green STATUS Green Nominal operational Red One or more of the spine fans is bad User should check individual spine fan LEDs for fault indications LEAF FANS Off No power to fan Green STATUS Green Nominal operational Red One or more of the leaf fans is bad User should check individual leaf fan LEDs for fault indications MASTER Off this management module is not the master MM Green Green Management module is operating as a master i e the other management module is a slave Figure 54 Management Module LEDs Master 3 1 5 1 Management Module PSU LED Indicator The management m
11. 56 Figure 49 PSU Cover On and Off o o ccooococoo 57 Figure 50 Leaf Board Led Indicators 58 Figure 51 Spine Status LEDS sai re le Be 59 Figure 52 Spine Side Panel Display Status Indications 60 Figure 53 Management Module Status Indications 61 Figure 54 Management Module LEDs 62 Figure 55 Port Numbering 63 Figure 56 Top and Bottom Ports Henke en 63 Figure 57 Management Module Interfaces 64 Figure 58 Reset Button 65 Figure 59 Spine Side Panel Display Status Indications 67 Figure 60 Management Module Status Indications for Normal Operation 67 Figure 61 InfiniBand Connector Symbol 81 Figure 62 Connector Male and Female Views 81 Mellanox Technologies 7 InfiniBand Switch Platform Hardware User Manual Revision History Table 1 Revision History of this User s Manual Revision Date Details 2 2 January 2014 Rearranged document Consolidated installation sections under Chapter 2 Installation on page 15 updated Chapter 1 Overview on page 11 and re ordered sections Updated Section 1 3
12. 69 5 2 Accessing the CPU via the Ethernet Connector 69 5 3 Upgrading Software irn ossi e a ET NEC NEN a de 69 Chapter 6 Troubleshooting 70 6 1 Power Supply Unit sedes ERE Bra ler ik 70 sar Board A Rust ode ue di Ra VES P PANEM 70 6 3 Management Module es 71 6 4 Spine Board save n roe he Ce tet Nate Pura RE 72 O ON SOIUNAIB asco doan Ae adu 72 Chapter 7 Disassembly and Disposal 73 7 1 Disassembling the Chassis 73 7 1 1 Removing the Chassis suasa ua aaaea 73 7 1 2 Removing the Bottom Shelf 73 e UDisposak a E tE e a cM a ds M euo ne 74 Appendix A Specification Data 75 A 1 76 A2 Approved Cables 77 A 3 EMC CertiticationS is ik ine e pa x ar Roe ee dida ex e oput 77 Appendix Calculating the Weight of Customized Chassis 78 Appendix Calculating the Power of a Chassis 79 Appendix D QSFP Interface 80 Appendix E Replacement Parts Ordering Numbers 82 Appendix Installation Safety Warnings 83 F 1 Installation Safety
13. Dan hab yungh youq gij dienheiq diuzgen dwg ad haenx ancienz saw 2000m Warning for Class A A English translation of above statement This is a Class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures F3 Avertissements de s curit pour l installation French 1 Instructions d installation Veuillez lire la totalit des instructions d installation avant de relier l quipement au secteur Mellanox Technologies 2 2 Blessures cause du poids Pr voyez assez de personnel pour soulever ce produit en toute s curit he e 2121 Ibs gt 55 kgs 70 121 lbs 40 Ibs 40 70 Ibs 32 55 kgs 18 kgs 18 32 kgs 3 quipement lourd Cet quipement est tr s lourd et doit tre d plac avec un syst me de levage m ca nique pour viter les blessures 4 Installation dans un emplacement acc s limit Cette unit doit tre install e dans un emplacement acc s limit 5 Danger d lectrocution A Danger d lectrocution Lorsque le module de ventilation est retir les broches d alimentation sont expos es
14. 27 Figure 12 Connect Rail Slide to Rack Vertical support 28 Figure 13 Inserting the Caged Nuts for the Faceplate 28 Figure 14 Chassis on Shelf with Filler Panel 29 Figure 15 Cable Holders dcs Leer RR den hen a ee 30 Figure 16 Inserting the Caged Nuts for the Cable Holder 31 Figure 17 Cable Holder Placement 32 Figure 18 Chassis Rails and Rail Slides 33 Figure 19 Installing the Handles 34 Figure 20 Screw the Handles the Chassis 34 Figure 21 The Rails are Already Connected Onto the Chassis 35 Figure 22 Raising the Chassis Using a Mechanical Lift 36 Figure 23 Put on the Ball came e bo etat 36 Figure 24 155100 Chassis on the Shelf 37 Figure 25 Face Plate Mounting Bolt Locations 37 Figure 26 Ground Connection 38 Figure 27 Multiple Power Inlets Electric Caution Notification 39 Figure 28 Spine Module btw ARR ads 40 Figure 29 Power Cord Numbering 42 Figure 30 Power Supply ve caca p e
15. 4 gt 14 Rx4p Rx3p 13 m GND GND I 27 ModPrsL spa 12 11 pm eu IntL SON 28 VccTx Rx 10 30 Vcc1 ResetL 9 31 LPMode ModSelL 32 GND GND 7 33 ne 34 Tx3n Tx4n 5 35 GND GND 4 36 2 3 l Tx1n Tx2n 2 38 GND 1 Figure 62 QSFP Connector Male and Female Views View into Rear of Connector Pd TI pe lt 2 Z 2 2 5 O y Jd 9 8 amp 9 5 85 8 2 6 gt 05 5 SP amp FETS SG Mellanox Technologies 81 InfiniBand Switch Platform Hardware User Manual Appendix E Replacement Parts Ordering Numbers Table 17 Replacement Parts Ordering Numbers Part Description OPN Power supply unit PSU 1000W for Modular Switch MTP005001 Family Power supply blank MTM005001 Leaf board unit 18 port QDR MIS5001QC Modular Switch Family Leaf Blank MTM005004 Spine board unit for QDR Switch system MIS5002QC Spine board blank MTM005002 PPC460 Management Module MIS5600MDC Management module blank MTM005003 Fan unit for leafs MTF005004 Modular Switch Family Management Blank MTM005003 Rack Installation Kit for IS5600 SX6536 Series MTR005600 MIS5X00 Modular Switch Series Spine Fan Unit MTF005003 DB to RJ45 Harness HAR000028 Power cord 250V 15A 2 0M C14 t
16. LED Condition LED Description Off No power to the spine Solid Green Spine is up and running Flashing Green Spine is powering up Solid Orange Non fatal error this spine needs troubleshooting but does not require chassis shutdown Solid Red Fatal error Mellanox Technologies 59 3 1 3 2 Fan LED The spine fan indicator LED has the following LED assignment Table 6 Spine Fan Status LED LED Color LED Description Solid Green Spine Fan is OK Flashing Green Spine Fan needs replacing Solid Yellow One or more of the fans in this spine is not working Each spine has two fans in the fan module 3 1 3 3 Spine to Leaf IB Connection Status LEDs The leaf connection status on each spine displays the condition of the connection between the spine and each leaf There is a minimum of one LED per leaf per spine and a maximum of 6 LEDs per leaf These LEDs indicate a valid connection between a leaf and a spine Table 7 shows the leaf to spine status according to the LED condition Table 7 Spine to Leaf IB Link Status LED Condition LED Description Off Link is down Solid Green Logical connection Flashing Green Data activity Solid Orange Physical connection 3 1 4 Spine Side Panel Display LED Indicators The spine side panel display has LEDs that show the chassis condition Figure 52 Spine Side Panel Display Status Indications m E Ei E m a STATUS PSU SPINE LEAF MNG1 MNG2
17. CSA 3 16 AWG 1 5 6 4 5 125 B 13 lt HAR gt 3 c 1 0 MM 300 250 10 20 21
18. Mellanox Technologies 75 InfiniBand Switch Platform Hardware User Manual Table 14 Switch Specification Sheet IS5100 Baseboard Performance and Device management Agents for full Infini Band In Band Management EMC ENVIRONMEN TAL ACCOUSTIC SOUND POWER LEVEL Physical Power and Environmental Protocol Support Regulatory Compliance InfiniBand Auto Negotiation of 20Gb s 40Gb Safety US Canada cTU Vus EU IEC60950 QoS 8 InfiniBand Virtual Lanes for all International CB ports Management USA Class A Canada ICES Class A EU EN55022 Class A EU EN55024 Class A EU EN61000 3 2 Class A EU EN61000 3 3 Class A Japan VCCI Class A EU IEC 60068 2 64 Ran dom Vibration EU IEC 60068 2 29 Shocks Type I II EU IEC 60068 2 32 Fall Test ISO 7779 ETS 300 753 67 5 db A Scalability and Performance Replaceable Parts Switching Perfor Simultaneous wire speed any port to leafs Up to 6 leafs 18 ports each mance any port Power Supplies 3 Power Supplies standard 48K Unicast Addresses Max per one of which is a redundant Addressing Subnet power supply 16K Multicast Addresses per Subnet Leaf Fan Mod 4 Leaf Fan Modules ules Switching Capacity 8 6 Tb s 3 Spine Fan Modules with Spine Fan Mod 2 integral fans per module ules 3 Spines Management 2 available 1 required for Modules operation A 1 EMI Certification EMI
19. dans l emplacement du module 4 NE PAS ins rer d outils ou la main dans l emplacement du module 6 Surchauffe Cet quipement ne doit pas tre en service dans un local dont la temp rature d passe le maximum recommand de 45 C 113 F En outre et pour garantir une circulation d air correcte laisser un espace d au moins 8 cm 3 autour des orifices de ventilation 7 Chassis empil sur d autres quipements Le ch ssis ne doit pas tre empil sur d autres quipements S il tombe il peut endom LA mager l quipement ou entra ner des blessures 8 Connexion de l alimentation redondante danger d lectrocution Ce produit est quip d une alimentation redondante ou d un cache si elle est absente LA Dans ce dernier cas ne pas faire fonctionner le produit si le cache est retir ou mal fix Mellanox Technologies 93 9 Fusibles phase neutre Ce systeme dispose de fusibles phase neutre D branchez tous les cordons d alimenta tion avant d ouvrir le capot ou de toucher tout l ment l int rieur 10 Plusieurs prises d alimentation Risque et danger d lectrocution Les alimentations sont toutes ind pendantes Pour s assurer que le commutateur est bien hors tension d branchez toutes les alimen tations 11 En cas d orage danger d lectrocution Pendant un orage ne pas travailler sur l quipement ni brancher ou d brancher des c bles 12 Connexion et d connexion
20. 4 eaf fan modules 6 leaf modules 2 management modules Mellanox Technologies 13 InfiniBand Switch Platform Hardware User Manual 1 2 Features List 108 QDR 40Gb s InfiniBand ports in a 6U switch e 1 2 1 compliant SDR DDR QDR link speed e power supply Congestion control Adaptive routing e Port mirroring e Chassis High Availability sMB High Availability 1 3 Power Supply Redundancy This chassis has N 1 power supply redundancy With a full complement of power sup plies one power supply can be removed and replaced without shutting down the chassis or stopping the flow of data 1 Features for a future release Mellanox Technologies 14 InfiniBand Switch Platform Hardware User Manual 2 Installation A This chassis can be installed in standard 19 racks that have depths between 65cm and 80cm between the vertical supports of the rack gt Installation and initialization of the chassis is a simple process requiring attention to the normal mechanical power and thermal precautions for rack mounted equipment Your Chassis will be shipped in two packages one with the all of the leafs leaf package that are ordered and an extra management module should it be ordered and the second pack age chassis package with all of the rest of the parts The chassis requires initial configuration to get the chassis and Fabric management up and running through remote manageme
21. BES RS232 RME A 495 7 I EL AS UL DP 1 DP 2 LPS 20 24 Fi t ti RAN CLASS 1 872 SRA EHE IEC 60 825 1 1993 A1 1997 2 2001 EN 60825 1 1994 A1 1996 A2 2001 IC ASE JEP JE m 25 HEAR f im E PR IO A A MER MAMA Mellanox Technologies 90 26 E 27 WEEE Ef WEEE 2002 96 EC FA ESSERE 7 508 EEE H ERBE BARA RARI 75 ARIE FE mm 28 Y EEE TN IT Mellanox Technologies 91 29 China Warning Statement English translation disconnect all power sources before service For non tropical use
22. Mellanox TECHNOLOGIES Mellanox Technologies Mellanox Technologies Ltd 350 Oakmead Parkway Suite 100 Beit Mellanox Sunnyv ale CA 94085 PO Box 586 Yokneam 20692 USA Israel www mellanox com www mellanox com Tel 408 970 3400 Tel 972 0 74 723 7200 Fax 408 970 3403 Fax 972 04 959 3245 Copyright 2014 Mellanox Technologies All Rights Reserved Mellanox Mellanox logo BidgeX ConnectX Connect IB CORE Direct InfiniBridge In fini Host InfiniScale MetroX MLNX OS PhyX ScalableHPC SwitchX UFM Virtual Protocol Interconnect and Voltaire are registered trademarks of Mellanox Technologies Ltd ExtendXTM FabricIT Mellanox Open Ethernet Mellanox Virtual Modular Switch MetroDX Unbreakable Link are trademarks of Mellanox Technologies Ltd All other trademarks are property of their respective owners 2 Mellanox Technologies Document Number 3242 InfiniBand Switch Platform Hardware User Manual Table of Contents Listiof Tables ous ae age een 5 List Of Figures ea en a re Ew 6 Revision History ss ee e a nn aa i 8 About this Manual uui en 9 Chapter 1 Overview issu en a 11 11 Product lnformatioms s ess ee aes 11 1 1 1 Serial Number and Product Version Information 11 14 2 License Key iius De eem xx De a ane Sere n da 12 1 1 3 Management Module MAC 12 1 1 4 Produc
23. Rizik od strujnog udara i opasnost od elektri ne energije PSU jedinice su neovisne gt Odspojite sva napajanja kako biste osigurali stanje bez napajanja unutar platforme preklopnika 11 Tijekom udara munje Opasnost od elektricne energije Tijekom djelovanja munja nemojte raditi na opremi ili spajati ili odspajati kabele 12 Spajanje Odspajanje bakrenog kabela InfiniBand Bakreni kabeli InfiniBand su te ki i nesavitljivi i kao takvi se moraju pa ljivo priklju iti na ili isklju iti iz konektora Obratite se proizvo a u kabela za posebna upo zorenja upute 13 Monta a ormari a i servisiranje opreza kako bi se osiguralo da sustav ostane stabilan Op enito trebali biste ispunja Kad se proizvod montira ili se servisira u ormari u moraju se poduzeti posebne mjere A vati ormari s opremom po ev i od dna prema vrhu Mellanox Technologies 115 or 14 Instaliranje opreme Ovu bi opremu trebalo instalirati zamjenjivati i ili servisirati samo obu eno i kvalifici rano osoblje Ova oprema trebala bi se instalirati u skladu s lokalnim i nacionalnim elektri nim kodovima 17 Instalacijski kodovi N Ovaj se uredaj mora instalirati sukladno najnovijoj verziji nacionalnih y N elektri nih kodova dr ave U Sjevernoj Americi oprema se mora instalirati 4 N sukladno vaZecim zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code 18 Zamjena baterije Upo
24. E Signal Description 1 GND Ground 2 Tx2n Transmitter Inverted Data Input 3 Tx2p Transmitter Non Inverted Data Input 4 GND Ground 5 Tx4n Transmitter Inverted Data Input 6 Tx4p Transmitter Non Inverted Data Input 7 GND Ground 8 ModSelL Module Select 9 ResetL Module Reset 10 Rx 3 3 V Power supply receiver 11 SCL 2 wire serial interface clock 12 SDA 2 wire serial interface data 13 GND Ground 14 Rx3p Receiver Non Inverted Data Output 15 Rx3n Receiver Inverted Data Output 16 GND Ground 17 Rxlp Receiver Non Inverted Data Output 18 Rxin Receiver Inverted Data Output 19 GND Ground 20 GND Ground 21 Rx2n Receiver Inverted Data Output 3 22 Rx2p Receiver Non Inverted Data Output 3 23 GND Ground 24 Rx4n Receiver Inverted Data Output 3 25 Rx4p Receiver Non Inverted Data Output 3 26 GND Ground 27 ModPrsL Module Present 28 IntL Interrupt 29 3 3 Power supply transmitter 30 Vccl 3 3 V Power Supply 31 LPMode Low Power Mode 32 GND Ground 33 Tx3p Transmitter Non Inverted Data Input 34 Tx3n Transmitter Inverted Data Input 35 GND Ground 36 Txlp Transmitter Non Inverted Data Input 37 Txin Transmitter Inverted Data Input 38 GND Ground ellanox Technologies 80 InfiniBand Switch Platform Hardware User Manual Figure 61 InfiniBand QSFP Connector Symbol J3 and J6 20 19 21 Rx2n Rxin 18 ___22 Rx2p Rx1p 17 2 eis GND 16 _ 24 15
25. 13 A with a minimum length of 1 5m six feet but no longer than 4 5m For European connection select a power supply cord that is internationally harmonized and marked lt HAR gt 3 conductor minimum 1 0 mm wire rated at 300 V with a PVC insulated jacket The cord must have a molded plug rated at 250 V 10 A 20 High Leakage Current LA Warning High leakage current Earth connection essential before connecting supply 21 Add GND connection information Before connecting this device to the power line the protective earth terminal screws of this device must be connected to the protective earth in the building installation LA GND Connection Information The building installation shall provide a means for a connection to protective earth and the equipment shall be permanently connected to that by a service person A SERVICE PERSON shall check whether or not the socket outlet from which the equipment is to be powered provides a connection to the building protective earth If not the SERVICE PERSON shall arrange for the installation of aPROTECTIVE EARTHING CONDUCTOR from the separate protective earthing terminal to the pro tective earth wire in the building The equipment shall be installed in area where equi potential bonding exists such as a telecommunication centre or a dedicated computer room 22 Installation codes This device must be installed according to the latest version of the country national electrica
26. N el ctricos nacionales del pa s en cuesti n En Am rica del Norte el equipo se debe instalar de acuerdo con las disposiciones vigentes del C digo El ctrico Nacional de los a EE UU y del C digo El ctrico de Canada 18 Cambio de bater a II y a danger d explosion s il y a remplacement incorrect de la batterie Remplacer uniquement avec une batterie du m me type ou d un type quivalent recommand par le constructeur Mettre au rebut les batteries usag es conform ment aux instructions du fabricant 19 Cable de alimentaci n homologado por UL y con certificaci n CSA N En conexiones de America del Norte seleccionar un cable de alimentaci n y homologado UL con certificaci n CSA de tres conductores 16 AWG termi A W nado en un enchufe moldeado con capuch n de 125 voltios nominal 13 A con una longitud minima de 1 5 metros pero m s de 4 5 metros En conexiones europeas seleccionar un cable de alimentaci n armonizado internacionalmente y marcado lt HAR gt de tres conductores hilo de 1 0 mm2 como m nimo 300 voltios nominal con cobertura protectora aislante de PVC El cable debe tener un enchufe moldeado con capuch n de 250 voltios nominal 10 A 20 Alta corriente de fuga ADVERTENCIA Alta corriente de fuga Es esencial efectuar la conexi n a tierra antes de conectar la alimentaci n Mellanox Technologies 103 Re M 21 Agregar informaci n de conexi n a tier
27. Power Supply Redundancy on page 14 e Section 2 6 2 Installing the Cable Holder on page 30 Section 2 9 Hot Swap Insertion and Extraction on page 41 e Section 7 1 Disassembling the Chassis on page 73 e Appendix F Installation Safety Warnings on page 83 Table 14 Switch Specification Sheet IS5100 on page 75 e Appendix C Calculating the Power of a Chassis on page 79 2 1 Sept 2012 Added figure 23 Added information regarding inserting the bottom spine first Insert spines from bottom to top 2 0 Feb 2012 Updated Section 7 and 7 1 1 9 Dec 2011 Removed irrelevant N N Redundancy section Added License Key section license for FabricIT CM Updated Section 7 and 7 1 1 8 Oct 2011 Changed name to Hardware User Manual Updated Table 10 LEDs display Updated Table 11 LEDs display Fixed the Leaf to spine connections LED section explanation 1 7 May 2011 Added last page with barcode Removed InfiniBand Fabric Initialization and Management Updated Fabric Management Software Section 1 6 Oct 2010 Added air flow direction 1 5 Oct 2010 Removed Chassis Rails from installation Kit and Installation instruc tions Fixed Port Connector LED Assignment 1 4 Aug 2010 Added QSFP Cable Power Budget Classification Added weight lifting warning Added Remove all protective plastic film from all sides and top of the chassis Added FCC Statement 15 19 Added CoG
28. of leafs 2 76 of leaf blanks 0 764 of management modules 3 15 Total This total is in kilograms Multiply the total by 2 2 to get the total weight in pounds Mellanox Technologies 78 x InfiniBand Switch Platform Hardware User Manual Appendix C Calculating the Power of a Chassis To calculate the power consumption of a chassis add the power of the fans spines leafs and management modules Table 15 Power Consumption of Chassis Parts Part Typ Power Passive Cables Drin Pen ja any IB QDR leaf 82 28W 121 45W Spine 102 86W Not applicable Fan 4 47W Not applicable Management module 15W Not applicable To calculate the chassis power at typical conditions fill in the table below Number of FRUs FRU Type de OL Total Power FRU Type of spines 102 86 W of leafs passive cables 82 28 W of leafs optical cables 121 45W of management modules 15W for the PPC 460 manage ment module 4 Chassis fan 447W 17 88 W Total DC power Total AC power Total DC power efficiency 85 Mellanox Technologies 79 InfiniBand Switch Platform Hardware User Manual Appendix D QSFP Interface M Table 16 InfiniBand QSFP Connector Pinout Connector en
29. the Leaf board and uninstall and reinstall the Leaf board 5 Replace the Leaf board with a new one A Should any of the boards shut down due to over temperature wait 5 minutes and then follow the procedure starting with step 2 gt Issue 3 The Physical link LED for the InfiniBand connector does not come on 1 Check that both ends of the cable are connected 2 Check that the locks on the ends are secured 3 Make sure that the latest FW version is installed on both the HCA card and the switch 4 If media adapters are used check that the all connections are good tight and secure 5 Replace the cable Issue 4 The Activity indication does not come on Check that the Subnet Manager has been started Mellanox Technologies 70 er InfiniBand Switch Platform Hardware User Manual 6 3 Management Module Issue 1 Yellow Status LED for the Chassis on the Management Module is Lit 1 Check the MLNX OS management for confirmation and possible explanation of the alert 2 Reset the master management module by pushing the rest button If you have two management modules installed this will convert the master management module to the slave and convert the slave to the master N If there is only one management module in the chassis all of the leafs and ports 4 are reset by bringing them down and powering them up when the management module is removed Make sure the S Fans and L Fans LEDs are green Make sure
30. In general you should fill the rack with equip ment starting from the bottom to the top 14 Equipment Installation Mellanox Technologies This equipment should be installed replaced and or serviced only by trained and qual ified personnel 84 Me VEN 15 Equipment Disposal Disposal of this equipment should be in accordance to all national laws and regula N tions 16 Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes 17 Installation Codes f This device must be installed according to the latest version of the country national electrical codes For North America equipment must be installed in accordance to the applicable requirements in the US National Electrical Code and the Canadian Electrical Code 18 Battery Replacement Warning Replace only with UL Recognized battery certified for maximum L abnormal charging current not less than 4mA There is a risk of explosion should the battery be replaced with a battery of an incorrect type Dispose of used batteries according to the instructions 19 UL Listed and CSA Certified Power Supply Cord A For North American power connection select a power supply cord that is UL Listed PA N and CSA Certified 3 conductor 16 AWG terminated with a molded plug rated at A W 125 V 13 A with a minimum length of 1 5m six feet but no longer than 4 5m For Eu
31. N de alimentare care este inregistrat UL si certificat CSA cu 3 conductoare 16 AWG y W terminat cu o fis turnat cu putere nominal egal cu 125 V 13 A cu o lungime de EROT minimum 1 5 m ase picioare dar nu mai lung de 4 5 m Pentru conectarea la o surs de alimentare n Europa selecta i un cordon de alimentare care este armonizat la nivel interna ional si marcat lt HAR gt cu 3 conductoare cu minimum 2 fire de 1 0 mm cu putere nominal egal cu 300 V si cu o manta izolant din PVC Cordonul de alimentare trebuie s fie prev zut cu o fi turnat cu putere nominal egal cu 250 V 10 A 20 Curent de scurgere de nalt frecven Avertisment Curent de scurgere de nalt frecven Imp m ntarea este esen ial nainte de a conecta sursa de alimentare 21 Ad ugarea de informa ii privind legarea la p m nt nainte de a conecta acest dispozitiv la o linie electric de energie suruburile bornelor de protec ie de legare la p m nt ale acestui dispozitiv trebuie s fie conectate la priza de p m nt de protec ie din instala ia cl dirii Informa ii privind legarea la p m nt Instalatia cl dirii va asigura un mijloc de conectare la priza de p m nt iar echipamen tul va fi n mod permanent conectat la priza de p m nt de un agent de ntre inere UN AGENT DE NTRE INERE va verifica dac priza borna de ie ire prin interme diul c reia va fi alimentat echipam
32. bottom with corresponding numbers dis played to the outside of the leafs vertically along the side panel Figure 31 Leaf Board Numbering xs EH S Gave Da vis avis L2 L4 L6 2 9 2 1 Extracting a Leaf Board Each leaf board has a ejector handle that locks the board in place and serves as a lever for seating or extracting see Figure 32 1 Run the shut down command no power enable lt module gt For example to shut down leaf 16 run the command below switch master config no power enable L16 2 Disconnect all cables connected to the leaf 3 Push the ejector handle to unlock the ejector from the chassis 4 Open the ejector until it is 45 degrees from the leaf Figure 32 Ejector Handle Pull the leaf out of the chassis Push the ejec tor handle Ejector handle po 5 Pull out the module half way through the guiding rails using the ejector handle 6 Lock the ejector handle Mellanox Technologies 43 InfiniBand Switch Platform Hardware User Manual 7 Hold the body of the leaf on both sides and remove it from the chassis The board is short therefore do not let go of it while sliding it out Figure 33 Leaf Release Push here to release the ejector handle Pull the ejector handle to remove the leaf gt 17 Iv AD E NA Y Ws YA We SA Vic VA 2 9 2 2 Inserting a Leaf Board When hot swapping any of the units it is nec
33. certification on the fully populated chassis was performed with the chassis installed in a closed two door rack using the chassis installation kit supplied by Mellanox Tech nologies Mellanox Technologies 76 InfiniBand Switch Platform Hardware User Manual A 2 Approved Cables For a list of all approved cables see http www mellanox com related docs user manuals Mellanox approved cables pdf A 3 EMC Certifications The list of approved certifications per chassis in different regions of the world is located on the Mellanox Website at http www mellanox com related docs user manuals Regulatory and Compliance Guide pdf EMC Statements are also in the Regulatory and Compliance Guide Mellanox Technologies 77 InfiniBand Switch Platform Hardware User Manual Appendix B Calculating the Weight of a Customized Chassis The weight of a customized chassis can be calculated for any possible customization as follows Take the weight of a chassis with the following FRUS installed e fans modules All power supplies The weight of the IS5100 chassis configured above is 54 7kg To this add the weight of installed FRUs e Spines Leafs Leaf blanks Management modules Fill in the table below to calculate the weight of your system Number of FRUs FRU Type Weight of 1 FRU Total Weight FRU Type Chassis as shipped 3t of Spines 3 77
34. chassis for the convenience of the IT manager All chassis conditions and management options are available and controllable through the manage ment SW either CLI or Web GUI v It is recommended that all of the chassis sub systems be maintained and managed through the management software 3 1 1 Power Supply Unit LEDs Each Power Supply Unit has the following indicator LEDs Figure 48 Power Supply Unit Status Indications r AC OK FAIL OK AC When lit this LED indicates input voltage between 100 and 240 Volts DC FAIL When lit this LED indicates a fault in the power supply DC OK When lit this LED indicates that the output from the power supply is 48 VDC A The PSUs are on the spine side of the chassis behind two cover panels The plugs for these PSUs are on the leaf side of the chassis gt Mellanox Technologies 56 Figure 49 PSU Cover On and Off PSU Covers On e ee ee ev o LE LE LE L ee es e e e e 0 a 185100 1 000000000 ee 000009000 000000000 090000000 2 0000000001 FAR 000000000 000000000 000000000 a 1000000000 gerer 0000000900 000000000 000000000 PSU Covers Off PSU 1 u 155100 D 0000900000 000000000 000000000 000000000 1 000000000 000000000 PSI 2 000000000 000000000 000000000 000000000 000000000 000000000 Nm Grounding post ESD Connector Mellanox Technologies 57 3 1 2 Leaf Board LED Indicators 3 1 2 1 3 1 2 2 Mellanox Tech
35. each leaf board are placed in two rows 9 ports to a row The ports are labelled as shown in Figure 55 The bottom row ports are flipped from the top row See Figure 56 Figure 55 Port Numbering Mellanox Technologies 63 M 3 2 3 3 3 4 3 4 1 3 4 2 3 4 3 Air Flow These switches come with the air flow pattern of air entering through the spine side and exiting through the connector side QSFP Cable Power Budget Classification 155100 switches are designed for active cables with a max power per module of 2 0W This is power level 2 according to the QSFP Public Specification Management Module Interfaces The switch system requires at least one management module The management module has five interfaces to connect to the IS5100 They are e 112C port 1 CONSOLE port this is an RS232 connector for connecting to a host machine this is an Ethernet connector e 1 USB port 1 RST reset button Figure 57 Management Module Interfaces 12 MIG A RST PSU S FANS u mo I 12 This interface is for Debug and Troubleshooting only This interface is for FAEs only CONSOLE The CONSOLE port is used during the installation process to configure the chassis for remote management Connect this port to a local host using the harness supplied with the chassis See the Installation Guide for the initial configuration procedure MGT Management The MGT port is an Etherne
36. la radiatii periculoase PRODUS LASER CLASA 1 si referire la cele mai recente standarde pentru laser IEC 60 825 1 1993 A1 1997 A2 2001 si EN 60825 1 1994 A1 1996 A2 2001 25 Carter adecvat SS AN IN Un carter electric mecanic si ignifug adecvat va fi furnizat de fabricantul produsului N final si sau utilizatorul final 26 Nu utilizati comutatorul ca raft sau spatiu de lucru Atentie Echipamentul montat pe o linie de alunecare sin nu va fi utilizat ca raft sau spatiu de lucru Scopul sinelor nu este de a glisa unitatea de pe rack Acestea sunt des tinate instal rii permanente numai la punctul final de oprire si nu vor fi folosite pentru depanare si intretinere E 27 Directiva DEEE In conformitate cu Directiva DEEE 2002 96 CE toate deseurile de echipamente elec trice si electronice EEE trebuie colectate separat si nu trebuie eliminate impreun cu deseurile menajere obisnuite Eliminati acest produs si toate componentele sale in mod responsabil si ecologic ellanox Technologies 113 F8 Sigurnosna upozorenja za instaliranje Croatian 1 Upute za instaliranje Pa ljivo pro itajte upute za instaliranje prije spajanja opreme na izvor elektri ne ener gije 2 Tjelesne ozljede uslijed te ine Kako biste sigurno podignuli ovaj proizvod koristite dovoljan broj ljudi LA e 40 Ibs 40 70 Ibs 70 121 lbs gt 121 Ibs 18 kg 18 32 kg 32 55 kg gt 55 kg 3 Te ka
37. least 8cm 3 inches of clearance around the ventilation openings 7 Stacking the Chassis The chassis should not be stacked on any other equipment If the chassis falls it can cause bodily injury and equipment damage Mellanox Technologies 83 8 Redundant Power Supply Connection Electrical Hazard This product includes a redundant power or a blank in its place In case of a blank power supply do not operate the product with the blank cover removed or not securely fastened 9 Double Pole Neutral Fusing M This system has double pole neutral fusing Remove all power cords before opening the cover of this product or touching any internal parts 10 Multiple Power Inlets Risk of electric shock and energy hazard The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform 11 During Lightning Electrical Hazard A During periods of lightning activity do not work on the equipment or connect or dis connect cables 12 Copper InfiniBand Cable Connecting Disconnecting Copper InfiniBand cables are heavy and not flexible as such they should be carefully attached to or detached from the connectors Refer to the cable manufacturer for spe cial warnings instructions 13 Rack Mounting and Servicing 5 When this product is mounted serviced in special precautions must be taken to ensure that the system remains stable
38. populated switch chassis 5 v Mellanox recommends a rack that is at least 80 cm long 2 6 1 ESD Connection Before starting any procedure on the IS5100 switch system 1 Put an ESD prevention wrist strap on your wrist and make sure there is good contact between your body and the strap 2 Plug the other end of the wrist strap to a valid ground Make sure that this is a tight fit 2 6 1 1 Installation ProcedureRequirements You will need 2 phillips screwdriver 3 phillips screwdriver e a grounding lug ground wire to properly ground the chassis v The installation will be much easier with a power screwdriver Y It is recommended to use AWG6 or 4mm diameter wire for grounding purposes It is recommended to have at least two people for the duration of the installation proce dure Use a mechanical lift to raise this chassis If not use enough manpower to ensure the safety and wellbeing of all of the people involved in the installation NG Mellanox Technologies 22 InfiniBand Switch Platform Hardware User Manual 2 6 1 2 Installation and Cable Management Kit Parts Parts for installing the shelf 1 shelf 8 M6 bolts for the caged nuts 4 caged nuts 2 Shelf rail slides 4 lock washers 2 long 2 hole flat washers Parts for installing the chassis 2chassis rail slides 4 handles 8 M 5 pan head bolts 8 allen head screws e 2 flat 4 hole metal spacers e allen wrench 8 l
39. so that the manage ment module will start a new cycle checking through the leafs and spines for the FW versions Extracting a Management Module Management modules are located on the leaf side above the leafs There are two places to install the management modules Only one management module is required to run the switch system Each management module has a pair of ejectors that lock the board in place and serve as a lever for seating or extracting see Figure 45 ellanox Technologies 52 InfiniBand Switch Platform Hardware User Manual 1 Run the shut down command no power enable lt module gt For example to shut down management module 2 run the command below switch master config no power enable MGMT2 Disconnect all cables connected to the management module Push outward on the ejector handles to unlock the ejectors from the chassis Open the ejectors until they are 45 degrees from the module Pull out the module half way through the guiding rails using the ejector handle Lock the ejector handle UM ue US Hold the body of the board on both sides and remove it from the chassis The board is short therefore do not let go of it while sliding it out Figure 45 Management Module WANN rq coc re Las N Ejector handles 2 9 5 1 Inserting a Management Module When hot swapping any of the units it is necessary to wait 1 minute after removing th
40. specification Related Documentation The documentation set accompanying the QSFP Chassis InfiniBand Switch platform includes the following Table 2 Reference Documents and Websites Document Name Description InfiniBand Architecture Specification The InfiniBand Architecture Specification that is provided by Vol 1 Release 1 2 1 IBTA Switch Product Release Notes For possible hardware issues see the switch support product page This requires a customer support login Look up the rele vant SwitchX based switch system series release note file Mellanox MLNX OS User Manual This document contains information regarding configuring and for VPI managing Mellanox Technologies SwitchX switch platforms listing all of the commands available through MLNX OS with explanations and examples Mellanox Technologies 9 or InfiniBand Switch Platform Hardware User Manual Conventions Throughout this manual the name IS5100 and the terms chassis and switch are used to describe the 108 port QSFP InfiniBand chassis unless explicitly indicated otherwise The following icons are used throughout this document to indicate information that is important to the user v This symbol makes recommendations to the user This symbol indicates information that is helpful to the user This symbol indicates a situation that can potentially cause damage to hardware or software Warning This symbol indicates a situatio
41. that the spine and the leafs both have the same version of FW Reburn the FW and remove and reinstall the management module Own Roo If you are running the chassis with only one management module remove and rein stall the management module Make sure the mating connectors of the unit are free of any dirt and or obstacles See Section 2 9 5 on page 52 7 If you are running the chassis with only one management module replace the man agement module Issue2 Yellow LED for the Leaf Fan on the Management Module is Lit 1 Check the MLNX OS management for confirmation and possible explanation of the alert 2 Make sure that there is nothing blocking the front or rear of the chassis and that the fan modules and ventilation holes are not blocked especially dust over the holes 3 If you find dust blocking the holes it is recommended to clean the fan unit and remove the dust from the front and rear panels of the switch using a vacuum cleaner 4 Determine which fan module is problematic by checking the status LED on each fan module 5 Remove and reinstall the problematic fan unit Make sure the mating connector of the new unit is free of any dirt and or obstacles See Section 2 9 4 on page 50 6 Replace the Leaf fan module LA Replace defective leaf fan modules as soon as they are identified Should any of the boards shut down due to over temperature follow the procedure starting in step 2 Issue 3 Yellow LED for the Spine F
42. to ensure maximum cable bend ing room Mellanox Technologies 26 Q OOoRV om InfiniBand Switch Platform Hardware User Manual Figure 10 Placement of Chassis in Rack Doors RACK p udi Cable with recommended bending radius 19 482 mnj Connector side Chassis AN Insufficient room for recommended bending radius Doors You will most likely need extra room for cable bending on the connector side of the chas sis and should plan to keep the spine side as close to the rack door as possible thus hav ing more room for the cables See Figure 1 on page 33 3 Clip 4 caged nuts into the holes in the rack you will be using to connect the shelf brackets Check that both sides of the shelf are at the same level in the rack Figure 11 Inserting the Caged Nuts for the Shelf ED 2 Top of shelf Bottom of shelf Do not use this gt hole for the shelf This hole is for the filler panel el e lel 4 Insert 2 caged nuts for the filler panel 5 Using two of the bolts for each rail slide install the rail slides onto the rack Check that both sides of the switch left and right are the same level in the rack Mellanox Technologies 27 InfiniBand Switch Platform Hardware User Manual Figure 12 Connect Rail Slide to Rack Vertical support LA A A 6 Place the four bolts for the caged nuts within reach 7 Put the shelf into plac
43. with a license for FabricIT Chassis Manager The license key to acti vate the license is found on the bottom side of the pull out tab Figure 2 License Key Label SAN MT1134x00560 License Key LK2 EFM CONFIG 5G2L SSHG LOKA L64Q K6D2 Q60Q 3ADH G88A 1H3Q 7FT9 5M Figure 3 Product Label Tab Location o o Top right hand corner of the spine side of the chassis Tab location with D i u Product label and management MAC 155100 1 1 3 Management Module MAC Each management module has a label with its MAC address See Figure 4 for the loca tion of this label Figure 4 Management Module MAC Address Location WM ry BT 1 1 4 Product Physical Specifications and Power The switch ships in a minimum base configuration plus additional modules depending on the chosen customer configuration Optional modules included e Leaf boards Management modules Mellanox Technologies 12 lt gt InfiniBand Switch Platform Hardware User Manual The following figure shows the connector and spine sides fully populated Figure 5 155100 Switch Views Leaf Side Spine Side gt eo e ADADA DA gt e H Ho a 185100 Er ISEB RRR 000000000 m M 950909009 000600000 000009600 3 supply units 000000000 ye 000000000 rar 000000006 000000500 E IMA 000000000 e e 000000000 000000000 000000000 3 spine modules
44. Allow 15 sec onds for link to get up To remove disengage the lock and slowly pull the connector away from the port receptacle Y N For a valid physical connection both ends of the cable must be connected to working devices Mellanox Technologies 40 InfiniBand Switch Platform Hardware User Manual Take care to not impede the air flow through the ventilation holes next to the Infini Band ports Use cable lengths which allow routing horizontally around to the side of the chassis before bending upward or downward in the rack 2 8 1 Supported Approved Cables For a list of approved cables for this switch see the Mellanox approved cable list http www mellanox com related docs user manuals Mellanox approved cables pdf 2 8 2 Cable Power Classes Chassis and switches need to be able to dissipate the heat generated by high power I O cables and modules The Mellanox IS5x00 series chassis are rated for cables up to class 2 as per the SFF committee classification SFF 8436 PDF See http www mellanox com content pages php pg cables for the cable class rating of Mellanox cables 2 9 Hot Swap Insertion and Extraction Before starting any procedure on 155100 switch system put an ESD prevention wrist strap on your wrist and connect to the 155100 chassis Do NOT mix replacement parts based on different generations of chip Do not install InfiniScale IV based replacement parts within a SwitchX based chas sis and
45. FANS FANS MASTER MASTER Mellanox Technologies 60 Table8 LEDs Display for Normal Operation n con Normal LED Condition Description State STATUS Off No Power Green Green System is up and running Yellow System warning Attention needed such as overheating Red System not operational Diagnostics fail CPU hang HW fail Overheat critical Blinking green System booting Restore factory defaults in progress PSU STATUS Off No power Green Green Normal operational Red PS fault detected User should check individual power supplies for fault indications SPINE FANS Off No power to fan Green STATUS Green Nominal operational Red One or more of the spine fans is bad User should check individual spine fan LEDs for fault indications LEAF FANS Off No power to fan Green STATUS Green Nominal operational Red One or more of the leaf fans is bad User should check individual leaf fan LEDs for fault indications MNGI Off Green MASTER no power STATUS this management module is not installed this management module is not the master Green Management module is operating as a master MNG2 Off Off MASTER no power STATUS this management module is not installed this management module is not the master Green Management module is operating as a master 3 1 5 Management Module LED Indicators Figure 53 Management Module Status Indications
46. Mellanox TECHNOLOGIES 108 Port InfiniBand QDR SwitchX Switch Platform Hardware User Manual PN MIS5100Q 3DNC Rev 2 2 www mellanox com NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE USE OF THE PRODUCT S AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE
47. Specification Sheet IS5100 SerDes Speeds Connector Types Center of Gravity CoGh CoGw CoGd Max Heat Output 20 and 40Gb s per port QSFP 115 58mm from bottom of chassis 227 2mm from left side surface 338 09mm from port end surface Measured from the bottom left corner as one faces the switch ports 9264BTUs hr sumption per Leaf Power Con sumption per Spine Power Con sumption Fan Power Con sumption Man agement Power Con sumption for optical cables QSFP 155100 Power consump tion Typ Physical Power and Environmental H x W x D 10 43 x 19 x 27 inches Input Voltage 90 264 50 60Hz 265 mm x 482 6mm x 685 mm 13A 100V The shelf adds 44 5mm to the height 6 3A 240V Temperature Weight 61 8 kg 136 Ibs minimum configu Operating 0 to 45 Celsius ration Non operating 40 to 70 Celsius 77 kg 170 Ibs full configuration 32 kg 71 lbs empty configuration Humidity operating 1096 8596 non condensing Mounting 19 Rack mount EIA 310 Power Con Typical 82 28W including passive power Max 89 74W including passive power Typical 102 86W includ ing 2 fans Max 110 32W including 2 fans Typ 4 47W Max 40W Typ 15W Max 22W 2 0W power level 2 108 ports Passive 1000W Active 1140W including at 1W Optical 1277W including at 2W Optical 1539W including at 2W
48. Stromversorgung anschlie en 2 Verletzungsgefahr wegen des Gewichts Um das Produkt sicher anzuheben gen gend Personen einsetzen e e e 40 Ibs 40 70 Ibs 70 121 lbs gt 121 Ibs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Schweres Ger t Dieses Ger t ist sehr schwer und muss mit einem mechanischen Hebeger t verschoben werden um Verletzungen zu vermeiden 4 Installation an Bereich mit eingeschr nktem Zugang Diese Ger t ist f r die Installation in einem Bereich mit beschr nktem Zugang vorge sehen 5 Stromschlagrisiko Stromschlagrisiko Bei abgenommenem Ventilatormodul sind die Stromkontakte in der Modulvertiefung zug nglich Es d rfen KEINE Werkzeuge oder K rperteile in die Vertiefung des Ventilatormoduls gelangen 6 bertemperatur Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von 45 C 113 F betrieben werden Es ist ein Luftstrom von 200 LFM bei maximaler Umgebungstemperatur erforderlich Au er dem sollten mindestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten Mellanox Technologies 97 7 Stapeln des Chassis Das Chassis sollte nicht auf andere Ger te gestapelt werden Wenn das Chassis herun terf llt kann es zu Verletzungen und Besch digungen an Ger ten f hren 6 Zweipolig Neutrale Sicherung Achtung Zw
49. Warnings English 83 F2 Chinese 87 F 3 Avertissements de s curit pour l installation French 92 F 4 Installation Sicherheitshinweise German 97 F 5 Advertencias de seguridad de instalaci n Spanish 101 F 6 Russian 105 F 7 Avertismente privind siguran a la instalare Romanian 109 F 8 Sigurnosna upozorenja za instaliranje Croatian 114 Mellanox Technologies 4 InfiniBand Switch Platform Hardware User Manual List of Tables Table 1 Revision History of this Users Manual 8 Table 2 Reference Documents and 9 Table swear Status LEDs a eta ae eke ra a Ga ERE RE x 58 Table 4 Connector Physical and Logical Link Indications 58 Table 5 Spine Status LED oir ts a EN 59 Table 6 Spine Fan Status LED i aia ee No S 60 Table 7 Spine to Leaf IB Link Status 60 Table 8 LEDs Display for Normal 61 Table 9 LEDs Display for Normal 62 Table 10 Management Module PSU LED Configurations 62 Table 11 Management Modul
50. a la instalare Romanian 1 Instruc iuni de instalare SLE 4 Cititi toate instruc iunile de instalare nainte de a conecta ellanox Technologies 109 2 Accidentare cauzat de greutate Apelati la un num r suficient de persoane pentru ridica in sigurant acest produs LA lt 40 Ibs 40 70 Ibs 70 121 Ibs gt 121 Ibs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Echipament greu Acest echipament este foarte greu si trebuie s fie mutat folosind un dispozitiv meca nic de ridicare pentru a evita producerea de leziuni 4 Instalarea ntr un loc cu acces limitat Aceast unitate este destinat instal rii ntr un loc cu acces limitat 5 Risc de soc electric A Risc de soc electric y Odat ce modulul ventilator este ndep rtat pinii electrici sunt accesibili n cavitatea 4 N modulului 2 NU introduceti instrumente sau p rti din corp cavitatea modulului ventilator 6 Temperatura in exces AN Acest echipament nu trebuie s fie ac ionat ntr o zon unde temperatura ambiant N dep e te valoarea maxim recomandat 45 C 113 F In plus pentru a asigura un flux de aer adecvat l sati un spatiu liber de cel putin 8 cm 3 inchi in jurul fantelor de ventilare 7 Suprapunerea cadrului Cadrul nu trebuie s fie suprapus peste niciun alt echipament In cazul in care cadrul cade poate cauza leziuni corporale si deterior ri ale echipa
51. a za opremu spoj na za titno uzemljenje zgrade Ako ne SERVISNO OSOBLJE e orga nizirati instaliranje VODI A ZA TITNOG UZEMLJENJA iz posebnog terminala za titnog uzemljenja na icu za titnog uzemljenja u zgradi Oprema e se instalirati u podru je gdje postoje ekvipotencijalni spojevi poput telekomunikacijskog centra ili namjenske ra unalne sobe 22 Instalacijski kodovi Ovaj se ure aj mora instalirati sukladno najnovijoj verziji nacionalnih elektri nih kodova dr ave U Sjevernoj Americi oprema se mora instalirati sukladno va e im zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code 23 Interkonekcija ure aja Kabeli za spajanje na jedinicu RS232 i Ethernet su elja moraju biti s UL certi fikatom vrste DP 1 ili DP 2 Napomena kad se nalazi u krugu bez LPS vodi a Za tita od strujnog preoptere enja Uvijek dostupni odobreni za titni ure aji od strujnog preoptere enja nazivne struje od 20 A moraju se ugraditi u o i enje zgrade 24 Izlo enost opasnom zra enju Pozor Kori tenje kontrola prilagodba ili izvo enje postupaka koji se razli kuju od onih koji su ovdje navedeni mo e izazvati izlaganje opasnom zra enju LASERSKI PROIZVOD KLASE 1 1 referenca na najnovije laserske standarde IEC 60 825 1 1993 A1 1997 A2 2001 1 EN 60825 1 1994 A1 1996 A2 2001 25 Odgovaraju a okolina Odgovaraju e elektri no mehani ko i protupo arno okru enje trebao bi om
52. an on the Management Module is Lit 1 Check the MLNX OS management for confirmation and possible explanation of the alert Mellanox Technologies 71 InfiniBand Switch Platform Hardware User Manual 2 Determine which spine has a defective fan by checking the Fan LEDs on all of the spines Make sure that there is nothing blocking the front or rear of the chassis and that the fan modules and ventilation holes are not blocked especially dust over the holes If you find dust blocking the holes it is recommended to clean the fan unit and remove the dust from the front and rear panels of the switch using a vacuum cleaner Remove and reinstall the fan unit of the spine Make sure the mating connector of the new unit is free of any dirt and or obstacles See Section 2 9 4 on page 50 Replace the spine fan module LA Replace defective spine fan modules as soon as they are identified 6 4 Spine Board Issue 1 The yellow LED on the Spine board is lit 1 Check the MLNX OS management for confirmation and possible explanation of the alert Make sure that there is nothing blocking the front or rear of the chassis and that the fan modules and ventilation holes are not blocked especially dust over the holes If you find dust blocking the holes it is recommended to clean the fan unit and remove the dust from the front and rear panels of the switch using a vacuum cleaner Remove and reinstall the spine board Make sure the mati
53. and Max heat to Specs in Appendix A 1 3 July 2010 Fixed graphic call out in Figure 4 1 2 July 2010 Added mote that the initial configuration must be performed on all of the management modules in the chassis Master before Slave Mellanox Technologies 8 InfiniBand Switch Platform Hardware User Manual Table 1 Revision History of this User s Manual Revision Date Details 1 1 June 2010 Added section on getting licenses Added note r e Wait 1 minute before putting in a Hotswap part New power numbers Added appendix Calculate Custom chassis weight Added appendix Calculate Custom chassis power Added a note that if EFM is updated and the FW image in the leafs and spines is earlier than the minimum that the new version of EFM can work with then the chassis management system will require 45 min utes to update all of the FW images in the leafs and spines Replaced Directive WEEE graphic Added a note switches must be configured to 10 100M auto negoti ation Moved Revision above About 1 0 May 2010 Initial release About this Manual This manual provides an overview of the SwitchX based 155100 modular InfiniBand chassis switch and guidelines for its operation Intended Audience This manual is intended for users and system administrators responsible for installing and setting up the chassis platform The manual assumes familiarity with the InfiniB and architecture
54. ash 2 Follow the steps in Section below Extracting Spine Boards Except 1 or 2 1 Run the shut down command no power enable module For example to shut down spine 06 run the command below switch master config no power enable S06 2 Push outward on the ejector handles to unlock the ejectors from the chassis ellanox Technologies 47 InfiniBand Switch Platform Hardware User Manual 3 Open the ejectors until they are at a45 degree angle from the module Do not use the fan FRU handle to extract the spine board 4 Pull out the module half way through the guiding rails using both ejectors 5 Lock the ejector handles 6 Hold the body of the board on both sides and remove it from the chassis 2 9 3 2 Inserting a Spine Board When hot swapping any of the units it is necessary to wait 1 minute after removing the defective part before inserting the new part This is necessary so that the manage ment module will start a new cycle checking through the leafs and for the FW versions To insert a spine board 1 Check for foreign objects in or mechanical damage to the chassis spine slots 2 Check spine mechanics for any noticeable damage or deviations from the pass crite rion shown in Figure 38 Figure 38 Intact vs Defected Mechanics Mellanox Technologies 48 eu InfiniBand Switch Platform Hardware User Manual 3 Check back signal connectors integrity Look for any broken s
55. assis 2 4 Leaf Package Contents The leafs are ordered by the customer and are shipped 4 to a box The customer will receive as many boxes as needed to fill the order 2 5 Management Package Contents When a second management module is ordered the package includes 1 management module ordered by the customer e RJA5 to DB9 harness 2 6 Physical Installation Warning This equipment is very heavy Safety is the first concern Make sure that adequate manpower and proper equipment is used for transporting and moving the h chassis The fully loaded chassis weighs 77 170 LBS full configuration 32 KG 71 LBS empty configuration 54 7kg 120 LBS shipped configuration The switch platform uses 7U of rack space in a standard 19 rack 6U for the chassis and 1U for the shelf The switch ships from the factory with mounting holes on the spine side There are upper brackets to connect the leaf side to the rack near the top of the chas sis The weight of the switch is supported from underneath the unit by the shelf Mellanox Technologies 21 em InfiniBand Switch Platform Hardware User Manual This chassis can be installed in standard 19 racks that have between 65cm and 80cm between the vertical supports of the rack Make sure that a fully populated rack including cables will have sufficient air flow for cooling A Choose a rack which is able to support the mechanical and environmental characteris tics of a fully
56. au depanat intr un rack trebuie s fie luate m suri de precautie speciale pentru a se asigura c sistemul r m ne stabil In general trebuie s umpleti rack ul cu echipamente incepand de jos in sus 14 Instalarea echipamentului Acest echipament trebuie s fie instalat inlocuit si sau depanat numai de c tre personal instruit si calificat 15 Eliminarea echipamentului Eliminarea acestui echipament trebuie s se realizeze in conformitate cu toate legile si regulamentele nationale 16 Codurile electrice locale si nationale Acest echipament trebuie s fie instalat conform codurilor electrice locale si nationale 17 Codurile ed instalare IN Acest dispozitiv trebuie s fie instalat in conformitate cu ultima versiune a codurilor N electrice nationale ale t rii in cauz Pentru America de Nord echipamentul trebuie s N fie instalat conform cerintelor aplicabile din Codul electric national al SUA si Codul electric canadian 18 nlocuirea bateriei Avertisment Inlocuiti numai cu o baterie recunoscut UL certificat pentru curent de inc rcare anormal maxim de minimum 4 mA LA Exist risc de explozie in cazul in care bateria este inlocuita cu o baterie necorespunz toare Eliminati bateriile folosite in conformitate cu instructiunile 19 Cordon de alimentare electric inregistrat UL si certificat CSA N Pentru conectarea la o surs de alimentare pentru America de Nord selectati un cordon
57. bleitstrom Earth Verbindung bevor Sie die Verbindung von wesentlicher Bedeutung werden 19 Infomationen zum Erdungsanschluss Bevor Sie dieses Ger t an das Stromnetz die Schutzerde Terminal Schrauben dieses Ger t muss an den Schutzleiter in der Geb udeinstallation Mellanox Technologies 99 AS M 20 Installationscodes Dieses Ger t muss installiert sein entsprechend auf die neueste Version des Landes National Electrical Code F r Nordamerika m ssen in bereinstimmung mit den gel LA tenden Vorschriften in der US amerikanischen National Electrical Code und dem Canadian Electrical Code 21 Verbindung der Ger te untereinander Kabel f r den Anschluss an das Ger t RS232 und Ethernet Schnittstellen m ssen UL zertifiziert Typ DP 1 oder DP 2 Hinweis wenn nicht mit Wohnsitz in LPS Schal tung berstromschutz Eine leicht zug ngliche Auflistung Abzweigleitung berstrom Schutzeinrichtung 20 A bewertet werden m ssen in dem Geb ude Verkabelung 22 Gef hrliche Strahlung Achtung Nutzung von Steuerungen oder Einstellungen oder Ausf hrung von Proze duren die hier nicht spezifiziert sind kann zu gef hrlichem Strahlenkontakt f hren Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards ICE 60 825 1 1993 A1 1997 A2 2001 und EN 60825 1 1994 A1 1996 A2 2001 23 Geeignetes Geh use Geeigneter elekrischer mechanischer und Feuerschutz sind vom Hersteller des Endprodukts o
58. ca equipment must be installed in accordance to the applicable requirements in the US National Electrical Code and the Canadian Electri cal Code 23 Interconnection Of Units Cables for connecting to the unit RS232 and Ethernet Interfaces must be UL certified type DP 1 or DP 2 Note when residing in non LPS circuit Overcurrent Protection A readily accessible Listed branch circuit overcurrent protective device rated 20 A must be incorporated in the building wiring 24 Hazardous Radiation Exposure Caution Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure CLASS 1 LASER PRODUCT and reference to the most recent laser standards IEC 60 825 1 1993 A1 1997 A2 2001 and EN 60825 1 1994 A1 1996 A2 2001 25 Proper Enclosure A suitable electrical mechanical and fire enclosure shall be provided by the end prod uct manufacturer and or the end user 26 Do Not Use the Switch as a Shelf or Work Space ellanox Technologies Caution Slide rail mounted equipment is not to be used as a shelf or a work space The rails are not intended for sliding the unit away from the rack It is for permanent instal lation at final resting place only not used for service and maintenance 86 27 WEEE Directive According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disp
59. caged nuts are to be placed The cable holders should go to the outside of the vertical supports A 2 Set the bottom of the cable holder at the level of the shelf If the cable holder is not set properly the upper bracket will not line up with the cable holder Mellanox Technologies 31 InfiniBand Switch Platform Hardware User Manual Figure 17 Cable Holder Placement Notch for upper bracket washer Set this even with the top of the shelf Screw the cable holder onto the rack using the screws provided Repeat steps 1 3 for the second cable holder Install the shelves The cable support shelves just sit on the cable holders Nn Pw Use the holes in the shelves to tie down the cables individually or in bundles Use Velcro ties to tie down the cables Electric cable ties are not recommended Mellanox Technologies 32 InfiniBand Switch Platform Hardware User Manual 2 6 3 Installing the Chassis Figure 18 Chassis Rails and Rail Slides Rail slides A es ee S d Do not use the handles on the fans for lifting or moving the chassis in the rack 1 Screw the handles onto the chassis Use the 8 allen head screws and the allen wrench provided Two handles go on the connector side and two go on the power side of the chassis Do not use the locknuts They are extras not needed for this installation Mellanox Technologies 33 InfiniBand Switch Platform Hardware User Manua
60. carga el ctrica Con el m dulo del ventilador quitado se obtiene acceso a las clavijas de alimentaci n desde dentro de la cavidad del m dulo NO introducir herramientas ni partes del cuerpo en la cavidad del m dulo del ventila dor 6 Sobretemperatura AA No se debe utilizar el equipo en un rea con una temperatura ambiente superior a la m xima recomendada 45 C Adem s para garantizar una circulaci n de aire adec N uada se debe dejar como minimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilaci n Mellanox Technologies 101 7 Apilamiento del chasis Los chasis no se deben apilar sobre otros equipos La ca da del chasis podr a causar lesiones corporales as como da os al equipo 8 Conexi n redundante de fuente de alimentaci n peligro de descarga Este producto incluye una fuente de alimentaci n redundante o en su lugar una vac a Si se dispone de una fuente de alimentaci n vac a no utilizar el producto si su tapa est quitada o no est bien cerrada 9 Fusible neutro o de polo doble Dos fusibles uno en el polo y otro en el neutro Quitar los cables de corriente antes de abrir la tapa de este producto o tocar cualquier componente interno gt 10 Tomas de alimentaci n m ltiples Riesgo de descarga el ctrica y peligro de corriente Todas las fuentes de alimentaci n son independientes Desconecte todas las fuentes de alimentaci n para asegu
61. d instructions for disassembly of the FRUs and chassis according to the WEEE Directive 10 Dispose of these pieces in a legal and environmentally friendly way 7 1 1 Removing the Chassis 1 2 pW Remove the screws connecting the upper brackets to the rack Remove the screws holding the chassis to the rack These screws are located in the faceplate on the spine side of the chassis Remove the upper brackets from the chassis Remove the lock down bars Dispose of the Chassis in a legal and environmental way Go to the Mellanox website for detailed instructions for disassembly of the chassis according to the WEEE Directive 7 1 2 Removing the Bottom Shelf 1 Remove all of the bolts that are holding the shelf to the rack Mellanox Technologies 73 InfiniBand Switch Platform Hardware User Manual 2 Remove the filler panels 3 Remove the shelf 4 Remove all of the caged nuts 7 2 Disposal According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way Go to the Mellanox website for detailed instructions for disassembly according to the WEEE Directive Mellanox Technologies 74 S InfiniBand Switch Platform Hardware User Manual Appendix A Specification Data Table 14 Switch
62. der dem Endbenutzer bereitzustellen 24 Switch nicht als Regal oder Arbeitsplatz nutzen Achtung Auf Schieber Schienen montiertes Ger t ist nicht als Regal oder Arbeitsbe reich zu nutzen Die Schienen sind nicht daf r bestimmt die Einheit aus dem Gestell weg zu ziehen Sie sind nur f r die permanente Installation an einem endg ltigen Stan dort gedacht nicht f r Instandhaltung und Wartung 25 WEEE Direktive Gem WEEE Directive 2002 96 EC m ssen alle elektrischen und elektronischen Abfallger te EEE separat gesammelt und nichit mit normalem Haushaltsm ll ensorgt werden Dieses Produkt und alle seine Teile in verantwortungsvoller und umweltfreundlicher Art und Weise entsorgen ellanox Technologies 100 F5 Advertencias de seguridad de instalaci n Spanish 1 Instrucciones de instalaci n Antes de conectar el equipo a la fuente de alimentaci n leer todas las instrucciones de instalaci n 2 Lesi n corporal a causa de peso 5 Recurra a suficientes personas para levantar este producto sin 40 Ibs 40 70 Ibs 70 121 lbs gt 121 Ibs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Equipos pesados Dado que el equipo es muy pesado se debe mover nicamente mediante un elevador mec nico para evitar lesiones 4 Instalaci n en lugares con acceso restringido Esta unidad ha sido ideada para instalar en lugares de acceso restringido 5 Riesgo de descarga el ctrica N Riesgo de des
63. du c ble InfiniBand en cuivre A Les cables InfiniBand en cuivre sont lourds et peu flexibles Par cons quent il faut proc der avec soin pour les brancher ou les d brancher des connecteurs Consulter le fabricant du cable pour obtenir des instructions ou des avertissements sp cifiques E vr 13 Montage en rack et maintenance Lors du montage ou de la maintenance de ce produit dans un rack il faut faire sp ciale ment attention pour s assurer que l ensemble reste stable En r gle g n rale le rack doit tre rempli en commengant par le bas 14 Installation de l quipement Cet quipement ne doit tre install remplac et maintenu que par un personnel form et qualifi 15 Mise au rebut de l quipement IN 4 N x D N La mise au rebut de cet quipement doit se faire conform ment toutes les lois et 4 N r glementations nationales Mellanox Technologies 94 Ra 16 Codes lectriques locaux et nationaux Cet quipement doit tre install conform ment aux codes lectriques locaux et nation aux 17 Codes d installation N Cet appareil doit tre install conform ment la version la plus r cente des codes lec trique nationaux En Am rique du Nord l quipement doit tre install en respectant N les exigences de l US National Electrical Code et du Code canadien de l lectricit 18 Remplacement de la batterie Avert
64. e S Fan LED Configurations 63 Table 12 Management Module L Fan LED Configurations 63 Table 13 Management Module MASTER LED Configurations 63 Table 14 Switch Specification Sheet 155100 75 Table 15 Power Consumption of Chassis Parts 79 Table 16 InfiniBand Connector Pinout 80 Table 17 Replacement Parts Ordering Numbers 82 Mellanox Technologies 5 ak le InfiniBand Switch Platform Hardware User Manual List of Figures Figure 1 Product Label i Ra C da dicam a 11 Figure 2 License Key 12 Figure 3 Product Label Tab Location 12 Figure 4 Management Module MAC Address Location 12 Figure 5 155100 Switch Views css ede er ea ER 13 Figure 6 Shelf Installation Kit Parts 23 Figure 7 Chassis Installation Parts 24 Figure 8 Shock and Tilt Stickers 44 024 RR har ae ak kan a a 25 Figure 9 Opening the Container 26 Figure 10 Placement of Chassis in Rack 27 Figure 11 Inserting the Caged Nuts for the Shelf
65. e and screw the bolts into the nuts from step 3 8 Extend the rail slides to the rack vertical support and screw them to the rack using the 2 hole washers and lock washers See Figure 12 9 Tighten all of the screws to 7 7 Nm or 68 pound inches 10 Insert 8 caged nuts for the faceplate in the exact locations shown in Figure 13 Inserting the Caged Nuts for the Faceplate 11 Install the filler panel directly below the shelf Figure 13 Inserting the Caged Nuts for the Faceplate Place caged nuts here Shelf Mellanox Technologies 28 InfiniBand Switch Platform Hardware User Manual Figure 14 Chassis on Shelf with Filler Panel Shelf Filler panel Mellanox Technologies 29 InfiniBand Switch Platform Hardware User Manual 2 6 2 Installing the Cable Holder v Now is the time to install the cable holder Figure 15 Cable Holders Right Side Cable Holder gt Left Side Cable Holder fe E 8 X M6 X 8 Caged Nut 4 d 8 X M6 bolt Cable support shelf For each model of chassis there is the one support shelf for every two leafs Mellanox Technologies 30 InfiniBand Switch Platform Hardware User Manual Figure 16 Inserting the Caged Nuts for the Cable Holder Place to connect the chassis rail slide Place caged nuts here O 000 Go 1 Place the cable holder next to the rack on the connector side of the chassis and iden tify the holes where the
66. e bottom up N When a slave management board is not installed or not working hot swapping the spine board connected to the master management board will cause the chassis to crash or spine 2 as the management modules are connected to the chassis components Neither the CLI nor the GUI management tools will allow you to shut down spine 1 through these spines Extracting Spine Board 1 2 Spine board 1 is connected to management board 1 and spine board 2 is connected to management board 2 Mellanox Technologies 46 im InfiniBand Switch Platform Hardware User Manual M Figure 36 Management Module Numbering MNGI management module 1 top MNG2 management module 2 bottom Removing spine 1 causes management module 1 to reset Removing spine 2 causes management module 2 to reset Warning If the spine you want to hot swap is connected to the master management module the management module will reboot when you take out the spine If you have only one management module the chassis will crash Figure 37 Spine Board Extraction Pull the latches to remove the spine TESTO rs ESSE A 921 2325 33 35 2000095906 000000000 0000000 55 5 299009000 If you need to hot swap 1 or 2 1 Check to see if the spine you need to remove is connected to the master management module See Figure 36 If you have only one management module the chassis will cr
67. e defective part before inserting the new part This is necessary so that the manage ment module will start a new cycle checking through the leafs and spines for the FW versions To insert a management board 1 Check for foreign objects in or mechanical damage to the chassis management slots 2 Check management mechanics for any noticeable damage 3 Check back signal connectors integrity Look for any broken signal dividers or any deviations from the pass criterion shown in Figure 46 4 Check power connector s integrity Look for any damage on the power connector casing or blades damage or any deviations from the pass criterion shown in Mellanox Technologies 53 InfiniBand Switch Platform Hardware User Manual Figure 47 Figure 47 Intact vs Defected Power Pin Holders 5 Start with the ejector handles fully open that is at 45 degrees to the front panel of the management 6 Holding the management by its sides carefully set the management board into the chassis 7 Using only the management ejector handles slowly slide the board into the chassis until the hooks reach the vertical bar Do not apply excessive force to slide in the management board If you feel resistance remove the management and double check both the chassis and management for any damage 8 Catch the hooks onto the vertical bar of the chassis and push the ejector handle shut 9 Lock the ejector handles onto the board the master manage
68. e management module is reset and the password is deleted You will then be able to enter without a password and make a new password for the user admin Mellanox Technologies 65 4 Chassis Power Up 4 N Before starting any procedure on the IS5100 system put an ESD prevention wrist strap on your wrist and connect to the 155 100 chassis Y With N 1 PSU redundancy the chassis must be started with a full complement of possi ble PSUs thereafter 1t can run on one less than the total number of PSUs This final PSU 1s redundant and allows for hot swapping a PSU should one fail Connecting the PSUs to different AC lines provides AC failover protection The system should continue to run and allow a hot swap of a defective PSU Should there not be enough power to keep all of the leafs running FabricIT EFM may power down some leafs If this happens it will be necessary to reboot the chassis once the defec tive PSU has been replaced 1 Check all FRUs for proper insertion and seating before connecting the AC power cords Boards e Power supplies e Leaf fan modules Spine fan modules 2 Insert all leafs that you plan to use in the chassis Start at the bottom of the chassis and work your way up Insert the first two spines in the top two slots Insert the rest of the spines from the bottom of the chassis up to slot 3 Insert thermal blanks in unused leaf slots to maintain balanced air flow Tighten all leaf and spine mounti
69. e shut 9 Lock the ejector handle onto the board Mellanox Technologies 45 InfiniBand Switch Platform Hardware User Manual 2 9 3 Spine Boards Do not install InfiniScale IV based replacement parts within a SwitchX 9 based chas sis and vice versa All Replacement modules must be consistent with the Chassis fam Do NOT mix replacement parts based on different generations of chip ily and switch chip generation N When hot swapping any of the units it is necessary to wait 1 minute after removing the J defective part before inserting the new part This is necessary so that the management 4 N module will start a new cycle checking through the leafs and spines for the FW ver sions Each spine has a pair of ejectors that lock the board in place and serve as levers for seat ing or extracting see Figure 37 Management board 1 is connected to spine board 1 and management board 2 is con nected to spine board 2 When a slave management board is not installed or not working the spine board connected to the master management board cannot be hot swapped All of the spine boards can be hot swapped when two management boards are installed and working IN IN 4 When more than one spine slot is empty always insert the lowest spine board first then f N work your way up A N If you need to replace the bottom spine and it does not go in try removing one or two N spines above it and then insert the spines from th
70. ee tes aa a ses d BA Ws Le ges 42 Figure 31 Leaf Board Numbering 43 Figure 32 Ejector 43 Figure 33 Leaf Release vo cu eee ER Ere ee 44 Figure 34 Intact vs Defected Signal Connectors 44 Figure 35 Intact vs Defected Power Pin Holders 45 Figure 36 Management Module Numbering 47 Figure 37 Spine Board Extraction za aaa a pun due ep mp ps 47 Mellanox Technologies 6 InfiniBand Switch Platform Hardware User Manual Figure 38 Intact vs Defected Mechanics 48 Figure 39 Intact vs Defected Side Signal Connectors 49 Figure 40 Intact vs Defected Middle Signal Connectors 49 Figure 41 Intact vs Defected Power Pin Holders 49 Figure 42 Leaf Fan Module Extraction 51 Figure 43 Spine Fan Module i 51 Figure 44 Fan Status LED on the Spine Module 52 Figure 45 Management Module 53 Figure 46 Intact vs Defected Signal Connectors 53 Figure 47 Intact vs Defected Power Pin Holders 54 Figure 48 Power Supply Unit Status Indications
71. eipolige bzw Neutralleiter Sicherung im Netzteil Netzstecker ziehen um sicher zustellen da keine Spannung am Ger t anliegt Entfernen Sie alle Netzkabel vor dem ffnen der Abdeckung dieses Produkts oder dem Ber hren der Innenteile 8 Mehrere Stromeing nge Risiko eines Stromschlags und Stomgefahr h Alle Stromversorgungseinheiten sind unabh ngig Trennen Sie alle Stomversorgungen um einen abgeschalteten Zustand im Inneren der Switch Plattform sicherzustellen 9 Bei Gewitter Elektrische Gefahr Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Kabel an oder ab 10 Anschlie en Trennen von InfiniBand Kupferkabel InfiniBand Kupferkabel sind schwer und nicht flexible Deshalb m ssen sie vorsichtig an die Anschl sse angebracht bzw davon getrennt werden Lesen Sie die speziellen Warnungen und Anleitungen des Kabelherstellers 11 Rack Montage und Wartung sichtsma nahmen zu ergreifen um die Stabilit t des Systems zu gew hrleisten Im Wenn dieses Produkt in einem Rack montiert oder gewartet wird sind besondere Vor A Allgemeinen sollten Sie das Gestell von unten nach oben mit Ger ten f llen 12 Ger teinstallation N IN 4 Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert ausge N tauscht oder gewartet werden Mellanox Technologies 98 mr 13 Ger teentsorgung Die Entsorgung dieses Ger ts sollte unter Beachtung a
72. ellow It can take up to 5 minutes to boot up the system Turn off the system if any LEDs remain red for more than 5 minutes 5 Check that the leaf status LEDs fan status LED and spine status LED in the spines are all green The maximum number of connections from each leaf is 6 If the number of leafs x the maximum number of connections per leaf is less than 36 then some of the leafto spine connection LEDs may be OFF Figure 28 Spine Module Fan LED 000000000 gg gg 20 2 A 36 Status LED Leaf connection LEDs 2 8 InfiniBand QSFP Cable Installation The switch uses industry standard InfiniBand cables which are available from sev eral vendors The standard cables support full 40 40Gb s QDR 20 20Gb s DDR and 10 10Gb s SDR bidirectional wire speed of the switch ports All Infini Band QSFP connections are made to the leaf boards Each leaf has 18 InfiniBand QSFP connectors in two rows which are numbered 1 18 See Section 3 1 6 for port numbering A If maximum cable lengths are exceeded data transfer will be reduced and the bit error rate will increase A All cables can be inserted or removed with the unit powered on To insert a cable press the connector onto the port receptacle until the connector is firmly seated The orange LED indicator above the port will light when the physical connection is established when both ends of the cable are properly connected to working devices
73. en the chassis management system may require up to 45 minutes to update all of the FW images in all of the leafs and spines If FabricIT EFM is updated and the FW image in the leafs and spines of the chassis is da Mellanox Technologies 69 o InfiniBand Switch Platform Hardware User Manual 6 Troubleshooting 6 1 Power Supply Unit A If the Power supplies cannot supply enough power the management module may shut down the some leafs gt As each PSU is plugged in make sure that the green power LEDs on the PSU comes on Issue 1 If the AC power LED is off 1 Check that the power cable is the correct power cable for your country Check that the power cable is plugged into a working outlet Check that the power cable has a voltage within the range of 100 240 volts AC Remove and reinstall the power cable Check the circuit breakers to be sure that the breaker has not tripped Check that the power cable is good Replace the power cable If the AC power LED is green but the OK power LED is off or the FAIL LED is on Replace the PSU au gt 6 2 Leaf Board Issue 2 The power LED for the Leaf board is off 1 Make sure that all ofthe PSUs are showing DC OK 2 Uninstall and reinstall the Leaf board 3 When the Yellow LED is on this indicates a fault in the board uninstall and reinstall the Leaf board 4 If uninstalling and reinstalling the Leaf board does not work burn the latest FW on
74. entul cu energie electric asigur o conexiune la priza de p m nt a cl dirii n caz contrar AGENTUL DE NTRE INERE va dispune instalarea unui CONDUCTOR DE PROTEC IE DE LEGARE LA P M NT de la borna separat de protec ie de legare la p m nt la cablul de protec ie de legare la p m nt al cl dirii Echipamentul va fi instalat ntr o zon unde exist leg turi echipotentiale precum un centru de telecomunica ii sau o camer a computerelor dedicat 112 M 22 Codurile de instalare Acest dispozitiv trebuie s fie instalat in conformitate cu ultima versiune a codurilor IN IN Y N electrice nationale ale t rii in cauz Pentru America de Nord echipamentul trebuie s fie instalat conform cerintelor aplicabile din Codul electric national al SUA si Codul electric canadian 23 Interconectarea unit tilor f Cablurile pentru conectarea la unitatea RS232 si la interfetele Ethernet trebuie s fie de A tipul DP 1 sau DP 2 certificate UL Not c nd se reg sesc ntr un circuit non LPS Ah Protectie la supracurent Un dispozitiv de protectie la supracurent inregistrat in circui AA tul de ramificare usor accesibil si cu o putere nominal egal cu 20 A trebuie s fie integrat In cablajul cladirii SS 24 Expunerea la radiatii periculoase Atentie Utilizarea elementelor de comanda sau ajustarea sau executarea altor proce duri decat a celor indicate in acest document poate avea ca rezultat expunerea
75. es 24 InfiniBand Switch Platform Hardware User Manual Figure 8 Shock and Tilt Stickers 2 6 1 4 Opening the Container Stickers unaffected by shipping Stickers showing excessive shock or tilt 1 Before starting the procedure put the ESD strap on and connect it to a valid ground 2 Open the crate by unscrewing the sides and top of the crate Mellanox Technologies 25 InfiniBand Switch Platform Hardware User Manual Figure 9 Opening the Container Container screws v It is highly recommended to have a screw gun or electric screwdriver for this step 3 Unscrew the sides of the crate 4 Remove and put aside the box 5 Visually inspect the chassis make sure that there is no visible damage all 3 spines are installed 3 PSUS are installed for the2 chassis all 4 fans are installed 1 management module is installed 6 Remove all protective plastic film from all sides and top of the chassis 7 If you wish you may reduce the weight of the chassis by removing all of the spines power supply units management modules and fan units and put aside for reinstalla tion after the chassis is installed in the rack 2 6 1 5 Installing the Shelf 1 Place the ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Make sure you have the spine side close to the doors
76. es de e e ode 46 2 94 Fan Modules koi Eee ehe 50 2 9 5 Management Module 52 2 9 6 Switch Shut Down Procedures 54 Chapter 3 Interfaces aan a a a a era an 56 3 1 PED Status IndiCalolS sai rei ceea ate ee nee 56 3 1 1 Power Supply Unit LEDS 56 3 1 2 Leaf Board LED Indicators 58 3 1 3 Spine Board LED Indicators 59 3 1 4 Spine Side Panel Display LED Indicators 60 3 1 5 Management Module LED Indicators 61 3 1 6 Port Connector Interfaces 63 Mellanox Technologies 3 InfiniBand Switch Platform Hardware User Manual 3 2 All FIOW ae Sn End eA 64 3 3 Cable Power Budget Classification 64 3 4 Management Module Interfaces 64 3 41 CES ea ti an ee OR n a Ca 64 34 2 CONSOLE ee ie e ARD RC Mar Rd atn 64 3 4 3 MGT Management 64 65 3 45 Reset a rin dd ac INE 65 Chapter 4 Chassis Power Up 66 4 1 Power Supply and Spine Board Indicator Status at Power 66 Chapter 5 Switch Management Tools 68 5 1 InfiniBand Subnet
77. essary to wait 1 minute after removing the defective part before inserting the new part This is necessary so that the manage ment module will start a new cycle checking through the leafs and for the FW versions To insert the leaf board 1 Check for foreign objects in or mechanical damage to the chassis leaf slots 2 Check leaf mechanics for any noticeable damage 3 Check back signal connectors integrity Look for any broken signal dividers or any deviations from the pass criterion shown in Figure 34 Figure 34 Intact vs Defected Signal Connectors Mellanox Technologies 44 InfiniBand Switch Platform Hardware User Manual 4 Check power connector s integrity Look for any damage on the power connector casing or blades damage or any deviations from the pass criterion show in Figure 35 Figure 35 Intact vs Defected Power Pin Holders 5 Start with the ejector handle fully open that is at 45 degrees to the front panel of the leaf 6 Holding the leaf by its sides carefully set the leaf board into the chassis 7 Applying equal pressure on both sides of the leaf board slowly slide the board into the chassis until the ejector handle reaches the vertical bar Do not apply excessive force to slide in the leaf board If you feel resistance remove the leaf board and double check both the chassis and leaf for any damage 8 Catch the hook onto the vertical bar of the chassis and push the ejector handl
78. f separate main and backup AC feeds The input voltage is Autorange 100 240 VAC 50Hz or 60Hz The output voltage for the PSUs is 48V The power cords should be standard 3 wire AC power cords including a safety ground Mellanox Technologies 38 InfiniBand Switch Platform Hardware User Manual 2 7 1 Powering Up the Switch Platform IN Make sure that the power cords are compatible with your outlets Power cords for dif b ferent countries can be ordered from Mellanox The chassis in N 1 mode must be started with a full complement of PSUs thereafter it can run on one less than the total number of PSUs This final PSU is redundant and allows for hot swapping a PSU should one fail Connecting the PSUs to different AC lines provides AC failover protection The system should continue to run and allow a hot swap of a defective PSU Should there not be enough power to keep all of the leafs running FabricIT EFM may power down some leafs If this happens it may be necessary to reboot the chassis once the defective PSU has been replaced Two simple ways to reboot is to use the reboot com mand in the CLI or reboot through the Web GUI The power system will divide the current consumption by the number of working PSUs Should one of the PSUS fail the total current consumption will then be divided by the remaining working PSUs When the failed PSU is hot swapped the new PSU will ramp up and pass its share of current so that the total curre
79. finiBand Switch Platform Hardware User Manual The manager also has the ability to burn new firmware and upgrade software on the switch 5 1 InfiniBand Subnet Manager The InfiniBand Subnet Manager SM is a centralized entity running in the switch It dis covers and configures all the InfiniBand fabric devices to enable traffic flow between those devices The SM applies network traffic related configurations such as QoS rout ing partitioning to the fabric devices You can view and configure the Subnet Parameters SM via the CLI WebUI Each InfiniBand subnet needs one subnet manager to discover activate and manage the subnet An InfiniBand network requires a Subnet Manager to be running in either the Infiniband switch itself switch based or on one of the nodes which is connected to the Infiniband fabric host based 5 2 Accessing the CPU via the Ethernet Connector Once the initial configuration is completed the management tools can be accessed through SSH Telnet WEB SNMP XML 5 3 Upgrading Software The new software and firmware updates are available to the user from the Mellanox Sup port website Copy the update to a known location on a Remote server within your LAN Use the CLI or the GUI in order to perform the Software upgrade For further informa tion please refer to the FabricIT EFM user manual an earlier version than the minimum that the new version of the software can work with th
80. he vertical rack support The caged nuts placed in the last procedure should line up with the holes in the faceplate 7 Screw the 8 screws through the faceplate and into the caged nuts Mellanox Technologies 36 InfiniBand Switch Platform Hardware User Manual 8 Slide the rail slides to the vertical rails Figure 24 155100 Chassis on the Shelf Figure 25 Face Plate Mounting Bolt Locations Holes in the faceplate for mounting on the rac 9 Place the 4 holed spacer on the outside of the vertical support and screw in the 4 screws for each rail slide Use the split lock washers here 10 Remove all four handles and save for future use 11 Ground the switch 12 Install all of the spines leafs and management modules 13 Install any power supply units and fan units removed at the start of the installation procedure 14 Insert all leafs that you plan to use in the chassis Start at the bottom of the chassis and work your way up 15 Insert the first two spines in the top two slots 16 Insert the rest of the spines from the bottom of the chassis up to slot 3 17 Insert thermal blanks in unused leaf slots to maintain balanced air flow Mellanox Technologies 37 InfiniBand Switch Platform Hardware User Manual 18 Tighten all leaf and spine mounting screws 19 Connect the power cords to the PSUs 20 Check the Status LEDs and confirm that all of the LEDs show status lights consistent with normal operatio
81. hen a log ical connection is made the LED will change to green When data is being transferred the light will blink green The switch does not provide a visual means to indicate the port Speed configuration ZA SDR DDR QDR and or the link width 1X or 4X The speed and link width config urations can be retrieved using management software 3 1 3 Spine Board LED Indicators Each leaf board is connected by links to each spine module Each spine has the following LEDs One status LED for the spine health e One status LED for the spine fan modules 36 status LEDs showing the existence of leaf to spine connections The 36 LEDs on each spine are divided by the number of leafs and the result N is the number of connections from each leaf that are connected to the spine 3 spines must be installed and working to ensure that full BW exists between nodes The maximum num ber of connections from each leaf is 6 If the number of leafs x the maximum number of connections per leaf is less than 36 then some of the leaf to spine connection LEDs may be OFF The status LEDs for the spine and their descriptions are shown in Table 5 The LEDs indicate as follows Figure 51 Spine Status LEDs AJ ee 0200000000 Spine Status Fan Status Spine leaf IB connection status 3 1 3 1 Status LED Table 5 shows the spine status according to the LED condition Table 5 Spine Status LED
82. ial configuration Once connected to the network the Sub net Management software automatically discovers and configures the fabric and begins utilizing the switch It is recommended that the Mellanox OpenFabrics software package be installed on all nodes connected to the switch The software package provides a subnet manager and net work management tools as well as connectivity software for servers and storage and is available on the Mellanox web site Basic installation is covered in Chapter 2 Installation on page 15 Hot swapping components and hardware maintenance is covered in Chapter 2 9 Hot Swap Insertion and Extraction on page 41 1 1 Product Information 1 1 1 Serial Number and Product Version Information The serial number GUID identifier and product version information are found on the label attached to the pull out tab below the Mellanox logo on the spine side of the chas sis Figure 1 Product Label P S N MT0806X01504 E TI o ooozesozo027051c Rev A1 GUI TUM MAC 0002C9020040 HIM ies in Israel hos Mellanox Technologies 11 InfiniBand Switch Platform Hardware User Manual The GUID is the System Image GUID according to the IB spec It is burned on the board which is in the chassis All the boards and the management software look for this GUID in addition to their own Node GUID 1 1 2 License Key This chassis comes
83. ignal dividers or any deviations from the pass criteria shown in Figure 39 and Figure 40 Pass r CELL e LLL 1 LL CT AL LL mm gt 4 Check power connector s integrity Look for any damage on the power connector casing or blades damage or any deviations from the pass criterion shown in Figure 41 Figure 41 Intact vs Defected Power Pin Holders Mellanox Technologies 49 InfiniBand Switch Platform Hardware User Manual M 2 9 4 2 9 4 1 5 Start with the ejector handles fully open that is at 45 degrees to the front panel of the spine A MA Do not use the fan FRU handle to insert the spine board 6 Holding the spine by its sides carefully set the spine board into the chassis 7 Using only the ejector handles slowly slide the board into the chassis until the hooks reach the vertical bar f N 4 Do not apply excessive force to slide in the spine board If you feel resistance remove N the spine and double check both the chassis and spine for any damage 8 Catch the hooks onto the vertical bar of the chassis and push the ejector handle shut 9 Lock the ejector handles onto the board Fan Modules There are four fan modules on the chassis for the leafs They are located on the spine side along the top of the chassis When a fan module is not functioning the status LED on the fan will light up Each spine has an individual fan module that contains two individual fa
84. ire une exposition dangereuse des rayonnements Pour les produits disposant de ports optiques PRODUIT LASER DE CLASSE 1 et r f rence aux plus r centes normes relatives aux lasers IEC 60 825 1 1993 A1 1997 A2 2001 et EN 60825 1 1994 1 1996 A2 2001 Pour les produits disposant de ports optiques 25 Armoire de protection appropriee Une enceinte appropri e aux niveaux lectrique m canique et incendie doit tre four nie par le constructeur du produit fini ou par l utilisateur 26 Ne pas utiliser comme tag re ou plan de travail Attention un quipement coulissant ou mont sur rail ne doit pas servir d tag re ni de plan de travail Les rails ne sont pas destin s faire coulisser l unit hors du rack Ils sont destin s une installation permanente l emplacement final pas pour l entretien ni la maintenance 27 Directive DEEE X Selon la Directive 2002 96 CE DEEE tous les d chets d quipements lectriques et lectroniques EEE doivent tre collect s s par ment et ne pas tre mis au rebut avec les d chets m nagers habituels Ce produit et toutes ses pi ces doivent tre mis au rebut d une mani re responsable respectant l environnement 28 Restrictions concernant l alimentation pour la Norvege ellanox Technologies 96 F 4 Installation Sicherheitshinweise German 1 Installationsanleitungen Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die
85. issement ne remplacer qu avec une batterie UL certifi e pour accepter un cou rant de charge anormal maximal sup rieur ou gal 4 mA LA Si la batterie n est pas remplac e par un type correct il y a un risque d explosion Les batteries usag es doivent tre mises au rebut conform ment aux instructions 19 Cordon d alimentation UL Listed et certifi CSA A Pour le branchement lectrique en Am rique du Nord utiliser un cordon d alimenta y N tion UL Listed et CSA Certified 3 conducteurs calibre 16 AWG avec une prise N moul e 125 V 13 A faisant au moins 1 5 m de long six pieds et au plus 4 5 m m Pour le branchement lectrique en Europe utiliser un cordon d alimentation au format international harmonis marqu lt HAR gt 3 conducteurs d au moins 1 mm2 de sec tion 300 V avec une gaine isolante en PVC Le cordon doit avoir une prise moul e 250 V 10 A 20 Courant de fuite lev Avertissement courant de fuite lev une connexion la terre est indispensable avant de brancher l alimentation 21 Information d ajout de branchement la terre GND Avant de relier cet appareil au secteur ses vis des bornes de la terre de protection doi vent tre reli es la terre de l installation lectrique de l immeuble Informations de LA branchement la terre L installation lectrique doit fournir une connexion la terre et un technicien de main tenance doit y relier l quipement de fa o
86. l Figure 19 Installing the Handles uuu uuu P Do not use the locknuts They are extras not needed for this installation Figure 20 Screw the Handles Onto the Chassis Do not use the handles on the fans for lifting or moving the chassis in the rack The handles go here n La NI 1 un sana Wil BE os a T Mellanox Technologies 34 InfiniBand Switch Platform Hardware User Manual Figure 21 The Rails are Already Connected Onto the Chassis aa S N SS y y 4 40 Ibs 40 70 lbs 70 121 lbs gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 2 Lift the chassis and slide it onto the shelf Use mechanical lift or enough people to safely lift the chassis It weighs 55kg 120165 Do not use the handles on the fans for lifting or moving the chassis in the rack Mellanox Technologies 35 InfiniBand Switch Platform Hardware User Manual _ Figure 22 Raising the Chassis Using a Mechanical Lift 3 Push the chassis into the rack until the faceplate is 20cm 8 from the vertical support 4 Putthe rail slides onto the rails Figure 23 Put on the Rail Slide 5 Slide the chassis further into the rack 6 Slide the chassis all the way into the rack until the faceplate is touching t
87. l codes For North America equipment must be installed in accordance to the applicable requirements in the US National Electrical Code and the Canadian Electri cal Code 23 Interconnection Of Units Cables for connecting to the unit RS232 and Ethernet Interfaces must be UL certified type DP 1 or DP 2 Note when residing in non LPS circuit Overcurrent Protection A readily accessible Listed branch circuit overcurrent protective device rated 20 A must be incorporated in the building wiring Mellanox Technologies 18 InfiniBand Switch Platform Hardware User Manual 24 Hazardous Radiation Exposure Caution Use of controls adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure CLASS 1 LASER PRODUCT and reference to the most recent laser standards 44 IEC 60 825 1 1993 A1 1997 A2 2001 and EN 60825 1 1994 A1 1996 A2 2001 25 Proper Enclosure 4 A suitable electrical mechanical and fire enclosure shall be provided by the end prod N uct manufacturer and or the end user 26 Do Not Use the Switch as a Shelf or Work Space Caution Slide rail mounted equipment is not to be used as a shelf or a work space The rails are not intended for sliding the unit away from the rack It is for permanent instal lation at final resting place only not used for service and maintenance 27 WEEE Directive According to the WEEE Directive 2002 96 EC all was
88. ller nationalen Gesetze Bestim mungen erfolgen Y 14 Regionale und nationale elektrische Bestimmungen Bestimmungen installiert werden N N Y N Dieses Ger t sollte unter Beachtung der regionalen und nationalen elektrischen N 15 Installationscodes Dieses Ger t muss entsprechend der aktuellsten Version des National Electrical Code j installiert weden In Nodamerika muss das Ger t gem den geltenden Anforderungen y des US National Electrical Code und des Canadian Electrical Code installiert werden 16 Akkuaustausch Warnung Nur durch von UL anerkannten Akkus ersetzen die f r maximalen anor l malen Ladestrom von nicht weniger als 4mA zertifiziert sind Es besteht Explosiionsgefahr wenn der Akku durch einen Akku eines falschen Typs ersetzt wird Akkus gem den Anweisungen entsorgen 17 UL und CSA zertifiziertes Netzkabel F r Nordamerika Stromanschluss w hlen Sie ein Netzkabel das UL und CSA Certi fed y N 3 Leiter 18 AWG mit einem angespritztem Stecker bewertet bei 125 V 15 mit a einer Mindestl nge von 1 5 m Six Feet aber nicht mehr als 4 5 m F r die europ ischen Zusammenhang w hlen Sie ein Netzkabel das international harmonisiert und der Aufschrift lt HAR gt 3 Leiter mindestens 0 75 mm2 Draht bewertet mit 300 V mit einem PVC Mantel isoliert Das Kabel muss eine angespritztem Stecker bewertet bei 250 V 10 A 18 Hoher Ableitstrom WARNUNG Hohe A
89. management module and tools available for Out of Band management of the switch system via FabricIT EFM A There are 2 Ethernet ports 1 for each management module that get connected to Ethernet switches These switches must be configured to 10 100M auto negotiation gt The IS5100 switch comes standard with a management software module for chassis management called FabricIT FabricIT is installed on all management modules for the managed switch systems based on InfiniScaleIV amp technology FabricIT includes a CLI WebUI SNMP and chassis management features for software and IB management soft ware OpenSM You can get more information via the Mellanox FabricIT EFM Software WebUI User s Manual or the Mellanox FabricIT EFM Software User Manual The managed switch system includes the following software components Embedded Subnet Manager SM e Chassis manager and system BIST SNMP agent 3rd party tool integration GUI Remote logging e SSH telnet e Secured access in band and out band Pv4 IPv6 network stack The chassis manager will give the user access to Switch temperatures Power supply voltages Fanunit information Power unit information Flash memory Monitoring of AC power to the PSUs DC power out from the PSUs chassis failures querying for switch serial numbers revisions software version SwitchX FW version switch temperatures ellanox Technologies 68 por In
90. ment module CPU and only then configure the slave By default the master CPU is the top management module For further information on the master and slave roles see the FabricIT EFM Software UM section High Availability y On switch systems with dual management systems first connect the cable and configure 2590 management modules in the chassis must go through an initial configuration proce dure See the Installation Guide for the initial configuration procedure 5 2 9 6 Switch Shut Down Procedures To shut down the chassis run the following command twice once for each MM Reload halt noconfirm Mellanox Technologies 54 InfiniBand Switch Platform Hardware User Manual AN The chassis cannot be restarted remotely To restart the chassis you must physically go to the switch and unplug all of the power cords to the chassis and then replug in all of the power cords to the chas sis The first time you run the command it shuts down the master management module and the second time shuts down the slave management module To shut down a leaf run the following command no power enable lt module gt To shut down a spine run the following command no power enable lt module gt To shut down a management module run the following command no power enable lt module gt Mellanox Technologies 55 gt 3 Interfaces 3 1 LED Status Indicators The LEDs are placed on the
91. mentului 8 Conexiunea la o surs de alimentare electric suplimentar pericol electric Acest produs include o surs de alimentare suplimentar sau un spatiu gol in locul acesteia n cazul in care spatiul pentru sursa de alimentare este gol nu operati produ sul c nd capacul orb este indep rtat sau nu este fixat in mod sigur Mellanox Technologies 110 2 9 Siguran fuzibil bipolar neutr Acest sistem este prev zut cu sigurant fuzibil bipolar neutr ndep rtati toate cor doanele de alimentare inainte de a deschide capacul acestui produs sau inainte de a atinge orice componente interne 10 Multiple mufe electrice Risc de soc electric si pericol electric Toate aparatele cu alimentare de la retea sunt independente Deconectati toate sursele de alimentare cu energie pentru a asigura decuplarea in inte riorul platformei de comutare gt 11 In timpul desc rc rilor electrice pericol electric A In timpul perioadelor cu desc rc ri electrice luminoase nu lucrati cu echipamentul sau N nu conectati sau deconectati cablurile 12 Conectarea deconectarea cablului din cupru InfiniBand AN A Cablurile InfiniBand din cupru sunt grele si inflexibile de aceea trebuie sa fie atasate A W sau detasate de conectori cu grij Consultati produc torul de cabluri pentru avertis 4 y mente instructiuni speciale 13 Montarea sau depanarea intr un rack Cand acest produs este montat s
92. n Warning Any yellow status LEDs is cause for concern and must be dealt with imme diately LA It can take up to 5 minutes to boot up during which time the status LED may indicate flashing green 21 You can start connecting all of the cables to the switch 2 6 4 Ground Connections Make sure to connect the ground post to a valid electrical ground Use a grounding lug and a ground wire of sufficient capacity to safely convey a potential discharge The grounding post is M 6 with 1mm pitch threads A ground wire of AWG 6 or 4mm diam eter is recommended for grounding this device The chassis is concurrently grounded through each of the PSUs Only connect the PSU cords to properly grounded outlets Do not rely on the PSU grounds It is absolutely necessary to connect the grounding post Make sure the connections are solid and permanent If you choose to not use the ground screw make sure that the rack is properly grounded and that there is a valid ground con nection between the chassis of the switch and the rack Test the ground using an Ohm meter Figure 26 Ground Connection ESD Post Ground Post 2 7 Power Connections The switch includes integrated hot swap power supplies which support up to 3 load shar ing 1000W The slots for the power supply units PSUs are on the spine side The left side has odd numbered PSUS and the right side has even numbered PSUs Each PSU has a dedicated AC inlet This design enables the optional use o
93. n las interfaces RS232 y Ethernet de la unidad deben estar homologados por UL tipo DP 1 o DP 2 Nota cuando residen en circuito no de tipo LPS Protecci n contra sobrecargas Al cableado del edificio se debe incorporar un disposi tivo de protecci n contra sobrecargas de circuito derivado de f cil acceso con una corriente nominal de 20 A 24 Exposici n a radiaci n peligrosa Precauci n el uso de controles o ajustes o la realizaci n de procedimientos distintos de los que aqu se especifican podr an causar exposici n a niveles de radiaci n peligro 05 PRODUCTO L SER DE CLASE 1 referencia las normas de l ser m s recientes IEC 60825 1 2007 03 y EN 60825 1 2007 25 Recinto adecuado ellanox Technologies El fabricante del producto final o el usuario final deber n suministrar un confinamiento adecuado para componentes el ctricos y mec nicos y contra incen dio 104 26 No utilizar el conmutador como estante ni como espacio de trabajo Cuidado Equipos montados en deslizadores o rieles no se deben utilizar como estantes ni como espacio de trabajo La finalidad de los rieles no es deslizar la unidad hacia afuera del bastidor Sirven solo para la instalaci n permanente en el lugar de destino final no para fines de servicio mantenimiento 27 Directiva WEEE Conforme a la Directiva 2002 96 CE sobre todos los residuos de equipos el c tricos y electr nicos EEE se deben recolectar por separado y
94. n permanente UN TECHNICIEN DE MAINTENANCE doit v rifier si la prise laquelle sera bran ch l quipement fournit une connexion la terre Si ce n est pas le cas le TECH NICIEN DE MAINTENANCE doit arranger l installation d un CONDUCTEUR DE MISE A LA TERRE allant de la borne de mise la terre jusqu au conducteur de terre de l immeuble Cet quipement doit tre install dans une zone disposant de liaisons quipotentielles comme un centre de t l communications ou une salle informatique d di e Mellanox Technologies 95 AE M 22 Codes d installation Cet appareil doit tre install conform ment la version la plus r cente des codes lec trique nationaux En Am rique du Nord l quipement doit tre install en respectant les exigences de l US National Electrical Code et du Code canadien de l lectricit 23 Interconnexion des unit s Les c bles de connexion aux interfaces RS232 et Ethernet de l appareil doivent tre certifi UL de type DP 1 ou DP 2 Note en cas d installation sur un circuit dont la puissance n est pas limit e Protection contre les surintensit s le c blage de l immeuble doit int grer un dispositif certifi de protection contre les surintensit s calibr 20 A et ais ment accessible 24 Exposition des rayonnements dangereux Attention l utilisation de commandes l ajustement ou la conduite de proc dures autres que celles indiqu es ici pourraient condu
95. n that can potentially cause personal injury and or damage to hardware or software Mellanox Technologies u InfiniBand Switch Platform Hardware User Manual 1 Overview This User Manual provides an overview of the 155100 Modular InfiniBand Switch Platform known in this document as the chassis or switch and its operational environ ment Mellanox 155100 switch systems provide the highest performing fabric solution by delivering high bandwidth and low latency to Enterprise Data Centers EDC High Per formance Computing HPC and Embedded environments Networks built with the 155100 system can carry converged traffic with the combination of assured bandwidth and granular quality of service Built with Mellanox s 4 generation InfiniScale IV InfiniBand switch device 155100 systems provide up to 40Gb s full bidirectional band width per port With up to 108 ports in a 6U high form factor these systems are among the densest switching systems available The switch platform comes pre installed with all necessary firmware for standard opera tion within an InfiniBand fabric and requires an InfiniBand compliant Subnet Manager running from one of the hosts or the management module of the switch system The ini tial configuration procedure should be followed to initialize the switch before connecting it to the network after which normal operation can proceed See the installation guide for details regarding the init
96. ndle EE m E Latch 6 S gt D e u T Grasping the handle with one hand push the black latch release while pulling the handle outward As the PSU unseats the PSU status indicators will turn off Remove the PSU To insert a PSU Make sure the mating connector of the new unit is free of any dirt and or obstacles Insert the PSU by sliding it into the opening until a slight resistance is felt Continue pressing the PSU until it seats completely The latch will snap into place confirming the proper installation 4 Insert the power cord into the supply connector on the other side of the chassis Replace the cover over the PSUs The green indicators should light If not extract the PSU and re insert it again Mellanox Technologies 42 InfiniBand Switch Platform Hardware User Manual 2 9 2 Leaf Boards Do NOT mix replacement parts based on different generations of chip Do not install InfiniScale based replacement parts within SwitchX based chas sis and vice versa All Replacement modules must be consistent with the Chassis fam ily and switch chip generation N When hot swapping any of the units it is necessary to wait 1 minute after removing 4 the defective part before inserting the new part This is necessary so that the manage N ment module will start a new cycle checking through the leafs and spines for the FW ABBA 4 versions The leaf boards are numbered from top to
97. ng connectors of the unit is free of any dirt and or obstacles See Section 2 9 3 on page 46 5 Make sure that the spine and the Leafs both have the same version of FW 6 Reburn the FW and remove and reinstall the spine 7 Replace the spine board 6 5 Software For more detailed instructions concerning MLNX OS software see the Mellanox MLNX OS SwitchX Software WebUI User s Manual or the Mellanox MLNX OS SwitchX Software User Manual Mellanox Technologies or 72 InfiniBand Switch Platform Hardware User Manual 7 Disassembly and Disposal 7 4 Disassembling the Chassis m Power down the chassis Remove all power cables Remove all connector cables Disconnect the ground lug from the ground post Loosen all locking screws for the leafs spines and management modules in the chas Sis Remove all leafs 7 Remove all spines 8 Remove all management modules 9 Use enough people to safely lift this product lt 40 Ibs 40 70 Ibs 70 121 lbs gt 121 Ibs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs product contains printed circuit boards cables and batteries According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be A collected separately and disposed of according to the directive This product and all of its parts are NOT to be disposed of with household waste This Go to the Mellanox website for detaile
98. ng screws Connect the power cords to the PSUs Connect the power cords to grounded electrical outlets N With N 1 PSU redundancy do not power up the chassis with less than all PSUs i installed 4 1 Power Supply and Spine Board Indicator Status at Power ON N As the power is turned on you should observe the following conditions for normal oper ation It can take up to 5 minutes to boot up the system Turn off the system if any LEDs remain red for more than 5 minutes Mellanox Technologies 66 ARE 1 Power Supply Unit s OK and DC OK indicators are ON and FAIL indicators are OFF 2 There is a green Status LED per spine board per leaf board and per management module that indicates power supplies are good 3 Spine Board indicators will display status of internal links to the installed leaf boards All PHY links to existing leaf Boards should be ON 4 Check the Spine LEDs and make sure they coincide with Figure 59 Figure 59 Spine Side Panel Display Status Indications i 3 m STATUS PSU SPINE LEAF MNG1 MNG2 FANS FANS MASTER MASTER 5 Check the Management Module LEDs and make sure they coincide with Figure 60 Figure 60 Management Module Status Indications for Normal Operation II un d i E e za INN 7 Mellanox Technologies 6 InfiniBand Switch Platform Hardware User Manual M 5 Switch Management Tools This chapter describes the
99. no se deben eliminar junto con residuos dom sticos Al deshacerse de este producto y de todas sus partes h galo de una manera respon sable y respetuosa con el medio ambiente F6 Russian 1 2 m e e 0 lt 40 Ibs 40 70 Ibs 70 121 lbs gt 121 Ibs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Mellanox Technologies 105 4 5
100. nologies 58 Figure 50 Leaf Board Led Indicators AMA ee O Status LED Each leaf board has a Status LED on the far left of the leaf Table 3 shows the leaf status according to the LED condition The Leaf Status indicator LED has the following LED assignment Table 3 Leaf Status LED LED Condition LED Description Off No power to the Leaf Solid Green Leaf is up and running Flashing Green Leaf is powering up Solid Orange Non fatal error this leaf needs troubleshooting but does not require chassis shutdown Solid Red Fatal error Leaf Board Port Connector LED Assignment Above the ports are two LEDs one for the upper port and one for the lower port y Each port has a single 2 color LED Table 4 shows the link status according to the LED condition Table 4 Connector Physical and Logical Link Indications LED Condition LED Description Off No power to the port Solid Green Logical link up Flashing Green Data activity flashing speed is proportional to data transfer speed Solid Orange Physical link up Flashing Orange A problem with the physical link The LED indicator corresponding to each data port will light orange when the physical connection is established that is when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port W
101. ns Should a sin gle fan fail the Fan Status LED on the spine and the S Fan LED on the management module will light indicating the necessity to replace the fan module Air flow through the spines is independent of the air flow through the leafs Leaf Fan Module There are 4 leaf fan modules found on the spine side Extracting the Leaf Fan Module 1 Push and hold the blue latch release See Figure 42 2 Slowly pull out the fan module using the handle ellanox Technologies 50 InfiniBand Switch Platform Hardware User Manual Figure 42 Leaf Fan Module Extraction Handle Latch Release Inserting the Leaf Fan Module When hot swapping any of the units it is necessary to wait 1 minute after removing the defective part before inserting the new part This is necessary so that the manage ment module will start a new cycle checking through the leafs and spines for the FW versions 1 Make sure the fan module is oriented correctly top side up Confirm that the location of the connector in the chassis will line up with the connector in the fan module 2 Slowly slide in the new leaf fan module If the fan module stops before it goes in all of the way it is inserted incorrectly or it may be for the other side of the chassis 3 Push the fan module until the latch engages 4 Make sure that the green leaf LED on the module comes on indicating that fan is running 2 9 4 2 Spine Fan Modules Each spine module ha
102. nt See the Installation Guide that is packed in the box for the instructions to make the initial configuration This unit is intended for installation in a Restricted Access Location A restricted ZA access area can be accessed only through the use of a special tool lock and key or other means of security 5 2 1 Installation Safety Warnings These safety warnings are in English For French German Spanish Russian and Roma nian see the Appendixes 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source 2 Bodily Injury Due to Weight M Use enough people to safely lift this product lt 40 Ibs 40 70 Ibs 70 121 Ibs gt 121 Ibs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Heavy Equipment h This equipment is very heavy and should be moved using a mechanical lift to avoid injuries Mellanox Technologies 15 InfiniBand Switch Platform Hardware User Manual 4 Installation in Restricted Access Location A N This unit is intended for installation in a Restricted Access Location 5 Risk of Electric Shock Risk of Electric Shock LA With the fan module removed power pins are accessible within the module cavity DO NOT insert tools or body parts into the fan module cavity 6 Over temperature This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended 45 C 113 F Moreover t
103. nt is always divided by the number of working PSUs 1 Plug in the power cords to the PSUs 2 Plug the other end of the power cords into grounded outlets at least two or three circuits or use a 3 phase circuit A 4 Make sure that the outlets and circuits will not be overloaded Spread out the load over Figure 27 Multiple Power Inlets Electric Caution Notification CAUTION ACHTUNG ATTENTION Risk of electric shock and Gafahr des elektrischen Schocks Risque de choc et de danger energy hazard Entferrnen des Netzsteckers e lectriques Le de branchment The PSUs are all independent elnes Netzteils spannungsfrei d une seule alimentation stabi Um alle Einhieten spannungsfrei lise e ne de branch uniquement Disconnect all power supplies to zu machen sind die Netzstecker qu un module Alimentation ensure a powered down state aller Netzteile zu entfernen Stabilise e Pour isoler com inside of the switch platform pletement le module en cause Il faut de brancher toutes les ali mentations stabilise es 3 Check the Status LEDs on all of the management modules and confirm that all of the LEDs show status lights consistent with normal operation 4 Any yellow or red status LEDs on any of the management modules is cause for con 4 and must dealt with immediately Mellanox Technologies 39 InfiniBand Switch Platform Hardware User Manual 4 Check that none of the LEDs on the spines are y
104. o C13 ACC000334 Power cord 125V 15A 2 0M C14 TO C13 ACC000242 Power cord Type for USA Canada Mexico Tai 204 wan Power cord Type H for Israel ACC000205 Power cord Type E F for Sweden France Germany ACC000207 Netherlands Russia Power cord Type G for UK ACC000208 Power cord Type D for India ACC000209 Power cord Type I for China ACC000210 Power cord Type J for Switzerland ACC000211 Power cord Type B for Japan ACC000212 Power cord Type I for Australia ACC000213 ellanox Technologies M 82 Appendix F Installation Safety Warnings F 1 Installation Safety Warnings English 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source 2 Bodily Injury Due to Weight YN Use enough people to safely lift this product 3 Heavy Equipment LA This equipment is very heavy and should be moved using a mechanical lift to avoid injuries 4 Installation in Restricted Access Location This unit is intended for installation in a Restricted Access Location 5 Risk of Electric Shock Risk of Electric Shock LA With the fan module removed power pins are accessible within the module cavity DO NOT insert tools or body parts into the fan module cavity 6 Over temperature This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended 45 C 113 F Moreover to guarantee proper air flow allow at
105. o guarantee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings 7 Stacking the Chassis The chassis should not be stacked on any other equipment If the chassis falls it can cause bodily injury and equipment damage 8 Redundant Power Supply Connection Electrical Hazard power supply do not operate the product with the blank cover removed or not securely This product includes a redundant power or a blank in its place In case of a blank A fastened 9 Double Pole Neutral Fusing This system has double pole neutral fusing Remove all power cords before opening the cover of this product or touching any internal parts 10 Multiple Power Inlets Risk of electric shock and energy hazard The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform Mellanox Technologies 16 InfiniBand Switch Platform Hardware User Manual 11 During Lightning Electrical Hazard During periods of lightning activity do not work on the equipment or connect or dis connect cables 12 Copper InfiniBand Cable Connecting Disconnecting A N Copper InfiniBand cables are heavy and not flexible as such they should be carefully A attached to or detached from the connectors Refer to the cable manufacturer for spe cial warnings instructions 13 Rack Mounting and Servicing When this product is mounted or serviced in a rack
106. ock washers 4 lock nuts for handles These nuts are not to be used 8 caged nuts for the faceplate 8 M6 bolts for the caged nuts 8 for the faceplate Parts for installing the filler panel Bottom filler panel e 2 M6 bolts 2caged nuts M6 Parts for installing the cable manager RH cable holder 1 LH cable holder 8caged nuts M6 8 M6 bolts 3cable holder shelves You will need 7U of space in the rack 6U for the chassis and 1U for the shelf Figure 6 Shelf Installation Kit Parts Angled Shelf Bracket Rail M6 X 16 Rail Slide e M6 X 12 bolts caged nuts and split lock washers Mellanox Technologies 23 InfiniBand Switch Platform Hardware User Manual Figure 7 Chassis Installation Parts lt Rail slide 0 M 5 Pan head 40 lt screws and vo lock washers 4 hole washer Y gt Screws for Ko Handles the handles I IN i S SOS Caged nuts P gt Y d Li 8 SS 2 6 1 3 Container Mishandling The container has shock and tilt stickers applied These will turn red if the container has been mishandled or roughly handled Upon receipt of the container look for and inspect the shock and tilt stickers to confirm that they have not tripped If one or more are red notify the shipper and Mellanox This on its own does not indicate damage to the con tents But be sure to carefully inspect the contents if any of the shock and tilt stickers have tripped Mellanox Technologi
107. odule PSU indicator should be green Table 10 Management Module PSU LED Configurations LED Condition Description Green OK All PSUs are working at correct input and output voltages Red Error One or more of the PSUS for the chassis is bad Check each PSU for a red LED Mellanox Technologies 62 om 3 1 5 2 Management Module S FANS LED Indicator The management module S FANS indicator should be green Table 11 Management Module S Fan LED Configurations LED Condition Description Green OK AII Spine fans are working at configured speed Red Error One or more of the spine fans within a spine fan module is bad Check the spines for a flashing green fan LED 3 1 5 3 Management Module L FANS LED Indicator The management module L FANS indicator should be green Table 12 Management Module L Fan LED Configurations LED Condition Description Green OK AII Chassis Leaf fans are working at configured speed Red Error One or more of the leaf fans for the chassis is bad Check each chassis fan for a red LED 3 1 5 4 Management Module MASTER LED Indicator Table 13 Management Module MASTER LED Configurations LED Condition Description Green This management module is the master Off This management module is the slave 3 1 6 Port Connector Interfaces The connector side of the switch has 6 leaf boards and each leaf board has 18 QSFP ports The ports on
108. ogu iti proizvo a krajnjeg proizvoda i ili krajnji korisnik 26 Nemojte koristiti preklopnik kao policu ili radnu povr inu ellanox Technologies Pozor Oprema montirana na kliza e vodilice ne bi se trebala koristiti kao polica ili radna povr ina Vodilice nisu namijenjene za povla enje ure aja iz ormari a Slu e samo za trajnu instalaciju na kona nom polo aju a ne za servisiranje i odr avanje 11 7 27 WEEE direktiva Sukladno WEEE direktivi 2002 96 EZ sav elektri ni 1 elektronicki otpad EEE trebao bi se prikupljati zasebno i ne bi se trebao odlagati kao obi an ku anski otpad Odlaganje ovog proizvoda i svih njegovih dijelova vr ite na odgovoran i ekolo ki na in 28 Elektri na ograni enja dr ave Norve ke N Ovaj je ure aj namijenjen samo za spajanje na elektri ni sustav s TN uzemljenjem i na elektri ni sustav s IT uzemljenjem dr ave Norve ke D Mellanox Technologies 118
109. oprema Ova oprema je vrlo te ka i treba se premje tati pomo u mehani kog dizala kako bi se izbjegle ozljede 4 Instaliranje na lokaciji s ograni enim pristupom Ovaj ure aj je namijenjen za instaliranje na lokaciju s ograni enim pristupom 5 Rizik od strujnog udara Rizik od strujnog udara S uklonjenim modulom ventilatora perima napajanja se mo e pristupiti u otvoru mod ula NEMOJTE umetati alat ili dijelove tijela u otvor modula ventilatora 6 Pregrijavanje Ovom se opremom ne bi trebalo rukovati u podru jima s temperaturom okoline koja prema uje najvi e preporu ene vrijednosti 45 C 113 F Osim toga kako bi se osig urao odgovaraju i protok zraka omogu ite najmanje 8 cm 3 in a razmaka oko otvora ventilatora Mellanox Technologies 114 7 Slaganje kucista Kuciste se ne bi trebalo slagati na drugu opremu Ako kuciste padne moZe izazvati tjelesne ozljede i ostecenje opreme 8 Redundantno napajanje Opasnost od elektritne energije Ovaj proizvod uklju uje redundantno napajanje ili prazan prostor na njegovu mjestu U slu aju praznog prostora za napajanje nemojte rukovati proizvodom ako je pok lopac uklonjen ili ako nije dobro pri vr en gt 9 Dvopolni neutralni osigurati Ovaj sustav raspola e dvopolnim neutralnim osigura ima Uklonite sve kabele napa janja prije otvaranja poklopca proizvoda ili dodirivanja unutarnjih dijelova 10 ViSestruki ulazi za napajanje
110. osed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way 5 Country of Norway Power Restrictions This unit is intended for connection to power system and IT power system of Norway only 2 RI RER i A BAS Dai RE h e e 40 Ibs 40 70 Ibs 70 121 lbs gt 121 Ibs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 LA RER MIRE DARE LUERA BSE 4 Mellanox Technologies 87 5 AEH fel BREWER LA 6 y 45 113 F 8 3 RM MIE LA 8 BER
111. ra GND de Antes de conectar el dispositivo a la l nea de alimentaci n los tornillos del terminal de la puesta a tierra de protecci n del dispositivo se deben conectar a la puesta a tierra de protecci n de la instalaci n del edificio Informaci n de conexi n a tierra La instalaci n del edificio deber prover un medio para la conexi n con la puesta a tierra de protecci n y un t cnico de servicio deber conectar permanentemente el equipo a dicho medio de conexi n Un T CNICO DE SERVICIO comprobar si la toma el ctrica de la que se suminis trar corriente al equipo provee una conexi n con la puesta a tierra de protecci n del edificio De no ser as el T CNICO DE SERVICIO se encargar de instalar un CON DUCTOR DE CONEXI N A TIERRA DE PROTECCI N del terminal de puesta a tierra de protecci n separado al conductor de tierra de protecci n del edificio El equipo se instalar en un rea donde haya conexi n equipotencial como por ejemplo un centro de telecomunicaciones o una sala de computadoras dedicada 22 C digos de instalaci n gt Este dispositivo se debe instalar conforme a la versi n m s reciente de los c digos el ctricos nacionales del pa s en cuesti n En Am rica del Norte el equipo se debe instalar de acuerdo con las disposiciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad 23 Interconexi n de unidades Los cables para la conexi n co
112. rar que no haya corriente alguna dentro de la plataforma de conmutaci n 11 Al haber rayos peligro de descarga No utilizar el equipo ni conectar o desconectar cables durante per odos de actividad de rayos 12 Cable de conexi n y desconexi n InfiniBand de cobre AN Dado que los cables de cobre InfiniBand son pesados y no son flexibles su conexi n a rer los conectores y su desconexi n se deben efectuar con mucho cuidado Para ver adver N tencias o instrucciones especiales consultar al fabricante del cable N 13 Montaje y mantenimiento del bastidor Al instalar o realizar el mantenimiento de este aparato en un bastidor es preciso adop tar precauciones especiales para garantizar que el sistema se mantenga estable En gen eral en un bastidor los equipos se deben instalar comenzando desde abajo hacia arriba Mellanox Technologies 102 Me 14 Instalaci n del equipo La instalaci n el reemplazo y el mantenimiento de este equipo estar n a cargo nica mente de personal capacitado y competente La eliminaci n definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales 16 C digos el ctricos locales y nacionales Este equipo se debe instalar conforme a los c digos el ctricos locales y nacio Y nales 17 C digos de instalaci n AN Este dispositivo se debe instalar conforme a la versi n m s reciente de los c digos
113. ropean connection select a power supply cord that is internationally harmonized and marked lt HAR gt 3 conductor minimum 1 0 mm wire rated at 300 V with a PVC insulated jacket The cord must have a molded plug rated at 250 V 10 A 20 High Leakage Current LA Warning High leakage current Earth connection essential before connecting supply Mellanox Technologies 85 SN M 21 Add GND connection information h Before connecting this device to the power line the protective earth terminal screws of this device must be connected to the protective earth in the building installation GND Connection Information The building installation shall provide a means for a connection to protective earth and the equipment shall be permanently connected to that by a service person A SERVICE PERSON shall check whether or not the socket outlet from which the equipment is to be powered provides a connection to the building protective earth If not the SERVICE PERSON shall arrange for the installation of a PROTECTIVE EARTHING CONDUCTOR from the separate protective earthing terminal to the pro tective earth wire in the building The equipment shall be installed in area where equi potential bonding exists such as a telecommunication centre or a dedicated computer room 22 Installation codes h This device must be installed according to the latest version of the country national electrical codes For North Ameri
114. s a fan module with two individual fans built in When a fan mod ule is not functioning the Fan Status LED on the spine will light up Figure 43 Spine Fan Module 005500095 999050055 Fan module When a fan module is removed the indicator light will reset Mellanox Technologies 51 InfiniBand Switch Platform Hardware User Manual M 2 9 5 Figure 44 Fan Status LED on the Spine Module Extracting the Spine Fan Module 1 Push the two blue latch buttons together while pulling the fan module out Inserting the Spine Fan Module When hot swapping any of the units it is necessary to wait 1 minute after removing the defective part before inserting the new part This is necessary so that the manage ment module will start a new cycle checking through the leafs and spines for the FW versions 1 Make sure the fan module is oriented correctly top side up Confirm that the location of the connector in the chassis will line up with the connector in the fan module 2 Slowly slide in the new spine fan module 3 Push the fan module as far as it will go make sure the locking latches engage Ifthe Fan LED continues to show red remove the fan module and check the pins on the connector inside of the spine to make sure that none of them are bent Management Module When hot swapping any of the units it is necessary to wait 1 minute after removing the defective part before inserting the new part This is necessary
115. special precautions must be taken LA to ensure that the system remains stable In general you should fill the rack with equip ment starting from the bottom to the top 14 Equipment Installation This equipment should be installed replaced and or serviced only by trained and qual ified personnel Disposal of this equipment should be in accordance to all national laws and regula tions 16 Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes 5 17 Installation Codes A This device must be installed according to the latest version of the country A N national electrical codes For North America equipment must be installed in accordance to the applicable requirements in the US National Electrical Code C and the Canadian Electrical Code Mellanox Technologies 17 xl InfiniBand Switch Platform Hardware User Manual 18 Battery Replacement Warning Replace only with UL Recognized battery certified for maximum L abnormal charging current not less than 4mA There is a risk of explosion should the battery be replaced with a battery of an incorrect type Dispose of used batteries according to the instructions 19 UL Listed and CSA Certified Power Supply Cord For North American power connection select a power supply cord that is UL Listed and CSA Certified 3 conductor 16 AWG terminated with a molded plug rated at 125 V
116. t Physical Specifications and 12 1 2 Features List suma i pie Rise an 14 1 3 Power Supply 14 Chapter 2 Installation a ua ana 15 2 1 Installation Safety Warnings 15 2 2 Environmental and Safety Recommendations 19 2 3 Chassis Package Contents 20 2 4 Leaf Package Contents 21 2 5 Management Package Contents 21 2 6 Physical Installation ee 21 2 6 1 ESD Connection c oer bere Pelle ana 22 2 6 2 Installing the Cable Holder 30 2 6 3 Installing the Chassis sanaan aaae 33 2 6 4 Ground Connections 38 2 7 Power Gonngclons cose xu er EXER I ERE adas 38 2 7 1 Powering Up the Switch Platform 39 2 8 InfiniBand Cable Installation 40 2 8 1 Supported Approved Cables 41 2 8 2 Cable Power Classes 41 2 9 Hot Swap Insertion and Extraction 41 2 9 1 Power Supply Units 41 2 9 2 Leaf Boards eoo spp RAO ea tea se eR 43 2 9 3 Spine Boards RE o ba ee io te
117. t port for remote management Any remote terminal con nected to the Ethernet port can then be used to manage the fabric and chassis ellanox Technologies 6 4 4 Each Ethernet connector gets connected to Ethernet switches These switches must be configured to 100M auto negotiation o Initial configuration must be done on all of the management modules The first man agement module you configure will be the master A 3 4 4 USB The USB port can be used to upload new SW using any storage device that has a USB connector This interface is USB 2 0 3 4 5 Reset RST The Reset button resets the chassis management module when the button is pushed When the button is held down for 15 seconds the management module is reset and the password deleted DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset button Sharp objects can cause damage use a flat object such as a paper clip Figure 58 Reset Button CONSOLE This button resets the CPU of the management module A quick push of this button per forms this reset When the reset button is pushed on the master management module this management module is reset becoming the slave and the other management module becomes the master If there is only one management module in the chassis all of the leafs and ports are reset by bringing them down and powering them up when the reset button is pushed When the button is held down for 15 seconds th
118. te electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way ama 28 Country of Norway Power Restrictions This unit is intended for connection to a TN power system and an IT power system of Norway only 2 2 Environmental and Safety Recommendations The following are Mellanox recommendations v Recommended ambient temperature in the System room is 20 5 C Recommended humidity range is 40 15 without condensing Mellanox Technologies 19 InfiniBand Switch Platform Hardware User Manual It is highly recommended that the installation sites be as isolated as possible from all sources of radio transmissions and electrical interference It is highly recommended that the installation site building be equipped with a light ning rod It is highly recommended that the installation site be equipped with smoke detectors and a fire alarm warning system The system requires a KVA rated UPS system It is recommended that a UPS system be installed to protect the equipment in the event of unexpected power failure Make sure that the outlets and circuits will not be overloaded Spread out the load over at least two or three circuits or use a 3 phase circuit gt 2 3 Chassis Package Contents The package includes 1 box containing installation kit par
119. ts cable management system power cords e 1 shelf 1 chassis with the following modules installed e fans e 3 spines 1 management module e fans 3 PSUs for the SX6506 3R or e 2 PSUs for the SX6506 NR If you wish you may reduce the weight of the chassis by removing all of the spines power supply units management modules and fan units and put aside for reinstallation after the chassis is installed in the rack 1 installation guide Mellanox Technologies 20 InfiniBand Switch Platform Hardware User Manual box containing various other parts Inside the single box is 3 smaller boxes installation kit box e 1 box containing power cords 250v 15a 2 0M C14 to C13 USA UL Standard e 1 cable management kit Before you install your new IS5100 series chassis unpack the system and check to make sure that all the parts have been sent check this against the parts list Check the parts for visible damage that may have occurred during shipping If anything is damaged or missing contact your customer representative immediately The rack mounting holes conform to the EIA 310 standard for 19 inch racks Guaran tee proper ventilation by leaving 8cm 3 of space to the front and rear of the switch This will ensure proper air flow through the chassis This is crucial for maintaining good airflow at ambient temperature In particular route cables such that they do not impede the air into or out of the ch
120. vice versa All Replacement modules must be consistent with the Chassis fam ily and switch chip generation When hot swapping any of the units it is necessary to wait 1 minute after removing the defective part before inserting the new part This is necessary so that the manage ment module will start a new cycle checking through the leafs and spines for the FW versions This switch platform supports hot swap capabilities for the parts listed below Power supply units Leaf boards Spine boards Leaf fan module Spine fan module Management modules 2 9 1 Power Supply Units 2 9 1 1 Extracting and Inserting the Power Supply Unit To extract a PSU 1 Determine which AC connector on the connector side of the chassis corresponds to the defective PSU Mellanox Technologies 41 o or InfiniBand Switch Platform Hardware User Manual 2 gt m VA Remove the power cord from the power supply unit Note which power cord it is according to the AC numbering Figure 29 Power Cord Numbering On the spine side of the chassis remove the cover to the power supply unit for the non working PSU Odd numbered PSUs are on the left side and even numbered PSUs are on the right side facing the spines There are four phillips head screws for the cover plate Figure 30 Power Supply Ha
121. zorenje Bateriju zamijenite samo baterijom iz serije UL koja je certifici rana za maksimalnu nepravilnu struju punjenja ne manju od 4 mA LA Postoji rizik od eksplozije ako se baterija zamijeni neodgovaraju om vrstom OdloZite prazne baterije sukladno uputama 19 UL CSA kabel napajanja Za sjevernoameri ku mre u odaberite kabel napajanja koji je na UL listi i sa CSA certifikatom 3 Zilni 16 AWG 16 AWG koji zavr ava lijevanim utika em nazivnog napona od 125 V 13 A minimalne duljine od 1 5 m six feet est stopa ali ne dulji od 4 5 m Za europsku mre u odaberite kabel napajanja koji je me unarodno uskla en i ozna en lt HAR gt 3 ilni 5 najmanje 1 0 mm ice nazivnog napona od 300 V s PVC izolacijom Kabel mora imati lijevani utika nazivnog napona od 250 V nazivne struje od 10 A 20 Veliko curenje struje h Upozorenje Veliko curenje struje Prije spajanja napajanja nu no je spojiti uzem ljenje Mellanox Technologies 116 ES M 21 Dodaj informaciju GND spoju Prije spajanja ovog ure aja na elektri ni vod vijci terminala za titnog uzemljenja ure aja moraju se spojiti na za titno uzemljenje u instalacijama zgrade Informacija o GND spajanju Instalacije u zgradi omogu it e sredstva za spajanje na za titno uzemljenje a servisno osoblje e trajno odr avati spoj opreme s uzemljenjem SERVISNO OSOBLJE e provjeriti omogu uje li ili ne zidna uti nica napajanj

Download Pdf Manuals

Related Search

Related Contents

Samsung GT-S5233S User Manual  8000 Series User`s Manual 635 KB    ディスプレイドライバのアップデート手順書  Nady Systems PCL815 Noise Reduction Machine User Manual  EK Water Blocks EK-CoolStream RAD XTX (360)  Funk-ET-Sensor für kompatible Steuergeräte von  Sunfire 300 Two Amplifier  Matrox Electronic Systems II User's Manual  V850ES/Jx3-L Sample Program (Watchdog Timer 2 (WDT2)) Reset  

Copyright © All rights reserved. Failed to retrieve file