Home

Mellanox 1U Switch and Gateway Systems Hardware User Manual

1. 15 EN B N 16 UL CSA IN C UL CSA
2. mo 32 3 19 4 76 Mellanox Technologies Rev 1 1 5 nic 4 MID PR DID 222 6 7 N PN 45 113 F nov DYP 8 3 DAV 7 399 TDS PN 8 MI
3. 2 N 40 lbs 40 70 16 70 121 lbs gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Mellanox Technologies 93 4 CHAT 5 45 1
4. 18 RS232 RRN ZAIRE I HWE RM AE UL ARA DP 1 DP 2 LPS MBERE 2 F ET SS FH B BU gt REGIS EE RE IE 20A 19 BA 82 Mellanox Technologies Rev 1 1 3 8 20 WEEE 5 WEEE 97 2002 96 EC PAREN EREI ST Ex EEE METER ERE 75 ARIE FE nn 21 TN RK tA IT Lo 5 Avertissements de s curit pour l installation French 1 Instructions d installation Y N Veuillez lire la totalit des instructions d installation avant de relier l quipement au 4 secteur 2 Blessures cause du poids Pr voyez assez de personnel pour soulever ce produit en toute s curit lt 40 lbs 40 70 lbs 70 121 lbs gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 quipement lourd Cet quipement est lourd et doit tre d plac avec un syst me de levage m canique pour viter les blessures Mellanox Technologies 4 D
5. 20 19 20 WEEE 2002 96 WEEE E 9 Avertismente privind siguran a la instalare Romanian 1 Instruc iuni de instalare Citi i toate instruc iunile de instalare nainte de a conecta 96 Mellanox Technologies Rev 1 1 2
6. Y X 14 DINI 15 Ah 16 NASI mp3 235 Ah UL CSA nonon 3 16 AWG 13A 125 1 5 6 4 5 235 lt gt 3 DITA 1 0 V 2 300 DY PVC 250 10A V 8 Mellanox Technologies Rev 1 1 17 29
7. 9 10 InfiniBand InfiniBand 94 Technologies Rev 1 1 11 B H
8. 12 VA Features a ne e eena 12 1 4 1 Network Management Feature 12 1 5 Certifications va nee a qe lee el noire pi rade id 12 1 6 Ordering Information 13 Chapter 2 Installation 16 2 1 Safety Warm ess nasser klar ga E ka 16 22 Air Flow ele ile MEI m ela a 17 2 3 Package Contents use te Kli eee AR a ds enne Blade dd ala 19 24 Mounting Options rero unb ER ER ae en pe nep 20 2 4 1 19 Systems Mounting 20 2 4 2 Side by Side u nn ta gh REG e RAE CR AG eed 25 ZA Table TOD ds A a go dans UE SU d ds 29 2 5 Gro nding ae ala ale ia liessen 31 2 67 Cable Installation sw er om era 32 2 6 1 Using a Breakout Cable 32 2 7 Examples of Port Mapping Assignmlnitial Power On 35 2 8 System Bring Up slam ds ahd etd imi E ZRH Len 37 2 8 1 Configuring Network Attributes 37 2 8 2 Remote Connection 5 kemik elik a 40 2 9 FRU Replacemsnts de SEE e EN EB e li 41 2 9 1 Power Supply and Fans 41 Chapter 3 Intertaces ilikiler meyda 44 3 1 Data Interfaces er ats eke le ele lay Ne 44 3 11 Speed ies A 44
9. 2 A 1 1 lt 40 lbs 40 70 lbs 70 121 16 gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 4 5 45 C 113 F 8 3 RM WEEE o 80 Mellanox Technologies Rev 1 1 7 A ABR 8 4 PSU HS ABW BREERERENE 9
10. PINI IN PN gt 9 MIO TON MIN MIN pin DITO NIWAN 10 09929 PN Mellanox Technologies 77 11 InfiniBand OF Ah 12 YN 5331 01932 IWNI 13
11. Rev 1 1 Appendix A Accessory and Replacement Parts Table 27 OPNs for Replacement Parts OPN Part Description MSX60 PF 300W Power Supply w Power Supply Side to Connector side for MSX60XX and MSX10XX series switch systems MSX60 PR 300W Power Supply w Connector side to Power Supply side for MSX60XX and MSX10XX series switch systems MSX60 FF Fan module with power supply side to connector side for MSX60XX and MSX10XX series switch systems MSX60 FR Fan module with connector side to power supply side for MSX60XX and MSX10XX series switch systems MSX60 DKIT installation kit for SX6005 SX6012 and SX1012 series short depth 10 switches allows installation of One or Two switches side by side into standard depth racks MSX60 BKIT Rack installation kit for MSX60XX and MSX10XX series short depth 1U sys tems to be mounted into short depth racks MSX60 SKIT Rack installation kit for MSX60XX and MSX10XX series short standard depth 1U systems to be mounted into standard depth racks MTUSB 1 PC DB9 or RJ 45 to USB adapter located in EVB products only HAR000028 Harness RS232 2M cable DB9 to RJ 45 for managed switches only ACC000501 Power cord Type C13 C14 66 Mellanox Technologies Rev 1 1 Appendix B Thermal Threshold Definitions There are three thermal threshold definitions for the SwitchX switch device which impact the overall switch system operat
12. ob EA TERRA T AR 10 InfiniBand RK InfiniBand 584848 ARAM 2 DEE Be E BB E EE L K ER 12 7 N 13 RERE Y N ERIZOS AR Mellanox Technologies 81 14 15 UL IZA CSA BERR BEE FERNS sis AES UL CSA 88 185888 16 g AWG 125 V 13 A REED 15 AR ARR FEAS lt HAR gt FE SEM MEME 10 X8 MEEA 300V RA PVC 8000808 BR 250 V 10 Ao 16 A E 17
13. View into Rear of Connector 18 35 Top lews QSFP Connector Male and Female V Figure 36 Rev 1 1 Rev 1 1 6 2 RJ 45 CONSOLE and I2C Interface The RJ 45 CONSOLE and I2C interface uses the EIA 568A standard wiring color coding CONSOLE Table 28 RJ 45 CONSOLE Pinout 134 Connection Signal Pin Color DD a B 7U TXD RJ 45 RTS 1 G W RJ45 DTR Mp E TXD RJ 45 DTR 2 RXD END RXD RJ 45 TXD 3 O W d Ping GND GND 4 Looking into the Socket GND GND 5 B W RXD RJ 45 RXD 6 0 GND 7 Br W GND GND 8 Br Table 29 RJ 45 12C Pinout Connection Signal Pin Color TXD RJ 45 SDA G W TXD GND 2 G I2C ii RXD GND 3 O W 4 BI TXD Pin 1 Rx S Rs SDA GND GND 5 BI W Eun RXD GND RXD RJ 45 SCL 6 0 jav GND GND 7 Br W GND Pin 8 GND GND 8 Br Looking into the Socket 70 Mellanox Technologies Rev 1 1 6 3 RJ45 to DB9 Harness Pinout In order to connect a host PC to the Console RJ45 port of the system a RS232 harness cable DB9 to RJ45 is supplied Figure 37 RJ45 to DB9 Harness Pinout Mellanox Technologies 71 Rev 1 1 Appendix Disassembly and Disposal D 1 Disassembly Procedure To disassemble the system from the rack 1 Unplu
14. 3 12 x A NGC A ME e 45 313 Management s ose a sua EAR poer E e REER 45 PRI US Bi Ea a are 45 40 3 1 6 Reset Button eee Ysera e et a pu Berner 46 32 LEDS ire alati ai senes ie vem ES denos ede 46 3 2 1 LED Notifications unis a ee dae 46 3 3 Inventory Pull out Tab 5 Chapter 4 Software Management sssss s 53 4 1 InfiniBand Subnet 53 Mellanox Technologies 3 4 2 Fabric Inspector Diagnostics 53 43 Upgrading Software on Managed Systems 54 4 4 Updating Firmware on Externally Managed Systems 54 44 1 Obtaining the Current Firmware version 54 4 4 2 Reprogramming the System Through PC Port 55 4 4 3 HowtoGetMellanoxFirmwareTools MFD 56 Chapter 5 TIroubleshooting 8 57 5 1 Troubleshooting Instructions 57 Chapter 6 Specifications 42 2429 6r AAA dani e t 8 59 SX0005 SCFIeS kl a ed ERU a ee el sen 59 6 22 SXO I2 S TI S im D ban Ba 60 6 3 SXGT Seres e ar ns need Bene bm esime ei 6l 04 0018 Series sc se ogee A leurs Su NES 62 6 55 50025 Series EN u ln ea etude nll ma 63 0 62 SENES stacca d
15. Table 5 Ordering Part Numbers OPNs Description SwitchX 2 based FDR InfiniBand 1U Switch 12 QSFP ports 1 Power Supply AC unmanaged short depth P2C airflow Rail Kit must be purchased separately RoHS6 SwitchX 2 based FDR 10 InfiniBand 1U Switch 12 QSFP ports 1 Power Supply AC unmanaged short depth P2C airflow Rail Kit must be purchased separately RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 12 OSFP ports 1 Power Supply AC PPC460 short depth P2C airflow Rail Kit must be purchased separately RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 12 OSFP ports 1 Power Supply AC PPC460 short depth C2P airflow Rail Kit must be purchased separately RoHS6 Switch X amp 2 based FDR InfiniBand IU Switch 12 QSFP ports 2 Power Supplies AC PPC460 short depth P2C airflow Rail Kit must be purchased separately RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 12 OSFP ports 2 Power Supply AC PPC460 short depth C2P airflow Rail Kit must be purchased separately RoHS6 SwitchX 2 based FDR 10 InfiniBand 1U Switch 12 OSFP ports 1 Power Supply AC PPC460 short depth P2C airflow Rail Kit must be purchased separately RoHS6 Switch X amp 2 based FDR 10 InfiniBand IU Switch 12 QSFP ports 2 Power Sup plies AC PPC460 short depth P2C airflow Rail Kit must be purchased separately RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 18 QSFP ports 1 Power Supply
16. The system s inventory parameters such as serial number part number GUID and MAC address can be extracted from the Inventory pull out tab on the lower right side of the front panel Mellanox Technologies 51 Rev 1 1 Interfaces Figure 33 Pull out Tab Avr A Vu SA Vs NE A SIN MT1117X00014 DT PIN MSXEOSCF 18FR WG s GUID 0002C90200400080 Rev B6 IM IME LA Made In China gt Pull out tab 52 Mellanox Technologies Software Management Rev 1 1 4 Software Management Managed systems come with an embedded management CPU card that runs MLNX OS man agement software The MLNX OS systems management package and related documentation can be downloaded via the product page http www mellanox com page mlnx os 4 1 InfiniBand Subnet Manager The InfiniBand Subnet Manager SM is a centralized entity running in the system The SM applies network traffic related configurations such as QoS routing partitioning to the fabric devices You can view and configure the Subnet Manager parameters via the CLI WebUI Each subnet needs one subnet manager to discover activate and manage the subnet Each network requires a Subnet Manager to be running in either the system itself system based or on one of the nodes which is connected to the fabric host based Y No more than two subnet manage
17. 0 1 Step 4 Run the burn command Flint d dev mst mtusbai 1 Ew SX rel 7 4 0 0 Al bin b Step 5 Power cycle the system by unplugging and re plugging the power cord to load the new firm ware 4 4 3 How to Get Mellanox Firmware Tools MFT Mellanox Firmware Tools MFT and documentation are available for download via http www mellanox com page management tools The MFT kit includes e mlxburn flint Spark debug utilities 56 Mellanox Technologies Troubleshooting Rev 1 1 5 Troubleshooting 5 1 Troubleshooting Instructions Table 19 Troubleshooting Problem Indicator Symptoms Corrective Measures LEDs System Status LED 1s This state means that the MLNX OS software did not blinking for more than 5 boot properly and only firmware is running minutes To overcome it connect to the system via the console port and check the software status You might need to contact an FAE if the MLNX OS software did not load properly System Status LED 1s red This state can indicate a number of problems Critical system fault CPU error bad firmware Over Temperature To overcome it e o Check Environmental conditions room temperature Fan Status LED is red This state is indicative of a problem with the FAN Check that the FAN is fully inserted and nothing blocks the airflow Replace the FAN FRU if needed PSU Status LED is red This state is indicative of a problem with the PSU Check
18. 255 255 2590 IPv enabled yes Autoconf enabled no Autoconf route yes Autoconf privacy no DHCPv6 running no IPv addresses 1 IPv6 address fe80 202 c9ff fe63 b55a 64 Speed 1000Mb s auto Duplex full auto Interface type ethernet Interface source physical TUR 1500 HW address 00 02 C9 63 B5 5A RX bytes 968810197 TX bytes 1172590194 RX packets 10982099 TX packets 10921755 RX mcast packets 0 TX discards 0 RX discards 0 TX errors 0 RX errors 0 TX overruns 0 RX overruns 0 TX carrier 0 RX frame 0 TX collisions 0 TX queue len 1000 r ga sit sx01 config Step 6 You are advised to check the software version embedded in your system using the command show version you can continue and compare this version to the latest version that can be retrieved from Mellanox support site To upgrade software simply refer to MLNX OS user manual 2 8 2 Remote Connection Once the network attributes are set you can access the CLI via SSH or the WebUI via HTTP HTTPs To access the CLI perform the following steps Step 1 Set up an Ethernet connection between the system and a local network machine using a stan dard RJ45 connector Step 2 Start a remote secured shell SSH using the command ssh l username IP address gt ssh 1 username ip address 40 Mellanox Technologies Installation Rev 1 1 Mellanox MLNX OS Switch Management Password Step3 Login as admin defau
19. Accidentare cauzat de greutate N Apelati la un num r suficient de persoane pentru a ridica in sigurant acest produs 4 i TTT lt 40 lbs 40 70 lbs 70 121 16 gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Echipament greu Acest echipament este greu si trebuie s fie mutat folosind un dispozitiv mecanic de ridicare pentru a evita producerea de leziuni 4 Riscde oc electric Risc de oc electric Odat ce modulul ventilator este indep rtat pinii electrici sunt accesibili in cavitatea modulului NU introduceti instrumente sau p rti din corp in cavitatea modulului ventilator 5 Temperatur in exces Acest echipament nu trebuie sa fie ac ionat ntr o zon unde temperatura ambiant dep e te valoarea maxim recomandat 45 C 113 F n plus pentru a asigura un flux de aer adecvat l sa i un spa iu liber de cel pu in 8 cm 3 inchi n jurul fantelor de ventilare 6 Suprapunerea cadrului Cadrul nu trebuie s fie suprapus peste niciun alt echipament n cazul n care cadrul cade poate cauza leziuni corporale i deterior ri ale echipamentului 7 Conexiunea la o surs de alimentare electric suplimentar pericol electric AN Acest produs include o surs de alimentare suplimentar sau un spa iu gol n locul Y N acesteia n cazul in care spatiul pentru sursa de alimentare este gol nu operati produ sul capacul orb este indep rtat sau nu este fi
20. Environmental Temperature Operational 0 to 45 C Non Operational 40 to 709C Humidity Operational 10 85 non condensing Non Operational 10 90 non condensing Altitude Operational 3050m Power Input Voltage 100 240 VAC 50 60Hz CPU and Switch CPU PPC460EX Switch Mellanox SwitchX 2 Switching Capacity 1 34 Tb s non blocking 60 Mellanox Technologies Specifications Rev 1 1 6 3 SX6015 Series Table 22 SX6015 Specifications Feature Value Mechanical Size Short 1 716 H H x 16 85 W x16 8 D 43 6mm H x 428mm W x 428 9 mm D Standard 1 716 H H x 16 85 W x24 75 D 43 6mm H x 428mm W x 628 9 mm D Mounting 19 Rack mount Weight Short System with 1 PSU 8 01kg 17 651bs System with 2PSUs 8 75kg 19 291bs Standard System with 1 1 8 System with 2 11853 858 Speed 40 56Gb s per port Connector cage 18 QSFP Heat dissipation 576 BTUs hr Environmental Temperature Operational 0 to 45 C Non Operational 40 to 70 C Humidity Operational 10 85 non condensing Non Operational 10 90 non condensing Altitude Operational 3050m Power Input Voltage 100 240 VAC 50 60Hz Typical ATIS score under snake topology with passive cables 78 15W 62 46 Main Devices CPU N A Switch Mellanox SwitchX 2 Switching Capacity 2 02 Tb s non blocking Mellanox Technologies
21. Existing LAN infrastructures and management practices can be preserved easing deployment and provid ing significant return on investment 10 Mellanox Technologies Introduction to Mellanox SX60XX Systems Rev 1 1 Figure 1 InfiniBand Systems Family Front Side View SX6005 SX6012 SX6015 5X6018 1 2 Speed and Switching Table 3 describes maximum throughput and interface speed per system model Table 3 Speed and Switching Capabilities System Model ped pest git 40 56GbE QSFP Interfaces Throughput SX6005 externally managed N A 12 1 34 Tb s SX6012 internally managed N A 12 1 34Tb s SX6015 externally managed N A 18 2 02Tb s SX6018 internally managed N A 18 2 02Tb s SX6025 externally managed N A 36 4 03Tb s SX6036G internally managed N A 36 4 03Tb s The switches can support 10Gb s interfaces using QSFP to SFP adapters Mellanox Technologies 11 Rev 1 1 Introduction to Mellanox SX60XX Systems 1 3 Management Interfaces and FRUs Table 4 lists the various management interfaces and available replacement parts per system model Table 4 Management Interfaces and FRUs MGT MGT System 2 Replaceable Replaceable USB Ports Ports Console Model PSU Fan Qty Location SX6005 N A N A N A Front N A N A N A Rear SX6012 Front 1 Front Rear Front N A N A mini USB SX6015 N A N A N A Front N A 2 FRUs I FRU R
22. Interfaces Rev 1 1 3 1 2 RS232 Console 4 This interface is not found in externally managed systems 5 The port labeled Console is an RS232 serial port used for initial configuration and debugging Upon first installation of the system you need to connect a PC to this interface and configure network parameters for remote connections Refer to Section 2 8 1 to view the full pro cedure 3 1 3 Management The RJ45 Ethernet port labeled MGT El provides access for remote management The man agement port is configured with auto negotiation capabilities by default LOOMbE to 1000GbE The management port network attributes such as IP Address need to be pre configured via the RS232 console port before using the port Refer to Section 2 8 1 to view the full procedure Make sure you use only FCC compliant Ethernet cables 3 1 4 USB The USB interface is USB 2 0 compliant and can be used by MLNX OS software to connect to an external disk for software upgrade or file management The USB connector comes with either regular or mini USB shapes To view the full matrix of the USB configuration options refer to Table 4 Management Inter faces and FRUs A USB 1 0 is not supported gt 4 Do NOT use excessive force when inserting or extracting the USB disk from the con nector ha Mellanox Technologies 45 Rev 1 1 Interfaces 3 1 5 12C The I2C connector is located either on the power supply side
23. on the right side of the unit that indicates the status of the unit Figure 31 Rear Side Panel E TITI IL EMILE HT Power Supply Unit Mellanox Technologies 49 Rev 1 1 Interfaces The primary power supply PS unit is located on the left side and the secondary unit is located Action Reguired N A In case there is an FRU the module should be replaced Otherwise the sys tem should be replaced Check power source or replace the cable on the right side Table 15 Power Supply Unit Status LED Assignments Description The Power supply is running in normal condi tion Error the unit is not operational There is no power to the system the unit is receiving no power LED Behavior Solid Green Solid Red Off Bad Port LED The Bad Port LED indicator is used to indicate symbol errors in one or more system ports Table 16 shows the bad port status LED assignment Action Reguired N A Check symbol error counters on the sys tem UI to identify the ports Replace the cable on these ports Table 16 Bad Port LED Assignments Description No symbol errors have been received in last few seconds normal condition Error one or more ports have received symbol errors Possible causes are Bad cable Bad connection Bad connector LED Configuration Off Flashing Orange UID LED The UID LED is a debug feature that up
24. tical supports Figure 11 Installation Kit Parts for a Side by Side Installation Mellanox Technologies 25 Rev 1 1 Installation gt Installing the system slides on the system Step 1 Place the ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground Step 2 Screw the two systems mounted rails to the system using six flat head screws per rail The rec ommended torque is 0 7 0 1 Nm Figure 12 Screw on the System Mounted Rails gt Installthe two system frame into the rack Step 1 Slide the frame slides into the frame 26 Mellanox Technologies Installation Rev 1 1 Figure 13 Two Systems Frame Connector side of the rack Step 2 Place the frame in the rack Both sides of the frame must be on the inside of the rack Figure 14 Placemeni of Frame in the Rack Step 3 Take the 10 spacer bushings and use them to adapt the square openings in the vertical support Mellanox Technologies 27 Rev 1 1 Installation Figure 15 Placing the Spacer in the Rack Step 4 Use the 10 M5 pan head screws Do not tighten the screws to the frame Figure 16 Using the Spacer Bushings Step 5 Slide the system into the frame and screw in the capture bolts into the frame 28 Mellanox Technologies Installation Rev 1 1 Figure 17 Insert System into Frame St
25. 1 Introduction to Mellanox SX60XX Systems 1 Introduction to Mellanox SX60XX Systems 1 1 Overview The SX60XX systems provide the highest performing fabric solution in a 1U form factor by delivering up to 4Tb s of non blocking bandwidth with 200ns port to port latency These systems are the industry s most cost effective building blocks for embedded systems and storage with a need for low port density systems Whether looking at price to performance or energy to performance these systems offer superior performance power and space reducing capital and operating expenses and providing the best return on investment The systems are an ideal choice for smaller departmental or back end clustering uses with high performance needs such as storage data base and GPGPU clusters Powerful servers combined with high performance storage and applications that use increasingly complex computations are causing data bandwidth requirements to spiral upward As servers are deployed with next generation processors High Performance Computing HPC environments and Enterprise Data Centers EDC need every last bit of bandwidth delivered with Mellanox s FDR InfiniBand systems Built with Mellanox s sixth generation SwitchX amp 2 InfiniBand FDR 56Gb s system device these standalone systems are an ideal choice for top of rack leaf connectivity or for building small to extremely large sized clusters These systems enable efficient computing with features such a
26. 3 16 AWG 1 5 M 6 4 5 125 13 A lt HAR gt 3 1 0 MM 300 250 10 Mellanox Technologies 95 17 18 RS232 Ethernet DP 1 DP 2 UL
27. 61 Rev 1 1 Specifications 6 4 SX6018 Series Table 23 SX6018 Specifications Feature Value Mechanical Size Short 1 716 H H x 16 85 W x16 8 D 43 6mm H x 428mm W x 428 9 mm D Standard 1 716 H H x 16 85 W x24 75 D 43 6mm H x 428mm W x 628 9 mm D Mounting 19 Rack mount Weight Short System with 1 PSU 8 01kg 17 651bs System with 2PSUs 8 75kg 19 291bs Standard System with 1 1 8 System with 2 11853 858 Speed 40 56Gb s per port Connector cage 18 QSFP Heat dissipation 675 BTUs hr Environmental Temperature Operational 0 to 45 C Non Operational 40 to 70 C Humidity Operational 10 85 non condensing Non Operational 10 90 non condensing Altitude Operational 3050m Power Input Voltage 100 240 VAC 50 60Hz Typical ATIS score under snake topology with passive cables 78 15W 60 3 Main Devices CPU PPC460EX Switch Mellanox SwitchX 2 Switching Capacity 2 02 Tb s non blocking 62 Mellanox Technologies Specifications Rev 1 1 6 5 SX6025 Series Table 24 SX6025 Specifications Feature Value Mechanical Size Short 1 716 H H x 16 85 W x16 8 D 43 6mm 428mm W 428 9 mm D Standard 1 716 H H x 16 85 W x24 75 D 43 6mm x 428mm W x 628 9 mm D Mounting 197 Rack moun
28. 85 non condensing Non Operational 10 90 non condensing Altitude Operational 3050m Power Input Voltage 100 240 VAC 50 60Hz Typical ATIS score under snake topology with passive cables 78 15W 77 83 Max Consumption Active cables 224W 6 2 W port Passive cables 119W 3 3W port Typ Consumption Active cables 182W 5W port Passive cables 100W 2 8W port Main Devices CPU PPC460EX Switch Mellanox SwitchX Switching Capacity 4 03 Tb s non blocking 64 Mellanox Technologies Specifications Rev 1 1 6 7 SX6036G Series Table 26 SX6036G Specifications Feature Value Mechanical Size Standard 1 716 H H 16 85 W x24 75 D 43 6mm H 428mm W 628 9 mm D Mounting 19 Rack mount Weight System with 1 1 8 System with 2 51185 858 Speed 40 56Gb s per port Connector cage 36 QSFP Heat dissipation 798 BTUs hr Environmental Temperature Operational 0 to 45 C Non Operational 40 to 709C Humidity Operational 1096 8596 non condensing Non Operational 10 90 non condensing Altitude Operational 3050m Power Input Voltage 100 240 VAC 50 60Hz Typical ATIS score under snake topology with passive cables 78 15W 77 83 Main Devices CPU PPC460EX Switch Mellanox SwitchX Switching Capacity 4 03 Tb s non blocking Mellanox Technologies 65
29. Example Mellanox configuration wizard Do you want to use the wizard for initial configuration yes Step 1 Hostname Step 2 Use DHCP on mgmtO interface yes no Step 3 Use zeroconf on mgmt0 interface no Step 4 Primary IP address for example 192 168 10 4 10 10 10 10 Mask length may not be zero if address is not zero interface eth0 Step 5 Netmask 0 0 0 0 255 255 255 0 Step 6 Default gateway for example 192 168 10 1 10 10 10 255 Step 7 Primary DNS server Step 8 Domain name Step 9 Enable IPv6 yes Step 10 Enable IPv6 autoconfig SLAAC on mgmt0 interface no Step 11 Admin password Enter to leave unchanged To change an answer enter the step number to return to Otherwise hit lt enter gt to save changes and exit Choice Configuration changes saved To return to the wizard from the CLI enter the configuration jump start command from configure mode Launching CLI gt Mellanox Technologies 39 Rev 1 1 Installation Step 5 Before attempting a remote for example SSH connection to the system check the mgmt0 interface configuration Specifically verify the existence of an IP address To check the current mgmt0 configuration enter the following commands Switch config show interfaces mgmt0 r ga sit sx01 config show interfaces 0 Interface mgmt0 status Comment Admin up yes Link up yes DHCP running yes IP address 10 209 28 50 Netmask
30. Interconexi n de unidades Los cables para la conexi n con las interfaces RS232 y Ethernet de la unidad deben estar homologados por UL tipo DP 1 o DP 2 Nota cuando residen en circuito no de tipo LPS Protecci n contra sobrecargas Al cableado del edificio se debe incorporar un disposi tivo de protecci n contra sobrecargas de circuito derivado de f cil acceso con una corriente nominal de 20 A 2 Mellanox Technologies Rev 1 1 20 No utilizar el conmutador como estante ni como espacio de trabajo Cuidado Equipos montados en deslizadores o rieles no se deben utilizar como estantes ni como espacio de trabajo La finalidad de los rieles no es deslizar la unidad hacia afuera del bastidor Sirven solo para la instalaci n permanente en el lugar de destino final no para fines de servicio o mantenimiento 21 Directiva WEEE Conforme a la Directiva 2002 96 CE sobre RAEE todos los residuos de equipos el c tricos y electr nicos EEE se deben recolectar por separado y no se deben eliminar junto con residuos dom sticos A deshacerse de este producto y de todas sus partes h galo de una manera respons able y respetuosa con el medio ambiente E 8 Rus sian 1
31. North America equipment must be installed in accordance to the applicable requirements in the US National Electrical Code and the Canadian Electri cal Code 17 Interconnection Of Units Cables for connecting to the unit RS232 and Ethernet Interfaces must be UL certified type DP 1 or DP 2 Note when residing in non LPS circuit 18 Overcurrent Protection A readily accessible Listed branch circuit overcurrent protective device rated 20 A must be incorporated in the building wiring 19 Do Not Use the Switch as a Shelf or Work Space Caution Slide rail mounted equipment is not to be used as a shelf or a work space The rails are not intended for sliding the unit away from the rack It is for permanent instal lation at final resting place only not used for service and maintenance Mellanox Technologies 20 WEEE Directive According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way 21 Country of Norway Power Restrictions This unit is intended for connection to a TN power system and an IT power system of Norway only mann 1 5597 man
32. US amerikanischen National Electrical Code und dem Canadian Electrical Code 18 Verbindung der Ger te untereinander Kabel f r den Anschluss an das Ger t RS232 und Ethernet Schnittstellen m ssen UL zertifiziert Typ DP 1 oder DP 2 Hinweis wenn nicht mit Wohnsitz in LPS Schal tung berstromschutz Eine leicht zug ngliche Auflistung Abzweigleitung berstrom Schutzeinrichtung 20 A bewertet werden m ssen in dem Geb ude Verkabelung 19 Switch nicht als Regal oder Arbeitsplatz nutzen Achtung Auf Schieber Schienen montiertes Ger t ist nicht als Regal oder Arbeitsbere ich zu nutzen Die Schienen sind nicht daf r bestimmt die Einheit aus dem Gestell weg zu ziehen Sie sind nur f r die permanente Installation an einem endg ltigen Stan dort gedacht nicht f r Instandhaltung und Wartung 20 WEEE Direktive Gem WEEE Directive 2002 96 EC m ssen alle elektrischen und elektronischen Abfallger te EEE separat gesammelt und nichit mit normalem Haushaltsm ll ensorgt werden Dieses Produkt und alle seine Teile in verantwortungsvoller und umweltfreundlicher Art und Weise entsorgen Mellanox Technologies 89 E 7 Advertencias de seguridad de instalaci n Spanish 1 Instrucciones de instalaci n Antes de conectar el equipo a la fuente de alimentaci n leer todas las instrucciones de instalaci n 2 Lesi n corporal a causa de peso N Recurra a suficientes personas para levantar este producto
33. Wizard Session Static IP Configuration 39 Table 12 Status LEDS v oett e aeter ela a bal asal Sl 47 Table 13 System Status LED Assignments 48 Table 14 Fan Status LED Assignments 48 Table 15 Power Supply Unit Status LED Assignments 50 Table 16 Bad Port LED Assignments 50 Table 17 Port LEDs in Ethernet System Mode 5 Table 18 Port LEDs in InfiniBand System Mode 5 Table 19 Troubleshooting seres 5 405 ste a Ml e E Salak e a es 57 Table 20 SX6005 Specifications 59 Table 21 SX6012 Specifications so ee es 60 Table 22 SX6015 Specifications 61 Table 23 SX6018 Specifications 62 Table 24 SX6025 Specifications 63 Table 25 SX6036 Specifications 64 Table 26 SX6036G Specifications 65 Table 27 OPNs for Replacement Parts 66 Table 285 CONSOLE Pinot busca ada 70 Table 29 RAS 126 Pinout sep O
34. heavy and should be moved using a mechanical lift to avoid injuries 4 Risk of Electric Shock Risk of Electric Shock With the fan module removed power pins are accessible within the module cavity DO NOT insert tools or body parts into the fan module cavity 5 Over temperature This equipment should not be operated in an area with an ambient temperature exceed y N ing the maximum recommended 45 C 113 F Moreover to guarantee proper allow li at least 8cm 3 inches of clearance around the ventilation openings Mellanox Technologies 73 6 Stacking the Chassis The chassis should not be stacked on any other eguipment If the chassis falls it can cause bodily injury and eguipment damage 7 Redundant Power Supply Connection Electrical Hazard This product includes a redundant power or a blank in its place In case of a blank power supply do not operate the product with the blank cover removed or not securely fastened 8 Multiple Power 65 Risk of electric shock and energy hazard 4 The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform 9 During Lightning Electrical Hazard During periods of lightning activity do not work on the equipment or connect or dis connect cables 10 Copper InfiniBand Cable Connecting Disconnecting Copper InfiniBand cables are heavy and not flexible as such they should be carefully attach
35. replace the power cable Replace the PSU if needed The activity LED does not Make sure that there is an SM running in the fabric light up InfiniBand Mellanox Technologies 57 Rev 1 1 Troubleshooting Table 19 Troubleshooting Problem Indicator Symptoms Corrective Measures Systemboot The last software upgrade Make sure that there is an SM running in the fabric failure failed on PPC based sys Connect the RS232 connector CONSOLE to a tems laptop Push the reset button on the system or on the man agement module You will have 5 seconds to stop the U Boot by pressing Control B Choose the image you wish to upload Use image 1 or image 2 only Select the previous image to boot U Boot 2009 01 mlnx1 4 date CPU AMCC PowerPC 460EX Rev A at 1000 MHz PLB 200 OPB 100 EBC 100 MHz Security Kasumi support Bootstrap Option H Boot ROM Location I2C Addr 0x52 Internal PCI arbiter disabled 32 kB I Cache 32 kB D Cache Board Mellanox PPC460EX Board FDEF No I2C ready DRAM 2 GB ECC enabled 400 MHz CL3 FLASH 16 MB NAND 1024 MiB PCI Bus Dev VenId DevId Class Int PCIEO link is not up 1 successfully set as root complex 01 00 15b3 bd34 0006 00 Net ppc 4 eth0 ppc 4xx ethl Hit Ctrl B to stop autoboot 0 Mellanox MLNX OS Boot Menu 1 SX PPC M460EX 3 3 5006 dev HA 2013 04 10 12 02 49 ppc 2 SX PPC M460EX 3 3 5006 dev HA 2013 0
36. to operate at a higher less than optimal temperature For power supply unit air flow direction refer to Section 2 2 on page 17 gt To extract a fan unit Step 1 Fora fan unit composed of two fans using two fingers push both latch releases towards each other simultaneously while pulling the fan module out of the system As the fan unseats the Fan Status LED will turn off For a single fan unit grasping the handle with your right hand push the latch release with your thumb while pulling the handle outward As the fan unit unseats the fan unit status LEDs will turn off Step 2 Remove the fan unit Figure 27 Fan Module Latches NES LEE BEBE m Der These two latches must be pushed towards each other at the same time while the module is pulled out gt Toinsert a fan unit Step 1 sure the mating connector of the new unit is free of any dirt and or obstacles Step 2 Insert the fan unit by sliding it into the opening until slight resistance is felt Continue pressing the fan unit until it seats completely The green Fan Status LED should light Ifnot extract the fan unit and reinsert it After two unsuccessful attempts to install the fan unit power off the system before attempt ing any system debug Mellanox Technologies 43 Rev 1 1 Interfaces 3 Interfaces The systems support the following interfaces Data interfaces InfiniBand and Ethernet 100 1000 MbE RJ45 management i
37. yerine bo elektrik kutusu i erir G kayna i in bo elektrik kutusu varsa kutunun kapa a kken veya tam olarak kapat lmam ken r n al t rmay n 8 oklu G Giri leri Elektrik arpmas riski ve enerji tehlikesi B t n PSU lar G Kayna niteleri ayr d r Anahtar platformundaki g c kapatmak i in t m g kaynaklar n n ba lant lar n kesin 9 im ek Elektrik arpma Tehlikesi G ky z nde im ek akt zamanlarda ekipman zerinde al may n veya kablo ba lamay n ya da kablo ba lant s kesmeyin 10 Bak r nfiniband Kablo Ba lama Ba lant y Kesme Bak r nfiniband kablolar a rd r ve esnemezler Bu nedenle ba lant lara ok dikkatli bir ekilde tak lmalar veya kar lmalar gerekir zel uyar lar talimatlar i in kablo reticinize ba vurun 11 skele Montaj ve Bak m Bu r n bir iskelede monte edildiyse veya bir iskele ile sunulduysa sistemin sabit kalmas i in zel nlemler al nmal d r Genelde ekipmanlar iskeleye a a dan yukar do ru doldurman z gerekir Ekipman n yaln zca e itimli ve nitelikli personel taraf ndan monte edilmesi de i tirilmesi ve veya bak m n n yap lmas gerekir 13 Ekipman n At lmas 7 N Bu ekipman n imhas nda t m ulusal yasalara d zenlemelere uyulmas gerekir N 108 Mellanox Technologies Rev 1 1 9 0 1 14 Y
38. 13 F 8 3 6 7
39. 27 Figure 14 Placement of Frame in the Rack 27 Figure 15 Placing the Spacer in the Rack 28 Figure 16 Using the Spacer Bushings 28 Figure 17 Insert System into Frame 29 Figure 18 Placing the Bumpers 30 Figure 19 Cable Orientation cia e Baler tesa eae te I ER ir 32 Figure 20 Breakout or Fanout Cable 33 Figure 21 SX6018 Port Splitting Options 33 Figure 22 6036 G Port Splitting Options 34 Figure 23 System Status LEDs 5 Minutes After Power On 36 Figure 24 Two Power Inlets Electric Caution Notifications 36 Figure 25 Power Supply Unit Extraction 42 Figure 26 PS Unit Pulled Out aan Va 2 DLR i ates 42 Figure 2 7 Fan Module Latches ses frank bae e a g le EVE Np e UE an 43 Figure 28 SystemStatusLEDs FrontandRearsides 47 Figure 29 Fan Status LED Front and Rear sides 48 Fipure 30 Power Status LED u eese eee anl VeRO CET ev CR re tee a ler 49 Figure31 R ea nSide P
40. 32 i la interfetele Ethernet trebuie s fie de Y tipul DP 1 sau DP 2 certificate UL Not c nd se reg sesc intr un circuit non LPS Protectie la supracurent Un dispozitiv de protectie la supracurent inregistrat in cir cuitul de ramificare usor accesibil i cu o putere nominal egal cu 20 A trebuie fie integrat in cablajul cladirii 19 Nu utilizati comutatorul ca raft sau spatiu de lucru Atentie Echipamentul montat pe o linie de alunecare sin nu va fi utilizat ca raft sau spatiu de lucru Scopul Sinelor nu este de a glisa unitatea de pe rack Acestea sunt des tinate instal rii permanente numai la punctul final de oprire Si nu vor fi folosite pentru depanare i intretinere 20 Directiva DEEE n conformitate cu Directiva DEEE 2002 96 CE 10816 de eurile de echipamente elec trice si electronice EEE trebuie colectate separat Si nu trebuie eliminate impreun cu deseurile menajere obisnuite Eliminati acest produs i toate componentele sale in mod responsabil si ecologic Mellanox Technologies 99 E 10 Sigurnosna upozorenja za instaliranje Croatian 1 Upute za instaliranje Pa ljivo pro itajte upute za instaliranje prije spajanja opreme na izvor elektri ne energije 2 Tjelesne ozljede uslijed te ine F Kako biste sigurno podignuli ovaj proizvod koristite dovoljan broj ljudi lt 40 Ibs 40 70 Ibs 70 121 Ibs gt 121 Ibs lt 18 kg 18 32 kg 32 55 kg gt 55 kg 3 Te ka opr
41. 4 11 14 05 39 ppc 3 U Boot prompt Choice 58 Mellanox Technologies Specifications Rev 1 1 6 Specifications 6 1 SX6005 Series Table 20 SX6005 Specifications Feature Value Mechanical Size 1 73 H x 7 9 W 15 7 D 44mm H x 200mm W x 398 8mm D Mounting side by side for 19 rack mount or table top Weight System with 1 PSU 2 98kg 6 571bs System with 2 PSUs 3 2kg 7 051bs Speed 10 40 or 56 Gb s per port Connector cage 12 QSFP Air flow 55 CFM Heat dissipation 573 BTUs hr Environmental Temperature Operational 0 to 45 C Non Operational 40 to 709C Humidity Operational 10 85 non condensing Non Operational 10 90 non condensing Altitude Operational 3050m Power Input Voltage 100 240 VAC 50 60Hz Typical ATIS score under snake topology 38 18 CPU and Switch CPU N A Switch Mellanox SwitchX 2 Switching Capacity 1 34 Tb s non blocking Mellanox Technologies 59 Rev 1 1 Specifications 6 2 SX6012 Series Table 21 SX6012 Specifications Feature Value Mechanical Size 1 73 H x 7 9 W 15 7 D 44mm H x 200mm W x 398 8mm D Mounting side by side for 19 rack mount or table top Weight System with 1 PSU 2 98kg 6 571bs System with 2 PSUs 3 2kg 7 051bs Speed 10 40 or 56 Gb s per port Connector cage 12 QSFP Heat dissipation 573 BTUs hr
42. AC unmanaged short depth C2P airflow Rail Kit RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 18 QSFP ports 1 Power Supply AC unmanaged standard depth P2C airflow Rail Kit RoHS6 SwitchX 2 based FDR 10 InfiniBand 1U Switch 18 OSFP ports 1 Power Supply AC unmanaged short depth C2P airflow Rail Kit RoHS6 Switch X amp 2 based FDR 10 InfiniBand IU Switch 18 QSFP ports 1 Power Supply AC unmanaged standard depth P2C airflow Rail Kit RoHS6 OPN MSX6005F 1BFS MSX6005T 1BFS MSX6012F 1BFS MSX6012F IBRS MSX6012F 2BFS MSX6012F 2BRS MSX6012T 1BFS MSX6012T 2BFS MSX6015F IBRS MSX6015F 1SFS MSX6015T IBRS MSX6015T 1SFS System Model SX6005 SX6012 SX6015 Mellanox Technologies 13 Rev 1 1 Introduction to Mellanox SX60XX Systems Table 5 Ordering Part Numbers OPNs Description SwitchX 2 based FDR InfiniBand 1U Switch 18 QSFP ports 1 Power Supply AC PPC460 short depth C2P airflow Rail Kit RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 18 QSFP ports 1 Power Supply AC PPC460 standard depth P2C airflow Rail Kit RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 18 QSFP ports 2 Power Supplies AC PPC460 standard depth C2P airflow Rail Kit RoHS6 SwitchX 2 based FDR 10 InfiniBand 1U Switch 18 QSFP ports 1 Power Supply AC PPC460 short depth C2P airflow Rail Kit 6 S
43. E POSSIBILITY OF SUCH DAMAGE Mellanox TECHNOLOG ES Mellanox Technologies 350 Oakmead Parkway Suite 100 Sunnyvale CA 94085 U S A www mellanox com Tel 408 970 3400 Fax 408 970 3403 Copyright 2015 Mellanox Technologies All Rights Reserved Mellanox Mellanox logo BridgeX ConnectX Connect IB CoolBox CORE Direct amp GPUDirect InfiniBridge InfiniHost InfiniScale Kotura Kotura logo MetroX MLNX OS PhyX ScalableHPC SwitchX TestX UFM Virtual Protocol Interconnect Voltaire and Voltaire logo are registered trademarks of Mellanox Technologies Ltd CyPUTM ExtendXTM FabricITTM FPGADirectTM HPC XTM Mellanox Care Mellanox CloudX Mellanox NEO Mellanox Open Ethernet Mellanox PeerDirect Mellanox Virtual Modular Switch MetroDX NVMeDirect StPUTM Switch IBTM Unbreakable LinkTM are trademarks of Mellanox Technologies Ltd All other trademarks are property of their respective owners 2 Mellanox Technologies Document Number MLNX 15 4047 Rev 1 1 Table of Contents Revision History se ote a de om uza ekerine 8 About this Manual 9 Chapter Introduction to Mellanox SX60XX Systems 10 1 1 Overview M cundis na reger lan uda a ak OX nr 10 1 2 Speed and Switching eec vs RE V SR ol ala tee ol ER iG 11 1 3 Management Interfaces and FRUSs
44. IDs Mellanox Technologies 53 Software Management 4 3 Upgrading Software on Managed Systems Software and firmware updates are available from the Mellanox Support website Check that your current revision is the same one that is on the Mellanox website If not upgrade your soft ware Copy the update to a known location on a Remote server within the user s LAN Use the CLI or the GUI in order to perform software upgrades For further information please refer to the MLNX OS Software User Manual section Upgrading MLNX OS Software Be sure to read and follow all of the instructions regarding the updating of the software on your system Managed systems do not require Firmware updating Firmware updating is done through the MLNX OS management software The system comes standard with a management software module for system management called Mellanox Operating System MLNX OS MLNX OS is installed on all SwitchX 2 based managed systems MLNX OS includes a CLI WebUI SNMP system management software and IB management software OpenSM The Ethernet ports for remote management connect to Ethernet systems These sys tems must be configured to 100Mb 1 Gb auto negotiation 4 4 Updating Firmware on Externally Managed Systems All firmware updates should be done in band Go to the Mellanox Website and confirm that the firmware is the latest If not reburn the latest firmware from the downloads site New firmware versions wil
45. Mellanox TECHNOLOGIES Mellanox 1U Switch and Gateway Systems Hardware User Manual Models SX6005 SX6012 SX6015 SX6018 SX6025 SX6036 SX6036G Rev 1 2 www mellanox com NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE USE OF THE PRODUCT S AND RELATED DOCUMENTATION EVEN IF ADVISED OF TH
46. X6018F 1SFS MSX6018F 2SRS MSX6018T 1BRS MSX6018T 1SFS MSX6025F 1BRR MSX6025F 1BRS MSX6025F 1SFR MSX6025F 1SFS MSX6025F ISRR MSX6025F 1SRS MSX6025T 1BRS MSX6025T 1SFR MSX6025T 1SFS System Model SX6018 SX6025 14 Mellanox Technologies Introduction to Mellanox SX60XX Systems Rev 1 1 Table 5 Ordering Part Numbers OPNs Description SwitchXQ based FDR InfiniBand Switch 36 ports 1 Power Supply Short depth Managed PSU side to Connector side airflow Rail Kit and RoHS6 Switch X amp based FDR InfiniBand Switch 36 ports 1 Power Supply Short depth Managed Connector side to PSU side airflow Rail Kit and RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 36 OSFP ports 1 Power Supply AC PPC460 short depth C2P airflow Rail Kit RoHS6 SwitchX based FDR InfiniBand Switch 36 QSFP ports 1 Power Supply Standard depth Managed PSU side to Connector side airflow Rail Kit and RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 36 QSFP ports 1 Power Supply AC PPC460 standard depth P2C airflow Rail Kit RoHS6 SwitchX based FDR10 InfiniBand Switch 36 ports 1 Power Supply Short depth Managed Connector side to PSU side airflow Rail Kit and RoHS6 SwitchX 2 based FDR 10 InfiniBand 1U Switch 36 QSFP ports 1 Power Supply AC PPC460 short depth C2P airflow Rail Kit RoHS6 SwitchX
47. agati na drugu opremu Ako ku i te padne mo e izazvati tje lesne ozljede i o te enje opreme 7 Collegamento di alimentazione ridondante Pericoli elettrici Questo prodotto dotato di un alimentatore ridondante o qualora esso non sia installato di uno spazio vuoto Qualora l alimentatore non sia installato non utilizzare il prodotto con il coperchio rimosso o non fissato correttamente 8 Prese di alimentazione multiple Rischio e pericolo di scosse elettriche Gli alimentatori sono tutti indipendenti Scollegare tutti gli alimentatori per assicurarsi che il commutatore non sia sotto tensione 9 Durante i temporali pericolo di scosse elettriche Durante i temporali non effettuare interventi sull apparecchiatura e non collegare o scollegare i cavi 10 Collegamento scollegamento del cavo di rame InfiniBand I cavi di rame InfiniBand sono pesanti e non flessibili Di conseguenza vanno collegati o scollegati con cura dai connettori Per avvertenze istruzioni speciali rivolgersi al produttore di cavi 104 Mellanox Technologies Rev 1 1 11 Montaggio su rack e manutenzione Ouando questo prodotto viene montato 0 sottoposto a manutenzione su un rack 6 necessario adottare delle precauzioni speciali per assicurarsi che il sistema resti stabile In generale il rack va riempito con apparecchiature procedendo dal basso verso l alto 12 Installazione dell apparecchiatura Questa appare
48. agers habituels Ce produit et toutes ses pi ces doivent tre mis au rebut d une mani re responsable respectant l environnement E 21 Restrictions concernant l alimentation pour la Norv ge Cet appareil est pr vu pour tre reli un syst me d alimentation TN et un syst me d alimentation informatique de Norv ge uniquement 6 Installation Sicherheitshinweise German 1 Installationsanleitungen Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die Stromversorgung anschlieBen 86 Mellanox Technologies Rev 1 1 2 Verletzungsgefahr wegen des Gewichts IN Um das Produkt sicher anzuheben gen gend Personen einsetzen lt 40 lbs 40 70 lbs 70 121 16 gt 121 Ibs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Schweres Ger t Dieses Ger t ist schwer und muss mit einem mechanischen Hebeger t verschoben werden um Verletzungen zu vermeiden 4 Stromschlagrisiko Stromschlagrisiko L Bei abgenommenem Ventilatormodul sind die Stromkontakte in der Modulvertiefung zug nglich Es d rfen KEINE Werkzeuge oder K rperteile in die Vertiefung des Ventilatormoduls gelangen 5 bertemperatur IN Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von 45 C 113 F betrieben werden Es ist ein Luft strom von 200 LFM bei maximaler Umgebungstemperatur erforderlich Au erdem sollten mindestens 8 cm 3 in Freiraum u
49. amming the System Through The 26 Port This interface is for Debug and Troubleshooting only This interface is for FAEs and advanced users only 4 The I2C connector should only be used when the firmware cannot be updated in band A lt Use the MTUSB 1 adapter available from Mellanox to reprogram the system firmware using a server or PC running MFT Figure 34 MTUSB 1 with Cables The MTUSB adapter comes with three cables but has only two connections for cables One cable is an I2C cable with DB9 female connectors on both ends One cable is a I2C cable with DB9 female connector to RJ 45 male Use the cable that matches your system The other is a USB cable with one type A host connection to be connected to the server or PC and a type B con nection to be connected to the MTUSB adapter Figure 35 I2C Cable Connected to SX6025 With the system connected to a computer through the MTUSB it is now possible to reprogram the SPI Flash memory Mellanox Technologies 55 Software Management 4 4 2 1 Instructions for Reprogramming Through the 26 Port Step 1 Make sure that the MTUSB I2C cable is connected to the system and USB cable is connected to a com puter MFT is running on the computer mtusb 1 mst device appears in mst status Step 2 Open the bus by running the unlock command gt 120 dev mst mtusb 1 w 0x22 Oxla Oxfb Step 3 Open 0X48 by running the following command gt i2c dev mst mtusb 1 0x70 0
50. anel eves re cota Ia iz eS RE MER bare eng ALERT AUR 49 Figur 32 Port CEDS aan bi re aerosol eS NES 51 Figure 33 Tab ur act san be kl mea 0 ine ll 52 Figure 34 MTUSB 1 with Cables 55 Figure 35 I2C Cable Connected to SX6025 55 Figure 36 Connector Male and Female Views 69 Mellanox Technologies 5 Figure 37 RJ45 to DB9 Harness Pinout 71 6 Mellanox Technologies Rev 1 1 List of Tables Table 1 RevisionHistoryTable aa 8 Tabl 2 References un Ee ea uq aaa pave Ft Dt Ai a fele te ae 9 Table 3 Speed and Switching Capabilities 11 Table 4 Management Interfaces and FRUs 12 Table 5 Ordering Part Numbers OPNs 13 Table 6 Air Flow Label Legend 4 4 22 17 Table 7 Installation Kit Options 20 Table 8 Port Splitting Options 34 Table 9 Serial Terminal Program Configuration 37 Table 10 Configuration Wizard Session DHCP 38 Table 11 Configuration
51. anger d lectrocution Danger d lectrocution 4 Lorsque le module de ventilation est retir les broches d alimentation sont expos es dans l emplacement du module NE PAS ins rer d outils ou la main dans l emplacement du module 5 Surchauffe Cet quipement ne doit pas tre en service dans un local dont la temp rature d passe le maximum recommand de 45 C 113 F En outre et pour garantir une circulation d air correcte laisser un espace d au moins 8 cm 3 autour des orifices de ventilation 6 Ch ssis empil sur d autres quipements Le ch ssis ne doit pas amp tre empil sur d autres quipements S il tombe il peut endom mager l quipement ou entrainer des blessures 7 Connexion de l alimentation redondante danger d lectrocution Ce produit est quip d une alimentation redondante ou d un cache si elle est absente Dans ce dernier cas ne pas faire fonctionner le produit si le cache est retir ou mal fix 8 Plusieurs prises d alimentation Risque et danger d lectrocution Les alimentations sont toutes ind pendantes Pour s assurer que le commutateur est bien hors tension d branchez toutes les alimen tations 9 En cas d orage danger d lectrocution Pendant un orage ne pas travailler sur l quipement ni brancher ou d brancher des c bles 10 Connexion et d connexion du c ble InfiniBand en cuivre Les c bles InfiniBand en cuivre sont lourds et peu flexibles Par cons
52. anox Technologies 37 Login as admin and use admin as password On the first login the MLNX OS configuration wizard will start To configure network attributes and other initial parameters to the system follow the configu ration wizard as shown in Table 10 Table 10 Configuration Wizard Session DHCP Comments You must perform this configuration the first time you operate the system or after resetting the system Type and then press lt gt If you wish to accept the default hostname press lt Enter gt Other wise type a different hostname and press lt Enter gt Perform this step to obtain an IP address for the system mgmt0 is the management port of the system If you wish the DHCP server to assign the IP address type yes and press lt Enter gt If you type no DHCP then you will be asked whether you wish to use the zeroconf configuration or not If you enter no no Zeroconf you must enter a static IP and the session will continue The management interface will be able to use IPv6 addresses This turns on auto configuration of the IPv6 addresses This is unsuitable for DHCPv6 If you enter no no IPv6 you will automatically be referred to Step 6 To enable DHCPv6 on the MGMTO interface To avoid illegal access to the machine please type a password and then press Enter Then confirm the password by re entering it No
53. at conform codurilor electrice locale si nationale 98 Mellanox Technologies Rev 1 1 15 Codurile ed instalare Acest dispozitiv trebuie s fie instalat n conformitate cu ultima versiune a codurilor electrice nationale ale rii n cauz Pentru America de Nord echipamentul trebuie s fie instalat conform cerin elor aplicabile din Codul electric na ional al SUA i Codul electric canadian 16 Cordon de alimentare electric nregistrat UL i certificat CSA N Pentru conectarea la o surs de alimentare pentru America de Nord selectati un cordon de alimentare care este nregistrat UL si certificat CSA cu 3 conductoare 16 AWG terminat cu o fi turnat cu putere nominal egal cu 125 V 13 A cu o lungime de SS minimum 1 5 m sase picioare dar nu mai lung de 4 5 m Pentru conectarea la o surs de alimentare in Europa selectati un cordon de alimentare care este armonizat la nivel international i marcat lt HAR gt cu 3 conductoare cu minimum 2 fire de 1 0 mm cu putere nominala egala cu 300 V si cu o manta izolanta din PVC Cordonul de alimentare trebuie sa fie prevazut cu o fisa turnata cu putere nominala egala cu 250 V 10 A 17 Curent de scurgere de inalt frecventa Avertisment Curent de scurgere de inalt frecventa Imp m ntarea este esential inainte de a conecta sursa de alimentare 18 Interconectarea unitatilor N Cablurile pentru conectarea la unitatea RS2
54. ata Gta yasi k eg ee ee reas 64 6 7 SX0036G Series asso rinde 65 Appendix A Accessory and Replacement Parts 66 Appendix B Thermal Threshold Definitions 67 Appendix C Interface Specifications 68 CL OSEP Interface x i se a S tamya 68 C2 RJ 45CONSOLEandI2CMterface 70 C 3 RJ45 to DB9 Harness Pinout 71 Appendix D Disassembly and Disposal 72 D 1 Disassembly Procedure 72 D2 Disposal sa ee Eel ERI DEN eb ILE 72 Appendix E Safety Warnings Multiple Languages 73 E 1 NordicCountriesNotices 73 E 2 Installation Safety Warnings English 73 decre 76 E 3 EA Chinese 80 E 5 Avertissements de s curit pour l installation French 83 E 6 Installation Sicherheitshinweise German 86 EJ Advertencias de seguridad de instalaci n Spanish 90 E 8 Russian 93 E 9 Avertismente privind siguran a la instalare Romania
55. banana connector or on the front side RJ45 connector The I2C interface is used for debugging and is intended for Mellanox debug person nel only 3 1 6 Reset Button The reset button is located on the front side panel under the status LEDs This reset button reguires a tool to be pressed DO NOT use a sharp pointed object such as a needle or a push pin for pressing the Reset button Use a flat object to push the reset button gt To reset the system and the CPU of its management board perform the following Push the Resetr button and keep it pressed for up to 14 seconds gt To reset the system the CPU of its management board and the admin password perform the following Push the Reset button and keep it pressed for at least 15 seconds You will then be able to enter without a password and set a new password for the user admin In the externally managed systems the reset button resets the device 3 2 LEDs 3 2 1 LED Notifications The system s LEDs are an important tool for hardware event notification and troubleshooting Mellanox systems have two types of LEDs Status LEDs Port LEDs The Status LEDs are located to the left side of the front panel and on the power side at the far right The port LEDs are located on top of the data ports see Section 3 2 46 Mellanox Technologies Interfaces Rev 1 1 Table 12 Status LEDs Symbol Name Description Normal Conditions System Status LED Sho
56. based FDR10 InfiniBand Switch 36 ports 1 Power Supply Stan dard depth Managed PSU side to Connector side airflow Rail Kit and RoHS6 SwitchX 2 based FDR 10 InfiniBand 1U Switch 36 QSFP ports 1 Power Supply AC PPC460 standard depth P2C airflow Rail Kit RoHS6 SwitchX 2 based InfiniBand to Ethernet 1U gateway 36 QSFP ports 2 Power Supplies AC PPC460 short depth P2C airflow Rail Kit RoHS6 SwitchX 2 based InfiniBand to Ethernet 1U gateway 36 QSFP ports 2 Power Supplies AC PPC460 standard depth P2C airflow Rail Kit RoHS6 Switch X 2 based InfiniBand to Ethernet 1U gateway 36 QSFP ports 2 Power Supplies AC PPC460 standard depth C2P airflow Rail Kit RoHS6 OPN MSX6036F 1BFR MSX6036F 1BRR MSX6036F 1BRS MSX6036F 1SFR MSX6036F 1SFS MSX6036T 1BRR MSX6036T 1BRS MSX6036T 1SFR MSX6036T 1SFS MSX6036G 2BFS MSX6036G 2SFS MSX6036G 2SRS System Model SX6036 SX6036G Mellanox Technologies 15 Rev 1 1 Installation 2 Installation Installation and initialization of the system require attention to the normal mechanical power and thermal precautions for rack mounted eguipment The rack mounting holes conform to the ETA 310 standard for 19 inch racks Take precautions to guarantee proper ventilation in order to maintain good airflow at ambi ent temperature gt The installation procedure for t
57. cchiatura va installata sostituita e o sottoposta a manutenzione solo da personale addestrato e qualificato 13 Smaltimento dell apparecchiatura Lo smaltimento di questa apparecchiatura va effettuato in conformit con tutte le leggi e le normative nazionali 14 Codici elettrici locali e nazionali Questa apparecchiatura va installata in conformit con le norme elettriche locali e nazionali 15 Codici di installazione Questo dispositivo va installato in conformit con l ultima versione dei codici elettrici nazionali del Paese Per il Nord America l apparecchiatura va installata in conformit con 1 requisiti applicabili del codice elettrico nazionale USA e del codice elettrico canadese 16 Cavo di alimentazione UL e munito di certificazione CSA Per una connessione di alimentazione nordamericana selezionare un cavo di alimentazione di tipo UL e munito di certificazione CSA a 3 conduttori 16 AWG terminato con una spina stampata con tensione nominale pari a 125 V 13 A di lunghezza minima pari a 1 5 m sei piedi ma non piu lunga di 4 5 m Per una connessione europea selezionare un cavo di alimentazione armonizzato a livello internazionale e contrassegnato da lt HAR gt a 3 conduttori minimo 1 0 mm2 fili con guaina isolante in PVC Il cavo deve disporre di una spina stampata di potenza nominale pari a 250 V 10 A 17 Corrente di dispersione elevata Avvertenza corrente di dispersi
58. e RAR A dabas RAR en 70 Mellanox Technologies 7 Revision History Table 1 Revision History Table Date Revision Description June 2015 1 2 Added Hebrew safety warnings Added Japan VCCI Statement Updated Specifications Updated Mounting Options January 2015 1 1 Minor formatting edits January 2015 1 0 First release of the new edition 8 Mellanox Technologies Rev 1 1 About this Manual This manual describes the installation and basic use of the Mellanox InfiniBand V PI systems Intended Audience This manual is intended for 11 managers and system administrators References Table 2 References Document Description SwitchX Switch System For possible hardware issues see the switch support product page This docu Hardware Release Notes ment can be found on the support web page for this product MLNX OS User Manual This document contains information regarding configuring and managing MLNX OS software see http www mellanox com page mlnx os Conventions The following icons are used throughout this document to indicate information that 1s important to the user Y This icon makes recommendations to the user gt This icon indicates information that is helpful to the user gt This icon indicates a situation that can potentially cause personal injury or damage to hardware or software Risk of electric shock Mellanox Technologies 9 Rev 1
59. ear SX6018 Front 2 Front x2 Rear Front 2 FRUs 1 FRU SX6025 N A N A N A Front N A 2 FRUs I FRU Rear SX6036 Front 2 Front 2 Rear Front 2 FRUs 1 FRU SX6036G Front 2 Front 2 Rear Front 2 FRUs 1 FRU 1 4 Features 1 4 1 Network Management Feature For a full feature list refer to the product brief of the relevant system System USB Model SX6005 http www mellanox com related docs prod ib switch systems PB SX6005 pdf SX6012 http www mellanox com related docs prod ib switch systems PB SX6012 pdf SX6015 http www mellanox com related docs prod ib switch systems PB SX6015 pdf SX6018 http www mellanox com related docs prod ib switch systems PB SX6018 pdf SX6025 http www mellanox com related docs prod ib switch systems PB SX6025 pdf SX6036 http www mellanox com related docs prod ib switch systems PB SX6036 pdf SX6036G http www mellanox com related docs prod gateway systems PB SX6036G pdf 1 5 Certifications The list of certifications such as EMC Safety and others per system for different regions of the world is located on the Mellanox website at http www mellanox com page environmental_compliance 12 Mellanox Technologies Introduction to Mellanox SX60XX Systems Rev 1 1 1 6 Ordering Information the following table lists ordering information for the available systems Please pay attention to the airflow direction when ordering your system For more details see Air Flow on page 17
60. ed to or detached from the connectors Refer to the cable manufacturer for spe cial warnings instructions 11 Rack Mounting and Servicing When this product is mounted or serviced in a rack special precautions must be taken to ensure that the system remains stable In general you should fill the rack with equip ment starting from the bottom to the top 12 Equipment Installation This equipment should be installed replaced and or serviced only by trained and qual ified personnel 74 Mellanox Technologies Rev 1 1 5 13 Equipment Disposal Disposal of this eguipment should be in accordance to all national laws and regula tions This equipment should be installed in compliance with local and national electrical codes 15 UL Listed and CSA Certified Power Supply Cord For North American power connection select a power supply cord that is UL Listed and CSA Certified 3 conductor 16 AWG terminated with a molded plug rated at 125 V 13 A with a minimum length of 1 5m six feet but no longer than 4 5m For European connection select a power supply cord that is internationally harmonized and marked lt HAR gt 3 conductor minimum 1 0 mm wire rated at 300 V with a PVC insulated jacket The cord must have a molded plug rated at 250 V 10 A 7 16 Installation codes This device must be installed according to the latest version of the country national electrical codes For
61. ema Ova oprema je vrlo te ka i treba se premje tati pomo u mehani kog dizala kako bi se izbjegle ozljede 4 Rizik od strujnog udara Rizik od strujnog udara 4 S uklonjenim modulom ventilatora perima napajanja se mo e pristupiti u otvoru mod ula NEMOJTE umetati alat ili dijelove tijela u otvor modula ventilatora 5 Pregrijavanje A Ovom se opremom ne bi trebalo rukovati u podru jima s temperaturom okoline koja y N prema uje najvi e preporu ene vrijednosti 45 C 113 F Osim toga kako bi se osigu rao odgovaraju i protok zraka omogu ite najmanje 8 cm 3 in a razmaka oko otvora ventilatora 6 Slaganje ku i ta Ku i te se ne bi trebalo slagati na drugu opremu Ako ku i te padne mo e izazvati tje lesne ozljede i o te enje opreme 100 Mellanox Technologies Rev 1 1 7 Redundantno napajanje Opasnost od elektri ne energije Ovaj proizvod uklju uje redundantno napajanje ili prazan prostor na njegovu mjestu U slu aju praznog prostora za napajanje nemojte rukovati proizvodom ako je pok lopac uklonjen ili ako nije dobro pri vr en 8 Vi estruki ulazi za napajanje Rizik od strujnog udara i opasnost od elektri ne energije PSU jedinice su neovisne Odspojite sva napajanja kako biste osigurali stanje bez napajanja unutar platforme preklopnika 9 Tijekom udara munje Opasnost od elektri ne energije Tijekom djelovanja munja nemojte raditi na opremi ili spajati il
62. ep 6 Tighten the capture nuts Step 7 Install the blank panel into the frame opposite the system or install a second system Step 8 Tighten the capture nuts Step 9 Tighten all ten screws The recommended screw torque is 3 5 0 3 Nm 2 4 3 Table Top This section is relevant to short depth systems that allow such form of installation only Included in the box is a bag with 4 rubber stick on feet for table top installation gt Table Top Installation Step 1 Peel and stick the four rubber bumpers into the bottom of the system Place them in the round circles Mellanox Technologies 29 Rev 1 1 Installation Figure 18 Placing the Bumpers Bottom of the system Step2 Place 8 1181 surface Make sure the system sits solid on the surface Step 3 Connect the power cord Step 4 Connect the data transfer cables 30 Mellanox Technologies Installation Rev 1 1 2 5 Grounding Check to determine if your local or national electrical codes require an external ground to all IT components If so connect a ground wire to one of the casing screws and connect the other end to a valid ground If you choose to not use the ground screw make sure that the rack is properly grounded and that there is a valid ground connection between the chassis of the system and the rack Test the ground using an Ohm meter ZA nally grounded not including the power cord ground You must follow all national 4 Some national a
63. epresenta tive for assistance Off The system has no power Check the power source and cable 3 2 1 2 Fan Status LED All fans must be operating while the power supply is plugged in Figure 29 Fan Status LED Front and Hear sides AN Mellanox TECHNOLOG ES Thisisatwo color LED Table 14 Fan Status LED Assignments LED Behavior Description Action Required Solid Green All fans are up and running normal N A condition 48 Mellanox Technologies Interfaces Rev 1 1 Table 14 Fan Status LED Assignments LED eT a a Behavior Description Action Required Solid Red Error one or more fans is not oper In case there is an FRU the module should be replaced Oth ating properiy erwise the system should be replaced Off The fan unit is not receiving any Check that the fan unit is properly and completely inserted power Risk of Electric Shock da With the fan module removed power pins are accessible within the module cavity DO NOT insert tools or body parts into the fan module cavity 3 2 1 3 Power Supply Status LEDs Figure 30 Power Status LED There are two power supply inlets in the system for redundancy The system can operate with only one power supply connected In case the power supply is an FRU a second power supply unit can be added to support hot swap ability Each power supply unit has a single 2 color LED
64. erel ve Ulusal Elektrik Kodlar Bu ekipman n montaj nda yerel ve ulusal elektrik kodlar na uyulmas gerekir 15 Montaj Kodlar Bu cihaz n lke ulusal elektrik kodlar n n son s r m ne g re monte edilmesi gerekir Kuzey Amerika i in ekipman n ABD Ulusal Elektrik Kodu ve Kanada Elektrik Kodu nun uygulama ko ullar na g re monte edilmesi gerekir 16 UL Kay tl ve CSA Onayl G Kayna Kablosu Kuzey Amerika da g ba lant s i in UL Kay tl ve CSA Onayl bir g kayna kablosu se in 3 iletken 16 AWG 125 V de erinde kal planm bir fi le biten 13 A en az 1 5 m alt fit uzunlu unda fakat 4 5 m den uzun olmayan bir kablo Avrupa da g ba lant s i in uluslararas uyumlu ve lt HAR gt i aretli 3 iletken en az 1 0 mmo tel 300 V de erinde ve PVC yal t ml bir g kayna kablosu se in Kablonun 250 V 10 A de erinde bir kal planm fi i olmas gerekmektedir 17 Y ksek Ka ak Ak m Uyary Y ksek ka ak ak m varsa g kayna na ba lanmadan nce mutlaka toprak lama ba lant s yap lmal d r 18 nitelerin Ara Ba lant s RS232 nitesini ve Ethernet Arabirimlerini ba layacak olan kablolar n UL onayl veya DP 2 tipi olmas gerekir Not LPS olmayan devreye aitse A r Ak m Korumas Kolayca eri ilebilecek 20 V Kay tl devre par as a r ak m koruma cihaz n n bina elektrik ebekesinde
65. es Rev 1 1 E 12 Montaj G venlik Uyar lar T rk e 1 Montaj Talimatlar Ekipman g kayna na ba lamadan nce t m montaj talimatlar n okuyun 2 A rl k Nedeniyle Fiziksel Yaralanma N Bu r n g venli bir ekilde kald rabilmek i in yeterli say da insandan yard m al n A lt 40 lbs 40 70 lbs 70 121 lbs gt 121 lbs lt 18 kg 18 32 kg 32 55 kg gt 55 kg 3 A r Ekipman Bu ekipman ok a rd r ve yaralanmalar nlemek i in ekipman n mekanik asans r kullan larak ta nmas gerekir 4 Elektrik arpmas Riski Bu ekipman nerilen maksimum ortam s cakl n a an alanlarda calistirilmamalidir 45 113 F Ayr ca d zg n hava ak sa lamak i in havaland rma deliklerinin etraf nda en az 8 cm 3 in a kl k b rak lmal d r 5 A r s nma 4 Bu ekipman nerilen maksimum ortam s cakl n a an alanlarda al t r lmamal d r 45 C 113 F Ayr ca d zg n hava ak sa lamak i in havaland rma deliklerinin etraf nda en az 8 cm 3 in a kl k b rak lmal d r 6 asi stif asinin di er herhangi bir ekipman n zerine istiflenmemesi gerekir asi d erse fiziksel yaralanmalara ve ekipmanda hasara neden olabilir Mellanox Technologies 107 7 Yedekli G Kayna y Ba lantysy Elektrik arpma Tehlikesi Bu r n yedekli g kayna veya onun
66. es on the side of the rack you will slide the system into This is the same side of the system that will be next to the vertical support 22 Mellanox Technologies Installation Rev 1 1 Figure 8 Installing the Slides Step 6 Slide the system into the rails Step 7 Place the system and screw the bolts into the nuts Tighten the bolts to 4 5 0 5 Nm Mellanox Technologies 23 Rev 1 1 Installation Figure 9 System Placement in the Rack Figure 10 Installation Completed 24 Mellanox Technologies Installation Rev 1 1 2 4 2 Side by Side This section is relevant to short depth systems that allow such form of installation only 4 SX6005 and SX6012 do not include installation kit in the package The side by side installation kit must be ordered separately The order number is MSX60 DKIT Installation kit parts for a side by side installation Two system metal frame 2 frame rail slides 4 system mounting rails The kit contains 10 M 5 Pan head screws enough rails to install 2 systems 24 flat head screws The kit contains blank cover enough screws to install 2 systems 10 spacer bushing for frame installation 4 rubber stick on feet Not used for side by side installation The installation kits come with enough system mounted rails and flat head screws to install two systems The 2 system frames will fit into racks with from 21 533mm to 34 864mm between the ver
67. g and remove all connectors 2 Unplug all power cords 3 Remove the ground wire 4 Unscrew the center bolts from the side of the system with the bracket Support the weight of the system when you remove the screws so that the system does not fall 5 Slide the system from the rack 6 Remove the rail slides from the rack 7 Remove the caged nuts D 2 Disposal According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE should be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way Follow the instructions found at http www mellanox com page dismantling procedures for proper disassembly and disposal of the switch according to the WEEE directive 72 Mellanox Technologies Rev 1 1 Appendix Safety Warnings Multiple Languages E 1 Nordic Countries Notices i In Finland Laite on liitett v suojakoskettimilla varustettuun pistorasiaan Y N In Norway Apparatet m tilkoples jordet stikkontakt In Sweden Apparaten skall anslutas till jordat uttag E 2 Installation Safety Warnings English 1 Installation Instructions Read all installation instructions before connecting the equipment to the power source 2 Bodily Injury Due to Weight Use enough people to safely lift this product 3 Heavy Equipment This equipment is
68. g this feature you should login into the MLNX OSQ CLI and configure the individual ports to be split 2 or split 4 For further information and guidance it is recommended to read more about Mellanox breakout cables on the Mellanox Community Website 32 Mellanox Technologies Installation Rev 1 1 Figure 20 Breakout or Fanout Cable Y 2 6 1 1 SX6012 In this switch all ports can be split to 4x10GbE no limitation 2 6 1 2 SX6018 Figure 21 SX6018 Port Splitting Options This port can be split into 4 10Gb s SFP This port can be split into 2 10Gb s SFP Mellanox Technologies 33 Rev 1 1 Installation Figure 22 6036 G Port Splitting Options 2 6 1 3 SX6036 G Can be split to2 Ann The maximum 10 Gb s Ethernet ports configurable with this switch is 64 Can be split to 4 Yes disables port 19 Yes disables port 24 Yes disables port 30 Yes disables port 25 Yes disables port 31 Yes disables port 36 Port Can be split to2 Table 8 Port Splitting Options Can be split to 4 Yes disables port 1 Yes disables port 6 Yes disables port 12 Yes disables port 7 Yes disables port 13 Yes disables port 18 Port N 34 Mellanox Technologies Installation Rev 1 1 Examples of Port Mapping Assignml nitial Power On The system s input vo
69. gt 18 m sa pa MINI Ethernet RS232 UL DP 1 non DP 2 mo 19 PALI DYSON NIN 20A 20 PN PN Now 2 21 WEEE x WEEE 2002 96 EC 22 TN IT Mellanox Technologies 79 EA Chinese 1
70. he Metrox system involves the following phases 1 Follow the safety warnings in Section E 2 Installation Safety Warnings English on page 73 2 attention to the air flow consideration within the system and rack refer to Air Flow on page 17 3 Make sure that none of the package contents is missing or damaged see Package Contents on page 19 4 Mount the system to the rack see Mounting Options on page 20 5 Groundthe system refer to Grounding on page 31 6 Power on the system refer to Examples of Port Mapping Assignmlnitial Power On on page 35 7 Perform system bring up see System Bring Up on page 37 FRU replacements are described in Section 2 9 on page 41 2 1 Safety Warnings Prior to the installation please review the safety warnings as follows For Nordic Countries Notices see Section E 1 Nordic Countries Notices on page 73 For Safety Warnings in English see Section E 2 Installation Safety Warnings English on page 73 For Safety Warnings in Hebrew see Section E 3 on page 76 For Safety Warnings in Chinese see page 80 For Safety Warnings in French see Section E 5 Avertissements de s curit pour l installation French on page 83 For Safety Warnings in German Section E 6 Installation Sicherheitshinweise German on page 86 For Safety Warnings in Spanish see Section E 7 Ad
71. he power supply unit Mellanox Technologies 41 Rev 1 1 Installation Figure 25 Power Supply Unit Extraction Push Here min Latch release Figure 26 PS Unit Pulled Out gt Toinserta power suppiy unit Step 1 sure the mating connector of the new unit is free of any dirt and or obstacles Do not attempt to insert a power supply unit with a power cord connected to it Step 2 Insert the power supply unit by sliding it into the opening until a slight resistance is felt Step3 Continue pressing the power supply unit until it seats completely The latch will snap into place confirming the proper installation Step 4 Insert the power cord into the supply connector Step 5 Insert the other end of the power cord into an outlet of the correct voltage The green power supply unit indicator should light If not repeat the whole procedure to extract the power supply unit and re insert it 42 Mellanox Technologies Installation Rev 1 1 2 9 1 2 Fan The system can operate indefinitely with less than a full compliment of fans in the fan modules so long as the ambient temperature is below 45 Celsius Operation without a fan unit should not exceed two minutes During fan hot swap if the LED indicator is OFF the fan unit is disconnected Make sure that the fans have the air flow that matches the model number An air flow opposite to the system design will cause the system
72. i odspajati kabele 10 Spajanje Odspajanje bakrenog kabela InfiniBand Bakreni kabeli InfiniBand su te ki 1 nesavitljivi i kao takvi se moraju pa ljivo prikl ju iti na ili isklju iti iz konektora Obratite se proizvo a u kabela za posebna upo zorenja upute 11 Monta a ormari a i servisiranje Kad se proizvod montira ili se servisira u ormari u moraju se poduzeti posebne mjere opreza kako bi se osiguralo da sustav ostane stabilan Op enito trebali biste ispunja vati ormari s opremom po ev i od dna prema vrhu Ovu bi opremu trebalo instalirati zamjenjivati i ili servisirati samo obu eno i kvalifici rano osoblje 13 Odlaganje opreme y N Odlaganje opreme trebalo bi se vr iti sukladno nacionalnim zakonima i propisima N Mellanox Technologies 101 14 Lokalni i nacionalni elektri ni kodovi Ova oprema trebala bi se instalirati u skladu s lokalnim i nacionalnim elektri nim kodovima 15 Instalacijski kodovi Ovaj se ure aj mora instalirati sukladno najnovijoj verziji nacionalnih elek tri nih kodova dr ave U Sjevernoj Americi oprema se mora instalirati suk ladno va e im zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code 16 UL CSA kabel napajanja Za sjevernoameri ku mre u odaberite kabel napajanja koji je na UL listi 1 sa CSA certifikatom 3 ilni 16 AWG 16 AWG koji zavr ava lijevanim uti ka em nazivnog napona od 125 V 13 A minimalne du
73. instalar conforme a la versi n m s reciente de los c digos el ctricos nacionales del pa s en cuesti n En Am rica del Norte el equipo se debe instalar de acuerdo con las disposiciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad 16 Cable de alimentaci n homologado por UL y con certificaci n CSA En conexiones de Am rica del Norte seleccionar un cable de alimentaci n homologado por UL y con certificaci n CSA de tres conductores 16 AWG termi nado en un enchufe moldeado con capuch n de 125 voltios nominal 13 A con una longitud m nima de 1 5 metros pero no m s de 4 5 metros En conexiones europeas seleccionar un cable de alimentaci n armonizado internacionalmente y marcado lt HAR gt de tres conductores hilo de 1 0 mm2 como m nimo 300 voltios nominal con cobertura protectora aislante de PVC El cable debe tener un enchufe moldeado con capuch n de 250 voltios nominal 10 A 17 Alta corriente de fuga ADVERTENCIA Alta corriente de fuga Es esencial efectuar la conexi n a tierra antes de conectar la alimentaci n 18 C digos de instalaci n Este dispositivo se debe instalar conforme a la versi n m s reciente de los c digos el ctricos nacionales del pa s en cuesti n En Am rica del Norte el equipo se debe instalar de acuerdo con las disposiciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad 19
74. ion state Warning Critical and Emergency 1 Warning 105C On managed systems only When the SwitchXG device crosses the 100C threshold a Warning Threshold message will be issued by the MLNX OS management SW indicating to system administration that the switch has crossed the Warning threshold Note that this temperature threshold does not require nor lead to any action by hardware such as switch shutdown 2 Critical 120C When the SwitchX device crosses this temperature the firmware will automatically shut down the device 3 Emergency 130C In case the firmware fails to shut down the SwitchX device upon crossing the Critical thresh old the Switch X device will auto shutdown upon crossing the Emergency 130C threshold Mellanox Technologies 67 Rev 1 1 Appendix C Interface Specifications 6 1 QSFP Interface Ono Signal Description Pin Number Pin Name 1 GND Ground 2 Tx2n Transmitter Inverted Data Input 3 Tx2p Transmitter Non Inverted Data Input 4 GND Ground J3 and J6 5 Tx4n Transmitter Inverted Data Input 20 SUE cnp SSE 6 Tx4p Transmitter Non Inverted Data Input 21 Rxin 18 gt 7 GND Ground 22 Rx2p Rxtp 17 8 ModSelL Module Select ENS eno 9 ResetL Module Reset EE EM 10 13 3 V Power supply receiver Er Da ima 13 11 SCL 2 wire serial interface clock 27 12 12 SDA 2 wire serial i
75. iption Designation R Connector side inlet to power side outlet Red labels are placed on the power inlet side Mellanox Technologies 17 Rev 1 1 Installation Table 6 Air Flow Label Legend Direction Label PES Description Designation F Power side inlet to connec tor side outlet Blue labels are placed on the power inlet side Figure 2 Air Flow Direction Marking Connector Side Inlet to Power Side Outlet IN LIT LLI Ili olgu ne nimii m H ll Hillu LL LLLLEL W Figure 3 Air Flow Direction Marking Power Side Inlet to Connector Side Outlet QUE WI LL LL LL LE EL LES The rear view shown in the above figures does not apply 0 2 18 Mellanox Technologies Installation Rev 1 1 2 3 Package Contents Before installing your new system unpack the system and check against the parts list below that all the parts have been sent Check the parts for visible damage that may have occurred during shipping The SX60XX package content is as follows 1 System Rail kit not applicable for half width systems lor2 according to order Power cables Type C13 to C14 length 183cm 1 Harness DB9 to RJ 45 applicable for managed systems only 1 Quick Start Guide If anything is damaged m
76. issing contact your sales representative at support mella nox com Mellanox Technologies 19 Rev 1 1 Installation 2 4 Mounting Options 2 4 1 19 Systems Mounting This section is applicable for 197 systems There are two installation kit options standard and short Standard depth systems should be mounted using the standard rail kit short systems can be mounted using either of the rail kits Table 7 Installation Kit Options Kit OPN Rack Size MSX60 BKIT 40 60 cm deep Short MSX60 SKIT 60 80 cm deep Standard The following parts are included in the rail kit rack see Figure 4 Two rails Two rail slides Two system slides 16 recessed flat head 6 32 screws with extras 10 caged nuts 10 pan head M6 screw bolts Figure 4 Rack Rail Kit Parts System slide x2 Rail x2 Rail slide x2 nus and bolts 11111 T Installation Rev 1 1 gt Planning the system s placement in the rack Before mounting the system to the rack select the way you wish to place the system Pay atten tion to the airflow within the rack cooling connector and cabling options While planning how to place the system review the following points Make sure the system air flow is compatible with your installation selection It is important to keep the airflow within the rack in the same direction Incase there are cables that can
77. kurulu olmas gerekir 19 Anahtar Raf veya al ma Alan olarak kullanmayinl Dikkat S rg l rayl ekipman raf veya al ma alan olarak kullan lamaz Raylar niteyi iskeleden uza a kayd rmak i in yap lmam t r Sadece ekipman n son olarak duraca yerdeki kal c montaj i indir servis veya bak m i in kullan lamaz Mellanox Technologies 20 WEEE Y nergesi WEEE Y nergesi 2002 96 EC uyar nca t m elektrikli ve elektronik ekipman at klar EEE ayr olarak toplanmal ve evsel at klarla birlikte pe at lmamal d r x Bu r n ve t m par alar evreye dost ve sorumlu bir ekilde imha edilmelidir gt 21 Norve G K s tlamalar ZA Bu nite bir TN g sistemine ve sadece Norve in TT g sistemine ba lanmak i indir 22 Japan VCCI Statement gt COREK 2 2 A CI 024 RER TEATS 5 CICESE TOBAKCIHMERE TMT 6 5 118 201503 VCCI A 110 Mellanox Technologies
78. l be posted on the Mellanox firmware download page http www mellanox com supportdownloader Access to this page requires a login name and password You will need the Mellanox Firmware Tools package to update firmware for this system It can also be downloaded from http www mellanox com page management tools You will also need to download and unzip the firmware binary image Go to http www mella nox com supportdownloader and select SwitchX 2 systems Click in the Table for the firm ware image that you need In order to get information regarding the externally managed system you must download the Mellanox MFT tools from http www mellanox com page management tools Select and download the release that matches your system Follow the instructions in the User Manual http www mellanox com pdf MFT MFT user manual pdf to get the tools 4 4 1 Obtaining the Current Firmware version In order to obtain the firmware version of the externally managed system 1 Run the following command from a host flint d lid number qq 2 Compare the results of this command with the latest version for your system posted on http www mellanox com supportdownloader select the SwitchX SwitchX 2 System page 3 If the current version is not the latest version follow the directions in the MFT User manual to burn the new firmware inband 54 Mellanox Technologies Software Management Rev 1 1 4 4 2 Reprogr
79. limentaci n son independientes Desconecte todas las fuentes de alimentaci n para asegurar que no haya corriente alguna dentro de la plataforma de conmutaci n 9 Al haber rayos peligro de descarga 4 No utilizar el equipo ni conectar o desconectar cables durante periodos de actividad de rayos 10 Cable de conexi n y desconexi n InfiniBand de cobre Dado que los cables de cobre InfiniBand son pesados y no son flexibles su conexi n a los conectores y su desconexi n se deben efectuar con mucho cuidado Para ver adver tencias o instrucciones especiales consultar al fabricante del cable 11 Montaje y mantenimiento del bastidor Al instalar o realizar el mantenimiento de este aparato en un bastidor es preciso adoptar precauciones especiales para garantizar que el sistema se mantenga estable En general en un bastidor los equipos se deben instalar comenzando desde abajo hacia arriba 12 Instalaci n del equipo La instalaci n el reemplazo y el mantenimiento de este equipo estar n a cargo nica mente de personal capacitado y competente 13 Eliminaci n del equipo La eliminaci n definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales Mellanox Technologies 91 14 C digos el ctricos locales y nacionales Este equipo se debe instalar conforme a los c digos el ctricos locales y nacio nales 15 C digos de instalaci n Este dispositivo se debe
80. ljine od 1 5 m six feet est stopa ali ne dulji od 4 5 m Za europsku mre u odaberite kabel napajanja koji je me unarodno uskla en i ozna en lt HAR gt 3 ilni s najmanje 1 0 mm ice nazivnog napona od 300 V s PVC izolacijom Kabel mora imati lijevani utika nazivnog napona od 250 V nazivne struje od 10 A 17 Veliko curenje struje Upozorenje Veliko curenje struje Prije spajanja napajanja nu no je spojiti uzeml jenje 18 Interkonekcija ure aja A Kabeli za spajanje na jedinicu RS232 1 Ethernet su elja moraju biti s UL cer AB tifikatom vrste DP 1 ili DP 2 Napomena kad se nalazi u krugu bez LPS y N vodi a Za tita od strujnog preoptere enja Uvijek dostupni odobreni za titni ure aji od strujnog preoptere enja nazivne struje od 20 A moraju se ugraditi u o i enje zgrade 19 Nemojte koristiti preklopnik kao policu ili radnu povr inu Pozor Oprema montirana na kliza e vodilice ne bi se trebala koristiti kao polica ili radna povr ina Vodilice nisu namijenjene za povla enje ure aja iz ormari a Slu e samo za trajnu instalaciju na kona nom polo aju a ne za servisiranje i odr avanje 102 Mellanox Technologies Rev 1 1 3 0 1 20 WEEE direktiva Sukladno WEEE direktivi 2002 96 EZ sav elektri ni i elektroni ki otpad EEE trebao bi se prikupljati zasebno i ne bi se trebao odlagati kao obi an ku anski otpad Odlaganje ovog proizvoda i svih njegovih dijelova v
81. lt username is admin password admin Step 4 Once you get the CLI prompt you are ready to use the system For additional information about MLNX OS refer to MLNX OS User Manual located on Mellanox sup port web 2 9 FRU Replacements Never run the system more than 5 minutes with an uncovered open PSU or fan slot 4 This section does not apply to SX6005 and SX6012 5 2 9 1 Power Supply and Fans 2 9 1 1 Power Supply Mellanox systems equipped with two replaceable power supply units work in a redundant config uration Either unit may be extracted without bringing down the system Make sure that the power supply unit that you are NOT replacing is showing all green for both the power supply unit and System Status LEDs IN Power supply units have directional air flows similar to the fan module The fan mod ule airflow must coincide with the airflow of all of the power supply units If the power supply unit airflow direction is different from the fan module airflow direction the system s internal temperature will be affected For power supply unit air flow direction refer to Section 2 2 on page 17 To extract a power supply unit Step 1 Remove the power cord from the power supply unit 2 Grasping the handle with your right hand push the latch release with your thumb while pulling the handle outward As the power supply unit unseats the power supply unit status LEDs will turn off Step3 Remove t
82. ltage is auto adjusting for 100 240VAC 50 60Hz power connections The power cords should be standard 3 wire AC power cords including a safety ground and rated for 27 ISA or higher Caution The system platform will automatically power on when AC power is applied There is no power system Check all boards power supplies and fan tray modules for proper insertion before plugging in 8 power cable AN This unit is intended for installation in a Restricted Access Location A restricted access area can be accessed only through the use of a special tool lock and key or other means of security Plug in the first power cable Step 1 Do not plug the cords to power supplies yet Step 2 Plug in the second power cable Step 3 Wait for the system upload process PA It may take up to five minutes to turn on the system If the System Status LED shows red after five minutes unplug the system and call your Mellanox representative for assistance Step 4 Check the System Status LEDs and confirm that all of the LEDs show status lights consistent with normal operation as shown in Figure 23 below For more information refer to LEDs on page 46 Mellanox Technologies 35 Rev 1 1 Installation Figure 23 System Siatus LEDs 5 Minutes After Power On Mellanox A PS1 PS2 D UID RST System with 1 PSU Mellanox 1 PS2 O UID RST 485000 System with 2 PSUs y Cautio
83. m die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten 6 Stapeln des Chassis Das Chassis sollte nicht auf andere Ger te gestapelt werden Wenn das Chassis herunt erf llt kann es zu Verletzungen und Besch digungen an Ger ten f hren 7 Mehrere Stromeing nge Risiko eines Stromschlags und Stomgefahr Alle Stromversorgungseinheiten sind unabh ngig Trennen Sie alle Stomversorgungen um einen abgeschalteten Zustand im Inneren der Switch Plattform sicherzustellen Mellanox Technologies 87 8 Bei Gewitter Elektrische Gefahr Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Kabel an oder ab 9 Anschlie en Trennen von InfiniBand Kupferkabel InfiniBand Kupferkabel sind schwer und nicht flexible Deshalb m ssen sie vorsichtig an die Anschl sse angebracht bzw davon getrennt werden Lesen Sie die speziellen Warnungen und Anleitungen des Kabelherstellers 10 Rack Montage und Wartung Wenn dieses Produkt in einem Rack montiert oder gewartet wird sind besondere Vor sichtsma nahmen zu ergreifen um die Stabilit t des Systems zu gew hrleisten Im Allgemeinen sollten Sie das Gestell von unten nach oben mit Ger ten f llen 11 Ger teinstallation Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert aus getauscht oder gewartet werden Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationale
84. n 96 E 10 Sigurnosna upozorenja za instaliranje Croatian 100 E 11 Avvertenze di sicurezza per l installazione italiano 103 E 12 Montaj G venlik Uyar lar T rk e 107 4 Mellanox Technologies Rev 1 1 List of Figures Figure 1 InfiniBand Systems Family Front Side View 11 Figure 2 Flow Direction Marking Connector Side Inlet to Power Side Outlet 18 Figure 3 Flow Direction Marking Power Side Inlet to Connector Side Outlet 18 Figure 4 Rack Rail Kit Parts u ii ok ee ae anne Deos 20 Figure5 Screwing on the Ra l 21 Figure 6 Inserting the Caged Nuts 22 Figure 7 Slide the Rail into the Rail Slide 22 Figure 8 Installing the Slides 23 Figure 9 System Placement in the Rack 24 Figure 10 Installation Completed 24 Figure 11 Installation Kit Parts for a Side by Side Installation 25 Figure 12 Screw on the System Mounted Rails 26 Figure 13 Two Systems Frame nn me here tee ru Re tes braun bu Aa he a
85. n After inserting a power cable and confirming the green System Status LED 7A N light is on make sure that the Fan Status LED shows green A N If the Fan Status LED is not green unplug the power connection and check that the fan module 15 inserted properly and that the mating connector of the fan unit is free of any dirt and or obstacles If no obstacles were found and the problem persists call your Mellanox representative for assistance Figure 24 Two Power Inlets Electric Caution Notifications CAUTION ACHTUNG ATTENTION Risk of electric shock and energy Gafahr des elektrischen Risque de choc et de danger hazard The two power supply Schocks Entferrnen des e lectriques Le de branch units are independent Netzsteckers elnes Netz ment d une seule alimentation teils spannungsfrei Um stabilise e ne de branch Disconnect all power supplies to alle Einhieten spannungs uniquement qu un module ensure a powered down state frei zu machen sind die Alimentation Stabilise e inside of the switch platform Netzstecker aller Netzteile Pour isoler completement le zu entfernen module en cause Il faut de brancher toutes les alimen tations stabilise es 36 Mellanox Technologies Installation Rev 1 1 2 8 System Bring Up 4 The bring up procedures described in this section do not apply to managed systems Such systems are ready for operation after power on gt In order to query the system perform firmware upgrade or o
86. n Gesetze Bestim mungen erfolgen 13 Regionale und nationale elektrische Bestimmungen Dieses Ger t sollte unter Beachtung der regionalen und nationalen elektrischen Bes timmungen installiert werden 14 Installationscodes Dieses Ger t muss entsprechend der aktuellsten Version des National Electrical Code installiert weden In Nodamerika muss das Ger t gem den geltenden Anforderungen des US National Electrical Code und des Canadian Electrical Code installiert werden 88 Mellanox Technologies Rev 1 1 15 UL und CSA zertifiziertes Netzkabel F r Nordamerika Stromanschluss w hlen Sie ein Netzkabel das UL und CSA Certi fied 3 Leiter 18 AWG mit einem angespritztem Stecker bewertet bei 125 V 15 mit einer Mindestl nge von 1 5 m Six Feet aber nicht mehr als 4 5 m F r die europ ischen Zusammenhang w hlen Sie ein Netzkabel das international harmonisiert und der Aufschrift lt HAR gt 3 Leiter mindestens 0 75 mm2 Draht bewertet mit 300 V mit einem PVC Mantel isoliert Das Kabel muss eine angespritztem Stecker bewertet bei 250 V 10 A 16 Hoher Ableitstrom WARNUNG Hohe Ableitstrom Earth Verbindung bevor Sie die Verbindung von wesentlicher Bedeutung werden 17 Installationscodes Dieses Ger t muss installiert sein entsprechend auf die neueste Version des Landes National Electrical Code F r Nordamerika m ssen in bereinstimmung mit den gel tenden Vorschriften in der
87. nd or local codes may require IT components to be bonded and exter and local codes when installing this equipment 5 Mellanox Technologies 31 Rev 1 1 Installation 2 6 Cable Installation All 680105 can be inserted or removed with the unit powered on gt Toinserta cable press the connector into the port receptacle until the connector is firmly seated The LED indica tor corresponding to each data port will light when the physical connection is established When a logical connection is made the relevant port LED will turn on gt Toremovea cable disengage the locks and slowly pull the connector away from the port receptacle The LED indi cator for that port will turn off when the cable is unseated For more information about port LEDs refer to Section 3 2 1 6 Port LEDs on page 51 Do not force the cable into the cage with more than 40 newtons 9 0 pounds 4kg force Greater insertion force may cause damage to the cable or the cage Figure 19 Cable Orientation 2 6 1 Using a Breakout Cable gt Only internally managed switches in Ethernet switch mode support splitting of the data stream A 400202 port can be split to 4 ports or less of 10020 each by using a Mellanox breakout cable In some switches not all ports can be split When using a port to split a data stream into 4 10 Gb s data streams one of the other ports on the switch will be disabled unmapped from the switch When usin
88. not bend within the rack or in case more space is needed for cable bending radius it is possible to recess the connector side or the FRU side by 2 5 08cm by optional placement of the system s rails The FRU side is extractable Mounting the sliding rail inverted to the system will allow you to slide the FRU side of the system in and out Mounting the slides to the system Step 1 The recession feature is bi directional meaning that you can recess the system either backward or forward Step2 Screw the system slides onto the system Use 5 flat head 6 32 screws for a short system and 7 screws for a standard depth system to connect each system slide The recommended tightening torque is 1 5 0 2 Nm Figure 5 Screwing on the Rail aa 5 screws per side are needed for the short system 7 screws per side are needed for the standard system If using a torque screwdriver to tighten the screws set it to 1 5 0 2 Nm Step 3 Clip the caged nuts into the holes in the rack on the side of the rack you will be sliding the sys tem into Mellanox Technologies 21 Rev 1 1 Installation Figure 6 Inserting the Caged Nuts Side you will slide the system into Second side Step 4 Slide therail into the rail slide Step 5 Using two of the M6 bolts for each corner install the rails and rail slides in the rack Do not tighten the bolts yet Figure 7 Slide the Rail into the Rail Slide This side of the rail kit go
89. nterface data ModPrsL SDA 28 a i 11 13 GND Ground 29 Ter mM 10 14 Rx3p Receiver Non Inverted Data Output 30 Veci Resetl 9 15 Rx3n Receiver Inverted Data Output 31 LpMode ModSell 16 GND Ground 32 GND 7 17 Rxlp Receiver Non Inverted Data Output 33 Tx3p Tx4p B 18 Receiver Inverted Data Output 34 Tx4n 5 35 an cip 19 GND Ground 36 3 20 GND Ground Tx2n 2 21 Rx2n Receiver Inverted Data Output 3 gt Si GND 22 Rx2p Receiver Non Inverted Data Output 3 23 GND Ground 24 Rx4n Receiver Inverted Data Output 3 25 Rx4p Receiver Non Inverted Data Output 3 26 GND Ground 27 ModPrsL Module Present 28 IntL Interrupt 29 Tx 13 3 V Power supply transmitter 30 Vcc 1 3 3 V Power Supply 31 LPMode Low Power Mode 32 GND Ground 33 Tx3p Transmitter Non Inverted Data Input 34 Tx3n Transmitter Inverted Data Input 35 GND Ground 36 Txlp Transmitter Non Inverted Data Input 37 Txin Transmitter Inverted Data Input 68 Mellanox Technologies 69 Mellanox Technologies GND TX2n TX2p GND TX4n TX4p GND ModSelL O ResetL VecRx LO CD SCL spa LL GND RX3p RX3n GND RX1p View into Front of Cage RX1n GND A GND n p GND TX3n TX3p GND LPMode Vcc1 VccTx IntL ModPrsL GND RX4p RX4n GND
90. nterface s USB port RS232 Console port 2C interface Reset button Status and Port LEDs In order to review the full configuration options matrix refer to Table 4 Management Interfaces and FRUs 3 1 Data Interfaces The data interfaces use QSFP connectors The full list of interfaces per system 15 provided in Table 3 Speed and Switching Capabilities on page 11 VPI enabled managed systems or SX6036G running as ETH port can support the below as well Each QSFP port can be connected with QSFP cable or connector for 40 56Gb s or 10Gb s when connecting through Mellanox QSFP to SFP QSA adapters LR4 transceivers are supported in the following ports 1 3 33 35 3 1 1 Speed InfiniBand speed is auto adjusted by the infiniBand protocol Mellanox systems support FDR FDR10 InfiniBand FDR is an InfiniBand data rate where each lane of a 4X port runs a bit rate of 14 0625 Gb s with 64b 66b encoding resulting in an effective bandwidth of 56 25 Gb s FDRIO is a non standard InfiniBand data rate where each lane of a 4X port runs a bit rate of 10 3125 Gb s with a 64b 66b encoding resulting in an effective bandwidth of 40 Gb s FDR10 supports 20 more bandwidth over QDR due to better encoding rate Both FDR and FDR10 support Forward Error Correction FEC as defined in IEEE 802 3ap chapter 74 4 FDR and FDR10 are only guarenteed to work with approved Mellanox cables 5 44 Mellanox Technologies
91. on user configuration lights a blue LED for ease in find ing a particular system within a cluster This is a future feature that is not yet available 3 2 1 4 3 2 1 5 50 Mellanox Technologies Interfaces Rev 1 1 3 2 1 6 Port LEDs Figure 32 Port 5 Table 17 Port LEDs in Ethernet System Mode LED Behavior Description Action Reguired Off Physical link is down Check the cable Solid Green Physical link is up with no traffic N A Flashing Green Physical link is up with traffic N A Flashing Orange Physical errors Check the cable Table 18 Port LEDs in InfiniBand System Mode LED Behavior Description Action Required Off Physical link is down Check the cable Solid Green Logical link is up N A Flashing Green Data activity flashing speed is pro N A portional to data transfer speed Solid Orange Physical link is up Wait for the Logical link to raise Check that the SM is up Flashing Orange A problem with the physical link Check that the SM is up In InfiniBand system mode the LED indicator corresponding to each data port will light orange when the physical connection is established that is when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port When a logical connection is made the LED will change to green When data is being transferred the light will blink green 3 3 Inventory Pull out Tab
92. one elevata il collegamento a terra 6 essenziale prima di collegare l alimentazione Mellanox Technologies 105 18 Interconnessione delle unit I cavi per il collegamento all unit RS232 e alle interfacce Ethernet devono disporre della certificazione UL ed essere del tipo DP 1 o DP 2 Nota in caso di installazione su un circuito la cui potenza non limitata Protezione contro le sovracorrenti la cablatura dell edificio deve integrare un dispositivo di protezione contro le sovracorrenti di potenza nominale pari a 20 19 Non utilizzare lo switch come scaffale o piano di lavorol Attenzione un apparecchiatura scorrevole o montata su binari non va utilizzata come scaffale o piano di lavoro I binari non sono progettati per far scorrere e allontanare l unit dal rack Essi sono destinati all installazione permanente solo nel luogo di lavoro e non vengono utilizzati per assistenza e manutenzione 20 Direttiva RAEE Secondo la direttiva RAEE 2002 96 EC tutti i rifiuti da apparecchiature elettriche ed elettroniche RAEE vanno raccolti separatamente e non smaltiti nei normali rifiuti domestici Smaltire questo prodotto e tutte le sue parti in modo responsabile e rispettoso dell ambiente 21 Limitazioni relative all alimentazione per la Norvegia Questa apparecchiatura 6 progettata esclusivamente per il collegamento a un sistema di alimentazione TN e a un sistema di alimentazione IT 106 Mellanox Technologi
93. quent il faut proc der avec soin pour les brancher ou les d brancher des connecteurs Consulter le fabricant du c ble pour obtenir des instructions ou des avertissements sp cifiques 84 Mellanox Technologies Rev 1 1 11 Montage en rack et maintenance Lors du montage ou de la maintenance de ce produit dans un rack il faut faire sp ciale ment attention pour s assurer que l ensemble reste stable En r gle g n rale le rack doit tre rempli en commen ant par le bas 12 Installation de l quipement Cet quipement ne doit tre install remplac et maintenu que par un personnel form et qualifi La mise au rebut de cet quipement doit se faire conform ment toutes les lois et r glementations nationales Cet quipement doit tre install conform ment aux codes lectriques locaux et nation aux 15 Codes d installation Cet appareil doit tre install conform ment la version la plus r cente des codes lec trique nationaux En Am rique du Nord l quipement doit tre install en respectant les exigences de l US National Electrical Code et du Code canadien de l lectricit 16 Cordon d alimentation UL Listed et certifi CSA N Pour le branchement lectrique en Am rique du Nord utiliser un cordon d alimenta tion UL Listed et CSA Certified 3 conducteurs calibre 16 AWG avec une prise moul e 125 V 13 A faisant au moins 1 5 m de long six pieds et au pl
94. r ite na odgovoran i ekolo ki na in 21 Elektri na ograni enja dr ave Norve ke a Ovaj je ure aj namijenjen samo za spajanje na elektri ni sustav s TN uzemljenjem i na elektri ni sustav s IT uzemljenjem drZave Norve ke E 11 Avvertenze di sicurezza per l installazione italiano 1 Istruzioni di installazione N Leggere tutte le istruzioni di installazione prima di collegare l apparecchiatura all alimentazione 2 Lesioni 3 causa del peso A Usare un numero di persone sufficiente per sollevare in sicurezza questo prodotto lt 40 lbs 40 70 lbs 70 121 lbs gt 121 lbs lt 18 kg 18 32 kg 32 55 kg gt 55 kg 3 Apparecchiatura pesante Questa apparecchiatura 6 molto pesante e va spostata mediante un sollevatore meccanico per evitare lesioni Mellanox Technologies 4 Rischio di scosse elettriche Rischio di scosse elettriche Con il modulo ventola rimosso i pin di alimentazione sono accessibili all interno della cavit del modulo NON inserire strumenti o parti del corpo nella cavit del modulo della ventola 5 Temperatura eccessiva N Questa apparecchiatura non va utilizzata in un area con una temperatura ambiente superiore a quella massima consigliata 45 C 113 F Inoltre per assicurare un flusso d aria adeguato lasciare almeno 8 cm 3 pollici di spazio attorno alle aperture di ventilazione 6 Impilare lo chassis Ku i te se ne bi trebalo sl
95. rs are recommended for any single fabric The InfiniBand Subnet Manager running on the system supports up to 648 nodes If the fabric includes more than 648 nodes you may need to purchase Mellanox s Unified Fabric Manager UFMO software package Each subnet needs one subnet manager to discover activate and manage the subnet Each network requires a Subnet Manager to be running in either the system itself system based or on one of the nodes which is connected to the fabric host based The subnet manager OpenSM assigns Local IDentifiers LIDs to each port connected to the fabric and develops a routing table based on the assigned LIDs A typical installation using the OFED package will run the OpenSM subnet manager at system start up after the drivers are loaded This automatic OpenSM is resident in memory and sweeps the fabric approximately every 5 seconds for new adapters to add to the subnet routing tables 4 2 Fabric Inspector Diagnostics Fabric Inspector is a plug amp play licensed software within MLNX OSQ displaying and filtering all identified systems and nodes within the fabric Fabric Inspector includes a complete set of InfiniBand tools for fabric wide diagnostics to check node node and node switch connectivity and to verify routes within the fabric Advanced filtering allows creating filtering rules on a system wide basis between nodes or port connections based on traffic patterns and user assigned system names GU
96. s static routing adaptive routing and advanced congestion management These features ensure the maximum effective fabric bandwidth by eliminating congestion The managed systems comes with an onboard subnet manager enabling simple out of the box fabric bring up for up to 648 nodes MLNX OS software delivers complete chassis manage ment of firmware power supplies fans ports and other interfaces Mellanox s edge systems can also be coupled with Mellanox s Unified Fabric Manager UFM software for managing scale out InfiniBand computing environments UFM enables data center operators to efficiently provision monitor and operate the modern data center fabric UFM boosts application performance and ensures that the fabric is up and running at all times InfiniBand systems come as internally or externally managed Internally managed systems come with a CPU that runs the management software MLNX OS and management ports which are used to transfer management traffic into the system Externally managed systems come without the CPU and management ports and are managed using firmware tools Mellanox s InfiniBand to Ethernet gateway built with Mellanox s SwitchX 2 based systems provides the most cost effective high performance solution for data center unified connectivity solutions Mellanox s gateways enable data centers to operate at up to 56Gb s network speeds while seamlessly connecting to 1 10 and 40GbE networks with low latency 400ns
97. sin lt 40 Ibs 40 70 16 70 121 lbs gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Eguipos pesados Dado que el eguipo es pesado se debe mover nicamente mediante un elevador mec nico para evitar lesiones 4 Riesgo de descarga el ctrica Riesgo de descarga el ctrica Con el m dulo del ventilador quitado se obtiene acceso a las clavijas de alimentaci n desde dentro de la cavidad del m dulo NO introducir herramientas ni partes del cuerpo en la cavidad del m dulo del ventila dor 5 Sobretemperatura No se debe utilizar el equipo en un rea con una temperatura ambiente superior a la N m xima recomendada 45 C Adem s para garantizar una circulaci n de aire adec N uada se debe dejar como m nimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilacion 6 Apilamiento del chasis N Los chasis no se deben apilar sobre otros equipos La ca da del chasis podr a causar lesiones corporales as como da os al equipo 90 Mellanox Technologies Rev 1 1 7 Conexi n redundante de fuente de alimentaci n peligro de descarga Si se dispone de una fuente de alimentaci n vacia no utilizar el producto si su tapa 4 Este producto incluye una fuente de alimentaci n redundante o en su lugar una vacia est guitada o no est bien cerrada 8 Tomas de alimentaci n m ltiples Riesgo de descarga el ctrica y peligro de corriente Todas las fuentes de a
98. t Weight Short System with 1 PSU 7 08kg 15 60lbs System with 2PSUs 7 82kg 17 24lbs Standard System with 1 PSU 8 02kg 17 68lbs System with 2 PSUs 8 76kg 19 311bs Speed 40 56Gb s per port Connector cage 36 QSFP Heat dissipation 798 BTUs hr Environmental Temperature Operational 0 to 45 C Non Operational 40 to 70 C Humidity Operational 10 85 non condensing Non Operational 10 90 non condensing Altitude Operational 3050m Power Input Voltage 100 240 VAC 50 60Hz Typical ATIS score under snake topology with passive cables 78 15W 73 41 Main Devices CPU N A Switch Mellanox SwitchX 2 Switching Capacity 4 03 Tb s non blocking Mellanox Technologies 63 Rev 1 1 Specifications 6 6 SX6036 Series Table 25 SX6036 Specifications Feature Value Mechanical Size Short 1 716 H H x 16 85 W x16 8 D 43 6mm H x 428mm W x 428 9 mm D Standard 1 716 H H x 16 85 W x24 75 D 43 6mm H x 428mm W x 628 9 mm D Mounting 19 Rack mount Weight Short System with 1 PSU 7 08kg 15 60lbs System with 2PSUs 7 82kg 17 24lbs Standard System with 1 11 8 System with 2 51185 858 Speed 40 56Gb s per port Connector cage 36 QSFP Heat dissipation 798 BTUs hr Environmental Temperature Operational 0 to 45 C Non Operational 40 to 70 C Humidity Operational 10
99. te that password characters are not printed The wizard displays a summary of your choices and then asks you to confirm the choices or to re edit them Either press Enter to save changes and exit or enter the configu ration step number that you wish to return to Note To re run the configuration wizard run the command configura tion jump start in Config mode Wizard Session Display Mellanox configuration wizard Do you want to use the wizard for initial configuration yes Step 1 Hostname switch Step 2 Use DHCP on mgmt0 interface no yes Step 3 Enable IPv6 yes Step 4 Enable IPv6 auto config SLAAC on mgmt0 interface no Step 5 Enable DHCPv6 on mgmt0 interface no Step 6 Admin password Press lt Enter gt to leave unchanged new password gt Step 6 Confirm admin pass word new password gt You have entered the following information A summary of the configura tion is now displayed To change an answer enter the step number to return to or hit lt enter gt to save changes and exit Choice lt Enter gt Configuration changes saved The table below shows an example of static IP configuration for mgmt0 interface Rev 1 1 Installation Step Step 4 38 Mellanox Technologies Installation Rev 1 1 Table 11 Configuration Wizard Session Static IP Configuration Wizard Session Display Static IP Configuration
100. ther firmware operation Refer to the latest Mellanox Firmware tools MFT located on Mellanox com www mellanox com gt Products gt Software gt InfiniBand VPI Drivers gt In order to obtain the Firmware version of the externally managed system Step 1 Run the following command from a host flint d lid number qq Step 2 Compare the results of this command with the latest version for your system posted on the www mellanox com gt Support gt Firmware Downloads gt Switch System page Step 3 Ifthe current version is not the latest version follow the directions in the MFT User manual to burn the new firmware 2 8 1 Configuring Network Attributes The procedures described in this chapter assume that you have already installed and powered on according to the instructions in this document gt To perform initial configuration of the system perform the following Step 1 Connect a host PC to the Console RJ45 port of the system using the supplied harness cable DB9 to RJ45 Make sure to connect to the Console RJ45 port and not to the Ethernet MGT port Step 2 Configure a serial terminal program for example HyperTerminal minicom or Tera Term on your host PC with the settings described in Table 9 Once you perform that you should get the CLI prompt of the system Table 9 Serial Terminal Program Configuration Parameter Setting Baud Rate 9600 Data bits 8 Stop bits 1 Parity None Flow Control None Mell
101. us 4 5 m Pour le branchement lectrique en Europe utiliser un cordon d alimentation au format international harmonis marqu lt HAR gt 3 conducteurs d au moins 1 mm2 de sec tion 300 V avec une gaine isolante en PVC Le cordon doit avoir une prise moul e 250 V 10 A 17 Courant de fuite lev Avertissement courant de fuite lev une connexion la terre est indispensable avant de brancher l alimentation Mellanox Technologies 85 18 Interconnexion des unit s Les c bles de connexion aux interfaces RS232 et Ethernet de l appareil doivent tre certifi UL de type DP 1 ou DP 2 Note en cas d installation sur un circuit dont la puissance n est pas limit e Protection contre les surintensit s le c blage de l immeuble doit int grer un dispositif certifi de protection contre les surintensit s calibr 20 A et ais ment accessible 19 Ne pas utiliser comme tag re ou plan de travail Attention un quipement coulissant ou mont sur rail ne doit pas servir d tag re ni de plan de travail Les rails ne sont pas destin s faire coulisser l unit hors du rack Ils sont destin s une installation permanente l emplacement final pas pour l entretien ni la maintenance 20 Directive DEEE Selon la Directive 2002 96 CE DEEE tous les d chets d quipements lectriques et lectroniques EEE doivent tre collect s s par ment et ne pas etre mis au rebut avec les d chets m n
102. vertencias de seguridad de instalaci n Spanish on page 90 For Safety Warnings in Russian see Section E 8 Russian on page 93 For Safety Warnings in Romanian see Section E 9 Avertismente privind siguranta la instalare Romanian on page 96 16 Mellanox Technologies Installation Rev 1 1 For Safety Warnings in Croatian see Section E 10 Sigurnosna upozorenja za instaliranje Croa tian on page 100 For Safety Warnings in Italian see Section E 11 Avvertenze di sicurezza per l installazione italiano on page 103 For Safety Warnings in Turkish see Section E 12 Montaj G venlik Uyar lar T rkge on page 107 2 2 Air Flow Mellanox systems are offered with two air flow patterns Connector front side inlet to power side outlet marked with red labels on the power supply side as shown in Figure 2 Power rear side inlet to connector side outlet marked with blue labels on the power supply side as shown in Figure 3 All servers and systems in the same rack should be planned with the same air flow direction All FRU components need to have the same air flow direction A mismatch in the air flow will affect the heat dissipation Table 6 provides an air flow label color legend and respective OPN designations Table 6 Air Flow Label Legend Direction Lapel CEN a Descr
103. witchX 2 based FDR 10 InfiniBand 1U Switch 18 QSFP ports 1 Power Supply AC PPC460 standard depth P2C airflow Rail Kit RoHS6 SwitchX based FDR InfiniBand Switch 36 QSFP ports 1 Power Supply Short depth Unmanaged Connector side to PSU side airflow Rail Kit and RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 36 QSFP ports 1 Power Supply AC unmanaged short depth C2P airflow Rail 1 6 SwitchX based FDR InfiniBand Switch 36 QSFP ports 1 Power Supply Standard depth Unmanaged PSU side to Connector side airflow Rail Kit and RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 36 QSFP ports 1 Power Supply AC unmanaged standard depth P2C airflow Rail Kit RoHS6 SwitchX based FDR InfiniBand Switch 36 QSFP ports 1 Power Supply Standard depth Unmanaged Connector side to PSU side airflow Rail Kit and RoHS6 SwitchX 2 based FDR InfiniBand 1U Switch 36 QSFP ports 1 Power Supply AC unmanaged standard depth C2P airflow Rail Kit RoHS6 SwitchX 2 based FDR 10 InfiniBand 1U Switch 36 QSFP ports 1 Power Supply AC unmanaged short depth C2P airflow Rail Kit RoHS6 SwitchXQ based FDR10 InfiniBand Switch 36 ports 1 Power Supply Stan dard depth Unmanaged PSU side to Connector side airflow Rail Kit and RoHS6 SwitchX 2 based FDR 10 InfiniBand 1U Switch 36 QSFP ports 1 Power Supply AC unmanaged standard depth P2C airflow Rail Kit RoHS6 OPN MSX6018F 1BRS MS
104. ws the health of the system Green se Fan Status LED Shows the health of the fans Green PS1 Power supply 1 Shows the health of the right side power supply Green unit PS2 Power supply 2 Shows the health of the left side power supply unit Green Bad Port LED lights up when a symbol error is detected on one Off of the ports U D Unit Identifier LED Lights up on command through the CLI Off 3 2 1 1 System Status LED Figure 28 System Status LEDs Froni and Rear sides Both of these LEDs show the system s status Rear side Front side status LED status LED Both of the System Status LEDs front and back supply identical information E AN It may take up to five minutes to turn on the system Ifthe System Status LED shows M N red after five minutes unplug the system and call your Mellanox representative for 4 assistance Mellanox Technologies 47 Rev 1 1 Interfaces Table 13 System Status LED Assignments LED Behavior Description Action Reguired Solid Green The system is up and running normal N A condition Flashing Green The system 18 booting up This assignment Wait up to five minutes for the end of the is valid on managed systems only booting process Solid Red Major Error has occurred For example Ifthe System Status LED shows red five corrupted firmware system is overheated minutes after starting the system unplug the etc system and call your Mellanox r
105. xat n mod sigur Mellanox Technologies 97 8 Multiple mufe electrice Risc de soc electric i pericol electric Toate aparatele cu alimentare de la retea sunt independente Deconectati toate sursele de alimentare cu energie pentru a asigura decuplarea n inter iorul platformei de comutare 9 n timpul desc rc rilor electrice pericol electric In timpul perioadelor cu desc rc ri electrice luminoase nu lucrati cu echipamentul sau nu conectati sau deconectati cablurile 10 Conectarea deconectarea cablului din cupru InfiniBand IAN X Cablurile InfiniBand din cupru sunt grele si inflexibile de aceea trebuie s fie ata ate Ah sau deta ate de conectori cu grij Consultati produc torul de cabluri pentru avertis mente instructiuni speciale 11 Montarea sau depanarea intr un rack Cand acest produs este montat sau depanat intr un rack trebuie sa 116 luate m suri de precautie speciale pentru a se asigura c sistemul r m ne stabil In general trebuie sa umpleti rack ul cu echipamente incep nd de jos in sus 12 Instalarea echipamentului Acest echipament trebuie s fie instalat nlocuit i sau depanat numai de c tre personal instruit i calificat 13 Eliminarea echipamentului N Eliminarea acestui echipament trebuie s se realizeze in conformitate cu toate legile Si regulamentele nationale 14 Codurile electrice locale si nationale Acest echipament trebuie sa fie instal

Mellanox 1U Switch and Gateway Systems Hardware User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents