Home

User Manual

1. Interface For PCIE CX4 clocking and reset of the PCI Express QSFP for connection to the server side board QSFP for connection to the server side board Interface For Ethernet RJ45 for remote Ethernet connection Mellanox Technologies 37 Rev 1 5 Installing the PCIE 1 GbE Server Side board Figure 25 Server Side Card Power connection The PCB server board has 3 interfaces Interface For PCIE CX4 clocking and reset QSFP for connection to the server side board QSFP for connection to the server side board 38 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Figure 26 PCIE 1GbE Extender RJ45 1GbE Connector for remote management CX4 Clock and Reset Connector QSFP RX Green Connector QSFP TX Blue Connector 5 2 Removing the Top Cover 1 Place the ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Remove the 6 screws from the power side of the top 3 Slide the top towards the power side A With the cover off you will need a clip on fan cooling the chip heat sink Mellanox Technologies 39 Rev 1 5 Installing the PCIE 1 GbE Server Side board Figure 27 Screw Locations 40 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 5 3 Removing the Management CPU
2. X P N MT51336 EN EVB MI RENDUM Rev A1 L0 2V L1 69 20 00 2 LOW 20 2V 11 60 20 00 1 LOW MAC 0002C927051C EAN NTN Made in IL 12 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 2 40 Gb s Ethernet 40 Gb ETH is only guaranteed to work with approved Mellanox Cables 5 Each QSFP port is capable of up to 40GigE and SFP ports except for the Reference ports can run at 10GigE 1GigE Ports 1 and 2 and 35 and 36 not connected to the chip All ports are capable of virtual switching VEPA All usable virtual switching ports are grouped together The port protocol can only be obtained from the management interface Mellanox Technologies 13 Rev 1 5 FDR 3 FDR The SwitchX EVB supports FDR a pre standard InfiniBand data rate where each lane of a 4X port runs a bit rate of 14 0625Gb s with a 64b 66b encoding resulting in an effective bandwidth of 54 54Gb s The FDR physical layer is an IBTA specified physical layer using different block types deskew mechanism and framing rules SwitchX also supports FDR10 a non standard InfiniBand data rate where each lane of a 4X port runs a bit rate of 10 3125Gb s with a 64b 66b encoding resulting in an effective bandwidth of 40Gb s FDR10 supports 20 more bandwidth over regular QDR using the same QSFP cables connec tors Both FDR and FDR10 support Forward Error Correction FEC as describ
3. CC CL CC OL CC OL CC 1 Place the ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Choose which side of the switch you want even with the rack vertical support Either the side with the power supply units or the side with the IB connectors can be even with one of the vertical rack supports A To Transfer the power cord from the connector side to the power side through the rail kit see Section D Transferring the Power Cord on page 59 Things to consider before choosing where to mount the rails and rail slides The distance between the rack and the door can be as little as 4 cm on one side of the rack and as much as 18 cm on the other side of the rack Keep in mind that there can be as many as 36 cables connected to the switch Mellanox Technologies 29 Rev 1 5 Basic Operation and Installation Do you want the connector side recessed in the rack to allow for a larger cable bending radius It is possible to recess the connector side by 5cm by optional placement of the switch rails See Figure 16 Mounting Options Willthe connector side be recessed past other equipment in the rack and will this be problematic The installation kit allows for a 2 recess of the switch past the vertical support Figure 16 Mounting Options Verti
4. 6 82 8 6 6 8 6 6 6 LE amp 16 6 6 6 2 0 9 6 Jo E 6 0 9 0 Cs 4 Mellanox Technologies 45 Rev 1 5 Installing the PCIE 1GbE Server Side board The mini SMP connections are defined by the labels on the board not by the silk on the board Table 7 Port Connector Numbering Sheet 1 of 3 Connector Type Signal Description 1 Mini SMP Calibration Calibration of length 2X 2 Mini SMP Calibration Calibration of length 2X 3 SMA Reference Connects to Port 2 Ref to compliance port 4 4 SMA Reference Connects to Port 2 Ref to compliance port 4 5 SMA Reference Connects to Port 1 Ref to compliance port 2 6 SMA Reference Connects to Port 1 Ref to compliance port 2 7 SMA Reference Connects to Port 1 Ref to compliance port 2 8 SMA Reference Connects to Port 1 Ref to compliance port 2 9 SMA Reference Connects to Port 2 Ref to compliance port 4 10 SMA Reference Connects to Port 2 Ref to compliance port 4 11 Mini SMP Data SX HW Port 27 RX lane C Negative 12 Mini SMP Data SX HW Port 27 RX lane C Positive 13 Mini SMP Data SX HW Port 27 RX lane A Negative 14 Mini SMP Data SX HW Port 27 RX lane A Positive 15 Mini SMP Data SX HW Port 27 RX lane D Negative 16 Mini SMP Data SX HW Port 27 RX lane D Positive 17 Mini SMP Data SX
5. Syst me de fusible neutre double p le Veuillez debrancher tous les A cordons d alimentation avant d ouvrir le boitier de ce produit ou de toucher un de ses composants internes 6 Orages dangers lectriques LA Pendant un orage il ne faut pas utiliser le mat riel et il ne faut pas brancher ou d brancher les c bles 64 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 7 Branchement d branchement des c bles en cuivre tr s attention en les branchant et en les d branchant des connecteurs Consultez le fab Les c bles InfiniBand en cuivre sont lourds et ne sont pas flexibles il faut donc faire ricant des c bles pour conna tre les mises en garde et les instructions sp ciales 8 Risque de choc et de danger Risque de choc et de danger LA electriques Le de branchment d une seule alimentation stabilise e ne branch uniquement qu un module Alimentation Stabilise e Pour isoler completement le module en cause Il faut de brancher toutes les alimentations stabilise es Risk of electric shock and energy hazard h The PSUs are all independent Disconnect all power supplies to ensure a powered down state inside of the switch platform 9 Montage et entretien sur baie ciales pour s assurer que le syst me reste stable En g n ral il faut remplir la baie avec Lorsque ce produit est mont ou entretenu sur baie il faut prendre des pr cautions sp du mat riel de bas en h
6. extract the fan unit and reinsert it A After two unsuccessful attempts to install the fan unit power off the switch before attempting any system debug 36 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 5 Installing the PCIE 1GbE Server Side board The PCIE 1GbE server side board disables the internal Management capabilities and disconnects the management interfaces When installed the system side board allows for direct contact with the SwitchX device for external management and SW development purposes The PCIE 1GbE server side board allows for a direct connection of an external server directly to the SwitchX chip It allows for a PCIE slot in the external server to be connected to a PCIE port in the SwitchX EVB This will support a PCIE 2 0 1X connection An alternative is to select to use the RJ45 1GbE connection to the SwitchX EVB The user can connect this RJ45 connector to any Ethernet 10 100 1000 port for management 51 PCIE 1GbE Extender Kit parts Part Quantity For PCIE PCB server board 1 Server side board EVB Daughter board 1 System side board MT PCI HS QSFP 2 QSFP 26AWG 2m cable for the PCIE fabric MCC4L30 002 1 CX4 30AWG 2m cable for the PCIE clock and Reset The EVB daughter board has 4 interfaces three for PCIE and one for Ethernet use A Do not use both PCIE and Ethernet at one time You must select either the PCIE or the Ethernet connection The interfaces are
7. HW Port 27 RX lane B Negative 18 Mini SMP Data SX HW Port 27 RX lane B Positive 19 3 Pin Dc Primary connector 20 3 Pin Dc Secondary connector 21 Mini SMP Data SX HW Port 27 TX lane A Positive 22 Mini SMP Data SX HW Port 27 TX lane A Negative 23 Mini SMP Data SX HW Port 27 TX lane B Positive 24 Mini SMP Data SX HW Port 27 TX lane B Negative 25 Mini SMP Data SX HW Port 27 TX lane C Positive 26 Mini SMP Data SX HW Port 27 TX lane C Negative 27 Mini SMP Data SX HW Port 27 TX lane D Positive 46 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Table 7 Port Connector Numbering Continued Sheet 2 of 3 Connector amp Type Signal Description 28 Mini SMP Data SX HW Port 27 TX lane D Negative 29 12V PS1 30 SMA Calibration Calibration of length 2X 31 SMA Calibration Calibration of length 2X 32 Mini SMP Calibration Calibration of length X 33 Mini SMP Calibration Calibration of length X 34 Fans 35 SMA Calibration Calibration of length 2X 36 SMA Calibration Calibration of length 2X 37 Main 38 Mini SMP Calibration Calibration of length 2X 39 Mini SMP Calibration Calibration of length 2X 40 Mini SMP Calibration Calibration of length X 41 Mini SMP Calibration Calibration of length X 42 CX4 Clock and Reset 43 QSFP RX Data 44 QS
8. SMA mini SMP interfaces Ports 3 and 4 are SMA ports and ports 33 and34 are mini SMP ports Use port 4 for compliance and use port 2 as the reference port Compliance ports are the worst case loss for all of the on board connectors through the channel They are designed to have an insertion loss of 5 5dB as defined in SFF 8431 See Figure 12 on page 22 for identifying the trace and compliance ports See Figure 35 on page 45 and Table 7 on page 46 for locations and numbering of the trace and compliance port board connections As of this revision only port 4 is verified at the proper designed insertion loss Use port 4 for compliance 1 4 Reference Traces Ports 1 and 2 and 35 and 36 are not connected to the chip These are reference ports and go to the SMA mini SMP interfaces See Figure 35 on page 45 and Table 7 on page 46 For locations and numbering of the board connections Ports 1 and 2 are SMAports and ports 35 and36 are mini SMP ports These reference traces are designed to have identical insertion loss as the corresponding compli ance ports and those traces are routed in the same geometry and length as the traces of the com pliance ports 1 5 Serial Number and Product Version Information The Serial number and GUID for the switch and the MAC for the Management PC are found on the pull out tab below the USB interface connection Mellanox Technologies 11 Rev 1 5 Overview Figure 2 Pull Out Tab S N MT1117X00014
9. Section 4 6 6 Extracting and Inserting the Fan Unit on page 35 LA Caution Do not run the switch if the System Status LED for the Fans is Yellow The link LED for the connector does not come on 1 Check that both ends of the cable are connected 2 Check that the locks on the ends are secured 3 Make sure that the latest firmware version is installed on both the HCA and the switch 4 If media adapters are used check that the all connections are good tight and secure The activity LED does not come on Check that the Subnet Manager has been started The switch is off 1 Unplug the switch 2 Wait 5 minutes 3 Plug in the switch 4 If the switch does not come on check the power supplies 54 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 5 Check the temperature 6 Check the Fan status The switch is not working and unresponsive 1 Reset the switch If resetting the switch does not work 2 Unplug the switch 3 Wait 5 minutes 4 Plug in the switch 5 If the switch does not come on check the power supplies Mellanox Technologies 55 Rev 1 5 Appendix A Specifications MT51336 Specifications Table 9 Specifications for MT51336 Physical Power and Environmental Size Lx W x 629 mm x 428 mm x 43 6 mm Voltage 12V 3 3V 24 76 in x 16 85 in x 1 71 in Weight 9 31kg 20 52 Ibs Typ Typ 50 40GigE Air Flow 62CFM Active Cables 182W 5W
10. compliance pair 34 36 Compliance Ports 3 4 Compliance Ports 33 34 4 4 1 2 Top and Bottom Orientation Figure 13 Top and Bottom Ports 7 NM 22 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 4 4 2 Management and Firmware Updating Interfaces WILL WORK IF THE MANAGEMENT BOARD WAS REMOVED AND OR Ad REPLACED WITH THE PCIE IGbE EXTENDER NONE OF THE MANAGEMENT INTERFACES ON THE CONNECTOR SIDE There are four interfaces to connect to the EVB 2X 10 100Mgb IGb Ethernet connectors labelled MGT e 1 USB port that is labelled z This interface can be used to update software or firm ware connector that is labelled CONSOLE Use this connector to connect to the host PC There is one I2C interface to connect to the SwitchX MT51336 on the power side but this is for Mellanox FAEs and advances users only Figure 14 Management Interfaces MGTV 4 4 2 1 RJ 45 Connector CONSOLE The port labelled CONSOLE is for a local host connection to the management module This is used the first time the switch is connected An HAR 000028 harness is included in the package to connect to a DB9 connection on a host PC Connecting to a local host PC and following the instructions in the Installation Guide Configuring the Switch for the First Time must be done before any remote management is available For the Socke
11. connector 3 pin type at connector number 19 on Figure 35 on page 45 Use the DB9 to 3 pin dongle in the MTUSB 1 accessory kit to connect to this primary 3 pin I2C con nector on the board to have direct access to the chip Connector number 20 on Figure 35 on 24 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 page 45 gives access to the secondary I2C connector Access to these connectors is only available with the top cover removed A This interface is for use with the help of Mellanox support personnel only 45 Switch Platform Installation and Operation Installation and initialization of the switch platform are straightforward processes requiring attention to the normal mechanical power and thermal precautions for rack mounted equipment The switch EVB platform requires initial configuration to operate as an InfiniBand switch All switches come with an internal PPC based management board This board allows for managing the switch through a host PC or remotely through the Ethernet 4 5 1 Installation Safety Warnings For Safety Warnings in French see Section G Avertissements de s curit d installation French on page 64 for German see Section H Installation Sicherheitshinweise German on page 68 and for Spanish see Section G Advertencias de seguridad para la instalaci n Span ish on page 77 1 Installation Instructions A Read all installation instructions before connecting the
12. cord that is internationally harmonized and marked lt HAR gt 3 conductor minimum 0 75 mm2 wire rated at 300 V with a PVC insulated jacket The cord must have a molded on plug cap rated 250 V 10 A 4 5 2 Mechanical Installation The switch platform can be rack mounted and is designed for installation in a standard 19 rack The power side of the switch includes a hot swap power supply module a blank cover and a hot swap fan tray There are two possible air flow directions Be sure that the switch air flow direc tion is compatible with your system rack and PSU The connector side of the switch has the data ports system LEDs and management connection ports The switch platform contains auto sensing 100 240 VAC connections for the PSU The installer should use a rack capable of supporting the mechanical and environmental charac teristics of a fully populated platform The rack mounting holes conform to the EIA 310 standard for 19 inch racks Take pre cautions to guarantee proper ventilation in order to maintain good airflow at ambient temperature Cable routing in particular should not impede the air exhaust from the chassis Mellanox Technologies 27 Rev 1 5 Basic Operation and Installation 4 6 Package Contents and Installation Before you install your new EVB board unpack the system and check to make sure that all the parts have been sent check this against the parts list below Check the parts for visible dam
13. equipment to the power source 2 Over temperature This equipment should not be operated in an area with an ambient temperature exceed A ing the maximum recommended 45 C 113 F Moreover to guarantee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings 3 Stacking the Chassis h The chassis should not be stacked on any other equipment If the chassis falls it can cause bodily injury and equipment damage 4 Redundant Power Supply Connection Electrical Hazard La This product includes a blank cover over the space for the redundant power supply Do not operate the product if the blank cover is not securely fastened or if it is removed Mellanox Technologies 25 Rev 1 5 Basic Operation and Installation 5 During Lightning Electrical Hazard LA During periods of lightning activity do not work on the equipment or connect or dis connect cables 6 Copper Cable Connecting Disconnecting Copper cables are heavy and not flexible as such they should be carefully attached to or detached from the connectors Refer to the cable manufacturer for special warnings A and instructions Support the weight of copper by tying them to the rack or to a cable management system 7 Rack Mounting and Servicing When this product is mounted or serviced in a rack special precautions must be taken A to ensure that the system remains stable In general you should fill the rack with equip ment starting f
14. into the Rail Slide 32 Figure 20 Power Supply Unit Extraction 33 Fi re 21 PSETPUlled a ee sant manne 34 Figure 22 Top and Bottom 35 Figure 23 Air Flow Labels 35 Figure 24 Fan Module Latches 36 Figure 25 Server Side Cards ne oe Ad bbe xcu See Ae uer uy 38 Figure 26 PCIE TGDE Extender 39 Figure 27 Screw Locations is a EREE 40 Figure 28 Slide the T OD Ste ate ae a 40 Figure 29 Management Board Installed 41 Figure 30 Unscrew the Management Board 41 Figure 31 Remove the Management Board 42 Figure 32 Holes for the Extender Board Interfaces 42 Figure 33 Install the Extender 43 Figure 34 Connecting the EVB to the Server Side Board 44 Figure 35 EVB Board Connections View 1 45 Mellanox Technologies 5 Rev 1 5 Figure 36 Reset Button 49 Fig
15. port Passive cables 100W 2 8W port Typ Typ 40GigE Active Cables 186W 5 2 W port Passive cables 104W 2 9 W port Max e Max 40GigE Active Cables 224W 6 2 W port Passive cables 119W 3 3W port Temperature 0 C to 45 C 56 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Appendix B Thermal Threshold Definitions Warning 100 C A warning threshold message will be sent by the MLNX OS management SW indicating the switch has crossed the Warning threshold The administrator should deal with the overheating At this point the switch will not shut down Critical 120 C At this temperature the firmware will automatically shut down the switch Emergency 1309C In case the firmware failed to shut down the SwitchX when reaching the Critical threshold a hardware mechanism will automatically shut down the switch at 1300C Mellanox Technologies 57 Rev 1 5 Appendix Replacement Parts Ordering Numbers Table 10 Replacement Parts Ordering Numbers Part Description OPN DB9 or RJ 45 to USB Adapter MTUSB 1 Fan module with power supply side to connector side air flow MSX60 FF Fan module with connector side to power supply side air flow MSX60 FR 300W Power Supply w Power Supply Side to Connector side air flow MSX60 PF 300W Power Supply w Connector side to Power Supply side air flow MSX60 PR Power cord
16. powered on and a cable is plugged into the port with the other end of the connec tor plugged into a functioning port After plugging in a cable lock the connector using the latch 34 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 ing mechanism particular to the cable vendor When a logical connection is made the yellow light will come on When data is being transferred the green light will blink Cables in the bottom row should be inserted up side down in relation to the how the cables are inserted in the top row Figure 22 Top and Bottom Ports To remove disengage the locks and slowly pull the connector away from the port receptacle Both LED indicators will turn off when the cable is unseated Care should be taken not to impede the air exhaust flow through the ventilation holes next to the connector ports Cable lengths should be used which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack 4 6 6 Extracting and Inserting the Fan Unit This switch can operate indefinitely with one of the three fans in the fan module inoperable so long as the ambient temperature is below 45 Celsius Operation without a fan unit should not exceed two minutes During fan hot swap if both indicators are OFF then the fan unit is disconnected Figure 23 Air Flow Labels XX II IIJ II XI II
17. the HCA cards connected to this switch system can be downloaded from the same site Mellanox Technologies 53 Rev 1 5 Troubleshooting 7 Troubleshooting As soon as a switch is plugged in make sure that the green power LEDs on the PSUs are on Status LED and or Status Health LED If either of these two LEDs is red unplug the switch and call your Mellanox representative Power supply unit If the LED on the PSU is not lit or is red check that the power cable is plugged into a working outlet 1 Check that the power cable has a voltage within the range of 100 240 volts AC 2 Check that the air flow direction of the PSUs are consistent with the Fan module air flow 3 Remove and reinstall the power cable 4 Remove and reinstall the PSU The power LED for the switch shuts off 1 Check that the there is adequate ventilation Are the fan LEDs showing that the fans are all up and running 2 Make sure that there is nothing blocking the front or rear of the chassis and that the fan modules and ventilation holes are not blocked especially dust over the holes 3 If you find dust blocking the holes it is recommended to clean the fan unit and remove the dust from the front and rear panels of the switch using a vacuum cleaner The green power LED for the fans does not come on 1 Check that the Power LEDs are on 2 Remove and reinstall the fan unit Make sure the mating connector of the new unit is free of any dirt and or obstacles See
18. 1 5 List of Figures Figure 1 Connector and Power Side Panels 9 Figure 2 PU Out Tab sks ERROR 1 eeu aes 12 Figure 3 Connector and Power Side 15 Figure 4 Power Side Panel 15 Figure 5 Power Fan and System LEDs 17 Figure 6 System Health LED saurer goo e n HR ER DURER 17 Figure 7 Power Side Panel 18 Figures PSU Status LEDS escai ce Rs xa Cd dee bad ER ER Pees 19 Figure 9 Fan Status LED Connector Side 19 Figure 10 Fan Status LED Power side 20 Foure dI Reset BUG a heen oe Sas ee SE EH TUE Ree 21 Figure 12 Port 22 Figure 13 Top and Bottom Ports 22 Figure 14 Management Interfaces 23 Figure 15 Rack Rail Kit Pans 29 Figure 16 Mounting Options Fe ee 30 Figure 17 Serewing on the Rail 31 Figure 18 Inserting the Caged Nuts 31 Figure 19 Slide the Rail
19. 1 TX packets 992717 RX mcast packets 0 TX discards 0 RX discards 0 TX errors 0 RX errors 0 TX overruns 0 RX overruns 0 TX carrier 0 RX frame 0 DS Collisions 0 TX queue len 1000 Mellanox Technologies 51 Rev 1 5 Connecting to the Switch Platform 6 Connecting to the Switch Platform When the Power PC is removed the switch EVB becomes externally managed A unmanaged and can only be managed through the host server management or through the remote Ethernet connector 6 1 I2C Connector The I2C connection provides access to Flash and EEPROMs This connection allows access to the switch for updating firmware when in band firmware updating is impossible Note The DB to 3 pin dongle in the MTUSB 1 accessory kit is used to connect to the pri mary 3 pin I2C connector on the board This is for use with the MTUSB 1 adapter This is nec essary only when updating firmware cannot be updated in band 4 This interface is for Debug and Troubleshooting only This interface is for FAEs and advanced users only When you install the switch it comes with the latest firmware burned on the board All firmware updates should be done in band This is only done when you receive an e mail that a newer firm ware version for your switch is available Download the latest firmware from http www mellanox com gt Support gt Firmware Download For instructions on downloading firmware see http www mellanox com mellanox com g
20. 45_DTR 2 G Looking into the Socket RXD RJ 45_TXD 3 O W GND GND 4 Bl GND GND 5 RXD RJ 45 RXD 6 O GND GND 7 Br W GND GND 8 Br 12C J34 TxD RJ45_SDA Pini En _ 8 ELSE GND cei GND END Pin 8 Looking into the Socket Mellanox Technologies 63 Rev 1 5 Appendix G Avertissements de s curit d installation French 1 Instructions d installation h Lisez toutes les instructions d installation avant de brancher le mat riel la source d alimentation lectrique 2 Temp rature excessive Ce mat riel ne doit pas fonctionner dans une zone avec une temp rature ambiante d passant le maximum recommand de 45 C 113 F Un flux d air de 200LFM YN cette temp rature ambiante maximale est n cessaire En outre pour garantir un bon coulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation 3 Empilage du ch ssis LA Le ch ssis ne doit pas tre empil sur un autre mat riel Si le ch ssis tombe il peut pro voquer des blessures corporelles et des d gradations de biens 4 Connection d Alimentation electrique excedentaire dangers lectriques Ce produit comporte un couvercle transparent sur l espace pour l alimentation lec h trique redondante Ne pas faire fonctionner le produit si le couvercle transparent n est pas solidement fix ou s il est enlev 5 Syst me de fusible neutre double p le Avertissement
21. 56 58 60 2 64 66 68 70 74 76 78 84 86 88 90 92 94 96 98 100 102 104 106 108 112 114 116 118 120 miu e y N un ew o oo Re 3 al S SS Y e HH a S Ss GBEI MDII RXO 4 12V MDII RXO GBE1_MDI1 RX0 6 12V GBEO_MDI1 RX0 7i factory GND restore 8 X GND 9 GP LV MDIO TXO 10 3 3V GBEO_MDIO TXO 11 GP_HV GBE1_MDI0 TX0 12 3 3V GBEO_MDIO TX0 13 X GND 14 3 3V GND 15 Sys Err 2 5 GBE 16 x 2 5VA_GBE Mellanox Technologies 61 Rev 1 5 Table 11 Connector Pinout 62 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Appendix F RJ 45 CONSOLE and Ethernet interfaces The RJ 45 CONSOLE and Ethernet interfaces uses the EIA 568A standard wiring color coding CONSOLE 5 Table 12 RJ 45 Pinout o ense PIN Connection Signal Pin Color RI45_DTR TXD RJ 45_RTS G W __ _ GND TXD RJ
22. 9964 XxX II II II II II 99 II 58 EE IIJ XX xx 99 II 49 64 rr II II 11 II XI II II II II 11 II 11 II These air flow labels must be the same gt To extract a Fan Unit 1 Using two fingers push both latch releases towards each other simultaneously while pulling the fan module out of the switch As the fan unseats the fan status indicator will turn off Mellanox Technologies 35 Rev 1 5 Basic Operation and Installation Figure 24 Fan Module Latches 11 II II xr II 11 II II XI II 11 11 II xr II IX II IY II II 11 II XI II ix Pol ZE xx Xx LoS 654 99 FA r 99 94 XX 654 99 II 996 Lei 1 79 691 ZT wx II 99 II XIJIL XX voi 9 54 ba pa ba pa Domo IXI II XIJ II r xr XX xr II II IX IX II II II IY Ik I XY xr II II xr Ir II II II These two latches must be pushed towards each other at the same time while the module is pulled out To insert a FAN Unit Make sure the mating connector of the new unit is free of any dirt and or obstacles 2 Insert the fan unit by sliding it into the opening until slight resistance is felt Continue press ing the fan unit until it seats completely The green fan status indicator should light If not
23. A quick push of this button performs this reset When the button is held down for 15 sec onds the switch is reset and the password is deleted You will then be able to enter without a pass word and make a new password for the user admin If the PCIE 1GbE Extender is installed the reset button resets the CPU of the switch device only Mellanox Technologies 21 Rev 1 5 Basic Operation and Installation 4 2 QSFP Cable Power Budget Classification The SwitchX EVB QSFP ports are designed for active cables with a max power per module of 2W Typical power per port is 1 5W 43 SFP Cable Power Budget Classification The SwitchX EVB SFP ports are designed for active cables with a max power per module of 1 5W Typical power per port is 1W 4 4 Interfaces 4 4 1 Port Connector Interfaces 4 4 1 1 36 Port Switches The Connector side of the switch EVB has 24 QSFP ports and 12 SFP ports These are placed in two rows 18 ports to a row The ports are labelled as shown in Figure 12 The bottom row ports are flipped from the top row See Figure 13 for bottom row top row port orientation Figure 12 Port Numbering Reference Traces 1 2 Reference Traces 35 36 One Trace and compliance pair 1 3 One Trace and compliance pair 33 35 TC 2580071595299 43 sun numum cs emm m Db asa FF ll m E FEE DE sa aS re A lea MEA 1a e men 26m AEE UIN_Y One Trace and compliance pair 2 4 One Trace and
24. FDR link speed FDRIO supports 20 more bandwidth over regular QDR using the same cables connec tors All ports can be set to gateway ports connecting to 40GigE over QSFP or 1 10GigE over QSA 4 032 Tb s aggregate data switching capacity with ultra low latency Mellanox Technologies 9 Rev 1 5 Overview 1 4 Management CPU The EVB comes with a Power PC 460E CPU for management It also comes with a PCIE 1GbE Extender that allows the user bypass the management CPU and to connect directly to the chip When the PCIE 1GbE Extender is used the Power PC is removed from the sys tem and none of the management interfaces on the connector side will work When the Power PC is removed the switch EVB becomes unmanaged and does NOT need Initial configuration 1 2 PCIEAGbE Extender The Power PC management module can be removed and in its place PCIE 1GbE extender can be installed When the Management module is removed the EVB becomes externally managed The PCIE 1GbE extender kit contains the system side board and the server side board The board has four connectors Interface Description CX4 connector for clocking and reset 2 QSFP connectors one is blue one is green The green one goes from the green labeled connector on the EVBduaghter board to the green label on the server side card included in the kit The blue one goes from the blue labeled connector on the EVBduaghter board to the blue labe
25. FP TX Data 45 RJ45 Ethernet management connection 46 SMA Clock Option for ext clock 106 25MHz 47 SMA Calibration Calibration of length X 48 SMA Calibration Calibration of length X 49 SMA Calibration Calibration of length X 50 SMA Calibration Calibration of length X 51 Mini SMP Reference Connects to Port 35 Ref to compliance port 33 52 Mini SMP Reference Connects to Port 35 Ref to compliance port 33 53 Mini SMP Reference Connects to Port 36 Ref to compliance port 34 54 Mini SMP Reference Connects to Port 36 Ref to compliance port 34 55 Mini SMP Reference Connects to Port 36 Ref to compliance port 34 56 Mini SMP Reference Connects to Port 36 Ref to compliance port 34 Mellanox Technologies 47 Rev 1 5 Installing the PCIE 1GbE Server Side board Table 7 Port Connector Numbering Continued Sheet 3 of 3 Connector Type Signal Description 57 Mini SMP Reference Connects to Port 35 Ref to compliance port 33 58 Mini SMP Reference Connects to Port 35 Ref to compliance port 33 59 Mini SMP Data SX HW Port 36 RX lane D Negative 60 Mini SMP Data SX HW Port 36 RX lane D Positive 61 Mini SMP Data SX HW Port 36 RX lane B Negative 62 Mini SMP Data SX HW Port 36 RX lane B Positive 63 Mini SMP Data SX HW Port 36 RX lane A Negative 64 Mini SMP Data SX HW Port 36 RX lane A Positive 65 Mini SMP Data SX HW Port 36 RX lane C Negative 66 Min
26. Figure 29 Management Board Installed Mellanox Technologies 41 Rev 1 5 Installing the PCIE 1GbE Server Side board Figure 31 Remove the Management Board Pull up the management card 5 4 Installing the PCIE 1GbE Extender 1 Place the ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Put the connectors for the extender daughter board through the holes in the frame Figure 32 Holes for the Extender Board Interfaces Set the connectors through these holes 42 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Figure 33 Install the Extender Board Push the daughter board down into the board connector Screw in the four screws Remove the blank panel from the power side of the EVB Put the wire ties onto the bottom of the case Run the cables through the power side end of the EVB The cables are for 10 100 1000Mb Ethernet management RJ45 Ethernet cable Connect the RJ45 cable to a switch or server Ethernet port This is 10 100 1000Mb interface For PCIE control 1 CX4 cable 2 QSFP cables blue to blue and green to green Connect all 3 connectors blue green and Clock from E
27. Mellanox TECHNOLOGIES SwitchX Evaluation Board Hardware User Manual PN MT51336 EN EVB MT51336 VPI EVB Rev 1 5 www mellanox com NOTE THIS HARDWARE SOFTWARE OR TEST SUITE PRODUCT PRODUCT S AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS IS WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUSTOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY ANY EXPRESS OR IMPLIED WARRANTIES INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY FROM THE USE OF THE PRODUCT S AND RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE Me
28. N 3 Leiter 18 AWG mit einem angespritztem Stecker bewertet bei 125 V 15 mit einer Mindestl nge von 1 5 m Six Feet aber nicht mehr als 4 5 m Fiir die europ ischen Zusammenhang w hlen Sie ein Netzkabel das international harmonisiert und der Aufschrift lt HAR gt 3 Leiter mindestens 0 75 mm2 Draht bewertet mit 300 V mit einem PVC Mantel isoliert Das Kabel muss eine angespritztem Stecker bewertet bei 250 V 10 A 15 Ableitstrom gt 3 5mA LEAKAGE gt 3 5mA LA WARNUNG Hohe Ableitstrom Earth Verbindung bevor Sie die Verbindung von wesentlicher Bedeutung werden 16 Add GND Verbindung Informationen LA Bevor Sie dieses Ger t an das Stromnetz die Schutzerde Terminal Schrauben dieses Ger t muss an den Schutzleiter in der Geb udeinstallation 17 Installation Codes Dieses Ger t muss installiert sein entsprechend auf die neueste Version des Landes LA National Electrical Code F r Nordamerika m ssen in bereinstimmung mit den gel tenden Vorschriften in der US amerikanischen National Electrical Code und dem Canadian Electrical Code 18 Zusammenschaltung von EINHEITEN Kabel f r den Anschluss an das Ger t RS232 und Ethernet Schnittstellen m ssen UL zertifiziert Typ DP 1 oder DP 2 Hinweis wenn nicht mit Wohnsitz in LPS Schal 4 tung berstromschutz Eine leicht zug ngliche Auflistung Abzweigleitung berstrom Schutzeinrichtung 20 A bewertet werden m ssen in dem Geb ude Verkabelung 19 Zwe
29. Serial Number and Product Version Information 11 Chapter 2 40 Gb s 1 13 Chapter 3 FDR E uk na ER e ELA OE 14 Chapter 4 Basic Operation and Installation 15 4 1 Switch Platform Hardware Overview 15 4441 Status LEDS na Mas SCR 16 4 1 2 Reset Button 21 4 2 QSFP Cable Power Budget Classification 22 4 3 SFP Cable Power Budget Classification 22 2 4 MISH ACCS FO So D eee Laid 22 4 4 1 Port Connector Interfaces 22 4 4 2 Management and Firmware Updating Interfaces 23 4 5 Switch Platform Installation and Operation 25 4 5 1 Installation Safety Warnings 25 4 5 2 Mechanical Installation 27 4 6 Package Contents and Installation 28 4 6 1 Installing the Switch in the 28 4 6 2 Grounding the 32 4 6 3 Power Connections and Initial Power 33 4 6 4 Extracting and Inserting the Power Supply Unit 33 4 6 5 Cable I
30. Type C13 C14 ACC000500 Installation Kit for short switches in racks 40 60 cm deep MSX60 BKIT Installation Kit for short or standard switches in racks 60 80 cm deep MSX60 SKIT 58 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Appendix D Transferring the Power Cord To use the rail kit to transfer the power cord from the connector side to the power side follow these directions Do you want to install power cords on both sides of the switch or only one side For each power cord you want to transfer 1 Once you have decided which side of the switch will be next to the vertical support 2 Make sure that you place the cord so that the correct end of the cord will be at the power side of the switch This will depend on which of the four mounting options you choose Figure 38 Transfer Power Cord 3 Put the power cord in the switch slide channel 4 Push the cord end through the hole in the switch slide Leave 7 of cord hanging out from the hole 5 Screw the switch slides to the switch Mellanox Technologies 59 Rev 1 5 Figure 39 Install the Switch Slide Figure 40 Transfer Power Cord Finished 6 Return to step 4 on page 36 and continue the installation 60 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Appendix E Samtec Connector Pinout Figure 41 Connector Pinout 46 48 52 54
31. a a tierra de protecci n y un t cnico de servicio deber conectar permanentemente el equipo a dicho medio de conexi n Un T CNICO DE SERVICIO comprobar si la toma el ctrica de la que se suminis trar corriente al equipo provee una conexi n con la puesta a tierra de protecci n del edificio De no ser as el T CNICO DE SERVICIO se encargar de instalar un CON DUCTOR DE CONEXI N A TIERRA DE PROTECCI N del terminal de puesta a tierra de protecci n separado al conductor de tierra de protecci n del edificio El equipo se instalar en un rea donde haya conexi n equipotencial como por ejemplo un centro de telecomunicaciones o una sala de computadoras dedicada 16 C digos de instalaci n Este dispositivo se debe instalar conforme a la versi n m s reciente de los c digos el ctricos nacionales del pa s en cuesti n En Am rica del Norte el equipo se debe instalar de acuerdo con las disposiciones vigentes del C digo El ctrico Nacional de los EE UU y del C digo El ctrico de Canad 17 Directiva sobre RAEE Conforme a la Directiva 2002 96 CE sobre RAEE todos los residuos de equipos el c tricos y electr nicos EEE se deben recolectar por separado y no se deben eliminar junto con residuos dom sticos Al deshacerse de este producto y de todas sus partes h galo de una manera respon sable y respetuosa con el medio ambiente EEN dor 74 Mellanox Technologies
32. age that may have occurred during shipping The switch comes packed with the following items Part Quantity Description EVB Switch 1 Switch PCIE 1GbE 1 kit that replaces the management module and allows for external man Extender kit agement Power cable 1 Type B 6ft US 125V 10 chord See Replacement Parts Ordering Num bers on page 58 to order power cords for various countries harness 1 For connecting from the RJ45 CONSOLE connector to a DB9 connector of a laptop host MTUSB 1 MTUSB For use by Mellanox FAEs only QSA 2 QSFP to SFP Adapter modules MC2207130 002 2 QSFP FDR 30AWG 2m cables MC3309124 004 2 SFP 30AWG 2m cables bumpers 5x Rubber feet for using the EVB on a table top A If anything is damaged or missing contact your customer representative immediately 4 6 1 Installing the Switch in the Rack Tools and Customer Supplied Parts Phillips Screwdrivers 1 and 2 grounding screw ESD strap grounding wire sufficient to reach a valid ground ESD mat 28 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Parts included in the rail kit e 2 rails 14 recessed flat head screws for the standard switch e 2 rail slides 10 caged nuts e 2 switch slides 10 pan head screws M6 Figure 15 Rack Rail Kit Parts Switch slide Rail Rail slide c EI gt
33. aut 10 Fuite gt 3 5mA Leakage gt 3 5mA ATTENTION La connexion la terre des forts courants de fuite est essentielle avant le branchement de l alimentation Avant de brancher l appareil la conduite d alimentation les vis de protection la terre du terminal de l appareil doivent tre appliqu es l installation de protection la Terre du b timent 11 Forts Courants de Fuite High Leakage Current A Attention Forts courants de fuite Il est essentiel de relier a la terre avant de brancher l alimentation 12 Ajouter une information de connexion la masse Connect a Valid Ground to this Device terre du terminal de l appareil doivent tre appliqu es l installation de protection la Avant de brancher l appareil la conduite d alimentation les vis de protection la Terre du b timent Mellanox Technologies 65 Rev 1 5 13 Installation du mat riel LA Ce mat riel ne doit tre install remplac ou entretenu que par du personnel form et qualifi 14 Elimination du mat riel LA L limination de ce mat riel doit s effectuer dans le respect de toutes les l gislations et r glementations nationales en vigueur 15 Codes lectriques locaux et nationaux YN Ce mat riel doit tre install dans le respect des codes lectriques locaux et nationaux 16 Codes d installation L appareil doit tre install selon l ancienne version des codes lectriques nationaux du A pa
34. cal Support Connector side Rack door Power sid Connector side ower side Connector side Connector side 3 Decide which mounting option you want to use 4 Screw the switch slides onto the switch Use 5 flat head screws for short switches and 7 screws for standard depth switches to connect each switch slide 30 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Figure 17 Screwing on the Rail 7 screws per side are needed for the standard switch Figure 18 Inserting the Caged Nuts Side you will slide the swich into Second side eh lekeel 5 Clip 6 caged nuts into the holes in the rack on the side of the rack you will be sliding the switch into Check that both sides of the switch power side and connector side are at the same level in the rack 6 Clip 4 more caged nuts into the holes on the opposite side of the rack Check that both sides of the switch left and right are the same level in the rack 7 Slide the rail into the rail slide 8 Using two of the bolts for each corner install the rails and rail slides in the rack Do not tighten the bolts yet Mellanox Technologies 31 Rev 1 5 Basic Operation and Installation Figure 19 Slide the Rail into the Rail Slide This side of the rail kit goes on the side of the rack you will slide the switch int
35. ctor LED Assignment Above the ports are two LEDs one for the upper port and one for the lower port V The fol lowing table shows the port status according to the LED indication Mellanox Technologies 17 Rev 1 5 Basic Operation and Installation Table 3 Connector Physical and Logical Link Indications LED Status LED Description Off No power to the port Solid Green Logical link up Flashing Green Data activity flashing speed is proportional to data transfer speed Solid Orange Physical link up Flashing Orange A problem with the physical link Usually the SM is down or not enabling the port 4 1 1 4 Power Supply Status Indicators The switch EVB is only available with one installed Power Supply Unit Figure 7 Power Side Panel Fan status LED PSUI status LED Power Supply Unit Fan Unit PES The power supply unit PSU is located on the right side of the power side panel The PSU has a single 2 color LED on the right side of the PSU that indicates the internal status of the unit 18 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Figure 8 PSU Status LEDs This is a two color LED D Green OK Red Major fault Off No power to the system Fan air flow indicator 9 Table 4 PSU Status LED Configurations LED Color Status Solid Green OK The Power supply is delivering the correct voltage 12VDC Solid Red Error The PSU is no
36. ed in IEEE 802 3ap chapter 74 FDRIO is only guaranteed to work with approved Mellanox ConnectX 3 adapters 5 14 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 4 Basic Operation and Installation 4 1 Switch Platform Hardware Overview Figure 4 shows the power side panel and connector side panel views of the switch EVB Figure 3 Connector and Power Side Panel mu 51 Fa UID RST The figure shows port configurations for the switch systems including e 2 Ethernet RJA5 connectors e RJ45 connector for connecting to a host PC CONSOLE e connector 24 QSFP ports 12 SFP ports various switch port fan and power status LEDs Figure 4 Power Side Panel e hot swap fan module e power supply unit e 1 I2C connector various switch port fan and power status LEDs All connectivity except for power cords is via the connector side panel All connectors can sup port active cables Mellanox Technologies 15 Rev 1 5 Basic Operation and Installation 4 1 1 Status LEDs 4 1 1 1 System Status Indicators The System Status indicators A are located to the left of the connectors on the connector side panel and on the power side at the far right Both of these LEDs give identical information Green OK Yellow a fault in the sys tem Red Major Fault or Fatal Error Led Color shows the switch status Power side Connector
37. i SMP Data SX HW Port 36 RX lane C Positive 67 Mini SMP Data SX HW Port 36 TX lane A Positive 68 Mini SMP Data SX HW Port 36 TX lane A Negative 69 Mini SMP Data SX HW Port 36 TX lane B Positive 70 Mini SMP Data SX HW Port 36 TX lane B Negative 71 Mini SMP Data SX HW Port 36 TX lane C Positive 72 Mini SMP Data SX HW Port 36 TX lane C Negative 73 Mini SMP Data SX HW Port 36 TX lane D Positive 74 Mini SMP Data SX HW Port 36 TX lane D Negative 75 SMA Clock Option for ext clock 156 25MHz 5 7 Switch Shut Down Procedure To shut down the switch run the command Reload halt noconfirm The switch cannot be restarted remotely A To restart the switch you must physically go to the switch and unplug and replug in all of the power cords to the chassis 5 8 Disassembly of the Switch from the Rack To disassemble the switch from the rack 48 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Unplug and remove all connectors Unplug all power cords Remove the ground wire PSN Unscrew the 2 bolts from the side of the switch with the bracket A Support the weight of the switch when you remove the screws so that the switch does not fall 5 Slide the switch from the rack 6 Remove the rail slides from the rack 7 Remove the eight caged nuts 5 9 Disposal According to the WEEE Directive 2002 96 EC all waste electrical and electronic equipment EEE sho
38. ion History Table 1 Revision History Revision Description 1 5 Fixed Figure 35 and Table 7 Added Power up sequence to Section 5 5 1 4 Added Appendix B Thermal Definitions 1 3 Decision to include I2C power side interface 1 2 Changes recommended by the field application engineers 1 1 Added Internal I2C section 1 0 Initial Release 8 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 1 Overview This EVB is intended to be used as a platform to evaluate the SwitchX silicon SW engineers can use it as a means for SW development using the SwitxchX SDK SW developers can imple ment initial driver development integration into non PPC CPU environments Signal integrity engineers can use it to evaluate SwitchX SI performance and compliance to spec This EVB can be used to evaluate and qualify Ethernet SerDes IB SerDes FC SerDes Initial Ethernet and IB switch testing for L2 L2 This EVB can be used both while rack mounted standard 19 rack and in a tabletop setup for Signal Integrity evaluation Figure 1 Connector and Power Side Panels PS1 UID RST Full Feature List Reference traces SMA and mini SMP Compliance ports SMA and mini SMP e 2 ports connect to mini SMP connectors for SI testing 24 QSFP ports PSU 8 SFP ports 24 FDR 56Gb s ports in a 1U switch 1 3 and 1 21 complaint SDR DDR QDR FDR10
39. ipolige bzw Neutralleiter Sicherung im Netzteil Achtung LA Zweipolige bzw Neutralleiter Sicherung im Netzteil Netzstecker ziehen um sicher zustellen da keine Spannung am Ger t anliegt Entfernen Sie alle Netzkabel vor dem ffnen der Abdeckung dieses Produkts oder dem Ber hren der Innenteile 70 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 LA A EL LZ 40 Ibs 40 70 lbs 70 121 lbs gt 121 lbs 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 20 Bodily Injury Due to Weight Use enough people to safely lift this product Mellanox Technologies 71 Rev 1 5 Appendix Advertencias de seguridad para la insta laci n Spanish 1 Instrucciones de instalaci n y Antes de conectar el equipo a la fuente de alimentaci n leer todas las instrucciones de instalaci n 2 Lesi n corporal por peso A e 40 Ibs 40 70 lbs 70 121 lbs gt 121 lbs lt 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 3 Lesi n corporal por peso A This equipment is very heavy and should be moved using a mechanical lift to avoid injuries 4 Sobrecalentamiento No se debe utilizar el equipo en un rea con una temperatura ambiente superior a la m xima recomendada 45 C Adem s para garantizar una circulaci n de aire adec A uada se debe dejar como minimo un espacio de 8 cm 3 pulgadas alrededor de las aberturas de ventilaci n 5 Apilamiento del chasis Los chasis no se deben apilar sob
40. l on the server side card included in the kit Server Side board a card that gets inserted into the server X8 PCI slot Use only one option the PCIE or the Ethernet do not use both RJ 45 connector for management through an ethernet port The server side board in the kit gets inserted in a server Connect the card into a 8X or 16X PCI slot This card has 3 ports Interface Description CX4 connector for clocking and reset 2 QSFP connectors is blue one is green The green one goes from the green labeled connector on the EVBduaghter board to the green label on the server side card included in the kit The blue one goes from the blue labeled connector on the EVBduaghter board to the blue label on the server side card included in the kit 10 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 1 2 4 PCIE Extender Kit This option allows the EVB to be managed through the server This is done with three cables connecting the EVB to the Server One cable is for clocking and reset and two cables are for data TX and RX 1 2 2 1GbE Extender Kit The PCIE extender allows for remote management through the 10 100 1000Mb RJ45 Ethernet connection on the EVB Extender side board This is connected to any standard Ethernet port fab ric management port 1 3 Compliance Ports Ports 3 and 4 and 33 and 34 are connected to the chip These are compliance ports and go to the
41. ler Umgebungstemperatur erforderlich Au erdem sollten mindestens 8 cm 3 in Freiraum um die Bel ftungs ffnungen sein um einen einwandfreien Luftstrom zu gew hrleisten 3 Stapeln des Chassis LA Das Chassis sollte nicht auf andere Ger te gestapelt werden Wenn das Chassis herun terf llt kann es zu Verletzungen und Besch digungen an Ger ten f hren 4 Redundanter Stromversorgungsanschluss Elektrische Gefahr Dieses Produkt verf gt ber eine Abdeckung ber dem Bereich f r die redundante LA Stromversorgung Betreiben Sie das Produkt nicht wenn diese Abdeckung nicht sicher festsitzt oder entfernt wurde 5 Bei Gewitter Elektrische Gefahr LA Arbeiten Sie w hrend eines Gewitters und Blitzschlag nicht am Ger t schlie en Sie keine Kabel an oder ab 6 AnschlieBen Trennen von Kupferkabel Kupferkabel sind schwer und nicht flexible Deshalb m ssen sie vorsichtig an die LA Anschl sse angebracht bzw davon getrennt werden Lesen Sie die speziellen Warnun gen und Anleitungen des Kabelherstellers 7 Gafahr des elektrischen Schocks Gafahr des elektrischen Schocks Entferrnen des Netzsteckers elnes Netzteils span LA nungsfrei Um alle Einhieten spannungsfrei zu machen sind die Netzstecker aller Netz teile zu entfernen 68 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Risk of electric shock and energy hazard h The PSUs are all independent Disconnect all power supplies to ensure a
42. llanox TECHNOLOGIES Mellanox Technologies Mellanox Technologies Ltd 350 Oakmead Parkway Suite 100 Beit Mellanox Sunnyvale CA 94085 PO Box 586 Yokneam 20692 U S A Israel www mellanox com www mellanox com Tel 408 970 3400 Tel 972 0 74 723 7200 Fax 408 970 3403 Fax 972 0 4 959 3245 Copyright 2013 Mellanox Technologies All Rights Reserved Mellanox Mellanox logo BridgeX ConnectX CORE Direct InfiniBridgeG InfiniHost InfiniScale MLNX OS PhyX SwitchX UFMO Virtual Protocol Interconnect amp and Voltaire are registered trademarks of Mellanox Technologies Ltd Connect IB FabricIT Mellanox Open Ethernet MetroX MetroDX ScalableHPC Unbreakable Link are trademarks of Mellanox Technologies Ltd All other trademarks are property of their respective owners 2 Mellanox Technologies Document Number 3493 SwitchX Switch EVB Hardware User Manual Rev 1 5 Table of Contents Revision History i522 2 4 332 9 Qr ida ge Br Chapter 1 9 14H Management Lar ee 10 1 2 PCIE 1GbE Extender Kilo a sc a 10 1 2 4 PCIE Extender Kit A A A WIRE 11 1 2 2 Extender 11 1 3 Compliance Pons c exu ce ia sos 11 1 4 Reference Traces 11 1 5
43. n installing this equipment 4 6 3 Power Connections and Initial Power On The switch platform ships with one Power Supply Unit The input voltage is auto adjusting for 100 240 VAC 50 60Hz power connections The power cord should be standard 3 wire AC power cord including a safety ground and rated for 15A or higher Caution The switch platform will automatically power on when AC power is applied A There is no power switch Check all boards power supplies and fan tray modules for proper insertion before plugging in a power cable Caution After inserting a power cable and confirming the green system status LED i light is on make sure that the Fan Status indicator shows green If the fan status indicator is not green then unplug the power connection and check that the fan module is inserted properly and that the mating connector of the fan unit is free of any dirt and or obstacles A Caution When turning off the switch make sure to use the shut down procedure 4 6 4 Extracting and Inserting the Power Supply Unit Power supply unit has directional air flow similar to the fan module The Fan module A airflow must coincide with the airflow of the PSU If the PSU airflow direction is dif ferent from the fan module airflow direction the system will shut down Figure 20 Power Supply Unit Extraction 644 XIJ II XIJ II xXx II 9691 IIJ II 779 64 XX 694 9691 II II Latch Relea
44. nstallation 34 4 6 6 Extracting and Inserting the Fan Unit 35 Chapter 5 Installing the PCIE 1GbE Server Side board 37 5 1 PCIE 1GbE Extender Kit parts 37 5 2 Removing the Top 39 5 3 Removing the Management 41 5 4 Installing the PCIE 1GbE 42 5 5 Installing the Server Side Board 44 5 6 Board Connectors Numbering and Locations 45 5 7 Switch Shut Down Procedure 48 5 8 Disassembly of the Switch from the 48 5 91 IDISPOSA cee a ee oise 49 Mellanox Technologies 3 Rev 1 5 5 10 Resetting the Switch 49 5 11 Configuring the Switch for the First Time 50 Chapter 6 Connecting to the Switch Platform 52 Gl 2 COMES Cea doom seed we ose eee 52 6 2 How to Get Mellanox Firmware Tools 52 6 97 Updating Firmware e So aed OO awe ae PS 53 Chapter 7 Troubleshooting 54 4 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev
45. o This is the same side of the switch that will be next to the vertical support 9 Slide the switch into the rails 10 Tighten the bolts to 9 2 Nm or 81 5 pound inches 11 Put the switch into place and screw the bolts into the nuts Tighten the bolts to 9 2 Nm or 81 5 pound inches 12 Ground the switch 13 Plug in the power cables 14 Check the Status LEDs and confirm that all of the LEDs show status lights consistent with normal operation Warning Any yellow or red status LEDs are cause for concern and must be dealt with i immediately It can take up to 5 minutes to boot up during which time the status LED may indicate flashing green 15 You can start connecting all of the cables to the switch 4 6 2 Grounding the Switch Check to determine if your local or national electrical codes require an external ground to all IT components If so connect a ground wire to one of the casing screws and connect the other end to a valid ground If you choose to not use the ground screw make sure that the rack is properly 32 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 grounded and that there is a valid ground connection between the chassis of the switch and the rack Test the ground using an Ohm meter Some national and or local codes may require IT components to be bonded and exter nally grounded not including the power cord ground You must follow all national Adi and local codes whe
46. o para componentes el ctricos y mec nicos y contra incen dio 12 Eliminaci n de equipos La eliminaci n definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales 13 C digos el ctricos locales y nacionales LA Este equipo se debe instalar conforme a los c digos el ctricos locales y nacio nales Mellanox Technologies 73 Rev 1 5 14 Cable de alimentaci n homologado por UL y con certificaci n CSA En conexiones de Am rica del Norte seleccionar un cable de alimentaci n homologado por UL y con certificaci n CSA de tres conductores 16 AWG termi A nado en un enchufe moldeado con capuch n de 125 voltios nominal 13 A con una longitud m nima de 1 5 metros pero no m s de 4 5 metros En conexiones europeas seleccionar un cable de alimentaci n armonizado internacionalmente y marcado lt HAR gt de tres conductores hilo de 1 0 mm2 como m nimo 300 voltios nominal con cobertura protectora aislante de PVC El cable debe tener un enchufe moldeado con capuch n de 250 voltios nominal 10 A 15 Afiadir conexi n a tierra Antes de conectar el dispositivo a la l nea de alimentaci n los tornillos del terminal de la puesta a tierra de protecci n del dispositivo se deben conectar a la puesta a tierra de A protecci n de la instalaci n del edificio Informaci n de conexi n a tierra La instalaci n del edificio deber prover un medio para la conexi n con la puest
47. o the CONSOLE RJ 45 port of the switch and not to the Ether net MGT port gt No remote IP connection is available at this stage 2 Configure a serial terminal program for example HyperTerminal minicom or Tera Term on your host PC with the settings described in Table 8 Table 8 Serial Terminal Program Configuration Parameter Setting Baud Rate 9600 Data bits 8 Stop bits 1 50 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Table 8 Serial Terminal Program Configuration Continued Parameter Setting Parity None Flow Control None 3 Login from a serial terminal program as root and use root as password This starts the Mel lanox configuration wizard 4 Before attempting a remote for example SSH connection to the switch check the mgmt0 interface configuration Specifically verify the existence of an IP address To check the cur rent mgmt0 configuration enter the following commands Sx 43 standalone master gt enable Sx 43 standalone master show interfaces mgmt0 The following is an example of the output Interface mgmt0 state Admin up yes Link up yes IP address 11872 o 110 5 413 Netmask 255429523340 Speed 1000Mb s auto Duplex full auto Interface type ethernet Interface source physical MTU 1500 HW address 00 02 C9 11 2A AE Comment RX bytes 1343502058 TX bytes 313920869 RX packets 1758921
48. ons are possible 20 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Table 6 Bad Port LED Configurations LED Configuration Description Off OK All ports are up and running Flashing Orange Error or possibly more ports has just received a symbol error This LED shows symbol errors Possible causes for this are bad cable bad connection bad connector This LED lights up when one or more ports is receiving a symbol error The LED immediately goes off until the next symbol error is received 4 1 1 7 UID LED Switch Identifier The UID LED is a debug feature that will become available to customers in the near future For details please contact Mellanox Technologies support 4 1 2 Reset Button On the connector side panel under the system LEDs is a reset button This reset button requires a tool to be pressed a paper clip will do A DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset button Sharp objects can cause damage use a flat object such as a paper clip Figure 11 Reset Button Use an opened paper clip to press the reset button for 15 seconds to reset the main and management CPUs and to delete the existing password This button resets both the CPU of the switch device and the CPU of the management module It thereby resets all of the ports by bringing them down and powering them up when the button is pushed
49. powered down state inside of the switch platform 8 Rack Montage und Wartung sichtsma nahmen zu ergreifen um die Stabilit t des Systems zu gew hrleisten Im Wenn dieses Produkt in einem Rack montiert oder gewartet wird sind besondere Vor Allgemeinen sollten Sie das Gestell von unten nach oben mit Ger ten f llen 9 Ger teinstallation h Diese Ger t sollte nur von geschultem und qualifiziertem Personal installiert ausge tauscht oder gewartet werden 10 Ger teentsorgung h Die Entsorgung dieses Ger ts sollte unter Beachtung aller nationalen Gesetze Bestim mungen erfolgen 11 Regionale und nationale elektrische Bestimmungen LA Dieses Ger t sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden 12 Richtigen Schutz sicherstellen LA Geeigneter elekrischer mechanischer und Feuerschutz sind vom Hersteller des Endprodukts oder dem Endbenutzer bereitzustellen 13 Strahlenkontakt Achtung Nutzung von Steuerungen oder Einstellungen oder Ausf hrung von Proze duren die hier nicht spezifiziert sind kann zu gefahrlichem Strahlenkontakt f hren Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards ICE 60 825 1 1993 A1 1997 A2 2001 und EN 60825 1 1994 A1 1996 A2 2001 Mellanox Technologies 69 Rev 1 5 14 UL und CSA Certified Netzkabel F r Nordamerika Stromanschluss w hlen Sie ein Netzkabel das UL und CSA Certi fied Y
50. re otros equipos La ca da del chasis podr a causar lesiones corporales as como da os al equipo 6 Dos fusibles uno en el polo y otro en el neutro Dos fusibles uno en el polo otro el neutro los cables de corriente antes de abrir la tapa de este producto o tocar cualquier componente interno 72 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 7 Cuando hay rayos peligro de descarga el ctrica A No utilizar el equipo ni conectar o desconectar cables durante per odos de actividad de rayos 8 Conexi n y desconexi n del cable Copper Dado que los cables de cobre son pesados y no son flexibles su conexi n a los conec tores y su desconexi n se deben efectuar con mucho cuidado Para ver advertencias o A instrucciones especiales consultar al fabricante del cable 9 Montaje y mantenimiento de bastidores Al instalar o realizar el mantenimiento de este aparato en un bastidor es preciso adop tar precauciones especiales para garantizar que el sistema se mantenga estable En gen eral en un bastidor los equipos se deben instalar comenzando desde abajo hacia arriba 10 Instalaci n de equipos La instalaci n el reemplazo y el mantenimiento de este equipo estar n a cargo nica mente de personal capacitado y competente 11 Asegurar confinamientos adecuados El fabricante del producto final o el usuario final deber n suministrar LA un confinamiento adecuad
51. rom the bottom to the top 8 Equipment Installation This equipment should be installed replaced or serviced only by trained and qualified personnel 9 Equipment Disposal A Disposal of this equipment should be in accordance to all national laws and regula tions 10 Local and National Electrical Codes T This equipment should be installed in compliance with local and national electrical codes 11 Battery Replacement There is a risk of explosion should the battery be replaced with a battery of an incorrect A e Dispose of used batteries according to the instructions 26 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 12 Hazardous Radiation Exposure Caution Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure CLASS 1 LASER PRODUCT and reference to the most recent laser standards IEC 60 825 1 1993 A1 1997 A2 2001 and EN 60825 1 1994 A1 1996 A2 2001 13 Do Not use as a Shelf Caution Slide rail mounted equipment is not to be used as a shelf or a work space 14 UL Approved AC Power Cords For North American power connection select a power supply cord that is UL Listed and CSA Certified 3 conductor 18 AWG terminated in a molded on plug cap rated at 125 V 15 A with a minimum length of 1 5m six feet but no longer than 4 5m gt For European connection select a power supply
52. se Mellanox Technologies 33 Rev 1 5 Basic Operation and Installation Figure 21 PSU Pulled Out Fan Unit PS Unit1 To extract a PSU 1 If possible run the shut down procedure See Switch Shut Down Procedure on page 48 2 Remove the power cord from the power supply unit 3 Grasping the handle with your right hand push the latch release with your thumb while pull ing the handle outward As the PSU unseats the PSU status indicators will turn off 4 Remove the PSU To insert a PSU 1 Make sure the mating connector of the new unit is free of any dirt and or obstacles A Do not attempt to insert a PSU with a power cord connected to it 2 Insert the PSU by sliding it into the opening until a slight resistance is felt 3 Continue pressing the PSU until it seats completely The latch will snap into place confirming the proper installation 4 Insert the power cord into the supply connector 5 Insert the other end of the power cord into an outlet of the correct voltage The green PSU indicator should light If not repeat the whole procedure to extract the PSU and re insert it 4 6 5 Cable Installation All cables can be inserted or removed with the unit powered on To insert a cable press the con nector into the port receptacle until the connector is firmly seated The GREEN LED indicator corresponding to each data port will light when the physical connection is established that is when the unit is
53. side status LED status LED The system status indicators should display as follows When the switch is plugged in within three minutes the STATUS LED should light up green The PSU LED should light up green If the PSU LED is not green this indicates a prob lem with the power supply The switch is operational only if the PSU LED is green The FAN LED should light up green If the FAN LED shows red troubleshoot the fan module 16 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 Figure 5 Power Fan and System LEDs Table 2 System Status LED Configurations LED Configuration STATUS System Health LED Solid Green OK The system is up and running Flashing Green The system is booting up Solid Yellow Error A fault in the system most likely the firmware did not BOOT properly Solid Red Major Error Possible damage can result to the switch Turn off immediately e g bad firmware can t boot overheated Off Off The system has no power 4 1 1 2 Power Side Panel System LED On the right side of the power side panel is a single system LED that displays the health of the switch This indicator is the same as the system status indicator on the other side of the switch The LED assignment is as in Table 2 Figure 6 System Health LED his is a three color ED Green OK Yellow Fault in the system Red Major fault 4 1 1 3 Port Conne
54. t Products gt Adapter IB VPI SW gt Firmware Tools Be sure to download the user manual appropriate to your OS Read the instructions in the User manual for the firmware update procedure 6 2 How to Get Mellanox Firmware Tools Mellanox Firmware Tools MFT and documentation are available for download via http www mellanox com mellanox com gt Products gt Adapter IB VPI SW gt Firmware Tools The MFT kit includes mlxburn flint spark debug utilities See Related Documentation on page 7 52 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 6 3 Updating Firmware When you buy the switch it comes with the latest firmware burned on the board AII firmware updates should be done through the management software Go to the Mellanox Website and con firm that the firmware is the latest If not reburn the latest firmware from the download site New firmware versions will be posted on the Mellanox firmware download page http www mellanox com gt Support gt Firmware Download You will also need to download and unzip the firmware binary image This is provided in the Mellanox Web site at http www mellanox com gt Support gt Firmware Download and go to the SwitchX Switch systems Click in the Table for the firmware image that you need Be sure to read and follow all of the instructions regarding the updating of the firmware on your switch system Firmware for
55. t operational Off Off There is no power to the system 4 1 1 5 Fan Status Indicators The indicator AN is located to the left of the connectors on the connector side panel Figure 9 Fan Status LED Connector Side This is a two color LED Green OK Red Major fault Off No power to the system The LED indicator on the Fan Module is on the right side of the module Mellanox Technologies 19 Rev 1 5 Basic Operation and Installation Figure 10 Fan Status LED Power side This is a two color LED Green OK Red Major fault Off No power to the system Fan air flow indicator The following fan status conditions are possible Table 5 Fan Status LED Configurations LED Configuration FAN LED Solid Green OK The system is up and running Solid Red Error One or more fans is not operating properly The system should be powered down and troubleshoot the fan module Off Off The fan unit is not receiving any power Check that the fan unit is properly and completely inserted A All fans must be operating while the power supply is plugged in A If the switch shuts down due to over temperature unplug the switch wait 5 minutes and replug in the switch For more information See Troubleshooting on page 54 4 1 1 6 Bad Port LED zm The Bad Port indicator is located on the left side of the connector side panel of the unit The following Bad Port conditi
56. t pinout see RJ 45 CONSOLE and Ethernet interfaces on page 63 This connector will not work if the management module is removed That is if you are using the PCIE 1GbE Extender aa Mellanox Technologies 23 Rev 1 5 Basic Operation and Installation 4 4 2 2 RJ 45 Ethernet Connector MGT The Ethernet connection labelled MGT provides access for remote management The switch can be connected to any Ethernet port This connector will not work if the management module is removed That is if you are using the PCIE 1GbE Extender Each Ethernet connector gets connected to Ethernet switches These switches must be configured to 10M 100M 1G auto negotiation 4 4 2 3 USB interface There is a single USB connector This connector can be used to install software and or firmware upgrades using a memory device that has a USB connector Zu This connector will not work if the management module is removed That is if you are using the PCIE 1GbE Extender 4 4 2 4 External 12C Interface There is an I2C connector on the far left of the power side of the switch This interface is NOT to be used by customers Use the internal I2C connectors for access to the 2c tree A This interface is for use with and by Mellanox support personnel only There are two 3 pin I2C interfaces on the board Access to these connectors is only available with the top cover removed 4 4 2 5 Internal I2C Interface There is an I2C
57. uld be collected separately and not disposed of with regular household waste Dispose of this product and all of its parts in a responsible and environmentally friendly way Follow the instructions found in the Mellanox Web site at mellanox com for proper instructions to disassemble and dispose of the Switch according to the WEEE directive 5 10 Resetting the Switch Should the switch stop working try resetting the switch On the connector side panel under the system LEDs is a reset button This reset button requires a tool to be pressed Figure 36 Reset Button Press the rest button This button resets the switch when the button is pushed A quick push of this button resets the whole switch When the button is held down for 15 seconds the switch is reset and the password is deleted The LEDs will flicker for a fraction of a second to indicate reset is occurring You will then be able to enter without a password and make a new password for the user admin Mellanox Technologies 49 Rev 1 5 Installing the PCIE 1 GbE Server Side board 5 11 Configuring the Switch for the First Time 4 When the Power PC is removed the switch EV B becomes unmanaged and does NOT need Initial configuration 5 1 Connect the host PC to the CONSOLE RJ 45 port of the switch system using the supplied cable The CONSOLE ports for the EVB is shown below Figure 37 Management Interfaces MT51336 EN EVB MGT 4 LA Make sure to connect t
58. ure 37 Management Interfaces 50 Figure 38 Transfer Power Cord 59 Figure 39 Install the Switch Slide 60 Figure 40 Transfer Power Cord Finished 60 Figur 41 C nnector PINOUT zu dew Dh ee Ph 61 6 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 List of Tables Table 1 Revision History 8 Table 2 System Status LED Configurations 17 Table 3 Connector Physical and Logical Link Indications 18 Table 4 PSU Status LED Configurations 19 Table 5 Fan Status LED Configurations 20 Table 6 Bad Port LED Configurations 21 Table 7 Port Connector Numbering 46 Table 8 Serial Terminal Program Configuration 50 Table 9 Specifications tor MT51396 is vi daca ao een 56 Table 10 Replacement Parts Ordering Numbers 58 Table 11 Connector PIAR 61 5 PINOT ser Da r aera C ea EN aaa ee Ee 63 Mellanox Technologies 7 Rev 1 5 Revis
59. urs 18 AWG termin par une fiche moul e d une tension nominale de 125 V 15 A avec une longueur minimale de 1 5 m 6 pieds et d une longueur maxi male de 4 5 m 18 pieds Pour les prises lectriques en Europe choisissez un cordon lectrique harmonis inter nationalement et marqu lt HAR gt 3 conducteurs d un diam tre de fil minimum de 0 75 mm2 d une tension nominale de 300 V avec une gaine isol e en PVC Le cordon doit avoir une fiche moul e d une tension nominale de 250 V et d une intensit nominale de 10 A 21 40 Ibs 40 70 lbs 70 121 lbs gt 121 lbs 18 kgs 18 32 kgs 32 55 kgs gt 55 kgs 22 Conform ment la Directive WEEE Conform ment la Directive WEEE 2002 96 EC les d chets d quipements lec triques et lectroniques EEE doivent tre tri s et ne peuvent tre limin s avec les d chets m nagers Veuillez disposer de ce produit et de tous ses composants de mani re responsable et respectueuse de l environnement Mellanox Technologies 67 Rev 1 5 Appendix H Installation Sicherheitshinweise German 1 Installationsanleitungen A Lesen Sie alle Installationsanleitungen bevor Sie das Ger t an die Stromversorgung anschlie en 2 bertemperatur Dieses Ger t sollte nicht in einem Bereich mit einer Umgebungstemperatur ber der maximal empfohlenen Temperatur von 45 C 113 F betrieben werden Es ist ein Luft N strom von 200 LFM bei maxima
60. xtender to the Server Select only one of these two options Either use the RJ45 Ethernet connection option or the PCIE option DO NOT TRY AND USE BOTH OPTIONS AT THE SAME TIME When running the SwitchX EVB without the top cover use portable fans to keep the heat sinks cool Mellanox Technologies 43 Rev 1 5 Installing the PCIE 1 GbE Server Side board 5 5 Installing the Server Side Board 1 Place the ESD mat on the floor where you will be working and put on the ESD strap Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground 2 Insert the server side board into a X8 or X16 PCIE slot in the server Figure 34 Connecting the EVB to the Server Side Board pm 3 Connect the QSFP cables from the daughter board to the server board connect green to green and blue to blue 4 Connect the CX4 cable from the daughter board to the server board 5 Tie down the cables using the cable ties in the EVB 6 First power up the EVB and then power up the server 44 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 5 6 Board Connectors Numbering and Locations Figure 35 EVB Board Connections View 1 NJ N ON MON ON MOM NM B HB O O PBB 6 uo URUGONMPOD0oouounrumvmmbeoo09uumrum II 6
61. ys Pour l Am rique du Nord l quipement doit tre install conform ment aux sp cifications du Code Electrique National Am ricain et du Code Electrique Canadien 17 Interconnexion des unites Les c bles de branchement l unit RS232 et les interfaces Ethernet doivent tre certi fi s UL de type DP 1 ou DP 2 Note lorsqu il existe dans un circuit non LPS YN Protection contre la surintensit Un appareil de protection r pertori facilement accessible contre la surintensit du circuit de branchement et calibr a 20A doit tre incorpor dans le cablage lectrique du b timent 18 Exposition au rayonnement grave Mise en garde l utilisation de commandes ou de r glages ou l ex cution de proc dures autres que ce qui est sp cifi dans les pr sentes peut engendrer une exposition au rayonnement grave PRODUIT LASER DE CLASSE 1 et r f rences aux normes laser les plus r centes 60 825 1 1993 A1 1997 A2 2001 et NE 60825 1 1994 1 1996 A2 2001 66 Mellanox Technologies SwitchX Switch EVB Hardware User Manual Rev 1 5 19 S assurer que les enceintes sont appropri es h Des enceintes lectriques m caniques et incendie adapt es doivent tre fournies par le fabricant du produit final ou par l utilisateur final 20 Cordons lectriques CA homologu s UL Pour les prises lectriques en Am rique du Nord choisissez un cordon lectrique homologu UL et certifi CSA A 3 conducte

User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents