Home

SPARC Enterprise M4000/M5000 Servers Installation Guide

image

Contents

1. 2 2 1 2 PSU 0 psu PSU 2pSU43 Circuit breaker Circuit breaker Grounding The system is shipped with grounding type three wire power cords Always connect the cords into grounded power outlets Contact your facilities manager or a qualified electrician to determine what type of power is supplied to your building No additional earth grounding is necessary but it may be added if desired Chapter 2 Preparing to Install the Server 2 7 22 2 22 3 2 8 Cable Connections TABLE 2 3 lists the power cords for the servers TABLE 2 3 Power Cords System Location Power Cord Type SPARC Enterprise Americas Taiwan M4000 Server Korea Japan Connector Rest of the world SPARC Enterprise Americas Taiwan M5000 Server Korea Japan Connector Rest of the world NEMA L5 15 125V 15A NEMA L6 20 250V 20A IEC60309 16A 250V 3PIN with IEC 60320 C20 NEMA L5 15 125V 15A NEMA L6 20 250V 20A IEC60309 16A 250V 3PIN with IEC 60320 C20 Note For servers that have the B type plug confirm that a 20A overcurrent protection device is available outside the server If one is not available prepare an external
2. Powering on the server Powering On the Server on page 3 10 Installing additional peripheral devices Connecting Additional Peripheral Devices on page 3 15 Environmental Setup Setting up the network Overview of Network Configuration on page 4 1 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 CHAPTER 2 Preparing to Install the Server This chapter describes the items you are required to check the environmental requirements for installation installation areas and other related matters It contains the following sections 24 Section 2 1 Safety Precautions on page 2 1 Section 2 2 Before Installing the Server on page 2 2 Section 2 3 Tools and Equipment on page 2 9 Safety Precautions To protect both yourself and the equipment observe the following precautions when possible Observe the precautions warnings and notes on handling shown on the server Use an electrostatic discharge ESD jack or wrist or foot strap when possible Do not block any ventilation holes Do not install the server at a location exposed to direct sunlight or near a device that may become hot Do not install the server at a location that has a lot of dust or that is exposed to corrosive gases or air with a high salt concentration Do not install the server at a location exposed to frequent vibrations Install the system on a flat and level surface Use grounding wires
3. Location Number Component POWER LED XSCF STANDBY LED CHECK LED Power switch Mode switch keyswitch O oO A WO N e Antistatic ground socket FIGURE A 4 shows the SPARC Enterprise M5000 server operator panel A 10 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 FIGURE A 4 SPARC Enterprise M5000 Server Operator Panel AN c5 s IGQGOOOOOOOOOOOOO Component Location Number POWER LED XSCF STANDBY LED Mode switch keyswitch Antistatic ground socket CHECK LED Power switch oO MM oc A 11 Appendix A System Views During startup the firmware toggles the front panel LEDs on and off to verify that each one is working correctly After that the front panel LEDs operate as described in TABLE A 1 TABLE A 1 Operator Panel LEDs and Switches Icon Name Color POWER LED Green Description Indicates the server power status D XSCF Green STANDBY LED CHECK LED Amber Power switch Mode switch keyswitch e On Server has power Off Server is without power Blinking The power off sequence is in progress Indicates the readiness of the XSCF On XSCF unit is functioning normally Off XSCF unit is stopped Blinking Under system initialization after NFB on or under system power on process Indicates that server detected a fault On Error detec
4. 7 172 mm fan FAN_A 0 8 172 mm fan FAN_A 3 9 172 mm fan FAN_A 2 10 Backplane unit BPU_B includes IOBP Power distribution board bus bar 11 172 mm fan backplane FANBP_C 12 CD RW DVD RW backplane DVDBP_B 13 Tape drive backplane TAPEBP 14 Hard disk drive backplane HDDBP 1 IOU 1 15 Hard disk drive backplane HDDBP 0 IOU 0 16 Hard disk drive HDD 1 IOU 0 17 Hard disk drive HDD 0 IOU 0 18 Hard disk drive HDD 3 IOU 1 19 Hard disk drive HDD 2 IOU 1 20 Tape drive unit TAPEU 21 CD RW DVD RW drive unit DVDU 22 Faceplate 23 Power supply unit PSU 0 24 Power supply unit PSU 1 25 Power supply unit PSU 2 26 Power supply unit PSU 3 27 Operator panel OPNL 28 I O unit IOU 0 Appendix A System Views A 7 A 8 Location Number Component 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 DC DC Converter Riser DDCR IOU 0 Not shown DC DC Converter DDC_B on DDCR on IOU 0 DC DC Converter DDC_A IOU 0 Not shown I O Unit IOU 1 DC DC Converter Riser DDCR IOU 1 Not shown DC DC Converter DDC_B on DDCR on IOU 1 DC DC Converter DDC_A IOU 1 Not shown PCI slot PCI 0 IOU 1 PCI slot PCI 1 IOU 1 PCI slot PCI 2 IOU 1 PCI slot PCI 3 IOU 1 PCI slot PCI 4 IOU 1 PCI slot PCI 4 IOU 0 PCI slot PCI 3 IOU 0 PCI slot PCI 2 IOU 0 PCI slot PCI 1 IOU 0 PCI slot PCI 0 IOU 0 eXtended System
5. Connecting Input Power Cords 3 2 3 2 1 Connecting a UPS Unit 3 3 3 2 2 Verifying the Power Input Connections Before Applying Power 3 4 3 3 Connecting the Administration Console 3 5 3 3 1 Connecting the Console 3 7 3 3 2 Initializing the XSCF Unit 3 9 3 4 Powering On the Server 3 10 341 Verifying the Configuration 3 11 3 4 2 Checking the Dual Power Feed 3 15 3 5 Connecting Additional Peripheral Devices 3 15 4 Connecting the Domains to the Network 4 1 4 1 Overview of Network Configuration 4 1 4 2 Connecting to the Network 4 1 43 Verifying the Network Connection 4 2 44 Verifying Operation by Running Oracle VTS Software 4 2 A System Views A 1 A 1 SPARC Enterprise M4000 Server Views A 1 A 2 SPARC Enterprise M5000 Server Views A 5 A 3 Operator Panel Overview A 9 B Fault Isolation B 1 B 1 Corrective Actions to Common Problems B 1 B 2 Using the Diagnostic Commands B 2 B 2 1 Using the showhardconf Command B 2 B 2 2 Using the showlogs Command B 5 B 2 3 Using the showstatus Command B 6 B 2 4 Using the fmdump Command B 6 B 2 4 1 fmdump V Command B 6 B 2 4 2 fmdump e Command B 7 B 2 5 Using the fmadm faulty Command B 7 B 2 5 1 fmadm config Command B 8 vi SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 B 3 B 2 6 Using the fmstat Command B 8 Traditional Oracle Solaris Diagnostic Commands B 9 B 3 1 sing the iostat Command B 9 3 11 Options B 9 Jsing the prtdiag Command B 11 3 2 1 Options B 11
6. s affili es SPARC64 est une marque de SPARC International Inc utilis e sous licence par Fujitsu Microelectronics Inc et Fujitsu Limited Tout autre nom mentionn peut correspondre des marques appartenant d autres propri taires United States Government Rights Commercial use U S Government users are subject to the standard government user license agreements of Oracle and orits affiliates and Fujitsu Limited and the applicable provisions of the FAR and its supplements Avis de non responsabilit les seules garanties octroy es par Oracle et Fujitsu Limited et ou toute soci t affili e de l une ou l autre entit en rapport avec ce document ou tout produit ou toute technologie d crits dans les pr sentes correspondent aux garanties express ment stipul es dans le contrat de licence r gissant le produit ou la technologie fournis SAUF MENTION CONTRAIRE EXPRESS MENT STIPUL E DANS CE CONTRAT ORACLE O FUJITSU LIMITED ET LES SOCI T S AFFILI ES L UNE OU L AUTRE ENTIT REJETTENT TOUTE REPRESENTATION OU TOUTE GARANTIE QUELLE QU EN SOIT LA NATURE EXPRESSE OU IMPLICITE CONCERNANT CE PRODUIT CETTE TECHNOLOGIE OU CE DOCUMENT LESQUELS SONT FOURNIS EN L TAT EN OUTRE TOUTES LES CONDITIONS REPRESENTATIONS ET GARANTIES EXPRESSES OU TACITES Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE LA QUALIT MARCHANDE L APTITUDE UNE UTILISATION PARTICULIERE OU L ABSENCE DE CONTREFAGON SONT EXCLUES DANS LA MESURE A
7. 3 3 Using the prtconf Command on page B 14 m Section B 3 4 Using the netstat Command on page B 16 m Section B 3 5 Using the ping Command on page B 17 m Section B 3 6 Using the ps Command on page B 18 m Section B 3 7 Using the prstat Command on page B 19 Most of these commands are located in the usr bin or usr sbin directories Using the iostat Command The iostat command iteratively reports terminal drive and tape I O activity as well as CPU utilization B 3 1 1 Options TABLE B 3 describes options for the iostat command and how those options can help troubleshoot the server TABLE B 3 Options for iostat Option Description How It Can Help No option Reports status of local I O devices Provides a quick three line output of device status c Reports the percentage of time the system has Provides a quick report of CPU status spent in user mode in system mode waiting for I O and idling Appendix B Fault Isolation B 9 TABLE B 3 Options for iostat Continued Option Description How It Can Help e Displays device error summary statistics The total Provides a short table with accumulated errors hard errors soft errors and transport errors errors Identifies suspect I O devices are displayed E Displays all device error statistics Provides information about devices manufacturer model number serial number size and errors n Displays names in descriptive format Descr
8. 40 a 255 255 255 255 00 14 4f 3a 93 85 sppp0 224 0 0 22 255 255 255 255 bge0 san ff2 42 a 255 255 255 255 00 14 4f 3a 93 af bge0 san09 lab r01 66 255 255 255 255 0 00 e0 52 ec 1a 00 spppO 192 168 1 1 255 255 255 255 bge0 san ff2 9 b 255 255 255 255 00 03 ba dc af 2a bge0 bizzaro 255 255 255 255 0 00 03 ba 11 b3 c1 bge0 san ff2 9 a 255 255 255 255 o 00 03 ba dc af 29 bge0 racerx b 255 255 255 255 0 00 0b 5d dc 08 b0 bge0 224 0 0 0 240 0 0 0 SM 01 00 5e 00 00 00 B 16 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 B 3 5 Using the ping Command The ping command sends ICMP ECHO REQUEST packets to network hosts Depending on how the ping command is configured the output displayed can identify troublesome network links or nodes The destination host is specified in the variable hostname B 3 5 1 Options TABLE B 7 describes options for the ping command and how those options can help troubleshooting TABLE B 7 Options for ping Option Description How It Can Help hostname The probe packet is sent to Verifies that a host is active on the network g hostname i interface SVR hostname and returned Forces the probe packet to route through a specified gateway Designates which interface to send and receive the probe packet through Replaces host names with IP addresses Pings continuously in one second intervals Ctrl C aborts Upon abort statistics are displaye
9. 541 2240 02 Type 1 DDC_A 0 Status Normal DDCR Status Normal DDC_B 0 Status Normal IOU 1 Status Normal Ver 0101h Serial BF073226HP FRU Part Number CF00541 4361 01 541 4361 01 Type 1 DDC A40 Status Normal DDCR Status Normal DDC B4 0 Status Normal XSCFU Status Normal Active Ver 0101h Serial BF07435D98 FRU Part Number CF00541 0481 04 541 0481 04 E OPNL Status Normal Ver 0101h Serial BF0747690D FRU Part Number CF00541 0850 06 541 0850 06 PSU 0 Status Normal Serial 0017527 0738063762 FRU Part Number CF00300 1898 0350 300 1898 03 50 Power_Status Off AC 200 V PSU 3 Status Normal Serial 0017527 0738063767 FRU Part Number CF00300 1898 0350 300 1898 03 50 Power Status Input fail AC FANBP C Status Normal Ver 0501h Serial FF2 24 FRU Part Number CF00541 3099 01 541 3099 01 FAN_A 0 Status Normal FAN Affl Status Normal FAN A42 Status Normal FAN A43 Status Normal B z Refer to the showhardconf man page for more information B 4 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 B 2 2 Using the showlogs Command The showlogs command displays the contents of a specified log in order of timestamp starting with the oldest date The showlogs command displays the following logs m error log m power log m event log m temperature and humidity record m monitoring message log m console message log m panic message log m IPL
10. Before installing the server you must know the system configuration and obtain all the prerequisite information for system installation For instructions refer to the SPARC Enterprise M4000 M5000 Servers Site Planning Guide and the guide that came with the rack Facility Power To prevent catastrophic failures the facility power design must ensure that adequate redundant power is provided to the system Electrical work and installations must comply with applicable local state or national electrical codes Note The following power numbers are maximums and are based on fully configured systems Actual numbers might vary according to your system configuration SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 TABLE 2 1 Electrical Specifications for the SPARC Enterprise M4000 Server Parameter Number of power cords Redundancy Input current Voltage range Current maximum Current frequency range Power draw maximum Volt ampere Heat Power factor Value 2 1 power cord per power supply unit 1 1 redundant Second power supply is redundant at 200 VAC 100 127 VAC 200 240 VAC 24 0A at 100 127 VAC 12A per cord 12 0A at 200 240 VAC 12A per cord 50 60 Hz 1 692 W 2 power cords 1 763 VA 5 774 BTUs hr 6 091 kJ hr 0 98 TABLE 2 2 Electrical Specifications for the SPARC Enterprise M5000 Server Parameter Value Number of power cords Redundancy Input current
11. Domain 0 Domain Status Initialization Phase Domain 1 Domain Status Initialization Phase MBU B Status Normal Ver 0201h Serial BC07490823 FRU Part Number CF00541 0478 05 541 0478 05 i Memory_Size 64 GB CPUM 0 CHIP 0 Status Normal Ver 0501h Serial PP07230160 FRU Part Number CA06761 D204 AO LGA JUPP 01 H Freq 2 530 GHz Type 32 Core 4 Strand 2 Ej OD CPUM 3 CHIP 1 Status Normal Ver 0501h Serial PP074804 FRU Part Number CA06761 D204 AO LGA JUPP 01 H Freq 2 530 GHz Type 32 Core 4 Strand 2 MEMB 0 Status Normal Ver 0101h Serial BF09061GOE FRU Part Number CF00541 0545 06 541 0545 06 MEM 0A Status Normal Code c1000000000000005372T128000HR3 7A 356d 0d016912 Type 1A Size 1 GB MEM 3B Status Normal Code c1000000000000004572T128000HR3 7A 252b 04123424 Type 1A Size 1 GB MEMB 7 Status Normal Ver 0101h Serial BF09061GBA FRU Part Number CF00541 0545 06 541 0545 06 MEM 0A Status Normal Code 2cffffffffffffff0818HTF12872Y 53EB3 0300 d504600c Type 1A Size 1 GB MEM 3B Status Normal Code 7 7 e00000000004aEBE10RD4AGFA 5C E 3020 2229c19c Type 1A Size 1 GB Appendix B Fault Isolation B 3 showhardconf output continued DDC Aff0 Status Normal DDC A41 Status Normal DC A42 Status Normal DC A43 Status Normal DC_B 0 Status Normal DC_B 1 Status Normal IOU 0 Status Normal Ver 0101h Serial BF07486TEU FRU Part Number CF00541 2240 02
12. February 2012 3 2 1 Connecting a UPS Unit An uninterruptible power supply UPS unit is used to provide a stable supply of power to the system in the event of a power failure or an extensive power interruption A UPS with an UPC interface can be connected to the UPC ports on the XSCFU unit XSCFU FIGURE 3 2 so that emergency shutdown processing can be executed When using a single power feed connect the UPC cable to UPC 0 When using a dual power feed connect the UPC cables to UPC 0 and UPC 1 FIGURE 3 1 Note UPC 1 cannot be used when using single power feed Refer to the SPARC Enterprise M4000 M5000 Servers Service Manual for the interface specifications of the UPC port Chapter 3 Installing the Server 3 3 FIGURE 3 1 SPARC Enterprise M5000 Server Dual power Feed UPC Connections UPC 1 UPC Interface Cables ACHO Circuit breaker ACH Circuit breaker 322 Verifying the Power Input Connections Before Applying Power Have the site electrician verify that the input power source fulfills the power requirements Refer to the SPARC Enterprise M4000 M5000 Servers Site Planning Guide for input power requirements Note Both ends of the power cords should have been connected prior to shipment for servers preinstalled in an equipment rack or when the server was mounted in the equipment cabinet If the power cords were not connected previously connect them before applying
13. THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID EG cu CA Adobe PostScript Copyright 2007 2012 Oracle et ou ses soci t s affili es Tous droits r serv s Fujitsu Limited a fourni et v rifi des donn es techniques de certaines parties de ce composant Oracle et ou ses soci t s affili es et Fujitsu Limited d tiennent et contr lent chacune des droits de propri t intellectuelle relatifs aux produits et technologies d crits dans ce document De m me ces produits technologies et ce document sont prot g s par des lois sur le copyright des brevets d autres lois sur la propri t intellectuelle et des trait s internationaux Ce document le produit et les technologies aff rents sont exclusivement distribu s avec des licences qui en restreignent l utilisation la copie la distribution et la d compilation Aucune partie de ce produit de ces technologies ou de ce document ne peut tre reproduite sous quelque forme que ce soit par quelque moyen que ce soit sans l autorisation crite pr alable d Oracle et ou ses soci t s affili es et de Fujitsu Limited et de leurs ventuels bailleurs de licence Ce document bien qu il vous ait t fourni ne vous conf re aucun droit et aucune licence expresses ou tacites concernant le produit ou la technologie auxquels il se rapporte Par ailleurs il ne contient ni ne repr sente aucun engagement de quelque type que ce soit de la part d Oracle ou de Fujitsu Limited o
14. the XSCF with the applynetwork and rebootxscf commands m Domain to Service Processor Communications Protocol DSCP configuration setdscp m Altitude setting setaltitude Note setaltitude must be followed by a rebootxscf to apply the altitude setting m Dual power feed option setting setdualpower feed Chapter 3 Installing the Server 3 9 Note setdualpowerfeed requires a complete chassis power cycle all power cords removed to apply any changes Make certain to allow 30 seconds before plugging the power cords back into the chassis To perform XSCF initial settings use the XSCF default user account Until user accounts for user environment is registered log in with a default user account and default password The privileges of the default user are useradm and platadm 2 Log in to the XSCF Shell using a user account and password set during Step 1 See the SPARC Enterprise M3000 M4000 M5000 M8000 M9000 Servers XSCF User s Guide for details on how to log in to the user account 3 4 3 10 Powering On the Server This section explains how to power on the server the first time 1 Set the mode switch on the operator panel to the Service position 2 From the XSCF Shell type the console command XSCF gt console d domain ID Replace domain ID with the number of a specific domain you want to access This command switches the prompt from the XSCF console to the domain console 3 Confirm that the XSCF ST
15. 00 M5000 Servers Installation Guide February 2012 4 From the ok prompt use the probe scsi all command to confirm that the storage devices are installed ok probe scsi all pci 0 600000 pci 0 pci 8 pci 0 scsi l MPT Version 1 05 Firmware Version 1 07 00 00 Target 0 Unit 0 Disk SEAGATE ST973401LSUN72G 0556 143374738 Blocks 73 GB SASAddress 5000c5000092beb9 PhyNum 0 Target 1 Unit 0 Disk SEAGATE ST973401LSUN72G 0556 143374738 Blocks 73 GB SASAddress 5000c500002eeaf9 PhyNum 1 Target 3 Unit 0 Removable Read Only device TSSTcorpCD DVDW TS L532USR01 SATA device PhyNum 3 5 Use the show devs command to confirm that the PCI devices are installed ok show devs pci 41 700000 pci 40 600000 pci 48 4000 cmp 480 0 pseudo mc 240 200 nvram pseudo console virtual memory memory m0 aliases options openprom chosen packages pci 40 600000 pci 0 pci 40 600000 pci 0 pci 9 pci 40 600000 pci 0 pci 8 pci 40 600000 pci 0 pci 8 pci 0 1 pci 40 600000 pci 0 pci 8 pci 0 pci 40 600000 pci 0 pci 8 pci 0 1 ethernet 1 pci 40 600000 pci 0 pci 8 pci 0 network 2 1 pci 40 600000 pci 0 pci 8 pci 0 network 2 Chapter 3 Installing the Server 3 13 The show devs command command output continued pci 40 600000 pci 0 pci 8 pci 0 scsi 1 pci 40 600000 pci 0 pci 8 pci 0 scsi 1 disk pci 40 600000 pci 0 pci 8 pci 0 scsi 1 tape pci 48 4000 ebus 1 pci 48 4000 ebus 1 panel 14 280030 pci 48 40
16. 00 ebus 1 scfc 14 200000 pci 48 4000 ebus 1 serial 14 400000 pci 48 4000 ebus 1 flashprom 10 0 cmp 480 0 core l cmp 480 0 core 0 cmp 480 0 core 1 cpu 1 cmp 480 0 core 1 cpu 0 cmp 480 0 core 0 cpu l cmp 480 0 core 0 cpu 0 openprom client services packages obp tftp packages terminal emulator packages disk label packages deblocker packages SUNW builtin drivers ok 6 Compare the configuration shown by showhardconf u probe scsi all and show devs with the shipping list If the configuration is incorrect contact your sales representative 7 Boot the Oracle Solaris operating system Oracle Solaris OS and configure the domains Refer to the Oracle Solaris software documentation for details 3 14 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 3 4 2 Checking the Dual Power Feed If the dual power feed option is used follow the procedure below to confirm that the system can operate even if one power feed is stopped Note Dual Power Feed mode cannot be used with 100V power 10 11 12 13 3 Confirm that the system is powered on by checking the output of the showdomainstatus a command from the XSCF Shell Switch off all main line switches of AC GRID A Confirm that the POWER LED on the operator panel is on At the XSCF Shell verify power failure with the showlogs event command Switch on all the main line switches of AC GRID A switched off
17. 20A overcurrent protection that can be achieved by means of no fuse breakers NFBs or fuses The B type plug refers to plugs other than grounding type ones with two parallel blades such as the NEMA L6 30 L6 20 L6 15 and L5 15 Refer to the SPARC Enterprise M4000 M5000 Servers Site Planning Guide for electronic specifications of the midrange servers Checking the Installation Location When installing the server consider not only the device sizes but also the sizes of the required service areas maintenance areas For details refer to the SPARC Enterprise M4000 M5000 Servers Site Planning Guide and the manual that came with the rack The site electrician should verify the proper electrical hookups SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 2 3 Tools and Equipment The following sections list the tools that are required to install the servers The following tools are required to install the servers Screwdriver Phillips No 2 Antistatic wrist strap Antistatic mat Ethernet cable of category 5 or higher Console one of the following m ASCII terminal m Workstation Terminal server or patch panel connected to a terminal server m Personal computer XSCF Unit configuration information IP Address subnet mask default gateway and so on Domain configuration information IP Address subnet mask default gateway and so on Chapter 2 Preparing to Install the Server 2 9 2 10
18. 8 0 okay 8 8 pci pciex10b5 8532 NA pci 10 600000 pci 0 pci 8 01 PCIe 16 bc 8532 10b5 3 9 0 okay qur 8 pci pciex10b5 8532 NA pci 10 600000 pci 0 pci 9 01 PCIx 16 8 125 1033 4 0 0 okay 100 133 pci pciexclass 060400 NA pci 10 600000 pci 0 pci 8 pci 0 01 PCIx 16 8 125 1033 4 0 1 okay 133 pci pciexclass 060400 NA pci 10 600000 pci 0 pci 8 pci 0 1 01 PCIx 16 2 50 1000 5 1 0 okay 133 scsi pci1000 50 LSI 1064 pci 10 600000 pci 0 pci 8 pci 0 scsi l 01 PCIx 16 10 1648 14e4 5 2 0 okay 133 network pcil4e4 1648 NA pci 10 600000 pci 0 pci 8 pci 0 network 2 01 PCIx 16 10 1648 14e4 5 2 1 okay 133 network pcil4e4 1648 NA pci 10 600000 pci 0 pci 8 pci 0 network 2 1 Hardware Revisions System PROM revisions OBP 4 24 13 2010 02 08 13 17 Environmental Status Mode switch is in LOCK mode ses System Processor Mod SPARC64 VII mode Appendix B Fault Isolation B 13 B 3 3 Using the prtconf Command Similar to the show devs command run at the ok prompt the prtconf command displays the devices that are configured The prtconf command identifies hardware that is recognized by the Oracle Solaris OS If hardware is not suspected of being bad yet software applications are having trouble with the hardware the prtconf command can indicate if the Oracle Solaris software recognizes the h
19. ANDBY LED green on the operator panel is lit 4 Push the power switch on the operator panel to power on the server The server starts and begins a self diagnosis Watch the initial system administration console for error messages during the boot process See Appendix B Fault Isolation for fault information 5 Confirm that ok is displayed on the domain console SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 3 4 1 10 Confirm that the POWER LED green on the operator panel is lit Check the POWER LED on each component If the POWER LEDs are not lit see Appendix B for installation troubleshooting information Press and hold the Enter key and press the shift 3 and period keys These key combinations switch you from the domain console to the XSCF console Execute fmdump or showlogs with the error option from the XSCF Shell and confirm that no errors are found See the Section B 2 4 Using the fmdump Command on page B 6 and Section B 2 2 Using the showlogs Command on page B 5 for details Connect the system control network to the XSCF Unit LAN port using an Ethernet cable The system control network is one or more administrative consoles used to monitor the network This connection will replace the temporary connection made between the administration console and the serial port on the XSCF Unit Both XSCF Unit LAN ports must be used to ensure redundancy in the sys
20. Control facility unit XSCFU DC DC Converter DDC_A 0 DC DC Converter DDC_A 1 DC DC Converter DDC_A 2 DC DC Converter DDC_A 3 DC DC Converter DDC_B 0 DC DC Converter DDC_B 1 Motherboard unit MBU_B Motherboard carriage Memory board MEMB 7 Memory board MEMB 6 Memory board MEMB 5 Memory board MEMB 4 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 Location Number Component 59 Memory Board MEMB 3 60 Memory board MEMB 2 61 Memory board MEMB 1 62 Memory board MEMB 0 Contact your sales representative for tape drive unit options on M4000 M5000 servers A 3 Operator Panel Overview When no network connection is available the operator panel is used to start or stop the system The operator panel displays three LED status indicators a power switch and a security keyswitch The panel is located on the front of the system in the upper right When the system is running the Power and XSCF Ready LEDs green should be lit and the Check LED amber should not be lit If the Check LED is lit search the system logs to determine what is wrong The three LED status indicators on the operator panel provide the following m General system status m System problem alerts m Location of the system fault FIGURE A 3 shows the SPARC Enterprise M4000 server operator panel Appendix A System Views A 9 FIGURE A 3 SPARC Enterprise M4000 Server Operator Panel RON
21. L 172 mm fan module FAN_A 0 172 mm fan module FAN_A 1 DC DC Converter DDC B 0 DC DC Converter DDC A70 DC DC Converter DDC_A 1 Motherboard unit MBU_A Motherboard carriage CPU module CPUM 1 CPU module CPUM 0 Memory board MEMB 3 Memory board MEMB 2 Appendix A System Views A 3 A 4 Location Number Component 30 31 32 33 34 35 36 37 38 39 40 41 Memory board MEMB 1 Memory board MEMB 0 PCI slot IOU 0 PCI 0 PCI slot IOU 0 PCI 1 PCI slot IOU 0 PCI 2 PCI slot IOU 0 PCI 3 PCI slot IOU 0 PCI 4 eXtended System Control facility unit XSCFU 1 0 Unit IOU 0 DC DC Converter Riser DDCR IOU 0 Not shown DC DC Converter DDC B on DDCR on IOU 0 DC DC Converter DDC A IOU 0 Not shown Contact your sales representative for tape drive unit options on M4000 M5000 servers SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 A 2 SPARC Enterprise M5000 Server Views FIGURE A 2 shows the SPARC Enterprise M5000 server Appendix A System Views A 5 A 6 FIGURE A 2 SPARC Enterprise M5000 Server Component Locations 22 23 24 2526 27 28 29 30 31 32 33 34 35 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 Location Number Component 1 Top cover 2 CPU module CPUM 0 3 CPU module CPUM 1 4 CPU module CPUM 2 5 CPU module CPUM 3 6 172 mm fan FAN_A 1
22. SPARC Enterprise M4000 M5000 Servers Installation Guide co Sun FUJITSU co JAN a I 2 SPARC Manual Code C120 E351 08EN February 2012 Copyright 2007 2012 Oracle and or its affiliates All rights reserved Fujitsu Limited provided technical input and review on portions of this material Oracle and or its affiliates and Fujitsu Limited each own or control intellectual property rights relating to products and technology described in this document and such products technology and this document are protected by copyright laws patents and other intellectual property laws and international treaties This document and the product and technology to which it pertains are distributed under licenses LE their use copying distribution and decompilation No part of such product or technology or of this document may be reproduced in any form by any means without prior written authorization of Oracle and or its affiliates and Fujitsu Limited and their applicable licensors if any The furnishings of this document to you does not give you any rights or licenses express or implied with respect to the product or RARE to which it pertains and this document does not contain or represent any commitment of any kind on the part of Oracle or Fujitsu Limited or any affiliate of either of them This document and the product and technology described in this document may incorporate third party intellectual property copyrighted by and or licensed from t
23. SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 CHAPTER 3 Installing the Server This chapter describes how to install the server It contains the following sections m Section 3 1 Checking Components on page 3 1 m Section 3 2 Connecting Input Power Cords on page 3 2 m Section 3 3 Connecting the Administration Console on page 3 5 m Section 3 4 Powering On the Server on page 3 10 m Section 3 5 Connecting Additional Peripheral Devices on page 3 15 Note Do not install any additional PCI cards or peripherals until the server has been installed and booted successfully Caution When raising the unit do not grab the handles on the front The handles on the front are only to be used for pushing in or pulling out the unit in the rack They are not designed to bear the weight of the unit Caution Extend only one server out of the equipment rack at a time to prevent unbalancing the rack The stabilizer if applicable must be deployed whenever a server is extended out of the rack gt gt 3 1 Checking Components This section explains how to check server components 1 Check the components against the packing list that came with the server 3 1 2 Check for a model name and input format on the shipping list If any of the items on the packing list are missing incorrect or damaged contact your sales representative 912 3 2 Connect
24. UTORIS E PAR LA LOI APPLICABLE Sauf mention contraire express ment stipul e dans ce contrat dans la mesure autoris e par la loi applicable en aucun cas Oracle ou Fujitsu Limited et ou l une ou l autre de leurs soci t s affili es ne sauraient tre tenues responsables envers une quelconque partie tierce sous quelque th orie juridique que ce soit de tout manque ee ou de perte de profit de probl mes d utilisation ou de perte de donn es ou d interruptions d activit s ou de tout dommage indirect sp cial secondaire ou cons cutif m me si ces entit s ont t pr alablement inform es d une telle ventualit LA DOCUMENTATION EST FOURNIE EN L TAT ET TOUTE AUTRE CONDITION D CLARATION ET GARANTIE EXPRESSE QU TACITE EST FORMELLEMENT EXCLUE DANS LA MESURE AUTORIS E PAR LA LOI EN VIGUEUR Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE LA QUALIT MARCHANDE L APTITUDE UNE UTILISATION PARTICULI RE OU L ABSENCE DE CONTREFA ON Contents Preface ix Installation Overview 1 1 1 1 Installation Workflow 1 1 Preparing to Install the Server 2 1 2 1 2 2 2 3 Safety Precautions 2 1 Before Installing the Server 2 2 2 2 1 Facility Power 2 2 2 2 1 1 Facility Power Requirements and Characteristics 2 4 2 2 1 2 Grounding 2 7 2 22 Cable Connections 2 8 2 2 3 Checking the Installation Location 2 8 Tools and Equipment 2 9 Installing the Server 3 1 3 1 3 2 Checking Components 3 1
25. Voltage range Current maximum Current frequency range Power draw maximum Volt ampere Heat Power factor 4 1 power cord per power supply unit 2 2 redundant Second and fourth power supplies are redundant at 200 VAC 100 127 VAC 200 240 VAC 48A at 100 127 VAC 12A per cord 24A at 200 240 VAC 12A per cord 2 2 redundancy 50 60 Hz 3 270 W 4 power cords 3 406 VA 11 160 BTUs hr 11 772 kJ hr 0 98 Chapter 2 Preparing to Install the Server 2 3 2 2 1 1 FIGURE 2 1 Facility Power Requirements and Characteristics For proper redundancy your facility should have two independent power sources Either circuit breakers connected to separate power company utility feeds or UPS uninterruptible power system For power redundancy the power cords should not be connected to the same facility power source If the computer equipment is subjected to repeated power interruptions and fluctuations it is susceptible to a higher component failure rate than it would be with a stable power source There are two basic configurations m Power Cords With Redundant PSU Connection FIGURE 2 1 and FIGURE 2 2 m Power Cords With Dual power Feed Connection FIGURE 2 3 and FIGURE 2 4 Note If more than one power cord of this server is connected directly to the same facility power source distribution panel connect the power cords to outlets independently using one cable per power feed Caution Ensure that the circuit
26. anted by Oracle and Fujitsu Limited and or any affiliate of either of them in connection with this document or any product or technology described herein are those expressly set forth in the license agreement pursuant to which the product or technology a EXCEPT AS EXPRESSLY SET FORTH IN SUCH AGREEMENT ORACLE OR FUJITSU LIMITED AND OR THEIR AFFILIATES MAKE NI REPRESENTATIONS OR WARRANTIES OF ANY KIND EXPRESS OR IMPLIED REGARDING SUCH PRODUCT OR TECHNOLOGY OR THIS DOCUMENT WHICH ARE ALL PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING WITHOUT LIMITATION ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID Unless otherwise expressly set forth in such agteement to the extent allowed by applicable law in no event shall Oracle or Fujitsu Limited and or any of their affiliates have any liability to any third party under any legal theory for any loss of revenues or profits loss of use or data or business interruptions or for any indirect special incidental or consequential damages even if advised of the possibility of such damages DOCUMENTATION IS PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT
27. ardware and if a driver for the hardware is loaded Brod Options TABLE B 5 describes options for the prtconf command and how those options can help troubleshooting TABLE B 5 Options for prtconf Option Description How It Can Help No option Displays the device tree of If a hardware device is recognized then it is probably devices recognized by the OS functioning properly If the message driver not attached is displayed for the device or for a sub device then the driver for the device is corrupt or missing D Similar to the output of no Lists the driver needed or used by the OS to enable the option however the device device driver is listed p Similar to the output of no Reports a brief list of the devices option yet is abbreviated V Displays the version and date of Provides a quick check of firmware version the OpenBoot PROM firmware B 14 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 The following example shows output for the prtconf command prtconf System Configuration xxxx Memory size 1024 Megabytes System Peripherals Software Nodes SUNW Sun SPARC packages driver not attached SUNW builtin drivers driver not attached deblocker driver not attached disk label driver not attached terminal emulator driver not attached dropins driver not attached kbd translator driver not attached obp tftp driver not attached SUNW i2c ram device driver not
28. assumes there is only one fault fmdump TIME UUID SUNW MSG ID Nov 02 10 04 15 4911 0ee65618 2218 4997 c0dc b5c410ed8ec2 SUN4 8000 0Y B 2 4 1 fmdump V Command You can obtain more detail by using the V option as shown in the following example fmdump V u 0ee65618 2218 4997 c0dc b5c410ed8ec2 TIME UUID SUNW MSG ID Nov 02 10 04 15 4911 0ee65618 2218 4997 c0dc b5c410ed8ec2 SUN4 8000 0Y 100 fault io fire asic FRU hc product id SUNW A70 motherboard 0 rsrc hc motherboard 0 hostbridge 0 pciexrc 0 B 6 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 B 2 4 2 At least three lines of new output are delivered to the user with the V option m The first line is a summary of information you have seen before in the console message but includes the timestamp the UUID and the Message ID m The second line is a declaration of the certainty of the diagnosis In this case you are 100 percent sure the failure is in the asic described If the diagnosis might involve multiple components you might see two lines here with 50 percent in each for example m The FRU line declares the part which needs to be replaced to return the server to a fully operational state m The rsrc line describes which component was taken out of service as a result of this fault fmdump e Command To get information of the errors which caused this failure you can use the e option as shown i
29. attached SUNW fru device driver not attached SUNW asr driver not attached ufs file system driver not attached chosen driver not attached openprom driver not attached client services driver not attached options instance 0 aliases driver not attached Appendix B Fault Isolation B 15 B 3 4 B 3 4 1 Using the netstat Command The netstat command displays the network status Options TABLE B 6 describes options for the netstat command and how those options can help troubleshooting TABLE B 6 Options for netstat Option Description How It Can Help i Displays the interface state Provides a quick overview of the network status including packets in out error in out collisions and queue i interval Providing a trailing number Identifies intermittent or long duration network events with the i option repeats the By piping netstat output to a file overnight activity netstat command every can be viewed all at once interval seconds p Displays the media table Provides MAC address for hosts on the subnet zu Displays the routing table Provides routing information n Replaces host names with IP Used when an address is more useful than a host name addresses The following example shows output for the netstat p command netstat p Net to Media Table IPv4 Device IP Address Mask Flags Phys Addr bge0 san ff1 14 a 255 255 255 255 6 00 14 4f 3a 93 61 bge0 san ff2
30. breaker is off when installing or removing AC power cords in order to avoid damage to the PSU or system SPARC Enterprise M4000 Server With Redundant PSU Connection 2 4 1 0 PSU 0 PSU 1 Circuit breaker SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 FIGURE 2 2 SPARC Enterprise M5000 Server With Redundant PSU Connection PSU 0 psu PSU 2psU 3 Circuit breaker Chapter 2 Preparing to Install the Server 2 5 For a dual power feed connection connect the individual power cords separately to each AC power supply system FIGURE 2 3 SPARC Enterprise M4000 Server With Dual power Feed Connection be e e L I d PSU 0 PSU 1 Circuit breaker Circuit breaker 2 6 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 FIGURE 2 4 SPARC Enterprise M5000 Server With Dual power Feed Connection
31. cation of the XSCF Unit on the SPARC Enterprise M4000 server Connecting the Console This section explains how to physically connect and configure the console 1 Connect the administrative console to the serial port using the serial cable that shipped with the server Configure the settings on the administrative console The console should have the following settings Baud rate 9600 bps Data length 8 bit Parity None Stop 1 bit Flow control None Delay Except for 0 Set the mode switch on the operator panel to the Service position The Service position is indicated by an icon that looks like a wrench the Locked position is indicated by an icon that looks like a lock FIGURE 3 3 Chapter 3 Installing the Server 3 7 FIGURE 3 3 Operator Panel Mode Switch Jm ju ju C C fu oa ui CA m oD T CB For more details on the operator panel see Section A 3 Operator Panel Overview on page A 9 4 Turn on the input power Note Wait at least 30 seconds before turning on the system power that you turned off by pulling out the power cord or using the circuit breakers on the distribution panel Refer to the manual that shipped with the input power source for instructions 5 Watch the administration console for error messages as the XSCF Unit powers on See Appendix B Fault Isolation for fault information 6 Confirm that the XSCF STANDBY LED green on the operator panel is lit 7 Wh
32. ctor 00 A 65536MB okay 4096MB 16 no 8 way 00 B 65536MB okay 4096MB 16 no 8 way 01 A 65536MB okay 4096MB 16 no 8 way 01 B 65536MB okay 4096MB 16 no 8 way IO Devices IO Lane Frq LSB Type LPID RvID DvID VnID BDF State Act Max Name Model Logical Path 00 PCIe 0 bc 8532 10b5 2 0 0 okay 8 8 pci pciex10b5 8532 NA pci 0 600000 pci 0 00 PCIe 0 bc 8532 10b5 3 8 0 okay 8 8 pci pciex10b5 8532 NA pci 0 600000 pci 0 pci 8 00 PCIe 0 bc 8532 10b5 3 9 0 okay 1 8 pci pciex10b5 8532 NA pci 0 600000 pci 0 pci 9 00 PCIx 0 8 125 1033 4 0 0 okay 100 133 pci pciexclass 060400 NA pci 0 600000 pci 0 pci 8 pci 0 00 PCIx 0 8 125 1033 4 0 1 okay 133 pci pciexclass 060400 NA pci 0 600000 pci 0 pci 8 pci 0 1 B 12 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 prtdiag v output continued IO Lane Frq LSB Type LPID RvID DvID VnID BDF State Act Max Name Model Logical Path 00 PCIx 0 2 50 1000 5 1 0 okay 133 scsi pci1000 50 LSI 1064 pci 0 600000 pci 0 pci 8 pci 0 scsi l 00 PCIx 0 10 1648 14e4 5 2 0 okay 133 network pcil4e4 1648 NA pci 0 600000 pci 0 pci 8 pci 0 network 2 00 PCIx 0 10 1648 14e4 5 2 1 okay 133 network pcil4e4 1648 NA pci 0 600000 pci 0 pci 8 pci 0 network 2 1 01 PCIe 16 bc 8532 10b5 2 0 0 okay 8 8 pci pciex10b5 8532 NA pci 10 600000 pci 0 01 PCIe 16 bc 8532 10b5 3
33. d Displays the route the probe packet followed in one second intervals By identifying different routes to the target host those individual routes can be tested for quality Enables a simple check of secondary network interfaces Used when an address is more beneficial than a host name Helps identify intermittent or long duration network events By piping ping output to a file activity overnight can later be viewed at once Indicates probe packet route and number of hops Comparing multiple routes can identify bottlenecks Appendix B Fault Isolation B 17 B 3 6 The following example shows output for the ping s command ping s san ff2 17 a PING san ff2 17 a 56 data bytes 64 bytes from san ff2 17 a 10 1 67 31 icmp_seq 0 time 0 427 ms 64 bytes from san ff2 17 a 10 1 67 31 icmp seg 1 time 0 194 ms SE san ff2 17 a PING Statistics 2 packets transmitted 2 packets received 0 packet loss round trip ms min avg max stddev 0 172 0 256 0 427 0 102 Using the ps Command The ps command lists the status of processes Using options and rearranging the command output can assist in determining the resource allocation B 3 6 1 Options TABLE B 8 describes options for the ps command and how those options can help troubleshooting TABLE B 8 Options for ps Option Description How It Can Help e Displays information for every Identifies the process ID and the executable process mf Genera
34. de xii Syntax of the Command Line Interface CLI The command syntax is as follows m A variable that requires input of a value must be put in Italics m An optional element must be enclosed in m A group of options for an optional keyword must be enclosed in and delimited by SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 Documentation Feedback If you have any comments or requests regarding this document go to the following websites m For Oracle users http www oracle com goto docfeedback Include the title and part number of your document with your feedback SPARC Enterprise M4000 M5000 Servers Installation Guide E26845 01 m For Fujitsu users http www fujitsu com global contact computing sparce index html Preface xiii xiv SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 CHAPTER 1 Installation Overview This chapter provides the process for installing the servers 1 1 Installation Workflow Installing a server requires the steps in FIGURE 1 1 1 2 FIGURE 1 1 Workflow Required for Installation Preparation Checking the cables and environmental conditions Before Installing the Server on page 2 2 Installation and checking the power supply Connecting the power cords Connecting Input Power Cords on page 3 2 Connecting the console Connecting the Administration Console on page 3 5
35. en the login prompt appears enter default for the login name login default Note Step 8 must be performed within a minute of Step 7 or the login certification will time out 8 Set the mode switch on the operator panel to the Locked position 9 Press the RETURN key Wait five seconds before continuing to Step 10 10 Set the mode switch on the operator panel to the Service position 11 Press the RETURN key 3 8 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 3 3 2 Note If Step 10 is not performed within 1 minute the login certification will expire 12 Confirm that the XSCF Shell prompt is displayed on the administration console XSCF gt Initializing the XSCF Unit To use full XSCF functionality various settings need to be set 1 Set the required settings See section Setting up XSCF in the SPARC Enterprise M 3000 4000 M5000 M8000 M9000 Servers XSCF User s Guide for details on how to set these settings The following settings are required m Registration of an XSCF user account and password and user privileges adduser password setprivileges m User account of a field engineer FE for maintenance m Date and time settings setdate settimezone m Confirmation of XSCF host public key showssh m SSH telnet settings setssh settelnet m Network interface routing and DNS related settings setnetwork setroute setnameserver etc Note Reset
36. he suppliers to Oracle and or its affiliates and Fujitsu Limited including software and font technology Per the terms of the GPL or LGPL a copy of the source code governed by the GPL or LGPL as applicable is available upon request by the End User Please contact Oracle and or its affiliates or Fujitsu Limited This distribution may include materials developed by third parties Parts of the product may be derived from Berkeley BSD systems licensed from the University of California UNIX is a registered trademark in the U S and in other countries exclusively licensed through X Open Company Ltd Oracle and Java are registered trademarks of Oracle and or its affiliates Fujitsu and the Fujitsu logo are registered trademarks of Fujitsu Limited All SPARC trademarks are used under license and are registered trademarks of SPARC International Inc in the U S and other countries Products bearing SPARC trademarks are based upon architectures developed by Oracle and or its affiliates SPARC64 is a trademark of SPARC International Inc used under license by Fujitsu Microelectronics Inc and Fujitsu Limited Other names may be trademarks of their respective owners United States Government Rights Commercial use U S Government users are subject to the standard government user license agreements of Oracle and or its affiliates and Fujitsu Limited and the applicable provisions of the FAR and its supplements Disclaimer The only warranties gr
37. if you are running the latest diagnostic engines An example of the fmadm output XSCF gt fmadm config MODULE VERSION STATUS DESCRIPTION eft 1 16 active eft diagnosis engine event transport 2 0 active Event Transport Module faultevent post L 0 active Gate Reaction Agent for errhandd fmd self diagnosis L 0 active Fault Manager Self Diagnosis iox agent L 0 active IO Box Recovery Agent reagent LT active Reissue Agent sysevent transport 0 active SysEvent Transport Agent syslog msgs L 0 active Syslog Messaging Agent XSCF gt Using the fmstat Command The fmstat command can report statistics associated with the Oracle Solaris fault manager The fmstat command shows information about DE performance In the example below the eft DE also seen in the console output has received an event which it accepted A case is opened for that event and a diagnosis is performed to solve the cause for the failure An example of the fmstat output B 8 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 B 3 B 3 1 Traditional Oracle Solaris Diagnostic Commands These superuser commands can help you determine if you have issues in your server in the network or within another server that you are networking with The following commands are detailed in this section m Section B 3 1 Using the iostat Command on page B 9 m Section B 3 2 Using the prtdiag Command on page B 11 m Section B
38. in Step 2 At the XSCF Shell verify power recovery with the showlogs event command Check that the AC LED and DC LED are lit on PSU 0 M4000 server PSU 0 PSU 2 M5000 server From the XSCF Shell confirm a Power Status is On by executing the showhardconf command Switch off all main line switches of AC GRID B Confirm that the POWER LED on the operator panel is on At the XSCF Shell verify power failure with the showlogs event command Switch on all the main line switches of AC GRID B switched off in Step 9 At the XSCF Shell verify power recovery with the showlogs event command Connecting Additional Peripheral Devices When you add additional storage devices mount the heaviest subassemblies at the lowest available opening to minimize the danger of a top heavy server Refer to the manual that came with the peripheral device for additional instructions Chapter 3 Installing the Server 3 15 Set the mode switch on the operator panel to the Locked position and give the key to the system administrator 3 16 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 CHAPTER 4 Connecting the Domains to the Network This chapter discusses how to establish a network for the servers It contains the following sections m Section 4 1 Overview of Network Configuration on page 4 1 m Section 4 2 Connecting to the Network on page 4 1 m Section 4 3 Verifying the Network Connectio
39. ing Input Power Cords The servers are shipped with grounding type three wire power cords Always connect the cords into grounded power outlets Caution The server is designed to work with power systems having a grounded neutral conductor Do not connect the equipment into any other type of power system Contact your facilities manager or a qualified electrician to determine what type of power is supplied to your building 1 Arrange the layout of all cables outside the system and secure the cables in place to prevent them from being damaged Refer to Facility Power Requirements and Characteristics on page 2 4 for diagrams showing cable connections Note It is the installer s responsibility to ensure that the facility power source has sufficient electrical power and redundancy to handle the required installation 2 Verify that the input power breaker is off 3 Connect the power cords to the input power source For redundancy in case of power source failure PSUO and PSU2 should be powered from AC GRID A and PSU1 and PSU3 should be powered from AC GRID B Note Use 200V when connecting cords for redundancy 100V is not supported 4 Make certain the power cords are tightly fastened Note The power cords and infiniband cables should hang loosely in a service loop behind the server or the cable management arm may not be able to fully retract SPARC Enterprise M4000 M5000 Servers Installation Guide
40. iptive format helps identify devices x For each drive reports extended drive statistics Provides rate information similar to the The output is in tabular form e option This helps identify poor performance of internal devices and other I O devices across the network The following example shows output for one iostat command iostat En c0t0d0 Soft Errors 0 Hard Errors 0 Transport Errors 0 Vendor SEAGATE Product ST973401LSUN72G Revision 0556 Serial No 0521104T9D Size 73 40GB lt 73400057856 bytes gt Media Error 0 Device Not Ready 0 No Device 0 Recoverable 0 Illegal Request 0 Predictive Failure Analysis 0 cOtido0 Soft Errors 0 Hard Errors 0 Transport Errors 0 Vendor SEAGATE Product ST973401LSUN72G Revision 0556 Serial No 0521104V3V Size 73 40GB lt 73400057856 bytes gt Media Error 0 Device Not Ready 0 No Device 0 Recoverable 0 Illegal Request 0 Predictive Failure Analysis 0 B 10 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 B 3 2 Using the prtdiag Command The prtdiag command displays configuration and diagnostic information The diagnostic information identifies any failed component The prtdiag command is located in the usr platform platform name sbin directory Note The prtdiag command might indicate a slot number different than that identified elsewhere in this document This is normal B 3 2 1 Options TABLE B 4 describes o
41. m from each domain and configuring the domains for the network Refer to the Oracle VTS user s guide for information on installing and use of the Oracle VTS software 4 2 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 APPENDIX A System Views Appendix provides views of the systems This appendix has the following sections m Section A 1 SPARC Enterprise M4000 Server Views on page A 1 m Section A 2 SPARC Enterprise M5000 Server Views on page A 5 m Section A 3 Operator Panel Overview on page A 9 A 1 SPARC Enterprise M4000 Server Views FIGURE A 1 shows the SPARC Enterprise M4000 server SPARC Enterprise M4000 Server Component Locations FIGURE A 1 41 40 39 38 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 A 2 Location Number a AeA W N e 0 N OA 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 Component 60 mm fan FAN_B 0 60 mm fan FAN_B 1 Top cover Fan cover Backplane Unit BPU A includes IOBP Power distribution board 172 mm fan backplane FANBP A 60 mm fan backplane FANBP B Tape drive backplane TAPEBD Hard disk drive backplane HDDBP 0 CD RW DVD RW backplane DVDBP A CD RW DVD RW drive unit DVDU Hard disk drive HDDf1 Hard disk drive HDD 0 Tape drive unit TAPEU Faceplate Power supply unit PSU 0 Power supply unit PSU 1 Operator panel OPN
42. message log An example of the showlogs output XSCF gt showlogs error Date Oct 03 13 53 05 UTC 2006 Code 40000000 faffc201 011d000100000000 Status Information Occurred Oct 03 13 53 04 742 UTC 2006 FRU XSCFU Msg XSCF process down detected Date Oct 03 13 53 05 UTC 2006 Code 40000000 faffc201 011d000100000000 Status Information Occurred Oct 03 13 53 05 880 UTC 2006 FRU XSCFU Msg XSCF process down detected Date Oct 03 14 36 58 UTC 2006 Code 40000000 faffc201 011d000100000000 Status Information Occurred Oct 03 14 36 57 777 UTC 2006 FRU XSCFU Msg XSCF process down detected Date Oct 03 17 23 11 UTC 2006 Code 80002000 cc 0000 0104340100000000 Status Alarm Occurred Oct 03 17 23 10 868 UTC 2006 FRU FAN_A 0 Msg Abnormal FAN rotation speed Insufficient rotation XSCF gt Appendix B Fault Isolation B 5 B 2 3 Using the showstatus Command The showstatus displays the information concerning the server s degraded FRUs An asterisk which indicates that the unit has been degraded is displayed along with any of the following states m Normal m Faulted m Degraded m Deconfigured m Maintenance An example of the showstatus output XSCF gt showstatus FANBP_C Status Normal z FAN_A 0 Status Faulted XSCF gt B 2 4 Using the fmdump Command The fmdump command can be used to display the contents of any log files associated with the Oracle Solaris fault manager This example
43. n on page 4 2 m Section 4 4 Verifying Operation by Running Oracle VTS Software on page 4 2 4 1 Overview of Network Configuration By this point in the installation the server is up and running The domains still need to be connected to the network 4 2 Connecting to the Network The hubs switches and cables used to connect the networks must be supplied by the user Note Connecting the I O units to the user s LAN allows the domains to access the network If you want the domains to be isolated from the network skip this step 4 1 Connect the network to the domains using an Ethernet cable You can connect to either the Gigabit Ethernet GbE port on the I O unit or on an Ethernet card installed in the I O unit 4 3 Verifying the Network Connection 1 Check the LAN link lamp on the I O Unit or PCI slot that is connected to the network for activity 2 Use a system on the network to navigate to one of the domains on the server Refer to the Oracle Solaris software documentation for information on accessing a server over the network 4 4 Verifying Operation by Running Oracle VTS Software Start the server from each domain configure the server for the network and run Oracle VTS Software The Oracle VTS software is a diagnostic tool for verifying hardware operations and checking the device connection status Refer to the Oracle Solaris software documentation for information on starting the syste
44. n the following example fmdump e TIME CLASS Nov 02 10 04 14 3008 ereport io fire jbc mb per B 2 5 Using the fmadm faulty Command The fmadm faulty command can be used by administrators and service personnel to view and modify system configuration parameters that are maintained by the Oracle Solaris Fault Manager The fmadm faulty command is primarily used to determine the status of a component involved in a fault as shown in the following example fmadm faulty STATE RESOURC degraded dev pci le 600000 0ee65618 2218 4997 c0dc b5c410ed8ec2 The PCI device is degraded and is associated with the same UUID as seen in the preceding example You might also see faulted states Appendix B Fault Isolation B 7 B 2 5 1 B 2 6 XSCF gt XSCF gt fmstat module ev recv ev acpt wait svc_t w b open solve memsz bufsz eft 0 0 0 0 0 0 0 0 0 0 3 3M 0 event transport 0 0 0 0 0 0 0 0 0 0 6 4K 0 faultevent post 2 0 0 0 8 9 0 0 0 0 0 0 fmd self diagnosis 24 24 0 0 352 1 0 0 1 0 24b 0 iox agent 0 0 04 0 0 0 0 0 0 0 0 0 reagent 0 0 0 0 0 0 0 0 0 0 0 0 sysevent transport 0 0 0 0 8700 4 0 0 0 0 0 0 syslog msgs 0 0 0 0 0 0 0 0 0 0 97b 0 fmadm config Command The fmadm config command output shows the version numbers of the diagnosis engines in use by your server as well as their current state You can check these versions against information on the My Oracle Support website to determine
45. nit and other units so that you can always locate faulty components and identify specific errors Check log files System messages are often displayed on the system console These messages can alert you to system problems such as a device that is about to fail Check using the XSCF You can use the XSCF Shell to find details of an error state the Shell device status history and other status information B 2 Using the Diagnostic Commands The following commands are detailed in this section Section B 2 1 Using the showhardconf Command on page B 2 Section B 2 2 Using the showlogs Command on page B 5 Section B 2 3 Using the showstatus Command on page B 6 Section B 2 4 Using the fmdump Command on page B 6 Section B 2 5 Using the fmadm faulty Command on page B 7 Section B 2 6 Using the fmstat Command on page B 8 B 2 1 Using the showhardconf Command The showhardconf command displays information about each FRU The following information is displayed Current configuration and status Number of installed FRUs Domain information IOBOX information Name properties of PCI cards B 2 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 An example of the showhardconf output XSCF gt showhardconf SPARC Enterprise M5000 Serial BCF07500B6 Operator Panel Switch Locked Power Supply System Dual SCF ID XSCF 0 System Power On System Phase Cabinet Power On
46. of class 3 or higher Sharing any grounding wire will lead to a malfunction Do not place cables under the equipment or have cables stretched tight Do not disconnect a power cord to the server while its power is on Do not place anything on the server or perform any work directly above it 2 1 m Be careful not to allow the ambient temperature to rise sharply in winter Such a sudden temperature change would cause condensation to form inside the product Allow for a sufficient warm up period prior to operation m Do not install the server near a copy machine air conditioner welding machine or any other loud equipment m Do not install the server near any equipment generating lots of electronic noise m Do not install the system on the same circuits as devices such as equipment elevators which can cause voltage sags when they are started up m Take measures to prevent static electricity from being generated at the location m Confirm that the supply voltage and frequency match the electrical ratings indicated on the server m Do not insert anything into any opening in the server The server contains high voltage parts If a metal object or another conductor were inserted into an opening in the equipment it could cause a short circuit that could cause fire electric shock or equipment damage m For details on maintenance of the server contact a certified service engineer 22 2 21 2 2 Before Installing the Server
47. orrective Actions to Common Problems on page B 1 m Section B 2 Using the Diagnostic Commands on page B 2 m Section B 3 Traditional Oracle Solaris Diagnostic Commands on page B 9 B 1 Corrective Actions to Common Problems This section provides information on the more common installation problems and their solutions TABLE B 1 Common Installation Problems Problem Solution No power to system Check to ensure that the input power source is on and that the power connectors are secure Check that the power cords are tightly fastened to both the system power supply units and to the input power source If a powered equipment rack is being use check to ensure it is turned on bootdisk command Check to see that the PCI PCI X card in slot 0 is properly seated results in can t Move the PCI PCI X card in slot 0 to another slot if possible locate boot device m Refer to the Before Using Solaris 10 and Checklists for Installation and Bug Information in the Solaris 10 Release and Installation Collection B 1 Refer to the SPARC Enterprise M4000 M5000 Servers Service Manual for LED status TABLE B 2 Types of Troubleshooting Methods Troubleshooting Method Description Check LEDs The system LEDs on the operator panel indicate any system or hardware error detected during initial diagnosis or system operation Additional LEDs are provided on the XSCF Unit power supply unit fan u
48. power to the power cords 3 4 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 3 3 Connecting the Administration Console The serial port on the XSCF Unit is a RJ 45 interface port used to monitor the boot process and to modify the default settings The port is monitored and configured using an administrative console connected to the serial port by a serial cable You can monitor and configure the XSCF Unit using any one of the following devices as the administrative console m ASCII terminal m Workstation m Terminal server or patch panel connected to a terminal server m Personal computer Note It is possible to connect to the LAN ports using Telnet or ssh access The LAN ports have class B private address values but they will not send out a packet by themselves until configured Note The modular connector RCI connector is not for connection to TNV circuits See item 1 in FIGURE 3 2 FIGURE 3 2 shows the locations of the ports on the XSCF Unit Chapter 3 Installing the Server 3 5 FIGURE 3 2 Ports on XSCF Unit SPARC Enterprise M5000 Server Shown Location Number Component 1 RCI Port 2 Serial Port 3 USB port 4 LAN 1 Ethernet 1 3 6 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 3 3 1 Location Number Component LAN 0 Ethernet 0 UPCf1 UPC 0 See Section A 1 SPARC Enterprise M4000 Server Views on page A 1 for the lo
49. ptions for the prtdiag command and how those options can help troubleshooting TABLE B 4 Options for prtdiag Option Description No option Lists components v Verbose mode Displays the time of the most recent AC power failure and the most recent hardware fatal error information How It Can Help Identifies CPU timing and PCI cards installed Provides the same information as no option Additionally lists fan status temperatures ASIC and PROM revisions Appendix B Fault Isolation B 11 The following example shows output for the prtdiag command in verbose mode prtdiag v System Configuration xxxx Server System clock frequency 1012 MHz Memory size 262144 Megabytes a tt CPUS SSS S gt gt SSS gt SS gt gt CPU CPU Run L2 CPU CPU LSB Chip ID MHz MB Impl Mask 00 0 0 I 2 97 4 5 6 7 2660 11 0 7 192 00 1 8 9 10 11 12 13 14 15 2660 11 0 7 192 00 2 16 T7 18 19 20 2l 22 23 2660 11 0 7 92 00 3 24 25 26 27 28 29 3040 31 2660 11 0 7 92 01 0 32 33 34 355 36 137 1387 39 2660 11 0 7 92 01 T 40 41 42 43 44 45 46 47 2660 11 0 7 92 01 2 484 49 50 DL 52 535 0 54 155 2660 11 0 7 3592 01 3 56 57 58 5 997 600 61 62 4 63 2660 11 0 7 192 Memory Configuration Memory Available Memory DIMM of Mirror Interleave LSB Group Size Status Size DIMMs Mode Fa
50. rprise M4000 M5000 Servers Documents SPARC Enterprise M3000 M4000 M5000 M8000 M9000 Servers Product Notes SPARC Enterprise M4000 M5000 Servers Product Notes External I O Expansion Unit Product Notes SPARC Enterprise M3000 M4000 M5000 M8000 M9000 Servers Glossary All getting started guides are printed documents For XCP version 1100 or later Text Conventions This manual uses the following fonts and symbols to express specific types of information Fonts symbols AaBbCc123 AaBbCc123 Italic Meaning What you type when contrasted with on screen computer output This font represents the example of command input in the frame The names of commands files and directories on screen computer output This font represents the example of command input in the frame Indicates the name of a reference manual Indicates names of chapters sections items buttons or menus Example XSCF gt adduser jsmith XSCF gt showuser P User Name jsmith Privileges useradm auditadm See the SPARC Enterprise M3000 M4000 M5000 M8000 M900 0 Servers XSCF User s Guide See Chapter 2 System Features Preface xi Notes on Safety Read the following documents thoroughly before using or handling any SPARC Enterprise M4000 M5000 server m SPARC Enterprise M3000 M4000 M5000 M8000 M9000 Servers Important Legal and Safety Information m SPARC Enterprise M4000 M5000 Servers Safety and Compliance Gui
51. sing the prtconf Command B 14 3 3 1 Options B 14 341 Options B 16 sing the ping Command B 17 3 5 1 Options B 17 sing the ps Command B 18 3 6 1 Options B 18 U B U B U B Using the netstat Command B 16 B U B U B U sing the prstat Command B 19 B 3 7 1 Options B 20 Contents vii viii SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 Preface This guide describes how to install and set up the SPARC Enterprise M4000 M5000 servers from Oracle and Fujitsu This document is intended for authorized service providers References herein to the M4000 server or M5000 server are references to the SPARC Enterprise M4000 or SPARC Enterprise M5000 server This preface includes the following sections Audience on page ix Related Documentation on page x Text Conventions on page xi Notes on Safety on page xii Syntax of the Command Line Interface CLI on page xii Documentation Feedback on page xiii Audience This guide is written for experienced system administrators with working knowledge of computer networks and advanced knowledge of the Oracle Solaris Operating System Oracle Solaris OS Related Documentation All documents for your server are available online at the following locations Documentation Link Sun Oracle software http www oracle com documentation related manuals Oracle Solaris OS and so on Fujitsu documents http w
52. ted that disables the startup Off Normal or the breaker is off power failure Blinking Indicates the position of fault Switch to direct server power on power off The Locked setting e Normal key position Power on is available with the Power switch but power off is not Disables the Power switch to prevent unauthorized users from powering the server on or off The Locked position is the recommended setting for normal day to day operations The Service setting Service should be provided at this position Power on and off is available with Power switch The key cannot be pulled out at this position A 12 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 The following table provides the meanings of the mode switch TABLE A 2 Meanings of the Mode Switch Function Mode Switch State Definition Locked Service Inhibition of Break Signal Reception Enabled Reception of the break Disabled signal can be enabled or disabled for each domain using setdomainmode Power On Off by Only power on is enabled Enabled power switch Appendix A System Views A 13 A 14 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 APPENDIX B Fault Isolation This chapter describes basic fault isolation information related to installation of the SPARC Enterprise M4000 M5000 servers from Oracle and Fujitsu This appendix has the following sections m Section B 1 C
53. tem control network Note The XSCF Ethernet port is IEEE 802 3i and IEEE 802 3u compliant This requires auto negotiation for the port into which it terminates Verifying the Configuration Verify the hardware configuration by following the procedure below on a console connected to the system control network 1 Log in to the server and access the XSCF Shell Refer to the SPARC Enterprise M3000 M4000 M5000 M8000 M9000 Servers XSCF User s Guide for details Chapter 3 Installing the Server 3 11 2 Type the showhardconf command with the u option from the XSCF Shell XSCF gt showhardconf u SPARC Enterprise M5000 Memory Size 64 GB 4 FRU Quantity MBU_B 1 CPUM 4 Freq 2 530 GHz 8 MEMB 8 MEM 64 Type 1A Size 1 GB 64 DDC_A 4 DDC_B 2 IOU 2 DDC_A 2 DDCR 2 DDC B 2 XSCFU 1 OPNL 1 PSU 4 FANBP C 1 FAN A 4 See the Section B 2 1 Using the showhardconf Command on page B 2 for details 3 Use the console command to go to the ok prompt XSCF gt console d domain_ID Replace domain ID with the number of a specific domain you want to access This command switches the prompt from the XSCF console to the domain console 3 12 SPARC Enterprise M40
54. terminal window and the total number of processes Output is automatically updated every five seconds Ctrl C aborts Limits output to number of lines Permits sorting list by key parameter Verbose mode How It Can Help Output identifies process ID user ID memory used state CPU consumption and command name Limits amount of data displayed and identifies primary resource consumers Useful keys are cpu default time and size Displays additional parameters The following example shows output for the prstat command prstat n 5 s size PID USERNAME SIZE RSS STATE 100463 root 66M 61M sleep 100006 root 11M 9392K sleep 100004 root 10M 8832K sleep 100061 root 9440K 6624K sleep 100132 root 8616K 5368K sleep Total 52 processes 188 lwps load averages PRI NICE TIME CPU PROCESS NLWP 59 0 0 01 03 0 0 fmd 19 59 0 0 00 09 0 0 svc configd 16 59 0 0 00 04 0 0 svc startd 14 59 0 0 00 01 0 0 snmpd 1 59 0 0 00 04 0 0 nscd 35 0 00 0 00 0 00 B 20 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012
55. tes a full listing Provides the following process information user ID parent process ID time when executed and the path to the executable o option Enables configurable output Provides only most important information Knowing the The pid pcpu pmem and percentage of resource consumption helps identify comm options display process processes that are affecting performance and might be ID percent CPU consumption hung percent memory consumption and the responsible executable respectively The following example shows output for one ps command B 18 SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 ps PID TTY TIME CMD 101042 pts 3 0 00 ps 101025 pts 3 0 00 sh Note When using sort with the r option the column headings are printed so that the value in the first column is equal to zero B 3 7 Using the prstat Command The prstat utility iteratively examines all active processes and reports statistics based on the selected output mode and sort order The prstat command provides output similar to the ps command Appendix B Fault Isolation B 19 B 3 7 1 Options TABLE B 9 describes options for the prstat command and how those options can help troubleshooting TABLE B 9 Options for prstat Option No option n number s key Description Displays a sorted list of the top processes that are consuming the most CPU resources List is limited to the height of the
56. u des soci t s affili es de l une ou l autre entit Ce document ainsi que les produits et technologies qu il d crit peuvent inclure des droits de propri t intellectuelle de parties tierces prot g s par copyright et ou c d s sous licence par des fournisseurs Oracle et ou ses soci t s affili es et Fujitsu Limited y compris des logiciels et des technologies atives aux polices de caract res Conform ment aux conditions de la licence GPL ou LGPL une copie du code source r gi par la licence GPL ou LGPL selon le cas est disponible sur demande par I Utilisateur final Veuillez contacter Oracle et ou ses soci t s affili es ou Fujitsu Limited Cette distribution peut comprendre des composants d velopp s par des parties tierces Des parties de ce produit peuvent tre d riv es des syst mes Berkeley BSD distribu s sous licence par l Universit de Californie UNIX est une marque d pos e aux Etats Unis et dans d autres pays distribu e exclusivement sous licence par X Open Company Ltd Oracle et Java sont des marques d pos es d Oracle Corporation et ou de ses soci t s affili es Fujitsu et le logo Fujitsu sont des marques d pos es de Fujitsu Limited Toutes les marques SPARC sont utilis es sous licence et sont des marques d pos es de SPARC International Inc aux Etats Unis et dans d autres pays Les produits portant la marque SPARC reposent sur des architectures d velopp es par Oracle et ou ses soci t
57. ww fujitsu com sparcenterprise manual Oracle M series http www oracle com technetwork documentation sparc server documents mseries servers 252709 html The following table lists titles of related documents SPARC Enterprise M4000 M5000 Servers Documents SPARC Enterprise M4000 M5000 Servers Site Planning Guide SPARC Enterprise Equipment Rack Mounting Guide SPARC Enterprise M4000 M5000 Servers Getting Started Guide SPARC Enterprise M4000 M5000 Servers Overview Guide SPARC Enterprise M3000 M4000 M5000 M8000 M9000 Servers Important Legal and Safety Information SPARC Enterprise M4000 M5000 Servers Safety and Compliance Manual External I O Expansion Unit Safety and Compliance Guide SPARC Enterprise M4000 Server Unpacking Guide SPARC Enterprise M5000 Server Unpacking Guide SPARC Enterprise M4000 M5000 Servers Installation Guide SPARC Enterprise M4000 M5000 Servers Service Manual External I O Expansion Unit Installation and Service Manual SPARC Enterprise M3000 M4000 M5000 M8000 M9000 Servers Administration Guide SPARC Enterprise M3000 M4000 M5000 M8000 M9000 Servers XSCF User s Guide SPARC Enterprise M3000 M4000 M5000 M8000 M9000 Servers XSCF Reference Manual SPARC Enterprise M4000 M5000 M8000 M9000 Servers Dynamic Reconfiguration DR User s Guide SPARC Enterprise M4000 M5000 M8000 M9000 Servers Capacity on Demand COD User s Guide x SPARC Enterprise M4000 M5000 Servers Installation Guide February 2012 SPARC Ente

Download Pdf Manuals

image

Related Search

Related Contents

Whynter ARC-12SD Portable Air Conditioner Owner`s  第四章 接 合 工 事  ダウンロード(日本語)  Manual del Usuario - Estabilizadores de tensión  

Copyright © All rights reserved.
Failed to retrieve file