Home

SPARC Enterprise T5140 and T5240 Servers Service Manual

1. EH DMM Channel 1 A DMM 1 SA DMM DIMM SS DIMMO Channelo DIMM 1 Channel 0 C gg TA lt olfo O y w a o l Branch 0 Branch 1 l DIMM1 DIMM 0 Channel 1 F Branch 0 l Branch 1 DIMM 0 _DIMM 1 Channel 1 Channel 0 96 J2400 J2500 J2300 J2200 J1800 J1900 J2100 J2000 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table identifies the order in which FB DIMMS must be added when upgrading the memory capacity of a SPARC Enterprise T5140 server TABLE FB DIMM Configuration Installation Map SPARC Enterprise T5140 Servers FB DIMM Motherboard FB DIMM Installation Branch Name Channel Name FRU Name Connector Order CMP 0 Channel 0 SYS MB CMP0O BRO CH0 DO J0500 1 Branch 0 SYS MB CMP0 BR0 CH0 D1 J0600 2 Channel 1 SYS MB CMP0 BR0 CH1 D0 J0700 1 SYS MB CMP0 BRO CH1 D1 JO800 2 CMP 0 Channel 0 SYS MB CMP0 BR1 CHO DO J0900 1 Branch 1 SYS MB CMP0 BR1 CH0 D1 J1000 2 Channel 1 SYS MB CMP0 BR1 CH1 D0 J1100 1 SYS MB CMP0 BR1 CH1 D1 J1200 2 CMP 1 Channel 0 SYS MB CMP1 BR0 CH0 D0 J1800 1 B h0 or SYS MB CMP1 BRO CHO D1 J1900 3 Channel 1 SYS MB CMP1 BR0 CH1 D0 J2000 1 SYS MB CMP1 BR0 CH1 D1 J2100 3 CMP 1 Channel 0 SYS MB CMP1 BR1 CH0 D0 J2200 1 Branch 1 SYS MB CMP1 BR1 CH0 D1 J2300 3 Channel 1 SYS MB CMP1 BR1 CH1 D0 J2400 1 SYS MB CMP1 BR1 CH1 D1 J2500
2. INFO message 42 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following example POST reports a memory error at FB DIMM location SYS MB CMP0 BR1 CH0 D0 The error was detected by POST running on core 7 strand 2 22 gt 2 gt ERROR TEST Data Bitwalk 2 gt H W under test SYS MB CMP0 BR1 CH0O DO 2 gt Repair Instructions Replace items in order listed by H W under test above 7 2 gt MSG Pin 149 failed on SYS MB CMPO BR1 CHO DO J2001 7 2 gt END_ERROR a i E 7 2 gt Decode of Dram Error Log Reg Channel 2 bits 60000000 0000108c 7 2 gt 1 MEC 62 R W1C Multiple corrected errors one or more CE not logged 7 2 gt 1 DAC 61 R W1C Set to 1 if the error was a DRAM access CE 7 2 gt 108c SYND 15 0 RW ECC syndrome 22 gt 2 gt Dram Error AFAR channel 2 00000000 00000000 2 gt L2 AFAR channel 2 00000000 00000000 NNN Related Information m ILOM Properties that Affect POST Behavior on page 35 m Examples of POST Management on page 37 m Run POST in Maximum Mode on page 39 m Clear POST Detected Faults on page 41 Managing Faults Using the PSH Feature These topics explain how to use the Solaris Predictive Self Healing PSH feature to diagnose conditions that may develop into hardware failures over time allowing for corrective intervention before the failure occurs m Solaris PSH Feature Overview on page 44 m PS
3. showkeyswitch showlocator showlogs b lines e lines v g lines p logtype r p 1 showplat form v Turns the Locator LED on the server on or off Displays the environmental status of the host server This information includes system temperatures power supply front panel LED hard drive fan voltage and current sensor status See Display FRU Information With the show Command on page 32 Displays current system faults See Faults Displayed by show faulty on page 29 Displays information about the FRUs in the server Displays the status of the virtual keyswitch Displays the current state of the Locator LED as either on or off Displays the history of all events logged in the service processor event buffers in RAM or the persistent buffers Displays information about the operating state of the host system the system serial number and whether the hardware is providing service 28 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Related Information m Managing Components With Automatic System Recovery Commands on page 50 Faults Displayed by show faulty The ILOM show faulty command will display the following kinds of fault information m Environmental faults m Invalid configurations m Faults detected during POST session m Faults detected by predictive self healing PSH feature Detecting and Managing Faults 29 Example of show fault
4. Motherboard Components in SPARC Enterprise T5140 Servers on page 184 I O Components in SPARC Enterprise T5140 Servers on page 186 Power Distribution Fan Module Components in SPARC Enterprise T5140 Servers on page 188 Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5140 Servers on page 190 HDD Data Cable Routing for SAS RAID Controller Cards in Four Disk Capable SPARC Enterprise T5140 Servers on page 193 HDD Data Cable Routing for SAS RAID Controller Cards in Eight Disk Capable SPARC Enterprise T5140 Servers on page 194 Related Information Identifying FRUs in SPARC Enterprise T5140 Servers on page 183 183 Motherboard Components in SPARC Enterprise T5140 Servers Motherboard Components SPARC Enterprise T5140 Servers FIGURE SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 184 The following table identifies the components located on the motherboard and points to instructions for servicing them TABLE Motherboard Components SPARC Enterprise T5140 Servers Item FRU Replacement Instructions Notes FRU Name If Applicable 1 PClIe XAUI risers 2 Removable rear panel cross beam 3 PCle filler panel 4 FB DIMMs J SCC module 6 Battery Servicing PCle XAUI Risers on page 104 Servicing PCIe XAUI Risers on page 104 Servicing PCle XAUI Risers on page 104 Identify Faulty FB DIMMs Us
5. on page 103 Servicing PCle XAUI Risers on page 104 Servicing the Battery on page 114 Servicing the SCC Module on page 116 Servicing the Memory Mezzanine Assembly SPARC Enterprise T5240 on page 118 Servicing the Motherboard Assembly on page 122 Related Information Infrastructure Boards in SPARC Enterprise T5140 Servers on page 2 Servicing FB DIMMs These topics explain how to identify locate and replace faulty FB DIMMs They also describe procedures for upgrading memory capacity and provide guidelines for achieving and maintaining valid memory configurations Memory Fault Handling Overview on page 82 Identify Faulty FB DIMMs Using the show faulty Command on page 83 Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 Remove FB DIMMs on page 84 Install Replacement FB DIMMs on page 86 Verify Successful Replacement of Faulty FB DIMMs on page 88 Upgrade Memory Configuration With Additional FB DIMMs on page 91 81 FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 Memory Fault Handling Overview A variety of features play a role in how the memory subsystem is configured and how memory faults are handled Understanding the underlying features helps you identify and repair memory problems This section descr
6. Front Panel Controls and Indicators on SPARC Enterprise T5140 Servers on page 5 Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers on page 9 TABLE Service Related Commands on page 26 Faults Displayed by show faulty on page 29 Viewing Solaris OS Messages on page 48 Detecting Faults Using SunVTS Software on page 53 Detecting Faults With POST on page 34 TABLE ILOM Properties Used to Manage POST Operations on page 36 Detecting and Managing Faults 19 TABLE Diagnostic Action Diagnostic Flowchart Reference Table Continued Possible Outcome Additional Information Check if the fault is environmental Flowchart item 6 Determine if the fault was detected by PSH Flowchart item 7 Determine if the fault was detected by POST Flowchart item 8 Contact technical support Flowchart item 9 Determine if the fault is an environmental fault or a configuration fault e Faults Displayed by show faulty on page 29 If the fault listed by the show faulty command displays a temperature or voltage fault then the fault is an environmental fault Environmental faults can be caused by faulty FRUs power supply or fan or by environmental conditions such as when computer room ambient temperature is too high or the server airflow is blocked When the environmental condition is corrected the fault will automatically clear I
7. UNIX Commands This document might not contain information on basic UNIX commands and procedures such as shutting down the system booting the system and configuring devices Refer to the following for this information m Software documentation that you received with your system m Solaris Operating System documentation which is at http docs sun com Text Conventions Typeface Meaning AaBbCc123 and directories on screen computer output AaBbCc123 What you type when contrasted with on screen computer output AaBbCc123 Book titles new words or terms words to be emphasized Replace command line variables with real names or values The names of commands files Examples Edit your login file Use 1s a to list all files You have mail o 6 su Password Read Chapter 6 in the User s Guide These are called class options To delete a file type rm filename The settings on your browser might differ from these settings Preface xvii Prompt Notations The following prompt notations are used in this manual Shell Prompt Notations C shell C shell superuser machine name machine name Bourne shell and Korn shell Bourne shell and Korn shell superuser ILOM service processor gt ALOM compatibility shell sc gt OpenBoot PROM firmware ok Conventions for Alert Messages This manual uses the following conventions to show alert messages which are
8. on page 67 4 For SPARC Enterprise T5140 servers disconnect and stow the hard drive data cable a Unplug the hard drive data cable from J6401 on the motherboard b Remove the hard drive data cable from its seat on the CMP air duct c Place the hard drive cable end out of the way of the air duct 5 Rotate the air duct up and toward the front of the system 6 Press the Fault Locator button on the motherboard to identify the FB DIMMs that need to be replaced Tip Make a note of the faulty FB DIMM location Note For memory configuration information see FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 or FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 7 Push down on the ejector tabs on each side of the FB DIMM until the FB DIMM is released Caution FB DIMMs and heat sinks on the motherboard may be hot Servicing Motherboard Components 85 FIGURE Removing FB DIMMs 8 Grasp the top corners of the faulty FB DIMM and lift it out of its slot 9 Place the FB DIMM on an antistatic mat 10 Repeat Step 7 through Step 9 for any other FB DIMMs you intend to remove 11 If you do not plan to install replacement FB DIMMs at this time install filler panels in the empty slots Related Information m Install Replacement FB DIMMs on page 86 m Verify Successful Replacement of Faulty FB DIMMs on page 88 V Install Replacemen
9. 141 diag_level parameter 36 diag_mode parameter 36 diag_trigger parameter 36 diag_verbosity parameter 36 diagnostics low level 35 running remotely 23 dmesg command 49 DVD drive FRU name 187 201 E electrostatic discharge ESD preventing using an antistatic mat 59 preventing using an antistatic wrist strap 58 safety measures 58 enablecomponent command 42 environmental faults 19 20 23 event log checking the PSH 46 EVENT_ID FRU 45 F Fan Fault system LED interpreting to diagnose faults 21 verifying state with replacement fan module 134 fan module determining fault state 21 Fault LED 21 134 FRU name 189 203 fan module LEDs using to identify faults 21 209 fan power board FRU name 189 203 Fault fan module LED 134 Fault hard drive LED 22 Fault power supply LED 137 fault manager daemon fmd 1M 44 fault records 48 faults clearing POST detected faults 41 clearing with ILOM set command 31 detected by POST 19 detected by PSH 19 environmental 19 20 forwarded to ILOM 23 recovery 23 repair 23 FB DIMM Fault LEDs 22 FB DIMMs troubleshooting 82 fmadm command 48 fmdump command 45 FRU event ID 45 FRU ID PROMs 23 G graceful shutdown 60 61 H hard drive determining fault state 22 Fault LED 22 hard drive backplane FRU name 187 201 help command 26 l I O subsystem 35 50 ILOM commands set 31 show faulty 28 installing PCIe XAUI riser 107 SC
10. FIGURE Power Supply Release Handle SPARC Enterprise T5240 Servers 6 Pull the power supply out of the chassis Servicing Power Supplies 139 V Install a Power Supply 1 Align the replacement power supply with the empty power supply chassis bay 2 Slide the power supply into the bay until it is fully seated FIGURE Installing a Power Supply SPARC Enterprise T5140 Server 140 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Installing a Power Supply SPARC Enterprise T5240 Server 3 Based on the model of your server AC or DC apply power to the power supply in one of the following ways m AC server models Connect the power cord to the power supply m DC server models Turn on the power using the circuit breaker at the power source Caution For server models with DC input power do not disconnect and reconnect the power cable at the Wago connector on the server DC power supply unit Instead control the input power using the circuit breaker at the power source Verify that the PSU OK LED is lighted 4 Close the CMA inserting the end of the CMA into the rear left rail bracket 5 Verify that the Fault LED on the replaced power supply the system Power Supply Fault LED and the front and rear Service Required LEDs are off Servicing Power Supplies 141 Power Supply Configuration Reference The following table describes the FRU device names for power supplies
11. PCle or XAUI names in ILOM messages are displayed with the full FRU name such as SYS MB RISERO PCIEO Note Fill the lower PCle XAUI slots Slots 0 2 first Related Information m Remove a PCIe or XAUI Card on page 109 m Install a PCIe or XAUI Card on page 109 m Remove a PCle XAUI Riser on page 105 m Install a PCle XAUI Riser on page 107 Servicing Motherboard Components 114 Servicing the Battery These topics explain how to replace a faulty battery m System Battery Overview on page 114 m Remove a Battery on page 115 m Install a Battery on page 116 System Battery Overview The battery maintains system time when the server is powered off and a time server is unavailable If the server fails to maintain the proper time when it is powered off and not connected to a network replace the battery The following figure shows the battery location on the SPARC Enterprise T5140 The SPARC Enterprise T5240 is in a similar location SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Battery Location SPARC Enterprise T5140 Server Shown Related Information m Remove a Battery on page 115 a Install a Battery on page 116 V Remove a Battery 1 Remove PCIe XAUI riser 2 See Remove a PCle XAUI Riser on page 105 2 Using a No 1 flat blade screwdriver press the clip away from the battery and pull the battery up and out of i
12. disconnect power cords before servicing the power distribution board Remove the Power Distribution Board Note the chassis serial number and server part number There are printed on a label located on the side of the chassis 1 Remove the motherboard assembly See Remove the Motherboard Assembly on page 123 2 SPARC Enterprise T5140 server Remove all power supplies a Grasp the power supply handle and press the release latch See the following figure b Slide the power supply out of the system SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Removing a Power Supply From a SPARC Enterprise T5140 Server 3 SPARC Enterprise T5240 server Remove the mezzanine riser guide See Remove a Memory Mezzanine Assembly on page 118 4 Disconnect the top cover interlock cable from the power distribution board 5 SPARC Enterprise T5240 server Disconnect the ribbon cable between the power distribution board and the power supply backplane See Panel 1 in the following figure FIGURE Removing a Power Distribution Board From a SPARC Enterprise T5240 Server Servicing Boards and Components 165 6 SPARC Enterprise T5240 server Remove the four No 2 Phillips screws securing the power distribution board to the power supply backplane 7 Remove the No 2 Phillips screw securing the power distribution board to the chassis as shown in the following figure FIGURE Removing the Power Dis
13. models Power Supply Status LEDs Each power supply contains a series of LEDs visible when looking at the back panel of the system 135 FIGURE Power Supply LEDs SPARC Enterprise T5140 Server Shown The following table describes the three power supply LEDs TABLE Power Supply Status LEDs Legend LED Icon Color 1 OK Green This LED lights when the power supply DC OK voltage from the PSU to the server is within tolerance 2 Fault Amber This LED is lit when the power supply is faulty 3 AC AC Green This LED turns on when AC voltage is Present applied to the power supply Note For DC models this is the DC input OK LED It turns on when the input DC power is present For DC PSUs this symbol is either DC or a power connector The front and rear panel Service Required LEDs turn on if the system detects a power supply fault Note If a power supply fails and you do not have a replacement available leave the failed power supply installed to ensure proper airflow in the server 136 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Related Information m Servicing Power Distribution Boards on page 163 m Servicing Power Supply Backplanes SPARC Enterprise T5240 Servers on page 170 m Remove a Power Supply on page 137 m Install a Power Supply on page 140 A V Remove a Power Supply Caution Hazardous voltages are present To reduce the risk
14. normal standby diag locked e y enables you to skip the confirmation question when setting the keyswitch to stby Controls the host server OpenBoot PROM firmware method of booting Performs a poweroff followed by poweron Powers off the host server Powers on the host server Indicates if it is okay to perform a hot swap of a power supply This command does not perform any action But this command provides a warning if the power supply should not be removed because the other power supply is not enabled Generates a hardware reset on the host server Reboots the service processor Sets the virtual keyswitch Detecting and Managing Faults 27 TABLE ILOM Command Service Related Commands Continued ALOM CMT Command Description set SYS LOCATE value value Fast_blink Off No ILOM equivalent show faulty No ILOM equivalent show SYS keyswitch_state SYS LOCATE show show SP logs event list show HOST setlocator value on off showenvironment showfaults v showfru g lines s d FRU e g lines specifies the number of lines to display before pausing the output to the screen e s displays static information about system FRUs defaults to all FRUs unless one is specified e d displays dynamic information about system FRUs defaults to all FRUs unless one is specified See Display FRU Information With the show Command on page 32
15. use the following command to change to the system console sc gt console Detecting and Managing Faults 25 Service Related ILOM Command Summary The following table describes the ILOM shell commands most frequently used when performing service related tasks The middle column identifies the ALOM CMT command that produces the same result TABLE Service Related Commands ILOM Command ALOM CMT Command Description help command set HOST send_break_action break set SYS component clear_fault_action true start SP console show SP console history help command Displays a list of all available commands with syntax and descriptions Specifying a command name as an option displays help for that command break y c D Takes the host server from the OS to e y skips the confirmation either kmdb or OpenBoot PROM question equivalent to a Stop A depending on the mode Solaris software was c executes a console command after the break command booted completes e D forces a core dump of the Solaris OS clearfault UUID Manually clears host detected faults The UUID is the unique fault ID of the fault to be cleared console f Connects you to the host system f forces the console to have read and write capabilities consolehistory b lines l e lines v Displays the contents of the g lines boot run system s console buffer The following options enable you to specify how t
16. 16 40 56 faults 0 SP faultmgmt 0 sp_detected_fault SYS MB CMP0 BR1 CH0 D0 faults 0 Forced fail POST 40 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Note The system can boot and run using memory that was not disabled Related Information m Clear POST Detected Faults on page 41 m Examples of POST Management on page 37 m POST Output Quick Reference on page 42 Y Clear POST Detected Faults In most cases when POST detects a faulty component POST logs the fault and automatically takes the failed component out of operation by placing the component in the ASR blacklist See Managing Components With Automatic System Recovery Commands on page 50 In most cases the replacement of the faulty FRU is detected when the service processor is reset or power cycled In this case the fault is automatically cleared from the system This procedure describes how to identify a POST detected fault and if necessary manually clear the fault 1 After replacing a faulty FRU enter the show faulty command to identify any faults detected by POST POST detected faults are distinguished by the text Forced fail No UUID number is reported for POST detected The following example shows show faulty output for a failed memory module in FB DIMM slot SYS MB CMP0 BR1 CMP0 D0 gt show faulty Target Property Value a nea EE EE Bee POSEAN NE ee ee ee SP faultmgmt 0 fru SYS
17. All FB DIMMs within a single CMP branch must have the same capacity If the System Firmware is at least version 7 1 7 f the FB DIMM capacities on different CPUs can be different When replacing a faulty FB DIMM the replacement FB DIMM must have the same FRU part number as the FB DIMM being replaced If you are not able to obtain a replacement FB DIMM with the same FRU part number may need to replace all the FB DIMMs in the branch to ensure that all FB DIMMs in that branch have the same FRU part number SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE BRanch 0 CMP1 Ranch 1 BRanch 0 CMPO FB DIMM Configuration on Motherboard SPARC Enterprise T5240 Servers BRanch 1 Dir Din J 1 CORN ooo pm m CHannd 1 CHamnd 0 oown m CHannd 1 CHannd 0 8X Dinm _ Din gt B CHannd O CHannd 1 ooun F xample Nomenclature SY S MB CMP1 BRO CH1 D0 motherboard 1 COMO m oooo m F CHannd 0 CHannd 1 Dir Dir coon m oone pm CORN EE coun FE 2HH H E C _ o con 16X H HHH The following figure shows the physical location for the FB DIMMs on the motherboard in a SPARC Enterprise T5240 server Servicing Motherboard Components 99 FIGURE Physical FB DIMM
18. EXCEPT AS EXPRESSLY SET FORTH IN SUCH AGREEMENT FUJITSU LIMITED SUN MICROSYSTEMS INC AND THEIR AFFILIATES MAKE NO REPRESENTATIONS OR WARRANTIES OF ANY KIND EXPRESS OR IMPLIED REGARDING SUCH PRODUCT OR TECHNOLOGY OR THIS DOCUMENT WHICH ARE ALL PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING WITHOUT LIMITATION ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID Unless otherwise expressly set forth in such agreement to the extent allowed by applicable law in no event shall Fujitsu Limited Sun Microsystems Inc or any of their affiliates have any liability to any third party under any legal theory for any loss of revenues or profits loss of use or data or business interruptions or for any indirect special incidental or consequential damages even if advised of the possibility of such damages DOCUMENTATION IS PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID eo Sea 4 Adobe PostScript Copyright 2009 Sun Microsystems Inc 4150 Network Circle Santa Clara California 95054 Etats Unis Tous droits r serv s Entr e et re
19. Enterprise T5140 and T5240 Servers Service Manual July 2009 10 11 12 13 a All FB DIMMs removed from the previous motherboard Ensure that the FB DIMM modules are installed in the same memory configuration as they were in before See FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 or FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 for guidance b SCC module See Install the SCC Module on page 117 Connect the hard drive data cables For cable routing instructions see whichever of the following topics apply m Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5140 Servers on page 190 m Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5240 Servers on page 204 Install the air duct See Install the Air Duct on page 104 Reinstall the motherboard to power distribution board ribbon cable Reinstall the PCIe and XUAI risers See Install a PCle XAUI Riser on page 107 Install the top cover See Install the Top Cover on page 177 Install the server into the rack See Reinstall the Server in the Rack on page 178 Attach the power cables See Connect Power Cords to the Server on page 181 Power on the server See Power On the Server Using the poweron Command on page 181 or Power On the Server Using the Front Panel Power Butto
20. Hard Drive Cage Overview The hard drive cage is the mechanical assembly that contains the system hard drives DVD USB module and hard drive backplane Servicing Boards and Components 151 You must remove the hard drive cage to access the following components a Hard drive backplane m Front control panel light pipe assemblies Related Information m Remove the Hard Drive Cage on page 152 a Install the Hard Drive Cage on page 154 m Remove the Hard Drive Backplane on page 157 m Remove the Front Control Panel Light Pipe Assemblies on page 161 V Remove the Hard Drive Cage 1 Power off the system See Removing Power From the System on page 60 2 Disconnect all external cables 3 Remove the server from the rack Place the server on a hard flat surface See Remove the Server From the Rack on page 64 4 SPARC Enterprise T5140 Remove the inner glides from the server Each inner glide is secured with a locking tab Release the tab and slide each inner glide off the server mounting studs 5 Attach an antistatic wrist strap 6 Remove the top cover See Remove the Top Cover on page 67 7 If you are servicing the hard drive backplane remove all hard drives See Remove a Hard Drive on page 71 Note Make a note of the drive locations before removing them You will need to install the hard drives in the same locations when reassembling the system 8 If you are serv
21. MB CMP0 BR1 CHO DO SP faultmgmt 0 timestamp Dec 21 16 40 56 SP faultmgmt 0 timestamp Dec 21 16 40 56 faults 0 SP faultmgmt 0 sp_detected_fault SYS MB CMP0 BR1 CH0 DO faults 0 Forced fail POST If no fault is reported this procedure is complete Do not perform the subsequent steps Detecting and Managing Faults 41 2 Clear the fault by setting the FRU s component_state property to Enabled This will remove the component from the ASR blacklist Use the FRU name that was reported in the fault in Step 1 gt set SYS MB CMP0 BR1 CH0 DO component_state Enabled The fault is cleared and should not show up when you run the show faulty command Additionally the Service Required LED is no longer on 3 Reset the server You must reboot the server for the change to the component_state property to take effect 4 At the ILOM prompt use the show faulty command to verify that no faults are reported gt show faulty Target Property Value ee a eee eee POEET E EE PE Rete et oe E POST Output Quick Reference POST error messages use the following syntax ERROR TEST ailing test H W under test FRU Repair Instructions Replace items in order listed by H W test above MSG test error message END_ERROR In this syntax c the core number s the strand number Warning messages use the following syntax WARNING message Informational messages use the following syntax
22. Requirements and concepts of installation and facility planning for the setup of SPARC Enterprise and PRIMEQUEST Server specifications for site planning Product features Manual Code C120 E488 C120 E554 C120 E489 C120 E555 C120 E493 C120 E391 C120 E495 C120 H007 C120 H028 C120 E494 Preface XV xvi Title Description Manual Code SPARC Enterprise T5140 and T5240 Servers Installation Guide SPARC Enterprise T5140 and T5240 Servers Service Manual SPARC Enterprise T5140 and T5240 Servers Administration Guide Integrated Lights Out Manager 2 0 User s Guide Integrated Lights Out Manager 2 0 Supplement for SPARC Enterprise T5140 and T5240 Servers Integrated Lights Out Manager ILOM 3 0 Concepts Guide Integrated Lights Out Manager ILOM 3 0 Getting Started Guide Integrated Lights Out Manager ILOM 3 0 Web Interface Procedures Guide Integrated Lights Out Manager ILOM 3 0 CLI Procedures Guide Integrated Lights Out Manager ILOM 3 0 SNMP and IPMI Procedures Guide Integrated Lights Out Manager ILOM 3 x Feature Updates and Release Notes Integrated Lights Out Manager ILOM 3 0 Supplement for SPARC Enterprise T5140 and T5240 Servers External I O Expansion Unit Installation and Service Manual External I O Expansion Unit Product Notes Detailed rackmounting cabling power on and configuring information How to run diagnostics to troubleshoot the ser
23. Set cli_mode to alom Note The asterisks in the example will not appear when you enter your password You can combine the create and set commands on a single line gt create SP users admin role Administrator cli_mode alom Creating user Enter new password Enter new password again Created SP users admin Detecting and Managing Faults 33 3 Log out of the root account after you have finished creating the new account 4 Log into the ALOM CLI shell indicated by the sc gt prompt from the ILOM login prompt using the username and password you created in Step 2 login admin Password Waiting for daemons to initialize Daemons ready Integrated Lights Out Manager Version 2 0 0 0 Copyright 2007 Sun Microsystems Inc All rights reserved Use is subject to license terms sc gt Note Multiple service processor accounts can be active concurrently A user can be logged in under one account using the ILOM shell and another account using the ALOM CMT shell Related Information Diagnostics Tools Quick Reference on page 17 ILOM Troubleshooting Overview on page 23 Service Related ILOM Command Summary on page 26 Detecting Faults With POST These topics explain how to use POST as a diagnostic tool POST Overview on page 35 ILOM Properties that Affect POST Behavior on page 35 Examples of POST Manageme
24. T5240 server FIGURE Removing the Front Control Panel Light Pipe Assembly From a SPARC Enterprise T5240 Server Servicing Boards and Components 161 3 Slide the light pipe assembly out of the control panel Related Information m Install the Front Control Panel Light Pipe Assemblies on page 162 m Remove the Hard Drive Cage on page 152 V Install the Front Control Panel Light Pipe Assemblies 1 Insert the light pipe assembly into the control panel 2 Align the control panel light pipe assembly with the mounting holes on the hard drive cage a Two screws secure the assembly to the hard drive cage in the SPARC Enterprise T5140 server m Three screws secure the assembly to the hard drive cage in the SPARC Enterprise T5240 server The following figure illustrates installation of the front control panel light pipe on a SPARC Enterprise T5240 server Except for minor differences such as the number of screws installation is the same for SPARC Enterprise T5140 servers 162 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Installing a Front Control Panel Light Pipe Assembly in a SPARC Enterprise T5240 Server 3 Secure the light pipe assembly with the No 1 Phillips screws 4 Install the hard drive cage See Install the Hard Drive Cage on page 154 Related Information m Remove the Front Control Panel Light Pipe Assemblies on page 161 Servicing Power Distribution Boar
25. Use the Solaris message files to view hard drive faults For general information about ILOM see the Integrated Lights Out Manager ILOM 3 0 Concepts Guide For detailed information about ILOM features that are specific to this server see the Integrated Lights Out Manager ILOM 3 0 Supplement for SPARC Enterprise T5140 and T5240 Servers Methods for Connecting to the Service Processor Before you can run ILOM commands you must connect to the service processor You can do this using either of the following methods m Connect an ASCII terminal directly to the serial management port m Use the ssh command to connect to service processor through an Ethernet connection on the network management port Note Refer to the Integrated Lights Out Manager ILOM 3 0 Supplement for SPARC Enterprise T5140 and T5240 Servers for instructions on configuring and connecting to ILOM SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 How to Switch From the System Console to the Service Processor The following example shows the character sequence hash period used to change from the system console to the service processor ok How to Switch From the Service Processor to the System Console The following example showiest I LOM command for changing from the service processor to the system console gt start SP console If you are connected to the service processor using the ALOM CMT shell
26. an Installation in a SPARC Enterprise T5240 Server 2 Secure the power supply backplane with one No 2 Phillips screw 3 Install the power distribution board See Install the Power Distribution Board on page 167 4 Install the power supplies Slide each power supply into its bay until the power supply locks into place Servicing Boards and Components 173 FIGURE Installing a Power Supply Illustrating Installation of a Power Supply in a SPARC Enterprise T5240 Server 5 Install the motherboard assembly See Install the Motherboard Assembly on page 125 Related Information m Remove the Power Supply Backplane on page 171 Servicing Paddle Cards These topics explain how to remove and install paddle cards in SPARC Enterprise T5140 and T5240 servers a Paddle Card Overview on page 175 m Remove the Paddle Card on page 175 a Install the Paddle Card on page 176 174 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Paddle Card Overview The paddle card serves as the interconnect between the power distribution board and the fan power boards hard drive backplane and front panel I O board Related Information m Remove the Paddle Card on page 175 V Remove the Paddle Card 1 Remove the motherboard assembly See Remove the Motherboard Assembly on page 123 2 Remove the power distribution board See Remove the Power Distribution Board on p
27. are test categories that are recommended for running on this server SunVTS Tests Field Replaceable Units Exercised by Tests By BJ 1 Enabie Disave EYE Test Results Test t State Scheduling Policy Stress t Progress Indicator Test Status ejo Disk Enabled Time high idle 0 0 Interconnect Enabled Time high idle 0j o0 loports Enabled Time high idle 00 Memory Enabled Time high idle 0j o0 Network Enabled Time high idle 0 o0 Processor Enabled Time high idle 0 o0 Enable Disable Memory Test Processor Test Disk Test Network Test Interconnect Test IO Ports Test Environment Test FB DIMMs CMP motherboard Disks cables disk backplane DVD drive Network interface network cable CMP motherboard Board ASICs and interconnects I O serial port interface USB subsystem Motherboard and service processor 5 Optional Customize individual tests Click on the name of the test to select and customize individual tests Note Use the System Excerciser High Stress Mode to test system operations Use the Component Stress High setting for the highest stress possible 54 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 6 Click the Start button to start the test process Status and error messages appear in the test messages area located across the bottom of the window You can stop testing at any time by clicking the Stop button Statu
28. cover See Remove the Top Cover on page 67 4 Open the air duct to gain to access the FB DIMM Fault Locator button 5 Press the FB DIMM Fault Locator button on the motherboard This will cause an amber LED associated with the faulty FB DIMM to light for a few minutes Servicing Motherboard Components 83 FIGURE FB DIMM Fault Locator Button on the Motherboard 6 Note the FB DIMM associated with the illuminated LED 7 Ensure that all other FB DIMMs are seated correctly in their slots Related Information a Identify Faulty FB DIMMs Using the show faulty Command on page 83 V Remove FB DIMMs Before beginning this procedure ensure that you are familiar with the cautions and safety instructions described in General Safety Information on page 57 empty FB DIMM slots If the server includes a memory mezzanine this caution A Caution Do not leave FB DIMM slots empty You must install filler panels in all applies to those FB DIMM slots as well 84 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 1 Extend the server to the maintenance position See Extend the Server to the Maintenance Position on page 63 2 Remove power from the server See Disconnect Power Cords From the Server on page 62 3 Remove the top cover See Remove the Top Cover
29. from the Sun VTS message and replace the FRU Identify faulty FRU from the POST message and replace the FRU Diagnostics Flowchart 1 Are the Power OK and AC OK LEDs off Yes No 2 Are any faults reported by the ILOM showfaults command No 3 Do the Solaris logs indicate a faulty FRU No 4 Does Sun VTS report any faulty devices Yes No 5 Does POST report any faulty devices Yes Check the power source and connections The showfaults command displays a fault 6 Is the fault an environmental fault Yes No 7 Is the fault a PSH detected fault Yes No 8 The fault is a POST detected fault 9 Contact Sun Support if the fault condition persists SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Identify the fault condition from the fault message Identify and replace the faulty FRU from the PSH message and perform the procedure to clear the PSH detected fault Identify and replace the faulty FRU from the POSTmessage and perform the procedure to clear the POST detected faults The following table provides brief descriptions of the troubleshooting actions shown in the flowchart It also provides links to topics with additional information on each diagnostic action TABLE Diagnostic Acti
30. intended to prevent injury to the user or bystanders as well as property damage and important messages that are useful to the user Warning This indicates a hazardous situation that could result in death or serious personal injury potential hazard if the user does not perform the procedure correctly Caution This indicates a hazardous situation that could result in minor or moderate personal injury if the user does not perform the procedure correctly This signal also indicates that damage to the product or other property may occur if the user does not perform the procedure correctly Caution This indicates that surfaces are hot and might cause personal injury if touched Avoid contact xviii SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Caution This indicates that hazardous voltages are present To reduce the risk of electric shock and danger to personal health follow the instructions Tip This indicates information that could help the user to use the product more effectively Alert Messages in the Text An alert message in the text consists of a signal indicating an alert level followed by an alert statement A space of one line precedes and follows an alert statement Caution The following tasks regarding this product and the optional products provided from Fujitsu should only be performed by a certified service engineer Users must not perform these tasks In
31. interface which is the default interface SunVTS software also supports a TTY user interface and a command line interface CLI All three interfaces are described in the SunVTS Software User s Guide 1 Start the agent and Javabridge on the server cd usr sunvts bin startsunvts 2 At the interface prompt choose C to start the SunVTS client 3 Start SunVTS browser environment from a web browser on the client system In the browser s address field type http servername 6789 This causes the SunVTS browser interface to be displayed Detecting and Managing Faults 53 FIGURE User ia11 SunVTS SunVTS Browser Interface Test Group on bofa d APPLICATIONS VERSION System Status idle Elapsed Time 000 00 00 Test Mode System Exerciser Session m Test Group 6 oc our Here By Default all the tests are enabled To run a subset of tests select the tests that should not be run and click Disable button Then to execute enabled tests click on Start Tests button To restart a completed test reset the test counters by clicking the Reset Results button Edit Global Options Start Tests Stop Tests Reset Results Reprobe 4 Optional Select the test category you want to run The following
32. might not be present in this slot for some configurations Identifying FRUs in SPARC Enterprise T5140 Servers 189 Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5140 Servers There are two SAS controller card options for the SPARC Enterprise T5140 and T5240 servers both options support RAID The standard option uses the on board SAS controller card preinstalled on every server The second option is a StorageTek SAS RAID Internal Host Bus Adapter HBA PCle card The internal cabling of your server will be different depending on the SAS controller card option you choose 190 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Internal Cables for the Onboard SAS Controller Card Four Disk Capable SPARC Enterprise T5140 Servers Figure Legend 1 Top cover safety interlock 2 Motherboard to PDB cable 3 Hard drive data cable TABLE Data Cable Routing Details Four Disk Capable SPARC Enterprise T5140 Servers Item FRU Connections Routing notes 3 HDD data From J4101 SAS0 on the motherboard Routed along CMP Module 1 CMP1 then over cable to J0301 P1 on the hard drive the chassis center wall and then over the fan backplane power boards Identifying FRUs in SPARC Enterprise T5140 Servers 191 FIGURE Internal Cables for the Onboard SAS Controller Card Eight Disk Capable SPARC Enterprise T5140 Servers Figure Legend 1 Top cover safety
33. of electric shock and danger to personal health follow the instructions 1 Move to the rear of the server chassis so you can view the power supply status LEDs The amber Fault LED on the failed power supply will be on 2 Optional You can verify the status indicated by the Fault LED by running the ILOM show faulty command The Fault LED indication is verified if the show faulty command lists that power supply as faulty 3 Locate and release the cable management arm CMA a Press and hold the tab as show in the following figure b Rotate the cable management arm out of the way so that you can access the power supply Servicing Power Supplies 137 FIGURE Cable management Arm Release Mechanism 4 Based on the model of your server AC or DC remove power from the server in one of the following ways m AC server models Disconnect the power cord from the faulty power supply a DC server models Turn off the power using the circuit breaker on the power source cable at the Wago connector on the server DC power supply unit Instead turn off A Caution For server models with DC input power do not disconnect the power the power at the circuit breaker on the power source 5 Grasp the power supply handle and press the release latch 138 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Power Supply Release Handle SPARC Enterprise T5140 Servers
34. remove and install the I O cards themselves a PCle XAUI Riser Overview on page 105 m Remove a PCle XAUI Riser on page 105 a Install a PCle XAUI Riser on page 107 m Remove a PCle or XAUI Card on page 109 a Install a PCle or XAUI Card on page 109 m PCIe and XAUI Card Reference for SPARC Enterprise T5140 Servers on page 112 a PCIe and XAUI Card Reference for SPARC Enterprise T5240 Servers on page 113 104 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 PCle XAUI Riser Overview PClIe XAUI cards are installed on vertical risers You must remove the PCI cross beam and relevant riser to access a PCIe XAUI card Caution This procedure requires that you handle components that are sensitive to static discharge This sensitivity can cause the component to fail Caution Ensure that all power is removed from the server before removing or installing expansion cards You must disconnect the power cords before performing this procedure You must remove PCle riser 2 when servicing the SCC module You must remove all three PCle XAUI risers when servicing the motherboard Remove a PCle XAUI Riser 1 Power off the server See Removing Power From the System on page 60 2 Disconnect all power cables See Disconnect Power Cords From the Server on page 62 3 Attach an antistatic wrist strap 4 Disconnect any data cables connected to the cards on th
35. server front panel including the power and system locator buttons and the various status and fault LEDs Note The front panel also provides access to internal hard drives the removable media drive and the two front USB ports Identifying Server Components 5 FIGURE Front Panel Controls and Indicators on SPARC Enterprise T5140 Servers Figure Legend 1 2 3 4 6 Locator LED and button Hard Drive map Service Required LED Power OK LED Power button Power Supply Service Required LED Overtemp LED Fan Module Service Required LED on ona SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table provides descriptions of these controls and indicators TABLE Front Panel Controls and Indicators SPARC Enterprise T5140 and T5240 Servers LED or Button Icon or Label Description Locator LED WW The Locator LED can be turned on to identify a particular system When on it and button blinks rabidly There are three methods for turning a Locator LED on white e Issuing the I LOM command set SYS LOCATE value Fast_Blink e Issuing the ALOM CMT command setlocator on e Pressing the Locator button Service If on indicates that service is required POST and ILOM are two diagnostics Required LED tools that can detect a fault or failure resulting in this indication amber VAN The ILOM show faulty command provides details about any faults that cause this indicator to light Under some fau
36. the service processor ILOM shell default ILOM browser interface BI a ALOM CMT compatibility shell The ILOM shell provides access to ILOM s features and functions through a command line interface CLI The shell prompt looks like this 40S e E The ILOM browser interface supports the same set of features and functions as the shell but through windows on a browser interface The ALOM CMT compatibility shell emulates the ALOM CMT interface used on earlier generations of CMT servers The ALOM CMT compatibility shell prompt looks like this sco Note Unless indicated otherwise all examples of interaction with the service processor are depicted with ILOM shell commands 16 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Multiple service processor accounts can be active concurrently A user can issue ILOM shell commands while logged in under one account and at the same time issue ALOM CMT shell commands while operating in another account Related Information m Diagnostics Tools Quick Reference on page 17 Diagnostics Tools Quick Reference The following flowchart illustrates the complementary relationship of the different diagnostic tools and indicates a default sequence of use Detecting and Managing Faults 17 FIGURE Faulty hardware suspected Identify faulty FRU from the fault message and replace the FRU Identify faulty FRU
37. you want to configure 6 Wait until the blue Ready to Remove LED is no longer lit on the drive that you installed Servicing Hard Drives 75 7 At the Solaris prompt type the cfgadm al command to list all drives in the device tree including any drives that are not configured cfgadm al This command should identify the Ap_id for the hard drive that you installed The output should indicate that the drive you installed is configured For example the output should look like this Ap_id Type Receptacle Occupant Condition c0 scsi bus connected configured unknown c0 dsk c1t0d0 disk connected configured unknown c0 dsk c1t1d0 disk connected configured unknown usb0 1 unknown empty unconfigured ok usb0 2 unknown empty unconfigured ok usb0 3 unknown empty unconfigured ok usb1 1 unknown empty unconfigured ok usb1 2 unknown empty unconfigured ok usb1 3 unknown empty unconfigured ok usb2 1 unknown empty unconfigured ok usb2 2 unknown empty unconfigured ok usb2 3 unknown empty unconfigured ok usb2 4 unknown empty unconfigured ok usb2 5 unknown empty unconfigured ok usb2 6 unknown empty unconfigured ok usb2 7 unknown empty unconfigured ok usb2 8 unknown empty unconfigured ok Related Information a Install a Hard Drive on page 73 m Four Drive Capable Backplane Configuration Reference on page 77 m Eight Drive Capable Backplane Configuration Reference on page 78 m Sixteen Drive Capable Backpl
38. 0 Mbps connection e Off Operating as a 10 Mbps connection Right LED Green Link Activity indicator e Blinking There is activity on this port e Off No link is established The NET MGT port only operates in 100 Mbps or 10 Mbps so the speed indicator LED will be green or off never amber Related Information a LED Overview on page 21 14 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Detecting and Managing Faults These topics explain how to use various diagnostic tools to monitor server status and troubleshoot faults in the server m Diagnostic Tools Overview on page 15 m Detecting Faults With ILOM on page 22 m Detecting Faults With POST on page 34 m Managing POST Operations on page 35 m Managing Faults Using the PSH Feature on page 43 m Viewing Solaris OS Messages on page 48 m Managing Components With Automatic System Recovery Commands on page 50 m Detecting Faults Using SunVTS Software on page 53 Related Information m Identifying FRUs in SPARC Enterprise T5140 Servers on page 183 m Identifying FRUs in SPARC Enterprise T5240 Servers on page 195 Diagnostic Tools Overview The service processor provides a range of system management and diagnostic tools that enable you to monitor server operations and troubleshoot server problems The following is a high level summary of the various diagnostic tools that are available
39. 0 servers to operation after you have performed service procedures m Install the Top Cover on page 177 m Reinstall the Server in the Rack on page 178 m Return the Server to the Normal Rack Position on page 180 m Connect Power Cords to the Server on page 181 m Power On the Server Using the poweron Command on page 181 m Power On the Server Using the Front Panel Power Button on page 182 V Install the Top Cover 1 Place the top cover on the chassis Set the cover down so that it hangs over the rear of the server by about an inch 25 4 mm 2 Slide the top cover forward until it seats 177 FIGURE Installing the Top Cover Note If an emergency shutdown occurred when the top cover was removed you must install the top cover and use the poweron command to restart the system See Power On the Server Using the poweron Command on page 181 for more information about the poweron command Related Information m Power On the Server Using the poweron Command on page 181 V Reinstall the Server in the Rack Caution The chassis is heavy To avoid personal injury use two people to lift it and set it in the rack 1 Place the ends of the chassis mounting brackets into the slide rails See 178 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Returning the Server to the Rack 2 Slide the server into the rack until
40. 028 2007 12 19 22 01 32 036 command and spin 0 gt INFO 0 gt POST Passed all devices 0 gt POST Return to VBSC 0 gt Master set ACK for vbsc runpost oo oS SO T5240 No Keyboard OpenBoot 7968 MB memory available Serial 75916434 stacie obp 0 Ethernet address 0 14 4f 86 64 92 Host ID xxxxx 0 ok 4 If POST detects a faulty device information about the device will be passed to the service processor for handling Fault information will also be displayed Note If POST does not detect a fault the system will boot In this case the problem being investigated probably falls outside the scope of POST s test coverage POST s failure to detect any faults should be considered diagnostic data as well 5 Evaluate the test information returned by POST See POST Output Quick Reference on page 42 for a summary of the syntax used in POST fault reporting 6 Run the ILOM show faulty command to obtain additional fault information If show faulty detects a fault the service processor logs the fault disables the faulty component and causes the Service Required LED to light In the following example FB DIMM module SYS MB CMP0 BR1 CH0 D0 is disabled gt show faulty Target Property Value ee Se eee eae Geo a eto Da a eee ones seen secsasecee SP faultmgmt 0 fru SYS MB CMP0 BR1 CHO DO SP faultmgmt 0 timestamp Dec 21 16 40 56 SP faultmgmt 0 timestamp Dec 21
41. 2 Infrastructure Boards in SPARC Enterprise T5140 Servers SPARC Enterprise T5140 servers are based on a 1U chassis family The following table provides a summary of the circuit boards used in these servers Board Description Motherboard Power distribution board Paddle card Fan power boards 2 Hard drive backplane Front I O board This board includes two CMP modules slots for 16 FB DIMM memory control subsystems and all service processor ILOM logic It also hosts a removable SCC module which contains all MAC addresses host ID and ILOM configuration data This board distributes main 12V power from the power supplies to the rest of the system This board is directly connected to the paddle card and to the motherboard via a bus bar and ribbon cable This board also supports a top cover safety interlock kill switch This board serves as the interconnect between the power distribution board and the fan power boards disk drive backplane and front I O board These boards carry power to the system fan modules In addition these boards contain fan module status LEDs and transmit status and control data for the fan modules This board includes the connectors for the hard drives This board also contains the interconnect for the front I O board Power and Locator buttons and system component status LEDs Each drive has its own Power Activity Fault and Ready to Remove LEDs This board conne
42. 3 Upgrade path DIMMs should be added with each group populated in the order shown Related Information a FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 m Identify Faulty FB DIMMs Using the show faulty Command on page 83 m Remove FB DIMMs on page 84 m Install Replacement FB DIMMs on page 86 m Verify Successful Replacement of Faulty FB DIMMs on page 88 m Upgrade Memory Configuration With Additional FB DIMMs on page 91 Servicing Motherboard Components 97 98 FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers When planning FB DIMM upgrades to SPARC Enterprise T5240 servers observe the following memory configuration guidelines The motherboard has 16 slots that support industry standard FB DIMMs Use only 1 5 volt FB DIMMs in SPARC Enterprise T5140 and T5240 servers SPARC Enterprise T5240 servers support three FB DIMM configurations a 8 FB DIMMs Group 1 in FIGURE FB DIMM Configuration on Motherboard SPARC Enterprise T5240 Servers on page 99 a 12 FB DIMMs Groups 1 and 2 in FIGURE FB DIMM Configuration on Motherboard SPARC Enterprise T5240 Servers on page 99 a 16 FB DIMMs Groups 1 2 and 3 in FIGURE FB DIMM Configuration on Motherboard SPARC Enterprise T5240 Servers on page 99 SPARC Enterprise T5240 servers can be equipped with a memory mezzanine assembly which provides an additional 16 FB DIMM slots
43. 3 Detecting Faults Using SunVTS Software 53 v Run the SunVTS Software 54 Preparing to Service the System 57 General Safety Information 57 Safety Symbols 57 Electrostatic Discharge Safety Measures 58 Antistatic Wrist Strap Use 58 Antistatic Mat 59 Essential Tools 59 v Find the Chassis Serial Number 59 Removing Power From the System 60 v Power Off the Server Service Processor Command 60 v Power Off the Server Power Button Graceful 62 v Power Off the Server Emergency Shutdown 62 v Disconnect Power Cords From the Server 62 Positioning the System for Servicing 62 v Extend the Server to the Maintenance Position 63 v Remove the Server From the Rack 64 Accessing Internal Components 67 v Perform Electrostatic Discharge Prevention Measures 67 Contents vii v Remove the Top Cover 67 Servicing Hard Drives 69 Hard Drive Servicing Overview 69 Hard Drive LEDs 70 v Remove a Hard Drive 71 v Install a Hard Drive 73 Four Drive Capable Backplane Configuration Reference 77 Eight Drive Capable Backplane Configuration Reference 78 Sixteen Drive Capable Backplane Configuration Reference 79 Servicing Motherboard Components 81 Servicing FB DIMMs 81 Memory Fault Handling Overview 82 v Identify Faulty FB DIMMs Using the show faulty Command 83 v Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button 83 v Remove FB DIMMs 84 v Install Replacement FB DIMMs 86 v Verify Successful Replacement of Faulty FB DIMMs_ 88 Upgrade Memor
44. 4 62 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 V Extend the Server to the Maintenance Position The following components can be serviced with the server in the maintenance position Hard drives Fan modules Power supplies DVD USB module Fan power boards FB DIMMs PCle XAUI cards Motherboard battery SCC module If the server is installed in a rack with extendable slide rails use this procedure to extend the server to the maintenance position 1 Optional Use the set SYS LOCATE command from the gt prompt to locate the system that requires maintenance gt set SYS LOCATE value Fast_Blink Once you have located the server press the Locator LED and button to turn it off Verify that no cables will be damaged or will interfere when the server is extended Although the cable management arm CMA that is supplied with the server is hinged to accommodate extending the server you should ensure that all cables and cords are capable of extending From the front of the server release the two slide release latches as shown in the following figure Squeeze the green slide release latches to release the slide rails Preparing to Service the System 63 FIGURE Slide Release Latches 4 While squeezing the slide release latches slowly pull the server forward until the slide rails latch V Remove the Server From the Rack The server must be remove
45. B Module Illustrates installing in a SPARC Enterprise T5140 server 2 Slide the pull tab back into the system Servicing Boards and Components 147 3 Install the hard drive you removed during the DVD USB module removal procedure 4 Plug in the power cords 5 Power on the system See Power On the Server Using the poweron Command on page 181 or Power On the Server Using the Front Panel Power Button on page 182 Related Information m Remove the DVD USB Module on page 145 m Servicing the Hard Drive Backplane on page 156 Servicing Fan Power Boards These topics explain how to remove and install fan power boards a Fan Power Board Overview on page 148 m Remove the Fan Power Board on page 149 a Install the Fan Power Board on page 150 Related Information m Remove the Hard Drive Backplane on page 157 Fan Power Board Overview Fan power boards carry power to the system fan modules They also contain fan module status LEDs and carry status and control data for the fan modules You must remove both fan power boards in order to access the following components m Paddle card m SPARC Enterprise T5240 server Hard drive data cables Related Information m Remove the Fan Power Board on page 149 a Install the Fan Power Board on page 150 148 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 m Servicing Paddle Cards on page 174 V Re
46. C module 117 L latch power supply 138 slide rail 63 LED AC Present power supply LED 19 141 Fan Fault system LED 21 134 Fault fan module LED 21 134 Fault hard drive LED 22 Fault power supply LED 21 137 FB DIMM Fault motherboard LEDs 22 Overtemp system LED 21 Power OK system LED 19 Power Supply Fault system LED 21 141 Service Required system LED 21 22 136 LEDs fan module 21 Service Required system LED 22 log files viewing 49 M maintenance position 65 memory fault handling 82 memory mezzanine air baffle 121 memory mezzanine assembly 2U and supported configurations 100 message ID 44 mezzanine air baffle 120 motherboard FRU name 197 motherboard handles 124 N Normal mode virtual keyswitch position 94 also see setkeyswitch command O Overtemp system LED 21 overtemperature condition 21 132 P paddle card FRU name 189 203 PCle XAUI riser FRU name 185 197 installing 107 POST 210 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 see power on self test POST power distribution board FRU name 189 203 Power OK system LED 19 power supply about 135 AC Present LED 19 141 Fault LED 21 137 FRU name 142 189 203 Power Supply Fault system LED interpreting to diagnose faults 21 using to verify successful power supply replacement 141 powercycle command 27 39 poweron command 27 power on self test POST about 35 c
47. CHanndO CHanndO CHannd 1 A CHannd 1 CHanndO CHanndO CHannd 1 Memory mezzanine 0 k Memory mezzanine Le mezzanine 1 Memory mezzanine O mezzanine 0 The following table identifies the order in which FB DIMMS must be added when upgrading the memory capacity of a SPARC Enterprise T5240 server The rows representing FB DIMMs in the memory mezzanine assembly are shaded TABLE FB DIMM Configuration Installation Map SPARC Enterprise T5240 Servers FB DIMM FB DIMM Installation Branch Name Channel Name FRU Name Connector Order CMP 0 Branch Channel 0 SYS MB CMP0 BRO CH0 DO J0500 1 0 SYS MB CMP0 BR0 CH0 D1 J0600 2 Channel 1 SYS MB CMP0 BR0 CH1 D0 J0700 1 SYS MB CMP0 BRO CH1 D1 JO800 2 CMP 0 Branch Channel 0 SYS MB CMP0 BR1 CH0 D0 J0900 1 j SYS MB CMP0 BR1 CH0 D1 J1000 2 Channel 1 SYS MB CMP0 BR1 CH1 D0 J1100 1 SYS MB CMP0 BR1 CH1 D1 J1200 2 Servicing Motherboard Components 101 TABLE FB DIMM Configuration Installation Map SPARC Enterprise T5240 Servers Continued FB DIMM FB DIMM Installation Branch Name Channel Name FRU Name Connector Order CMP 1 Branch Channel 0 SYS MB CMP1 BRO CHO DO J1800 1 SYS MB CMP1 BRO CHO D1 J1900 3 Channel 1 SYS MB CMP1 BR0 CH1 D0 J2000 1 SYS MB CMP1 BRO CH1 D1 J2100 3 CMP 1 Branch Channel 0 SYS MB CMP1 BR1 CHO DO J2200 1 F SYS MB CMP1 BR1 CH0 D1 J2300 3 Channel 1 SYS MB CMP1 BR1 CH1 D0 J2400 1 SYS MB CMP1 BR1 CH1 D1 J2500 3 CMP 0 Branch Cha
48. CIEO SYS MB RISERO component_s PCIE3 SYS MB RISER1 component_s PCIE1 SYS MB RISER1 component_s PCIE4 SYS MB RISER2 component_s PCIE2 SYS MB RISER2 component_s PCIE5 SYS MB NETO component_s SYS MB NET1 component_s SYS MB NET2 component_s SYS MB NET3 component_s SYS MB PCIE component_s Disabled Enabled Enabled Enabled Enabled Enabled Enabled Enabled Enabled Enabled i ss ss aM Related Information m Display System Components on page 51 m Disable System Components on page 52 m Enable System Components on page 53 Vv Disable System Components You disable a component by setting its component_state property to Disabled This adds the component to the ASR blacklist 1 At the gt prompt set the component_state property to Disabled gt set SYS MB CMP0 BR1 CH0 D0 component_state Disabled 2 Reset the server so that the ASR command takes effect gt stop SYS Are you sure you want to stop SYS y n y Stopping SYS Detecting and Managing Faults 51 gt start SYS Are you sure you want to start SYS y n y Starting SYS Note In the ILOM shell there is no notification when the system is actually powered off Powering off takes about a minute Use the show HOST command to determine if the host has powered off Related Information m View the System Message Log Files on page 49 m Display System Com
49. Contents of This Manual This manual is organized as described below Identifying Server Components Identifies key components of the SPARC Enterprise T5140 and T5240 servers including major boards and internal system cables as well as front and rear panel features Detecting and Managing Faults Describes the diagnostics that are available for monitoring and troubleshooting the server Preparing to Service the System Describes the steps necessary to prepare the servers for service Servicing Hard Drives Explains how to remove and install hard drives Servicing Motherboard Components Explains how to replace the motherboard and its components Servicing Fan Modules Explains how to service faulty fan modules Servicing Power Supplies Explains how to remove and replace power supply modules Servicing Boards and Components Explains how to service infrastructure boards and components Returning the Server to Operation Describes how to bring the server back to operation after performing service procedures Identifying FRUs in SPARC Enterprise T5140 Servers Identifies and illustrates Field Replaceable Units FRUs contained in SPARC Enterprise T5140 servers Identifying FRUs in SPARC Enterprise T5240 Servers Identifies and illustrates Field Replaceable Units FRUs contained in SPARC Enterprise T5240 servers xiv SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Related Documentation The latest
50. D6D4 fru_serial_number d81813ce fault_state OK clear_fault_action none Commands cd show Related Information m Diagnostics Tools Quick Reference on page 17 Y Create an ALOM CMT Shell The default shell for the service processor is the ILOM shell You can use the ALOM CMT compatibility shell to emulate the ALOM CMT interface that was supported on an earlier generation of CMT servers 32 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The service processor sends email alerts to all ALOM CMT users that are logged in It also enters the event in the ILOM event log 1 Log onto the service processor with username root When powered on the service processor boots to the ILOM login prompt The factory default password is changeme login root Password Waiting for daemons to initialize Daemons ready Integrated Lights Out Manager Version 2 0 0 0 Copyright 2007 Sun Microsystems Inc All rights reserved Use is subject to license terms Warning password is set to factory default 2 Create a new user in this example the new user name is admin setting the account role to Administrator and the CLI mode to alom gt create SP users admin Creating user Enter new password Enter new password again Created SP users admin gt set SP users admin role Administrator Set role to Administrator gt set SP users admin cli_mode alom
51. Fault LEDs are located on the fan board On SPARC Enterprise T5240 servers the Fan Fault LEDs are located on the fan modules 4 Pull up on the green fan module label until you remove the fan module from the chassis or replaced Do not service any other components in the fan compartment unless the system is shut down and the power cords removed Pull up the fan module by holding the green label only Caution When changing the fan modules only the fan modules may be removed FIGURE Removing a Fan Module 132 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Related Information m Extend the Server to the Maintenance Position on page 63 V Install a Fan Module Caution To ensure proper system cooling be certain to install the replacement fan module in the same slot from which the faulty fan was removed 1 With the top cover door open install the replacement fan module into the server The fan modules are keyed to ensure that they are installed facing in the correct direction FIGURE Installing a Fan Module Servicing Fan Modules 133 2 Apply firm pressure to fully seat the fan module 3 Verify that the Fan Fault LED on the replaced fan module is off 4 Close the top cover door 5 Verify that the system Fan Fault LED Service Required LEDs and the individual fan module Fault LED are off 6 Run the ILOM show faulty command to verify that the fan fault has been
52. H Detected Fault Console Message on page 45 m Identify PSH Detected Faults With fmdump on page 45 m Clear PSH Detected Faults on page 47 Detecting and Managing Faults 43 Solaris PSH Feature Overview The Solaris OS uses the Fault Manager daemon fmd 1M which starts at boot time and runs in the background to monitor the system If a component generates an error the daemon handles the error by correlating the error with data from previous errors and other related information to diagnose the problem Once diagnosed the Fault Manager daemon assigns the problem a Universal Unique Identifier UUID that distinguishes the problem across any set of systems When possible the Fault Manager daemon initiates steps to self heal the failed component and take the component offline The daemon also logs the fault to the syslogd daemon and provides a fault notification with a message ID MSGID You can use the message ID to get additional information about the problem from the knowledge article database The Predictive Self Healing technology covers the following server components m Multicore processor Memory m I O subsystem The PSH console message provides the following information about each detected fault m Type m Severity Description Automated response Impact m Suggested action If the Solaris PSH facility detects a faulty component use the fmdump command to identify the fault Faulty FRUs are identified in f
53. Hard Drive Servicing Overview on page 69 e Hard Drive LEDs on page 70 e Remove a Hard Drive on page 71 e Install a Hard Drive on page 73 FB DIMM e Service Required LED front and rear panel See these sections e FB DIMM Fault LED on motherboard e Servicing the Motherboard Assembly on when FB DIMM Locate button is pressed page 122 e Identify Faulty FB DIMMs Using the show faulty Command on page 83 e Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 Other e Service Required LED front and rear panel Note Not all components have an components individual component Fault LED If the Service Required LED is lit use the show faulty command to obtain additional information about the component affected e Identify Faulty FB DIMMs Using the show faulty Command on page 83 Detecting Faults With ILOM These topics explain how to use ILOM the service processor firmware to diagnose faults and verify successful repairs a ILOM Troubleshooting Overview on page 23 a Service Related ILOM Command Summary on page 26 Related Information a POST Overview on page 35 a ILOM Properties that Affect POST Behavior on page 35 22 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 ILOM Troubleshooting Overview ILOM enables you to remotely run diagnostics such as power on self test POST that would otherwise require physical proxi
54. Ie XAUI riser 2 See Remove a PCle XAUI Riser on page 105 2 Locate the SCC module 3 Pull the SCC module straight up from its connector Related Information m SCC Module Overview on page 116 m Install the SCC Module on page 117 Y Install the SCC Module 1 Unpack the replacement SCC module and set it on an antistatic mat 2 Align the SCC module with its connector on the motherboard Note The SCC module and its connector are keyed 3 Press the SCC module down until it seats 4 Install PCIe XAUI riser 2 See Install a PCle XAUI Riser on page 107 5 Install the top cover See Install the Top Cover on page 177 6 Slide the server into the rack See Reinstall the Server in the Rack on page 178 7 Connect the power supplies Connect Power Cords to the Server on page 181 Note As soon as the power cords are connected standby power is applied Depending on how the firmware is configured the system might boot at this time 8 Power on the server See Power On the Server Using the poweron Command on page 181 or Power On the Server Using the Front Panel Power Button on page 182 Servicing Motherboard Components 117 Related Information a SCC Module Overview on page 116 m Remove a Memory Mezzanine Assembly on page 118 A Servicing the Memory Mezzanine Assembly SPARC Enterprise T5240 These topics explain how to remov
55. Install the server into the rack See Reinstall the Server in the Rack on page 178 Install the hard drives Note Take care to be certain you are installing the hard drives in the correct drive bays 12 13 See Install a Hard Drive on page 73 Install the DVD USB module See Install the DVD USB Module on page 147 Connect the power cords Note As soon as the power cords are connected standby power is applied Depending on how the firmware is configured the system might boot at this time 14 Power on the system See Power On the Server Using the poweron Command on page 181 Related Information m Remove the Hard Drive Cage on page 152 156 Servicing the Hard Drive Backplane These topics explain how to remove and install hard drive backplanes a Hard Drive Backplane Overview on page 157 m Remove the Hard Drive Backplane on page 157 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 m Install the Hard Drive Backplane on page 159 Hard Drive Backplane Overview The hard drive backplane is housed in the hard drive cage It provides data and control signal connectors for the hard drives It also provides the interconnect for the front I O board power and locator buttons and system component status LEDs Note Each drive has its own Power Activity Fault and Ready to Remove LEDs Related Information m Remove t
56. Installing a Hard Drive Illustrating Installation in a SPARC Enterprise T5240 Server 3 With the latch open slide the hard drive into its bay until it is fully seated Then close the latch to secure the drive 74 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 4 At the Solaris prompt type the cfgadm al command This will list all drives in the device tree including drives that are not configured cfgadm al This command should identify the Ap_id for the hard drive you plan to remove as shown below Ap_id Type Receptacle Occupant Condition co scsi bus connected configured unknown c0 dsk c1t0d0 disk connected configured unknown c0 sd1 disk connected unconfigured unknown usb0 1 unknown empty unconfigured ok usb0 2 unknown empty unconfigured ok usb0 3 unknown empty unconfigured ok usb1 1 unknown empty unconfigured ok usb1 2 unknown empty unconfigured ok usb1 3 unknown empty unconfigured ok usb2 1 unknown empty unconfigured ok usb2 2 unknown empty unconfigured ok usb2 3 unknown empty unconfigured ok usb2 4 unknown empty unconfigured ok usb2 5 unknown empty unconfigured ok usb2 6 unknown empty unconfigured ok usb2 7 unknown empty unconfigured ok unknown empty unconfigured ok 5 Type the cfgadm c configure command to configure the disk For example the following shows drive c0 dsk c1t1d1 being configured cfgadm c configure c0 sd1 where c0 sd1 is the disk that
57. LOM Properties that Affect POST Behavior on page 35 m Examples of POST Management on page 37 m POST Output Quick Reference on page 42 ILOM Properties that Affect POST Behavior The following table describes the ILOM properties that determine how POST performs its operations Detecting and Managing Faults 35 Note The value of keyswitch_state must be normal when individual POST parameters are changed TABLE ILOM Properties Used to Manage POST Operations Parameter Values Description keyswitch_state normal The system can power on and run POST based on the other parameter settings This parameter overrides all other commands diag The system runs POST based on predetermined settings stby The system cannot power on locked The system can power on and run POST but no flash updates can be made diag_mode off POST does not run normal Runs POST according to diag_level value service Runs POST with preset values for diag_level and diag_verbosity diag_level max If diag_mode normal runs all the minimum tests plus extensive processor and memory tests min If diag_mode normal runs minimum set of tests diag_trigger none Does not run POST on reset diag_verbosity user_reset power_on_reset error_reset all_resets none min normal max Runs POST upon user initiated resets Only runs POST for the first power on This option is the default Runs POST if fatal errors are detected Runs POS
58. Locations in SPARC Enterprise T5140 Servers J1100 J1200 J1000 JO900 J0500 JO600 J0800 J0700 e ESH pimmo Channel 1 22257 DIMM 1 DIMM 0 DIMM 0 Channel 0 DIMM 1 SESS DIMM channel 0 DIMM 1 i DIMM 0 Channel 1 Branch 0 l Branch 1 DIMM 0 Em DIMM 1 Channel 1 Branch 0 Branch 1 l J2400 J2500 J2300 J2200 J1800 J1900 J2100 J2000 SPARC Enterprise T5240 servers can be equipped with an optional memory mezzanine assembly which provides an additional 16 FB DIMM slots Servers that have the memory mezzanine assembly can support for the following additional memory configuration groups m 24 FB DIMMs Groups 1 2 3 and 4 fully populated motherboard 8 FB DIMM slots in the memory mezzanine assembly m 32 FB DIMMs Groups 1 2 3 4 and 5 fully populated motherboard fully populated memory mezzanine assembly 100 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table identifies the order in which FB DIMMS must be added when upgrading the memory capacity of a SPARC Enterprise T5240 server These groups are shown in FIGURE FB DIMM Configuration With Memory Mezzanine Assembly SPARC Enterprise T5240 Servers CMP1 CMPO BRanchO BRanch 1 BRanch 0 BRanch 1 CHannd 1
59. MMs Identify Faulty See configuration rules See FB DIMM FB DIMMs Using the before upgrading Configuration show faulty FB DIMMs Guidelines for SPARC Command on page 83 Enterprise T5240 Identify Faulty Servers on page 98 FB DIMMs Using the FB DIMM Fault Locator Button on page 83 5 Motherboard assembly Servicing the Must be removed to SYS MB Motherboard Assembly access power on page 122 distribution board power supply backplane and paddle card 6 SCC module Servicing the SCC Contains host ID MAC SYS MB SC SCC_NV Module on page 116 addresses and service RAM processor configuration data 7 Battery Servicing the Battery Necessary for system SYS MB BAT on page 114 clock and other functions Identifying FRUs in SPARC Enterprise T5240 Servers 197 Memory Mezzanine Components in SPARC Enterprise T5240 Servers FIGURE Memory Mezzanine Assembly Components SPARC Enterprise T5240 Servers 198 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table identifies the components located on the memory mezzanine assembly and points to instructions for servicing them TABLE Memory Mezzanine Assembly Components SPARC Enterprise T5240 Servers Item FRU Replacement Instructions Notes FRU Name If Applicable 1 Memory mezzanine Servicing the Memory Must be installed to N A assembly air duct Shipping bracket FB DIMMs Auxiliary air vent Memory m
60. PARC Enterprise T5140 server Install the power supplies 8 Slide each power supply into its bay until the power supply locks into place 168 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Installing a Power Supply in a SPARC Enterprise T5140 Server 9 SPARC Enterprise T5240 server Install the mezzanine riser guide 10 Install the motherboard assembly See Install the Motherboard Assembly on page 125 Note After replacing the power distribution board and powering on the system you must run the ALOM CMT setcsn and setcpn commands to set the electronically readable chassis serial number and server part number 11 At the ALOM CMT command line interface use the setcsn command to set the chassis serial number and the setcpn command to set the server part number on the power distribution board The following is an example of the command line dialog used to set the chassis serial number and server part number for a SPARC Enterprise T5140 server Servicing Boards and Components 169 Caution When performing the following steps use special care to enter the correct numbers Once the power distribution board has been programmed with a chassis serial number or server part number the number cannot be changed sc gt setsc sc_servicemode true Warning misuse of this mode may invalidate your warranty sc gt setesn c chassis_serial_number Are you sure you want to permanently set t
61. SPARC Enterprise T5140 Servers on page 112 for additional information 4 Remove the PClIe XAUI riser board See Remove a PCle XAUI Riser on page 105 5 Remove the PCI filler panel m SPARC Enterprise T5140 servers PCIe filler panels are located in the removable PCI cross beam Press the filler panel in from the rear until it snaps into place as shown in the following figure FIGURE Installing a PCIe Card SPARC Enterprise T5140 m SPARC Enterprise T5240 servers PCIe filler panels are located on the riser board assembly Press the filler panel in from the rear until it snaps into place as shown in the following figure 110 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FI GURE Installing a PCIe Card SPARC Enterprise T5240 10 Insert the PCIe XAUI card into the correct slot on the riser board Replace the PCIe XAUI riser See Install a PCIe XAUI Riser on page 107 Install the top cover See Install the Top Cover on page 177 Slide the server into the rack See Return the Server to the Normal Rack Position on page 180 Connect any data cables required to the PCIe XAUI card Route data cables through the cable management arm Servicing Motherboard Components 111 11 Connect the power supplies See Connect Power Cords to the Server on page 181 Note As soon as the power cords are connected standby power is applied Depending on how th
62. SPARC Enterprise T5140 Servers Item FRU Replacement Instructions Notes FRU Name If Applicable Air duct Remove the Air Duct Must be installed to N A Power distribution board bus bar Paddle card Fan power boards Power supplies Fan modules on page 103 Install the Air Duct on page 104 Servicing Power Distribution Boards on page 163 Servicing Paddle Cards on page 174 Servicing Fan Power Boards on page 148 Servicing Power Supplies on page 135 Servicing Fan Modules on page 129 provide proper cooling to the system Bus bar is attached to the PDB with four screws If replacing a defective PDB you must move the bus bar to the new board and program the chassis serial number using the setscn command Includes the top cover interlock switch Must be removed to service the paddle card Two power supplies provide N 1 redundancy At least six fan modules must be installed in the server SYS PDB SYS CONNBD SYS FANBDO SYS FANBD1 SYS PSO SYS PS1 SYS FANBD0O FMO SYS FANBD0O FM1 SYS FANBD0O FM2 SYS FANBD0 FM3 SYS FANBD1 FMO SYS FANBD1 FM1 SYS FANBD1 FM2 SYS FANBD1 FM3 The service processor checks for proper fan module configuration and issues a service warning if a fan module is missing or inserted into an unsupported slot A fan module might not be present in this slot for some configurations f A fan module
63. T after any reset No POST output is displayed POST output displays functional tests with a banner and pinwheel POST output displays all test and informational messages POST displays all test informational and some debugging messages The following flowchart is a graphic illustration of the same set of ILOM set command variables SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Flowchart of ILOM Properties Used to Manage POST Operations diag_mode user reset diag trigger power on reset error reset Service Mode Forces a Sun prescribed level of diagnostic execution Overrides user defined settings as if parameters were diag_level max diag_verbosity max diag_trigger all resets User defined settings are not modified Normal Mode Diagnostic execution is enabled User defined settings control test coverage and verbosity via diag_level diag_verbosity diag_trigger System boot OpenBoot PROM Solaris boot Examples of POST Management This topic shows examples of the ILOM set command being used to configure POST behavior The examples illustrate only a subset of the ILOM properties that can be used to control POST operations Detecting and Managing Faults 37 Note When you change individual POST parameter values the keyswitch_state value must be set to normal keyswitch_state Set to normal You put POST in its default mode by s
64. age 164 3 Remove the fan power boards Remove the Fan Power Board on page 149 4 Remove the two No 1 Phillips screws securing the paddle card to the chassis FIGURE Removing a Paddle Card Illustrating Removal From a SPARC Enterprise T5140 Server 5 Slide the paddle card back away from its connector on the hard drive backplane Servicing Boards and Components 175 6 Tilt the paddle card away from the side of the chassis and lift the paddle card up and out of the system 7 Place the paddle card on an antistatic mat Related Information a Install the Paddle Card on page 176 VY Install the Paddle Card 1 Lower the paddle card into the chassis FIGURE Installing a Paddle Card Illustrating Installation Into a SPARC Enterprise T5140 Server 2 Slide the paddle card forward to plug it into the hard drive backplane 3 Secure the paddle card with two No 1 Phillips screws 4 Install the fan power boards See Install the Fan Power Board on page 150 5 Install the power distribution board See Install the Power Supply Backplane on page 173 6 Install the motherboard assembly See Install a Memory Mezzanine Assembly on page 120 Related Information m Remove the Paddle Card on page 175 176 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Returning the Server to Operation These topics explain how to return SPARC Enterprise T5140 and T524
65. age 181 Note As soon as the power cords are connected standby power is applied Depending on how the firmware is configured the system might boot at this time 14 Power on the server See Power On the Server Using the poweron Command on page 181 or Power On the Server Using the Front Panel Power Button on page 182 15 Perform the following steps to verify that there are no faults a Set the virtual keyswitch to diag so that POST will run in Service mode gt set SYS keyswitch_state Diag Set keyswitch_state to Diag b Power cycle the system gt stop SYS Are you sure you want to stop SYS y n y Stopping SYS gt start SYS Are you sure you want to start SYS y n y Starting SYS Note The server takes about one minute to power off The ILOM console does not indicate when the system is actually powered off Servicing Motherboard Components 93 c Switch to the system console to view POST output gt start SYS console Watch the POST output for possible fault messages The following output is a sign that POST did not detect any faults 0 gt INFO 20 gt POST Passed all devices 0 gt POST Return to VBSC 0 gt Master set ACK for vbsc runpost command and spin 0 0 0 0 0 0 0 0 Note Depending on the configuration of ILOM POST variables and whether POST detected faults or not the system might boot or the system might rem
66. agnosis and maintenance Caution The following tasks regarding this product and the optional products provided from Fujitsu should only be performed by a certified service engineer Users must not perform these tasks Incorrect operation of these tasks may cause malfunction m Unpacking optional adapters and such packages delivered to the users m Plugging or unplugging of external interface cards Remodeling Rebuilding Caution Do not make mechanical or electrical modifications to the equipment Using this product after modifying or reproducing by overhaul may cause unexpected injury or damage to the property of the user or bystanders xxii SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Alert Label The following is a label attached to this product m Never peel off the label m The following label provides information to the users of this product Fan Module and Fan Board Configuration and Service pi ANGE mo am MP anano FANBDO ranno mo m m ATTENTION System WILL SHUT DOWN when top cover is removed Power down system before removing top cover Preface xxiii Fujitsu Welcomes Your Comments If you have any comments or requests regarding this document or if you find any unclear stat
67. ain at the ok prompt If the system is at the ok prompt type boot d Return the virtual keyswitch to Normal mode gt set SYS keyswitch_state Normal Set ketswitch_state to Normal Related Information m Remove FB DIMMs on page 84 a Install Replacement FB DIMMs on page 86 m Verify Successful Replacement of Faulty FB DIMMs on page 88 m FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 a FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers When planning FB DIMM upgrades to SPARC Enterprise T5140 servers observe the following memory configuration guidelines a The motherboard has 16 slots that support industry standard FB DIMMs m Use only 1 5 volt FB DIMMs in SPARC Enterprise T5140 and T5240 servers 94 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 SPARC Enterprise T5140 servers support these FB DIMM configurations 8 FB DIMMs Group 1 in FIGURE FB DIMM Configuration for SPARC Enterprise T5140 Servers on page 95 a 12 FB DIMMs Groups 1 and 2 in FIGURE FB DIMM Configuration for SPARC Enterprise T5140 Servers on page 95 a 16 FB DIMMs Groups 1 2 and 3 in FIGURE FB DIMM Configuration for SPARC Enterprise T5140 Servers on page 95 All FB DIMMs within a single CMP branch must have the same capacity If the Sy
68. al Install the shipping bracket Two captive screws secure the shipping bracket 7 Install the top cover See Install the Top Cover on page 177 Servicing Motherboard Components 121 8 Attach the power cables See Connect Power Cords to the Server on page 181 9 Power on the server See Power On the Server Using the poweron Command on page 181 or Power On the Server Using the Front Panel Power Button on page 182 Related Information m Remove a Memory Mezzanine Assembly on page 118 m Install the Top Cover on page 177 m Connect Power Cords to the Server on page 181 m Power On the Server Using the poweron Command on page 181 m Power On the Server Using the Front Panel Power Button on page 182 A Servicing the Motherboard Assembly These topics explain how to remove and install the motherboard assembly m Motherboard Servicing Overview on page 122 m Remove the Motherboard Assembly on page 123 m Install the Motherboard Assembly on page 125 Motherboard Servicing Overview The motherboard assembly must be removed in order to access the following components m Power distribution board m Power supply backplane SPARC Enterprise T5240 server m Paddle card Note This procedure requires removing the server from the rack Caution The server is heavy Two people are required to remove it from the rack 122 SPARC Enterprise T5140 an
69. an be used to obtain additional fault information SUN4V 8000 JA Details about the faulted FRU This includes the FRU s part number part 541215101 and serial number serial 101083 The Location field provides the name of the FRU In this example the FRU name is MB meaning the motherboard 2 Use the message ID to obtain more information about this type of fault a In a browser go to the Predictive Self Healing Knowledge Article web site http www sun com msg b Obtain the message ID from the console output or the ILOM show faulty C command Enter the message ID in the SUNW MSG ID field and click Lookup In the following example the message ID SUN4V 8000 JA provides information for corrective action CPU errors exceeded acceptable levels Type Fault Severity Major Description The number of errors associated with this CPU has exceeded acceptable levels Automated Response The fault manager will attempt to remove the affected CPU from service 46 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Impact System performance may be affected Suggested Action for System Administrator Schedule a repair procedure to replace the affected CPU the identity of which can be determined using fmdump v u lt EVENT_ID gt Details The Message ID SUN4V 8000 JA indicates diagnosis has determined that a CPU is faulty The Solaris fault manager arranged an auto
70. ane Configuration Reference on page 79 76 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Four Drive Capable Backplane Configuration Reference The following table shows the physical hard drive locations in a four drive capable backplane TABLE Physical Drive Locations in a Four Drive Capable Backplane The following table matches the FRU names and the default OpenBoot PROM Solaris drive pathnames with the physical drive locations in a four drive capable backplane TABLE Physical Drive Locations FRU Names and Default Drive Pathnames for a Four Drive Capable Backplane Physical Location FRU Name OpenBoot PROM Solaris Default Drive Pathname HDDO SYS HDDO c0 dsk c1t0d0 HDD1 SYS HDD1 c0 dsk c1t1d0 HDD2 SYS HDD2 c0 dsk c1t2d0 HDD3 SYS HDD3 c0 dsk c1t3d0 DVD SYS DVD Related Information m Install a Hard Drive on page 73 m Remove a Hard Drive on page 71 m Eight Drive Capable Backplane Configuration Reference on page 78 m Sixteen Drive Capable Backplane Configuration Reference on page 79 Servicing Hard Drives 77 Eight Drive Capable Backplane Configuration Reference The following table identifies the hard drive slot numbering in an eight drive capable backplane TABLE Physical Drive Locations in an Eight Drive Capable Backplane HDD1 HDD3 HDD5 DVD HDDO HDD2 HDD4 HDD6 HDD7 The following table matches the FRU names and
71. anine assembly on an antistatic mat Servicing Motherboard Components 119 7 If you are replacing a faulty memory mezzanine assembly remove the mezzanine air duct and transfer the FB DIMMs to the new memory mezzanine assembly Install filler panels in the empty memory mezzanine connector slots if you are not replacing the memory mezzanine immediately Related Information a Install a Memory Mezzanine Assembly on page 120 a Removing Power From the System on page 60 m Remove the Top Cover on page 67 Vv Install a Memory Mezzanine Assembly Caution This procedure requires that you handle components that are sensitive to static discharge Static discharges can cause the components to fail 1 Remove any filler panels from the memory mezzanine connector slots if necessary Store the filler panels in a safe place You will reuse the filler panels if you remove the memory mezzanine assembly in the future 2 Ensure that the release levers are extended 3 Lower the memory mezzanine assembly into the chassis Ensure that the connectors between the memory mezzanine assembly and the motherboard are aligned 120 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Installing the Memory Mezzanine Assembly 4 Close the levers to lock the memory mezzanine assembly into place 5 Install the memory riser air duct FIGURE Installing the Memory Mezzanine Air Duct 6 Option
72. are registered trademarks of SPARC International Inc in the U S and other countries Products bearing SPARC trademarks are based upon architecture developed by Sun Microsystems Inc SPARC64 is a trademark of SPARC International Inc used under license by Fujitsu Microelectronics Inc and Fujitsu Limited SSH is a registered trademark of SSH Communications Security in the United States and in certain other jurisdictions The OPEN LOOK and Sun Graphical User Interface was developed by Sun Microsystems Inc for its users and licensees Sun acknowledges the pioneering efforts of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry Sun holds a non exclusive license from Xerox to the Xerox Graphical User Interface which license also covers Sun s licensees who implement OPEN LOOK GUIs and otherwise comply with Sun s written license agreements United States Government Rights Commercial use U S Government users are subject to the standard government user license agreements of Sun Microsystems Inc and Fujitsu Limited and the applicable provisions of the FAR and its supplements Disclaimer The only warranties granted by Fujitsu Limited Sun Microsystems Inc or any affiliate of either of them in connection with this document or any product or technology described herein are those expressly set forth in the license agreement pursuant to which the product or technology is provided
73. ault messages using the FRU name PSH Detected Fault Console Message When a PSH fault is detected a Solaris console message displayed The following example illustrates the type of information contained in a console message generated when a PSH fault is detected VENT ID SUNW MSG ID SUN4V 8000 DX TYPE Fault VER 1 SEVERITY Minor EVENT TIME Wed Sep 14 10 09 46 EDT 2005 PLATFORM SUNW system_name CSN HOSTNAME wgs48 37 SOURCE cpumem diagnosis REV 1 5 E 92e9 fbe 735e c218 cf87 9el720a28004 ESC The number of errors associated with this memory module has exceeded T 44 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 acceptable levels Refer to http sun com msg SUN4V 8000 DX for more information AUTO RESPONSE Pages of memory associated with this memory module are being removed from service as errors are reported IMPACT Total system memory capacity will be reduced as pages are retired REC ACTION Use fmdump v u lt EVENT_ID gt to identify the module Schedule a repair procedure to replace the affected memory module PSH detected faults also cause the Service Required LED to be turned on Use the ILOM show faulty command to view summary information about the fault See Faults Displayed by show faulty on page 29 for more information about the show faulty command Faults detected by the Solaris PSH facili
74. bout powering off the server is located in the SPARC Enterprise T5140 and T5240 Servers Administration Guide 1 Log in as superuser or equivalent Depending on the type of problem you might want to view server status or log files You also might want to run diagnostics before you shut down the server Refer to the SPARC Enterprise T5140 and T5240 Servers Administration Guide for log file information 2 Notify affected users that the server will be shut down Refer to your Solaris system administration documentation for additional information 3 Save any open files and quit all running programs Refer to your application documentation for specific information on these processes 4 Shut down all logical domains Refer to the Solaris system administration documentation for additional information 5 Shut down the Solaris OS Refer to the Solaris system administration documentation for additional information 6 Switch from the system console to the gt prompt by typing the Hash Period key sequence 7 At the gt prompt type the stop SYS command Note You can also use the Power button on the front of the server to initiate a graceful server shutdown See Power Off the Server Power Button Graceful on page 62 This button is recessed to prevent accidental server power off Use the tip of a pen to operate this button Refer to the Integrated Lights Out Manager ILOM 3 0 Supplement for SPARC Enterpri
75. cO FUJITSU SPARC Enterprise T5140 and T5240 Servers Service Manual C120 E497 04EN c FUJITSU SPARC Enterprise T5140 and T5240 Servers Service Manual Copyright 2009 Sun Microsystems Inc 4150 Network Circle Santa Clara California 95054 U S A All rights reserved FUJITSU LIMITED provided technical input and review on portions of this material Sun Microsystems Inc and Fujitsu Limited each own or control intellectual property rights relating to products and technology described in this document and such products technology and this document are protected by copyright laws patents and other intellectual property laws and international treaties The intellectual property rights of Sun Microsystems Inc and Fujitsu Limited in such products technology and this document include without limitation one or more of the United States patents listed at http www sun com patents and one or more additional patents or patent applications in the United States or other countries This document and the product and technology to which it pertains are distributed under licenses restricting their use copying distribution and decompilation No part of such product or technology or of this document may be reproduced in any form by any means without prior written authorization of Fujitsu Limited and Sun Microsystems Inc and their applicable licensors if any The furnishing of this document to you does not give you any right
76. cessor 25 How to Switch From the Service Processor to the System Console 25 Service Related ILOM Command Summary 26 Faults Displayed by show faulty 29 Example of show Example of show Example of show Example of show fau fau fau fau Technology 30 lty Output When No Fault is Present 30 lty Output for Environmental Faults 30 lty Output for Faults Detected by POST 30 lty Output for Faults Detected by PSH v Clear FRU Faults Manually 31 v Display FRU Information With the show Command 32 v Create an ALOM CMT Shell 32 Detecting Faults With POST 34 POST Overview 35 Managing POST Operations 35 ILOM Properties that Affect POST Behavior 35 Examples of POST Management 37 keyswitch_stateSettonormal 38 keyswitch_stateSettodiag 38 diag_mode Set to off 38 diag_mode Set to service 38 v Run POST in Maximum Mode 39 v Clear POST Detected Faults 41 POST Output Quick Reference 42 Managing Faults Using the PSH Feature 43 Solaris PSH Feature Overview 44 PSH Detected Fault Console Message 45 v Identify PSH Detected Faults With fmdump 45 v Clear PSH Detected Faults 47 vi SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Viewing Solaris OS Messages 48 v Check the Message Buffer 49 v View the System Message Log Files 49 Managing Components With Automatic System Recovery Commands 50 ASR Overview 50 v Display System Components 51 v Disable System Components 52 v Enable System Components 5
77. cessor will usually detect the repair automatically and extinguish the Service Required LED Many environmental faults can automatically recover For example a temporary condition may cause the computer room temperature to rise above the maximum threshold producing an overtemperature fault in the server If the computer room temperature then returns to the normal range and the server s internal temperature also drops back to an acceptable level the service processor will detect the new fault free condition It will extinguish the Service Required LED and clear the fault state from the FRU PROM Detecting and Managing Faults 23 24 Note No ILOM command is needed to manually repair an environmental fault The service processor can automatically detect when a FRU is removed In many cases it does this even if the FRU is removed while the service processor is not running Note If the service processor does not automatically clear a fault state after the fault is corrected you must perform these tasks manually The procedure for clearing faults manually is described in Clear FRU Faults Manually on page 31 Note ILOM does not automatically detect hard drive replacement The Solaris Predictive Self Healing technology does not monitor hard drives for faults As a result the service processor does not recognize hard drive faults and will not light the fault LEDs on either the chassis or the hard drive itself
78. ckplane in a SPARC Enterprise T5140 Server Servicing Boards and Components 159 FIGURE Installing a Hard Drive Backplane in a SPARC Enterprise T5240 Server 3 Install the hard drive cage See Install the Hard Drive Cage on page 154 Related Information m Remove the Hard Drive Backplane on page 157 Servicing Front Control Panel Light Pipe Assemblies These topics explain how to remove and install front control panel light pipe assemblies m Front Control Panel Light Pipe Assemblies Overview on page 161 m Remove the Front Control Panel Light Pipe Assemblies on page 161 m Install the Front Control Panel Light Pipe Assemblies on page 162 160 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Front Control Panel Light Pipe Assemblies Overview The front control panel light pipe assemblies are mounted on each side of the hard drive cage You must remove the hard drive cage to access the screws that attach the light pipe assemblies to the hard drive cage V Remove the Front Control Panel Light Pipe Assemblies 1 Remove the hard drive cage See Remove the Hard Drive Cage on page 152 2 Remove the No 1 Phillips screws securing the front control panel light pipe assembly to the hard drive cage m Two screws secure the assembly to the hard drive cage in the SPARC Enterprise T5140 server m Three screws secure the assembly to the hard drive cage in the SPARC Enterprise
79. cleared See Detecting Faults With ILOM on page 22 for more information on using the show faulty command Related Information m Extend the Server to the Maintenance Position on page 63 m Faults Displayed by show faulty on page 29 134 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Servicing Power Supplies The topics explain how to remove and replace power supply modules m Power Supplies Overview on page 135 m Remove a Power Supply on page 137 m Install a Power Supply on page 140 m Power Supply Configuration Reference on page 142 Power Supplies Overview These servers are equipped with redundant hot swappable power supplies With redundant power supplies you can remove and replace a power supply without shutting the server down Some models of the server use AC input power and other models use DC input power For input power specifications for both AC and DC models refer to the SPARC Enterprise T5140 and T5240 Server Site Planning Guide The server models that run on DC input power require you to build the input power cable to specific safety guidelines For instructions on building the DC power cables and the safety guidelines refer to the SPARC Enterprise T5140 and T5240 Server Installation Guide Note The instructions in this manual use the AC server models as examples However unless noted otherwise the instructions also apply to the DC server
80. correct operation of these tasks may cause malfunction Also important alert messages are shown in Notes on Safety on page xix Notes on Safety Important Alert Messages This manual provides the following important alert signals Caution This indicates a hazardous situation could result in minor or moderate personal injury if the user does not perform the procedure correctly This signal also indicates that damage to the product or other property may occur if the user does not perform the procedure correctly Preface xix Task Warning Maintenance Damage The server is heavy Two persons are required to remove it from the rack The servers are heavy Two people might be required to carry the chassis and install it in the rack Caution This indicates that hazardous voltages are present To reduce the risk of electric shock and danger to personal health follow the instructions Task Warning Maintenance Electric shock Never attempt to run the server with the covers removed Hazardous voltage present Because 3 3v standby power is always present in the system you must unplug the power cords before accessing any cold serviceable components The system supplies power to the power distribution board even when the server is powered off To avoid personal injury or damage to the server you must disconnect power cords before servicing the power distribution board The system supplies p
81. cts directly to the hard drive backplane This board is packaged with the DVD drive as a single unit Related Information m Infrastructure Boards in SPARC Enterprise T5240 Servers on page 3 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 m Identifying FRUs in SPARC Enterprise T5140 Servers on page 183 m Identifying FRUs in SPARC Enterprise T5240 Servers on page 195 Infrastructure Boards in SPARC Enterprise 5240 Servers SPARC Enterprise T5240 servers are based on a 2U chassis family The following table provides a summary of the circuit boards used in these servers Board Description Motherboard Memory mezzanine assembly SPARC Enterprise T5240 Servers only Power distribution board Power supply backplane SPARC Enterprise T5240 Servers only Paddle card Fan power boards 2 This board includes two CMP modules slots for 16 FB DIMM memory control subsystems and all service processor I LOM logic It also hosts a removable SCC module which contains all MAC addresses host ID and ILOM configuration data This optional assembly provides an additional 16 memory slots in addition to the 16 slots provided on the motherboard This board distributes main 12V power from the power supplies to the rest of the system This board is directly connected to the paddle card and to the motherboard via a bus bar and ribbon cable This board also supports a top cover saf
82. d T5240 Servers Service Manual July 2009 Related Information m Remove the Motherboard Assembly on page 123 m Install the Motherboard Assembly on page 125 Remove the Motherboard Assembly Caution This procedure requires that you handle components that are sensitive to electrostatic discharge This discharge can cause server components to fail 1 Run the showrc command and make a note of any SP variables that have been modified from the factory default 2 Stop Solaris OS to get the OpenBoot PROM prompt 3 Run the printenv command to make a note of any OpenBoot PROM variables that have been modified 4 Power off the server See Removing Power From the System on page 60 5 Remove the server from the rack See Remove the Server From the Rack on page 64 6 Attach an antistatic wrist strap 7 Remove the top cover See Remove the Top Cover on page 67 8 Remove the air duct See Remove the Air Duct on page 103 9 Remove all PCIe XAUI riser assemblies See Remove a PCle XAUI Riser on page 105 Note Make note of the location of expansion cards in PCle XAUI risers 0 and 1 10 Disconnect the motherboard to power distribution board ribbon cable 11 Disconnect the hard drive data cables Servicing Motherboard Components 123 a Press the latching mechanism on the connector to release the cable plug If you have difficulty releasing the cable plug first
83. d T5240 Servers Service Manual July 2009 The following table identifies the power distribution and fan module components in the server and points to instructions for servicing them TABLE Power Distribution Fan Module Components SPARC Enterprise T5240 Servers Item FRU Replacement Instructions Notes FRU Name If Applicable 1 Air duct Remove the Air Duct Must be installed to N A on page 103 provide proper cooling Install the Air Duct on to the system Must be page 104 removed to install the memory mezzanine assembly 2 Power supply backplane Servicing Power Supply This part is bundled N A Backplanes SPARC with the power Enterprise T5240 distribution board and Servers on page 170 bus bar 3 Power distribution Servicing Power Bus bar is attached to the SYS PDB board bus bar Distribution Boards on PDB with four screws page 163 If replacing a defective PDB you must move the bus bar to the new board and program the chassis serial number 4 Paddle card Servicing Paddle Includes the top cover SYS CONNBD Cards on page 174 interlock switch 5 Fan power boards Servicing Fan Power Must be removed to SYS FANBDO Boards on page 148 service the paddle card SYS FANBD1 6 Fan modules Servicing Fan Modules At least five fan modules SYS FANBDO FMO on page 129 must be installed in the SYS FANBD0O FM1 eee SYS FANBDO FM2 SYS FANBD1 FMO SYS FANBD1 FM1 SYS FANBD1 FM2 7 Power supplies Serv
84. d from the rack to remove or install the following components Motherboard Power distribution board Power supply backplane SPARC Enterprise T5240 server Paddle card Disk cage Hard drive backplane Front panel light pipe assemblies 64 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Caution If necessary use two people to dismount and carry the chassis 1 Disconnect all the cables and power cords from the server 2 Extend the server to the maintenance position See Power Off the Server Service Processor Command on page 60 3 Press the metal lever that is located on the inner side of the rail to disconnect the cable management arm CMA from the rail assembly as shown in the following figure The CMA is still attached to the cabinet but the server chassis is now disconnected from the CMA FIGURE Metal Lever and Cable Management Arm Preparing to Service the System 65 Caution If necessary use two people to dismount and carry the chassis 4 From the front of the server pull the release tabs forward and pull the server forward until it is free of the rack rails as shown in the following figure A release tab is located on each rail FIGURE Release Tabs and Slide Assembly 5 Set the server on a sturdy work surface 66 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Accessing Internal Components These topics explain how to acc
85. displays a UUID go directly to Step 4 88 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 3 Use the set command to enable the FB DIMM that was disabled by POST In most cases replacement of a faulty FB DIMM is detected when the service processor is power cycled In those cases the fault is automatically cleared from the system If show faulty still displays the fault clear it with the set command gt set SYS MB CMP0 BRO CH0O DO component_state Enabled 4 Perform the following steps to verify the repair a Set the virtual keyswitch to diag so that POST will run in Service mode gt set SYS keyswitch_state Diag Set keyswitch_state to Diag b Power cycle the system gt stop SYS Are you sure you want to stop SYS y n y Stopping SYS gt start SYS Are you sure you want to start SYS y n y Starting SYS Note The server takes about one minute to power off Use the show HOST command to determine when the host has been powered off The console will display status Powered Off c Switch to the system console to view POST output Watch the POST output for possible fault messages The following output indicates that POST did not detect any faults gt start SYS console 0 gt INFO 0 gt POST Passed all devices 0 gt POST Return to VBSC 0 gt Master set ACK for vbsc runpost command and spin ooo a ooo O Servicing Motherboard Component
86. dm repair command with the UUID Use the same UUID that was displayed in the output of the ILOM show faulty command fmadm repair 3aa7c854 9667 e176 efe5 e487e520 Related Information m Remove FB DIMMs on page 84 m Install Replacement FB DIMMs on page 86 m Upgrade Memory Configuration With Additional FB DIMMs on page 91 m FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 a FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 Upgrade Memory Configuration With Additional FB DIMMs Before you begin this memory upgrade procedure become familiar with the memory configuration guidelines described in FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 Caution Ensure that all power is removed from the server before installing FB DIMMs or damage to the FB DIMMs might occur Caution You must disconnect the power cords from the system before performing this procedure 1 Unpack the replacement FB DIMMs and place them on an antistatic mat 2 SPARC Enterprise T5140 server Disconnect and stow the hard drive data cable a Unplug the hard drive data cable from J6401 on the motherboard b Remove the hard drive data cable from its seat on the CMP air duct c Place the hard drive cable end out of the way of the air duct 3 Rotate the air duct up and toward the front of the system Servicing Motherboa
87. ds The following topics explain how to remove and install power distribution boards They also provide important safety information related to working with power distribution boards m Power Distribution Board Overview on page 164 m Remove the Power Distribution Board on page 164 m Install the Power Distribution Board on page 167 Servicing Boards and Components 163 164 Related Information m Servicing Power Supply Backplanes SPARC Enterprise T5240 Servers on page 170 Power Distribution Board Overview The power distribution board distributes main 12V power from the power supplies to the rest of the system It is directly connected to the paddle card and to the motherboard by means of a bus bar and ribbon cable This board also supports a top cover safety interlock kill switch It is easier to service the power distribution board with the bus bar assembly attached If you are replacing a faulty power distribution board you must remove the bus bar assembly from the old board and attach the assembly to the new power distribution board If you replace a faulty power distribution board you must program the new power distribution board with the chassis serial number and part number These numbers are needed for obtaining product support Caution The system supplies power to the power distribution board even when the server is powered off To avoid personal injury or damage to the server you must
88. e After a period of time usually every week a new messages file is automatically created The original contents of the messages file are rotated to a file named messages 1 Over a period of time the messages are further rotated to messages 2 and messages 3 and then deleted 1 Log in as superuser 2 Type the following command more var adm messages 3 If you want to view all logged messages type the following command more var adm messages Managing Components With Automatic System Recovery Commands These topics explain the role played by the Automatic System Recovery ASR feature and how to manage the components it controls m ASR Overview on page 50 m View the System Message Log Files on page 49 m Display System Components on page 51 m Disable System Components on page 52 m Enable System Components on page 53 ASR Overview The ASR feature enables the server to automatically configure failed components out of operation until they can be replaced In the server the following components are managed by the ASR feature m UltraSPARC T2 Plus processor strands Memory FB DIMMs m I O subsystem Detecting and Managing Faults 49 The database that contains the list of disabled components is referred to as the ASR blacklist asr db In most cases POST automatically disables a faulty component After the cause of the fault is repaired FRU replacement loose connec
89. e PCIe XAUI riser being removed Label the cables to ensure proper connection later 5 Slide the server out of the rack See Extend the Server to the Maintenance Position on page 63 6 If you are servicing a PClIe XAUI card locate its position in the system 7 Remove the PCI cross beam a Loosen the two captive Phillips screws on each end of the removable PCI cross beam b Slide the PCI cross beam back to remove it from the chassis Two mushroom standoffs secure the removable cross beam to the back of the system Servicing Motherboard Components 105 FIGURE Removing the PCle XAUI Riser SPARC Enterprise T5140 FIGURE Removing the PCle XAUI Riser SPARC Enterprise T5240 8 Loosen the captive screw securing the riser to the motherboard 9 Lift the riser up to remove it from the system Remove the riser and any PCle XAUI cards attached to it as a unit Related Information m Install a PCle XAUI Riser on page 107 m Remove a PCle or XAUI Card on page 109 a Install a PCIe or XAUI Card on page 109 106 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Y Install a PCIle XAUI Riser 1 Lower the PCIe XAUI riser and any cards attached to it into the system Note PCle XAUI and PCIe risers have keyed connectors to prevent incorrect installation on the motherboard The following figure illustrates this step for SPARC Enterprise T5140 servers FIGURE Installing th
90. e PCle XAUI Riser SPARC Enterprise T5140 The following figure illustrates the same process for SPARC Enterprise T5240 servers Servicing Motherboard Components 107 FIGURE Installing the PCle XAUI Riser SPARC Enterprise T5240 8 9 Ensure that the PCIe back panels are properly engaged with the corresponding slots in the motherboard tray back panel connector assembly Tighten the captive screw to secure the riser to the motherboard Install the PCI cross beam Slide the cross beam forward over the PCIe XAUI risers Ensure that the cross beam is engaged with the standoffs on either side of the chassis rear panel PCI cross beam Tighten the two captive Phillips screws securing the removable PCI cross beam to the chassis Install the top cover Slide the server into the rack See Return the Server to the Normal Rack Position on page 180 Connect any data cables you removed to service the PCle XAUI cards Connect all power cables Related Information Remove a PCle XAUI Riser on page 105 Remove a PCle or XAUI Card on page 109 Install a PCle or XAUI Card on page 109 108 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 V Remove a PCIe or XAUI Card 1 Locate the PCIe XAUI card that you want to remove Note its corresponding riser board See Rear Panel Components and Indicators on SPARC Enterprise T5140 Servers on page 8 or Rear Panel Comp
91. e T5140 Servers on page 190 m Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5240 Servers on page 204 1 Position the hard drive cage in the chassis over the chassis standoffs This is shown in the following figure 154 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Installing a Hard Drive Cage Illustrating Installation in a SPARC Enterprise T5240 Server 2 Connect the hard drive data cables Press the plug into its socket until the plug snaps into place If the cables do not reach the hard drive cage perform this step after Step 4 3 SPARC Enterprise T5140 server 8 disk capable Remove fan FM1 4 Slide the hard drive cage back until the hard drive backplane engages with the paddle card connector 5 Replace the No 2 Phillips screws securing the hard drive cage to the chassis Two screws secure the disk cage to each side of the chassis 6 SPARC Enterprise T5240 server Install the fan power boards See Install the Fan Power Board on page 150 Servicing Boards and Components 155 10 11 SPARC Enterprise T5240 server Install the fan modules See Install a Fan Module on page 133 Install the top cover See Install the Top Cover on page 177 SPARC Enterprise T5140 Install the inner glides Slide each inner glide onto the mounting studs on the server until the glide snaps into place SPARC Enterprise T5140
92. e action is required e Steady on Indicates that a fan failure event has been acknowledged and a service action is required on at least one of the fan modules Identifying Server Components 11 Related Information a LED Overview on page 21 Rear Panel Components and Indicators on SPARC Enterprise T5240 Servers The following figure shows the layout of the I O ports PCle ports 10 Gbit Ethernet XAUI ports if equipped and power supplies on the rear panel FIGURE Rear Panel Components and Indicators on SPARC Enterprise T5240 Servers Figure Legend PSU 1 PSU 0 PCle 3 PCle XAUI 0 PCle 4 PCle XAUI 1 PCle 5 N OO fF OD PCle 2 Rear panel status LEDs Serial management port Network management port Gigabit Ethernet ports 0 1 2 3 USB ports 0 1 DB 9 serial port 12 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table provides descriptions of the LEDs located on the rear panel TABLE LED Indicators on the SPARC Enterprise T5240 Server Rear Panel LED or Button Icon or Label Description Locator LED WW The Locator LED can be turned on to identify a particular system When on it and button blinks rabidly There are three methods for turning a Locator LED on white e Issuing the ILOM command set SYS LOCATE value Fast_Blink e Issuing the ALOM CMT command setlocator on e Pressing the Locator button Service If on indicates that service is req
93. e and install a memory mezzanine assembly m Memory Mezzanine Assembly Overview on page 118 m Remove a Memory Mezzanine Assembly on page 118 a Install a Memory Mezzanine Assembly on page 120 Memory Mezzanine Assembly Overview The memory mezzanine assembly must be removed in order to access the following components Motherboard FB DIMMs Motherboard m Power distribution board m Power supply backplane SPARC Enterprise T5240 server m Paddle card Related Information m Remove a Memory Mezzanine Assembly on page 118 a Install a Memory Mezzanine Assembly on page 120 Remove a Memory Mezzanine Assembly Caution This procedure requires that you handle components that are sensitive to static discharge Static discharges can cause the components to fail 118 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 1 Power off the server Removing Power From the System on page 60 2 Attach an antistatic wrist strap 3 Remove the top cover See Remove the Top Cover on page 67 4 Remove the shipping bracket Note The shipping bracket is not required for normal system operation Some systems might not have a shipping bracket installed 5 Open the release levers on either side of the memory mezzanine assembly FIGURE Removing the Memory Mezzanine Assembly 6 Lift the memory mezzanine assembly up and out of the system Place the memory mezz
94. e board into its mushroom standoffs in the chassis floor and slide the board to the right into the paddle card FIGURE Installing a Fan Power Board Illustrates installation in a SPARC Enterprise T5140 server 2 Secure the board to the chassis with a Phillips screw 150 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 3 Install the fan modules See Install a Fan Module on page 133 4 Install the top cover See Install the Top Cover on page 177 5 If the server has been removed from the rack return it to the rack as described in Reinstall the Server in the Rack on page 178 6 Slide the server into the rack See Return the Server to the Normal Rack Position on page 180 7 Connect the power cords See Connect Power Cords to the Server on page 181 8 Power on the system See Power On the Server Using the poweron Command on page 181 or Power On the Server Using the Front Panel Power Button on page 182 Related Information m Remove the Fan Power Board on page 149 Servicing the Hard Drive Cage These topics explain how to remove and install the hard drive cage m Hard Drive Cage Overview on page 151 m Remove the Hard Drive Cage on page 152 m Install the Hard Drive Cage on page 154 Related Information m Remove the Hard Drive Backplane on page 157 m Remove the Front Control Panel Light Pipe Assemblies on page 161
95. e capable SPARC Enterprise T5140 server TABLE Fan Module Locations and FRU Names for SPARC Enterprise T5140 Servers With a 4 Disk Capable Backplane SYS FANBD1 FMO SYS FANBD1 FM1 SYS FANBD1 FM2 Empty SYS FANBD0O FMO SYS FANBD0O FM1 SYS FANBD0O FM2 Empty Front of System The following table shows the FRU device names for the fan modules in the eight hard drive capable SPARC Enterprise T5140 server TABLE Fan Module Locations and FRU Names for SPARC Enterprise T5140 Servers With an 8 Disk Capable Backplane SYS FANBD1 FMO SYS FANBD1 FM1 SYS FANBD1 FM2 Empty SYS FANBD0O FMO SYS FANBD0 FM1 SYS FANBD0O FM2 SYS FANBD0O FM3 Front of System Fan Module Configurations for SPARC Enterprise T5240 Servers 8 and 16 Disk Capable The following table shows the FRU device names for the fan modules in SPARC Enterprise T5240 servers This information applies to both the eight hard drive capable and sixteen hard drive capable version of the system TABLE Fan Module Locations and FRU Names for SPARC Enterprise T5240 Servers With an 8 or 16 Disk Capable Backplane SYS FANBD1 FMO SYS FANBD1 FM1 Empty SYS FANBD0O FMO SYS FANBD0O FM1 SYS FANBDO FM2 Front of System 130 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Fan Module Status LEDs Each fan module contains a pair of LEDs which are visible when you open the fan compartment access door The following table describes the sta
96. e cause of the problem contact your service representative for support 20 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 LED Overview The server provides the following groups of LEDs Front panel system LEDs Rear panel system LEDs Hard drive LEDs Power supply LEDs Fan module LEDs Rear panel Ethernet port LEDs FB DIMM Locate LEDs The following table provides quick reference information about the various LEDs It also points to more detailed descriptions for each TABLE System Faults and the Corresponding LED States Component Fault Fault LEDs Lit Additional Information Power supply Fan module Service Required LED front and rear panel Power Supplies Overview on page 135 Front panel Power Supply Fault LED e Remove a Power Supply on page 137 Individual power supply Fault LED e Install a Power Supply on page 140 Service Required LED front and rear panel Fan Module Overview on page 129 Front panel Fan Fault LED e Remove a Fan Module on page 131 Individual fan module Fault LED e Install a Fan Module on page 133 Overtemp LED if overtemp condition exists Detecting and Managing Faults 21 TABLE System Faults and the Corresponding LED States Continued Continued Component Fault Fault LEDs Lit Additional Information Hard drive e Service Required LED front and rear panel See these sections e Individual hard drive Fault LED e
97. e firmware is configured the system might boot at this time 12 Power on the server See Power On the Server Using the poweron Command on page 181 or Power On the Server Using the Front Panel Power Button on page 182 Related Information m Remove a PCle or XAUI Card on page 109 m Remove a PCle XAUI Riser on page 105 a Install a PCle XAUI Riser on page 107 PCIe and XAUI Card Reference for SPARC Enterprise T5140 Servers The following table shows the physical PCle XAUI slot locations on the SPARC Enterprise T5140 server as viewed from the rear of the system TABLE FB DIMM Configuration Installation Map SPARC Enterprise T5240 Servers PCIe 0 XAUI 0 PCIe 1 XAUI 1 PCIe 2 TABLE PCIe and XAUI Support SPARC Enterprise T5140 Servers Slot PCle Controller Supported Device Types FRU Name PCleOor 1 x8 PCle operating at x8 SYS MB RISERO PCIEO XAUI 0 XAUI expansion card SYS MB RISERO XAUIO PCle lor 0 x8 PCle operating at x8 SYS MB RISER1 PCIE1 XAUI 1t XAUI expansion card SYS MB RISER1 XAUI1 PCle 2 0 x16 PCle operating at x8 SYS MB RISER2 PCIE2 Slots 0 and 1 are shared PCle XAUI slots You can only install one or the other type of card t Slots 0 and 1 are shared PCle XAUI slots You can only install one or the other type of card t PCIe controller 1 also supports the on board Ethernet controller for the NETO NET1 NET2 and NET3 ports PCle controller 0 also supports the
98. e following figure shows the release button in a SPARC Enterprise T5140 server The top cover release button in a SPARC Enterprise T5240 server is similar Note In newer versions of the top cover the release button is located closer to the edge of the cover Except for this difference in location the release mechanism operates in the same manner in both versions FIGURE Removing the Top Cover 3 Remove the top cover Lift up and remove the cover The figure above shows the SPARC Enterprise T5140 server The SPARC Enterprise T5240 server is similar Related Information m Install the Top Cover on page 177 68 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Servicing Hard Drives These topics explain how to remove and install hard drives in SPARC Enterprise T5140 and T5240 servers m Hard Drive Servicing Overview on page 69 m Hard Drive LEDs on page 70 m Remove a Hard Drive on page 71 m Install a Hard Drive on page 73 a Four Drive Capable Backplane Configuration Reference on page 77 m Eight Drive Capable Backplane Configuration Reference on page 78 m Sixteen Drive Capable Backplane Configuration Reference on page 79 Hard Drive Servicing Overview Hard drives in SPARC Enterprise T5140 and T5240 servers are capable of being removed and installed while the server is running This feature referred to as being hot pluggable depends on how the
99. e server and then manually remove the drive from the chassis Servicing Hard Drives 71 1 At the Solaris prompt type the cfgadm al command This will list all drives in the device tree including drives that are not configured cfgadm al This command should identify the Ap_id for the hard drive you plan to remove as shown below Ap_id Type Receptacle Occupant Condition c0 scsi bus connected configured unknown c0 dsk c1t0d0 disk connected configured unknown c0 dsk c1t1d0 disk connected configured unknown usb0 1 unknown empty unconfigured ok usb0 2 unknown empty unconfigured ok usb0 3 unknown empty unconfigured ok usb1 1 unknown empty unconfigured ok usb1 2 unknown empty unconfigured ok usb1 3 unknown empty unconfigured ok usb2 1 unknown empty unconfigured ok usb2 2 unknown empty unconfigured ok usb2 3 unknown empty unconfigured ok usb2 4 unknown empty unconfigured ok usb2 5 unknown empty unconfigured ok usb2 6 unknown empty unconfigured ok usb2 7 unknown empty unconfigured ok usb2 8 unknown empty unconfigured ok 2 Type cfgadm c unconfigure to unconfigure the disk For example the following shows drive c0 dsk c1t1d1 being unconfigured cfgadm c unconfigure c0 dsk cit1d1 3 Wait until the blue Ready to Remove LED lights This LED will help you identify which drive is unconfigured and can be removed 4 On the drive you plan to remove push the hard drive release button
100. e set of LEDS Note The OK Activity LED has slightly different behavior for SSDs than for disk based drives This difference is described in the table that follows the figure FIGURE Hard Drive LEDs 70 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table explains how to interpret the hard drive status LEDs TABLE Status LEDs for Hard Drives LED 1 Ready to Remove 2 Service Required 3 OK Activity HDDs 3 OK Activity SSDs 0 Color Blue Amber Green Green Description Indicates that a hard drive can be removed during a hot plug operation Indicates that the hard drive is has experienced a fault condition Indicates the HDD s availability for use e On Drive is idle and available for use e Off Read or write activity is in progress Indicates the drive s availability for use e On Drive is idle and available for use e Off Read or write activity is in progress e Flashes on and off This occurs during hot plug operations It can be ignored Note The front and rear panel Service Required LEDs also light when the system detects a hard drive fault Related Information m Remove a Hard Drive on page 71 m Install a Hard Drive on page 73 YV Remove a Hard Drive Removing a hard drive from the server is a three step process You must first identify the drive you wish to remove unconfigure that drive from th
101. efault Drive Pathnames for a Sixteen Drive Capable Backplane Physical Location FRU Address OpenBoot PROM Solaris Default Drive Pathname HDDO SYS HDDO c0 dsk c1t0d0 HDD1 SYS HDD1 c0 dsk c1t1d0 HDD2 SYS HDD2 c0 dsk c1t2d0 HDD3 SYS HDD3 c0 dsk c1t3d0 HDD4 SYS HDD4 c0 dsk c1t4d0 HDD5 SYS HDD5 c0 dsk c1t5d0 HDD6 SYS HDD6 c0 dsk c1t6d0 HDD7 SYS HDD7 c0 dsk c1t7d0 HDD8 SYS HDD8 c0 dsk c1t8d0 HDD9 SYS HDD9 c0 dsk c1t9d0 HDD10 SYS HDD10 c0 dsk c1t10d0 HDD11 SYS HDD11 c0 dsk c1t11d0 HDD12 SYS HDD12 c0 dsk c1t12d0 HDD13 SYS HDD13 c0 dsk c1t13d0 Servicing Hard Drives 79 80 TABLE Physical Drive Locations FRU Addresses and Default Drive Pathnames for a Sixteen Drive Capable Backplane Continued Physical Location FRU Address OpenBoot PROM Solaris Default Drive Pathname HDD14 SYS HDD14 c0 dsk c1t14d0 HDD15 SYS HDD15 c0 dsk c1t15d0 DVD SYS DVD Related Information m Install a Hard Drive on page 73 m Remove a Hard Drive on page 71 m Four Drive Capable Backplane Configuration Reference on page 77 m Eight Drive Capable Backplane Configuration Reference on page 78 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Servicing Motherboard Components These topics explain how to replace the motherboard and its components in the SPARC Enterprise T5140 and SPARC Enterprise T5240 servers Servicing FB DIMMs on page 81 Servicing the Air Duct
102. ements in the document please state your points specifically on the form at the following URL For Users in U S A Canada and Mexico https download computers us fujitsu com For Users in Other Countries http www fujitsu com global contact computing sparce_index ht ml xxiv SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Identifying Server Components These topics identify key components of the SPARC Enterprise T5140 and T5240 servers including major boards and internal system cables as well as front and rear panel features Infrastructure Boards in SPARC Enterprise T5140 Servers on page 2 Infrastructure Boards in SPARC Enterprise T5240 Servers on page 3 Internal System Cables for SPARC Enterprise T5140 Servers on page 4 Internal System Cables for SPARC Enterprise T5240 Servers on page 5 Front Panel Controls and Indicators on SPARC Enterprise T5140 Servers on page 5 Rear Panel Components and Indicators on SPARC Enterprise T5140 Servers on page 8 Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers on page 9 Rear Panel Components and Indicators on SPARC Enterprise T5240 Servers on page 12 Status LEDs for Ethernet Ports and the Network Management Port on page 14 Related Information Identifying FRUs in SPARC Enterprise T5140 Servers on page 183 Identifying FRUs in SPARC Enterprise T5240 Servers on page 195
103. es access to internal hard drives the removable media drive if equipped and the two front USB ports Identifying Server Components 9 FIGURE Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers Figure Legend 1 2 3 4 Locator LED and button Service Required LED Power OK LED Power button on oO Uo Power Supply Service Required LED Overtemp LED Fan Module Service Required LED Hard Drive map 10 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table provides descriptions of these controls and indicators TABLE Front Panel Controls and Indicators SPARC Enterprise T5140 and T5240 Servers LED or Button Icon or Label Description Locator LED WW The Locator LED can be turned on to identify a particular system When on it and button blinks rabidly There are three methods for turning a Locator LED on white e Issuing the I LOM command set SYS LOCATE value Fast_Blink e Issuing the ALOM CMT command setlocator on e Pressing the Locator button Service If on indicates that service is required POST and ILOM are two diagnostics Required LED tools that can detect a fault or failure resulting in this indication amber VAN The ILOM show faulty command provides details about any faults that cause this indicator to light Under some fault conditions individual component fault LEDs are lit in addition to the system Service Required LED P
104. escription Top cover interlock cable This cable connects the safety interlock switch on the top cover to the power distribution board Ribbon cable This cable carries signals between the power distribution board and the motherboard Hard drive data cable This cable carries data and control signals between the motherboard and the hard drive backplane Related Information m Identifying FRUs in SPARC Enterprise T5140 Servers on page 183 4 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Internal System Cables for SPARC Enterprise T5240 Servers The following table identifies the internal system cables used in SPARC Enterprise T5240 servers Cable Description Top cover interlock cable Ribbon cable Ribbon cable Hard drive data cables 1 or 2 depending on the type of hard drive backplane Related Information This cable connects the safety interlock switch on the top cover to the power distribution board This cable carries signals between the power supply backplane and the power distribution board This cable carries signals between the power distribution board and the motherboard This cable carries data and control signals between the motherboard and the hard drive backplane m Identifying FRUs in SPARC Enterprise T5240 Servers on page 195 Front Panel Controls and Indicators on SPARC Enterprise T5140 Servers The following figure shows the layout of the T5140
105. ess components contained within the chassis and the steps needed to protect against damage or injury from electrostatic discharge Perform Electrostatic Discharge Prevention Measures on page 67 Remove the Top Cover on page 67 Remove the Air Duct on page 103 Install the Air Duct on page 104 Perform Electrostatic Discharge Prevention Measures Many components housed within the chassis can be damaged by electrostatic discharge To protect these components from damage perform the following steps before opening the chassis for service 1 Prepare an antistatic surface to set parts on during the removal installation or replacement process Place ESD sensitive components such as the printed circuit boards on an antistatic mat The following items can be used as an antistatic mat m Antistatic bag used to wrap a replacement part m ESD mat m A disposable ESD mat shipped with some replacement parts or optional system components Attach an antistatic wrist strap When servicing or removing server components attach an antistatic strap to your wrist and then to a metal area on the chassis Related Information General Safety Information on page 57 Remove the Top Cover 1 Unlatch the fan module door Pull the release tabs back to release the door Preparing to Service the System 67 2 Press the top cover release button and slide the top cover to the rear about a 0 5 inch 12 7 mm Th
106. etting the virtual keyswitch property to normal This enables the system to turn on and for POST to run gt set SYS keyswitch_state normal Set keyswitch_state to normal keyswitch_state Set to diag You can apply preconfigured diagnostic settings to POST operations by setting the virtual keyswitch property to diag gt set SYS keyswitch_state diag Set keyswitch_state to diag diag_mode Set to off You can prevent POST from running by setting the diag_mode property to off gt set SYS diag _mode off Set diag_mode to off diag_mode Set to service You force POST to run with a set of preconfigured values for diag_level and diag_verbosity by setting the diag_mode property to service gt set SYS diag_mode service Set diag_mode to service Related Information a ILOM Properties that Affect POST Behavior on page 35 a Run POST in Maximum Mode on page 39 a Clear POST Detected Faults on page 41 38 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 YV Run POST in Maximum Mode POST can be helpful when used as a first stage diagnostic tool When a fault s symptoms are unclear you can run POST in maximum mode to generate extensive status information on all the key system components 1 From the ILOM prompt set the virtual keyswitch to diag so that POST will run in service mode gt set SYS keyswitch_state Dia
107. ety interlock kill switch This board carries 12V power from the power supplies to the power distribution board over a pair of bus bars In SPARC Enterprise T5140 servers the power supplies connect directly to the power distribution board This board serves as the interconnect between the power distribution board and the fan power boards disk drive backplane and front I O board These boards carry power to the system fan modules In addition these boards contain fan module status LEDs and transmit status and control data for the fan modules Identifying Server Components 3 Board Description Hard drive backplane This board includes the connectors for the hard drives This board also contains the interconnect for the front I O board Power and Locator buttons and system component status LEDs Each drive has its own Power Activity Fault and Ready to Remove LEDs Front I O board This board connects directly to the hard drive backplane This board is packaged with the DVD drive as a single unit Related Information m Infrastructure Boards in SPARC Enterprise T5140 Servers on page 2 m Identifying FRUs in SPARC Enterprise T5140 Servers on page 183 m Identifying FRUs in SPARC Enterprise T5240 Servers on page 195 Internal System Cables for SPARC Enterprise T5140 Servers The following table identifies the internal system cables used in SPARC Enterprise T5140 servers Cable D
108. ezzanine assembly Mezzanine Assembly SPARC Enterprise T5240 on page 118 Servicing the Memory Mezzanine Assembly SPARC Enterprise T5240 on page 118 Identify Faulty FB DIMMs Using the show faulty Command on page 83 Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 Servicing the Memory Mezzanine Assembly SPARC Enterprise T5240 on page 118 Servicing the Memory Mezzanine Assembly SPARC Enterprise T5240 on page 118 ensure proper system cooling Optional component Must be installed if shipping the system to another location See configuration rules before upgrading FB DIMMs Must be installed to ensure proper system cooling Must be removed to access motherboard FB DIMMs motherboard power distribution board power supply backplane and paddle card N A See FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers on page 98 N A SYS MB CMP0 MRO SYS MB CMP1 MR1 Identifying FRUs in SPARC Enterprise T5240 Servers 199 I O Components in SPARC Enterprise T5240 Servers FIGURE I O Components SPARC Enterprise T5240 Servers 200 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table identifies the I O components in the server and points to instructions for servicing them TABLE I O Components SPARC Enterprise T5240 Servers Item FRU Replacement Instructi
109. f the fault indicates that a fan or power supply is bad you can perform a hot swap of the FRU You can also use the fault LEDs on the server to identify the faulty FRU fans and power supplies If the fault displayed included a uuid and sunw msg id property the fault was detected by the Solaris Predictive Self Healing software If the fault is a PSH detected fault refer to the PSH Knowledge Article web site for additional information The Knowledge Article for the fault is located at the following link e Managing Faults Using the PSH Feature on page 43 e Clear PSH Detected Faults on page 47 http www sun com msg message ID where message ID is the value of the sunw msg id property displayed by the show faulty command After the FRU is replaced perform the procedure to clear PSH detected faults POST performs basic tests of the server components and reports faulty FRUs When POST detects a faulty FRU it logs the fault and if possible takes the FRU offline POST detected FRUs display the following text in the fault message e Detecting Faults With POST on page 34 e Clear POST Detected Faults on page 41 Forced fail reason In a POST fault message reason is the name of the power on routine that detected the failure The majority of hardware faults are detected by the server s diagnostics In rare cases a problem might require additional troubleshooting If you are unable to determine th
110. fault Related Information POST Overview on page 35 Solaris PSH Feature Overview on page 44 PSH Detected Fault Console Message on page 45 Identify Faulty FB DIMMs Using the show faulty Command on page 83 Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 82 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 V Identify Faulty FB DIMMs Using the show faulty Command The ILOM show faulty command displays current system faults including faults detected in FB DIMMs Enter show faulty at the gt prompt gt show faulty Target Property Value Be ee eee ee ee ae r 2 a ante ee a See eS ame eee eee eee SP f aultmgmt 0 fru SYS MB CMP0 BR1 CHO DO SP faultmgmt 0 timestamp Dec 21 16 40 56 SP faultmgmt 0 timestamp Dec 21 16 40 56 faults 0 SP faultmgmt 0 sp_detected_fault SYS MB CMP0 BR1 CHO0 DO faults 0 Forced fail POST Related Information m Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 V Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button Use the FB DIMM Fault Locator button to identify faulty FB DIMMs This button is located on the motherboard 1 Extend the server to the maintenance position See Extend the Server to the Maintenance Position on page 63 2 Disconnect power from the server See Removing Power From the System on page 60 3 Remove the top
111. fault information 19 Solaris Predictive Self Healing PSH see Predictive Self Healing PSH stop SYS ILOM command 61 SunVTS tests 55 user interfaces 55 Index 211 using for fault diagnosis 19 system components see components T top cover removing 68 topic guidelines 1 15 57 69 81 129 135 143 177 183 195 troubleshooting AC OK LED state 19 by checking Solaris OS log files 19 FB DIMMs 82 Power OK LED state 19 using POST 19 20 using SunVTS 19 using the show faulty command 19 U Universal Unique Identifier UUID 44 USB ports also see DVD USB module USB ports front FRU name 187 201 vV virtual keyswitch 93 W Wago connector 141 212 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 cO FUJITSU
112. g Set keyswitch_state to Diag 2 Reset the system so that POST runs There are several ways to initiate a reset The following example shows a reset using a power cycle command sequence For other methods refer to the SPARC Enterprise T5140 and T5240 Servers Administration Guide gt stop SYS Are you sure you want to stop SYS y n y Stopping gt start SYS SYS Are you sure you want to start SYS y n y Starting SYS Note The server takes about one minute to power off 3 Switch to the system console to view the POST output The following is an partial example of POST output gt start SP console 19 22 01 17 810 0 0 PHY level Loopback 22 534 0 0 2007 12 BCM5466R 2007 12 Port 2 2007 12 1 Port 3 2007 12 2007 12 Loopback 2007 12 2007 12 BCM5466R 19 22 01 9 223012 19 22 01 19 22 01 Test 19 22 01 19 22 01 22 22 27 27 542 553 22 556 271 274 0 0 PHY level Loopback 0 0 O gt INFO STATUS Running RGMII 1G Test 0 gt End Neptune 1G Loopback Test 0 gt Begin Neptune 1G Loopback Test 0 gt 0 gt INFO STATUS Running BMAC level 0 gt O gt INFO STATUS Running RGMII 1G Test Detecting and Managing Faults 39 2007 12 19 22 01 32 004 0 0 0 gt End Neptune 1G Loopback Test Port 3 2007 12 19 22 01 32 012 2007 12 19 22 01 32 019 2007 12 19 22 01 32
113. hard drives are configured Note SPARC Enterprise T5140 and T5240 servers support both traditional disk based storage devices and flash SSDs diskless storage devices based on solid state memory The terms hard drive and HDD hard disk drive are used in a generic sense to refer to both types of internal storage devices To hot plug a drive you must first take it offline This prevents applications from accessing it and removes software links to it There are two conditions that will prevent a drive from being hot plugged m The hard drive contains the sole image of the operating system that is the operating system is not mirrored on another drive m The hard drive cannot be logically isolated from the server s online operations 69 If either of these conditions exist you must power off the server before replacing a hard drive Related Information m Removing Power From the System on page 60 m Power On the Server Using the poweron Command on page 181 m Power On the Server Using the Front Panel Power Button on page 182 m Four Drive Capable Backplane Configuration Reference on page 77 a Eight Drive Capable Backplane Configuration Reference on page 78 m Sixteen Drive Capable Backplane Configuration Reference on page 79 Hard Drive LEDs Each hard drive has a group of three status LEDs as shown in the following figure Both disk based hard drives and flash SSDs use the sam
114. he Chassis Serial Number to chassis_serial_ number y n Yy setcsn Chassis serial number recorded sc gt setepn p chassis_part_number Are you sure you want to permanently set the Chassis Part Number to chassis_part_number y n y setcpn Chassis part number recorded sc gt showplatform SPARC Enterprise T5140 Chassis Serial Number chassis serial number Domain Status SO Running sc gt setsc sc_servicemode false Related Information m Remove the Power Distribution Board on page 164 Servicing Power Supply Backplanes SPARC Enterprise T5240 Servers The following topics explain how to remove and install power supply backplanes in SPARC Enterprise T5240 servers Power supply backplanes are not used in SPARC Enterprise T5140 servers m Power Supply Backplane Overview on page 171 Related Information a Servicing Power Distribution Boards on page 163 170 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Power Supply Backplane Overview The power supply backplane carries 12V power from the power supplies to the power distribution board over a pair of bus bars Note SPARC Enterprise T5140 servers do not use a power supply backplane In these systems the power supplies connect directly to the power distribution board when the server is powered off To avoid personal injury or damage to the server A Caution The system supplies standby power to the power supp
115. he Hard Drive Backplane on page 157 m Install the Hard Drive Backplane on page 159 Remove the Hard Drive Backplane 1 Remove the hard drive cage See Remove the Hard Drive Cage on page 152 2 Remove the No 1 Phillips screws securing the backplane to the hard drive cage m Two screws secure the backplane in the SPARC Enterprise T5140 server See the first figure below m Four screws secure the backplane in the SPARC Enterprise T5240 server See the second figure below Servicing Boards and Components 157 FIGURE Removing a Hard Drive Backplane Illustrating removal from a SPARC Enterprise T5140 server FIGURE Removing a Hard Drive Backplane Illustrating removal from a SPARC Enterprise T5240 server 158 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 3 Slide the backplane down and off the hard drive cage retention hooks 4 Place the hard drive backplane on an antistatic mat Related Information m Install the Hard Drive Backplane on page 159 V Install the Hard Drive Backplane 1 Slide the backplane under the retention hooks on the hard drive cage 2 Install the No 1 Phillips screws that secure the backplane to the hard drive cage m Two screws secure the backplane in the SPARC Enterprise T5140 server See the first figure below m Four screws secure the backplane in the SPARC Enterprise T5240 server See the second figure below FIGURE Installing a Hard Drive Ba
116. he output is displayed g lines specifies the number of lines to display before pausing e lines displays n lines from the end of the buffer b lines displays n lines from the beginning of the buffer v displays the entire buffer boot run specifies the log to display run is the default log 26 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 TABLE Service Related Commands Continued ILOM Command ALOM CMT Command Description set HOST bootmode property value where property is state config or script stop SYS stop SYS start SYS set SYS PSx prepare_to_remove_action true reset SYS reset SP start SYS set SYS keyswitch_state value normal locked standby diag bootmode normal reset_nvram config configname bootscript string powercycle f The f option forces an immediate poweroff Otherwise the command attempts a graceful shutdown poweroff y e y enables you to skip the confirmation question e f forces an immediate shutdown e e c executes a console command after completion of the poweron command poweron removefru SYS PSO SYS PS1 reset y c e y enables you to skip the confirmation question e c executes a console command after completion of the reset command resetsc y e y enables you to skip the confirmation question setkeyswitch y value
117. herboard handle Routing the cable between the FB DIMMs and CMP1 processor Heat shrink tubing A U N Routing the cable through the fan midwall to the hard drive backplane Identifying FRUs in SPARC Enterprise T5140 Servers 193 HDD Data Cable Routing for SAS RAID Controller Cards in Eight Disk Capable SPARC Enterprise T5140 Servers There are two SAS controller card options for the SPARC Enterprise T5140 and T5240 servers both options support RAID The standard option uses the on board SAS controller card preinstalled on every server The second option is a StorageTek SAS RAID Internal Host Bus Adapter HBA PCle card The internal cabling of your server will be different depending on the SAS controller card option you choose FIGURE Hard Drive Data Cable Routing for SAS RAID Controller Card in Eight Disk Capable SPARC Enterprise T5140 Servers aL Figure Legend Routing the data cable through the left channel on the motherboard handle Routing the data cable through the right channel on the motherboard handle Routing the cable between the two processors A O N Routing the cables through the fan midwall to the hard drive backplane 194 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Identifying FRUs in SPARC Enterprise T5240 Servers These topics identify and illustrate Field Replaceable Units FRUs contained in SPARC Enterprise T5240 servers Motherboard Components in SPARC E
118. ibes how the server deals with memory faults The following server features manage memory faults POST By default POST runs when the server is powered on For correctable memory errors CEs POST forwards the error to the Solaris Predictive Self Healing PSH daemon for error handling If an uncorrectable memory fault is detected POST displays the fault with the device name of the faulty FB DIMMs and logs the fault POST then disables the faulty FB DIMMs Depending on the memory configuration and the location of the faulty FB DIMM POST disables half of physical memory in the system or half the physical memory and half the processor threads When this offlining process occurs in normal operation you must replace the faulty FB DIMMs based on the fault message and enable the disabled FB DIMMs with the ILOM command set device component_state enabled where device is the name of the FB DIMM being enabled for example set SYS MB CMP0 BRO CHO DO component_state enabled Solaris Predictive Self Healing PSH technology PSH uses the Fault Manager daemon fmd to watch for various kinds of faults When a fault occurs the fault is assigned a unique fault ID UUID and logged PSH reports the fault and suggests a replacement for the FB DIMMs associated with the fault If you suspect the server has a memory problem run the ILOM show faulty command This command lists memory faults and identifies the FB DIMM modules associated with the
119. icing Power Two power supplies SYS PSO Supplies on page 135 provide N 1 SYS PS1 A fan module might not be present in this slot for some configurations 8 P 8 Identifying FRUs in SPARC Enterprise T5240 Servers redundancy 203 Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5240 Servers There are two SAS controller card options for the SPARC Enterprise T5140 and T5240 servers both options support RAID The standard option uses the on board SAS controller card preinstalled on every server The second option is a StorageTek SAS RAID Internal Host Bus Adapter HBA PCle card The internal cabling of your server will be different depending on the SAS controller card option you choose 204 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Internal Cables for Onboard SAS Controller Cards Eight Disk Capable SPARC Enterprise T5240 Servers inl am 1 i pe Nee Figure Legend Top cover safety interlock PDB to power supply backplane cable Motherboard to PDB cable Hard drive data cables A U N TABLE Data Cable Routing Details Eight Disk Capable SPARC Enterprise T5240 Servers Item FRU Connections Routing notes 4 HDD data Lower cable in the figure From Routed between CMP Module 0 CMP0 and cable J4101 SASO on the motherboard to CMP Module 1 CMP1 then under the chassis J0301 on the hard drive backplane center wall and then under the fa
120. icing the hard drive backplane remove the DVD USB module See Remove the DVD USB Module on page 145 152 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 A 9 SPARC Enterprise T5240 server Remove the fan modules and fan power boards See Remove the Fan Power Board on page 149 10 Remove the No 2 Phillips screws securing the hard drive cage to the chassis Two screws secure the disk cage to each side of the chassis FIGURE Removing a Hard Drive Cage Illustrating Removal From a SPARC Enterprise T5140 Server 11 Slide the hard drive cage forward to disengage the backplane from the paddle cards 12 Disconnect the hard drive data cables a Press the release button b Remove the plug from the connector on the hard drive backplane Caution The hard drive data cables are delicate Ensure that they are safely out of the way when servicing the motherboard Servicing Boards and Components 153 13 Lift the hard drive cage up and out of the chassis 14 Set the hard drive cage on an antistatic mat Related Information m Install the Hard Drive Cage on page 154 m Remove the Hard Drive Backplane on page 157 V Install the Hard Drive Cage Before performing any installation steps review the proper cable routing and connections The following topics contain detailed cable routing information m Internal Cables for Onboard SAS Controller Cards in SPARC Enterpris
121. icker located on the front of the server and on another sticker on the side of the server If it is not convenient to read either sticker you can run the ILOM show SYS command to obtain the chassis serial number Type show SYS at the ILOM prompt gt show SYS SYS Targets SERVICE LOCATE ACT PS_ FAULT TEMP FAULT FAN_FAULT Preparing to Service the System 59 Properties type Host System keyswitch_state Normal product_name T5240 product_serial_number 0723BBC006 fault_state OK clear_fault_action none power_state On Commands cd reset set show start stop Removing Power From the System These topics describe different methods for removing power from the chassis m Power Off the Server Service Processor Command on page 60 m Power Off the Server Power Button Graceful on page 62 m Power Off the Server Emergency Shutdown on page 62 m Disconnect Power Cords From the Server on page 62 Related Information m Servicing Motherboard Components on page 81 m Servicing Boards and Components on page 143 V Power Off the Server Service Processor Command You can use the service processor to perform a graceful shutdown of the server and to ensure that all of your data is saved and the server is ready for restart 60 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Note Additional information a
122. icular system When on it CE blinks rabidly There are three methods for turning a Locator LED on e Issuing the ILOM command set SYS LOCATE value Fast_Blink e Issuing the ALOM CMT command setlocator on e Pressing the Locator button If on indicates that service is required POST and ILOM are two diagnostics tools that can detect a fault or failure resulting in this indication The ILOM show faulty command provides details about any faults that cause this indicator to light Under some fault conditions individual component fault LEDs are lit in addition to the system Service Required LED Provides the following indications e Off System is not running in its normal state System power might be off The service processor might be running e Steady on System is powered on and is running in its normal operating state No service actions are required e Fast blink System is running in standby mode and can be quickly returned to full function e Slow blink A normal but transitory activity is taking place Slow blinking might indicate that system diagnostics are running or the system is booting Related Information m LED Overview on page 21 Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers The following figure shows the layout of the T5140 server front panel including the power and system locator buttons and the various status and fault LEDs Note The front panel also provid
123. ides the following operational fan indications amber FAN e Off Indicates a steady state no service action is required e Steady on Indicates that a fan failure event has been acknowledged and a service action is required on at least one of the fan modules Identifying Server Components 7 Related Information a LED Overview on page 21 Rear Panel Components and Indicators on SPARC Enterprise T5140 Servers The following figure shows the layout of the connectors associated with the system I O ports PCIe ports 10 Gbit Ethernet XAUI ports if equipped and power supplies on the rear panel of SPARC Enterprise T5140 servers It also shows the locations of the rear panel LEDs FIGURE Rear Panel Components and Indicators on SPARC Enterprise T5140 Serves Figure Legend 8 oa fF WN PSU 0 7 Serial management port PSU 1 8 Network management port PCle XAUI 0 9 Gigabit Ethernet ports 0 1 2 3 PCle XAUI 1 10 USB ports 0 1 PCle 2 11 DB 9 serial port Rear panel system status LEDs SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table provides descriptions of the LEDs located on the rear panel TABLE Rear Panel LED Indicators SPARC Enterprise T5140 and T5240 Servers LED or Button Locator LED and button white Service Required LED amber Power OK LED green Icon or Label Description The Locator LED can be turned on to identify a part
124. in the servers TABLE Power Supply FRU Names Physical Device FRU Name PSO SYS PSO PS1 SYS PS1 Note Power supply names in ILOM messages are displayed with the full FRU name such as SYS PSO 142 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Servicing Boards and Components These topics explain how to service field replaceable units FRUs in SPARC Enterprise T5140 and T5240 servers a Important Safety Instructions on page 143 m Servicing DVD USB Modules on page 144 m Servicing Fan Power Boards on page 148 m Servicing the Hard Drive Cage on page 151 m Servicing the Hard Drive Backplane on page 156 m Servicing Front Control Panel Light Pipe Assemblies on page 160 m Servicing Power Distribution Boards on page 163 m Servicing Power Supply Backplanes SPARC Enterprise T5240 Servers on page 170 m Servicing Paddle Cards on page 174 Important Safety Instructions This topic provides a summary of the safety precautions you need to follow when servicing circuit boards and other components contained the server chassis Most components housed within the chassis must never be serviced while power is present in the chassis The following table identifies those components TABLE Components That Require Removal of System Power Before Servicing is Performed Component Servicing procedures DVD USB module Servicing DVD USB Mod
125. indirect sp cial secondaire ou cons cutif m me si ces entit s ont t pr alablement inform es d une telle ventualit LA DOCUMENTATION EST FOURNIE EN L ETAT ET TOUTES AUTRES CONDITIONS DECLARATIONS ET GARANTIES EXPRESSES OU TACITES SONT FORMELLEMENT EXCLUES DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE A L APTITUDE A UNE UTILISATION PARTICULIERE OU A L ABSENCE DE CONTREFACON Contents Preface xiii Identifying Server Components 1 Infrastructure Boards in SPARC Enterprise T5140 Servers 2 Infrastructure Boards in SPARC Enterprise T5240 Servers 3 Internal System Cables for SPARC Enterprise T5140 Servers 4 Internal System Cables for SPARC Enterprise T5240 Servers 5 Front Panel Controls and Indicators on SPARC Enterprise T5140 Servers 5 Rear Panel Components and Indicators on SPARC Enterprise T5140 Servers 8 Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers 9 Rear Panel Components and Indicators on SPARC Enterprise T5240 Servers 12 Status LEDs for Ethernet Ports and the Network Management Port 14 Detecting and Managing Faults 15 Diagnostic Tools Overview 15 Service Processor Interfaces 16 Diagnostics Tools Quick Reference 17 LED Overview 21 Detecting Faults With ILOM 22 ILOM Troubleshooting Overview 23 Methods for Connecting to the Service Processor 24 How to Switch From the System Console to the Service Pro
126. ing the show faulty Command on page 83 Identify Faulty FB DIMMs Using the FB DIMM Fault Locator Button on page 83 Servicing the SCC Module on page 116 Servicing the Battery on page 114 Identifying FRUs in SPARC Enterprise T5140 Servers Back panel PCI cross beam must be removed to access risers Remove this component to service PCle XAUI risers and cards Must be installed in blank PCI slots See configuration rules before upgrading FB DIMMs Contains host ID MAC addresses and service processor configuration data Necessary for system clock and other functions SYS MB RISERO SYS MB RISER1 SYS MB RISER2 N A N A See FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 SYS MB SC SCC_NV RAM SYS MB BAT 185 I O Components in SPARC Enterprise T5140 Servers FIGURE I O Components SPARC Enterprise T5140 Servers 186 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table identifies the I O components in the server and points to instructions for servicing them TABLE I O Components SPARC Enterprise T5140 Servers Item FRU Replacement Instructions Notes FRU Name If Applicable 1 Top cover Remove the Top Cover Removing top cover if N A on page 67 the system is running Install the Top Cover will result in immediate on page 177 shutdown 2 Left control panel light Ser
127. interlock 2 Motherboard to PDB cable 3 Hard drive data cables TABLE Data Cable Routing Details Four Disk Capable SPARC Enterprise T5140 Servers Item FRU Connections Routing notes 3 HDD data Lower cable in the figure From Routed between CMP Module 0 CMP0 and cable J4101 SAS0 on the motherboard to CMP Module 1 CMP1 then under the chassis J0301 P2 on the hard drive center wall and then under the fan power board backplane 3 HDD data Upper cable in the figure From Routed along CMP Module 1 CMP1 then cable J4102 SAS1 on the motherboard to under the chassis center wall and then under the J0302 P3 on the hard drive PDB board backplane 192 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 HDD Data Cable Routing for SAS RAID Controller Cards in Four Disk Capable SPARC Enterprise T5140 Servers There are two SAS controller card options for the SPARC Enterprise T5140 and T5240 servers both options support RAID The standard option uses the on board SAS controller card preinstalled on every server The second option is a StorageTek SAS RAID Internal Host Bus Adapter HBA PCIe card The internal cabling of your server will be different depending on the SAS controller card option you choose FIGURE Hard Drive Data Cable Routing for SAS RAID Controller Card in Four Disk Capable SPARC Enterprise T5140 Servers aL Figure Legend Routing the cable through the right channel on the mot
128. k Capable 130 Fan Module Status LEDs 131 Contents ix v Remove a Fan Module 131 v Installa Fan Module 133 Servicing Power Supplies 135 Power Supplies Overview 135 Power Supply Status LEDs 135 v Remove a Power Supply 137 v Installa Power Supply 140 Power Supply Configuration Reference 142 Servicing Boards and Components 143 Important Safety Instructions 143 Servicing DVD USB Modules 144 DVD USB Module Overview 145 v Remove the DVD USB Module 145 v Install the DVD USB Module 147 Servicing Fan Power Boards 148 Fan Power Board Overview 148 v Remove the Fan Power Board 149 v Install the Fan Power Board 150 Servicing the Hard Drive Cage 151 Hard Drive Cage Overview 151 v Remove the Hard Drive Cage 152 v Install the Hard Drive Cage 154 Servicing the Hard Drive Backplane 156 Hard Drive Backplane Overview 157 v Remove the Hard Drive Backplane 157 v Install the Hard Drive Backplane 159 Servicing Front Control Panel Light Pipe Assemblies 160 x SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Front Control Panel Light Pipe Assemblies Overview 161 v Remove the Front Control Panel Light Pipe Assemblies 161 v Install the Front Control Panel Light Pipe Assemblies 162 Servicing Power Distribution Boards 163 Power Distribution Board Overview 164 v Remove the Power Distribution Board 164 v Install the Power Distribution Board 167 Servicing Power Supply Backplanes SPARC Enterprise T5240 Servers 170 Power Su
129. k the FB DIMM in place If the FB DIMM does not easily seat into the connector verify that the orientation of the FB DIMM is as shown in FIGURE Installing FB DIMMs on page 87 Servicing Motherboard Components 87 9 Repeat Step 6 through Step 8 until all new FB DIMMs are installed 10 SPARC Enterprise T5140 servers Reconnect the hard drive cable a Route the hard drive data cable over the fan module and along the air duct b Plug the data cable into J6401 on the motherboard 11 Install the top cover See Install the Top Cover on page 177 12 Slide the server into the rack See Return the Server to the Normal Rack Position on page 180 13 Connect the power cords See Connect Power Cords to the Server on page 181 Note As soon as the power cords are connected standby power is applied Depending on how the firmware is configured the system might boot at this time Related Information m Remove FB DIMMs on page 84 m Verify Successful Replacement of Faulty FB DIMMs on page 88 V Verify Successful Replacement of Faulty FB DIMMs 1 Access the ILOM gt prompt Refer to the Integrated Lights Out Manager 3 0 ILOM 3 0 Supplement for SPARC Enterprise T5140 and T5240 Servers for instructions 2 Use the show faulty command to determine how to clear the fault a If show faulty indicates a POST detected the fault go to Step 3 a If show faulty indicates a host detected fault output
130. lt conditions individual component fault LEDs are lit in addition to the system Service Required LED Power OK Provides the following indications LED e Off System is not running in its normal state System power might be off green The service processor might be running e Steady on System is powered on and is running in its normal operating state No service actions are required e Fast blink System is running in standby mode and can be quickly returned to full function e Slow blink A normal but transitory activity is taking place Slow blinking might indicate that system diagnostics are running or the system is booting Power button The recessed Power button toggles the system on or off e Press once to turn the system on e Press once to shut the system down in a normal manner e Press and hold for 4 seconds to perform an emergency shutdown Power Supply REAR Provides the following operational PSU indications Fault LED PS e Off Indicates a steady state no service action is required amber e Steady on Indicates that a power supply failure event has been acknowledged and a service action is required on at least one PSU Overtemp LED Provides the following operational temperature indications amber e Off Indicates a steady state no service action is required e Steady on Indicates that a temperature failure event has been acknowledged and a service action is required Fan Fault LED TOP Prov
131. ly backplane even you must disconnect the power cords before servicing the power supply backplane V Remove the Power Supply Backplane Note the chassis serial number and server part number They are printed on a label located on the side of the chassis 1 Remove the motherboard assembly See Remove the Motherboard Assembly on page 123 2 Remove the power supplies a Grasp the power supply handle and press the release latch b Slide the power supply out of the system See the following figure Servicing Boards and Components 171 FIGURE Removing a Power Supply From a SPARC Enterprise T5240 Server 3 Remove the power distribution board See Remove the Power Distribution Board on page 164 4 Remove the No 2 Phillips screw securing the power supply backplane to the power supply bay 5 Lift the power supply backplane up and off its standoffs and out of the system FIGURE Removing a Power Supply Backplane From a SPARC Enterprise T5240 Server 6 Place the power supply backplane on an antistatic mat 172 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Related Information m Install the Power Supply Backplane on page 173 V Install the Power Supply Backplane 1 Mount the power supply backplane to the front of the power supply bay Place the backplane over its standoffs Press down toward the floor of the chassis FIGURE Installing a Power Supply Backplane Illustrating
132. marques d pos es de Fujitsu Limited Toutes les marques SPARC sont utilis es sous licence et sont des marques de fabrique ou des marques d pos es de SPARC International Inc aux Etats Unis et dans d autres pays Les produits portant les marques SPARC sont bas s sur une architecture d velopp e par Sun Microsystems Inc SPARC64 est une marques d pos e de SPARC International Inc utilis e sous le permis par Fujitsu Microelectronics Inc et Fujitsu Limited SSH est une marque d pos e registre de SSH Communications Security aux Etats Uniset dans certaines autres juridictions L interface d utilisation graphique OPEN LOOK et Sun a t eusen Nae par Sun Microsystems Inc pour ses utilisateurs et licenci s Sun reconna t les efforts de pionniers de Xerox pour la recherche et le d veloppement du concept des interfaces d utilisation visuelle ou graphique pour l industrie de l informatique Sun d tient une license non exclusive de Xerox sur l interface d utilisation graphique Xerox cette licence couvrant galement les licenci s de Sun qui mettent en place l interface d utilisation graphique OPEN LOOK et qui en outre se conforment aux licences crites de Sun Droits du gouvernement am ricain logiciel commercial Les utilisateurs du gouvernement am ricain sont soumis aux contrats de licence standard de Sun Microsystems Inc et de Fujitsu Limited ainsi qu aux clauses applicables stipul es dans le FAR et ses suppl ments A
133. mated attempt to disable this CPU 3 Follow the suggested actions to repair the fault Y Clear PSH Detected Faults When the Solaris PSH facility detects faults the faults are logged and displayed on the console In most cases after the fault is repaired the corrected state is detected by the system and the fault condition is repaired automatically However this repair should be verified In cases where the fault condition is not automatically cleared the fault must be cleared manually 1 After replacing a faulty FRU power on the server 2 At the ILOM prompt use the show faulty command to identify PSH detected faults PSH detected faults are distinguished from other kinds of faults by the presence of a sunw msg id and uuid property gt show faulty Target Property Value As Oe ene ee fe eee ee A eee ee oe eee eee eee ee eee eee SP faultmgmt 0 fru SYS MB CMP0 BRO CH1 D0 SP faultmgmt 0 timestamp Dec 14 22 43 59 SP faultmgmt 0 sunw msg id SUN4vV 8000 Dx faults 0 SP faultmgmt 0 uuid 3aa7c854 9667 e176 efe5 e487e520 faults 0 7a8a SP faultmgmt 0 timestamp Dec 14 22 43 59 faults 0 The next step depends on whether or not a fault was reported m If show faulty does not report a fault stop Do not go on to the next step m Ifa fault is reported perform Step 3 and Step 4 Detecting and Managing Faults 47 3 Use the clear_fault_action property of the FRU to clear the fault f
134. mity to the server s serial port You can also configure ILOM to send email alerts of hardware failures hardware warnings and other events related to the server or to ILOM The service processor runs independently of the server using the server s standby power Therefore ILOM firmware and software continue to function when the server OS goes offline or when the server is powered off Faults detected by ILOM POST and the Solaris Predictive Self Healing PSH technology are forwarded to ILOM for fault handling FIGURE Fault Reporting Through the ILOM Fault Manager Environmentals L POST m gt FRU fault LEDs ILOM System fault LED fault manager User alerts Solaris PSH showfaults In the event of a system fault I LOM ensures that the Service Required LED is turned on FRUID PROMs are updated the fault is logged and alerts are displayed Faulty FRUs are identified in fault messages using the FRU name The service processor can detect when a fault is no longer present When this happens it clears the fault state in the FRU PROM and extinguishes the Service Required LED A fault condition can be removed in two ways m Unaided recovery Faults caused by environmental conditions can clear automatically if the condition responsible for the fault improves over time m Repaired fault When a fault is repaired by human intervention such as a FRU replacement the service pro
135. move the Fan Power Board If you are removing the fan power boards to access the paddle card or hard drive cage you must remove the server from the rack See Remove the Server From the Rack on page 64 1 Power off the server See Removing Power From the System on page 60 2 Disconnect the power cables 3 Extend the server into the maintenance position See Extend the Server to the Maintenance Position on page 63 Note If you are removing the fan power boards to service the paddle card or hard drive cage you must remove the server from the rack See the topic Remove the Server From the Rack on page 64 4 Attach an antistatic wrist strap 5 Remove the top cover See Remove the Top Cover on page 67 6 Remove the fan modules Note If you are replacing a defective fan power board remove only the fan modules needed to access the fan power board See Remove a Fan Module on page 131 7 Remove the Phillips screw that secures the fan power board to the chassis Servicing Boards and Components 149 FIGURE Removing the Fan Power Board Illustrates removal from a SPARC Enterprise T5140 server 8 Slide the fan power board to the left to disengage it from the paddle card 9 Remove the fan power board from the system and place it on an antistatic mat Related Information a Install the Fan Power Board on page 150 V Install the Fan Power Board 1 Lower th
136. n on page 182 Related Information Remove the Motherboard Assembly on page 123 Servicing Motherboard Components 127 128 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Servicing Fan Modules These topics explain how to service faulty fan modules m Fan Module Overview on page 129 m Remove a Fan Module on page 131 a Install a Fan Module on page 133 Related Information m Preparing to Service the System on page 57 Fan Module Overview The fan modules are mounted across the width of the chassis between the hard drive cage and the CPU modules They are accessed by lifting the top cover door The default number of fan modules installed in the server is different for the two server models m SPARC Enterprise T5140 Servers contain at least six fan modules m SPARC Enterprise T5240 Servers contain at least five fan modules Each fan module contains two fans mounted in an integrated hot swappable CRU If a fan module fails replace it as soon as possible to maintain server availability Caution Hazardous moving parts Unless the power to the server is completely shut down the only service permitted in the fan compartment is the replacement of the fan modules by trained personnel 129 Fan Module Configurations for SPARC Enterprise T5140 Servers 4 and 8 Disk Capable The following table shows the FRU device names for the fan modules in the four hard driv
137. n power board 4 HDD data Upper cable in the figure From Routed along CMP Module 1 CMP1 then cable J4102 SAS1 on the motherboard to under the chassis center wall and then under the J0302 on the hard drive backplane fan power boards Identifying FRUs in SPARC Enterprise T5240 Servers 205 FIGURE Internal Cables for Onboard SAS Controller Cards Sixteen Disk Capable SPARC Enterprise T5240 Servers rT Im I Se E S B iB l Ji Prem Figure Legend 1 Top cover safety interlock 2 PDB to power supply backplane cable 3 Motherboard to PDB cable 4 Hard drive data cable TABLE Data Cable Routing Details Eight Disk Capable SPARC Enterprise T5240 Servers Item FRU Connections Routing notes 4 HDD data From J4101 SAS0 on the motherboard Routed between CMP Module 0 CMP0 and cable to J0301 on the hard drive backplane CMP Module 1 CMP1 then under the chassis center wall and then under the fan power board 206 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 HDD Data Cable Routing for SAS RAID Controller Cards in SPARC Enterprise T5240 Servers There are two SAS controller card options for the SPARC Enterprise T5140 and T5240 servers both options support RAID The standard option uses the on board SAS controller card preinstalled on every server The second option is a StorageTek SAS RAID Internal Host Bus Adapter HBA PCle card The internal cabli
138. ng of your server will be different depending on the SAS controller card option you choose FIGURE HDD Data Cable Routing for SAS RAID Controller Cards in Eight or Sixteen Disk Capable SPARC Enterprise T5240 Servers Figure Legend 1 2 3 4 Routing the first hard drive cable through the right notch on the motherboard handle Routing the second hard drive cable through the left notch on the motherboard handle Routing both hard drive cables between the two processors Routing both cables through the fan midwall to the hard drive backplane Identifying FRUs in SPARC Enterprise T5240 Servers 207 208 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Index A about 16 AC Present power supply LED 19 141 airflow blocked 20 antistatic wrist strap 58 ASR blacklist 50 asrkeys system components 51 B battery FRU name 185 197 locating 114 blacklist ASR 50 bootmode command 27 break command 26 Cc cable management arm 137 clearfault command 26 clearing POST detected faults 41 clearing PSH detected faults 47 command fmdump 45 removefru 27 setdate 116 setlocator 28 63 setscn 189 show faulty 22 showfaults 28 showfru 28 component_state ILOM component property 42 components disabled automatically by POST 50 displaying state of 50 displaying using showcomponent command 51 console command 26 39 94 consolehistory command 26 D DC server models 138
139. nnel 0 SYS MB CMP0 MRO BRO CH0 D2 J0201 4 i SYS MB CMP0 MR0 BR0 CH0 D3 J0301 4 Channel 1 SYS MB CMP0 MR0 BR0 CH1 D2 J0401 4 SYS MB CMP0 MR0 BR0 CH1 D3 J0501 4 CMP 0 Branch Channel 0 SYS MB CMP0 MRO BR1 CH0 D2 J0601 4 SYS MB CMP0 MRO BR1 CH0 D3 JO701 4 Channel 1 SYS MB CMP0 MRO BR1 CH1 D2 J0801 4 SYS MB CMP0 MR0 BR1 CH1 D3 J0901 4 CMP 1 Branch Channel 0 SYS MB CMP1 MR1 BR0 CH0 D2 J0201 5 k SYS MB CMP1 MR1 BR0 CH0 D3 J0301 5 Channel 1 SYS MB CMP1 MR1 BR0 CH1 D2 J0401 5 SYS MB CMP1 MR1 BR0 CH1 D3 J0501 5 CMP 1 Branch Channel 0 SYS MB CMP1 MR1 BR1 CH0 D2 J0601 5 k SYS MB CMP1 MR1 BR1 CH0 D3 J0701 5 Channel 1 SYS MB CMP1 MR1 BR1 CH1 D2 J0801 5 SYS MB CMP1 MR1 BR1 CH1 D3 J0901 5 Upgrade path DIMMs should be added with each group populated in the order shown Related Information m FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 m Identify Faulty FB DIMMs Using the show faulty Command on page 83 102 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Remove FB DIMMs on page 84 Install Replacement FB DIMMs on page 86 Verify Successful Replacement of Faulty FB DIMMs on page 88 Upgrade Memory Configuration With Additional FB DIMMs on page 91 Servicing the Air Duct These topics explain how to remove and replace the air duct Remove the Air Duct on page 103 Install the Air Duct on page 104 Remo
140. nt on page 37 POST Output Quick Reference on page 42 34 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 POST Overview Power on self test POST is a group of PROM based tests that run when the server is powered on or when it is reset POST checks the basic integrity of the critical hardware components in the server CMP memory and I O subsystem If POST detects a faulty component the component is disabled automatically If the system is able to run without the disabled component it will boot when POST completes its tests For example if POST detects a faulty processor core the core will be disabled and once POST completes its test sequence the system will boot and run using the remaining cores You can control various aspects of how POST performs its operations For example you can specify the events that cause POST to run the level of testing POST performs and the amount of diagnostic information POST displays You use the ILOM set command to control the state of the applicable ILOM properties These properties are listed and described in ILOM Properties that Affect POST Behavior on page 35 Related Information m Managing POST Operations on page 35 Managing POST Operations These topics explain how to control the way POST performs its operations m ILOM Properties that Affect POST Behavior on page 35 m Examples of POST Management on page 37 Related Information m I
141. nterprise T5140 and T5240 Servers Service Manual July 2009 Related Information m Remove the Hard Drive Backplane on page 157 DVD USB Module Overview The DVD ROM drive and front USB board are mounted in a removable module that is accessed from the system s front panel The DVD USB module must be removed from the hard drive cage in order to service the hard drive backplane FIGURE DVD USB Module in a SPARC Enterprise T5140 Server SPARC Enterprise 15140 Emo Pe one ei Rn Wawa Wau The Hard Drive backplane supports either a SATA DVD or a PATA DVD depending on when it was manufactured Servers that contain a SATA compatible backplane have a SATA label on the front bezel Servers with the older PATA compatible backplanes do not have any DVD label on the bezel Note SATA compatible backplanes have special keying that prevents full insertion of a PATA DVD When installing a PATA type DVD do not force the module if it resists full insertion It may be that the backplane is not PATA compatible Related Information m Remove the DVD USB Module on page 145 m Install the DVD USB Module on page 147 m Remove the Hard Drive Backplane on page 157 V Remove the DVD USB Module 1 Power off the server See Removing Power From the System on page 60 Servicing Boards and Components 145 2 Unplug the power cords 3 Attach an antistatic wrist strap 4 Remove the hard d
142. nterprise T5240 Servers on page 196 Memory Mezzanine Components in SPARC Enterprise T5240 Servers on page 198 I O Components in SPARC Enterprise T5240 Servers on page 200 Power Distribution Fan Module Components in SPARC Enterprise T5240 Servers on page 202 Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5240 Servers on page 204 HDD Data Cable Routing for SAS RAID Controller Cards in SPARC Enterprise T5240 Servers on page 207 Related Information Identifying FRUs in SPARC Enterprise T5140 Servers on page 183 195 Motherboard Components in SPARC Enterprise T5240 Servers FIGURE Motherboard Components in SPARC Enterprise T5240 Servers 196 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table identifies the components located on the motherboard and points to instructions for servicing them TABLE Motherboard Components SPARC Enterprise T5240 Servers Item FRU Replacement Instructions Notes FRU Name If Applicable 1 PCle XAUI risers Servicing PCle XAUI Back panel PCI cross SYS MB RISERO Risers on page 104 beam must be removed SYS MB RISER1 to access risers SYS MB RISER2 2 PCIe filler panel Servicing PCle XAUI Must be installed in N A Risers on page 104 blank PCI slots 3 Removable back panel Servicing PCle XAUI Remove this to service N A cross beam Risers on page 104 PCle XAUI risers and cards 4 FB DI
143. omponents disabled by 50 fault clearing 41 faults detected by 19 faulty components detected by 41 troubleshooting with 20 using for fault diagnosis 19 Predictive Self Healing PSH clearing faults 47 faults detected by 19 memory faults 82 PSH see Predictive Self Healing PSH PSU OK LED 141 R rear panel PCI cross beam removing 105 removefru command 27 removing rear panel PCI cross beam 105 SCC module 117 top cover 68 reset command 27 reset system using ILOM 39 using POST commands 39 resetsc command 27 S SCC module FRU name 185 197 installing 117 removing 117 service processor prompt 61 Service Required system LED 22 cleared by enablecomponent command 42 interpreting to diagnose faults 21 22 triggered by ILOM 23 triggered by power supply fault 136 set command and component_state property 42 setdate command 116 setkeyswitch parameter 27 93 setlocator command 28 63 setscn command 189 show faulty command 28 and Service Required LED 22 using to check for faults 19 showcomponent command 51 showenvironment command 28 showfaults command syntax 28 showfru command 28 showkeyswitch command 28 showlocator command 28 showlogs command 28 showplatform command 28 shutdown using powercycle command graceful shutdown 27 using powercycle f command emergency shutdown 27 using poweroff command 27 slide rail latch 63 Solaris log files 19 Solaris OS checking log files for
144. on Diagnostic Flowchart Reference Table Possible Outcome Additional Information Check Power OK and AC Present LEDs on the server Flowchart item 1 Run the ILOM show faulty command to check for faults Flowchart item 2 Check the Solaris log files for fault information Flowchart item 3 Run SunVTS software Flowchart item 4 Run POST Flowchart item 5 The Power OK LED is located on the front and rear of the chassis The AC Present LED is located on the rear of the server on each power supply If these LEDs are not on check the power source and power connections to the server The show faulty command displays the following kinds of faults e Environmental faults e Solaris Predictive Self Healing PSH detected faults e POST detected faults Faulty FRUs are identified in fault messages using the FRU name The Solaris message buffer and log files record system events and provide information about faults e If system messages indicate a faulty device replace the FRU e For more diagnostic information review the SunVTS report Flowchart item 4 SunVTS is an application you can run to exercise and diagnose FRUs To run SunVTS the server must be running the Solaris OS e If SunVTS reports a faulty device replace the FRU e If SunVTS does not report a faulty device run POST Flowchart item 5 POST performs basic tests of the server components and reports faulty FRUs e
145. on With the show Command on page 32 V Clear FRU Faults Manually Use the clear_fault_action property of a FRU to manually clear faults recorded in a FRU PROM There are two conditions where this step may be needed m To clear a fault diagnosed by the predictive self healing feature without replacing the faulty FRU m To clear a fault that the service processor was unable to clear following a FRU replacement Note This procedure clears the fault from the service processor but not from the host If the fault persists in the host it must be manually cleared At the gt prompt enter the clear_fault_action property gt set SYS MB CMP0 BRO CHO DO clear_fault_action True Are you sure you want to clear SYS MB CMP0 BRO CHO0O DO y n y Set clear_fault_action to true Related Info m Clear PSH Detected Faults on page 47 Detecting and Managing Faults 31 Vv Display FRU Information With the show Command At the gt prompt enter the show command The following example illustrates show command output for a memory module FB DIMM gt show SYS MB CMP0 BRO CHO DO SYS MB CMP0 BRO CHO DO Targets RO R1 SEEPROM SERVICE PRSNT T_AMB Properties type DIMM component_state Enabled fru_name 1024MB DDR2 SDRAM FB DIMM 333 PC2 5300 fru_description FBDIMM 1024 Mbyte fru_manufacturer Micron Technology fru_version FFFFFF fru_part_number 18HF12872FD667
146. on board storage controllers for the hard drives DVD and USB ports 112 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 PCIe and XAUI Card Reference for SPARC Enterprise T5240 Servers The following table shows the physical PCle XAUI slot locations on the SPARC Enterprise T5240 server as viewed from the rear of the system TABLE FB DIMM Configuration Installation Map SPARC Enterprise T5240 Servers PCIe 3 PCIe 4 PCIe 5 PCIe 0 XAUI 0 PCIe 1 XAUI 1 PCIe 2 TABLE PCIe and XAUI Support SPARC Enterprise T5240 Servers Slot PCle Controller Supported Device Types FRU Name PCleQor 1 x8 PCle operating at x8 SYS MB RISERO PCIEO XAUI 0 XAUI expansion card SYS MB RISERO XAUIO PCle lor 0 x8 PCIe operating at x8 SYS MB RISER1 PCIE1 XAUI 1t XAUI expansion card SYS MB RISER1 XAUI1 PCle 2 0 x16 PCle operating at x8 SYS MB RISER2 PCIE2 PCle 3 0 x8 PCle operating at x8 SYS MB RISERO PCIE3 PCle 4 1 x8 PCle operating at x8 SYS MB RISER1 PCIE4 PCIe 5 1 x8 PCle operating at x8 SYS MB RISER2 PCIES Slots 0 and 1 are shared PCle XAUI slots You can only install one or the other type of card Slots 0 and 1 are shared PCle XAUI slots You can only install one or the other type of card PCIe controller 1 also supports the on board Ethernet controller for the NETO NET1 NET2 and NET3 ports PCIe controller 0 also supports the on board storage controllers for the hard drives DVD and USB ports
147. on the server m LEDs Status indicators are provided on the server s front and rear panels as well as on some FRUs m ILOM The Integrated Lights Out Manager ILOM firmware runs on the service processor and is the central software resource for identifying and managing problems in the server Power on self test POST POST performs diagnostics on system components whenever the system is turned on or a system reset is issued m Solaris OS Predictive Self Healing PSH PSH continuously monitors the health of the processor and memory collecting data that can be used to predict component failures before they occur PSH works with ILOM to take a component offline if data indicate there is a high risk it will fail m Solaris OS log files and command interface The Solaris OS reports operational and error information to its standard log files It also provides various commands for investigating system status m SunVTS This is an application that exercises the system provides hardware validation and discloses possible faulty components with recommendations for repair The LEDs ILOM PSH and many of the log files and console messages are integrated For example when the Solaris software detects a fault it displays the fault logs it and passes information to ILOM where it is logged Depending on the fault one or more LEDs might also be illuminated Service Processor Interfaces There are three methods of interacting with
148. onents and Indicators on SPARC Enterprise T5240 Servers on page 12 If necessary note where the PCIe XAUI cards are installed Unplug all data cables from the card Note the location of all cables for reinstallation later Remove the riser board See Remove a PCle XAUI Riser on page 105 Carefully remove the PCle XAUI card from the riser board connector Place the PCIe XAUI card on an antistatic mat If you are not replacing the PCIe XAUI card install a PCle XAUI filler panel m SPARC Enterprise T5140 PCIe filler panels are located in the removable PCI cross beam Press the filler panel into the cross beam from the rear m SPARC Enterprise T5240 PCIe filler panels are located on the riser board assembly Press the filler panel into the riser board back panel from the rear Caution To ensure proper system cooling and EMI shielding you must use the appropriate PCle filler panel for the server Related Information Install a PCIe or XAUI Card on page 109 Remove a PCle XAUI Riser on page 105 Install a PCle XAUI Riser on page 107 V Install a PCIe or XAUI Card 1 2 Unpackage the replacement PCIe or XAUI card and place it on an antistatic mat Locate the proper PCIe XAUI slot for the card you are replacing Servicing Motherboard Components 109 3 If necessary review the PCIe and XAUI card guidelines to plan your installation See PCIe and XAUI Card Reference for
149. onents located on these boards Do not touch the components along their connector edges Caution You must disconnect both power supplies before servicing any of the components documented in this chapter Antistatic Wrist Strap Use Wear an antistatic wrist strap and use an antistatic mat when handling components such as hard drive assemblies circuit boards or PCI cards When servicing or removing server components attach an antistatic strap to your wrist and then to a metal area on the chassis Following this practice equalizes the electrical potentials between you and the server Note An antistatic wrist strap is no longer included in the accessory kit for the SPARC Enterprise T5140 and T5240 servers However antistatic wrist straps are still included with options SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Antistatic Mat Place ESD sensitive components such as motherboards memory and other PCBs on an antistatic mat Essential Tools The following tools should be available for most service operations Antistatic wrist strap Antistatic mat No 1 Phillips screwdriver No 2 Phillips screwdriver No 1 flat blade screwdriver battery removal Pen or pencil to power on server V Find the Chassis Serial Number If you require technical support for your system you will be asked to provide the server s chassis serial number You can find the chassis serial number on a st
150. ons Notes FRU Name If Applicable 1 Top cover Remove the Top Cover Removing top coverif N A on page 67 the system is running Install the Top Cover will result in immediate on page 177 shutdown 2 Hard drive backplane Servicing the Hard SYS SASBP Drive Backplane on page 156 3 Hard drive cage Servicing the Hard Must be removed to N A Drive Cage on page 151 service hard drive backplane and front control panel light pipes 4 Left control panel light Servicing Front Control Metal light pipe bracket N A pipe assembly Panel Light Pipe is not a FRU Assemblies on page 160 5 Hard drives Remove a Hard Drive Hard drives must be See Eight Drive on page 71 removed to service the Capable Backplane Install a Hard Drive hard drive backplane Configuration on page 73 Reference on page 78 or Sixteen Drive Capable Backplane Configuration Reference on page 79 6 DVD USB module Servicing DVD USB Must be removed to SYS DVD Modules on page 144 service the hard drive SYS USBBD backplane 7 Right control panel light Servicing Front Control Metal light pipe bracket N A pipe assembly Panel Light Pipe Assemblies on page 160 is not a FRU Identifying FRUs in SPARC Enterprise T5240 Servers 201 Power Distribution Fan Module Components in SPARC Enterprise T5240 Servers FIGURE Power Distribution Fan Module Components SPARC Enterprise T5240 Servers 202 SPARC Enterprise T5140 an
151. ow all cautions and instructions marked on the equipment and described in the documentation shipped with your system Follow all cautions and instructions marked on the equipment and described in the SPARC Enterprise T5140 and T5240 Servers Safety and Compliance Guide m Ensure that the voltage and frequency of your power source match the voltage and frequency inscribed on the equipment s electrical rating label m Follow the electrostatic discharge safety practices as described in this section Safety Symbols You will see the following symbols in various places in the server documentation Note the explanations provided next to each symbol 57 Caution There is a risk of personal injury or equipment damage To avoid personal injury and equipment damage follow the instructions Caution Hot surface Avoid contact Surfaces are hot and might cause personal injury if touched Caution Hazardous voltages are present To reduce the risk of electric shock and danger to personal health follow the instructions Electrostatic Discharge Safety Measures Electrostatic discharge ESD sensitive devices such as the motherboards PCI cards hard drives and memory cards require special handling Caution Circuit boards and hard drives contain electronic components that are extremely sensitive to static electricity Ordinary amounts of static electricity from clothing or the work environment can destroy the comp
152. ower OK Provides the following indications LED e Off System is not running in its normal state System power might be off green The service processor might be running e Steady on System is powered on and is running in its normal operating state No service actions are required e Fast blink System is running in standby mode and can be quickly returned to full function e Slow blink A normal but transitory activity is taking place Slow blinking might indicate that system diagnostics are running or the system is booting Power button The recessed Power button toggles the system on or off e Press once to turn the system on e Press once to shut the system down in a normal manner e Press and hold for 4 seconds to perform an emergency shutdown Power Supply REAR Provides the following operational PSU indications Fault LED PS e Off Indicates a steady state no service action is required amber e Steady on Indicates that a power supply failure event has been acknowledged and a service action is required on at least one PSU Overtemp LED Provides the following operational temperature indications amber e Off Indicates a steady state no service action is required e Steady on Indicates that a temperature failure event has been acknowledged and a service action is required Fan Fault LED TOP Provides the following operational fan indications amber FAN e Off Indicates a steady state no servic
153. ower to the power supply backplane even when the server is powered off To avoid personal injury or damage to the server you must disconnect power cords before servicing the power supply backplane For server models with DC input power do not disconnect the power cable at the Wago connector on the server DC power supply unit Instead turn off the power at the circuit breaker on the power source XX SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Caution This indicates that surfaces are hot and might cause personal injury if touched Avoid contact Task Warning Maintenance Extremely hot Some components on the motherboard might be hot Use caution when handling the motherboard especially near the CPU heat sink FB DIMMs and heat sinks on the motherboard may be hot If you touch the heat sink when removing the bus bar screw you might get burned Preface xxi A Product Handling Maintenance Warning Certain tasks in this manual should only be performed by a certified service engineer User must not perform these tasks Incorrect operation of these tasks may cause electric shock injury or fire a Installation and reinstallation of all components and initial settings m Removal of front rear or side covers Mounting de mounting of optional internal devices m Plugging or unplugging of external interface cards m Maintenance and inspections repairing and regular di
154. ponents on page 51 a Enable System Components on page 53 V Enable System Components You enable a component by setting its component_state property to Enabled This removes the component from the ASR blacklist 1 At the gt prompt set the component_state property to Enabled gt set SYS MB CMP0 BR1 CH0 DO component_state Enabled 2 Reset the server so that the ASR command takes effect gt stop SYS Are you sure you want to stop SYS y n y Stopping SYS gt start SYS Are you sure you want to start SYS y n y Starting SYS Note In the ILOM shell there is no notification when the system is actually powered off Powering off takes about a minute Use the show HOST command to determine if the host has powered off Related Information a View the System Message Log Files on page 49 m Display System Components on page 51 m Disable System Components on page 52 52 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Detecting Faults Using SunVTS Software This topic explains in general terms how to use SunVTS software to exercise system components For detailed instructions on using SunVTS software see the latest version of the SunVTS Software User s Guide and any associated Release Notes m Run the SunVTS Software on page 54 Run the SunVTS Software The following procedure description is based on use of the SunVTS software s browser
155. pply Backplane Overview 171 v Remove the Power Supply Backplane 171 v Install the Power Supply Backplane 173 Servicing Paddle Cards 174 Paddle Card Overview 175 v Remove the Paddle Card 175 v Install the Paddle Card 176 Returning the Server to Operation 177 v Install the Top Cover 177 Reinstall the Server in the Rack 178 Return the Server to the Normal Rack Position 180 Connect Power Cords to the Server 181 Power On the Server Using the poweron Command 181 lt a lt lt Power On the Server Using the Front Panel Power Button 182 Identifying FRUs in SPARC Enterprise T5140 Servers 183 Motherboard Components in SPARC Enterprise T5140 Servers 184 I O Components in SPARC Enterprise T5140 Servers 186 Power Distribution Fan Module Components in SPARC Enterprise T5140 Servers 188 Contents xi xii Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5140 Servers 190 HDD Data Cable Routing for SAS RAID Controller Cards in Four Disk Capable SPARC Enterprise T5140 Servers 193 HDD Data Cable Routing for SAS RAID Controller Cards in Eight Disk Capable SPARC Enterprise T5140 Servers 194 Identifying FRUs in SPARC Enterprise T5240 Servers 195 Motherboard Components in SPARC Enterprise T5240 Servers 196 Memory Mezzanine Components in SPARC Enterprise T5240 Servers 198 I O Components in SPARC Enterprise T5240 Servers 200 Power Distribution Fan Module Components in SPARC Enterprise T5240 Servers 202 Internal Cables fo
156. produit ou la technologie auxquels ilse rapporte Par ailleurs il ne contient ni ne repr sente aucun engagement de quelque type que ce soit de la part de Fujitsu Limited ou de Sun Microsystems Inc ou des soci t s affili es Ce document et le pr duit et les technologies qu il d crit peuvent inclure des droits de propri t intellectuelle de parties tierces prot g s par copyright et ou c d s sous licence par des fournisseurs Fujitsu Limited et ou Sun Microsystems Inc y compris des logiciels et des technologies relatives aux polices de caract res Par limites du GPL ou du LGPL une copie du code source r gi par le GPL ou LGPL comme applicable est sur demande vers la fin utilsateur disponible veuillez contacter Fujitsu Limted ou Sun Microsystems Inc Cette distribution peut comprendre des composants d velopp s par des tierces parties Des parties de ce produit pourront tre d riv es des syst mes Berkeley BSD licenci s par l Universit de Californie UNIX est une marque d pos e aux Etats Unis et dans d autres pays et licenci e exclusivement par X Open Company Ltd Sun Su pee baat le Jobo Sun Java Netra Solaris Sun StorageTek docs sun com OpenBoot SunVTS Sun Fire SunSolve CoolThreads et J2EE sont des marques de fabrique ou des marques d pos es de Sun Microsystems Inc ou ses filiales aux Etats Unis et dans d autres pays Fujitsu et le logo Fujitsu sont des
157. push the plug slightly into the connector then press the latching mechanism b Keeping the latching mechanism pressed pull the plug from the connector on the hard drive backplane Caution The hard drive data cables are delicate Ensure they are safely out of the way when servicing the motherboard 12 If you are replacing the motherboard remove the following components m All FB DIMMs Note memory configuration so that you can install the FB DIMMs in the replacement motherboard a SCC PROM 13 Using a No 2 Phillips screwdriver remove the four screws that secure the motherboard assembly to the bus bar Caution If you touch the heat sink when removing the bus bar screw you might get burned Note Set the four screws aside You must use these screws to attach the motherboard to the bus bar during installation 14 Loosen the captive screw securing the motherboard to the chassis The captive screw is green and is located to the left of the bus bar screws 15 Using the green handle slide the motherboard toward the back of the system and lift it out of the chassis Caution Some components on the motherboard might be hot Use caution when handling the motherboard especially near the CMP heat sinks SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Removing the Motherboard Assembly SPARC Enterprise T5140 Server Shown 16 Place the motherboard assembly on an an
158. r Onboard SAS Controller Cards in SPARC Enterprise T5240 Servers 204 HDD Data Cable Routing for SAS RAID Controller Cards in SPARC Enterprise T5240 Servers 207 Index 209 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Preface This manual provides detailed procedures that describe the removal and replacement of replaceable parts in the SPARC Enterprise T5140 and T5240 Servers This manual also includes information about the use and maintenance of the servers This document is written for technicians system administrators authorized service providers ASPs and users who have advanced experience troubleshooting and replacing hardware For Safe Operation This manual contains important information regarding the use and handling of this product Read this manual thoroughly Pay special attention to the section Notes on Safety on page xix Use the product according to the instructions and information available in this manual Keep this manual handy for further reference Keep this manual handy for further reference Fujitsu makes every effort to prevent users and bystanders from being injured or from suffering damage to their property Use the product according to this manual Before You Read This Document To fully use the information in this document you must have thorough knowledge of the topics discussed in the SPARC Enterprise T5140 and T5240 Servers Product Notes xiii Structure and
159. r Using the poweron Command on page 181 Power On the Server Using the Front Panel Power Button on page 182 V Power On the Server Using the poweron Command Note If you are powering on the server following an emergency shutdown that was triggered by the top cover interlock switch you must use the poweron command Returning the Server to Operation 181 Type poweron at the service processor prompt gt poweron You will see an gt Alert message on the system console This message indicates that the system is reset You will also see a message indicating that the VCORE has been margined up to the value specified in the default scr file that was previously configured For example gt start SYS Related Information m Power On the Server Using the Front Panel Power Button on page 182 V Power On the Server Using the Front Panel Power Button Use a pointed object such as a pen or pencil to press the Power button on the front panel See Power On the Server Using the Front Panel Power Button on page 182 for more information on the Power button Related Information m Power On the Server Using the poweron Command on page 181 182 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Identifying FRUs in SPARC Enterprise 5140 Servers These topics identify and illustrate Field Replaceable Units FRUs contained in SPARC Enterprise T5140 servers
160. rd Components 91 4 Remove any filler panels from the FB DIMM slots if necessary Store the filler panels in a safe place You will reuse the filler panels if you remove FB DIMMs in the future 5 Ensure that the ejector tabs are in the open position 6 Line up the FB DIMM with the connector Align the FB DIMM notch with the key in the connector This alignment ensures that the FB DIMM is oriented correctly 7 Push the FB DIMM into the connector until the ejector tabs lock the FB DIMM in place FIGURE Installing FB DIMMs Note If the FB DIMM does not easily seat into the connector it may not have the correct orientation If the orientation is reversed damage to the FB DIMM might occur 8 Repeat Step 5 through Step 7 until all FB DIMMs are installed 9 Rotate the air duct back into its operating position The air duct snaps into position above the CMP and memory modules 10 SPARC Enterprise T5140 server Reconnect the hard drive data cable a Route the hard drive data cable over the fan module and along the air duct b Plug the data cable into J6401 on the motherboard 92 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 11 Install the top cover See Install the Top Cover on page 177 12 Slide the server into the rack See Return the Server to the Normal Rack Position on page 180 13 Connect the power supplies See Connect Power Cords to the Server on p
161. rives that are adjacent to the DVD USB module The HDD number will vary depending on the backplane type m 4 disk capable backplane remove HDD3 See Four Drive Capable Backplane Configuration Reference on page 77 m 8 disk capable backplane remove HDD7 See Eight Drive Capable Backplane Configuration Reference on page 78 a 16 disk capable backplane remove HDD13 See Sixteen Drive Capable Backplane Configuration Reference on page 79 5 Release the DVD USB module from the hard drive backplane Use the finger indentation in the hard drive bay below the DVD USB module to extend the release tab FIGURE Removing the DVD USB Module illustrates removal from a SPARC Enterprise T5140 server 146 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 6 Slide the DVD USB module out of the hard drive cage 7 Place the module on an antistatic mat Related Information a Install the DVD USB Module on page 147 m Servicing the Hard Drive Backplane on page 156 Install the DVD USB Module Caution Be certain the DVD type and Hard Drive backplane are compatible both are SATA or both are PATA types Special keying will resist installation of a PATA DVD into a SATA type DVD bay Do not force the module if you meet resistance or you may damage the backplane DVD USB Module or both 1 Slide the DVD USB module into the front of the chassis until it seats FIGURE Installing the DVD US
162. rom the service processor gt set SYS MB CMP0 BRO CHO DO clear_fault_action True Are you sure you want to clear SYS MB CMP0 BRO CHO DO y n y Set clear_fault_action to true 4 Clear the fault from all persistent fault records In some cases even though the fault is cleared some persistent fault information remains and results in erroneous fault messages at boot time To ensure that these messages are not displayed run the Solaris command fmadm repair specifying the UUID of the erroneous message fmadm repair 7ee0e46b ea64 6565 e684 e996963 7b86 Viewing Solaris OS Messages These topics explain how to display OS messages from the message buffer and log files maintained by Solaris OS m Check the Message Buffer on page 49 m View the System Message Log Files on page 49 V Check the Message Buffer 1 Log in as superuser 2 Type the dmesg command dmesg The dmesg command displays the most recent messages generated by the system Vv View the System Message Log Files The error logging daemon syslogd automatically records various system warnings errors and faults in message files These messages can alert you to system problems such as a device that is about to fail 48 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The var adm directory contains several message files The most recent messages are in the var adm messages fil
163. s 89 Note Depending on the configuration of ILOM POST variables and whether POST detected faults or not the system might boot or the system might remain at the ok prompt If the system is at the ok prompt type boot d Return the virtual keyswitch to Normal mode gt set SYS keyswitch_state Normal Set ketswitch_state to Normal e Switch to the system console and type the Solaris OS fmadm faulty command fmadm faulty No memory faults should be displayed If faults are reported refer to the diagnostics instructions described in ILOM Troubleshooting Overview on page 23 for guidance in troubleshooting the fault 5 Switch to the ILOM command shell 6 Run the show faulty command gt show faulty Target Property Value aot ah gs er nT APN aD Se en eS eee Pe ee re ae eee ae eee ae SP faultmgmt 0 fru SYS MB CMP0 BRO CH1 DO SP faultmgmt 0 timestamp Dec 14 22 43 59 SP faultmgmt 0 sunw msg id SUN4V 8000 Dx faults 0 SP faultmgmt 0 uuid 3aa7c854 9667 e176 efe5 e487e520 faults 0 7a8a SP faultmgmt 0 timestamp Dec 14 22 43 59 faults 0 If the show faulty command reports a fault with a UUID go on to Step 7 If show faulty does not report a fault with a UUID you are done with the verification process 90 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 gt 7 Switch to the system console and type the fma
164. s and error messages appear in the test messages area spread across the bottom of the window Note You can stop the test process at any time by clicking on the Stop button 7 To check for SunVTS messages click on the Logs tab You can view any of the following logs m Information Detailed versions of all the status and error messages that appear in the test messages area m Test Error Detailed error messages from individual tests m VTS Kernel vtsk Error Error messages pertaining to SunVTS software itself Look here if SunVTS software appears to be acting strangely especially when it starts up Solaris OS Messages var adm messages A file containing messages generated by the operating system and various applications m Test Messages var sunvts logs A directory containing the log files Detecting and Managing Faults 55 56 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Preparing to Service the System These topics describe how to prepare the SPARC Enterprise T5140 and T5240 servers for servicing m General Safety Information on page 57 m Essential Tools on page 59 m Removing Power From the System on page 60 m Positioning the System for Servicing on page 62 m Accessing Internal Components on page 67 General Safety Information For your protection observe the following safety precautions when setting up your equipment Foll
165. s or licenses express or implied with respect to the product or technology to which it pertains and this document does not contain or represent any commitment of any kind on the part of Fujitsu Limited or Sun Microsystems Inc or any affiliate of either of them This document and the product and technology described in this document may incorporate third party intellectual property copyrighted by and or licensed from suppliers to Fujitsu Limited and or Sun Microsystems Inc including software and font technology Per the terms of the GPL or LGPL a copy of the source code governed by the GPL or LGPL as applicable is available upon request by the End User Please contact Fujitsu Limited or Sun Microsystems Inc This distribution may include materials developed by third parties Parts of the produet may be derived from Berkeley BSD systems licensed from the University of California UNIX is a registered trademark in the U S and in other countries exclusively licensed through X Open Company Ltd Sun Sun Microsystems Ty the Sun logo Java Netra Solaris Sun StorageTek docs sun com M OpenBoot SunVTS Sun Fire SunSolve CoolThreads and J2EE are trademarks or registered trademarks of Sun Microsystems Inc or its subsidiaries in the U S and thi tri z y other countries Fujitsu and the Fujitsu logo are registered trademarks of Fujitsu Limited All SPARC trademarks are used under license and
166. se T5140 and T5240 Servers for more information about the poweroff command Related Information m Power Off the Server Power Button Graceful on page 62 m Power Off the Server Emergency Shutdown on page 62 Preparing to Service the System 61 oo V Power Off the Server Power Button Graceful Press and release the Power button If necessary use a pen or pencil to press the Power button Related Information m Power Off the Server Service Processor Command on page 60 m Power Off the Server Emergency Shutdown on page 62 Power Off the Server Emergency Shutdown Caution All applications and files will be closed abruptly without saving changes File system corruption might occur Press and hold the Power button for four seconds Related Information m Power Off the Server Service Processor Command on page 60 m Power Off the Server Power Button Graceful on page 62 Disconnect Power Cords From the Server Unplug all power cords from the server Caution Because 3 3v standby power is always present in the system you must unplug the power cords before accessing any cold serviceable components Positioning the System for Servicing These topics explain how to position the system so you can access the components that need servicing m Extend the Server to the Maintenance Position on page 63 m Remove the Server From the Rack on page 6
167. stem Firmware is at least version 7 1 7 f the FB DIMM capacities on different CPUs can be different When replacing a faulty FB DIMM the replacement FB DIMM must have the same FRU part number as the FB DIMM being replaced If you are not able to obtain a replacement FB DIMM with the same FRU part number may need to replace all the FB DIMMs in the branch to ensure that all FB DIMMs in that branch have the same FRU part number FIGURE FB DIMM Configuration for SPARC Enterprise T5140 Servers CMP1 CMPO BRanchO BRanch 1 BRanchO BRanch 1 CHannd 1 CHannd O CHanndO CHannd 1 CHannd 1 CHannd0O CHanndO CHanne 1 PT PT PT A ki ki T PT i HNE Jelle 8x I IN Ja 3 9 3 5 8 6 0 2 0 0 0 0 0 0 0 0 0 0 0 ijo motherboard 0 0 E 0 m xample Nomenclature SY S MB CMP1 BRO CH1 D0 3 J CORN coon H 9 coan re COUNT Ry HHHH H H HHHH HH The following figure shows the physical location for the FB DIMMs on the motherboard in a SPARC Enterprise T5140 server Servicing Motherboard Components 95 FIGURE Physical FB DIMM Locations in SPARC Enterprise T5140 Servers J1100 J1200 J1000 JO900 J0500 JO600 J0800 J0700 e
168. t FB DIMMs Before beginning this procedure ensure that you are familiar with the information provided in these topics m Preparing to Service the System on page 57 m FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers on page 94 Note If the server is already extended and open begin the procedure at Step 4 1 Extend the server to the maintenance position See Extend the Server to the Maintenance Position on page 63 86 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 2 Remove power from the server See Disconnect Power Cords From the Server on page 62 3 Remove the top cover See Remove the Top Cover on page 67 4 SPARC Enterprise T5140 servers Disconnect and stow the hard drive data cable a Unplug the hard drive data cable from J6401 on the motherboard b Remove the hard drive data cable from its seat on the CMP air duct c Place the hard drive cable end out of the way of the air duct 5 Unpackage the replacement FB DIMMs and place them on an antistatic mat 6 Ensure that the ejector tabs on the connector that will receive the FB DIMM are in the open position 7 Align the FB DIMM notch with the key in the connector Caution Ensure that the orientation is correct The FB DIMM might be damaged if the orientation is reversed FIGURE Installing FB DIMMs 8 Push the FB DIMM into the connector until the ejector tabs loc
169. the brackets lock into place The server is now in the extended maintenance position Related Information m Return the Server to the Normal Rack Position on page 180 m Connect Power Cords to the Server on page 181 Returning the Server to Operation 179 V Return the Server to the Normal Rack Position 1 Release the slide rails from the fully extended position by pushing the release tabs on the side of each rail FIGURE Release Tabs on the Rail 2 While pushing on the release tabs slowly push the server into the rack Ensure that the cables do not get in the way 3 Reconnect the cables to the back of the server If the CMA is in the way disconnect the left CMA release and swing the CMA open 4 Reconnect the CMA Swing the CMA closed and latch it to the left rack rail 180 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Related Information Reinstall the Server in the Rack on page 178 Connect Power Cords to the Server on page 181 Power On the Server Using the poweron Command on page 181 Power On the Server Using the Front Panel Power Button on page 182 V Connect Power Cords to the Server Reconnect both power cords to the power supplies Note As soon as the power cords are connected standby power is applied Depending on how the firmware is configured the system might boot at this time Related Information Power On the Serve
170. the default OpenBoot PROM Solaris drive pathnames with the physical drive locations in an eight drive capable backplane TABLE Physical Drive Locations FRU Names and Default Drive Pathnames for an Eight Drive Capable Backplane Physical Location FRU Name OpenBoot PROM Solaris Default Drive Pathname HDDO SYS HDDO c0 dsk c1t0d0 HDD1 SYS HDD1 c0 dsk c1t1d0 HDD2 SYS HDD2 c0 dsk c1t2d0 HDD3 SYS HDD3 c0 dsk c1t3d0 HDD4 SYS HDD4 c0 dsk c1t4d0 HDD5 SYS HDD5 c0 dsk c1t5d0 HDD6 SYS HDD6 c0 dsk c1t6d0 HDD7 SYS HDD7 c0 dsk c1t7d0 DVD SYS DVD Related Information a Install a Hard Drive on page 73 m Remove a Hard Drive on page 71 a Four Drive Capable Backplane Configuration Reference on page 77 m Sixteen Drive Capable Backplane Configuration Reference on page 79 78 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Sixteen Drive Capable Backplane Configuration Reference The following table identifies the hard drive slot numbering in a sixteen drive capable backplane TABLE Physical Drive Locations in a Sixteen Drive Capable Backplane HDD3 HDD7 HDD12 HDD15 HDD2 HDD6 HDD11 HDD14 HDD1 HDD5 HDD9 DVD HDDO HDD4 HDD8 HDD10 HDD13 The following table matches the FRU names and the default OpenBoot PROM Solaris drive pathnames with the physical drive locations in a sixteen drive capable backplane TABLE Physical Drive Locations FRU Addresses and D
171. tistatic mat Related Information m Install the Motherboard Assembly on page 125 V Install the Motherboard Assembly Caution This procedure requires that you handle components that are sensitive to static discharge Static discharges can cause the components to fail 1 Position the motherboard so that its screw holes align with the chassis standoffs Servicing Motherboard Components 125 FIGURE Installing the Motherboard Assembly SPARC Enterprise T5140 Server 2 Using the green handle and the back edge of the motherboard tray push down firmly and equally while sliding the motherboard to the front of the chassis Tip After installing the motherboard into the chassis ensure that the motherboard is correctly seated by gently lifting up on the handles If the board moves upward then it is not correctly seated Ensure that the motherboard tray sits flush with the chassis floor Also check for binds and ensure that the bus bar screw holes are correctly aligned with the bus bar at the front of the motherboard 3 Tighten the captive screw that secures the motherboard to the front of its tray in the chassis 4 Install the four No 2 Phillips screws that secure the motherboard to the bus bar Note When you reinstall the motherboard you must use the correct screws to attach the motherboard to the bus bar 5 If you are installing a new motherboard install the following components 126 SPARC
172. to open the latch 72 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 FIGURE Locating the Hard Drive Release Button and Latch Caution The latch is not an ejector Do not bend the latch too far to the right Doing so can damage the latch 5 Grasp the latch and pull the drive out of the drive slot Related Information Install a Hard Drive on page 73 Four Drive Capable Backplane Configuration Reference on page 77 Eight Drive Capable Backplane Configuration Reference on page 78 Sixteen Drive Capable Backplane Configuration Reference on page 79 V Install a Hard Drive Installing a hard drive into the SPARC Enterprise T5140 and T5240 servers is a two step process You must first install a hard drive into the desired drive slot Then you must configure that drive to the server 1 If necessary remove the blank panel from the chassis Servicing Hard Drives 73 Note SPARC Enterprise T5140 servers might have up to seven blank panels covering unoccupied drive slots SPARC Enterprise T5240 servers might have as many as fifteen blank panels covering unoccupied hard drive slots 2 Align the replacement drive to the drive slot Hard drives are physically addressed according to the slot in which they are installed If you install a hard drive as a replacement for a drive that was removed the new drive must go into the same slot as the drive it is replacing FIGURE
173. tor reseated and so on you might need to remove the component from the ASR blacklist The following ASR commands enable you to view and add or remove components asrkeys from the ASR blacklist You run these commands from the ILOM gt prompt Command Description show components Displays system components and their current state set asrkey component_state Enabled Removes a component from the asr db blacklist where asrkey is the component to enable set asrkey component_state Disabled Adds a component to the asr db blacklist where asrkey is the component to disable Note The asrkeys vary from system to system depending on how many cores and memory are present Use the show components command to see the asrkeys on a given system After you enable or disable a component you must reset or power cycle the system for the component s change of state to take effect Related Information m Display System Components on page 51 m Disable System Components on page 52 a Enable System Components on page 53 Vv Display System Components The show components command displays the system components asrkeys and reports their status 50 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 At the gt prompt enter the show components command In the following example PCIE3 is shown as disabled gt show components Target Property SYS MB RISERO component_s Enabled P
174. tribution Board From a SPARC Enterprise T5140 Server 8 Grasp the bus bar and pull the power distribution board bus bar assembly to the left away from the paddle card 9 Lift the power distribution board bus bar assembly up and out of the system 10 Place the power distribution board bus bar assembly on an antistatic mat Related Information a Install the Power Distribution Board on page 167 166 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 V Install the Power Distribution Board 1 Lower the power distribution board bus bar assembly into the chassis The power distribution board fits over a series of mushroom standoffs in the floor of the chassis 2 Slide the power distribution board bus bar assembly to the right until it plugs into the paddle card FIGURE Installing a Power Distribution Board in a SPARC Enterprise T5140 Server 3 Install the No 2 Phillips screw to secure the power distribution board to the chassis 4 SPARC Enterprise T5240 server Attach the four No 2 Phillips screws securing the power distribution board to the power supply backplane Servicing Boards and Components 167 FIGURE Installing a Power Distribution Board in a SPARC Enterprise T5240 Server 5 SPARC Enterprise T5240 server Connect the power supply backplane ribbon cable to its plug on the power distribution board 6 Connect the top cover interlock cable to the power distribution board 7 S
175. ts holder Related Information m Install a Battery on page 116 Servicing Motherboard Components 115 V Install a Battery 1 Unpack the replacement battery 2 Pry the clip open slightly and insert the battery into the battery holder Looking at the system from the rear install the positive side facing to the right towards the chassis wall and away from the center of the motherboard 3 Install PCIe XAUI riser 2 See Install a PCle XAUI Riser on page 107 4 Use the ILOM setdate command to set the day and time See the Integrated Lights Out Manager ILOM 3 0 Supplement for SPARC Enterprise T5140 and T5240 Servers 5 After returning the server to operation check and reset the Solaris OS date Related Information m Remove a Battery on page 115 Servicing the SCC Module These topics explain how to replace a faulty SCC module a SCC Module Overview on page 116 m Remove the SCC Module on page 117 m Install the SCC Module on page 117 SCC Module Overview The SCC module contains system host ID MAC addresses and configuration variable settings for ILOM If you are replacing a motherboard you must move the SCC module from the old motherboard to the new one Related Information m Remove the SCC Module on page 117 m Install the SCC Module on page 117 116 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 V Remove the SCC Module 1 Remove the PC
176. tus LEDs located on the fan modules TABLE Fan Module Status LEDs LED Color Notes Power OK Green This LED is lit when the system is powered on OK and the fan module is functioning correctly Service Required Amber This LED is lit when the fan module is faulty In addition the system Fan Fault LED is lit In addition The front and rear panel Service Required LEDs are also lit if the system detects a fan module fault If the fan fault causes an over temperature condition to occur the system Overtemp LED will turn on and an error message will be logged as well as displayed on the system console Related Information m Front Panel Controls and Indicators on SPARC Enterprise T5140 Servers on page 5 m Rear Panel Components and Indicators on SPARC Enterprise T5140 Servers on page 8 m Front Panel Controls and Indicators on SPARC Enterprise T5240 Servers on page 9 m Rear Panel Components and Indicators on SPARC Enterprise T5240 Servers on page 12 YV Remove a Fan Module 1 Extend the server into the maintenance position See Extend the Server to the Maintenance Position on page 63 Servicing Fan Modules 131 2 Lift the latch and open the top cover door Caution The system might start to overheat if the top cover door is left open for more than 60 seconds 3 The faulty fan module is identified with a corresponding fault LED On SPARC Enterprise T5140 servers the Fan
177. ty are also reported through service processor alerts SC Alert Most detected fault MSGID SUN4v 8000 Dx Note You must be logged in to the ALOM CMT shell to see Solaris PSH fault alerts Identify PSH Detected Faults With fmdump The f mdump command displays the list of faults detected by the Solaris PSH facility and identifies the faulty FRU for a particular EVENT_ID UUID Note The information fmdump displays is taken from the PSH event log which retains the fault data after the fault has been repaired For that reason fmdump cannot be used to verify that a FRU replacement has cleared a fault Instead use the fmadm faulty command to verify that the fault has cleared Detecting and Managing Faults 45 1 Check the event log using the mdump command with v for verbose output fmdump v u d940ac2 d21le c94a 258 f 8a9bb69d05b TIME UUID SUNW MSG ID Jul 31 12 47 42 2008 fd940ac2 d21e c94a f258 f8a9bb69d05b SUN4V 8000 JA 100 fault cpu ultraSPARC T2 misc_regs Problem in cpu cpuid 16 serial 5D67334847 Affects cpu cpuid 16 serial 5D67334847 FRU he serial 101083 part 541215101 motherboard 0 Location MB In this example the following information is provided about the detected fault Date and time of the fault Jul 31 12 47 42 2008 Universal Unique Identifier UUID The UUID is unique for every fault 4940ac2 d21e c94a 258 f8a9bb69d05b Message identifier which c
178. uired POST and ILOM are two diagnostics Required LED tools that can detect a fault or failure resulting in this indication amber VAN The ILOM show faulty command provides details about any faults that cause this indicator to light Under some fault conditions individual component fault LEDs are lit in addition to the system Service Required LED Power OK Provides the following indications LED OK e Off System is not running in its normal state System power might be off green The service processor might be running e Steady on System is powered on and is running in its normal operating state No service actions are required e Fast blink System is running in standby mode and can be quickly returned to full function e Slow blink A normal but transitory activity is taking place Slow blinking might indicate that system diagnostics are running or the system is booting Related Information m LED Overview on page 21 Identifying Server Components 13 Status LEDs for Ethernet Ports and the Network Management Port Each Ethernet port has two status LEDs that provide connection information Two additional LEDs provide the same information for the service processor network management port TABLE Network Management Port and Ethernet Port LEDs LED Color Description Left LED Amber Speed indicator or e Amber on Operating as a Gigabit connection 1000 Mbps Green e Green on Operating as a 10
179. ules on page 144 Fan power boards Servicing Fan Power Boards on page 148 Hard drive cage Servicing the Hard Drive Cage on page 151 143 TABLE Components That Require Removal of System Power Before Servicing is Performed Component Servicing procedures Hard drive backplane Servicing the Hard Drive Backplane on page 156 Front control panel light pipe Servicing Front Control Panel Light Pipe Assemblies on page 160 Power distribution board Servicing Power Distribution Boards on page 163 Power supply backplane SPARC Servicing Power Supply Backplanes SPARC Enterprise T5240 server Enterprise T5240 Servers on page 170 Paddle card Servicing Paddle Cards on page 174 Note Fan modules are the only chassis components that may be removed or installed with power present Caution Never run the server with the covers removed Hazardous voltage is present Caution Chassis covers must be in place while the server is running to ensure proper air flow within the chassis Running the server with the covers removed may result in damage to the equipment Related Information m General Safety Information on page 57 144 Servicing DVD USB Modules These topics explain how to remove and install DVD USB modules a DVD USB Module Overview on page 145 m Remove the DVD USB Module on page 145 m Install the DVD USB Module on page 147 SPARC E
180. ve the Air Duct You must remove the air duct before removing or installing the following components Power distribution board Power supply backplane SPARC Enterprise T5240 Fan module boards Paddle card Hard drive cage Hard drive backplane Motherboard Caution To prevent the system from overheating ensure that the air duct is correctly installed before powering on the server 1 2 3 Slide the system out of the rack See Extend the Server to the Maintenance Position on page 63 Remove the top cover See Remove the Top Cover on page 67 Open the air duct Disengage the rear of the air duct from the motherboard and rotate the air duct forward Servicing Motherboard Components 103 Related Information a Install the Air Duct on page 104 m Remove the Top Cover on page 67 Vv Install the Air Duct installed to prevent the system from overheating A Caution When the server is in operation ensure that the air duct is correctly 1 Use the guide pins to align and install the air duct into the chassis 2 Rotate the air duct down until it is seated on the motherboard 3 Install the top cover See Install the Top Cover on page 177 Related Information m Remove the Air Duct on page 103 m Install the Top Cover on page 177 Servicing PCle XAUI Risers These topics explain how to service the riser units that support PCle and XAUI cards and how to
181. ver and how to remove and replace parts in the server How to perform administrative tasks that are specific to the servers Information that is common to all platforms managed by Integrated Lights Out Manager ILOM 2 0 How to use the ILOM 2 0 software on the servers Information that describes ILOM 3 0 features and functionality Information and procedures for network connection logging in to ILOM 3 0 for the first time and configuring a user account or a directory service Information and procedures for accessing ILOM 3 0 functions using the ILOM web interface Information and procedures for accessing ILOM 3 0 functions using the ILOM CLI Information and procedures for accessing ILOM 3 0 functions using SNMP or IPMI management hosts Enhancements that have been made to ILOM firmware since the ILOM 3 0 release How to use the ILOM 3 0 software on the servers Procedures for installing the External I O Expansion Unit on the SPARC Enterprise T5120 T5140 T5220 T5240 T5440 servers Important and late breaking information about the External I O Expansion Unit SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 C120 E496 C120 E497 C120 E498 C120 E474 C120 E499 C120 E573 C120 E576 C120 E574 C120 E575 C120 E579 C120 E600 C120 E578 C120 E543 C120 E544 Note Product Notes are available on the website only Please check for the recent update on your product
182. versions of all the SPARC Enterprise Series manuals are available at the following Web sites Global Site http www fujitsu com sparcenterprise manual Japanese Site http primeserver fujitsu com sparcenterprise manual Title SPARC Enterprise T5140 Server Getting Started Guide SPARC Enterprise T5140 Server Getting Started Guide For Models That Run on DC Input Power SPARC Enterprise T5240 Server Getting Started Guide SPARC Enterprise T5240 Server Getting Started Guide For Models That Run on DC Input Power SPARC Enterprise T5140 and T5240 Servers Product Notes Important Safety Information for Hardware Systems SPARC Enterprise T5140 and T5240 Servers Safety and Compliance Guide SPARC Enterprise PRIMEQUEST Common Installation Planning Manual SPARC Enterprise T5140 and T5240 Servers Site Planning Guide SPARC Enterprise T5140 and T5240 Servers Overview Guide Description Minimum steps to power on and boot the server for the first time Minimum steps to power on and boot the server that run on DC input power for the first time Minimum steps to power on and boot the server for the first time Minimum steps to power on and boot the server that run on DC input power for the first time Information about the latest product updates and issues Safety information that is common to all SPARC Enterprise series servers Safety and compliance information that is specific to the servers
183. vicing Front Control Light pipe bracket is not N A pipe assembly Panel Light Pipe a FRU Assemblies on page 160 3 Hard drive cage and Servicing the Hard Hard drive cage must be SYS SASBP hard drive backplane Drive Cage on removed to service hard page 151 drive backplane and Servicing the Hard front control panel light Drive Backplane on pipes page 156 4 Hard drives Remove a Hard Drive Hard drives must be See Four Drive Capable on page 71 removed to service the Backplane Configuration Install a Hard Drive hard drive backplane Reference on page 77 or on page 73 Eight Drive Capable Backplane Configuration Reference on page 78 5 DVD USB module Servicing DVD USB Must be removed to SYS DVD Modules on page 144 service the hard drive SYS USBBD backplane 6 Right control panel light Servicing Front Control Light pipe bracket is not N A pipe assembly Panel Light Pipe Assemblies on page 160 a FRU Identifying FRUs in SPARC Enterprise T5140 Servers 187 Power Distribution Fan Module Components in SPARC Enterprise T5140 Servers FIGURE Power Distribution Fan Module Components SPARC Enterprise T5140 Servers 188 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 The following table identifies the power distribution and fan module components in the server and points to instructions for servicing them TABLE Power Distribution Fan Module Components
184. vis de non responsabilit les seules garanties octroy es par Fujitsu Limited Sun Microsystems Inc ou toute soci t affili e de l une ou l autre entit en rapport avec ce document ou tout produit ou toute technologie d crit e dans les pr sentes correspondent aux garanties express ment stipul es dans le contrat de licence r gissant le produit ou la technologie fourni e SAUF MENTION CONTRAIRE EXPRESS MENT STIPULEE DANS CE CONTRAT FUJITSU LIMITED SUN MICROSYSTEMS INC ET LES SOCIETES AFFILIEES REJETTENT TOUTE REPRESENTATION OU TOUTE GARANTIE QUELLE QU EN SOIT LA NATURE EXPRESSE OU IMPLICITE CONCERNANT CE PRODUIT CETTE TECHNOLOGIE OU CE DOCUMENT LESQUELS SONT FOURNIS EN L ETAT EN OUTRE TOUTES LES CONDITIONS REPRESENTATIONS ET GARANTIES EXPRESSES OU TACITES Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE A L APTITUDE A UNE UTILISATION PARTICULIERE OU A L ABSENCE DE CONTREFA ON SONT EXCLUES DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE Sauf mention contraire express ment stipul e dans ce contrat dans la mesure autoris e par la loi applicable en aucun cas Fujitsu Limited Sun Microsystems Inc ou l une de leurs filiales ne sauraient tre tenues responsables envers une quelconque partie tierce sous quelque th orie juridique que ce soit de tout manque gagner ou de perte de profit de probl mes d utilisation ou de perte de donn es ou d interruptions g activites ou de tout dommage
185. vue tecnical fournies par FUJITSU LIMITED sur des parties de ce mat riel Sun Microsystems Inc et Fujitsu Limited d tiennent et contr lent toutes deux des droits de propri t intellectuelle relatifs aux produits et technologies d crits dans ce document De m me ces produits technologies et ce document sont prot g s par des lois sur le copyright des brevets d autres lois sur la propri t intellectuelle et des trait s internationaux Les droits de propri t intellectuelle de Sun Microsystems Inc et Fujitsu Limited concernant ces produits ces technologies et ce document comprennent sans que cette liste soit exhaustive un ou plusieurs des brevets d pos s aux Etats Unis et indiqu s a l adresse http www sun com patents de m me qu un ou plusieurs brevets ou applications brevet es suppl mentaires aux Etats Unis et dans d autres pays Ce document le produit et les technologies aff rents sont exclusivement distribu s avec des licences qui en restreignent l utilisation la copie la distribution et la d compilation Aucune partie de ce produit de ces technologies ou de ce document ne peut tre reproduite sous quelque forme que ce soit par quelque moyen que ce soit sans l autorisation crite pr alable de Fujitsu Limited et de Sun Microsystems Inc et de leurs ventuels bailleurs de licence Ce document bien qu il vous ait t fourni ne vous conf re aucun droit et aucune licence expresses ou tacites concernant le
186. y Configuration With Additional FB DIMMs 91 FB DIMM Configuration Guidelines for SPARC Enterprise T5140 Servers 94 FB DIMM Configuration Guidelines for SPARC Enterprise T5240 Servers 98 Servicing the Air Duct 103 v Remove the Air Duct 103 v Install the Air Duct 104 Servicing PCle XAUI Risers 104 PCle XAUI Riser Overview 105 viii SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 Remove a PCle XAUI Riser 105 Install a PCIle XAUI Riser 107 Remove a PCIe or XAUI Card 109 Install a PCIe or XAUI Card 109 PCle and XAUI Card Reference for SPARC Enterprise T5140 Servers 112 PCIe and XAUI Card Reference for SPARC Enterprise T5240 Servers 113 q lt 4 lt Servicing the Battery 114 System Battery Overview 114 v Remove a Battery 115 v Installa Battery 116 Servicing the SCC Module 116 SCC Module Overview 116 v Remove the SCC Module 117 v Install the SCC Module 117 Servicing the Memory Mezzanine Assembly SPARC Enterprise T5240 118 Memory Mezzanine Assembly Overview 118 v Remove a Memory Mezzanine Assembly 118 v Install a Memory Mezzanine Assembly 120 Servicing the Motherboard Assembly 122 Motherboard Servicing Overview 122 v Remove the Motherboard Assembly 123 v Install the Motherboard Assembly 125 Servicing Fan Modules 129 Fan Module Overview 129 Fan Module Configurations for SPARC Enterprise T5140 Servers 4 and 8 Disk Capable 130 Fan Module Configurations for SPARC Enterprise T5240 Servers 8 and 16 Dis
187. y Output When No Fault is Present gt show faulty Target Property Example of show faulty Output for Environmental Faults gt show faulty Target Property eto at 2 eit tee te 4 SP faultmgmt 0 fru SP faultmgmt 0 timestamp SP faultmgmt 0 timestamp SP faultmgmt 0 faults 0 sp_detected_fault SYS FANBD0 FM0 Dec 14 23 01 32 Dec 14 23 01 32 faults 0 TACH at SYS FANBD0 FM0 F0 has exceeded low non recoverable threshold Example of show faulty Output for Faults Detected by POST gt show faulty Target Property T Re ee S See ee REA SP faultmgmt 0 fru SP faultmgmt 0 timestamp SP faultmgmt 0 timestamp faults 0 SP faultmgmt 0 l faults 0 sp_detected_fault SYS MB CMP0 BR1 CH0 D0 Dec 14 23 01 32 Dec 14 23 01 32 faults 0 SYS MB CMP0 BR1 CH0 D0 Forced fail POST Example of show faulty Output for Faults Detected by 30 SPARC Enterprise T5140 and T5240 Servers Service Manual July 2009 PSH Technology gt show faulty Target Property SP faultmgmt 0 timestamp Dec 14 22 43 59 SP faultmgmt 0 sunw msg id SUN4V 8000 DxX SP faultmgmt 0 SYS MB CMP0 BR0 CH1 1 faults 0 SP faultmgmt 0 uuid 3aa7c854 9667 e176 efe5 e487e520 faults 0 7a8a SP faultmgmt 0 timestamp Dec 14 22 43 59 faults 0 Related Information m Clear FRU Faults Manually on page 31 Display FRU Informati

SPARC Enterprise T5140 and T5240 Servers Service Manual

Contents

Download Pdf Manuals

Related Search

Related Contents