Home

IBM RS/6000 User's Manual

1. E 116 15 E gt 14 13 E E 12 1 jan eS 10 9 Processor Node5s 5 slots 5 8 E Processor AFShunt Modet a 1 Assembly slots 1 4 AC Line Cord I A II Testpoints L D JJ0 0 i Rn 00o 000000 000 i Ben Rear PowerLED PCI Card Frame Supervisor Card Figure 2 3 Rear view of frame locations Note See notes under Eigure 2 1 on page 2 4 for processor node switch assembly numbering Frame locations Figure 2 1 on page 2 3 shows a front view of the RS 6000 SP frame locations with numbered processor nodes and the three phase SEPBU Frame FRA This list shows the designations specifically for the RS 6000 SP frame G1 Right hand rear ground G2 Left hand rear ground G3 PDU ac ground G4 PDU dc ground G5 Input cable ground Chapter 2 Locations 2 5 G6 Front door ground G7 Rear door ground G8 Ground SW Power on switch LD LED card FC Front cover RC Rear cover Example E01 FRA G1 2 6 RS 6000 SP SP Switch2 Service Guide Switch assembly locations HOMO BOO ooo ooo nal IIA Supervisor O Card m E J34 es OOOO QOOO OOOO OOOO LED Power Extension Cable OS OOO COCO Eje Tray Tray di supply Power supply Power suppl
2. Action Go to Step 0620 0041 2 Use the following prioritized table to service problems reported in the var adm SPlogs css0 p0 out top file The messages are from comment lines preceding the error Notes a Be aware that wrap plugs or terminators used in the following steps can potentially fail therefore exercise caution before performing major replacements to make sure that a diagnostic wrap plug or terminator is not faulty me and switch assembl b Where applicable fra out top file For example E02 S17 BH J18 Identifies the switch in frame 2 slot 17 using bulkhead jack 18 E02 N05 Identifies node in frame 2 slot 5 E06 S02 BH J3 Identifies multi switch frame 6 slot 2 BH J3 Refer to notes at beginning of Se arrest Simian oe Refer to KEormat structure on page 2 1 for more information on the nomenclature cable connections and logical to physical frame translations Table 1 7 Problem from the out top file jack numbers are indicated on each line of the A for more information on Priority Condition Action 1 e Primary node connection to check primary e Node connections on same switch as or secondary processor node connection 1 of 5 primary node 2 On board connections 2 of 5 3 Node connections not on same switch as primary node 3 of 5 4 e Frame to frame e Switch to switch 4 of 5 e Switch connections 5 All problems in var adm SPl
3. Old Style 2 01 m Frame 16 H10 15 y 16 Hito 15 y V8 T v1 Aa y 14 H9 13 7 y 14 H9 13 N T T H 4 f H v7 12 H8 11 y H 12 H8 11 vH gt a E v2 z HH y 10 H 9 H v 10 H7 9 al 1 HH 1 ER de Pi OA ve HE 8 H 7 y HH 8 H6 7 y HH r 1 A 1 H A v3 I N y 6 H5 5 BA y 6 H5 5 I T I a Ha 3 y a H4 3 ws y 3 H3 4 va 3 H3 4 N Switch A Switch N A N Power j Power N H1 H1 El E2 Fa El E2 p 4 AR E3 a sT Figure 2 7 Frame cabling routing path in rear of RS 6000 SP frame 2 01 m frame Note For a multi switch frame F C 2032 refer to Eigure 2 4 nodes Refer to shows external cable routing in a RS 6000 SP frame populated with 16 processor to see the routing paths Chapter 2 Locations 2 9 Table 2 1 External cable routing Frame Horizontal Slot Number Cable Budget Entrance New Frame Entrance Vertical Routing Routing Old Node millimeters inches Style Old Style Old Style Style 1 1800 71 ES El V4 H3 2 1500 59 E3 El V4 H3 3 1680 66 E3 E2 V5 H4 4 1980 78 E3 E2 V5 H4 5 2160 85 E3 El V3 H5 6 1850 73 E3 E1 V3 H5 7 2030 80 E3 E2 V6 H6 8 2340 92 E3 E2 V6 H6 9
4. 05N6351 E00 S00 BH J25 E00 N04 BH PA 05N6351 E00 S00 BH J9 E00 N05 BH PA 05N6351 E00 S00 BH J10 E00 N06 BH PA 05N6351 E00 S00 BH J24 E00 N07 BH PA 05N6351 E00 S00 BH J23 E00 N08 BH PA 05N6351 05N6351 E00 S00 BH J31 E00 S00 BH J32 E00 N09 BH PA E00 N10 BH PA 05N6351 05N6351 E00 S00 BH J18 E00 S00 BH J17 E00 N11 BH PA E00 N12 BH PA 05N6351 E00 S00 BH J33 E00 N13 BH PA 05N6351 E00 S00 BH J34 E00 N14 BH PA 05N6351 E00 S00 BH J16 E00 N15 BH PA Chapter 2 Locations 2 11 Table 2 2 SP Switch2 data cable chart continued Cable Part Plug from Plug to Number Location Location 05N6351 E00 S00 BH J15 E00 N16 BH PA Notes 1 PA refers to connector on SP Switch2 adapter 2 Only one cable type is used for all switch locations Note For external frame to frame cable locations see 2 12 RS 6000 SP SP Switch2 Service Guide Chapter 3 Service procedures Personal ESD requirements nn o DT Tools and files overview s s nn BM Using the css snap script s e e s a sos s ros soaa ser os anada os ga BB css snap file structure s s s s ode a ee a a G A Files collected by css snap s a s s soa coa roas oaos soc oas I css snap file package names non nommen 96 Disk space handling s e s s s s sos ste fo o a oa d 96 SP Switch2 supervisor self tes
5. e If yes call the next level of support e If no verify that the customer is not experiencing problems with this switch If no problems are being experienced or this is an N 1 fan or power supply failure then no immediate service is required and service can be deferred until a later date If problems are being experienced and the customer will allow power on service service can be performed now by treating the problem as an Errpt message of Shutdown or Failure and going to ESiep 0800 0031 Step 0600 003 A critical power or environmental problem has been detected and the switch has logically powered off 1 If service action has just been completed on this switch check for loose cables or shorted conditions 2 Record the locations of all failing FRUs multiple FRUs may be reported Note Fans are N 1 devices two fans off will power off the SP Switch2 Power Supplies are N 2 three power supplies off will power off the SP Switch2 Therefore fix all fan problems before troubleshooting power supply problems 3 Power off the switch using the rear 48 V circuit breaker Remember to turn on the circuit breaker when the repair has been completed 4 Based on the text of the message use the information in Table 1 3 to continue service Table 1 3 Perspectives SP Switch2 status indicators Condition Action P480K Fan 1 2 3 or 4 indicator is red Temperature indicator is red
6. expected top xnsb yisb 0 All nodes Used by rc switch to more easily letc SP parse out chip connection information Where x the number of the node switch board y the number of the intermediate switch board fs_daemon_print file All nodes A log of the daemon var adm SPlogs css0 p0 3 2 RS 6000 SP SP Switch2 Service Guide Table 3 2 Setup output files continued File Location Description Directory css snap log All nodes Log files created by the switch var adm SPlogs css support code Table 3 3 Tuning output files File Location Description Directory daemon stdout Allnodes Keeps a detailed account of the var adm SPlogs css tuning process initiated by the Estart command It includes data from every tuning operation since the current daemon on the primary node was initiated topology data Primary Arecord of the primary node how var adm SPlogs css many nodes were initialized and the links between them daemon stderr All nodes A record of which nodes were not var adm SPlogs css initialized out top Primary Reports errors from the last tuning var adm SPlogs css0 p0 procedure It begins as a copy of the topology file and errors are indicated to the right of each entry out top old Primary A copy of out top from the previous var adm SPlogs css0 p0 run router log Primary The router log file generated by the var adm SPlogs css0 p0 route ta
7. in Bsn spl before proceeding SPSFDO14 DANGER Before connecting ac power cables to electrical outlets ensure that e The customer s branch distribution circuit breakers customer power source circuit breakers are off and tagged with DO NOT OPERATE tags S229 0237 or national language equivalent e The activities in Performing the Customer 50 60 Hz Power Receptacle Safety Check have been performed on all customer power source outlets and cable connectors SPSFDO15 DANGER Ensure that the customer s branch distribution circuit breakers customer power source circuit breakers to the ac power outlets are off and tagged with DO NOT OPERATE tags S229 0237 or national language equivalent SPSFDO16 DANGER Both the SEPBU power chassis and the PDU 48 V dc power chassis are field replaceable units FRUs which contain NO serviceable parts they are labeled as such Do not attempt to isolate or repair these components since doing so may result in severe injury or even death SPSFDO17 Caution notices CAUTION The weight of the PDU assembly 48 V dc power chassis and the SEPBU power chassis is greater than 18 Kg 40 lbs Be careful when removing or installing Remove all 48 V dc power supplies from the power chassis before removing or installing the power chassis SPSFC007 CAUTION The unit weight exceeds 18 Kg 40 Ibs and requires two service personnel to lift SP
8. 4 1 Handling an anti static device me u La Re Oe or a AR 4 2 Removing SP Switch2 fan assemblies and power supplies ieee Me a eR ee a ew AS 4 3 Removing SP Switch2 power and environmental LED assembly 44 4 4 Removing and replacing SP Switch2 supervisor and interposer cards 45 4 5 Installing an SP Switch2 supervisor and interposer cards 4 6 4 6 Removing SP Switch2 circuit breaker assembly m nn nn nn AD Copyright IBM Corp 2000 2002 Vv vi RS 6000 SP SP Switch2 Service Guide Tables po N HSH SH SH oo St I 3 1 3 3 3 4 5 1 5 2 5 3 5 5 5 6 5 7 VHODNA WN Switch Problem Diagnostics i e SP Switch2 supervisor LED indications f Perspectives SP Switch2 status indicators Fan Failure Diagnostics Power supply failure diagnostics SP Switch2 error conditions Problem from the out top file Service Request Numbers SRNs for SP Switch2 adapters Switch Problem Priority Listing External cable routing SP Switch2 data cable chart Service procedure tools Setup output files Tuning output files SP Switch2 log files SP Switch2 assembly view 1 SP Switch2 assembly view 2 Switch cables SP Switch2 Frame F C 2032 F C 2032 frame extender SP Switch2 Frame Model 556 and F C 2034 Model 556 and F C 2034 frame extender Copyright IBM Corp 2000 2002 vii viii RS 6000 SP SP Switch2 Servi
9. Diagnosis Guide GA22 7350 for initial problem determination If there is nothing wrong with the customer operating procedures customer supplied cables or the power source the customer should then call IBM for service How to use this book This book is intended for RS 6000 SP product trained service personnel When performing RS 6000 SP maintenance the service provider must n all Maintenance Analysis Procedures beginning with the Start MAPs in the Beginning with the Start MAPs isolate the problem to one or more of these RS 6000 SP components e Supervisor Subsystem e Processor Node e Power Subsystem e High Voltage Transformer World Trade e Ethernet Local Area Networks LANs e PCI Adapter Note If the diag peste procedures indicate that the problem is isolated to a SP Switch2 the information in will direct you to return to this book If you cannot determine the failure s cause you should request the assistance of the RS 6000 SP Field Support Center How to send your comments Your feedback is important in helping to provide the most accurate and highest quality information If you have any comments about this book or any other RS 6000 SP documentation e Send your comments by e mail to mhvrcfs us ibm com Be sure to include the name of the book the order number of the book and if applicable the specific location of the text you are commenting on for example a page number or table number e Fill o
10. FCC statement European Union EU statement United Kingdom telecommunications safety requirements Industry Canada compliance statement For installations in Japan Electromagnetic interference EMI statement Taiwan Radio protection for Germany Index iV RS 6000 SP SP Switch2 Service Guide 3 9 3 9 3 9 3 10 3 10 3 10 3 11 3 11 3 12 4 1 42 42 42 4 3 4 4 4 4 4 6 4 6 4 7 4 7 4 8 4 8 49 4 10 8 1 5 2 5 6 5 8 5 10 5 12 5 14 A 1 A A 2 A 2 A 2 A 2 AS A 3 X 1 Figures 1 1 SP Switch2 Assembly High Level en ee ee ae the le 1 2 SP Switch2 Wrap Plugs mee ee en ID 1 3 SP Switch2 Chassis Assembly on on 2 ee ee ee ee 111 2 1 Front view of frame locations a et eS al a e ee a se a eS 2 2 Front view of multi switch frame locations Beh A a OR A es et LA 2 3 Rear view of frame locations 1 ee ee 2D 2 4 SP Switch2 high level planar view a ew eg a eel 2 5 RS 6000 SP connector details as seen at receiving ends not at cable ends por ee apy O 2 6 Frame cabling routing path in rear of RS 6000 SP frame 1 93 m frame 29 2 7 Frame cabling routing path in rear of RS 6000 SP frame 2 01 m frame 29 2 8 Frame cable routing paths in rear of RS 6000 SP multi switch frame ied en 1 93 r m frame fee amp 4 3 i o 2 11
11. Power Supply 1 2 3 or 4 indicator is red Chapter 1 Maintenance Analysis Procedures MAPs 1 9 Switch environment MAP 0600 Step 0600 004 Perspective display shows Fan X Failure on a red background 1 Use Hable 1 4 to service components 2 Refer to component being serviced Table 1 4 Fan Failure Diagnostics for instructions about the Priority Component Action 1 Fan 1 2 3 or 4 a Check specified fans for blockages or loose 1 of 6 connecians b Fix any obvious problems and continue at Steg on page L c If you do not find any problems continue at Priority 2 2 Fan 1 2 3 or 4 a Replace fans as described in Chapter 4 FR 20f6 b 3 Switch supervisor card a Replace the card 3 of 6 b 4 Power supply 1 2 3 or 4 a Replace the power supply associated with the fan 4 of 6 e Refer to b Continue at 5 Switch planar 5 of 6 b 6 All replaced Call next level of support 1 10 RS 6000 SP SP Switch2 Service Guide Switch environment MAP 0600 Planar air baffle Interposer Slots Planar Power supplies Fan assemblies LED bracket Figure 1 3 SP Switch2 Chassis Assembly Step 0600 005 You performed the recommended action in Table 1 4 on page 1 10 1 Component replaced or reseated 2 Check the yellow switch supervisor LED for an On or flashing condition 3 Is the yellow switch supervisor LED On or flash
12. 9 5 9 5 7 5 9 5 13 5 13 5 3 5 5 5 5 5 5 5 15 5 15 5 15 5 15 5 5 5 5 5 3 5 3 5 3 5 3 5 5 5 5 5 3 5 7 5 9 5 13 5 9 5 13 5 5 5 13 5 13 5 11 5 11 5 11 5 11 5 7 5 7 5 7 5 7 5 3 removing 4 8 replacing 4 9 54G 2882 54G2943 74F1823 77G0599 77G0818 O Copyright IBM Corp 2000 2002 5 9 5 11 5 13 5 15 5 11 5 15 5 9 5 13 5 9 5 13 5 3 A active configuration removing from 3 9 restoring 3 9 assembly naming standard 2 2 audience of this book xv B base code verification 3 8 blank interposer removing 4 6 replacing 4 7 bootlist resetting 3 11 C cable plug locations 2 1 cables switch 5 6 circuit breaker assembly 48 V dc removing 4 8 replacing 4 9 clock resetting 3 11 component connector details 2 7 connector location naming standard 2 2 css snap disk space 3 6 file package names 3 6 file structure 3 4 files 3 4 script using 3 3 D data cables Switch2 2 11 diagnostics switch port 3 12 disk space css snap 3 6 E ESD procedures 3 1 requirements 3 1 external cable routing 2 9 F F C 2032 5 8 5 10 F C 2034 5 12 5 14 fan assembly removing 4 2 replacing 4 2 female wrap plug 1 5 fencing nodes 3 10 files created by css snap 3 4 package names css snap 3 6 structure css snap 3 4 files overview service 3 1 format structure 2 1 frame multi switch 5 8 5 12 rear view 2 4 frame cable routing path in rear of frame 2 8 2 10
13. Power supplies e Fan assemblies e Switch planar assembly e Interposer cards Removing a fan assembly Note The fan assembly is hot pluggable Note Refer to H 1 Unscrew the fan assembly mounting screws located on the front of the switch chassis 2 Grasp the fan assembly s grill work flange and remove the assembly by pulling it out of the chassis Note If the fan assembly contains the LED bracket assembly remove the assembly and save it for use with the new fan assembly e Refer to Replacing a fan assembly Note If the failed fan assembly contained the LED bracket assembly reinstall the saved assembly into the new fan assembly e Refer to 1 Insert and seat the fan assembly into the switch chassis 2 Tighten the assembly s mounting screws 4 2 RS 6000 SP SP Switch2 Service Guide 3 SP Switch2 service procedures Return to the procedure that directed you here Removing a power supply Note The power supply is a card mounted assembly and is hot pluggable 1 da emo on page 4 4 Swing the hinged air dam covering the entrance to the fan bay back and upward to expose the locking levers on each side of the power supply card Unlatch the card by rotating the locking levers outward Slide the power supply forward and remove it Figure 4 2 Removing SP Switch2 fan assemblies and power supplies Replacing a power supply 1 Swing the hinged air dam covering the entrance to t
14. Rail right Screw Nutclip SP Switch2 assembly Plate blank 4 EIA Screw M5 Nutclip Plate blank 2 EIA Screw M5 Nutclip Chocks Rubber not shown Power cables multi switch frame Cable 48 V dc Frame slots 2 and 4 not shown Cable 48 V dc Frame slots 6 and 8 not shown Cable 48 V dc Frame slots 10 and 12 not shown Cable 48 V dc Frame slots 14 and 16 not shown Chapter 5 Parts catalog 5 9 F C 2032 frame extender 5 10 RS 6000 SP SP Switch2 Service Guide A a LLL Ne A E A A E E E E e e ile ie ie E AA Table 5 5 F C 2032 frame extender Assembly index 4 oa A UMN Part number 44P1029 4491031 54G2943 44P1032 44P1030 54G2882 Units Description Top cover frame extender Right side frame extender Bracket lower frame Leveling pad Cable bracket frame extender Left side frame extender Screw hex head M5 Chapter 5 Parts catalog 5 11 SP Switch2 Frame Model 556 and F C 2034 5 12 RS 6000 SP SP Switch2 Service Guide Table 5 6 SP Switch2 Frame Model 556 and F C 2034 Assembly Part
15. amp amp aoe bok e woe a 22 Example of format structure Gu eee ete ee ee ea Re a ee Frame WWW he pl aw e oe oe a ee a G a oe pe el Major assembly XXX 2 Sub assembly MD 2 Connection location ZZZZ a m Bue te A BR Ge E AAA Examples for using complete levels of nomenclature E ts Be E CA ee gy og ae Location diagrams of the RS 6000 SP components a 2 22 Front and rear views of RS 6000 SP frame nn a a ee 28 Frame locations 2 m m moe poe oa e a ooa d aa e a i DB Frame FRA e s x s s AS a bop a ERE ee eee eo oe O Switch assembly locations 2 a a a nn 27 Connector details s zs e nn 2 7 Cable routing bog wh Gh a ae ee a E 2 8 Cable routing in a multi switch frame FIC 2032 a A ee le ee 2 10 Switch data Cables s s s e s ee 2 11 SP Switch2 data cables a a a aaa 2 11 Naming standard for RS 6000 SP components The purpose of this section is to define a naming standard for all components in the RS 6000 SP system This standard provides a consistent logical naming convention system necessary for documentation including details assembly drawings schematics manufacturing documents service documents and customer publications Format structure The RS 6000 SP system is structured in a modular fashion with different levels of assembly which can be independently described These levels are 1 System level 2 Frame level 3 Major assembly level
16. and restoring switch resources Removing an SP Switch2 from the active configuration Restoring an SP Switch2 to the active configuration Using Perspectives to fence and unfence nodes attached to the switch Service position procedures Placing an SP Switch2 into service gt position i Replacing an SP Switch2 from service position Resetting the clock and bootlist after servicing a node Running diagnostics on a switch port Chapter 4 FRU removals and replacements Handling static sensitive devices Bo SP Switch2 service procedures Removing a fan assembly Replacing a fan assembly Removing a power supply Replacing a power supply j Removing the LED bracket assembly Replacing the LED bracket assembly Removing the switch supervisor card Replacing the switch supervisor card Removing an interposer card Replacing an interposer card Removing the switch planar Replacing the switch planar Removing the 48 V de circuit breaker assembly Replacing the 48 V dc circuit breaker assembly Removing the LED power extension cable Replacing the LED power extension cable Chapter 5 Parts catalog SP Switch2 assembly view 1 SP Switch2 assembly view 2 Switch cables SP Switch2 Frame F C 2032 F C 2032 frame extender SP Switch2 Frame Model 556 and F C 2034 Model 556 and F C 2034 frame extender Notices Trademarks Electronic emissions notices So a AOS Federal Communications Commission
17. any other message consult the Diagnosing SP Switch2 Problems section of Parallel System Support Programs for AIX Diagnosis Guide GA22 7350 3 Determine the primary node number From an AIX window on the control workstation enter Eprimary 4 Determine the host name for this node by checking reliable hostname for the node number with the command splstdata n pg 5 Log into primary node as root using the telnet command telnet PrimaryNodename 6 Check both errpt a N Worm pg and errpt a N css0 pg for any switch related problems If any errors are listed use the error information with this MAP to help isolate the problem 7 Check the functional state of the switch in the out top file by issuing the following command on the primary node pg var adm SPlogs css0 p0 out top Notes a Verify that the timestamp on the out top file is current using Is I var adm SPlogs css0 p0 out top b Refer to Starting a service call MAP 0100 in on using the pg command 8 Problems are indicated at the end of a text line by the following sequence ErrorMessage j for information lt OR ErrorMessage Error message example s 13 2 s 23 2 E01 S17 BH J4 to E02 S17 BH J4 2 L initialized link is not operational link failed to time For a detailed interpretation of these error messages refer to the out top information in Parallel System Support Programs for AIX Diagnosis Guide GA22 7350 9
18. appear to be fully connected at the switch assembly and the processor node e If yes go to e If no a Fix the cable connection problem Step 0620 009 The cable appears to be fully connected at both the switch assembly and at the processor node 1 From the front of the RS 6000 SP frame or from the control workstation check the Power green LED on the processor node to make sure it is lit 2 Is the Power green LED lit indicating the processor node is powered on e If yes go to e If no go to Step 0620 010 The processor must be powered on for the switch to recognize the port 1 Power on this processor node and check the Power green LED 2 Does the Power green LED stay lit indicating the processor node is powered on e If yes go to e If no a The processor node has a power problem Chapter 1 Maintenance Analysis Procedures MAPs 1 23 Switch Function MAP 0620 b Go to Processor node diagnostics and descriptions MAP 0130 in RS 6000 SP System to fix problem Step 0620 011 The Power green LED is lit indicating the processor node is powered on 1 Run advanced diagnostics in service mode on device cssX where X 0 or 1 on this processor node and its associated switch port Refer to e Running diagnostics in a processor node in Notes a Advanced cable wrap tests will not run successfully for 10 15 and 20 meter SP Switch2 data cables If these data cables a
19. e g processor node 4 Sub Assembly level e g cards fan assembly The format structure is used to individually identify any connection location at any level in the assembly The main use of this format is to describe connector cabling and schematic locations shown in tables and diagrams throughout this manual Example of format structure Format FRAME WWW MAJOR ASSEMBLY XXX SUBASSEMBLY YY CONNECTOR NUMBER ZZZZ en www 1st character is the frame type E for RS 6000 SP frame L for logical RS 6000 SP frame used for models 30X and 40X S for multi switch frame C for control workstation Z for another frame such as a server e 2nd and 3rd characters are the frame number 00 for any all frames designates location inside any all frames Copyright IBM Corp 2000 2002 2 1 01 99 for frames 1 99 specific to that frame Notes 1 E01 designates RS 6000 SP physical frame 1 2 LOO designates any all RS 6000 SP logical frames 3 S00 designates any all RS 6000 SP multi switch frames 4 For locations inside a frame the Frame WWW and or Major Assembly XXX strings may be omitted making the format YY ZZZ maor assembly XXX 1st character is the major assembly type all three characters if the assembly occurs only once in a frame N for processor node assembly S for switch assembly PDU for frame power supply assembly ADC for ac dc Converter assembly FRA for frame e 2nd a
20. failed the self test therefore you need to analyze the LED conditions you observed during the self test 1 Did the green and yellow supervisor LEDs light e If yes go to SEE e If no go to Step 0595 004 Both green and yellow supervisor LEDs did not light during the self test 1 Check the supervisor LEDs on the nodes connected to the same supervisor cable as the switch 2 Are any other supervisor LEDs lit e If yes a Replace the switch supervisor e If no go to the Start MAP 0100 in the de and troubleshoot the supervisory bus system Step 0595 005 The switch supervisor failed the self test However during the self test the green and yellow LEDs on the supervisor did light 1 Did the yellow LED flash the wrong address or was it on steady after the self test completed e f the yellow LED flashed the wrong address go to e If the yellow LED was on steady after the self test go to Chapter 1 Maintenance Analysis Procedures MAPs 1 7 Switch supervisor communications MAP 0595 Step 0595 006 The supervisor self test failed because the yellow LED flashed the wrong address 1 Make certain that the correct supervisor harness connector is plugged into the supervisor 2 Is the correct harness plugged in e If yes go to the Start MAP 0100 in the supervisory bus system and troubleshoot the e If no a Plug in the correct supervisor connector b Return to A and confirm the original conditi
21. flashing 2 and continue service with the next highest priority Switch power MAP 0610 Purpose of this MAP This MAP provides diagnostic steps for resolving problems related to SP Switch2 power Note Refer to O for placing the switch into the service position or removing it from the service position Step 0610 001 A power problem with the switch was detected 1 On the switch check the status condition of the green switch supervisor LED 2 Status condition for the green switch supervisor LED is as follows r Green power LED Off No 48 V dc power available at switch Flashing Power available at switch but switch logic is Off On Power available at switch and logic is On 3 Is the green switch supervisor LED Off e If yes go to e If no The green switch supervisor LED is On or flashing Go to EStep 0610 0021 Step 0610 002 1 Is the green switch supervisor LED flashing e If the green LED is flashing go to EStep 0610 0031 e If the green LED is lit but not flashing a This indicates that you do not have a power supply problem Step 0610 003 The green switch supervisor LED is flashing 1 Attempt to power up the switch using Perspectives from the control workstation e Note the status of the green switch supervisor LED 2 Does green LED light and stay lit e If yes go to Ewitch function MAP 0620 and refer to switch to the active configuration e If the green LED con
22. frame extender F C 2032 5 10 F C 2034 5 14 Model 556 5 14 frame locations 2 3 2 5 frame naming standard 2 1 front view of frame locations 2 3 front view of multi switch frame locations 2 4 H handling static sensitive devices 4 1 interposer card removing 4 6 replacing 4 7 isolation service procedures 3 1 L LED bracket removing 4 4 replacing 4 4 LED cable 1 11 LED power extension cable removing 4 9 replacing 4 10 location diagrams of the RS 6000 SP components component connector details 2 7 external cable routing 2 9 frame 2 5 frame cable routing path in rear of frame 2 8 2 10 front view of frame locations 2 3 front view of multi switch frame locations 2 4 locations cable plug 2 1 cable plug locations 2 1 connector details 2 1 frame rear view 2 4 location diagrams of RS 6000 SP components 2 1 major assembly naming standard 2 2 male wrap plug 1 5 Model 556 5 12 5 14 multi switch frame 5 8 5 10 5 12 5 14 multi switch frame locations 2 4 X 2 RS 6000 SP SP Switch2 Service Guide N names css snap files 3 6 naming standard assembly 2 2 connector location 2 2 for RS 6000 SP components 2 1 format structure 2 1 frame 2 1 major assembly 2 2 nodes fencing 3 10 unfencing 3 10 notices safety ix numbers service request 1 24 O opening switch pane 3 7 P package names css snap 3 6 parts catalog F C 2034 5 12 frame 5 8 frame extender 5 10 5 14 Model 556 frame 5 12 switch cables 5 6 view
23. intended to state or imply that only that IBM product program or service may be used Any functionally equivalent product program or service that does not infringe any IBM intellectual property right may be used instead However it is the user s responsibility to evaluate and verify the operation of any non IBM product program or service IBM may have patents or pending patent applications covering subject matter described in this document The furnishing of this document does not give you any license to these patents You can send license inquiries in writing to IBM Director of Licensing IBM Corporation North Castle Drive Armonk NY 10504 1785 U S A The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some states do not allow disclaimer of express or implied warranties in certain transactions therefore this statement may not apply to you This information could include technical inaccuracies or typographical errors Changes are periodically made to the information herein these changes will be incorporated in new editions of the publication IBM may make improvements and or changes in t
24. network fenced Action Go to responding 8 Device has been Link has been Description Initialization of this link detected a different removed from network because of a miswire removed from network probable miswire switch node number than the one expected Action 1 Check the cable_miswire file in var adm SPlogs cssX p0 where X 0 or 1 and rewire the cable as needed 2 If the cabling does not match correct the cabling problem then go to step 5 3 If this occurs on all nodes of a frame check for a logical to physical frame number mismatch 4 Have the customer update the configuration or you can correct the cabling as appropriate A for next problem to verify fix 1 21 Chapter 1 Maintenance Analysis Procedures MAPs Switch Function MAP 0620 Table 1 6 SP Switch2 error conditions continued Error Device Message Link Message Description and Action 9 Destination not reachable Step 0620 004 You were directed here by an Error Condition listed in Table 1 6 on page 1 19 which lists functional problems reported in var adm SPlogs css0 p0 out top file This file lists all switch data connections with comment lines indicating the various types 1 Check the entire var adm SPlogs css0 p0 out top file for errors before proceeding to the prioritized table Link has been removed from network not connected Description Possible hardware problem
25. or circuitry on these components Handling static sensitive devices Attention Adapters planars disk drives supervisor cards and memory cards are sensitive to static electricity discharge These devices are wrapped in antistatic bags or containers to prevent this damage Perform the following procedures to prevent damage to these devices 1 Do not remove the device from the antistatic bag or container until you are ready to install the device in the system unit 2 You must wear an ESD wristband while installing or removing any static sensitive devices 3 With the device still in its antistatic bag touch it to a metal frame of the system 4 Grasp cards and boards by the edges Hold drives by the frame Avoid touching the solder joints and pins 5 Handle the devices carefully in order to prevent permanent damage Copyright IBM Corp 2000 2002 4 1 SP Switch2 service procedures Ly L f Ly uw Lr A eS TAO Fik eee AAA AntistaticBag Figure 4 1 Handling an anti static device SP Switch2 service procedures CAUTION The unit weight exceeds 18 Kg 40 Ibs and requires two service personnel to lift SPSFC002 Note This chapter describes removal and replacement procedures for the following SP Switch2 FRUs e Circuit breaker assembly e LED bracket assembly e LED power extension cable e Switch supervisor card e
26. pluggable 4 6 RS 6000 SP SP Switch2 Service Guide SP Switch2 service procedures Note Refer to Handling Note If multiple cards are to be removed label and record the position of each card and its associated I O cable 1 If the interposer card is a switch interposer remove the I O cable e Only switch interposer cards have an attached I O cable 2 Loosen the captive screw holding the card retention bracket to the switch chassis 3 Swing the bracket out and remove it from the switch chassis 4 Remove the interposer card from its slot by pulling outward on the hot plug actuator handle Replacing an interposer card Note An interposer card may be either a e Switch interposer e Blank interposer Position and hold the interposer card at the far end of the hot plug actuator Insert the far end of the actuator into the actuator guides of the interposer slot Push the actuator to the end of the guide track Seat the interposer card into its switch planar jack by pushing the actuator handle inward Hook the card retention bracket to the chassis and swing the bracket closed e Make certain all actuator handles are inside the bracket 6 Secure the card retention bracket by tightening the captive screw 7 If this was a switch interposer card reconnect the I O cable 8 Return to the procedure that directed you here gr zur a Removing the switch planar Attention Removal of the switch planar involves the removal of the switch
27. switch supervisor code 3 8 user s responsibilities xvi using css snap script 3 3 V verification base code 3 8 switch supervisor 3 7 verification and isolation procedures switch supervisor self test 3 6 Index X 3 verification service procedures 3 1 W who should use book xv wrap interposer removing 4 6 replacing 4 7 wrap plugs 1 5 X 4 RS 6000 SP SP Switch2 Service Guide Reader s comments We d like to hear from you RS 6000 SP SP Switch2 Service Guide Publication No GA22 7444 03 Overall how satisfied are you with the information in this book Very Satisfied Satisfied Neutral Overall satisfaction O How satisfied are you that the information in this book is Very Satisfied Satisfied Neutral Accurate Complete Easy to find Easy to understand Well organized Applicable to your tasks OOOOU0 Please tell us how we can improve this book Thank you for your responses May we contact you Yes No Dissatisfied Dissatisfied Very Dissatisfied Very Dissatisfied When you send comments to IBM you grant IBM a nonexclusive right to use or distribute your comments in any way it believes appropriate without incurring any obligation to you Name Address
28. with next highest priority item in the list for this SRN c Otherwise power off this processor node and continue service at E 2 Data cable a Check to see if a switch cable is connected at switch adapter of this processor node 2 of 6 b Reseat switch data cable at switch adapter of this processor node c Run advanced diagnostics on the device cssX where X 0 or 1 and its associated switch port d If diagnostics fail with the previous SRN replace switch data cable e Continue service at 3 SP Switch2 adapter a Replace the switch adapter card on this processor node 3 of 6 b Reconnect all cables to the processor node c Continue service at 4 System or I O planar a Run advanced diagnostics on the Base System or I O planar If a problem is detected use SRN to 4 of 6 service b Replace the system or I O planar on this processor node Make sure to reinstall all parts and cables c Reconnect all cables to the processor node d Continue service at 5 Wrap plug or Check the wrap plug or terminator again to make sure Terminator that it is not at fault 5 of 6 6 All components replaced Call next level of support 6 of 6 Step 0620 01 An SRN listed in indicated that you have a software problem and Priority 1 in directed you to this step Chapter 1 Maintenance Analysis Procedures MAPs 1 25 Switch Function MAP 0620 1 From the node front panel on the
29. 1 5 2 view 2 5 4 Perspectives checking switch status 3 7 fencing nodes 3 10 opening a switch pane 3 7 switch supervisor verification 3 7 unfencing nodes 3 10 placing into service position 3 10 plug locations cable 2 1 plugs wrap 1 5 port switch diagnostics 3 12 power assembly 1 11 power supply removing 4 3 replacing 4 3 prerequisite knowledge for this book xv Procedures ESD 3 1 purpose of book xv task procedures overview xv R rear view of frame locations 2 4 removing 48 V dc circuit breaker assembly 4 8 blank interposer 4 6 fan assembly 4 2 interposer card 4 6 removing continued LED bracket 4 4 LED power extension cable 4 9 power supply 4 3 RS 6000 components 4 1 switch interposer 4 6 switch planar 4 7 switch supervisor card 4 5 wrap interposer 4 6 removing switch from active configuration 3 9 removing switch resources 3 9 replacing 48 V dc circuit breaker assembly 4 9 blank interposer 4 7 fan assembly 4 2 interposer card 4 7 LED bracket 4 4 LED power extension cable 4 10 power supply 4 3 RS 6000 components 4 1 switch interposer 4 7 switch planar 4 8 switch supervisor card 4 6 wrap interposer 4 7 replacing from service position 3 11 request numbers service 1 24 Requirements ESD 3 1 resetting clock and bootlist 3 11 restoring switch resources 3 9 restoring switch to active configuration 3 9 RS 6000 components removing and replacing 4 1 S safety notices ix script using css
30. 10 1 Refresh Perspectives 2 Power on the switch 3 Does Perspectives indicate that the problem is still present e If yes return to the Start MAP 0100 in the e f no go to the End of call procedures MAP 0650 in the dd and troubleshoot the 1 8 _RS 6000 SP SP Switch2 Service Guide Switch environment MAP 0600 Switch environment MAP 0600 Purpose of this MAP This MAP provides diagnostic information for switch problems that are related to the operating environment Note Refer to on page for removing the switch from the service position Step 0600 001 A switch environmental problem has been detected 1 You have observed either The yellow switch supervisor LED is on or flashing e Perspectives switch environmental indicator is yellow or red ne e Errpt message stating Warning Shutdown or Failure O for placing a switch into the service position or The yellow switch supervisor LED is on or the Perspectives environmental indicator is yellow or the Errpt message states Warning go to Step 0600 0021 The yellow switch supervisor LED is flashing or the Perspectives environmental indicator is red or the Errpt message states Shutdown or Failure go to Step 0600 0031 Step 0600 002 You received a switch environment Warning 1 Does this same message occur on other switches or on any processor nodes mounted in the same frame as this switch
31. 2510 99 E3 El v2 H7 10 2210 87 E3 E1 V2 H7 11 2390 94 E3 E2 V7 H8 12 2690 106 E3 E2 NEL H8 13 2870 113 ES El V1 H9 14 2570 101 E3 E1 V1 H9 15 2740 108 E3 E2 V8 H10 16 3050 120 E3 E2 V8 H10 Cable routing in a multi switch frame F C 2032 Figure 2 8 on page 2 11 shows the back view of the RS 6000 SP multi switch frame with frame extension showing the horizontal and vertical paths of cable routing from connector to connector The depths has been amplified on the drawing 2 10 RS 6000 SP SP Switch2 Service Guide 1 93 m frame 16 Hio 15 v Pa ll Ny ja H9 13 IE l it 12 H8 11 y Ny UN v TO H 9 Hnn A is 8 H6 7 v i T T yy YF 6 HS 5 1 qd Ma a Ha 3 vont y E 5 1 I My LA tl Switch Power H1 Eo o Figure 2 8 Frame cable routing paths in rear of RS 6000 SP multi switch frame F C 2032 1 93 m frame Switch data cables SP Switch2 data cables describes the attachment locations and routing for the internal SP Switch2 data cables Table 2 2 SP Switch2 data cable chart Cable Part Number Plug from Location Plug to Location 05N6351 E00 S00 BH J7 E00 N01 BH PA 05N6351 E00 S00 BH J8 E00 N02 BH PA 05N6351 E00 S00 BH J26 E00 N03 BH PA
32. 6000 SP frame 2 2 RS 6000 SP SP Switch2 Service Guide Front and rear views of RS 6000 SP frame Figure 2 1 shows a front view of the RS 6000 SP frame locations a describes the assembly designations for the RS 6000 SP frame SP Frame locations 2 01 m and 1 93 m frames front view 15 16 13 14 11 12 9 10 High Processor Node 5 5 slots 5 8 High Processor Node 1 slots 1 4 1 Switch assembly a i slot 17 Main power switch with LED Left skit Right skirt A B E D 48 V power module locations Front cover skirt and air filter removed Figure 2 1 Front view of frame locations See notes below Figure notes 1 Frames equipped with the SP Redundant Power Supply must have four power modules books installed in the SEPBU Wide processor nodes take up an entire shelf position two thin processor node slots They are identified by the odd numbered position In a F C 2032 frame switch assemblies take up an entire shelf partition They are identified by the even numbered position Processor node slots are numbered up to N16 An SMP High Node takes up 2 shelf positions slots It is identified by the least odd number posit
33. AP 0610 3 If all interposers have been tested go to Step 0610 017 You tested all interposers and the circuit breaker still trips 1 Replace the circuit breaker assembly 2 Check the circuit breaker 3 Does the circuit breaker still trip e If yes go to Step 0610 0181 e If no return to Step 0610 018 You replaced the circuit breaker assembly but the circuit breaker still trips 1 Replace the switch planar 2 Return to 4 to verify fix 4 to verify fix Note If replacing the switch planar does not correct this problem verify fix fails call the next level of support Step 0610 019 The switch circuit breaker is in the On position the input power cable connections appear good and the green switch supervisor LED is Off 1 Replace the switch supervisor card 2 Are both the green switch supervisor and front panel power LEDs On If yes go to Ewitch function MAP 0620 Step 0620 021 on page 1 27 active configuration e If no If both the i switch supervisor and front panel power LEDs are Off go to FStep 0610 0231 and return the switch to the Ifthe front panel power LED is Off but the green switch supervisor LED is On go to EStepl 610 0201 Step 0610 020 The front panel power LED is Off but the green switch supervisor LED is On 1 Replace the switch s LED bracket assembly 2 Is the front panel power LED On If yes go to Switch function MAP 0620 active co
34. Company or Organization Phone No Readers Comments We d Like to Hear from You GA22 7444 03 Fold and Tape Please do not staple Fold and Tape BUSINESS REPLY MAIL FIRST CLASS MAIL PERMIT NO 40 ARMONK NEW YORK POSTAGE WILL BE PAID BY ADDRESSEE IBM Corporation Department 55JA Mail Station P384 2455 South Road Poughkeepsie NY 12601 5400 NO POSTAGE NECESSARY IF MAILED IN THE UNITED STATES Fold and Tape Please do not staple GA22 7444 03 Fold and Tape Cut or Fold Along Line Cut or Fold Along Line Printed in the United States of America amp on recycled paper containing 10 recovered post consumer fiber GA22 7444 03
35. Corp Contents Figures Tables Safety and environmental notices Safety notices in English Danger notices Caution notices j Laser safety information Environmental notices Product recycling and disposal About this book y Who should use this book Related information User s responsibilities How to use this book How to send your comments Chapter 1 Maintenance Analysis Procedures MAPs Switch MAPs Switch description and problem determination MAP 0590 Switch supervisor communications MAP 0595 Switch environment MAP 0600 Switch power MAP 0610 Switch function MAP 0620 Chapter 2 Locations Naming standard for RS 6000 sp components Format structure Location diagrams of the RS 6000 sp components Front and rear views of RS 6000 SP frame Frame locations Switch assembly locations Connector details Cable routing Cable routing in a multi switch frame FIC 2032 Switch data cables ia a ceed Chapter 3 Service procedures Personal ESD requirements Tools and files overview Using the css snap script css snap file structure css snap file package names Disk space handling SP Switch2 supervisor self test Self test Conditions Switch supervisor status verification using Perspectives Opening a switch pane Checking switch status Base code verification oe f Updating the SP Switch2 supervisor code Copyright IBM Corp 2000 2002 Removing
36. D SP Switch2 adapter RDRAM Controller test failed 1 765 2yx3 D SP Switch2 adapter SRAM test failed 1 765 2yx4 D SP Switch2 adapter SRAM Controller test failed 1 765 2yx5 D SP Switch2 adapter DMA test failed 1 765 2yx6 D SP Switch2 adapter WRAP test failed 1 765 2yx7 D SP Switch2 adapter Registers test failed 1 765 2yx8 D SP Switch2 adapter 740 access test failed 1 765 2yx9 D SP Switch2 adapter Reassembly test failed 1 765 2yxA D SP Switch2 adapter Segmentation test failed 1 765 2yxB D SP Switch2 adapter Interrupts adapter 1 1 24 RS 6000 SP SP Switch2 Service Guide Switch Function MAP 0620 Table 1 8 Service Request Numbers SRNs for SP Switch2 adapters continued Service Request SRN Notes Number Source Failing Component Description Notes 1 If y 1 in these SRNs you must troubleshoot the SP Switch2 adapter software SRN 765 x1xx before you follow procedures related to a hardware item 2 x may be any digit Step 0620 012 An SRN was obtained and fable 1 8 on page 1 24 was used to determine the list of possible failing components 1 From the list of possible failing components use the following prioritized table Table 1 9 to perform service Table 1 9 Switch Problem Priority Listing Priority Failing Component Action 1 Software a Have customer verify that the software is configured and operating correctly for this processor 1 of 6 node system b If no problem is found continue
37. Does var adm SPlogs css0 p0 out top file report any problems If yes use the SPS2 Error Conditions table Table 1 6 on page 1 19 to continue service e If no go to FStep 0620 0021 Step 0620 002 No functional problems found 1 Have you replaced any components or fixed problems e If yes a You have resolved the switch problem b Go to End of call MAP 0650 in e If no go to Step 0620 003 You did not find any functional problems and you did not fix or replace anything 1 Did Estart command start okay e If yes call the next level of support e If no a Consult the Diagnosing Switch Problems section of Parallel System Support Programs for AIX Diagnosis Guide GA22 7350 1 18 RS 6000 SP SP Switch2 Service Guide b Return to Table 1 6 SP Switch2 error conditions Switch Function MAP 0620 Error Device Message Link Message Description and Action 2 Initialized N A Description Initialization detected a wrapped port where a processor node was expected this may result from isolation procedures or else a disconnected cable Action 1 If this is an unexpected condition check cabling against the configuration file var adm SPlogs cssX p0 out top where X 0 or 1 and review the appropriate miswire file var adm SPlogs cssX p0 cable_miswire where X 0 or 1 If the processor node can be reconnected remove the wrap plug and connect the data cable betwee
38. J6 To run the test from the control workstation for this example the syntax of the command is usr Tpp ssp bin spd wrap_test j E01 S17 BH J6 The wrap test will indicate when to use the following items that are supplied as part of the ship group e Wrap cable e Wrap plug e Interposer wrap card 3 12 RS 6000 SP SP Switch2 Service Guide Chapter 4 FRU removals and replacements Handling static sensitive devices SP Switch2 service procedures Removing a fan assembly Replacing a fan assembly Removing a power supply Replacing a power supply Removing the LED bracket assembly Replacing the LED bracket assembly Removing the switch supervisor card Replacing the switch supervisor card Removing an interposer card Replacing an interposer card Removing the switch planar Replacing the switch planar Removing the 48 V de circuit breaker assembly Replacing the 48 V dc circuit breaker assembly Removing the LED power extension cable Replacing the LED power extension cable 4 1 4 2 4 2 4 2 4 3 4 3 4 4 4 4 4 5 4 6 4 6 4 7 4 7 4 8 4 8 4 9 4 9 4 10 This chapter describes the removal and replacement of RS 6000 SP product specific Field Replaceable Unit FRU components Attention Components in the frame are susceptible to damage from static discharge Always use an ESD wristband when working inside frame covers See more details Do not touch the pins
39. MAL mode Make sure all processor nodes are IPLed completely in NORMAL mode 2 If any processor nodes lost connection to the switch due to unplugging node data cable you will need to include them in the following command From the control workstation enter dsh w nodelist usr lpp ssp css rc switch where nodelist is a list of node names separated by commas Note When working with a two plane SP Switch2 system add the adapter name to the command as follows dsh w nodelist usr lpp ssp css rc switch a lt adapter_name gt OR if all processor nodes have lost switch connection enter Chapter 1 Maintenance Analysis Procedures MAPs 1 27 Switch Function MAP 0620 dsh a usr lpp ssp css rc switch Note When working with a two plane SP Switch2 system add the adapter name to the command as follows dsh a usr lpp ssp css rc switch a lt adapter_name gt Example dsh w fr2n03 fr2n04 fr3n01 usr lpp ssp css rc switch Attention Issuing this command on processor nodes that did not lose a connection may cause unpredictable results 3 Have customer start the switch code from the control workstation by entering Estart 4 Check var adm SPlogs css0 p0 out top file on the primary node l to verify that there are no other switch problems 1 28 RS 6000 SP SP Switch2 Service Guide Chapter 2 Locations Naming standard for RS 6000 SP ONE 2 oe ee ee ee ee ee ee ee Format structure pact amp bog Bom woe
40. RS 6000 SP SP Switch2 Service Guide GA22 7444 03 RS 6000 SP SP Switch2 Service Guide GA22 7444 03 Note Before using this information and the product it supports read the information in bage bl and MaCs on page Aci Fourth edition April 2002 IBM welcomes your comments A form for readers comments may be provided at the back of this publication or you may address your comments to the following address International Business Machines Corporation Department 55JA Mail Station P384 2455 South Road Poughkeepsie NY 12601 5400 United States of America FAX United States amp Canada 1 845 432 9405 FAX Other Countries Your International Access Code 1 845 432 9405 IBMLink United States customers only IBMUSM10 MHVRCFS Internet e mail mhvrcfs us ibm com If you would like a reply be sure to include your name address telephone number or FAX number Make sure to include the following in your comment or note e Title and order number of this book e Page number or topic related to your comment When you send information to IBM you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you Copyright International Business Machines Corporation 2000 2002 All rights reserved US Government Users Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM
41. SFC002 CAUTION The covers are to be closed at all times except for service by trained service personnel SPSFC003 CAUTION When the unit is being serviced the covers should not be left off or opened while the machine is running unattended SPSFCO004 Safety and environmental notices xi CAUTION Due to weight of each thin node under 18 Kg 40 Ibs use care when removing and replacing thin nodes above shoulder height SPSFC005 CAUTION The wide node weight may exceed 32 Kg 70 5 Ibs SPSFC006 CAUTION Do not open more than one wide node or switch assembly drawer at a time SPSFC007 CAUTION Make sure the stability foot and wheel chocks are installed on the frame These are required to maintain frame balance and position during service operations SPSFC008 CAUTION Outer edges of chassis may be sharp Care must be taken when removing and installing chassis SPSFC009 CAUTION The ground strip may have sharp edges SPSFCO10 CAUTION Do not remove wide nodes or switch assemblies from the mounting slides Caution must be observed when working with mounting slides to prevent pinched fingers or accidental release of the unit SPSFCO11 CAUTION Do not remove the drawer case mounting screws at the bottom of both sides SPSFC012 CAUTION Once the latch is released push the drawer closed Do not pull as the drawer may disengage from the rails creating a safety hazard SPSFC013 CAUTION Du
42. anslated into other national aa which are compiled from all the books in the library GA22 7441 Installation and relocation procedures maintenance agreement and qualification procedures SP system verification GA22 7442 General SP system service procedures the system Start MAP and MAPs and parts catalog for the frames and power subsystems Use this book to begin a diagnostic procedure to isolate a problem to a specific major component of the SP system uida GA22 7444 Service procedures MAPs and parts catalog information specific to the SP Switch2 this book GA22 7445 Service procedures MAPs and parts catalog information specific to all uniprocessor type nodes parts catalog information specific to this node This book and other RS 6000 SP hardware and software documentation are available both online and for some books in printed form from the following sources e The Web site at http www ibm com servers eserver pseries library sp_books index html e The Resource Center on the PSSP product media e Printed and CD ROM versions which can be ordered from IBM For more information on these sources and an extensive listing of RS 6000 SP related publications see the bibliography in Copyright IBM Corp 2000 2002 XV User s responsibilities Before calling IBM for service the system administrator should use the problem determination section of the Parallel System Support Programs for AIX
43. ayed spsvrmgr Frame Slot Supervisor Media Installed Required State Versions Version Action 1 0 Active u_10 3c 0721 u_10 3c 0721 Upgrade u_10 3c 0723 1 Active u_10 2e 0702 u_10 2e 0704 None u_10 2e 0704 5 Active u_10 2e 0702 u_10 2e 0704 None u_10 2e 0704 13 Active u_90 10 071b u_90 10 071c None u_90 10 071c 14 Active u_90 10 071b u_90 10 071c None u_90 10 071c 17 Active u_90 00 070a u_90 00 071e None u_90 00 070c u_90 00 070e Updating the SP Switch2 supervisor code Note Neither the SP Switch2 circuit breaker nor the inline switch need to be in the On 1 position to 1 DAN load new supervisor code From the control workstation enter smitty supervisor Select List Supervisors That Require Action Note the frame number and slot number Press PF3 Cancel Select Update Selectable Supervisors That Require Action Enter the frame number and slot numbers to be updated Note This will take at least 12 minutes to complete Return to the procedure that directed you here 3 8 RS 6000 SP SP Switch2 Service Guide Removing and restoring switch resources This procedure can be performed to allow customer to use a switch feature while extended service actions are performed on an individual frame of a multi frame system with the switch feature DO NOT PERFORM this procedure unless the required service operation will take the switch out of the switch configuration for a minimum of two hours for example a part mu
44. ble electrical shock during machine installation relocation or reconfiguration connect the primary power cable only after connecting all electrical signal cables SPSFD007 DANGER High voltage present Perform Lockout safety procedures to remove primary power to the frame SPSFDO008 DANGER High voltage present Perform Lockout safety procedures to remove primary power to the frame and high voltage transformer if present SPSFD009 DANGER High voltage present at test points Use high voltage test probes SPSFDO10 DANGER High energy present Do not short 48V to frame or 48VRtn Shorting will result in system outage and possible physical injury SPSFDO11 DANGER If a unique power module fails all LEDs will be off The high voltage LED will be off even though the high voltage is still present SPSFDO12 DANGER The remaining steps of the procedure contain measurements that are taken with power on Remember that hazardous voltages are present SPSFDO13 X RS 6000 SP SP Switch2 Service Guide DANGER The frame main circuit breaker and the controller must not be switched on again now Before disconnecting the power cables from the power receptacles ensure that the customer s branch distribution circuit breakers customer power source circuit breakers are Off and tagged with DO NOT OPERATE tags S229 0237 Refer to Lockout safety procedures
45. ble generator after initialization router log old Primary A copy of router log from a previous var adm SPlogs css0 p0 run Using the css snap script The css snap script is located in the usr lpp ssp css directory When the script runs it collects log trace and dump files created by SP Switch2 support code device driver worm fault service daemon and diagnostics into a single compressed package Attention css snap uses a number of undocumented utilities to collect information Some of these can be destructive when used on a running system After using css snap to collect diagnostic information it s best to run usr lpp ssp css rc switch in order to reset and reload the switch adapter and eliminate residual effects of these utilities This procedure should be used only under the direction of the IBM Support Center When working with a two plane SP Switch2 system add the adapter name to the command as follows dsh a usr lpp ssp css rc switch a lt adapter_name gt The css snap script is called whenever a serious error is detected by the switch support code You can direct the system to create a snapshot by loging into the desired node and manually issuing the command lusr Ipp ssp css css snap with any of the optional flags c n s a cssX where X 0 or 1 p p0 where e c Flushes the adapter cache and prints the result This is the default Chapter 3 Service procedures 3 3 e n Assumes t
46. bvious connection problem to verify fix Step 0620 018 The var adm SPlogs css0 p0 out top file indicated a switch problem and all connection appeared to be okay Note Be aware that in large systems connections for switch assemblies not in the multi switch frame are usually scattered throughout the out top file 1 If this is a multi frame system check the indicated interposers against the wiring charts for multi frame switch systems 2 Is this a multi frame system with problems reported on all switch data cables from one or more switches e If yes a Determine if a power or environmental problem exists on that switch 1 26 RS 6000 SP SP Switch2 Service Guide Switch Function MAP 0620 e If no go to FStep 0620 0191 Step 0620 019 Some but not all switch data cables appear to be having problems 1 Depending on whether the problem is a wrapped port or a switch to switch connection perform one of the following steps e Wrapped port wrap plug installed Remove the existing wrap plug Install a different wrap plug on the interposers indicated e Switch to switch connection Disconnect the switch data cable from both ports indicated Install wrap plugs on the interposers indicated Note When unplugging the two ends of the suspect cable check var adm SPlogs css0 p0 out top to verify only two 2 ports were lost If four 4 ports were lost then two cables were swapped across that switch to switch connection Connec
47. c switch log node nodes Fault service daemon initialization information rc switch log previous node nodes Node s previous fault service daemon initialization information regs out adapter nodes Most recent css snap s read_regs command dump file SP Switch2 adapter s registers dump file router log port nodes SP Switch2 routing information scan_out log adapter nodes TBIC scan ring binary information scan_save log adapter nodes Previous TBIC scan ring binary information spd trace port control workstation Tracing of advanced switch diagnostics spdata out port primary node Most recent css snap s splstdata command dump file SP Switch2 data requests 3 5 Chapter 3 Service procedures Table 3 4 SP Switch2 log files continued Log File Information Level File Location File Contents topology data port primary node System error messages from the distribution of the topology file to the secondary nodes Note The files ending in out are produced by running the appropriate command to dump internal in memory trace information or dump data to a file The complete package of output files will be found in var adm SPlogs css css snap file package names Once the css snap script creates the package of compressed files the package file is given a name that varies according to the flags used with the css snap command If the a and p flags are not used The file name is hostname yy
48. case the user will be required to take adequate measures Radio protection for Germany Dieses Ger t ist berechtigt in bereinstimmung mit Dem deutschen EMVG vom 9 Nov 92 das EG Konformit tszeichen zu f hren Der Aussteller der Konformit tserkl rung ist die IBM Germany Dieses Ger t erf llt die Bedingungen der EN 55022 Klasse A F r diese von Ger ten gilt folgende Bestimmung nach dem EMVG Ger te d rfen an Orten f r die sie nicht ausreichend entst rt sind nur mit besonderer Genehmigung des Bundesministers f r Post und Telekommunikation oder des Bundesamtes f r Post und Telekommunikation betrieben werden Die Genehmigung wird erteilt wenn keine elektromagnetischen St rungen zu erwarten sind Auszug aus dem EMVG vom 9 Nov 92 Para 3 Abs 4 Hinweis Dieses Genehmigungsverfahren ist von der Deutschen Bundespost noch nicht ver ffentlicht worden Notices A 3 A 4 RS 6000 SP SP Switch2 Service Guide Index Numerics 0375867 05N6603 05N6647 08J5557 11J4774 11J5155 11J5189 11J5191 11J5193 11J5195 11P0006 11P0097 11P0492 11P1636 12K0486 12K0487 12K0606 2113088 2113089 2113090 2113091 2113966 2113967 2113969 3117106 3117109 3117112 3117113 3117137 3117152 3118514 3118515 3118752 44P0769 44P0771 44P1029 44P1030 44P1031 44P1032 46G9698 46G9699 46G9700 46G9701 46H9688 48 V dc circuit breaker assembly 5 9 5 13 5 3 5 5 5 3 5 9 5 9 5 9 5 13 5 9 5 9 5
49. ce Guide Safety and environmental notices Safety notices in English For general information concerning safety refer to Electrical Safety for IBM Customer Engineers S229 8124 For a copy of this publication contact your IBM marketing representative or the IBM branch office serving your locality The following is a list of all safety notices in English only pertaining to SP hardware maintenance tasks from this and other RS 6000 SP hardware publications Translations of each of the safety notices into other languages are included in B3000 EP Satay Informallarl DANGER notices warn you of conditions or procedures that can result in death or severe personal injury CAUTION notices warn you of conditions or procedures that can cause personal injury that is neither lethal nor extremely hazardous Each notice contains a reference number SPSFXXXxX which you can use to help find a specific notice in other languages Danger notices DANGER Do not attempt to open the covers of the power supply Power supplies are not serviceable and are to be replaced as a unit SPSFDOOT DANGER An electrical outlet that is not correctly wired could place hazardous voltage on metal parts of the system or the devices that attach to the system It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock Before installing or removing signal cables ensure that th
50. ch supervisor LED ON or FLASHING e f the switch supervisor LED is ON or FLASHING return to determine if any other conditions exist If no obvious problems are found call next level of support e If the switch supervisor LED is not ON or FLASHING a You have resolved the problem b Go to Step 0620 021 on page 1 27 to verify fix Step 0600 009 You found an obvious airflow blockage or abnormally high temperature source near air intakes 1 Remove blockage or high temperature source 2 Return to to verify fix Step 0600 010 Perspective display shows PS X Failure on a red background 1 Use Table 1 5 to service components 2 Refer to K component being serviced for instructions about the Table 1 5 Power supply failure diagnostics Priority Component Action 1 Power Supply 1 2 3 or 4 a Replace the power supplies 1 of 4 b Continue at Step 0600 0111 2 Switch supervisor card a Replace the card 2 of 4 b Continue at FStep 0600 0111 gt Switch planar a Replace planar chassis 3 of 4 b Continue at Step 0600 0111 4 All replaced Call next level of support 4 of 4 Step 0600 011 You performed the recommended action in fable 1 5 1 Component replaced or reseated 2 Check the yellow switch supervisor LED for an On or flashing condition 1 12 RS 6000 SP SP Switch2 Service Guide Switch environment MAP 0600 3 Is the yellow switch supervisor LED On or
51. control workstation put the node in the SERVICE mode 2 Power on this processor node 3 Go to Step 0620 0141 Step 0620 014 At this point you must run the advanced diagnostics in service mode on the device cssX where X 0 or 1 and its associated switch port 1 Did you get an SRN from the diagnostics e If yes go to Step 0620 0161 e If no go to EStep 0620 0151 Step 0620 015 Since the diagnostics did not return an SRN no problem was detected 1 Have you just reseated repaired or replaced a component e If yes go to A to verify fix e If no a Problem is in the switch assembly to service or replace switch assembly Step 0620 016 The advanced diagnostics returned an SRN indicating that the diagnostics detected a problem 1 Is this SRN the same as the previous SRN e If yes go to in the list for this SRN e If no go to Step 0620 017 An error message in the var adm SPlogs css0 p0 out top file indicated that you either have an external switch connection problem Priority 3 in able 1 7 on page 1 24 directed you to this step 1 Check the specified jacks at rear of switch assemblies for an obvious problem such as a loose connection 2 Pay special attention to cables that may have been moved recently 3 Do connections appear to be okay If yes go to Step 0620 0181 e If no Alto perform service on the next highest priority component to service the new SRN a Fix the o
52. ctive configuration Placing an SP Switch2 into service position Note Make certain the switch has been removed from the active configuration before placing the switch into the service position Place the switch circuit breaker in the Off 0 position Set the inline switch on the power cable to the Off 0 position At the rear of the switch remove the power cable from slot J1 and the supervisor cable from slot J2 Record the positions of all switch cables connected to the interposers in slots J3 through J34 Remove the switch cables Remove the switch mounting screws from the front of the frame Remove the switch by sliding it out of the front of the frame NOOO RWON gt 3 10 RS 6000 SP SP Switch2 Service Guide Replacing an SP Switch2 from service position Note Make certain the switch has been returned to the active configuration after replacing the switch Oh Gn Go Nees from the service position Install the switch by sliding it into the front of the frame Reinstall the screws holding the switch to the front of the frame Reconnect all switch cables to their recorded interposer positions Reattach the power cable to slot J1 and the supervisor cable to slot J2 Set the inline switch to the On 1 position Place the switch circuit breaker in the On 1 position Resetting the clock and bootlist after servicing a node When servicing a node the node becomes disconnected from its power sourc
53. d and both the switch front panel and green switch supervisor LEDs remain Off 1 Replace the switch planar 2 Are both power LEDs On e If yes go to Switch function MAP 0620 active configuration e If no call the next level of support Switch function MAP 0620 Purpose of this MAP en 0620 0 on page A and return the switch to the ep 0020 0 on page A and return the switch to the This MAP provides diagnostic information for problems related to the SP Switch2 function Notes 1 Refer to Appendix A in allation and Relocation for frame to frame or switch to switch cables Logical frame to physical frame translation information can also be found in this appendix 2 Refer to Ol for placing or removing the switch into or from service position Step 0620 001 A message in Perspectives indicated that you have a switch function problem and Hable 1 1 on page 1 9 directed you to this MAP 1 To complete the following procedures you will need to have primary node root access Customer may enter root password when required 2 If either of the following two conditions is true e Estart has not been run by the customer e The CE has already replaced components that might affect the switch Then from the control workstation enter Estart Chapter 1 Maintenance Analysis Procedures MAPs 1 17 Switch Function MAP 0620 You should receive a message indicating successful initialization If you receive
54. des entries for the switch will refer to node17 or slot17 In a multi switch frame switches will be listed as even slot addresses o y Female Wrap Plug Male Wrap Plug Figure 1 2 SP Switch2 Wrap Plugs Notes 1 SP Switch2 advanced diagnostics use the 8 75 meter data cable provided by the SPS feature bill of material 2 Advanced cable wrap tests will not run successfully for 10 15 and 20 meter SPS data cables If these data cables are used change the suspected cable 3 Refer to in Chapter 5 Parts catalog for the wrap plug part numbers Table 1 1 Switch Problem Diagnostics Priority Message or condition Action 1 Supervisor communication problem e Yellow switch supervisor LED on green LED off MAP 0495 on page 1 of 4 e Perspectives switch pane indicates problem with 48 volts but other voltages are OK e Perspectives switch pane shows several gray icons with question marks Fans are running but green LEDs on all interposer cards and all power supplies are off Note Power supply LEDs are viewable through the fan assemblies Note For information on opening a Perspectives Chapter 1 Maintenance Analysis Procedures MAPs 1 5 Switch Description and Problem Determination MAP 0590 Table 1 1 Switch Problem Diagnostics continued Priority Message or condition Action 2 Environmental problems e Control w
55. e fan removed 1 Replace the fan 2 Return to Step 0610 012 You removed a fan power supply pair and the circuit breaker still trips 1 Reinstall the fan power supply pair e If you have tested all fan power supply pairs go to Step 0610 0131 2 Remove the next fan power supply pair 3 Return to 4j and test the next fan power supply pair Step 0610 013 You tested by removal and replacement all fan power supply pairs and the circuit breaker still trips 1 Remove the switch supervisor card 2 Check the circuit breaker 3 Does the circuit breaker still trip e If yes reinstall the switch supervisor card and go to Step 0610 0141 e If no replace the switch supervisor card and return to Step 0610 014 You removed the switch supervisor card but the circuit breaker still trips 1 Remove all interposer cards to isolate 2 Check the circuit breaker 3 Does the circuit breaker trip e If yes go to e If no go to Step 0610 015 1 Reinstall the interposer cards one at a time 2 Does the circuit breaker trip e If yes replace the interposer and return to beginning of this step to test the replacement interposer e If no go to Step 0610 016 1 Reinstall the next interposer card 2 Return to and check that the circuit breaker does not trip 4 to verify the replacement 4 to verify the replacement fan 4j to verify fix Chapter 1 Maintenance Analysis Procedures MAPs 1 15 Switch power M
56. e for a period of time Since nodes normally do not have a real battery the NVRAM will loose it s memory when disconnected from power for about 10 minutes Sometimes less This will cause the date to be reset to January 1 1970 and the bootlist to be cleared This can cause some problems with booting It is highly recommended to reset the clock and bootlist before booting the node This is done as follows 1 Before powering down the node to be serviced display the current bootlist Run diagnostics diag Choose the Service Aids panel Choose the Display Alter Bootlist panel Choose Normal Mode Choose Display Current Bootlist oaoop This will display the current bootlist Power down the node service it and hook it back into the frame On the control workstation run spbootins to set the node to boot in maintenance mode For example if it is node 12 of frame 2 enter spbootins r maintenance 2 12 1 On the control workstation netboot the node From the SP Perspectives Launch Pad select Hardware Perspectives Click on the processor node or nodes you are going to boot from a network Click on Actions button on the tool bar Verify the nodes selected then click on the Apply button IPL from network device begins oaoop Note If Packets Received always shows 00000 there is a network or configuration problem When this boots a console window will pop up on your display Follow the prompt
57. e power cables for the system unit and all attached devices are unplugged When adding or removing any additional devices to or from the system ensure that the power cables for those devices are unplugged before the signal cables are connected If possible disconnect all power cables from the existing system before you add a device Use one hand when possible to connect or disconnect signal cables to prevent a possible shock from touching two surfaces with different electrical potentials During an electrical storm do not connect cables for display stations printers telephones or station protectors for communications lines SPSFD002 DANGER In the U S Canada and Japan this product has a 4 wire power cable with a 4 prong plug Use this power cable with a correctly grounded power receptacle to prevent possible electric shock SPSFD003 DANGER Copyright IBM Corp 2000 2002 ix Before you connect the power cable of this product to ac power verify that the power receptacle is correctly grounded and has the correct voltage SPSFD004 DANGER During an electrical storm do not connect or disconnect any cable that has a conductive outer surface or a conductive connector SPSFD005 DANGER Switch off power and unplug the machine power cable from the power receptacle before removing or installing any part that is connected to primary power SPSFD006 DANGER To prevent possi
58. e to the weight of each wide node use care when sliding and closing wide processor nodes above shoulder height SPSFC014 CAUTION When moving frames into position team members should work together Using one person on each corner of the frame can prevent strain e In raised floor installations mechanically safe moldings should be installed around floor cutouts Extreme caution should be used when moving frames during installation or removal because of the proximity of floor cutouts to casters SPSFC015 Xii RS 6000 SP SP Switch2 Service Guide CAUTION When using step ladder or step stool be sure that the work surface is level and the step ladder or step stool is in good working order SPSFCO16 CAUTION Portable ladders present a serious safety hazard if not used properly Follow these general guidelines e Make sure the ladder is firm and steady and has no defective rungs or braces e Work only on a level surface e Never use a metal ladder near electrical power lines Never overreach Instead move the ladder Be as careful on a short ladder as on a 30 foot extension ladder False security can lead to carelessness and falls which can cause painful injuries SPSFCO017 CAUTION All IBM laser modules are designed so that there is never any human access to laser radiation above a class 1 level during normal operation user maintenance or prescribed service conditions Data processing environments can contain eq
59. etermination MAP 0590 DOO OOOO OOOO ee ee LJ J2 Supervisor Card EDDIE OIEA INLAND QUAN AL J34 OOOO OOOO OOOO OOOO O LED Power Extension Cable GO DODO OOOO Tray Tray O dia supply Power supply Power supply Power supply 2 3 4 Plu ns Fan Fan Fan Fan 1 2 3 4 LED Bracket Assembly Figure 1 1 SP Switch2 Assembly High Level Diagram There are two LEDs on the front of each switch assembly For quick reference their definitions are as follows Chapter 1 Maintenance Analysis Procedures MAPs 1 3 Switch Description and Problem Determination MAP 0590 Yellow Environment LED Off No environmental problems detected by switch supervisor card On Warning of environmental condition out of nominal range Preventative Maintenance should be scheduled for this switch Flashing Serious environmental condition detected power shut off Green Power LED Off No 48 V dc power available at switch assembly Flashing Power available at switch assembly but switch logic is Off On Power available at switch assembly and logic is On Note Refer to into or from service position Step 0590 001 Read the following warning and then follow steps to ensure continuity of customer s jobs in the queue Q for placing or removing the switch assembly Attention Servicing a
60. evel File Location File Contents core node nodes Fault service daemon core dump file css snap log node nodes css snap snapshot command log information Contains a list of all files gathered in the last snapshot CSS _test log node nodes Present if the CSS_ test command was run on the node daemon log node nodes Fault service daemon output file DeviceDB dump port nodes Latest dump of the device data base from the fault service daemon Ecommands log node control workstation Log entries of all Ecommands emasterd log node control workstation TOD Management emasterd daemon collected errors and notifications emasterd stdout node control workstation More detailed trace file from TOD Management emasterd daemon errpt out node nodes Most recent errpt a and errpt results flt port nodes Hardware error conditions found on the SP Switch2 recovery action taken by the fault service daemon and general operations that alter theSP Switch2configuration fs_daemon_print file port nodes Fault service daemon port status information ifcl_dump out adapter nodes Most recent css snap s ifcl_dump command dump file IP dump information logevnt out node nodes Log error log events monitored by ha netstat out adapter nodes Most recent css snap s netstat command dump file Network status information odm out adapter nodes The node s adapter_status configuration as saved in the ODM out top port nodes SP Switch2 plane link information r
61. hat the device driver or daemon has flushed the cache e s Takes a soft snap which does not dump the adapter state This excludes the col_dump out This flag is used for temporary errors TYPE TEMP where the integrity of the adapter is in doubt or when it is not desirable to corrupt the adapter state by the use of diagnostic routines e a Specifies a single adapter When this flag is not used all the node s configured adapters will be selected This is the default e p Specifies a single port on a specified adapter hence a specific plane This option must be used together with the a option When this flag is not specified all the adapter s ports are selected This is the default Collect the css snap information from both the primary node and all nodes that are experiencing SP Switch2 problems Do not reboot the nodes before running css snap because rebooting causes the loss of valuable diagnostic information css snap file structure The files collected by running the css snap script are organized into the following hierarchy of directories var adm SPlogs css e Node global level log file e Contains information relevant to all the ports and adapters in the node var adm SPlogs cssX where X 0 or 1 e Adapter level log file the 0 in cssO refers to the adapter id e Contains information relevant to all the ports on a specific adapter var adm SPlogs cssX p0 where X 0 or 1 e Port level log file the O in pO is the port nu
62. he fan bay back and upward to expose the card guide tracks on the chassis framework Align the power supply card with the guide tracks and insert the card Seat the assembly and engage the two locking levers by rotating them inward Replace the fan Chapter 4 FRU removals and replacements 4 3 SP Switch2 service procedures Removing the LED bracket assembly Note The LED bracket assembly is hot pluggable 1 Remove the fan assembly housing the LED bracket assembly 3 Remove the LED bracket assembly Note If you are replacing a failed fan save the LED bracket assembly for use with the new fan LED bracket assembly Fan assembly LED bracket retaining screw Figure 4 3 Removing SP Switch2 power and environmental LED assembly Replacing the LED bracket assembly 1 Mount the LED bracket assembly in the fan assembly 2 Secure the LED bracket assembly to the fan assembly side wall with the mounting screw 3 Replace the fan assembly 4 Return to the procedure that directed you here 4 4 RS 6000 SP SP Switch2 Service Guide SP Switch2 service procedures Removing the switch supervisor card Note The switch supervisor card is hot pluggable Note Refer to Handling 1 Remove the switch supervisor cable from the supervisor card located in slot J2 2 Loosen the captive screw holding the card retention bracket to the switch chassis 3 Swing the bracket out and remove it from the swi
63. he product s and or the program s described in this publication at any time without notice IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you Trademarks The following terms are trademarks of the International Business Machines Corporation in the United States or other countries or both AIX IBM IBMLink POWERstation RS 6000 SP Other company product and service names may be the trademarks or service marks of others Copyright IBM Corp 2000 2002 A 1 Electronic emissions notices Federal Communications Commission FCC statement This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits IBM is not responsible for any radio or television i
64. he switch for faults It lusr Ipp ssp css restarts the switch if a fault is detected css snap All nodes Collects log trace and dump lusr Ipp ssp css CWS information created by SP Switch2 support code device driver worm fault service daemon diagnostics rc switch All nodes Starts the daemons and IP lusr Ipp ssp css configuration tools Note When working with a two plane SP Switch2 system add the adapter name to the command as follows lusr Ipp ssp css rc switch a lt adapter_name gt Estart Primary or Tunes the switch and puts in into run usr lpp ssp bin Control phase Also kicks off the route table Node generator and distributes the routes to the nodes by placing them in the etc SP directory on the control node Eprimary All nodes Sets a node as the primary node lusr Ipp ssp bin Etopology All nodes Stores switch topology information in usr lpp ssp bin the System Data Repository for a node or a series of nodes Also retrieves a topology files out of the SDR ifconfig All nodes This sets up the IP interface to the NA switch AIX command Table 3 2 Setup output files File Location Description Directory rc switch log All nodes Logs all information on the last run var adm SPlogs css of rc switch It will indicate if this is a primary or secondary node the associated switch chip information and IP address information rc switch log previous All nodes A copy the previous run of var adm SPlogs css rc switch
65. hes the switch address Yellow LED goes off for about two seconds green LED stays off Both LEDs light for about one second Upon self test completion e Green LED should be on if the self test was performed with switch power on e Green LED should be off if the self test was performed with switch power off PUDO NS Fail conditions e Green and Yellow LEDs never light e Yellow LED flashes wrong address e Yellow LED is on steady Switch supervisor status verification using Perspectives To verify the switch supervisor status you must click the switch icon located on a Perspectives switch pane e If a switch icon is not visible go to e If a switch icon is visible go to Opening a switch pane Unless you have saved display settings the Hardware Perspective does not open with a switch pane displayed To open a switch pane from the Hardware Perspectives window 1 Click the Add Pane icon on the tool bar e The Add Pane dialog box opens From the Pane Type pulldown select Frames and Switches Select your choice of adding the pane to the current window or to a new window If desired enter a new pane title Click OK to open the pane and close the dialog box You may repeat these steps to add additional switch panes ES Checking switch status 1 In the Frame and Switch pane click the icon of the switch you want to verify e A switch icon is displayed next to the frame icon only if a switch is installed in the f
66. ication adapters The batteries must be recycled or disposed of properly Recycling facilities might not be available in your area In the United States IBM has established a collection process for reuse recycling or proper disposal of used sealed lead acid nickel cadmium and nickel metal hydride batteries and battery packs from IBM equipment For information on proper disposal of batteries in this product please contact IBM at 1 800 426 4333 For information on disposal of batteries outside the United States contact your local waste disposal or recycling facility Safety and environmental notices Xili XIV RS 6000 SP SP Switch2 Service Guide About this book This book covers the SP Switch2 only Refer to information related to the SP Switch 3 GA22 7443 for This book is to help you as a customer engineer diagnose and repair an RS 6000 SP SP Switch2 by performing the following tasks e Identify field replaceable unit FRU locations e Isolate RS 6000 SP failures using Maintenance Analysis Procedures MAPs e Perform diagnostic service procedures e Perform removal and replacement procedures e Identify FRUs and their corresponding part numbers Who should use this book This book is intended for RS 6000 SP product trained service personnel Related information The following books make up the complete RS 6000 SP hardware service library E RS 6000 SP Safety Information GA22 7467 Safety notices in English and tr
67. ing e If yes return to If no go to EStep 0620 021 on page 1 271 Step 0600 006 Perspectives indicated a shutdown temperature condition and Hable 1 3 on page 1 9 directed you to this step A and continue service with the next highest priority Temperature is out of specified range however no serious electrical current or fan speed problems have been detected 1 Check for airflow blockage at air intakes and exhaust of the switch assembly and system frame Also check air temperatures around the frame looking for sources of abnormally high temperatures above 40 C or 104 F 2 Is there an obvious airflow blockage or abnormally high temperature source near air intakes e If yes go to e If no go to Chapter 1 Maintenance Analysis Procedures MAPs 1 11 Switch environment MAP 0600 Step 0600 007 You are here for one of the following reasons e An over temperature condition exists e You fixed an obvious airflow blockage or removed a high temperature source near the air intakes e A problem with the switch supervisor card sensors may exist For any of the reasons listed above 1 Perform 2 Does the card pass self test e If yes go to Step 0600 00811 e If no replace the switch supervisor card If the problem persists call the next level of support Step 0600 008 The switch supervisor card passed the self test 1 Check the yellow switch supervisor LED for ON or FLASHING condition 2 Is the yellow swit
68. ion of the occupied slots Chapter 2 Locations 2 3 Figure 2 3 shows a front view of the RS 6000 SP multi switch frame SP Switch Frame Locations Front View D Switch AsmS16 D Switch AsmS14 Switch Asm 12 O Switch AsmS10 Switch Asm S8 I Switch Asm S6 0 Switch Asm S4 Switch Asm S2 MainPower lt L Switch with A LED Lo H H H LeftSkit el Right Skirt al A B C 48 V Power Modules Front Cover and Skirt and Air Filter Removed Figure 2 2 Front view of multi switch frame locations Figure 2 3 on page 2 5 shows a rear view of the RS 6000 SP frame locations 2 4 RS 6000 SP SP Switch2 Service Guide SP Frame Locations Rear View
69. mber on the adapter e Contains information relevant to a specific port Files collected by css snap The css snap script collects all the files which reside in the var adm SPlogs css node level var adm SPlogs css0 adapter level and var adm SPlogs css0 p0 port level directories and some additional files from the tmp directory Some of the files reside on each node while others reside only on the primary node or on the control workstation Under normal circumstances the css snap script will collect the following files Table 3 4 SP Switch2 log files Log File Information Level File Location File Contents adapter log adapter nodes Adapter status information from the fault service daemon cable_miswire port primary node Node to switch or switch to switch plane miswired connection information cadd_dump out node nodes Most recent css snap s cadd_dump command dump file SP Switch2 adapter device driver trace buffer dump file chgcss log node nodes Log file of chgcss which changes the adapter device driver s attributes col_dump gsd adapter nodes The most recent css snap s col_dump command dump file Microcode dump information colad trace adapter nodes SP Switch2 adapter diagnostics messages 3 4 RS 6000 SP SP Switch2 Service Guide Table 3 4 SP Switch2 log files continued Log File Information L
70. mmddhhmmss css snap tar Z If a cssX where X 0 or 1 is used but p is not specified The file name is hostname yymmddhhmmss adapter0 css snap tar Z If a cssX where X 0 or 1 and p p0 are both used The file name is hostname yymmddhhmmss adapter0 port0 css snap tar Z Hostname is the name of the node where the css snap command was issued and yymmdahhmmss is the date and time that the information was collected Disk space handling css snap avoids flooding var by following these rules e If less than 10 of var is free css snap exits e If the CSS portion of var is more than 30 of the total space in var css snap erases old snap files until the CSS share sinks below 30 If successful css snap proceeds If not it exits SP Switch2 supervisor self test The following procedures will help you perform self test on the switch supervisor card Upon completion of this test return to the procedure that sent you here 1 Detach supervisor harness from connector at back of the unit Detaching the supervisor harness removes the 12 volt power from the supervisor card 2 Reinsert the supervisor harness to perform the supervisor card self test 3 Check green and yellow LEDs on the switch supervisor card for the self test conditions listed below 3 6 RS 6000 SP SP Switch2 Service Guide Self test Conditions 22 Pass sequence Both LEDs light for about 10 seconds Both LEDs go off Green LED stays off while the yellow LED flas
71. n the switch assembly and the processor node If the processor node is to be permanently removed have the customer update the switch topology If problem is on board connection as indicated by out top or Estart_sw 0028 331 Note 1 switch to switch links did not initialize Switch performance may be affected Run the switch wrap test described in A lem or go to to verify fix Chapter 1 Maintenance Analysis Procedures MAPs 1 19 Switch Function MAP 0620 Table 1 6 SP Switch2 error conditions continued Error Device Message Link Message Description and Action 0 Uninitialized Uninitialized Description Switch adapter has not been initialized Processor node may not recognize adapter due to hardware failure or bad software configuration Action 1 If there are any other errors in the var adm SPlogs css0 p0 out top file on the primary node address those errors first Note If the problem is on all nodes in the frame check for any hardware problems with the switch assembly Also check for switch to switch problems on all jacks of the switch assembly 2 If all the nodes are uninitialized except for the primary node verify that the primary node is connected to the correct port 3 Have customer verify that the correct switch software is installed and running on the problem node rc switch starts the fault_service_Worm_RTG_CS daemon Note e If the daemon starts g
72. nd 3rd characters are the major assembly number 00 for any all major assemblies designates location inside any all major assemblies 01 99 for major assembly 1 99 specific to that major assembly Sub assembly YY 1st and 2nd characters are the assembly designation inside the major assembly This string may be omitted in some cases Refer to the lists of two character designations associated with each major assembly throughout this chapter Example SC denotes a switch card Connection location ZZZZ e 1st character is the connection type P for plug cable side J for jack card component side G for chassis ground connection e 2nd 3rd and 4th characters are number identifiers Leading zeroes may be omitted Example P102 is plug 102 Examples for using complete levels of nomenclature To describe the jack 23 on the switch assembly bulkhead in the second RS 6000 SP frame in a four frame configuration designate as EQ2 S01 BH J23 To describe plug 1 on the power card of the any switch assembly of any RS 6000 SP frame in any size system configuration designate as E00 S00 PC P1 or just PC P1 Location diagrams of the RS 6000 SP components See Eigure 2 1 on page 2 3 Eigure 2 2 on page 2 4 and Figure 2 3 on page 2 5 in the pages that follow for views of the RS 6000 SP frame locations Refer to the diagrams included in this section for specific views and cabling of the main component sections in the RS
73. nfiguration e If no a Call the next level of support You may be advised to replace the LED power extension cable and if needed the switch planar b If advised to proceed go to FStep 0610 0217 Step 0610 021 The switch s front panel power LED remained Off after you replaced the LED bracket assembly and you were advised to continue troubleshooting 1 Replace the LED power extension cable 2 Is the front panel power LED On e If yes go to Ewitch function MAP 0620 active configuration e If no go to Step 0610 022 on page 1 171 and return the switch to the and return the switch to the ep 0620 0 on page 1 16 _RS 6000 SP SP Switch2 Service Guide Switch power MAP 0610 Step 0610 022 The switch s front panel power LED remained Off after replacing the LED power extension cable 1 Replace the switch planar 2 Is the front panel power LED On e If yes go to Bwitch function MAP 0620 Step 0620 021 on page 1 27 and return the switch to the active configuration e If no call the next level of support Step 0610 023 The switch supervisor card was replaced and both the switch front panel and green switch supervisor LEDs remain Off 1 Replace the switch s circuit breaker assembly 2 Are both power LEDs On e If yes go to Ewitch function MAP 0620 active configuration e If no go to Step 0610 0241 Step 0610 024 The switch s circuit breaker assembly was replace
74. nterference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment Unauthorized changes or modifications could void the user s authority to operate the equipment This device complies with Part 15 of the FCC Rules Operation is subject to the following two conditions 1 this device may not cause harmful interference and 2 this device must accept any interference received including interference that may cause undesired operation European Union EU statement This product is in conformity with the protection requirements of EU Council Directive 89 336 EEC on the approximation of the laws of the Member States relating to electromagnetic compatibility The manufacturer cannot accept responsibility for any failure to satisfy the protection requirements resulting from a non recommended modification of the product including the fitting of option cards supplied by third parties Consult with your dealer or sales representative for details on your specific hardware This product has been tested and found to comply with the limits for Class A Information Technology Equipment according to CISPR 22 European Standard EN 55022 The limits for Class A equipment were derived for commercial and industrial environments to provide reasonable protection against interference with licensed communication equipment Attention This is a Class A product In a domestic environment this product ma
75. number Units Description index 1 31L8515 AR Rail left 77G0599 AR Screw 74F 1823 AR Nutclip 2 11P0097 AR Bracket mounting SP Switch2 77G0599 AR Screw 74F1823 AR Nutclip 3 3118514 AR Rail right 77G0599 AR Screw 74F1823 AR Nutclip 4 44P0769 1 Frame asm single line cord 44P0771 1 Frame asm dual line cord 5 1135155 AR Plate blank 2 ElA 54G2882 AR Screw M5 0375867 AR Nutclip 6 11P0492 AR SP Switch2 Chapter 5 Parts catalog 5 13 Model 556 and F C 2034 frame extender A LIT 5 14 RS 6000 SP SP Switch2 Service Guide Table 5 7 Model 556 and F C 2034 frame extender Assembly Part number Units Description index 1 21L3091 1 Top cover frame extender 2 21L3088 1 Right side frame extender 3 Bracket lower frame 4 54G2943 2 Leveling pad 5 2113090 16 Cable bracket frame extender 6 2113089 1 Left side frame extender 54G2882 36 Screw hex head M5 Chapter 5 Parts catalog 5 15 5 16 RS 6000 SP SP Switch2 Service Guide Notices This information was developed for products and services offered in the U S A IBM may not offer the products services or features discussed in this document in other countries Consult your local IBM representative for information on the products and services currently available in your area Any reference to an IBM product program or service is not
76. o continue service actions eu Bun Chapter 3 Service procedures 3 9 Using Perspectives to fence and unfence nodes attached to the switch penne nodes Bring up Hardware Perspectives for the system a Select the node to be fenced by either e Double clicking the node e Opening the node s notebook 3 Select either e Fence e Fence with autojoin Note Selecting the autojoin option will automatically place the node back into the operations of the partition on successful power on of the Node It is suggested that Autojoin not be selected at any time when performing a service action 4 Click Apply Unfencing nodes 1 Bring up Hardware Perspectives for the system 2 Select the node to be unfenced by either e Double clicking the node e Opening the node s notebook 3 Select Unfence 4 Click Apply Efence of primary and primary backup nodes System design does not allow Efence of primary and backup nodes by default However with the f option the primary and primary backup node may be fenced In this case a new oncoming primary node or oncoming primary backup node will be selected for you and an Estart will be issued You will need to use the Eprimary command after the Efence command has completed to see what the new primary and primary backup nodes are Service position procedures Note When placing a switch into the service position ensure that the customer has removed the switch from the a
77. o to A lf the daemon does not start go to El e When working with a two plane SP Switch2 system add the adapter name to the command as follows rc switch a lt adapter_name gt 4 If you Are not certain that the problem is hardware related go to the Parallel System Support Programs for AIX Diagnosis Guide GA22 7350 Are certain that you have a hardware problem go to E 5 If you get no result try swapping in another switch adapter Repeat step 3 If you get a result the problem is probably resolved repeat base Ld ior next problem or go to to verify fix 6 The problem is probably the switch assembly Go to 1 N A Link is not operational Link is retiming 2 N A Wrap plug is installed Description Initialization detected a wrap plug or cable rather than the expected cabling Action Repeat problem or go to 3 Device has been removed from network because of a bad signature Link is not operational Link failed to time Description Possible hardware problem Action Go to 1 20 RS 6000 SP SP Switch2 Service Guide Table 1 6 SP Switch2 error conditions continued Switch Function MAP 0620 Error Device Message Link Message Description and Action 4 Device has been Link has been Description Switch network not wired as specified in switch removed from removed from topology or problem with connection between s
78. ogs css0 p0 out top file 5 of 5 have been addressed 1 22 _RS 6000 SP SP Switch2 Service Guide Switch Function MAP 0620 Step 0620 005 The var adm SPlogs css0 p0 out top file indicates a problem with a Primary node or Secondary node connection 1 Open frame rear cover and check the cable connection from the indicated switch assembly jack to the processor node 2 Is there a cable connected to the indicated jack on the switch assembly e If yes go to Step 0620 0081 If no go to Step 0620 006 No cable connected at the indicated interposer on the switch assembly refer to the tables in ESwitch data 1 Should there be a cable connecting the indicated interposer to a processor node e If yes a Connect a switch data cable from this interposer to the proper processor node b Go to Step 0620 021 on page 1 27 If no go to EStep 0620 0071 Step 0620 007 A switch cable is not required on the indicated interposer 1 Have customer check the switch configuration file to see if an interposer is required in that slot e Use the Etopology command 2 Did you just correct the switch configuration e If yes go to Step 0620 021 on page 1 27 e If no go to to service or replace the switch assembly Step 0620 008 You have a switch cable connected to the indicated interposer on the switch assembly 1 Check cable connection at switch assembly and processor node 2 Does the cable
79. on SP Switch2 Assembly reference only Replacement Assembly Switch Planar Cable LED Power Extension Baffle Power Supply Bay Tray Bracket Card Retention Card Switch Interposer Card Switch Interposer Wrap Blank not shown Card Switch Supervisor Assembly Circuit Breaker Chapter 5 Parts catalog 5 5 Switch cables This page intentionally left blank 5 6 RS 6000 SP SP Switch2 Service Guide Table 5 3 Switch cables Assembly index Part number 11P0006 31L7152 46G9698 46G9699 46G9700 46G9701 Units AR AR AR AR AR Description SP Switch2 Data Cable Cable Switch Data 2615 mm SP Switch2 External Cables Cable SP Switch 2 Power Cable S S External 5 m Cable S S External 10 m Cable S S External 15 m Cable S S External 20 m Chapter 5 Parts catalog 5 7 SP Switch2 Frame F C 2032 5 8 RS 6000 SP SP Switch2 Service Guide Table 5 4 SP Switch2 Frame F C 2032 Assembly index 4 Part number 31L8515 77G0599 74F 1823 11P0097 77G0559 74F 1823 31L8514 77G0599 74F 1823 1134774 54G2882 0375867 11J5155 54G2882 0375867 08J5557 11J5189 11J5191 11J5193 11J5195 Units AR AR AR AR AR AR AR AR AR AR AR AR AR 8 AR AR 4 Description Rail left Screw Nutclip Bracket mounting SP Switch2 Screw Nutclip
80. ons Step 0595 007 The supervisor self test failed because the yellow LED was on steady This indicates that the supervisor is operating with base code only and needs to have the correct application code loaded Note If the replacement supervisor card is new or it has the wrong application code the self test will fail at the last step and the yellow LED will remain on Perform the SP Switch2 Base code verification procedure on B d 2 Based on the inermanon returned from the Eo vais perform the procedure for 3 After updating the supervisor code perform the 4 Does the supervisor pass the self test e If yes go to Step 0595 0101 e If no go to the Start MAP 0100 in the supervisory bus system Step 0595 008 You replaced an SP Switch2 supervisor card 1 Reconnect the supervisor harness to the connector at the back of the SP Switch2 e Reconnecting the harness initiates the supervisor self test 2 Do the green and yellow LEDs light e If yes go to Step 0595 0091 e If no go to the Start MAP 0100 in the supervisory bus system Step 0595 009 You replaced a supervisor card and the green and yellow LEDs lit during the self test 1 Rerun the e While the test is running compare the LED conditions on the supervisor with those listed in the Self test Conditions table 2 Did the supervisor pass the self test e If yes go to EStep 0595 002 on page 1 71 e If no go to ESten 0595 003 on page 1 7 Step 0595 0
81. orkstation errpt file reports a switch 2 of 4 failure shutdown or warning message associated with a fan power supply or temperature indicator e Perspectives switch environmental indicator is yellow and a fan or power supply indicator is red e Perspectives switch environmental indicator is either yellow or red and the temperature indicator is either yellow or red e Yellow switch supervisor LED is on or flashing 3 Power problem Go to e Green switch supervisor LED is off or flashing hage 1 13 3 of 4 e Perspectives switch power indicator is red e Switch has no power All voltages at zero 4 Switch function problem Go to Error in var adm SPlogs css0 p0 out top see hage 1 17 4 of 4 note e Problem with switch_responds Problem returned from errpt a N Worm or errpt a N css0 issued on the primary node e Problem detected by CE customer Notes 1 out top is located on the primary node To find the primary node issue Eprimary 2 Verify that the file has a valid recent time stamp using ls 1 Switch supervisor communications MAP 0595 Notes 1 Refer to g O for procedures used to place the switch into the service position or for removing it from the service position 2 Refer to Table 1 2 for descriptions of the SP Switch2 supervisor LED indications Table 1 2 SP Switch2 supervisor LED indications Green LED Yellow LED Indication On Off Normal switch o
82. peration Flashing Off Logically powered off 48 V available Off Off Physically powered off 48 V circuit breaker off On On Non critical power or environmental problem Critical power or environmental problem On Off or Flashing Flashing Note For this indication the green and yellow LEDs are flashing together Off On Supervisor communications or base code problem 1 6 _RS 6000 SP SP Switch2 Service Guide Switch supervisor communications MAP 0595 Table 1 2 SP Switch2 supervisor LED indications continued Green LED Yellow LED Indication Defective supervisor card replace card Flashing Flashing Note For this indication the green and yellow LEDs are flashing alternately Step 0595 001 Perspectives indicates that a power problem exists and the yellow LED on the SP Switch2 supervisor is On and it is not flashing 1 2 Did the supervisor pass the self test e If yes go to Sal e If no go to Step 0595 002 The supervisor passed the self test This indicates that the self test may have reset the supervisor processor and you need to determine if the problem has been cleared 1 Refresh Perspectives 2 Power on the switch 3 Does Perspectives indicate that the original problem is still present or that a new problem is occurring e If yes return to the Start MAP 0100 in the e f no go to the End of call procedures MAP 0650 in the Step 0595 003 The SP Switch2 supervisor
83. plugs Refer to e Interposer wrap card Used to test the SP Switch2 interposer interface 4 for the interposer wrap card part number e Switch data cables two ypes Internal to the frame External data cables multi frame only Attention Switch data plug and jack connector pins are easily bent Check for bent pins on male plugs or bent pin guides on female jacks if a cable is difficult to plug Problems with bent pins or pin guides can propagate to new plugs and jacks if not corrected first Refer to Figure 1 1 on page 1 3 for a high level view of the RS 6000 SP SP Switch2 assembly O Copyright IBM Corp 2000 2002 1 1 Switch Description and Problem Determination MAP 0590 Switch Connection Types Standard Node Processor nodes in 9076 SP frames are attached to the switches with switch cables Switch to Switch Connections between switches Switch Assembly Description SP Switch2 Each switch chip has its own clock and all clocks communicate through the switch data cables Each switch provides a maximum of 16 switch to node ports and 16 switch to switch ports FRUs include Fans circuit breaker assembly LED bracket assembly LED power extension cable switch supervisor card switch power supplies switch interposer cards and the complete planar replacement assembly Note An 8 port variation of the SP Switch2 is not available 1 2 RS 6000 SP SP Switch2 Service Guide Switch Description and Problem D
84. processor node or switch assembly will interrupt customer usage of the processor node and the remainder of the switch network If the switoh feature must be replaced in a multi frame system refer to g for information on isolating the switch assembly Attention Itis possible that the SP Switch2 cabling has been modified from recommended or documented configurations Any connector jack numbers will be correct as reported by system programs so tracing cables from the jack may be necessary It may be necessary for the customer to complete all active parallel jobs or jobs using switch interface for example tape SL ADSM ene remove the switch feature from the active configuration Refer to 9 for these procedures Step 0590 002 Determine the_condition of the switch by viewing its LEDs and the information displayed in Perspectives Then refer to for a prioritized list of conditions Find the first condition that describes your problem then perform the associated action Step 0590 003 Check for errors indicating environmental problems with the switch feature These can be viewed by issuing the appropriate command from the control workstation e errpt a N sphwlog pg e errpt a N css0 errpt a N Worm e Refer to the Starting a service call MAP 0100 in information on the pg command 1 4 RS 6000 SP SP Switch2 Service Guide Switch Description and Problem Determination MAP 0590 Note In a frame with processor no
85. rame 2 Click the Notebook icon on the tool bar e When the Notebook window opens make certain that the Switch Status tab is selected 3 The Node failure attribute displays the status of the switch supervisor e No displayed in green highlight indicates that the switch supervisor has not failed and the supervisor is responding to communication from the frame supervisor e Yes displayed in red highlight indicates that the switch supervisor has failed and it is not responding to the frame supervisor Note Clicking Help in the Notebook window s lower right corner displays attribute descriptions Chapter 3 Service procedures 3 7 Base code verification Note This is not a Perspectives function Perform the following procedure to check for supervisor conditions that require action 1 2 3 From the control workstation window enter smitty supervisor The following menu is displayed Check For Supervisors That Require Action Single Message Issued gt List Status of Supervisors Report Form List Status of Supervisors Matrix Form List Supervisors That Require Action Report Form List Supervisors That Require Action Matrix Form Update ALL Supervisors That Require Action Use Most Current Level Update Selectable Supervisors That Require Action Use Most Current Level Select the second option List Status of Supervisors Report Form A frame similar to the following example is displ
86. re used swap or change the suspected cable b Advanced cssX where X 0 or 1 diagnostics will require a male and a female wrap plug to perform the card wrap and cable wrap tests When testing the SP Switch2 adapter the cable associated with the male and female wrap plugs a leet in we ship group must be used to perform card diagnostics refer to c If unable to run diagnostics make certain the adapter is configured comal d If the adapter is configured correctly and diagnostics fail replace the card 2 Do you get a Service Request Number SRN from cssX where X 0 or 1 diagnostics e If yes a An SRN was obtained from diagnostics b Use the following SRN table Table 1 8 to continue service c After using Table 1 8 go to e If no a The diagnostics did not detect a problem therefore the problem is in switch assembly Table 1 8 Service Request Numbers SRNs for SP Switch2 adapters Service Request SRN Notes Number Source Failing Component Description 765 x1xx D SP Switch2 adapter software Software problem probably due If the fifth digit to bad installation y 1 Note Reinstall the software If troubleshoot the SRN does not clear contact next adapter software level of support first 765 1yx6 D Switch cable Wrap test failed Problem caused 1 by bad switch cable 765 2yx1 D SP Switch2 adapter RDRAM test failed 1 765 2yx2
87. removed in this procedure will appear in the out top file with error messages however the remainder of the switch resources are now available for customer use 6 If switch re initialization was successful the customer can start running parallel jobs again 7 Return to MAPs to continue service action s na Restoring an SP Switch2 to the active configuration Identify the switch to be restored to the active configuration Have customer stop all current parallel jobs and suspend all parallel jobs on the job queue Make sure that the circuit breaker at the rear of the switch is in the Off 0 position Comnect all cables to the switch Pay attention to the labels on the cables Put the circuit breaker at the rear of the switch in the On 1 position If the primary processor node was changed during the isolation procedure the customer can change the primary processor node back to the original selection however this is NOT required The primary node is set by the Eprimary command Refer to Parallel System Support Programs for AIX Administration Guide SA22 7348 for more information 7 The customer can re initialize the switch using the Estart command Cables connected to the switch assembly and processor nodes which were restored in this procedure should appear in the out top file without any error messages 8 If switch re initialization was successful the customer can start running parallel jobs again 9 Return to MAPs t
88. s a Start Maintenance Mode for System Recovery b Access a Root Volume Group c Continue d Choose correct disk from the list e Access this volume group and start a shell In the maintenance shell set the date command For example to set the date to August 3 1995 do date 0803123095 In the maintenance shell set the boot list a Run diagnostics diag b Choose the Service Aids panel c Choose the Display Alter Bootlist panel d Choose Normal Mode e Choose Alter Current Bootlist f Set the bootlist the way it was before the node was serviced Close the console window Chapter 3 Service procedures 3 11 9 On the control workstation set the node to boot from disk For example spbootins r disk 2 12 1 10 On the control workstation use Perspectives to power off the node and then power it back on The node will now boot from the device that you specified in step 7 with the correct time Running diagnostics on a switch port Attention Servicing a processor node or switch assembly may interrupt customer usage of the processor node and the remainder of the switch network If Ihe switch feature must be replaced in a multi frame system refer to al for information on isolating the switch assembly Before running diagnostic tests on a switch to diagnose node to switch problems you must identify the port number For example Bulkhead jack 6 on switch 17 frame 1 is identified as E01 S17 BH
89. s externally accessible plug in assemblies Do not attempt to remove the planar from the chassis 6 The switch planar in now considered to be removed Note The new planar assembly is supplied as a chassis mounted unit Chapter 4 FRU removals and replacements 4 7 SP Switch2 service procedures Replacing the switch planar Attention Replacement of the switch planar involves the replacement of the removed switch s externally accessible plug ins into a new partially populated switch planar in chassis assembly 1 Remove all fan assemblies from the new switch planar assembly a Replace the switch supervisor card 4 Return to the procedure that directed you here Removing the 48 V dc circuit breaker assembly Remove the circuit breaker assembly mounting screws Loosen the captive screws on the chassis center top cover and remove the cover Unplug the circuit breaker assembly power cable from J48V on the switch planar Grasp the circuit breaker bracket with one hand apply finger pressure at its base from the empty J2 slot with the other hand and remove the assembly by pulling it out of the chassis DN 2 4 8 RS 6000 SP SP Switch2 Service Guide Circuit breaker bracket Bracket mounting screws SP Switch2 service procedures Figure 4 6 Removing SP Switch2 circuit breaker assembly Replacing the 48 V dc circuit breaker assembly 1 upon 7 Insert the 48 V dc circuit breaker assembly into
90. snap 3 3 self test switch supervisor 3 6 service position placing into 3 10 replacing from 3 11 service position procedures 3 10 service procedures placing switch assembly into service position 3 10 removing switch resources 3 9 replacing a switch assembly from service position 3 11 restoring switch resources 3 9 service position 3 10 verification and isolation 3 1 service request numbers 1 24 SP Switch2 LED cable 1 11 power assembly 1 11 SP Switch2 assembly high level diagram 1 2 SP Switch2 data cables 2 11 SPS resources removing 3 9 restoring 3 9 SRNs 1 24 static sensitive devices 4 1 structure css snap file 3 4 supervisor code updating 3 8 supervisor self test switch 3 6 supervisor verification switch 3 7 switch removing from active configuration 3 9 restoring to active configuration 3 9 switch assembly environment MAP flowcharted 1 9 switch cables 5 6 switch function MAP flowcharted 1 17 switch interposer removing 4 6 replacing 4 7 switch pane opening 3 7 switch status 3 7 switch planar removing 4 7 replacing 4 8 switch port diagnostics 3 12 switch power MAP flowcharted 1 13 switch resources removing 3 9 restoring 3 9 switch status 3 7 switch supervisor card removing 4 5 replacing 4 6 switch supervisor code updating 3 8 switch supervisor self test 3 6 switch supervisor verification 3 7 Switch2 data cables 2 11 T tools overview service 3 1 trademarks A 1 U unfencing nodes 3 10 updating
91. st be ordered or a switch or frame must be repeatedly powered on off and or the customer specifically requests it Attention This procedure is intended to allow the customer to use the switch feature during extended repair action The customer must stop all parallel jobs prior to starting the repair Once the repair is complete the customer must stop all parallel jobs again to reconfigure the switch to include the resource again If the service action is expected to be complete in a short period of time for example two hours or less this additional interruption of all parallel jobs will probably cost the customer more time than was saved by use of the switch feature during that short period Removing an SP Switch2 from the active configuration 1 Sane the switch which is to be removed from the active configuration see 2 If the primary processor node usually in Frame 1 is connected to the switch identified in step 1 the customer must select an available processor node to be the new primary processor node The primary node is set by the Eprimary command Refer to Parallel System Support Programs for AIX Administration Guide SA22 7348 for more information Have customer stop all current parallel jobs and suspend all parallel jobs on the job queue Put circuit breaker at the rear of switch assembly in the Off 0 position The customer can re initialize the switch using the Estart command The frame and processor nodes which were
92. t a lt s a somos foe 0 oo r oao mo I Self test Conditions koa og a AAA ew a Switch supervisor status verification using Perspectives Be oe E a ee a a a a Opening a switch pane 8 Checking switch status 2 a a a a 87 Base code verification eo a w opo fo we aa a a a e e o a a gt Updating the SP Switch2 supervisor code oan Oh tee a es ae te ee A O Removing and restoring switch resources So Mo wt em Gh aR OO Removing an SP Switch2 from the active configuration oo Ae we ae ay Bly he Restoring an SP Switch2 to the active configuration Le ethos Be woe ey 2 OY Using Perspectives to fence and unfence nodes attached to the switch 2 A ae e aoe amp amp amp 2710 Fencing nodes s a s osoa sodo s a ee ee 3 10 Unfencing nodes gt s s w s w mw e soa bog roa 310 Service position procedures eg Be Bk a ch a E O Placing an SP Switch2 into service o position oo a oe be we we 2 et ee O Replacing an SP Switch2 from service position 2 2 nn nn 9 11 Resetting the clock and bootlist after servicing anode 9 11 Running diagnostics on a switch port s e soos 0 0 0 0 2 2 0 nn 12 Attention Components in the frame are susceptible to damage from static discharge Always use an ESD wristband when working inside frame covers See e for more details Do not touch the pins or circuitry on these components Personal ESD requirements The processor uses FRUs that are known
93. t the cables correctly and check var adm SPlogs css0 p0 out top for any other errors 2 Make sure processor nodes that were put in Service mode are returned to Normal mode Make sure all processor nodes are IPLed completely Have customer verify that the switch code is running on all processor nodes From the control workstation type Estart followed by ENTER Check var adm SPlogs css0 p0 out top file for problems regarding the interposers indicated Does out top file show a problem on any interposers indicated e If yes a Problem is in the switch assembly which is still reporting a problem b Goto EStep 0620 0201 to service or replace the switch assembly e If no a lf this is a switch to switch connection remove both wrap plugs from the switch assemblies b Replace the frame to frame switch data cable that was disconnected before c Go to to verify fix Step 0620 020 You have determined that there is a problem in the switch assembly and that you need to replace the switch assembly D omn g w Note Before taking this action contact the next level of support They will be able to advise you about system availability options that may allow the customer to continue operating 1 Replace the switch planar 2 Goto Step 0620 0211 Step 0620 021 You have replaced switch components and need to verify that the problem has been fixed 1 Make sure any processor nodes that were put in SERVICE mode are returned to NOR
94. tch chassis 4 Remove the supervisor card from switch by pulling outward on the card s hot plug actuator Card retention bracket Figure 4 4 Removing and replacing SP Switch2 supervisor and interposer cards Chapter 4 FRU removals and replacements 4 5 SP Switch2 service procedures Chassis Card Card guide rail cross section Actuator handle Card in slot e E 2 Card fully engaged Push a O 4 i 3 Figure 4 5 Installing an SP Switch2 supervisor and interposer cards Replacing the switch supervisor card aR oN oo nm Position and hold the switch supervisor card at the far end of the hot plug actuator Insert the far end of the actuator into the actuator guides of switch slot J2 Push the actuator to the end of the guide track Push the actuator handle inward and seat the supervisor card into switch planar jack J2 Hook the card retention bracket to the chassis side wall mount and swing the bracket closed e Make certain all actuator handles are inside the bracket Secure the card retention bracket to the switch chassis by tightening the captive screw Reconnect the switch supervisor cable to the switch supervisor card Return to the procedure that directed you here Removing an interposer card Note An interposer card may be either a e Switch interposer e Blank interposer Note Interposer card assemblies are hot
95. the switch chassis Secure the assembly to the chassis with the mounting screws Plug the circuit breaker assembly power cable into J48V on the switch planar Install the center top cover and secure it by tightening the captive screws Replace the switch supervisor card and the card retention bracket Return to the procedure that directed you here Removing the LED power extension cable 1 Loosen the captive screws on the chassis center top cover and remove the cover Unhook and remove both planar air baffles Unplug the LED extension cable power connector from switch planar jack JLED e At this time do not remove the extension cable from the cover slot At the rear of the front top cover and at the top of power bays 2 and 3 loosen the captive screws securing the removable trays Remove the tray from bay 3 and then remove the tray from bay 2 Chapter 4 FRU removals and replacements 4 9 SP Switch2 service procedures 8 9 10 11 Remove the front top cover from the chassis as follows a Remove the cover mounting screws b Slide the front top cover toward the center of the chassis c Remove the cover when it disengages from the chassis framework Cut the tie wrap securing the LED power extension cable to the cover mounted power tray Slide the LED extension cable out of the holding slot Remove the LED extension cable by squeezing the retention wings on the power connector and pushing the connector o
96. tinues flashing go to Frame supervisor not responding MAP 0110 in Et e Guide 7l and return the Chapter 1 Maintenance Analysis Procedures MAPs 1 13 Switch power MAP 0610 Step 0610 004 The green switch supervisor LED is Off 1 Make certain that the switch power cable is properly connected to jack J1 on the switch and on the SEPBU 2 Place the inline switch on the switch power cable into the On 1 position if it is not already in that position 3 Place the switch circuit breaker into the On 1 position if it is not already in that position 4 Does the switch circuit breaker trip to the Off 0 position e If yes go to EStep 0610 0051 e If no go to Step 0610 005 The switch circuit breaker went tripped to the Off 0 position 1 One at a time remove each fan power supply pair 2 After each fan power supply pair is removed check to see if the circuit breaker trips 3 Does the circuit breaker still trip Step 0610 006 The switch circuit breaker stayed in the On 1 position 1 Check the status of the green switch supervisor LED 2 Is the green LED lit If the green LED is off go to Step 0610 0071 e If the green LED is on a You have resolved the switch assembly problem b Go to Switch function MAP 0620 and refer to switch to the active configuration Step 0610 007 The switch circuit breaker is in the On 1 position and the green switch s
97. to be sensitive to electrostatic discharge ESD To prevent ESD damage to FRUs or to prevent system failures observe the following procedures e Keep the FRU in its original static dissipative shipping container until the FRU is ready to be installed in the system Move the static dissipative container near the location where the FRU is to be installed within ESD wrist strap distance If the FRU must be put down for any reason first place it in its static dissipative container or place it on the static dissipative mat e Open only the covers that are necessary to complete the task Any time a cover is open the service representative and all people in the area must be ESD safe If power is switched on or if removing or exchanging any FRU always use the ESD kit part 93F2649 Put on the ESD wrist strap Attach the ESD cable to the wrist strap Attach the ESD mat to the wrist strap if required Attach the insulated clip to the ESD cable Attach the insulated clip to the frame holes labeled ESD If the frame holes are not available use a grounding point on the frame Or a 00 ID Tools and files overview The following three tables provide an overview of the tools setup files and tuning files used in the service procedures O Copyright IBM Corp 2000 2002 3 1 Table 3 1 Service procedure tools Utility Runs on Description Directory fault_service_Worm_RTG_CS All nodes Monitors t
98. uipment transmitting on system links with laser modules that operate at greater than class 1 power levels For this reason never look into the end of an optical fiber cable or open receptacle Only trained service personnel should perform the inspection or repair of optical fiber cable assemblies and receptacles SPSFC018 Laser safety information The RS 6000 SP might contain certain communication adaptors such as ESCON or FDDI which are fiber optic based and use lasers Laser Compliance All lasers are certified in the U S to conform to the requirements of DHHS 21 CFR Subchapter J for class 1 laser products Outside the U S they are certified to be in compliance with the IEC 825 first edition 1984 as aclass 1 laser product Consult the label on each part for laser certification numbers and approval information Environmental notices Product recycling and disposal This product contains materials such as circuit boards cables electromagnetic compatibility gaskets and connectors which might contain lead and copper beryllium alloys that require special handling and disposal at end of life Before this unit is disposed of these materials must be removed and recycled or discarded according to applicable regulations IBM offers product return programs in several countries You can find country specific instructions at www ibm com ibm environment products prp phtml This product might contain nickel cadmium or lithium batteries in commun
99. upervisor LED is off 1 Perform the witch Iperviso 19 6 2 Did the green switch supervisor LED light during the supervisor self test e If yes go to Step 0610 0081 e If the green LED remained off go to Step 0610 008 The green switch supervisor LED lights during the supervisor self test but not when the switch circuit breaker is in the On 1 position 1 Place the inline switch on the switch power cable in the Off 0 position Remove the power cable from jack J1 at the rear of the switch Return the inline switch on the switch power cable to the On 1 position Check for 48 volts dc across the two power pins on the disconnected power cable Were you able to measure 48 V on the power cable e If yes go to e If no you have a problem with 48 V dc power distribution Go to Open in 48 V dc distribution MAP 0560 in to return the ar oN 1 14 _RS 6000 SP SP Switch2 Service Guide Switch power MAP 0610 Step 0610 009 The switch circuit breaker no longer trips to the Off 0 position when a fan power supply pair is removed 1 Reinstall the power supply into the switch 2 Check circuit breaker 3 Does the circuit breaker still trip e If yes go to EStep 0610 01011 e If no go to EStep 0610 0111 Step 0610 010 A power supply caused the circuit breaker to trip 1 Replace the power supply 2 Return to Step 0610 011 The circuit breaker does not trip with th
100. ut of the tray bracket Replacing the LED power extension cable 1 10 11 12 Insert the fan end connector of the LED power extension cable into its mounting hole on the front top cover mounted tray bracket Lock the connector to the bracket by pushing the connector into the mounting hole until its retention wings extend Slide the cable into the slot at the rear of the tray Using the tie wrap cutouts provided in the tray sheet metal tie wrap the cable to the tray Install the front top cover to the chassis as follows a Place the front top cover beveled edge rearward over the center of the switch and align the cover s outboard trays to the power bay guides on the chassis framework b Push the top cover forward until it is seated and install the cover mounting screws Insert a removable tray into the framework guides near the top of power bay 2 seat the tray and tighten the tray s captive screw Insert the remaining removable tray into the framework guides near the top of power bay 3 seat the tray and tighten the tray s captive screw Plug the connector on the planar end of the LED extension cable into switch planar jack JLED Install both planar air baffles by hooking the ends of each baffle to the switch chassis e Make certain that the LED extension cable is captured by the slot in the baffle Install the center top cover and tighten the captive mounting screws Install the fan assembly containing the LED displa
101. ut one of the forms at the back of this book and return it by mail by fax or by giving it to an IBM representative XVi _RS 6000 SP SP Switch2 Service Guide Chapter 1 Maintenance Analysis Procedures MAPs This chapter provides information for identifying problems and guides you to the most likely failed Field Replaceable Unit FRU The MAPs then refer you to the FRU Removal Replacement procedures for the corrective action ome MAPS Attention Components in the frame are susceptible to damage from static discharge Always use an ESD wristband when working inside frame covers See more details Do not touch the pins or circuitry on these components Switch description and problem determination MAP 0590 Purpose of this MAP This MAP describes the components of the SP Switch2 fabric and provides a table Table 1 1 on page 1 4 containing diagnostic information Each SP Switch2 has the following components e Switch interposer cards One per occupied switch port Connects the SP Switch2 to a switch adapter mounted in processor node e SP Switch2 adapter Installed in processor nodes Connects processor node to SP Switch2 Note Systems equipped with the SP Switch2 require SP Switch2 adapters This switch cannot connect to the SP Switch MX2 adapter e Switch supervisor e Switch power cable e Switch wrap plugs To test systems using SP Switch2 interposer cards and adapters use male and female wrap
102. witch and network faulty network or miswire device faulty Note You may get this error number for a jack which could connect to a node but instead has a wrap plug In this case this message is a warning only and can be ignored Action 1 Check the cable_miswire file in var adm SPlogs cssX p0 where X 0 or 1 and rewire the cable as needed 2 If the cabling does not match correct the cabling problem then go to step 5 below 3 If this occurs on all nodes of a frame check for a logical to physical frame number mismatch 4 lf there is a mismatch have the customer update the configuration or you can correct the cabling as appropriate 5 5 Device has been Link has been Description Node was fenced from the network removed from removed from network by system network by system Action run Eunfence for the node administrator administrator 6 Device has been Link has been Description AUTOJOIN was not selected for node during removed from removed from removal network no network no AUTOJOIN AUTOJOIN Action 1 Ifthere is an obvious problem like node powered off or disconnected fix that problem first Then issue Eunfence for this processor node 2 If problem was resolved repeat Step 0620 001 on baue 11 for next problem or go to Step 0620 021 on to verify fix 3 If RE was not resolved go to 7 Device has been Link has been Description Possible hardware problem removed from removed from network for not
103. y Power supply 2 3 4 Plug Fan Fan Fan Fan 1 2 3 4 LED Bracket Assembly Figure 2 4 SP Switch2 high level planar view Connector details 8 shows RS 6000 SP component connector details Chapter 2 Locations 2 7 3x5 Power A1 A2 A3 oporo 8x1 Power 3 pin Power Key 123 y 23 24 25 105306 O 9 pin D shell 2x25 Berg DADOOCOOC OD H amp 08000000008 25 pin D shell 2x13 Berg 123 232425 43 2 1 4x1 DASD Power 50 pin SCSI Figure 2 5 RS 6000 SP connector details as seen at receiving ends not at cable ends Cable routing and Eigure 2 7 on page 2 9 show back views of the RS 6000 SP frame showing the horizontal and vertical paths of cable routing from connector to connector with the depth amplified on the drawing Note When attaching exterior and interior cables to a POWER3 SMP High Node allow for enough cable for a 2 foot service loop for node movement into service position 2 8 RS 6000 SP SP Switch2 Service Guide 1 93 m frame 16 Hio 15 y qa 14 H9 13 MA it 12 H8 11 y UN 0 H 9 1 8 H6 7 v T 1 H5 5 i m 4 H4 3 i C tl Switch Power H1 AM E Figure 2 6 Frame cabling routing path in rear of RS 6000 SP frame 1 93 m frame New Style 2 01 m Frame
104. y cause radio interference in which case the user may be required to take adequate measures United Kingdom telecommunications safety requirements Notice to customers This apparatus is approved under approval number NS G 1234 J 100003 for indirect connection to public telecommunications systems in the United Kingdom Industry Canada compliance statement This Class A digital apparatus meets the requirements of the Canadian Interference Causing Equipment Regulations Cet appareil num rique de la classe A respecte toutes les exigences du Reglement sur le mat riel brouilleur du Canada A 2 RS 6000 SP SP Switch2 Service Guide For installations in Japan CORE FRUNERESERFEBE FH EZ VCC DEI BOC DIRAA ase CT Se ee CBRE in NAS de O k DBR The following is a summary of the VCCI Japanese statement in the box above This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment VCCI If this equipment is used in a domestic environment radio disturbance may arise When such trouble occurs the user may be required to take corrective actions Electromagnetic interference EMI statement Taiwan Sores ie ce HARRY aN En EA Eee Pe AB iF ARE Se SEE ADA T GAS SRE Ree ee BHA The following is a summary of the EMI Taiwan statement above Warning This is a Class A product In a domestic environment this product may cause radio interference in which
105. y into the switch chassis e Refer to FReplacing an SP Switch om se Return to the procedure that directed you here 4 10 RS 6000 SP SP Switch2 Service Guide Chapter 5 Parts catalog SP Switch2 assembly view 1 SP Switch2 assembly view 2 Switch cables SP Switch2 Frame F C 2032 F C 2032 frame extender SP Switch2 Frame Model 556 and F C 2034 Model 556 and F C 2034 frame extender O Copyright IBM Corp 2000 2002 3 2 5 4 5 6 5 8 5 10 5 12 5 14 SP Switch2 assembly view 1 5 2 RS 6000 SP SP Switch2 Service Guide Table 5 1 SP Switch2 assembly view 1 Assembly index i O a A Ww PY Part number 31L7106 11P1636 31L7137 21L3969 05N6603 3117112 77G0818 46H9688 05N6647 3117109 Units MYN A A _ Description SP Switch2 Assembly reference only Fan assembly Power Supply 3 4 V Baffle Air Flow Cover Center Top Replacement Assembly Switch Planar Cable LED Power Extension Wrap Plug Diagnostic Male not shown Wrap Plug Diagnostic Female not shown Cable 8 75 m for wrap testing Assembly LED Bracket Chapter 5 Parts catalog 5 3 SP Switch2 assembly view 2 5 4 RS 6000 SP SP Switch2 Service Guide Table 5 2 SP Switch2 assembly view 2 Assembly Part number index i 05N6603 3117112 21L3966 31L7113 12K0606 12K0486 12K0487 31L8752 7 2113967 a A oO PP Units AR AR Descripti

IBM RS/6000 User's Manual

Contents

Download Pdf Manuals

Related Search

Related Contents