Home

11 - Oracle Documentation

Contents

1. 10 p Node 0 Node 1 o o Y e e B gt E 5 1 j LI gt CT gt UIC gt Er j Cu gt CY Uic EE G Y G S T S G 9 G c O b U C L y I E O Ed OU c 1 SS A 1 L LL gt UNO e b gt U d p TC P D o moon S TT ABN o e o e O sun Ko Sun S SI e e S IL e e J E o oo o p o oo o LU Sli A DOLO Gee U ge l o A OIG Gag U Se A al oc co SUN O Sun O Sun ol wl en o o ES o gt o oo o o oo O al T a MO Aa Q oo Go o s AO AO Qoo Oo Figure 10 26 SPARCstorage Array 2 and 3 Connection Example Ultra Ente
2. Node 0 Node 1 o o Y e e B gt E 5 1 j LI gt CT gt UIC gt Er j Cu gt CY Uic EE G Y G S T S G 9 G c O b U C L y I E O Ed OU c 1 SS A 1 r LL gt UNO e b gt U d p TC 9 P DO o om eC S TT ABN o S ES o a E O sun Ko Sun S SI e e S IL e e J E o oo o p o oo o UT Sli A DOLO Gee U ge l o A OIG Gag U Se A al oc co SUN O Sun O Sun ol wl en o o ES o gt o oo o o oo e U a MO Aa Q oo Go o s AO AO Qoo Oo Figure 9 18 SPARCstorage Array 2 and 3 Connection Example Ultra Enterprise Cluster 4000 Hardware Installation 9 21 9 27 Array 4 45
3. S004 0006 09 4 0 PP ECL 10 0 GOO 1 00 DG 0 A 20 0 53 Soporan AR DONE ICSU aC COO MOO DG 25 0 SOP oo DG oo uoo Doo d oo 559ooood99 O PLOT ORIOL TOSS OA 0004600 600460 6000 66004600 600406050 400601460 TOOD OOD GOOD OOD GOON GOOD GOD GOOD OO9090D OOOO 0 e ele o o oe Ho HoHo 5 t E H U Darou D o R s a a lo ln On On JU o Rear view JU J ule D o eti ipigi f N i ML Bh aj Fo i b Lo ar ERA M o N E o BE agl lo e b run o d l SSA 3 p 4 n e lo ql ol Wa j S o l1 E3 Cial IF L TS ana Co le R p El ETE o N SSA 4 lo t dbo o o lel o p e s al p A A aj pI b e BTT e IO H H HI o As i 2 RSM 0 q A FANG o eT I TT 2 To ol WY HY Y lo dn FAIS a E RSM 1 H AAZ ZA e Y ol oT Ty y v HO o lola HY LY Glo N HG ui 4 HT RSM2 Jr A Alle d c ol e y IE o ej WY LE Glo d P d a e RSM 3 AA IA e
4. I b a a N a a E a 3 o o a y o K M M Node 0 o 3 Node 1 E o a 3 o b JEH I lo 4 gt lo a M la p 2 q a E0 E 3 EX mm EHHH gt a o E UL pus je Sor Se S 3 q fen Ad IIA L die bee c de3grn T Y To IH tm AU LL d noa mcodp a gt ben road la d ecn d Eel ERIS fp o c c31 7S q 2u c oo Y o A b c sl 34 PA Eras L U E la 9 IL gt Ue EN lo k 1 f T Jol m lal DIL _ o q 9 Za Do le R cc 7 raal LE 9 gt U 7 19 E gt 0S E Ll ley RSS oc e YA ES PSS G SS elle 2 e c 3 4 le e A Ave B a o A l pem el m l a dls wo TIE e E p sp E to oo y li J o oc hy T nmn anes TT BSR nes S el Bose a e Li a o El E o Io a ex o o e deaf e a 5 e fal el S a m ki Array 2 k a Array 3 hd a oj o ae Ol a o oo o o zem Sill 210 DRI Get oe y 3 4777 mpm e ee que y el r 0 o o o H SIDA SS
5. Node 0 cabinet A Cabinet C SSA 6 Node 1 cabinet B e e L z a 2 pm _e E op cn l e opn lo o0c Eu ES k Drs 9 c o0cc cc ES oc eS te R I 9 ape ge igi m o Ses e He e p ol Hil o E EA La tot oe oo O EN d a ER E E D eoa C ot zik SSA 7 Uc SL S o C Ir V 717 e RSMO Hi 7 i i J Y e Wy RSM 1 v d fifi E dy wy o MM IB Za HY d d Pe SII AM o o lo LIAE lo as Pla 7 El Q7 dir RSM3 pj UM iA i Figure 10 28 SPARCstorage Array 6 and 7 SPARCstorage Array 200 Series Connection Example Ultra Enterprise Cluster 5000 Hardware Installation 10 35 10 Key notches Keys hidden Key notches E o e 9 mo
6. Rear view Front view ls i N 4 ect ce N LA 1 a ee E 6 N 4 q lo como a o E SSA 4 nal Q5 SPAROStorago Array IL lal gt n 7 D M 2 e 3 ntc IL o s mr Y l SSA 5 gt lo Camo 0 ZEB Qe l SPARCstorage Array Fa e e a e e y 7 ST TT RSM 0 l hy T n 71718 CAPA 1 RsM1 EE ND 8s Ca a H RSM 2 1 MA e IIA E i ae E a a 2 7 AA A 5 RSM 3 tte lll RPTE JE ul i Ve 777 f gt o o wel Y Z Lh eE F 7 Figure A 19 SPARCstorage Array 200 Series and SPARCstorage RSM Installation Table A 1 SPARCstorage Array 200 Series Chassis Hole Assignments in the Expansion Cabinet Tray Number System or Enclosure 0 Topmost 1 Ultra Enterprise Cluster Expansion Cabinet 64 68 79 83 42 46 57 61 Rackmount Rail Installation A 19 m A 7 Installing the SPARCstorage RSM Chassis Install these removable storage module units in the expansion rack using the hole numbers specified in Table A 2 See Figure A 19 for a graphic of this installation Not
7. SS p F i ion tie Public net Eth Admin workstation gt E ublic net Ethernet o o ow E O go o 9 Bj EE Jo I co E Uc ad E cac _ o o E G o o 9 G o o o G 9 91 0c 9 2S Soo O 1 TS 0 DSSS 9 9 1 21 229 o 9 L9 o e L9 f l e ME L9 o C 9 m J amp L l EY 9 9 E gt cor o 2 o o 29 LE o 2 2 S Q9 JJ Node 0 Node 1 Figure 11 19 Node Interface to the Terminal Concentrator 11 3 3 Connecting Node 0 to Node 1 Ethernet Using the Ethernet cables connect one node to the other 11 3 3 1 First Cable 1 Connect one end of the Ethernet cable to the onboard Ethernet port on I O board slot 1 See Figure 11 20 2 Connect the other end to the Ethernet port on board 1 in the other node Ultra Enterprise Cluster 6000 Hardware Installation 11 27 11 11 28 Node 0 Node 1 11 3 32 11 5 33 Figure 11 20 Node to Node Ethernet Connection Second Cable 1 Connect one end of the Ether
8. eL iz CD ROM tape CD ROM tape scidO SCI To Private H SCI net 1 UO slot 3 SCI scid1 SCI 1 0 slot 3 I O slot 1 1 O slot 1 10 100Mbit Shared database 10 100Mbit hme0 hme0 A SPARCstorage arrays gt FC OM FC OM FC OM FC OM hme1 hmei FC OM FC OM FC OM FC OM 1 CPU Memory boards with 1 CPU Memory boards with 2 UltraSPARC modules and 2 UItraSPARC modules and 256 Mbytes memory 256 Mbytes memory Clock board Clock board Serial port A Terminal Serial port A concentrator Node 0 Node 1 Administration workstation Primary cane Figure 2 2 Clustered PDB System Based on the Ultra Enterprise 6000 System Product Description 23 lll No Ethernet Ethernet Node 0 Node 1 L PE CD ROM tape CD ROM tape I O slot 3 hme1 hme1 I O slot 3 I Private ro I O slot 1 hmee Water hme2 1 0 slot 1 hme0 hme0 SPARCstorage arrays FC
9. uw Figure 9 19 SPARCstorage Array 4 and 5 Connection Example Ultra Enterprise Cluster Hardware Site Preparation April 1997 Node 0 Node 1 s lo BI E B i cr E oma SS ter Va Eo Ne e m E oM W E 0c i ES lgc a c b gt gt re D R gt DOo eo Es a oa E bobo Ojea I fea W CEC E AL AL 3 Nr l AO OO eG eorioe Dag U a IQ ser Io ef En e Ex oa 10 Ao mal 0099 IN J Array 5
10. booooooooooa ooaooooaoodaooadooaooboOoodOobOooO GQOODOODOODOODOOOOOOODOOOOOOOODOOUODOOCOGOO POoOOOOOOOOOGQOOGdO0OcOOGdOOQOOdOOodOODOOOQ0ODOOO OO JO UGB US OBO CR KO CIO JG ORE QOO VO o o60DOO O0000000D0000000000 00DOOO0GdO0 DOoOOOOOOOOOG dO0O dO00O0O0 0O00O0Od0OOQ0OODOOOQODOOO q0 00009009000900000000009000000000D0 00000 A A AS 9 O O O Q gt 5 L P U o a a lo O LE A U Y TU n IS Js O Js e S o JL D o f o TEX LL A zo Q a pe lA 7 Uii 0111 H 0 0 0 o Q9 9 ar U N ed Y 7 Figure C 1 SPARCserver 1000E to Ultra Enterprise 3000 Node to Node Connection 2 gt o co p E I U E RU E O e TS 7 Os Jp a gt a H E EI T1 f g E T E PA a T G U G D B iem EN la O lt Jo gt ee A E E O DE oe U f 9 E gt 0 4 lo mue N F O 9 of Y 9 E T Figure C 2 SPARCserver 1000E to Ultra Enterprise 5000 4000 Node to Node Connection Ultra Enterprise Cluster Hardware Site Preparation April 1997 Dnm BEN d N
11. al a e q o R M o Node 1 S o T a o y e Glo Lu C c oL 3T rs x 1 Ora D c occu SIG s E Eta gt r D Cn E e PSS oed L JL e o C oo SIS L Y El On IL gt 0S E g 10 E lel ER e cos oq nor l o q o e M vds e t r o dle OG n o d o Y oer Pra o el Te3T pep E Te TEN P e E L 4 lla om Array 0 M K c Array 1 e o m o a El q lo oo o B E UE lil He JP oll o PSIG do P d a AA bi ul o o lo N o E lv E SS d E 3 E o a a o gt sl a SS al g s le a M 7 Ter q o B q R A o gt o a o d gt H la 0 I a o el a q o a a a o k E d e Figure 11 25 SPARCstorage Array 0 and 1 Connection Example 11 34 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11
12. Front view Rear view Private net FC S CPU Memory boards PCMs Clock board VO boards Il y Optical port gt gt tl q onboard FC OM o 20 e0 ese gt Ma co o zw X 0 z Cow Ao 1 T EE EA Pp pes X 2 o e o o esce 3 4 lo ud e O S gt So0 gt o u 5 SS EZ 6 E S m R B9 7 0 1 2 Disk board SBus slots Figure 9 8 Ultra Enterprise Cluster 4000HA Card Cage Expansion Example Typical of Node 0 and 1 9 5 2 I O Boards Use the appropriate section below for PDB or HA installation Caution Install FC OM modules in the A locations only Do not install FC OM modules in the B location If FC OM modules are installed in both locations then a failure of either module can result in loss of communication with both supported SPARCstorage arrays or other storage device 9 5 2 1 PDB Installation Only I O Boards Intended for Slots 1 and 3 Equipped with SCI SBus Cards Configure and install the SCI SBus cards These will be installed into the two I O boards each which will be installed in card cage slots 1 and 3 of node 0 and 1 For this procedure proceed to Appendix B Configuring the SCI SBus Card This procedure takes the installer through installation of I O boards in card cage slots 1 and 3 of both nodes 9 8 Ultra En
13. FRONT VIEW REAR VIEW Private net PCMs Clock board 1 O boards ZN 0 Optical port eS wit AS onboard FC OM o 00 00 KL O CB il U XI g U U B S ur So Eo ea 1 e e Q gt dR 3 9 AE 5 T E a lo O ze 7 0 1 2 Disk board SBus slots Figure 5 9 Ultra Enterprise Cluster 5000 4000HA Card Cage Minimum Population Typical of Node 0 and 1 5 2 2 Expansion Note Do not occupy or connect cables to both optical ports on any given I O board Beyond minimum configuration use the first available optical module port following all such ports in the system This will ensure that the controller numbering is preserved if the Solaris operating environment is reinstalled An expanded configuration consists of Two nodes Three or more SPARCstorage Array 100 series units Expansion cabinets containing Two SPARCstorage Array 200 series units hosting the devices below Four SPARCstorage RSM or differential SCSI tray systems 5 2 2 1 Power Cooling Modules PCMs Four PCMs must be installed in each node Ultra Enterprise Cluster Hardware Site Preparation April 1997 a lll 5 2 2 2 Board Population The card cages in the node 0 and node 1 servers are configured identically Figure 5 10 and Figure 5 11 show example expansion board populatio
14. Administration workstation Terminal concentrator E H TB ru a ER LT LD 56 Public net Ethernet Saa m do LT o ny o 2 e 9 Lj gt Je 9 fur B co le wr B T Ea C AR o C 4 KH oc y qe So on 5 O o o gt rico A R o SS O 1 2 Ud boar 3 9 e lt lt 0c l es o 9 2 c9 e m O 9 1 Se CT 9 pg LI LE a EE S 2 o 9 L2 e 2 Y O c 2 J Node 0 Node 1 Note Ultra Enterprise Cluster 6000 shown but applies to Ultra Enterprise Cluster 5000 too Figure 10 19 Node Interface to the Terminal Concentrator 10 3 3 Connecting Node 0 to Node 1 Ethernet Using the Ethernet cables connect one node to the other 10 3 3 1 First Cable 1 Connect one end of the Ethernet cable to the onboard Ethernet port on I O board slot 1 See Figure 10 20 2 Connect the other end to the Ethernet port on board 1 in the other node Ultra Enterprise Cluster 5000 Hardware Installation 10 25 10 Node 0 Node 1 o A e
15. PCMs Clock board O boards S Optical port wp ESN X 7 Y onboard FC OM o 00 o9 E E 1 x c S gt SY Ce e 9 cu y 1 T 1 T M e o o es bee 3 e e 9 i 5 a r s R we 7 0 1 Disk board SBus slots Figure 10 14 Ultra Enterprise Cluster 5000HA Card Cage Minimum Population Typical of Node 0 and 1 Front view Rear view Private net FC S PCMs X Clock board 1 O boards s c 8 B Optical port ug la cl onboard FC OM E 2000 IDTILM 7 A Ug 9 9 p Ad bc 1 EE X e e 9 P cuceesex 9 3 ig o O O 0 5 ES T mex EM o o 9 7 ELI 0 1 2 Disk board SBus slots Figure 10 15 Ultra Enterprise Cluster 5000HA Card Cage Expansion Example Typical of Node 0 and 1 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 10 3 1 2 10 3 1 3 10 3 1 4 Installing I O Boards for PDB I O Boards Intended for Slots 1 and 3 Equipped with SCI SBus Cards Configure and install the SCI SBus cards These will be installed into the two I O boards each which will be installed in card cage slots 1 and 3 of node 0 and 1 For this procedure proceed to Appendix B Configuring the SCI SBus Card This procedure takes the installer through installation of I O boards in card cage slots 1 and 3 of both nodes PDB and HA In
16. aoe 0 cS Coco cy o c J Figure 6 8 Turning the AC Power Switch to ON Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll Legend Locked Normal power ON in secure mode Diagnostics Normal power ON with full diagnostics On Normal power ON Standby OFF no DC power Locked Standby Diagnostics Figure 6 9 Key Switch in the ON Position Warning Never move the system when the power is on Failure to heed this warning may result in catastrophic disk drive failure Always power the system off before moving it Powering Off and On 6 13 6 6 7 Powering On the SPARCstorage Array Chassis For proper power on procedures for each chassis installed in the cabinet or stand alone refer to the appropriate installation and or service manual for that chassis 6 8 Reading POST Messages and Boot Messages 6 14 For each server system installed in the expansion cabinet refer to the appropriate installation and or service manual Read the section covering Power On Self Test POST messages and boot messages to interpret messages for that server Likewise for each storage chassis install
17. Sipbo gaojp oo ciao pajdo oa Cb O d d b 6 0 d o O d b b O O d b O9 O d b b O O d b b OO e e e 2 N o p D o gt lo le o o a b b do d e e LI le o b B p gt C e gt p p p ol jo e Ulo i p p gt d n o a a le o dk p m lb Sa id e p N gt se gt 6 a p a o Figure 2 10 Expansion Cabinet with SPARCstorage Array 200 Series Units Hosting RSM Trays Ultra Enterprise Cluster Hardware Site Preparation April 1997 Rear view Front view E e D ong prs 9 a jE as nr M L C T r N e a f 8 a H j 9 Sraratrage Ary e q SS kal 5 o L 4 SPARCstorage B L x lt l ns 200 series units lt L O04 9 lo c D ia M N L E 4 M M Soo io al e 9 SPARCstorage Array la 3 n M SS M L e N b B S gt lt MM a
18. Figure 7 8 Removing the Front Bezel To replace the front bezel reverse these instructions Internal Access and Leveling 7 11 7 12 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Ultra Enterprise Cluster 3000 Hardware Installation 8 Do these tasks in the order listed Preparing the Server page 8 1 Connecting the Power Cords page 8 1 Installing the SPARCstorage Arrays page 8 4 Installing the Terminal Concentrator page 8 6 Configuring the Card Cages page 8 6 Cabling System Components page 8 13 Closing the Cabinet page 8 26 8 1 Preparing the Server 1 Unpack and inventory the equipment if you have not already done so See Chapter 1 Checklist for a list of equipment 2 Move the cabinets to their designated installation locations For site planning guidelines See Chapter 5 Ultra Enterprise Cluster Configurations 8 2 Connecting the Power Cords On each server node chassis perform the procedure which follows 8 1 lll Co 1 Use the handle on the front of the Enterprise 3000 system to pull the front door open 2 Locate the system key switch in the upper right corner insert the key provided with your system and turn the key switch to the Standby position See Figure 8 1 Figure
19. Node 0 cabinet A Cabinet C SSA 6 Node 1 cabinet B e e L E a EP E E pps gt k e G E Drs ecce 2 ES oc eS te R I 9 ape CSS So ES i e RES Sage o He e le m Hilf a o E EA o tot oe oo 6E d a ER E E D eoa C ZEE ATT SSA 7 SS 2 o C Ir V 717 e RSMO Hi 7 i i J Y dE Wy P RSM 1 v d fifi E dy wy o MM bid WY d d Zle eT IAA AM gt o lo LIAE lo as Pla 7 d d ai RSM3 pi UM iA i Figure 9 20 SPARCstorage Array 6 and 7 SPARCstorage Array 200 Series Connection Example Ultra Enterprise Cluster 4000 Hardware Installation 9 23 lll O Key notches Keys hidden Key notches E o e 9 mo L lt Y gl Lo O OC es N Uv Uv U 2 U U 2 O e SS oz E S A e B L 4 E Y DOE O e Ra o E P Qo9 U 9e EA m e o SS o SSS Figure 9 21 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 100 Series Unit 9 24 Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll Key notches Keys
20. o LE Ss as E R HA 0 CI co O X G D D O e 9 PP E 2 PH dR EN vf S L o e IL O H OL EU Dee ur S e o La C gt Figure C 8 Ultra Enterprise 3000 to Ultra Enterprise 5000 4000 Node to Node Connection for HA Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll OQOQOQOODOODOODOOOODOODOODOOOOOOOOODOOOQOQD KSA SSO CY IE ICI I CI CIC EY CIO Y T ICI PG ICI CIE d EXE 2 002 9 03 Uo OD UO oo000000000000800000000bD00000000000080050000 ogooQ 2000000000 o 9POoOOOOOOOODOOOQqOD 9OVOOCVOVIOTIO GO OV OBO AA E AREA EA LALALA AA ANS NS NANI v Do e UO c oO oO O oO OUO O DO O Oc C 0 D OO CO QU C 0 O DO CO 60608600b5bO0O0bOObOOOObOObOObOOOOOO0O0OObOoOOodOb 000000000000000000 000D00 0000000000 000000 o a o o 4 o o a a o p 9 gt o p us e e E E M lt o E E n EO lo L 3 D oy y o D T L G T lo o e o te E O O Dn a la C 0 OT T e f y h 4 O AN Re J a y N E E EY 1 L io o A o o o coy N
21. o Blower assemblies o O O 00 rete DO OO DO OO DO OO 09 QO Dal OO O O 0009 000 000 000 Terminal concentrator E 000 000 ooo ooo Figure 10 11 Plugging the Terminal Concentrator into the Power Sequencer Node 0 10 3 Power Cooling Modules PCMs Each PCM provides power and cooling to the one or two boards installed adjacent to it For this reason every board or board pair must be supported by an adjacent PCM Ensure that a PCM is installed for each board or board pair to be installed in the card cage Install additional PCMs as required to meet this requirement Ultra Enterprise Cluster 5000 Hardware Installation 10 15 10 10 16 Note To adhere to cooling and power requirements one power cooling module PCM must be installed for every two boards plus an additional one for redundancy Install the PCMs adjacent to populated board slots to ensure the fan in the PCM cools the associated boards 10 3 1 Configuring the Card Cages 10 3 1 1 For instructions on removing I O boards refer to the documentation supplied with the I O boards or the Ultra Enterprise 6000 5000 4000 System Manual Note Logically there is no difference between the board slots in the front or rear of the card cage and each slot can accept any board type For this system however install CPU Memo
22. Figure 10 12 Ultra Enterprise Cluster 5000PDB Card Cage Minimum Population Typical of Node 0 and 1 Front view CPU Memory boards gt 00 o9 M ee E 0 EL L 1 L 2 lo e e 4 lo m 6 o o PCMs Rear view SCI Clock board m Ne o fa 1 E f T E q D C b ng A e E O OS E EEC o 2 gt oca o O aa 0 1 2 SBus slots Rear view SCI Clock board A YA w ES a Y z H TUD cu U O O o mmc gt gt SH a2 e PSS ae 9 ecc H gt 0 1 2 SBus slots Figure 10 13 Ultra Enterprise Cluster 5000PDB Card Cage Expansion Example Typical of Node 0 and 1 Ultra Enterprise Cluster 5000 Hardware Installation I O boards Optical port onboard FC OM N 0 O 1 O boards Optical port onboard FC OM N 0 O 10 17 10 CPU Memory board CPU Memory boards 10 18 O Rmo O A N o Front view Rear view Private net FC S
23. oo GO oo R E E CA EE EE 000 oaooaooaooood o 00060b000 00600600040 aoo 6o00aoobood 00 o O o06000100DO0ODOOD 00D0O0D D Oo000bDOoOoG00b ogo0oGaoobO Oo00DOObDOObD oo00boooaobD o0000000d d00 O0O0dOOOOdOODOOGdOOO0O0O0000000DOODO0 ooooooodgoodaoodoooodooDoodooo0ooo0oood0DODOO oqooqooDooDooDOoOoOODOODOODOOOOOO0OOODOOOQOD oqooqoopDooDooDpooooDpooDOoOoDOOOOOOOOODOOOQqOD OOYVOCVOTIVOTCIV ODI OVD ODO ODIO OVO OVIU OV OI OGODO GID EOCVOOCNVOTCYVOTI OVI GON OVIY ODI ODYV OVI OV OI OGIDI OD e q 9 9 9 2 l 2 EE Sl sls o o 4 9 o a L o o 9 9 o q 6 l o a a l a a l c A r T o ol le o 58 o DO ON OV in e e 3 n im e Figure 8 17 SPARCstorage Array 2 Connection Example Ultra Enterprise Cluster 3000 Hardware Installation 8 23 20D 00 D400 400 060004004000 6000 0006400000 000 CODCOD GOS AOSD GOOD GOO TCOS GOOD OOD 0000000000 QOOIADARDOGAVABCAAAAAIGGAAAATAAANIAAGADAD 99990999900 900999090 700090019900 009000999000 o e 9 o 9 gt p s x9 MEM ERA o 9 C ITEM o I o gt a DES
24. Figure 8 18 SPARCstorage Array 3 and 4 SPARCstorage Array 200 Series 8 24 Connection Example Ultra Enterprise Cluster Hardware Site Preparation April 1997 Co lll Node end Keys Key notches Array end 9 9 ele 9 9 i a 2 S 2 s UNS S A be Keys hidden Key notches a a 25 A m jo E On Or ISIE El Il No Z e cem OS EEE o o Ho HoHo a Oooo Jy Ld Figure 8 19 SPARCstorage Array Fiber Cable Connection Ultra Enterprise Cluster 3000 Hardware Installation 8 25 lll Co Table 8 3 Node to SPARCstorage Array Cable Connection Example I O Board From Node 0 FC OM From Node 1 FC OM To SPARCstorage Array 1 Onboard 0 port A Onboard 0 port B 3 Onboard 1 port A Onboard 1 port B 1 SBus slot 1 2 port A SBus slot 1 2 port B 3 SBus slot 1 3 port A SBus slot 1 3 port B 1 SBus slot 2 4 port A SBus slot 2 4 port B 8 8 Closing the Cabinet Replace all panels on the cabinet See Chapter 7 Internal Access and Leveling for procedures Proceed to Chapter 11 for terminal concentrator config
25. cp D m lt E Twisted pair cable Figure 4 9 Example of 10 100BASE T Twisted Pair Ethernet Set up Ethernet using Sun supplied or third party components Read any applicable manufacturer instructions to obtain the best results Ultra Enterprise Cluster Hardware Site Preparation April 1997 Ultra Enterprise Cluster Configurations 5 This chapter details configuration requirements and presents interface and cabling information for possible Enterprise Cluster system configurations Minimum and example expansion configurations are shown and expansion is addressed Ultra Enterprise Cluster 3000 page 5 1 Ultra Enterprise Cluster 4000 and 5000 page 5 8 Ultra Enterprise Cluster 6000 page 5 15 System Component Cabling page 5 20 5 1 Ultra Enterprise Cluster 3000 The basic Enterprise Cluster 3000 systems is shown in Figure 5 1 5 1 lll a Administration workstation SPARCstorage Array Model 100 Series units Terminal concentrator serves primary node SPARCstorage Array Model 100 Series units Ultra Enterprise 3000 Systems Figure 5 1 Ultra Enterprise Clust
26. DIAG switch Figure 11 4 SPARCstorage Array Voltage Rating on the Serial Number Label Ultra Enterprise Cluster 6000 Hardware Installation 11 7 s Em 3 Locate the serial number label on the rear panel of the chassis See Figure 11 4 4 Check the electrical ratings label on the serial number label Verify that the stated rating matches your AC input voltage Table 11 1 provides maximum system operating voltage and frequency ranges and lists current requirements at nominal line voltage for a cabinet in maximum configuration Table 11 1 SPARCstorage Array 100 Series Nominal Power and Maximum Current Parameters Maximum Power Nominal AC Input Operating Operating Current Supply Configuration Voltage Range Single Phase Range Frequency Range Requirement Output North American 100 120 VAC 90 264 VAC 47 63 Hz 6 5A 460W International 220 240 VAC 90 264 VAC 47 63 Hz 6 5A 460W Connecting the Power 1 Connect SPARCstorage Array power cords a Plug a power cord into the connector at the rear of each array See Figure 11 5 amp Sun o ofi EUM AC power connector lt M On Off switch G OO O s HE MM Q00 Co o A B Figure 11 5 SPARCstorage Array AC Power Connector 11 8 Ultra Enterprise Cluster Hardware Site Pr
27. Figure 8 12 Node Interface to the Terminal Concentrator 8 7 3 Connecting Node O to Node 1 Ethernet Using the Ethernet cables connect one node to the other 8 7 3 1 First Cable 1 Connect one end of the Ethernet cable to the onboard Ethernet port on I O board slot 1 See Figure 8 13 2 Connect the other end to the Ethernet port on board 1 in the other node Ultra Enterprise Cluster 3000 Hardware Installation 8 17 8 18 Node 0 Node 1 9090009008900000900900000000000000DOOOGODOOOGq DOOOOOOOOOQOQOOGOOOOQOOGOOQOOGQOODOOOGQODOOO oGuacGooGoocaoGadoocooGaocoanaoaocduoG2ocOoOQ coGusoGoacooaco ocaGo oGOoocooGooGoaaoGuoGODUOG o RRR RN RRR RRR RR RRR 0000 9000000009 ODO OU UOOUOCUDUOOCODDUOODOUODUODOCOODOOCOOODDOU 00D00000DOO00000D0000000000000000000000D dOODOODOODOODOOOODOODOOOOO000000d0090 004000 90090000009000000000000000000000009080900090 DOOOOOOQODOOQOOGQOOOOQOOGQOOQOOQ0000OO0OQODOOO OODOQDOODOOOOOQODOOOOOOOOOOQOOQODOOOQQOOD QOODOODOODOODOOOQODOODOOQOOOOQOQOGQODOOQQOO a a aao aaa aR aaa Raa rra aaa noO aaa aaa aa aa a a aa R TR ANAIS COUCOU oo 990000909000 OCCO 00000
28. L Q SS 9 E 0 LS SS E Le la C J Jm al e e I c JE 10 e too H 9 C O oe 0 trono e S o O h e o o 9 L J Node 0 Node 1 Figure 9 12 Node Interface to the Terminal Concentrator 9 7 3 Connecting Node O to Node 1 Ethernet Using the Ethernet cables connect one node to the other 9 7 3 1 First Cable 1 Connect one end of the Ethernet cable to the onboard Ethernet port on I O board slot 1 See Figure 9 13 2 Connect the other end to the Ethernet port on board 1 in the other node Ultra Enterprise Cluster 4000 Hardware Installation 9 15 Node 0 Node 1 ff N o o A e a le E c B Es ollo gt E p boo py L U y n G e Sb Sno e LO ld gt gt gt e Reo gt e Bn 4c 9 E o Y pre o e HA LY o ETT O Y 6 Y Figure 9 13 Node to Node Ethernet Connection 9 7 3 2 Second Cable 1 Connect one end of the Ethernet cable to the Ethernet port on I O board slot 3 See Figure 9 13 2 Connect the other end to the Ethernet port on I O board slot 3 9 7 4 Connecting Node O to Node 1
29. 4 4 4 2 Power Requirements and Options 4 5 4 2 1 Electrical Circuits Required oo ooooo oooo 4 5 4 3 Ethernet Networks ecsc svere se Ep o I VR 4 7 4 3 1 Public and Client Networks ooo o oo 4 7 4 3 2 Private Node to Node Network 4 7 4 3 3 RS 232C and RS 423A 600 NR 4 8 44 Coaxial Ethernet Cabling iii iussisse yn 4 10 4 4 1 Ethernet Design Considerations 4 11 4 4 2 Preparing the Ethernet Network 4 13 5 Ultra Enterprise Cluster Configurati0NS 5 1 5 1 Ultra Enterprise Cluster 2000 c ccuven de Peek eure sees 5 1 5 1 1 Minimum Configuration cdi wesw wien a 5 2 5 1 2 EXPANSION ARA ARA aic 5 5 5 2 Ultra Enterprise Cluster 4000 and 5000 5 8 5 21 Minimum Configuration e 5 10 5 2 2 EXPANSION ccs E ERROR ERE ERU LEE ut beds 5 12 5 3 Ultra Enterprise Cluster 6000 oocoocooocmoo 5 15 5 3 1 Minimum Configuration e 5 16 Dida o e CC ecce et eoo pb ooo dub eX 5 18 54 System Component Cabling eter RERO 5 20 vi Ultra Enterprise Cluster Hardware Site Preparation April 1997 5 4 1 Administration Workstation 5 20 54 2 Terminal Concentrator sse mmm 5 20 5 4 3 Public Net Ethernet Licor cscii e 5 21 5 4 4 Mode 0 to Node liada os ds ii 5 21 54 5 SPARCstorage Arrays sr rs 5 21 Part 2 Hardware Installation 6 Powering Off and A lt lt erase 6 1 6 1 Powerin
30. A 7 Figure A 7 Securing the Left Side Rail to the Rack A 7 Figure A 8 Removing the Front Panel A 9 Figure A 9 Removing the Side Panels 0 0 cece eee eee A 10 Figure A 10 Removing the Popouts from the Top Panel A 11 Figure A 11 Removing the Top Panel 0 c cece eee eee ee A 12 Figure A 12 Replacing the Popouts in the Top Panel A 12 Figure A 13 Removing the peet A 13 Figure A 14 Installing the Base Plate on the Array A 14 Figure A 15 Base Plate Installed oo A 15 Figure A 16 Installing the Array in the Cabinet n nnananannnnnna A 16 Figure A 17 Aligning the Array Base Plate with the Side Rails A 17 Figure A 18 Installing Screws to Secure the Base Plate to the Side Brackets A 18 Figure A 19 SPARCstorage Array 200 Series and SPARCstorage RSM Installation rito eee a dde A 19 FIGURE A 20 SPARCstorage Array 200 Series and Differential SCSI Tray Installation eta ico ed A 21 Figure B 1 Scrubber Jumper Positions B 2 Figure B 2 SCISBus Card Installed in the I O Board B 3 Figure B 3 SCI SBus Card Configuration in Node 0 and Node 1 B 4 Figures xxiii xxiv Figure B 4 Figure C 1 Figure C 2 Figure C 3 Figure C 4 Figure C 5 Figure C 6 Figure C 7 Figure C 8 Figure C 9 Figure C 10 nodeid Adapter Number and IP Assignment for Each SCI SBus an B 5 SPARCse
31. Array 0 gt Array 1 Array 2 Rear view Hole 42 Hole 31 Hole 27 Hole 16 Hole 12 Hole 1 Figure A 2 Side Rail Installation Locations and Hole Numbers in the Ultra Enterprise Cluster 5000 Node Cabinet A 1 3 Ultra Enterprise Cluster 6000 Node Cabinets SPARCstorage Arrays are installed in the top and optionally bottom chassis position Figure A 3 Note Any additional SPARCstorage Arrays are installed in one or more expansion cabinets A typical installation is shown in Figure A 3 Side rail hole numbers are identified here Rackmount Rail Installation A 3 lll aN Front view Rear view f b hd e P o e o a a zes O o e a z e a e q e o P a P e o o a M o sl q M gt D a Ege S lt o N EIS o a ol o a sl ren e Ola E N RI G a N o oo o lo E c coc M B M z uu us ola Tol ele e po S id I dlle o
32. Clock board Peripheral power supply AC input 9 He Ho HoHo TU Pm B o E 5 p al L i Er a a a DN SBus slots 1 n n I I SCI T Ui Lo T 0 OFLA Peripheral power supply tt l di D 9 9 9 He H9 H9 Optical port onboard FC OM CPU Memory board I O boards 7 5 3 1 Board slots Figure 8 6 Enterprise Cluster 3000PDB Card Cage Expansion Example Typical of Node 0 and Node 1 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Co lll PCMs Peripheral power supply AC input SBus slots 1 2 Peripheral power supply CPU Memory board Nore ESE SEE E EEES EEE E E ELE ELE CO 0000DOOOOOOOOOOGOOOOOOODOOQdOODOOOOOOOODOO O cC o0 Ga 0 GO C Ga 9 6 acoacaaVosa ObOObOOO0000000400000000000000D00000000000 D Oo 0d OGOOGdOOG0OOOODOOODO O0DOODOOOOOOOOOOQOOOOOOODOOQOODOOOOO OO 0000 AA KATE 0 2 0 L 1 6 0 L 1 A Bi EA 9 0 amp C we 1 O boards 7 5 3 1 Board slots Filler panel Clock bo
33. 11 8 Plugging SPARCstorage Arrays into the Power Sequencer 11 9 Installing the Terminal Concentrator Hinge 11 11 Assembling the Terminal Concentrator Bracket 11 12 Terminal Concentrator Installed on the Hinge 11 13 Terminal Concentrator Cable Locations 11 14 Plugging the Terminal Concentrator into the Power Sequencer Node 0 nnnnnnanaan naarn 11 15 xxi xxii Figure 11 12 Figure 11 13 Figure 11 14 Figure 11 15 Figure 11 16 Figure 11 17 Figure 11 18 Figure 11 19 Figure 11 20 Figure 11 21 Figure 11 22 Figure 11 23 Figure 11 24 Figure 11 25 Figure 11 26 Figure 11 27 Figure 11 28 Figure 11 29 Figure 12 1 Figure 12 2 Figure A 1 Ultra Enterprise Cluster 6000PDB Card Cage Minimum Population Typical of Node 0 and 1 11 17 Ultra Enterprise Cluster 6000PDB Card Cage Expansion Example Typical of Node 0 and 1 11 18 Ultra Enterprise Cluster 6000HA Card Cage Minimum Population Typical of Node 0 and 1 11 19 Ultra Enterprise Cluster 6000HA Card Cage Expansion Example Typical of Node 0 and 1 11 20 Load B ard ceci resci cser tm ge decane EE Ed 11 22 Installing the Terminator on the Disk Board 11 23 Connecting the Administration Workstation 11 25 Node Interface to the Terminal Concentrator 11 27 Node to Node Ethernet Connecti0N oooooooooomm
34. OS E A E oa U U LOCAL OFF REMOTE switch Set to REMOTE SWITCHED OUTLET CONTROL LOCAL J15 OUT OFF 0 H 9 REMOTE J14 IN POWER AVAILABLE SWITCHED OUTLETS O 00 l epe Main power switch MO O A nO o P 0 O E R S OHT T a Figure 10 2 Local Off Remote Switch and Main Power Switch 10 1 2 Connecting the Power Cords Perform this procedure in the sequence given 1 Remove the cabinet panels to access the power switches and cables See Chapter 8 for panel removal procedures 2 Level the cabinet See Section 7 1 1 4 Adjusting the Stabilizer Bar and Leveling Pads Ultra Enterprise Cluster 5000 Hardware Installation 10 3 10 3 Turn the AC distribution unit power switch to Off The switch is at the rear of the cabinet See Figure 10 2 electrical shock to personnel exists L Warning The power must be turned off at the AC distribution unit or risk of 4 Locate the AC power cord and uncoil it 5 Open the spring loaded cover and plug the female end of the power cord into the cabinet AC connector This connector is at the rear of the cabinet at the bottom right corner a Open the spring loaded cover on the AC connector housing b Plug
35. PN 595 3373 01 MN HE oO 9o 1 DIAG switch Figure 9 3 SPARCstorage Array Voltage Rating on the Serial Number Label 3 Locate the serial number label on the rear panel of the chassis 4 Check the electrical ratings label on the serial number label Verify that the stated rating matches your AC input voltage Ultra Enterprise Cluster 4000 Hardware Installation 9 3 lll LO Table 9 1 provides maximum system operating voltage and frequency ranges and lists current requirements at nominal line voltage for a cabinet in maximum configuration Table 9 1 SPARCstorage Array 100 Series Nominal Power and Maximum Current Parameters Maximum Nominal AC Input Operating Operating Current Power Supply Configuration Voltage Range Single Phase Range Frequency Range Requirement Output North American 100 120 VAC 90 264 VAC 47 63 Hz 6 5A 460W International 220 240 VAC 90 264 VAC 47 63 Hz 6 5A 460W 9 2 2 Connecting the Power 1 Connect the SPARCstorage Array power cords Connect a power cord at the rear of each chassis see Figure 9 4 AC receptacle j On Off switch Sun ol E Md us E r 3 pL e oo e g o mm wm Qoo 100 AFR A B Figure 9 4
36. C 2 Node to Node Cabling Instructions C 3 PDB Clusters Refer to Table C 3 for a guide to illustrations showing node to node cabling between mixed servers Table C 3 Ultra Enterprise and SPARCcenter SPARCserver Platform Combinations Host Platform to Host Platform See Figure PDB Clusters SPARCserver 1000E Ultra Enterprise 3000 Figure C 1 SPARCserver 1000E Ultra Enterprise 5000 4000 Figure C 2 SPARCserver 2000E Ultra Enterprise 5000 4000 Figure C 3 SPARCserver 2000E Ultra Enterprise 6000 Figure C 4 Ultra Enterprise 3000 Ultra Enterprise 5000 4000 Figure C 5 Ultra Enterprise 3000 Ultra Enterprise 6000 Figure C 6 Ultra Enterprise 5000 4000 Ultra Enterprise 6000 Figure C 7 HA Clusters Ultra Enterprise 3000 Ultra Enterprise 5000 4000 Figure C 8 Ultra Enterprise 3000 Ultra Enterprise 6000 Figure C 9 Ultra Enterprise 5000 4000 Ultra Enterprise 6000 Figure C 10 The following server combinations are allowed for PDB clusters Mixed Compute Platforms C 3
37. Keys hidden Key notches E Tal U NI W nu lle EI O a s ELE i de Te c 9 l Figure 9 22 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 200 Series Unit Ultra Enterprise Cluster 4000 Hardware Installation 9 25 lll O Table 9 3 Node to SPARCstorage Array Cable Connection Example T O Board From Node 0 FC OM From Node 1 FC OM To SPARCstorage Array 1 Onboard 0 port A Onboard 0 port B 3 Onboard 1 port A Onboard 1 port B 5 Onboard 2 port A Onboard 2 port B 1 SBus slot 1 3 port A SBus slot 1 3 port B 3 SBus slot 1 4 port A SBus slot 1 4 port B 5 SBus slot 1 5 port A SBus slot 1 5 port B 1 SBus slot 2 6 port A SBus slot 2 6 port B 3 SBus slot 2 7 port A SBus slot 2 7 port B 9 8 Closing the Cabinet Replace all panels on the cabinet See Chapter 7 Internal Access and Leveling for procedures Proceed to Chapter 11 for terminal concentrator configuration procedures 9 26 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Ultra Enterprise Cluster 5000 Hardware Installation 10 10 1 Factory Assembled Ultra Enterprise Cluster 5000 Hardware Do these
38. SCI w C gt 0 C gt L 1 PA a i C 00 O oC 756 2 Peripheral power supply 74 Optical port onboard FC OM I O boards 7 5 3 1 Board slots CPU Memory board Filler panel Figure 5 2 Ultra Enterprise Cluster 3000PDB Card Cage Minimum Population Typical of Node 0 and Node 1 5 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 a lll a0900900000000000n00000000000000900000000 SEDO DO o C DO OU D GC D O C OO C DO CO OO C D CO OO PCMs EOD RR DU NX B 9 D B 9 B Peripheral power supply AC Input S S e Le Le To Clock board B 9 o U 9 o B n 4 PU 5 o o b a L 0 unu pulp YIU a a o SBus slots i JU Y o I LIKE do 2 IIS ine Peripheral power supply Private net Optical port CPU Memory board Kar onboard FC OM I O boards Filler panel 7 5 gt i Board slots Figure 5 3 Ultra Enterprise Cluster 3000HA Card Cage Minimum Population Typical of Node 0 and Node 1 5 1 1 3 SBus Card Population Install the quantity and types of cards that are appropriate for your system 5 1 2 Expans
39. Ultra Enterprise Cluster 6000 Hardware Installation 11 19 11 CPU Memory boards 0 2 4 6 8 10 12 14 11 20 Front view Rear view PCMs FC S Private net Clock board jo boards E cum Eum a Se 8 Optical port 2905 9 5 eo dc 31 onboard FC OM 1 o o ES Cua 40 as Ju x 7 G o ME O amp L 3 Ld EET 9 T o JJ A 5 send LU ez o e gt A 7 g 9 Mara a Fal e Pome ooo EL o 9 13 e e E IE Y Y SD vd a o Sass ze i 0 1 2 Disk board SBus slots Figure 11 15 Ultra Enterprise Cluster 6000HA Card Cage Expansion Example Typical of Node 0 and 1 11 8 1 2 Installing I O Boards for PDB Use the appropriate section below for PDB or HA installation 1 0 Boards Intended for Slots 1 and 3 Equipped with SCI SBus Cards Configure and install the SCI SBus cards These will be installed into the two I O boards each which will be installed in card cage slots 1 and 3 of node 0 and 1 For this procedure proceed to Appendix B Configuring the SCI SBus Card This procedure takes the installer through installation of I O boards in card cage slots 1 and 3 of both nodes 11 5 1 3 PDB and HA Installation 1 Co
40. 20 90 00008000 08083000 00000000 0000000 Figure 11 1 Key Switch in the Standby Position 4 Set the LOCAL OFF REMOTE switch to REMOTE See Figure 11 2 HS Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 1 SWITCHED OUTLET CONTROL o p a 1 s EJ Z gt E peer a LOCAL OFF REMOTE switch D L 1 e le aM set to REMOTE E OFF o p N o A Ii 7 1 REMOTE J14 le 1 IN D o 8 o lle a Q J sl ls b POWER AVAILABLE SWITCHED OUTLETS D U O 00 b a 1 1 N E Main power switch dl k M O O s S A H l s NO 9 S P o a o wO S p k es E s S R o a b a o a Pas o q Tos Figure 11 2 Local Off Remote Switch and Main Power Switch 11 1 2 Connecting the Power Cords Perform this procedure in the sequence given 1 Remove the cabinet panels to access the power switches and cables See Chapter 8 for panel removal procedures 2 Level the cabinet See Section 7 1 1 4 Adjusting the Stabilizer Bar and Leveling Pads 3 Turn the AC distribution unit power switch to Off The switch is at the rear o
41. Do not stack multiple Ultra Enterprise 4000 systems so that they sit directly on top of each other resting on the top cover of the system below Use the following guidelines to prepare a location for your server The server unit requires approximately 1 5 feet 47 cm of space in the front and back for access by service personnel See Figure 4 1 Aminimum space of 6 inches 16 cm is required on both sides of the server to afford adequate air flow 4 2 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Ha lll peripherals next to each other side by side L Warning To avoid exhaust air recirculation do not put systems or Keep power and interface cables clear of foot traffic Route cables inside walls under the floor through the ceiling or in protective channels Route interface cables away from motors and other sources of magnetic or radio frequency interference 4 1 3 Ultra Enterprise Cluster 5000 Server Determine the floor plan layout for your installation Figure 4 2 and Figure 4 3 are examples of floor plans for the minimum and maximum configurations respectively Access 4 feet Cabinet A Cabinet B Rear Node 0 Access Node 1 1 server 3 feet 1 server 1 or 2 arrays 1 array Front Access 3 feet Figure 4 2 Enterprise Cluster 5000 Server Floor Plan Example Minimum Configuration Top View Planning for Hardware Power and Network Requirements
42. Figure B 3 SCI SBus Card Configuration in Node 0 and Node 1 Note In rack mounter servers SCI cable strain relief brackets are used to support the cables The bracket is designed to accommodate and support the cable in I O board SBus slot 0 only Note SCI cables are available in lengths of two five or ten meters B 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 oj lll B 2 SCI Nodeid Values SCI cards use nodeids as hardware addresses Unique nodeid values must be assigned to each card during software configuration See Figure B 4 Note Nodeids are the equivalent of Ethernet addresses for SCI nodeid 8 adapter 0 204 152 65 1 nodeid 16 adapter 0 204 152 65 2 scidO E nodeid 12 adapter 1 204 152 65 17 nodeid 20 adapter 1 204 152 65 18 scid1 pu Node 0 Node 1 Figure B 4 nodeid Adapter Number and IP Assignment for Each SCI SBus Card B 3 SCI Driver Installation and Configuration for Ultra Enterprise Cluster Systems 1 Install the PDB software using pdbinstall Specify SCI
43. and adapter number 1 cards are connected using another Table B 1 specifies nodeid values that will be assigned and programmed into the card by the sciconf script Table B 1 nodeid Values Assigned to SCI SBus cards by the sciconf Script Node Adapter Number nodeid Interface IP Address 0 0 in lower SBus slot number 8 scid0 204 152 65 1 0 1 in higher SBus slot number 12 scid1 204 152 65 17 1 0 in lower SBus slot number 16 scid0 204 152 65 2 1 1 in higher SBus slot number 20 scid1 204 152 65 18 Run this command opt SUNWsci bin sciconf B 5 SUNWSsci SCI Driver Installation and Configuration Procedure for Non PDB Systems 1 Install the SUNWsci package pkgadd d package directory SUNWsci 2 Configure the nodeid adapter number and firmware for all SCI SBus cards Run the sciconf script in opt SUNWsci bin sciconf Configuring the SCI SBus Card B 7 lll Se B 6 What s Next B 8 3 Edit the etc sci iffconff file and uncomment the ifconfig commands for the appropriate system node Power cycle both systems nodes sync init 5 Return to the Ultra Enterprise installation procedure for the server type in question Ultra Enterprise 3000 The appropriate procedure below e Section 8 6 2 I O Boards Ultra Enterprise 4000 The appropriate procedure below e Section 9 5 2 I O Boards Ultra Enterprise 5000 The appropr
44. warning may result in catastrophic disk drive failure Always power the Warning Never move the system when the power is on Failure to heed this system off before moving it Ultra Enterprise Cluster Hardware Site Preparation April 1997 o lll 6 5 Powering Off an Ultra Enterprise Cluster 3000 Cabinet Note It is understood that the server in question is in the process of hardware installation and has no users nor data files to be concerned with If this is not true halt the system using the procedure found in the Enterprise Cluster System Service Manual Sun part number 802 6786 any cable while power is applied to the system Caution To avoid damaging internal circuits do not disconnect or connect 1 Pull on the handle to open the system front door 2 Locate the system keyswitch in the upper right corner and turn the key switch to the Standby position fully counterclockwise See Figure 6 6 3 Turn off the system power in this order a External drives and expansion cabinets if any b System AC power switch see Figure 6 7 c Terminal Powering Off and On 6 9 6 10 Legend Locked Normal power ON in secure mode Diagnostics Normal power ON with full diagnostics On Normal power ON Standby OFF no DC power Locked Standby Diagnostics F
45. En O m1 pe TT Terminator Terminator 9 7 8 1 9 7 8 2 9 7 8 3 Figure 9 16 Disk Board Connection 9 7 8 Connecting the SPARCstorage Arrays Installing the Second FC OM Optical Module in all SPARCstorage Arrays Install the second module in the array using instructions provided with the module The arrays are delivered with one FC OM optical module installed Labeling Fiber Optic Cables Label the fiber optic cables prior to installation Labeling ensures accurate installation and eases system reconfiguration and expansion later Put labels on both ends of each cable with the node cabinet and elevation information imprinted on it Use Figure 9 17 through Figure 9 20 as guides Installing the Fiber Optic Cables 1 Plug one end of the fiber cable into the FC OM in the I O board See Figure 9 21 and Figure 9 22for cable type and connection details Ultra Enterprise Cluster 4000 Hardware Installation 9 19 lll O 2 Plug the other end of the fiber cable into the FC OM connector on the SPARCstorage Array rear panel Plug node 0 into connector A and node 1 into connector B Repeat to connect both nodes to both SPARCstorage Arrays Refer to Table 9 3 on page 9 26 for a listing of all cable connections 3 Repeat steps 1 and 2 for all FC OM cables to be connected 4 Dress and secure all cables using cable ties as required Note Cables are shown loose for clarity To complete the task dress a
46. HER ENS 60008000b00b00000005000000000000000000000D 0000000d00d0000000000000000D00000000D000 O000000000000D00000000000 00000 00D LADA SA WO OS ORO DERE 0 000 0004d0040004000004000400 00000000 000000000 O0000100b00D00000000000002000000090009000D 0 00 0 00 000 00000000 00000000000000000000000 P Oq00000D000D00D0000000D00D009000 E eeoa goe gae gaa ga goe oe goe goe o a N SY o c KT e el Q9 R Q9 C Ey a a a a o LL lo a a o h _ lt gt gt s En 2 G G U Fo G U 1 e p S M07 hind L 3 CA U 30 DEI 2 h o e a a lo id E Soo l Ir t po T 9 o 9 E o o e e t n PE o Ld y o He HOHOHOHO ud FE c 3 e a t y ltra Enterprise 6000 L C 8 C 4 HA Clusters The following server combinations are allowed for both HA clusters 09000000000000050000000000000000000000000 0D00D000000000000000000090000000000000D0 0900900090090090D0090090000000000009000900 SODA SER OC GALA QUASI VO GINGER eHelleHeleHe HO HO HO 50 BP DO 0 gt EE A CO
47. Install the SCI SBus cards in the I O boards a Install one non scrubber SCI card into the I O board to be installed in slot 1 Install it in SBus slot 0 b Install the other non scrubber SCI card into the I O board to be installed in slot 3 Install it in SBus slot 0 Note For SBus card installation procedures refer to the documentation supplied with the I O boards or to the Ultra Enterprise 6000 5000 4000 System Manual 6 Install the I O boards in the card cages a Node 0 Install the scrubber equipped I O boards into card cage slots 1 and 3 b Node 1 Install the non scrubber equipped I O boards into card cage slots 1 and 3 Note For I O board installation procedures refer to the documentation supplied with the I O boards or to the Ultra Enterprise 6000 5000 4000 System Manual The resulting installation is represented in Figure B 3 Configuring the SCI SBus Card B 3 lll S Scrubber On Scrubber Off scidO ES Scrubber On Scrubber Off off scid1 A Node 0 Node 1
48. SCI Host and Cables 9 7 4 1 Connect one Ultra Enterprise Cluster 4000 node to the other Note Node to node connection is made using the appropriate SCI cables 530 2360 2 meter 530 2361 5 meter 530 2362 10 meter First Cable 1 Connect one end of the SCI cable to the SCI SBus card in I O board slot 1 SBus position 0 See Figure 9 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 9 2 Connect the other end to the I O board slot 1 SBus position 0 in the other node Nade Q Node 1 f d 3 o c o e 9 Ru a T 1 ET H E o E gt amp gt o P ike eo GD o i G S y G 7 i D o o o NN o o EMEN e ve Ge OO O COC 7 4 e C U C oy cc Li A o o gt Soo o ES oc SSS O 9 O LT bed E Y L Figure 9 14 Node to Node SCI Connection 9 7 4 2 Second Cable 1 Connect one end of the SCI cable to the SCI SBus card in I O board slot 3 SBus position 0 See Figure 9 14 2 Connect the other end to the identical SCI SBus card in I O board slot 3 SBus position 0 in the other node 9 7 5 Remaining Cables Connect all remaining cables Table 9 2 on page 9 12 summarizes
49. Ultra Enterprise Cluster 3000 Cabinet 6 11 4000 system 6 8 6000 5000 system 6 4 U Ultra Enterprise Cluster 3000 configurations 2 6 4000 configurations 2 8 5000 configurations 2 12 6000 configurations 2 14 V verifying configuration terminal concentrator 12 5 I 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Revision History Revision Dash Date Comments 802 6783 11 11 April 1997 Beta Review Version 1 2 Ultra Enterprise Cluster Hardware Site Preparation April 1997
50. a le E c B Es ollo gt E p boo py L U y n G e Sb Sno o LO ld gt gt gt MA Reo H aE e Bn 4c o 9 E o Y pre o e LY o O O V 6 Y Figure 10 20 Node to Node Ethernet Connection 10 3 3 2 Second Cable 1 Connect one end of the Ethernet cable to the Ethernet port on I O board slot 3 See Figure 10 20 2 Connect the other end to the Ethernet port on I O board slot 3 10 3 3 3 Connecting Node 0 to Node 1 8SCI Host and Cables Using the SCI private net cables connect one Ultra Enterprise Cluster 5000 node to the other Note Node to node connection is made using the SCI host cables and cable bracket Note Use 2 5 or 10 meter SCI cable as appropriate 10 26 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 Cable and Bracket Preparation Note SCI cables are thick and stiff The cable bracket incorporates a track on the top and the bottom one for each cable to support the cables These tracks mechanically form and support the SCI cables This allows the bracket to hold the cable connector flush against the SCI host connector and isolate the connection from cable inflexibility twist or pull SCI cable for I O board 3 Cable bracket At the rear of the cabinet loosely install two screws in the rack in holes 58 Install one at the left and one at the right These screws will accept the slotted holes in the
51. and becoming the master of the logical hosts lll O C 1 1 PDB Table C 1 PDB Mixed Platform and Processor Equivalency Ultra Enterprise Ultra Enterprise Platform SPARCserver 1000 SPARCcenter 2000 3000 5000 4000 Ultra Enterprise 3000 x Ultra Enterprise 5000 4000 X x4 5 xt Ultra Enterprise 6000 xt x xt 1 Itis understood that identical platform ypes are allowed and so are not documented here 2 Three Sun4D 60 MHz processors are equivalent to one Sun4U 167 MHz processor 3 Example SPARCcluster 1000 has eight to twelve 60 MHz modules and 512 Mbytes memory Ultra Enterprise 3000 has four 167 MHz modules and 512 Mbytes memory 4 Itis understood that the processor memory and I O capabilities are equivalent 5 Example SPARCcluster 2000 has twelve to twenty 60 MHz modules and 512 Mbytes memory Ultra Enterprise 5000 4000 or 6000 has eight 167 MHz modules and 512 Mbytes memory C 1 2 HA Table C 2 HA Mixed Platform and Processor Equivalency Ultra Enterprise Ultra Enterprise Platform SPARCserver 1000 SPARCcenter 2000 3000 5000 4000 Ultra Enterprise 3000 Ultra Enterprise 5000 4000 x Ultra Enterprise 6000 x x 1 Itis understood that identical platform ypes are allowed and so are not documented here 2 tis understood that the processor memory and I O capabilities are equivalent C 2 Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll
52. are necessary to complete the installation Chapter 2 Product Description defines what an Ultra Enterprise Cluster server is and presents details of several example configurations Chapter 3 Specifications provides system specifications Chapter 4 Planning for Hardware Power and Network Requirements provides guidelines and information for preparing the site Chapter 5 Ultra Enterprise Cluster Configurations provides configuration information for the Ultra Enterprise Cluster systems Chapter 6 Powering Off and On provides procedures for powering the system off and on xxix UNIX Commands Chapter 7 Internal Access and Leveling explains how to remove all relevant cover panels Chapter 8 provides procedures for installing the Ultra Enterprise Cluster 3000 system Chapter 9 provides procedures for installing the Ultra Enterprise Cluster 4000 system Chapter 10 provides procedures for installing the Ultra Enterprise Cluster 5000 system Chapter 11 provides procedures for installing the Ultra Enterprise Cluster 6000 system Chapter 12 Configuring the Terminal Concentrator and Installing the Software explains how to configure the terminal concentrator Appendix A Rackmount Rail Installation gives procedures for installing rails in the cabinets and installing SPARCstorage Array 100 and 200 Series systems on the rails Appendix B Configuring the SCI SBus Card gives procedures needed
53. iii 4 s QR lo OS Sm A L QUU E HE G rl Figure C 3 SPARCcenter 2000E to Ultra Enterprise 5000 4000 Node to Node Connection T_T H H H 3 J a Y E O AED B Cc viQ C_ gt E p 0O E O Figure C 4 SPARCcenter 2000E to Ultra Enterprise 6000 Node to Node Connection Mixed Compute Platforms fos U E 0 DJ UHL coca coo rara IU rana do Ob o b O 6 b OO b O60 D OO D O OO O OOO 6 0 O 40000040 00090000000000000900000000090090000009000 dOODOODOODOODOOOODOODOOOOOO0O0O00000000000 90900900900900090900900000000900099000090 OS COOCOO DOCE OOO COCO Ce DOCHO ODO ODO BOO APO OOO DOOUOOBOOBOODODOGODOO dOODOODOODOODOOOODOODO
54. 1 Cluster Foundation Packages Cluster Foundation Package 6000 Ethernet and Fibre Channel cabling SBus Ethernet and Fibre Channel adapter cards One SPARCstation 4 cluster console complete 2 9 2 2 Mass Storage Options 14 Gbyte 8 mm tape internal drive Multi tape backup tray with one 14 Gbyte 8 mm tape internal drive Front load 1 2 inch tape for the expansion cabinet 20 Gbyte 4 mm auto loader with data center tray 20 Gbyte 4 mm tape auto loader internal drive 56 inch data center expansion cabinet Ballast kit 2 9 2 3 Monitor and Graphics Accelerator Options Not for HA 2 9 2 4 17 inch color monitor TurboGX frame buffer and cable 20 inch color monitor TurboGX frame buffer and cable Other Options Network terminal server Product Description 2 21 lll No 2 9 3 SPARCstorage Array Model 100 Series 2 9 3 1 Optional SPARCstorage Array Model 112 12 6 Gbyte 6 x 2 1 Gbyte Fast Wide SCSI 2 Disk SPARCstorage Array with 2 meter Fibre Channel cable 37 8 Gbyte 18 x 1 05 Gbyte Fast Wide SCSI 2 Disk SPARCstorage Array with 2 meter Fibre Channel cable 63 Gbyte 30 x 1 05 Gbyte Fast Wide SCSI 2 Disk SPARCstorage Array with 2 meter Fibre Channel cable 2 9 3 2 Optional SPARCstorage Array Model 110 2 1 Gbyte SC Fast Wide SCSI 2 Disk 12 6 Gbyte 6 x 1 05 Gbyte SC Fast Wide SCSI 2 Disks Fibre Channel SBus Host Adapter Single Channel Host Connection for the SPARCstorage Array Fibre Channel Optical Module Se
55. 100BASE T Ethernet also known as twisted pair Ethernet For 10BASE T and 100BASE T two pairs of unshielded wires connect to each workstation or a server One pair transmits and the other receives The 10BASE T and 100BASE T cable is made up of twisted pairs These cables use RJ 45 connectors Planning for Hardware Power and Network Requirements 4 13 4 14 Workstation The cable connects the computer to a hardware interface called a hub A coaxial or optical fiber cable connects the hub to the network Single and multiple connection hubs are available commercially The maximum length of twisted pair cables is 100 meters 330 feet If cables connect through a wall socket the combined length should not exceed 100 meters Figure 4 9 summarizes implementation of twisted pair Ethernet Note Multiplexer boxes require a transceiver when used with the Ethernet applications described here Although these transceivers are compatible with Sun equipment Sun Microsystems does not guarantee the performance of any component not purchased from Sun Note Many transceivers are compatible with both level 1 and level 2 Ethernet To operate these transceivers with Sun equipment set the device for level 2 operation using the manufacturer s instructions Coaxial cable or optical fiber Tap Sot Tap Network cable Concentrator hub Concentrator hub Lj L
56. 12 requirements power 4 5 S SCI cable 5 21 10 26 11 28 SBus card configuring B 1 server description 2 1 set terminal concentrator IP address 12 3 network address 12 3 subnet mask 12 3 shut down 1 3 Ultra Enterprise Cluster 3000 system 6 9 4000 system 6 6 6000 5000 system 6 2 side panels See panel remove side rails hole numbers A 2 to A 4 install A 6 SPARCstorage array 200 series hole numbers A 18 install base plate A 14 in cabinet A 15 power on pointer 6 14 SPARCstorage RSM hole numbers A 20 specifications electrical expansion cabinet 3 11 Ultra Enterprise Cluster 3000 3 9 4000 3 9 5000 3 10 6000 3 11 environmental Ultra Enterprise Cluster 3000 3 12 4000 3 12 6000 5000 3 13 physical expansion cabinet 3 6 SPARCstorage Array 112 3 8 Ultra Enterprise Cluster 3000 3 2 4000 3 3 5000 3 4 6000 3 5 stabilizer bar adjust 7 5 switch AC power 6 3 to 6 7 6 11 8 3 key 6 2 to 6 13 8 2 9 1 to 9 2 10 2 11 2 11 6 system clearance Ultra Enterprise Cluster 3000 4 1 4000 4 2 T terminal concentrator configuration 12 1 front panel and LEDs 12 2 reboot 12 4 set IP address 12 3 network address 12 3 subnet mask 12 3 setup verification 12 5 test button 12 2 test button terminal concentrator 12 2 top panel SPARCstorage array remove A 10 turning off Ultra Enterprise Cluster 3000 system 6 9 4000 system 6 6 6000 5000 system 6 2 turning on
57. 2 12 Figure 2 13 Clustered PDB System Based on the Ultra Enterprise 3000 4000 5000 System 2 2 Clustered PDB System Based on the Ultra Enterprise 6000 System sss 2 3 Clustered HA System Based on the Ultra Enterprise 4000 5000 System sss 2 4 Clustered HA System Based on Ultra Enterprise 6000 System 2 5 Ultra Enterprise Cluster 3000 SysteM oooooooommoo 2 7 Ultra Enterprise Cluster 4000 System CAbinet Node Cabinet 2 9 Basic Ultra Enterprise Cluster 4000 SysteM 2 10 Basic Ultra Enterprise Cluster 5000 System 2 12 Basic Ultra Enterprise Cluster 6000 SysteM 2 14 Expansion Cabinet with SPARCstorage Array 200 Series Units Hosting RSM Trays ssi geins eeni p a e 2 16 Expansion Cabinet with SPARCstorage Array 200 Series Units Hosting Differential SCSI Trays ooooooooooormmmooo 2 17 SPARCstorage Array 112 0 2 23 SPARCstorage Array Model 200 Series Unit 2 24 XV xvi Figure 4 1 Figure 4 2 Figure 4 3 Figure 4 4 Figure 4 5 Figure 4 6 Figure 4 7 Figure 4 8 Figure 4 9 Figure 5 1 Figure 5 2 Figure 5 3 Figure 5 4 Figure 5 5 Figure 5 6 Figure 5 7 Figure 5 8 Figure 5 9 Figure 5 10 Standalone Server Access Areas Top View 4 2 Enterprise Cluster 5000 Server Floor Plan Example Minimum Configuration Top View oooooooomooo 4 3 Enterprise Cluster 5000 Server Floor Plan
58. 3 3 Shipping Specifications U S Metric Height 34 in 86 cm Width 29 in 74 cm Depth 22 5 in 57 cm Weight 185 lb approx 84 kg approx Ultra Enterprise Cluster Hardware Site Preparation April 1997 Oy lll 3 1 2 Ultra Enterprise Cluster 4000 System Table 3 4 Standalone Server Physical Specifications U S Metric Height 13 5 in 34 cm Width 19 7 in 50 cm Depth 22 in 56 cm Weight 150 Ib approx 68 kg approx Power cord 6 ft 1 8m Table 3 5 Standalone Server Clearance and Service Access U S Metric Front 18 in 47 cm Rear 18 in 47 cm Left 6 in 16 cm Right 6 in 16 cm Table 3 6 Standalone Server Shipping Specifications U S Metric Height 19 0 in 48 cm Width 23 8 in 60 cm Depth 26 8 in 68 cm Weight 160 Ib approx 72 kg approx Specifications 3 3 lll Oy 3 1 3 Ultra Enterprise Cluster 5000 System Caution Make no mechanical or electrical modifications to the cabinets Sun is not responsible for the regulatory compliance if a cabinet is modified Table 3 7 Ultra Enterprise Cluster 5000 Server Physical Specifications Specification U S Metric Diagram Height 56 in 143 cm Width 30 in 77 cm Depth 39 in 99 cm 56 in 143 cm l 39 in T ed ES 99 cm Weight 800 Ib 360 kg Approximate weight depending upon configuration Power cord 15 ft 4 6m Table 3 8 Ultra Enterprise Cluster 5000 Server Clearance and Service Access Access U S Metric Front
59. 3 Connecting Node 0 to Node 1 Ethernet 10 25 10 3 4 Disk Board HA Qni 10 30 104 Closing the Cabinet ead dun e eee ed ed 10 38 Ultra Enterprise Cluster 6000 Hardware Installation 11 1 11 1 Factory Assembled Ultra Enterprise Cluster 6000 Hardware ERR REA biam es 11 1 11 1 1 Preparing the Cabinet sioe oce 11 2 11 1 2 Connecting the Power Corda 11 3 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 2 Customer Assembled Ultra Enterprise Cluster 6000 Hardware Installation rwr E CR Epio 11 5 11 2 1 Preparing the Cabinet iouis eer rcc ee 11 5 11 2 2 Removing the Cabinet Panels 11 5 11 2 3 Installing the Cabinets ecc e tee ten 11 6 11 2 4 Connecting the Main AC Cord 11 6 11 2 5 Installing SPARCstorage Arrays in the System Cabinets 32s dr esr ee d epa 11 7 11 2 6 Installing the Terminal Concentrator 11 10 11 3 Power Cooling Modules PCMS 11 15 11 31 Configuring the Card Cages sisse ne 11 16 11 3 2 Cabling System Components nn nnne 11 24 11 3 3 Connecting Node 0 to Node 1 Ethernet 11 27 11 3 4 Disk Board HA Only 1 4 eer RR RR RR 11 32 114 Closing the Cabinet cerros EE v Ea Eua 11 39 Part 3 Software Installation 12 Configuring the Terminal Concentrator and Installing Ihe BOL EWAEG s oec ks Wade ed e TT x Ss AA 12 1 12 1 Configuring the Terminal Concentrator 12 1 12 2 Checkpoint to Verif
60. 48 in 122 cm Rear 36 in 92 cm Left 36 in 92 cm Right 2in 5cm 3 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Oy lll 3 1 4 Ultra Enterprise Cluster 6000 System Sun is not responsible for the regulatory compliance if a cabinet is modified Caution Make no mechanical or electrical modifications to the cabinets Table 3 9 Ultra Enterprise Cluster 6000 Server Physical Specifications Specification U S Metric Diagram Height 56 in 143 cm Width 30 in 77 cm Depth 39 in 99 cm p SS 39 in 39 in 99 cm 77 cm Weight 900 Ib 360 kg Approximate weight depending upon configuration Power cord 15 ft 4 6m Table 3 10 Ultra Enterprise Cluster 6000 Server Clearance and Service Access Access U S Metric Front 48 in 122 cm Rear 36 in 92 cm Left 36 in 92 cm Right 2in 5cm Specifications 95 lll Oy 3 1 5 Expansion Cabinet Caution Make no mechanical or electrical modifications to the cabinets Sun is not responsible for the regulatory compliance if a cabinet is modified Table 3 11 Expansion Cabinet Physical Specifications Specification U S Metric Diagram Height 56 in 143 cm Width 30 in 77 cm Depth 39in 99cm A SS 56 in SS y 143 cm ES SI 39 in 30 in 99 cm 77 cm Weight 10001b 155 kg Approximate weight depending upon configuration Power cord 15 ft 4 6m Table 3 12 Expansion Cabinet Clearance and Service Acc
61. 6000 Hardware Installation 11 17 ae 11 Front view Rear view SCI Clock board CPU Memory PCMs V 1 O boards boards o E o 2 Optical port E idis ES T onboard FC OM 0 L 1 e e e e o S U O c 5 2 le e e 9 le oce cc 3 4 1 c 5 e e o 9 1 o OTIS 6 PER ct 6 o S amp B 0 OT f 8 o e e o O ee o ee I 9 9 10 p FU ED o gt _ 11 e a e E O gt EE A 12 Ec mel o 9 OO C vo 13 14 E ll R o CHO 223 m 0 1 2 Load board SBus slots Figure 11 13 Ultra Enterprise Cluster 6000PDB Card Cage Expansion Example Typical of Node 0 and 1 11 18 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 Front view Rear view PCMs FC S Private net Clock board CPU Memory board Optical port onboard FC OM 00 00 b N a o 0 1 I O boards a e 3 B el o 4 5 le us a D 7 Load boards 4 dl 8 9 Load boards ls d 10 11 E mm 12 13 E d 14 15 0 1 2 Disk board SBus slots Figure 11 14 Ultra Enterprise Cluster 6000HA Card Cage Minimum Population Typical of Node 0 and 1
62. 8 1 Key Switch in the Standby Position 3 Turn the AC power switch to Off This switch is at the rear of the system on the peripheral power supply AC PPS AC that is installed in the far left corner See Figure 8 2 4 Connect the female end of the power cord into the AC connector This connector is at the rear of the system on the PPS AC just below the AC power switch See Figure 8 2 8 2 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Co lll 5 Route the power cord through the power cord retainer clip A plastic clip is attached to the back support bracket a Use a Phillips screwdriver to open the plastic retainer clip Remove the screw b Place the power cord inside the open clip c Replace the screw to reattach the retainer clip to the support bracket 6 Connect the male end of the power cord into a grounded outlet The outlet must be a 100 120 or 220 240 VAC 15A circuit Retainer clip OFF AC connector Support bracket s Figure 8 2 AC Power Switch Power Receptacle and Retainer Clip Ultra Enterprise Cluster 3000 Hardware Installation 8 3 lll Co Caution Do not turn on power to the unit yet Doing so can cause system damage to occur 8 8 Installing the SPARCstorage Arrays Two or more SPARCstorage Arrays are installed in th
63. Cluster Hardware Site Preparation Planning and Installation Manual Solstice HA 1 3 Programmer s Guide Ultra Enterprise Cluster Service Manual Solstice HA 1 3 New Product Information FCS only Solstice Disksuite 4 1 Binder Set Solstice Disksuite 4 1 User s Guide Solstice Disksuite 4 1 Reference Guide SSolstice Disksuite 4 1 Installation Product Notes 825 3526 802 6782 802 6790 802 6784 802 6785 802 6786 804 5449 802 6793 802 6792 825 3589 802 7621 805 0317 802 6783 805 0318 802 6786 805 0629 851 2369 802 4215 802 6724 802 7196 Preface XXXV Notes Cautions and Warnings xxxvi N N Warning This equipment contains lethal voltage Accidental contact can result in serious injury or death Caution Improper handling by unqualified personnel can cause serious damage to this equipment Unqualified personnel who tamper with this equipment may be held liable for any resultant damage to the equipment Individuals who remove any outer panels or open covers to access this equipment must observe all safety precautions and ensure compliance with skill level requirements certification and all applicable local and national laws Procedures contained in this document must be performed by qualified service trained maintenance providers Note Before you begin carefully read each of the procedures in this manual If you have not performed similar operations on comparable equipmen
64. E a elle a oll S N R e gt 3 al a llo o els ij E SI a Allo e ej o N le 3 o a s N EE e 2 Jb e A 1 2 D a e e lo lle la o LI o ojo e ell le fo had gt IT 0 4e e Fs 6 B 9a 5 S i S e lo e bouem ote oe le ee ee eS d E aL gt 3 225 252252 creen R a el o ol oae e E D ii o ol fe i ES Hole 27 el lt EE Hole 27 A 0 BI lls R IT CSE rra Hole 17 2 je EE Hole 16 y e esoo or A eee ener o A A E E LES o o ol a A he ae REA a dl e a a bl Ie x Sl i L o oue el o ol LU lo al M el oda aa e ka Hole 12 sl b i e Hole 12 RI HS k ood i _ Array 1 Hole 2 a lol MA j K HS Hole 1 NATA AE s sL 1 EC RR o o R i o A 4 Figure A 3 Side Rail Installation Locations and Hole Numbers in the Itra Enterprise Cluster 6000 Node Cabinet Note The rails are asymmetrical front to rear with respect to the lower hole position the lower hole used in the rear is one lower than that in the front A 1 4 Expansion Cabinets SPARCstorage Array chassis are installed in all five positions A typical installation is shown in Figure A 4 Side rails are installed using screw hole positions identified in Figure A 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 A Note The rails are asymmetrical front to rear with respect to the lower hole position used The l
65. Ethernet cable Example transceivers are connected 2 5 meters apart not 2 0 meters Example transceivers are connected 15 meters apart 6 multiples of 2 5 meters not 14 0 meters Figure 4 8 shows an example of a typical network setup The server system can be any one of the systems in this figure Transceiver L Transceiver 3 4 meter extension Terminator lc Server or Server or workstation workstation Note 5 meters 15 meters 3 4 meter extension 23 4 meters minimum length allowed Figure 4 8 Ethernet Cabling Length Example Using N type Cable If a terminator is required install a 50 ohm terminator on the unused transceiver N connector or the end of the coaxial cable Use a female double N type connector Note Sun equipment conforms to the Ethernet 10BASE T and 100BASE T standard which states that the link test function should always be enabled on both the node and the hub If you have problems verifying the connection between your Sun equipment and your hub you need to verify that your hub also has the link test function enabled Refer to the Troubleshooting chapter in the applicable server system service manual and the manual provided with your hub for more information about the link test function 4 4 2 Preparing the Ethernet Network Sun Microsystems follows the IEEE standard for 10BASE T and
66. For these procedures proceed to the the appropriate document listed below PDB Ultra Enterprise PDB 1 2 Software Planning and Installation Guide part number 802 6790 High Availability Solstice HA 1 2 Software Planning and Installation Guide HA part number 802 7211 12 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Rackmount Rail Installation A This appendix provides procedures to install the following assemblies Installing the Rackmount Rails for SPARCstorage Array 100 Series page A 1 Chassis Installing the Side Rails page A 6 Preparing the SPARCstorage Array 100 Series Chassis page A 8 Installing the Base Plate on the Chassis page A 14 Installing the Array in the Cabinet page A 15 Installing the SPARCstorage Array 200 Series Chassis in the Expansion page A 18 Cabinet Installing the SPARCstorage RSM Chassis page A 20 A 1 Installing the Rackmount Rails for SPARCstorage Array 100 Series Chassis The rackmount rails are required when installing the SPARCstorage Array 100 series chassis into the Ultra Enterprise 5000 and Ultra Enterprise 6000 node cabinets The kit consists of the side rails and base plate identified in Figure A 1 along with fasteners and certain other items Rail installation consists of Installing the side rails in the cabinet to accept the array Installing the base plate on the SPARCstorage Array lll aN Installing the a
67. LLL E Y 0 e 7e o 9 LS a 1 2 PR a I o le S 3 4 ae o ER Q S E 5 6 an ea A O gt 0 SSS 7 7 e 9 Mara 10 B5 e el oe e o 11 e t gt U O DOS 12 13 e e e 9 IE SS 9 cr tL 14 e Ta g o O ze 15 0 1 2 Disk board SBus slots Figure 5 16 Ultra Enterprise Cluster 6000HA Card Cage Expansion Example Typical of Node 0 and 1 5 4 System Component Cabling Interface cabling is illustrated in Chapter 11 Ultra Enterprise Cluster 6000 Hardware Installation 5 4 1 Administration Workstation This unit connects to the Terminal concentrator directly through a serial adapter cable Public Ethernet 5 4 2 Terminal Concentrator This unit connects to 5 20 Ultra Enterprise Cluster Hardware Site Preparation April 1997 D TheSerial A port on the clock boards in node 0 and node 1 connection is via serial adapter cables Public Ethernet 5 4 3 Public Net Ethernet Connection to the public or client network is via the terminal concentrator and administration workstation see the bulleted items in Section 5 4 1 and Section 5 4 2 5 4 4 Node 0 to Node 1 The two Enterprise PDB nodes are connected over two SCI links Two links are used to eliminate the possibility of a single point of failure Sun cables three lengths are used Note Use 2 5 or 10 meter SCI cable as appropriate In each node communication is hosted by a SCI adapter for each link The
68. Manual 9 6 Node 1 Card Cage 1 Repeat the instructions in Section 9 5 above for node 1 Ultra Enterprise Cluster 4000 Hardware Installation 9 11 9 9 7 Cabling System Components Network cabling is presented in Table 9 2 Procedures for connecting each cable follow the table Note For fiber optic cable connections see Table 9 3 Table 9 2 Cable Connections Except Fiber Optic System Board From Node 0 From Node 1 To Interface Type I O slot 1 Onboard hme Node 1 onboard hme RJ 45 TPE HA on I O board 1 private net Onboard hme Node 0 onboard hme RJ 45 TPE on I O board 1 private net Onboard SCSI Wide SCSI terminator Wide SCSI Onboard SCSI Wide SCSI terminator Wide SCSI Public net SBus card in Public net Ethernet or slot 1 FDDI Public net SBus Public net Ethernet or card in slot 1 FDDI Install terminator on SCSI Install terminator Wide SCSI port on SCSI port Public net SBus card in Public net Ethernet or slot 1 FDDI I O slot 3 Onboard hme Node 1 onboard hme RJ 45 TPE on I O board 2 private net Onboard hme Node 0 onboard hme RJ 45 TPE on I O board private net PDB SCI SBus port Node 1 SCI SBus port SCI cable SCI SBus card Node 0 SCI SBus port SCI cable Clock Board Serial A Terminal concentrator Serial All port 2 Serial A Terminal concentrator Serial port 3 912 Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll Table 9 2 Cable Connections Except Fiber Optic Sy
69. OM FC OM FC OM FC OM FC OM FC OM FC OM FC OM p ep 1 CPU Memory board with 2 1 CPU Memory board with 2 UltraSPARC modules and UltraSPARC modules and 256 Mbyte of memory 256 Mbyte of memory I O slot 7 Disk Clock board I O slot 7 Disk Clock board board boot disks 2 Serial port A board boot disks 2 Serial port A Terminal concentrator Administration workstation Primary Ethernet Figure 2 3 Clustered HA System Based on the Ultra Enterprise 4000 5000 System 2 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 No lll Ethernet Ethernet Node 0 Node 1 A a en CD ROM tape CD ROM tape I O slot 3 hme1 hme1 I O slot 3 I Private ro I O slot 1 hme2 network hme2 1 0 slot 1 hme0 hme0 SPARCstorage arrays FC OM FC OM FC OM FC OM FC OM FC OM FC OM FC OM p Ii 1 CPU Memory board with 2 1 CPU Memory board with 2 UltraSPARC modules and UltraSPARC modules and 256 Mbyte of memory 256 Mbyte of memory I O slot 15 Disk Clock board I O slot 15 Disk Clock board board boot disks 2 Serial port A board boot disks 2 Serial port A Terminal concentrator Administration workstation Primary Ethern
70. SCSI devices Note To adhere to cooling and power requirements one power cooling module PCM must be installed for every two boards plus an additional one for redundancy Install the PCMs adjacent to populated board slots to ensure the fan in the PCM cools the associated boards Note Install a load board in all empty slots to ensure proper cooling and to provide proper bus termination CPU Memory Boards 1 Install the CPU Memory boards into the card cage as viewed from the front Install them from lowest 0 through the highest 14 as appropriate For CPU Memory board installation procedures refer to the documentation supplied with the CPU Memory boards or the Ultra Enterprise 6000 5000 4000 System Manual See Figure 11 12 and Figure 11 13 or Figure 11 14 and Figure 11 15 for PDB and HA respectively 2 Fill all unused slots in the front of the system with a load board Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 Front view Rear view PCMs SCI Clock board CPU Memory board Optical port c c onboard FC OM o 0 o0 eae x o 0 1 1 O boards el o 2 3 b el e 4 5 Load boards Y Sal D 7 E E ie 7 Load boards o dl 10 11 dm m 12 13 a 14 15 0 1 2 SBus slots Figure 11 12 Ultra Enterprise Cluster 6000PDB Card Cage Minimum Population Typical of Node 0 and 1 Ultra Enterprise Cluster
71. Standalone Server Clearance and Service Access Standalone Server Shipping Specifications Ultra Enterprise Cluster 5000 Server Physical Specifications Ultra Enterprise Cluster 5000 Server Clearance and Service Access o oooooooomooomooomoo ooo Ultra Enterprise Cluster 6000 Server Physical Specifications Ultra Enterprise Cluster 6000 Server Clearance and Service Access 2 eee eee o Expansion Cabinet Physical Specifications Expansion Cabinet Clearance and Service Access Ultra Enterprise 5000 Server Physical Specifications Ultra Enterprise 5000 Server Clearance and Service Access SPARCstorage Array 112 Physical Specifications SPARCstorage Array Clearance and Service Access Server Electrical Specifications rarena Standalone Server Electrical Specifications Cabinet Server Electrical SpecificationS Cabinet Server Electrical Specifications 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 3 4 3 4 3 5 3 6 3 6 3 7 3 7 3 8 Table 3 21 Table 3 22 Table 3 23 Table 3 24 Table 4 1 Table 4 2 Table 4 3 Table 4 4 Table 4 5 Table 8 1 Table 8 2 Table 8 3 Table 9 1 Table 9 2 Table 9 3 Table 10 1 Table 10 2 Table 10 3 Table 11 1 Table 11 2 Tables Electrical Specifications for the Expansion Cabinet With Two SPARCstorage Array 20
72. TRI S not for HA High speed serial interface SBus HSI S not for HA Serial parallel controller SPC S not for HA Fast Differential SCSI 2 Buffered Ethernet DSBE S Differential Fast Wide Intelligent SCSI 2 Host Adapter DWIS S Single ended Fast Wide Intelligent SCSI 2 Host Adapter SWIS S Ultra Enterprise Cluster Hardware Site Preparation April 1997 No lll Fast Wide SCSI 2 and 10 100 Mbit Buffered Ethernet Fibre Channel Card SOCHA 25 Mbit second Fibre Channel Optical Module FC25 OM SunFastEthernet Removable Media Options Internal CD ROM drive 4x speed 8 Gbyte 4 mm tape drive DDS2 14 Gbyte 8 mm tape drive 2 54 Gbyte QIC tape drive 5 Gbyte 4 mm tape drive 14 Gbyte 8 mm tape drive Graphics Options Not for HA 17 inch premium color monitor TurboGX4 frame buffer and cable 20 inch premium color monitor TurboGX4 frame buffer and cable FFB FFB DBZ ZX frame buffer ZX2 frame buffer 2 8 SPARCSstorage Array Model 100 Series Options SPARCstorage Array Model 101 6x 1 05 Gbyte FC 25 18 x 1 05 Gbyte FC 25 30 x 1 05 Gbyte FC 25 SPARCstorage Array Model 102 e 6x 2 1 Gbyte FC 25 e 18 x 2 1 Gbyte FC 25 30 x 2 1 Gbyte FC 25 SPARCstorage Array Model 112 e 6x 2 1 Gbyte FC 25 e 18 x 2 1 Gbyte FC 25 30 x 2 1 Gbyte FC 25 Product Description 2 19 Controllers Model 200 Model 210 Disks e SPARCstorage RSM 4 2 Gbyte hot plug disks e SPARCstorage RSM 9 Gbyte hot
73. Ultra Enterprise Cluster 6000PDB and HA 2 21 2 9 3 SPARCstorage Array Model 100 Series 2 22 3 Specifications xa utu kr Ro AN SAA AAA ed AR 3 1 3 1 Physical SpecittcatiODS iba e ei 3 1 3 1 1 Ultra Enterprise Cluster 3000 System 3 2 3 1 2 Ultra Enterprise Cluster 4000 System 3 3 3 1 3 Ultra Enterprise Cluster 5000 System 3 4 3 1 4 Ultra Enterprise Cluster 6000 System 3 5 3 1 5 Expansion Cabinet isis ideae E eh 3 6 3 1 6 Cluster Beady Node rn eee ee ska 3 7 3 2 Electrical Specifications v a a3 y erre boe 3 9 3 2 1 Ultra Enterprise Cluster 3000 System 3 9 3 2 2 Ultra Enterprise Cluster 4000 System 3 9 3 2 3 Ultra Enterprise Cluster 5000 System 3 10 3 2 4 Ultra Enterprise Cluster 6000 System 3 11 3 2 5 Expansion Cabinet 42254539 dale wxsexp i 3 11 3 3 Environmental Specifications seva Vedescextuveveves 3 12 3 3 1 Ultra Enterprise Cluster 3000 3 12 3 3 2 Ultra Enterprise Cluster 4000 3 12 3 8 3 Ultra Enterprise Cluster 6000 5000 3 13 4 Planning for Hardware Power and Network Requirements 4 1 4 1 Hardware Planning iid oes esca NARRA 4 1 Contents v 4 1 1 Ultra Enterprise Cluster 3000 Server 4 1 4 1 2 Ultra Enterprise Cluster 4000 Server 4 2 4 1 3 Ultra Enterprise Cluster 5000 Server 4 3 4 14 Enterprise Cluster 6000 Server
74. accept any board type For this PDB system however install CPU Memory boards in the front slots and I O and disk boards in the rear slots to facilitate proper cabling Install the first I O board in slot 1 This is the only slot connected to the onboard SCSI devices Note Install a filler panel in all empty slots to ensure proper cooling and to provide proper bus termination Ultra Enterprise Cluster 4000 Hardware Installation 5 lll LO 9 5 1 CPU Memory Boards 1 Install the CPU Memory boards into the card cage as viewed from the front Install them from lowest 0 through the highest 14 as appropriate For CPU Memory board installation procedures refer to the documentation supplied with the CPU Memory boards or the Ultra Enterprise 6000 5000 4000 System Manual See Figure 9 5 and Figure 9 6 or Figure 9 7 and Figure 9 8 for PDB and HA respectively 2 Fill all unused even numbered slots with a filler panel Front view Rear view CPU Memory board PCMs SCI Clock board W O boards S Optical port S2 mgl We 2 onboard FC OM S asus ERS y EIL EA 0 Ug 9 e E I 1 rfe E Lp 2 g e e oS Sas 3 a E o e SI 6 p da o Y P 0 1 2 SBus slots Figure 9 5 Ultra Enterprise Cluster 4000PDB Card Cage Minim
75. adjust the pads to level the cabinet Internal Access and Leveling 25 7 6 Leveling pad ES Figure 7 4 Leveling Pads Adjusting the Stabilizer Bar Adjust the two leveling pads on the stabilizer bar pa With the stabilizer bar fully extended screw the pads down until they almost touch the floor Leave approximately 6 mm 1 4 inch clearance between the pads and floor This clearance will prevent the cabinet from tilting yet allow you to easily extend and retract the stabilizer bar See Figure 7 5 Slide the stabilizer bar back into the cabinet N Q Restore the wrench to its storage place in the rack Ultra Enterprise Cluster Hardware Site Preparation April 1997 N lll 7 1 1 5 Figure 7 5 Stabilizer Bar Removing and Replacing the Side Panels To remove the side panel 1 Loosen two slot head captive screws near the panel base See Figure 7 6 2 Tilt the panel bottom out 3 Lift the panel up until free of the tabs at the top of the chassis Set the panel aside Internal Access and Leveling 7 7 7 8 Chassis tabs Side panel Captive screws Figure 7 6 Removing the Side Panels To replace a side panel 1 Place the panel against the cabinet so the notches on the panel inside align with the tabs at the chassis top 2 Lower the panel into place and allow it to hang flush agai
76. all trays 8 39 50 71 81 Rear view Front view E e o GI lt y gm gt Cre Jo e gt SSA 4 3 i be Coco O o N Osm SPARCstorage aray P E S o E a 0 e o l Ho T K ki ann 2 50 SSA H5 Tray 0 Tray 1 Tray 2 Tray 3 FIGURE A 20 SPARCstorage Array 200 Series and Differential SCSI Tray Installation V Om SPARCstorage Array 9 9 9 s aa os 9 s o Haal o py Haat Y paq uv Haal ti o L m am Rackmount Rail Installation A 21 lll aN A22 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Configuring the SCI SBus Card bz This appendix provides procedures for configuring and installing the SCI SBus card into the appropriate I O boards B 1 SCI Rings and Scrubber Settings The SCI host device uses the concept of rings in which two or more nodes SCI SBus cards are mutually connected In a given ring one host device SCI SBus card is designated as scrubber Assignment as scrubber is accomplished by setting the onboard scrubber jumper The scrubber performs certain ring maintenance functions The sc
77. and expansion cabinets See Section 6 1 Powering Off an Ultra Enterprise Cluster 6000 or 5000 Cabinet Ultra Enterprise Cluster 5000 Hardware Installation 10 5 10 10 2 2 Removing the Cabinet Panels Remove the cabinet panels to access the power switches and cables See Chapter 7 Internal Access and Leveling 10 2 3 Installing the Cabinets 1 Unplug AC cords and all cabling to allow repositioning of the cabinets 2 Move the cabinets to their designated installation locations See Chapter 4 for site planning guidelines Note When moving the cabinets replace all panels to protect inner components during transport 3 Level the cabinet s See Section 7 1 1 4 Adjusting the Stabilizer Bar and Leveling Pads 10 2 4 Connecting the Main AC Cord 1 For all AC powered internal components plug in AC cords to provide grounding for static electricity This connection provides a ground path that prevents damage from Caution Do not disconnect the power cord when working on the system electrostatic discharge 2 Turn the front panel key switch to the Standby position See Figure 10 1 3 Turn the AC distribution unit power switch to Off The switch is at the rear of the cabinet See Figure 10 2 risk of electrical shock to personnel exists Warning The switch must be turned off at the cabinet AC distribution unit or 4 Uncoil the AC power cord and connect it to an AC outlet The AC out
78. as the network interface pdbinstall is loaded from the PDB software CD Configuring the SCI SBus Card B 5 2 Configure the nodeid adapter number and firmware for all SCI SBus cards Run the sciconf script in opt SUNWsci bin sciconf 3 Power cycle both systems nodes sync init 5 4 Start PDB pdbadmin startnode The scid0 and scidl network interfaces are configured by the PDB script opt SUNWcluster bin reconf_ener during pdbadmin startnode Note pdbadmin stopnode in PDB now takes down the private line network interfaces B 4 Configuring the SCI SBus cards Using the scicon Script B 6 The sciconf script is provided in the SUNWsci package to automatically configure the SCI SBus cards with the appropriate nodeid adapter number and firmware values This script has no command line parameters If the PDB software is not installed the script will prompt for system node number 0 or 1 before proceeding with card configuration Note Only two SCI SBus cards can be installed in each system node Adapter numbers are assigned according to ascending physical SBus slot order The SCI card residing in the lower numbered slot is assigned as adapter number 0 the card in the higher slot is assigned as adapter number 1 Ultra Enterprise Cluster Hardware Site Preparation April 1997 B Note Adapter number 0 cards are connected together using one SCI cable
79. be connected at this time Your system may have more network cables than are listed in this table Connect all remaining cables Ultra Enterprise Cluster 5000 Hardware Installation 10 29 10 10 3 3 4 Internal SCSI Tray If a disk board is installed skip this procedure and proceed to Section 10 3 4 1 I O board in slot 1 install a terminator on the SCSI connector of the I O board to be installed in slot 1 See Figure 10 23 for connector location Figure 10 23 SCSI Terminator Installation on the I O Board 10 3 4 Disk Board HA Only 1 I O board in slot 1 connect one end of the SCSI cable to the onboard SCSI port See Figure 10 24 for connector locations 2 Connect the other end to the SCSI IN port on the disk board 3 Install a terminator on the SCSI OUT port on the disk board 10 30 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 Node 0 Node 1 2 lo 9 fm e o E H e E 2eEs r y See O Q9 o ht O U Ca T na ty EV SDE ESO Q9 e o 9 ro CO Y ADE C3 i E E RADIO ES Ff o e o pp E L T n R m
80. be routed inside walls under the floor through the ceiling or in protective channels Interface cables should be routed away from motors and other sources of magnetic or radio frequency interference e SPARCstorage Arrays can be located up to 2 kilometers 1 24 miles from the system cabinets System cabinets can be located up to 10 meters 33 feet from each other 4 1 1 Ultra Enterprise Cluster 3000 Server Use the following guidelines to prepare a location for your server The server unit requires approximately 1 5 feet 47 cm of space in the front and back for access by service personnel See Figure 4 1 Aminimum space of 6 inches 16 cm is required on both sides of the server to afford adequate air flow 4 1 lll HS Warning To avoid exhaust air recirculation do not put systems or peripherals next to each other side by side Keep power and interface cables clear of foot traffic Route cables inside walls under the floor through the ceiling or in protective channels Route interface cables away from motors and other sources of magnetic or radio frequency interference 1 5 feet access at rear 6 inches on each side E Standalone system 1 5 feet access at front Figure 4 1 Standalone Server Access Areas Top View 4 1 2 Ultra Enterprise Cluster 4000 Server The Ultra Enterprise 4000 system is designed to sit on the floor on a caster base or on a desk or table Note
81. cables that can be connected at this time Your system may have more network cables than are listed in this table 9 7 6 Internal SCSI Tray If a disk board is installed skip this procedure and proceed to Section 9 7 7 Ultra Enterprise Cluster 4000 Hardware Installation 9 17 lll LO 1 I O board in slot 1 install a terminator on the SCSI connector of the UO board panel See Figure 9 15 for connector location Figure 9 15 SCSI Terminator Installation on the I O Board 9 7 7 Disk Board HA Only 1 I O board in slot 1 connect one end of the SCSI cable to the onboard SCSI port See Figure 9 16 for connector locations 2 Connect the other end to the SCSI IN port on the disk board 3 Install a terminator on the SCSI OUT port on the disk board 9 18 Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll Node 0 Node 1 2 lo 9 fm e o E E H E ES J D O fm I I 5 i 1 DO pes GS T Y Q9 o O ht O U bc T na IL O QU 4D Du o Q9 e o 9 ro CO Y ADE C3 i E E RADIO ES Ff e o o pp E L T n R me l
82. drive trays 3 Rear 18 in 46 cm Access to power supply and array controller Left 4 in 10 cm To maintain airflow Right 4 in 10 cm To maintain airflow 3 8 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Oy lll 3 2 Electrical Specifications Electrical specifications are presented in Table 3 17 through Table 3 21 3 2 1 Ultra Enterprise Cluster 3000 System Table 3 17 Server Electrical Specifications Parameter Input current Voltage range Current maximum Current frequency range Input power rating Total continuous power Volt Ampere rating BTU rating Power factor Plug type US International Value 100 120 Vac or 200 240 Vac 8 5A 47 63 Hz 750W 825 VA 2600 BTU 0 92 0 96 NEMA 5 15P 10A single phase IEC 320 C14 3 2 2 Ultra Enterprise Cluster 4000 System Table 3 18 Standalone Server Electrical Specifications Parameter Value Input current Voltage range 100 120 Vac or 200 240 Vac Current maximum 12A Current frequency range 47 63 Hz Input power rating Total continuous power 1370W Volt Ampere rating 1440 VA BTU rating 4680 BTU Specifications 3 9 lll Oy Table 3 18 Standalone Server Electrical Specifications Continued Parameter Value Power factor 0 92 0 96 Plug type U S NEMA 5 15P International 10A single phase IEC 320 connected for 220 240 Vac 3 2 3 Ultra Enterprise Cluster 5000 System Table 3 19 provides specifications for an Ultra
83. for a listing of all cable connections 3 Repeat steps 1 and 2 for all FC OM cables to be connected 4 Dress and secure all cables using cable ties as required Note Cables are shown loose for clarity To complete the task dress and secure all cables using cable ties as appropriate Ultra Enterprise Cluster 3000 Hardware Installation 8 21 8 22 Node 1 d600b00D00D0000000000500000000000000000000 000000005000000000000000000000000000000D0 OOOdOOdOOdOOdQOODOGOOGQOODOODOODOOOGQOOO OO O QOdOOGOOGQOODOODOGOODOODOODOODOOOQOODOOOd qOODOODOODOODOOOODOODOOOO 900009000 0000000000090090 D0 00 0009000000000090 a BoD oob DoD DoD LC LOD o OO 000000 O1 D 0 OO 0 0 O0 PDA PDD 000000000000000D0000 000D 9090014000000 dOOd DOODOGOODO O ODOOOUOODOOOd 300D00D00D0000000000000000000001000 0000900 000000000000000 00009 000000000000 D00000 0 D O OOodOodoOdOOdOODOQOOQOODOODOODOOOQOOOOQ O QOdOOdOOGdOODOODOGQOODOODOODOODOOOQOODOO OG BN DENT DEP era drea DAUD AAD era era ta AA e A o ta OD C CO a AS wueovaocoucoooodocooDOOCOUUOOODOUUOOODUOUOO a o o D o o o lt o o o M o o o M o B o o a o a a
84. gt So0 gt o u 5 SS EZ 6 e e e e Paes Lo 7 0 1 2 Disk board SBus slots Figure 5 11 Ultra Enterprise Cluster 5000 4000HA Card Cage Expansion Example Typical of Node 0 and 1 5 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 a lll 5 8 Ultra Enterprise Cluster 6000 This section covers configuration requirements and interface and cabling for possible Enterprise Cluster 6000 systems Included here is information covering minimum and expansion configuration systems The basic system is shown in Figure 5 12 Node 0 Node 1 N WN AN SPARCstorage Arrays SPARCstorage Array Figure 5 12 Ultra Enterprise Cluster 6000 System Use these example installations as a guide to assembling any size system Omit those elements that will be absent from your particular site installation Ultra Enterprise Cluster Configurations 5 15 5 9 1 Minimum Configuration 5 3 1 1 5 3 1 2 Minimum configuration is two nodes supporting two PDB or three HA SPARCstorage Arrays Power Cooling Modules PCMs Three PCMs minimum must be installed in each node Board Population The card cages in the node 0 and node 1 servers are configured identically Figure 5 13 and Figure 5 14 show minimally populated card cages for both nodes CPU Memory Boards Even numbered slot 0 is configured with a CP
85. in the power cord female end See Figure 10 3 c Release the cover j FAN A F x bz c i Figure 10 3 Power Connector and Detachable Cable 10 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 6 Plug the power cord male end into the facilities power connector As noted in Chapter 4 Planning for Hardware Power and Network Requirements the AC outlet must be part of a circuit dedicated to this system Do not connect electrical motors or heaters to this circuit This connection provides a ground path that prevents damage from Caution Do not disconnect the power cord when working on the system electrostatic discharge 10 2 Customer Assembled Ultra Enterprise Cluster 5000 Hardware Installation Do these tasks in the order listed Preparing the Cabinet page 10 5 Removing the Cabinet Panels page 10 6 Installing the Cabinets page 10 6 Connecting the Main AC Cord page 10 6 Installing the SPARCstorage Array Systems in the System Cabinets page 10 7 Installing the Terminal Concentrator page 10 10 Configuring the Card Cages page 10 16 Cabling System Components page 10 21 10 2 1 Preparing the Cabinet Prepare the cabinet using the procedures which follow 10 2 1 1 Powering Off the Cabinets If the system cabinets are powered and operating halt the operating systems and power off the system
86. is centered in the hole 3 Press down on the side opposite the dot to secure the popout in place A Install the remaining three popouts in the same manner Figure A 12 Replacing the Popouts in the Top Panel Ultra Enterprise Cluster Hardware Site Preparation April 1997 pee lll A 3 3 4 Removing the Feet 1 Invert the array See Figure A 13 2 Unscrew all four feet The feet and screws are not used in this configuration Figure A 13 Removing the Feet A 3 3 5 Removing the Bottom Panel The bottom panel is identical to the top panel and is removed in the same manner With the array inverted and the front facing you repeat Section A 3 3 2 Removing the Top Panel See Figure A 11 Rackmount Rail Installation A 13 m A 4 Installing the Base Plate on the Chassis The base plate mounts to the chassis underside kit for this purpose The screws originally used for the feet are too long and Caution For this procedure use only the four short screws provided in the will damage the chassis 1 Invert the array with the front facing you Figure A 14 2 Place the base plate on the array Figure A 14 3 Loosely thread four short screws from the kit in all four holes When all screws are started tighten them 4 Restore the array to the upright position with the front facing you See Figure A 15 Figure A 14 Installing the Base Plate on the Array A 14 Ultra Enterprise Clust
87. it then becomes the default for console input thus preventing input from the system administration workstation terminal concentrator serial port In addition plugging a keyboard directly into a host I O board while power is applied to the host sends a break signal to the Solaris operating system just as if you had typed a Stop L1 A on the keyboard Warning Do not plug a keyboard directly into a host I O board If a keyboard 1 Plug one end of cable PN 530 2152 into the terminal concentrator Port 1 See Figure 8 10 2 Plug the other end into the administration workstation RS 232 connector RS 232 to RJ 45 Client net Ethernet Z H LE J JE 5 7 Nm Administration workstation Terminal concentrator Figure 8 10 Connecting the Administration Workstation 3 Plug the client network Ethernet cable into the administration workstation Ethernet socket 8 7 2 Connecting the Terminal Concentrator Using the 530 2152 5 Meter or 530 2151 1 Meter cable proceed as follows 1 Connect Node 0 a Plug the DB25 end of the cable into the Serial A port on the clock board in node 0 See Figure 8 11 Ultra Enterprise Cluster 3000 Hardware Installation 8 15 lll Co b Plug the RJ 45 end of this cable into the terminal concentrator port 2 See Figure 8 12 Serial
88. o o o o a a o a a o I o El o B B K 9 o a 0 0 gt A d E A TEM Osun L Osun ol ada Pe S s Array 0 S 3 Array 1 O oo o e oo o EA L J o aca Bat G ag Joo 5 a Cas Bag G ag Joo 5 A B A B Figure 8 16 SPARCstorage Array 0 and 1 Connection Example Ultra Enterprise Cluster Hardware Site Preparation April 1997 6d60 00b00bOo boOO0ObOObOObOO0000000b CG o o 000 6460000500b00b0000b0050050060000000500000b 0000600 odo C
89. oe Ra Rh alba oka ng gata 9 6 Node l Card Cage aea aD AER De ae RICERCA E AA pe RRR 9 7 Cabling System Components 236444 ex esee ER Re 9 7 1 Cabling the Administration Workstation 9 7 2 Connecting the Terminal Concentrator 9 7 3 Connecting Node 0 to Node 1 Ethernet 9 7 4 Connecting Node 0 to Node 1 SCI Host a a Cables sius es racer 9 7 5 Remaining Cables iii EA E ea 9 7 6 Internal SCSI Tay 9 7 7 Disk Board HA Only ccce ee 9 7 8 Connecting the SPARCstorage ArrayS ix 10 11 9 8 Closing the Cabinet porra 9 26 Ultra Enterprise Cluster 5000 Hardware Installation 10 1 10 1 Factory Assembled Ultra Enterprise Cluster BUD Hard ate sacan epe E rao AA 10 1 10 1 1 Preparing the Cabinet ee ee ae E 10 2 10 1 2 Connecting the Power Corda 10 3 10 2 Customer Assembled Ultra Enterprise Cluster 5000 Hardware Installation 25 2 2522 Re era 10 5 10 2 1 Preparing the Cabinet err 9 10 5 10 2 2 Removing the Cabinet Panels 10 6 10 2 3 Installing the Cabinets 2 ics esos etn nhat 10 6 10 2 4 Connecting the Main AC Cord 10 6 10 2 5 Installing the SPARCstorage Array Systems in the System Cabinets o Ra 10 7 10 2 6 Installing the Terminal Concentrator 10 10 10 3 Power Cooling Modules PCMs oooocoocooo mo 10 15 10 3 1 Configuring the Card Cages iii 10 16 10 3 2 Cabling System Components o oooo moo 10 21 10 3
90. one minute and then boot Figure 6 3 You should see and hear several things happen The fans in the power supplies begin turning The left LED green on the front of the cabinet turns on immediately to indicate the DC power supply is functioning The middle LED yellow begins flashing The right LED green flashes after firmware completes Power On Self Test to denote that the operating system is running Note These events may take several minutes to occur Caution Never move the system cabinet or the expansion cabinets when system power is on Excessive movement can cause catastrophic disk drive failure Always power the server OFF before moving cabinets o9 og 0608050000000000 00000000 0600d005b00 Figure 6 3 Key Switch in the On Position Powering Offand On 6 5 6 6 3 Powering Off an Ultra Enterprise Cluster 4000 Cabinet Note It is understood that the server in question is in the process of hardware installation and has no users nor data files to be concerned with If this is not true halt the system using the procedure found in the Enterprise Cluster System Service Manual Sun part number 802 6786 1 Turn the front panel key switch tod the standby position fully counter
91. only the DC power supply and DC powered devices in the cabinet 2 Turn off the system power in this order a External drives and expansion cabinets if any Ultra Enterprise Cluster Hardware Site Preparation April 1997 b System cabinet AC distribution unit power switch The unit is at the rear of the cabinet see Figure 6 2 c Terminal Local off remote switch Power switch A A LOCAL Pu REMOTE LJ o SWITCHED OUTLET CONTROL J15 OUT J14 IN EM POWER AVAILABLE SWITCHED OUTLETS O 00 Pe M O o A W O P 9 o E R O NN Figure 6 2 AC Distribution Unit Power Switch Caution Turn off the power at the AC distribution unit power switch on the rear of the system before attempting to access the system cabinet Powering Off and On 6 3 N Warning Some users may elect to power internal cabinet components like SPARCstorage Arrays the terminal concentrator etc from an external power source a power circuit other than from the cabinet internal AC power distribution unit These components if plugged into an external power source will remain powered even after the cabinet AC distribution unit is turned OFF Examine the system to verify that no component is externally powered before proceeding If any component is externally powered turn the component OFF using the ON OFF swi
92. port A Figure 8 11 Serial Port A on the Clock Board 2 Connect Node 1 a Plug the DB25 end of the cable into the Serial A port on the clock board in node 1 b Plug the RJ 45 end of this cable into the terminal concentrator port 3 See Figure 8 12 3 Connect the public net Ethernet Plug the public net Ethernet cable into the RJ 45 or DB25 connector as appropriate on the terminal concentrator 8 16 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Co lll Administration workstation Public net Ethernet Node 0 Terminal Node 1 concentrator GP PILI L LSS AA POLL LOCAL BA IS o OI EA ODER PPP LOI L OA EO SCA E E h E ior UR e o o o ole o E o o e o F sh C gt O o o Q9 Vv O Q9 9 0 o e i gt 4 gt b x o 4 4 4 o S n Ln s n Lin 001001 De LOL a a o a a o 9 Oni In Oni R IH iB Ui lin e e e e e H a e a o e Cs E S J
93. to configure the SCI SBus card and driver for use in this system Appendix C Mixed Compute Platforms provides guidelines on which platform types are allowed to be combined to make a cluster and explains how to connect the different node types together This document may not include specific software commands or procedures Instead it may name software tasks and refer you to operating system documentation or the handbook that was shipped with your new hardware The type of information that you might need to use references for includes Shutting down the system Booting the system Configuring devices e e e Other basic software procedures Ultra Enterprise Cluster Hardware Site Preparation April 1997 See one or more of the following e Solaris 2 x Handbook for SMCC Peripherals contains Solaris 2 x software commands On line AnswerBook for the complete set of documentation supporting the Solaris 2 x software environment Other software documentation that you received with your system Typographic Conventions The following table describes the typographic changes used in this book Typeface or Symbol Meaning Example AaBbCc123 The names of commands Edit your login file files and directories Use 1s a to list all files on screen computer output machine name You have mail AaBbCc123 What you type contrasted machine name su with on screen computer Password output AaBbCc12
94. 0 Series Units and Four RSM Units 3 11 Temperature Humidity and Altitude Limits 3 12 Standalone Server Temperature Humidity and Altitude LimitS oocoocccccccccccccccccccc 3 12 Cabinet Server Temperature Humidity and Altitude Limits cessisse Re eds 3 13 Platform and Chassis Connector Requirements 4 7 Open Circuit Voltages ae EE ES KR R eE RE ER RETER 4 8 Generic Pinouts for Sun System Boards and Communication Producte n susa asne rasne 4 10 Ethernet Design Considerations 4 11 Ethernet Cabling Limitations for N type Coaxial Cable 4 12 SPARCstorage Array 100 Series Nominal Power and Maximum Current Parameters lt anan nn nnana 8 5 Cable Connections Except Fiber Optic oo o 8 14 Node to SPARCstorage Array Cable Connection Example 8 26 SPARCstorage Array 100 Series Nominal Power and Maximum Current Parameters 9 4 Cable Connections Except Fiber Optic oo o 9 12 Node to SPARCstorage Array Cable Connection Example 9 26 SPARCstorage Array 100 Series Nominal Power and Maximum Current Parameters lees 10 8 Cable Connections Except Fiber Optic o o 10 22 Node to SPARCstorage Array Cable Connection Example 10 38 SPARCstorage Array 100 Series Nominal Power and Maximum Current Parameters 0 00 cee cece eee 11 8 Cable Connections Except Fiber Optic oo o 11 24 xxvii x
95. 0 series units SPARCstorage RSM units Differential SCSI disk trays Checklist 1 13 1 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 No Ii Product Description 2 1 Standard Features Ultra Enterprise clustered systems operate on various hardware configurations including the Ultra Enterprise 3000 4000 5000 and 6000 systems These systems are targeted at enterprise wide mission critical database applications Ultra Enterprise clustered systems support several PDB parallel data base and HA high availability database products For information on the database products supported refer to the applicable document e PDB Ultra Enterprise Cluster Administration Guide HA Solstice HA 1 2 Software Administration Guide Clustered systems improve the availability characteristics of databases A cluster consists of two compute nodes servers The two nodes communicate with each other using two private network links The benefits of coupling database servers are increased performance and higher level of database availability The database s for these systems are implemented on clustered platforms using redundant SPARCstorage Array Model 100 series units For expanded systems the controllers can be either SPARCstorage Array Model 200s or 210s which are used with SPARCstorage RSM s removable storage media unit or 9 Gbyte disk trays Clustered software maintains a mirror image database on the dis
96. 0000000000000 000800800000000008000000 DOOO00000000000000000080000008000000080b000 0000000000000000000000000000000000000000 d000000000000000000000000000000000000000 o gt P gt gt s gt gt D gt gt o o o o T al 8 8 7 4 Figure 8 13 Node to Node Ethernet Connection 7 3 2 Second Cable 1 Connect one end of the Ethernet cable to the Ethernet port on I O board slot 3 2 Connect the other end to the Ethernet port on I O board slot 3 Connecting Node 0 to Node 1 SCI Host and Cables Connect one Enterprise Cluster 3000 node to the other Note Node to node connection is made using the appropriate SCI cables 530 2360 2 meter 530 2361 5 meter 530 2362 10 meter Ultra Enterprise Cluster Hardware Site Preparation April 1997 8 7 4 1 First Cable T EE TI I AI MI MM CIA M A ET AA AAA AAA O 6060060bo6Oo0bOObOOOObOObOObOoOO 0
97. 12 2 leveling pads adjust 7 5 local off remote switch 9 2 10 3 11 3 M messages boot 6 14 POST 6 14 mixed compute platforms C 1 O open hinged front door 7 2 options external Ultra Enterprise Cluster Ultra Enterprise Cluster Hardware Site Preparation April 1997 5000 4000 3000 2 20 6000 2 21 outer covers See panel remove P panel front bezel Ultra Enterprise 3000 7 10 Ultra Enterprise 4000 7 9 open door cabinet 7 2 Ultra Enterprise 3000 7 10 remove rear screen 7 3 side 7 7 replace kick 7 4 rear screen 7 3 side 7 8 SPARCstorage array remove bottom A 13 front A 8 side A 9 top A 10 platforms mixed C 1 popouts top panel remove A 10 replace A 12 POST messages 6 14 power cabinet AC switch 6 3 6 7 9 2 10 3 11 3 local off remote switch 9 2 10 3 11 3 off Ultra Enterprise Cluster 3000 cabinet 6 9 4000 system 6 6 6000 5000 system 6 2 on SPARCstorage array pointer 6 14 Ultra Enterprise Cluster Index 3000 cabinet 6 11 4000 cabinet 6 8 6000 5000 system 6 4 requirements 4 5 preparation 4 1 R rails install base plate on SPARCstorage array A 14 rear screen panel See panel remove reboot terminal concentrator 12 4 remove panel rear screen 7 3 side 7 7 SPARCstorage array panel bottom A 13 front A 8 side A 9 top A 10 popouts A 10 replace panel kick 7 4 rear screen 7 3 side 7 8 SPARCstorage array top panel popouts A
98. 3 Command line placeholder To delete a file type rm filename replace with a real name or value AaBbCc123 Book titles new words or Read Chapter 6 in the User s Guide terms or words to be These are called class options emphasized You must be root to do this Preface xxxi Shell Prompts xxxii The following table shows the default system prompt and superuser prompt for the C shell Bourne shell and Korn shell Shell Prompt C shell C shell superuser Bourne shell and Korn shell Bourne shell and Korn shell superuser machine name machine nameid Ultra Enterprise Cluster Hardware Site Preparation April 1997 Related Documentation The following documents contain information that may be helpful to the system administrator and service provider Table P 1 Related Documents Product Family Title Part Number Ultra Enterprise Server Installation Service Safety EMI Installation Service Safety EMI SPARCstorage Array 100 SPARCstorage Array 200 Ultra Enterprise Server 3000 Binder Set Ultra Enterprise 3000 Systems Installation Guide Ultra Enterprise 3000 System Manual Ultra Enterprise System Cabinet Regulatory Compliance Guide Ultra Enterprise Server 6000 5000 4000 Binder Set Ultra Enterprise 6000 5000 4000 Systems Installation Guide Ultra Enterprise 6000 5000 4000 Systems Manual Ultra Enterprise System Cabinet Regulatory Compliance Guide SPARCstorage A
99. 4 3 lll HS Access 4 feet Additional Cabinets D Cabinet C Cabinet A CabinetB Rear and above 2 arrays _ _ e 2 arrays 20x Access Node 0 a Access Node 1 4 RSM units 4 RSM units 3 feet 1 server 3 feet 1 server 8 arrays 8 arrays Front Access 3 feet Figure 4 3 Enterprise Cluster 5000 Server Floor Plan Example Maximum Configuration Top View 4 1 4 Enterprise Cluster 6000 Server Determine the floor plan layout for your installation Figure 4 4 and Figure 4 5 are examples of floor plans for minimum and maximum configurations respectively Access 4 feet Cabinet A Cabinet B Rear Node 0 4 Access _y Node 1 1 server 3 feet 1 server 1 or 2 arrays 1 array Front Access 3 feet Figure 4 4 Enterprise Cluster 6000 Server Floor Plan Example Minimum Configuration Top View 4 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Hx lll Access 4 feet Additional Cabinets D Cabinet C Cabinet A CabinetB Pear and above 2 arrays _ 2arrays Access Node 0 Access Node 1 4 RSM units 4 RSM units 3 feet 1 server 3 feet 1 server 2 arrays 2 arrays Front Access 3 feet Figure 4 5 Enterprise Cluster 6000 Server Floor Plan Example Maximum Configuration Top View 4 2 Power Requirements and Options Each cabinet should have a dedicated AC breaker
100. 5 5 8 9 3000PDB 5 4 8 7 4000HA 5 12 9 7 4000PDB 5 11 9 6 5000HA 5 12 10 18 5000PDB 5 11 10 17 6000HA 5 17 11 19 6000PDB 5 17 11 17 checklist 1 1 commands addr 12 3 image 12 4 ping 12 5 seq 12 4 compute platforms mixed C 1 I 1 configuring SCI SBus card B 1 terminal concentrator 12 1 Ultra Enterprise Cluster 3000 8 1 4000 9 1 5000 10 1 10 5 6000 11 1 11 5 connecting power cord 8 2 9 2 10 4 11 4 D description server 2 1 disk array chassis See SPARCstorage array disk drive caution 6 5 door open 7 2 Ultra Enterprise 3000 7 10 Ultra Enterprise 4000 7 1 E Ethernet network planning 4 7 expansion cabinet A 4 F floorplan Ultra Enterprise Cluster 5000 4 3 Ultra Enterprise Cluster 6000 4 4 front panel array remove A 8 H height adjust levelling pads 7 5 hinged door open 7 2 hole numbers side rails A 2 to A 4 SPARCstorage 200 series A 18 SPARCstorage RSM A 20 terminal concentrator 10 10 11 10 I installation base plate on the array A 14 side rails in the cabinet A 6 SPARCstorage array 200 series A 18 in the cabinet A 15 SPARCstorage RSM A 20 Ultra Enterprise Cluster 3000 8 1 4000 9 1 5000 10 1 6000 11 1 IP address setting 12 3 K key switch 6 2 to 6 13 8 2 9 1 to 9 2 10 2 11 2 11 6 kick panel See panel remove kick L label fiber optic cables 8 21 9 19 10 31 11 33 LEDs cabinet 6 5 terminal concentrator
101. 7 5 9 2 Expansion 5 3 2 1 5 3 2 2 Note Do not occupy or connect cables to both optical ports on any given I O board Beyond minimum configuration use the first available optical module port following all such ports in the system This will ensure that the controller numbering is preserved if the Solaris operating environment is reinstalled An example of an expansion configuration consists of six cabinets equipped as follows First and second cabinets each containing One node Two SPARCstorage Array 100 series units Expansion cabinets each containing Two SPARCstorage Array 200 series units hosting the devices below Four SPARCstorage RSM or differential SCSI tray systems Power Cooling Modules PCMs Besides providing power each PCM provides required cooling to the one or two boards installed adjacent to it For this reason every board or board pair must be supported by an adjacent PCM In this system a full complement of PCMs is eight per node sixteen per cluster Board Population The card cages in the node 0 and node 1 servers are configured identically Figure 5 15 and Figure 5 16 show the example expansion board population installed in the card cages of both nodes CPU Memory Boards Even numbered slots 0 2 4 6 8 10 12 and 14 are configured with CPU Memory boards Ultra Enterprise Cluster Hardware Site Preparation April 1997 a lll CPU Memory boards 0 2 4 6
102. 8 10 12 14 I O Boards Odd numbered slots 1 3 5 7 9 11 13 and 15 are configured with I O boards SBus cards are installed in the appropriate SBus slots FRONT VIEW REAR VIEW SCI Clock board POMs y 1 O boards m e Ve O gt SU TR E Optical port o 9000 Do e dl onboard FC OM lo o o 9 UI 1 lo M o o 9 NC o GS 29 3 lens d o o l9 ao oD E 5 ph O Y EXE e 7 el e 7S o SD E 7 a E o o e e 2 9 t O U O DE 9 lo e 2 9 Q gt 11 s E ars o o l0 coc 13 r I o ol o LM gt 15 0 1 2 Load board SBus slots Figure 5 15 Ultra Enterprise Cluster 6000PDB Card Cage Expansion Example Typical of Node 0 and 1 Ultra Enterprise Cluster Configurations 5 19 lll a FRONT VIEW REAR VIEW CPU Memor Pri FC S Clock board G y PCMs rivate net ock board 0 boards aN X E ai e 2 Optical port r See EOS AS onboard FC OM G ND ou G S
103. A 1 2 Software Planning and Installation Guide part number 802 7211 12 5 2 Ultra Enterprise Cluster PDB Perform the procedures which follow For information on installing the Solaris 2 5 1 operating system on the nodes from the Solaris CD and the SMCC Updated CD refer to the SMCCSPARC Hardware Platform Guide Solaris 2 5 1 Note The Solaris operating system installed on both PDB nodes must match the operating system version level Sun Solaris 2 5 1 installed on the system administration workstation The operating system is installed during hardware installation to facilitate running the SunVTS diagnostic system SunVTS is used to verify that the hardware is installed correctly At this point establish an important installation milestone Completion and sign off of this acceptance test by both the installer and the site client is a mutual declaration that operational acceptance of all nodes of the cluster hardware with associated components cabling and installation has been completed checked and approved Ultra Enterprise Cluster Hardware Site Preparation April 1997 iZ Note This acceptance test is designed to prove that the physical installation was performed correctly and completely It is not the intent of the acceptance test to prove system fault detection capabilities nor to inject failures for example and then to monitor the results Perform the acceptance test after All hardware is instal
104. All J ua la 4 a X Tels a N a o b o a Figure 11 26 SPARCstorage Array 2 and 3 Connection Example Ultra Enterprise Cluster 6000 Hardware Installation 11 35 mmm Node 0 Cabinet C Node 1 M Z m e D E b b p eu Ea ce e qm S amp S re lo E gc ES i o o PONT Y m Yo 9 7 A A 7 lol RSMO Ge VA IAE Note Example only You may o U INDIA e HSM 1 choose to connection arrays Al ii Ti LAE to other FC S card locations l av ZU 3 o lo HZ LY Le AGE lau o ES TIA 4 444 Haus A Figure 11 27 SPARCstorage Array 4 and 5 SPARCstorage Array 200 Series Connection Example 11 36 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 Cabling 1 Plug one end of the fiber cable into the FC OM in the I O board See
105. Board nnnnnanasnna nan 8 16 Node Interface to the Terminal Concentrator 8 17 Node to Node Ethernet Connecti0N oooooooooomooo 8 18 Node to Node SCI Connection o 8 19 SCSI Terminator Installation on the I O Board 8 20 SPARCstorage Array 0 and 1 Connection Example 8 22 SPARCstorage Array 2 Connection Example 8 23 SPARCstorage Array 3 and 4 SPARCstorage Array 200 Series Connection Example eserci kand EE a o 8 24 SPARCstorage Array Fiber Cable Connection 8 25 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Figure 9 1 Figure 9 2 Figure 9 3 Figure 9 4 Figure 9 5 Figure 9 6 Figure 9 7 Figure 9 8 Figure 9 9 Figure 9 10 Figure 9 11 Figure 9 12 Figure 9 13 Figure 9 14 Figure 9 15 Figure 9 16 Figure 9 17 Figure 9 18 Figure 9 19 Figure 9 20 Figure 9 21 Figures Key Switch in the Standby Position oooooooooo 9 2 AC Power Switch and AC Connector ssas sssse usen 9 2 SPARCstorage Array Voltage Rating on the Serial Number Label crc x RZ R RR irise RAR KRE R RR T 9 3 SPARCstorage Array AC Power Connector and Power Switch 9 4 Ultra Enterprise Cluster 4000PDB Card Cage Minimum Population Typical of Node 0 and 1 9 6 Ultra Enterprise Cluster 4000PDB Card Cage Expansion Example Typical of Node 0 and 1 9 7 Ultra Enterprise Cluster 4000HA Card Cage Minimum Population Typ
106. Client net Ethernet O O 000 O O O O GJ Figure 10 18 Connecting the Administration Workstation 3 Plug the client network Ethernet cable into the administration workstation Ethernet socket Ultra Enterprise Cluster 5000 Hardware Installation 10 23 10 10 24 10 3 2 2 Connecting the Terminal Concentrator Using the 530 2152 5 Meter or 530 2151 1 Meter cable proceed as follows 1 Connect Node 0 a Plug the DB25 end of the cable into the Serial A port on the clock board in node 0 See Figure 10 19 b Plug the RJ 45 end of this cable into the terminal concentrator port 2 Connect Node 1 a Plug the DB25 end of the cable into the Serial A port on the clock board in node 1 b Plug the RJ 45 end of this cable into the terminal concentrator port 3 Connect the public net Ethernet Plug the public net Ethernet cable into the RJ 45 or DB25 connector as appropriate on the terminal concentrator Ultra Enterprise Cluster Hardware Site Preparation April 1997 10
107. Cstorage Array Model 100 series units For expanded systems the disk arrays are SPARCstorage Array Model 200s hosting SPARCstorage RSM units Removable Storage Media or SPARCstorage Array Model 210s hosting differential SCSI trays Figure 2 8 shows the Ultra Enterprise 5000 hardware required to support the Ultra Enterprise software Note that these figures depict a system with more than the minimum configuration Terminal concentrator hidden SPARCstorage Array Model 112 Figure 2 8 Basic Ultra Enterprise Cluster 5000 System 2 4 1 PDB Configuration The minimum configuration is listed below 12 Ultra Enterprise Cluster Hardware Site Preparation April 1997 No lll Two nodes based on the 5000 each containing One CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM Two I O boards each with one SCI card and one FC OM Two SCI cables and brackets Two SPARCstorage Array Model 100 series units Four fibre optic cables Terminal concentrator with short and long serial cables CD ROM and 8 mm tape drive Administration workstation with CD ROM drive not shown 2 4 2 HA Configuration The minimum configuration is listed below Two nodes based on the 5000 each containing One CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM Two I O boards each with one FC OM Two SPARCstorage Array M
108. E RIDE RA 8 10 8 6 3 I O Boards Intended for Slot 1 and Optionally 5 8 11 8 64 Clock Board asses reete xen 8 13 8 6 5 Node 1 Card Age 455486 sos es wx Vua ES dd 8 13 8 7 Cabling System Components ecce ques 8 13 8 7 1 Cabling the Administration Workstation 8 15 8 7 2 Connecting the Terminal Concentrator 8 15 8 7 3 Connecting Node 0 to Node 1 Ethernet 8 17 8 7 4 Connecting Node 0 to Node 1 SCI Host and Cables 2 22 25 REEF RE Rhe E EE WE T 8 18 8 7 5 Remaining Cables secc ree 8 20 8 7 6 Internal SCSI Devices 8 20 8 7 7 Connecting the SPARCstorage Arrays 8 21 8 8 Closing the Cabinet 44 ad eg pati ea RE de er 8 26 9 Ultra Enterprise Cluster 4000 Hardware Installation ooooooooooooo o 9 1 viii Ultra Enterprise Cluster Hardware Site Preparation April 1997 Contents 9 1 Preparing the System n ed a dee Ei 9 2 Installing the SPARCstorage Array Systems 9 2 1 Preparing the SPARCstorage Arrays 9 2 2 Connecting the Power 22a der Rr EE ERE 9 3 Installing the Terminal Concentrator 9 4 Power Cooling Modules PCMS 9 5 Configuring the Card Capes cese eere teen 9 5 1 CPU Memory Boards nn 9 5 2 I OBoards eeeeeee eee eee 9 5 3 I O Boards Intended for Slot 1 and Optionally DANG sxetaxs3xaeeRens es coo eee eed 954 Filler Parties 9 5 5 Disk Board HA System Only 2 erre ee ews 9 5 6 Clock Board
109. Enterprise 5000 Cluster Systems cabinet equipped with three SPARCstorage Arrays Table 3 19 Cabinet Server Electrical Specifications Parameter Specification Value Input current Voltage range 200 240 Vac Current maximum 24A Current frequency range 47 63 Hz Input power rating Total continuous power 3500W with 3 drive trays Volt ampere rating 3700 VA BTU rating 12 000 BTU Power factor 0 92 0 96 Plug type U S NEMA L6 30P for 200 240 Vac International 32A single phase IEC 309 connected for 220 240 Vac 3 10 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Oy lll 3 2 4 Ultra Enterprise Cluster 6000 System Table 3 20 provides specifications for one server cabinet equipped with two SPARCstorage Arrays Table 3 20 Cabinet Server Electrical Specifications Parameter Specification Value Input current Voltage range 200 240 Vac Current maximum 24A Current frequency range 47 63 Hz Input power rating Total continuous power 3500W with 3 drive trays Volt ampere rating 3700 VA BTU rating 12 000 BTU Power factor 0 92 0 96 Plug type US NEMA L6 30P for 200 240 Vac International 32A single phase IEC 309 connected for 220 240 Vac 3 2 5 Expansion Cabinet Table 3 21 provides specifications for the expansion cabinet housing two SPARCstorage Array 200 series and four RSM units Table 3 21 Electrical Specifications for the Expansion Cabinet With Two SPARCstorage Array 200 Series Units and Four RSM Un
110. Enterprise Cluster Hardware Site Preparation April 1997 10 SPARCstorage Array 2 Bla Terminal concentrator node 0 only 2 Connect the chassis to power Plug the power cords from the chassis into the power sequencer Use the switched outlets identified in Figure 10 6 for the SPARCstorage Arrays 0 5 as appropriate Node 0 O Blower assemblies O O 9 o S e m E os e Oo O O O LO LOU SPARCstorage gt Array 4 O O O O OJ LO PON fo O o LOJI ILOJ SPARCstorage Array 0 O Oly O O LO LO SPARCstorage Array 3 H Terminal concentrator node 0 only Node 1 000 9 a B 8 8 o o Oll IO O O J Le o Io O O OJ LO OT IO O O O Le o1 OY O O LO LO Blower assemblies SPARCstorage Array 5 SPARCstorage Array 1 LA Figure 10 6 Plugging SPARCstorage Arrays Terminal Concentrator into the Power Sequencer 3 Turn on the AC power switch on all SPARCstorage Arrays See Figure 10 5 Ultra Enterprise Cluster 5000 Hardware Installation 10 9 10 10 2 6 Installing the Terminal Concentrator Install the terminal concentrator mounting bracket in the primary cabinet 1 Install the terminal concentrator bracket hinge a Locate the hinge portion of the terminal conc
111. Example Maximum Configuration Top View oooooooomoo 4 4 Enterprise Cluster 6000 Server Floor Plan Example Minimum Configuration Top View ooooooooomoo 4 4 Enterprise Cluster 6000 Server Floor Plan Example Maximum Configuration Top View 4 5 Power Connector and Detachable Cable 4 6 Connecting Twisted Pair Ethernet to N type Coaxial Cable 4 12 Ethernet Cabling Length Example Using N type Cable 4 13 Example of 10 100BASE T Twisted Pair Ethernet 4 14 Ultra Enterprise Cluster 3000 System n n aanaannanana 5 2 Ultra Enterprise Cluster 3000PDB Card Cage Minimum Population Typical of Node 0 and Node 1l 5 4 Ultra Enterprise Cluster 3000HA Card Cage Minimum Population Typical of Node 0 and Node 1l 5 5 Ultra Enterprise Cluster 3000PDB Card Cage Expansion Example Typical of Node 0 and Node T 5 7 Ultra Enterprise Cluster 3000HA Card Cage Expansion Example Typical of Node 0 and Node T 5 8 Ultra Enterprise Cluster 4000 Server o oooooooo om 5 9 Ultra Enterprise Cluster 5000 Server o ooooooo oo m 5 10 Ultra Enterprise Cluster 5000 4000PDB Card Cage Minimum Population Typical of Node 0 and 1 oooooo o o 5 11 Ultra Enterprise Cluster 5000 4000HA Card Cage Minimum Population Typical of Node 0 and 1 5 12 Ultra Enterprise Cluster 5000 4000PDB Card Cage Expansion Example Typical of
112. Figure 11 28 or Figure 11 29 as appropriate Key notches o Ss e o uri EY gt Ra Dato C Keys hidden e o Sue Eu Key notches d o C VO qm 1 e e mo e o 59 o e o 9 di o e o 9 o O a oO Oo EET Di e eo Figure 11 28 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 100 Series Unit Ultra Enterprise Cluster 6000 Hardware Installation 11 37 s Em Keys Key notches Keys hidden Key notches o z RJ S NS gt cU c 5 i Poo EXE Py U 9 eec c2 o le o j e E 9 ES 2 Es o A bau um e CA 29 C O o 2 vE o o 9 E L E E 1 o 9 O ce SS O 1 0 1 O e L 2 Figure 11 29 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 200 Series Unit 2 Plug the other end of
113. L lt Y gl Lo O OC es N Uv Uv U 2 U U 2 O e SS oz E S A e B L 4 E Y DOE O e BE o gt P Qo9 U 9e EA m e o o SSS A Figure 10 29 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 100 Series Unit 10 36 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 Key notches Keys Keys hidden Key notches E Tal U NI W nu lle EI a Figure 10 30 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 200 Series Unit Ultra Enterprise Cluster 5000 Hardware Installation 10 37 mI Table 10 3 Node to SPARCstorage Array Cable Connection Example I O Board From Node 0 FC OM From Node 1 FC OM To SPARCstorage Array 1 Onboard 0 port A Onboard 0 port B 3 Onboard 1 port A Onboard 1 port B 5 Onboard 2 port A Onboard 2 port B 1 SBus slot 1 3 port A SBus slot 1 3 port B 3 SBus slot 1 4 port A SBus slot 1 4 port B 5 SBus slot 1 5 port A SBus slot 1 5 port B 1 SBus slot 2 6 port A SBus slot 2 6 port B 3 SBus slot 2 7 port A SBus slot 2 7 port B 10 4 Closing the Cabinet Replace all panels on the ca
114. Node 0 and 1 5 13 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Figure 5 11 Figure 5 12 Figure 5 13 Figure 5 14 Figure 5 15 Figure 5 16 Figure 5 17 Figure 5 18 Figure 6 1 Figure 6 2 Figure 6 3 Figure 6 4 Figure 6 5 Figure 6 6 Figure 6 7 Figure 6 8 Figure 6 9 Figure 7 1 Figure 7 2 Figure 7 3 Figure 7 4 Figure 7 5 Figures Ultra Enterprise Cluster 5000 4000HA Card Cage Expansion Example Typical of Node 0 and 1 Ultra Enterprise Cluster 6000 SysteM oooooooooooo Ultra Enterprise Cluster 6000PDB Card Cage Minimum Population Typical of Node 0 and 1 Ultra Enterprise Cluster 6000HA Card Cage Minimum Population Typical of Node 0 and 1 Ultra Enterprise Cluster 6000PDB Card Cage Expansion Example Typical of Node 0 and 1 Ultra Enterprise Cluster 6000HA Card Cage Expansion Example Typical of Node 0 and 1 SPARCstorage Array Fiber Cable Connection SPARCstorage Array 200 Series Connecti0N Key Switch in the Standby Position oooooooomoo AC Distribution Unit Power SWitch o oooooo o Key Switch in the On Position Key Switch in the Standby Position oooooooomoo AC Power Switch 2 0 Key Switch in the STANDBY Position 4 Turning the AC Power Switch to OFF o oo o o oo Turning the AC Power Switch to ON Key Switch
115. OODOODOOOdO 00000 9q00DOODOODOODOOOODOODOOOOOO0O0QOQ00DOOOQO O0 BBD WWD WO BW WOH BO WO CCB OSV WOB GBH 0006000006000 00000000000000000000000000 80 00 0000000000000000000000000000000000000 PCMs 09099 00009009000090090090090090000000000 q90000000000D0090000000900900000900000900 COS ANS AAS o Ho eHeleHe Clock board Peripheral power supply AC input il i o Ho Ho HS 0 ge 0 a SBus slots 1 nU U SCI jo 2 LNI H n U Peripheral power supply zen H H 9 gH 9 He He TIN Optical port CPU Memory board onboard FC OM I O boards Filler panel 7 5 3 1 Board slots Figure 8 5 Enterprise Cluster 3000PDB Card Cage Minimum Population Typical of Node 0 and Node 1 Ultra Enterprise Cluster 3000 Hardware Installation 8 7 60500500b0000000000000000000000005000000b0 O0d00 d00G 000OODOGQOODOODOODOODOOOGdOODOOOGd 0000000000000000000000000090000080090000000D0 QO0o0d0OO0d00000000000000000009000d000D00 0d SOSIEGO o0do00doo0dOODOODOdOODOODOODOODOOOGdOODOOOd S o O00D000000000000000D000000D0 00D0000000000000 OO0dO0O0QOOQOODOODOGOODOODOODOODOOOQOODOOOd O90000000DOOOOOOODOOOOOOOOOOQOOQODOOOQOODO 90000q00qQOOP OODOQOODOODOODOODOOOQOODOQOOQ o a D o a o
116. OOOO00000d09B000d0 00000090000000000000000000001000000000000 0900000000000090000000000000090800000000 gt gt 4 gt gt 4 a gt gt a o a o a Lo b a fH S cu d o a a H n o i Bl h 5 E 9 7 o FT gt y 2 Xr xr Uu E xr B H s 9 O c od R L cu 16 P 9 4 U amp L 3 O 9 o mne 9rHneoemne 9 ae E Figure C 5 Ultra Enterprise 3000 to Ultra Enterprise 5000 4000 Node to Node Connection Ultra Enterprise Cluster Hardware Site Preparation April 1997 Figure C 6 Ultra Enterprise 3000 to U Figure C 7 Ultra Enterprise 5000 4000 to Ultra Enterprise 6000 Node to Node Connection 7 gt B m NET Bl E 2 ee dd o G o o o e e Sab 9 es PS gt o oo q pu UJ o hz O 0 gt O a e E L 1 E e PT SS o Node to Node Connection Mixed Compute Platforms
117. Oo000000bo000005 G OobO ObO ObOObOOOObOObOoOO0O000000000b0000000 ooo0oooodoo dooGdOoOoOOGOODOOGdOOO0O0O00000G0DOO00 oooaooaGooadooGooDOGOOGQOODOODOODOOOGOOO0D0O00 AIDA CC PPP GMP POP PMP RETE OD ARE NS SA S AU aA Am MU UT UOS DU oo 0 00000 600800bDo00G00900090 a co SOOEOODOOUOOTCOODOCOOTOODOODOODOOOGOOO O00 CAOOACO ODD ODO ODD OD ODO ODD ODD ODD OD OO ODODOGOD 690090000000000000000000000000004000000000 o00000000000 00000 000D00 0000000000000000 oo0oogaoodooadoodooDOGQOOUOODOODOODOOOGQOOO0O0O0O0 o o B 5 o o o U o y e o H ez v lt lt SN 9 9 D D D 9 9 9 D D 9 9 U y 0 l o allla le allla lo T o T i o E B l i l i Figure 8 14 N 8 7 4 2 Second Cable SBus position 0 See Figure 8 14 ode to Node SCI Connection Ultra Enterprise Cluster 3000 Hardware Installation 1 Connect one end of the SCI cable to the SCI SBus card in I O board slot 1 SBus position 0 See Figure 8 14 2 Connect the other end to the I O board slot 1 SBus position 0 in the other 1 Connect one end of the SCI cable to the SCI SBus card in I O board slot 3 2 Connect the other end to the identical SCI SBus card in I O board slot 3 SBus position 0 in the other node lll Co 8 7 5 Remaining Cables Connect all remaining cables Table 8 2 on page 8 14 summarizes cables that can be connec
118. QOOQOODOODOGQOODOODOODOODOOOQQO ODOOO Q ODIO ION IO OIDO IO III PCMs o66doodoodoObo bodoObo bOObDO ObOoOOdOODOOOd 200000000000 00000000 000000000000000000000 N eHe eHe He gt a b b a b Clock board Peripheral power supply AC Input 9 9 o o p p a o p gt qn o lt lt o a i RP I ka oc SBusslots 1 SCI L E C 00 O oC ca c n0 gt 0 q 0 77 2 Peripheral power supply T1 gt S ei o L Optical port onboard FC OM CPU Memory board I O boards 7 5 3 1 Board slots Figure 5 4 Ultra Enterprise Cluster 3000PDB Card Cage Expansion Example Typical of Node 0 and Node 1 Ultra Enterprise Cluster Configurations Ser lll a CPP LIE E SLL E OL LIL LIS ILS IIE PILI ISLS LIE CE OOO aaa 9QogqooqooqoopooDoqOODOODOODOODOOGOQOODOOOQQ P G M S ARI RIA RIA RA RICA RIA RANA RNA RICA AR Se EC PSC ELS Ko ve do d roe DOODOODOOCTOO 0 PPP b a b b 4 D Clock board Per
119. RCstorage Arrays Install the second module in the array using the instructions provided with the module The arrays are delivered with one FC OM optical module installed Labeling Fiber Optic Cables Label the fiber optic cables prior to installation Labeling ensures accurate installation and eases system reconfiguration and expansion later One end connects to an FC OM module in node 0 or 1 cabinet A or B The other end connects to an FC OM module in the SPARCstorage Array in the target cabinet Put labels on both ends of each cable Use Figure 11 25 through Figure 11 27 as guides Ultra Enterprise Cluster 6000 Hardware Installation 11 33 11 Note Cables are shown loose for clarity To complete the task dress and secure all cables using cable ties as appropriate
120. SPARCstorage Array AC Power Connector and Power Switch 2 Plug the power cords into the power source Route the power cords to the designated power source Dress the power cords as required Roll any excess cord and secure it using cable ties 3 Turn on the AC power switch on all SPARCstorage Arrays See Figure 9 4 9 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 eo lll 9 3 Installing the Terminal Concentrator Install the terminal concentrator in its designated installation place 9 4 Power Cooling Modules PCMs Each PCM provides power and cooling to the one or two boards installed adjacent to it For this reason every board or board pair must be supported by an adjacent PCM Ensure that a PCM is installed for each board or board pair to be installed in the card cage Install additional PCMs as required to meet this requirement Note To adhere to cooling and power requirements one power cooling module PCM must be installed for every two boards plus an additional one for redundancy Install the PCMs adjacent to populated board slots to ensure the fan in the PCM cools the associated boards 9 5 Configuring the Card Cages For instructions on removing I O boards refer to the documentation supplied with the I O boards or the Ultra Enterprise 6000 5000 4000 System Manual Note Logically there is no difference between the board slots in the front or rear of the card cage and each slot can
121. Swift SunLink TurboGX Workstation et SunVTS sont des marques d pos es ou enregistr es de Sun Microsystems Inc aux Etats Unis et dans d autres pays Toutes les marques SPARC utilis es sous licence sont des marques d pos es ou enregistr es de SPARC International Inc aux Etats Unis et dans d autres pays Les produits portant les marques SPARC sont bas s sur une architecture d velopp e par Sun Microsystems Inc Les utilisateurs d interfaces graphiques OPEN LOOK et Sun ont t d velopp s de Sun Microsystems Inc pour ses utilisateurs et licenci s Sun reconna t les efforts de pionniers de Xerox Corporation pour la recherche et le d veloppement du concept des interfaces d utilisation visuelle ou graphique pour l industrie de l informatique Sun d tient une licence non exclusive de Xerox sur l interface d utilisation graphique cette licence couvrant aussi les licenci s de Sun qui mettent en place les utilisateurs d interfaces graphiques OPEN LOOK et qui en outre se conforment aux licences crites de Sun Le syst me X Window est un produit du X Consortium Inc Biblioth que XPM Copyright 1990 93 GROUPE BULL L utilisation la copie la modification et la distribution de ce logiciel et de sa documentation quelque fin que cesoit sont autoris es titre gracieux condition que la mention du copyright ci dessus apparaisse dans tous les exemplaires que cette mention et cette autorisation apparaissent sur la documentation ass
122. U Memory board I O Boards Odd numbered slots 1 and 3 are configured with I O boards SBus cards are installed in the appropriate SBus slots see Figure 5 13 and Figure 5 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 a lll FRONT VIEW REAR VIEW PCMs SCI Clock board CPU Memory board Optical port E e v 9 onboard FC OM EC SN S d o 0 1 b A S I O boards da ep 2 a e aia lo dl e 4 5 lo e 3 Load boards 7 6 7 7 b a m a o 8 AE AES gt Load boards ol o 10 11 lo 9 9 a 12 13 lo lo e lo a e 14 15b b _el 0 1 2 SBus slots Figure 5 13 Ultra Enterprise Cluster 6000PDB Card Cage Minimum Population Typical of Node 0 and 1 FRONT VIEW REAR VIEW PCMs Private net Clock board CPU Memory board Optical port gt c onboard FC OM 9 0 009 P Us sl 0 1 IO boards e 6 o 2 3 lo 4 e 4 5 o al 6 7 Load boards b EP e 8 9 Load boards le 4 e 10 11 e e e 12 13 fo ad o 14 15 m 0 1 2 Disk board SBus slots Figure 5 14 Ultra Enterprise Cluster 6000HA Card Cage Minimum Population Typical of Node 0 and 1 Ultra Enterprise Cluster Configurations 5 1
123. Ultra Enterprise Cluster Hardware Site Preparation Planning and Installation Guide 4 Sun microsystems THE NETWORK IS THE COMPUTER Sun Microsystems Computer Company A Sun Microsystems Inc Business 2550 Garcia Avenue Mountain View CA 94043 USA 415 960 1300 fax 415 969 9131 Part No 802 6783 11 Revision A April 1997 Copyright 1995 1996 1997 Sun Microsystems Inc 2550 Garcia Avenue Mountain View California 94043 1100 U S A Allrights reserved This product or document is protected by copyright and distributed under licenses restricting its use copying distribution and decompilation No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors if any Portions of this product may be derived from the UNIX system and from the Berkeley 4 3 BSD system licensed from the University of California UNIX is a registered trademark in the United States and in other countries and is exclusively licensed by X Open Company Ltd Third party software including font technology in this product is protected by copyright and licensed from Sun s suppliers RESTRICTED RIGHTS LEGEND Use duplication or disclosure by the government is subject to restrictions as set forth in subparagraph c 1 ii of the Rights in Technical Data and Computer Software clause at DFARS 252 227 7013 and FAR 52 227 19 Sun Sun Microsystems the Sun logo SunDocs Ultra Enterpr
124. Y T b 7 4 M L q i Id D a do a IS ll MEE al L Differential SCSI E s z d A trays 7 S r d NI o 1s di qo o CE an Xu na c i D 3 NE al g L L s Figure 2 11 Expansion Cabinet with SPARCstorage Array 200 Series Units Hosting Differential SCSI Trays Product Description 2 2 7 Internal Options 2 18 The following internal options can be purchased for Ultra Enterprise systems CPU Memory Board Options Expansion of Existing Nodes UItraSPARC Server CPU board no processor or memory Memory Options 64 Mbyte ECC memory expansion SIMMs 8x8 Mbyte SIMM e 256 Mbyte ECC memory expansion SIMMs 8x32 Mbyte SIMM e 1 Gbyte ECC memory expansion SIMMs 8x128 Mbyte SIMM Processor Options UltraSPARC module with one 167MHz UltraSPARC processor and 2 Mbyte or 512 Mbyte Cache Disk Board Options Typically applies to Ultra Enterprise Cluster 6000 5000 4000 systems only Internal plug in hard disk board with two 2 1 Gbyte SCSI disks Internal plug in hard disk board with two 4 Gbyte SCSI disks SBus Options Fast SCSI 2 Buffered Ethernet card FSBE S SBus Quad Ethernet Controller SOEC FDDI single and or dual attach SBus interface Sun ATM 155M fiber adapter not for HA Sun ATM 155UTP adapter not for HA MII adapter UTP MII adapter fiber SunSwift M Ethernet Adapter SunLink ISDN not for HA Token ring interface SBus
125. a PCM is installed to support the peripheral power supply and peripheral power supply AC input unit Note In the Ultra Enterprise Cluster 3000 System the required complement of PCMs is three in each node Two provide power and cooling to the four board slots and one must be present to cool the peripheral power supply and peripheral power supply AC input unit and to provide redundant power 8 6 Configuring the Card Cages 8 6 For instructions on removing I O boards refer to the documentation supplied with the I O boards or the Enterprise 3000 System Manual Logically there is no difference between the board slots and each slot can accept any board type However since the lowest numbered board slot slot 1 is the only slot connected to the onboard SCSI devices this slot is reserved for the first I O board Note Board slot numbers are marked on the chassis Install a filler panel in all empty slots to ensure proper cooling and to provide proper bus termination Ultra Enterprise Cluster Hardware Site Preparation April 1997 Co lll 8 6 1 CPU Memory Board 1 Install the CPU Memory board into slot 7 For CPU Memory board installation procedures refer to the documentation supplied with the CPU Memory boards or the Enterprise 3000 System Manual See Figure 8 5 and Figure 8 6 or Figure 8 7 and Figure 8 8 for PDB and HA respectively 60000000000000000000000000000504000006000 OoodOOGdOOdOOdOODOQOOQOOD
126. able 4 2 but an overlap in values of certain parameters exists When interconnecting RS 423A with RS 232C circuits remember that performance is limited to that of RS 232C Table 4 2 Open Circuit Voltages Open Circuit Voltages Recommended Standard Minimum Maximum Without Damage RS 232C 3 0V 25 0V 25 0V RS 423A 4 0V 6 0V 12 0V Table 4 2 shows a common operating area between 4 0 and 6 0 volts However there are differences between the two standards involving rise time data rate and cable length specifications e RS 232C specifies that the rise time through the 3 volt transition should not exceed 4 5 of the signal element duration e RS 423 generally requires much slower rise times which are specified from 1076 9076 of the total signal amplitude to reduce cross talk for operation over longer distances Cable Requirements Evaluate the routing of cables to all equipment Keep cable runs short to increase interface reliability Other considerations include Make cable runs to equipment outside the computer room as direct as possible Place equipment in the computer room in a way to minimize cable run length to units outside the room Where necessary allow extra cable length to Ultra Enterprise Cluster Hardware Site Preparation April 1997 4 3 3 2 4 3 3 3 Enable cables to be routed clear of strong radio frequency interference RED fields Permit system expansion or relocation Cable Len
127. ackage installed Both nodes have routing table established for the private interconnect Both nodes have SUNWvts package installed 1 Become superuser and change directories cd opt SUNWvts bin N Set the following environment variables For a Bourne shell BYPASS FS PROBE 1 export BYPASS FS PROBE For aC shell setenv BYPASS FS PROBE 1 3 Become superuser and type vtsk Executing the vtsk command starts the SunVTS kernel The SunVTS kernel probes system devices and awaits commands from an interface Note The following error message may be displayed if you are executing the vtsk command for the second time such as when directed to in the final step of this procedure vtsk SunVTS kernel is already running Ultra Enterprise Cluster Hardware Site Preparation April 1997 12 If this error message occurs type the following ps ef grep vtsk find process id of vtsk kill INT lt vtsk pid vtsk 4 Wait a few minutes to enable vt sk to finish probing the system and then initiate a probe_map file using the vtsprobe command As shown in the following example the output which can be lengthy is redirected to a file for later viewing The vt sprobe command without modifiers will produce a console screen output vtsprobe gt tmp probe map 5 Verify that the response to the vtsprobe
128. all FC OM modules in the B location If FC OM modules are installed in both locations then a failure of either module can result in loss of communication with both supported SPARCstorage Arrays or other storage devices Ultra Enterprise Cluster 4000 Hardware Installation 9 9 lll LO 3 Install the I O board into the card cage slots 1 and 5 For I O board installation procedures refer to the documentation supplied with the CPU Memory boards or the Ultra Enterprise 6000 5000 4000 System Manual 9 5 4 Filler Panels 4 Fill all unused slots with a filler panel See Figure 9 9 Springfingers Figure 9 9 Filler Panel 9 5 5 Disk Board HA System Only 1 If your system is intended to boot from a disk board install it in slot 7 For disk board installation procedures refer to the documentation supplied with the board or in the Ultra Enterprise 6000 5000 4000 System Manual Note PDB systems boot from bootable SPARCstorage arrays 9 10 Ultra Enterprise Cluster Hardware Site Preparation April 1997 9 2 Install the terminator on the bottom OUT SCSI II port of the disk board in slot 7 See Figure 9 10 Figure 9 10 Installing the Terminator on the Disk Board 9 5 6 Clock Board 1 The clock board is installed in the clock board slot above the I O boards For clock board installation procedures refer to documentation supplied with the card s in question or the Ultra Enterprise 6000 5000 4000 System
129. and 3 of node 0 and 1 For this procedure proceed to Appendix B Configuring the SCI SBus Card This procedure takes the installer through installation of I O boards in card cage slots 1 and 3 of both nodes 8 6 2 2 PDB and HA Installation 1 Configure and install any other SBus cards as appropriate 2 Load the I O boards with the appropriate FC OM modules For module card installation procedures refer to the documentation supplied with the card s in question or the Enterprise 3000 System Manual Caution Install FC OM modules in the A locations only Do not install FC OM modules in the B location If FC OM modules are installed in both locations then a failure of either module can result in loss of communication with both supported SPARCstorage arrays or other storage device 3 Install the I O boards in the card cage See Figure 8 5 through Figure 8 8 I O Boards Intended for Slot 5 Optional Configure and install any SBus cards as appropriate and install the I O board in the card cage 8 6 3 I O Boards Intended for Slot 1 and Optionally 5 1 Load the I O board with the appropriate SBus cards For SBus card installation procedures refer to documentation supplied with the card s in question or the Enterprise 3000 System Manual Ultra Enterprise Cluster 3000 Hardware Installation 8 11 8 12 2 Load the I O board with the appropriate FC OM modules For module card installation procedures refer to docu
130. and long serial cables CD ROM and optionally 8 mm tape drive Administration workstation with CD ROM drive not shown 2 8 Ultra Enterprise 4000 Configurations There are several types of disk arrays used by the shared database The main system uses SPARCstorage Array Model 100 series units For expanded systems the disk arrays are SPARCstorage Array Model 200s hosting SPARCstorage RSM units Removable Storage Media or SPARCstorage Array Model 210s hosting differential SCSI trays Figure 2 6 shows the Ultra Enterprise Cluster system node cabinet Figure 2 7 shows the Ultra Enterprise Cluster 4000 hardware required to support the Ultra Enterprise software Ultra Enterprise Cluster Hardware Site Preparation April 1997 ll N L X ULA eo Kab L Y EA C S T A VLLL LLL EEE LLL LL EIER a NUR EM ER UV EUN M LLL LII L ILl t ELLLELLLLL ITI p EI EE RN m n d d a d ECOS L t VEL ey ey ay ey ST L L LEELEC L LEN UN RN NI UN RN NER E EA d FR A A A A AR Ultra Enterprise Cluster 4000 System CAbinet Node Cabinet Figure 2 6 2 9 Product Description lll No Terminal concentrator primary node only SPARCstorage Array Model 100 Serie
131. ard Private net 9 EMO Optical port onboard FC OM Figure 8 7 Enterprise Cluster 3000HA Card Cage Minimum Population Typical of Node 0 and Node 1 Ultra Enterprise Cluster 3000 Hardware Installation lll Co PCMs 9990999009000 0090009 9000000900000 OO OD OCOOCOCI o DOCOCOCO O090000b00b00b00005b00500DO000090000D0 0000000000000000000000008000 a 9 005000005000 Clock board Peripheral power supply AC input Ni S S 9 9 x O SBus slots 1 Private net Optical port onboard FC OM CPU Memory board AA I O boards 7 5 3 1 Board slots oOo oaoa E amp E 0 amp co 5 D E n J al 2 gt e Peripheral power supply San 5 Figure 8 8 Enterprise Cluster 3000HA Card Cage Expansion Example Typical of Node 0 and Node 1 8 6 2 I O Boards Use the appropriate section below for PDB or HA installation 8 10 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Co lll 8 6 2 1 PDB Installation Only I O Boards Intended for Slots 1 and 3 Equipped with SCI SBus Cards Configure and install the SCI SBus cards These will be installed into the two I O boards each which will be installed in card cage slots 1
132. ard Disk board Power cooling module PCMS Administration workstation SBus cards PDB SCI SBus card FC S SBus card Modules FC OM modules Chassis Terminal concentrator Terminal concentrator bracket Cables RS 232 serial cable long PN 530 2152 short PN 530 2151 HA private net 1 meter PN 530 2149 5 meter PN 530 2150 Differential SCSI 530 1884 PDB SCI cable 5 meter PN 530 2310 Fiber optic cable 15 meter PN 595 3379 System cabinet SPARCstorage Array units Rackmount kit PDB SCI bracket Expansion cabinet SPARCstorage Array 200 series units SPARCstorage RSM units Differential SCSI disk trays Checklist 1 7 lll A 1 4 Ultra Enterprise Cluster 5000 Customer Assembled 1 4 1 General Description Table 1 7 Requirements for Ultra Enterprise Cluster 5000 System Customer Assembled Per Node Per Cluster System Device Min Max Min Max Comment Terminal concentrator 1 1 Installed in customer defined location SPARCstorage Array PDB 2 PDB 24 Each equipped with 2 HA 2 HA 26 FC OM host adapters Rackmount kit 1 3 PDB 2 PDB 24 Mounts one SSA 100 HA 2 HA 26 Series chassis Cable set 1 1 Client net HA other Administration workstation 1 1 Ultra Enterprise 5000 System 1 1 2 2 CPU Memory boards each with 1 1 2 2 2 UltraSPARC modules 256 Mbytes RAM I O boards each equipped with 2 PDB 7 PDB 4 PDB 14 PDB I O boards in one fiber interface FC OM HA 6 HA 4 HA 12 slots 1 and 3 are m
133. ardware Site Preparation April 1997 Figure 10 20 Figure 10 21 Figure 10 22 Figure 10 23 Figure 10 24 Figure 10 25 Figure 10 26 Figure 10 27 Figure 10 28 Figure 10 29 Figure 10 30 Figure 11 1 Figure 11 2 Figure 11 3 Figure 11 4 Figure 11 5 Figure 11 6 Figure 11 7 Figure 11 8 Figure 11 9 Figure 11 10 Figure 11 11 Figures Node to Node Ethernet Connection 10 26 Installing the Two SCI Cables in the Cable Bracket 10 27 Installing the SCI Cable Bracket oooooooooo 10 29 SCSI Terminator Installation on the I O Board 10 30 Disk Board Connection sunsa susara rsrsrsr rren 10 31 SPARCstorage Array 0 and 1 Connection Example 10 32 SPARCstorage Array 2 and 3 Connection Example 10 33 SPARCstorage Array 4 and 5 Connection Example 10 34 SPARCstorage Array 6 and 7 SPARCstorage Array 200 Series Connection Example 0000 c cece cece ee 10 35 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 100 Series Unit 10 36 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 200 Series Unit 10 37 Key Switch in the Standby Position ooooooommo 11 2 Local Off Remote Switch and Main Power Switch 11 3 Power Connector and Detachable Cable 11 4 SPARCstorage Array Voltage Rating on the Serial Number Label s sees ER ERES 11 7 SPARCstorage Array AC Power Connector
134. ays extend the stabilizer bar before pulling the disk drive trays out for servicing The trays extend on slide rails and the weight shift forward could tend to topple the cabinet if the stabilizer bar is not fully extended The cabinet has six pads Four leveling pads on the cabinet frame support the cabinet and are adjusted to raise the cabinet off the wheels level it and prevent rocking Two pads incorporated into the front of the stabilizer bar are adjusted to prevent the cabinet from tipping forward when internal trays are extended These pads contact the floor to prevent tipping Extending the Stabilizer Bar Grasp the stabilizer bar under the front edge and pull it out to its fully extended position Adjusting the Leveling Pads This procedure requires that the screen panel and kick panel be removed See Section 7 1 1 2 Removing and Replacing the Rear Screen Panel and Section 7 1 1 3 Removing and Replacing the Kick Panel 1 Remove the leveling wrench located inside the cabinet Locate the leveling wrench in the upper part of the rack Press the cable tie tab to free the wrench 2 Remove the kick panel The kick panel is secured by two captive screws 3 Use the wrench to lower the four main leveling pads not the pads on the stabilizer bar See Figure 7 4 The four main leveling pads are located near the corners of the cabinet a Lower the pads to raise all four wheels off the floor b Using a level
135. binet See Chapter 7 Internal Access and Leveling for procedures Proceed to Chapter 11 for terminal concentrator configuration procedures 10 38 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Ultra Enterprise Cluster 6000 Hardware Installation 11 Do tasks in the order listed Preparing the Cabinet page 11 2 Removing the Cabinet Panels page 11 5 Installing the Cabinets page 11 6 Connecting the Main AC Cord page 11 6 Installing SPARCstorage Arrays in the System Cabinets page 11 7 Installing the Terminal Concentrator page 11 10 Configuring the Card Cages page 11 16 Cabling System Components page 11 24 11 1 Factory Assembled Ultra Enterprise Cluster 6000 Hardware The basic Ultra Enterprise Cluster 6000 configuration is completely pre assembled in a single cabinet Note If you are installing a customer assembled system see Section 11 2 Customer Assembled Ultra Enterprise Cluster 6000 Hardware Installation 11 1 11 11 1 1 Preparing the Cabinet 1 Unpack and inventory the equipment if you have not already done so See Chapter 1 Checklist for a list of equipment 2 Move the cabinets to their designated installation locations For site planning guidelines See Chapter 4 Enterprise Cluster 6000 Server 3 Turn the front panel key switch to the Standby position See Figure 11 1
136. ble ties as required Note Cables are shown loose for clarity To complete the task dress and secure all cables using cable ties as appropriate Node 0 Node 1 f gt 6 c o0 c5 B z E B E E OCC o E a G 7 gt 0 t E G O So O eS SY 8 9 O o 9 L CO UA pot ee fp O Y CP Oi S E e So a4 e Ra E U Ctl pr O Gallos LS E Y o e RES A AY Osu W Osun of L e y e e e e m n o P o Array 0 S R Array 1 o namng Geg eo c mug ale 5 L c A INS Y M J JS H Figure 10 25 SPARCstorage Array 0 and 1 Connection Example Ultra Enterprise Cluster Hardware Site Preparation April 1997
137. cable bracket Orient the bracket with the narrow portion of the slotted holes up and the cable track opening to the left See Figure 10 21 SCI cable for I O board 1 Oar Figure 10 21 Installing the Two SCI Cables in the Cable Bracket 3 Lay the cable for I O board 1 into the top of the bracket with the connector toward the left and facing away from you Form the cable into the curved track built into the top of the bracket Install two cable clamps to secure the cable Use two plastic rivets to secure the clamps to the bracket Repeat Steps 2 and 3 for the bottom cable Install the cable in the track on the underside of the bracket and secure Ultra Enterprise Cluster 5000 Hardware Installation 10 27 10 Cable and Bracket Installation 1 Install the bracket with cables on the rack a Approach the rack Align the cable connectors with the mating connectors on the I O boards Do not force the connectors onto the host connectors at this time b Adjust the cables in the tracks as required to allow the bracket surface to mate flush against the rack Adjust cables so the slotted holes in the bracket fit over the screws installed in Step 1 Allow the bracket to rest on the screws but do not tighten c Plug the cable connectors into the hosts Examine the cable connector to host spacing Adjust the cables in the tracks as required to allow the top and bottom connectors to mate with the hosts d Tighte
138. centrator and Installing the Software I 12 1 Configuring the Terminal Concentrator 1 Edit the contents of the etc remote file on the administration workstation and create the following line a dv dev term a br 9600 2 From the administration workstation type the following command to connect the workstation serial port TTYA to terminal concentrator port 1 tip a Note Your administration workstation may have a combined serial port labeled SERIAL A B In this case you cannot use the TTYB port without the appropriate splitter cable See the documentation supplied with your workstation for more information 3 Verify that the server and the terminal concentrator are powered on and that the cabinet key switch if applicable is in the ON position 12 1 12 2 4 Reset the terminal concentrator Press the Test button on the front panel for three or more seconds until the Power LED blinks rapidly Release the button see Figure 12 1 Test LED orange Test button STATUS 3c POWER UNIT NET ATIN LOAD ACTIVE Luc LE El J Ml X LJ Figure 12 1 Terminal Concentrator Test Button 5 Within 30 seconds press the Test button again Note Verify that the orange test LED lights to ensure the unit is in test mode The terminal concentrator performs a self test which lasts about 30 seconds Message
139. clockwise The key switch is behind the front door see Figure 6 4 Standby o le EJ o s em aL o LL 1 co a L u o e 9 ams ER e Figure 6 4 Key Switch in the Standby Position Note The front panel keys for this switch are packed in the accessory box 2 Turn off the system power in this order a External drives and expansion cabinets if any b System cabinet AC power switch The unit is at the rear of the cabinet see Figure 6 5 c Terminal 6 6 Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll ON AC connector 7 STs lt gt resi IR Em ET O E O E EE Figure 6 5 AC Power Switch Caution Turn off the AC power switch on the rear of the cabinet before accessing the system Warning External components like the SPARCstorage Arrays and terminal concentrator are powered by an external power source a power circuit other than from the cabinet internal AC power circuit These externally powered components will remain powered even after the cabinet AC switch is turned off Turn off externally powered components using the ON OFF switch at the rear of the components in question Failure to turn off externally powered components poses a risk of equipment damage a
140. command is similar to the following for the private net devices Note The data listed in the following example is displayed before the private net is configured Network hmel nettest Port Address Unknown Host ID 80500419 Domain Name nn nn nn com hme2 nettest Port Address Unknown Host ID 80500419 Domain Name nn nn nn com If the data listed for the private net devices does not match the build configuration check and correct any cabling errors and then repeat steps 1 through 5 6 Verify that there is a response under the Network heading to the vtsprobe command for any network interface devices installed Consult documentation supplied with your network interface card to determine the correct entry for your device Configuring the Terminal Concentrator and Installing the Software 1211 12 7 Verify that the re following for the sponse to the vtsprobe command is similar to the SPARCstorage Arrays ssa4 plntest Vendor Id Product Id Product Rev Firmware Rev Serial Number Disks Attached c3t2d1 c3t2d0 c3t1d0 SUN SSA210 1 0 3 6 00000078BB2B c3t2d6 c3t2d5 c3t2d4 c3t2d3 c3t2d2 If the data listed for the SPARCstorage Arrays does not match the build configuration check and correct any cabling errors and then repeat Steps 1 through 7 Verify that the re sponse to the vtsprobe command is similar to the following for each disk listed under a SPARCstorag
141. cond Fibre channel port for use on either the SPARCstorage Array or the Fibre Channel SBus Host Adapter 2 9 3 3 Optional SPARCstorage Array Model 112 Accessories 2 meter Fiber Optic cable 15 meter Fiber Optic cable The array unit is shown in Figure 2 12 2 Ultra Enterprise Cluster Hardware Site Preparation April 1997 All panels attached for tabletop installation All panels removed for rack installation Figure 2 12 SPARCstorage Array 112 2 9 3 4 Optional SPARCstorage Array Model 200 Series Accessories 2 meter fibre optic cable 15 meter fibre optic cable The array unit is shown in Figure 2 13 Product Description 2 23 N I Figure 2 13 SPARCstorage Array Model 200 Series Unit Ultra Enterprise Cluster Hardware Site Preparation April 1997 2 24 Specifications 3 This chapter provides the environmental physical and electrical specifications for all Ultra Enterprise Cluster systems 3 1 Physical Specifications Physical specifications are presented in Table 3 1 through Table 3 16 3 1 3 2 3 1 1 Ultra Enterprise Cluster 35000 System Table 3 1 System Physical Specifications U S Metric Height 25 5 in 64 5 cm Width 17 in 43 2 cm Depth 23 5 in 59 7 cm Weight 160 Ib approx 72 7 kg approx Power cord 6 ft 1 8m Table 3 2 Clearance and Service Access U S Metric Front 18 in 45 7 cm Rear 18 in 45 7 cm Left 6 in 15 cm Right 6 in 15 cm Table
142. d hme RJ 45 TPE on I O board private net PDB SCI SBus port Node 1 SCI SBus port SCI cable SCI SBus card Node 0 SCI SBus port SCI cable Clock Board Serial A Terminal concentrator Serial All port 2 Serial A Terminal concentrator Serial port 3 Other Administration Terminal concentrator Serial workstation Serial A port 1 Administration Primary Ethernet AUI or RJ 45 workstation Ethernet port network 1 Category 5 twisted pair private net cable part number 530 2149 1 meter or 530 2150 5 meter 10 22 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 10 3 2 1 Cabling the Terminal Concentrator is plugged into a I O board it then becomes the default for console input thus preventing input from the system administration workstation terminal concentrator serial port In addition plugging a keyboard directly into a host I O board while power is applied to the host sends a break signal to the Solaris operating system as if you typed Stop L1 A on the keyboard Warning Do not plug a keyboard directly into a host I O board If a keyboard 1 Plug one end of cable PN 530 2152 into the terminal concentrator Port 1 See Figure 10 18 2 Plug the other end into the administration workstation RS 232 connector Administration workstation Terminal concentrator E jl n Client net Ethernet RS 232 to RJ 45 z y
143. e Install the 200 series chassis into the rear of the expansion cabinet so the connector panel on the rear of the unit is accessible from the front Table A 2 SPARCstorage RSM Chassis Hole Assignments In the Expansion Cabinet Tray number System or enclosure 0 1 2 3 4 5 6 7 Ultra Enterprise Cluster Expansion N Al N A N A N A 4649 56 592 66 69 79 82 Cabinet Locking brackets front all trays 4243 52 53 62 08 75 76 Locking brackets rear all trays 4344 53 54 63 64 76 77 1 The top four positions are not used 2 Theside rear bottom hole is 57 3 The right side rear bottom hole is 80 4 Useonly hole 76 on the left side rear A 8 Installing the Differential SCSI Tray Chassis Install these disk trays in the expansion rack using the hole numbers specified in Table A 2 See FIGURE A 20 for a graphic of this installation Note Install the 200 series chassis into the rear of the expansion cabinet so the connector panel on the rear of the unit is accessible from the front A 20 Ultra Enterprise Cluster Hardware Site Preparation April 1997 pee lll Table A 3 Differential SCSI Tray Hole Assignments In the Expansion Cabinet Tray number System or enclosure 0 3 4 6 7 Ultra Enterprise Cluster Expansion 45 14 15 25 26 35 36 4647 56 57 67 68 77 78 Cabinet Locking brackets rear
144. e Array c1t0d0 rawte Logical Controll c1t0dl rawte Logical Controll c1t1d0 rawte Logical Controll Capacity Capacity Capacity SparcStorageArray p1n0 st logical name test name Name c1t0d0 1002 09MB er plnO st logical name test name Name c1t0dl 1002 09MB er plnO st logical name test name Name cl1t1d0 1002 09MB er plnO If the data listed for the disks does not match that shown under the corresponding SPARCstorage Array the disk may be bad In this case you may have to type through 8 boot r to rebuild the device tree Then repeat Steps 1 9 Compare the probe maps generated by each node 12 12 Ultra Enterprise Cluster Hardware Site Preparation April 1997 E 10 Check and verify WWN of each SPARCstorage Array 11 Check and compare disk logical name and capacity for all disks under the corresponding SPARCstorage Array If there is not an identical match replace the SPARCstorage Array controller and or disks if necessary Note Logical disk names may differ on the two nodes For PDB This does not indicate a problem for HA it does 12 To run a final system functional check run SunVTS using the procedure in Section 12 6 12 Running SunVTS 12 6 1 2 Running SunVTS Run a final functional test of the system using SunVTS 1 Become superuser and change directories cd opt SUNWvts bin 2 Inv
145. e Cluster 6000 Factory Assembled 1 5 1 General Description Table 1 9 Requirements for Ultra Enterprise Cluster 6000 System Factory Assembled Per Node Per Cluster System Device Min Max Min Max Comment Terminal concentrator 1 1 Installed in customer defined location SPARCstorage Array PDB 2 PDB 58 Each equipped with 2 FC OM HA 2 HA 56 host adapters Rackmount kit 1 2 PDB 2 PDB 58 Mounts one SSA 100 Series HA 2 HA 56 chassis Cable set 1 1 Client net HA other Administration workstation 1 1 Ultra Enterprise 6000 System 1 1 2 2 CPU Memory boards each with 1 1 2 2 2 UltraSPARC modules 256 Mbytes RAM I O boards each equipped with 2 PDB 15 PDB 4 PDB 30 PDB I O boards in slots 1 and 3 one fiber interface FC OM HA 14 HA 4 HA 28 are configured with SCI cards module and SCI cards PDB only 2 2 4 4 FC S SBus card PDB 0 PDB 19 PDB 0 PDB 36 HA 0 HA 18 HA 0 HA 38 Disk boards PDB 0 PDB 2 PDB 0 PDB 4 HA 1 HA 2 HA 2 HA 4 Power cooling modules PCMs 3 8 6 16 FC OM optical modules PDB 2 PDB 15 PDB 4 PDB 30 HA 2 HA 14 HA 4 HA 28 1 128 Mbytes RAM is the minimum amount supported 1 10 Ultra Enterprise Cluster Hardware Site Preparation April 1997 A lll 1 5 2 Checklist Table 1 10 Checklist for Ultra Enterprise Cluster 6000 System Factory Assembled Per Node Quantity Per Cluster Quantity Category Item Planned On Hand Planned On Hand Systems Ultra Enterpri
146. e Figure A 10 Press down on the popout at the small dot This action rocks the popout on a hinge point unlatching it Slide the popout back away from the dots and lift it free as shown in Figure A 10 set the popout aside Repeat step 1 through 3 to remove the remaining three popouts from the top panel Ultra Enterprise Cluster Hardware Site Preparation April 1997 pee lll A 3 3 2 2t Figure A 10 Removing the Popouts from the Top Panel Removing the Top Panel 1 Place your fingers under the panel rear lip and lift See Figure A 11 Lift with enough force to bow the panel rear up at the center This action causes three small raised features on the panel underside to clear cutouts in the chassis sheet metal 2 While lifting the panel rear tap the front with your hand to slide the panel rearward Slide the panel a few inches only This is enough to disengage it from the chassis Note If necessary slide your lifting hand side to side under the rear lip while tapping the front to free each of the three raised areas on the panel underside of sheet metal cutouts beneath 3 Lift the top panel straight up and clear of the chassis set it aside Rackmount Rail Installation A 11 A 12 Figure A 11 Removing the Top Panel A 3 3 3 Replacing the Four Popouts To prevent losing the popouts 1 Orient the popout so the dots are nearest each other Figure A 12 2 Slide the popout in until it
147. e cluster These devices provide storage for the highly available data NFS file systems and DBMS databases 8 3 1 Preparing the SPARCstorage Arrays 1 Locate the DIAG switch on the array rear panel See Figure 8 3 2 Ensure that the DIAG switch is set to DIAG and not to DIAG EXT Do not use the DIAG EXT position as it will invoke extended diagnostics and prevent the SPARCstorage Array from booting Use DIAG only for normal operation Serial number label Z PN 595 3373 01 NN MN oO Oo A B DIAG switch Figure 8 3 SPARCstorage Array Voltage Rating on the Serial Number Label 3 Locate the serial number label on the rear panel of the chassis 4 Check the electrical ratings label on the serial number label Verify that the stated rating matches your AC input voltage 8 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 8 Table 8 1 provides maximum system operating voltage and frequency ranges and lists current requirements at nominal line voltage for a cabinet in maximum configuration Table 8 1 SPARCstorage Array 100 Series Nominal Power and Maximum Current Parameters Maximum Nominal AC Input Operating Operating Current Power Supply Configuration Voltage Range Single Phase Range Frequency Range Requirement Output North Am
148. e environmental specifications presented in Table 3 24 apply to the Ultra Enterprise Cluster 5000 and Ultra Enterprise Cluster 6000 systems Avoid temperature extremes and keep the work area clean Maintain the operating conditions shown in Table 3 24 Table 3 24 Cabinet Server Temperature Humidity and Altitude Limits Specification Operating Nonoperating Temperature 41F to 95F 5C to 40C 4F to 140F 20C to 60C Humidity 20 to 80 RH noncondensing 93 RH 27C max wb Altitude 9 843 ft 3 km 39 370 ft 12 km Install the Ultra Enterprise Cluster 6000 system in a computer room environment to ensure secure access to computers and stored information In addition a computer room can fulfill the requirements for a controlled environment especially with regard to temperature humidity and airborne dust A computer room installation usually provides improved protection against damage by fire flood or other danger originating in the building Specifications 3 13 3 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Planning for Hardware Power and Network Requirements 4 4 1 Hardware Planning Floor space and other requirements for the Ultra Enterprise Cluster systems are The cabinets require approximately three feet of space in the front and three feet of space at the back for access by service personnel Power and interface cables should be kept out of the way of foot traffic Cables can
149. e is placed on the cable connector or I O board See Figure 11 22 11530 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 SCI cable bracket o z o JE d Q o LA 9 ER 9 o see EE Y gt o A v q o 9 gt o a q o PEA a 0 o o L Y o q 0 9 0 gt E d L q 0 TH LI LI LAT o a a q lt l LL SCI cable b a R HA _ bracket N P a o pa ame le e 5 Mm Des N Sm fe il AD P ceno I a L L L e e _ el 7 e PA To Se ced d o ol d C a gt e B 0 a o L c 1 o OPH lle e 4 s NG o da gt e K EIR o E 4 Sl H lls P 31 na o TZ E p a 0 LT e E n n o HU 9 lo el o NIC p o AN S Die gt of Ae eC feat d Sl Z lal N ow B pa ni o o a o o a s o o E d ooo 0 D D a o 0 d 0 Figure 11 22 Installing the SCI Bracket to Connect the Nodes 2 Second node Repeat the Cable and Bracket Preparation and Cable and Bracket Installation procedures above for
150. e l o L T E TT Terminator Terminator 10 3 4 1 Figure 10 24 Disk Board Connection Connecting the SPARCstorage Arrays Tasting the Second FC OM Optical Module in all SPARCstorage rrays Install the second module in the array using instructions provided with the module The arrays are delivered with one FC OM optical module installed Labeling Fiber Optic Cables Label the fiber optic cables prior to installation Labeling ensures accurate installation and eases system reconfiguration and expansion later One end connects to an FC OM module in node 0 or 1 cabinet A or B The other end connects to an FC OM module in the SPARCstorage Array in the target cabinet Put labels on both ends of each cable Use Figure 10 25 through Figure 10 28 as guides Installing the Fiber Optic Cables 1 Plug one end of the fiber cable into the FC OM in the I O board See Figure 10 29 and Figure 10 30 for cable type and connection details Ultra Enterprise Cluster 5000 Hardware Installation 10 31 10 10 32 2 Plug the other end of the fiber cable into the FC OM connector on the SPARCstorage Array rear panel Plug node 0 into connector A and node 1 into connector B Repeat to connect both nodes to both SPARCstorage Arrays Refer to Table 10 3 on page 10 38 for a listing of all cable connections 3 Repeat steps 1 and 2 for all FC OM cables to be connected 4 Dress and secure all cables using ca
151. e sections listed below 5 2 1 Minimum Configuration 5 2 1 1 The minimum configuration is two nodes supporting two PDB or three HA SPARCstorage Arrays Power Cooling Modules PCMs Three PCMs minimum must be installed in each node Ultra Enterprise Cluster Hardware Site Preparation April 1997 a lll 5 2 1 2 Board Population The card cages in the node 0 and node 1 servers are configured identically Figure 5 8 and Figure 5 9 show minimally populated card cages for both nodes CPU Memory Boards Even numbered slot 0 is configured with a CPU Memory board I O Boards Odd numbered slots 1 and 3 are configured with I O boards SBus cards are installed in the appropriate slots Clock Board One clock board is required in each node FRONT VIEW REAR VIEW CPU Memory board PCMs SCI Clock board W O boards Ue EENI Optical port c W re E L2 onboard FC OM E ES Oe Se NR ea Z2 JS 1 e e e e HAC E U E gt A 2 2 Sy E ho 9 3 e 9 HE C U OOO 4 mL J o e 5 E uw m e PB d 0 1 2 SBus slots Figure 5 8 Ultra Enterprise Cluster 5000 4000PDB Card Cage Minimum Population Typical of Node 0 and 1 Ultra Enterprise Cluster Configurations Sell CPU Memory board 5 12 O A MY O
152. ed 1 3 1 General Description Table 1 5 Requirements for Ultra Enterprise Cluster 5000 System Factory Assembled Per Node Per Cluster System Device Min Max Min Max Comment Terminal concentrator 1 1 Installed in customer defined location SPARCstorage Array PDB 2 PDB 24 Each equipped with 2 HA 2 HA 26 FC OM host adapters Cable set 1 1 Client net HA other Administration workstation 1 1 Ultra Enterprise 5000 System 1 1 2 2 CPU Memory boards each with 1 1 2 2 2 UltraSPARC modules 256 Mbytes RAM I O boards each equipped with 2 PDB 7 PDB 4 PDB 14 PDB I O boards in slots one fiber interface FC OM HA 6 HA 4 HA 12 1 and 3 are configured module and with SCI cards SCI cards PDB only 2 2 4 4 FC S SBus card PDB 0 PDB 19 PDB 0 PDB 36 HA 0 HA 18 HA 0 HA 38 Disk boards PDB 0 PDB 0 PDB 0 PDB 0 HA 1 HA 4 HA 2 HA 8 Power cooling modules PCMs 3 4 6 8 FC OM optical modules PDB 2 PDB 7 PDB 4 PDB 14 HA 2 HA 6 HA 4 HA 12 1 128 Mbytes RAM is the minimum amount supported 1 6 Ultra Enterprise Cluster Hardware Site Preparation April 1997 A lll 1 3 2 Checklist Table 1 6 Checklist for Ultra Enterprise Cluster 5000 System Factory Assembled Per Node Quantity Per Cluster Quantity Category Item Planned On Hand Planned On Hand Systems Ultra Enterprise 5000 System nodes CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM 128 Mbytes min I O bo
153. ed in the expansion cabinet refer to the installation and or service manual for the server acting as node to that storage chassis Messages presented by this server will encompass power on and boot behavior of the storage chassis in question In addition refer to the installation and or service manual for the storage chassis itself for any additional clarification Ultra Enterprise Cluster Hardware Site Preparation April 1997 Internal Access and Leveling f This chapter provides procedures for Removing panels from the three cabinet types Leveling the cabinets Ultra Enterprise Cluster 5000 6000 page 7 1 Ultra Enterprise Cluster 4000 page 7 9 Ultra Enterprise Cluster 3000 page 7 10 7 1 Ultra Enterprise Cluster 5000 6000 Note Power must be turned off before removing panels For powering off and on procedures see Chapter 6 Powering Off and On Cabinet outer panels are shown in Figure 7 1 through Figure 7 3 7 1 1 CD ROM lape Device Door The small door to the left of the top panel can contain a CD ROM drive and or a tape drive To open the door Push on the top right corner of the door The clasp will release and the door will spring open To close the door 7 1 7 2 Press gently to engage the clasp 7 1 1 1 Opening the Hinged Door 1 Grasp the door at the upper right corner and pull towards you firmly See Figure 7 1 The door is secured by a catch mechanism at the side o
154. edures 11 2 1 Preparing the Cabinet 11 2 1 1 Powering Off the Cabinets If the system cabinets are powered and operating halt the operating systems and power off the system and expansion cabinets See Section 6 1 Powering Off an Ultra Enterprise Cluster 6000 or 5000 Cabinet 11 2 2 Removing the Cabinet Panels Remove the cabinet panels to access the power switches and cables See Chapter 7 1 1 4 Internal Access and Leveling Ultra Enterprise Cluster 6000 Hardware Installation 11 5 11 11 2 3 Installing the Cabinets 1 Unplug the AC cords and all cabling to allow repositioning of the cabinets 2 Move the cabinets to their designated installation locations See Chapter 4 for site planning guidelines Note When moving the cabinets it is advisable to replace all panels to protect inner components during transport 3 Level the cabinet s See Section 7 1 1 4 Adjusting the Stabilizer Bar and Leveling Pads 11 2 4 Connecting the Main AC Cord N N 11 6 1 For all AC powered internal components plug in AC cords to provide grounding for static electricity Caution Do not disconnect the power cord when working on the system This connection provides a ground path that prevents damage from electrostatic discharge 2 Turn the front panel key switch to the Standby position See Figure 11 4 3 Turn the AC distribution unit power switch to Off The switch is at the rear of the cabin
155. ee the following for the workstation connection procedures Enterprise Cluster 3000 Section 8 7 2 Connecting the Terminal Concentrator and Table 8 2 for this procedure Enterprise Cluster 4000 Section 9 7 2 Connecting the Terminal Concentrator and Table 9 2 for this procedure Enterprise Cluster 5000 Section 10 3 2 2 Connecting the Terminal Concentrator and Table 10 2 for this procedure 6 1 6 2 Enterprise Cluster 6000 Section 11 3 2 2 Connecting the Terminal Concentrator and Table 10 2 for this procedure 6 1 Powering Off an Ultra Enterprise Cluster 6000 or 5000 Cabinet Note It is understood that the server in question is in the process of hardware installation and has no users nor data files to be concerned with If this is not true halt the system using the procedure found in the Enterprise Cluster System Service Manual part number 802 6786 1 Turn the front panel key switch tod the standby position The key switch is behind the front door See Figure 6 1 9 9090909009099000 o 08 G 9 G 90909 990907 Figure 6 1 Key Switch in the Standby Position Note The front panel keys for this switch are packed in the accessory box Note The standby position 6 does not turn off any AC powered drive trays in the lower part of the system cabinet The key switch controls
156. embled page 1 8 Ultra Enterprise Cluster 6000 Factory Assembled page 1 10 Ultra Enterprise Cluster 6000 Customer Assembled page 1 12 1 1 lll A 1 1 Ultra Enterprise Cluster 3000 Customer Assembled 1 1 1 General Description Table 1 1 Requirements for Ultra Enterprise Cluster 3000 System Customer Assembled Per Node Per Cluster System Device Min Max Min Max Comment Terminal concentrator 1 1 Installed in customer defined location SPARCstorage Array PDB 2 PDB 10 Each equipped with HA 2 HA 12 2 FC OM Cable set 1 1 Client net HA other Administration workstation 1 1 Ultra Enterprise 3000 System 1 1 2 2 Chassis not mounted in a rack CPU Memory boards each with 1 2 2 4 Installed in slot 0 2 UltraSPARC modules 256 Mbytes RAM I O boards each equipped with 2 3 4 6 PDB I O boards in 1 fiber interface FC OM module slots 1 and 2 are PDB SCI cards configured with SCI 2 2 4 4 cards Power cooling modules PCMs 3 3 6 6 FC S SBus card PDB 0HA 0 PDB 7HA 9 PDB 0 PDB 14 HA 0 HA 18 FC OM optical modules 2 3 4 6 1 128 Mbytes RAM is the minimum amount supported T2 Ultra Enterprise Cluster Hardware Site Preparation April 1997 A lll 1 1 2 Checklist Table 1 2 Checklist for Ultra Enterprise Cluster 3000 System Customer Assembled Per Node Quantity Per Cluster Quantity Category Item Planned On Hand Planned On Hand Systems Ultra Enterprise 3000 System node
157. entrator bracket assembly b Install the locator screws Loosely install two locator screws in the right hand rail in the rear of the cabinet Thread them into holes 8 and 30 as shown in Figure 10 7 Note The locator screws will accept the slotted holes in the hinge piece c Place slotted holes of the hinge over the locator screws and allow the hinge to drop into place d Install an additional pair of screws into holes 9 and 29 Tighten these screws as well as those in holes 8 and 30 see Figure 10 7 10 10 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 a ES ZA 7 1 Figure 10 7 Installing the Terminal Concentrator Hinge 2 Install the terminal concentrator in the bracket and assemble the bracket a Place the side pieces of the bracket against the terminal concentrator as shown in Figure 10 8 Ultra Enterprise Cluster 5000 Hardware Installation 10 11 10 b Lower the terminal concentrator with side pieces onto the bottom plate Align the holes in the side pieces with those in the bottom plate Nuts 6 Side piece 2each i Terminal concentrator Bottom plate A Figure 10 8 Assembling the Terminal Concentrator Bracket c Install three nuts on threaded studs penetrating through each side plate Tighten the nuts This completes assembly of the bracket assembly 3 Instal
158. eparation April 1997 LS b Route the power cords to the power sequencer Dress the power cords down the left side of the rack Roll any excess cord and tuck it into the space under the power distribution unit at the bottom of the cabinet Secure in place using cable ties 2 Plug in the SPARCstorage Arrays Plug the power cords from the chassis into the power distribution unit Use the switched outlets identified in Figure 11 6 for SPARCstorage Arrays 0 3 as appropriate E Blower assemblies 00000009 200009000 9 00009009 o ooo 000 esc feg SPARCstorage Ife Ife Array 2 o o LOU LOU SPARCstorage alils Array 0 concentrator Ol MOV node 0 only O O O O Figure 11 6 Plugging SPARCstorage Arrays into the Power Sequencer Ultra Enterprise Cluster 6000 Hardware Installation 11 9 11 3 Turn the AC power switch to ON on all SPARCstorage Arrays and servers See Figure 11 5 11 2 6 Installing the Terminal Concentrator Install the terminal concentrator mounting bracket in the primary cabinet 1 Install the terminal concentrator bracket hinge a Locate the hinge portion of the terminal concentrator bracket assembly b Install the locator screws Loosely install two locator screws in the right hand rail in the rear of the cabinet Thread them into holes 8 and 30 as shown in Figure 11 7 Note The locat
159. er 3000 System 5 1 1 Minimum Configuration The minimum configuration is two nodes supporting two or three SPARCstorage Arrays for PDB and HA respectively F Ultra Enterprise Cluster Hardware Site Preparation April 1997 a lll 5 1 1 1 5 1 1 2 Power Cooling Modules PCMs Three PCMs must be installed in each node Board Population The card cages in the node 0 and node 1 servers are configured identically Figure 5 2 and Figure 5 3 show minimally populated card cages for both nodes CPU Memory Boards Slot 7 is configured with a CPU Memory board I O Boards Slots 1 3 and optionally 5 are configured with I O boards SBus cards are installed in the appropriate slots Clock Board One clock board is required in each node Ultra Enterprise Cluster Configurations 5 3 lll a 90POODOODOOOOOOODOOOOOOOOOOQOOGQODOOOQOODO a GcaoscacsoceacoacocoocoacGoacoocacacocooo ATIATI III IS IIS IISI SIISII SIII III IIIS IIIS o6doodoodoOoboObOdOODOODOObDOObOOOdOODOOOd0 900000000OOOOOOODOOOOOOOOOOQOOQODOOOQOODO OQOGOOQOOQOODOODOGQOODOODOODOODOOOQQO ODOOO Q OOOO Ia an0 IIS PCMs 66 06 6 00 6 0 6 6 5 0 6 b 0 6 6 56 6 D 6 6 5 6 6 5 0 60 0 6 6 D 60 6 d 0000000000000000D00000000000008000000000D0 Noe re Tere He b b a b a Clock board Peripheral power supply AC Input 9 TEAM 9 v 1 J SBus slots 1
160. er Hardware Site Preparation April 1997 Ha lll Table 4 1 Platform and Chassis Connector Requirements Platform Type U S Type International Comment Ultra Enterprise Cluster 3000 NEMA 5 15P By country One per node Ultra Enterprise Cluster 4000 chassis SPARCstorage Array 100 One per storage Series Plug array chassis SPARCstorage Array 200 Coumtry kits Series provided with Multi disk Pack international Connector shipments include the proper cables for the country of destination Ultra Enterprise Cluster 5000 NEMA L6 30P 30A single phase IEC 309 One per node Ultra Enterprise Cluster 6000 cabinet Expansion Cabinet 0 IF One per expansion E Plug e Plug pal NE perd i ey AA Connector Connector 4 3 Ethernet Networks 4 3 1 Public and Client Networks This network is per customer choice The mode of network communication is Ethernet at time of publication 4 3 2 Private Node to Node Network Ultra Enterprise Cluster systems follow the IEEE standard for SCI and Ethernet Planning for Hardware Power and Network Requirements 4 7 4 8 4 3 3 RS 232C and RS 423A 4 3 3 1 This section addresses asynchronous cables used to connect your Sun servers and Workstation to the terminal concentrator Most systems enable you to select between two EIA interface standards RS 232C or RS 423A Differences between the two standards are noted in T
161. er Hardware Site Preparation April 1997 pee lll Figure A 15 Base Plate Installed A 5 Installing the Array in the Cabinet N N Install the array from the bottom up in the order shown in Figure A 2 Warning The cabinet can become front heavy while installing the array Ensure that the stabilizer bar is extended before proceeding Failure to extend this bar can result in the cabinet tipping forward and injuring personnel Warning The SPARCstorage Array chassis is heavy Obtain the aid of an assistant to help lift the array Attempting to lift the array alone can result in injury to personnel 1 With one person on each side lift the array and approach the expansion cabinet with the back of the array facing the front of the cabinet Figure A 16 Rackmount Rail Installation A 15 Figure A 16 Installing the Array in the Cabinet Note If the cabinet tends to roll away lower the main leveling pads as instructed in Chapter 7 Section 7 1 1 4 Adjusting the Stabilizer Bar and Leveling Pads Ultra Enterprise Cluster Hardware Site Preparation April 1997 A 2 Line up the array base plate with mating side rails in the cabinet See Figure A 17 NN y Wu n remi RN EXE REAR aoe 7 7 Figure A 17 Aligning the Array Base Plate with the Side Rails 3 Rest the array on the side rails then slide t
162. er optic cabling For fiber optic cable connections see Table 8 3 Table 8 2 Cable Connections Except Fiber Optic System Board From Node 0 From Node 1 To Interface Type I O slot 1 Onboard hme Node 1 onboard hme RJ 45 TPE HA on I O board 1 private net Onboard hme Node 0 onboard hme RJ 45 TPE on I O board 1 private net Onboard SCSI Wide SCSI terminator Wide SCSI Onboard SCSI Wide SCSI terminator Wide SCSI Public net SBus card in Public net Ethernet or slot 1 FDDI Public net SBus Public net Ethernet or card in slot 1 FDDI Install terminator on SCSI Install terminator Wide SCSI port on SCSI port Public net SBus card in Public net Ethernet or slot 1 FDDI I O slot 3 Onboard hme Node 1 onboard hme RJ 45 TPE on I O board 2 private net Onboard hme Node 0 onboard hme RJ 45 TPE on I O board private net PDB SCI SBus port Node 1 SCI SBus port SCI cable SCI SBus card Node 0 SCI SBus port SCI cable Clock Board Serial A Terminal concentrator Serial All port 2 Serial A Terminal concentrator Serial port 3 Other Administration Terminal concentrator Serial workstation Serial A port 1 Administration Primary Ethernet AUI or RJ 45 workstation Ethernet port network 1 Category 5 twisted pair private net cable part number 530 2149 1 meter or 530 2150 5 meter 8 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Co lll 8 7 1 Cabling the Administration Workstation is plugged into a I O board
163. erican 100 120 VAC 90 264 VAC 47 63 Hz 6 5A 460W International 220 240 VAC 90 264 VAC 47 63 Hz 6 5A 460W 8 3 1 1 Connecting the Power 1 Connect the SPARCstorage Array power cords Connect a power cord at the rear of each chassis see Figure 8 4 AC receptacle On Off switch EX Sun e E O azo ames 77A 47 63Hz MODEL NO 1010 PN 595 3373 01 mm mm O o9 Co A B Figure 8 4 SPARCstorage Array AC Power Connector and Power Switch 2 Plug the power cords into the power source Route the power cords to the designated power source Dress the power cords as required Roll any excess cord and secure it using cable ties 3 Turn on the AC power switch on all SPARCstorage Arrays See Figure 8 4 Ultra Enterprise Cluster 3000 Hardware Installation 8 5 8 8 4 Installing the Terminal Concentrator Install the terminal concentrator in its designated installation place 8 5 Power Cooling Modules PCMs Each PCM provides power and cooling to the one or two boards installed adjacent to it For this reason every board or board pair must be supported by an adjacent PCM Ensure that a PCM is installed for each board or board pair to be installed in the card cage Install additional PCMs as required to meet this requirement In addition ensure
164. ess Access U S Metric Front 36 in 92 cm Rear 36 in 92 cm Left 36 in 92 cm Right 36 in 92 cm 3 6 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Oy lll 3 1 6 Cluster Ready Node The following data is for each of the principal components of a Ultra Enterprise Cluster 5000 customer assembled system Ultra Enterprise 5000 Server and SPARCstorage Array 112 chassis Table 3 13 Ultra Enterprise 5000 Server Physical Specifications Specification U S Metric Diagram Height 56 in 143 cm Width 30 in 77 cm Depth 39 in 99 cm VA 39 in 30 in 99 cm 77 cm Weight 875 lb 400 kg Approximate weight depending upon configuration Power cord 15 ft 4 6m Table 3 14 Ultra Enterprise 5000 Server Clearance and Service Access Access U S Metric Front 48 in 122 cm Rear 36 in 92 cm Left 36 in 92 cm Right 2in 5cm Specifications 37 lll Oy Table 3 15 SPARCstorage Array 112 Physical Specifications Specification U S Metric Diagram Height 890in 22 6 cm Width 19 46 in 49 43 cm Depth 21 06 in 53 49 cm 8 94 in 22 7 cm 19 46 in 21 06 in 49 4 cm 53 5 cm Note All panels visible here are removed for rack installation Weight 110 Ib 50 kg Approximate for 30 drive option Actual weight depends on installed options Power cord 6 ft 1 83 m Table 3 16 SPARCstorage Array Clearance and Service Access Access US Metric Comments Front 24 in 61 cm Access to fan tray and
165. et Figure 2 4 Clustered HA System Based on Ultra Enterprise 6000 System Product Description 2 5 Each server has a disk partition to store its operating system that is the usr ops and var file systems The disk partition for the operating system can be mirrored to improve system availability although these files are not viewed as a shared resource Each server boots from its own operating disk partition The database volumes are stored on two or more SPARCstorage disk arrays with each disk array cross connected to both servers via a 25 Mbyte second full duplex Fibre Channel optical link Database volumes are mirrored across multiple disk arrays for high availability The maximum number of storage arrays that can be installed is determined by the number of available optical connection slots on the servers 2 2 Ultra Enterprise 3000 Configurations 2 6 There are several types of disk arrays used by the shared database This basic cluster is not installed in a rack The system features SPARCstorage Array Model 100 series units For expanded systems the disk arrays may be e SPARCstorage Array Model 100 series units or e SPARCstorage Array Model 200s hosting SPARCstorage RSM units Removable Storage Media or SPARCstorage Array Model 210s hosting differential SCSI trays Figure 2 5 shows Ultra Enterprise 3000 system hardware required to support the Ultra Enterprise software 2 2 1 PDB Configuration The m
166. et Warning The switch must be turned off at the cabinet AC distribution unit or risk of electrical shock to personnel exists 4 Uncoil the AC power cord and connect it to an AC outlet The AC outlet should be part of a circuit dedicated to this system Do not connect electrical motors or heaters to this circuit Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 11 2 5 Installing SPARCstorage Arrays in the System Cabinets 11 2 5 1 11 2 5 2 Two or more SPARCstorage Arrays are installed in the cluster These devices provide storage for the database The cluster contains two identically configured Ultra Enterprise 6000 systems Mounting in the Cabinet Install the rails in the cabinets and install the SPARCstorage Arrays on the rails For these procedures See Appendix A Rackmount Rail Installation Preparing the SPARCstorage Arrays 1 Locate the DIAG switch on the array rear panel See Figure 11 4 2 Ensure that the DIAG switch is set to DIAG and not to DIAG EXT Do not use the DIAG EXT position as it will invoke extended diagnostics and prevent the SPARCstorage Array from booting Use the DIAG position only for normal operation b Sun el IST ex 9m 100 77A 7 83Hz MODEL NO 1010 Serial number label um um 909 O lt A B
167. f the cabinet See Figure 11 2 Ultra Enterprise Cluster 6000 Hardware Installation Ip 11 Warning The power must be turned off at the AC distribution unit or risk of electrical shock to personnel exists 4 Locate the AC power cord and uncoil it 5 Plug in the AC power cord a Open the lock on the cover of the AC connector housing This connector housing is at the rear of the cabinet at the bottom right corner See Figure 11 3 b Open the spring loaded cover The cover has detents to secure it in the open position c Plug the power cord female end into the connector d Close the lock to secure the plug in place The lock engages features on the plug housing to hold it fast Figure 11 3 Power Connector and Detachable Cable 11 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 II 6 Plug the power cord male end into the facilities power connector As noted in Chapter 4 Planning for Hardware Power and Network Requirements the AC outlet must be part of a circuit dedicated to this system Do not connect electrical motors or heaters to this circuit This connection provides a ground path that prevents damage from Caution Do not disconnect the power cord when working on the system electrostatic discharge 11 2 Customer Assembled Ultra Enterprise Cluster 6000 Hardware Installation If the system is to be assembled at the site follow these proc
168. first two I O boards must have SCI SBus cards installed The two cables connect the two nodes directly no hubs are used 5 4 5 SPARCstorage Arrays Note Determine your fiber optic cable requirements Read the appropriate sections to determine the quantity length and type of cables you will require Each cable is labeled before or during installation as instructed in Chapter 11 in the section titled Labeling Fiber Optic Cables under Section 11 3 4 1 Each SPARCstorage Array 100 series and 200 series unit incorporates two FC OM optical modules the second one being optional One module connects to node 0 and the other to node 1 These are identified as A and B on the SPARCstorage Array chassis back panel See Figure 5 17 and Figure 5 18 for an example of SPARCstorage Array to node communication fiber optic cable connection Ultra Enterprise Cluster Configurations Sal lll a Key notches Keys hidden N Key notches mo H We zl E N og IE Doo Oo st 5 gt Array end Node end Figure 5 17 SPARCstorage Array Fiber Cable Connection Ultra Enterprise Cluster Hardware Site Preparation April 1997 5 22 a l
169. g Off an Ultra Enterprise Cluster 6000 or 5000 Cabinets etorri A Ed eu d iria E inta 6 2 6 2 Powering On an Ultra Enterprise Cluster 6000 or 5000 6 3 Powering Off an Ultra Enterprise Cluster 4000 Cabinet 6 6 6 4 Powering On an Ultra Enterprise Cluster 4000 Cabinet 6 8 6 5 Powering Off an Ultra Enterprise Cluster 3000 Cabinet 6 9 6 6 Powering On an Ultra Enterprise Cluster 3000 Cabinet 6 11 6 7 Powering On the SPARCstorage Array Chassis 6 14 6 8 Reading POST Messages and Boot Messages 6 14 7 Internal Access and Leveling oooooooo m o o 7 1 7 1 Ultra Enterprise Cluster 5000 6000 suus 7 1 7 1 1 CDAROM Tape Device DDOf 6s sn untur 7 1 7 2 Ultra Enterprise Cluster 4000 o oooocooccooo mo o 7 9 Tl Top Bezel xc RR RERIA o 7 9 7 3 Ultra Enterprise Cluster 3000 w ii isto ERR m 7 10 e e AAA 7 10 foe AA eL CORPER EA PESCE TR E 7 10 Contents vii 8 Ultra Enterprise Cluster 3000 Hardware Installation 8 1 8 1 Preparing the Server coe aae ec etd dL rr 8 1 8 2 Connecting the Power Cords o ooocooccooomo o 8 1 8 3 Installing the SPARCstorage Arrays 8 4 8 3 1 Preparing the SPARCstorage Arrays 8 4 8 4 Installing the Terminal Concentrator 8 6 8 5 Power Cooling Modules PCMS 8 6 8 6 Configuring the Card Cages oooooccooccooocmmo 8 6 8 6 1 CPU Memory Board dci 8 7 8 6 2 I O Boards ierre es aga RAW d
170. gth Where possible use short serial interface cables for 9600 baud You can use longer cables provided the resulting load capacitance measured at the interface point and including the signal terminator does not exceed 2500 picofarads For further information see EIA STANDARD RS 232C and EIA STANDARD RS 423 A EIA RS 232C cabling specification is available from Electronics Industries Association 2001 I Street N W Washington D C 20006 USA Phone 202 457 4900 Shield Ground Drain Some interface applications require shielded cable to minimize RFI When used connect the shield to frame ground at one or both ends depending on the specific application Note On Sun Microsystems DB 25 connectors the shield ground lead can be connected to pin 1 at the cable end connecting to Sun equipment this serves as protective ground Planning for Hardware Power and Network Requirements 4 9 lll HS 4 3 3 4 Generic Pinouts Table 4 3 provides a cross reference of pinouts for Sun Workstations to standard EIA RS 232C and CCITT designations Table 4 3 Generic Pinouts for Sun System Boards and Communication Products Designation Pin No 25 pin Signal Description EIA CCITT 1 Protective Ground AA 101 2 Transmitted Data BA 103 3 Received Data BB 104 4 Request To Send CA 105 5 Clear To Send CB 106 6 Data Set Ready CC 107 7 Signal Ground AB 102 8 Data Carrier Detect CF 109 15 Transmit Clock In DCE So
171. gured with SCI SCI cards PDB only 2 2 4 4 cards FC S SBus card PDB 0 PDB 19 PDB 0 PDB 36 HA 0 HA 18 HA 0 HA 38 Disk boards PDB 0 PDB 0 PDB 0 PDB 0 HA 1 HA 4 HA 2 HA 8 Power cooling modules PCMS 3 4 6 8 FC OM optical modules PDB 2 PDB 7 PDB 4 PDB 14 HA 2 HA 6 HA 4 HA 12 1 128 Mbytes RAM is the minimum amount supported 1 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 A lll 1 2 2 Checklist Table 1 4 Checklist for Ultra Enterprise Cluster 4000 System Customer Assembled Per Node Quantity Per Cluster Quantity Category Item Planned On Hand Planned On Hand Systems Ultra Enterprise 4000 System nodes CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM 128 Mbytes min I O board Disk board Power cooling module PCMs Administration workstation SBus cards PDB SCI SBus card FC S SBus card Modules FC OM modules Chassis Terminal concentrator Cables RS 232 serial cable long PN 530 2152 short PN 530 2151 HA private net 1 meter PN 530 2149 5 meter PN 530 2150 Differential SCSI 530 1884 PDB SCI cable 5 meter PN 530 2310 Fiber optic cable 15 meter PN 595 3379 System cabinet SPARCstorage Array units Administration workstation Monitor Expansion cabinet SPARCstorage Array 200 series units SPARCstorage RSM units Differential SCSI disk trays Checklist 1 5 lll A 1 8 Ultra Enterprise Cluster 5000 System Factory Assembl
172. hat follows the broadcast address is the terminal concentrator address with the host portion set to 255 or all ones monitor addr Enter Internet address lt uninitialized gt terminal concentrator IP address lt ethernet gt Type of IP packet encapsulation lt ethernet gt Load Broadcast Y N Y lt return gt monitor Enter Subnet mask 255 255 255 0 subnet mask Enter preferred load host Internet address lt any host gt lt return gt Enter Broadcast address 0 0 0 0 your network broadcast address Enter preferred dump address 0 0 0 0 return Select type of IP packet encapsulation ieee802 ethernet return 8 Verify that the terminal concentrator boots from itself instead of the network To do this type the following commands at the monitor prompt and press Return after verifying the correct settings shown in the second screen display Configuring the Terminal Concentrator and Installing the Software 12 3 12 monitor seq Enter a list of 1 to 4 interfaces to attempt to use for downloading code or upline dumping Enter them in the order they should be tried separated by commas or spaces Possible interfaces ar Ethernet net SELF self Enter Interface sequence net self Interface sequence self monitor image Enter Image name ip oper 52 enet mop OPER 52 ENET SYS return Enter TFTP Load direct
173. he array in 4 Thread in a screw through the slotted hole in the front of the base plate into the left and right side rail See Figure A 18 5 At the cabinet rear insert screws through the holes in the rear of the side rails and screw them into threaded holes in the base plate See Figure A 18 Rackmount Rail Installation A 17 lll aN E S NANNAN Y Y Figure A 18 Installing Screws to Secure the Base Plate to the Side Brackets 6 Alternately tighten the screws at the front and rear of the base plate side rails until the array base plate is firmly clamped in the side rails Do this on both sides of the cabinet 7 Repeat steps 1 through 6 for all remaining arrays to be installed A 6 Installing the SPARCstorage Array 200 Series Chassis in the Expansion Cabinet Install these controller units in the expansion rack using the hole numbers specified in Table A 1 See Figure A 19 for a graphic of this installation Note Install the 200 series array into the rear of the expansion cabinet so the connector panel on the rear of the unit is accessible from the front A 18 Ultra Enterprise Cluster Hardware Site Preparation April 1997 pee lll
174. hinge assembly and drop the bracket onto the hinge see Figure 11 9 11412 Ultra Enterprise Cluster Hardware Site Preparation April 1997 II 4 Install the keeper screw in the shorter boss pin This ensures the assembly will not be accidently knocked off the hinge N AN Figure 11 9 Terminal Concentrator Installed on the Hinge 5 Connect the power cord a At the rear of the terminal concentrator install the power cord See Figure 11 10 Ultra Enterprise Cluster 6000 Hardware Installation H 3 11 b Plug the other end into the AC power distribution unit See Figure 11 11 SSSWSXAR V I eX WA E Al El AIAG AG al Ed Ed Ed AEG E El El El AT ATO 0 ED ED BLEED Eg B B E RAMA D B BT aE A 0 M VEV II IT EA DOOD LV CU ITI of Dy D Df D DEVE EIE BRB TETTE EDA AAA Oo popa pepe 4 A E ll El El Ed El El ATE Fn n a R El E a Ed El o AE EA Ss x Power cord Figure 11 10 Terminal Concentrator Cable Locations 6 Close the terminal concentrator bracket Swing the bracket assembly closed and install screws in holes 8 and 30 on the left side rail 11 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 o Blower assemblies o O O 00 rete DO OO DO OO DO OO 09 QO Dal OO O O 0009 000 000 000 Terminal co
175. iate procedure below Section 10 3 1 2 Installing I O Boards for PDB Section 10 3 1 3 PDB and HA Installation Ultra Enterprise 6000 The appropriate procedure below Section 11 3 1 2 Installing I O Boards for PDB Section 11 3 1 5 Disk Board HA System Only Ultra Enterprise Cluster Hardware Site Preparation April 1997 Mixed Compute Platforms C Clusters may be comprised of two hosts which are different platform types and may have different type processors Such platform combinations however are governed by constraints regarding compatibility and equivalency between the hosts This appendix specifies which platforms and processors may be joined to create a cluster Combinations not found here are not allowed C 1 Platform and Processor Equivalency Table C 1 and Table C 2 list the compute platforms which can be combined to create a cluster for PDB and HA application respectively In addition they present module and memory equivalencies Note The I O connections must be identical for the two nodes however the processor and memory configurations need not be identical The larger the disparity however the greater the probability the two nodes will not boot up at the same rate which may affect HA start up from a cold start For example after a total system power failure the larger node may take longer to boot This can result in the smaller node starting HA without detecting the larger node
176. ical of Node 0 and 1 9 7 Ultra Enterprise Cluster 4000HA Card Cage Expansion Example Typical of Node 0 and 1 9 8 Faller Pan l isos osito a etae dede ds 9 10 Installing the Terminator on the Disk Board 9 11 Connecting the Administration Workstation 9 13 Node Interface to the Terminal Concentrator 9 15 Node to Node Ethernet Connection 600000000 9 16 Node to Node SCI Connection 0 666 e cece 9 17 SCSI Terminator Installation on the I O Board 9 18 Disk Board Connection sussa susara srr rrn ee eee ee 9 19 SPARCstorage Array 0 and 1 Connection Example 9 20 SPARCstorage Array 2 and 3 Connection Example 9 21 SPARCstorage Array 4 and 5 Connection Example 9 22 SPARCstorage Array 6 and 7 SPARCstorage Array 200 Series Connection Example spressi 9 S TR aR a T E 9 23 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 100 Series Unit 9 24 xix XX Figure 9 22 Figure 10 1 Figure 10 2 Figure 10 3 Figure 10 4 Figure 10 5 Figure 10 6 Figure 10 7 Figure 10 8 Figure 10 9 Figure 10 10 Figure 10 11 Figure 10 12 Figure 10 13 Figure 10 14 Figure 10 15 Figure 10 16 Figure 10 17 Figure 10 18 Figure 10 19 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 200 Series Unit 9 25 Key Switch in the Standby Position ooo
177. if applicable Caution Do not disconnect the power cord from the wall socket when working on the server This connection provides a ground path that prevents damage from uncontrolled electrostatic discharge 4 Turn the key switch to the On position See Figure 6 9 Several things should occur The fans in the power supplies begin turning The top front panel LED green turns on immediately denoting the power supply is delivering DC power The middle front panel LED yellow flashes while POST runs for approximately 60 seconds After 60 seconds this LED turns off if the tests pass If the LED remains lit after 60 seconds a test has failed The bottom front panel LED green flashes to show that boot is successful and the operating system is running If this LED fails to turn on and the middle LED is on a severe hardware fault exists PDOOOOOOOOOOQOOGQOOOOQOOQOOQOOQOODOOOQODOOO c acGsaGoeecoacoacacoocooocaaocaodcaocooocooac OccOcOOOOcOocaocoococaooocooooooco0cooaOnodu dO6ODOODOODbOODOOO ODOODOOOOO000004d05000000 9900900 0000990900000009000000000000800000 goopI OPO ODO ODO OV ODO ODO SIO OVO OVO TODO ONTOS DINO IRIS ARANA NINAS ANAIS 290 c O C9 c cO C c D Occo DOOO OOOOOOOGdOOdO0000d0000006008000b000800b000 d000000000000000000000000000000d00000000 9 9 o a a o a 9 9 ON a p p o gt on gt
178. igure 6 6 Key Switch in the STANDBY Position Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll 000000000000 00000000000000000000000000000 00200100000 000000900000000000000000000000 299000000000 000009000000000090900000900000 RARE oro 0 0 0 D o OX o OO OO OO O O0 OD OOS USooo SODIO INSI NS ANS INN IAS ARAS AS 00O0c0ccOoOCOOOCOO0OCOUCGOOCOO0nOCOODOOODOUO bd I ES gt Jo oC 010 d J 7 0 pul D 0 EE gt o O oC K AC connector Figure 6 7 Turning the AC Power Switch to OFF 6 6 Powering On an Ultra Enterprise Cluster 3000 Cabinet 1 Begin with a safety inspection a Use the handle on the front of the system to open the front door b Turn the system key switch to 5 the Standby position See Figure 6 6 c Turn the AC power switch to ON The AC power switch is at the rear of the enclosure See Figure 6 8 d Verify that the AC power cord is plugged into a wall socket Note The front panel keys for this switch are packed in the accessory box 2 Turn on power to any expansion cabinets Read the documentation supplied with the expansion cabinet for specific instructions Powering Off and On 6 11 3 Turn on power to the terminal
179. in the ON Position 6 600 c eee ee Opening the Hinged Door 0 00 Removing the Rear Screen Panel ooooooooo o oo Removing the Kick Panel 2 0 0c eee eee Leveling Pads een Stabilizer Ba l erbe Re dd ERAS xvii xviii Figure 7 6 Figure 7 7 Figure 7 8 Figure 8 1 Figure 8 2 Figure 8 3 Figure 8 4 Figure 8 5 Figure 8 6 Figure 8 7 Figure 8 8 Figure 8 9 Figure 8 10 Figure 8 11 Figure 8 12 Figure 8 13 Figure 8 14 Figure 8 15 Figure 8 16 Figure 8 17 Figure 8 18 Figure 8 19 Removing the Side Panels nana nananannaan rran 7 8 Removing the Top Bezel Panel 000000000 7 9 Removing the Front Bezel 7 11 Key Switch in the Standby Position oooooooooo 8 2 AC Power Switch Power Receptacle and Retainer Clip 8 3 SPARCstorage Array Voltage Rating on the Serial Number Lab l sisisi sisinio asa a o 8 4 SPARCstorage Array AC Power Connector and Power Switch 8 5 Enterprise Cluster 3000PDB Card Cage Minimum Population Typical of Node 0 and Node T 8 7 Enterprise Cluster 3000PDB Card Cage Expansion Example Typical of Node 0 and Node T 8 8 Enterprise Cluster 3000HA Card Cage Minimum Population Typical of Node 0 and Node T 8 9 Enterprise Cluster 3000HA Card Cage Expansion Example Typical of Node 0 and Node T 8 10 Filler Panel cid eb a rn er ER e 8 13 Connecting the Administration Workstation 8 15 Serial Port A on the Clock
180. ing up on the latch with the other This should release the latch 2 With the panel released gently swing the panel bottom away from the array and lift it clear Set the panel aside A 8 Ultra Enterprise Cluster Hardware Site Preparation April 1997 pee lll Figure A 8 Removing the Front Panel A 3 2 Removing the Side Panels The side panels are self attached slide and lock panels 1 Remove the front panel as described in the previous section 2 Remove the side panel a Grasp the panel with both hands and slide it toward the rear of the array about 2 1 2 centimeters about one inch Tap the front edge of the panel with the heel of your hand if necessary to slide the panel toward the rear of the chassis see Figure A 9 b Pull the panel away free of the array and set it aside 3 Repeat Step 2 to remove the remaining side panel Rackmount Rail Installation A 9 lll aN LT 2 S art des L uai HD JA M Figure A 9 Removing the Side Panels A 3 3 Removing the Top Panel A 3 3 1 The top panel slides to the rear to a release point after the popouts are removed then lifts off Removing the Four Popouts 1 On the panel find the location where the two dots are adjacent to each other one dot on the popout one on the top panel Se
181. inimum configuration is listed below Two nodes based on Ultra Enterprise 3000 each containing One CPU Memory board with 2 UItraSPARC modules and 256 Mbytes RAM Two I O boards each with one SCI card and one FC OM Two SCI cables Two SPARCstorage Array Model 100 series units Four fiber optic cables Terminal concentrator with short and long serial cables Ultra Enterprise Cluster Hardware Site Preparation April 1997 No lll CD ROM and optionally 8 mm tape drive Administration workstation with CD ROM drive not shown SPAROstorage Array Model 100 Series units Ss Administration workstation Terminal concentrator serves primary node SPAROstorage Array Model 100 Series units Ultra Enterprise 3000 Systems Figure 2 5 Ultra Enterprise Cluster 3000 System 2 2 2 HA Configuration The minimum configuration is listed below Two nodes based on Ultra Enterprise 3000 each containing Product Description 2 7 lll No 2 8 One CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM Two I O boards each with one FC OM Two SPARCstorage Array Model 100 series units Four fiber optic cables Terminal concentrator with short
182. ion See the following notes regarding adding SPARCstorage Arrays Note Do not occupy or connect cables to both optical ports on any given I O board Ultra Enterprise Cluster Configurations 5 6 5 1 2 1 5 1 2 2 Note Beyond minimum configuration use the first available optical module port following all other boards in the system This will ensure that the controller numbering is preserved if the Solaris operating environment is reinstalled An expansion configuration consists of Two nodes Ten PDB or twelve HA SPARCstorage Array systems These components can be installed in cabinets Power Cooling Modules PCMs Three PCMs must be installed in each node Board Population The card cages in the node 0 and node 1 servers are configured identically Figure 5 4 and Figure 5 5 show the expanded board population installed in the card cages of both nodes CPU Memory Boards Slots 7 is configured with a CPU Memory board I O Boards Slots 1 3 and 5 are configured with I O boards SBus cards are installed in the appropriate slots Clock Board One clock board is required in each node Ultra Enterprise Cluster Hardware Site Preparation April 1997 a lll 90POODOODOOOOOOODOOOOOOOOOOQOOGQODOOOQOODO a GcaoscacsoceacoacocoocoacGoacoocacacocooo EATI III IS IIS IISI SIISII III III IIIS IIIJ o6doodoodoOoboObOdOODOODOObDOObOOOdOODOOOd 900000000OOOOOOODOOOOOOOOOOQOOQODOOOQOODO OQOGOO
183. ipheral power supply AC Input o Ue Vo Ue 5 o o 5 5 9 ES ALERT Private net 0 Wn L r Sun a a a o SBusslots 1 l j ul aue tus 1 o 12102100 m r1 mie 2 MINI MI 1 Peripheral power suppl HT MM p p ppy 7 o s Ue Use Ho Optical port onboard FC OM CPU Memory board A I O boards 7 5 3 1 Board slots Figure 5 5 Ultra Enterprise Cluster 3000HA Card Cage Expansion Example Typical of Node 0 and Node 1 5 2 Ultra Enterprise Cluster 4000 and 5000 The basic Enterprise Cluster 4000 and 5000 systems are shown in Figure 5 6 and Figure 5 7 respectively 5 8 Ultra Enterprise Cluster Hardware Site Preparation April 1997 a lll Terminal concentrator primary node only Ry NP Administration workstation Ultra Enterprise 4000 System SPARCstorage Array Model 100 Series units S Figure 5 6 Ultra Enterprise Cluster 4000 Server Ultra Enterprise Cluster Configurations 59 Terminal concentrator hidden SPARCstorage Array Model 112 Figure 5 7 Ultra Enterprise Cluster 5000 Server Use these configurations as a guide to assembling any size system Omit those elements that will be absent from your particular site installation To install a system use the appropriat
184. is 500 meters eraris This may consist of one continuous piece of cable or segments but the segments must be in factors of 2 5 meters Spacing taps closer or farther apart disrupts cable impedance characteristics Cut the Ethernet cable only at 2 5 meter marks The minimum length of any segment is approximately 24 meters Connect the cable sheath conductor to earth ground Transceivers Attach transceivers taps and or repeaters only at the 2 5 meter intervals on Planning for Hardware Power and Network Requirements the cable The distance between transceivers and or taps must be in increments of 2 5 meters and no closer than 2 5 meters from each other and no farther apart than 500 meters The path between two transceivers and or taps cannot have more than one repeater Install 50 ohm terminators on all ends of the Ethernet cable Install them in a transceiver outlet or at the end of the cable for example in the last transceiver at the end of the cable The transceiver cable between the transceiver and workstation or terminal should be no longer than 50 meters 4 11 4 12 If planning a large network more than 40 workstations you may improve local performance by grouping and connecting workstation client clusters in small physical networks with gateway workstations to create your larger logical network Arranging workstation client clusters according to work function like engineering accounting and so on is one
185. ise PDB Solaris AnswerBook RSM SunSwift SunLink TurboGX Workstation and SunVTS are trademarks or registered trademarks of Sun Microsystems Inc in the United States and in other countries All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International Inc in the United States and in other countries Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems Inc The OPEN LOOK and Sun Graphical User Interfaces were developed by Sun Microsystems Inc for its users and licensees Sun acknowledges the pioneering efforts of Xerox Corporation in researching and developing the concept of visual or graphical user interfaces for the computer industry Sun holds a nonexclusive license from Xerox to the Xerox Graphical User Interface which license also covers Sun s licensees who implement OPEN LOOK GUIs and otherwise comply with Sun s written license agreements X Window System is a trademark of X Consortium Inc XPM library Copyright 1990 93 GROUPE BULL Permission to use copy modify and distribute this software and its documentation for any purpose and without fee is hereby granted provided that the above copyright notice appear in all copies and that both that copyright notice and this permission notice appear in supporting documentation and that the name of GROUPE BULL not be used in advertising or publicity pertaining to distribution of the software withou
186. its Parameter Specification Input current Voltage range Current maximum Current frequency range Input power rating Total continuous power Volt ampere rating BTU rating Value 200 240 VAC 24A at 220 VAC input 47 63 Hz 5016W 5280 VA 17 104 BTU Specifications 3 11 lll Oy Table 3 21 Electrical Specifications for the Expansion Cabinet With Two SPARCstorage Array 200 Series Units and Four RSM Units Continued Parameter Specification Value Power factor 0 91 0 96 Plug type US NEMA L6 30P for 200 240 VAC International 32A single phase IEC 309 connected for 220 240 VAC 3 8 Environmental Specifications Environmental specifications are presented in Table 3 22 through Table 3 24 3 3 1 Ultra Enterprise Cluster 3000 Table 3 22 Temperature Humidity and Altitude Limits Operating Nonoperating Temperature 41F to 104F 5C to 40C AF to 140F 20C to 60C Humidity 20 to 80 RH noncondensing 93 RH 27C max wb Altitude 9 843 ft 3 km 39 370 ft 12 km 3 3 2 Ultra Enterprise Cluster 4000 Table 3 23 Standalone Server Temperature Humidity and Altitude Limits Operating Nonoperating Temperature 41F to 104F 5C to 40C AF to 140F 20C to 60C Humidity 20 to 80 RH noncondensing 93 RH 27C max wb Altitude 9 843 ft 3 km 39 370 ft 12 km 3 12 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Oy lll 3 3 3 Ultra Enterprise Cluster 6000 5000 Th
187. k arrays 2 1 lll No Secondary Ethernet The systems are designed for reliability and serviceability They have no single point of failure and can be repaired and maintained online See Figure 2 1 through Figure 2 4 for functional block diagrams of clustered systems Secondary Ethernet 99 Node 0 Node 1 did CD ROM tape CD ROM tape scidO SCI Private SCI net 7 UO slot 3 SCI scii SCI UO slot 3 I O slot 1 I O slot 1 10 100Mbit Shared database 10 100Mbit hme0 hme0 Hr SPARCstorage arrays A FC OM FC OM FC OM FC OM hme1 hmei FC OM FC OM FC OM FC OM 1 CPU Memory boards with 1 CPU Memory boards with 2 UltraSPARC modules and 2 UltraSPARC modules and 128 Mbytes memory 128 Mbytes memory Clock board Clock board Serial port A Terminal Serial port A SS ie E concentrator AS l en Administration workstation Primary Eee Figure 2 1 Clustered PDB System Based on the Ultra Enterprise 3000 4000 5000 System pon Ultra Enterprise Cluster Hardware Site Preparation April 1997 No lll Secondary Ethernet Secondary Ethernet
188. l the terminal concentrator bracket onto the hinge in the chassis Turn the terminal concentrator bracket on its side so the hinge holes and cable connectors face right Align the bracket holes with boss pins in the hinge assembly and drop the bracket onto the hinge see Figure 10 9 10 12 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 4 Install the keeper screw in the shorter boss pin This ensures the assembly will not be accidently knocked off the hinge Figure 10 9 Terminal Concentrator Installed on the Hinge 5 Connect the power cord a At the rear of the terminal concentrator install the power cord See Figure 10 10 Ultra Enterprise Cluster 5000 Hardware Installation 10 13 E 10 b Plug the other end into the AC power distribution unit See Figure 10 11 S as C SESS RRN agas G AARAA o SANRA IA N AARAA s SANAA B AARAA g AALA AARAA amp gu 4 AARAA yA ESI Q A o NA SES S STT S ESI ES f SINA A QU N Q N QU Q Q R a A NA Q ya e Q e Sages SESS SE f Q S RN Pes SER P A Pa Power cord Figure 10 10 Terminal Concentrator Cable Locations 6 Close the terminal concentrator bracket Swing the bracket assembly closed and install screws in holes 8 and 30 on the left side rail 10 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10
189. led and cabling is complete The Solaris operating system is installed including Installation of the system administration workstation Configuration of the terminal concentrator Perform the acceptance test using the procedures presented in the following sections 12 6 1 Using SunVTS N 12 011 SunVTS is one of the on line diagnostics tools for Ultra Enterprise servers See Section 12 6 1 2 Running SunVTS A utility within SunVTS vtsprobe is used to verify installation of system hardware SPARCstorage Arrays private net devices and network interfaces See Section 12 6 1 1 Verifying Hardware Installation Caution Run SunVTS only while no database application software is running Use SunVTS at this stage only to verify that the hardware configuration is correct Do not attempt to use SunVTS to validate software configuration If you run SunVTS while database application software is running unpredictable results can occur Note SunVTS must be run separately on each node There is no provision for running SunVTS on both nodes at the same time When you are done running SunVTS on one node you must then repeat the process on the other node Verifying Hardware Installation There are four prerequisites for the following procedure Configuring the Terminal Concentrator and Installing the Software 12 9 12 12 10 Both nodes have Solaris 2 5 1 installed Both nodes have SPARCstorage Array p
190. let should be part of a circuit dedicated to this system Do not connect electrical motors or heaters to this circuit 10 6 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 10 2 5 Installing the SPARCstorage Array Systems in the System Cabinets 10 2 5 1 10 2 5 2 Two or more SPARCstorage Arrays are installed in the cluster These devices provide storage for the highly available data NFS file systems and DBMS databases Mounting in the Cabinet Install the rails in the cabinets and install the SPARCstorage Arrays on the rails For these procedures See Appendix A Rackmount Rail Installation Preparing the SPARCstorage Arrays 1 Locate the DIAG switch on the array rear panel See Figure 10 4 2 Ensure that the DIAG switch is set to DIAG and not to DIAG EXT Do not use the DIAG EXT position as it will invoke extended diagnostics and prevent the SPARCstorage Array from booting Use DIAG only for normal operation amp Sun e o1 acces ra TA 7 83Hz MODEL NO 1010 Serial number label PN 595 3373 01 lt lt wm mm o0 Co T A B DIAG switch Figure 10 4 SPARCstorage Array Voltage Rating on the Serial Number Label 3 Locate the serial number label on the rear panel of the chassis Ultra Enterprise Cluster 5000 Hardware In
191. ll Keys Key notches Keys hidden Key notches li 0 3 we co S 0 E 2 o coc o 9 s 9 rmn LI E m A o c 1r 1 o AA L T t Ic J r 1 o Bg O ej LEE Figure 5 18 SPARCstorage Array 200 Series Connection Ultra Enterprise Cluster Configurations Ss lll a 5 24 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Powering Offand On 6 Caution Use these power off on procedures only for systems that are newly installed or in the process of being installed Do not use these procedures on a system running real application database and processing live transactions Performing these procedures on a system serving as a node in an on line cluster poses great threat of irrecoverable data loss and a system crash For procedures on turning off or on a system which is operating as a node in a live cluster refer to the Ultra Enterprise Cluster System Service Manual part number 802 6786 Note For panel removal procedures see Chapter 7 Internal Access and Leveling For these procedures the administration workstation may need to be installed see the caution above S
192. lo o S He Ho Hoe Ie o 5 e L 3 H C 9 kan o Figure C 9 Ultra Enterprise 3000 to Ultra Enterprise 6000 Node to Node Connection o E E ez OOO E e 19 o re y D o o e E C fp ESO Ce e S 2e Tr ut Figure C 10 Ultra Enterprise 5000 4000 to Ultra Enterprise 6000 Node to Node Connection for HA Mixed Compute Platforms C 9 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Index A AC power cord connecting 8 2 switch 6 11 8 3 cabinet 10 4 to 10 6 11 3 to 11 6 adjust leveling pads 7 5 B bezel remove Ultra Enterprise 3000 7 10 Ultra Enterprise 4000 7 9 boot messages 6 14 bottom panel array remove A 13 C cabinet AC power switch 6 3 6 7 expansion A 4 install side rails A 6 SPARCstorage array A 15 key switch 8 2 9 2 10 2 11 2 LEDs 6 5 main power switch 9 2 10 3 11 3 cable length 4 8 SCI 5 21 10 26 11 28 card cage population expansion Ultra Enterprise Cluster 3000HA 5 8 8 10 3000PDB 5 7 8 8 4000HA 5 14 9 8 4000PDB 5 13 9 7 5000HA 5 14 10 18 5000PDB 5 13 10 17 6000HA 5 20 11 20 6000PDB 5 19 11 18 card cage population minimum Ultra Enterprise Cluster 3000HA
193. mentation supplied with the card s in question or the Enterprise 3000 System Manual Caution Install FC OM modules in the A locations only Do rot install FC OM modules in the B location If FC OM modules are installed in both locations then a failure of either module can result in loss of communication with both supported SPARCstorage Arrays or other storage devices 3 Install the I O board into the card cage slots 1 and 5 For I O board installation procedures refer to the documentation supplied with the CPU Memory boards or the Enterprise 3000 System Manual 4 If the third I O board is not installed fill the empty slot with a filler panel See Figure 8 9 5 Install the I O board in the card cage See Figure 8 5 through Figure 8 8 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Co lll Springfingers Figure 8 9 Filler Panel 8 6 4 Clock Board 1 The clock board must be installed in the clock board slot to the right of the I O boards For clock board installation procedures refer to documentation supplied with the card s in question or the Enterprise 3000 System Manual 8 6 5 Node 1 Card Cage 1 Repeat the instructions in Section 8 6 for node 1 8 7 Cabling System Components Network cabling is presented in Table 8 2 Procedures for connecting each cable follow the table Ultra Enterprise Cluster 3000 Hardware Installation 8 13 lll Co Note Table 8 2 does not cover fib
194. meters The type variable for each port must be set to dial_in If it is set to hardwired the cluster console may be unable to detect when a port is already in use The next section explains how to determine if the port type variable must be set 12 3 1 Determining if the Port Type Variable Must Be Set Perform this procedure to see if you must set the port variable 1 Find the Sun label on the top panel of the terminal concentrator See Figure 12 2 Configuring the Terminal Concentrator and Installing the Software 12 5 12 2 Examine the serial number to see if it is in the lower serial number range The serial number consists of seven digits followed by a dash and ten more digits f the numbers after the dash start with 9520 or higher the port type variable is set correctly no action is required If the numbers after the dash start with 9519 or lower the port type variable must be changed 3 If you must change the port type variable use the procedure in Section 12 3 2 Port Parameters Procedure Sun label 9520 or higher denotes the type variable is correct Sun label showing serial number 9519 or lower denotes the variable must be reset Y 7 LES pz DAN pt XXXXXXX 952OXXXXXX Dw obadebed UAV DLL LL XXXXXXX XX Figure 12 2 Determining the Terminal Concentrator Version 12 3 2 Port Parameters Procedure Using an administration worksta
195. n the screws to secure the bracket to the rack Note The SCI bracket automatically aligns the cable connectors to the SCI SBus cards in I O board slots 1 and 3 SBus position 0 Caution Tighten the screws carefully or connector damage may occur Readjust the cables in the tracks as required to prevent cable binding as the screws are tightened e Check your work Ensure that the connectors are secure and that no excessive force is placed on the cable connector or I O board See Figure 10 22 10 28 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 SCI cable bracket s gt mn S I He me ers a SO Aolo j an Y D X Y ANI NN SES Figure 10 22 Installing the SCI Cable Bracket 2 Install the second node Repeat the Cable and Bracket Preparation and Cable and Bracket eaasacaaoaacaeeaaaaas Installation procedures above for the remaining node Remaining Cables N X B SCI cable bracket Table 10 2 summarizes cables that can
196. ncentrator E 000 000 000 ooo Figure 11 11 Plugging the Terminal Concentrator into the Power Sequencer Node 0 11 3 Power Cooling Modules PCMs Each PCM provides power and cooling to the one or two boards installed adjacent to it For this reason every board or board pair must be supported by an adjacent PCM Ensure that a PCM is installed for each board or board pair to be installed in the card cage Install additional PCMs as required to meet this requirement Ultra Enterprise Cluster 6000 Hardware Installation als 11 11 16 Note To adhere to cooling and power requirements one power cooling module PCM must be installed for every two boards plus an additional one for redundancy Install the PCMs adjacent to populated board slots to ensure the fan in the PCM cools the associated boards 11 8 1 Configuring the Card Cages 11 3 1 1 For instructions on removing the CPU Memory board and I O board refer to the documentation supplied with the Ultra Enterprise 6000 5000 4000 System Manual Note Logically there is no difference between the board slots in the front or rear of the card cage and each slot can accept any board type For this system however install CPU Memory boards in the front slots and I O and disk boards in the rear slots to facilitate proper cabling Install the first I O board in slot 1 This is the only slot connected to the onboard
197. nd secure all cables using cable ties as appropriate Node 0 Node 1 13 N o o uj gt uy B IL H IL Er 0 c Ll cS Seo DO 9 G G G G G G G G G Y G 9 Kin pU p E t 5 e PUK 1 C7 O 9 La o d ce S 9 t gt U m Y a I O o o cc Sn pz EDO PE N ce 9 e O LD LH cS e MM wv ca O Sun Y sun eC TEX EJ C dX e E Array 0 Ss Array 1 Ssh o oo o e oo o QE JH SO Qe U Oo E Mon O 09 Os E NL Y Y y Figure 9 17 SPARCstorage Array 0 and 1 Connection Example 9 20 Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll
198. nd or personnel hazard from electrical shock Powering Offand On 6 7 6 6 8 6 4 Powering On an Ultra Enterprise Cluster 4000 Cabinet 1 Begin with a safety inspection a Turn the system key switch to the Standby position See Figure 6 4 Note The front panel keys for this switch are packed in the accessory box a Ensure the AC power switch is off The AC power switch is at the rear of the cabinet See Figure 6 5 b Verify the power cord is plugged into the correct facilities outlet 2 Turn on power to any expansion cabinets Read the documentation supplied with each type of expansion cabinet for specific instructions 3 Turn on the terminal if applicable 4 Turn the AC power switch to On See Figure 6 5 5 Turn the key switch on the front panel to the On position See Figure 6 4 You should see and hear several things happen The fans in the power supplies begin turning The top front panel LED green turns on immediately denoting the power supply is delivering DC power The middle front panel LED yellow flashes while POST runs for approximately 60 seconds After 60 seconds this LED turns off if the tests pass If the LED remains lighted after 60 seconds a test has failed The bottom front panel LED green flashes to show that booting is successful and the operating system is running If this LED fails to turn on and the middle LED is on a severe hardware fault exists
199. net cable to the Ethernet port on I O board slot 3 2 Connect the other end to the Ethernet port on I O board slot 3 Connecting Node 0 to Node 1 SCI Host and Cables Using the SCI private net cables connect one Ultra Enterprise Cluster 6000 node to the other Note Node to node connection is made using the SCI host cables and cable bracket Note Use 2 5 or 10 meter SCI cable as appropriate Preparing the Cable and Bracket Note SCI cables are thick and stiff The cable bracket incorporates a track on the top and the bottom to support the top and bottom cables respectively These tracks mechanically form and support the SCI cables This allows the Ultra Enterprise Cluster Hardware Site Preparation April 1997 II bracket to hold the cable connector flush against the SCI host connector SBus card and isolate the connection from the effects of cable inflexibility twist or pull 1 At the rear of the cabinet loosely install two screws in the rack in holes 58 Install one at the left and one at the right These screws will accept the slotted holes in the cable bracket 2 Orient the bracket with the narrow portion of the slotted holes up and the cable track opening to the left See Figure 11 21 SCI cable for I O board 1 SCI cable for I O board 3 Cable bracket AAA Figure 11 21 Installing the Two SCI Cables in the Cable Bracket 3 Lay the cable for 1 O board 1 into the to
200. nfigure and install any other SBus cards as appropriate Ultra Enterprise Cluster Hardware Site Preparation April 1997 II 2 Load the I O boards with the appropriate FC OM modules For module card installation procedures refer to the documentation supplied with the card s in question or the Ultra Enterprise 6000 5000 4000 System Manual Caution Install FC OM modules in the A locations only Do not install FC OM modules in the B location If FC OM modules are installed in both locations then a failure of either module can result in loss of communication with both supported SPARCstorage arrays or other storage device 3 Install the I O boards in the card cage See Figure 11 12 through Figure 11 15 I O Boards Intended for Slots 5 Through 15 Optional Configure and install any SBus cards as appropriate and install the I O board in the card cage 11 3 1 4 Filler Panels Fill all unused slots with a filler panel See Figure 11 16 Ultra Enterprise Cluster 6000 Hardware Installation 11 21 11 11 22 11 3 1 5 11 3 1 6 Figure 11 16 Load Board Disk Board HA System Only 1 If your system is intended to boot from a disk board install it in slot 15 For disk board installation procedures refer to documentation supplied with the board or in the Ultra Enterprise 6000 5000 4000 System Manual Note PDB systems boot from bootable SPARCstorage arrays SCSI Termination PDB system Install
201. ns installed in the card cages of both nodes CPU Memory Boards Even numbered slots 0 2 4 and 6 are configured with CPU Memory boards I O Boards Odd numbered slots 1 3 5 and 7 are configured with I O boards SBus cards are installed in the appropriate SBus slots Clock Board One clock board is required in each node FRONT VIEW REAR VIEW CPU Memory boards PCMs SCI Clock board VO boards as Optical port c c a Ye onboard FC OM o o0 0 0 E aN ME y c AAA Ce X 0 9 1 S22 1 2 b o 9 e c RI 3 ET 4 o 9 lorca 5 6 ct m EA o e e 0 SSS a 7 0 1 2 SBus slots Figure 5 10 Ultra Enterprise Cluster 5000 4000PDB Card Cage Expansion Example Typical of Node 0 and 1 Ultra Enterprise Cluster Configurations 5 13 lll a FRONT VIEW REAR VIEW Private net FC S CPU Memory boards PCMs Clock board VO boards ras 1 Optical port gt c i y onboard FC OM e 29 oo eS Bs Ld 5 zw X 0 z ow Ao cz 1 T EE EA Pp pes X 2 lo e e o Ra Sr Saw 3 4 lo ud e O S
202. nst the chassis 3 Tighten the two captive screws at the panel base Ultra Enterprise Cluster Hardware Site Preparation April 1997 N lll 7 2 Ultra Enterprise Cluster 4000 The Enterprise 4000 system has a top bezel that must be removed to access the SCSI tray and the keyswitch tray 7 2 1 Top Bezel To remove the top bezel 1 Grasp the bottom corners of both sides of the top bezel and pull it toward you Apply inward pressure to release the snap locks on each side 2 Tilt the top bezel upward to a 45 angle and remove the bezel Set the bezel aside See Figure 7 7 Figure 7 7 Removing the Top Bezel Panel To replace the top bezel reverse these instructions Internal Access and Leveling 7 9 4 7 3 Ultra Enterprise Cluster 3000 7 10 7 3 1 Front Door To open the door Use the handle on the front of the Enterprise 3000 system and pull the front door open 7 3 2 Front Bezel To remove the front bezel 1 Grasp the front bezel on both sides near the center Place your thumbs on top of the front bezel and place your other fingers at the slight indentations under the front bezel for leverage 2 Pull the front bezel straight out toward you and set it aside See Figure 7 8 Ultra Enterprise Cluster Hardware Site Preparation April 1997 N lll
203. ntial SCSI Disk Tray Service Manual Ultra Enterprise X000 Systems Boards Installation Guide Ultra Enterprise CPU Installation Guide Ultra Enterprise SIMM Installation Guide Ultra Enterprise Systems Peripheral Power Supply Installation Guide Ultra Enterprise Systems PCM Installation Guide Ultra Enterprise Cluster PDB Preparation Binder Set Getting Started roadmap Ultra Enterprise Cluster Hardware Site Preparation Planning and Installation Guide this document 802 2031 825 2227 801 6127 801 5972 802 5341 802 6135 802 5331 802 5355 802 6084 802 5062 802 7341 802 5030 802 5031 802 5032 802 5033 802 6244 825 3525 802 6782 802 6783 xxxiv Ultra Enterprise Cluster Hardware Site Preparation April 1997 Table P 1 Related Documents Continued Product Family Title Part Number Ultra Enterprise HA Clusters Ultra Enterprise Cluster PDB System Binder Set Getting Started roadmap Ultra Enterprise PDB 1 2 Software Site Preparation Planning and Installation Guide Ultra Enterprise Cluster PDB System Administration Guide Ultra Enterprise Cluster PDB Volume Manager Administration Guide Ultra Enterprise Cluster Service Manual Ultra Enterprise PDB 1 2 Software CD insert Ultra Enterprise PDB 1 2 Software Release Notes Ultra Enterprise PDB Error Messages Ultra Enterprise Cluster High Availability Binder Set Getting Started Roadmap Solstice HA 1 3 User s Guide Ultra Enterprise
204. oce Lean ied 1 8 iii 14 2 C Beck Sb ec RR ERREUR YN OUR ane ee 1 9 1 5 Ultra Enterprise Cluster 6000 Factory Assembled 1 10 1 5 1 General Desctipnitias es v doxes Ere Re 1 10 152 Checklist 5 exceso seduta RI reex ask PINE 1 11 1 6 Ultra Enterprise Cluster 6000 Customer Assembled 1 12 1 6 1 General Description o eyed etx ORE Ead 1 12 1 62 ENS os ee pee borea aar d Ven Od 1 13 2 Product Description icceceves ek E UC P EEEREEERE ES 2 1 2 1 Standard Pealtl s ar 2 2 2 Ultra Enterprise 3000 Configurations 2 6 2 2 1 PDBCOonlipurations pida ias 2 6 2 2 2 HA Configuration dais evt ne eee ska 2 7 2 3 Ultra Enterprise 4000 Configurations 2 8 2 3 1 PDB Configuration veececee hr REA rp 2 11 2 3 2 HA COMUN us eben va er eae ee ee ees 2 11 2 4 Ultra Enterprise 5000 Configurations 2 12 2 4 1 PDB CODDPHPIEOTL ad ades e 9 e een cde d a 2 12 2 4 2 HA Configuration eds V D eer CER 2 13 2 5 Ultra Enterprise 6000 Configurations 2 14 2 5 1 PDB Configuration repisa 2 15 2 5 2 HA Conneuraion x 2 15 26 TEXDODSEDIE ERE K Med ER n RRS rte eee 2 16 27 Internal Opto sana creer tue poer E PEE te 2 18 2 8 SPARCstorage Array Model 100 Series Options 2 19 iv Ultra Enterprise Cluster Hardware Site Preparation April 1997 29 Bxtemal LO PONS cnt RR EE RR ERROR EX Raf gar 2 20 2 9 1 Ultra Enterprise Cluster 5000 4000 3000 2 20 2 9 2
205. oci e et que l utilisation du nom du GROUPE BULL des fins publicitaires ou de distribution soit soumise dans tous les cas une autorisation pr alable et crite Le GROUPE BULL ne donne aucune garantie relative l aptitude du logiciel r pondre une utilisation particuli re Le logiciel est fourni en l tat sans garantie explicite ou implicite CETTE PUBLICATION EST FOURNIE EN L ETAT SANS GARANTIE D AUCUNE SORTE NI EXPRESSE NI IMPLICITE Y COMPRIS ET SANS QUE CETTE LISTE NE SOIT LIMITATIVE DES GARANTIES CONCERNANT LA VALEUR MARCHANDE L APTITUDE DES PRODUITS A REPONDRE A UNE UTILISATION PARTICULIERE OU LE FAIT QU ILS NE SOIENT PAS CONTREFAISANTS DE PRODUITS DE TIERS e Qa Adobe PostScript Contents S 2a oeste tre Wee dasa ot ae es xxix Ordering Sun Documents oy dir i pda xxxvii Part 1 Site Preparation and Planning Vo CherkBSbo ssim ORAR ROG RR EA a 1 1 1 1 Ultra Enterprise Cluster 3000 Customer Assembled 1 2 1 1 1 General Description ccc cci en 1 2 1 1 2 Checklist prisons cane TIPPS 1 3 1 2 Ultra Enterprise Cluster 4000 Customer Assembled 1 4 1 2 1 General Description assi ts 1 4 Log Checklist essc oreondckdudes x3 a RUE RR RONDE Maa 1 5 1 3 Ultra Enterprise Cluster 5000 System Factory Assembled 1 6 1 3 1 General Description odds so acre E ERES a 1 6 132 Checklist dai cr errekan o ve 1 7 1 4 Ultra Enterprise Cluster 5000 Customer Assembled 1 8 1 4 1 General Description is oce
206. odel 100 series units Four fibre optic cables Terminal concentrator with short and long serial cables CD ROM and 8 mm tape drive Administration workstation with CD ROM drive not shown Product Description 213 2 2 5 Ultra Enterprise 6000 Configurations Two types of disk arrays are used by the database SPARCstorage Array Model 100 series units within the system cabinets and for expanded systems SPARCstorage Array Model 200s with SPARCstorage RSM units in expansion cabinets Figure 2 9 shows the Ultra Enterprise 6000 hardware required to support the Ultra Enterprise software Note that these figures depict a system with more than the minimum configuration Terminal concentrator hidden SPARCstorage Array Model 112 Figure 2 9 Basic Ultra Enterprise Cluster 6000 System 2 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 No lll 2 5 1 PDB Configuration The minimum configuration is listed below Two Ultra Enterprise 6000 cabinets each equipped with One CPU Memory board with 256 Mbytes RAM and 2 UltraSPARC modules Two I O boards each with one SCI card and one FC OM Three Power Cooling Modules Two SCI cables and brackets Two SPARCstorage Array Model 100 series units Terminal concentrator with short and long serial cables Four fibre optic cables CD ROM and 8 mm tape drive Administra
207. odule and configured with SCI SCI cards PDB only 2 2 4 4 cards FC S SBus card PDB 0 PDB 19 PDB 0 PDB 36 HA 0 HA 18 HA 0 HA 38 Disk boards PDB 0 PDB 0 PDR 0 PDB 0 HA 1 HA 4 HA 2 HA 8 Power cooling modules PCMs 3 4 6 8 FC OM optical modules PDB 2 PDB 7 PDB 4 PDB 14 HA 2 HA 6 HA 4 HA 12 1 128 Mbytes RAM is the minimum amount supported 1 8 Ultra Enterprise Cluster Hardware Site Preparation April 1997 A lll 1 4 2 Checklist Table 1 8 Checklist for Ultra Enterprise Cluster 5000 System Customer Assembled Per Node Quantity Per Cluster Quantity Category Item Planned On Hand Planned On Hand Systems Ultra Enterprise 5000 System nodes CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM 128 Mbytes min I O board Disk board Power cooling module PCMs Administration workstation SBus cards PDB SCI SBus card FC S SBus card Modules FC OM modules Chassis Terminal concentrator Terminal concentrator bracket Cables RS 232 serial cable long PN 530 2152 short PN 530 2151 HA private net 1 meter PN 530 2149 5 meter PN 530 2150 Differential SCSI 530 1884 PDB SCI cable 5 meter PN 530 2310 Fiber optic cable 15 meter PN 595 3379 System cabinet SPARCstorage Array units Rackmount kit PDB SCI bracket Expansion cabinet SPARCstorage Array 200 series units SPARCstorage RSM units Differential SCSI disk trays Checklist 1 9 lll A 1 5 Ultra Enterpris
208. oke the SunVTS using in one of the following ways a If you logged in on the HA server console port the serial console port connected through the terminal concentrator type sunvts b To use a window based interface to remotely execute SunVTS SunVTS 2 0 supports the OPEN LOOK and Common Desktop Environment CDE windowing environments do this From the administration workstation s windowing system type 4 sunvts h ha host name Note This allows you to monitor the HA server ha host name italics in the CDE environment Configuring the Terminal Concentrator and Installing the Software 12 13 12 c In the OpenWindows environment type sunvts 1 h ha host name d To run in the TTY interface mode type sunvts t h ha host name If the system does not have a frame buffer a TTY base SunVTS control panel will be displayed After the TTY interface is displayed direct the cursor to the start button and press Return to start SunVTS system testing Allow for one system pass of the SunVTS run For details of how to run SunVTS refer to the SunVTS 2 0 User s Guide Part Number 802 5331 12 6 2 Acceptance Test Criteria This acceptance test has completed successfully if the data listed for all hardware components match the corresponding build configurations If this is not true the system has failed acceptance test 12 7 Software Installation
209. ooo 11 28 Installing the Two SCI Cables in the Cable Bracket 11 29 Installing the SCI Bracket to Connect the Nodes 11 31 Connecting the Internal SCSI Tray nannannrenana 11 32 Disk Board Connecti0M ooccocccocccccccccccccccccc 11 33 SPARCstorage Array 0 and 1 Connection Example 11 34 SPARCstorage Array 2 and 3 Connection Example 11 35 SPARCstorage Array 4 and 5 SPARCstorage Array 200 Series Connection Example ass R dd RR RRR R R R R RR 11 36 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 100 Series Unit 11 37 SPARCstorage Array Fiber Cable Connection to SPARCstorage Array Model 200 Series Unit 11 38 Terminal Concentrator Test Button 12 2 Determining the Terminal Concentrator Version 12 6 Rackmount Kit Side Rails and Base Plate A 2 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Figure A 2 Side Rail Installation Locations and Hole Numbers in the Ultra Enterprise Cluster 5000 Node Cabinet A 3 Figure A 3 Side Rail Installation Locations and Hole Numbers in the Ultra Enterprise Cluster 6000 Node Cabinet A 4 Figure A 4 Side Rail Installation Locations and Hole Numbers in the Expansion Cabinet estee KC tret K RET R R KKR TR A 5 Figure A 5 Threading Screws into the Rack Right Side Rail A 6 Figure A 6 Securing the Right Side Rail to the Rack
210. ooooomoo 10 2 Local Off Remote Switch and Main Power Switch 10 3 Power Connector and Detachable Cable 10 4 SPARCstorage Array Voltage Rating on the Serial Number Lapel seerias siias irainei e ea 10 7 SPARCstorage Array AC Power Connector and Power Switch 10 8 Plugging SPARCstorage Arrays Terminal Concentrator into the Power Sequencer 6 6 ene eee 10 9 Installing the Terminal Concentrator Hinge 10 11 Assembling the Terminal Concentrator Bracket 10 12 Terminal Concentrator Installed on the Hinge 10 13 Terminal Concentrator Cable Locations 10 14 Plugging the Terminal Concentrator into the Power Sequencer UNOS IO elite eae ieee pee TIRE E eee tn ER a n 10 15 Ultra Enterprise Cluster 5000PDB Card Cage Minimum Population Typical of Node 0 and 1 10 17 Ultra Enterprise Cluster 5000PDB Card Cage Expansion Example Typical of Node 0 and 1 10 17 Ultra Enterprise Cluster 5000HA Card Cage Minimum Population Typical of Node 0 and 1 10 18 Ultra Enterprise Cluster 5000HA Card Cage Expansion Example Typical of Node 0 and 1 10 18 Filler Panel cocoa ii a desea Pees REPE 10 20 Installing the Terminator in the Disk Board SCSI OUT Connector e 10 21 Connecting the Administration Workstation 10 23 Node Interface to the Terminal Concentrator 10 25 Ultra Enterprise Cluster H
211. or screws will accept the slotted holes in the hinge piece c Place the slotted holes of the hinge over the locator screws and allow the hinge to drop into place d Install an additional pair of screws into holes 9 and 29 Tighten these screws as well as those in holes 8 and 30 11 10 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 Boss pins 2 each Holes 30 29 Hinge Figure 11 7 Installing the Terminal Concentrator Hinge 2 Install the terminal concentrator in the bracket and assemble the bracket a Place the side pieces of the bracket against the terminal concentrator as shown in Figure 11 8 Ultra Enterprise Cluster 6000 Hardware Installation 11 11 11 b Lower the terminal concentrator with side pieces onto the bottom plate Align the holes in the side pieces with those in the bottom plate Nuts 6 Side piece 2each i Terminal concentrator Bottom plate A Figure 11 8 Assembling the Terminal Concentrator Bracket c Install three nuts on threaded studs penetrating through each side plate Tighten the nuts This completes assembly of the bracket assembly 3 Install the terminal concentrator bracket onto the hinge in the chassis Turn the terminal concentrator bracket on its side so the hinge holes and cable connectors face right Align the bracket holes with the boss pins in the
212. ory return Enter TFTP Dump path filename dump 0 0 0 0 return monitor 9 Quit the tip program by typing monitor return monitor tilde and period 10 Use the power switch on the back of the terminal concentrator to turn the terminal concentrator off momentarily and then on again A power cycle will reboot the terminal concentrator The terminal concentrator is ready when the Load light on the front panel goes off Note For more information about commands available on the terminal concentrator see the Terminal Concentrator General Reference Guide 11 Disconnect the serial cable from the administration workstation The cable is no longer needed 12 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 12 12 2 Checkpoint to Verify Terminal Concentrator Setup Verify your installation up to this point telnet to the terminal concentrator over the network by typing 9 telnet terminal concentrator name The normal response is Trying ip address Connected to terminal concentrator Escape character is J f you do not get the preceding message ping the host system by typing ping hostname If the system does not respond reset the ip address and subnet mask settings and verify your installation again ping terminal concentrator name 12 3 Setting the Port Para
213. ower hole used in the rear is one lower than that in the front Front view Rear view Nt S I Mea 7 ve B A E E Hole 72 M i i E al Hole 72 Hole 63 eee ee js ur Hole 62 A O a Ao o a M AAA ru hi IIS Hole 57 a Array Amy jp Hole 57 Hole 48 SL In HIS Nu Hole 47 Hi I SE Ef Hole 42 Array pe ji Array n Hole 42 Hole 33 E Pepo EIN M ls Hole 32 E Aa nee j it 7 p Hole 27 4 Array J ji Array f Hole 27 Hole 18 ON a NIS jr k Hole 17 de I Eo j E jJ a Hole 12 A Array al Array a Hole 12 Hole 3 pies AA Jo Bi is Hole 2 lt HM N Figure A 4 Side Rail Installation Locations and Hole Numbers in the Expansion Cabinet Rackmount Rail Installation A 5 Em A 2 Installing the Side Rails 1 Loosely thread in two screws on the right side of the rack a At the rear of the rack thread a screw a few turns into hole 18 b Thread a screw into hole 18 at the front of the rack Do not tighten See Figure A 5 Hole 18 AH d LC e X 2000020000020202020 Hole 18 0000000000000000000 Figure A 5 Threading Screws into the Rack Right Side Rail 2 Place the right side rail in the rack Align the open slotted holes at the top of the rail with the screws installed in step 1 3 Slide the rail to the rear so the holes seat on the shafts of the scre
214. p of the bracket with the connector toward the left and facing away from you Form the cable into the curved track built into the top of the bracket 4 Install two cable clamps to secure the cable Use two plastic rivets to secure the clamps to the bracket 5 Repeat steps 2 and 3 for the bottom cable Install the cable in the track on the underside of the bracket and secure Installing the Cable and Bracket 1 Install the bracket with cables on the rack Ultra Enterprise Cluster 6000 Hardware Installation 11 29 11 a Approach the rack Align the cable connectors with the mating connectors on the I O boards Do not force the connectors onto the host connectors at this time b Adjust the cables in the tracks as required to allow the bracket surface to mate flush against the rack Adjust cables so the slotted holes in the bracket fit over the screws installed in step 1 Rest the bracket on the screws but do not tighten c Plug the cable connectors into the hosts Examine the cable connector to host spacing Adjust the cables in the tracks as required to allow the top and bottom connectors to mate with the hosts d Tighten the screws to secure the bracket to the rack Caution Tighten the screws carefully or connector damage may occur Readjust the cables in the tracks as required to prevent cable binding as the screws are tightened e Check your work Ensure that the connectors are secure and that no excessive forc
215. panel The cabinets should not share this breaker panel with unrelated equipment Each cabinet has a single power cord that supplies AC power to the internal power distribution unit Internal components terminal concentrator boot disks server chassis and SPARCstorage Arrays as appropriate are plugged into the power distribution unit in factory configured systems All rackmounted components in the cabinets can be connected to appropriate power outlets external to the cabinets to increase high availability 4 2 1 Electrical Circuits Required The following requirements apply Ultra Enterprise Cluster 5000 server cabinet one of two each cabinet housing one server and one two or three SPARCstorage Arrays Ultra Enterprise Cluster 6000 server cabinet one of two each cabinet housing one server and one or two SPARCstorage Arrays Planning for Hardware Power and Network Requirements 4 5 4 6 Expansion cabinet housing two SPARCstorage Array Model 200 Series and four RSM devices distribution unit system reliability may be adversely affected Caution Do not power other electrical equipment from the cabinet AC power Each cabinet requires a 30A circuit The cabinet is powered by the power cable as shown in Figure 4 6 For connector requirements see Table 4 1 2 D E 7 VP O Figure 4 6 Power Connector and Detachable Cable Ultra Enterprise Clust
216. plug disks Differential SCSI tray 2 0 or 2 9 Gbyte hot plug disks 2 9 External Options 2 20 The following external options can be purchased for Ultra Enterprise systems 2 9 1 Ultra Enterprise Cluster 5000 4000 3000 2 9 1 1 Cluster Foundation Packages Cluster Foundation Package Ultra Enterprise 5000 complete Ethernet and Fibre Channel cabling SBus Ethernet and Fibre Channel adapter cards One SPARCstation 4 Cluster console complete SPARCcluster support services package Cluster Foundation Package Ultra Enterprise 5000 Rack Complete Ethernet and Fibre Channel cabling SBus Ethernet and Fibre Channel adapter cards One SPARCstation 4 cluster console and one data center expansion cabinet 2 9 1 2 Mass Storage Options 20 Gbyte 4 mm auto loader with data center tray 14 Gbyte 8 mm tape internal drive Multi tape backup tray with one 14 Gbyte 8 mm tape internal drive Front load 1 2 inch tape for the expansion cabinet 20 Gbyte 4 mm auto loader internal backup tape Enterprise expansion cabinet Ultra Enterprise Cluster Hardware Site Preparation April 1997 No lll 2 9 1 3 Monitor and Graphics Accelerator Options Not for HA 17 inch mid range color monitor TurboGX frame buffer and cable 17 inch color monitor TurboGX frame buffer and cable 20 inch color monitor TurboGX frame buffer and cable 2 9 1 4 Other Options Network terminal server 2 9 2 Ultra Enterprise Cluster 6000PDB and HA 2 9 2
217. possible scheme Smaller networks fewer than 40 workstations may not benefit from this scheme Figure 4 7 shows the elements used in the installation process Vampire tap or N type connectors Ethernet cable Ethernet cable Server Transceiver pooeocgodod oo Multiplex panel or use a single port interface box Transceiver drop cable Twisted pair cable Figure 4 7 Connecting Twisted Pair Ethernet to N type Coaxial Cable Determine whether to install a terminator Refer to Table 4 5 which lists the cabling limitations for Ethernet Table 4 5 Ethernet Cabling Limitations for N type Coaxial Cable Cable Segment Length in Meters Allowed contiguous length of cable segments 23 4 70 2 117 0 and 500 0 Distance between transceivers multiples of 2 57 Minimum length of coaxial cable segments 23 4 Maximum length of transceiver drop cable 50 0 1 Finite lengths as constrained by transmission line phenomena Minimum length 23 4M maximum 500M If cable falls shorter than one of these values add cable to achieve next highest value Ultra Enterprise Cluster Hardware Site Preparation April 1997 Ha lll Transceiver 5 meters 15 meters Transceiver drop cable Twisted pair cable Server or workstation 2 Transceivers are placed at intervals of 2 5 meters or multiples of 2 5 meters along the
218. pposite the hinge The door will release and swing open AWW Figure 7 1 Opening the Hinged Door Ultra Enterprise Cluster Hardware Site Preparation April 1997 N lll 7 1 1 2 Removing and Replacing the Rear Screen Panel To remove the rear screen panel 1 Remove the two 10 Phillips screws securing the panel to the frame See Figure 7 2 2 Tilt the panel top out and lift it free of the chassis Set the panel aside There is a flange on the bottom of the rear screen Rear screen panel Sa Screws 2 Figure 7 2 Removing the Rear Screen Panel To replace the rear screen panel 1 Insert the panel so the bottom flange engages behind the top of the kick panel 2 Tilt the panel flush against the frame and secure it using the Phillips screws removed above Internal Access and Leveling ra lll N 7 1 1 3 Removing and Replacing the Kick Panel To remove the kick panel 1 Loosen the two captive screws See Figure 7 3 To replace the kick panel Arrange cables if applicable neatly behind the kick panel then fasten the two captive screws to secure the panel in place Zo Kick panel Figure 7 3 Removing the Kick Panel 7 4 Ultra Enterprise Cluster Hardware Site Preparation April 1997 N lll 7 1 4 4 Adjusting the Stabilizer Bar and Leveling Pads N Warning Alw
219. r AC connector M HA lo E H tE ET MM A ia gs ee S D E E L if t GOLEO Seo 9 gt Uq L IC 9 e 9 E E E 9 E xs Figure 9 2 AC Power Switch and AC Connector 4 Connect the male end of the power cord into a grounded wall outlet The outlet must be a 100 240 VAC 15A circuit O22 Ultra Enterprise Cluster Hardware Site Preparation April 1997 LO lll This connection provides a ground path that prevents damage from Caution Do not disconnect the power cord when working on the system electrostatic discharge 9 2 Installing the SPARCstorage Array Systems Two or more SPARCstorage Arrays are installed in the cluster These devices provide storage for the high availability data NFS file systems and DBMS databases 9 2 1 Preparing the SPARCstorage Arrays 1 Locate the DIAG switch on the array rear panel See Figure 9 3 2 Ensure that the DIAG switch is set to DIAG and not to DIAG EXT Do not use the DIAG EXT position as it will invoke extended diagnostics and prevent the SPARCstorage Array from booting Use DIAG only for normal operation amp Sun C I E e 47 63Hz MODEL NO 1010 Serial number label H
220. rnet or slot 1 FDDI I O slot 3 Onboard hme Node 1 onboard hme RJ 45 TPE on I O board 2 private net Onboard hme Node 0 onboard hme RJ 45 TPE on I O board private net PDB SCI SBus port Node 1 SCI SBus port SCI cable SCI SBus card Node 0 SCI SBus port SCI cable Clock Board Serial A Terminal concentrator Serial All port 2 Serial A Terminal concentrator Serial port 3 Other Administration Terminal concentrator Serial workstation Serial A port 1 Administration Primary Ethernet AUI or RJ 45 workstation Ethernet port network 1 Category 5 twisted pair private net cable part number 530 2149 1 meter or 530 2150 5 meter 11 24 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 11 8 2 1 Connecting the Administration Workstation Client net Ethernet n Warning Do not plug a keyboard directly into a host I O board If a keyboard is plugged into an I O board it then becomes the default for console input thus preventing input from the system administration workstation terminal concentrator serial port In addition plugging a keyboard directly into a host I O board while power is applied to the host sends a break signal to the Solaris operating system just as if you had typed a Stop L1 A on the keyboard 1 Plug one end of cable PN 530 2152 into the terminal concentrator Port 1 See Figure 11 18 2 Plug the other end into the administration workstation RS 232 connector Administration work
221. rprise Cluster 5000 Hardware Installation 10 33 10 10 34 45 JD J Node 0 Node 1 a gt o e 6 l 9 ea B E el al p E E on ge E ena rc ter Ee Va i Eo Ne ES Li SS fa NU le e TPE 9 N o LD eo k Ga Ey Pr Se c3 u S e o p 8 zz RE of ra eil MES DL 171 Es S lll x Go bo 8 0 I J ee Aeee o cs pon M fet eS NR YET Al Jz AL al La O o 5o o o oa ol 5 E IO Beene E ona Qe es a er m mmc E 0 ca Array 4 Array 5 no o va ol T e ala Aloe e lo Mala O gos Sy E Wi K Figure 10 27 SPARCstorage Array 4 and 5 Connection Example Ultra Enterprise Cluster Hardware Site Preparation April 1997 10
222. rray with base plate attached on side rails in the cabinet Reconfiguring the fan assemblies to provide correct cooling Base plate e Left rail NS Figure A 1 Rackmount Kit Side Rails and Base Plate A 1 1 Array Installation Positions Note Cabinet cooling is an important factor Install only SPARCstorage Array 100 series chassis in the Ultra Enterprise Cluster system cabinets Use only the hole numbers specified for installing side rails These hole numbers determine array spacing for proper ventilation A 1 2 Ultra Enterprise Cluster 5000 Node Cabinets SPARCstorage Array chassis are installed in the lower three positions A typical installation is shown in Figure A 2 Side rails are installed using screw hole positions identified in Figure A 2 SPARCstorage Arrays are installed in the top position and optionally the two array positions below this Figure A 3 A 2 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Hole 42 Hole 31 Hole 27 Hole 16 Hole 12 Hole 1 Front view S S ss O b 1 o S c Ijio a vilo 9 9 d K ea gt gt 20 o0 ki D slo o 9 I e e e gt N o e o E le e 9 4 S b Lj b D A E al a ee LJ s b b B 3 E oft ot E B S b B S a E OW oh eee RUN CN DE B i
223. rray 100 Installation and Service Set SPARCstorage Array Model 100 Series Installation Manual SPARCstorage Array Model 100 Series Service Manual SPARCstorage Array Regulatory Compliance Manual SPARCstorage Array User s Guide Doc Set SPARCstorage Array Configuration Guide SPARCstorage Array User s Guide SPARCstorage Array Product Note Disk Drive Installation Manual for the SPARCstorage Array Model 100 Series SPARCstorage Array Model 200 Series Installation Manual SPARCstorage Array Model 200 Series Service Manual SPARCstorage Array Battery and PROM Installation Note Manual 825 3388 802 6050 802 6051 801 3846 825 3388 801 3844 801 3845 801 3846 825 2513 801 2205 801 2206 801 7103 825 2514 802 2041 802 2042 802 2043 801 2207 802 2027 802 2028 802 2029 Preface xxxiii Table P 1 Related Documents Continued Product Family Title Part Number Terminal Concentrator Software Diagnostics Options Ultra Enterprise PDB Clusters SPARCstorage Array Model 200 Series Regulatory Compliance Manual Terminal Concentrator Binder Set Terminal Concentrator Installation Notes Terminal Concentrator General Reference Guide SMCC SPARC Hardware Platform Guide Solstice System Manager Install Manual SunVTS Version 2 0 User s Guide Solstice SyMON User s Guide Ultra Enterprise Expansion Cabinet Installation and Service Manual Sparcstorage RSM Installation Operations and Service Manual Differe
224. rubber host always resides in the primary cabinet node 0 1 Assign two SCI cards as scrubbers These will be installed in node 0 I O boards 1 and 3 2 In these two cards install the jumper to dedicate these cards as scrubbers Install the jumpers in the On position as shown in Figure B 1 B 1 B 2 Scrubber jumper Designates card as scrubber Designates card as non scrubber B Component side view Figure B 1 Scrubber Jumper Positions 3 Examine the two cards that are not assigned as scrubbers Ensure the numbers are in the Off position as shown in Figure B 1 These will be installed in node 1 I O boards 1 and 3 4 Node 0 Install the SCI SBus cards in the I O boards a Install one scrubber SCI card into the I O board to be installed in slot 1 Install it in SBus slot 0 See Figure B 2 b Install the other scrubber SCI card into the I O board to be installed in slot 3 Install it in SBus slot 0 Note For SBus card installation procedures refer to the documentation supplied with the I O boards or to the Ultra Enterprise 6000 5000 4000 System Manual Ultra Enterprise Cluster Hardware Site Preparation April 1997 oj lll SCI SBus card ee ooo J Ot ellel elle Ce Figure B 2 SCI SBus Card Installed in the I O Board 5 Node 1
225. rver 1000E to Ultra Enterprise 3000 Node to Node Connection 0000 c eee eee eee C 4 SPARCserver 1000E to Ultra Enterprise 5000 4000 Node to Node Connection 0 0 0000 e eee eee eee C 4 SPARCcenter 2000E to Ultra Enterprise 5000 4000 Node to Node Connection esee eeees C 5 SPARCcenter 2000E to Ultra Enterprise 6000 Node to Node Connection 0000 cece cece ences C 5 Ultra Enterprise 3000 to Ultra Enterprise 5000 4000 Node to Node Connection 0 0 c cece C 6 Ultra Enterprise 3000 to Ultra Enterprise 6000 Node to Node Connection 66 c cece eens C 7 Ultra Enterprise 5000 4000 to Ultra Enterprise 6000 Node to Node Connection 66 cc cece eee C 7 Ultra Enterprise 3000 to Ultra Enterprise 5000 4000 Node to Node Connection for HA 6 6 6 0 cece eee eee C 8 Ultra Enterprise 3000 to Ultra Enterprise 6000 Node to Node Connection C 9 Ultra Enterprise 5000 4000 to Ultra Enterprise 6000 Node to Node Connection for HA C 9 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Tables Table 1 1 Table 1 2 Table 1 3 Table 1 4 Table 1 5 Table 1 6 Table 1 7 Table 1 8 Table 1 9 Table 1 10 Requirements for Ultra Enterprise Cluster 3000 System Customer Assembled sse Checklist for Ultra Enterprise Cluster 3000 System Customer Assembled 0 00 00 cece cee ee eee eee Requirements for Ultra Enterprise Cluster 4000 Sys
226. ry boards in the front slots and I O and disk boards in the rear slots to facilitate proper cabling Install the first I O board in slot 1 This is the only slot connected to the onboard SCSI devices Note To adhere to cooling and power requirements one power cooling module PCM must be installed for every two boards plus an additional one for redundancy Install the PCMs adjacent to populated board slots to ensure the fan in the PCM cools the associated boards Note Install a filler panel in all empty slots to ensure proper cooling and to provide proper bus termination CPU Memory Boards 1 Install the CPU Memory boards into the card cage as viewed from the front Install them from lowest 0 through the highest 6 as appropriate For CPU Memory board installation procedures refer to the documentation supplied with the CPU Memory boards or the Ultra Enterprise 6000 5000 4000 System Manual See Figure 10 7 and Figure 10 8 or Figure 10 9 and Figure 10 10 for PDB and HA respectively 2 Fill all unused slots in the front of the system with a filler panel Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 Front view CPU Memory board PCMs E oo Cc 200 00 0 5 ao A 2 Tj E 9 9 4 B a EE 9 9 6 RE Em JA e a 9
227. s CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM 128 Mbytes min I O board Power cooling module PCMs Administration workstation SBus cards PDB SCI SBus card FC S SBus card Modules FC OM modules Chassis Terminal concentrator Cables RS 232 serial cable long PN 530 2152 short PN 530 2151 HA private net 1 meter PN 530 2149 5 meter PN 530 2150 Differential SCSI 530 1884 PDB SCI cable 5 meter PN 530 2310 Fiber optic cable 15 meter PN 595 3379 Administration workstation with monitor Expansion cabinet SPARCstorage Array 200 series units SPARCstorage RSM units Differential SCSI disk trays Checklist 1 3 lll A 1 2 Ultra Enterprise Cluster 4000 Customer Assembled 1 2 1 General Description Table 1 3 Requirements for Ultra Enterprise Cluster 4000 System Customer Assembled Per Node Per Cluster System Device Min Max Min Max Comment Terminal concentrator 1 1 Installed in customer defined location SPARCstorage Array PDB 2 PDB 24 Each equipped with 2 HA 2 HA 26 FC OM host adapters Cable set 1 1 Client net HA other Administration workstation 1 1 Ultra Enterprise 4000 System 1 1 2 2 Chassis not mounted in a rack CPU Memory boards each with 1 1 2 2 2 UltraSPARC modules and 256 Mbytes RAM I O boards each equipped with 1 2 PDB 7 4 PDB 14 PDB I O boards in fiber interface FC OM module HA 6 HA 12 slots 1 and 3 are and confi
228. s display on the terminal screen If the network connection is not found press the q key to stop the message When terminal concentrator boot completes successfully the front panel LEDs light as shown Table 12 1 Front Panel LEDs Indicating a Successful Boot Power Green Unit Green Net Green Attn Amber Load Green Active Green ON ON ON OFF OFF Intermittent blinking If boot fails the LEDs on the front panel may light in one of these modes Table 12 2 Front Panel LEDs Indicating a Failed Boot Power Unit Net Attn Load Active Mode Green Green Green Amber Green Green Hardware failure ON Blinking OFF Blinking OFF OFF Network test failure ON ON Blinking OFF OFF Intermittent blinking Network test aborted ON ON OFF Blinking OFF Intermittent blinking or net command failed Booted wrong image ON ON ON Blinking OFF OFF Other failure One or more Status LEDs 1 8 are ON Ultra Enterprise Cluster Hardware Site Preparation April 1997 E If the LEDs denote another mode of failure refer to the Ultra Enterprise Cluster System Service Manual 6 Check the connector to the public net to verify that it is connected correctly 7 Upon successful power on the monitor prompt appears Use the addr command to assign an IP address subnet mask and network address to the terminal concentrator In the example t
229. s units Administration workstation Ultra Enterprise 4000 System Figure 2 7 Basic Ultra Enterprise Cluster 4000 System 2 10 Ultra Enterprise Cluster Hardware Site Preparation April 1997 No lll 2 3 1 PDB Configuration The minimum configuration is listed below Two nodes based on the 4000 each containing One CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM Two I O boards each with one SCI card and one FC OM Two SCI cables Two SPARCstorage Array Model 100 series units Four fibre optic cables Terminal concentrator with short and long serial cables CD ROM and optionally 8 mm tape drive Administration workstation with CD ROM drive not shown 2 3 2 HA Configuration The minimum configuration is listed below Two nodes based on the 4000 each containing One CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM Two I O boards each with one FC OM Two SPARCstorage Array Model 100 series units Four fibre optic cables Terminal concentrator with short and long serial cables CD ROM and optionally 8 mm tape drive Administration workstation with CD ROM drive not shown Product Description 2 11 2 2 4 Ultra Enterprise 5000 Configurations There are several types of disk arrays used by the shared database The main system cabinets uses SPAR
230. se 6000 System nodes CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM 128 Mbytes min I O board Disk board Power cooling module PCMs Administration workstation SBus cards PDB SCI SBus card FC S SBus card Modules FC OM modules Chassis Terminal concentrator Terminal concentrator bracket Cables RS 232 serial cable System cabinet Expansion cabinet long PN 530 2152 short PN 530 2151 HA private net 1 meter PN 530 2149 5 meter PN 530 2150 Differential SCSI 530 1884 PDB SCI cable 5 meter PN 530 2310 Fiber optic cable 15 meter PN 595 3379 SPARCstorage Array units Rackmount kit PDB SCI bracket SPARCstorage Array 200 series units SPARCstorage RSM units Differential SCSI disk trays Checklist 1 11 lll A 1 6 Ultra Enterprise Cluster 6000 Customer Assembled 1 6 1 General Description Table 1 11 Requirements for Ultra Enterprise Cluster 6000 System Customer Assembled Per Node Per Cluster System Device Min Max Min Max Comment Terminal concentrator 1 1 Installed in customer defined location SPARCstorage Array PDB 2 PDB 58 Each equipped with 2 HA 2 HA 56 FC OM host adapters Rackmount kit 1 2 PDB 2 PDB 58 Mounts one SSA 100 HA 2 HA 56 Series chassis Cable set 1 1 Client net HA other Administration workstation 1 1 Ultra Enterprise 6000 System 1 1 2 2 CPU Memory boards each with 1 1 2 2 2 UltraSPARC modules 256 Mbytes RAM I O boards each eq
231. stallation 1 Configure and install any other SBus cards as appropriate 2 Load the I O boards with the appropriate FC OM modules For module card installation procedures refer to the documentation supplied with the card s in question or the Ultra Enterprise 6000 5000 4000 System Manual Caution Install FC OM modules in the A locations only Do not install FC OM modules in the B location If FC OM modules are installed in both locations then a failure of either module can result in loss of communication with both supported SPARCstorage arrays or other storage device 3 Install the I O boards in the card cage See Figure 10 7 through Figure 10 10 I O Boards Intended for Slot 5 and 7 Optional Configure and install any SBus cards as appropriate and install the I O board in the card cage Filler Panels Fill all unused slots with a filler panel See Figure 10 16 Ultra Enterprise Cluster 5000 Hardware Installation 10 19 10 Springfingers Figure 10 16 Filler Panel 10 3 1 5 Disk Board HA System Only 1 If your system is intended to boot from a disk board install it in slot 7 For disk board installation procedures refer to the documentation supplied with the board or in the Ultra Enterprise 6000 5000 4000 System Manual Note PDB systems boot from bootable SPARCstorage arrays 2 Install the terminator on the SCSI II OUT port of the disk board in slot 7 See Figure 10 17 10 20 Ultra En
232. stallation 10 7 10 4 Check the electrical ratings label on the serial number label Verify that the stated rating matches your AC input voltage Table 10 1 provides maximum system operating voltage and frequency ranges and lists current requirements at nominal line voltage for a cabinet in maximum configuration Table 10 1 SPARCstorage Array 100 Series Nominal Power and Maximum Current Parameters Maximum Nominal AC Input Operating Operating Current Power Supply Configuration Voltage Range Single Phase Range Frequency Range Requirement Output North American 100 120 VAC 90 264 VAC 47 63 Hz 6 5A 460W International 220 240 VAC 90 264 VAC 47 63 Hz 6 5A 460W Connecting the Power 1 Connect the SPARCstorage Array power cords a Connect a power cord at the rear of each chassis See Figure 10 5 AC receptacle On Off switch l Y Sun 9 US 2d S a T 77A 47 63Hz MODEL NO 1010 PN 595 3373 01 2 wmm um O o9 Co A B Figure 10 5 SPARCstorage Array AC Power Connector and Power Switch b Route the power cords to the power sequencer Dress the power cords down the right side of the rack Roll any excess cord and tuck it into the space under the power sequencer at the bottom of the cabinet Secure it in place using cable ties 10 8 Ultra
233. station Terminal concentrator E jl RS 232 to RJ 45 z y Client net Ethernet O O 000 O O O O GJ Figure 11 18 Connecting the Administration Workstation 3 Plug the client network Ethernet cable into the administration workstation Ethernet socket Ultra Enterprise Cluster 6000 Hardware Installation 1125 11 11 26 11 8 2 2 Connecting the Terminal Concentrator Using the 530 2152 5 Meter or 530 2151 1 Meter cable proceed as follows 1 Connect Node 0 a Plug the DB25 end of the cable into the Serial A port on the clock board in node 0 See Figure 11 18 b Plug the RJ 45 end of this cable into the terminal concentrator port 2 Connect Node 1 a Plug one end of the RJ 45 cable into the Serial A port on the clock board in node 1 See Figure 11 19 b Plug the RJ 45 end of this cable into the terminal concentrator port 3 Connect the public net Ethernet Plug the public net Ethernet cable into the RJ 45 or DB25 connector as appropriate on the terminal concentrator Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 m A Terminal concentrator N I aad
234. stem Board From Node 0 From Node 1 To Interface Type Other Administration Terminal concentrator Serial workstation Serial A port 1 Administration Primary Ethernet AUI or RJ 45 workstation Ethernet port network 1 Category 5 twisted pair private net cable part number 530 2149 1 meter or 530 2150 5 meter 9 7 1 Cabling the Administration Workstation Warning Do not plug a keyboard directly into a host I O board If a keyboard is plugged into a I O board it then becomes the default for console input thus preventing input from the system administration workstation terminal concentrator serial port In addition plugging a keyboard directly into a host I O board while power is applied to the host sends a break signal to the Solaris operating system just as if you had typed a Stop L1 A on the keyboard 1 Plug one end of cable PN 530 2152 into the terminal concentrator Port 1 See Figure 9 11 2 Plug the other end into the administration workstation RS 232 connector RS 232 to RJ 45 Client net Ethernet d y r a 5 rj a a a a O A el Sy Administration workstation Terminal concentrator Figure 9 11 Connecting the Administration Workstation 3 Plug the client network Ethernet cable into the administration workstation Ethernet socket Ultra Enterprise Clu
235. ster 4000 Hardware Installation 9 13 lll LO 9 7 2 Connecting the Terminal Concentrator Using the 530 2152 5 Meter or 530 2151 1 Meter cable proceed as follows 1 Connect Node 0 a Plug the DB25 end of the cable into the Serial A port on the clock board in node 0 See Figure 9 12 b Plug the RJ 45 end of this cable into the terminal concentrator port 2 2 Connect Node 1 a Plug the DB25 end of the cable into the Serial A port on the clock board in node 1 b Plug the RJ 45 end of this cable into the terminal concentrator port 3 3 Connect the public net Ethernet Plug the public net Ethernet cable into the RJ 45 or DB25 connector as appropriate on the terminal concentrator 9 14 Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll Administration workstation E T P i Terminal concentrator Public net Ethernet y E 9 LXI sur y o H Er T i Z U L r amp S R U q y o o i G U y D o Le y SIK i U eo eo 55 ES
236. t do not attempt to perform these procedures Ultra Enterprise Cluster Hardware Site Preparation April 1997 Ordering Sun Documents SunDocs is a distribution program for Sun Microsystems technical documentation Easy convenient ordering and quick delivery is available from SunExpress You can find a full listing of available documentation on the World Wide Web http www sun com sunexpress To order or for more information Telephone 1 800 873 7869 North America only Fax 1 800 944 0661 North America only Sun Welcomes Your Comments Please use the Reader Comment Card that accompanies this document We are interested in improving our documentation and welcome your comments and suggestions If a card is not available you can email or fax your comments to us Please include the part number of your document in the subject line of your email or fax message e Email smcc docs sun com e Fax SMCC Document Feedback 1 415 786 6443 Preface xxxvii xxxviii Ultra Enterprise Cluster Hardware Site Preparation April 1997 Checklist This chapter gives specific information and checklists to use when you inventory each type of Ultra Enterprise Cluster system Ultra Enterprise Cluster 3000 Customer Assembled page 1 2 Ultra Enterprise Cluster 4000 Customer Assembled page 1 4 Ultra Enterprise Cluster 5000 System Factory Assembled page 1 6 Ultra Enterprise Cluster 5000 Customer Ass
237. t specific written prior permission GROUPE BULL makes no representations about the suitability of this software for any purpose It is provided as is without express or implied warranty THIS PUBLICATION IS PROVIDED AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT Copyright 1995 1996 1997 Sun Microsystems Inc 2550 Garcia Avenue Mountain View Californie 94043 1100 U S A Tous droits r serv s Ce produit ou document est prot g par un copyright et distribu avec des licences qui en restreignent l utilisation la copie et la d compilation Aucune partie de ce produit ou de sa documentation associ e ne peut tre reproduite sous aucune forme par quelque moyen que ce soit sans l autorisation pr alable et crite deSun et de ses bailleurs de licence s il y en a Des parties de ce produit pourront tre deriv es du syst me UNIX et du syst me Berkeley 4 3 BSD licenci par l Universit de Californie UNIX est une marque enregistr e aux Etats Unis et dans d autres pays et licenci e exclusivement par X Open Company Ltd Le logiciel d tenu par des tiers et qui comprend la technologie relative aux polices de caract res est prot g par un copyright et licenci par des fournisseurs de Sun Sun Sun Microsystems le logo Sun SunDocs Ultra Enterprise PDB Solaris AnswerBook RSM Sun
238. tasks in the order listed Preparing the Cabinet page 10 2 Connecting the Power Cords page 10 3 Configuring the Card Cages page 10 16 Cabling System Components page 10 21 The basic Ultra Enterprise Cluster 5000 configuration is completely pre assembled in a single cabinet Note If you are installing a customer assembled system see Section 10 2 Customer Assembled Ultra Enterprise Cluster 5000 Hardware Installation 10 10 1 1 Preparing the Cabinet 1 Unpack and inventory the equipment if you have not already done so See Chapter 1 Checklist for a list of equipment 2 Move the cabinets to their designated installation locations For site planning guidelines See Chapter 5 Ultra Enterprise Cluster Configurations 3 Turn the front panel key switch to the Standby position see Figure 10 1 o o9 00 oao0n0000 G000000 oo000TOD O0RDOHDOGCO Figure 10 1 Key Switch in the Standby Position 10 2 Ultra Enterprise Cluster Hardware Site Preparation April 1997 10 4 Set the LOCAL OFF REMOTE switch to REMOTE see Figure 10 2 d4bboddboodbboddbobboodboodbboddb5oodbooddboodboodbposcdbood l RCR gc o El o Pp SD o EEE gt o ooo i NE Etc h 5 0 SODA
239. tch at the rear of the component in question Failure to turn off externally powered components poses a risk of equipment damage and or personnel hazard from electrical shock 6 2 Powering On an Ultra Enterprise Cluster 6000 or 5000 Cabinet 6 4 1 Begin with a safety inspection a Turn the system key switch to the Standby position See Figure 6 1 Note The front panel keys for this switch are packed in the accessory box Note The standby position 6 does not turn off any AC powered drive trays in the lower part of the system cabinet The key switch controls only the DC power supply and DC powered devices in the main cabinet a Ensure the AC power switch on the cabinet rear is off The AC distribution unit is at the rear of the cabinet See Figure 6 2 b Verify the power cord is plugged into the correct facilities outlet 2 Turn on power to any expansion cabinets Read the documentation supplied with the expansion cabinet for specific instructions 3 Turn on power to the terminal if applicable 4 Ensure the LOCAL OFF REMOTE switch is in the REMOTE position Figure 6 2 Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll 5 Turn the AC distribution unit power switch to ON Listen for the sound of AC powered devices such as SPARCstorage Arrays and fans to start up 6 Turn the key switch to the power on position The system will run firmware diagnostics for about
240. ted at this time Your system may have more network cables than are listed in this table 8 7 6 Internal SCSI Devices 1 I O board in slot 1 install a terminator on the SCSI connector of the I O board panel See Figure 8 15 for connector location Fiber 0 Fiber 1 Figure 8 15 SCSI Terminator Installation on the I O Board 8 20 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Co lll 8 7 7 Connecting the SPARCstorage Arrays 8 7 7 1 8 7 7 2 8 7 7 3 Installing the Second FC OM Optical Module in all SPARCstorage Arrays Install the second module in the array using instructions provided with the module The arrays are delivered with one FC OM optical module installed Labeling Fiber Optic Cables Label the fiber optic cables prior to installation Labeling ensures accurate installation and eases system reconfiguration and expansion later Put labels on both ends of each cable with the node and SPARCstorage Array information imprinted on it Use Figure 8 16 through Figure 8 18 as guides Installing the Fiber Optic Cables 1 Plug one end of the fiber cable into the FC OM in the I O board See Figure 8 19 for cable type and connection details 2 Plug the other end of the fiber cable into the FC OM connector on the SPARCstorage Array rear panel Plug node 0 into connector A and node 1 into connector B Repeat to connect both nodes to both SPARCstorage Arrays Refer to Table 8 3 on page 8 26
241. tem Customer Assembled 6 0 66 naaraan Checklist for Ultra Enterprise Cluster 4000 System Customer Assembled esses eee Requirements for Ultra Enterprise Cluster 5000 System Factory Assembled 0000 ccc aee Checklist for Ultra Enterprise Cluster 5000 System Factory Assembled ooooooococcococcoronorrrac Requirements for Ultra Enterprise Cluster 5000 System Customer Assembled 0000s Checklist for Ultra Enterprise Cluster 5000 System Customer Assembled 0 00000 cece eee cece eee Requirements for Ultra Enterprise Cluster 6000 System Factory Assembled scis cas aR R TR R ERRER eee Checklist for Ultra Enterprise Cluster 6000 System Factory Assembled e eee eens 1 2 1 3 1 4 1 5 1 7 1 8 xxvi Table 1 11 Table 1 12 Table 3 1 Table 3 2 Table 3 3 Table 3 4 Table 3 5 Table 3 6 Table 3 7 Table 3 8 Table 3 9 Table 3 10 Table 3 11 Table 3 12 Table 3 13 Table 3 14 Table 3 15 Table 3 16 Table 3 17 Table 3 18 Table 3 19 Table 3 20 Requirements for Ultra Enterprise Cluster 6000 System Customer Assembled rrenaren Checklist for Ultra Enterprise Cluster 6000 System Customer Assembled 0 00 0c cece eee eee ee System Physical Specifications sussa nnen Clearance and Service Access 00000 c cece eee Shipping Specifications x x x e e K K K K eee eee Standalone Server Physical Specifications
242. terprise Cluster Hardware Site Preparation April 1997 10 Figure 10 17 Installing the Terminator in the Disk Board SCSI OUT Connector 10 3 1 6 Clock Board 1 The clock board is installed in the clock board slot above the I O boards For clock board installation procedures refer to documentation supplied with the card s in question or the Ultra Enterprise 6000 5000 4000 System Manual 10 3 1 7 Node 1 Card Cage 1 Repeat Section 10 3 1 above for node 1 10 3 2 Cabling System Components Network cabling is presented in Table 10 2 Procedures for connecting each cable follow the table Ultra Enterprise Cluster 5000 Hardware Installation 10 21 DL x 10 Note For fiber optic cable connections see Table 10 3 Table 10 2 Cable Connections Except Fiber Optic System Board From Node 0 From Node 1 To Interface Type I O slot 1 Onboard hme Node 1 onboard hme RJ 45 TPE HA on I O board 1 private net Onboard hme Node 0 onboard hme RJ 45 TPE on I O board 1 private net Onboard SCSI Wide SCSI terminator Wide SCSI Onboard SCSI Wide SCSI terminator Wide SCSI Public net SBus card in Public net Ethernet or slot 1 FDDI Public net SBus Public net Ethernet or card in slot 1 FDDI Install terminator on SCSI Install terminator Wide SCSI port on SCSI port Public net SBus card in Public net Ethernet or slot 1 FDDI I O slot 3 Onboard hme Node 1 onboard hme RJ 45 TPE on I O board 2 private net Onboard hme Node 0 onboar
243. terprise Cluster Hardware Site Preparation April 1997 O lll 9 5 2 2 PDB and HA Installation 1 Configure and install any other SBus cards as appropriate 2 Load the I O boards with the appropriate OLC modules For module card installation procedures refer to the documentation supplied with the card s in question or the Ultra Enterprise 6000 5000 4000 System Manual Caution Install FC OM modules in the A locations only Do not install FC OM modules in the B location If FC OM modules are installed in both locations then a failure of either module can result in loss of communication with both supported SPARCstorage arrays or other storage device 3 Install the I O boards in the card cage See Figure 9 5 through Figure 9 8 I O Boards Intended for Slot 5 and 7 Optional Configure and install any SBus cards as appropriate and install the I O board in the card cage 9 5 3 I O Boards Intended for Slot 1 and Optionally 5 and 7 1 Load the I O board with the appropriate SBus cards For SBus card installation procedures refer to documentation supplied with the card s in question or the Ultra Enterprise 6000 5000 4000 System Manual 2 Load the I O board with the appropriate OLC modules For module card installation procedures refer to documentation supplied with the card s in question or the Ultra Enterprise 6000 5000 4000 System Manual Caution Install FC OM modules in the A locations only Do rot inst
244. the Array in the Cabinet A 15 A 6 Installing the SPARCstorage Array 200 Series Chassis in the Expansion Cabinet aise us cct RAI Re eae A 18 xii Ultra Enterprise Cluster Hardware Site Preparation April 1997 A 7 Installing the SPARCstorage RSM Chassis A 20 A 8 Installing the Differential SCSI Tray Chassis A 20 B Configuring the SCI SBus Card o oooocmoommomoo o B 1 B 1 SCI Rings and Scrubber Settings 244 4 esee teres B 1 B 2 SCI Nodeid Values skr RR rrr RR ea B 5 B 3 SCI Driver Installation and Configuration for Ultra Enterprise Cluster Systems oooooooo o B 5 B 4 Configuring the SCI SBus cards Using the scicon Script B 6 B 5 SUNWSsci SCI Driver Installation and Configuration Procedure for Non PDB Systems 0ooo ooooocmooo B 7 B 6 What S Nexos cae Eu REGE certes apa le s eb a os B 8 C Mixed Compute Platforms sss x x x x x x e e e e C 1 C 1 Platform and Processor Equivalency C 1 Coll AA Ed LUE a are cte C2 CA HA AA E RES REPRE E EN ER duds C2 C 2 Node to Node Cabling Instructions C 3 Gor PDB Cl St rS o reo pete sel a pr d Rr E WP C 3 A o M C 8 Contents xiii xiv Ultra Enterprise Cluster Hardware Site Preparation April 1997 Figures Figure 2 1 Figure 2 2 Figure 2 3 Figure 2 4 Figure 2 5 Figure 2 6 Figure 2 7 Figure 2 8 Figure 2 9 Figure 2 10 Figure 2 11 Figure
245. the fiber cable into the FC OM connector or the SPARCstorage Array rear panel Plug node 0 into connector A and node 1 into connector B Repeat Step 2 to connect both nodes to all SPARCstorage Arrays See Table 11 3 for a list of all fiber optic cable connections See Figure 11 29 for all point to point connections in an example expansion configuration 3 Repeat steps 1 and 2 for all FC OM cables to be connected 4 Dress and secure all cables using cable ties as required 11 38 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 Table 11 3 Node to SPARCstorage Array Cable Connection Example I O Board From Node 0 FC OM From Node 1 FC OM To SPARCstorage Array 1 Onboard 0 port A Onboard 0 port B 3 Onboard 1 port A Onboard 1 port B 5 Onboard 2 port A Onboard 2 port B 1 SBus slot 1 3 port A SBus slot 1 3 port B 3 SBus slot 1 4 port A SBus slot 1 4 port B 5 SBus slot 1 5 port A SBus slot 1 5 port B 1 SBus slot 2 6 port A SBus slot 2 6 port B 3 SBus slot 2 7 port A SBus slot 2 7 port B 11 4 Closing the Cabinet Replace all panels on the cabinet See Chapter 7 Internal Access and Leveling for procedures Proceed to Chapter 11 for terminal concentrator configuration procedures and software installation and setup procedures Ultra Enterprise Cluster 6000 Hardware Installation 11 39 11 11 40 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Configuring the Terminal Con
246. the remaining node Ultra Enterprise Cluster 6000 Hardware Installation 11 31 11 Remaining Cables Table 11 2 summarizes the cables that can be connected at this time Your system may have more network cables than are listed in this table Connect all remaining cable 11 3 3 4 Internal SCSI Tray If a disk board is installed skip this procedure and proceed to Section 11 3 4 1 I O board in slot 1 install a terminator on the SCSI connector of the I O board panel See Figure 11 23 for connector location e Fiber 0 Fiber 1 p Terminator Figure 11 23 Connecting the Internal SCSI Tray 11 3 4 Disk Board HA Only 1 I O board in slot 1 connect one end of the SCSI cable to the onboard SCSI port See Figure 11 24 for connector locations 2 Connect the other end to the SCSI IN port on the disk board 11 32 Ultra Enterprise Cluster Hardware Site Preparation April 1997 11 Disk board a Terminator 11 3 4 1 3 Install a terminator on the SCSI OUT port on the disk board Node 0 Node 1 r la o E S alL CS 4 O E Alb 9 a ev no E 9 o o e NH o M 2 Disk board O e O LA Terminat r HB 2 ee Figure 11 24 Disk Board Connection Connecting the SPARCstorage Arrays Installing the FCIOM Optical Module in all SPA
247. the terminator on the SCSI II port of the I O board in slot 1 Ultra Enterprise Cluster Hardware Site Preparation April 1997 IST HA system Install the terminator on the top OUT SCSI II port of the disk board in slot 7 See Figure 11 17 Figure 11 17 Installing the Terminator on the Disk Board 11 3 1 7 Clock Board 1 The clock board must be installed in the clock board slot above the I O boards For clock board installation procedures refer to documentation supplied with the card s in question or the Ultra Enterprise 6000 5000 4000 System Manual 11 3 1 8 Node 1 Card Cage 1 Repeat Section 11 3 1 above but for node 1 Ultra Enterprise Cluster 6000 Hardware Installation 11 23 D ond 11 11 3 2 Cabling System Components Ethernet and SCSI II cabling is presented in Table 11 2 Procedures for connecting each cable follow the table Table 11 2 Cable Connections Except Fiber Optic System Board From Node 0 From Node 1 To Interface Type I O slot 1 Onboard hme Node 1 onboard hme RJ 45 TPE HA on I O board 1 private net Onboard hme Node 0 onboard hme RJ 45 TPE on I O board 1 private net Onboard SCSI Wide SCSI terminator Wide SCSI Onboard SCSI Wide SCSI terminator Wide SCSI Public net SBus card in Public net Ethernet or slot 1 FDDI Public net SBus Public net Ethernet or card in slot 1 FDDI Install terminator on SCSI Install terminator Wide SCSI port on SCSI port Public net SBus card in Public net Ethe
248. tion perform these steps to set the port parameters Substitute your host name for planets tc Note Make sure that the terminal concentrator is powered on and has completed booting 12 6 Ultra Enterprise Cluster Hardware Site Preparation April 1997 12 admin ws telnet terminal concentrator name Trying terminal concentrator IP address Connected to planets tc Escape character is Rotaries Defined cli m Enter Annex port name or number cli Annex Command Line Interpreter Copyright 1991 Xylogics Inc annex su Password typethepassword de ault password is the terminal concentrator IP address annex admin Annex administration MICRO XL UX R7 0 1 8 ports admin set port 1 8 type dial in You may need to reset the appropriate port Annex subsystem or reboot the Annex for changes to take effect admin quit annexis boot bootfile return warning return Note This will cause the terminal concentrator to reboot Thus the terminal concentrator will be unavailable for about a minute Configuring the Terminal Concentrator and Installing the Software 12 7 12 4 Resetting the Terminal Concentrator Configuration Parameters For this procedure refer to the Ultra Enterprise Cluster Service Manual Chapter 3 12 5 Installing the Solaris 2 5 1 Operating System 12 6 Acceptance Test 12 8 on the Nodes 12 5 1 Ultra Enterprise Cluster HA Proceed to the Solstice H
249. tion workstation with CD ROM drive not shown 2 5 2 HA Configuration The minimum configuration is listed below Two Ultra Enterprise 6000 cabinets each equipped with One CPU Memory board with 256 Mbytes RAM and 2 UltraSPARC modules Two I O boards each with one SCI card and one FC OM Three Power Cooling Modules Two SPARCstorage Array Model 100 series units Terminal concentrator with short and long serial cables Four fibre optic cables CD ROM and 8 mm tape drive Administration workstation with CD ROM drive not shown Product Description 2 15 2 2 6 Expansion SPAROstorage 200 series S SPAROstorage RSM units 2 16 System expansion is accomplished by adding additional SPARCstorage Arrays These are typically housed in expansion racks Example expansion racks are shown in Figure 2 10 and Figure 2 11 Front view Rear view b lo D la e lo L b 4 I o9 searosterageAray P
250. uipped with 2 PDB 15 PDB 4 PDB 30 PDB I O boards in one fiber interface FC OM HA 14 HA 4 HA 28 slots 1 and 3 are module and configured with SCI SCI cards PDB only 2 2 4 4 cards FC S SBus card PDB 0 PDB 19 PDB 0 PDB 36 HA 0 HA 18 HA 0 HA 38 Disk boards PDB 0 PDB 2 PDB 0 PDB 4 HA 1 HA 2 HA 2 HA 4 Power cooling modules PCMs 3 8 6 16 FC OM optical modules PDB 2 PDB 15 PDB 4 PDB 30 HA 2 HA 14 HA 4 HA 28 1 128 Mbytes RAM is the minimum amount supported 1 12 Ultra Enterprise Cluster Hardware Site Preparation April 1997 A lll 1 6 2 Checklist Table 1 12 Checklist for Ultra Enterprise Cluster 6000 System Customer Assembled Per Node Quantity Per Cluster Quantity Category Item Planned On Hand Planned On Hand Systems Ultra Enterprise 6000 System nodes CPU Memory board with 2 UltraSPARC modules and 256 Mbytes RAM 128 Mbytes min I O board Disk board Power cooling module PCMs Administration workstation SBus cards PDB SCI SBus card FC S SBus card Modules FC OM modules Chassis Terminal concentrator Terminal concentrator bracket Cables RS 232 serial cable long PN 530 2152 short PN 530 2151 HA private net 1 meter PN 530 2149 5 meter PN 530 2150 Differential SCSI 530 1884 PDB SCI cable 5 meter PN 530 2310 Fiber optic cable 15 meter PN 595 3379 System cabinet SPARCstorage Array units Rackmount kit PDB SCI bracket Expansion cabinet SPARCstorage Array 20
251. um Population Typical of Node 0 and 1 9 6 Ultra Enterprise Cluster Hardware Site Preparation April 1997 O lll Front view Rear view CPU Memory boards PCMs SCI Clock board O boards A Optical port c c AD J _ 9l onboard FC OM o0 0 0 CR E g E gt al 0 c ul e 9 A gt 0 Sa Z 1 2 b o e 9 e 52 Exe 3 B 4 0 9 gt 5 6 li E e o gt gt gt 7 0 1 2 SBus slots Figure 9 6 Ultra Enterprise Cluster 4000PDB Card Cage Expansion Example Typical of Node 0 and 1 Front view Rear view Private net FC S CPU Memory board PCMs NV Clock board 1 O boards o L Optical port c c la A onboard FC OM o6 o8 S B 4 dl J o X X D o EY E o F X 0 9 r Y coo 1 n DS N i 2 g 9 T YS cc 3 4 b al o o e 9 5 6 b E To o Ee ZA 7 0 1 Disk board SBus slots Figure 9 7 Ultra Enterprise Cluster 4000HA Card Cage Minimum Population Typical of Node 0 and 1 Ultra Enterprise Cluster 4000 Hardware Installation 9 7 lll LO
252. uration procedures 8 26 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Ultra Enterprise Cluster 4000 Hardware Installation 3 Do these tasks in the order listed Preparing the System page 9 1 Installing the SPARCstorage Array Systems page 9 3 Installing the Terminal Concentrator page 9 5 Configuring the Card Cages page 9 5 Cabling System Components page 9 12 Closing the Cabinet page 9 26 9 Preparing the System 1 Unpack and inventory the equipment if you have not already done so See Chapter 1 Checklist for a list of equipment 2 Move the system chassis to their designated installation locations For site planning guidelines See Chapter 5 Ultra Enterprise Cluster Configurations 1 Insert the key provided with your system into the front panel key switch Turn it to the Standby position fully counterclockwise See Figure 9 1 9 1 lll LO Standby o ej Jj o O o e o LL 1 EL eo E EE E o ol b 4 p vv Figure 9 1 Kev Switch in the Standby Position 2 Set the AC power switch to the OFF position See Figure 9 2 3 Connect the female end of the power cord into the AC connector This connector is to the left of the AC power switch on the system rea
253. urce DB 114 17 Receive Clock In DCE Source DD 115 20 Data Terminal Ready CD 108 2 24 Transmit Clock Out DTE Source DA 113 Note Sun Microsystems cannot guarantee proper system operation when maximum specified cable lengths are exceeded 4 4 Coaxial Ethernet Cabling For small Ethernet installations you can purchase 15 meter lengths of Ethernet cable from Sun Microsystems Use these 15 meter lengths only as single pieces not as extensions with other cables These branch cables come with two transceiver types Vampire tap N type in line 4 10 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Workstations can serve as gateways between physically separate Ethernet links When a gateway is in place users perceive a single logical network and have transparent access to all the systems on both physical networks A gateway workstation simply has one Ethernet connection to each separate Ethernet cable The software that performs the internetwork routing is included in the standard Solaris software release 4 4 1 Ethernet Design Considerations Refer to Table 4 4 Table 4 4 Ethernet Design Considerations Category Specification Description Cable Type Standard 802 3 50 ohm Capable of a 10 100 megabit second transmission rate Ethernet cable Network Cable Cable purchased in bulk should have marks on the casing every 2 5 meters Desi diu The maximum length of any standard Ethernet cable segment
254. ws 4 Install screws in the bottom rail holes front and rear In the rear it is hole 9 in the front it is hole 10 See Figure A 6 A 6 Ultra Enterprise Cluster Hardware Site Preparation April 1997 pee lll Rear Into hole 18 eI m l Into hole 9 e TL eU Into hole 18 Into hole 10 Figure A 6 Securing the Right Side Rail to the Rack 5 Tighten all four screws top and bottom 6 Repeat steps 1 through 4 for the left side rail See Figure A 7 7 Install all remaining pairs of side rails at the hole numbers specified in Figure A 2 through Figure A 4 Into hole 18 y Ta Into hole 10 Into hole 18 ty NS Into hole 9 Figure A 7 Securing the Left Side Rail to the Rack Rackmount Rail Installation A 7 m A 3 Preparing the SPARCstorage Array 100 Series Chassis Storage chassis may have plastic panels installed Part of chassis preparation involves removing these panels from each chassis to be installed Note If plastic panels are not present skip this procedure and go to Section A 4 Installing the Base Plate on the Chassis on page A 14 A 3 1 Removing the Front Panel The front panel rests in a groove along the top edge of the panel 1 Place your fingers under the arrow embossed on the front panel and press up on the latch to release the panel See Figure A 8 Note If the panel resists becoming unlatched press down on the top of the panel with one hand while press
255. xviii Table 11 3 Table 12 1 Table 12 2 Table A 1 Table A 2 Table A 3 Table B 1 Table C 1 Table C 2 Table C 3 Node to SPARCstorage Array Cable Connection Example 11 39 Front Panel LEDs Indicating a Successful Boot 12 2 Front Panel LEDs Indicating a Failed Boot 12 2 SPARCstorage Array 200 Series Chassis Hole Assignments in the Expansion Cabinet T RN ERT R A R T A 19 SPARCstorage RSM Chassis Hole Assignments In the Expansion Cabinet uni kae xa ad ERR KE REGE A 20 Differential SCSI Tray Hole Assignments In the Expansion Cabinet A 21 nodeid Values Assigned to SCI SBus cards by the sciconf Script B 7 PDB Mixed Platform and Processor Equivalency C2 HA Mixed Platform and Processor Equivalency C2 Ultra Enterprise and SPARCcenter SPARCserver Platform COMDINAIONS iio cade vedere oa PE e Edda C 3 Ultra Enterprise Cluster Hardware Site Preparation April 1997 Preface This manual provides installation instructions for Ultra Enterprise Cluster systems These instructions are designed for a qualified trained service provider and or system administrator with networking knowledge For information on troubleshooting problems refer to the Ultra Enterprise Cluster System Service Manual 802 6790 How This Book Is Organized Part 1 Site Planning and Preparation Chapter 1 Checklist has checklists to verify that you have all the items that
256. y Terminal Concentrator Setup 12 5 12 3 Setting the Port Parameters 002004 sseuusdus 12 5 12 3 1 Determining if the Port Type Variable Must Be Set 12 5 12 3 2 Port Parameters Procedure ooooo 12 6 12 4 Resetting the Terminal Concentrator Configuration T utudietelb saturado Esa o 12 8 Contents xi 12 5 Installing the Solaris 2 5 1 Operating System an the NOGESs sectario rare 12 8 12 5 1 Ultra Enterprise Cluster HA esee t dass 12 8 12 5 2 Ultra Enterprise Cluster PDB isis cdc er Rn 12 8 12 6 Acceptance Test si deen EN II oC NNT E 12 8 120 1 Using Sun VTS ps pst 12 9 12 6 2 Acceptance Test Criteria cocida 12 14 12 7 Software Installation 42 22 e EE ERE ERE E 12 14 Part 4 Appendixes and Index A Rackmount Rail InstallatioN ooooooooomoo m A 1 A 1 Installing the Rackmount Rails for SPARCstorage Array 100 Series Chassis 53 ost e A 1 A 1 1 Array Installation Positions A 2 A 1 2 Ultra Enterprise Cluster 5000 Node Cabinets A 2 A 1 3 Ultra Enterprise Cluster 6000 Node Cabinets A 3 A 14 Expansion Cabinets cessi eee an A 4 A2 Installing the Side Rails A 6 A 3 Preparing the SPARCstorage Array 100 Series Chassis A 8 A 3 1 Removing the Front Panel o o oo o o o A 8 A 3 2 Removing the Side Panels A 9 A 3 3 Removing the Top Panel 1255 e ex n ne A 10 A 4 Installing the Base Plate on the Chassis A 14 A 5 Installing

Download Pdf Manuals

Related Search

Related Contents

T'nB CRJ45RJ11M5 telephony cable  Bedienungsanleitung – Einstelltipps Four à vapeur combiné - V-Zug  Netgear WG302v1 Application Note  Samsung GW731K Εγχειρίδιο χρήσης  USER`S MANUAL - Rivanna Medical  

Copyright © All rights reserved. Failed to retrieve file