Home

Compaq AA-RHGWC-TE User's Manual

1. dga132 1004 0 1 0 1 dgb132 1002 0 2 0 2 dgb132 1003 0 2 0 3 dga132 1001 0 1 0 4 1 Path from host bus adapter A to controller A port 1 Path from host bus adapter B to controller A port 2 Path from host bus adapter B to controller B port 1 A N Path from host bus adapter A to controller B port 2 c Set the bootdef_dev console environment variable for member system 2 boot disk to a comma separated list of several of the boot path s that show up as connected in the reachability display wwidmgr quickset or wwidmgr show reachability You must initialize the system to use any of the device names in the bootdef_dev variable as follows P00 gt gt gt set bootdef dev dga132 1001 0 1 0 dga132 1004 0 1 0 dgb132 1002 0 2 0 dgb132 1003 0 2 0 POO gt gt gt init 3 Boot the new cluster member system into the cluster and complete the cluster installation 4 Repeat steps 1 through 3 for other cluster member systems 6 7 Converting the HSG80 from Transparent to Multiple Bus Failover Mode If you are upgrading from Tru64 UNIX Version 4 0F or Version 4 0G and TruCluster Software Products Version 1 6 to Tru64 UNIX Version 5 1 and TruCluster Server Version 5 1 you may want to change from transparent failover to multiple bus failover to take advantage of multibus support in Tru64 UNIX Version 5 1 and multiple bus failover mode and the ability to create a no single point
2. Clusterwide Just var ID 9 Member 1 Boot Disk ID 10 Member 2 Boot Disk ID 11 Quorum Disk ID 12 ID 13 Do not use for ID 14 or data disk May redundant be used for power redundant power PWR 15 supply supply ZK 1595U Al Table 9 1 shows the components used to create the cluster shown in Figure 9 9 and Figure 9 10 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 19 Table 9 1 Hardware Components Used for Configuration Shown in Figure 8 9 and Figure 8 10 Callout Number Description 1 BN21W 0B Y cable 2 H879 AA terminator 3 BN21K or BN21L cable 4 H885 AA trilink connector a The maximum combined length of the BN21K or BN21L cables must not exceed 25 meters 9 4 2 2 Connecting Two BA356s for Shared SCSI Bus Usage When you use two BA356 storage shelves on a shared SCSI busina TruCluster configuration one BA356 must be configured for SCSI IDs 0 through 6 and the other configured for SCSI IDs 8 through 14 To prepare two BA356 storage shelves for shared SCSI bus usage see Figure 9 10 follow these steps 1 Complete the steps of Section 9 4 1 2 for each BA356 Ensure that the personality module address switches on one BA356 are set to select SCSI IDs 0 through 6 and that the address switches on the other BA356 personality module are set to select SCSI IDs 8 through 14 If either of the BA356 storage shelves wi
3. SCSI Port Device Default SCSI ID MUC 2 D Drive 5 top 5 E Drive 4 4 F Drive 3 3 A Drive 2 5 B Drive 1 4 C Drive 0 bottom 3 8 11 5 TL893 and TL896 Automated Tape Library Internal Cabling The default internal cabling configurations for the TL893 and TL896 Automated Tape Libraries ATLs is as follows e TheSCSI input for the TL893 is high density 68 pin differential The default internal cabling configuration for the TL893 is a three bus mode shown in Figure 8 15 as follows The top shelf tape drive SCSI ID 5 and MUC SCSI ID 2 are on SCSI Port C and are terminated on the MUC To allow the use of the same MUC and terminator used with the TL822 and TL 826 a 68 pin to 50 pin adapter is used on the MUC to connect the SCSI cable from the tape drive to the MUC In Figure 8 15 it is shown as part number 0425031 the SCSI Diff Feed Through This SCSI bus is terminated on the MUC with terminator part number 0415498 a 50 pin Micro D terminator The middle shelf tape drive SCSI ID 4 is on SCSI Port B and is terminated on the drive with a 68 pin Micro D terminator part number 0415619 The bottom shelf tape drive SCSI ID 3 is on SCSI Port A and is also terminated on the drive with a 68 pin Micro D terminator part number 0415619 8 52 Configuring a Shared SCSI Bus for Tape Drive Use Figure 8 15 TL893 Three Bus Configuration 0415498 50 Pin Micro D Terminator 0425031 SCSI Diff Feed Through
4. Accuracy software works as manual says Clarity easy to understand Organization structure of subject matter Figures useful Examples useful Index ability to find topic Usability ability to access information quickly Please list errors you have found in this manual Page Description Additional comments or suggestions to improve this manual What version of the software described by this manual are you using Name title department Mailing address Electronic mail Telephone Date Do Not Cut or Tear Fold Here and Tape prr qr COMPAQ Set rit a a POSTAGE WILL BE PAID BY ADDRESSEE COMPAQ COMPUTER CORPORATION UBPG PUBLICATIONS MANAGER ZKO3 3 Y32 110 SPIT BROOK RD NASHUA NH 03062 2698 NO POSTAGE NECESSARY IF MAILED IN THE UNITED STATES UT STUL Uo MO
5. ceeeeeee eee eee eee eee MC1 to MC2 Standard Hub Rolling Upgrade Replace Third System Memory Channel Adapters cceeeee eee e eae MC1 to MC2 Standard Hub Rolling Upgrade Replace Second MC1in Second System 00 cecee eee e cee eee eee eee eee eae eee MC1 to MC2 Standard Hub Rolling Upgrade Final Configuration sisa 008 oe eed Soteide fac he a aa d EA Point to Point Topology 6 cece cece eee eee e eee eee eae eee Fabric TOpolOgy p aaa cca oaa qnnaies cade aaao shiny at Arbitrated Loop Topology cceeeee eee e eee e tees tease teenies Fibre Channel Single Switch Transparent F ailover CONFIQUIATION ioc cco iriri ieee en dee cede eee En EKE MultipleBus NSPOF Configuration Number 1 MultipleBus NSPOF Configuration Number 2 5 MultipleBus NSPOF Configuration Number 3 45 A Simple Zoned Configuration c cee eee eeee eee eens Portion of QBB Showing I O Riser Modules s es Front View of Expansion and Primary PCI Drawers Rear View of Expansion and Primary PCI Drawers 1 16 2 2 3 8 3 10 3 14 3 15 3 20 3 21 3 24 3 25 4 18 5 20 5 21 5 22 5 23 5 24 5 25 Contents xiii WO O O O O O O OO 32 200NOMH N O xiv Contents TZ88N VA SCSI ID Switches c cece cece eeeeeeeeeeaeeeees Shared SCSI Buses with SBB Tape Drives 0 006 DS TZ89N VW SCSI I
6. cccceecee eee eect eee eee eae eee 9 10 9 3 2 1 Non UltraSCSI BA356 Storage Shelf 4 9 10 9 3 2 2 UltraSCS I BA356 Storage Shelf eeeeee eee 9 13 9 4 Preparing the Storage for Configurations Using External TEP MINGRION i set aiaisn ted ca ss ee lec coush Gls A a aeaa cea 9 14 9 4 1 Preparing BA350 BA356 and UltraSCSI BA356 Storage Shelves for an Externally Terminated TruCluster Server Configurationy ces2c cck cian bike dered teens be Bienes MAAT an 9 15 9 4 1 1 Preparing a BA350 Storage Shelf for Shared SCSI LI SAGG EE twaatidacheins A seni cake eetas 9 15 9 4 1 2 Preparing a BA356 Storage Shelf for Shared SCSI Usage A aa seas edt eb AE AAI ATAA edad TERE ONA 9 16 9 4 1 3 Preparing an UltraSCSI BA356 Storage Shelf for a TruCluster Configuration scceeeee cnet eee eee 9 17 9 4 2 Connecting Storage Shelves Together 0eceeeee ee 9 17 9 4 2 1 Connecting a BA350 and a BA356 for Shared SCSI BUS Usage hiss a EEEE S A TEA T EET ES 9 18 9 4 2 2 Connecting Two BA356s for Shared SCSI Bus Usage 9 20 9 4 2 3 Connecting Two UltraSCS BA356s for Shared SCSI BUS USaQ iorra k ea AARRE i wa E eae bas 9 22 9 4 3 Cabling a Non UltraSCSI RAID Array Controller to an Externally Terminated Shared SCSI Bus 665 9 24 9 4 3 1 Cabling an HSZ40 or HSZ50 in a Cluster Using External Termination ccceeeee eee e eee eee eee 9 25 x Contents 9 4 3 2 9 4 4 Cabling an HSZ
7. Note This material has been written with the premise that there are only two member systems in any TruCluster Server configuration using direct connect disks for storage Using this assumption and further assuming that the member systems use SCSI IDs 6 and 7 the storage shelf housing disks in the range of SCSI IDs 0 through 6 can only use SCSI IDs 0 through 5 If there are more than two member systems additional disk slots will be needed to provide the additional member system SCSI Ds 9 4 1 1 Preparing a BA350 Storage Shelf for Shared SCSI Usage To prepare a BA350 storage shelf for usage on a shared SCSI bus follow these steps 1 Ensurethat the BA350 storage shelf s internal termination and jumper is installed see Section 9 3 1 and Figure 9 6 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 15 2 You will need a DWZZA VA signal converter for the BA350 Ensure that the DWZZA VA single ended termination jumper J 2 is installed Remove the termination from the differential end by removing the five 14 pin differential terminator resistor SIPs 3 Attach an H885 AA trilink connector to the DWZZA VA 68 pin high density connector 4 Install the DWZZA VA in slot 0 of the BA350 9 4 1 2 Preparing a BA356 Storage Shelf for Shared SCSI Usage To prepare a BA356 storage shelf for shared SCSI bus usage follow these steps 1 You need either a DWZZB AA or DWZZB VW signal conv
8. 4 and 5 Must be down reserved for testing 6 Default is up disable bus reset on power up 8 50 Configuring a Shared SCSI Bus for Tape Drive Use Table 8 12 MUC Switch Functions cont Switch Function 7 Host selection Down for SCSI up for serial 8 Must be down reserved for testing a For a TruCluster Server cluster switch 7 is down allowing switches 1 2 and 3 to select the MUC SCSI ID 8 11 3 Setting the MUC SCSI ID The multi unit controller MUC SCSI ID is set with switch 1 2 and 3 as shown in Table 8 13 Note that switch 7 must be down to select the SCSI bus and enable switches 1 2 and 3 to select the MUC SCSI ID Table 8 13 MUC SCSI ID Selection MUC SCSI ID sw Sw2 SW3 0 Down Down Down 1 Up Down Down 2 Down Up Down 3 Up Up Down 4 Down Down Up 5 Up Down Up 6 Down Up Up 7 Up Up Up a This is the default MUC SCSI ID 8 11 4 Tape Drive SCSI IDs Each tape library arrives with default SCSI ID selections The TL893 is shown in Table 8 14 The TL896 is shown in Table 8 15 If you must modify the tape drive SCSI IDs use the push button up down counters on the rear of the drive to change the SCSI ID Table 8 14 TL893 Default SCSI IDs SCSI Port Device Default SCSI ID MUC 2 C Drive 2 top 5 B Drive 1 middle 4 A Drive 0 bottom 3 Configuring a Shared SCSI Bus for Tape Drive Use 8 51 Table 8 15 TL896 Default SCSI IDs
9. 6 6 1 Before You Install The following sections cover the preliminary steps that must be completed before you install Tru64 UNIX and TruCluster Server on Fibre Channel disks 6 6 1 1 Configure the HSG80 Storagesets After the hardware has been installed and configured storagesets must be configured for software installation The following disks disk partitions are needed for base operating system and cluster installation e Tru64 UNIX disk e Cluster root e Cluster usr e Cluster var e Member boot disk one for each cluster member system e Quorum disk if used If you are installing only the operating system you need only the Tru64 UNIX disk and any disks needed for applications This document assumes that both the base operating system and cluster software are to be installed on Fibre Channel disks If you are installing a cluster you need one or more disks to hold the Tru64 UNIX operating system The disk s are either private disk S on the system that will become the first duster member or disk s on a shared bus that the system can access Whether the Tru64 UNIX disk is on a private disk or a shared disk shut down the cluster before booting a cluster member system standalone from the Tru64 UNIX disk An example configuration will show the procedure necessary to set up disks for base operating system and cluster installation Modify the procedure according to your own disk needs You can use any supported RAID le
10. Cluster Administration Describes cluster specific administration tasks Highly Available Applications Describes how to deploy applications on a TruCluster Server cluster Consult the following AlphaServer GS80 160 320 documentation to assist you in configuring an AlphaServer GS80 GS160 or GS320 system in a TruCluster Server configuration Installation Guide System Management Console Installation and User s Guide User s Guide Firmware Reference Manual About This Manual The StorageWorks UltraSCSI Configuration Guidelines document provides guidelines regarding UltraSCSI configurations For information about setting up a RAID subsystem see the following manuls as appropriate for your configuration DEC RAID Subsystem User s Guide HS Family of Array Controllers User s Guide RAID Array 310 Configuration and Maintenance Guide User s Guide Configuring Your StorageWorks Subsysten HSZ40 Array Controllers HSOF Version 3 0 Gating Started RAID Array 450 V5 4 for Compaq Tru64 UNIX Installation Guide HSZ70 Array Controlle HSOF Version 7 0 Configuration Manual HSZ80 Array Controller ACS Version 8 2 Compaq StorageWorks HSG80 Array Controller ACS Version 8 5 Configuration Guide Compaq StorageWorks HSG80 Array Controller ACS Version 8 5 CLI Reference Guide MA6000 HSG60 Array Controller ACS Version 8 5 Solution Software for Compaq Tru64 UNIX Installation and Configuration Guide Compaq StorageWorks HSG60 HSG80
11. H8574 A or Low 50 pin Terminates a TZ885 or TZ887 tape drive H8860 AA 341102 001 High 50 pin Terminates a Compaq 20 40 GB DLT Tape Drive H879 AA or High 68 pin Terminates an H885 AA trilink connector 330563 001 BN21W 0B Y cable or an ESL9326D Enterprise Library tape drive H8861 AA VHDCI 68 pin VHDCI trilink connector that attaches to VH DCI 68 pin cables UltraSCSI BA356J A1 and HSZ70 or HSZ80 RAID controllers Can be terminated with an H8863 AA terminator if necessary H8863 AA VHDCI 68 pin Terminate a VHDCI trilink connector 152732 001 VHDCI 68 pin Low Voltage Differential terminator The requirements for trilink connectors are as follows e If you connect a SCSI cable toa trilink connector do not block access to the screws that mount the trilink or you will be unable to disconnect the trilink from the device without disconnecting the cable e Donot install an H885 AA trilink if installing it will block an adjacent peripheral component interconnect PCI port Use a BN21W OB Y cable instead 2 14 Hardware Requirements and Restrictions 3 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware A TruCluster Server cluster uses shared SCSI buses external storage shelves or RAID controllers and supports disk mirroring and fast file system recovery to provide high data availability and reliability This chapter e Introduces SCSI bus configuration concepts e Describes requir
12. JAI SCSI Bus Termination Resistors RM1 RM8 amp ZK 1451U Al 4 18 TruCluster Server System Configuration Using UltraSCSI Hardware 5 Setting Up the Memory Channel Cluster Interconnect This chapter describes Memory Channel configuration restrictions and describes how to set up the Memory Channel cluster interconnect including setting up a Memory Channel hub Memory Channel optical converter MC2 only and connecting link cables Two versions of the Memory Channel PCI adapter are available CCMAA and CCMAB MC2 Two variations of the CCMAA PCI adapter are in use CCMAA AA MC1 and CCMAA AB MC1 5 As the hardware used with these two PCI adapters is the same this manual often refers to MC1 when referring to either of these variations See the TruCluster Server Software Product Description SPD for a list of the supported Memory Channel hardware See the Memory Channel User s Guide for illustrations and more detailed information about installing jumpers Memory Channel adapters and hubs You can have two Memory Channel adapters with TruCluster Server but only one rail can be active at a time This is referred to as a failover pair If the active rail fails cluster communications fails over to the inactive rail See Section 2 2 for a discussion on Memory Channel restrictions To set up the Memory Channel interconnects follow these steps referring to the appropriate section and the Memory Channel User s Gui
13. With dual 180 watt power supplies installed there are slots available for six 3 5 inch SBBs or two 5 25 inch SBBs Table 3 3 DS DWZZH UltraSCSI Hub Maximum Configurations DS DWZZH 03 DS DWZZH 05 Disk Drives Personality Module 5 0 0 Not Installed 4 0 0 Installed 3 0 3 Installed 2 0 4 Installed 1 0 5 Installed 0 2 0 Not Installed 3 1 0 Not Installed 2 1 1 Installed 1 1 2 Installed 0 1 3 Installed a DS DWZZH UltraSCSI hubs and disk drives may coexist in a storage shelf Installed disk drives are not associated with the DS DWZZH UltraSCSI hub SCSI bus segments they are on the SCSI bus connected to the personality module If the personality module is installed you can install a maximum of four DS DWZZH 03 UltraSCSI hubs The personality module must be installed to provide a path to any disks installed in the storage shelf Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 11 3 6 1 2 2 DS DWZZH 05 Fair Arbitration Although each cluster member system and storage controller connected to an UltraSCSI hub are on separate SCSI bus segments they all share a common SCSI bus and its bandwidth As the number of systems accessing the storage controllers increases it is likely that the adapter with the highest priority SCSI ID will obtain a higher proportion of the UltraSCSI bandwidth The DS DWZZH 05 UltraSCSI hub provides a fair arbitration feature that override
14. 6 Usethe show configand show device console Section 10 1 3 and commands to display the installed devices Example 10 1 through and information about the KZPSA BBs or Example 10 4 KZPBA CBs on the AlphaServer systems Look for KZPSA or pk in the display to determine which devices are KZPSA BBs Look for Qhogic ISP1020 in the show config display and isp in the show device display to determine which devices are KZPBA CBs Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 7 Table 10 3 Installing a KZPSA BB or KZPBA CB for Use with External Termination cont Step Action Refer to 7 Use the show pk or show isp console Section 10 1 4 1 through commands to determine the status of the Section 10 1 4 3 and KZPSA BB or KZPBA CB console environment Example 10 6 through variables and then use the set console Example 10 9 command to set the KZPSA BB bus speed to fast termination power to on and the KZPSA or KZPBA CB SCSI bus ID Notes Ensure that the SCSI ID that you useis distinct from all other SCSI IDs on the same shared SCSI bus If you do not remember the other SCSI IDs or do not have them recorded you must determine these SCSI Ds You will have problems if you have two or more SCSI adapters at the same SCSI ID on any one SCSI bus 8 Repeat steps 1 through 7 for any other KZPSA BBs or KZPBA CBs to be installed on this shared SCSI bus on other member systems
15. 8 13 1 General OVErVieW 0 0 cece ce cece eee eee ee eee tent eta eenaes 8 13 2 ESL9326D Enterprise Library Overview 5065 8 13 3 Preparing the ESL9326D Enterprise Library for Shared SGSI BUS U SAGE ieee ki ienaa da n leeds ni en eats 8 48 8 48 8 50 8 50 8 51 8 51 8 52 8 54 8 67 8 67 70 8 71 8 72 8 73 8 73 8 74 Contents ix 8 13 3 1 ESL9326D Enterprise Library Robotic and Tape Drive Required Firmware 0 cccee eee ee eee e eee ee eae ees 8 75 8 13 3 2 Library Electronics and Tape Drive SCSI IDs 8 75 8 13 3 3 ESL9326D Enterprise Library Internal Cabling 8 75 8 13 3 4 Connecting the ESL9326D Enterprise Library tothe Shared SCSMBUS incc2 cascieeet eee ey ches dai oy 8 77 9 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 1 Using SCSI Bus Signal Converters c ecceeeee eee eee 9 2 9 1 1 Types of SCSI Bus Signal Converters 0 eeeeeee 9 2 9 1 2 Using the SCSI Bus Signal Converters 0es 9 3 9 1 2 1 DWZZA and DWZZB Signal Converter Termination 9 3 9 1 2 2 DS BA35X DA Termination 0cceceeeee eee eee 9 4 9 2 Terminating the Shared SCSI BUS ssssssessesesssssesresreresns 9 5 9 3 Overview of Disk Storage Shelves cece eee cnet eee ees 9 8 9 3 1 BA350 Storage Shelf cccceecee rrer eee eee ee eee eae eed 9 9 9 3 2 BA356 Storage Shelf
16. 927 20 113 HSG80 gt show d144 4 LUN Uses Used by D144 CROOT MIR partition LUN ID 6000 1FE1 0000 0D60 0009 8080 0434 0028 IDENTIFIER 144 Switches RUN NOWRITE_PROTECT READ _CACHE READAHEAD CACHE WRITEBACK CACHE MAXIMUM_CACHED_ TRANSFER SIZE 32 Access NEWCON49 NEWCONS50 NEWCON51 NEWCONS52 NEWCON53 NEWCON54 NEWCONSS NEWCONS56 NEWCON61 NEWCON62 NEWCON64 NEWCON65 NEWCON68 NEWCON74 NEWCON76 NEWCON77 State ONLINE to the other controller NOPREFERRED_ PATH Size 3351207 blocks Geometry C H S 1483 20 113 1 Assign a unit number to each partition When the unit is created by the ADD UNIT command disable access to all hosts This allows selective access in case there are other systems or clusters connected to the same switch as our cluster Using Fibre Channel Storage 6 41 Record the unit name of each partition with the intended use for that partition see Table 6 2 2 Set an identifier for each storage unit Use any number between 1 and 9999 To keep your storage naming as consistent and simple as possible consider using the unit number of the unit as its UDID for instance if the unit number is D133 use 133 as the UDID Note however that the identifier must be unique If you have multiple RA8000 or ESA12000 storage arrays a unit number such as D133 might not be unique across the storage arrays The identifier you select shows up as the user
17. The HSZ20 HSZ40 and HSZ50 cannot operate at UltraSCSI speeds when used with the KZPBA CB You can also use a DS DWZZH 03 or DS DWZZH 05 UltraSCSI hub with one of these RAID array controllers and either the KZPSA BB or KZPBA CB host bus adapters UltraSCSI cables are required to make the connection to the hub UltraSCSI speed is not supported with these RAID array controllers when used with a hub and the KZPBA CB host bus adapter 9 24 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 4 3 1 Cabling an HSZ40 or HSZ50 in a Cluster Using External Termination To connect an HSZ40 or HSZ50 controller to an externally terminated shared SCSI bus follow these steps 1 If the HSZ40 or HSZ50 will be on the end of the shared SCSI bus attach an H879 AA terminator to an H885 AA trilink connector Attach an H885 AA trilink connector to each RAID controller port Attach the H885 AA trilink connector with the terminator to the controller that will be on the end of the shared SCSI bus If you are using dual redundant RAID array controllers install a BN21 K or BN21L cable a BN21L 0B is a 0 15 meter cable between the H885 AA trilink connectors on the controllers When the host bus adapters K ZPSA BB or KZPBA CB have been installed connect the host bus adapters and RAID array controllers together with BN21K or BN21L cables as follows e Both member systems are on the ends of the bus Attach a BN21
18. You can add additional shared SCSI buses with Compaq 20 40 GB DLT Tape Drives by adding additional DWZZB AA Compag 20 40 GB DLT Tape Drive combinations Notes Ensure that there is no conflict with tape drive and host bus adapter SCSI IDs To achieve system performance capabilities we recommend placing no more than two Compaq 20 40 GB DLT Tape Drives on a SCSI bus and also recommend that no shared storage be placed on the same SCSI bus with the tape drive 8 12 Configuring a Shared SCSI Bus for Tape Drive Use Figure 8 5 Cabling a Shared SCSI Bus with a Compaq 20 40 GB DLT Tape Drive Network Member Member Memory System Channel System 1 Interface 2 Memory Channel Memory Channel KZPBA CB ID 6 KZPBA CB ID 7 KZPBA CB ID 6 KZPBA CB ID 7 DWZZB AA 20 40 GB DLT Tape Drive ZK 1604U Al Table 8 4 shows the components used to create the cluster shown in Figure 8 5 Table 8 4 Hardware Components Used to Create the Configuration Shown in Figure 8 5 Callout Number Description BN38C or BN38D cable BN37A cable H8861 AA VHDCI trilink connector H8863 AA VHDCI terminator BN21W 0B Y cable H879 AA terminator 328215 00X BN21K or BN21L cable H 885 AA trilink connector ooN al u BI WInNnile Configuring a Shared SCSI Bus for Tape Drive Use 8 13 Table 8 4 Hardware Components Used to Create the Configura
19. e 9600 BPS e 8 data bits e 1stop bit e No parity Connect the RA8000 or ESA12000 to the power source and apply power Note The KGPSA host bus adapters must be cabled to the switch with the system power applied before you turn power on to the RA8000 ESA12000 in order for the HSG80 to see the connection to the KGPSAs If an uninterruptible power supply UPS is used instead of the external cache battery to prevent the controller from periodically checking the cache batteries after power is applied enter the following command gt set this CACHE UPS Note Setting the controller variable CACHE _UPs for one controller sets it for both controllers From the maintenance terminal usethe show this and show other commands to verify that controllers have the current firmware version See the Compaq StorageWorks HSG80 Array Controller ACS Version 8 5 CLI Reference Guide for information on upgrading the firmware To ensure proper operation of the HSG80 with Tru64 UNIX and TruCluster Server set the the controller values as follows set nofailover 1 clear cli 2 set multibus copy this 3 clear cli 4 set this port 1 topology offline 5 set this port 2 topology offline 5 set other port 1 topology offline 5 set other port 2 topology offline 5 set this port 1 topology fabric 6 set this port 2 topology fabric 6 6 6 set other port 1 top
20. e Pass through mechanism The pass through mechanism is attached to the back of the expansion unit and each of the other modules and allows the transfer of tape cartridges between the various modules It is controlled by the expansion unit For each base or data unit added toa configuration the pass through mechanism must be extended by seven inches the height of each module A seven inch gap may be left between modules providing there is sufficient space but additional pass through mechanism extensions must be used 8 12 1 3 TL881 and TL891 Rackmount Scalability The rackmount version of the TL881 and TL891 MiniLibraries provides a scalable tape library system that you can configure for maximum performance maximum capacity or various combinations between the extremes Either library uses DLT IV tape cartridges but can also use DLT II or DLT 11 xt tape cartridges Table 8 17 shows the capacity and performance of a TL881 or TL891 MiniLibrary in configurations set up for either maximum performance or maximum capacity Configuring a Shared SCSI Bus for Tape Drive Use 8 59 Table 8 17 TL881 and TL891 MiniLibrary Performance and Capacity Comparison TL881 MiniLibrary TL891 MiniLibrary Configured Number of Number of Transfer Storage Transfer Storage for Base Units Data Units Rate Capacity Ratef Capacity Maximum Performance 5 0 15 MB sec 1 32 TB 66 50 MB sec 2 31 TB 66 54 cartridges 180 cartridges GB hou
21. 1 BN38C or BN38D cable 2 BN37A cable 3 H8861 AA VHDCI trilink connector 4 H8863 AA VHDCI terminator 5 6 7 BN21W 0B Y cable H879 AA terminator 328215 00X BN21K or BN21L cables a The maximum length of the BN38C or BN38D cable on one SCSI bus segment must not exceed 25 meters The maximum length of the BN37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters 8 12 2 2 2 Configuring a Base Unit as a Slave to the Expansion Unit The TL881 TL891 base units are shipped configured as standalone systems When they are used in conjunction with the MiniLibrary expansion unit the expansion unit must control the robotics of each of the base units Therefore the base units must be configured as slaves to the expansion unit After the hardware and cables are installed but before you power up the expansion unit in a MiniLibrary system for the first time you must reconfigure each of the base units in the system as a slave The expansion unit will not have control over the base unit robotics when you power up the MiniLibrary system if you do not reconfigure the base unit as a slave To reconfigure a TL881 TL891 base unit as a slave to the MiniLibrary expansion unit perform the following procedure on each base unit in the system 1 Turn on the power switch on the TL881 TL891 base unit to be reconfigured Note Do not power on the expansion unit Leav
22. 9 Install the remaining SCSI bus hardwareneeded Section 9 4 for storage DWZZA B RAID array controllers storage shelves cables and terminators BA350 storage shelf Section 9 3 1 Section 9 4 1 1 and Section 9 4 2 1 Non UltraSCS BA356 storage shelf Section 9 3 2 1 Section 9 4 1 2 and Section 9 4 2 2 Ultra BA356 storage shelf Section 9 3 2 2 Section 9 4 1 3 and Section 9 4 2 3 HSZ40 or HSZ50 RAID array controller Section 9 4 3 10 Install the tape device hardware and cables Chapter 8 on the shared SCSI bus as follows TZ88 Section 8 1 TZ89 Section 8 2 Compaq 20 40 GB DLT Tape Drive Section 8 3 TZ885 Section 8 5 TZ887 Section 8 6 TL891 TL892 MiniLibrary Section 8 7 10 8 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices Table 10 3 Installing a KZPSA BB or KZPBA CB for Use with External Termination cont Step Action Refer to TL890 with TL891 TL892 Section 8 8 TL894 Section 8 9 TL895 Section 8 10 TL893 TL896 Section 8 11 TL881 TL891 DLT MiniLibraries Section 8 12 Compaq ESL9326D Enterprise Library Section 8 13 Notes If you install tape devices on the shared SCSI buses ensure that you understand how the particular tape device s affect the shared SCSI bus The TL893 TL894 TL895 TL896 and ESL9326D have long internal SCSI cables therefore they cannot be externally terminated with a trilinkAterminator combination These tape libraries must be on the
23. DS scan foee cane dda eek eet eta deta a a a a aa a Mele pee TL894 Tape Library Internal Cabling 0cceeeees Connecting the TL894 Tape Library to the Shared SCSI BUS tech icictese thecal a ates gets hates a atlanta a ach eet ona Preparing the TL895 DLT Automated Tape Library for Shared SCSI Bus WSage iscsi aapa ae a a s tan aaa Deena TL895 Robotic Controller Required Firmware Setting the TL895 Tape Library SCSI IDS TL895 Tape Library Internal Cabling 0cceeeees Upgrading a TL895 ccccce cece ee eeeeeeeeeeeeeneeeeeanees Lee NAAA OOO OW o CO A E E E RN RAR o N P N oO 8 20 8 21 8 23 8 23 8 25 8 29 8 29 8 29 8 30 8 33 8 34 8 35 8 36 8 37 8 37 8 39 8 41 8 43 8 44 8 44 8 45 8 47 8 10 5 Connecting the TL895 Tape Library to the Shared SCSI BUS aerieni ene Tp eana EAA handed See ES 8 11 Preparing the TL893 and TL896 Automated Tape Libraries for Shared SCSI Bus Usage s ssssssssrrrrrrrrrrrrrrrrrrrrrns 8 11 1 Communications with the Host Computer 55 8 11 2 MUC Switch FUNCtIONS 0 cece eect eee eee eed 8 11 3 Setting the MUC SCSI ID cece eee eee eee eee eee eee 8 11 4 Tape Drive SCSI IDS 0 0 cece cece ee cece ee eee eee teat ees 8 11 5 TL893 and TL896 Automated Tape Library nternal Cabling oeri irinn iiien rele de tees eae eee chee 8 11 6 Connecting the
24. Figure 7 3 Rear View of Expansion and Primary PCI Drawers I O Riser 1 I O Riser 0 Expansion REI Drawer iF FF in Console Serial Bus Node ID Module PCI Drawer Node ID CSB Connector J ssm O se oman 4 ey x CELTIE TE SEL sarean sees 1 E TTITTTRTT om at i e Breer ee R PAREI PCI peter Local Terminal yl Ss i f rar aN Ce i rin i COM1 Port Ali HEA Y ve ifika J74 PCI Drawer Node ID rH g Ji H Bs Bie i i ERA HN iiia 7 CSB Connector Eus AY Cs mcr ie ege De Sea h lad Console Serial Standard I O Module Bus Node ID Module ZK 1751U Al 7 3 Configuring Partitioned GS80 GS160 or GS320 Systems in a TruCluster Configuration An AlphaServer GS80 160 320 system can be a member of a TruCluster Server configuration Alternatively any AlphaServer GS80 160 320 hard partition can participate as a member system provided that the partition meets the hardware requirements that Section 7 2 describes The following section covers configuring a single partition AlphaServer GS80 160 320 system as multiple hard partitions in a TruCluster Server configuration The description covers the case of a newly installed system that is to be used as two member systems in a TruCluster Server configuration 7 3 1 Repartitioning a Single Partition AlphaServer GS80 160 320 as Two Partitions in a Cluster The information in this section assumes that this is a new AlphaServer GS80 160 320 syste
25. NH 03062 2698 A Reader s Comment form is located in the back of each printed manual The form is postage paid if you mail it in the United States Please include the following information along with your comments e The full title of the book and the order number The order number is printed on the title page of this book and on its back cover e The section numbers and page numbers of the information on which you are commenting e Theversion of Tru64 UNIX that you are using e If known the type of processor that is running the Tru64 UNIX software The Tru64 UNIX Publications group cannot respond to system problems or technical support inquiries Please address technical questions to your local system vendor or to the appropriate Compaq technical support office Information provided with the software media explains how to send problem reports to Compaq Conventions The following typographical conventions are used in this manual A number sign represents the superuser prompt cat Boldface type in interactive examples indicates typed user input xxii About This Manual file Italic Slanted type indicates variable values placeholders and function argument names A vertical ellipsis indicates that a portion of an example that would normally be present is not shown cat 1 A cross reference to a reference page includes the appropriate section number in parentheses For example cat 1 indicates that you can find
26. Note The SRM console firmware includes the SP1020 1040 based PCI option firmware which includes the KZPBA CB When you update the SRM console firmware you are enabling the KZPBA CB firmware to be updated On a powerup reset the SRM console loads KZPBA CB adapter firmware from the console system flash ROM into NVRAM for all Qlogic 1SP1020 1040 based PCI options including the KZPBA CB PClI to Ultra SCSI adapter Usethe show configand show device console Section 10 1 3 and commands to display the installed devices Example 10 1 through and information about the KZPSA BBs or Example 10 4 KZPBA CBs on the AlphaServer systems Look for KZPSA or pk in the display to determine which devices are KZPSA BBs Look for Qhogic ISP1020 in the show config display and isp in the show device display to determine which devices are KZPBA CBs Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 5 Table 10 2 Installing the KZPSA BB or KZPBA CB for Radial Connection to a DWZZH UltraSCSI Hub cont Step Action Refer to 6 Use the show pk or show isp console Section 10 1 4 1 through commands to determine the status of the Section 10 1 4 3 and KZPSA BB or KZPBA CB console environment Example 10 6 through variables and then use the set console Example 10 9 command to set the KZPSA BB bus speed to fast termination power to on and the KZPSA or KZPBA CB SCSI bus ID Notes Ensure that the
27. PALcode OpenVMS PALcode V1 54 43 Tru6 4 UNIX PALcode V1 49 45 Processors CPU 0 Alpha 21264 4 500 MHz SROM Revision V1 82 Bcache size 4 MB CPU 1 Alpha 21264 4 500 MHz SROM Revision V1 82 Bcache size 4 MB 4 10 TruCluster Server System Configuration Using UltraSCSI Hardware Example 4 1 Displaying Configuration on an AlphaServer DS20 cont Core Logic Cchip DECchip 21272 CA Rev 2 1 Dchip DECchip 21272 DA Rev 2 0 Pchip 0 DECchip 21272 EA Rev 2 2 Pchip 1 DECchip 21272 EA Rev 2 2 TIG Rev 4 14 Arbiter Rev 2 10 0x1 MEMORY Array Size Base Addr 0 512 MB 000000000 Total Bad Pages 0 Total Good Memory 512 MBytes PCI Hose 00 Bus 00 Slot 05 0 Cypress 82C693 Bridge to Bus 1 ISA Bus 00 Slot 05 1 Cypress 82C693 IDE dqa 0 0 105 0 Bus 00 Slot 05 2 Cypress 82C693 IDE dqb 0 1 205 0 Bus 00 Slot 05 3 Cypress 82C693 USB Bus 00 Slot 07 DECchip 21152 AA Bridge to Bus 2 PCI Bus 00 Slot 08 QLogic ISP1020 pkc0O 7 0 8 0 SCSI Bus ID 7 dkc0 0 0 8 0 HSZ70 dkc1 0 0 8 0 HSZ70 dkc100 1 0 8 0 HSZ70 dkc101 1 0 8 0 HSZ70CCL dkc2 0 0 8 0 HSZ70 dkc3 0 0 8 0 HSZ70 dkc4 0 0 8 0 HSZ70 dkc5 0 0 8 0 HSZ70 dkc6 0 0 8 0 HSZ70 dkc7 0 0 8 0 HSZ70 Bus 00 Slot 09 QLogic ISP1020 pkd0 7 0 9 0 SCSI Bus ID 7 dkd0 0 0 9 0 HSZ40 dkd1 0 0 9 0 HSZ40 dkd100 1 0 9 0 HSZ40 dkd101 1 0 9 0 HSZ40 dkd102 1 0 9 0 HSZ40 dkd5 0 0 9 0 HSZ40 dkd 0 0 9 0 HSZ40 dkd7 0 0 9 0 HSZ40 Bus 02 Slot 00 NCR 53C875 pka0 7 0 2000 0 SC
28. PC that provides a terminal emulator window for each console Modem port on the standard I O module Two universal serial bus USB ports on standard I O module Keyboard port Mouse port Operator Control panel OCP port Parallel port A communication port COM 2 The BA54A BA PCI drawer is an expansion PCI drawer top PCI drawer in Figure 7 2 and Figure 7 3 and contains Two I O riser modules for connection toa QBB I O riser module Two power supplies which provides a redundant power supply Two PCI backplanes Each PCI backplane has 2 PCI buses each with seven available slots Console serial bus interface module Figure 7 2 shows the front view of an expansion and a primary PCI drawer The primary PCI drawer is on the bottom You can easily recognize it because of the CD ROM keyboard and mouse ports COM2 and parallel ports and connection to the OCP Figure 7 3 shows the rear view of both Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 5 types of PCI drawers It is harder to distinguish the type of PCI drawer from the rear but slot 1 provides the key The primary PCI drawer has a standard I O module in slot 1 and the console and modem ports and USB connections are visible on the module Figure 7 2 Front View of Expansion and Primary PCI Drawers Va add 7 ZK 1750U AI 7 6 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration
29. SET D141 IDENTIFIER 141 HSG80 gt SET D142 IDENTIFIER 142 HSG80 gt SET D143 IDENTIFIER 143 HSG80 gt SET D144 IDENTIFIER 144 HSG80 gt set d131 ENABLE ACCESS PATH NEWCON49 NEWCON50 NEWCON51 NEWCON52 3 HSG80 gt set d131 ENABLE ACCESS PATH NEWCONS53 NEWCON54 NEWCONS5S NEWCON56 Warning 1000 Other host s in addition to the one s specified can still access this unit If you wish to enable ONLY the host s specified disable all access paths DISABLE ACCESS ALL then again enable the ones specified HSG80 gt set d131 ENABLE ACCESS PATH NEWCON61 NEWCON62 NEWCON64 NEWCON65 Warning 1000 Other host s in addition to the one s specified can still access this unit If you wish to enable ONLY the host s specified disable all access paths DISABLE ACCESS ALL then again enable the ones specified HSG80 gt set d131 ENABLE ACCESS PATH NEWCON68 NEWCON74 NEWCON76 NEWCON77 Warning 1000 Other host s in addition to the one s specified can still access this unit If you wish to enable ONLY the host s specified disable all access paths DISABLE ACCESS ALL then again enable the ones specified HSG80 gt set d132 ENABLE ACCESS PATH NEWCON49 NEWCON50 NEWCONS51 NEWCON52 HSG80 gt set d144 ENABLE ACCESS PATH NEWCON49 NEWCON50 NEWCONS51 NEWCON52 HSG80 gt set d144 ENABLE ACCESS PATH NEWCON53 NEWCONS4 NEWCONSS NEWCON56 Warning 1000 Other host s in addition to the one
30. The maximum storage capacity of the library is 3500 GB uncompressed based upon 100 CompacTape IV cartridges at 35 GB each For moreinformation on the TL895 see the following manuals e TL895 DLT TapeLibrary Facilities Planning and Installation Guide e TL895 DLT Library Operator s Guide e TL895 DLT TapeLibrary Diagnostic Software U se s Manual For more information on upgrading from five to six or seven tape drives see the TL895 Drive U pgrade Instructions manual Note There are rotary switches on the library printed circuit board used to set the library and tape drive SCSI IDs The SCSI IDs set by these switches are used for the first 20 to 30 seconds after power is applied until the electronics is activated and able to set the SCSI IDs electronically Configuring a Shared SCSI Bus for Tape Drive Use 8 43 The physical SCSI IDs should match the SCSI IDs set by the library electronics Ensure that the SCSI ID set by the rotary switch and from the control panel do not conflict with any SCSI bus controller SCSI 1D The following sections describe how to prepare the TL 895 for use on a shared SCSI bus in more detail 8 10 1 TL895 Robotic Controller Required Firmware Robotic firmware version N 2 20 is the minimum firmware revision supported in a TruCluster Server cluster For information on upgrading the robotic firmware see the Flash Download section of the TL895 DLT Tape Library Diagnostic Software User s Manual 8 10
31. To determine if a jumper module or terminator module is installed ina BA356 remove the devices from slots 1 and 6 and note the following pin locations see Figure 9 8 e Theidentification pin on a jumper module aligns with the top holein the backplane e Theidentification pin on a terminator module aligns with the bottom hole in the backplane 9 12 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices Figure 9 8 BA356 Jumper and Terminator Module Identification Pins Slot 6 Slot 1 Jumper Jumper Pin Pin Slot 6 Slot 1 Terminator Terminator Pin Pin ZK 1529U Al 9 3 2 2 UltraSCSI BA356 Storage Shelf The UltraSCS BA356 DS BA356 F or DS BA356 KH has a single ended wide UltraSCS I bus The DS BA35X DA personality module provides the interface between the internal single ended UltraSCSI bus segment and the shared wide differential UltraSCSI bus The UltraSCS I BA356 uses a 180 watt power supply An older non UltraSCS I BA356 that has been retrofitted with a BA35X HH 180 watt power supply and DS BA35X DA personality module is still only FCC certified for Fast 10 configurations See Section 3 2 4 for a discussion on bus speed The UltraSCSI BA356 can hold up to seven StorageWorks building blocks SBBs These SBBs are UltraSCSI single ended wide devices The disk SCSI IDs are based upon the slot they are installed in The S3 swi
32. To install the KGPSA BC or KGPSA CA PClI to Fibre Channel adapter modules follow these steps For more information see the following documentation e KGPSA BC PClI to Optical FibreChanne Host Adapter User Guide Using Fibre Channel Storage 6 23 64 Bit PCl to Fibre Channa Host Bus Adapter User Guide Caution Static electricity can damage modules and electronic components We recommend using a grounded antistatic wrist strap and a grounded work surface when handling modules 1 If necessary install the mounting bracket on the KGPSA BC module Place the mounting bracket tabs on the component side of the board Insert the screws from the solder side of the board 2 TheKGPSA BC should arrive with the gigabit link module GLM installed If not close the GLM ejector mechanism Then align the GLM alignment pins alignment tabs and connector pins with the holes oval openings and board socket Press the GLM into place The KGPSA CA does not use a GLM it uses an embedded optical shortwave multimode Fibre Channel interface 3 Install the KGPSA in an open 32 or 64 bit PCI slot 4 Insert the optical cable SC connectors into the KGPSA BC GLM or KGPSA CA SC connectors The SC connectors are keyed to prevent their being plugged in incorrectly Do not use unnecessary force Do not forget to remove the transparent plastic covering on the extremities of the optical cable 5 Connect the fiber optic cables to the shortwave Gigabit Int
33. cceeee cece eee teens BA350 Internal SCSI BUS ccceecee eee eee eee eee tated BA356 Internal SCSI BUS 0c cee cee eee ence eee eee eae BA356 J umper and Terminator M odule Identification Pins BA350 and BA356 Cabled for Shared SCSI Bus Usage Two BA356s Cabled for Shared SCSI Bus Usage Two UltraSCSI BA356s Cabled for Shared SCSI Bus Usage Externally Terminated Shared SCSI Bus with Mid Bus HSZ50 RAID Array Controllers ccceee eee ee eee e eee eee ena e eee Externally Terminated Shared SCSI Bus with HSZ50 RAID Array Controllers at BUS End cceeeee eect eee eee eee eee TruCluster Server Cluster Using DS DWZZH 03 SCSI Adapter with Terminators Installed and HSZ50 Tables 2 1 TruCluster Server Cluster Using KZPSA BB SCSI Adapters a DS DWZZH 05 UltraSCS I Hub and an HSZ50 RAID Array Controller 2205 ok luna tasers cide eked oh A AA E datisee oul KZPSA BB Termination Resistors ceccceeeeseeeeeeeeeees RAID Controller Minimum Required Array Controller SOPLWALE iter eit hctea etek ee bedded cneta eE aR dE Ee RAID Controller SCSI IDS c ccc eee eee eee eee eee eee eee Supported SCSI Cables ccccceeceeeeeeeeeeeeeeeeeenneeees Supported SCSI Terminators and Trilink Connectors SCSI BUS SpeedS tics caiseee ces cead aes cokes tadsle di des saedengiaeesns SCSI Bus Segment Length c cece eee eee ee ee eee e eae
34. differential host adapter in Cluster Administration the PCI slot corresponding to the logical bus to Section 2 3 3 and be used for the shared SCSI bus Ensure that KZPBA CB PCI to Ultra the number of adapters are within limits for the SCSI Differential Host system and that the placement is acceptable Adapter User s Guide 3 Install a BN38C cable between the KZPBA CB UltraSCSI host adapter and a DWZZH port Notes The maximum length of a SCSI bus segment is 25 meters including the bus length internal to the adapter and storage devices One end of the BN 38C cable is 68 pin high density The other end is 68 pin VHDCI The DWZZH accepts the 68 pin VH DCI connector The number of member systems in the cluster has to be one less than the number of DWZZH ports 4 Power up thesystem and usethe show config Section 4 3 2 and and show device console commands to display Example 4 1 through the installed devices and information about Example 4 4 the KZPBA CBs on the AlphaServer systems Look for QLogic ISP1020 in the show config display and isp in the show device display to determine which devices are KZPBA CBs 5 Use the show pk or show isp console Section 4 3 3 and commands to determine the KZPBA CB SCSI bus ID and then use the set console command to set the SCSI bus ID Example 4 5 through Example 4 7 TruCluster Server System Configuration Using UltraSCSI Hardware 4 9 Table 4 3 Installing the KZPBA CB for Radial Connection to a DWZZH Ul
35. information on the cat command in Section 1 of the reference pages cluster Bold text indicates a term that is defined in the glossary About This Manual xxiii 1 Introduction This chapter introduces the TruCluster Server product and some basic cluster hardware configuration concepts Subsequent chapters describe how to set up and maintain TruCluster Server hardware configurations See the TruCluster Server Software Installation manual for information about software installation see the TruCluster Server Cluster Administration manual for detailed information about setting up member systems and highly available applications 1 1 The TruCluster Server Product TruCluster Server the newest addition to the Compaq Tru64 UNIX TruCluster Software products family extends single system management capabilities to clusters It provides a clusterwide namespace for files and directories including a single root file system that all cluster members share It also offers a cluster alias for the Internet protocol suite TCP IP so that a cluster appears as a single system to its network clients TruCluster Server preserves the availability and performance features found in the earlier TruCluster products e Like the TruCluster Available Server Software and TruCluster Production Server products TruCluster Server lets you deploy highly available applications that have no embedded knowledge that they are executing in a cluster They can access t
36. reboot P00 gt gt gt boot warning main memory zone is not free POO gt gt gt init P00 gt gt gt boot If you have initialized and booted the system then shut down the system and try to use the wwidmgr utility you may be prevented from doing so If you receive the following error initialize the system and retry the wwidmgr command P00 gt gt gt wwidmgr show adapter wwidmgr available only prior to booting Reinit system and try again POO gt gt gt init P00 gt gt gt wwidmgr show adapter For more information on the wwidmgr utility see the Wwidmgr User s Manual which is on the Alpha Systems Firmware U pdate CD ROM in the Doc directory Use the worldwide ID manager to show all KGPSA adapters P00 gt gt gt wwidmgr show adapter Link is down item adapter WWN Cur Topo Next Topo pga0 0 0 3 1 Nvram read failed 0 pgad0 0 0 3 1 1000 0000 c920 eda0 FABRIC UNAVAIL pgb0 0 0 4 0 Nvram read failed 1 pgb0 0 0 4 0 1000 0000 c920 da0l1 FABRIC UNAVAIL pgc0 0 0 5 1 Nvram read failed 2 pgc0 0 0 5 1 1000 0000 c920 cd9c FABRIC UNAVAIL 9999 All of the above Using Fibre Channel Storage 6 25 The Link is down message indicates that one of the adapters is not available probably due to its not being plugged into a switch The warning message Nvram read failed indicates that the KGPSA NVRAM has not been initialized and formatted The next topology will always be UNAVAIL for the host bus adapter
37. storage shelf but use a DWZZB VW signal converter to connect a wide differential host bus adapter toa non UltraSCSI BA356 single ended and wide storage shelf The DS BA35X DA personality module is used in an UltraSCSI BA356 to connect an UltraSCSI host bus adapter to the single ended disks in the UltraSCSI BA356 You could install a DWZZB VW in an UltraSCS I BA356 9 2 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices but you would waste a disk slot and it would not work with a KZPBA CB if there are any UltraSCSI disks in the storage shelves The following sections discuss the DWZZA and DWZZB signal converters and the DS BA35X DA personality module 9 1 2 Using the SCSI Bus Signal Converters TheDWZZA and DWZZB signal converters are used in the BA350 and BA356 storage shelves They have removable termination The DS BA35X DA personality module is used in the UltraSCSI BA356 It has switch selectable differential termination The single ended termination is active termination The following sections describe termination for these signal converters in more detail 9 1 2 1 DWZZA and DWZZB Signal Converter Termination Both the single ended side and the differential side of each DWZZA and DW2ZZB signal converter has removable termination To use a signal converter you must remove the termination in the differential side and attach a trilink connector to this side To remove the differential termi
38. tape drive 1 SCSI ID 4 is on SCSI Port B and is terminated on the tape drive Configuring a Shared SCSI Bus for Tape Drive Use 8 53 Thelower bay bottom shelf tape drive tape drive 0 SCSI ID 3 is on SCSI Port C and is terminated on the tape drive Thetape drive terminators are 68 pin differential terminators part number 0415619 Figure 8 16 TL896 Six Bus Configuration 0415498 50 Pin Micro D Terminator 0425031 SCSI Diff Feed Through 0425017 Cable MUC E SCSI Address 2 0415619 a i 68 pin Terminator 0415619 68 pin Terminator Lower Bay 0415619 a i 68 pin Terminator 0415619 68 pin Terminator SS SCSI Port G Rear Connector Panel SCSI Port H SCSI Port B SCSI Port E Ss SCSI Port C SCSI Port F SCSI Port ZK 1327U Al 8 11 6 Connecting the TL893 and TL896 Automated Tape Libraries to the Shared SCSI Bus The TL893 and TL896 Automated Tape Libraries ATLs have up to 3 meters of internal SCSI cabling on each SCSI bus Because of the internal SCSI cable lengths it is not possible to use a trilink connector or Y cable to terminate the SCSI bus external to the library as is done with other devices 8 54 Configuring a Shared SCSI Bus for Tape Drive Use on the shared SCSI bus Each SCSI bus must be terminated internal tothe tape library at the tape drive itself with the installed SCSI terminators Therefore TL893 and TL896 tape libraries must be
39. termination resistors RM 1 RM8 as shown in Figure 4 1 10 1 4 5 Updating the KZPSA BB Adapter Firmware You must check and update as necessary the system and host bus adapter firmware The firmware may be out of date Read the firmware release notes from the AlphaSystems Firmware Update CD ROM for the applicable system SCSI adapter If the Standard Reference Manual SRM console or KZPSA BB firmware is not current boot the Loadable Firmware Update LFU utility from the Alpha Systems Firmware Update CD ROM Choose the update entry from the list of LFU commands LFU can update all devices or any particular device you select When you boot the Systems Firmware Update CD ROM you can read the firmware release notes After booting has completed enter read _rel notes at the UPD gt prompt You can also copy and print the release notes as shown in Section 4 2 To update the firmware boot the LFU utility from the Alpha Systems Firmware Update CD ROM It is not necessary to use the flag option to the boot command Insert the Alpha Systems Firmware Update CD ROM and boot For example to boot from dka600 POO gt gt gt boot dka6 00 10 18 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices The boot sequence provides firmware update overview information Use Return to scroll the text or press Ctrl C to skip the text After the overview information has been displayed the name of the default
40. 0656 DKA500 RRD46 1337 DKCO HSZ70 V71Z DKC1 HSZ70 V71Z DKC7 HSZ70 V71Z DKDO HSZ40 YAO3 DKD1 HSZ40 YA03 DKD100 HSZ40 YA03 DKD101 HSZ40 YA03 DKD102 HSZ40 YA03 DKD7 HSZ40 YA03 DVAO EWAO 00 06 2B 00 0A 48 FWAO 08 00 2B B9 0D 5D PKAO SCSI Bus ID 7 PKBO SCSI Bus ID 7 PKCO SCSI Bus ID 7 5 57 PKDO SCSI Bus ID 7 5 57 4 12 TruCluster Server System Configuration Using UltraSCSI Hardware Example 4 3 shows the output from the show config console command entered on an AlphaServer 8200 system Example 4 3 Displaying Configuration on an AlphaServer 8200 gt gt gt show config Name Type Rev Mnemonic TLSB 4 KN7CC AB 8014 0000 kn7cc ab0 5 MS7CC 5000 0000 ms7cc0 8 KFTIA 2020 0000 kftiaod C0 Internal PCI connected to kftiao pcio 0 QLogic ISP1020 10201077 0001 ispo 1 QLogic ISP1020 10201077 0001 ispl 2 DECchip 21040 AA 21011 0023 tulipo 4 QLogic ISP1020 10201077 0001 isp2 5 QLogic ISP1020 10201077 0001 isp3 6 DECchip 21040 AA 21011 0023 tulipl C1 PCI connected to kftia0 0 KZPAA 11000 0001 kzpaa0 1 QLogic ISP1020 10201077 0005 isp4 2 KZPSA 81011 0000 kzpsao 3 KZPSA 81011 0000 kzpsal 4 KZPSA 81011 0000 kzpsa2 7 DEC PCI MC 181011 000B mco Example 4 4 shows the output from the show device console command entered on an AlphaServer 8200 system Example 4 4 Displaying Devices on an AlphaServer 8200 gt gt gt show device polling for units on isp0 slot0 bus0 hose0 polling for units o
41. 1 View adapter s current Topology N d Display Attached Adapters Change targeted adapter w x Exit sarebu 6 66 Using Fibre Channel Storage View adapter s Target Id Mappings 3 Change Target ID Mappings emx0 T Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration This chapter contains information about using AlphaServer GS80 160 320 hard partitions in a TruCluster Server Version 5 1 configuration with Tru64 UNIX Version 5 1 7 1 Overview An AlphaServer GS80 160 320 system provides the capability to define individual subsets of the system s computing resources Each subset is capable of running an operating system The Tru64 UNIX Version 5 1 operating system supports hard partitions which are partitions that are defined by a quad building block QBB boundary All the CPUs memory and I O resources in a QBB are part of a hard partition you cannot split the components across multiple hard partitions and resources cannot be shared between hard partitions A partition can include multiple QBBs The TruCluster Server Version 5 1 product supports the use of AlphaServer GS80 160 320 hard partitions as a cluster member system You can compose a cluster entirely of the partitions on a system or of AlphaServer GS80 160 320 partitions and other AlphaServer systems You can view an AlphaServer GS80 160 320 hard partition as a separate standalone system The AlphaServer GS80 160 320 s
42. 1 2 to prepare the BA350 and BA356 Ensure that the BA356 is configured for SCSI IDs 8 through 14 2 If either storage shelf will be at the end of the shared SCSI bus attach an H879 AA terminator to the H885 AA trilink on the DWZZA or DW2ZZB for the storage shelf that will be at the end of the bus You can choose either storage shelf to be on the end of the bus 3 Connect aBN21K or BN21L between the H885 AA trilink on the DWZZA BA350 and the H 885 AA trilink on the DWZZB BA356 4 When the KZPSA BB or KZPBA CB host bus adapters have been installed e Ifthe storage shelves are on the end of the shared SCSI bus connect a BN21K or BN21L cable between the BN21W 0B Y cables on the host bus adapters Connect another BN21K or BN21L cable between the BN21W O0B Y cable with an open connector and the H 8855 AA trilink on the storage shelf with an open connector e If the storage shelves are in the middle of the shared SCSI bus connect a BN21K or BN21L cable between the BN21W 0B Y cable on each host bus adapter and the H8855 AA trilink on a storage shelf 9 18 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices Figure 9 9 shows a two member TruCluster Server configuration using a BA350 and a BA356 for storage Figure 9 9 BA350 and BA356 Cabled for Shared SCSI Bus Usage Network Member System 2 Memory Channel KZPSA BB ID 7 Memory Channel Interface
43. 1 The number within the brackets is the item number of the device shown on any particular line 2 The UDID is assigned at the HSG80 with the set Dn IDENTIFIER xxx command and is not used by the Tru64 UNIX operating system but may be set as we have done with the SET D131 IDENTIFIER 131 group of commands When the identifier is not set at the HSG80 a value of 1 is displayed 3 The worldwide name for the device It is prefixed with the value WWID 01000010 The most significant 64 bits of the worldwide name resembles the HSG80 worldwide name and is assigned when the unit is manufactured The least significant 64 bits is a volume serial number generated by the HSG80 You can use the HSG80 SHOW unit command to determine the worldwide name for each storage unit as shown in Example 6 2 4 The console environment variable set for this worldwide name Only 4 wwidn console environment variables wwid0 wwid1 wwid2 and wwid3 can beset The console show dev command only shows those disk devices for which a wwidn console environment variable has been set using the wwidmgr quickset Using Fibre Channel Storage 6 45 or wwidmgr set command In this example none of the wwidn environment variables is set 4 Look through the wwidmgr show wwid display see Example 6 4 and locate the UDID for the Tru64 UNIX disk 133 and each member system boot disks 131 132 to ensure the storage unit is seen Asa second check compare the
44. 1fe1 0001 4770 0009 9171 3579 0007 ev none 2 UDID WWID 01000010 6000 1fe1 0001 4770 0009 9171 3579 0009 ev none 3 UDID WWID 01000010 6000 1fe1 0001 4770 0009 9171 3579 000a ev none 4 UDID WWID 01000010 6000 1fe1 0001 4770 0009 9171 3579 000b ev none 5 UDID WWID 01000010 6000 1fe1 0001 4770 0009 9171 3579 000c ev none 6 UDID WWID 01000010 6000 1fe1 0001 4770 0009 9171 3579 000d ev none 71 UDID WWID 01000010 6000 1fe1 0001 4770 0009 9171 3579 000e ev none 8 UDID WWID 01000010 6000 1fe1 0001 4770 0009 9171 3579 000f ev none 9 UDID WWID 01000010 6000 1fe1 0001 4770 0009 9171 3579 0010 ev none 0 UDID 131 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002f ev none UDID 132 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 0030 ev none 2 UDID 133 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002e ev none 3 UDID 141 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 0029 ev none 4 UDID 142 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002a ev none 5 UDID 143 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002b ev none 6 UDID 144 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 0028 ev none 7 UDID 1 WWID 01000010 6000 1fe1 0000 0ca0 0009 8090 0708 002b ev none 8 UDID 1 WWID 01000010 6000 1fe1 0000 0ca0 0009 8090 0708 002c ev none 9 UDID 1 WWID 01000010 6000 1fe1 0000 0ca0 0009 8090 0708 002d ev none 20 UDID 1 WWID 01000010 6000 1fe1 0000 0ca0 0009 8090 0708 002e ev none 1 2 3 4
45. 2 8 SES Cablesisscrcscashsb onc ta coma er AAEE eee Ree a N A 2 12 2 9 SCSI Terminators and Trilink Connectors cc cece cece eee 2 14 3 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 1 Shared SCSI Bus Configuration Requirements 55 3 2 3 2 SCSI Bus Performance cccce cece eee cece ee eee eee eens 3 3 3 2 1 SCSI Bus Versus SCSI Bus Segments ceeee eee 3 3 3 2 2 Transmission Methods ceceeeee eect eee eee teen 3 4 3 2 3 Data Path r2s cxseeieti ia saevac E EUA NEEE EE E AAA SAAR Aa 3 5 3 2 4 BUSS Peed 25 ieont titan a uraa Aiae vanes AA ace 3 5 3 3 SCSI Bus Device Identification Numbers 0000e 3 5 3 4 SCSI Bus Length oiaccc cee vieecnsieee i ei ee esi ened edie 3 6 3 5 Terminating the Shared SCSI Bus When Using UltraSCSI PUUDS aaa eaten oe At Men nant fees E ER N E ate 3 7 3 6 WltraS SI HUBS insna i alan uate genetic aee E A Aa ee east 3 8 3 6 1 Using a DWZZH UltraSCSI Hub in a Cluster Configuration ehces ceeded cee eave eidd cet EE iee sevice 3 8 3 6 1 1 DS DWZZH 03 Description ecceeeee ener eee 3 9 3 6 1 2 DS DWZZH 05 Description cc cece eee e eee 3 10 3 6 1 2 1 DS DWZZH 05 Configuration Guidelines 3 10 3 6 1 2 2 DS DWZZH 05 Fair Arbitration 0055 3 12 3 6 1 2 3 DS DWZZH 05 Address Configurations 3 13 3 6 1 2 4 SCSI Bus Termination Power 0ceeeee ees 3 15
46. 24 01 09 T4 0 07 06 ON SrvSw NORMAL XSROM T05 4 03 24 02 10 CPUO0 SROM V5 0 7 ON CPU1 SROM V5 0 7 ON CPU2 SROM V5 0 7 ON CPU3 SROM V5 0 7 ON HPM T05 4 03 24 01 18 X4 1 08 18 ON SCM MASTER T05 4 03 24 01 21 T4 2 09 08 ON SCM SLAVE T05 4 03 24 01 21 T4 2 09 08 ON Ineligible The console serial bus CSB node ID or in the case of a QBB the CPU number in the QBB The CSB node address ranges are as follows 10 to 1f PCI backplane manager PBM The CSB node ID is based on the PCI drawer node ID setting e0 to e7 System control manager SCM The CSB node ID is also based on the PCI drawer node ID setting 30 to 37 Power system manager PSM Based on the hard QBB ID QBB 0 7 40 Hierarchical switch power manager HPM CO to CF In response to the SCM show csb command the PSM provides CSB node addresses for the CPUs and I O risers even though they are not on the console serial bus This enables SCM commands to be directed at any specific CPU for instance power off cpu c4 ThePSM responds to SCM commands and powers the CPU on or off The type of CSB node PBM PCI backplane manager PSM Power system manager HPM Hierarchical switch power manager Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 17 e SCM master This PCI primary drawer has the master SCM e SCM slave TheSCM on this PCI primary drawer is a slave and has not been desi
47. 255 An additional increment at a count of 255 resets the count to 0 Tab Esc Leftward triangle Allows you to tab through multiple optional functions for example the fields in an IP address You can use this button to abort an entry which takes you to the previous menu item If pressed repeatedly the front panel display will turn off Enter Rightward triangle Causes the switch to accept the input you have made and move to the next function 6 5 1 2 2 Setting the Ethernet IP Address and Subnet Mask from the Front Panel Before you telnet to the switch you must connect the Ethernet cable and then set the Ethernet IP address and subnet mask To use the front panel to set the Ethernet address and subnet mask follow these steps 1 Press any of the switch front panel buttons to activate the display for the top level menu If the Configuration Menu is not displayed press the down button repeatedly until it is displayed Select Menu Configuration Menu Using Fibre Channel Storage 6 19 Note Pressing the down button selects the next lower top level menu The top level menus are Configuration Menu Operation Menu Status Menu Test Menu 2 Press Enter to display the first submenu item in the configuration menu Ethernet IP address Ethernet IP address 10 00 00 10 The underline cursor denotes the selected address field Use the up or down button to increase or decrease the displayed number Use the T
48. 3 Connect aBN37A VHDCI to VHDCI cable between the H 8861 AA trilink connectors on the UltraSCSI BA356s 4 When the KZPSA BBs or KZPBA CBs are installed e If one of the UltraSCSI BA356s is on the end of the SCSI bus install a BN38C or BN38D HD68 to VHDCI cable between one of the BN21W OB Y cables on the host bus adapters and the open connector on the H 8861 AA trilink connector on the DS BA35X DA personality module Connect the BN21W 0B Y cables on the two member system host adapters together with a BN21K or BN21L cable e Ifthe UltraSCS I BA356s arein the middle of the SCSI bus install a BN38C or BN38D HD68 to VHDCI cable between the BN21W 0B Y cable on each host bus adapter and the open connector on the H 8861 AA trilink connector on the DS BA35X DA personality modules 9 22 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices Figure 9 11 shows a two member TruCluster Server configuration using two UltraSCSI BA356s for storage Figure 9 11 Two UltraSCSI BA356s Cabled for Shared SCSI Bus Usage Network Member Member a i iManiony Syete Channel Interface Memory Channel Memory Channel KZPBA CB ID 6 KZPBA CB ID 7 UltraSCSI BA356 Clusterwide usr var ID8 Member 1 Boot Disk ne Member 2 Boot Disk ID 10 eee ID 11 __ Data ID 4 ID 12 disks l Do not use for Da ID 13
49. 5 4 provide two sequences that you can follow while carrying out the steps of Table 5 4 Figure 5 2 shows a dual redundant virtual hub configuration using MC1 hardware being upgraded to MC2 Figure 5 3 through Figure 5 8 show a three node standard hub configuration being upgraded from MC1 toMC2 Note When you upgrade from dual redundant MC1 hardware to dual redundant MC2 hardware you must replace all the MC1 hardware on one interconnect before you start on the second interconnect except as described in step 4 of Table 5 4 Memory Channel adapters jumpered for 512 MB may require a minimum of 512 MB physical RAM memory Ensure that your system has enough physical memory to support the upgrade For two MC2 Memory Channel adapters you will need more than 1 GB of physical memory 5 14 Setting Up the Memory Channel Cluster Interconnect Table 5 4 Adding a Memory Channel Interconnect or Rolling from a Dual Redundant MC1 Interconnect to MC2 Interconnects Step Action Refer to 1 If desired manually relocate all applications from the TruCluster cluster member that will be shut down using the duster Server Cluster application availability CAA caa_relocate command Administration 2 On the system having an MC1 adapter installed Tru64 UNIX or replaced log in as the root user and execute the Systen shutdown h utility to halt the system Administration Note After the system is at the console prompt use the console set co
50. 6 16 6 17 6 18 6 19 6 21 6 22 6 23 6 23 6 23 6 24 6 27 6 28 6 33 6 34 6 36 6 36 6 40 6 43 6 48 6 49 6 6 2 Install the Tru64 UNIX Operating System 065 6 51 6 6 3 Determining dev disk dskn to Use for a Cluster nstallati sige a va ceay tata ear tetee ace Ta A AET a 6 51 6 6 4 Label the Disks to Be Used to Create the Cluster 6 53 6 6 5 Install the TruCluster Server Software and Create the First Cluster Member cccccceeceeeeeeeeeeeneeeeennees 6 53 6 6 6 Reset the bootdef_dev Console Environment Variable 6 53 6 6 7 Add Additional Systems to the Cluster 000 6 55 6 7 Converting the HSG80 from Transparent to Multiple Bus Failover Mode snorren me e davedtaeesiaas 6 57 6 7 1 OVEJITA aa e eh a a 6 58 6 7 2 Procedure to Convert from Transparent to Multiple bus Failover Mode ccccccceeeeeeseeeeeseeeeeeaeeeeeeaneeeennees 6 59 6 8 Using the emx Manager to Display Fibre Channel Adapter Information seseris ei e a A a a ai i ed vas 6 62 6 8 1 Using the emxmor Utility to Display Fibre Channel Adapter Information 0 cceeeeeee eee rrenen erenn 6 62 6 8 2 Using the emxmgr Utility Interactively 005 6 65 7 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 1 OVENVIOW oori narea eg aaa ates e eee 7 1 7 2 Hardware Requirements for a Hard Partition ina Cluster 7 2 7 3 Configuring Partiti
51. 77 cabling 8 74 8 77 capacity 8 74 firmware 8 75 internal cabling 8 76 number of drives 8 74 part numbers 8 74 SCSI connectors 8 77 setting SCSI IDs 8 75 tape cartridges 8 74 tape drives 8 74 termination 8 77 upgrading 8 74 F F Port 6 6 fabric 6 5 6 7 failover mode changing 6 58 multiple bus 6 58 set nofailover 6 59 transparent 6 58 FCP 6 4 Fibre Channel arbitrated loop 6 8 data rates 6 4 distance 6 4 F Port 6 6 fabric 6 5 6 7 FL_Port 6 5 frame 6 5 N Port 6 5 NL_Port 6 5 point to point 6 6 restrictions 2 5 supported configurations 6 9 switch installation 6 16 terminology 6 5 topology 6 6 6 64 Fibre Channel Protocol SeeFCP file var adm messages 6 27 firmware 35 70 DLT tape drives 8 75 ESL9326D 8 75 fail safe loader 7 18 HSG80 6 29 KZPBA CB 2 9 4 7 7 13 10 5 KZPSA 10 18 KZPSA BB 2 8 2 9 10 5t 10 18 obtaining release notes 4 4 reset system for update 7 21 10 19 SRM console 4 7t 7 4 10 5t 10 18 SROM 7 18 TL894 8 37 TL895 8 44 update CD ROM 4 4 updating 10 18 updating GS80 160 320 7 18 FL_ Port 6 5 G GBIC 2 7 6 17 GigaBit nterface Converter SeeGBIC Gigabit Link Module SeeGLM GLM 2 7 H hard partition defined 7 1 repartitioning 7 8 requirements 7 2 hardware components SCSI adapters 2 5 SCSI cables 2 12 SCSI signal converters 2 11 storage shelv
52. Compaq customer service You can set the user names and passwords for users at or below the security level of the present login level by executing the passwd command Enter a new user name if desired and a new password for the user 6 22 Using Fibre Channel Storage Notes Use Ctrl H to correct typing errors Use the logout command to log out from any telnet connection 6 5 1 2 5 Setting the Switch Name via Telnet Session After you set the IP address and subnet mask you can use a telnet session to log in to the switch to complete other switch management functions or monitor switch status For example if a system s etc hosts file contains an alias for the switch s IP address set the switch name to the alias This allows you to telnet to the switch name from that system Telnet froma system that has the IP address in its etc hosts file and set the switch address as follows telnet 132 25 47 146 Return User admin Return Passwd Return Admin gt switchName fcswl1 Return Admin gt switchName Return fcswl Admin gt Note When you telnet to the switch the next time the prompt will include the switch name for example fcswl Admin gt 6 5 2 Installing and Configuring the KGPSA PCI to Fibre Channel Adapter Module The following sections discuss KGPSA installation and configuration 6 5 2 1 Installing the KGPSA PCI to Fibre Channel Adapter Module
53. D The maximum combined length of the BN38C and BN21K or BN21L cables on the storage SCSI bus segment must not exceed 25 meters 9 30 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices Figure 9 15 shows a sample configuration that uses KZPSA BB SCSI adapters a DS DWZZH 05 UltraSCSI hub and an HSZ50 RAID array controller Figure 9 15 TruCluster Server Cluster Using KZPSA BB SCSI Adapters a DS DWZZH 05 UltraSCSI Hub and an HSZ50 RAID Array Controller Network Member System 1 Memory Channel KZPSA BB ID 4 2 Memory Channel KZPSA BB ID 5 Member System 4 T KZPSA BB ID7 Memory Channel 3 KZPSA BB ID 6 Memory Channel ZK 1767U AI Note The systems shown in Figure 9 15 use KZPSA BB SCSI adapters They could be KZPBA CB UltraSCSI adapters without changing any cables in the configuration Table 9 4 shows the components used to create the cluster shown in Figure 9 15 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 31 10 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices This chapter describes how to prepare the systems for a TruCluster Server cluster when there is a need for external termination or radial connection to non UltraSCSI RAID array controllers HSZ40 and HSZ50 This chapter does not provide detailed informatio
54. Drive Use Table 8 18 DLT MiniLibrary Part Numbers cont DLT Library Component Number of Tape Tabletop Rackmount Part Number Drives TL891 DLT MiniLibrary 2 Rackmount 120876 B 22 Base Unit Add on DLT 35 70 drive 1 N A 120878 B 21 for TL891 MiniLibrary Expansion Unit N A Rackmount 120877 B21 MiniLibrary Data Unit N A Rackmount 128670 B21 Note The TL881 DLT MiniLibrary tabletop model is available as fast wide differential or fast wide single ended The single ended model is not supported in a cluster configuration The TL891 DLT MiniLibrary tabletop model is only available as fast wide differential 8 12 2 Preparing a TL881 or TL891 MiniLibrary for Shared SCSI Bus Use The following sections describe how to prepare the TL881 and TL891 DLT MiniLibraries for shared SCSI bus usein more detail 8 12 2 1 Preparing a Tabletop Model or Base Unit for Standalone Shared SCSI Bus Usage A TL881 or TL891 DLT MiniLibrary tabletop mode or a rackmount base unit may be used standalone You may want to purchase a rackmount base unit for future expansion Note To achieve system performance capabilities we recommend placing no more than two tape drives on a SCSI bus and also recommend that no shared storage be placed on the same SCSI bus with a tape library The topics in this section provide information on preparing the TL881 or TL891 DLT MiniLibrary tabletop model or rackmount base unit for use on a shared SCS
55. Fibre Channel host bus adapters and that the worldwide name for KGPSA pga is 1000 0000 C920 DA01 Example 6 1 shows that the connections for pga are NEWCON49 NEWCON50 NEWCON54 and NEWCONS56 You could change the name of NEWCON4 9 to indicate that it is the first connection of four to pga on member system pepicelli as follows HSG80 gt rename NEWCON49 pep pga 1 13 For each connection to your cluster verify that the operating system is TRU64_UNIX and the unit offset is 0 Search the show connection display for the worldwide name of each of the KGPSA adapters in your cluster member systems If the operating system and offsets are incorrect set them then restart both controllers as follows HSG80 gt set NEWCON49 unit offset 0 1 HSG80 gt set NEWCON49 operating system TRU64 UNIX 2 HSG80 gt restart other 3 HSG80 gt restart this 3 HSG80 gt show connection 4 1 Set the relative offset for LUN numbering to 0 You can set the unit _offset to nonzero values but use caution Make sure you understand the impact 2 Specify that the host environment connected to the Fibre Channel port is TRU64_UNIX You must change each connection to TRU64_UNIX This is very important Failure to set this to TRU64_ UNIX will prevent your system from booting correctly recovering from run time errors or from booting at all The default operating system is Windows NT and NT uses a
56. Figure 8 9 ccc cece eee eee cnet eee ee eee eae Hardware Components Used to Create the Configuration Shown in Figure 8 10 0 ccc cece eee cnet ee eee eee ena 2 10 2 10 2 13 2 14 3 5 3 6 3 11 3 21 4 6 8 28 8 33 Contents xv 8 20 8 21 9 1 xvi Contents TL894 Default SCSI ID SettingS cece cece cece eee eee Hardware Components Used to Create the Configuration Shown in Figure 8 12 cc cece ee eect ee eee eae eae TL895 Default SCSI ID SettingS cece cece eee eee eee MUC Switch FUNCtIONS 00 cece eee eee eae MUC SCSI ID Selection ccc cece eee eee ee eee eee TL893 Default SCSI IDS cece cece eee eee ee eae TL896 Default SCSI IDS cece cece eee eee ee eae Hardware Components Used to Create the Configuration Shown in Figure 8 16 cece eee cnet eee eee eee eae TL881 and TL891 MiniLibrary Performance and Capacity Compari Son agence essed edge an eda eee eee ie DLT MiniLibrary Part Numbers ccceeeeeeee eee e eee Hardware Components Used to Create the Configuration Shown in Figure 8 17 00 0 cece ccc ee eee eee ee eee eee eens Hardware Components Used to Create the Configuration Shown in Figure 8 18 00 cece eect ee eee eee eae Shared SCSI Bus Cable and Terminator Connections for the ESL9326D Enterprise Library cccceeeeeeee tenet teens Hardware Components Used for Co
57. H8861 AA VHDCI trilink connector 4 H8863 AA VHDCI terminator 5 BN21W 0B Y cable 6 H879 AA terminator 7 328215 00X BN21K or BN21L cables 8 4 Configuring a Shared SCSI Bus for Tape Drive Use Table 8 2 Hardware Components Used to Create the Configuration Shown in Figure 8 2 cont Callout Number Description 8 DWZZA VA with H885 AA trilink connector 9 DWZZB VW with H885 AA trilink connector a The maximum length of the BN38C or BN38D cable on one SCSI bus segment must not exceed 25 meters The maximum length of the BN37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters 8 1 3 Setting the TZ88N TA SCSI ID The TZ88N TA SCSI ID is set with a push button counter switch on the rear of the unit Push the button above the counter to increment the address push the button below the counter to decrement the address until you have the desired SCSI ID selected 8 1 4 Cabling the TZ88N TA You must connect the TZ88N TA tabletop model to a single ended segment of the shared SCSI bus It is connected to a differential portion of the shared SCSI bus with a DWZZA AA or DWZZB AA Figure 8 7 shows a configuration of a TZ885 for use on a shared SCSI bus You can replace the TZ885 shown in the illustration with a TZ88N TA To configure the shared SCSI bus for use with a TZ88N TA follow these steps 1 You will need one DWZZA AA or DWZZB AA for each TZ88N TA Ensure that DWZ
58. HSG80 gt HSG80 gt HSG80 gt HSG80 gt HSG80 gt SET SET SET SET SET SET SET SET NEWCON4 9 NEWCONS51 NEWCONS5 NEWCONS56 NEWCON57 NEWCON6 0 NEWCON61 NEWCON6 5 UNIT OFFSET UNIT OFFSET UNIT OFFSET UNIT OFFSET UNIT OFFSET UNIT OFFSET UNIT OFFSET UNIT OFFSET ooo 0000 0 5 At the console of each system accessing storage units on this HSG80 follow these steps a Usethe wwid manager to show the Fibre Channel environment variables and determine which units are reachable by the system This is the information the console uses when not in wwidmgr mode to find Fibre Channel devices P00 gt gt gt wwidmgr wwido wwid1 wwid2 wwid3 N1 N2 N3 N4 show ev 133 1 131 1 132 1 50001fe100000d64 6 60 Using Fibre Channel Storage WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002e WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002f WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 0030 Note You must set the console to diagnostic mode to use the wwidmgr command for the following AlphaServer systems AS1200 AS4x00 AS8x00 GS60 GS60E and GS140 Set the console to diagnostic mode as follows P00 gt gt gt set mode diag Console is in diagnostic mode P00 gt gt gt For each wwidn line record the unit number 131 132 and 133 and worldwide name for the storage unit The unit number is the first field in the display after wwidn The Nn value is the HSG80 port being used to acc
59. MUC s SCSI Address 2 0425017 Cable O TZ89 Tape Drive _62 SCSI Address5 top shelf TZ89 Tape Drive 620 SCSI Address 4 o middle shelf TZ89 Tape Drive 0S SCSI Address 3 J a bottom shelf Drive Housing A 0415619 aa 68 pin Micro D Terminator 0415619 aa 68 pin Micro D Terminator SCSI PortA SCSIPortB SCSI Port C Rear Connector Panel ZK 1326U Al The SCSI input for the TL896 is also high density 68 pin differential The default internal cabling configuration for the TL896 is a six bus configuration shown in Figure 8 16 as follows Theupper bay top shelf tape drive tape drive 5 SCSI ID 5 and MUC SCSI ID 2 are on SCSI Port D To allow the use of the same MUC and terminator used with the TL822 and TL826 a 68 pin to 50 pin adapter is used on the MUC to connect the SCSI cable from the tape drive to the MUC In Figure 8 16 it is shown as part number 0425031 SCSI Diff Feed Through This SCSI bus is terminated on the MUC with terminator part number 0415498 a 50 pin Micro D terminator Theupper bay middle shelf tape drive tape drive 4 SCSI ID 4 is on SCSI Port E and is terminated on the tape drive Theupper bay bottom shelf tape drive tape drive 3 SCSI ID 3 is on SCSI Port F and is terminated on the tape drive Thelower bay top shelf tape drive tape drive 2 SCSI ID 5 is on SCSI Port A and is terminated on the tape drive Thelower bay middle shelf tape drive
60. Manual xvii Chapter 7 Describes the use of AlphaServer GS80 GS160 or GS320 hardware partitions in a TruCluster Server configuration Chapter 8 Describes how to configure a shared SCSI bus for tape drive tape loader or tape library usage Chapter 9 Describes the requirements for a shared SCSI bus using externally terminated configurations and radial configurations using non UltraSCSI RAID array controllers Chapter 10 Describes how to prepare systems and host bus adapters for the TruCluster Server configurations described in Chapter 9 Appendix A Provides a blank table to use to convert from the HSG80 unit numbers to dev disk dskn and device names for an actual Fibre Channel TruCluster Server configuration Related Documents xviii Consult the following manuals for assistance in TruCluster Server installation administration and programming tasks TruCluster Server Software Product Description SPD The comprehensive description of the TruCluster Server Version 5 1 product You can find the latest version of the SPD and other TruCluster Server documentation at the following URL http www tru 4unix compaq com faqs publications pub page cluster list html Release Notes Provides important information about TruCluster Server Version 5 1 Technical Overview Provides an overview of the TruCluster Server technology Software Installation Describes how to install the TruCluster Server product
61. Name Storageset Uses Used by BOOT MIR mirrorset DISK30200 DISK40000 Switches POLICY for replacement BEST_PERFORMANCE COPY priority NORMAL READ_SOURCE LEAST_BUSY MEMBERSHIP 2 2 members present State UNKNOWN State only available when configured as a unit Size 8378028 blocks HSG80 gt SHOW CROOT MIR 4 Name Storageset Uses Used by CROOT MIR mirrorset DISK30300 DISK40100 Switches POLICY for replacement BEST PERFORMANCE COPY priority NORMAL READ SOURCE LEAST BUSY MEMBERSHIP 2 2 members present State UNKNOWN State only available when configured as a unit Size 8378028 blocks Using Fibre Channel Storage 6 37 Example 6 2 Setting Up the Mirrorset cont HSG80 gt CREATE PARTITION BOOT MIR SIZE 25 5 HSG80 gt CREATE PARTITION BOOT MIR SIZE 25 5 HSG80 gt CREATE PARTITION BOOT MIR SIZE LARGEST 5 HSG80 gt CREATE_PARTITION CROOT MIR SIZE 5 6 HSG80 gt CREATE PARTITION CROOT MIR SIZE 15 6 HSG80 gt CREATE PARTITION CROOT MIR SIZE 40 6 HSG80 gt CREATE_PARTITION CROOT MIR SIZE LARGEST 6 HSG80 gt SHOW BOOT MIR 7 Name Storageset Uses Used by BOOT MIR mirrorset DISK30200 DISK40000 Switches POLICY for replacement BEST_PERFORMANCE COPY priority NORMAL READ_SOURCE LEAST_BUSY MEMBERSHIP 2 2 members present State UNKNOWN State only available when configured as a unit Size 8378028 blocks Partitions
62. Path from host bus adapter A to controller B port 2 You can set units preferred to a specific controller in which case both controllers will be active 3 Set the bootdef_dev console environment variable for member system 1 boot disk to a comma separated list of several of the boot path s that show up as connected in the reachability display wwidmgr quickset 6 54 Using Fibre Channel Storage or wwidmgr show reachability You must initialize the system to use any of the device names in the bootdef_dev variable as follows POO gt gt gt set bootdef dev dga131 1001 0 1 0 dga131 1004 0 1 0 dgb131 1002 0 2 0 dgb131 1003 0 2 0 POO gt gt gt init Note The console system reference manual SRM software guarantees that you can set the bootdef_dev console environment variable toa minimum of four device names You may be able to set it to five but four is all that is guaranteed 6 6 7 Add Additional Systems to the Cluster To add additional systems to the cluster follow this procedure 1 On the system where you installed the Tru64 UNIX operating system boot the system into the cluster single member cluster and referring to the TruCluster Server Software Installation procedures use clu_add_member to add subsequent duster members Before you boot the system being added to the cluster on the newly added cluster member a Usethe wwidmgr utility with the quickset option to set the device unit number for th
63. SCSI ID that you useis distinct from all other SCSI IDs on the same shared SCSI bus If you do not remember the other SCSI IDs or do not have them recorded you must determine these SCSI Ds If you are using a DS DWZZH 05 you cannot use SCSI ID 7 for a KZPSA BB or KZPBA CB host bus adapter SCSI ID 7 is reserved for DS DWZZH 05 use If you are using a DS DWZZH 05 and fair arbitration is enabled you must use the SCSI ID assigned to the hub port the adapter is to be connected to You will have problems if you have two or more SCSI adapters at the same SCSI ID on any one SCSI bus 7 Repeat steps 1 through 6 for any other KZPSA BBs or KZPBA CBs to be installed on this shared SCSI bus on other member systems 8 Connect a DS DWZZH 03 or DS DWZZH 05 Section 9 4 4 to an HSZ40 or HSZ50 10 1 2 Installing a KZPSA BB or KZPBA CB Using External Termination Use the steps in Table 10 3 to set up a KZPSA BB or KZPBA CB for a TruCluster Server cluster using the old method of external termination and Y cables 10 6 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices Table 10 3 Installing a KZPSA BB or KZPBA CB for Use with External Termination Step Action Refer to 1 Remove the KZPSA BB internal termination Section 10 1 4 4 resistors Z1 Z2 Z3 Z4 and Z5 Figure 10 1 and KZPSA PCI to SCSI Storage Adapter Installation and User s Guide Remove the eight KZPBA CB internal te
64. To visually locate a disk enter ping lt disk gt where lt disk gt is the device name for example dsk0 of the disk you want to locate If that disk has a visible indicator light it will blink until you are ready to continue Device Size Controller Disk Name in GB Type Model Location 1 dsko 4 0 SCSI RZ2CA LA bus 0 targ 0 lun 0 2 dsk15 1 0 SCSI HSG80 IDENTIFIER 133 3 dsk17 2 0 SCSI HSG80 IDENTIFIER 131 If you flash the light on a storage unit logical disk that is a mirrorset stripeset or RAI Dset the lights on all disks in the storageset will blink Record the dev disk dskn value dsk15 for the Tru64 UNIX disk that matches the UDID 133 Table 6 2 Complete the installation following the instructions in the Tru64 UNIX Installation Guide 6 6 3 Determining dev disk dskn to Use for a Cluster Installation Before you can install the TruCluster Server software you must determine which dev disk dskn to use for the various TruCluster Server disks To determine the dev disk dskn to use for the cluster disks follow these steps 1 With the Tru64 UNIX Version 5 1 operating system at single user or multi user mode use the hardware manager hwmgr utility with the view devices option to display all devices on the system Pipe the command through the grep utility to search for any items with the IDENTIFIER qualifier hwmgr view dev grep IDENTIFIER HWID Device Name Mfg Model Location 62 dev dis
65. TruCluster Server Configuration with HSZ80 in Multiple Bus Failover Mode Member System 2 Memory Channel mca1 Memory Channel mca1 Memory Channel mca0 Memory Channel mca0 KZPBA CB ID 6 KZPBA CB ID 7 T recs i RZPBAOB D7 Memory Channel Interfaces Member System 1 DS DWZZH 03 ZK 1602U AI Table 3 4 shows the components used to create the cluster shown in Figure 3 8 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 25 4 TruCluster Server System Configuration Using UltraSCSI Hardware This chapter describes how to prepare systems for a TruCluster Server cluster using UltraSCSI hardware and the preferred method of radial configuration including how to connect devices to a shared SCSI bus for the TruCluster Server product This chapter does not provide detailed information about installing devices it describes only how to set up the hardware in the context of the TruCluster Server product Therefore you must have the documentation that describes how to install the individual pieces of hardware This documentation should arrive with the hardware All systems in the cluster must be connected via the Memory Channel cluster interconnect Not all members must be connected toa shared SCSI bus You need to allocate disks for the following uses e Oneor moredisks to hold the Tru64 UNIX operating system The disk s are either private disk s on
66. Using Fibre Channel Storage nodename 5000 1FE1 0000 0CBO SCSI tgt id 5 portname 1000 0000 C920 A7AE nodename 1000 0000 C920 A7AE SCSI tgt id 6 portname 1000 0000 C920 CD9C nodename 1000 0000 C920 CD9C SCSI tgt id 7 portname 1000 0000 C921 0D00 emx0 nodename 1000 0000 C921 0D00 The previous example shows four Fibre Channel devices on this SCSI bus The Fibre Channel adapter in question emxo at SCSI ID 7 is denoted by the presence of the emxo designation Usethe emxmgr t command to display the Fibre Channel topology for the adapter For example emxmgr t emxl emx1 state information 1 Link connection is UP Point to Point Fabric attached FC DID 0x210413 Link is SCSI bus 3 e g scsi3 SCSI target id 7 portname is 1000 0000 C921 07C4 nodename is 1000 0000 C921 07C4 N Port at FC DID 0x210013 SCSI tgt id 5 2 portname 5000 1FE1 0001 8932 nodename 5000 1FE1 0001 8930 Present Logged in FCP Target FCP Logged in N Port at FC DID 0x210113 SCSI tgt id 1 2 portname 5000 1FE1 0001 8931 nodename 5000 1FE1 0001 8930 Present Logged in FCP Target FCP Logged in N Port at FC DID 0x210213 SCSI tgt id 2 2 portname 5000 1FE1 0001 8941 nodename 5000 1FE1 0001 8940 Present Logged in FCP Target FCP Logged in N Port at FC DID 0x210313 SCSI tgt id 4 2 portname 5000 1FE1 0001 8942 nodename 5000 1FE1 0001 8940 Present Logged in FCP Target FCP Logged in N Port at FC DID 0x210513 SCSI tgt id 6 2
67. a KZPBA CB or KZPSA BB BN 38D VHDCI VHDCI toa port on an UltraSCSI hub BN37A Two VHDCI VHDCI Connects two VHDCI trilinks to to each other or an UltraSCSI hub toa VHDCI _ trilink on an HSZ70 or HSZ80 199629 002 or Two high 50 pin Connect a Compaq 20 40 GB DLT 189636 002 HD to Tape Drive to a DWZZB AA 68 pin HD 146745 003 or Two high 50 pin Daisy chain two Compaq 20 40 146776 003 HD to GB DLT Tape Drives 50 pin HD 189646 001 or Two high 68 pin Connect a Compaq 40 80 DLT Tape 189646 002 HD Drive toa DWZZB AA or daisy chain two Compaq 40 80 DLT Tape Drives a Do not use a KZPBA CB with a DWZZA AA or DWZZB AA and a TZ885 or TZ887 The DWZZAs and DWZZBs can not operate at UltraSCSI speed Always check a SCSI cable for bent or broken pins Be surethat you do not bend or break any pins when you connect or disconnect a cable Hardware Requirements and Restrictions 2 13 2 9 SCSI Terminators and Trilink Connectors Table 2 4 describes the supported trilink connectors and SCSI terminators and the context in which you would use them Table 2 4 Supported SCSI Terminators and Trilink Connectors Trilink Den Pins Configuration Use Connector or sity Terminator H885 AA Three 68 pin Trilink connector that attaches to high density 68 pin cables or devices such as a KZPSA BB KZPBA CB HSZ40 HSZ50 or the differential side of a SCSI signal converter Can be terminated with an H879 AA terminator to provide external termination
68. a host and the storage in a TruCluster Server configuration is 50 meters 25 meters between any host and the UltraSCSI hub and 25 meters between the UltraSCS I hub and the RAID array controller 3 6 Shared SCSI Bus Requirements and Configurations Using UltraSCS I Hardware Because of the cable length limit you must plan your hardware configuration carefully and ensure that each SCSI bus meets the cable limit guidelines In general you must place systems and storage shelves as close together as possible and choose the shortest possible cables for the shared bus 3 5 Terminating the Shared SCSI Bus When Using UltraSCSI Hubs You must properly connect devices to a shared SCSI bus In addition you can terminate only the beginning and end of each bus segment either single ended or differential There are two rules for SCSI bus termination e Thereare only twoterminators for each SCSI bus segment If you use an UltraSCSI hub you only have to install one terminator e If you do not use an UltraSCSI hub bus termination must be external External termination is covered in Section 9 2 Notes With the exception of the TZ885 TZ887 TL890 TL891 and TL892 tape devices can only be installed at the end of a shared SCSI bus These tape devices are the only supported tape devices that can be terminated externally We recommend that tape loaders be on a separate shared SCSI bus to allow normal shared SCSI bus termination for those shared
69. and W2 are installed to enable the single ended termination Remove the termination from the differential end by removing the five 14 pin SIP resistors Attach an H885 AA trilink connector to the differential end of the DWZZB AA Connect the single ended end of the DWZZB AA to the TZ887 with a BN21M cable Install an H8574 A or H8890 AA terminator on the other TZ887 SCSI connector Connect the trilink on the DWZZB AA to another trilink or Y cable on the differential shared SCSI bus with BN21K or BN21L cables Ensure that the trilink or Y cable at both ends of the shared SCSI bus is terminated with an H879 AA terminator The single ended SCSI bus may be daisy chained from one single ended tape drive to another with BC19J cables as long as the SCSI bus maximum Configuring a Shared SCSI Bus for Tape Drive Use 8 21 length is not exceeded and there are sufficient SCSI IDs available Ensure that the tape drive on the end of the bus is terminated with an H8574 A or H8890 AA terminator You can add additional shared SCSI buses with TZ887 tape drives by adding additional DWZZB AA TZ887 combinations Note Ensure that there is no conflict with tape drive and host bus adapter SCSI IDs Figure 8 9 Cabling a Shared SCSI Bus with a TZ887 Network Member System 2 Member System Memory Channel 1 Interface amaw o emee 11 KZPBA CB ID 6 KZPBA CB I
70. appropriate bus connection including installing SCSI controllers UltraSCS I hubs trilink connectors and SCSI signal converters After you install all necessary cluster hardware and connect the shared SCSI buses be sure that the systems can recognize and access all the shared disks See Section 4 3 2 You can then install the TruCluster Server software as described in the TruCluster Server Software nstallation manual 4 1 Planning Your TruCluster Server Hardware Configuration Before you set up a TruCluster Server hardware configuration you must plan a configuration to meet your performance and availability needs You must determine the following components for your configuration e Number and type of member systems and the number of shared SCSI buses You can use two to eight member systems for TruCluster Server A greater number of member systems connected to shared SCSI buses gives you better application performance and more availability However all the systems compete for the same buses to service I O requests soa greater number of systems decreases O performance Each member system must have a supported SCSI adapter for each shared SCSI bus connection There must be enough PCI slots for the Memory Channel cluster interconnect s and SCSI adapters The number of available PCI slots depends on the type of AlphaServer system e Cluster interconnects You need only one cluster interconnect in a duster For TruCluster Server
71. be two disks available for highly available applications Note Slot 6 in the UltraSCSI BA356 is not available because SCSI ID 6 is generally used for a member system SCSI adapter However Introduction this slot can be used for a second power supply to provide fully redundant power to the storage shelf With the use of the cluster file system see the TruCluster Server Cluster Administration manual for a discussion of the cluster file system the clusterwide root usr and var file systems could be physically placed on a private bus of either of the member systems But if that member system was not available the other member system s would not have access to the clusterwide file systems Therefore placing the clusterwide root usr and var file systems on a private bus is not recommended Likewise the quorum disk could be placed on the local bus of either of the member systems If that member was not available quorum could never be reached in a two node cluster Placing the quorum disk on the local bus of a member system is not recommended because it creates a single point of failure The individual member boot and swap partitions could also be placed on a local bus of either of the member systems If the boot disk for member system 1 was on a SCSI bus internal to member 1 and the system was unavailable due to a boot disk problem other systems in the cluster could not access the disk for possible repair If the m
72. boot file is provided If it is the correct boot file press Return at the Bootfile prompt Otherwise enter the name of the file you wish to boot from The firmware images are copied from the CD ROM and the LFU help message shown in the following example is displayed kk kToadable Firmware Update Utility Function Description Display Displays the system s configuration table Exit Done exit LFU reset List Lists the device revision firmware name and update revision Readme Lists important release information Update Replaces current firmware with loadable data image Verify Compares loadable and hardware images or Help Scrolls this function table The list command indicates in the device column which devices it can update Use the update command to update all firmware or you can designate a specific device to update for example KZPSA BB pkbo UPD gt update pkb0O After updating the firmware and verifying this with the verify command reset the system by cycling the power Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 19 A Worldwide ID to Disk Name Conversion Table Table A 1 Converting Storageset Unit Numbers to Disk Names File System HSG80 WWID UDID Device Name dskn or Disk Unit Tru64 UNIX disk Cluster root usr var Member 1 boot disk Member 2 boot disk Member 3 boot disk Member 4 boot disk Qu
73. bus configuration requirements Section 3 1 SCSI bus performance Section 3 2 SCSI bus device identification numbers Section 3 3 SCSI bus length Section 3 4 SCSI bus termination Section 3 5 UltraSCSI hubs Section 3 6 Configuring UltraSCSI hubs with RAID array controllers Section 3 7 3 1 Shared SCSI Bus Configuration Requirements A shared SCSI bus must adhere to the following requirements Only an external bus can be used for a shared SCSI bus SCSI bus specifications set a limit of 8 devices on an 8 bit narrow SCSI bus The limit is 16 devices on a 16 bit SCSI bus wide See Section 3 3 for more information The length of each physical bus is strictly limited See Section 3 4 for more information You can directly connect devices only if they have the same transmission mode differential or single ended and data path narrow or wide Use a SCSI signal converter to connect devices with different transmission modes See Section 9 1 for information about the DWZZA BA350 or DW2ZZB BA356 signal converters or the DS BA35X DA personality module which acts as a differential to single ended signal converter for the UltraSCSI BA356 For each SCSI bus segment you can have only two terminators one at each end A physical SCSI bus may be composed of multiple SCSI bus segments If you do not use an UltraSCSI hub you must use trilink connectors and Y cables to connect devices to a shared bus so you can disconnect
74. bus errors The BA350 storage shelf contains internal SCSI bus termination and a SCSI bus jumper The jumper is not removed during normal operation The BA350 can be set up for two bus operation but that option is not very useful for a shared SCSI bus and is not covered in this manual Figure 9 6 shows the relative locations of the BA350 SCSI bus terminator and SCSI bus jumper They are accessed from the rear of the box For operation within a TruCluster Server cluster both the jumper and T terminator must be installed Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 9 Figure 9 6 BA350 Internal SCSI Bus POWER 7 ZK 1338U Al 9 3 2 BA356 Storage Shelf There are two variations of the BA356 used in TruCluster Server clusters the BA356 non UltraSCSI BA356 and the UltraSCSI BA356 An example of the non UltraSCSI BA356 is the BA356 KC which has a wide single ended internal SCSI bus It has a BA35X MH 16 bit personality module only used for SCSI ID selection and a 150 watt power supply It is referred to as the non UltraSCSI BA356 or BA356 in this manual You use a DWZZB VW as the interface between the wide differential shared SCSI bus and the BA356 wide single ended SCSI bus segment 9 3 2 1 Non UltraSCSI BA356 Storage Shelf The non UltraSCS BA356 like the BA350 can hold up to seven StorageWorks building blocks SBBs However unlike the BA350 these SBBs are wide de
75. buses 3 2 3 Data Path There are two data paths for SCSI devices e Narrow Implies an 8 bit data path for SCSI 2 The performance of this mode is limited e Wide Implies a 16 bit data path for SCSI 2 or UltraSCSI This mode increases the amount of data that is transferred in parallel on the bus 3 2 4 Bus Speed Bus speeds vary depending upon the bus clocking rate and bus width as shown in Table 3 1 Table 3 1 SCSI Bus Speeds SCSI Bus Transfer Rate MHz Bus Width in Bytes Bus Bandwidth Speed MB sec SCSI 5 1 5 Fast SCSI 10 1 10 Fast Wide 10 2 20 UlItraSCsSl 20 2 40 UltraSCSl l 40 2 80 3 3 SCSI Bus Device Identification Numbers On a shared SCSI bus each SCSI device uses a device address and must have a unique SCSI ID from 0 to 15 For example each SCSI bus adapter and each disk in a single ended storage shelf uses a device address SCSI bus adapters have a default SCSI ID that you can change by using console commands or utilities For example a KZPSA adapter has an initial SCSI ID of 7 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 5 Note If you are using a DS DWZZH 05 UltraSCS hub with fair arbitration enabled SCSI ID numbering will change see Section 3 6 1 2 Use the following priority order to assign SCSI IDs tothe SCSI bus adapters connected to a shared SCSI bus 7 6 5 4 3 2 1 0 15 14 13 12 11 10 9 8 This order specifies that 7
76. by the HSG80 controller with device names that the AlphaServer console can use That is the AlphaServer console must know about the devices before it can boot from or dump to them and it must have a valid Fibre Channel connection 6 34 Using Fibre Channel Storage to each of those devices For example to boot from storage unit D1 as presented by the HSG80 controller the AlphaServer console requires a device name such as dga133 1002 0 1 0 that identifies the storage unit In addition dga133 1002 0 1 0 must be reachable via a valid Fibre Channel connection This section describes how to perform the following tasks e Configure HSG80 storagesets In this document example storagesets are configured for both Tru64 UNIX and TruCluster Server on Fibre Channel storage Modify the storage configuration to meet your needs Section 6 6 1 1 e Set a user defined identifier U DID for each storage unit Although Tru64 UNIX does not use this identifier directly you use the UDID as input tothe wwidmgr quickset command in a subsequent step Section 6 6 1 2 e UsetheUDID asinput tothe wwidmgr quickset command to se the device unit number The device unit number is a subset of the device name as shown ina show device display For example in the device name DKA100 1001 0 1 0 the device unit number is 100 DKA100 The Fibre Channel worldwide name often referred to as the worldwide 1D or WWID is too long 64 bits to be used as the d
77. connect a PCI host adapter to the cluster remove the adapter termination resistor SIPs and install a Y cable and an H879 AA terminator for external termination This allows the removal of a SCSI bus cable from the host adapter without affecting SCSI bus termination This method discussed in Chapter 9 and Chapter 10 may be used with or without a DWZZH UltraSCSI hub When used with an UltraSCSl hub there may be more than one member system on a SCSI bus segment attached to a DS DWZZH 03 hub port The following sections describe how to install the KZPBA CB PClI to UltraSCSI differential host adapter and configure them into TruCluster Server clusters using the preferred method of radial connection with internal termination TruCluster Server System Configuration Using UltraSCSI Hardware 4 5 Note The KZPSA BB can be used in any configuration in place of the KZPBA CB The use of the KZPSA BB is not mentioned in this chapter because it is not UltraSCSI hardware and it cannot operate at UltraSCSI speeds The use of the KZPSA BB and the KZPBA CB with external termination is covered in Chapter 10 It is assumed that when you start to install the hardware necessary to create a TruCluster Server configuration you have sufficient storage to install the TruCluster Server software and that you have set up any RAID storagesets Follow the steps in Table 4 2 to start the procedure for TruCluster Server hardware installation You can save ti
78. connector into the receptacle and then use the screws to pull the connector in tight The connector must be tight to ensure a good ground contact If you are setting up redundant interconnects all Memory Channel adapters in a system must have the same jumper setting either VHO or VH1 Note With the TruCluster Server Version 5 1 product and virtual hub mode there is no longer a restriction requiring that mcao in one system be connected to mcao in the other system 5 5 1 2 Connecting MC1 Link Cables in Standard Hub Mode If there are more than two systems in a cluster use a standard hub configuration Connect a BC12N 10 link cable between the Memory Channel adapter and a linecard in the CCMHA hub starting at the lowest numbered slot in the hub If you are setting up redundant interconnects the following restrictions apply e Each adapter installed in a system must be connected to a different hub e Each Memory Channel adapter in a system must be connected to linecards that are installed in the same slot position in each hub For example if you connect one adapter toa linecard installed in slot 1 in one hub you must connect the other adapter in that system toa linecard installed in slot 1 of the second hub 5 8 Setting Up the Memory Channel Cluster Interconnect Figure 5 1 shows Memory Channel adapters connected to linecards that are in the same slot position in the Memory Channel hubs Figure 5 1 Connecting Memory Channe
79. connector on HSZ70 controller B or HSZ80 controller B Port 1 2 When the KZPBA CBs are installed use a BN38C or BN38D HD68 to VHDCI cable to connect the first KZPBA CB on each system toa port on the first DWZZH hub Ensure that the KZPBA CB SCSI ID matches the SCSI ID assigned to the DWZZH 05 port it is cabled to 12 13 14 and 15 Install BN38C or BN38D HD68 to VH DCI cables to connect the second K ZPBA CB on each system to a port on the second DWZZH hub Ensure that the KZPBA CB SCSI ID matches the SCSI ID assigned to the DWZZH 05 port it is cabled to 12 13 14 and 15 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 23 Figure 3 7 shows a two member TruCluster Server configuration with a radially connected dual redundant HSZ70 configured for multiple bus failover Figure 3 7 TruCluster Server Configuration with HSZ70 in Multiple Bus Failover Mode Network Member System Memory System 1 Channel 2 Interface Memory Channel i Memory Channel KZPBA CB 1D 6 T KZPBA CB 107 T T KZPBA CB ID 7 DS DWZZH 03 ZK 1601U Al Table 3 4 shows the components used to create the cluster shown in Figure 3 7 3 24 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware Figure 3 8 shows a two member TruCluster Server configuration with a radially connected dual redundant HSZ80 configured for multiple bus failover Figure 3 8
80. create the cluster The example Table 6 2 uses disks dsk18 var dsk19 usr dsk20 cluster root and dsk21 Quorum For instance disklabel rw dsk20 HSG80 6 6 5 Install the TruCluster Server Software and Create the First Cluster Member After labeling the disks use the TruCluster Server Software Installation procedures and install the TruCluster Server software on the first cluster member the system where you just installed Tru64 UNIX After installing the TruCluster Server software subsets runtheclu_create command to create the first cluster member using the procedures in the TruCluster Server Software Installation manual When clu_create terminates do not reboot the system Shut down the system and reset the bootdef_dev console environment variable to provide multiple boot paths to the member system boot disk before booting see Section 6 6 6 Then boot the first cluster member 6 6 6 Reset the bootdef_dev Console Environment Variable If you set the bootdef_dev console environment variable to multiple paths in Section 6 6 1 5 the base operating system installation or clu_create procedures modify the variable and you should reset it to provide multiple boot paths Using Fibre Channel Storage 6 53 To reset the bootdef_dev console environment variable follow these steps 1 Obtain the device name and worldwide name for the Fibre Channel unit from where you will boot cluster member system 1 see Table 6 2
81. defined identifier UDID inthe wwidmgr show wwid display It will be used by the WWID manager when setting the device unit number and boot def dev console environment variable The identifier also shows up during the Tru64 UNIX installation to allow you to select the Tru64 UNIX installation disk The identifier is also used with the hardware manager view devices command hwmgr view devices tolocate the dev disk dskn value Note We recommend that you set the identifier for all Fibre Channel storagesets It provides a sure method of identifying the storagesets Make the identifiers unique numbers within the domain or within the cluster at a minimum In other words do not use the same identifier on more than one HSG80 The identifiers should be easily recognized Ensure that you record the identifiers see Table 6 2 3 Enable access to each unit for those hosts that you want to be able to access this unit Because access was initially disabled to all hosts you can ensure selective access to the units If you do not remember the connection names use the HSG80 show connection command as shown in Example 6 1 to determine the HSG80 connection names for the connection to the KGPSA host bus adapters Many of the connections used here are shown in Example 6 1 Use the connection name for each connection to the KGPSA host bus adapter on the host for which you want access enabled Many of the connections used here are show
82. devices select the desired device library or drive by scrolling through the devices with the arrow buttons After the library or selected drive is selected use the Select button to highlight the SCSI ID 6 Usethe arrow buttons to scroll through the setting choices until the desired setting appears 7 When you have the desired setting press the Change button to save the setting as part of the library configuration 8 Repeat steps 5 through 7 to make additional changes to the library configuration 9 Placethelibrary back at the user level of security as follows Press the lock icon on the vertical bar of the control panel On the Password screen press the User button A screen appears informing you that the new security level has been set c Press the OK button The lock icon appears as a locked lock and displays a U to indicate that the control panel is back at User level 10 Power cycle the tape library to allow the new SCSI IDs to take effect 8 10 3 TL895 Tape Library Internal Cabling The default internal cabling configuration for the TL895 tape library has the library robotics controller and top drive drive 0 on SCSI bus port 1 Drive 1 is on SCSI bus port 2 drive 2 is on SCSI bus port 3 and soon A terminator part number 0415619 is connected to each of the drives to provide termination at the tape drive end of the SCSI bus In this configuration each of the tape drives except tape drive 0 and the robotics
83. different SCSI dialect to talk to the HSG80 controller 3 Restart both controllers to cause all changes to take effect 4 Enter the show connection command once more and verify that all connections have the offsets set to 0 and the operating system is set to TRU64_UNIX 6 32 Using Fibre Channel Storage Note If the fiber optic cables are not properly installed there will be inconsistencies in the connections shown 14 Set up the storage sets as required for the applications to be used An example is provided in Section 6 6 1 1 6 5 3 1 Obtaining the Worldwide Names of HSG80 Controller The RA8000 or ESA12000 is assigned a worldwide name when the unit is manufactured The worldwide name and checksum of the unit appears on a sticker placed above the controllers The worldwide name ends in zero 0 for example 5000 1F E1 0000 OD60 You can also use the SHOW THIS CONTROLLER Array Controller Software ACS command For HSG80 controllers the controller port IDs are derived from the RA8000 ESA12000 worldwide name as follows e In a subsystem with two controllers in transparent failover mode the controller port IDs increment as follows Controller A and controller B port 1 worldwide name 1 Controller A and controller B port 2 worldwide name 2 For example using the worldwide name of 5000 1F E 1 0000 0D60 the following port I Ds are automatically assigned and shared between the ports aS
84. end of the bus segment Termination for the other end of the bus segment is provided by the e Installed KZPBA CB or KZPSA BB termination resistor SIPs e External termination on a trilink connector attached to an UltraSCSl BA356 personality module DS BA35X DA HSZ70 or HSZ80 Note The DS DWZZH 03 05 UltraSCSI hubs cannot be connected toa StorageWorks BA35X storage shelf because the storage shelf does not provide termination power to the hub 3 6 1 Using a DWZZH UltraSCSI Hub in a Cluster Configuration The DS DWZZH 03 and DS DWZZH 05 UltraSCSI hubs are supported in a TruCluster Server cluster They both provide radial connection of cluster member systems and storage and are similar in the following ways e Contain internal termination for each port therefore the hub end of each SCSI bus segment is terminated Note Do not put trilinks on a DWZZH UltraSCSI hub beacuse it is not possible to remove the DWZZH internal termination 3 8 Shared SCSI Bus Requirements and Configurations Using UltraSCS Hardware 3 6 1 1 e Require that termination power termpwr be provided by the SCSI bus host adapters on each SCSI bus segment Note The UltraSCSI hubs are designed to sense loss of termination power such as a cable pull or termpwr not enabled on the host adapter and shut down the applicable port to prevent corrupted signals on the remaining SCSI bus segments DS DWZZH 03 Description The DS DWZZH 03 e Is a3 5 inc
85. end of the shared SCSI bus We recommend that tape devices be placed on a separate shared SCSI bus 10 1 3 Displaying KZPSA BB and KZPBA CB Adapters with the show Console Commands Usethe show config and show device console commands to display system configuration Use the output to determine which devices are KZPSA BBs or KZPBA CBs and to determine their SCSI bus IDs Example 10 1 shows the output from the show config console command on an AlphaServer 4100 system Example 10 1 Displaying Configuration on an AlphaServer 4100 P00 gt gt gt show config Compaq Computer Corporation AlphaServer 4x00 Console V5 1 3 OpenVMS PALcode V1 19 14 Tru6 4 UNIX PALcode V1 21 22 Module Type Rev Name System Motherboard 0 0000 mthrbrdo Memory 64 MB SYNC 0 0000 memo je 0000 mem1 0000 mem2 0000 mem3 Memory 64 MB SYNC Memory 64 MB SYNC Memory 64 MB SYNC oo Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 9 Example 10 1 Displaying Configuration on an AlphaServer 4100 cont CPU 4MB Cache CPU 4MB Cache PCI Motherboard Bus 0 Slot 1 OF WN Bus 1 Slot Bus 0 Slot 3 0000 3 0000 Bridge IODO IOD1 600 0021 8 0000 iodo PCIO Option Name Type Rev PCEB 4828086 0005 3 Trio064 Trio32 88115333 0000 DECchip 21040 AA 21011 0024 DEC KZPSA 81011 0000 DEC PCI MC 181011 000B pceb0 EISA Bridge connected to iodo Option Name Type Rev iod1 PCI
86. externally terminated with a trilink terminator combination Therefore in general with the exception of the TL890 TL891 and TL892 tape loaders must be on the end of the shared SCSI bus See Chapter 8 for information on configuring tape devices on a shared SCSI bus e You cannot use Prestoserve in a TruCluster Server cluster to cache O operations for any storage device regardless of whether it is located on a shared bus or a bus local to a given system Because data in the Prestoserve buffer cache of one member is not accessible to other member systems TruCluster Server cannot provide correct failover when Prestoserve is being used Table 4 1 describes how to maximize performance availability and storage capacity in your TruCluster Server hardware configuration For example if you want greater application performance without decreasing I O performance you can increase the number of member systems or you can set up additional shared storage Table 4 1 Planning Your Configuration To increase You can Application performance Increase the number of member systems 1 0 performance Increase the number of shared buses Member system availability Increase the number of member systems Cluster interconnect availability Use redundant cluster interconnects TruCluster Server System Configuration Using UltraSCSI Hardware 4 3 Table 4 1 Planning Your Configuration cont To increase You can Disk availabi
87. following example is displayed xx Toadable Firmware Update Utility Function Description Display Displays the system s configuration table Exit Done exit LFU reset List Lists the device revision firmware name and update revision Readme Lists important release information Update Replaces current firmware with loadable data image Verify Compares loadable and hardware images or Help Scrolls this function table The list command indicates in the device column which devices it can update It also shows the present firmware revision and the update revision on the CD ROM Usethe update command to update all firmware or you can designate a specific device to update for example SRM firmware UPD gt update srm 7 20 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration Caution Do not abort the update doing so can cause a corrupt flash image in a firmware module A complete firmware update takes a long time The length of time increases proportionally to the number of PCI adapters you have 9 After you update the firmware use the verify command to verify the firmware update then transfer control back tothe SCM and reset the system POO gt gt gt Esc Esc scm SCM_EO gt reset 10 Set the hard partitions back to the original configuration SCM_EO gt set hp count 2 11 At the master SCM turn system power on SCM_EO gt power on 1
88. g Connection 4 SCSI Port 4 Rear Panel Host s Connection 3 z SCSI Port3 Rear Panel Host Connection 2 Internal SCSI Termination 2 Internal SCSI Termination 3 kK SCSI Port 2 Rear Panel Host p Connection 1 SCSI Port 1 Internal SCSI Termination 4 SCSI Cable 3m ZK 1324U AI You can reconfigure the tape drives and robotics controller in a two bus configuration by using the SCSI jumper cable part number 6210567 supplied in the accessories kit shipped with each TL894 unit Remove the terminator from one drive and remove the internal SCSI cable from the other drive to be daisy chained Use the SCSI jumper cable to connect the two drives and place them on the same SCSI bus Notes We recommend that you not place more than two TZ89 tape drives on any one SCSI bus in these tape libraries We also recommend that storage be placed on shared SCSI buses that do not have tape drives Therefore we do not recommend that you reconfigure the TL894 tape library into the one bus configuration Appendix B of the TL81X TL894 Automated Tape Library for DLT Cartridges Facilities Planning and Installation Guide provides figures showing various bus configurations In these figures the configuration changes have been made by removing the terminators from both drives installing the SCSI bus jumper cable on the drive connectors vacated by the terminators then 8 40 Configuring a Shared SCSI
89. have achieved higher availability But even if you have a second Memory Channel and redundant networks because we cannot useLSM tomirror the clusterwide root quorum or the member boot disks we do not have a no single point of failure NSPOF cluster 1 5 4 Using Hardware RAID to Mirror the Clusterwide Root File 1 12 System and Member System Boot Disks You can use hardware RAID with any of the supported RAID array controllers to mirror the clusterwide root quorum and member boot disks Figure 1 6 shows a cluster configuration using an HSZ70 RAID array controller An HSZ40 HSZ50 HSZ80 HSG60 or HSG80 could be used Introduction instead of the HSZ70 The array controllers can be configured as a dual redundant pair If you want the capability to fail over from one controller to another controller you must install the second controller Also you must set the failover mode Figure 1 6 Cluster Configuration with HSZ70 Controllers in Transparent Failover Mode Network Member Member System System 1 2 Memory Channel Interface Memory Channel Host Bus Adapter ID 6 Memory Channel Host Bus Adapter ID 7 HSZ70 HSZ70 StorageWorks RAID Array 7000 ZK 1589U Al In Figure 1 6 the HSZ40 HSZ50 HSZ70 HSZ80 HSG60 or HSG80 has transparent failover mode enabled SET FAILOVER COPY THIS CONTROLLER In transparent failover mode both controllers are connected to the same shared S
90. management console terminal emulator to create a new terminal window for the partition 7 Turn on theAC circuit breakers for each of the QBBs Doing so provides power to the console serial bus CSB and SCM Do not turn on the OCP key switch you do not have to go through the lengthy power up sequence to partition the system Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 9 Notes If the OCP key switch is in the on or Secure position the system will go through the power up sequence In this case when the power up sequence terminates power down the system with the power off SCM command then partition the system If the auto_quit_scem SCM environment variable is set equal 1 control will be passed to the SRM firmware at the end of the power up sequence Use the escape sequence Esc Esc scm to transfer control to the SCM firmware If the auto_quit _scmSCM environment variable is not set equal 0 the SCM retains control If you execute the power off command at the master SCM without designating a partition power is turned off to the entire system To turn power off to a partition use the SCM power off par n where nis the partition number A slave SCM can only control power for its own partition 8 When the power up and built in self tests BIST have completed and the system has been powered down use the master SCM to set the SCM environment variables to define the partitions
91. not interrupt the cluster operation e A duster with minimum storage for highly available applications Section 1 5 1 e A duster with more storage but the single SCSI bus is a single point of failure Section 1 5 2 e Adding a second SCSI bus allows the use of LSM to mirror the usr and var file systems and data disks However as LSM cannot mirror the root member system boot swap or quorum disks so full redundancy is not achieved Section 1 5 3 1 6 Introduction e Usinga RAID array controller in transparent failover mode allows the use of hardware RAID to mirror the disks However without a second SCSI bus second Memory Channel and redundant networks this configuration is still not a NSPOF cluster Section 1 5 4 e ByusinganHSZ70 HSZ80 or HSG80 with multiplebus failover enabled you can use two shared SCSI buses to access the storage Hardware RAID is used to mirror the root usr and var file systems and the member system boot disks data disks and quorum disk if used A second Memory Channel redundant networks and redundant power must also be installed to achieve a NSPOF cluster Section 1 5 5 Note The figures in this section are generic drawings and do not show shared SCSI bus termination cable names and so forth 1 5 1 Two Node Clusters Using an UltraSCSI BA356 Storage Shelf and Minimum Disk Configurations This section takes the generic illustrations of our cluster example one step fur
92. of failure NSPOF cluster Or you may be using transparent failover mode with Tru64 UNIX Version 5 1 and TruCluster Server Version 5 1 and want to take advantage of the ability to create a NSPOF configuration and the availability that multiple bus failover provides over transparent failover mode Using Fibre Channel Storage 6 57 6 7 1 Overview The change in failover modes cannot be accomplished with a simple SET MULTIBUS COPY THIS HSG80 CLI command because e Unit offsets are not changed by the HSG80 SET MULTIBUS_ FAILOVER COPY THIS command Each path between a Fibre Channel host bus adapter in a host computer and an active host port on an HSG80 controller is a connection During Fibre Channel initialization when a controller becomes aware of a connection to a host bus adapter through a switch it adds the connection to its table of known connections The unit offset for the connection depends on the failover mode in effect at the time the connection is discovered In transparent failover mode host connections to port 1 default to an offset of 0 host connections on port 2 default to an offset of 100 Host connections on port 1 can see units O through 99 host connections on port 2 can see units 100 through 199 In multiplebus failover mode host connections on either port 1 or 2 can see units 0 through 199 In multiple bus failover mode the default offset for both ports is 0 If you change the failover mode from transparent f
93. on the end of the shared SCSI bus In a TruCluster Server cluster with TL893 or TL896 tape libraries the member systems and StorageWorks enclosures or RAID subsystems may be isolated from the shared SCSI bus because they use trilink connectors or Y cables However if there is disk storage and an ATL on the same shared SCSI bus the ASE must be shut down to remove a tape library from the shared bus You can reconfigure the tape drives and robotics controller to generate other bus configurations by using the jumper cable ATL part number 0425017 supplied in the accessories kit shipped with each TL893 or TL896 unit Remove the terminator from one drive and remove the internal SCSI cable from the other drive to be daisy chained Use the jumper cable to connect the two drives and place them on the same SCSI bus Note We recommend that you not place more than two drives on any one SCSI bus in these tape libraries Figure 8 17 shows a sample TruCluster Server cluster using a TL896 tape library in a three bus configuration In this configuration tape drive 4 Port E has been jumpered totapedrive 5 tape drive 2 Port A has been jumpered to tape drive 3 and tape drive 1 Port B has been jumpered to tape drive 0 To add a TL893 or TL896 tape library to a shared SCSI bus select the member system that will be the next to the last device on the shared SCSI bus the tape library always has to be the last device on the shared SCSI bus Con
94. opto oly 1 opto eae MC2 Hub 2 ZK 1526U Al Setting Up the Memory Channel Cluster Interconnect 5 25 Figure 5 8 MC1 to MC2 Standard Hub Rolling Upgrade Final Configuration MC2 Hub 1 1 opto Gay O opto ZK 1527U Al 5 26 Setting Up the Memory Channel Cluster Interconnect 6 Using Fibre Channel Storage This chapter provides an overview of Fibre Channel Fibre Channel configuration examples and information on Fibre Channel hardware installation and configuration in a Tru64 UNIX or TruCluster Server Version 5 1 configuration The information includes an example storageset configuration how to determine the dev disk dskn value that corresponds to the Fibre Channel storagesets that have been set up as the Tru64 UNIX boot disk cluster root cluster usr cluster var cluster member boot and quorum disks and how to set up the bootdef_dev console environment variable to facilitate Tru64 UNIX Version 5 1 and TruCluster Server Version 5 1 installation Note TruCluster Server Version 5 1 configurations require one or more disks to hold the Tru64 UNIX operating system The disk s are either private disk s on the system that will become the first cluster member or disk s on a shared bus that the system can access Whether or not you install the base operating system on a shared disk always shut down the cluster before booting the Tru64 UNIX disk All configurations in this chapter are shown with the M
95. portname 1000 0000 C921 07F4 nodename 2000 0000 C921 07F4 Present Logged in FCP Initiator FCP Target FCP Logged in N Port at FC DID Oxfffffc SCSI tgt id 1 3 portname 20FC 0060 6900 5A1B nodename 1000 0060 6900 5A1B Present Logged in Directory Server N Port at FC DID Oxfffffe SCSI tgt id 1 3 Using Fibre Channel Storage 6 63 portname 2004 0060 6900 5A1B nodename 1000 0060 6900 5A1B Present Logged in F PORT 1 Status of the emx1 link The connection is a point to point fabric switch connection and the link is up The adapter is on SCSI bus 3 at SCSI ID 7 Both the port name and node name of the adapter the worldwide name are provided The Fibre Channel DID number is the physical Fibre Channel address being used by the N_ Port 2 A list of all other Fibre Channel devices on this SCSI bus with their SCSI ID port name node name physical Fibre Channel address and other items such as e Present The adapter indicates that this N_Port is present on the fabric e Logged in The adapter and remote N_Port have exchanged initialization parameters and have an open channel for communications nonprotocol specific communications e FCP Target This N_ Port acts as a SCSI target device it receives SCSI commands e FCP Logged in The adapter and remote N_Port have exchanged FCP specifi
96. s specified can still access this unit If you wish to enable ONLY the host s specified disable all access paths DISABLE ACCESS ALL then again enable the ones specified HSG80 gt set d144 ENABLE ACCESS PATH NEWCON61 NEWCON62 NEWCON64 NEWCON65 Warning 1000 Other host s in addition to the one s specified can still access this unit If you wish to enable ONLY the host s specified disable all access paths DISABLE ACCESS ALL then 6 40 Using Fibre Channel Storage Example 6 3 Adding Units and Identifiers to the HSG80 Storagesets cont again enable the ones specified HSG80 gt set d144 ENABLE ACCESS PATH NEWCON68 NEWCON74 NEWCON76 NEWCON77 Warning 1000 Other host s in addition to the one s specified can still access this unit If you wish to enable ONLY the host s specified disable all access paths DISABLE ACCESS ALL then again enable the ones specified HSG80 gt show d131 4 LUN Uses Used by D131 BOOT MIR partition LUN ID 6000 1FE1 0000 0D60 0009 8080 0434 002F IDENTIFIER 131 Switches RUN NOWRITE_PROTECT READ _CACHE READAHEAD CACHE WRITEBACK CACHE MAXIMUM_CACHED_ TRANSFER SIZE 32 Access NEWCON49 NEWCONS50 NEWCON51 NEWCON52 NEWCON53 NEWCON54 NEWCONS5S NEWCONS56 NEWCON61 NEWCON62 NEWCON64 NEWCON65 NEWCON68 NEWCON74 NEWCON76 NEWCON77 State ONLINE to the other controller NOPREFERRED_ PATH Size 2094502 blocks Geometry C H S
97. seven disks for highly available applications Figure 1 4 Two Node Cluster with Two UltraSCSI DS BA356 Storage Units Network Member Member System System 1 2 Memory Channel Memory Channel Host Bus Adapter ID 6 Host Bus Adapter ID 7 4 UltraSCSI UltraSCSI BA356 Shared BA356 UNIX SSeS Ses Disk poo noo Clusterwide usr var Memory Channel Interface ID8 Member 1 Boot Disk ID9 Member 2 Boot Disk ID 10 een D1 Data ID 12 disks Do not use for ints data disk May ID 14 or be used for redundant redundant power power supply supply ZK 1590U Al This configuration while providing more storage has a single SCSI bus that presents a single point of failure Providing a second SCSI bus would allow the use of the Logical Storage Manager LSM to mirror the usr and var Introduction file systems and the data disks across SCSI buses removing the single SCSI bus as a single point of failure for these file systems 1 5 3 Two Node Configurations with UltraSCSI BA356 Storage Units and Dual SCSI Buses By adding a second shared SCSI bus you now have the capability to use the Logical Storage Manager LSM to mirror data disks and the clusterwide usr and var file systems across SCSI buses Note You cannot use LSM to mirror the clusterwide root member system boot swap or quorum disks but you can use hardware RA
98. shows isp0 isp1 isp2 isp3 and isp5 The console code that assigns console environment variables counts every O adapter including the K ZPAA which is the device after isp3 and therefore logically isp4 in the numbering scheme The show isp console command skips over isp4 because the K ZPAA is not a QLogic 1020 1040 class module Example 10 3 and Example 10 4 show that isp0 isp1 isp2 and isp3 are on the internal KFTIA PCI bus and not on a shared SCSI bus Only isp5 the KZPBA CB is on a shared SCSI bus The other three shared SCSI buses use KZPSA BBs Example 10 7 shows the use of the show pk console command to display the console environment variables for KZPSA BBs on an AlphaServer 8x00 Example 10 7 Displaying Console Variables for a KZPSA BB on an AlphaServer 8x00 System P00 gt gt gt show pk pkaO_fast al pkaO_host_id 7 pka0_termpwr on pkbo_fast 1 pkbO_ host_id 7 pkb0O_termpwr on Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 15 Example 10 7 Displaying Console Variables for a KZPSA BB on an AlphaServer 8x00 System cont pkcO_ fast 1 pkcO_host_id 7 pkcO_termpwr on 10 1 4 2 Setting the KZPBA CB SCSI ID After you determine the console environment variables for the KZPBA CBs on the shared SCSI bus use the set console command to set the SCSI ID For a TruCluster Server cluster you will most likely have to set the SCSI ID for all KZPBA CB UltraSCSI
99. that has an unformatted NVRAM Both messages are benign and can be ignored for the fabric mode of operation To correct theNvram read failed situation use the wwidmgr set adapter command The previous display shows that all three KGPSA host bus adapters are set for fabric topology as the current topology the default When operating in a fabric if the current topology is FABRIC it does not matter if the next topology is Unavail or that the NVRAM is not formatted Nvram read failed If however the current topology is LOOP you have to change the topology to FABRIC to operate in a fabric You will never see the Nvram read failed message if the current topology is Loop The NVRAM has to have been formatted to change the current mode to LOOP Consider the case where the K GPSA current topology is LOOP as follows P00 gt gt gt wwidmgr show adapter item adapter WWN Cur Topo Next Topo 0 pga0 0 0 3 1 1000 0000 c920 eda0 LOOP LOOP 1 pgb0 0 0 4 0 1000 0000 c920 da0l1 LOOP LOOP 9999 All of the above If the current topology for an adapter is LOOP set an individual adapter to FABRIC by using the item number for that adapter for example O or 1 Use 9999 to s amp all adapters POO gt gt gt wwidmgr set adapter item 9999 topo fabric Reformatting nvram Reformatting nvram Note The qualifier in the previous command is topo and not topology You will get an error if you use topology Displaying the adapter i
100. the Enter button 5 Usetheup or down arrow button to scroll through the possible SCSI ID settings Press the Enter button when the desired SCSI ID is displayed Repeat steps 4 and 5 to se other SCSI bus IDs as necessary Press the Escape button repeatedly until the default menu is displayed 8 12 2 1 2 Cabling the TL881 or TL891 DLT MiniLibrary There are six 68 pin high density SCSI connectors on the back of the TL881 or TL891 DLT MiniLibrary standalone model or rackmount base unit The two leftmost connectors are for the library robotics controller The middle two are for tape drive 1 The two on the right are for tape drive 2 if the second tape drive is installed Configuring a Shared SCSI Bus for Tape Drive Use 8 63 Note The tape drive SCSI connectors are labeled DLT1 tape drive 1 and DLT2 tape drive 2 The control panel designation for the drives is DLTO tape drive 1 and DLT1 tape drive 2 The default for the TL881 or TL891 DLT MiniLibrary is to place the robotics controller and tape drive 1 on the same SCSI bus Figure 8 18 A 0 3 meter SCSI jumper cable is provided with the unit Plug this cable into the second connector from the left and the third connector If the MiniLibrary has two drives place the second drive on the same SCSI bus with another 0 3 meter SCSI bus jumper cable or place it on its own SCSI bus Notes The internal cabling of the TL881 and TL891 is too long to allow external termination w
101. the interface between the UltraSCSI differential bus and the UltraSCSI single ended bus in the UltraSCS BA356 The personality module controls termination for the external differential UltraSCSI bus segment and for both ends of the internal single ended bus segment For normal cluster operation the differential termination must be disabled since a trilink connector will be installed on personality module connector J A1 allowing the use of the UltraSCS BA356 or two UltraSCS BA356s in the middle of the bus or external termination for an UltraSCSI BA356 on the end of the bus Switch pack 4 switches S 4 1 and S4 2 are se to ON to disable the personality module differential termination The switches have no effect on the BA356 internal single ended UltraSCSI bus termination 9 4 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices Notes S4 3 and S4 4 have no function on the DS BA35X DA personality module See Section 9 3 2 2 for information on how to select the device SCSI IDs in an UltraSCS BA356 Figure 9 3 shows the relative positions of the two DS BA35X DA switch packs Figure 9 3 DS BA35X DA Personality Module Switches 1 2 E 3 E 4 E SCSI Bus Termination Switch S4 ore OAOUUO 1234 567 SCSI Bus Address Switch S3 ZK 1411U Al 9 2 Terminating the Shared SCSI Bus You must properly connect devices to a shared SCSI bus In addition you can terminat
102. the item number displayed by the wwidmgr show wwid command see Example 6 4 For instance to set the device unit number of item number 17 of Example 6 4 to 770 use the following command P00 gt gt gt wwidmgr quickset item 17 unit 770 The device names have also been set for the Tru64 UNIX disk and first cluster member system boot disks Record these device names for for later use In the reachability portion of the display the storagesets are reachable from KGPSA pga through two HSG80 ports and from KGPSA pgb through two HSG80 ports Also the device unit number has been set for each K GPSA to HSG80 controller port connection even if the storage unit is not currently reachable via that connection 6 6 1 4 Displaying the Available Boot Devices The only Fibre Channel devices displayed by the console show dev command are those devices that have been assigned to a wwidn environment variable with the wwidmgr quickset command The devices shown in the reachability display of Example 6 5 are available for booting and the setting of the bootdef_ dev console environment variable during normal console mode If you were to execute the show wwid console command now it would show that the environment variable wwidn is set for two disks Also the show n command shows that the units are accessible through four HSG80 N_Ports as follows P00 gt gt gt show wwid wwidO 133 1 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002e w
103. the system that will become the first cluster member or disk s on a shared bus that the system can access e Oneor more disks on a shared SCSI bus to hold the clusterwide root usr and var AdvFS file systems e One disk per member normally on a shared SCSI bus to hold member boot partitions e Optionally one disk on a shared SCSI bus to act as the quorum disk See Section 1 3 1 4 and for a more detailed discussion of the quorum disk see the TruCluster Server Cluster Administration manual All configurations covered in this manual assume the use of a shared SCSI bus Note If you are using Fibre Channel storage see Chapter 6 Before you connect devices toa shared SCSI bus you must e Plan your hardware configuration determining which devices will be connected to each shared SCSI bus which devices will be connected together and which devices will be at the ends of each bus TruCluster Server System Configuration Using UltraSCSI Hardware 4 1 This is especially critical if you will install tape devices on the shared SCSI bus With the exception of the TZ885 TZ887 TL890 TL891 and TL892 tape devices can only be installed at the end of a shared SCSI bus These tape devices are the only supported tape devices that can be terminated externally e Place the devices as close together as possible and ensure that shared SCSI buses will be within length limitations e Prepare the systems and storage shelves for the
104. through 6 The DS DWZZH 05 retains the SCSI ID of 7 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 13 Figure 3 3 DS DWZZH 05 Rear View lt Hij C C iii l CENH ZK 1448U AI 3 14 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware Figure 3 4 DS DWZZH 05 Front View W A Fair Controller Port Host Port SCSI ID SCSI ID 6 4 2 6 0 14 Power Host Port SCSI ID 3 15 Busy Host Port fod ren D pp ecg SCSI ID 0 12 13 ZK 1447U Al 3 6 1 2 4 SCSI Bus Termination Power Each host adapter connected to a DS DWZZH 05 UltraSCSI hub port must supply termination power termpwr to enable the termination resistors on each end of the SCSI bus segment If the host adapter is disconnected from the hub the port is disabled Only the UltraSCSI bus segment losing termination power is affected The remainder of the SCSI bus operates normally 3 6 1 2 5 DS DWZZH 05 Indicators The DS DWZZH 05 has two indicators on the front panel see Figure 3 4 The green LED indicates that power is applied to the hub The yellow LED indicates that the SCSI bus is busy 3 6 1 3 Installing the DS DWZZH 05 UltraSCSI Hub To install the DS DWZZH 05 UltraSCSI hub follow these steps 1 Removethe W1 jumper to enable wide addressing mode See F igure 3 3 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 15 2 If fair arbitration is to
105. to commands from or when being polled by the master SCM The CSB network consists of the following nodes One to eight SCMs The primary PCI drawer that is connected to the operator control panel OCP and with the lowest node ID usually 0 is the default master SCM upon initial power up The remaining SCMs are slaves You can designate one slave SCM as a standby tothe master The primary PCI drawer with the slave SCM that you designate to be the standby must also be connected to the OCP The OCP has two connectors for this purpose The standby SCM must have a node ID usually set to 7 4 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 1 that is higher than the master SCM Both the master SCM and standby SCM must have the scm_csb master eligible SCM environment variable set Note We recommend that you put the primary PCI drawers that contain the master and standby SCM in the power cabinet They both must be connected to the OCP One to eight power system managers PSMs one for each QBB One to 16 PCI backplane managers PBMs one for each PCI backplane A hierarchical switch power manager HPMs if the H switch is present Local terminal COM1 port on the standard I O module Connect a cable from the local terminal port on the standard I O module to the terminal server for each partition The terminal server is connected to the system management console
106. when you install the CCMAB Memory Channel PCI adapter in each system in the virtual hub configuration You should also connect the CCMAB Memory Channel adapter to the optical converter with a BN39B 01 cable When you install the CCMFB optical converter module in the second system you connect the two systems with the BN 34R fiber optics cable see Section 5 3 5 5 2 3 Connecting MC2 Link Cables in Standard Hub Mode No Fiber Optics If there are more than two systems in a cluster use a Memory Channel standard hub configuration Connect a BN 39B 04 4 meter or BN 39B 10 10 meter link cable between the Memory Channel adapter and a linecard in the CCMHB hub starting at the lowest numbered slot in the hub If you are setting up redundant interconnects the following restrictions apply e Each adapter installed in a system must be connected to a different hub e Each Memory Channel adapter in a system must be connected to linecards that are installed in the same slot position in each hub For example if you connect one adapter toa linecard installed in slot 0 opto in one hub you must connect the other adapter in that system toa linecard installed in slot 0 opto of the second hub Note You cannot install a CCMLB linecard in slot opto only 5 5 2 4 Connecting MC2 Cables in Standard Hub Mode Using Optical Converters If you are using optical converters in an MC2 configuration install an optical converter module CCMFB with attache
107. worldwide name values 5 Usethe wwidmgr command with the quickset option to set a device unit number for the Tru64 UNIX Version 5 1 installation disk and the first cluster member system boot disk Example 6 5 shows the use of the wwidmgr command with the quickset option to define a device unit number based on the UDID as an alias for the worldwide name for the Tru64 UNIX installation disk and the first cluster member system boot disk The wwidmgr quickset utility sets the device unit number and also provides a display of the device names and how the disk is reachable reachability display Thewwidmgr quickset command generates multiple device unit numbers based on the UDID The device unit number is an alias for the worldwide name in a format the console can use to identify storage unit The wwidmgr quickset command may generate multiple device names for a given device unit number because each possible path toa storage unit is given its own device name Example 6 5 shows e Theuseofthewwidmgr quickset command to set the device unit number for the Tru64 UNIX Version 5 1 installation disk to 133 and the first cluster member system boot disk to 131 e Thewwidmgr quickset command provides a reachability display equivalent to execution of the wwidmgr reachability command The reachability part of the display provides the following Theworldwide name for the storage unit that is to be accessed Thenew device name for the stor
108. 0 Hard Partitions in a TruCluster Server Configuration 7 3 We recommend that you connect I O riser O local I O riser ports 0 and 1 tothe primary PCI drawer that will be the master system control manager SCM The BA54A AA PCI drawer the bottom PCI drawer in Figure 7 2 and Figure 7 3 is a primary PCI drawer See Figure 2 1 for PCI drawer slot layout A primary PCI drawer contains A standard I O module in slot 0 0 1 that has EEPROMs for the system control manager SCM and system reference manual SRM firmware The SCM is powered by the V ux output of the PCI power supply whenever AC power is applied to the PCI drawer The master SCM uses the console serial bus CSB to Control system power up Monitor and configure the system Halt and reset the system Update firmware Operating system disk Two remote I O riser modules for connection to the QBB local O riser module TwoPCl backplanes Each PCI backplane Figure 2 1 has two PCI buses PCI bus 0 has threeslots PCI 1 has four slots A primary PCI drawer has a standard I O module in PCI bus 0 slot 0 0 1 CD ROM Two power supplies providing a redundant power supply Console serial bus CSB interface module The console serial bus consists of a network of microprocessors that the master SCM controls in a master slave relationship Each node is programmed to control and monitor the subsystem in which it resides in response
109. 00 dkd200 1 0 4 DKd200 dkd300 1 0 4 DKd300 polling kzpsa0 DEC KZPSA slot 5 bu kzpsa0 7 0 5 dke TPwr 1 Fast 1 B dke100 1 0 5 DKe100 dke200 2 0 5 DKe200 dke300 3 0 5 DKe300 R polling floppy0 FLOPPY pceb IBUS ho dva0 0 0 1000 0 DVAO polling kzpsal DEC KZPSA slot 4 bu kzpsal 7 0 4 dkf TPwr 1 Fast 1 B dkf 100 1 0 5 DK 100 dk 200 2 0 5 DK 200 dk 300 3 0 5 DK 300 polling tulipo DECchip 21040 AA ewa0 0 0 3 0 00 00 F8 21 0B 56 RZ26N 0568 RZ26 392A RZ26N 0568 s 0 PCI hose 1 TPwr 1 Fast 1 Bus ID 7 us ID 7 LO1 A11 RZ28 442D RZ26 392A Z26L 442D se 0 RX23 s 0 PCI hose 0 TPwr 1 Fast 1 Bus ID 7 us ID 7 E01 A11 RZ26 392A RZ28 442D RZ26 392A slot 3 bus 0 PCI hose 0 Twisted Pair Example 10 3 shows the output f rom the show config console command entered on an AlphaServer 8200 system Example 10 3 Displaying Configuration on an AlphaServer 8200 gt gt gt show config Name Type Rev Mnemonic TLSB 4 KN7CC AB 8014 0000 kn7cc ab0 Be MS7CC 5000 0000 ms7cc0O 8 KFTIA 2020 0000 kftiaod C0 Internal PCI connected to kftiao pcio 0 QLogic ISP1020 10201077 0001 ispo 1 QLogic ISP1020 10201077 0001 isp1 2 DECchip 21040 AA 21011 0023 tulipo 4 QLogic ISP1020 10201077 0001 isp2 5 QLogic ISP1020 10201077 0001 isp3 6 DECchip 21040 AA 21011 0023 tulipl Cl PCI connected to kftia0 0 KZPAA 11000 0001 kzpaa0 1 QLogic ISP1020 10201077 0005 isp4 2 KZPSA 81011 0000
110. 00 0000 C921 0A75 NEWCON76 TRU64_ UNIX THIS HOST _ID 1000 0000 C920 EDAO NEWCON77 TRU64_ UNIX THIS HOST ID 1000 0000 C921 086C Port Address Status 2 230813 OL this ADAPTER_ID 1000 0000 C920 aL 230813 OL this ADAPTER_ID 1000 0000 C920 2 230913 OL this ADAPTER _ ID 1000 0000 C920 a 230913 OL this ADAPTER _ ID 1000 0000 C920 nl 230913 OL other ADAPTER_ID 1000 0000 C920 di 230813 OL other ADAPTER _ID 1000 0000 C920 2 230913 OL other ADAPTER _ ID 1000 0000 C920 2 230813 OL other ADAPTER_ID 1000 0000 C920 2 210513 OL this ADAPTER _ ID 1000 0000 C921 1 210513 OL other ADAPTER _ID 1000 0000 C921 1 offline ADAPTER _ ID 1000 0000 C921 pk 210413 OL other ADAPTER_ID 1000 0000 C920 2 210413 OL this ADAPTER _ ID 1000 0000 C920 2 offline ADAPTER _ID 1000 0000 C921 1 210413 OL this ADAPTER _ID 1000 0000 C920 ali 210513 OL this ADAPTER _ ID 1000 0000 C921 Unit Offset 0 DAO1 0 DAO1 0 EDEB 0 EDEB 0 EDEB 0 DAO1 0 EDEB 0 DAO1 0 086C 0 086C 0 0943 0 EDAO 0 EDAO 0 OA75 0 EDAO 0 086C Using Fibre Channel Storage 6 31 Note You can change the connection name with the HSG80 CLI RENAME command For example assume that member system pepicelli has two KGPSA
111. 1 Option Name Type Rev NCR 53C810 11000 0002 NCR 53C810 11000 0002 QLogic ISP1020 10201077 0005 QLogic ISP1020 10201077 0005 DEC KZPSA 81011 0000 OB WD cpud cpul 10d0 iod1 saddleo Name pcebo vga0 tulipo pks1 mco slot 1 Name Name nero nerl ispo ispl pkso Example 10 2 shows the output from the show device console command entered on an AlphaServer 4100 system Example 10 2 Displaying Devices on an AlphaServer 4100 P00 gt gt gt show SCSI Bus ID 7 SCSI Bus ID 7 device polling ncrO NCR 53C810 slot 1 busO PCI hose 1 SCSI Bus ID 7 dka500 5 0 1 1 Dka500 RRD45 1645 polling ncr1l NCR 53C810 slot 2 busO PCI hose 1 SCSI Bus ID 7 dkb0 0 0 2 DKbO RZ29B 0007 dkb100 1 0 2 1 DKb100 RZ29B 0007 polling ispO QLogic ISP1020 slot 3 bus 0 PCI hose 1 dkc0 0 0 3 DKcO HSZ70 V70Z dkc1 0 0 3 DKc1 HSZ70 V70Z dkc2 0 0 3 DKc2 HSZ70 V70Z dkc3 0 0 3 DKc3 HSZ70 V70Z dkc4 4 0 3 DKc4 HSZ70 V70Z dkc5 0 0 3 DKc5 HSZ70 V70Z dkc6 0 0 3 DKc6 HSZ70 V70Z dkc100 1 0 3 1 DKc100 RZ28M 0568 dkc200 2 0 3 1 DKc200 RZ28M 0568 dkc300 3 0 3 1 DKc300 RZ28 442D polling ispl QLogic ISP1020 slot 4 bus 0 PCI hose 1 dkd0 0 0 4 DKdO HSZ50 AX X29Z dkd1 0 0 4 DKd1 HSZ50 AX X29Z dkd2 0 0 4 DKd2 HSZ50 AX X29Z 10 10 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices Example 10 2 Displaying Devices on an AlphaServer 4100 cont dkd100 1 0 4 DKd1
112. 1 reports that mcbo is on line but has not communicated with the Memory Channel adapter on node 0 4 Memory Channel adapter mcao has communicated with the adapter on the other node 5 Memory Channel adapter mebo has communicated with the adapter on the other node 6 Typing a Ctrl C on node 0 terminates the test on that node and the Memory Channel adapters on node 1 report off line 7 A Ctrl C on node 1 terminates the test Setting Up the Memory Channel Cluster Interconnect 5 13 5 7 Upgrading Memory Channel Adapters If you have a TruCluster Server configuration with redundant MC1 interconnects and want to upgrade to MC2 interconnects you can do so without shutting down the entire cluster When rolling from MC1 interconnects which use 128 MB Memory Channel address space to MC2 which uses either 128 or 512 MB Memory Channel address space all Memory Channel adapters must be operating at 128 MB Memory Channel address space the default until the last adapter has been changed At that time the address space can be increased to 512 MB if all MC2 adapters are jumpered for 512 MB This section covers adding a Memory Channel interconnect and the following rolling upgrade situations e Dual redundant MC1 interconnects in virtual hub mode Table 5 4 and Figure 5 2 e Dual redundant MC1 interconnects in standard hub mode Table 5 4 and Figure 5 3 through Figure 5 8 The figures following Table
113. 10 10 11 10 12 10 13 10 15 10 15 10 16 10 17 NSPOF Fibre Channel Cluster Using HSG80s in Multiple Bus Failover Mode mitata e e a aA E rl enecne debs tee oe PCI Backplane Slot Layout cece eee eect ee eee eee VHDCI Trilink Connector H 8861 AA acceca DS DWZZH 03 Front VieW cece cece eee eee eee eee eens DS DWZZH 05 Rear VieW 1 0 0 cece cece cece eee eee eae eee DS DWZZH 05 Front VieW cece e cece cnet ee eae eee Shared SCSI Bus with HSZ70 Configured for Transparent FONOVOD stokes ce vise a dens t canny adele een dessa ten sateen Shared SCSI Bus with HSZ80 Configured for Transparent Failover stantial hh eho a a A A Ta At at don Balad va TruCluster Server Configuration with HSZ70 in Multiple Bus Failover Mode 0 ccceccee cece eee eee eee eee eae etna een e eae ted TruCluster Server Configuration with HSZ80 in Multiple Bus Failover Mode 00 cccceccee cee eee cnet ence teen eae enna een ae ena e tee KZPBA CB Termination Resistors 0cceeeeeeee eee eee Connecting Memory Channel Adapters to Hubs 565 MC1toMC2 Virtual Hub Rolling Upgrade 0045 MC1 to MC2 Standard Hub Rolling Upgrade Initial CONF QUIPAt ON sai x aane e a eee EA EAR ARAE es MC1 to MC2 Standard Hub Rolling Upgrade First MC1 Module Replaced ce ccce eee e eee ence eee teeta e teen tasted MC1 to MC2 Standard Hub Rolling Upgrade Replace First MC1 Adapter in Second System
114. 100A systems support the variable you must set the bus probe algorithm console variable to new by entering the following command gt gt gt set bus probe algorithm new Usethe show bus probe algorithm console command to determine if your system supports the variable If the response is null or an error there is no support for the variable If the response is anything other than new you must set it to new e On AlphaServer 1000A and 2100A systems updating the firmware on the KZPSA BB SCSI adapter is not supported when the adapter is behind the PCI to PCI bridge 2 3 3 KZPBA CB SCSI Bus Adapter Restrictions KZPBA CB UltraSCSI adapters have the following restrictions A maximum of four HSZ50 HSZ70 or HSZ80 RAID array controllers can be placed on a single KZPBA CB UltraSCSI bus Only two redundant pairs of array controllers are allowed on one SCSI bus e TheKZPBA CB requires ISP 1020 1040 firmware Version 5 57 or higher which is available with the system SRM console firmware on the Alpha Systems Firmware 5 3 Update CD ROM or later e Themaximum length of any differential SCSI bus segment is 25 meters including the length of the SCSI bus cables and SCSI bus internal tothe SCSI adapter hub or storage device A SCSI bus may have more than one SCSI bus segment see Section 3 1 e Seethe KZPBA CB UltraSCSI Storage Adapter Module Release Notes AA R5XWD TE for more information 2 4 Disk Device Restrictions The restri
115. 131 1002 0 2 0 e dgb131 1004 0 2 0 e dgb133 1002 0 2 0 e dgb133 1004 0 2 0 Each of the storage units are reachable through four different paths two for each host bus adapter the Yes in the connected column 2 Set the bootdef_dev console environment variable to one of the boot path s that show up as connected tothe disk you will use for the Tru64 UNIX installation For the example disk configuration on the system where you are installing the Tru64 UNIX operating system which will eventually be the first cluster member set bootdef_dev as follows P00 gt gt gt set bootdef dev dga133 1002 0 1 0 3 You must initialize the system to use any of the device names in the bootdef_ dev variable POO gt gt gt init After the initialization the bootdef_dev will show up as follows P00 gt gt gt show bootdef dev bootdef dev dga133 1002 0 1 0 You are now ready to install the Tru64 UNIX operating system 6 50 Using Fibre Channel Storage 6 6 2 Install the Tru64 UNIX Operating System After reading the TruCluster Server Software Installation manual and using the Tru64 UNIX Installation Guide as a reference boot from the CD ROM and install the Tru64 UNIX Version 5 1 operating system When the installation procedure displays the list of disks available for operating system installation as shown here look for the identifier in the Location column Verify the identifier from the table you have been preparing see Table 6 2
116. 2 At the master SCM transfer control tothe SRM Then using the SRM at the console of each partition boot the operating system Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 21 8 Configuring a Shared SCSI Bus for Tape Drive Use The topics in this section provide information on preparing the various tape devices for use on a shared SCSI bus with the TruCluster Server product Notes Section 8 7 and Section 8 8 provide documentation for the TL890 TL891 TL 892 MiniLibrary family as sold with the DS TL891 NE NG DS TL891 NT DS TL892 UA DS TL890 NE NG part numbers The TL881 with a Compaq 6 3 part number was recently qualified in cluster configurations The TL891 rackmount base unit has been provided with a Compaq 6 3 part number The TL881 and TL891 only differ in the type of tape drive they use They both work with an expansion unit previously called the DS TL890 NE and a new module called the data unit Section 8 12 covers the TL881 and TL891 with the common components as sold with the Compaq 6 3 part numbers As long as the TL89x MiniLibrary family is being sold with both sets of part numbers the documentation will retain the documentation for both ways to configure the MiniLibrary 8 1 Preparing the TZ88 for Shared Bus Usage Two versions of the TZ88 are supported the TZ88N TA tabletop standalone enclosure and the TZ88N VA StorageWorks building blocks SBB 5 25 inch carrier
117. 2 Check the reachability display Example 6 5 provided by the wwidmgr quickset or the wwidmgr reachability commands for the device names that can access the storage unit from which you are booting Check the show dev command output to ensure the device name may be assigned to the bootdef_dev console environment variable Notes You should choose device names that show up as both ves and No in the reachability display connected column Keep in mind that for multiple bus failover only one controller is normally active for a storage unit You must ensure that the unit is reachable if the controllers have failed over If you have multiple Fibre Channel host bus adapters you should use device names for at least two host bus adapters For example to ensure that you have a connected boot path in case of a failed host bus adapter or controller failover choose device names for multiple host bus adapters and each controller port For example if you use the reachability display shown in Example 6 5 you could choose the following device names when setting the bootdef_dev console environment variable for the first cluster member system dga131 1004 0 1 0 1 dgb131 1002 0 2 0 2 dgb131 1003 0 2 0 3 dga131 1001 0 1 0 4 1 Path from host bus adapter A to controller A port 1 Path from host bus adapter B to controller A port 2 Path from host bus adapter B to controller B port 1 A N
118. 2 Setting the TL895 Tape Library SCSI IDs The library and each tape drive must have the SCSI ID set unless the default is sufficient Table 8 11 lists the TL895 default SCSI IDs Table 8 11 TL895 Default SCSI ID Settings SCSI Device SCSI ID Library Drive 0 Drive 1 Drive 2 Drive 3 Drive 4 Drive 5 Nyro RB WI Niro Drive 6 The SCSI IDs must be set mechanically by the rotary switches and electronically from the control panel After you have set the SCSI IDs from the switches power up the library and electronically set the SCSI IDs To electronically set the SCSI ID for the TL895 library and tape drives follow these steps 1 At the control panel press the Operator tab 2 Onthe Enter Password screen enter the operator password The default operator password is 1234 The lock icon is unlocked and shows an O toindicate that you have operator level security clearance 8 44 Configuring a Shared SCSI Bus for Tape Drive Use 3 On the Operator screen press the Configure Library button The Configure Library screen displays the current library configuration Note You can configure the library model number number of storage bins number of drives library SCSI ID and tape drive SCSI IDs from the Configure Library screen To change any of the configurations press the Configure button 5 Press the Select button until the item you wish to configure is highlighted For the
119. 20 in a Cluster Using External Terminations inks Sivek aie aah a eee eden Cabling an HSZ40 or HSZ50 RAID Array Controller ina Radial Configuration with an UltraSCSI Hub 10 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 1 10 1 1 10 1 2 10 1 3 10 1 4 10 1 4 1 10 1 4 2 10 1 4 3 10 1 4 4 10 1 4 5 TruCluster Server Hardware Installation Using PCI SCSI Adapters airaa oie eee Ea eee Pei y iaai ects Radial Installation of aK ZPSA BB or KZPBA CB Using Internal Termination cccccceeeeseeeeeeeeeeeneeeeeneees Installing a KZPSA BB or KZPBA CB Using External TERMINAL ON Asea a ea ae e a aa Displaying KZPSA BB and KZPBA CB Adapters with the show Console Commands 6 eeeeeee eect eee eee Displaying Console Environment Variables and Setting the KZPSA BB and KZPBA CB SCSI ID 0055 Displaying KZPSA BB and KZPBA CB pk or isp Console Environment Variables seses Setting the KZPBA CB SCSI ID aeee Setting KZPSA BB SCSI Bus ID Bus Speed and Termination POWer ccccceecceeeeseeeeeeeeeeeenneeees KZPSA BB and KZPBA CB Termination Resistors Updating the KZPSA BB Adapter Firmware A Worldwide ID to Disk Name Conversion Table Index Examples 4 1 4 2 4 3 4 4 4 5 Displaying Configuration on an AlphaServer DS20 Displaying Devices on an AlphaServer DS20 0005 Displaying Configura
120. 2000 storage arrays If used ensure that the external cache battery ECB is connected to the controller cache module s Install the fiber optic cables between the KGPSA and the switch Set the power verification and addressing PVA ID Use PVA ID 0 for the enclosure that contains the HSG80 controller s Set the PVA ID to 2 and 3 on expansion enclosures if present Note Do not use PVA ID 1 With Port Target LUN PTL addressing the PVA ID is used to determine the target ID of the devices on ports 1 through 6 the LUN is always zero Valid target ID numbers are 0 through 15 excluding numbers 4 through 7 Target IDs 6 and 7 are reserved for the controller pair and target IDs 4 and 5 are never used The endosure with PVA ID 0 will contain devices with target IDs O through 3 with PVA ID 2 target IDs 8 through 11 with PVA ID 3 target IDs 12 through 15 Setting a PVA ID of an enclosure to 1 would set target IDs to 4 through 7 generating a conflict with the target IDs of the controllers Remove the program card ESD cover and insert the controller s program card Replace the ESD cover Install disks into storage shelves Connect a terminal to the maintenance port on one of the HSG80 controllers You need a local connection to configure the controller for the first time The maintenance port supports serial communication with the following default values 6 28 Using Fibre Channel Storage 10 11
121. 21L cable between a Y cable or trilink connector on one of the system host bus adapters and the open connector on the trilink on the DWZZB AA differential end Keep the total length of the differential segment below the 25 meter maximum length Ensurethat thetrilink or Y cable at both ends of the differential segment of the shared SCSI bus is terminated with an H D68 differential terminator such as an H879 AA 4 Install a 152732 001 LVD terminator on one of the Compaq 40 80 GB DLT Drive SCSI connectors The LVD terminator works with either a low voltage differential or a single ended SCSI bus 5 Connect one of the following H D68 to H D68 cables between the other Compag 40 80 GB DLT Drive SCSI connector and the single ended end of the DWZZB AA signal converter e 189646 001 0 9 meter or 189646 002 1 8 meter cable e BN21K 01 or BN21L 01 1 meter cable e BN21K 02 or BN21L 02 2 meter cable This single ended SCSI bus segment is limited to a maximum length of 3 meters fast SCSI The single ended SCSI bus may be daisy chained from one tape drive to another with one of the cables listed in step 5 as long as you do not exceed the single ended SCSI bus maximum length of 3 meters The distance includes the length of both cables on the single ended bus segment Ensure that the tape drive on the end of the bus is terminated with an LVD terminator Ensure that SCSI IDs for the tape drive and host bus adapter do not conflict Configuring a
122. 3 6 1 2 5 DS DWZZH 05 Indicators cece eeee eee 3 15 3 6 1 3 Installing the DS DWZZH 05 UltraSCSI Hub 3 15 3 7 Preparing the UltraSCSI Storage Configuration 3 16 3 7 1 Configuring Radially Connected TruCluster Server Clusters with UltraSCSI Hardware 0 eeeee ee 3 17 3 7 1 1 Preparing an HSZ70 or HSZ80 for a Shared SCSI Bus Using Transparent Failover Mode 0 eeee eee 3 18 3 7 1 2 Preparing a Dual Redundant HSZ70 or HSZ80 for a Shared SCSI Bus Using Multiple Bus Failover 3 22 4 TruCluster Server System Configuration Using UltraSCSl Hardware 4 1 Planning Your TruCluster Server Hardware Configuration 4 2 4 2 Obtaining the Firmware Release Notes eeeeene eee 4 4 4 3 TruCluster Server Hardware Installation seeen 4 5 iv Contents 4 3 1 4 3 2 4 3 3 4 3 3 1 4 3 3 2 4 3 3 3 Installation of a KZPBA CB Using Internal Termination for a Radial Configuration cccccee eee ereere ees Displaying KZPBA CB Adapters with the show Console COMIMANAS poieni cody eh eevee die vee eisai de eee i cena eed Displaying Console Environment Variables and Setting the KZPBA CB SCSI ID 0 c ec ece cece ee eee ee ee eee Displaying KZPBA CB pk or isp Console Environment Variables c ceeeeeeeee eee e teens Setting the KZPBA CB SCSI ID eese KZPBA CB Termination Resistors eeee 5 Setting Up the Memory Channel Cluste
123. 4 number of 2 5 4 3 requirements 3 2 single ended 3 4 using trilink connectors 9 6 using Y cables 9 6 shared storage BA350 storage shelf 9 15 increasing capacity 4 2 4 3 non UltraSCS BA356 storage shelf 9 15 RAID subsystem array controller 9 24 UltraSCSI BA356 storage shelf 9 15 9 17 shortwave 6 24 show csb 7 16 show nvr 7 10 show system 7 14 SHOW THIS CONTROLLER command 6 33 signal converters 9 2 Index 10 creating differential bus 9 2 differential O module 9 2 differential termination 9 3 DS BA35X DA personality module 3 5 9 4 extending differential bus length 9 2 fast SCSI bus speed 9 2 overview 9 2 requirement 9 2 restrictions 2 11 SBB 9 2 single ended termination 9 3 standalone 9 2 terminating 9 2 termination 9 3 single ended SCSI buses description of 3 4 single ended transmission definition 3 4 storage shelves 9 8 9 9 9 13 attaching to shared SCSI bus 9 8 9 13 BA350 9 9 BA356 9 9 overview 9 8 9 13 setting up 3 16 9 14 subscriber connector 6 17 switch 10Base T Ethernet connection 6 16 changing password 6 22 changing user names 6 22 front panel 6 16 6 19 GBIC 6 17 installing 6 16 interface module 6 17 overview 6 16 setting Ethernet IP address 6 19 setting switch name 6 23 telnet session 6 23 sysconfig 5 18 sysconfigtab 5 18 system control manager SeeSCM system reset 6 25 6 48 T table of connections 6 58 terminal emulat
124. 5 8 last system repeat steps 1 7 and replace the MC1 adapters on the other interconnect 9 If desired after the last member system has had its second sysconfig MC1 adapter replaced with an MC2 adapter and the reference pages cluster is operational if all MC2 adapters are jumpered for 512 MB and you need to utilize 512 MB address space enable increasing the address space to 512 MB Setting Up the Memory Channel Cluster Interconnect 5 17 Table 5 4 Adding a Memory Channel Interconnect or Rolling from a Dual Redundant MC1 Interconnect to MC2 Interconnects cont Step Action Refer to On one member system use the sysconfig command to reconfigure the Memory Channel kernel subsystem to initiate the use of 512 MB address space The configuration change is propagated to the other cluster member systems sbin sysconfig r rm rm_use_512 1 Note After the configuration change is propagated to the other member systems you can reboot any member system and the 512 MB address space is still in effect If you use the sysconfig command to promote address space to 512 MB and inadvertently leave an MC2 adapter jumpered for 128 MB then reboot that system it will not rejoin the cluster When the system with the Memory Channel adapter jumpered for 128 MB is shut down and the TruCluster software running on the remaining cluster member systems discover that all operational Memory Channel adapters are jumpered for 512 MB because add
125. 7 0 0 1 3 PDPPP SPP sSiys soso Seo Sie See P P P PP 2670 1 2 32 POPP HPR Say cy ear BLL BIG P P P PP 26 0 1 3 33 PPPPSaPP Seo eS So Se P P P SPP 290 HSwitch Type Cables 76543210 Temp C HPM40 8 port PPPP 29 0 11 12 13 14 15 16 PCI Risel 1 Risel 0 Rise0 1 Rise0 0 RIO PS Temp Cab 7654 r i 7654 r ae En LO AL C 10 LLLM M MLLUUL LLS ik PP 305 11 LLLM M MLLUL LLs AS PPE 23 0 0 Hard partition number There are two hard partitions in this example 0 and 1 7 14 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 2 QBB number and console serial bus CSB node ID QBB 0 and 1 CSB node IDs 30 and 31 arein partition 0 QBB 2 and 3 CSB node IDs 32 and 33 are in partition 1 3 CPU module is present powered up and has passed self test P A dash indicates an empty slot An F indicates a self test failure In this example each QBB contains four CPU modules each of which has passed self test 4 Memory module is present powered up and has passed self test P A dash indicates an empty slot An F indicates a self test failure In this example each QBB contains two memory modules both of which has passed self test 5 Status of the PCI drawer I O risers that are plugged into the QBB I O risers in the form of Xm n X can either be a P p F or a dash QBB local I O risers are IoRo Port 0 T
126. 85 is connected to a single ended segment of the shared SCSI bus It is connected to a differential portion of the shared SCSI bus with a DWZZA AA or DWZZB AA Figure 8 7 shows a configuration of a TZ885 for use on a shared SCSI bus To configure the shared SCSI bus for use with a TZ885 follow these steps 1 You will need one DWZZA AA or DWZZB AA for each TZ885 tape drive Ensure that the DWZZA jumper J 2 or DWZZB jumpers W1 and W2 are installed to enable the single ended termination Remove the termination from the differential end by removing the five 14 pin SIP resistors 2 Attach a trilink connector to the differential end of the DWZZA or DWZZB 3 Connect the single ended end of a DWZZA to the TZ885 with a BC19 cable Connect the single ended end of a DWZZB to the TZ885 with a BN21M cable 4 Install an H8574 A or H8890 AA terminator on the other TZ885 SCSI connector 5 Connect a trilink or Y cable to the differential shared SCSI bus with BN21K or BN21L cables Ensure that thetrilink or Y cable at the end of the bus is terminated with an H879 AA terminator The single ended SCSI bus may be daisy chained from one single ended tape drive to another with BC19 cables as long as the SCSI bus maximum length is not exceeded Ensure that the tape drive on the end of the bus is terminated with a H8574 A or H8890 AA terminator You can add additional TZ885 tape drives to the differential shared SCSI bus by adding additional DWZZA or
127. Array Controller ACS Version 8 5 Maintenance and Service Guide MA6000 HSG60 Array Controller ACS Version 8 5 Solution Software for Compaq Tru64 UNIX Installation and Configuration Guide Compaq StorageWorks Release Notes RA8000 ESA12000 and MA8000 EMA12000 Solution Software V8 5b for Tru64 UNIX Compaq StorageWorks Modular Array Configuration Guide Modd 2100 and 2200 Ultra SCSI Controller Enclosures User Guide Compaq StorageWorks Enclosure 4200 Family LVD Disk Enclosure User Guide Wwidmgr User s Manual Consult the following documentation for other Fibre Channel storage information KGPSA BC PClI to Optical FibreChanne Host Adapter User Guide 64 Bit PCl to Fibre Channa Host Bus Adapter User Guide Compaq StorageWorks FibreChannd Storage Switch User s Guide About This Manual xix Compaq StorageWorks SAN Switch 8 Installation and Hardware Guide Compaq StorageWorks SAN Switch 16 Installation and Hardware Guide Compaq StorageWorks Fibre Channa SAN Switch 8 EL Installation and Hardware Guide Compaq StorageWorks Fibre Channd SAN Switch Management Guide Compaq StorageWorks SAN Switch Fabric Operating System Management Guide Fibre Channa Storage Hub 7 Installation Guide Fibre Channa StorageHub 7 Rack Mounting Installation Card For information about the tape devices see the following manuals TZ88 DLT Series Tape Drive Owner s Manual TZ89 DLT Series Tape Drive User s Guide TZ885 Modd 100 200 GB DLT 5 CartridgeMiniLibrary Ow
128. As with any of the shared SCSI devices the TZ88N TA and TZ88N VA SCSI IDs must be set to ensure that no two SCSI devices on the shared SCSI bus have the same SCSI ID The following sections describe preparing the TZ88 in more detail Configuring a Shared SCSI Bus for Tape Drive Use 8 1 8 1 1 Setting the TZ88N VA SCSI ID You must set the TZ88N VA switches before the tape drive is installed into the BA350 StorageWorks enclosure The Automatic selection is normally used The TZ88N VA takes up three backplane slot positions The physical connection is in the lower of the three slots For example if the tape drive is installed in slots 1 2 and 3 with the switches in Automatic the SCSI ID is 3 If the tape drive is installed in slots 3 4 and 5 with the switches in Automatic the SCSI ID is 5 The switch settings are shown in Table 8 1 Figure 8 1 shows the TZ88N VA with the backplane interface connector and SCSI ID switch pack Figure 8 1 TZ88N VA SCSI ID Switches Backplane Interface Connector SCSI ID Switch Pack Locking Handles TZ88N VA 8 2 Configuring a Shared SCSI Bus for Tape Drive Use Table 8 1 TZ88N VA Switch Settings SCSI ID SCSI ID Selection Switches 1 2 3 4 5 6 Automatic Off Off Off On On On 0 Off Off Off Off Off Off 1 On Off Off Off Off Off 2 Off On Off Off Off Off 3 On On Off Off Off Off 4 Off Off On Off Off Off 5 On Off On Off Off Off 6 Off On On Off Of
129. B AA and DS DSGGC AA Ethernet IP Address and Subnet Mask from a PC Or Terminal ccceeece cnet i ee iiaa 6 5 1 2 4 Logging In tothe Switch with a Telnet Connection 6 5 1 2 5 Setting the Switch Name via Telnet Session 6 5 2 Installing and Configuring the KGPSA PClI to Fibre Channel Adapter Module c ceeeeeeee eens eta eeeeaes 6 5 2 1 Installing the KGPSA PCI to Fibre Channel Adapter Mod l Ecin pena i ass a bh tration a aa Eaa ee 6 5 2 2 Setting the KGPSA BC or KGPSA CA to Run on a Fabric fe ieteice sted elaw nae Ske eed aai eevee ia EEEa 6 5 2 3 Obtaining the Worldwide Names of KGPSA Adapters 6 5 3 Setting Up the HSG80 Array Controller for Tru6 4 UNIX Instal lation ies eera naa Pea Aa A eae eee 6 5 3 1 Obtaining the Worldwide Names of HSG80 Controller 6 6 Installing Tru64 UNIX and TruCluster Server Software Using Fibre Channel Storage cece cece eee eee tenet eee need 6 6 1 Before You Install c cece cece eee ee eee eee eee eae 6 6 1 1 Configure the HSG80 Storagesets eeeeeaee 6 6 1 2 Adding Units and Identifiers to the HSG80 SEOPAGESES aioe i de edison aby idle fa Heel aaiae sable dete 6 6 1 3 Set the Device Unit Number ccceeee eee eee 6 6 1 4 Displaying the Available Boot Devices 6 6 1 5 Set the bootdef_dev Console Environment Variable for vi Contents Tru64 UNIX Installation wo cece cece eee eee e ees 6 11 6 14 6 14 6 15 6 16
130. Bus for Tape Drive Use installing an HD68 SCSI bus terminator on the SCSI bus port connector on the cabinet exterior This is not wrong but by reconfiguring in this manner the length of the SCSI bus is increased by 1 5 meters and may cause problems if SCSI bus length is of concern In a future revision of the previously mentioned guide the bus configuration figures will be modified to show all SCSI buses terminated at the tape drives 8 9 4 Connecting the TL894 Tape Library to the Shared SCSI Bus The TL894 tape libraries have up to 3 meters of internal SCSI cabling per SCSI bus Because of the internal SCSI cable lengths it is not possible to use a trilink connector or Y cable to terminate the SCSI bus external to the library as is done with other devices on the shared SCSI bus Each SCSI bus must be terminated internal to the tape library at the tape drive itself with the installed SCSI terminators Therefore TruCluster Server clusters using the TL894 tape library must ensure that the tape library is on the end of the shared SCSI bus In a TruCluster Server cluster with a TL894 tape library the member systems and StorageWorks enclosures or RAID subsystems may be isolated from the shared SCSI bus because they use trilink connectors or Y cables However the ASE must be shut down to remove a tape loader from the shared bus Figure 8 13 shows a sample TruCluster Server cluster using a TL894 tape library In the sample configurati
131. C or video terminal to set the Ethernet IP address and subnet mask To set the Ethernet IP address and subnet mask for the DS DSGGB AA or DS DSGGC AA switches follow these steps 1 Connect the switch serial port toa terminal or PC COM port with a standard serial cable with a DB9 connector Note that the serial port is only used for initial power on self test POST verification IP address configuration or for resetting the factory default settings If you are using a PC start a remote communication program for example HyperTerminal Set the port settings to 9600 bits per second 8 bits per character and no parity Turn on power to the switch and log in e DS DSGGB AA The switch automatically connects to the host and logs the user on to the switch as admin e DS DSGGC AA Plugging in the DS DSGGC AA switch turns the power on there is no on off power switch Login as the admin user The password is password Enter the ipAddrSet command then enter the IP address subnet mask and gateway address if necessary For example admin gt ipAddrSet Ethernet IP Address 10 77 77 77 16 142 72 54 Ethernet Subnetmask 255 255 255 0 Return Fibre Channel IP Address none Return Fibre Channel Subnetmask none Return Gateway Address none Return admin gt logout Using Fibre Channel Storage 6 21 When you have completed setting the IP address and subnet mask disconnec
132. CSI bus and device buses Both controllers service the entire group of storagesets single disk units or other storage devices Either controller can continue to service all of the units if the other controller fails Note The assignment of H SZ target IDs can be balanced between the controllers to provide better system performance See the RAID array controller documentation for information on setting up storagesets Introduction 1 13 Note that in the configuration shown in Figure 1 6 there is only one shared SCSI bus Even by mirroring the clusterwide root and member boot disks the single shared SCSI bus is a single point of failure 1 5 5 Creating a NSPOF Cluster To create a no single point of failure NSPOF cluster Use hardware RAID to mirror the clusterwide root usr and var file systems the member boot disks quorum disk if present and data disks Use at least two shared SCSI buses to access dual redundant RAID array controllers set up for multiple bus failover mode HSZ70 HSZ80 and HSG80 Install a second Memory Channel interface for redundancy Install redundant power supplies Install redundant networks Connect the systems and storage to an uninterruptable power supply UPS Tru64 UNIX support for multipathing provides support for multiple bus failover Notes Only the HSZ70 HSZ80 HSG60 and HSG80 are capable of supporting multiple bus failover SET MULTIBUS FAILOVER COPY THIS CONTRO
133. Channel Storage Figure 6 6 Multiple Bus NSPOF Configuration Number 2 Member Member peter System Memory Channel 2 Interface Memory Channel KGPSA KGPSA Memory Channel KGPSA ZK 1707U Al Using Fibre Channel Storage 6 13 Figure 6 7 Multiple Bus NSPOF Configuration Number 3 Member Member System System 1 Memory Channel 2 Memory Interface Memory Channel Channel KGPSA KGPSA KGPSA KGPSA ZK 1765U Al 6 4 Zoning and Cascaded Switches This section provides a brief overview of zoning and cascaded switches 6 4 1 Zoning A zone is a logical subset of the Fibre Channel devices connected to the fabric Zoning allows partitioning of resources for management and access control In some configurations it may provide for more efficient use of hardware resources by allowing one switch to serve multiple clusters or even multiple operating systems Figure 6 8 provides an example configuration using zoning This configuration consists of two independent zones with each zone containing an independent cluster 6 14 Using Fibre Channel Storage Figure 6 8 A Simple Zoned Configuration Memory Memory Memory Memory Channel Channel Channel Channel Cluster 1 Cluster 1 Cluster 2 Cluster 2 Member Member Member Member System 1 System 2 System 1 System 2 KGPSA KGPSA KGPSA KGPSA We 4 6 8 10 A Us 2 7 PE eae ZK 1709U Al Note Only static zoning is supported zones can only be changed when al
134. D cable on one SCSI bus segment must not exceed 25 meters The maximum length of the BN37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters 8 12 Preparing the TL881 and TL891 DLT MiniLibraries for 8 12 1 8 12 1 1 Shared Bus Usage The topics in this section provide an overview of the Compaq StorageWorks TL881 and TL891 Digital Linear Tape DLT MiniLibraries and hardware configuration information for preparing the TL881 or TL891 DLT MiniLibrary for use on a shared SCSI bus TL881 and TL891 DLT MiniLibraries Overview For more information on the TL881 or TL891 DLT MiniLibraries see the following Compaq documentation e TL881 MiniLibrary System User s Guide e TL891 MiniLibrary System User s Guide e TL881 MiniLibrary Drive Upgrade Procedure e Pass Through Expansion Kit Installation Instructions The TL881 and TL891 Digital Linear Tape DLT MiniLibraries are offered as standalone tabletop units or as expandable rackmount units The following sections describe these units in more detail TL881 and TL891 DLT MiniLibrary Tabletop Model The TL881 and TL891 DLT MiniLibrary tabletop model consists of one unit with a removable 10 cartridge magazine integral bar code reader and either one or two DLT 20 40 TL881 or DLT 35 70 TL891 drives The TL881 DLT MiniLibrary tabletop model is available as either fast wide differential or fast wide single ended The single ended m
135. D 7 3 a eK I O o DWZZB AA P Gl TZ887 ZK 1759U Al Table 8 6 shows the components used to create the cluster shown in Figure 8 9 8 22 Configuring a Shared SCSI Bus for Tape Drive Use 8 7 Preparing the TL891 and TL892 DLT MiniLibraries for Shared SCSI Usage Note To achieve system performance capabilities we recommend placing no more than two TZ89 drives on a SCSI bus and also recommend that no shared storage be placed on the same SCSI bus with a tape library The TL891 and TL892 MiniLibraries use one TL 891 or two TL892 TZ89N AV differential tape drives and a robotics controller which access cartridges in a 10 cartridge magazine Each tape drive present and the robotics controller have individual SCSI IDs There are six 68 pin high density SCSI connectors located on the back of the MiniLibrary two SCSI connectors for each drive and two for the robotics controller The TL891 uses a 0 3 meter SCSI bus jumper cable part of the TL891 package to place the robotics controller and tape drive on the same SCSI bus When upgrading to the TL892 you can place the second drive on the same SCSI bus another 0 3 meter SCSI bus jumper cable is supplied with the DS TL892 UA upgrade kit or place it on its own SCSI bus The following sections describe how to prepare the TL891 and TL892 in more detail 8 7 1 Setting the TL891 or TL892 SCSI ID The control panel on the front of the TL891 and TL892 MiniLibrari
136. D Switches c cece eee eee eee Compaq 20 40 GB DLT Tape Drive Rear Panel 55 Cabling a Shared SCSI Bus with a Compaq 20 40 GB DLT Tape Drive t2c 023 iann r te Levis Serene da eens yee eeha ira aa Aaa Cabling a Shared SCSI Bus with a Compaq 40 80 GB DLT DEVE maaa a a A A a a a a a a kaa ad Cabling a Shared SCSI Bus with a TZ885 cccceeeeeees TZ887 DLT MiniLibrary Rear Panel eseese Cabling a Shared SCSI Bus with a TZ887 l enn TruCluster Server Cluster with a TL892 on Two Shared SCSI TL890 and TL892 DLT MiniLibraries on Shared SCSI Buses TL894 Tape Library Four Bus Configuration 060085 Shared SCSI Buses with TL894 in Two Bus Mode TL895 Tape Library Internal Cabling cccceeeneeeees TL893 Three Bus Configuration ccceeeee eee eee eee eee TL896 Six Bus Configuration c cceee eect eee eee eee Shared SCSI Buses with TL896 in Three Bus Mode TL891 Standalone Cluster Configuration ceeeeee TL891 DLT MiniLibrary Rackmount Configuration ESL9326D Internal Cabling cceeeee eee e eee teens Standalone SCSI Signal Converter cceeeee cence eee SBB SCSI Signal Converter cccceeeeee eee ee ee eee eens DS BA35X DA Personality Module Switches 645 BN21W OB Y Cable cccccece eee eee eee eee eee eeaeeaeeaeeaes HD68 Trilink Connector H885 AA
137. D assignments are not linked to the physical port when fair arbitration is disabled The DS DWZZH 05 reserves SCSI ID 7 regardless of whether fair arbitration is enabled or not 3 12 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 6 1 2 3 DS DWZZH 05 Address Configurations The DS DWZZH 05 has two addressing modes wide addressing mode and narrow addressing mode With either addressing mode if fair arbitration is enabled each hub port is assigned a specific SCSI ID This allows the fair arbitration logicin the hub to identify the SCSI ID of the device partici pating in the arbitration phase of the fair arbitration cycle Caution If fair arbitration is enabled The SCSI ID of the host adapter must match the SCSI ID assigned to the hub port Mismatching or duplicating SCSI IDs will cause the hub to hang SCSI ID 7 is reserved for the DS DWZZH 05 whether fair arbitration is enabled or not J umper W1 accessible from the rear of the DS DWZZH 05 see Figure 3 3 determines which addressing mode is used The jumper is installed to select narrow addressing mode If fair arbitration is enabled the SCSI IDs for the host adapters are 0 1 2 and 3 See the port numbers not in parentheses in Figure 3 4 The controller ports are assigned SCSI IDs 4 through 6 and the hub uses SCSI ID 7 If jumper W1 is removed the host adapter ports assume SCSI IDs 12 13 14 and 15 The controllers are assigned SCSI IDs 0
138. DS DWZZH UltraSCS I Hub Maximum Configurations Hardware Components Used in Configuration Shown in Figure 3 5 Through Figure 3 8 ccceeeeee eee eee eens Planning Your Configuration ccceee cece e eee eee eens Configuring TruCluster Server Hardware ceceeeeeeeees Installing the KZPBA CB for Radial Connection toa DWZZH U ltraSCSl Hub riesenia eet te biden ad aa MC1 and MC1 5J umper Configuration eeeeees MC2 J umper Configuration ceeeeeee eee eee eee eee eee MC2 Linecard J umper Configurations 0 eceeeee eee Adding a Memory Channel Interconnect or Rolling from a Dual Redundant MC1 Interconnect toMC2 Interconnects Telnet Session Default User Names for Fibre Channel SWITCHES aeram eva i ee a E E Ea in Converting Storageset Unit Numbers to Disk Names TZ88N VA Switch SettingS ccc ceee cece eee eee eee eae eee Hardware Components Used to Create the Configuration Shown in Figure 8 2 0 0 0 cceecce cece eee eee ee ee eee e nae DS TZ89N VW Switch SettingS cece cece nett eee eee Hardware Components Used to Create the Configuration Shown in Figure 8 5 2 0 0c ceeece cece eee eee eee eee eee nae Hardware Components in the Configuration in Figure 8 6 Hardware Components Used to Create the Configuration Shown in Figure 8 6 c cece eect eee teeta ena Hardware Components Used to Create the Configuration Shown in
139. DWZZB TZ885 combinations 8 18 Configuring a Shared SCSI Bus for Tape Drive Use Note Ensure that there is no conflict with tape drive and host bus adapter SCSI IDs Figure 8 7 Cabling a Shared SCSI Bus with a TZ885 Network Member Memory Member System Channel System 1 Interface 2 Memory Channel Memory Channel KZPBA CB ID 6 KZPBA CB ID 7 ZK 1760U Al Table 8 6 shows the components used to create the cluster shown in Figure 8 7 Table 8 6 Hardware Components Used to Create the Configuration Shown in Figure 8 6 Callout Number Description BN38C or BN38D cable BN37A cable H8861 AA VHDCI trilink connector H8863 AA VHDCI terminator BN21W 0B Y cable H879 AA terminator 328215 00X BN21K or BN21L cables Nl Olu BR WwW Nie Configuring a Shared SCSI Bus for Tape Drive Use 8 19 Table 8 6 Hardware Components Used to Create the Configuration Shown in Figure 8 6 cont Callout Number Description 8 H885 AA trilink connector 9 BN21M cable 10 H8574 A terminator a The maximum length of the BN38C or BN 38D cable on one SCSI bus segment must not exceed 25 meters The maximum length of the BN37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters 8 6 Preparing the TZ887 for Shared SCSI Bus Usage TheTZ887 Digital Linear Tape DLT MiniLibrary combines a cartridge tape drive TZ88
140. F Cluster iranin nn Eee a a AE angen EEA AA a NANa aia Two N ode Clusters Using an UltraSCS BA356 Storage Shelf and Minimum Disk Configurations Two Node Clusters Using UltraSCS I BA356 Storage Units with Increased Disk Configurations eeeeeee Two Node Configurations with UltraSCS I BA356 Storage Units and Dual SCSI BUSES cece cece eee eee Using Hardware RAID to Mirror the Clusterwide Root File System and Member System Boot Disks Creating aNSPOF Cluster eenen Overview of Setting Up the TruCluster Server Hardware Config rati ON sey seasick ete eddie shee Aaa deck da pate ene Ae eves 2 Hardware Requirements and Restrictions 2 1 2 2 2 3 2 3 1 2 3 2 2 3 3 2 4 2 5 TruCluster Server Member System Requirements Memory Channel Restrictions cceeeeee eee eee teens Host Bus Adapter Restrictions cceeeeee eee eee eee eee Fibre Channel Requirements and Restrictions KZPSA BB SCSI Adapter Restrictions 0es KZPBA CB SCSI Bus Adapter Restrictions Disk Device Restrictions cece cece eee nett e eee eee RAID Array Controller Restrictions cceeceeeee eee eee POMNMNMNNN DND P qannanannawd Contents iii 2 6 SCSI Signal Converters eceeceee eee eee eee teense eee eae eas 2 10 2 7 DS DWZZH 03 and DS DWZZH 05 UltraSCSI Hubs 2 11
141. Hubs The DS DWZZH 03 and DS DWZZH 05 series UltraSCSI hubs are the only hubs supported in a TruCluster Server configuration They are SCSI 2 and draft SCSI 3 compliant SCSI 16 bit signal converters capable of data transfer rates of up to 40 MB sec These hubs can be listed with the other SCSI bus signal converters but as they are used differently in cluster configurations they will be discussed differently in this manual A DS DWZZH 03 or DS DWZZH 05 UltraSCSI hub can be installed in e A StorageWorks UltraSCSI BA356 shelf which has the required 180 watt power supply Hardware Requirements and Restrictions 2 11 The lower righthand device slot of the BA370 shelf within the RA7000 or ESA 10000 RAID array subsystems This position minimizes cable lengths and interference with disks A wide BA356 which has been upgraded to the 180 watt power supply with the DS BA35X HH option A DS DWZZH 03 or DS DWZZH 05 UltraSCSI hub Improves the reliability of the detection of cable faults Provides for bus isolation of cluster systems while allowing the remaining connections to continue to operate Allows for more separation of systems and storage in a cluster configuration because each SCSI bus segment can be up to 25 meters in length This allows a total separation of nearly 50 meters between a system and the storage Note The DS DWZZH 03 05 UltraSCSI hubs cannot be connected toa StorageWorks BA35X storage shelf because the storag
142. I bus Configuring a Shared SCSI Bus for Tape Drive Use 8 61 For complete hardware installation instructions see the TL881 MiniLibrary System User s Guide or TL891 MiniLibrary System User s Guide 8 12 2 1 1 Setting the Standalone MiniLibrary Tape Drive SCSI ID The control panel on the front of the TL891 and TL 892 MiniLibraries is used to display power on self test POST status display messages and to set up MiniLibrary functions When power is first applied toa MiniLibrary a series of POST diagnostics are performed During POST execution the MiniLibrary model number current date and time firmware revision and the status of each test is displayed on the control panel After the POST diagnostics have completed the default screen is shown DLTO Idle DLT1 Idle Loader Idle 0 gt lt 9 The first and second lines of the default screen show the status of the two if present drives The third line shows the status of the library robotics and the fourth line is a map of the magazine with the numbers from 0 to 9 representing the cartridge slots Rectangles present on this line indicate cartridges present in the corresponding slot of the magazine For example this fourth line o gt x x lt 9 where an X represents a rectangle indicates that cartridges are installed in slots 0 and 1 Note There are no switches for setting a mechanical SCSI ID for the tape drives The SCSI IDs default to five The MiniLi
143. ID Figure 1 5 shows a small cluster configuration with dual SCSI buses using LSM to mirror the clusterwide usr and var file systems and the data disks Introduction 1 11 Figure 1 5 Two Node Configurations with UltraSCSI BA356 Storage Units and Dual SCSI Buses UltraSCSI BA356 Member System 1 Host Bus Adapter ID 6 Host Bus Adapter ID 6 Memory Channel UltraSCSI BA356 Network Memory Channel Interface UltraSCSI BA356 Member System Memory Channel Host Bus Adapter ID 7 Host Bus Adapter ID 7 UltraSCSI BA356 la See Clusterwide ID8 Mirrored Mirrored IDO usr var Data Disk IDO usr var Data Disk ID8 Member 1 ID9 Mirrored ID 1 Boot Disk Data Disk ID 1 Not Used Data Disk ID Member 2 ID 10 Mirrored ID2 Boot Disk Data Disk ID2 Not Used Data Disk D10 Quorum ID 11 Mirrored D3 Disk Data Disk ID 3 Not Used Data Disk 1D 11 ID 12 Mirrored Mirrored IDs Bate Disk Data Disk 94 Data Disk Data Disk D 12 ID 13 Mirrored Mirrored IDS Data Disk Data Disk 25 Data Disk Data Disk D 13 Redundant ID 14 or Redundant ID 14 or ID6 PWR or not PWR ID6 PWR or not PWR used used PWR PWR PWR PWR ZK 1593U Al By using LSM to mirror the usr and var file systems and the data disks we
144. IDs for a Rackmount TL881 or TL891 DLT MiniLibrary After the base units have been reconfigured as slaves each base unit control panel still provides tape drive status and error information but all control functions are carried out from the expansion unit control panel This includes setting the SCSI ID for each of the tape drives present To set the SCSI Ds for the tape drives in a TL881 or TL891 DLT MiniLibrary rackmount configuration follow these steps 1 Apply power tothe MiniLibrary ensuring that you power up the expansion unit after or at the same time as the base and data units 2 Wait until power on self tests POST have terminated and the expansion unit and each base and data unit display the default screen 3 At the expansion unit control panel press the Enter button to display the Main Menu 4 Press the down arrow button until the Configure Menu item is selected and then press the Enter button to display the Configure submenu 5 Press the down arrow button until the Set SCSI item is selected and press the Enter button 6 Press the up or down arrow button to select the appropriate tape drive DLTO Bus ID DLT1 Bus ID DLT2 Bus ID and so on or library robotics Library Bus 1D for which you wish to change the SCSI bus ID In a configuration with three base units and assuming that each base unit has two tape drives the top base unit contains DLTO and DLT1 The next base unit down contains DLT2 and DLT3 The ne
145. IS WITHOUT WARRANTY OF ANY KIND THE ENTIRE RISK ARISING OUT OF THE USE OF THIS INFORMATION REMAINS WITH RECIPIENT INNO EVENT SHALL COMPAQ BE LIABLE FOR ANY DIRECT CONSEQUENTIAL INCIDENTAL SPECIAL PUNITIVE OR OTHER DAMAGES WHATSOEVER INCLUDING WITHOUT LIMITATION DAMAGES FOR LOSS OF BUSINESS PROFITS BUSINESS INTERRUPTION OR LOSS OF BUSINESS INFORMATION EVEN IF COMPAQ HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES AND WHETHER IN AN ACTION OF CONTRACT OR TORT INCLUDING NEGLIGENCE The limited warranties for Compaq products are exclusively set forth in the documentation accompanying such products Nothing herein should be construed as constituting a further or additional warranty Contents About This Manual 1 Introduction 1 3 1 1 1 3 1 2 1 3 1 3 3 1 4 1 1 1 1 a 1 2 3 3 1 4 5 0 1 0 2 0 3 0 4 The TruCluster Server Product cceeeeeeeee eee eee eae eee Memory Requirements cecee cece eee eee eens eee eta e eee Minimum Disk Requirements ccceceee cece teeta eens Disks Needed for Installation cccceeeeeeeeeeeeeees Tru64 UNIX Operating System Disk 0005 Clusterwide DiSk S ccc cece cece cece eee e eee e eee ees Member Boot DISK cccccce ce aa y e a Qu rum DISK raiteita aa a a E Generic Two Node Cluster ccecce ee eseeeeeeeeeeeeseeeeeneees Growing a Cluster from Minimum Storage to a NSPO
146. K or BN21L cable from the BN 21W 0B Y cable on each host bus adapter to the RAID array controller s e RAID array controller is on the end of the bus Connect a BN21K or BN21L cable from the BN21W 0B Y cable on one host bus adapter to the BN21W OB Y cable on the other host bus adapter Attach another BN21K or BN21L cable from the open BN21W 0B Y cable connector to the open H885 AA connector on the RAID array controller Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 25 Figure 9 12 shows two AlphaServer systems in a TruCluster Server configuration with dual redundant HSZ50 RAID controllers in the middle of the shared SCSI bus Note that the SCSI bus adapters are KZPSA BB PCl to SCSI adapters They could be KZPBA CB host bus adapters without changing any cables Figure 9 12 Externally Terminated Shared SCSI Bus with Mid Bus HSZ50 RAID Array Controllers Network Member System 2 Member System Channel Interface Memory Channel i Memory Channel KZPSA BB ID 6 KZPSA BB ID 7 1 Memory f q 00l 00 ZK 1596U AI Table 9 3 shows the components used to create the cluster shown in Figure 9 12 and Figure 9 13 Figure 9 13 shows two AlphaServer systems in a TruCluster Server configuration with dual redundant HSZ50 RAID controllers at the end of the shared SCSI bus As with Figure 9 12 the SCSI bus adapters are KZPSA BB PClI to SCSI adapters They could be KZ
147. KI100 RZ26 392A dki200 2 0 3 1 DKI200 RZ28 442C dki300 3 0 3 1 DKI300 RZ26 392A 4 3 3 Displaying Console Environment Variables and Setting the KZPBA CB SCSI ID The following sections show how to use the show console command to display the pk and isp console environment variables and set the KZPBA CB SCSI ID on various AlphaServer systems Use these examples as guides for your system Note that the console environment variables used for the SCSI options vary from system to system Also a class of environment variables for example pk or isp may show both internal and external options Compare the following examples with the devices shown in the show config and show dev examples to determine which devices are K ZPSA BBs or KZPBA CBs on the shared SCSI bus 4 14 TruCluster Server System Configuration Using UltraSCSI Hardware 4 3 3 1 Displaying KZPBA CB pk or isp Console Environment Variables To determine the console environment variables to use execute the show pk and show isp console commands Example 4 5 shows the pk console environment variables for an AlphaServer DS20 Example 4 5 Displaying the pk Console Environment Variables on an AlphaServer DS20 System P00 gt gt gt show pk pkaO_disconnect 1 pkaO_fast 1 pkaO_host_id 7 pkboO disconnect 1 pkbo_ fast ae pkbO_ host_id 7 pkcO_host_id 7 pkcO_soft_term on pkdo_host_id 7 pkdoO_soft_term on Comparing the show pk command display in Example 4 5 w
148. LLER Partitioned storagesets and partitioned single disk units cannot function in multiple bus failover dual redundant configurations with the HSZ70 or HSZ80 You must delete any partitions before configuring the controllers for multiple bus failover Partitioned storagesets and partitioned single disk units are supported with the HSG60 and HSG80 and ACS V8 5 or later Figure 1 7 shows a cluster configuration with dual shared SCSI buses and a storage array with dual redundant HSZ70s If thereis a failure in one SCSI bus the member systems can access the disks over the other SCSI bus 1 14 Introduction Figure 1 7 NSPOF Cluster Using HSZ70s in Multiple Bus Failover Mode Channel Member System 2 Interfaces perry cramer ead Rost Bis Adapter 77 Tru64 UNIX Disk Memory Member System 1 S Hosreus aspero f p HSZ70 HSZ70 StorageWorks RAID Array 7000 Figure 1 8 shows a cluster configuration with dual shared Fibre Channel SCSI buses and a storage array with dual redundant H SG80s configured for multiple bus failover ZK 1594U Al Introduction 1 15 Figure 1 8 NSPOF Fibre Channel Cluster Using HSG80s in Multiple Bus Failover Mode Member Member System System 1 Memory Channel 2 Memory Interface Memory Channel Channel KGPSA KGPSA KGPSA KGPSA ZK 1765U Al 1 6 Overview of Setting Up the TruCluster Server Hardware Configuration To set up a Tr
149. Mode displaying the Main Menu Note When you enter the Menu Mode the Ready light goes out an indication that the module is off line and all media changer commands from the host return a SCSI not ready status until you exit the Menu Mode and the Ready light comes on once again 2 Depress the down arrow button until the Configure Menu item is selected then press the Enter button to display the Configure submenu Note The control panel up and down arrows have an auto repeat feature When you press either button for more than one half second the control panel behaves as if you were pressing the button about four times per second The effect stops when you release the button 3 Press the down arrow button until the Set SCSI item is selected and press the Enter button 8 24 Configuring a Shared SCSI Bus for Tape Drive Use 4 Select the tape drive DLTO Bus ID or DLT1 Bus ID or library robotics LIB Bus D for which you wish tochange the SCSI bus ID The default SCSI IDs are as follows e Lib Bus ID 0 e DLTOBusID 4 e DLT1BusID 5 Use the up or down arrow button to select the item for which you need to change the SCSI ID Press the Enter button 5 Usetheup or down arrow button to scroll through the possible SCSI ID settings Press the Enter button when the desired SCSI ID is displayed Repeat steps 4 and 5 to se other SCSI bus IDs as necessary Press the Escape button repeatedly until the default menu is displaye
150. N 39B 04 cables 4 meter if the PCI drawer is in a GS160 or GS320 power cabinet Use BN 39B 10 cables 10 meter if the PCI drawer isin an expansion cabinet Ensure that you connect the cables to the 0 R and 1 R remote I O riser connections in the PCI drawer and not toa Memory Channel module Note We recommend that you connect I O riser O local I O riser ports 0 and 1 tothe primary PCI drawer that will be the master system control manager SCM If you require more than two PCI drawers in a hard partition you need more than one QBB in the partition Each QBB supports two PCI drawers 2 cables between a local I O riser and a PCI drawer 4 Set the PCI drawer node ID with the pushbutton up down counter on the CSB node ID module at the rear of each PCI drawer see Figure 7 3 Set the node ID of the primary PCI drawer with the master SCM tozero Set the node ID of the primary PCI drawer with the standby SCM if applicable to one Increment the PCI drawer node ID for successive PCI drawers 5 Ensure that the primary PCI drawer that contains the master SCM is connected to the OCP Connect the primary PCI drawer with the standby SCM if applicable to the OCP 6 Connect an H8585 AA connector to the terminal port on the standard 1 O module for the new partition Connect a BN 25G 07 cable between the H8585 AA connector and the terminal server to provide the console terminal connection to the system management console Use the system
151. N55 TRU64_ UNIX OTHER 2 230913 OL other 100 HOST _ID 1000 0000 C920 EDEB ADAPTER_ID 1000 0000 C920 EDEB NEWCON56 TRU64_ UNIX OTHER 2 230813 OL other 100 HOST _ID 1000 0000 C920 DA0 ADAPTER_ID 1000 0000 C920 DA01 NEWCON57 TRU64_ UNIX THIS 2 offline 100 Using Fibre Channel Storage 6 59 NEWCON58 NEWCON59 NEWCON60 NEWCON61 NEWCON62 NEWCON63 NEWCON64 NEWCON65 HOST _ID 1000 0000 C921 09F7 TRU64_ UNIX OTHER HOST _ID 1000 0000 C921 09F7 TRU64_ UNIX THIS HOST _ID 1000 0000 C921 09F7 TRU64_ UNIX OTHER HOST _ID 1000 0000 C921 09F7 TRU64_ UNIX THIS HOST _ID 1000 0000 C921 086C TRU64_ UNIX OTHER HOST _ID 1000 0000 C921 086C TRU64_ UNIX OTHER HOST _ID 1000 0000 C921 0943 TRU64_ UNIX OTHER HOST _ID 1000 0000 C920 EDAO TRU64_ UNIX OTHER HOST _ID 1000 0000 C921 086C 04 05 000 0000 C92 offline 000 0000 C92 offline 000 0000 C92 offline 000 0000 C92 3 OL this 000 0000 C92 3 OL other 000 0000 C92 offline 000 0000 C92 3 OL other O9F7 O9F7 O9F7 100 O9F7 100 086C 086C 0943 0 000 0000 C920 EDAO 3 OL other 100 000 0000 C921 086C The following connections are shown to have nonzero offsets NEWCON49 NEWCON51 NEWCON55 NEWCON56 NEWCON57 NEWCON60 NEWCON61 and NEWCON65 4 Set the unit offset to 0 for each connection that has a nonzero unit offset HSG80 gt HSG80 gt HSG80 gt
152. PBA CB host bus adapters without changing any cables 9 26 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices Figure 9 13 Externally Terminated Shared SCSI Bus with HSZ50 RAID Array Controllers at Bus End Network Member System 2 Memory Channel Member Channel Interface Memory Channel 1 Memory KZPSA BB ID 6 KZPSA BB ID 7 ZK 1597U Al Table 9 3 shows the components used to create the cluster shown in Figure 9 12 and Figure 9 13 Table 9 3 Hardware Components Used for Configuration Shown in Figure 8 12 and Figure 8 13 Callout Number Description 1 BN21W O0B Y cable 2 H879 AA terminator 3 BN21K or BN21L cable gt 4 H885 AA trilink connector a The maximum combined length of the BN21K or BN21L cables must not exceed 25 meters Thecable between the H 885 AA trilink connectors on the HSZ50s could bea BN 21L 0B a 0 15 meter cable Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 27 9 4 3 2 Cabling an HSZ20 in a Cluster Using External Termination To connect a SWXRA Z1 HSZ20 controller toa shared SCSI bus follow these steps 1 Referring tothe RAID Array 310 Deskside Subsystem SWXRA ZX Hardware User s Guide open the SWXRA Z1 cabinet locate the SCSI bus converter board and e Remove the five differential terminator resistor SIPs e Ensure that the W1 and W2 jumpers are installed to enabl
153. PCI to Fibre Channel host bus adapter an HSG80 array controller or another switch Each switch except the DS DSGGB AA and DS DSGGC AA has a front panel display and four push buttons that you use to manage the switch F our menus allow you to configure operate obtain status or test the switch The DS DSGGB AA and DS DSGGC AA are managed through a telnet session after the IP address has been set from a PC or terminal All switches have a 10Base T Ethernet RJ 45 port and after the IP address is set the Ethernet connection allows you to manage the switch e Remotely using a telnet TCP IP connection e With the Simple Network Management Protocol SNMP e Using Web management tools Note You have to set the IP address and subnet mask from the front panel or from a PC or terminal with the DS DSGGB AA before you can manage the switch through a telnet session SNMP or the Web 6 16 Using Fibre Channel Storage The DS DSGGC AA has a default IP address of 10 77 77 77 You may need to change this IP address before you connect the switch to the network The DSGGA switch has slots to accommodate up to four DS DSGGA AA or eight DS DSGGA AB plug in interface modules Each interface module in turn supports two Gigabit I nterface Converter GBIC modules The GBIC module is the electrical to optical converter The shortwave GBIC supports 50 micron multimode fiber MMF using the standard subscriber connector SC connector The l
154. PGBO WWN 1000 0000 c920 da0l e You canusethewwidmgr show adapter command as follows P00 gt gt gt wwidmgr show adapter item adapter WWN Cur Topo Next Topo 0 pga0 0 0 4 1 1000 0000 c920 eda0 FABRIC FABRIC 1 pgb0 0 0 3 0 1000 0000 c920 da0l1 FABRIC FABRIC 9999 All of the above e f the operating system is installed the worldwide name of a KGPSA adapter is also displayed in the boot messages generated when the emx driver attaches to the adapter when the adapter s host system boots Or you can use the grep utility and obtain the worldwide name from the var adm messages file as follows grep wwn var adm messages F W Rev 2 20X2 1 12 wwn 1000 0000 c920 eda0 F W Rev 2 20X2 1 12 wwn 1000 0000 c920 eda0 F W Rev 2 20X2 1 12 wwn 1000 0000 c920 eda0 Record the worldwide name of each KGPSA adapter for later use Using Fibre Channel Storage 6 27 6 5 3 Setting Up the HSG80 Array Controller for Tru64 UNIX Installation This section covers setting up the HSG80 controller for operation with Tru64 UNIX Version 5 1 and TruCluster Server Version 5 1 For more information on installing the HSG80 see the Compaq StorageWorks HSG80 Array Controller ACS Version 8 5 Configuration Guide or Compaq StorageWorks HSG80 Array Controller ACS Version 8 5 CLI Reference Guide To set up an HSG80 for TruCluster Server operation follow these steps Li If not already installed install the HSG80 controller s into the RA8000 or ESA1
155. Partition number Size Starting Block Used by 1 2094502 1072 38 MB 0 8 2 2094502 1072 38 MB 2094507 9 3 4189009 2144 77 MB 4189014 10 HSG80 gt HSG80 gt SHOW CROOT MIR 11 Name Storageset Uses Used by CROOT MIR mirrorset DISK30300 DISK40100 Switches POLICY for replacement BEST_PERFORMANCE COPY priority NORMAL READ_SOURCE LEAST_BUSY MEMBERSHIP 2 2 members present State UNKNOWN State only available when configured as a unit Size 8378028 blocks Partitions Partition number Size Starting Block Used by 1 418896 214 47 MB 0 12 2 1256699 643 42 MB 418901 13 3 3351206 1715 81 MB 1675605 14 4 3351207 1715 81 MB 5026816 1 1 Usethe conFIG utility to configure the devices on the device side buses 6 38 Using Fi and add them to the controller configuration The CONFIG utility takes about 2 minutes to complete You can use the ADD DISK command to add disk drives to the configuration manually bre Channel Storage Create the BOOT MIR mirrorset using disks 30200 and 30300 and the CROOT MIR mirrorset using disks 40000 and 40100 Initialize the BOOT MIR and CROOT MIR mirrorsets If you want to set any initialization switches you must do so in this step The BOOT MIR mirrorset will be used for the Tru64 UNIX and cluster member system boot disks The CROOT MIR mirrorset will be
156. Point to point Section 6 2 2 1 e Fabric Section 6 2 2 2 e Arbitrated loop Section 6 2 2 3 Note Although it is possible to interconnect an arbitrated loop with fabric hybrid configurations are not supported at the present time and therefore not discussed in this manual 6 2 2 1 Point to Point The point to point topology is the simplest Fibre Channel topology In a point to point topology one N_Port is connected to another N_Port bya single link Because all frames transmitted by one N_ Port are received by the other N_Port and in the same order in which they were sent frames require no routing Figure 6 1 shows an example point to point topology 6 6 Using Fibre Channel Storage Figure 6 1 Point to Point Topology Transmit Transmit r Receive Receive ZK 1534U AI 6 2 2 2 Fabric The fabric topology provides more connectivity than point to point topology The fabric topology can connect up to 224 ports The fabric examines the destination address in the frame header and routes the frame to the destination node A fabric may consist of a single switch or there may be several interconnected switches up to three interconnected switches is supported Each switch contains two or more fabric ports F_Port that are internally connected by the fabric switching function which routes the frame from one F_Port to another F_Port within the switch Communication between two switches is routed betw
157. SCSI ID for the TL894 robotics controller follow these steps 1 Press and release the Control Panel STANDBY button and verify that the SDA Status Display Area shows System Off line Press and release SELECT to enter the menu mode Verify that the following information is displayed in the SDA Menu Configuration Press and release SELECT to choose the Configuration menu Verify that the following information is displayed in the SDA Configuring a Shared SCSI Bus for Tape Drive Use 8 37 Menu Configuration Inquiry 6 Press and release the up or down arrow buttons to locate the SCSI Address submenu and verify that the following information is displayed in the SDA Menu Configuration SCSI Address 7 Press and release the SELECT button to choose the SCSI Address submenu and verify that the following information is displayed in the SDA Menu Configuration Robotics 8 Press and release the SELECT button to choose the Robotics submenu and verify that the following information is displayed in the SDA Menu SCSI Address SCSI ID 0 9 Usethe up and down arrow buttons to select the desired SCSI ID for the robotics controller 10 When the desired SCSI ID is displayed on line 2 press and release the SELECT button 11 Press and release the up or down button to clear the resulting display from the command 12 Press and release the up or down button and the SELECT button simultaneously and verify that System O
158. SCSI bus segment is terminated by the KZPBA CB onboard termination resistor SIPs or by a trilink connector terminator combination installed on the RAID array controller The KZPBA CB UltraSCSI host adapter e Isa high performance PCI option connecting the PCI based host system to the devices on a 16 bit ultrawide differential SCSI bus e Isinstalled in a PCI slot of the supported member system e Isasinglechannel ultrawide differential adapter e Operates at the following speeds 5 MB sec narrow SCSI at slow speed 10 MB sec narrow SCSI at fast speed 20 MB sec wide differential SCSI 40 MB sec wide differential UltraSCSI Note Even though the KZPBA CB is an UltraSCSI device it has an HD68 connector 4 8 TruCluster Server System Configuration Using UltraSCS Hardware Your storage shelves or RAID array subsystems should be set up before completing this portion of an installation Use the steps in Table 4 3 to set up a KZPBA CB for a TruCluster Server cluster that uses radial connection toa DWZZH UltraSCSI hub Table 4 3 Installing the KZPBA CB for Radial Connection to a DWZZH UltraSCSI Hub Step Action Refer to 1 Ensure that the eight KZPBA CB internal termination resistor SIPs RM 1 RM8 are installed Section 4 3 1 Figure4 1 and KZPBA CB PCl to Ultra SCSI Differential H ost Adapter User s Guide 2 Power down the system Install a KZPBA CB TruCluster Server PCl to UltraSCSI
159. SCSI buses without tape loaders Whenever possible connect devices to a shared bus so that they can be isolated from the bus This allows you to disconnect devices from the bus for maintenance purposes without affecting bus termination and cluster operation You also can set up a shared SCSI bus so that you can connect additional devices at a later time without affecting bus termination Most devices have internal termination For example the UltraSCSI KZPBA CB and the fast and wide KZPSA BB host bus adapters have internal termination When using a KZPBA CB or KZPSA BB with an UltraSCSI hub ensure that the onboard termination resistor SIPs have not been removed You will need to provide termination at the storage end of one SCSI bus segment You will install an H8861 AA trilink connector on the HSZ70 or HSZ80 at the bus end Connect an H8863 AA terminator to the trilink connector to terminate the bus Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 7 Figure 3 1 shows a VHDCI trilink connector UltraSCSI which you may attach to an HSZ70 or HSZ80 Figure 3 1 VHDCI Trilink Connector H8861 AA CX05744A 3 6 UltraSCSI Hubs The DS DWZZH series UltraSCSI hubs are UltraSCSI signal converters that provide radial connections of differential SCSI bus adapters and RAID array controllers Each connection forms a SCSI bus segment with SCSI bus adapters or the storage unit The hub provides termination for one
160. SI Bus ID 7 dka0 0 0 2000 0 RZ1CB CS dka100 1 0 2000 0 RZ1CB CS dka200 2 0 2000 0 RZ1CB CS dka500 5 0 2000 0 RRD46 Bus 02 Slot 01 NCR 53C875 pkb0 7 0 2001 0 SCSI Bus ID 7 TruCluster Server System Configuration Using UltraSCSI Hardware 4 11 Example 4 1 Displaying Configuration on an AlphaServer DS20 cont Bus 02 Slot 02 DE500 AA Network Controller ewa0 0 0 2002 0 PCI Hose 01 Bus 00 Slot 07 DEC PCI FDDI fwa0 0 0 7 1 Bus 00 Slot 08 DEC PCI MC Bus 00 Slot 09 DEC PCI MC ISA Slot Device Name Type Enabled 0 0 MOUSE Embedded Yes ab KBD Embedded Yes 2 COM1 Embedded Yes 3 COM2 Embedded Yes 4 LPT1 Embedded Yes 5 FLOPPY Embedded Yes 00 06 2B 00 0A 48 08 00 2B B9 0D 5D Rev 22 mca0 Rev 22 mcb0o BaseAddr IRQ DMA 60 60 3f8 2f8 3be 3f0 NAY WPHR Example 4 2 shows the output from the show entered on an AlphaServer DS20 system device console command Example 4 2 Displaying Devices on an AlphaServer DS20 P00 gt gt gt ka0 0 kal00 ka200 ka500 kc0 0 d d d d d dkc1 0 Ors 1 po 5 0 0 kc7 0 kd0 0 kd1 0 kd100 kd101 kd102 aoar rPRROOO aa w ro kco kdo NNNNOOOO oooo 00 00 B O o O Hh Oo oaoodo 20 PR o En 2000 0 2000 0 0 20 CcOOW Ww 69 O 20 ees 20 20 By BOM show device 00 0 2000 0 wwowooen o 0 0 02 0 1 00 0 01 0 0 0 DKAO RZ1CB CS 0656 DKA100 RZ1CB CS 0656 DKA200 RZ1CB CS
161. Shared SCSI Bus for Tape Drive Use 8 15 To achieve system performance capabilities we recommend that you place no more than two Compaq 40 80 GB DLT Drives on a SCSI bus and that you place no shared storage on the same SCSI bus with the tape drive Figure 8 6 Cabling a Shared SCSI Bus with a Compaq 40 80 GB DLT Drive Network Member Memory Member System Channel System 1 Interface 2 Memory Channel Memory Channel KZPBA CB ID 6 KZPBA CB ID 7 40 80 GB DLT Tape Drive ZK 1655U Al Table 8 5 lists the components that were used to create the cluster that is shown in Figure 8 6 Table 8 5 Hardware Components in the Configuration in Figure 8 6 Callout Number Description BN38C or BN38D cable BN37A cable H 8861 AA VHDCI trilink connector H 8863 AA VHDCI terminator BN21W 0B Y cable H879 AA HD68 terminator 328215 00X BN21K or BN21L HD68 to H D68 cable Nl Olu BR WIN e 8 16 Configuring a Shared SCSI Bus for Tape Drive Use Table 8 5 Hardware Components in the Configuration in Figure 8 6 cont Callout Number Description 8 H 885 AA trilink connector 9 189646 001 0 9 meter cable or 189646 002 1 8 meter cable 4 BN21K 01 or BN21L 01 1 meter cable 4 BN21K 02 or BN21L 02 2 meter cable 10 152732 001 LVD terminator a The maximum length of the BN38C or BN 38D cable on one SCSI bus segment must not exceed 25 meters Th
162. T Tape Drive 8 11 Compaq 40 80 GB DLT Drive 8 15 DS TZ89N TA 8 9 DS TZ89N VW 8 8 ESL9326D 8 74 8 75 8 77 TL881 891 DLT MiniLibrary 8 63 8 67 TL890 8 30 TL891 8 25 8 30 TL892 8 25 8 30 TL893 8 55 TL894 8 41 TL895 8 48 TL896 8 55 TZ885 8 18 TZ887 8 21 TZ88N TA 8 5 TZ88N VA 8 3 changing HSG80 failover modes 6 59 clu_create 6 53 cluster expanding 3 7 9 6 increasing availability 4 3 planning 4 2 cluster interconnects increasing availability 4 2 command caa_relocate 5 15t clu_create 6 53 CONFIGURATION RESTORE 6 34 disklabel 6 53 emxmgr 6 62 emxmgr d 6 62 emxmgr m 6 62 5 9 Index 2 emxmgr t 6 63 init 6 25 6 48 6 50 6 55 6 57 SAVE_CONFIGURATION 6 34 set bootdef_dev 6 50 6 55 6 57 SET FAILOVER COPY THIS CONTROLLER 1 13 set hp_count 7 10 set hp_qbb_maskn 7 10 SET MULTIBUS FAILOVER COPY THIS CONTROLLER 3 18 set scm_csb_master_eligible 7 12 show config 4 9t 10 5t 10 7t show csb 7 16 show device 4 9t 10 5t 10 7t show nvr 7 10 show system 7 14 SHOW THIS CONTROLLER 6 33 sysconfig 5 18 wwidmgr 6 44 wwidmor clear 6 44 wwidmor quickset 6 46 wwidmor show 6 25 6 45 6 48 Compaq 20 40 GB DLT Tape Drive 8 10 cabling 8 11 capacity 8 10 cartridges 8 10 connectors 8 10 setting SCSI ID 8 10 Compag 40 80 GB DLT Drive 8 14 cabling 8 15 capacity 8 14 cartridges 8 14 connectors 8 14 setti
163. TA 8 1 cabling 8 5 setting SCSI ID 8 5 Index 11 TZ88N VA 8 1 cabling 8 3 setting SCSI ID 8 2 TZ89 8 6 U utility hwmgr 6 51 wwidmgr 6 48 6 54 6 56 V UlItraSCSI BA356 disable termination 9 17 DS BA35X DA personality module 3 3 fast narrow SCSI drives 3 3 fast wide SCSI drives 3 3 jumper 9 14 personality module address switches 9 13 power supply 3 3 preparing 9 15 9 17 preparing for shared SCSI usage 9 17 SCSI ID selection 9 17 selecting SCSI IDs 9 13 termination 9 14 UltraSCSI host adapter host input connector 3 3 with non UltraSCSI BA356 3 3 with UltraSCS BA356 3 3 UltraSCSI hubs 3 8 upgrade DWZZA 2 11 upgrading ESL9326D 8 74 Index 12 var adm messages 6 27 variable Seeenvironment variable Very High Density Cable nterconnect SeeVHDCI VHDCI 3 3 acronym defined 3 3 HSZ70 host connector 3 3 W WorldWide ID Manager See wwidmer worldwide name description 6 27 wwidmgr 6 44 clear 6 44 quickset 6 46 show 6 25 6 45 6 48 Y Y cables connecting devices with 9 6 supported 2 12 How to Order Tru64 UNIX Documentation To order Tru64 UNIX documentation in the United States and Canada call 800 344 4825 n other countries contact your local Compaq subsidiary If you have access to Compaq s intranet you can place an order at the following Web site http asmorder ngo dec com If you need help deciding which documentat
164. TL891 Rackmount MiniLibrary for Shared SCSI Bus Usage A TL881 or TL891 MiniLibrary base unit may also be used in a rackmount configuration with an expansion unit data unit s and other base units to add tape drive and or cartridge capacity to the configuration The expansion unit is installed above the TL881 or TL891 DLT MiniLibrary base or data units in a SW500 SW800 or RETMA cabinet For complete hardware installation instructions see the TL881 MiniLibrary System User s Guide or TL891 MiniLibrary Systen User s Guide The topics in this section provide information on preparing the rackmount TL881 or TL891 DLT MiniLibrary for use on a shared SCSI bus It is assumed that the expansion unit base modules and pass through and motor mechanism have been installed 8 12 2 2 1 Cabling the Rackmount TL881 or TL891 DLT MiniLibrary You must make the following connections to render the DLT MiniLibrary system operational e Expansion unit to the pass through motor mechanism The motor mechanism cable is about 1 meter long and has a DB 15 connector on each end Connect it between the connector labeled Motor on the expansion unit to the motor on the pass through mechanism Note This cable is not shown in Figure 8 19 because the pass through mechanism is not shown in the figure e Robotics control cables from the expansion unit to each base unit or data unit These cables have a DB 9 male connector on one end and a DB 9 female conn
165. TL893 and TL896 Automated Tape Libraries to the Shared SCSI BUS cc cee eee ees 8 12 Preparing the TL881 and TL891 DLT MiniLibraries for Shared Bus Usage cece eee cece e eect ee eee ease eae eae eee 8 12 1 TL881 and TL891 DLT MiniLibraries Overview 8 12 1 1 TL881 and TL891 DLT MiniLibrary Tabletop Model 8 12 1 2 TL881 and TL891 MiniLibrary Rackmount COMPONENTS aurii divisien evant rials 8 12 1 3 TL881 and TL891 Rackmount Scalability 8 12 1 4 DLT MiniLibrary Part Numbers 0 see ees 8 12 2 Preparing a TL881 or TL891 MiniLibrary for Shared SCSI BUS US a5 chek cree cake E E E S daha 8 12 2 1 Preparing a Tabletop Mode or Base Unit for Standalone Shared SCSI Bus Usage 00685 8 12 2 1 1 Setting the Standalone MiniLibrary Tape Drive SCSI ID eiaeiiai a e A aa 8 12 2 1 2 Cabling the TL881 or TL891 DLT MiniLibrary 8 12 2 2 Preparing a TL881 or TL891 Rackmount MiniLibrary for Shared SCSI Bus Usage ecceeee eect eee ees 8 12 2 2 1 Cabling the Rackmount TL881 or TL891 DLT MiniLibrary vctesens covvece cutee y exe dis cna coe diene 8 12 2 2 2 Configuring a Base Unit as a Slave to the Expansion Unit 0c ce ceeeeee eee e cnet eee eae eee 8 12 2 2 3 Powering Up the TL881 TL891 DLT MiniLibrary 8 12 2 2 4 Setting the SCSI IDs for a Rackmount TL881 or TL891 DLT MiniLibrary s es 8 13 Compaq ESL9326D Enterprise Library cceeeeeees
166. Thehp_count SCM environment variable defines the number of hard partitions The hp _qbb maskn SCM environment variables define which QBBs by bit position will be part of partition n Example 7 1 shows how to set up two partitions with each partition containing two QBBs Partition 0 includes QBBs 0 and 1 partition 1 includes QBBs 2 and 3 Usethe show nvr SCM command to display the SCM environment variables Example 7 1 Defining Hard Partitions with SCM Environment Variables SCM_EO gt set hp count 2 SCM_E0 gt set hp_qbb mask0O 3 SCM_EO gt set hp qbb maskl c SCM_E0 gt show nvr COM1_PRINT_EN HP COUNT HP QBB MASKO HP QBB MASK1 HP QBB MASK2 HP QBB MASK3 HP QBB MASK4 AION 0o ooo0on uwNEe 7 10 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration Example 7 1 Defining Hard Partitions with SCM Environment Variables cont HP_QBB MASK5 HP _QBB MASK6 HP _QBB MASK7 SROM_MASK XSROM_MASK PRIMARY CPU 0 0 0 ff f EF EE EE EE FLEE EE FETE L O70 ff PRIMARY QBBO ff AUTO _QUIT_SCM 1 6 FAULT _TO SYS 0 DIMM READ DIS 0 SCM_CSB MASTER ELIGIBLE 1 7 PERF MON 20 SCM_FORCE_FSL 0 OCP_TEXT AS GS160 AUTO FAULT RESTART 1 SCM SIZING TIME c 1 Set the number of hard partitions to two 2 Set bits 0 and 1 of the mask 0011 to select QBB 0 and QBB 1 for hard partition 0 3 Set bits 2 and 3 of th
167. This is the case with the KZPBA CB and KZPSA BB SCSI adapters on some AlphaServer systems Use the H879 AA terminator to terminate one leg of a BN21W 0B Y cable or H885 AA trilink Use an H8861 AA VHDCI trilink connector see Figure 3 1 with a DS BA35X DA personality module to daisy chain two UltraSCSI BA356s or to terminate external to the UltraSCS I BA356 storage shelf Use the H8863 AA VHDCI terminator with the H8861 AA trilink connector 9 3 Overview of Disk Storage Shelves The following sections provide an introduction to the BA350 BA356 and UltraSCSI BA356 disk storage shelves 9 8 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 3 1 BA350 Storage Shelf Up to seven narrow 8 bit single ended StorageWorks building blocks SBBs can be installed in the BA350 Their SCSI IDs are based upon the slot they are installed in For instance a disk installed in BA350 slot 0 has SCSI ID 0 a disk installed in BA350 slot 1 has SCSI ID 1 and so forth Note Do not install disks in the slots corresponding to the host SCSI IDs usually SCSI ID 6 and 7 for a two node cluster You use a DWZZA VA as the interface between the wide differential shared SCSI bus and the BA350 narrow single ended SCSI bus segment Note Do not use a DWZZB VW in a BA350 The use of the wide DW2ZZB VW on the narrow single ended bus will result in unterminated data lines in the DWZZB VW which will cause SCSI
168. TruCluster Server Hardware Configuration Part Number AA RHGWC TE August 2000 Product Version TruCluster Server Version 5 1 Operating System and Version Tru64 UNIX Version 5 1 This manual describes how to configure the hardware for a TruCluster Server environment TruCluster Server Version 5 1 runs on the Tru64 UNIX operating system Compaq Computer Corporation Houston Texas 2000 Compaq Computer Corporation COMPAQ and the Compag logo Registered in U S Patent and Trademark Office Alpha AlphaServer StorageWorks TruCluster and Tru64 are trademarks of Compaq Information Technologies Group L P Microsoft and Windows are trademarks of Microsoft Corporation UNIX and The Open Group are trademarks of The Open Group All other product names mentioned herein may be trademarks or registered trademarks of their respective companies Cover photo Digital imagery copyright 1999 PhotoDisc Inc Confidential computer software Valid license from Compaq required for possession use or copying Consistent with FAR 12 211 and 12 212 Commercial Computer Software Computer Software Documentation and Technical Data for Commercial Items are licensed to the U S Government under vendor s standard commercial license Compaq shall not be liable for technical or editorial errors or omissions contained herein The information in this document is subject to change without notice THE INFORMATION IN THIS PUBLICATION IS PROVIDED AS
169. Unit Interface TL892 SCSI Bus Jumper ZK 1762U Al Table 8 7 shows the components used to create the cluster shown in Figure 8 10 Table 8 7 Hardware Components Used to Create the Configuration Shown in Figure 8 9 Callout Number Description 1 BN38C or BN38D cable 2 BN37A cable 3 H8861 AA VHDCI trilink connector 4 H8863 AA VHDCI terminator 5 BN21W 0B Y cable 6 H879 AA terminator 7 328215 00X BN21K or BN21L cable a The maximum length of the BN38C or BN38D cableon one SCSI bus segment must not exceed 25 meters The maximum length of the BN37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters 8 28 Configuring a Shared SCSI Bus for Tape Drive Use 8 8 Preparing the TL890 DLT MiniLibrary Expansion Unit The topics in this section provide information on preparing the TL890 DLT MiniLibrary expansion unit with the TL891 and TL892 DLT MiniLibraries for use on a shared SCSI bus Note To achieve system performance capabilities we recommend placing no more than two TZ89 drives on a SCSI bus and also recommend that no shared storage be placed on the same SCSI bus with a tape library 8 8 1 TL890 DLT MiniLibrary Expansion Unit Hardware The TL890 expansion unit is installed above the TL891 TL892 DLT MiniLibrary base units in a SW500 SW800 or RETMA cabinet The expansion unit integrates the robotics in the individ
170. V70Z DKF3 HSZ70 V70Z DKF4 HSZ70 V70Z DKF5 HSZ70 V70Z DKF6 HSZ70 V70Z DKF100 RZ28M 0568 DKF200 RZ28M 0568 DKF300 RZ28 442D on kzpsa0O slot 2 bus 0 hosel dkg TPwr 1 Fast 1 Bus ID 7 DKGO HSZ50 AX X29Z DKG1 HSZ50 AX X29Z DKG2 HSZ50 AX X29Z DKG100 RZ26N 0568 DKG200 RZ28 392A DKG300 RZ26N 0568 on kzpsal slot 3 bus 0 hosel dkh TPwr 1 Fast 1 Bus ID 7 DKH100 RZ28 442D DKH200 RZ26 392A DKH300 RZ26L 442D on kzpsa2 slot 4 bus 0 hosel dki TPwr 1 Fast 1 Bus ID 7 DKI100 RZ26 392A DKI200 RZ28 442C DKI300 RZ26 392A L01 All L01 All L01 A10 10 12 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 1 4 10 1 4 1 Displaying Console Environment Variables and Setting the KZPSA BB and KZPBA CB SCSI ID The following sections show how to use the show console command to display the pk and isp console environment variables and set the KZPSA BB and KZPBA CB SCSI ID on various AlphaServer systems Use these examples as guides for your system Note that the console environment variables used for the SCSI options vary from system to system Also a class of environment variables for example pk or isp may show both internal and external options Compare the following examples with the devices shown in the show config and show dev examples to determine which devices are K ZPSA BBs or KZPBA CBs on the shared SCSI bus Displaying KZPSA BB and KZPBA CB pk or i
171. VHDCI trilink connector 4 H8863 AA VHDCI terminator a The maximum length of the BN38C or BN38D cable on one SCSI bus segment must not exceed 25 meters The maximum combined length of the BN37A cables must not exceed 25 meters Figure 3 6 shows a two member TruCluster Server configuration with a radially connected dual redundant HSZ80 RAID array controller configured for transparent failover Figure 3 6 Shared SCSI Bus with HSZ80 Configured for Transparent Failover Network Member Member System f System 1 Memory 2 Channel Interface Memory Channel 1 KZPBA CB ID 6 Memory Channel T KZPBA CB ID 7 ZK 1600U Al Table 3 4 shows the components used to create the cluster shown in Figure 3 6 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 21 3 7 1 2 Preparing a Dual Redundant HSZ70 or HSZ80 for a Shared SCSI Bus Using Multiple Bus Failover Multiple bus failover is a dual redundant controller configuration in which each host has two paths two shared SCSI buses to the array controller subsystem The host s have the capability to move LUNs from one controller shared SCSI bus to the other If one host adapter or SCSI bus fails the host s can move all storage to the other path Because both controllers can service all of the units either controller can continue to service all of the units if the other controller fails Therefore multiple bus failover can comp
172. Version 5 1 the cluster interconnect is the Memory Channel However you can use redundant cluster interconnects to protect against an interconnect failure and for easier hardware maintenance If you have more than two member systems you must have one Memory Channel hub for each interconnect 4 2 TruCluster Server System Configuration Using UltraSCS Hardware e Number of shared SCSI buses and the storage on each shared bus Using shared SCSI buses increases storage availability You can connect 32 shared SCSI buses to a cluster member You can use any combination of KZPSA BB KZPBA CB or KGPSA BC CA host bus adapters In addition RAID array controllers allow you to increase your storage capacity and protect against disk controller host bus adapter and SCSI bus failures Mirroring data across shared buses provides you with more reliable and available data You can use Logical Storage M anager LSM host based mirroring for all storage except the clusterwide root file system the member specific boot disks and the swap and quorum disk e Nosinglepoint of failure NSPOF TruCluster Server cluster You can use mirroring and multiple bus failover with the HSZ70 HSZ80 and HSG80 RAID array controllers to create a NSPOF TruCluster Server cluster providing the rest of the hardware is installed e Tape loaders on a shared SCSI bus Because of the length of the internal SCSI cables in some tape loaders up to 3 meters they cannot be
173. ZA jumper J 2 or DWZZB jumpers W1 and W2 are installed to enable the single ended termination Remove the termination from the differential end by removing the five 14 pin SIP resistors 2 Attach atrilink connector to the differential end of the DWZZA or DWZZB 3 Connect the single ended end of a DWZZA tothe TZ88N TA with a BC19 cable Connect the single ended end of a DWZZB tothe TZ88N TA with a BN21M cable 4 Install aH8574 A or H8890 AA terminator on the other TZ88N TA SCSI connector 5 Connect a trilink or Y cable to the differential shared SCSI bus with BN21K or BN21L cables Ensure that thetrilink or Y cable at the end of the bus is terminated with an H879 AA terminator Configuring a Shared SCSI Bus for Tape Drive Use 8 5 The single ended SCSI bus may be daisy chained from one single ended tape drive to another with BC19 cables as long as the SCSI bus maximum length is not exceeded Ensure that the tape drive on the end of the bus is terminated with a H8574 A or H8890 AA terminator You can add additional TZ88N TA tape drives to the differential shared SCSI bus by adding additional DWZZA or DWZZB TZ88N TA combinations Note Ensure that there is no conflict with tape drive system and disk SCSI IDs 8 2 Preparing the TZ89 for Shared SCSI Usage Like the TZ88 the TZ89 comes in either a tabletop DS TZ89N TA or a StorageWorks building block SBB 5 25 inch carrier DS TZ89N VW The SBB version takes up three
174. a REPORTED PORT_ID on each port Controller A and controller B port 1 5000 1F E 1 0000 0D61 Controller A and controller B port 2 5000 1F E 1 0000 0D62 e Ina configuration with dual redundant controllers in multiplebus failover mode the controller port IDs increment as follows Controller A port 1 worldwide name 1 Controller A port 2 worldwide name 2 Controller B port 1 worldwide name 3 Controller B port 2 worldwide name 4 For example using the worldwide name of 5000 1F E 1 0000 0D60 the following port I Ds are automatically assigned and shared between the ports aS a REPORTED PORT_ID on each port Controller A port 1 5000 1FE 1 0000 0D61 Controller A port 2 5000 1F E 1 0000 0D62 Using Fibre Channel Storage 6 33 Controller B port 1 5000 1FE 1 0000 0D63 Controller B port 2 5000 1F E 1 0000 0D64 Because the HSG80 controller s configuration information and worldwide name is stored in nonvolatile random access memory NVRAM on the controller there are different procedures for replacing HSG80 controllers in an RA8000 or ESA12000 e If you replace one controller of a dual redundant pair the NVRAM from the remaining controller retains the configuration information including worldwide name When you install the replacement controller the existing controller transfers configuration information to the replacement controller e If you have to replace the HSG80 con
175. a wide SCSI bus The KZPSA BB must be set to fast speed for TruCluster Server Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 3 Note You may have problems if the member system supports the bus_probe_ algorithm console variable and it is not set to new See Section 2 3 2 The KZPBA CB UltraSCSI host adapter e Isa high performance PCI option connecting the PCI based host system to the devices on a 16 bit ultrawide differential SCSI bus e Isasinglechannel ultrawide differential adapter e Operates at the following speeds 5 MB sec narrow SCSI at slow speed 10 MB sec narrow SCSI at fast speed 20 MB sec wide differential SCSI 40 MB sec wide differential UltraSCSI Note Even though the KZPBA CB is an UltraSCSI device it has an HD68 connector Use the steps in Table 10 2 to set up a KZPSA BB or KZPBA CB host bus adapter for a TruCluster Server cluster that uses radial connection toa DWZZH UltraSCSI hub with an HSZ40 or HSZ50 RAID array controller Table 10 2 Installing the KZPSA BB or KZPBA CB for Radial Connection to a DWZZH UltraSCSI Hub Step Action Refer to 1 Ensure that the KZPSA BB internal termination Section 10 1 4 4 resistors Z1 Z2 Z3 Z4 and Z5 are installed Figure 10 1 and KZPSA PCI to SCSI Storage Adapter Installation and User s Guide Ensure that the eight KZPBA CB internal Section 4 3 3 3 termination resistor SIPs RM1 RM8 ar
176. ab Esc button to select the next field Modify the address fields until you have the address set correctly 3 Use Enter to accept the value and step to the next submenu item Ethernet Submask and then repeat step 2 to set the Ethernet subnet mask Press Enter to accept the Ethernet subnet mask 5 Press the Tab Esc button repeatedly to get back to the top level menu Press the down button to select the Operation Menu Select Menu Operation Menu 7 Ifthe switch is operational place the switch off line before rebooting or you will lose any transmission in progress Press Enter to display the first submenu in the Operation Menu Switch Offline Operation Menu Switch Offline 8 Press the down button until the Reboot submenu item is displayed Operation Menu Reboot 9 Press Enter You can change your mind and not reboot Reboot Accept Yes No 6 20 Using Fibre Channel Storage 10 Usethe Tab Esc button to select yes Press Enter to reboot the switch and execute the POST tests Note After changing any configuration menu settings you must reboot the switch for the change to take effect Refer to the switch documentation for information on other switch configuration settings 6 5 1 2 3 Setting the DS DSGGB AA and DS DSGGC AA Ethernet IP Address and Subnet Mask from a PC or Terminal For the DS DSGGB AA and DS DSGGC AA switches which do not havea front panel you must use a connection to a Windows 95 98 NT P
177. ackmount configuration The expansion unit must be enabled to control the base unit by setting the base unit to slave mode The data unit is a passive device and only works as a slave to the expansion unit To create a multimodule rackmount system there must be one expansion unit and at least one base unit The expansion unit has to be the top module in the configuration The expansion unit works with either the TL881 or TL891 base unit TL881 or TL891 base unit includes library robotics bar code reader a removable 10 cartridge magazine and one or two tape drives TL881 DLT 20 40 TZ88N AV drives TL891 DLT 35 70 TZ89N AV drives To participate in a MiniLibrary configuration each base unit must be set up as a Slave unit to pass control to the expansion unit Once the expansion unit has control over the base unit the expansion unit controls tape cartridge movement between the magazines and tape drives Note You cannot mix TL881 and TL891 base units in a rackmount configuration because the tape drives use different formats 8 58 Configuring a Shared SCSI Bus for Tape Drive Use e Data unit This rackmount module contains a 16 cartridge magazine to provide additional capacity in a multi module configuration The data unit robotics works in conjunction with the robotics of the expansion unit and base units It is under control of the expansion unit The data unit works with either the TL881 or TL891 base unit
178. adapters except one If you are using a DS DWZZH 05 with fair arbitration enabled you will have to set the SCSI IDs for all KZPBA CB UltraSCSI adapters Note You will have problems if you have two or more SCSI adapters at the same SCSI ID on any one SCSI bus If you are using a DS DWZZH 05 you cannot use SCSI ID 7 for aKZPBA CB UltraSCSI adapter SCSI ID 7 is reserved for DS DWZZH 05 use If DS DWZZH 05 fair arbitration is enabled the SCSI ID of the host adapter must match the SCSI ID assigned to the hub port Mismatching or duplicating SCSI IDs will cause the hub to hang Use the set console command as shown in Example 10 8 to set the KZPBA CB SCSI ID In this example the SCSI ID is set for KZPBA CB pke on the AlphaServer 4100 shown in Example 10 5 Example 10 8 Setting the KZPBA CB SCSI Bus ID P00 gt gt gt show pkcO host id 7 P00 gt gt gt set pkcO_ host_id 6 P00 gt gt gt show pkcO host id 6 10 16 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 1 4 3 Setting KZPSA BB SCSI Bus ID Bus Speed and Termination Power If the KZPSA BB SCSI ID is not correct or if it was reset to 7 by the firmware update utility or you need to change the KZPSA BB speed or enable termination power use the set console command Note All KZPSA BB host bus adapters should be enabled to generate termination power Set the SCSI bus ID with the set command as shown in the fol
179. age unit TheKGPSA adapters through which a connection to the storage unit is potentially available TheWWID of the HSG80 port s N_Ports that will be used to access the storage unit Theconnected column indicates whether the storage unit is currently available through the K GPSA to HSG80 controller port connection The HSG80 controllers are in multiple bus failover so each storage unit is presented by only one controller at a time 6 46 Using Fibre Channel Storage Example 6 5 Using the wwidmgr quickset Command to Set the Device Unit Number P00 gt gt gt wwidmgr quickset udid 133 Disk assignment and reachability after next initialization 6000 1fe1 0000 0d60 0009 8080 0434 002e via adapter via fc nport connected dga133 1001 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d64 No dga133 1002 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d62 Yes dga133 1003 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d63 No dga133 1004 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d61 Yes dgb133 1001 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d64 No dgb133 1002 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d62 Yes dgb133 1003 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d63 No dgb133 1004 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d61 Yes P00 gt gt gt wwidmgr quickset udid 131 Disk assignment and reachability after next initialization 6000 1fe1 0000 0d60 0009 8080 0434 002e via adapter via fc nport connected dga133 1001 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d64 No dga133 1002 0 1 0 pga0 0 0 1 0 5000 1
180. ageWorks 40 80 DLT Drive Reference Guide The following sections describe how to prepare the Compag 40 80 GB DLT Drive in more detail 8 4 1 Setting the Compaq 40 80 GB DLT Drive SCSI ID As with any of the shared SCSI devices the Compaq 40 80 GB DLT Drive SCSI ID must be set to ensure that no two SCSI devices on the shared SCSI bus have the same SCSI ID You set the Compaq 40 80 GB DLT Drive SCSI ID with a pushbutton counter switch on the rear of the unit Push the button above the counter to increment the address push the button below the counter to decrement the address until you select the desired SCSI ID 8 14 Configuring a Shared SCSI Bus for Tape Drive Use 8 4 2 Cabling the Compaq 40 80 GB DLT Drive The Compaq 40 80 GB DLT Drive is connected to a single ended segment of the shared SCSI bus Figure 8 6 shows a configuration with a Compaq 40 80 GB DLT Drive for use on a shared SCSI bus To configure the shared SCSI bus for use with a Compaq 40 80 GB DLT Drive follow these steps 1 You need one DWZZB AA for each shared SCSI bus with a Compaq 40 80 GB DLT Drive Ensure that the DWZZB AA jumpers W1 and W2 are installed to enable the single ended termination Remove the termination from the differential end by removing the five 14 pin SIP resistors 2 Connect an H885 AA trilink connector with attached H879 AA HD68 terminator to the differential end of the DWZZB AA signal converter 3 Connect a 328215 00X BN21K or BN
181. ailover to multi ple bus failover the offsets in the table of known connections remain the same as if they were for transparent failover mode the offset on port 2 remains 100 With an offset of 100 on port 2 a host cannot see units 0 through 99 on port 2 This reduces the availability Also if you have only a single HSG80 controller and lose the connection to port 1 you lose access to units 0 through 99 Therefore if you want to change from transparent failover to multiple bus failover mode you must change the offset in the table of known connections for each connection that has a nonzero offset Note It would do no good to disconnect and then reconnect the cables because once a connection is added to the table it remains in the table until you delete the connection e The system can access a storage device through only one HSG80 port The system s view of the storage device is not changed when the HSG80 is placed in multiple bus failover mode In transparent failover mode the system accesses storage units DO through D99 through port 1 and units D100 through D199 through port 2 In multiple bus failover mode you want the system to be able to access all units through all four ports 6 58 Using Fibre Channel Storage 6 7 2 Procedure to Convert from Transparent to Multiple bus Failover Mode To change from transparent failover to multiple bus failover mode by resetting the unit offsets and modifying the systems view of the s
182. al to the tape library at the tape drive itself with the installed SCSI terminators Therefore TruCluster Server clusters using the TL895 tape libraries must ensure that the tape libraries are on the end of the shared SCSI bus In a TruCluster Server cluster with a TL895 tape library the member systems and StorageWorks enclosures or RAID subsystems may be isolated from the shared SCSI bus because they use trilink connectors or Y cables However because the TL 895 cannot be removed from the shared SCSI bus all ASE services that use any shared SCSI bus attached to the TL895 must be stopped before the tape loader can be removed from the shared bus To add a TL895 tape library toa shared SCSI bus select the member system or storage device that will be the next tolast device on the shared SCSI bus Connect a BN21K or BN21L cable between a trilink or Y cable on that device to the appropriate tape library port 8 11 Preparing the TL893 and TL896 Automated Tape Libraries for Shared SCSI Bus Usage The topics in this section provide information on preparing the TL 893 and TL896 Automated Tape Libraries ATLs for use on a shared SCSI ina TruCluster Server cluster Note To achieve system performance capabilities We recommend placing no more than two TZ89 drives on a SCSI bus The TL893 and TL896 Automated Tape Libraries ATLs are designed to provide high capacity storage and robotic access for the Digital Linear Tape DLT series of tape d
183. all in storage shelves disk slots 2 10 Hardware Requirements and Restrictions Note We could list the UltraSCS I hubs because they contain a DOC DWZZA on a chip chip but they are discussed separately in Section 2 7 The restrictions for SCSI signal converters are as follows e If you remove the cover from a standalone unit be sure to replace the star washers on all four screws that hold the cover in place when you reattach the cover If the washers are not replaced the SCSI signal converter may not function correctly because of noise e If you want to disconnect a SCSI signal converter from a shared SCSI bus you must turn off the signal converter before disconnecting the cables To reconnect the signal converter to the shared bus connect the cables before turning on the signal converter Use the power switch to turn off a standalone SCSI signal converter To turn off an SBB SCSI signal converter pull it from its disk slot e If you observe any bus hung messages your DWZZA signal converters may have the incorrect hardware In addition some DWZZA signal converters that appear to have the correct hardware revision may cause problems if they also have serial numbers in the range of CX 444xxxxx to CX 449xxxxx To upgrade a DWZZA AA or DWZZA VA signal converter to the correct revision use the appropriate field change order F CO as follows DWZZA AA F002 DWZZA VA F 001 2 7 DS DWZZH 03 and DS DWZZH 05 UltraSCSI
184. an AlphaServer GS160 QBB with an I O riser module with a BN 39B cable connected to port 0 e Atleast onel O riser in the partition must be connected to a primary PCI drawer that provides the console terminal and operating system boot disk For example the portion of the cable on port 0 of the local I O riser shown in Figure 7 1 could be connected to the I O Riser 0 0 R connector in Figure 2 1 and Figure 7 3 A primary PCI drawer contains a standard I O module that provides both standard reference module SRM and system control manager SCM firmware You can connect additional I O risers in the partition to expansion PCI drawers 7 2 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration Figure 7 1 Portion of QBB Showing I O Riser Modules I O Riser BN39B I O Riser Cable ZK 1749U Al Notes You can have up to two I O riser modules in a QBB but you cannot split them across partitions Each I O riser has two cable connections Port 0 and Port 1 Ensure that both cables from one I O riser are connected to the same PCI drawer 0 R and 1 R in Figure 2 1 A QBB I O riser local is connected toa PCI I O riser remote by BN39B cables These cables are the same cables that are used with MC2 hardware Ensure that you connect the BN 39B cable from a QBB I O riser tothe 0 R I O Riser 0 or 1 R I O Riser 1 connector in a PCI drawer and not to a Memory Channel module Using GS80 GS160 or GS32
185. an UltraSCsl BA356 storage shelve extrapolate the needed information from Section 9 4 1 and Section 9 4 2 9 14 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices Later sections describe how to install cables to configure an HSZ20 HSZ40 or HSZ50 in a TruCluster Server configuration with two member systems 9 4 1 Preparing BA350 BA356 and UltraSCSI BA356 Storage Shelves for an Externally Terminated TruCluster Server Configuration You may be using the BA350 BA356 or UltraSCS I BA356 storage shelves in your TruCluster Server configuration as follows e A BA350 storage shelf provides access to SCSI devices through an 8 bit single ended and narrow SCSI 2 interface It can be used with a DWZZA VA and connected to a differential shared SCSI bus e A non Ultra BA356 storage shelf provides access to SCSI devices through a 16 bit single ended and wide SCSI 2 interface In a cluster configuration you would connect a non U Itra BA356 to the shared SCSI bus using DWZZB VW e An UltraSCSI BA356 storage shelf provides access to UltraSCSI devices through a 16 bit single ended wide UltraSCSI interface In a cluster configuration you would connect an UltraSCS I BA356 to the shared SCSI bus through the DS BA35X DA personality module The following sections discuss the steps necessary to prepare the individual storage shelves and then connect two storage shelves together to provide the additional storage
186. and an automatic cartridge loader It uses a seven cartridge CompacTape IV removable magazine with a total capacity of nearly 280 GB compressed It is capable of reading writing at approximately 10 8 GB per hour As with any of the shared SCSI devices the TZ887 SCSI IDs must be set to ensure that no two SCSI devices on the shared SCSI bus have the same SCSI ID The following sections describe how to prepare the TZ887 in more detail 8 6 1 Setting the TZ887 SCSI ID The TZ887 SCSI ID is set with a push button counter switch on the rear of the unit see Figure 8 8 Push the button above the counter to increment the address push the button below the counter to decrement the address until you have the desired SCSI ID selected 8 20 Configuring a Shared SCSI Bus for Tape Drive Use Figure 8 8 TZ887 DLT MiniLibrary Rear Panel oooooodod SCSI ID SCSI ID Selector Switch bf SpO N E Coy a TZ887 ZK 1461U Al 8 6 2 Cabling the TZ887 Tape Drive The TZ887 is connected to a single ended segment of the shared SCSI bus It is connected to a differential portion of the shared SCSI bus with a DWZZB AA Figure 8 9 shows a configuration with a TZ887 for use on a shared SCSI bus To configure the shared SCSI bus for use with a TZ887 follow these steps 1 You will need one DWZZB AA for each shared SCSI bus with a TZ887 tape drive Ensure that the DWZZB AA jumpers W1
187. apter Section 10 1 1 and Table 10 2 for radial connection to DWZZH UltraSCSI hub Externally terminated host bus adapter Section 10 1 2 Table 10 3 a If you install additional KZPSA BB or KZPBA CB SCSI adapters or an extra network adapter at this time delay testing the Memory Channel until you have installed all hardware Radial Installation of a KZPSA BB or KZPBA CB Using Internal Termination Use this method of cabling member systems and shared storage in a TruCluster Server cluster if you are using a DWZZH UltraSCSI hub You must reserve at least one hub port for shared storage 10 2 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices The DWZZH series UltraSCS I hubs are designed to allow more separation between member systems and shared storage Using the UltraSCSI hub also improves the reliability of the detection of cable faults A side benefit is the ability to connect the member systems SCSI adapter directly to a hub port without external termination This simplifies the configuration by reducing the number of cable connections A DWZZH UltraSCSI hub can be installed in e A StorageWorks UltraSCSI BA356 shelf which has the required 180 watt power supply e A non UltraSCSI BA356 that has been upgraded to the 180 watt power supply with the DS BA35X HH option An UltraSCSI hub only receives power and mechanical support from the storage shelf There is no SCSI bus continuit
188. are accessed through port 2 of both HSG80 controllers with the limit of a total of 128 storage units You cannot achieve a no single point of failure NSPOF configuration using transparent failover The host cannot initiate failover and if you lose a host bus adapter switch or a cable you lose the units behind at least one port You can however add the hardware for a second bus another KGPSA switch and RA8000 ESA12000 with associated cabling and use LSM to mirror across the buses However because you cannot use LSM to mirror the cluster root file system member boot partitions the quorum disk or swap partitions you cannot obtain an NSPOF transparent failover configuration even though you have increased availability 6 3 2 Fibre Channel Cluster Configurations for Multiple Bus Failover Mode With multiple bus failover e Thehost controls the failover by accessing units over a different path or causing the access to the unit to be through the other HSG80 controller one controller does not fail over to the other controller of its own accord e Each cluster member system has two or more K GPSA host bus adapters multiple paths to the storage units e Normally all available units DO through D199 with a limit of 128 storage units are available at all host ports Only one HSG80 controller will be actively doing I O for any particular storage unit However both controllers can be forced active by preferring units to o
189. artitions are of the desired size The partition number is in the first column followed by the partition size and starting block Partition for the quorum disk Partition for cluster root filesystem Partition for cluster usr filesystem Partition for cluster var filesystem Using Fibre Channel Storage 6 39 6 6 1 2 Adding Units and Identifiers to the HSG80 Storagesets After you have created the storagesets mirrorsets and partitions assign a unit number to each partition and set a unique identifier as shown in Example 6 3 The steps performed in Example 6 3 include e Assign a unit number to each storage unit and disable all access to the storage unit e Set an identifier for each storage unit e Enable selective access to the storage unit Example 6 3 Adding Units and Identifiers to the HSG80 Storagesets HSG80 gt ADD UNIT D131 BOOT MIR PARTITION 1 DISABLE ACCESS PATH ALL 1 HSG80 gt ADD UNIT D132 BOOT MIR PARTITION 2 DISABLE ACCESS PATH ALL HSG80 gt ADD UNIT D133 BOOT MIR PARTITION 3 DISABLE ACCESS PATH ALL HSG80 gt ADD UNIT D141 CROOT MIR PARTITION 1 DISABLE ACCESS PATH ALL HSG80 gt ADD UNIT D142 CROOT MIR PARTITION 2 DISABLE ACCESS PATH ALL HSG80 gt ADD UNIT D143 CROOT MIR PARTITION 3 DISABLE ACCESS PATH ALL HSG80 gt ADD UNIT D144 CROOT MIR PARTITION 4 DISABLE ACCESS PATH ALL HSG80 gt SET D131 IDENTIFIER 131 2 HSG80 gt SET D132 IDENTIFIER 132 HSG80 gt SET D133 IDENTIFIER 133 HSG80 gt
190. awer with the lowest node ID is chosen as master The other SCM will bea standby in case of a problem with the master SCM If the node ID switch is set to zero the CSB node ID will be 10 Example 7 4 If the node ID switch is set to one the CSB node ID will be 11 For example the following command enables the SCMs in the primary PCI drawers at node IDs 10 and 11 switch settings of 0 and 1 tobe master and standby of the console serial bus SCM_EO gt set scm csb master eligible 10 11 Note The system will hang if the master SCM is not connected to the OCP 10 At the standby SCM set the hp count and hp qbb maskn SCM environment variables to match the setting at the master SCM SCM_E0 gt set hp_ count 2 SCM_E0 gt set hp_qbb mask0O 3 SCM_EO gt set hp qbb maskl c 11 Turn the On Off switch tothe on or Secure position then power on each of the partitions with the master SCM After the power up sequence completes transfer control tothe SRM as shown in Example 7 2 Example 7 2 Turning Partition Power On SOM FO power on par 0 1 pel Buz power on par 1 2 SCM_E0 gt quit 3 P00 gt gt gt 1 Turn on power to partition 0 7 12 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration N Turn on power to partition 1 Transfer control from the SCM firmware tothe SRM firmware oo Note If the auto_quit_scm SCM env
191. ay the console environment variables for KZPBA CBs on an AlphaServer 8x00 Example 4 6 Displaying Console Variables for a KZPBA CB on an AlphaServer 8x00 System P00 gt gt gt show isp isp0O host_id 7 ispO soft_term on ispl_host_id 7 ispl_soft_term on isp2_host_id 7 isp2_ soft_term on isp3_host_id 7 isp3_soft_term on isp5 host_id 7 isp5 soft_term diff Both Example 4 3 and Example 4 4 show five isp devices isp0 isp1 isp2 isp3 and isp4 In Example 4 6 the show isp console command shows isp0 isp1 isp2 isp3 and isp5 The console code that assigns console environment variables counts every O adapter including the K ZPAA which is the device after isp3 and therefore logically isp4 in the numbering scheme The show isp console command skips over isp4 because the K ZPAA is not a QLogic 1020 1040 class module Example 4 3 and Example 4 4 show that isp0 isp1 isp2 and isp3 are devices on the internal KFTIA PCI bus and not on a shared SCSI bus Only isp4 the KZPBA CB is on a shared SCSI bus and the show isp console command displays it as isp5 The other three shared SCSI buses use KZPSA BBs Use the show pk console command to display the KZPSA console environment variables 4 16 TruCluster Server System Configuration Using UltraSCSI Hardware 4 3 3 2 Setting the KZPBA CB SCSI ID After you determine the console environment variables for the KZPBA CBs on the shared SCSI bus use the set console command to set
192. be used ensure that the switch on the front of the DS DWZZH 05 UltraSCSI hub is in the Fair position 3 Install the DS DWZZH 05 UltraSCSI hub in a UltraSCSI BA356 non UltraSCSI BA356 if it has the required 180 watt power supply or BA370 storage shelf 3 7 Preparing the UltraSCSI Storage Configuration A TruCluster Server cluster provides you with high data availability through the cluster file system CFS the device request dispatcher DRD service failover through the cluster application availability CAA subsystem disk mirroring and fast file system recovery TruCluster Server supports mirroring of the clusterwide root file system the member specific boot disks and the cluster quorum disk through hardware RAID only You can mirror the clusterwide usr and var file systems and the data disks using the Logical Storage Manager LSM technology You must determine the storage configuration that will meet your needs Mirroring disks across two shared buses provides the most highly available data See the TruCluster Server Software Product Description SPD to determine the supported storage shelves disk devices and RAID array controllers Disk devices used on the shared bus must be installed in a supported storage shelf or behind a RAID array controller Before you connect a storage shelf to a shared SCSI bus you must install the disks in the unit Before connecting a RAID array controller to a shared SCSI bus install the di
193. brary sets the electronic SCSI ID very quickly before any device can probe the MiniLibrary so the lack of a mechanical SCSI ID does not cause any problems on the SCSI bus To set the SCSI ID follow these steps 1 From the Default Screen press the Enter button to enter the Menu Mode displaying the Main Menu Note When you enter the Menu Mode the Ready light goes out an indication that the module is off line and all medium changer commands from the host return a SCSI not ready 8 62 Configuring a Shared SCSI Bus for Tape Drive Use status until you exit the Menu Mode and the Ready light comes on once again 2 Depress the down arrow button until the Configure Menu item is selected then press the Enter button to display the Configure submenu Note The control panel up and down arrows have an auto repeat feature When you press either button for more than one half second the control panel behaves as if you were pressing the button about four times per second The effect stops when you release the button 3 Press the down arrow button until the Set SCSI item is selected and press the Enter button 4 Select the tape drive DLTO Bus ID or DLT1 Bus ID or library robotics LIB Bus ID for which you wish tochange the SCSI bus ID The default SCSI IDs are as follows e Lib Bus ID 0 e DLTOBusID 4 e DLT1BusID 5 Use the up or down arrow button to select the item for which you need to change the SCSI ID Press
194. bus usage in more detail 8 3 1 Setting the Compaq 20 40 GB DLT Tape Drive SCSI ID As with any of the shared SCSI devices the Compaq 20 40 GB DLT Tape Drive SCSI ID must be set to ensure that no two SCSI devices on the shared SCSI bus have the same SCSI ID The Compaq 20 40 GB DLT Tape Drive SCSI ID is set with a push button counter switch on the rear of the unit see Figure 8 4 Push the button above the counter to increment the address push the button below the counter to decrement the address until you have the desired SCSI ID selected Only SCSI IDs in the range of 0 to 7 are valid Ensure that the tape drive SCSI ID does not conflict with the SCSI ID of the host bus adapters usually 6 and 7 or other devices on this shared SCSI bus 8 10 Configuring a Shared SCSI Bus for Tape Drive Use Figure 8 4 Compaq 20 40 GB DLT Tape Drive Rear Panel SCSI ID SCSI ID Selector Switch Ea o m E 20 40 GB DLT Tape Drive ZK 1603U AI 8 3 2 Cabling the Compaq 20 40 GB DLT Tape Drive The Compaq 20 40 GB DLT Tape Drive is connected to a single ended segment of the shared SCSI bus A DWZZB AA signal converter is required to convert the differential shared SCSI bus to single ended Figure 8 5 shows a configuration with a Compaq 20 40 GB DLT Tape Drive on a shared SCSI bus To configure the shared SCSI bus for use with a Compaq 20 40 GB DLT Tape Drive follow these steps 1 You
195. by the expansion unit as follows e Expansion unit 0 through 15 e Top TL891 TL892 16 through 25 e Middle TL891 TL892 26 through 35 e Bottom TL891 TL892 36 through 45 When all initialization communication between the expansion module and each base module has completed the base modules will display their cartridge numbers according to the remapped cartridge inventory For instance the middle base module default screen would be displayed as follows DLT2 Idle DLT3 Idle Loader Idle 26 gt lt 35 8 8 2 4 Setting the TL890 TL891 TL892 SCSI ID After the base modules have been reconfigured as slaves each base module control panel still provides tape drive status and error information but all control functions are carried out from the expansion unit control panel This includes setting the SCSI ID for each of the tape drives present To set the SCSI IDs for the tape drives in a MiniLibrary configured with TL890 TL 891 T L892 hardware follow these steps 1 Apply power tothe MiniLibrary ensuring that you power up the expansion unit after or at the same time as the base modules 2 Wait until power on self tests POST have terminated and the expansion unit and each base module display the default screen 3 At the expansion unit control panel press the Enter button to display the Main Menu Configuring a Shared SCSI Bus for Tape Drive Use 8 35 4 Press the down arrow button until the Configure Menu item is
196. c initialization parameters and have an open channel for communications F ibre Channel protocol specific communications e Logged Out The adapter and remote N_Port do not have an open channel for communication e FCP Initiator The remote N_Port acts as a SCSI initiator device it sends SCSI commands e FCP Suspended The driver has invoked a temporary suspension on SCSI traffic to the N_Port while it resolves a change in connectivity e F_PORT The fabric connection F_Port allowing the adapter to send Fibre Channel traffic into the fabric e Directory Server TheN Port is the FC entity queried to determine who is present on the Fibre Channel fabric 3 A target ID of 1 or 2 shows up for remote Fibre Channel devices that do not communicate using Fibre Channel protocol the directory server and F_Port 6 64 Using Fibre Channel Storage Note You can use the emxmgr utility interactively to perform any of the previous functions 6 8 2 Using the emxmgr Utility Interactively Start the emxmgr utility without any command line options to enter the interactive mode to e Display the presence of KGPSA Fibre Channel adapters e Display the target ID mappings for a Fibre Channel adapter e Display the current Fibre Channel topology for a Fibre Channel adapter You have already seen how you can perform these functions from the command line The same output is available using the interactive mode by
197. cannot be used in a duster 4 3 PSM 7 5 Q optical cable 6 17 optical converter cable connection 5 6 installation 5 6 P quorum disk and LSM 1 4 configuring 1 4 number of votes 1 4 R part numbers ESL9326D 8 74 partitioned storagesets 3 18 PBM 7 5 PCI backplane manager SeePBM PCI drawer contents 7 4 7 primary 7 4 7 slot layout 2 2 performance improving 4 2 personality module 3 3 9 13 Seealso signal converters 5 5 Index 8 RA8000 configuring 2 8 port configuration 2 8 replacing controllers of 6 34 transparent failover mode 2 8 unit configuration 2 8 radial connection bus termination 3 8 UltraSCSI hub 3 8 RAID 1 12 RAID array controllers advantages of use 3 17 and shared SCSI bus 9 24 preparing 9 24 using in ASE 9 24 repartitioning procedure 7 8 replacing HSG80 controller 6 34 requirements SCSI bus 3 1 9 1 reset 6 25 6 48 resetting offsets 6 59 restrictions 2 8 disk devices 2 9 KZPBA CB adapters 2 9 KZPSA adapters 2 8 Memory Channel interconnects 2 3 SCSI bus adapters 2 5 rolling upgrade MC1 to MC2 5 14 S SAVE_CONFIGURATION command 6 34 SC connector S subscriber connector SCM 7 4 master 7 5 master designate 7 5 powered by 7 4 purpose 7 4 slave 7 5 SCM command power on 7 12 set hp_count 7 10 set hp_qbb_mask 7 10 show nvr 7 10 scm_csb_master_eligible 7 5 7 12 SCSI number of devices suppor
198. configuration replace the MC1 adapter with an MC2 adapter Connect the second set of of MC2 adapters with a BN39B 10 link cable to form the second Memory Channel interconnect 5 16 Setting Up the Memory Channel Cluster Interconnect Table 5 4 Adding a Memory Channel Interconnect or Rolling from a Dual Redundant MC1 Interconnect to MC2 Interconnects cont Step Action Refer to Standard Hub Configuration Remove the MC1 adapter and install the MC2 adapter in Figure 5 4 and one system and on one rail at atime Usea BN39B 10 Figure 5 5 link cable to connect the new MC2 adapter to the linecard in the MC2 hub that corresponds to the same linecard that the MC1 module was connected to in the MC1 hub If this is the last system on this rail to receive an MC2 Figure 5 6 adapter that is all other member systems on this rail have one MC2 adapter you can replace both MC1 adapters at the same time Use a BN39B 10 link cable to connect the new MC2 adapters to the linecard in their respective MC2 hub that corresponds to the same linecard that the MC1 modules were connected to in the MC1 hubs 6 Turn on the system and run themc_diag Memory Channel Section 5 6 diagnostic Note that you cannot run mc_cable because this is the only system in the cluster that is shut down 7 Boot the system 8 Repeat steps 1 7 for all other systems in the cluster Figure 5 7 and When you have replaced both MC1 adapters in the Figure
199. connections to render the DLT MiniLibrary system operational Expansion unit tothe motor mechanism The motor mechanism cable is about 1 meter long and has a DB 15 connector on each end Connect it between the connector labeled Motor on the expansion unit to the motor on the pass through mechanism Note This cable is not shown in Figure 8 11 as the pass through mechanism is not shown in the figure Robotics control cables from each base module to the expansion unit These cables have a DB 9 male connector on one end and a DB 9 female connector on the other end Connect the male end to the Expansion Unit Interface connector on the base module and the female end to any Expansion Modules connector on the expansion unit Note It does not matter which interface connector a base module is connected to SCSI bus connection to the expansion unit robotics Connect the shared SCSI bus that will control the robotics to one of the SCSI connectors on the expansion unit with a BN21K or BN21L cable Terminate the SCSI bus with an H879 AA terminator on the other expansion unit SCSI connector SCSI bus connection to each of the base module tape drives Connect a shared SCSI bus to one of the DLT1 or DLT2 SCSI connectors on each of the base modules with BN21K or BN21L cables Terminate the other DLT1 or DLT2 SCSI bus connection with an H879 AA terminator You can daisy chain between DLT1 and DLT2 if present with a 0 3 meter SCSI bus jump
200. controller require a SCSI ID on a separate SCSI bus The robotics controller and tape drive drive 0 use two SCSI IDs on their SCSI bus Configuring a Shared SCSI Bus for Tape Drive Use 8 45 You can reconfigure the tape drives and robotics controller to place multiple tape drives on the same SCSI bus with SCSI bus jumper part number 6210567 included with the tape library Note We recommend placing no more than two TZ89 drives on a SCSI bus segment We also recommend that storage be placed on shared SCSI buses that do not have tape drives To reconfigure TL895 SCSI bus configuration follow these steps Remove the SCSI bus cable from one drive to be daisy chained Remove the terminator from the other drive to be daisy chained Ensure that the drive that will be the last drive on the SCSI bus has a terminator installed 4 Install a SCSI bus jumper cable part number 6210567 on the open connectors of the two drives to be daisy chained Figure 8 14 shows an example of a TL 895 that has tape drives 1 3 and 5 daisy chained to tape drives 2 4 and 6 respectively 8 46 Configuring a Shared SCSI Bus for Tape Drive Use Figure 8 14 TL895 Tape Library Internal Cabling Robotics Controller SCSI ID 0 Terminator A PN 0415619 Tape Drive 0 SCSI ID 1 Tape Drive 1 SCSI ID 2 Tape Drive 2 SCSI ID 3 Tape Drive 3 SCSI ID 4 SCSI Jumper Cable e PN 6210567 SCSI Port 8 SCSI Port 7 SCSI Po
201. cription SPD the technical update version of this information will be modified to include arbitrated loop The SPD will provide a pointer tothe technical update 6 3 Example Fibre Channel Configurations Supported by TruCluster Server This section provides diagrams of some of the configurations supported by TruCluster Server Version 5 1 Diagrams are provided for both transparent failover mode and multiple bus failover mode Using Fibre Channel Storage 6 9 6 3 1 Fibre Channel Cluster Configurations for Transparent Failover Mode With transparent failover mode e Thehosts do not know a failover has taken place failover is transparent to the hosts e Theunits are divided between an HSG80 port 1 and port 2 e If there are dual redundant HSG80 controllers controller A port 1 and controller B port 2 are normally active controller A port 1 and controller B port 1 are normally passive e If one controller fails the other controller takes control and both its ports are active Figure 6 4 shows a typical Fibre Channel cluster configuration using transparent failover mode Figure 6 4 Fibre Channel Single Switch Transparent Failover Configuration Member Memory Channel seen Memory Interface Memory Channel Channel KGPSA KGPSA Member System ZK 1531U Al 6 10 Using Fibre Channel Storage In transparent failover units DOO through D99 are accessed through port 1 of both controllers Units D100 through D199
202. ctions for disk devices are as follows e Disks on shared SCSI buses must be installed in external storage shelves or behind a RAID array controller e TruCluster Server does not support Prestoserve on any shared disk 2 5 RAID Array Controller Restrictions RAID array controllers provide high performance high availability and high connectivity access to SCSI devices through a shared SCSI bus Hardware Requirements and Restrictions 2 9 RAID array controllers require the minimum Array Controller Software ACS shown in Table 2 1 Table 2 1 RAID Controller Minimum Required Array Controller Software RAID Controller Minimum Required Array Controller Software HSZ20 3 4 HSZ40 3 7 HSZ50 5 7 HSZ70 7 7 HSZ80 8 3 1 HSG60 8 5 HSG80 8 5 RAID controllers can be configured with the number of SCSI IDs as shown in Table 2 2 Table 2 2 RAID Controller SCSI IDs RAID Controller Number of SCSI IDs Supported HSZ20 4 HSZ40 4 HSZ50 4 HSZ70 8 HSZ80 15 HSG60 N A HSG80 N A 2 6 SCSI Signal Converters If you are using a standalone storage shelf with a single ended SCSI interfacein your cluster configuration you must connect it toa SCSI signal converter SCSI signal converters convert wide differential SCSI to narrow or wide single ended SCSI and vice versa Some signal converters are standalone desktop units and some are StorageWorks building blocks SBBs that you inst
203. d 8 7 2 Cabling the TL891 or TL892 MiniLibraries There are six 68 pin high density SCSI connectors on the back of the TL891 The two leftmost connectors are for the library robotics controller The middle two are for tape drive 1 The two on the right are for tape drive 2 if the TL892 upgrade has been installed Note The tape drive SCSI connectors are labeled DLT 1 tape drive 1 and DLT2 tape drive 2 The control pane designation for the drives is DLTO tape drive 1 and DLT1 tape drive 2 The default for the DLT MiniLibrary TL891 is to place the robotics controller and tape drive 1 on the same SCSI bus A 0 3 meter SCSI jumper cable is provided with the unit Plug this cable into the second connector from the left and the third connector If the MiniLibrary has been upgraded to two drives place the second drive on the same SCSI bus with another 0 3 meter SCSI bus jumper cable or place it on its own SCSI bus Note To achieve system performance capabilities we recommend placing no more than two TZ89 tape drives on a SCSI bus The internal cabling of the TL891 and TL892 is too long to allow external termination with a trilink H879 AA combination Therefore the TL891 or TL892 must be the last device on the shared SCSI bus They may not be removed from the shared Configuring a Shared SCSI Bus for Tape Drive Use 8 25 SCSI bus without stopping all ASE services that generate activity on the bus For this reason we r
204. d Therefore you cannot use SCSI ID 7 on the member systems SCSI bus adapter The following section describes how to prepare the DS DWZZH 05 UltraSCSl hub for use on a shared SCSI bus in more detail 3 6 1 2 1 DS DWZZH 05 Configuration Guidelines The DS DWZZH 05 UltraSCS I hub can be installed in e A StorageWorks UltraSCSI BA356 shelf which has the required 180 watt power supply e A non UltraSCSI BA356 that has been upgraded to the 180 watt power supply with the DS BA35X HH option Note Dual power supplies are recommended for any BA356 shelf containing a DS DWZZH 05 UltraSCSI hub in order to provide a higher level of availability between cluster member systems and storage 3 10 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware e Thelower righthand device slot of the BA370 shelf within the RA7000 or ESA 10000 RAID array subsystems This position minimizes cable lengths and interference with disks A DS DWZZH 05 UltraSCSI hub uses the storage shelf only to provide its power and mechanical support it is not connected to the shelf internal SCSI bus Note When the DS DWZZH 05 is installed its orientation is rotated 90 degrees counterclockwise from what is shown in Figure 3 3 and Figure 3 4 The maximum configurations with combinations of DS DWZZH 03 and DS DWZZH 05 UltraSCSI hubs and disks in the same storage shelf containing dual 180 watt power supplies are shown in Table 3 3 Note
205. d BN 34R fiber optics cable when you install the CCMAB Memory Channel PCI adapter in each system in the standard hub configuration You should also connect the CCMAB Memory Channel adapter to the optical converter with a BN39B 01 cable 5 10 Setting Up the Memory Channel Cluster Interconnect Now you need to e Set the CCMLB linecard jumpers to support fiber optics e Connect the fiber optics cable toa CCMFB fiber optics converter module e Install the CCMFB fiber optics converter module for each fiber optics link Note Remember if you have more than four fiber optics links you need two or more hubs The CCMHB BA hub has nolinecards To set the CCMLB jumpers and install CCMFB optics converter modules in an MC2 hub follow these steps 1 Remove the appropriate CCMLB linecard and set the linecard jumpers toFiber On jumper pins 1 to 2 to support fiber optics See Table 5 3 2 Removethe CCMLB endplate and install the alternate endplate with the slot at the bottom 3 Removethe hub bulkhead blanking plate from the appropriate hub slot Ensure that you observe the slot restrictions for the optical converter modules Also keep in mind that all linecards for one Memory Channel interconnect must bein the same hub see Section 5 4 4 Thread the BN34R fiber optics cable through the hub bulkhead slot The other end should be attached to a CCMFB optics converter in the member system 5 Thread the BN3A4R fiber optics cable through t
206. d hub mode pins 1 to 2 jumpered Confirm that the jumpers are set properly for your configuration The jumper configurations are shown as if you were holding the module with the jumpers facing you with the module end plate in your left hand The jumpers are right next to the factory maintenance cable connector and are described in Table 5 1 Table 5 1 MC1 and MC1 5 Jumper Configuration If hub mode is Jumper Example Standard Pins 1 to 2 123 5 2 Setting Up the Memory Channel Cluster Interconnect Table 5 1 MC1 and MC1 5 Jumper Configuration cont If hub mode is Jumper Example Virtual VHO Pins 2 to 3 123 Virtual VH1 None needed storethejumper on pin 1 or 3 123 If you are upgrading from virtual hub mode to standard hub mode or from standard hub mode to virtual hub mode be sure to change the jumpers on all Memory Channel adapters on the rail 5 1 2 MC2 Jumpers The MC2 module CCMAB has multiple jumpers They are numbered right to left starting with J 1 in the upper righthand corner as you view the jumper side of the module with the endplatein your left hand The leftmost jumpers are 11 andJ 10 J 11 is above J 10 Most of the jumper settings are straightforward but the window size jumper J 3 needs some explanation If aCCMAA adapter MC1 or MC1 5 is installed 128 MB of address space is allocated for Memory Channel use If a CCMAB adapter M C2 PCI adapter is installed the memo
207. data disk May be used for _ ID 14 or redundant power redundant supply power supply ZK 1598U Al Table 9 2 shows the components used to create the cluster shown in Figure 9 11 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 23 Table 9 2 Hardware Components Used for Configuration Shown in Figure 9 11 Callout Number Description 1 BN21W 0B Y cable 2 H879 AA HD68 terminator 3 BN 38C or BN38D cable 4 H8861 AA VHDCI trilink connector 5 BN37A cable a The maximum combined length of the BN 38C or BN38D and BN37A cables on one SCSI bus segment must not exceed 25 meters 9 4 3 Cabling a Non UltraSCSI RAID Array Controller to an Externally Terminated Shared SCSI Bus A RAID array controller provides high performance high availability and high connectivity access to SCSI devices through the shared SCSI buses Before you connect a RAID controller toa shared SCSI bus you must install and configure the disks that the controller will use and ensure that the controller has a unique SCSI ID on the shared bus You can configure the HSZ20 HSZ40 and HSZ50 RAID array controllers with one to four SCSI IDs Because the HSZ20 HSZ40 and HSZ50 have a wide differential connection on the host side you connect them to one of the following differential devices e KZPSA BB host bus adapter e KZPBA CB host bus adapter e Another HSZ20 HSZ40 or HSZ50 Note
208. de as necessary 1 Set the Memory Channel jumpers Section 5 1 2 Install the Memory Channel adapter into a PCI slot on each system Section 5 2 3 If you are using fiber optics with MC2 install the CCMFB fiber optics module Section 5 3 4 If you have more than two systems in the cluster install a Memory Channel hub Section 5 4 5 Connect the Memory Channel cables Section 5 5 After you complete steps 1 through 5 for all systems in the cluster apply power tothe systems and run Memory Channel diagnostics Section 5 6 Setting Up the Memory Channel Cluster Interconnect 5 1 Note If you are installing SCSI or network adapters you may want to complete all hardware installation before powering up the systems to run Memory Channel diagnostics Section 5 7 provides procedures for upgrading from redundant MC1 interconnects to MC2 interconnects 5 1 Setting the Memory Channel Adapter Jumpers The meaning of the Memory Channel adapter module jumpers depends upon the version of the Memory Channel module 5 1 1 MC1 and MC1 5 Jumpers The MC1 and MC1 5 modules CCMAA AA and CCMAA AB respectively have adapter jumpers that designate whether the configuration is using standard or virtual hub mode If virtual hub mode is being used there can be only two systems One system must be virtual hub 0 VH 0 and the other must be virtual hub 1 VH1 The Memory Channel adapter should arrive with the jumpers set for standar
209. disk is 132 2 From the AlphaServer console use the wwidmgr clear all command to clear the stored Fibre Channel wwid1 wwid2 wwid3 wwid4 N1 N2 N3 and N4 console environment variables You want to start with all wwidn and Nn variables clear P00 gt gt gt wwidmgr clear all P00 gt gt gt show wwid wwid0 wwidl1 wwid2 wwid3 POO gt gt gt show n N1 N2 N3 N4 Note The console only creates devices for which the wwidn console environment variable has been set and are accessible through an HSG80 N_Port as specified by the Nn console environment variable also being set These console environment variables are set with the wwidmgr quickset Or wwidmgr set wwid commands The use of the wwidmgr quickset command is shown later in Example 6 5 3 Example 6 4 shows the use of the wwidmgr show wwid command to display the UDID and worldwide names of all devices known to the console Note that at this time if you were to issue the show device 6 44 Using Fibre Channel Storage console command it would not detect the Fibre Channel devices connected to the HSG80 Example 6 4 Displaying the UDID and Worldwide Names of Devices Known to the Console P00 gt gt gt wwidmgr show wwid 0 UDID WWID 01000010 6000 1fe1 0001 4770 0009 9171 3579 0008 ev none 1 UDID WWID 01000010 6000
210. dsk18 66 name SCSI WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002b dev_base_ name dsk19 7 s name SCSI WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002a dev_base_ name dsk20 68 name SCSI WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 0029 dev_base_ name dsk21 69 name SCSI WWID 0710002c COMPAQ CDR 8435 d05b003t00000100000 dev_base_ name cdrom0 For more information on the hardware manager hwmgr see hwmgr 8 6 52 Using Fibre Channel Storage 2 Search the display for the UDI Ds or worldwide names for each of the cluster installation disks and record the dev disk dskn values If you used the grep utility to search for a specific U DI D for example hwmgr view dev grep IDENTIFIER 131 repeat the command to determine the dev disk dskn for each of the remaining cluster disks Record the information for use when you install the cluster software You must label the disks before you install cluster software 6 6 4 Label the Disks to Be Used to Create the Cluster Before you run clu_create to create the first cluster member or clu_add_member to add subsequent duster members you must label the disks to be used for cluster software On the system where you installed the Tru64 UNIX operating system if you have not already done so boot the system Determine the dev disk dskn values to use for cluster installation see Section 6 6 3 Initialize disklabels for all disks needed to
211. e QLogic ISP1020 SCSI controller which implements the 16 bit wide SCSI bus and uses dynamic termination The QLogic ISP1020 module has two terminators one for the 8 low bits and one for the high 8 bits There are five possible values for pk 0_ soft term e off Turns off both the low 8 bits and high 8 bits e low Turns on the low 8 bits and turns off the high 8 bits high Turns on the high 8 bits and turns off the low 8 bits on Turns on both the low 8 bits and high 8 bits e diff Places the bus in differential mode The KZPBA CB is a Qlogic SP1040 module and its termination is determined by the presence or absence of internal termination resistor SIPs RM1 RM8 Therefore the pkbo_soft_term environment variable has no meaning and it may be ignored Example 10 6 shows the use of the show isp console command to display the console environment variables for KZPBA CBs on an AlphaServer 8x00 10 14 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices Example 10 6 Displaying Console Variables for a KZPBA CB on an AlphaServer 8x00 System P00 gt gt gt show isp ispO_host_id 7 isp0O soft_term on ispl_host_id 7 ispl_soft_term on isp2_host_id 7 isp2_soft_term on isp3_host_id 7 isp3_soft_term on isp5_host_id 7 isp5_soft_term diff Both Example 10 3 and Example 10 4 show five isp devices isp0 isp1 isp2 isp3 and isp4 In Example 10 6 the show isp console command
212. e 6 17 Connect the Ethernet cable Connect the fiber optic cables Connect power to the switch Au Fw Turn on the power The switch runs a series of power on self test POST tests The DS DSGGC AA has no power switch power is applied when the unit is plugged in 7 Set the switch IP address and subnet mask See Section 6 5 1 2 2 You can also set the switch name if desired see Section 6 5 1 2 5 The switch IP address and subnet mask must initially be set from the front panel except for the DS DSGGB AA or DS DSGGC AA 8 port Fibre Channel switches In this case you have to set the IP address from the PC or terminal You must usea telnet session to set the switch name 8 Reboot the switch to enable the changein IP address and subnet mask to take effect For more information on the individual switches see the following documentation e Compaq StorageWorks Fibre Channa Storage Switch User s Guide e Compaq StorageWorks SAN Switch 8 Installation and Hardware Guide e Compaq StorageWorks SAN Switch 16 Installation and Hardware Guide e Compaq StorageWorks Fibre Channa SAN Switch 8 EL Installation and Hardware Guide For more information on managing a Fibre Channel switch see the Compaq StorageWorks FibreChannd SAN Switch Management Guide For more information on the SAN switch fabric operating system see the Compaq StorageWorks SAN Switch Fabric Operating Systen Managenent Guide 6 5 1 2 Managing the Fibre Channel Switches Y
213. e 7 SCSI ID 5 SCSI Bulkhead O O GO O GO O GO O O GA GO O eo od ZK 1705U AI Note Each internal cable is up to 2 5 meters long The length of the internal cables two per SCSI bus must be taken into consideration when ordering SCSI bus cables The maximum length of a differential SCSI bus segment is 25 meters and the internal tape drive SCSI bus length is 5 meters Therefore you must limit the external SCSI bus cables to 20 meters maximum 8 76 Configuring a Shared SCSI Bus for Tape Drive Use 8 13 3 4 Connecting the ESL9326D Enterprise Library to the Shared SCSI Bus The ESL9326D Enterprise Library has 5 meters of internal SCSI bus cabling for each pair of tape drives Because of the internal SCSI bus lengths you cannot use a trilink connector or Y cable toterminate the SCSI bus external to the tape library as is done with other devices on the shared SCSI bus You must terminate each SCSI bus at the end of the SCSI bus by installing a terminator on the SCSI bulkhead SCSI connector Therefore you must ensure that the ESL9326D Enterprise Library is on the end of the shared SCSI bus in TruCluster Server configurations Note We recommend that you put disk storage devices on separate shared SCSI buses Use 328215 001 5 meter 328215 002 10 meter 328215 003 15 meter 328215 004 20 meter or BN21K BN21L cables of the appropriate length to connect the ESL9326D Enterprise Library toa shared SCSI bus The entir
214. e 8 3 DS TZ89N VW Switch Settings cont SCSI ID SCSI ID Selection Switches 1 2 3 4 5 6 7 8 5 On Off On Off Off Off Off Off 6 Off On On Off Off Off Off Off 7 On On On Off Off Off Off Off 8 Off Off Off On Off Off Off Off 9 On Off Off On Off Off Off Off 10 Off On Off On Off Off Off Off 11 On On Off On Off Off Off Off 12 Off Off On On Off Off Off Off 13 On Off On On Off Off Off Off 14 Off On On On Off Off Off Off 15 On On On On Off Off Off Off a SBB tape drive SCSI ID is determined by the SBB physical slot 8 2 2 Cabling the DS TZ89N VW Tape Drives No special cabling is involved with the DS TZ89N VW as it is installed in a BA356 StorageWorks enclosure A DWZZB VA installed in slot 0 of the BA356 provides the connection to the shared SCSI bus You must remove the DWZZB VW differential terminators Ensure that jumpers W1 and W2 are installed to enable the single ended termination The BA356 jumper must be installed and connector J B1 on the personality module must be left open to provide termination at the other end of the single ended bus A trilink connector on the differential end of the DWZZB VW allows connection to the shared bus If the BA356 containing the DS TZ89N VW is on the end of the bus install an H879 AA terminator on the trilink for that BA356 to provide termination for the shared SCSI bus Figure 8 2 shows a TruCluster Server cluster with three shared SCSI buses One shared bu
215. e For AlphaServer 8200 8400 GS60 GS60E or GS140 systems the Memory Channel adapter must be installed in slots 0 7 of a DWLPA PCIA option there are no restrictions fora DWLPB e If aTruCluster Server cluster configuration utilizes multiple Memory Channel adapters in standard hub mode the Memory Channel adapters must be connected to separate Memory Channel hubs The first Memory Channel adapter mcao in each system must be connected to one Memory Channel hub The second Memory Channel adapter mebo in each system must be connected to a second Memory Channel hub Also 2 4 Hardware Requirements and Restrictions each Memory Channel adapter on one system must be connected to the same linecard in each Memory Channel hub 2 3 Host Bus Adapter Restrictions To connect a member system to a shared SCSI bus you must install a host bus adapter in an I O bus slot The Tru64 UNIX operating system supports a maximum of 64 I O buses TruCluster Server supports a total of 32 shared O buses using KZPSA BB host bus adapters KZPBA CB UltraSCSI host bus adapters or KGPSA Fibre Channel host bus adapters The following sections describe the host bus adapter restrictions in more detail 2 3 1 Fibre Channel Requirements and Restrictions The following requirements and restrictions apply to the use of Fibre Channel with TruCluster Server Version 5 1 The HSG60 and HSG80 require Array Control Software ACS Version 8 5 or later Eight member s
216. e UltraSCS BA356 differential termination Ensure that personality module DS BA35X DA switch pack 4 switches S4 1 and S4 2 are ON see Figure 9 3 Note S4 3 and S4 4 are not used on the DS BA35X DA 9 4 2 Connecting Storage Shelves Together Section 9 4 1 covered the steps necessary to prepare the BA350 BA356 and UltraSCSI BA356 storage shelves for use on a shared SCSI bus However you will probably need more storage than one storage shelf can provide so you will need two storage shelves on the shared SCSI bus Note Because the BA350 contains a narrow 8 bit single ended SCSI bus it only supports SCSI IDs O through 7 Therefore a BA350 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 17 must be used with a BA356 or UltraSCS I BA356 if more than five disks are required The following sections provide the steps needed to connect two storage shelves and two member systems on a shared SCSI bus e BA350 and BA356 Section 9 4 2 1 e Two BA356s Section 9 4 2 2 e Two UltraSCS I BA356s Section 9 4 2 3 9 4 2 1 Connecting a BA350 and a BA356 for Shared SCSI Bus Usage When you use a BA350 and a BA356 for storage on a shared SCSI busin a TruCluster Server configuration the BA356 must be configured for SCSI IDs 8 through 14 To prepare a BA350 and BA356 for shared SCSI bus usage See Figure 9 9 follow these steps 1 Complete the steps in Section 9 4 1 1 and Section 9 4
217. e and will not show up in a console show dev display 6 6 1 3 Set the Device Unit Number The device unit number is a subset of the device name as shown in a show device console display For example in the device name dga133 1001 0 1 0 the device unit number is 133 The console uses this device unit number to identify a storage unit When you set a device unit number you are really setting an alias for the device worldwide name The 64 bit worldwide name is too large to be used as the device unit number so an alias is used instead This section describes how to use the wwidmgr quickset command to set the device unit number for the Fibre Channel disks to be used as the Tru64 Using Fibre Channel Storage 6 43 UNIX Version 5 1 installation disk or cluster member system boot disks Setting the device unit number allows the installation scripts to recognize a Fibre Channel disk To set the device unit number for a Fibre Channel device follow these steps 1 UsetheHSG80 show unit command to obtain the user defined identifier UDID for the HSG80 storageset to be used as the Tru64 UNIX Version 5 1 installation disk or cluster member system boot disks Record the UDI Ds The show unit command also displays the HSG80 disk name so you can be sure you are using the correct device In the example in Table 6 2 the Tru64 UNIX disk is unit D133 with a UDID 133 The UDID for the cluster member 1 boot disk is 131 and the cluster member 2 boot
218. e extender with an angled extender AlphaServer 2100A for instance or for an AlphaServer 8200 8400 GS60 GS60E or GS140 remove the extender completely If you are setting up a redundant Memory Channel configuration install the second Memory Channel adapter right after installing the first Memory Channel adapter Ensure that the jumpers are correct and are the same on both modules After you install the Memory Channel adapter s replace the system panels unless you have more hardware to install 5 3 Installing the MC2 Optical Converter in the Member System If you are going to use a CCMFB optical converter along with the MC2 PCI adapter install it at the same time that you install the MC2 CCMAB To install aMC2 CCMFB optical converter in the member system follow these steps See Section 5 5 2 4 if you are installing an optical converter in an MC2 hub 1 Remove the bulkhead blanking plate for the desired PCI slot 2 Thread one end of the fiber optics cable BN 34R through the PCI bulkhead slot 3 Thread the optics cable through the slot in the optical converter module CCMFB endplate at the top of the endplate 4 Remove the cable tip protectors and attach the keyed plug to the connector on the optical converter module Tie wrap the cable to the module 5 Seat the optical converter module firmly into the PCI backplane and secure the module with the PCI card cage mounting screw 6 Attach the 1 meter BN39B 01 cable f
219. e installed Figure 4 1 and KZPBA CB PCl to Ultra SCSI Differential Host Adapter User s Guide 10 4 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices Table 10 2 Installing the KZPSA BB or KZPBA CB for Radial Connection to a DWZZH UltraSCSI Hub cont Step Action Refer to 2 Power down the system Install a KZPSA BB KZPSA PClI to SCSI PCl to SCSI adapter or KZPBA CB UltraSCSI host Storage Adapter adapter in the PCI slot corresponding to the logical Installation and User s bus to be used for the shared SCSI bus Ensure Guideand KZPBA CB that the number of adapters are within limits for PCl to Ultra SCSI the system and that the placement is acceptable Differential Host Adapter User s Guide Install a BN38C cable between the KZPBA BB or KZPBA CB UltraSCSI host adapter and a DWZZH port Notes The maximum length of a SCSI bus segment is 25 meters including the bus length internal to the adapter and storage devices One end of the BN 38C cable is 68 pin high density The other end is 68 pin VHDCI The DWZZH accepts the 68 pin VH DCI connector The number of member systems in the cluster has to be one less than the number of DWZZH ports Power up the system and update the system Firmware release SRM console firmware and KZPSA BB host notes for the system bus adapter firmware from the latest Alpha Section 4 2 and Systems Firmware Update CD ROM Section 10 1 4 5
220. e it powered off until all base units have been reconfigured as slaves After a series of self tests have executed the default screen will be displayed on the base module control panel 8 70 Configuring a Shared SCSI Bus for Tape Drive Use DLTO Idle DLT1 Idle Loader Idle 0 gt lt 9 The default screen shows the state of the tape drives loader and number of cartridges present for this base unit A rectangle in place of the underscore indicates that a cartridge is present in that location 2 Press the Enter button to enter the Menu Mode displaying the Main Menu 3 Depress the down arrow button until the Configure Menu item is selected then press the Enter button Note The control panel up and down arrows have an auto repeat feature When you press either button for more than one half second the control panel behaves as if you were pressing the button about four times per second The effect stops when you release the button 4 Press the down arrow button until the Set Special Config menu is selected and press the Enter button 5 Press the down arrow button repeatedly until the Alternate Config item is selected and press the Enter button 6 Press the down arrow button to change the alternate configuration from the default Standalone to Slave Press the Enter button 7 After the selection stops flashing and the control panel indicates that the change is not effective until a reboot press the E
221. e mask 1100 to select QBB 2 and QBB 3 for hard partition 1 Display the SCM environment variables non volatile RAM to verify that the hard partition variables are set correctly Verify that the hard partition environment variables are correct Indicates that control will be transferred to the SRM firmware at the end of a power up sequence If you want to execute SCM commands use the escape sequence Esc Esc scm to transfer control to the SCM firmware If you want to ensure that control stays with the SCM at the end of a power up sequence set the auto quit scm SCM environment variable to zero The SCM on this primary PCI drawer is eligible to be selected as the master SCM on subsequent power ups It will be selected if it is connected to the OCP its CSB node ID is the lowest of the SCMs that are eligible to become master and the scm csb master eligible environment variable is set 9 Select one primary PCI drawer to be the master SCM and if desired another primary PCI drawer to be a standby SCM by setting the Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 11 scm_csb_master_ eligible environment variable The master and standby SCM must be connected to the OCP The master SCM must have the lowest node ID Use the node ID address obtained from the show csb SCM command see Example 7 4 If multiple primary PCI drawers are eligible the SCM on the PCI dr
222. e maximum length of the BN37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters The maximum length of this cable or of two cables if two tape drives are daisy chained is 3 meters 8 5 Preparing the TZ885 for Shared SCSI Usage The TZ885 Digital Linear Tape subsystems combine a cartridge tape drive TZ88 and an automatic cartridge loader The TZ885 uses a removable magazine The TZ885 uses a five cartridge CompacTape IV minitape library magazine with a 200 GB capacity compressed It is capable of reading writing at approximately 10 8 GB per hour As with any of the shared SCSI devices the TZ885 SCSI IDs must be set to ensure that no two SCSI devices on the shared SCSI bus have the same SCSI ID The following sections describe preparing the TZ885 in more detail 8 5 1 Setting the TZ885 SCSI ID To set the TZ885 SCSI ID from the Operators Control Panel OCP follow these steps 1 Press and hold the Display Mode push button for about five seconds until the SCSI ID SEL message is displayed SCSI ID SEL SCSI ID 0 2 Press the Select push button until you see the desired SCSI ID number in the display 3 Press the Display Mode push button again Issue a bus reset or turn the minilibrary power off and on again to cause the drive to recognize the new SCSI ID Configuring a Shared SCSI Bus for Tape Drive Use 8 17 8 5 2 Cabling the TZ885 Tape Drive The TZ8
223. e member system boot disk as shown in Example 6 7 For member system 2 in the example configuration it is the storage unit with UDID 132 see Table 6 2 Example 6 7 Setting Device Unit Number for Additional Member System P00 gt gt gt wwidmgr quickset udid 132 Disk assignment and reachability after next initialization 6000 1fe1 0000 0d60 0009 8080 0434 0030 dga132 1001 dga132 1002 dga132 1003 dga132 1004 dgb132 1001 dgb132 1002 dgb132 1003 dgb132 1004 via adapter via fc nport connected 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d64 No 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d62 Yes 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d63 No 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d61 Yes 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d64 No 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d62 Yes 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d63 No 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d61 Yes P00 gt gt gt init Using Fibre Channel Storage 6 55 b Set the bootdef_ dev console environment variable to one reachable path Yes in the connected column of Example 6 7 to the member system boot disk P00 gt gt gt set bootdef dev dga132 1002 0 1 0 c Boot genvmunix on the newly added cluster member system Each installed subset will be configured and a new kernel will be built and installed After the new kernel is built do not reboot the new cluster member system 2 Shut down the system and reset the bootdef_dev console environment variable to provide multiple boot pa
224. e only the beginning and end of each SCSI bus segment either single ended or differential There are two rules for SCSI bus termination e Thereare only two terminators for each SCSI bus segment e If you do not use an UltraSCSI hub bus termination must be external Note that you may use external termination with an UltraSCSI hub but is is not the recommended way Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 5 Whenever possible connect devices to a shared bus so that they can be isolated from the bus This allows you to disconnect devices from the bus for maintenance purposes without affecting bus termination and cluster operation You also can set up a shared SCSI bus so that you can connect additional devices at a later time without affecting bus termination Notes With the exception of the TZ885 TZ887 TL890 TL891 and TL892 tape devices can only be installed at the end of a shared SCSI bus These tape devices are the only supported tape devices that can be terminated externally We recommend that tape loaders be on a separate shared SCSI bus to allow normal shared SCSI bus termination for those shared SCSI buses without tape loaders Most devices have internal termination For example the KZPSA and KZPBA host bus adapters BA350 and BA356 storage shelves and the DW2ZZA and DWZZB SCSI bus signal converters have internal termination Depending on how you set up a shared bus
225. e redundant MC2 modules on a system jumpered for 512 MB you cannot have two MC2 modules on the same PCI bus If a Memory Channel module is installed on an AlphaServer GS80 160 320 PCI bus no other modules may be installed on that PCI bus not even the standard I O module The MC1 adapter cannot be cabled to a MC2 adapter Donot use the BC12N link cable with the CCMAB MC2 adapter Donot use the BN39B link cable with the CCMAA MC1 adapter Redundant Memory Channels are supported within a mixed Memory Channel configuration as long as MC1 adapters are connected to other MC1 adapters and MC2 adapters are connected to MC2 adapters A Memory Channel interconnect can use either virtual hub mode two member systems connected without a Memory Channel hub or standard hub mode two or more systems connected to a hub A TruCluster Server cluster with three or more member systems must be j umpered for standard hub mode and requires a Memory Channel hub If Memory Channel modules are jumpered for virtual hub mode all Memory Channel modules on a system must be jumpered in the same manner either virtual hub 0 VHO or virtual hub 1 VH1 You cannot have one Memory Channel module jumpered for VHO and another jumpered for VH1 on the same system The maximum length of an MC1 BC12N link cable is 3 meters 10 feet The maximum length of an MC2 BN 39B link cable is 10 meters Hardware Requirements and Restrictions 2 3 e In an MC2 configuration y
226. e shared SCSI bus including ESL9326 internal cables cannot exceed 25 meters Terminate each SCSI bus with a 330563 001 or H879 AA HD 68 terminator Connect the cables and terminator on the SCSI bulkhead SCSI connectors as indicated in Table 8 21 to form shared SCSI buses Table 8 21 Shared SCSI Bus Cable and Terminator Connections for the ESL9326D Enterprise Library Tape Drives on Shared Connect SCSI Cable Install HD68 Terminator SCSI Bus to Connector on Connector 0 1 and library electronics Q B 2 3 C D 4 5 E F 6 7 G H 8 9 l J 10 11 K L 12 13 M N 14 15 O P a Install 3 meter jumper cable part number 330582 001 between SCSI connectors R and A to place the library electronics on the SCSI bus with tape drives 0 and 1 Configuring a Shared SCSI Bus for Tape Drive Use 8 77 Notes Each ESL9326D Enterprise Library arrives with one 330563 001 H D68 terminator for each pair of tape drives one SCSI bus The kit also includes at least one 330582 001 jumper cable to connect the library electronics to tape drives 0 and 1 Tape libraries with more than six tape drives include extra 330582 01 jumper cables in case you do not have enough host bus adapters and you want to place more than two tape drives on a single SCSI bus a configuration that we do not recommend 8 78 Configuring a Shared SCSI Bus for Tape Drive Use 9 Configurations Using External Termination or Radial Connections
227. e shelf does not provide termination power to the hub 2 8 SCSI Cables If you are using shared SCSI buses you must determine if you need cables with connectors that are low density 50 pins high density 50 pins high density 68 pins H D68 or VHDCI UItraSCSI If you are using an UltraSCSI hub you will need HD68 toVHDCI and VHDCI toVHDCI cables In some cases you also have the choice of straight or right angle connectors In addition each supported cable comes in various lengths Use the shortest possible cables to adhere to the limits on SCSI bus length Table 2 3 describes each supported cable and the context in which you would use the cable Some Compag equivalent 6 3 part numbers are not provided 2 12 Hardware Requirements and Restrictions Table 2 3 Supported SCSI Cables Cable Connector Pins Configuration Use Density BN21W 0B Three high 68 pin A Y cable that can be attached toa KZPSA BB or KZPBA CB if there is no room for a trilink connector It can be used with a terminator to provide external termination BN21M One low one 50 pin Connects the single ended end of high LD to a DWZZA AA or DWZZB AA to 68 pin a TZ885 or TZ887 2 HD BN21K Two HD68 68 pin Connects BN21W Y cables or wide BN21L or devices For example connects 328215 00X KZPBA CBs KZPSA BBs HSZ40s HSZ50s the differential sides of two SCSI signal converters or a DWZZB AA to a BA356 BN 38C or One HD68 one HD68 to Connects
228. e the single ended termination on one end of the bus Note The RAID Array 310 SCSI bus converter board is the same logic board used in the DWZZB signal converter 2 Attach an H885 AA trilink connector tothe SCSI input connector on the back of the cabinet 3 UseaBN21K or BN21L cable to connect the trilink connector toa trilink connector or BN21W 0B Y cable attached to a differential SCSI controller another storage shelf or the differential end of a signal converter 4 Terminate the differential bus by attaching an H879 AA terminator to the H885 AA trilink connector or BN21W OB Y cable at each end of the shared SCSI bus Ensurethat all devices that make up the shared SCSI bus are connected and that there is a terminator at each end of the shared SCSI bus 9 4 4 Cabling an HSZ40 or HSZ50 RAID Array Controller in a Radial Configuration with an UltraSCS I Hub You may have an HSZ40 or HSZ50 that you wish to keep when you upgrade toa newer AlphaServer system You can connect an HSZ40 or HSZ50 to an UltraSCSI hub ina radial configuration but even if the host bus adapter is a KZPBA CB it will not operate at UltraSCSI speed with the HSZ40 or HSZ50 To configure a dual redundant HSZ40 or HSZ50 RAID array controller and an UltraSCSI hub in a radial configuration follow these steps 1 You will need two H885 AA trilink connectors Install an H879 AA terminator on one of the trilinks 9 28 Configurations Using External Terminat
229. e the Compaq StorageWorks ESL9000 Series Tape Library Tape Drive U pgrade Guide for more information Preparing the ESL9326D Enterprise Library for Shared SCSI Bus Usage The ESL9326D Enterprise Library contains library electronics robotic controller and from 6 to 16 35 70 DLT DS TZ89N AV fast wide differential DLT tape drives Tape devices are supported only on those shared SCSI buses that use the KZPSA BB or KZPBA CB host bus adapters 8 74 Configuring a Shared SCSI Bus for Tape Drive Use 8 13 3 1 8 13 3 2 8 13 3 3 Notes The ESL9326D Enterprise Library is cabled internally for two 35 70 DLT tape drives on each SCSI bus It arrives with the library electronics cabled to tape drives 0 and 1 Every other pair of tape drives is cabled together 2 and 3 4 and 5 6 and 7 and so on An extra SCSI bus jumper cable is provided with the ESL9326D Enterprise Library for those customers that do not have enough SCSI buses and want to jumper two SCSI buses together and place four tape drives on the same SCSI bus We recommend that you place no more that two 35 70 DLT tape drives on a shared SCSI bus We also recommended that you do not place storage on shared SCSI buses that have tape drives The following sections describe how to prepare the ESL9326D Enterprise Library in more detail ESL9326D Enterprise Library Robotic and Tape Drive Required Firmware Library electronics firmware V1 22 is the minimum firmware versio
230. e to the TL890 DLT MiniLibrary expansion unit perform the following procedure on each base module in the system 1 Turn on the power switch on the TL891 TL892 base module to be reconfigured Note Do not power on the expansion unit Leave it powered off until all base modules have been reconfigured as slaves Configuring a Shared SCSI Bus for Tape Drive Use 8 33 After a series of power on self tests have executed the default screen will be displayed on the base module control panel DLTO Idle DLT1 Idle Loader Idle 0 gt lt 9 The default screen shows the state of the tape drives loader and number of cartridges present for this base module A rectangle in place of the underscore indicates that a cartridge is present in that location 2 Press the Enter button to enter the Menu Mode displaying the Main Menu 3 Depress the down arrow button until the Configure Menu item is selected then press the Enter button Note The control panel up and down arrows have an auto repeat feature When you press either button for more than one half second the control panel behaves as if you were pressing the button about four times per second The effect stops when you release the button 4 Press the down arrow button until the Set Special Config menu is selected and press the Enter button 5 Press the down arrow button repeatedly until the Alternate Config item is selected and press the Enter button 6 Pr
231. ecommend that tape devices be placed on separate shared SCSI buses and that there be no storage devices on the SCSI bus The cabling depends on whether or not there are one or two drives and for the two drive configuration if each drive is on a separate SCSI bus Note It is assumed that the library robotics is on the same SCSI bus as tape drive 1 To connect the library robotics and one drive to a single shared SCSI bus follow these steps 1 Connect aBN21K or BN21L between the last trilink connector on the bus to the leftmost connector as viewed from the rear of the TL891 2 Install a 0 3 meter SCSI bus jumper between the rightmost robotics connector second connector from the left and the left DLT 1 connector the third connector from the left 3 Install an H879 AA terminator on the right DLT 1 connector the fourth connector from the left To connect the drive robotics and two drives to a single shared SCSI bus follow these steps 1 Connect aBN21K or BN21L between the last trilink connector on the bus to the leftmost connector as viewed from the rear of the TL 892 2 Install a 0 3 meter SCSI bus jumper between the rightmost robotics connector the second connector from the left and the left DLT1 connector the third connector from the left 3 Install a 0 3 meter SCSI bus jumper between the rightmost DLT1 connector the fourth connector from the left and the left DLT2 connector the fifth connector fr
232. ector on the other end Connect the male end to the Expansion Unit Interface connector on the base unit or Diagnostic Configuring a Shared SCSI Bus for Tape Drive Use 8 67 connector on the data unit and the female end to any Expansion Modules connector on the expansion unit Note It does not matter which interface connector you connect to a base unit or a data unit e SCSI bus connection to the expansion unit robotics Connect the shared SCSI bus that will control the robotics to one of the SCSI connectors on the expansion unit with a 328215 00X BN21K or BN21L cable Terminate the SCSI bus with an HD68 terminator such as an H879 AA on the other expansion unit SCSI connector e SCSI bus connection to each of the base module tape drives Connect a shared SCSI bus to one of the DLT1 or DLT2 SCSI connectors on each of the base modules with 328215 00X BN21K or BN21L cables Terminate the other DLT1 or DLT2 SCSI bus connection with an HD68 terminator H879 AA You can daisy chain between DLT1 and DLT2 if present with a 0 3 meter SCSI bus jumper supplied with the TL881 or TL891 Terminate the SCSI bus at the tape drive on the end of the shared SCSI bus with an HD68 terminator H 879 AA Notes Do not connect a SCSI bus tothe SCSI connectors for the library connectors on the base modules We recommend that no more than two tape drives be on a SCSI bus Figure 8 19 shows a TL891 DLT MiniLibrary configuration with an ex
233. ee Section 3 6 1 2 2 Ensurethat the W1 jumper is removed to select wide addressing mode see Section 3 6 1 2 3 Install a BN37A cable between the DWZZH 05 controller port and the open trilink connector on HSZ70 controller A B or HSZ80 controller A Port 1 2 or controller B Port 1 2 When the KZPBA CB host bus adapters in each member system are installed connect each KZPBA CB toa DWZZH port with a BN38C or BN38D HD68 to VHDCI cable Ensure that the KZPBA CB SCSI ID matches the SCSI ID assigned to the DWZZH 05 port it is cabled to 12 13 14 and 15 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 19 Figure 3 5 shows a two member TruCluster Server configuration with a radially connected dual redundant HSZ70 RAID array controller configured for transparent failover Figure 3 5 Shared SCSI Bus with HSZ70 Configured for Transparent Failover Network Member Member System System 1 Memory 2 Channel Interface Memory Channel KZPBA CB ID 7 Memory Channel KZPBA CB ID 6 ZK 1599U Al Table 3 4 shows the components used to create the clusters shown in Figure 3 5 Figure 3 6 Figure 3 7 and Figure 3 8 3 20 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware Table 3 4 Hardware Components Used in Configuration Shown in Figure 3 5 Through Figure 3 8 Callout Number Description 1 BN38C cable 2 BN37A cable 3 H8861 AA
234. een two expansion ports E_Ports When an N_Port is connected to an F_Port the fabric is responsible for the assignment of the Fibre Channel address to the N_Port attached to the fabric The fabric is also responsible for selecting the route a frame will take within the fabric to be delivered to the destination When the fabric consists of multiple switches the fabric can determine an alternate route to ensure that a frame gets delivered to its destination Figure 6 2 shows an example fabric topology Using Fibre Channel Storage 6 7 Figure 6 2 Fabric Topology Transmit Transmit Receive Receive Transmit Transmit N Port F_Port F_Port T gt Receive Receive ZK 1536U AI 6 2 2 3 Arbitrated Loop Topology In an arbitrated loop topology frames are routed around a loop created by the links between the nodes In an arbitrated loop topology a node port is called an NL_Port node loop port and a fabric port is called an FL_Port fabric loop port Figure 6 3 shows an example arbitrated loop topology 6 8 Using Fibre Channel Storage Figure 6 3 Arbitrated Loop Topology Transmit NL_Port NL_Port Receive Transmit Receive NL_Port ZK 1535U Al Note The arbitrated loop topology is not supported by the Tru64 UNIX Version 5 1 or TruCluster Server Version 5 1 products When support for Fibre Channel arbitrated loop is announced in the TruCluster Server Software Product Des
235. efault window is displayed 8 9 Preparing the TL894 DLT Automated Tape Library for Shared SCSI Bus Usage The topics in this section provide information on preparing the TL894 DLT automated tape library for use on a shared SCSI bus in a TruCluster Server cluster 8 36 Configuring a Shared SCSI Bus for Tape Drive Use Note To achieve system performance capabilities we recommend placing no more than two TZ89 drives on a SCSI bus segment We also recommend that storage be placed on shared SCSI buses that do not have tape drives The TL894 midrange automated DLT library contains a robotics controller and four differential TZ89 tape drives The following sections describe how to prepare the TL894 in more detail 8 9 1 TL894 Robotic Controller Required Firmware Robotic firmware Version S2 20 is the minimum firmware revision supported in a TruCluster Server cluster For information on upgrading the robotic firmware see the Flash Download section of the TL81X TL894 Automated TapeLibrary for DLT Cartridges Diagnostic Software User s Manual 8 9 2 Setting TL894 Robotics Controller and Tape Drive SCSI IDs The robotics controller and each tape drive must have the SCSI ID set unless the default is sufficient Table 8 9 lists the default SCSI IDs Table 8 9 TL894 Default SCSI ID Settings SCSI Device SCSI Address Robotics Controller 0 Tape Drive 0 2 Tape Drive 1 3 Tape Drive 2 4 Tape Drive 3 5 To set the
236. ember system boot disks are on a shared SCSI bus they can be accessed by other systems on the shared SCSI bus for possible repair By placing the swap partition on a system s internal SCSI bus you reduce total traffic on the shared SCSI bus by an amount equal to the system s swap volume TruCluster Server Version 5 1 configurations require one or more disks to hold the Tru64 UNIX operating system The disk s are either private disk s on the system that will become the first cluster member or disk S on a shared bus that the system can access We recommend that you place the usr var member boot disks and quorum disk on a shared SCSI bus connected to all member systems After installation you have the option to reconfigure swap and can place the swap disks on an internal SCSI bus to increase performance See the TruCluster Server Cluster Administration manual for more information 1 5 2 Two Node Clusters Using UltraSCSI BA356 Storage Units with Increased Disk Configurations The configuration shown in Figure 1 3 isa minimal configuration with a lack of disk space for highly available applications Starting with Tru64 Introduction 1 9 1 10 UNIX Version 5 0 16 devices are supported on a SCSI bus Therefore multiple BA356 storage units can be used on the same SCSI bus to allow more devices on the same bus Figure 1 4 shows the configuration in Figure 1 3 with a second UltraSCSl BA356 storage unit that provides an additional
237. ements for the shared SCSI bus e Provides procedures for cabling TruCluster Server radial configurations using UltraSCSI hubs and Dual redundant HSZ70 or HSZ80 RAID array controllers enabled for simultaneous failover Dual redundant HSZ70 or HSZ80 RAID array controllers enabled for multiple bus failover e Provides diagrams of TruCluster Server storage configurations using UltraSCSI hardware configured for radial connections Note Although the UltraSCS I BA356 might have been included in this chapter with the other UltraSCSI devices it is not The UltraSCS BA356 is covered in Chapter 9 with the configurations using external termination It cannot be cabled directly to an UltraSCS I hub because it does not provide SCSI bus termination power termpwr In addition to using only supported hardware adhering to the requirements described in this chapter will ensure that your cluster operates correctly Chapter 9 contains additional information about using SCSI bus signal converters and also contains diagrams of TruCluster Server configurations using UltraSCSI and non UltraSCSI storage shelves and RAID array controllers The chapter also covers the older method of using external termination and covers radial configurations with the DWZZH UltraSCSl hubs and non UltraSCS I RAID array controllers Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 1 This chapter discusses the following topics Shared SCSI
238. emory Channel interconnect required for TruCluster Server The illustrations could represent multiple standalone systems by removing the Memory Channel This chapter discusses the following topics e A procedure for Tru64 UNIX Version 5 1 or TruCluster Server Version 5 1 installation using Fibre Channel disks Section 6 1 e Fibre Channel overview Section 6 2 e Examplecluster configurations using Fibre Channel storage Section 6 3 e A brief discussion of zoning and cascaded switches Section 6 4 Using Fibre Channel Storage 6 1 The steps necessary to install and configure the Fibre Channel hardware Section 6 5 The steps necessary to install the base operating system and cluster software using disks accessible over the Fibre Channel hardware Section 6 6 Changing the HSG80 from transparent to multiplebus failover mode Section 6 7 A discussion on how you can use the emx manager emxmgr to display the presence of Fibre Channel adapters target ID mappings for a Fibre Channel adapter and the current Fibre Channel topology Section 6 8 6 1 Procedure for Installation Using Fibre Channel Disks Use the following procedure to install Tru64 UNIX Version 5 1 and TruCluster Server Version 5 1 using Fibre Channel disks If you are only installing Tru64 UNIX Version 5 1 complete the first eight steps Complete all the steps for a TruCluster Server Version 5 1 installation See the Tru64 UNIX Installation Guide TruCluste
239. emote 7 3 7 9 initialize 6 25 6 48 6 50 6 55 6 57 installation 3 16 See also hardware configuration KGPSA 6 23 KZPSA 10 3 MC2 5 10 MC2 cables 5 9 Memory Channel 5 6 Memory Channel cables 5 7 Memory Channel hub 5 7 optical converter 5 6 optical converter cables 5 10 switch 6 16 internal cabling ESL9326D 8 76 TL893 8 52 TL896 8 52 J jumpers MC1 and MC1 5 CCMAA 5 2 MC2 CCMAB 5 4 MC2 CCMLB 5 5 Memory Channel 5 2 K KGPSA GLM 6 24 installing 6 23 mounting bracket 6 24 obtaining the worldwide name of 6 27 setting to run on fabric 6 24 KZPBA CB displaying device information 4 9t 10 5t 10 7t restrictions 2 9 termination resistors 4 9t 10 4t 10 7t use in duster 4 6 10 2 KZPSA BB displaying device information 10 5t 10 7t installation 10 3 restrictions 2 8 setting bus speed 10 17 setting SCSI ID 10 17 setting termination power 10 17 termination resistors 10 4t 10 7t updating firmware 10 18 use in duster 10 2 L LFU 10 18 booting 10 18 starting 10 18 updating firmware 10 18 link cable installation 5 7 Loadable Firmware Update utility SeeLFU Logical Storage Manager SeeLSM LSM mirroring across SCSI buses 1 11 mirroring clusterwide usr 1 11 mirroring clusterwide var 1 11 mirroring clusterwide data disks 1 11 MA6000 configuring 2 8 port configuration 2 8 transparent failover mode 2 8 unit configura
240. ems must be operational to achieve quorum and form a cluster If only one system is operational it will loop waiting for the second system to boot before a cluster can be formed If one system crashes you lose the cluster Figure 1 1 Two Node Cluster with Minimum Disk Configuration and No Quorum Disk Network Member Memory Channel Member System System 1 2 PCI SCSI PCI SCSI Adapter Adapter Shared SCSI Bus root swap root swap ZK 1587U AI Figure 1 2 shows the same generic two node cluster as shown in Figure 1 1 but with the addition of a quorum disk By adding a quorum disk a duster may be formed if both systems are operational or if either of the systems and the quorum disk is operational This cluster has a higher availability than the cluster shown in Figure 1 1 See the TruCluster Server Cluster Introduction 1 5 Administration manual for a discussion of how and when to use a quorum disk Figure 1 2 Generic Two Node Cluster with Minimum Disk Configuration and Quorum Disk Network Member Memory Channel Member System System 1 2 PCI SCSI PCI SCSI Adapter Adapter Shared SCSI Bus root root swap swap ZK 1588U Al 1 5 Growing a Cluster from Minimum Storage to a NSPOF Cluster The following sections take a progression of clusters from a cluster with minimum storage to a no single point of failure NSPOF cluster a cluster where one hardware failure will
241. ences on the two wires This transmission method is less susceptible to noise than single ended SCSI and enables you to use longer cables Devices with differential SCSI interfaces include the following KZPBA CB KZPSA BB HSZ40 HSZ50 HSZ70 and HSZ80 controllers Differential side of a SCSI signal converter or personality module You cannot use the two transmission methods in the same SCSI bus segment For example a device with a differential SCSI interface must be connected to another device with a differential SCSI interface If you want to connect devices that use different transmission methods use a SCSI signal converter between the devices The DS BA35X DA personality module is discussed in Section 9 1 2 2 See Section 9 1 for information about using the DWZZ series of SCSI signal converters 3 4 Shared SCSI Bus Requirements and Configurations Using UltraSCS I Hardware You cannot use a DWZZA or DWZZB signal converter at UltraSCSI speeds for TruCluster Server if there are any UltraSCSI disks on the bus because the DWZZA or DWZZB will not operate correctly at UltraSCSI speed The DS BA35X DA personality module contains a signal converter for the UltraSCSI BA356 It is the interface between the shared differential UltraSCSI bus and the UltraSCSI BA356 internal single ended SCSI bus RAID array controller subsystems provide the function of a signal converter accepting the differential input and driving the single ended device
242. ensate for a failed host bus adapter SCSI bus or RAID array controller and can if the rest of the cluster has necessary hardware provide a NSPOF configuration Note Each host cluster member system requires at least two KZPBA CB host bus adapters Although both the HSZ70 and HSZ80 have multiple bus failover it operates differently e HSZ70 Only one controller or shared SCSI bus is active for the units that are preferred assigned to it If all units are preferred to one controller then all units are accessed through one controller If a controller detects a problem all of its units are failed over to the other controller If the host detects a problem with the host bus adapter or SCSI bus the host initiates the failover to the other controller and SCSI bus e HSZ80 Both HSZ80 controllers can be active at the same time If the host detects a problem with a host bus adapter or SCSI bus the host initiates the failover to the other controller If a controller detects a problem all of its units are failed over to the other controller Also the HSZ80 has two ports on each controller If multiple bus failover mode is enabled the targets assigned to any one port are visible to all ports unless access to a unit is restricted toa particular port ona unit by unit basis To cable an HSZ70 or HSZ80 for multiple bus failover in a TruCluster Server configuration using DS DWZZH 03 or DS DWZZH 05 UltraSCSI hubs you need two hub
243. ential SCSI adapters for example KZPSA BB at fast SCSI speeds e Fast wide SCSI drives green StorageWorks building blocks SBBs with part numbers ending in VW may be used in an UltraSCSI BA356 shelf e Donot use fast narrow SCSI drives green SBBs with part numbers ending in VA in any shelf that could assign the drive a SCSI ID greater than 7 It will not work e TheUltraSCSI BA356 requires a 180 watt power supply BA35X HH It will not function properly with the older lower wattage BA35X HF universal 150 watt power supply see Chapter 9 e An older BA356 that has been retrofitted with a BA35X HH 180 watt power supply and DS BA35X DA personality module is still only FCC certified for F ast 10 configurations see Chapter 9 3 2 SCSI Bus Performance Before you set up a SCSI bus it is important that you understand a number of issues that affect the viability of a bus and how the devices connected to it operate Specifically bus performance is influenced by the following factors e Transmission method Section 3 2 2 e Data path Section 3 2 3 e Bus speed Section 3 2 4 3 2 1 SCSI Bus Versus SCSI Bus Segments An UltraSCSI bus may comprise multiple UltraSCSI bus segments Each UltraSCSI bus segment comprises electrical conductors that may bein a Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 3 cable or a backplane and cable or backplane connectors Each UltraSCSl bus segment must have a
244. er Supplied with the TL891 Terminate the SCSI bus at the tape drive on the end of the shared SCSI bus with an H879 AA terminator 8 30 Configuring a Shared SCSI Bus for Tape Drive Use Notes Do not connect a SCSI bus to the SCSI connectors for the library connectors on the base modules We recommend that no more than two TZ89 tape drives be on a SCSI bus Figure 8 11 shows a MiniLibrary configuration with two TL892 DLT MiniLibraries and a TL890 DLT MiniLibrary expansion unit The TL890 library robotics is on one shared SCSI bus and the two TZ89 tape drives in each TL892 are on separate shared SCSI buses Note that the pass through mechanism and cable tothe library robotics motor is not shown in this figure Configuring a Shared SCSI Bus for Tape Drive Use 8 31 Figure 8 11 TL890 and TL892 DLT MiniLibraries on Shared SCSI Buses Network Member System 1 Memory Channel Int mO reroror _ erface KZPBA CB ID 6 Member System 2 Memory Channel KZPBA CB ID 7 G eraco HO KZPBA CB ID 6 KZPBA CB ID 6 KZPBA CB ID 7 Diag Motor oO oO SCSI p f TL890 Expansion Modules y Library Robotics Robotics a nag Control I l j 1 cables 0 3M SCSI Bus TL892 jumper Library Robotics DLT1DLT2 TES E Expansion lt Unit Interface TL892 ZK 1763U Al Table 8 8 shows the comp
245. erface Converter modules GBICs in the DSGGA DSGGB or DSGGC Fibre Channel switch or one of the seven fixed shortwave optical transceivers in the DS DSGGC AA 6 5 2 2 Setting the KGPSA BC or KGPSA CA to Run on a Fabric The KGPSA host bus adapter defaults to the fabric mode and can be used in a fabric without taking any action However if you install a KGPSA that has been used in the loop mode on another system you will need to reformat the KGPSA nonvolatile RAM NVRAM and configure it to run on a Fibre Channel fabric configuration Use the wwidmgr utility to determine the mode of operation of the KGPSA host bus adapter and to set the mode if it needs changing for example from loop to fabric Notes You must set the console to diagnostic mode to use the wwidmgr utility for the following AlphaServer systems AS1200 AS4x00 6 24 Using Fibre Channel Storage AS8x00 GS60 GS60E and GS140 Set the console to diagnostic mode as follows P00 gt gt gt set mode diag Console is in diagnostic mode P00 gt gt gt The console remains in wwid manager mode or diagnostic mode for the AS1200 AS4x00 AS8x00 GS60 GS60E and GS140 systems and you cannot boot until the system is re initialized Usethe init command or a system reset to re initialize the system after you have completed using the wwid manager If you try to boot the system and receive the following error initialize the console to get out of WWI D manager mode then
246. erter The DWZZB VW is more commonly used Verify signal converter termination as follows e Ensurethat the DWZZB W1 and W2 jumpers are installed to enable the single ended termination at one end of the bus The other end of the BA356 single ended SCSI bus is terminated on the personality module e Remove the termination from the differential side of the DWZZB by removing the five 14 pin differential terminator resistor SIPs The differential SCSI bus will be terminated external tothe DWZZB 2 Attach an H885 AA trilink connector to the DWZZB 68 pin high density connector 3 Set the switches on the BA356 personality module as follows e If the BA356 is to house disks with SCSI IDs in the range of 0 through 6 set the BA356 personality module address switches 1 through 7 to off e If the BA356 is to house disks with SCSI IDs in the range of 8 through 14 set BA356 personality module address switches 1 through 3 toon and switches 4 through 7 to off If you are using a DWZZB AA do not replace the personality module until you attach the cable in the next step 4 Ifyou are using a DWZZB AA signal converter use a BN21K 01 1 meter or BN 21L 01 1 meter cable to connect the single ended side of the DWZZB AA to the BA356 input connector J Al on the personality module Connector J Al is on the left side of the personality module as you face the front of the BA356 and is hidden from normal view This connection forms a single ended bus
247. erters A SCSI bus signal converter allows you to couple a differential bus segment to a single ended bus segment allowing the mixing of differential and single ended devices on the same SCSI bus to isolate bus segments for maintenance purposes Each SCSI signal converter has a single ended side and a differential side as follows e DWZZA 8 bit data path e DW2ZZB 16 bit data path e DS BA35X DA 16 bit personality module Note Some UltraSCSI documentation uses the UltraSCSI bus expander term when referring tothe DWZZB and UltraSCSI signal converters Other UltraSCSI documentation refers to some UltraSCSI products as bus extender converters For TruCluster Server there are no supported standalone UltraSCSI bus expanders DWZZC In this manual any device that converts a differential signal to a single ended signal is referred to as a signal converter the DS BA35X DA personality module contains a DWZZA on a chip or DOC chip A SCSI signal converter is required when you want to connect devices with different transmission modes 9 1 1 Types of SCSI Bus Signal Converters Signal converters can be standalone units or StorageWorks building blocks SBBs that are installed in a storage shelf disk slot You must use the signal converter module that is appropriate for your hardware configuration For example use a DWZZA VA signal converter to connect a wide differential host bus adapter to a BA350 single ended and narrow
248. es e Oneor moredisks to hold the Tru64 UNIX operating system The disk s are either private disk s on the system that will become the first cluster member or disk s on a shared bus that the system can access e Oneor more disks on a shared SCSI bus to hold the clusterwide root usr and var AdvFS file systems e Onedisk per member normally on a shared SCSI bus to hold member boot partitions e Optionally onedisk on a shared SCSI bus to act as the quorum disk See Section 1 3 1 4 and for a more detailed discussion of the quorum disk see the TruCluster Server Cluster Administration manual The following sections provide more information about these disks Figure 1 1 shows a generic two member cluster with the required file systems 1 3 1 1 Tru64 UNIX Operating System Disk 1 2 The Tru64 UNIX operating system is installed using AdvF S file systems on one or more disks on the system that will become the first cluster member For example dsk0a root_domain root dsk0g usr _domain usr dsk0h var_domain var The operating system disk Tru64 UNIX disk cannot be used as a clusterwide disk a member boot disk or as the quorum disk Introduction Because the Tru64 UNIX operating system will be available on the first cluster member in an emergency after shutting down the cluster you have the option of booting the Tru64 UNIX operating system and attempting to fix the problem See the TruCluster Server Cluster Administrati
249. es 9 9 terminators 2 14 trilink connectors 2 14 hardware configuration bus termination 3 7 9 5 disk devices 3 16 9 14 hardware requirements for 2 1 hardware restrictions for 2 1 requirements 3 1 9 1 SCSI bus adapters 2 5 SCSI bus speed 3 5 SCSI cables 2 12 SCSI signal converters 9 2 storage shelves 3 16 9 14 supported cables 2 1 supported terminators 2 1 supported trilinks 2 1 supported Y cables 2 1 terminators 2 14 trilink connectors 2 14 hierarchical switch power manager SeeHPM host bus adapters Index 5 See KGPSA KZPBA CB KZPSA BB HPM 7 5 HSG60 controller 1 13 ACS 2 5 configuring 2 8 port configuration 2 8 transparent failover mode 2 8 unit configuration 2 8 HSG80 controller 1 13 ACS 2 5 changing failover modes 6 59 configuring 2 8 6 28 multiple bus failover 6 30 obtaining the worldwide name of 6 33 port configuration 2 8 port_n_topology 6 30 replacing 6 34 resetting offsets 6 59 setting controller values 6 28 6 29 transparent failover mode 2 8 unit configuration 2 8 HSZ failover multiple bus 1 14 transparent 1 13 HSZ20 controller and shared SCSI bus 9 24 HSZ40 controller 1 13 and shared SCSI bus 9 24 HSZ50 controller 1 13 and shared SCSI bus 9 24 HSZ70 controller 1 13 and fast wide differential SCSI 3 3 HSZ80 controller 1 13 hwmgr 6 51 1 O buses number of 2 5 I O risers Index 6 cables 7 3 7 9 local 7 3 7 9 r
250. es cable lengths and interference with disks e A non UltraSCSI BA356 that has been upgraded to the 180 watt power supply with the DS BA35X HH option An UltraSCSI hub only receives power and mechanical support from the storage shelf There is no SCSI bus continuity between the DWZZH and storage shelf TruCluster Server System Configuration Using UltraSCSI Hardware 4 7 The DWZZH contains a differential to single ended signal converter for each hub port Sometimes referred to as a DWZZA on a chip or DOC chip The single ended sides are connected together to form an internal single ended SCSI bus segment Each differential SCSI bus port is terminated internal to the DWZZH with terminators that cannot be disabled or removed Power for the DWZZH termination termpwr is supplied by the host SCSI bus adapter or RAID array controller connected tothe DWZZH port If the member system or RAID array controller is powered down or the cable is removed from the KZPBA CB RAID array controller or hub port the loss of termpwr disables the hub port without affecting the remaining hub ports or SCSI bus segments This is similar to removing a Y cable when using external termination Note The UltraSCS I BA356 DS BA35X DA personality module does not generate termpwr Therefore you cannot connect an UltraSCSl BA356 directly toa DWZZH hub The use of the UltraSCSI BA356 in a TruCluster Server cluster is discussed in Chapter 9 The other end of the
251. es is used to display power on self test POST status display messages and to set up MiniLibrary functions When power is first applied toa MiniLibrary a series of POST diagnostics are performed During POST execution the MiniLibrary model number current date and time firmware revision and the status of each test is displayed on the control panel After the POST diagnostics have completed the default screen is shown DLTO Idle DLT1 Idle Loader Idle 0 gt lt 9 Configuring a Shared SCSI Bus for Tape Drive Use 8 23 The first and second lines of the default screen show the status of the two drives if present The third line shows the status of the library robotics and the fourth line is a map of the magazine with the numbers from 0 to 9 representing the cartridge slots Rectangles present on this line indicate cartridges present in the corresponding slot of the magazine For example this fourth line o gt x x lt 9 where X represents rectangles indicates that cartridges are installed in slots 0 and 1 Note There are no switches for setting a mechanical SCSI ID for the tape drives The SCSI IDs default to 5 The MiniLibrary sets the electronic SCSI ID very quickly before any device can probe the MiniLibrary so the lack of a mechanical SCSI ID does not cause any problems on the SCSI bus To set the SCSI ID follow these steps 1 Fromthe Default Screen press the Enter button to enter the Menu
252. ess the down arrow button to change the alternate configuration from the default Standalone to Slave Press the Enter button 7 After the selection stops flashing and the control panel indicates that the change is not effective until a reboot press the Enter button 8 When the Special Configuration menu reappears turn the power switch off and then on to cycle the power The base module is now reconfigured as a Slave to the TL890 expansion unit 9 Repeat the steps for each TL891 TL892 base module present that is to be a slave to the TL890 expansion unit 8 8 2 3 Powering Up the DLT MiniLibrary When turning on power tothe DLT MiniLibrary power must be applied to the TL890 expansion unit simultaneously or after power is applied to the the TL891 TL 892 base modules If the expansion unit is powered on first its 8 34 Configuring a Shared SCSI Bus for Tape Drive Use inventory of modules may be incorrect and the contents of some or all of the modules will be inaccessible to the system and to the host When the expansion unit comes up it will communicate with each base module through the expansion unit interface and inventory the number of base modules tape drives and cartridges present in each base module After the MiniLibrary configuration has been determined the expansion unit will communicate with each base module and indicate to the base module which cartridge group that base module contains The cartridges slots are numbered
253. ess the storage units controller B port 2 Clear the wwidn and Nn environment variables P00 gt gt gt wwidmgr clear all Initialize the console POO gt gt gt init Use the wwid manager with the quickset option to set up the device and port path information for the storage units from where each system will need to boot Each system may need to boot from the base operating system disk Each system will need to boot from its member system boot disk Using the storage units from the example cluster member 1 will need access to the storage units with UDI Ds 131 member 1 boot disk and 133 Tru64 UNIX disk Cluster member 2 will need access to the storage units with UDIDs 132 member 2 boot disk and 133 Tru64 UNIX disk Set up the device and port path for cluster member 1 as follows P00 gt gt gt wwidmgr quickset udid 131 POO gt gt gt wwidmgr quickset udid 133 Initialize the console POO gt gt gt init Verify that the storage units and port path information is set up and then reinitialize the console The following example shows the information for cluster member 1 P00 gt gt gt wwidmgr show ev wwido 133 1 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002e wwid1 131 1 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002f Using Fibre Channel Storage 6 61 N1 50001fe100000d64 N2 50001fe100000d62 N3 50001fe100000d63 N4 50001fe100000d61 POO gt gt gt init h Set the bootdef_dev console environ
254. evice unit number Therefore you set a device unit number that is an alias for the Fibre Channel worldwide name Section 6 6 1 3 e Display available Fibre Channel boot devices When you set the device unit number you also set the wwidn and Nn console environment variables These variables indicate which Fibre channel devices the console can access and which HSG80 ports can be used to access the devices The wwidn variables also show which devices are displayed by the show dev console command indicating that the devices can be used for booting or dumping Section 6 6 1 4 e Set the bootdef dev console environment variable Before you install the operating system or cluster software you must set the bootdef_dev console environment variable to ensure that you boot from the correct disk over a reachable path Section 6 6 1 5 e Install the Tru64 UNIX operating system Section 6 6 2 e Determine the dev disk dskn value to use for cluster disks Section 6 6 3 e Label the disks to be used to create the cluster Section 6 6 4 e Install TruCluster Server software and create the first cluster member Section 6 6 5 Using Fibre Channel Storage 6 35 e Reset the bootdef_dev console environment variable to provide multiple boot paths Section 6 6 6 e Add additional systems to the cluster Section 6 6 7 If you are installing the Tru64 UNIX operating system or TruCluster Server software follow the procedure in Chapter 1
255. f Off 7 On On On Off Off Off a SBB tape drive SCSI ID is determined by the SBB physical slot 8 1 2 Cabling the TZ88N VA There are no special cabling restrictions specific to the TZ88N VA it is installed in a BA350 StorageWorks enclosure A DWZZA VA installed in slot 0 of the BA350 provides the connection to the shared SCSI bus The tape drive takes up three slots You must remove the DWZZA VA differential terminators Ensure that DWZZA VA jumper J 2 is installed to enable the single ended termination The BA350 jumper and terminator must be installed A trilink connector on the DWZZA VA differential end allows connection to the shared bus An H879 AA terminator is installed on the trilink for the BA350 on the end of the bus to provide shared SCSI bus termination Configuring a Shared SCSI Bus for Tape Drive Use 8 3 Figure 8 2 shows a TruCluster Server cluster with three shared SCSI buses One shared bus has a BA350 with a TZ88N VA at SCSI ID 3 Figure 8 2 Shared SCSI Buses with SBB Tape Drives Network Memor y Member System 1 Channel Member System 2 Interface KZPBA CB ID 6 KZPBA CB ID 6 Ba350 ZK 1761U Al Table 8 2 shows the components used to create the cluster shown in Figure 8 2 Table 8 2 Hardware Components Used to Create the Configuration Shown in Figure 8 2 Callout Number Description 1 BN38C or BN38D cable 2 BN37A cable 3
256. fe1 0000 0d62 Yes dga133 1003 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d63 No dga133 1004 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d6 Yes dgb133 1001 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d64 No dgb133 1002 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d62 Yes dgb133 1003 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d63 No dgb133 1004 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d6 Yes 6000 1fe1 0000 0d60 0009 8080 0434 002 via adapter via fc nport connected dgal13 001 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d64 No dgal13 002 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d62 Yes dgal13 akote Di pau DR pga0 0 0 1 0 5000 1fe1 0000 0d63 No dga13 004 0 1 0 pga0 0 0 1 0 5000 1fe1 0000 0d6 Yes dgb13 001 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d64 No dgb13 002 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d62 Yes dgb131 1003 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d63 No dgb131 1004 0 2 0 pgb0 0 0 2 0 5000 1fe1 0000 0d6 Yes P00 gt gt gt init Notes Thewwidmgr quickset command can take up toa minute to complete on the AlphaServer 8x00 GS60 GS60E and GS140 systems You must reinitialize the console after running the WWID manager wwidmgr and keep in mind that the AS1200 AS4x00 AS8x00 GS60 GS60E and GS140 console is in diagnostic mode Using Fibre Channel Storage 6 47 The disks are not reachable and you cannot boot until after the system is initialized If you have not set the UDID you cannot set the device unit number as shown in Example 6 5 You have to use the quickset command with
257. fferential connection from the host adapters to both BA356s in parallel The switches on the personality module of one BA356 are set for SCSI IDs 0 through 7 and the switches on the personality module of the other BA356 are set for SCSI IDs 8 through 14 Note Do not install a narrow disk in a BA356 that is enabled for SCSI IDs 8 through 14 The SCSI bus will not operate correctly because the narrow disks cannot recognize wide addresses Likethe BA350 you can set up the BA356 for two bus operation by installing a SCSI bus terminator BA35X ME in place of the SCSI bus jumper However like the BA350 two bus operation in the BA356 is not very useful for a TruCluster Server cluster You can use the position behind slot 1 in the BA356 to store the SCSI bus terminator or jumper Figure 9 7 shows the relative locations of the BA356 SCSI bus jumper and the position for storing the SCSI bus jumper if you do install the terminator For operation within a TruCluster Server cluster you must install the J jumper Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 11 Figure 9 7 BA356 Internal SCSI Bus ZK 1339U Al Note that J Al and J B1 are located on the personality module in the top of the box when it is standing vertically J B1 on the front of the module is visible J Al is on the left side of the personality module as you face the front of the BA356 and is hidden from the normal view
258. ge differential LVD disk drives For moreinformation on configuring the MA8000 EMA12000 see the Compaq StorageWorks Modular Array Configuration Guide Only disk devices attached to the HSG60 or HSG80 Fibre Channel array controller are supported with the TruCluster Server product No tape devices are supported behind an HSG60 or HSG80 RAID array controller The only supported Fibre Channel adapters are the KGPSA BC and KGPSA CA PClI to Fibre Channel host bus adapters The KGPSA BC CA PCl to Fibre Channel adapters are only supported on the DWLPB PCIA option they are not supported on the DWLPA A host is only allowed to have one KGPSA connected to each switch or switch zone The only Fibre Channel switches supported are the DS DSGGA AA AB 8 16 port DS DSGGB AA AB 8 16 port or DS DSGGC AA 8 port Fibre Channel switches The DSGGA and DSGGB Fibre Channel switches support both shortwave GBIC SW and longwave GBIC LW GigaBit Interface Converter GBIC modules Seven of the eight DSGGC ports are fixed shortwave optical transceivers Only one DSGGC port is configured as a removable GBIC It may be shortwave or longwave The GBIC SW module supports 50 micron multimode fiber cables with the standard subscriber connector SC connector in lengths up to 500 meters The GBIC LW supports 9 micron single mode fiber cables with the SC connector in lengths up to 10 kilometers The KGPSA BC CA PClI to Fibre Channel host bus adapters and
259. gnated as a backup to the master e CPUn SROM Each CPU module has SROM firmware that is executed as part of the power up sequence e XROM Each CPU executes this extended SROM firmware on the PSM module after executing the SROM firmware 3 The revision of the firmware and compilation date 4 Therevision of the fail safe loader F SL firmware Each microprocessor on the CSB has both a normal firmware image in its flash ROM anda fail safe loader image in a backup ROM The fail safe loader firmware is executed when the system is reset It performs a checksum on the normal firmware image and then passes control to the normal firmware image 5 The state of power for each CPU I O riser and each node on the CSB 6 The srvsw field indicates that power is normal NORMAL or that the QBB power is off and can be serviced SERVICE The Ineligible field for the slave SCM indicates that the SCM is not a backup to the master SCM 7 5 Updating GS80 160 320 Firmware Occasionally you must update the AlphaServer GS80 160 320 or PCI host bus adapter firmware To determine the need for a firmware update you compare the current firmware versions with the versions available on the latest AlphaServer firmware update CD ROM The firmware release notes for the system provide a list of current firmware versions See Section 4 2 for two methods of obtaining the firmware release notes The following section pro
260. h StorageWorks building block SBB e Can be installed in A StorageWorks UltraSCS I BA356 storage shelf which has the required 180 watt power supply Thelower righthand device slot of the BA370 shelf within the RA7000 or ESA 10000 RAID array subsystems This position minimizes cable lengths and interference with disks A non UltraSCS BA356 which has been upgraded to the 180 watt power supply with the DS BA35X HH option e Uses the storage shelf only to provide its power and mechanical support it is not connected to the shelf internal SCSI bus e Has three Very High Density Cable Interconnect VH DCI differential SCSI bus connectors e Does not usea SCSI ID e DS DWZZH 03 and DS DWZZH 05 UltraSCS I hubs may be housed in the same storage shelf with disk drives Table 3 3 provides the supported configurations Figure 3 2 shows a front view of the DS DWZZH 03 UltraSCSI hub Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 9 Figure 3 2 DS DWZZH 03 Front View Differential symbol ZK 1412U Al The differential symbol and the lack of a single ended symbol indicates that all three connectors are differential 3 6 1 2 DS DWZZH 05 Description The DS DWZZH 05 e 1s a5 25 inch StorageWorks building block SBB e Has five Very High Density Cable Interconnect VH DCI differential SCSI bus connectors e Uses SCSI ID 7 whether or not fair arbitration mode is enable
261. hared bus without connecting the Y cable or trilink connector toa device If you do this you can connect a device tothe Y cable or trilink 9 6 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices connector at a later time without affecting bus termination This allows you to expand your configuration without shutting down the cluster Figure 9 4 shows a BN21W 0B Y cable which you may attach toa KZPSA BB or KZPBA CB SCSI adapter that has had its onboard termination removed You can also use the BN21W OB Y cable with a HSZ40 or HSZ50 controller or the unterminated differential side of a SCSI signal converter Note You will normally usea Y cable on a KZPSA BB or KZPBA CB host bus adapter where there is not room for an H885 AA trilink and a trilink connector elsewhere Figure 9 4 BN21W 0B Y Cable Figure 9 5 shows an HD68 trilink connector H885 AA which you may attach toa KZPSA BB or KZPBA CB adapter that has its onboard termination removed an HSZ40 or HSZ50 controller or the unterminated differential side of a SCSI signal converter Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 7 Figure 9 5 HD68 Trilink Connector H885 AA REAR VIEW FRONT VIEW ZK 1140U Al Note If you connect a trilink connector toa SCSI bus adapter you may block access to an adjacent PCI slot If this occurs usea Y cable instead of the trilink connector
262. he device unit number Select the disk you have chosen as the Tru64 UNIX operating system installation disk from the list of disks provided Section 6 6 2 After the new kernel has booted to multi user mode complete the operating system installation Determine the dev disk dskn values to be used for cluster installation Section 6 6 3 Use the disklabel utility to label the disks used to create the cluster Section 6 6 4 See the TruCluster Server Software Installation manual and install the TruCluster Server software subsets then run the clu_create utility to create the first cluster member Do not allow clu_create to boot the system Shut down the system to the console prompt Section 6 6 5 Reset the bootdef_dev console environment variable to provide multiple boot paths to the cluster member boot disk Section 6 6 6 Boot the first cluster member See the TruCluster Server Software Installation manual and add subsequent cluster member systems Section 6 6 7 As with the first cluster member you will have to e Use the wwidmgr command to set the device unit number for the member system boot disk e Set thebootdef dev environment variable e Reset the bootdef_dev environment variable after building a kernel on the new cluster member system Consult the following documentation to assist you in Fibre Channel storage configuration and administration KGPSA BC PCl to Optical Fibre Channa Host Adapter User Guide 64 Bit PC
263. he slot near the bottom of the endplate Remove the cable tip protectors and insert the connectors into the transceiver until they click into place Secure the cable to the module using the tie wrap 6 Install the CCMFB fiber optics converter in slot opto only 0 opto 1 opto 2 opto or 3 opto as appropriate 7 Install a BN39B 01 1 meter link cable between the CCMFB optical converter and the CCMLB linecard 8 Repeat steps 1 through 7 for each CCMFB module to be install ed 5 6 Running Memory Channel Diagnostics After the Memory Channel adapters hubs link cables fiber optics converters and fiber optics cables have been installed power up the systems and run the Memory Channel diagnostics Setting Up the Memory Channel Cluster Interconnect 5 11 There are two console level Memory Channel diagnostics mc_diag and mc_cable e Themc_diag diagnostic Tests the Memory Channel adapter s on the system running the diagnostic Runs as part of the initialization sequence when the system is powered up Runs on a standalone system or while connected to another system or a hub with the link cable e Themc_cable diagnostic Must berun on all systems in the cluster simultaneously therefore all systems must be at the console prompt Caution If you attempt to run mc_cable on one cluster member while other members of the cluster are up you may crash the duster Is designed to isolate problems to the Memory Channel adapte
264. heir disk data from any member in the cluster e Likethe TruCluster Production Server Software product TruCluster Server lets you run components of distributed applications in parallel providing high availability while taking advantage of cluster specific synchronization mechanisms and performance optimizations TruCluster Server augments the feature set of its predecessors by allowing all cluster members access to all file systems and all storage in the cluster regardless of where they reside From the viewpoint of clients a TruCluster Server cluster appears to be a single system from the viewpoint of a system administrator a TruCluster Server cluster is managed as if it were a single system Because TruCluster Server has no built in dependencies on the architectures or protocols of its private cluster interconnect or shared storage Introduction 1 1 interconnect you can more easily alter or expand your cluster s hardware configuration as newer and faster technologies become available 1 2 Memory Requirements Cluster members require a minimum of 128 MB of memory 1 3 Minimum Disk Requirements This section provides an overview of the minimum file system or disk requirements for a two node cluster For more information on the amount of space required for each required cluster file system see the TruCluster Server Software Installation manual 1 3 1 Disks Needed for Installation You need to allocate disks for the following us
265. high capacity 176 cartridge tape library providing up to 12 3 TB of storage The TL896 uses six fast wide differential TZ89N AV DLT tape drives It alsohas a maximum transfer rate of almost 10 MB per second per drive compressed or a total of about 60 MB per second The TL896 comes configured for six SCSI 2 buses a six bus configuration The SCSI bus connector is also high density 68 pin differential Both the TL893 and TL896 can be extended by adding additional cabinets DS TL893 AC for the TL893 or DS TL896 AC for the TL896 See the TL82X Cabine to Cabine Mounting Instructions manual for information on adding additional cabinets Up to five cabinets are supported with the TruCluster Server For TruCluster Server the tape cartridges in all the cabinets are combined into one logical unit with consecutive numbering from the first cabinet to the last cabinet by an upgrade from the multi unit multi LUN MUML configuration to a multi unit singl eLUN MUSL configuration See the TL82X TL89X MUML to MUSL Upgrade Instructions manual for information on the firmware upgrade Configuring a Shared SCSI Bus for Tape Drive Use 8 49 These tape libraries each have a multi unit controller MUC that serves two functions e Itisa SCSI adapter that allows the SCSI interface to control communications between the host and the tape library e t permits the host to control up to five attached library units in a multi unit configuration Mult
266. hrough 11 to set or change all other tape drive SCSI IDs Press and release the up or down button to clear the resulting display from the command Press and release the up or down button and the SELECT button simultaneously and verify that System On line or System Off line is displayed in the SDA 8 9 3 TL894 Tape Library Internal Cabling The default internal cabling configuration for the TL 894 tape library has the robotics controller and top drive drive 0 on SCSI bus port 1 Drive 1 is on SCSI bus port 2 drive 2 is on SCSI port 3 and drive 3 is on SCSI bus port 4 A terminator part number 0415619 is connected to each of the drives to provide termination at that end of the SCSI bus This configuration called the four bus configuration is shown in Figure 8 12 In this configuration each of the tape drives except SCSI bus drive 0 and the robotics controller requires a SCSI address on a separate SCSI bus The robotics controller and drive 0 use two SCSI IDs on their SCSI bus Configuring a Shared SCSI Bus for Tape Drive Use 8 39 Figure 8 12 TL894 Tape Library Four Bus Configuration Robotics Controller SCSI Address 0 C Tape Drive Pa Interface PWA Internal SCSI Termination 1 SCSI Cable 1 5m Tape Drive 0 SCSI Address 2 Tape Drive 1 SCSI Address 3 Tape Drive 2 SCSI Address 4 Tape Drive 3 SCSI Address 5 Indicates the default SCSI ID of the installed devices Rear Panel Host
267. i unit configurations are not discussed in this manual For moreinformation on multi unit configurations see the TL82X TL893 TL896 Automated Tape Library for DLT Cartridges Facilities Planning and Installation Guide The following sections describe how to prepare these tape libraries in more detail 8 11 1 Communications with the Host Computer Two types of communications are possible between the tape library and the host computer SCSI and EIA TIA 574 serial RS 232 for nine pin connectors Either method when used with the multi unit controller MUC allows a single host computer to control up to five units A TruCluster Server cluster supports SCSI communications only between the host computer and the MUC With SCSI communications both control signals and data flow between the host computer and tape library use the same SCSI cable The SCSI cable is part of the shared SCSI bus An RS 232 loopback cable must be connected between the Unit 0 and Input nine pin connectors on the rear connector panel The loopback cable connects the MUC to the robotic controller electronics Switch 7 on the MUC switch pack must be down to select the SCSI bus 8 11 2 MUC Switch Functions Switch pack 1 on the rear of the multi unit controller MUC is located below the MUC SCSI connectors The switches provide the functions shown in Table 8 12 Table 8 12 MUC Switch Functions Switch Function 1 2 and 3 MUC SCSI ID if Switch 7 is down
268. in the correct mode FABRIC or LOOP Connect the KGPSA to the switch See Chapter 6 e Memory Channel adapters Ensure that jumpers are set correctly see Chapter 5 Connect the Memory Channel adapters to each other or to the Memory Channel hub as appropriate See Chapter 5 Turn on the Memory Channel hubs and storage shelves then turn on the member systems Install the firmware set SCSI IDs and enable fast bus speed as necessary See Chapter 4 and Chapter 10 Display configuration information for each member system and ensure that all shared disks are seen at the same device number see Chapter 4 Chapter 6 or Chapter 10 Introduction 1 17 2 Hardware Requirements and Restrictions This chapter describes the hardware requirements and restrictions for a TruCluster Server cluster It includes lists of supported cables trilink connectors Y cables and terminators For the latest information about supported hardware see the AlphaServer options list for your system at the following URL http www compaq com alphaserver products options html 2 1 TruCluster Server Member System Requirements The requirements for member systems in a TruCluster Server cluster are as follows Each supported member system requires a minimum firmware revision See the Release Notes Overview supplied with the Alpha Systems Firmware Update CD ROM You can also obtain firmware information from the Web at the following URL http
269. ion best meets your needs see the Tru64 UNIX Documentation Overview which describes the structure and organization of the Tru64 UNIX documentation and provides brief overviews of each document The following table provides the order numbers for the Tru64 UNIX operating system documentation kits For additional information about ordering this and related documentation see the Documentation Overview or contact Compaq Name Order Number Tru64 UNIX Documentation CD ROM QA 6ADAA G8 Tru64 UNIX Documentation Kit QA 6ADAA GZ End User Documentation Kit QA 6ADAB GZ Startup Documentation Kit QA 6ADAC GZ General User Documentation Kit QA 6ADAD GZ System and Network Management Documentation K it QA 6ADAE GZ Developer s Documentation Kit QA 6ADAF GZ Reference Pages Documentation Kit QA 6ADAG GZ TruCluster Server Documentation Kit QA 6BRAA GZ Reader s Comments TruCluster Server Hardware Configuration AA RHGWC TE Compaq welcomes your comments and suggestions on this manual Your input will help us to write documentation that meets your needs Please send your suggestions using one of the following methods e This postage paid form e Internet electronic mail readers_comment zk3 dec com e Fax 603 884 0120 Attn UBPG Publications ZK 03 3 Y 32 If you are not using this form please be sure you include the name of the document the page number and the product name and version Please rate this manual Excellent Good Fair Poor
270. ion or Radial Connections to Non UltraSCSI Devices Attach the trilink with the terminator to the controller that you want to be on the end of the shared SCSI bus Attach an H885 AA trilink connector to the other controller Install a BN21K or BN21L cable between the H885 AA trilink connectors on the two controllers The BN21L 0B is a 0 15 meter cable If you are using a DS DWZZH 05 e Verify that the fair arbitration switch is in the Fair position to enable fair arbitration see Section 3 6 1 2 2 e Ensure that the W1 jumper is removed to select wide addressing mode see Section 3 6 1 2 3 Install the UltraSCS hub in e A StorageWorks UltraSCSI BA356 shelf which has the required 180 watt power supply e A non UltraSCS BA356 which has been upgraded to the 180 watt power supply with the DS BA35X HH option If you are using a e DS DWZZH 03 Install a BN38C or BN38D HD toVHDCI cable between any DS DWZZH 03 port and the open connector on the H 885 AA trilink connector on the RAID array controller e DS DWZZH 05 Install a BN38C or BN38D cable between the DW2ZZH 05 controller port and the open trilink connector on HSZ40 or HSZ50 controller Note Ensure that the HSZ40 or HSZ50 SCSI IDs match the DS DWZZH 05 controller port IDs SCSI IDs 0 6 When the host bus adapters K ZPSA BB or KZPBA CB have been installed in the member systems for a e DS DWZZH 03 Install a BN38C or BN38D HD68 to VHDCI cable between
271. ironment variable is set control is passed to the SRM firmware automatically at the end of the power up sequence 12 Obtain a copy of the latest firmware release notes for the AlphaServer system See Section 7 5 Compare the present firmware revisions see Example 7 4 with the required revisions that are indicated in the release notes Update the firmware if necessary see Section 7 5 Note that the SRM console firmware includes the SP 1020 1040 based PCI option firmware which includes the KZPBA CB When you update the SRM console firmware you are enabling the K ZPBA CB firmware to be updated On a power up reset the SRM console loads PCI option firmware from the console system flash ROM into NVRAM for all Qlogic SP1020 1040 based PCI options including the KZPBA CB PCl to Ultra SCSI adapter 13 At theterminal emulator for each partition access the SRM console firmware and complete each of the following as necessary a If applicable set the KZPBA CB SCSI IDs and ensure that you have access to all the shared storage b Run the Memory Channel diagnostics mc_diag andmc_ cable to verify that the Memory Channel adapters are operational Section 5 6 c Install the Tru64 UNIX operating system see the Tru64 UNIX Installation Guide d Install the TruCluster Server software see the TruCluster Server Software Installation manual 14 If you are using Fibre Channel storage follow the procedures in Chapter 6 Using Fibre Cha
272. is 14 The Model 4214R and Model 4254 disk enclosures support only the new Compaq hot pluggable wide UltraSCSI low voltage differential LVD disk drives e The StorageWorks Modular Array 8000 MA8000 and Enterprise Modular Array 12000 EMA12000 are also built with the new StorageWorks packaging which consists of A Compaq StorageWorks enclosure Model 2200 which houses dual redundant HSG80 controllers The14 bay drive shelves Compaq StorageWorks enclosure M odel 4200 The Model 2200 enclosure with HSG80 controllers support six SCSI buses which may be Six drive shelves Model 4214R with up to 12 disk drives each The drive shelves use single bus mode one SCSI bus per drive shelf Three drive shelves Model 4254 with up to 14 disk drives per drive shelf The Model 4254 drive shelf uses dual bus mode two SCSI buses each with 7 disk drives Notes The Model 4124R disk enclosure is a single bus enclosure that has slots for 14 drives but only 12 drives are supported at the present time The maximum number of drives behind an HSG80 single or dual redundant pair using six single bus Model 4214R disk enclosures is 72 2 6 Hardware Requirements and Restrictions The maximum number of drives behind an HSG80 single or dual redundant pair using three dual bus Model 4254 disk enclosures is 42 The Model 4214R and Model 4254 disk enclosures support only the new Compaq hot pluggable wide UltraSCSI low volta
273. is the highest priority and 8 is the lowest priority When assigning SCSI IDs use the highest priority ID for member systems starting at 7 Use lower priority IDs for disks Note that you will not follow this general rule when using the DS DWZZH 05 UltraSCSI hub with fair arbitration enabled The SCSI ID for a disk in a BA350 storage shelf corresponds to its slot location The SCSI ID for a disk in a BA356 or UltraSCSI BA356 depends upon its slot location and the personality module SCSI bus address switch settings 3 4 SCSI Bus Length There is a limit to the length of the cables in a shared SCSI bus The total cable length for a SCSI bus segment is calculated from one terminated end to the other If you are using devices that have the same transmission method and data path for example wide differential a shared bus will consist of only one bus segment If you have devices with different transmission methods you will have both single ended and differential bus segments each of which must be terminated only at both ends and must adhere tothe rules on bus length Table 3 2 describes the maximum cable length for a physical SCSI bus segment Table 3 2 SCSI Bus Segment Length SCSI Bus Bus Speed Maximum Cable Length Narrow single ended 5 MB sec 6 meters Narrow single ended fast 10 MB sec 3 meters Wide differential fast 20 MB sec 25 meters Differential UltraSCSI 40 MB sec 25 meters a The maximum separation between
274. ith a trilink terminator combination Therefore the TL881 or TL891 must be the last device on the shared SCSI bus They may not be removed from the shared SCSI bus without stopping all ASE services that generate activity on the bus To achieve system performance capabilities we recommend placing no more than two tape drives on a SCSI bus We recommend that tape devices be placed on separate shared SCSI buses and that there be no storage devices on the SCSI bus The cabling depends on whether or not there are one or two drives and for the two drive configuration if each drive is on a separate SCSI bus Note It is assumed that the library robotics is on the same SCSI bus as tape drive 1 To connect the library robotics and one drive to a single shared SCSI bus follow these steps 1 Connect a 328215 00X BN21K or BN21L between the last Y cable or trilink connector on the bus to the leftmost connector as viewed from the rear of the MiniLibrary The 328215 004 is a 20 meter cable 2 Install a 0 3 meter SCSI bus jumper between the rightmost robotics connector second connector from the left and the left DLT 1 connector the third connector from the left 8 64 Configuring a Shared SCSI Bus for Tape Drive Use 3 Install an HD68 differential terminator such as an H879 AA on the right DLT1 connector the fourth connector from the left To connect the drive robotics and two drives to a single shared SCSI bus follo
275. ith the show config command in Example 4 1 you determine that the first two devices shown in Example 4 5 pkao and pkbo are for NCR 53C875 SCSI controllers The next two devices pkco and pkdo shown in Example 4 1 as Qlogic 1SP1020 devices are KZPBA CBs which are really Qlogic SP1040 devices regardless of what the console says Our interest then is in pkco and pkdo Example 4 5 shows two pk 0_soft_term environment variables pkcO_soft_termand pkdo_ soft _term both of which are on The pk 0_ soft _term environment variable applies to systems using the QLogic I SP1020 SCSI controller which implements the 16 bit wide SCSI bus and uses dynamic termination The QLogic SP1020 module has two terminators one for the 8 low bits and one for the high 8 bits There are five possible values for pk 0_ soft term e off Turns off both low 8 bits and high 8 bits low Turns on low 8 bits and turns off high 8 bits e high Turns on high 8 bits and turns off low 8 bits TruCluster Server System Configuration Using UltraSCSI Hardware 4 15 e on Turns on both low 8 bits and high 8 bits e diff Places the bus in differential mode The KZPBA CB is a Qlogic ISP1040 module and its termination is determined by the presence or absence of internal termination resistor SIPs RM1 RM8 Therefore the pk 0_soft_term environment variable has no meaning and it may be ignored Example 4 6 shows the use of the show isp console command to displ
276. k dski5c DEC HSG80 IDENTIFIER 133 63 dev disk dsk1 c DEC HSG80 IDENTIFIER 132 64 dev disk dsk17c DEC HSG80 IDENTIFIER 131 65 dev disk dsk18c DEC HSG80 IDENTIFIER 141 66 dev disk dsk19c DEC HSG80 IDENTIFIER 142 Using Fibre Channel Storage 6 51 67 dev disk dsk20c DEC HSG80 IDENTIFIER 143 68 dev disk dsk21c DEC HSG80 IDENTIFIER 144 If you know that you have set the UDID for a large number of disks you can also grep for the UDID hwmgr view dev grep IDENTIFIER grep 131 Note If you have not set the UDID you can use hwmgr todetermine the dev disk dskn name by using the hardware manager to display device attributes and searching for the storage unit worldwide name as follows hwmgr get attribute a name a dev_base name more Use the more search utility to search for the worldwide name of the storageset you have set up for the particular disk in question The following example shows the format of the command output hwmgr get attribute a name a dev_base name alte name Compaq AlphaServer ES40 Dae name CPUO 62 name SCSI WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002e dev_base_ name dsk15 63 name SCSI WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 0030 dev_base_ name dsk16 64 name SCSI WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002f dev_base_ name dsk17 65 name SCSI WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 0028 dev_base_ name
277. kzpsa0 3 KZPSA 81011 0000 kzpsal 4 KZPSA 81011 0000 kzpsa2 7 DEC PCI MC 181011 000B mco Example 10 4 shows the output f rom the show device console command entered on an AlphaServer 8200 system Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 11 Example 10 4 Displaying Devices on an AlphaServer 8200 gt gt gt show device polling polling polling polling polling pke0 7 0 dke0 0 0 dke200 2 dke400 4 for FOr for for for em E e E ao E D G Gr FR units units units units units me polling for units dkf0 0 dkf1 dkf2 dkf3 dkf4 dkf5 dkf6 0 dkf100 dkf200 dkf300 D O OO O wu Ne oOoOoO0OO0OO0OO0OOO iT COORPRRHREHEE PRPRPPRPPPRPP RB PPP polling for units kzpsao dkg0 0 dkg1 0 dkg2 0 dkg100 dkg200 dkg300 WNrROOORF Qh COONNN MNNNRRERN mal H polling for units kzpsal dkh100 dkh200 dkh300 WNE SO 0 s03 0 WWW Ww sali 1 zt I polling for units kzpsa2 dkiloo dki200 dki300 WN PGW Q s 0 0z 0 WWW pe ale l st 1 on isp0 slot0 bus0 hose0 on ispl sloti bus0 hose0 on isp2 slot4 bus0 hose0 on isp3 slot5 bus0 hose0 kzpaa0 slot0 bus0 hosel kzpaa4 SCSI Bus ID 7 DKEO RZ28 442D DKE200 RZ28 442D DKE400 RRD43 0064 isp4 sloti bus0 hosel DKFO HSZ70 V70Z DKF1 HSZ70 V70Z DKF2 HSZ70
278. l Adapters to Hubs Memory Channel hub 1 oa a aem Memory Channel Channel adapters System A Linecards ZK 1197U AI 5 5 2 Installing the MC2 Cables To set up an MC2 interconnect use the BN 39B 04 4 meter or BN 39B 10 10 meter link cables for virtual hub or standard hub configurations without optical converters If optical converters are used use the BN39B 01 1 meter link cable and the BN 34R 10 10 meter or BN34R 31 31 meter fiber optics cable 5 5 2 1 Installing the MC2 Cables for Virtual Hub Mode Without Optical Converters To set up an MC2 configuration for virtual hub mode use BN 39B 04 4 meter or BN 39B 10 10 meter Memory Channel link cables to connect Memory Channel adapters to each other Notes MC2 link cables BN 39B are black cables Do not connect an MC2 cable to an MC1 or MC1 5 CCMAA module Setting Up the Memory Channel Cluster Interconnect 5 9 Gently push the cable s connector into the receptacle and then use the screws to pull the connector in tight The connector must be tight to ensure a good ground contact If you are setting up redundant interconnects all Memory Channel adapters in a system must have the same jumper setting either VHO or VH1 5 5 2 2 Installing MC2 Cables in Virtual Hub Mode Using Optical Converters If you are using optical converters in an MC2 configuration install an optical converter module CCMFB
279. l connected systems are shut down For information on setting up zoning refer to the SAN Switch Zoning documentation that is provided with the switch 6 4 2 Cascaded Switches Multiple switches may be connected to each other When cascading switches a maximum of three switches is supported with a maximum of two hops between switches The maximum hop length is 10 km longwave single mode or 500 meters shortwave multimode F ibre Channel cable Using Fibre Channel Storage 6 15 6 5 Installing and Configuring Fibre Channel Hardware This section provides information about installing the Fibre Channel hardware needed to support Tru64 UNIX or a TruCluster Server configuration using Fibre Channel storage Ensure that the member systems the Fibre Channel switches and the HSG80 array controllers are placed within the lengths of the optical cables you will be using Note The maximum length of the optical cable between the KGPSA and the switch or switch and the HSG80 array controller is 500 meters via shortwave multimode Fibre Channel cable The maximum distance between switches in a cascaded switch configuration is 10 kilometers using longwave single mode fiber 6 5 1 Installing and Setting Up the Fibre Channel Switch The Fibre Channel switches support up to 8 DS DSGGA AA DS DSGGB AA and DS DSGGC AA or 16 DS DSGGA AB or DS DSGGB AB full duplex 1 6025 Gbits sec ports Each switch port can be connected toa KGPSA BC or KGPSA CA
280. l the primary PCI drawers that contain the master and standby SCM if there is to be a standby SCM in the power cabinet of a GS160 or GS320 or RETMA cabinet for a GS80 they both must be connected to the OCP 2 Install the following hardware as appropriate for your TruCluster Server configuration in the primary or expansion PCI drawer of each partition and make all cable connections Keep your configuration as symmetrical as possible to make troubleshooting and reconfiguration tasks easier e Each system ina TruCluster Server configuration requires at least one Memory Channel adapter Ensure that you abide by the restrictions described in Section 2 2 and that you connect the cables for Memory Channel interconnects to the Memory Channel modules and not tothe I O risers The type of cables used BN 39B used for the Memory Channel interconnect are also used to connect the local I O risers on the QBB tothe remote I O risers on the PCI drawers 7 8 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration e Shared storage that is connected to KZPBA CB parallel SCSI or KGPSA CA Fibre Channel host bus adapters e Network controllers 3 Install BN39B cables between the local I O risers on the QBBs in the partition see Figure 7 1 and the remote I O risers in the primary and expansion PCI drawer see Figure 2 1 and Figure 7 3 Use BN39B 01 cables 1 meter for a PCI drawer in the GS80 RETMA cabinet Use B
281. l to Fibre Channd Host Bus Adapter User Guide Compaq StorageWorks Fibre Channel Storage Switch User s Guide Compaq StorageWorks SAN Switch 8 Installation and Hardware Guide Compaq StorageWorks SAN Switch 16 Installation and Hardware Guide Compaq StorageWorks Fibre Channd SAN Switch 8 EL Installation and Hardware Guide Compaq StorageWorks HSG80 Array Controller ACS Version 8 5 Configuration Guide Using Fibre Channel Storage 6 3 e Compaq StorageWorks HSG80 Array Controller ACS Version 8 5 CLI Reference Guide e MA6000 HSG60 Array Controller ACS Version 8 5 Solution Software for Compaq Tru64 UNIX Installation and Configuration Guide e Compaq StorageWorks HSG60 HSG80 Array Controller ACS Version 8 5 Maintenance and Service Guide e MA6000 HSG60 Array Controller ACS Version 8 5 Solution Software for Compaq Tru64 UNIX Installation and Configuration Guide e Compaq StorageWorks Release Notes RA8000 ESA12000 and MA8000 EMA12000 Solution Software V8 5b for Tru64 UNIX e Compaq StorageWorks Modular Array Configuration Guide e Modd 2100 and 2200 Ultra SCSI Controller Endosures User Guide e Wwidmgr User s Manual 6 2 Fibre Channel Overview Fibre Channel supports multiple protocols over the same physical interface Fibre Channel is primarily a protocol independent transport medium therefore it is independent of the function for which you use it TruCluster Server uses the Fibre Channel Protocol FCP for SCSI to use Fibre Channel as
282. line in PostScript and Portable Document F ormat PDF formats at http www compaq com info golden eggs At this URL you will find links to individual system storage or cluster configurations You can order the document through the Compaq Literature Order System LOS as order number EC RO26B 36 In addition have available the following manuals from the Tru64 UNIX documentation set e Installation Guide e Redease Notes e System Administration e Network Administration Also have available the hardware documentation for the systems SCSI controllers disk storage shelves or RAID controllers and any other hardware you plan to install Documentation for the following optional software products will be useful if you intend to use these products with TruCluster Server e Compaq Analyze e DECevent e Logical Storage Manager LSM e NetWorker e Advanced File System AdvF S Utilities e Performance M anager About This Manual xxi Reader s Comments Compaq welcomes any comments and suggestions you have on this and other Tru64 UNIX manuals You can send your comments in the following ways e Fax 603 884 0120 Attn UBPG Publications ZK 03 3 Y 32 e Internet electronic mail readers comment zk3 dec com A Reader s Comment form is located on your system in the following location usr doc readers_comment txt e Mail Compaq Computer Corporation UBPG Publications Manager ZK O3 3 Y 32 110 Spit Brook Road Nashua
283. lity Mirror disks across shared buses Use a RAID array controller Shared storage capacity Increase the number of shared buses Use a RAID array controller Increase disk size 4 2 Obtaining the Firmware Release Notes You may be required to update the system or SCSI controller firmware during a TruCluster Server installation so you may need the firmware release notes You can obtain the firmware release notes from e The Web at the following URL http www compaq com support Select software amp drivers then select All Products under the Alpha Systems heading Select Alpha Firmware updates then select the appropriate system e Thecurrent Alpha Systems Firmware Update CD ROM Note To obtain the firmware release notes from the Firmware Update Utility CD ROM your kernel must be configured for the ISO 9660 Compact Disk File System CDFS To obtain the release notes for the firmware update follow these steps 1 At the console prompt or using the system startup log if the Tru64 UNIX operating system is running determine the drive number of the CD ROM Boot the Tru64 UNIX operating system if it is not already running Log in as root Place the Alpha Systems Firmware Update CD ROM applicable to the Tru64 UNIX version installed or to be installed into the drive 5 Mount the CD ROM as follows dev disk cdrom0c is used as an example CD ROM drive mount rt cdfs o noversion dev disk cdrom0cc
284. ll be on the end of the SCSI bus attach an H879 AA terminator to the H885 AA trilink on the DWZZB for the BA356 that will be on the end of the bus Connect a BN21K or BN21L cable between the H885 AA trilinks When the KZPSA BB or KZPBA CB host bus adapters have been installed e If the BA356 storage shelves are on the end of the shared SCSI bus connect a BN21K or BN21L cable between the BN21W 0B Y cables on the host bus adapters Connect another BN21K or BN21L cable between the BN21W 0B Y cable with an open connector and the H 8855 AA trilink on the BA356 with an open connector e If the BA356s are in the middle of the shared SCSI bus connect a BN21K or BN21L cable between the BN21W 0B Y cable on each host bus adapter and the H 8855 AA trilink on a BA356 storage shelf 9 20 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices Figure 9 10 shows a two member TruCluster Server configuration using two BA356s for storage Figure 9 10 Two BA356s Cabled for Shared SCSI Bus Usage Network Do not use for data disk May be used for redundant power supply Member System Memory Channel r KZPSA BB ID 6 l Member System 2 Memory Channel KZPSA BB ID 7 Memory Channel Interface 1 Clusterwide usr var Member 1 Boot Disk 10 10 Member 2 B
285. lover through the cluster application availability CAA subsystem disk mirroring and fast file system recovery TruCluster Server supports mirroring of the clusterwide root file system the member specific boot disks and the duster quorum disk through hardware RAID only You can mirror the clusterwide usr and var file systems and the data disks using the Logical Storage Manager LSM technology You must determine the storage configuration that will meet your needs Mirroring disks across two shared buses provides the most highly available data Disk devices used on the shared bus must be located in a supported storage shelf Before you connect a storage shelf to a shared SCSI bus you must install the disks in the unit Before connecting a RAID array controller to a shared SCSI bus install the disks and configure the storagesets For detailed information about installation and configuration see your storage shelf or RAID array controller documentation After completing the following sections and setting up your RAID storagesets you should be ready to cable your host bus adapters to storage when they have been installed see Chapter 10 The following sections describe how to prepare storage for a shared SCSI bus and external termination for e A BA350 a BA356 and an UltraSCS I BA356 e Two BA356s e Two UltraSCSI BA356s e An HSZ20 HSZ40 or HSZ50 RAID array controller If you need to use a BA350 or non UltraSCS BA356 with
286. lowing example gt gt gt set pkn_0 host id The n specifies which KZPSA BB the environment variables apply to You obtain the n value fromthe show device and show pk console commands The number sign isthe SCSI bus ID for the KZPSA Set the bus speed with the set command as shown in the following example gt gt gt set pknO fast The number sign specifies the bus speed Use a 0 for slow and a 1 for fast Enable SCSI bus termination power with the set command as shown in the following example gt gt gt set pkn0O termpwr on Example 10 9 shows how to determine the present SCSI ID bus speed and the status of termination power and then set the KZPSA BB SCSI ID to 6 and bus speed to fast for pkbo Example 10 9 Setting KZPSA BB SCSI Bus ID and Speed P00 gt gt gt show pkb pkbo fast 0 pkboO host_id 7 pkbO_termpwr on P00 gt gt gt set pkbO host id 6 POO gt gt gt set pkbO fast 1 P00 gt gt gt show pkbO host id 6 P00 gt gt gt show pkbO fast 1 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 17 10 1 4 4 KZPSA BB and KZPBA CB Termination Resistors The KZPSA BB internal termination is disabled by removing termination resistors Z1 through Z5 as shown in Figure 10 1 Figure 10 1 KZPSA BB Termination Resistors Z5 Termination Resistor SIPs SEL 00 8ee z0 53 The KZPBA CB internal termination is disabled by removing the
287. m with hardware installed the system management console is connected for the first partition a terminal emulator window is open for the first partition and that the system has been powered up and tested as a single partition Also this section assumes that you have determined which QBBs to use in each partition Although the procedure specifies two hard partitions the maximum for a GS80 system it will work Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 7 equally well with any number of partitions as supported by the system type by modifying the amount and placement of hardware and the SCM environment variable values Notes View each partition as a separate system Ensure that the system comes up as a single partition the first time you turn power on Donot turn the key switch on Only turn on the AC circuit breakers Usethe SCM set hp count 0 command to ensurethat the system comes up as a single partition Then turn the key switch on to provide power to the system To repartition an AlphaServer GS80 160 320 system into two partitions to be used as TruCluster Server member systems follow this procedure 1 If necessary install a primary PCI drawer for each additional hard partition beyond partition 0 Install any expansion PCI drawers as needed to provide additional PCI slots Ensurethat the system already has a primary PCI drawer for the first partition Note We recommend that you instal
288. mation on the ESL9326D Enterprise Library see the following Compaq StorageWorks ESL9000 Series Tape Library documentation Unpacking and Installation Guide Reference Guide Maintenance and Service Guide Tape Drive Upgrade Guide Configuring a Shared SCSI Bus for Tape Drive Use 8 73 Note These tape devices have been qualified for use on shared SCSI buses with both the KZPSA BB and KZPBA CB host bus adapters 8 13 2 ESL9326D Enterprise Library Overview 8 13 3 The ESL9326D Enterprise Library is an enterprise Digital Linear Tape DLT automated tape library with from 6 to 16 fast wide differential tape drives This tape library uses the 35 70 DLT DS TZ89N AV differential tape drives The SCSI bus connectors are 68 pin high density The ESL9326D Enterprise Library has a capacity of 326 DLT cartridgesina fixed storage array back wall inside the left door and inside the right door This provides a storage capacity of 11 4 TB uncompressed for the ESL9326D Enterprise Library using DLT Tape IV cartridges The library can also use DLT Tape III or IIIXT tape cartridges The ESL9326D Enterprise Library is available as six different part numbers based on the number of tape drives Order Number Number of Tape Drives 146205 B 23 6 146205 B 24 8 146205 B25 10 146205 B 26 12 146205 B27 14 146205 B 28 16 You can upgrade a tape library with part number 146209 B21 which adds a 35 70 DLT tape drive Se
289. me by installing the Memory Channel adapters redundant network adapters if applicable and KZPBA CB SCSI adapters all at the same time Follow the directions in the referenced documentation or the steps in the referenced tables returning to the appropriate table when you have completed the steps in the referenced table Caution Static electricity can damage modules and electronic components We recommend using a grounded antistatic wrist strap and a grounded work surface when handling modules Table 4 2 Configuring TruCluster Server Hardware Step Action Refer to 1 Install the Memory Channel module s Chapter 5 cables and hub s if a hub is required 2 Install Ethernet or FDDI network User s guide for the applicable adapters Ethernet or FDDI adapter and the user s guide for the applicable system Install ATM adapters if using ATM See the documentation that came with the ATM adapter 3 Install a KZPBA CB UltraSCSI adapter Section 4 3 1 and Table 4 3 for each radially connected shared SCSI bus in each member system 4 6 TruCluster Server System Configuration Using UltraSCS Hardware Table 4 2 Configuring TruCluster Server Hardware cont Step Action Refer to 4 Update the system SRM console Use the firmware update release firmware from the latest Alpha Systems notes Section 4 2 Firmware Update CD ROM Note The SRM console firmware includes the SP1020 1040 based PCI option fir
290. ment variable to the member system boot device Use the paths shown in the reachability display of the wwidmgr quickset command for the appropriate device see Section 6 6 6 i Repeat steps a through h on each system accessing devices on the HSG80 6 8 Using the emx Manager to Display Fibre Channel Adapter Information The emx manager emxmgr utility was written for the TruCluster Software Product Version 1 6 products to be used to modify and maintain emx driver worldwide name to target ID mappings It is included with Tru64 UNIX Version 5 1 and although not needed to maintain worldwide name to target ID mappings it may be used with TruCluster Server Version 5 1 to e Display the presence of KGPSA Fibre Channel adapters e Display the target ID mappings for a Fibre Channel adapter e Display the current Fibre Channel topology for a Fibre Channel adapter See emxmgr 8 for more information on the emxmgr utility 6 8 1 Using the emxmgr Utility to Display Fibre Channel Adapter Information The primary use of the emxmgr utility for TruCluster Server is to display Fibre Channel information Use the emxmgr d command to display the presence of KGPSA Fibre Channel adapters on the system For example usr sbin emxmgr d emx0 emxl emx2 Usethe emxmgr m command to display an adapter s target ID mapping For example usr sbin emxmgr m emx0 emx0 SCSI target id assignments SCSI tgt id 0 portname 5000 1FE1 0000 0CB2 6 62
291. mmand to set the auto_action variable to halt This halts the system at the console prompt when the system is turned on ensuring that you are able to run the Memory Channel diagnostics gt gt gt set auto action halt 3 Turn off the system 4 Set the jumpers on the new Memory Channel Chapter 5 and module to be installed Memory Channel User s Guide MC1 Hub mode Standard hub mode or virtual hub mode VHO or VH1 e Virtual hub mode VHO J umper pins 2 to 3 e Virtual hub mode VH 1 No jumper e Standard hub mode J umper pins 1 to 2 MC2 Hub mode Standard hub mode or virtual hub mode VHO or VH1 e Virtual hub mode VHO J umper pins 2 to 3 e Virtual hub mode VH 1 No jumper e Standard hub mode J umper pins 1 to 2 J 3 Memory Channel address space Select 128 MB jumper pins 1 to 2 or 512MB jumper pins 2 to 3 as required for your configuration Setting Up the Memory Channel Cluster Interconnect 5 15 Table 5 4 Adding a Memory Channel Interconnect or Rolling from a Dual Redundant MC1 Interconnect to MC2 Interconnects cont Step Action Refer to Note If you set the J 3 jumpers for 128 MB because the other interconnect is MC1 and then later on decide to upgrade to dual redundant MC2 hardware using 512 MB address space you will have to reset the jumpers If you set the jumpers to 512 MB now the software will only allow the use of 128 MB address space for a mixed rail cluster MC1 on one
292. mnt 4 4 TruCluster Server System Configuration Using UltraSCS Hardware 6 Copy the appropriate release notes to your system disk In this example obtain the firmware release notes for the AlphaServer DS20 from the Version 5 6 Alpha Firmware Update CD ROM cp mnt doc ds20 v56 fw _relnote txt ds20 rel notes 7 Unmount the CD ROM drive umount mnt 8 Print the release notes 4 3 TruCluster Server Hardware Installation Member systems may be connected toa shared SCSI bus with a peripheral component interconnect PCI SCSI adapter Before you install a PCI SCSI adapter into a PCI slot on a member system ensure that the module is at the correct hardware revision The qualification and use of the DS DWZZH series UltraSCSI hubs in TruCluster Server clusters allows the PCI host bus adapters to be cabled into a cluster in two different ways e Preferred method with radial connection toa DWZZH UltraSCSI hub and internal termination The PCI host bus adapter internal termination resistor SIPs are not removed The host bus adapters and storage subsystems are connected directly toa DWZZH UltraSCSI hub port There can be only one member system connected to a hub port The use of a DWZZH UltraSCS I hub in a TruCluster Server cluster is preferred because it improves the reliability to detect cable faults e Old method with external termination Shared SCSI bus termination is external tothe PCI host adapters This is the old method used to
293. mware which includes the KZPBA CB When you update the SRM console firmware you are enabling the KZPBA CB firmware to be updated On a powerup reset the SRM console loads KZPBA CB adapter firmware from the console system flash ROM into NVRAM for all Qlogic 1SP1020 1040 based PCI options including the KZPBA CB PCl to Ultra SCSI adapter a if you install additional KZPBA CB SCSI adapters or an extra network adapter at this time delay testing the Memory Channel until you have installed all of the hardware 4 3 1 Installation of a KZPBA CB Using Internal Termination for a Radial Configuration Use this method of cabling member systems and shared storage in a TruCluster Server cluster if you are using a DWZZH UltraSCSI hub You must reserve at least one hub port for shared storage The DWZZH series UltraSCS I hubs are designed to allow more separation between member systems and shared storage Using the UltraSCSI hub also improves the reliability of the detection of cable faults A side benefit is the ability to connect the member systems SCSI adapter directly to a hub port without external termination This simplifies the configuration by reducing the number of cable connections A DWZZH UltraSCSI hub can be installed in e A StorageWorks UltraSCSI BA356 shelf that has the required 180 watt power supply e The lower righthand device slot of the BA370 shelf within the RA7000 or ESA 10000 RAID array subsystems This position minimiz
294. n about installing devices it describes only how to set up the hardware in the context of the TruCluster Server product Therefore you must have the documentation that describes how to install the individual pieces of hardware This documentation should arrive with the hardware All systems in the cluster must be connected via the Memory Channel cluster interconnect Not all members must be connected to a shared SCSI bus We recommend placing the clusterwide root usr and var file systems all member boot disks and the quorum disk if provided on shared SCSI buses All configurations covered in this manual assume the use of a shared SCSI bus Before proceeding further review Section 4 1 Section 4 2 and the first two paragraphs of Section 4 3 10 1 TruCluster Server Hardware Installation Using PCI SCSI Adapters The following sections describe how to install the KZPSA BB or KZPBA CB host bus adapters and configure them into TruCluster Server clusters using both methods of termination the preferred method of radial connection with internal termination used with the HSZ40 and HSZ50 RAID array controllers and the old method of external termination It is assumed that you have already configured and cabled your storage subsystems as described in Chapter 9 When the system hardware K ZPSA BB or KZPBA CB host bus adapters Memory Channel adapters hubs if necessary cables and network adapters have been installed you can con
295. n in Example 6 1 4 Usethe SHOW unit command where unit is D131 through D133 and D141 through 144 in the example to verify the identifier and that access to each unit is correct Ensure that there is no connection to an 6 42 Using Fibre Channel Storage unwanted system Record the identifier and worldwide name for later use Table 6 2 is a sample table filled in for the example Table A 1 in Appendix A is a blank table for your use in an actual installation Note At this point even though the table is filled in we do not yet know the device names or dskn numbers Table 6 2 Converting Storageset Unit Numbers to Disk Names File System HSG80 Worldwide Name UDID Device Name dskn or Disk Unit Member 1 boot D131 6000 1FE1 0000 0D60 131 dga131 1001 0 1 0 dsk17 disk 0009 8080 0434 002F Member2 boot D132 6000 1FE1 0000 O0D60 132 dga132 1001 0 1 0 dsk16 disk 0009 8080 0434 0030 Tru64 UNIX D133 6000 1F E1 0000 0D60 133 dga133 1001 0 1 0 dsk15 disk 0009 8080 0434 002E Quorum disk D141 6000 1FE1 0000 0D60 141 N A dsk21 0009 8080 0434 0029 Cluster root D142 6000 1FE1 0000 OD60 142 N A dsk20 0009 8080 0434 002A usr D143 6000 1FE1 0000 0D60 143 N A dsk19 0009 8080 0434 002B var D144 6000 1F E1 0000 OD60 144 N A dsk18 0009 8080 0434 0028 a These units are not assigned an alias for the device unit number by the WWI D manager command therefore they do not get a device nam
296. n ispl sloti bus0 hose0 polling for units on isp2 slot4 bus0 hose0 polling for units on isp3 slot5 bus0 hose0 polling for units kzpaa0 slot0O bus0 hosel pkeO 7 0 0 1 kzpaa4 SCSI Bus ID 7 dke0 0 0 0 1 DKEO RZ28 442D dke200 2 0 0 1 DKE200 RZ28 442D dke400 4 0 0 1 DKE400 RRD43 0064 polling for units isp4 sloti1 bus0 hosel dkf 0 0 0 1 1 DKFO HSZ70 V70Z dk 1 0 0 1 1 DKF1 HSZ70 V70Z dk 2 0 0 1 1 DKF2 HSZ70 V70Z dk 3 0 0 1 1 DKF3 HSZ70 V70Z TruCluster Server System Configuration Using UltraSCSI Hardware 4 13 Example 4 4 Displaying Devices on an AlphaServer 8200 cont dkf 4 0 0 1 1 DKF4 HSZ70 V70Z dkf 5 0 0 1 1 DKF5 HSZ70 V70Z dkf6 0 0 1 1 DKF6 HSZ70 V70Z dk 100 1 0 1 1 DKF100 RZ28M 0568 dk 200 2 0 1 1 DKF200 RZ28M 0568 dk 300 3 0 1 1 DKF300 RZ28 442D polling for units on kzpsa0 slot 2 bus 0 hosel AE dkg TPwr 1 Fast 1 Bus ID 7 LO1 All kzpsa0 4 0 2 dkg0 0 0 2 1 DKGO HSZ50 AX X29Z dkg1 0 0 2 1 DKG1 HSZ50 AX X29Z dkg2 0 0 2 1 DKG2 HSZ50 AX X29Z dkg100 1 0 2 1 DKG100 RZ26N 0568 dkg200 2 0 2 1 DKG200 RZ28 392A dkg300 3 0 2 1 DKG300 RZ26N 0568 polling for units on kzpsal slot 3 bus 0 hosel ek dkh TPwr 1 Fast 1 Bus ID 7 LO1 All kzpsal 4 0 3 dkhi00 1 0 3 1 DKH100 RZ28 442D dkh200 2 0 3 1 DKH200 RZ26 392A dkh300 3 0 3 1 DKH300 RZ26L 442D polling for units on kzpsa2 slot 4 bus 0 hosel aul dki TPwr 1 Fast 1 Bus ID 7 LO1 A10 kzpsa2 4 0 4 dkil00 1 0 3 1 D
297. n line or System Off line is displayed in the SDA To set the SCSI ID for each tape drive if the desired SCSI IDs are different from those shown in Table 8 9 follow these steps 1 Press and release the Control Panel STANDBY button and verify that the SDA Status Display Area shows System Off line Press and release SELECT to enter the menu mode Verify that the following information is displayed in the SDA Menu Configuration Press and release SELECT to choose the Configuration menu 5 Verify that the following information is displayed in the SDA Menu Configuration SCSI Address 8 38 Configuring a Shared SCSI Bus for Tape Drive Use 10 11 12 13 14 Press and release the SELECT button again to choose SCSI Address and verify that the following information is shown in the SDA Menu SCSI Address Robotics Use the down arrow button to bypass the Robotics submenu and verify that the following information is shown in the SDA Menu SCSI Address Drive 0 Use the up and down arrow buttons to select the drive number to set or change When you have the proper drive number displayed on line 2 press and release the SELECT button and verify that the following information is shown in the SDA Menu Drive 0 SCSI ID 0 Use the up and down arrow buttons to select the desired SCSI ID for the selected drive When the desired SCSI ID is displayed on line 2 press and release the SELECT button Repeat steps 8 t
298. n that supports TruCluster Server The 35 70 DLT tape drives require V97 or later firmware The firmware must be at V80 before you can upgrade to V97 Library Electronics and Tape Drive SCSI IDs Figure 8 20 shows the default robotics and tape drive SCSI IDs If these SCSI IDs are not acceptable for your configuration and you need to change them follow the steps in the Compaq StorageWorks ESL9000 Series Tape Library Reference Guide ESL9326D Enterprise Library Internal Cabling The default internal cabling for the ESL9326D Enterprise Library is to place two 35 70 DLT tape drives on one SCSI bus Figure 8 20 shows the default cabling for an ESL9326D Enterprise Library with 16 tape drives Each pair of tape drives is cabled together internally to place two drives on a single SCSI bus If your model has fewer drives all internal cabling is supplied The terminators for the drives that are not present are not installed on the SCSI bulkhead Configuring a Shared SCSI Bus for Tape Drive Use 8 75 Figure 8 20 ESL9326D Internal Cabling Tape Drive 8 SCSI ID 2 Tape Drive 9 SCSI ID 3 Tape Drive 10 SCSI ID 4 Tape Drive 11 SCSI ID 5 Tape Drive 12 SCSI ID 2 Tape Drive 13 SCSI ID 3 Tape Drive 14 SCSI ID 4 Tape Drive 15 SCSIID5 Tape Drive 0 SCSI ID 2 Tape Drive 1 SCSI ID 3 Tape Drive 2 SCSI ID 4 Tape Drive 3 SCSI ID 5 Tape Drive 4 SCSI ID 2 Tape Drive 5 SCSI ID 3 Tape Drive 6 SCSI ID 4 Tape Driv
299. n the right DLT2 connector the rightmost connector Figure 8 18 shows an example of a TruCluster configuration with a TL891 standalone MiniLibrary connected to two shared SCSI buses Configuring a Shared SCSI Bus for Tape Drive Use 8 65 Figure 8 18 TL891 Standalone Cluster Configuration Network Member Member Memory System Channel System 1 Interface 2 Memory Channel Memory Channel KZPBA CB ID 6 KZPBA CB ID 7 KZPBA CB ID 6 KZPBA CB ID 7 Library DLT1 Robotics DS DWZZH 03 iii Expansion Unit Interface ZK 1627U Al Table 8 19 shows the components used to create the cluster shown in Figure 8 18 Table 8 19 Hardware Components Used to Create the Configuration Shown in Figure 8 17 Callout Number Description 1 BN38C or BN38D cable 2 BN37A cable 3 H8861 AA VHDCI trilink connector 4 H8863 AA VHDCI terminator 5 BN21W 0B Y cable 8 66 Configuring a Shared SCSI Bus for Tape Drive Use Table 8 19 Hardware Components Used to Create the Configuration Shown in Figure 8 17 cont Callout Number Description 6 H879 AA terminator 7 328215 00X BN21K or BN21L cable a The maximum length of the BN38C or BN38D cable on one SCSI bus segment must not exceed 25 meters The maximum length of the BN37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters 8 12 2 2 Preparing a TL881 or
300. nation remove the five 14 pin termination resistor SIPs located near the differential end of the signal converter You can attach a terminator to the trilink connector to terminate the differential bus If you detach the trilink connector from the signal converter the shared SCSI bus is still terminated provided there is termination power You must keep the termination in the single ended side to provide termination for one end of the BA350 or BA356 single ended SCSI bus segment Verify that the termination is active A DWZZA should have jumper J 2 installed J umpers W1 and W2 should be installed in a DWZZB Figure 9 1 shows the status of internal termination for a standalone SCSI signal converter that has a trilink connector attached to the differential side Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 3 Figure 9 1 Standalone SCSI Signal Converter DI s G o wy Single ended ey side Differential side with trilink attached ZK 1050U Al Figure 9 2 shows the status of internal termination for an SBB SCSI signal converter that has a trilink connector attached to the differential side Figure 9 2 SBB SCSI Signal Converter Single ended side Differential side with trilink attached ZK 1576U Al 9 1 2 2 DS BA35X DA Termination The UltraSCSI BA356 shelf uses a 16 bit differential UltraSCSI personality module DS BA35X DA as
301. nd are those devices that have been assigned toa wwidn environment variable Before you start the Tru64 UNIX installation you must set the bootdef_dev console environment variable 6 6 1 5 Set the bootdef_dev Console Environment Variable for Tru64 UNIX Installation When booting from Fibre Channel devices you must set the bootdef_dev console environment variable to ensure that the installation procedure is able to boot the system after building the new kernel Note The bootdef_dev environment variable values must point to the same HSG80 Using Fibre Channel Storage 6 49 To set the bootdef_dev console environment variable for the Tru64 UNIX installation when booting from a Fibre Channel device follow these steps 1 Obtain the device name for the Fibre Channel storage unit where you will install the Tru64 UNIX operating system The device name shows up in the reachability display as shown in Example 6 5 with a Yes under the connected column You can also use the wwidmgr show reachability command to determine reachability Example 6 6 provides the display for a show dev command which shows the device names of devices that may be assigned to the bootdef_dev console environment variable Example 6 5 and Example 6 6 show that the following device names can be used in the bootdef_dev console environment variable as possible boot devices e dgal31 1002 0 1 0 e dgal31 1004 0 1 0 e dgal33 1002 0 1 0 e dgal33 1004 0 1 0 e dgb
302. ne controller or the other SET unit PREFERRED PATH THIS By balancing the preferred units you can obtain the best I O performance using two controllers Note If you have preferred units and the HSG80 controllers restart because of an error condition or power failure and one controller restarts before the other controller the HSG80 controller restarting first will take all the units whether they are preferred or not When the other HSG80 controller starts it will not have access to the preferred units and will be inactive Using Fibre Channel Storage 6 11 Therefore you want to ensure that both HSG80 controllers start at the same time under all circumstances so that the controller sees its own preferred units Figure 6 5 Figure 6 6 and Figure 6 7 show three different multiple bus NSPOF cluster configurations The only difference is the fiber optic cable connection path between the switch and the HSG80 controller ports If you consider the loss of a host bus adapter or switch the configurations in Figure 6 6 and Figure 6 7 will provide better throughput than Figure 6 5 because you still have access to both controllers With Figure 6 5 if you lose a host bus adapter or switch you lose the use of a controller Figure 6 5 Multiple Bus NSPOF Configuration Number 1 Member Member System System 1 Memory Channel 2 Memory Interface Memory Channel Channel KGPSA KGPSA KGPSA KGPSA ZK 1706U Al 6 12 Using Fibre
303. nect a BN21K BN21L or BN31G cable between the Y cable on the SCSI bus controller on that member system and the appropriate tape library port In Figure 8 17 one shared SCSI bus is connected to port B tape drives 0 and 1 one shared SCSI bus is connected to port A tape drives 2 and 3 and a third shared SCSI bus is connected to port E tape drives 4 and 5 and the MUC Configuring a Shared SCSI Bus for Tape Drive Use 8 55 Figure 8 17 Shared SCSI Buses with TL896 in Three Bus Mode Member System 1 eneycne pe Cema o OL KZPBA CB ID 6 KZPBA CB ID 6 KZPBA CB ID 6 Network Memory Channel Interface Member System 2 Memory Channel KZPBA CB ID 7 KZPBA CB ID 7 KZPBA CB ID 7 T KZPBA CB ID 7 SCSI Ports 3 bus mode ZK 1626U Al Table 8 16 shows the components used to create the cluster shown in Figure 8 17 Table 8 16 Hardware Components Used to Create the Configuration Shown in Figure 8 16 Callout Number Description 1 BN38C or BN38D cable 2 BN37A cable 3 H8861 AA VHDCI trilink connector 4 H8863 AA VHDCI terminator 5 BN21W 0B Y cable 8 56 Configuring a Shared SCSI Bus for Tape Drive Use Table 8 16 Hardware Components Used to Create the Configuration Shown in Figure 8 16 cont Callout Number Description 6 H879 AA terminator 7 328215 00X BN21K or BN21L cable a The maximum length of the BN38C or BN38
304. nect your host bus adapter to the UltraSCSI hub or storage subsystem Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 1 10 1 1 Follow the steps in Table 10 1 to start the TruCluster Server hardware installation procedure You can save time by installing the Memory Channel adapters redundant network adapters if applicable and KZPSA BB or KZPBA CB SCSI adapters all at the same time Follow the directions in the referenced documentation or the steps in the referenced tables for the particular SCSI host bus adapter returning to the appropriate table when you have completed the steps in the referenced table Caution Static electricity can damage modules and electronic components We recommend using a grounded antistatic wrist strap and a grounded work surface when handling modules Table 10 1 Configuring TruCluster Server Hardware for Use with a PCI SCSI Adapter Step Action Refer to 1 Install the Memory Channel module s Chapter 5 cables and hub s if a hub is required 2 Install Ethernet or FDDI network User s guide for the applicable adapters Ethernet or FDDI adapter and the user s guide for the applicable system Install ATM adapters if using ATM See the documentation that came with the ATM adapter 3 Install aKZPSA BB PCI SCSI adapter or KZPBA CB UltraSCSI adapter for each shared SCSI bus in each member system Internally terminated host bus ad
305. ner s M anual TZ887 Modd 140 280 GB DLT 7 CartridgeMiniLibrary Owner s M anual TL881 MiniLibrary System User s Guide TL881 MiniLibrary Drive Upgrade Procedure Pass Through Expansion Kit Installation Instructions TL891 MiniLibrary System User s Guide TL81X TL894 Automated Tape Library for DLT Cartridges Facilities Planning and Installation Guide TL81X TL894 Automated TapeLibrary for DLT Cartridges Diagnostic Software User s Manual TL895 DLT TapeLibrary Facilities Planning and Installation Guide TL895 DLT Library Operator s Guide TL895 DLT TapeLibrary Diagnostic Software User s Manual TL895 Drive Upgrade Instructions TL82X TL893 TL896 Automated Tape Library for DLT Cartridges Facilities Planning and Installation Guide TL82X TL893 TL896 Automated Tape Library for DLT Cartridges Operator s Guide TL82X TL893 TL896 Automated Tape Library for DLT Cartridges Diagnostic Software User s Manual TL82X Cabine to Cabine Mounting Instructions TL82X TL89X MUML toMUSL Upgrade Instructions xx About This Manual e For moreinformation on the ESL9326D Enterprise Library see the following Compaq StorageWorks ESL9000 Series Tape Library documentation Unpacking and Installation Guide Reference Guide Maintenanceand Service Guide Tape Drive Upgrade Guide The Golden Eggs Visual Configuration Guide provides configuration diagrams of workstations servers storage components and clustered systems It is available on
306. nfiguration Shown in Figure 8 9 and Figure 8 10 ccc cece ence eee eee eee eee Hardware Components Used for Configuration Shown in PIQUE 9 1 voce cea ee i E bed EEKE eaaa AEA dene Hardware Components Used for Configuration Shown in Figure 8 12 and Figure 8 13 cccce cece eect eee eee eee Hardware Components Used in Configuration Shown in Figure 9 TA pcre ccmnate daa tia eda e AEEA ial aad oi AEREE posed ii Configuring TruCluster Server Hardware for Use with a PCI SCSI Adapter aieri ena uoaa ua aara Ea eyed bie nee see nde te Installing the KZPSA BB or KZPBA CB for Radial Connection toa DWZZH UltraSCSI Hub cece cee eee eee eee eee Installing a KZPSA BB or KZPBA CB for Use with External TOF MIN AtlON aieia reaa aE aaa A bee teu a A Am ETE Converting Storageset Unit Numbers to Disk Names 8 37 8 42 8 44 8 50 8 51 8 51 8 52 8 56 8 60 8 66 8 70 8 77 9 20 9 24 9 27 9 30 10 2 10 4 About This Manual This manual describes how to set up and maintain the hardware configuration for a TruCluster Server cluster Audience This manual is for system administrators who will set up and configure the hardware before installing the TruCluster Server software The manual assumes that you are familiar with the tools and methods needed to maintain your hardware operating system and network Organization This manual contains 10 chapters an appendix and an inde
307. nformation again will show the topology that the adapters will assume after the next console initialization P00 gt gt gt wwidmgr show adapter item adapter WWN Cur Topo Next Topo 0 pga0 0 0 4 1 1000 0000 c920 eda0 LOOP FABRIC 1 pgb0 0 0 3 0 1000 0000 c920 da0l1 LOOP FABRIC 9999 All of the above 6 26 Using Fibre Channel Storage This display shows that the current topology for both KGPSA host bus adapters is LOOP but will be FABRIC after the next initialization A system initialization configures the KGPSAs to run on a fabric 6 5 2 3 Obtaining the Worldwide Names of KGPSA Adapters A worldwide name is a unique number assigned to a subsystem by the Institute of Electrical and Electronics Engineers IEEE and set by the manufacturer prior to shipping The worldwide name assigned toa subsystem never changes You should obtain and record the worldwide names of Fibre Channel components in case you need to verify their target ID mappings in the operating system Fibre Channel devices have both a node name and a port name worldwide name both of which are 64 bit numbers Most commands you use with Fibre Channel only show the port name There are multiple ways to obtain the KGPSA port name worldwide name e You can obtain the worldwide name from a label on the KGPSA module before you install it e You can usethe show dev command as follows P00 gt gt gt show dev pga0 0 0 1 0 PGAO WWN 1000 0000 c920 edao0 pgb0 0 0 2 0
308. ng SCSI ID 8 14 configuration restrictions 2 8 CONFIGURATION RESTORE command 6 34 configuring base unit as slave 8 33 8 70 connections to HSG80 6 58 connectors supported 2 14 console serial bus SeeCSB console terminal need for 7 9 terminal emulator 7 9 terminal server 7 9 console variable bus_probe_algorithm 2 9 CSB 7 4 nodes 7 5 purpose 7 4 D data path for buses 3 5 default SCSI IDs ESL9326D 8 75 TL881 TL891 8 62 TL890 8 36 TL891 8 36 TL892 8 36 TL893 8 51 TL894 8 37 TL895 8 44 TL896 8 51 device name 6 44 device unit number 6 44 setting 6 44 diagnostics Memory Channel 5 12 differential SCSI buses description of 3 4 differential transmission definition 3 4 disk devices restrictions 2 9 setting up 3 16 9 14 disk placement clusterwide usr 1 9 clusterwide var 1 9 clusterwide root 1 9 member boot 1 9 quorum 1 9 disklabel 6 53 displaying device information KZPBA CB 4 9t 10 5t 10 7t KZPSA BB 10 5t 10 7t DLT 20 40 GB DLT Tape Drive 8 10 40 80 GB DLT Drive 8 14 Compaq 20 40 GB DLT Tape Drive 8 10 Compag 40 80 GB DLT Drive 8 14 TZ885 8 17 TZ887 8 20 DLT MiniLibrary Configuring TL881 TL 891 as slave 8 70 Configuring TL891 as slave 8 33 TL881 8 57 TL891 8 57 DS BA356 DS DWZZH O03 installed in 2 11 3 9 4 7 9 29 10 3 DS DWZZH 05 installed in 3 10 DS BA35X DA personality module 3 3 3 5 4 8 9 2 9 3 DS DWZZH 03 3 8 bus connecto
309. ning cluster is not guaranteed across member failures This means that the member boot disks and the disk holding the clusterwide root cannot be used as quorum disks e The quorum disk can be small The cluster subsystems use only 1 MB of the disk e A quorum disk can have either 1 vote or no votes In general a quorum disk should always be assigned a vote You might assign an existing quorum disk no votes in certain testing or transitory configurations such as a one member cluster in which a voting quorum disk introduces a second point of failure e You cannot use the Logical Storage Manager LSM on the quorum disk 1 4 Generic Two Node Cluster This section describes a generic two node cluster with the minimum disk layout of four disks Note that additional disks may be needed for highly available applications In this section and the following sections the type of PCI SCSI bus adapter is not significant Also although an important consideration SCSI bus cabling including Y cables or trilink connectors termination and the use of UltraSCSI hubs are not considered at this time 1 4 Introduction Figure 1 1 shows a generic two node cluster with the minimum number of disks e Tru64 UNIX disk e Clusterwide root usr and var e Member 1 boot disk e Member 2 boot disk A minimum configuration cluster may have reduced availability due to the lack of a quorum disk As shown with only two member systems both syst
310. nnel Storage 15 Set up highly available applications or services as required Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 13 7 4 Determining AlphaServer GS80 160 320 System Configuration You may be required to reconfigure an AlphaServer GS80 160 320 system that is not familiar to you Before you start to reconfigure any system you need to determine e Thenumber of partitions in the system e Which QBBs are in each partition e Which PCI drawers are used by each partition e Which PCI drawer is connected to each QBB e The console serial bus CSB addresses Determine the necessary information with the following system control manager SCM commands show nvr Example 7 1 show system Example 7 3 and show csb Example 7 4 If you are at the SRM prompt use the escape sequence Esc Esc scm to transfer control to the SCM firmware Example 7 3 shows the display for the show system SCM command for an AlphaServer GS160 system Example 7 3 Displaying AlphaServer GS160 System Information SCM_EO gt show system System Primary QBBO 2 System Primary CPU 0 on QBB2 1 2 3 4 5 6 7 8 9 10 Par hrd sft CPU Mem IOR3 IOR2 IOR1 IORO GP QBB Dir PS Temp QBB 3210 3210 pci_box rio Mod BP Mod 321 C 0 0 30 PPPRP SPP aara Sri BOr T POG P P P PP 2
311. node cluster all inecards must be installed in the same hub For MC2 if fiber optics converters are used they can only be installed in hub slots opto only 0 opto 1 opto 2 opto and 3 opto If you have a five node or greater MC2 cluster using fiber optics you will need two or three CCMHB hubs depending on the number of fiber optics connections You will need one hub for the CCMLB linecards and possible optics converters and up to two hubs for the CCMFB optics converter modules The CCMHB BA hub has no linecards 5 5 Installing the Memory Channel Cables Memory Channel cable installation depends on the Memory Channel module revision and whether or not you are using fiber optics The following sections describe how to install the Memory Channel cables for MC1 and MC2 5 5 1 Installing the MC1 or MC1 5 Cables To set up an MC1 or MC1 5 interconnect use the BC12N 10 3 meter link cables to connect Memory Channel adapters and optionally Memory Channel hubs Setting Up the Memory Channel Cluster Interconnect 5 7 Note Do not connect an MC1 or MC1 5 link cable to an MC2 module 5 5 1 1 Connecting MC1 or MC1 5 Link Cables in Virtual Hub Mode For an MC1 virtual hub configuration two nodes in the cluster connect the BC12N 10 link cables between the Memory Channel adapters installed in each of the systems Caution Be very careful when installing the link cables Insert the cables straight in Gently push the cable s
312. nter button 8 When the Special Configuration menu reappears turn the power switch off and then on again to cycle the power The base unit is now reconfigured as a slave to the expansion unit 9 Repeat the steps for each TL881 TL891 base unit present that is to be a slave to the expansion unit 8 12 2 2 3 Powering Up the TL881 TL891 DLT MiniLibrary When turning on power to the TL881 or TL891 DLT MiniLibrary power must be applied to the expansion unit simultaneously or after power is applied tothe the base units and data units If the expansion unit is powered on first its inventory of modules may beincorrect and the contents of some or all of the modules will be inaccessible to the system and to the host Configuring a Shared SCSI Bus for Tape Drive Use 8 71 When the expansion unit comes up it will communicate with each base and data unit through the expansion unit interface and inventory the number of base units tape drives data units and cartridges present in each base and data unit After the MiniLibrary configuration has been determined the expansion unit will communicate with each base and data unit and indicate to the modules which cartridge group that base or data unit contains When all initialization communication between the expansion module and each base and data unit has completed the base and data units will display their cartridge numbers according to the remapped cartridge inventory 8 12 2 2 4 Setting the SCSI
313. ntial shared SCSI bus with BN21K or BN21L cables Ensure that the trilink at the end of the bus is terminated with an H879 AA terminator The wide single ended SCSI bus may be daisy chained from one single ended tape drive to another with BN21K or BN21L cables as long as the SCSI bus maximum length is not exceeded Ensure that the tape drive on the end of the bus is terminated with an H879 AA terminator You can add additional DS TZ89N TA tape drives to the differential shared SCSI bus by adding additional DWZZB AA DS TZ89N TA combinations Note Ensure that there is no conflict with tape drive system and disk SCSI IDs Configuring a Shared SCSI Bus for Tape Drive Use 8 9 8 3 Compaq 20 40 GB DLT Tape Drive The Compaq 20 40 GB DLT Tape Drive is a Digital Linear Tape DLT tabletop cartridge tape drive capable of holding up to 40 GB of data per Compactape IV cartridge using 2 1 compression It is capable of storing retrieving data at a rate of up to 10 8 GB per hour using 2 1 compression The Compaq 20 40 GB DLT Tape Drive uses CompacTape CompacTape IIIXT or CompacTape IV media It is a narrow single ended SCSI device and uses 50 pin high density connectors For more information on the Compaq 20 40 GB DLT Tape Drive see the following Compaq documentation e Compaq DLT User Guide e DLT TapeDriveUser Guide Supplement The following sections describe how to prepare the Compaq 20 40 GB DLT Tape Drive for shared SCSI
314. oR1 Port 1 TOR2 Port 2 and IOR3 Port 3 A P uppercase indicates that power is on and self test passed A p lowercase indicates that power is off and self test passed and an F indicates a self test failure The m n numbers for each QBB indicate which PCI drawer m 0 through and which PCI drawer I O riser n 0 1 thelocal I O riser is connected to For example QBBO Port O lORO is connected to PCI drawer 0 I O riser 0 Po 0 QBBO Port 1 1OR1 is connected to PCI drawer 0 I O riser 1 PO 1 Dashes in place of m n signify that the I O riser module is not installed The display always shows two sequences of for example because there are two ports on a local 1 0 riser module The other sequence you may observe is Px x which indicates that the I O riser module is installed powered up and has passed self test but a cable is not connected to the port For example a status of Px x P2 0 indicates that the local 1 0 riser is installed but only one cable is connected Global port module passed self test QBB backplane power system manager PSM passed self test QBB directory module passed self test QBB power supply status Each of these QBBs has two power supplies A dash indicates that there is no power supply in that position Oo IN oO 10 QBB backplane temperature in degrees Centigrade 11 Hierarchical switch H swi
315. odel is not supported in a TruCluster Server configuration TheTL891 DLT MiniLibrary tabletop model is only available as fast wide differential Configuring a Shared SCSI Bus for Tape Drive Use 8 57 8 12 1 2 TL881 and TL891 MiniLibrary Rackmount Components A TL881 or TL891 base unit which contains the tape drive s can operate as an independent standalone unit or in concert with an expansion unit and multiple data units A rackmount multiple module configuration is expandable to up to six modules in a configuration The configuration must contain at least one expansion unit and one base unit The TL881 and TL891 DLT MiniLibraries may include various combinations of MiniLibrary Expansion unit the MiniLibrary expansion unit enables multiple TL881 or TL891 modules to share data cartridges and work asa single virtual library The expansion unit also includes a 16 cartridge magazine The expansion unit integrates the robotics in the individual modules into a single coordinated library robotics system The expansion unit assumes control of the media maintaining an inventory of all media present in the system and controls movement of all media The tape cartridges can move freely between the expansion unit and any of the base units or data units via the system s robotically controlled pass through mechanism The expansion unit can control up to five additional attached modules base units and data units to create a multimodule r
316. ology fabric set other port 2 topology fabric Remove any failover mode that may have been previously configured Using Fibre Channel Storage 6 29 2 Prevents the command line interpreter CLI from reporting a misconfiguration error resulting from not having a failover mode set 3 Puts the controller pair into multiple bus failover mode Ensure that you copy the configuration information from the controller known to have a good array configuration Note Use the command set failover copy this controller to set transparent failover mode 4 When the command is entered to set multiple bus failover and copy the configuration information to the other controller the other controller will restart The restart may set off the audible alarm which is silenced by pressing the button on the EMU The CLI will display an event report and continue reporting the condition until cleared with the clear cli command 5 Takes the ports off line and resets the topology to prevent an error message when setting the port topology 6 Sets fabric as the switch topology 12 Enter the show connection command as shown in Example 6 1 to determine the HSG80 connection names for the connections to the KGPSA host bus adapters For an RA8000 ESA12000 with dual redundant HSG80s in multiple bus failover mode there will be four connections for each K GPSA in the cluster as long as all four HSG80
317. om the left 4 Install an H879 AA terminator on the right DLT2 connector the rightmost connector 8 26 Configuring a Shared SCSI Bus for Tape Drive Use To connect the drive robotics and one drive to one shared SCSI bus and the second drive to a second shared SCSI bus follow these steps 1 Connect a BN21K or BN21L between the last trilink connector on one shared SCSI bus to the leftmost connector as viewed from the rear of the TL892 Connect a BN21K or BN21L between the last trilink connector on the second shared SCSI bus tothe left DLT2 connector the fifth connector from the left Install a 0 3 meter SCSI bus jumper between the rightmost robotics connector the second connector from the left and the left DLT1 connector the third connector from the left Install an H879 AA terminator on the right DLT1 connector the fourth connector from the left and install another H879 AA terminator on the right DLT2 connector the rightmost connector Figure 8 10 shows an example of a TruCluster Server cluster with a TL892 connected to two shared SCSI buses Configuring a Shared SCSI Bus for Tape Drive Use 8 27 Figure 8 10 TruCluster Server Cluster with a TL892 on Two Shared SCSI Buses Network Memory Member System 1 Channel Member System 2 Interface Memory Channel Memory Channel KZPBA CB ID 6 KZPBA CB ID 7 KZPBA CB ID 6 KZPBA CB ID 7 KZPBA CB ID 6 KZPBA CB ID 7 Library Robotics Expansion
318. on the tape library has been connected in the two bus mode by jumpering tape drive 0 to tape drive 1 and tape drive 2 to tape drive 3 see Section 8 9 3 and Figure 8 12 Thetwo SCSI buses are left at the default SCSI IDs and terminated at drives 1 and 3 with the installed terminators part number 0415619 To add a TL894 toa shared SCSI bus select the member system or storage device that will be the next to last device on the shared SCSI bus Connect a BN21K or BN21L cable between the Y cable on that device tothe appropriate tape library port Configuring a Shared SCSI Bus for Tape Drive Use 8 41 In Figure 8 13 one bus is connected to port 1 robotics controller and tape drives 0 and 1 and the other bus is connected to port 3 tape drives 2 and 3 Ensure that the terminators are present on the tape drives 1 and 3 Figure 8 13 Shared SCSI Buses with TL894 in Two Bus Mode Network Memory Channel Member System 2 Member System 1 Interface Memory Channel KZPBA CB ID 7 KZPBA CB ID 7 KZPBA CB ID 7 Memory Channel KZPBA CB ID 6 KZPBA CB ID 6 KZPBA CB ID 6 DS DWZZH 03 2 bus mode HO gt SCSI Port 4 CZD SCSI Port 3 C TL894 ZK 1625U Al Table 8 10 shows the components used to create the cluster shown in Figure 8 13 Table 8 10 Hardware Components Used to Create the Configuration Shown in Figure 8 12 Callout N
319. on an AlphaServer 4100 0685 Displaying Configuration on an AlphaServer 8200 Displaying Devices on an AlphaServer 8200 0665 Displaying the pk Console Environment Variables on an AlphaServer 4100 System 0 cecceecee eee eee teense neta eee Displaying Console Variables for a KZPBA CB on an AlphaServer 8x00 System c cece ee eee e eee eee eee e tenes Displaying Console Variables for a KZPSA BB on an AlphaServer 8x00 System c cece eee ee sent eee e eee e teen ees Setting the KZPBA CB SCSI BuSID eseese Setting KZPSA BB SCSI Bus ID and Speed 00085 Two N ode Cluster with Minimum Disk Configuration and No QUOrUM DISK sS agan eA anA a a a E aa Generic Two Node Cluster with Minimum Disk Configuration AN QUOFUM DISK cenaod aneh t eaa A TN aT AAEE a Minimum Two Node Cluster with UltraSCSI BA356 Storage UNIT eead ceed Ss e825 5 tee e sana E a a a eaa aE ede ace Two Node Cluster with Two UltraSCS I DS BA356 Storage UNITS ini eter ra maai a a aaa r aaa oaa anana Weds wees Two Node Configurations with UltraSCSI BA356 Storage Units and Dual SCSI BUSES cece eee eee eee ee eee Cluster Configuration with HSZ70 Controllers in Transparent Failover Mode orisii eiii i i aai iaaii a NSPOF Cluster Using HSZ70s in Multiple Bus F ailover Modena ae a vag A aa aa E AAA ET Aa 5 13 6 31 6 37 6 40 6 45 6 47 6 49 6 55 7 10 7 12 7 14 7 16 10 9 10
320. on manual for more information 1 3 1 2 Clusterwide Disk s When you create a cluster the installation scripts copy the Tru64 UNIX root usr and var file systems from the Tru64 UNIX disk to the disk or disks you specify We recommend that the disk or disks used for the clusterwide file systems be placed on a shared SCSI bus so that all cluster members have access to these disks During the installation you supply the disk device names and partitions that will contain the clusterwide root usr and var file systems F or example dsk3b dsk4c and dsk3g dsk3b cluster root root dsk4c cluster_usr usr dsk3g cluster _var var The var fileset cannot share the cluster _usr domain but must bea separate domain cluster var Each AdvFS file system must bea separate partition the partitions do not have to be on the same disk If any partition on a disk is used by a clusterwide file system only clusterwide file systems can be on that disk A disk containing a clusterwide file system cannot also be used as the member boot disk or as the quorum disk 1 3 1 3 Member Boot Disk Each member has a boot disk A boot disk contains that member s boot swap and cluster status partitions For example dsk1 is the boot disk for the first member and dsk2 is the boot disk for the second member dsk1 first member s boot disk pepicelli dsk2 second member s boot disk polishham The installation scripts reformat each member s bo
321. ond physical rail The 3 jumper is set at 128 MB for nodes 0 2 and 4 on the second physical rail 16384 8 K B pages Setting Up the Memory Channel Cluster Interconnect 5 19 Figure 5 2 shows a dual redundant virtual hub configuration using MC1 hardware being upgraded to MC2 Figure 5 2 MC1 to MC2 Virtual Hub Rolling Upgrade ZK 1530U Al 5 20 Setting Up the Memory Channel Cluster Interconnect Figure 5 3 through Figure 5 8 show a three node standard hub configuration being upgraded from MC1 to MC2 Figure 5 3 MC1 to MC2 Standard Hub Rolling Upgrade Initial Configuration MC1 Hub 1 MC1 Hub 2 ZK 1522U Al Setting Up the Memory Channel Cluster Interconnect 5 21 Figure 5 4 MC1 to MC2 Standard Hub Rolling Upgrade First MC1 Module Replaced MC1 Hub 2 ZK 1523U Al 5 22 Setting Up the Memory Channel Cluster Interconnect Figure 5 5 MC1 to MC2 Standard Hub Rolling Upgrade Replace First MC1 Adapter in Second System MC2 Hub 1 O opto gae MC1 Hub 2 ZK 1524U AI Setting Up the Memory Channel Cluster Interconnect 5 23 Figure 5 6 MC1 to MC2 Standard Hub Rolling Upgrade Replace Third System Memory Channel Adapters MC2 Hub 1 opto MC2 Hub 2 MC1 Hub 2 ZK 1525U Al 5 24 Setting Up the Memory Channel Cluster Interconnect Figure 5 7 MC1 to MC2 Standard Hub Rolling Upgrade Replace Second MC1 in Second System MC2 Hub 1 O opto opto 1
322. oned GS80 GS160 or GS320 Systems ina TruCluster Configuration ccceecee eee eee eee eee eae eee 7 7 7 3 1 Repartitioning a Single Partition AlphaServer GS80 160 320 as Two Partitions in a Cluster 7 7 7 4 Determining AlphaServer GS80 160 320 System Configuration us s2isGeestiers cen wante er van Sues a e ans whee ie ase 7 14 7 5 Updating GS80 160 320 Firmware eceeee cnet nett eee 7 18 7 5 1 Updating AlphaServer GS80 160 320 Firmware 7 18 8 Configuring a Shared SCSI Bus for Tape Drive Use 8 1 Preparing the TZ88 for Shared Bus Usage 0 eees 8 1 8 1 1 Setting the TZ88N VA SCSI ID oo cc eccce eee eee eeeeeeeees 8 2 8 1 2 Cabling the TZ88N VA eessen 8 3 8 1 3 Setting the TZ88N TA SCSI ID oo ccc ccece cece eeeeeeeeeees 8 5 8 1 4 Cabling the TZ88N TA eeen 8 5 8 2 Preparing the TZ89 for Shared SCSI Usage n se 8 6 8 2 1 Setting the DS TZ89N VW SCSI ID cc cceece cece cena 8 6 Contents vii 8 2 2 8 2 3 8 2 4 8 3 8 3 1 8 3 2 8 4 8 4 1 8 4 2 8 5 1 8 5 2 8 6 1 8 6 2 8 7 8 7 1 8 7 2 8 8 8 8 1 8 8 2 8 8 2 1 8 8 2 2 8 8 2 3 8 8 2 4 8 9 8 9 1 8 9 2 8 9 3 8 9 4 8 10 8 10 1 8 10 2 8 10 3 8 10 4 viii Contents Cabling the DS TZ89N VW Tape Drives secese Setting the DS TZ89N TA SCSI ID ceceeee eee ee eee Cabling the DS TZ89N TA Tape Drives ecese Compaq 20 40 GB DLT Tape Drive ccccceeeeeeeeeeeeees Set
323. onents used to create the cluster shown in Figure 8 11 8 32 Configuring a Shared SCSI Bus for Tape Drive Use Table 8 8 Hardware Components Used to Create the Configuration Shown in Figure 8 10 Callout Number Description 1 BN38C or BN38D cable 2 BN37A cable 3 H8861 AA VHDCI trilink connector 4 H8863 AA VHDCI terminator 5 BN21W 0B Y cable 6 H879 AA terminator 7 328215 00X BN21K or BN21L cablee a The maximum length of the BN38C or BN38D cable on one SCSI bus segment must not exceed 25 meters The maximum length of the BN 37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters 8 8 2 2 Configuring a Base Module as a Slave The TL891 TL892 base modules are shipped configured as standalone systems When they are used in conjunction with the TL890 DLT MiniLibrary expansion unit the expansion unit must control the robotics of each of the base modules Therefore the base modules must be configured as a Slave to the expansion unit After the hardware and cables are installed but before you power up the expansion unit in a MiniLibrary system for the first time you must reconfigure each of the base modules in the system as a slave The expansion unit will not have control over the base module robotics when you power up the MiniLibrary system if you do not reconfigure the base modules as a slave To reconfigure a TL891 TL892 base module as a slav
324. ongwave GBIC supports 9 micron single mode fiber optical cables Only the 50 micron MMF optical cable is supported between the host bus adapters and switches or switches and HSG80 controllers for the TruCluster Server product Longwave single mode fiber optical cables are supported between switches in a cascaded switch configuration Note If you need to install additional interface modules in the DSGGA switch do so before you place the switch in a relatively inaccessible location because you have to remove the top cover to install the interface modules The DSGGB switch accommodates up to 8 DS DSGGB AA or 16 DS DSBBG AB GBIC modules The DS DSGGC AA switch has seven fixed shortwave optical transceivers and one removable GBIC 6 5 1 1 Installing the Switch Place the switch within 500 meters of the member systems with KGPSA PCI to F ibre Channel adapter and the HSG80 array controllers You can mount the switches in a 48 7 cm 19 in rackmount installation or place the switch on a flat solid surface When you plan the switch location ensure that you provide access to the front of the switch All cables plug into the front of the switch Also for those switches with a control panel the display and switches are on the front of the switch For an installation at a minimum you have to 1 Placethe switch or install it in the rack 2 Connect the DS DSGGB AA or DS DSGGC AA toa terminal or PC Using Fibre Channel Storag
325. oot Disk aM Quorum Disk ID 12 Data disk D13 ID 14 or redundant power PWR 15 Supply ZK 1592U Al Table 9 1 shows the components used to create the cluster shown in Figure 9 10 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 21 9 4 2 3 Connecting Two UltraSCSI BA356s for Shared SCSI Bus Usage When you use two UltraSCSI BA356 storage shelves on a shared SCSI bus in a TruCluster configuration one storage shelf must be configured for SCSI IDs 0 through 6 and the other configured for SCSI IDs 8 through 14 To prepare two UltraSCS BA356 storage shelves for shared SCSI bus usage see Figure 9 11 follow these steps 1 Complete the steps of Section 9 4 1 3 for each UltraSCS I BA356 Ensure that the personality module address switches on one UltraSCSI BA356 are set to select SCSI IDs 0 through 6 and the address switches on the other UltraSCSI BA356 personality module are set to select SCSI IDs 8 through 14 2 You will need two H8861 AA VHDCI trilink connectors If either of the UltraSCS I BA356 storage shelves will be on the end of the SCSI bus attach an a H8863 AA terminator to one of the H 8861 AA trilink connectors Install the trilink with the terminator on connector J A1 of the DS BA35X DA personality module of the UltraSCSI BA356 that will be on the end of the SCSI bus Install the other H8861 AA trilink onJ Al of the DS BA35X DA personality module of the other UltraSCSI BA356
326. or 7 9 terminal server 7 9 termination 9 13 BA356 9 11 DWZZA 9 16 DWZZB 9 16 ESL9326D 8 77 terminating the shared bus 3 7 9 5 UltraSCSI BA356 9 14 termination resistors KZPBA CB 4 9t 10 4t 10 7t KZPSA 10 4t 10 7t KZPSA BB 10 7t terminators supported 2 14 TL881 8 57 TL881 891 DLT MiniLibrary cabling 8 63 8 67 capacity 8 57 8 59 components 8 58 configuring base unit as slave 8 70 models 8 57 performance 8 59 powering up 8 71 setting the SCSI ID 8 62 8 72 TL890 cabling 8 30 default SCSI IDs 8 36 powering up 8 35 setting SCSI ID 8 35 TL891 8 23 8 57 cabling 8 25 8 30 configuring as slave 8 33 default SCSI IDs 8 25 8 36 setting SCSI ID 8 24 8 35 shared SCSI usage 8 23 TL892 8 23 cabling 8 25 8 30 configuring as slave 8 33 default SCSI IDs 8 25 8 36 setting SCSI ID 8 24 8 35 shared SCSI usage 8 23 TL893 8 48 8 49 cabling 8 52 8 55 MUC switch functions 8 50 setting SCSI ID 8 51 TL894 cabling 8 41 setting SCSI ID 8 37 TL895 cabling 8 48 TL896 8 48 8 49 cabling 8 52 8 55 MUC switch functions 8 50 setting SCSI ID 8 51 transparent failover 1 13 3 17 changing to multiplebus failover 6 59 example configuration 6 10 trilink connectors connecting devices with 9 6 requirement 2 14 supported 2 14 TZ88 8 1 versions 8 1 TZ885 8 17 cabling 8 18 setting SCSI ID 8 17 TZ887 8 20 cabling 8 21 setting SCSI 1D 8 20 TZ88N
327. orum disk Worldwide ID to Disk Name Conversion Table A 1 Numbers and Special Characters 20 40 GB DLT Tape Drive 8 10 cabling 8 11 capacity 8 10 cartridges 8 10 connectors 8 10 setting SCSI ID 8 10 40 80 GB DLT Drive 8 14 cabling 8 15 capacity 8 14 cartridges 8 14 connectors 8 14 setting SCSI ID 8 14 A ACS V8 5 2 5 arbitrated loop 6 8 ATL TL893 8 48 TL896 8 48 availability increasing 4 3 BA350 9 9 preparing 9 15 preparing for shared SCSI usage 9 15 termination 9 3 9 15 BA356 9 9 DS DWZZH 03 installed in 2 12 3 9 4 7 9 29 10 3 Index DS DWZZH 05 installed in 3 10 jumper 9 9 9 12 personality module address switches 9 11 preparing 9 15 9 17 preparing for shared SCSI usage 9 16 SCSI ID selection 9 16 selecting SCSI IDs 9 11 termination 9 3 9 9 9 11 BA370 DS DWZZH 03 installed in 2 12 3 9 BC12N 10 length 2 3 BC39B 10 length 2 3 bootdef_dev 6 49 6 53 6 55 6 57 setting 6 49 6 53 6 55 6 57 bus hung message 2 11 bus_probe_ algorithm 2 9 buses data paths 3 5 extending differential 9 2 narrow data path 3 5 speed 3 5 terminating 3 7 9 5 9 8 wide data path 3 5 C caa_relocate 5 15t cables BC12N 10 2 3 5 7 BN39B 01 5 7 5 9 BN39B 010 5 9 Index 1 BN 39B 04 5 7 5 9 BN 39B 10 2 3 5 7 ESL9326D 8 77 supported 2 12 cabling 20 40 GB DLT Tape Drive 8 11 40 80 GB DLT Drive 8 15 Compaq 20 40 GB DL
328. ot disk to contain three partitions an a partition for that member s root file system a b partition for swap and an h partition for cluster status information There are no usr or var file systems on a member s boot disk A member boot disk cannot contain one of the clusterwide root usr and var file systems Also a member boot disk cannot be used as the quorum disk A member disk can contain more than the three required Introduction 1 3 1 3 1 4 partitions You can move the swap partition off the member boot disk See the TruCluster Server Cluster Administration manual for more information Quorum Disk The quorum disk allows greater availability for dusters consisting of two members Its h partition contains cluster status and quorum information See the TruCluster Server Cluster Administration manual for a discussion of how and when to use a quorum disk The following restrictions apply to the use of a quorum disk e A duster can have only one quorum disk e The quorum disk should be on a shared bus to which all cluster members are directly connected If it is not members that do not have a direct connection to the quorum disk may lose quorum before members that do have a direct connection to it e The quorum disk must not contain any data The clu_quorum command will overwrite existing data when initializing the quorum disk The integrity of data or file system metadata placed on the quorum disk from a run
329. ou can manage the DS DSGGA AA DS DSGGA AB and DS DSGGB AB switches and obtain switch status from the front panel by making a telnet connection or by accessing the Web The DS DSGGB AA and DS DSGGC AA Fibre Channel switches do not have a front panel so you must use a telnet connection or use Web access Before you can make a telnet connection or access the switch via the Web you must assign an IP address and subnet mask to the Ethernet connection using the front panel or from a PC or terminal DS DSGGB AA and DS DSGGC AA You may have to modify the DS DSGGC AA IP address from the default of 10 77 77 77 6 18 Using Fibre Channel Storage 6 5 1 2 1 Using the Switch Front Panel The switch front panel consists of a display and four buttons The display is normally not active but it lights up when any of the buttons are pressed The display has a timer After approximately 30 seconds of inactivity the display will go out The four front panel buttons are Up Upward triangle Scrolls the menu up which effectively moves down the list of commands or increases the value being displayed Down Downward triangle Scrolls the menu down which effectively moves up the list of commands or decreases the value being displayed Note When the up or down buttons are used to increase or decrease a numerical display the number changes slowly at first but changes to fast mode if the button is held down The maximum number displayed is
330. ou can use a CCMFB optical converter in conjunction with the MC2 CCMAB module to increase the distance between systems e The BN34R fiber optics cable used to connect two CCMFB optical converters is available in 10 meter BN34R 10 and 31 meter BN 34R 31 lengths e Always check a Memory Channel link cable for bent or broken pins Be surethat you do not bend or break any pins when you connect or disconnect a cable e For AlphaServer 1000A systems the Memory Channel adapter must be installed on the primary PCI in front of the PCl to PCI bridge chip in PCI slots 11 12 or 13 the top three slots e For AlphaServer 2000 systems the B2111 AA module must be at Revision H or higher For AlphaServer 2100 systems the B2110 AA module must be at Revision L or higher Usethe examine console command to determine if these modules are at a supported revision as follows P00 gt gt gt examine b econfig 20008 econfig 20008 04 P00 gt gt gt If a hexadecimal value of 04 or greater is returned the I O module supports Memory Channel If a hexadecimal value of less than 04 is returned the I O module is not supported for Memory Channel usage Order an H3095 AA module to upgrade an AlphaServer 2000 or an H3096 AA module to upgrade an AlphaServer 2100 to support Memory Channel e For AlphaServer 2100A systems the Memory Channel adapter must be installed in PCI 4 through PCI 7 slots 6 7 8 and 9 the bottom four PCI slots
331. pansion unit a base units and a data unit The library robotics expansion unit is on oneshared SCSI bus and the two tape drives in the base unit are on separate shared SCSI buses The data unit is not on a shared SCSI bus as it does not contain any tape drives but tape cartridges only Note that the pass through mechanism and cable to the library robotics motor is not shown in this figure For more information on cabling the units see Section 8 12 2 1 2 With the exception of the robotics control on the expansion module a rackmount TL881 or TL891 DLT MiniLibrary is cabled in the same manner as a tabletop unit 8 68 Configuring a Shared SCSI Bus for Tape Drive Use Figure 8 19 TL891 DLT MiniLibrary Rackmount Configuration Network Memory Member System 1 Channel Member System 2 Interface Memory Channel Memory Channel KZPBA CGB ID 6 KZPBA CB ID 7 KZPBA CB ID 6 KZPBA CB ID 7 Diag Motor Expansion Unit gt r E i Modul 4 Expansion Modules Library Robotics TL891 Base Unit 0 3 Meter Jumper Cable Robotics Control Data Unit NOTE Robotic motor and pass through mechanism not shown ZK 1628U Al Table 8 20 shows the components used to create the cluster shown in Figure 8 19 Configuring a Shared SCSI Bus for Tape Drive Use 8 69 Table 8 20 Hardware Components Used to Create the Configuration Shown in Figure 8 18 Callout Number Description
332. ports are connected to the same fabric For example in a two node cluster with two KGPSAs in each member system and an RA8000 or ESA12000 with dual redundant HSG80s there will be 16 connections for the cluster If you have other systems or clusters connected to the switches in the fabric there will be other connections for the other systems In Example 6 1 note that the exclamation mark is part of the connection name The HOST_ID isthe KGPSA host name worldwide name and the ADAPTER_ID is the port name worldwide name 6 30 Using Fibre Channel Storage Example 6 1 Determine HSG80 Connection Names HSG80 show connection Connection Name Operating system Controller NEWCON49 TRU64_ UNIX THIS HOST_ID 1000 0000 C920 DA01 NEWCON50 TRU64 UNIX THIS HOST _ID 1000 0000 C920 DA01 NEWCON51 TRU64_ UNIX THIS HOST _ID 1000 0000 C920 EDEB NEWCON52 TRU64_ UNIX THIS HOST _ID 1000 0000 C920 EDEB NEWCON53 TRU64_ UNIX OTHER HOST _ID 1000 0000 C920 EDEB NEWCON54 TRU64_ UNIX OTHER HOST _ID 1000 0000 C920 DA0 NEWCON55 TRU64_ UNIX OTHER HOST _ID 1000 0000 C920 EDEB NEWCON56 TRU64_ UNIX OTHER HOST _ID 1000 0000 C920 DA0 NEWCON61 TRU64_ UNIX THIS HOST _ID 1000 0000 C921 086C NEWCON62 TRU64 UNIX OTHER HOST _ID 1000 0000 C921 086C NEWCON63 TRU64_ UNIX OTHER HOST _ID 1000 0000 C921 0943 NEWCON64 TRU64_ UNIX OTHER HOST _ID 1000 0000 C920 EDAO NEWCON74 TRU64_ UNIX THIS HOST _ID 1000 0000 C920 EDAO NEWCON75 TRU64 UNIX THIS HOST _ ID 10
333. pply failed self test and has been powered off e An asterisk indicates that the SCM has detected the presence of the power supply but that there has been no attempt to power on the power supply The PCI drawer temperature in degrees Centigrade Example 7 4 shows the display for the show csb SCM command for an AlphaServer GS160 system Example 7 4 Displaying Console Serial Bus Information SCM EO gt show csb 1 2 3 4 5 6 CSB Type Firmware Revision FSL Revision Power State 10 PBM T05 4 03 24 01 14 T4 2 09 08 ON 11 PBM T05 4 03 24 01 14 T4 2 09 08 ON 30 PSM T05 4 03 24 01 09 T4 0 07 06 ON SrvSw NORMAL 30 XSROM T05 4 03 24 02 10 co CPUO0 SROM V5 0 7 ON GE CPU1 SROM V5 0 7 ON C2 CPU2 SROM V5 0 7 ON 7 16 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration Example 7 4 Displaying Console Serial Bus Information cont C3 co cl 31 31 c4 cs C6 C7 32 32 c8 c9 CA CB c8 C9 33 33 Ce cD CE CF 40 EO El CPU3 SROM V5 0 7 ON IORO ON IOR1 ON PSM T05 4 03 24 01 09 T4 0 07 06 ON SrvSw NORMAL XSROM T05 4 03 24 02 10 CPU0 SROM V5 0 7 ON CPU1 SROM V5 0 7 ON CPU2 SROM V5 0 7 ON CPU3 SROM V5 0 7 ON PSM T05 4 03 24 01 09 T4 0 07 06 ON SrvSw NORMAL XSROM T05 4 03 24 02 10 CPU0 SROM V5 0 7 ON CPU1 SROM V5 0 7 ON CPU2 SROM V5 0 7 ON CPU3 SROM V5 0 7 ON IORO ON IOR1 ON PSM T05 4 03
334. r BC12N or BN339B link cables hub linecards fiber optics converters BN 3A4R fiber optics cable and to some extent to the hub Indicates data flow through the Memory Channel by response messages Runs continuously until terminated with Ctrl C Reports differences in connection state not errors Can berun in standard or virtual hub mode When the console indicates a successful response from all other systems being tested the data flow through the Memory Channel hardware has been completed and the test may be terminated by pressing Ctrl C on each system being tested Example 5 1 shows a sample output from node 1 of a standard hub configuration In this example the test is started on node 1 then on node 0 The test must be terminated on each system 5 12 Setting Up the Memory Channel Cluster Interconnect Example 5 1 Running the mc_cable Test gt gt gt mc_cable 1 To exit MC_CABLE type lt Ctr1 C gt mca0 node id 1 is online No response from node 0 on mca0d mcb0 node id 1 is online No response from node 0 on mcb0O Response from node 0 on mca0 Response from node 0 on mcb0o mcbO is offline mcaO is offline Ctri C gt gt gt Nolo los iolon 1 Themc_cable diagnostic is initiated on node 1 2 Node 1 reports that mcao is on line but has not communicated with the Memory Channel adapter on node 0 3 Node
335. r GB hour Capacity 1 4 3 MB sec 1 8TB 90 10 MB sec 3 15TB 90 10 8 cartridges 36 cartridges GB hour GB hour a Using an expansion unit with a full 16 cartridge magazine Each base unit has a full 10 cartridge magazine and two tape drives Using a data unit with full 16 cartridge magazine Up to 1 5 MB sec per drive Based on 20 GB cartridge uncompressed It could be up to 40 GB cartridge compressed Up to 5 MB sec per drive 9 Based on 35 GB cartridge uncompressed It could be up to 70 GB cartridge compressed By modifying the combinations of base units and data units the performance and total capacity can be adjusted to meet the customers needs 8 12 1 4 DLT MiniLibrary Part Numbers Table 8 18 shows the part numbers for the TL881 and TL891 DLT MiniLibrary systems Part numbers are only shown for the TL881 fast wide differential components Table 8 18 DLT MiniLibrary Part Numbers Number of Tape DLT Library Component Tabletop Rackmount Part Number Drives TL881 DLT Library 1 Tabletop 128667 B21 TL881 DLT Library 2 Tabletop 128667 B 22 TL881 DLT MiniLibrary 1 Rackmount 128669 B 21 Base Unit TL881 DLT MiniLibrary 2 Rackmount 128669 B 22 Base Unit Add on DLT 20 40 drive 1 N A 128671 B21 for TL881 TL891 DLT Library 1 Tabletop 120875 B21 TL891 DLT Library 2 Tabletop 120875 B 22 TL891 DLT MiniLibrary 1 Rackmount 120876 B21 Base Unit 8 60 Configuring a Shared SCSI Bus for Tape
336. r Interconnect 5 1 5 1 1 5 1 2 5 2 5 3 5 4 5 5 5 5 1 5 5 1 1 5 5 1 2 5 5 2 5 5 2 1 5 5 2 2 5 5 2 3 5 5 2 4 5 6 5 7 Setting the Memory Channel Adapter J umpers 55 MC1 and MC1 5J UMPEFS 2 ccc cece eect eee teen MC2 JUMPE S iaeia oega gnat ti a vale Installing the Memory Channel Adapter essesssrerreeeee Installing the MC2 Optical Converter in the Member System Installing the Memory Channel Hub ccceeee eee eee Installing the Memory Channel Cables ceeeee eee Installing the MC1 or MC1 5 Cables c eee ees Connecting MC1 or MC1 5 Link Cables in Virtual Hub M O0 avi EE E tia Gale wanna ed iam ha sae Connecting MC1 Link Cables in Standard Hub Made Installing the MC2 Cables c cece eee eeee eee teens Installing the MC2 Cables for Virtual Hub Mode Without Optical Converters 0cceeeeeeee eee eee Installing MC2 Cables in Virtual Hub Mode Using Optical Converters cccceceee eee e eee rettere rnrn Connecting MC2 Link Cables in Standard Hub Mode NO Fiber Optics ccccceeeeeceeeeeeeeeeeeeeeeeennees Connecting MC2 Cables in Standard Hub Mode Using Optical Converters c cece eect treerne Running Memory Channel Diagnostics ceeeee eee Upgrading Memory Channel Adapters 0 eee sees 6 Using Fibre Channel Storage 6 1 6 2 6 2 1 6 2 2 6 2 2 1 Procedure for Installation U
337. r Server Software Installation manual and other hardware manuals as appropriate for the actual installation procedures 1 2 Install the Fibre Channel switch Section 6 5 1 Install the KGPSA PCl to Fibre Channel host bus adapter Section 6 5 2 Set up the HSG80 RAID array controllers for a fabric configuration Section 6 5 3 Configure the HSG80 disks to be used for base operating system and cluster installation Be sure to set the identifier for each storage unit you will use for operating system or cluster installation Section 6 6 1 1 and Section 6 6 1 2 Power on the system where you will install Tru64 UNIX Version 5 1 If this is a cluster installation this system will also be the first cluster member Usethe console WWID manager wwidmgr utility to set the device unit number for the Fibre Channel Tru64 UNIX Version 5 1 disk and first cluster member system boot disks Section 6 6 1 3 Use the show wwid and show n console commands to show the disk devices that are currently reachable and the paths to the devices Section 6 6 1 4 Use the WWID manager to set the bootdef_dev console environment variable for the system where you will install the Tru64 UNIX operating system Section 6 6 1 5 6 2 Using Fibre Channel Storage 10 11 12 13 See the Tru64 UNIX Installation Guide and install the base operating system from the CD ROM Theinstallation procedure will recognize the disks for which you set t
338. rail MC2 on the other rail J 4 Page size J umper pins 1 to 3 to select 8 KB J 5 AlphaServer 8x00 Mode J umper pins 1 to 2 for AlphaServer 8200 8400 GS60 GS60E and GS140 systems and jumper pins 2 to 3 for all other AlphaServer systems J 10 Fiber Optics Mode Enable J umper pins 2 to 3 to enable the use of the fiber optics modules J umper pins 1 to 2 to disable the use of fiber optics 5 If adding a Memory Channel interconnect nstall Chapter 5 and the Memory Channel adapter module Memory Channel User s Guide If this is the second system in a virtual hub configuration connect an MC1 or MC2 link cable between the MC1 or MC2 modules For a standard hub configuration use a link cable to connect the adapter to the Memory Channel hub linecard in the hub slot that corresponds to the existing Memory Channel linecard in the other hub If rolling from a dual redundant MC1 interconnect to MC2 interconnects Remove the MC1 adapter and install the MC2 adapter Virtual Hub If this is the first system in a virtual hub configuration Figure 5 2 B replace the MC1 adapter with an MC2 adapter If this is the second system in a virtual hub configuration Figure 5 2 C replace both MC1 adapters with MC2 adapters Usea BN 39B 10 link cable to connect Memory Channel adapters between systems to form the first MC2 interconnect If this is the second adapter on the first system in a Figure 5 2 D virtual hub
339. ress space has been promoted to 512 MB the active rail will use 512 MB address space A system jumpered for 128 MB cannot join the cluster The startup error message on the system jumpered for 128 MB follows panic MC2 adapter has too little memory If you have used the sysconfig command to promote Memory Channel address space to 512 MB you may need to know the actual address space being used by a logical rail Use the dbx debugger utility as follows to determine e Logical size in 8 KB pages of a rail e Physical size J 3 jumper setting for physical rails dbx k vmunix dbx p rm_log rail _to_ctx 0 gt mgmt page va gt size 1 16384 2 dbx p rm_adapters 0 gt rmp_prail va gt rmc_size 3 0 65536 4 1 0 2 65536 4 3 0 4 65536 4 5 0 6 0 7 0 5 18 Setting Up the Memory Channel Cluster Interconnect dbx p rm_adapters 1 gt rmp_prail va gt rmc_size 5 0 16384 6 1 0 2 16384 6 3 0 4 16384 6 5 0 6 0 7 0 Check the size of a logical rail The logical rail is operating at 128 MB 16384 8 KB pages Verify the jumper settings for the member systems on the first physical rail TheJ 3 jumper is set at 512 MB for nodes 0 2 and 4 on the first physical rail 65536 8 KB pages Verify the jumper settings for the member systems on the sec
340. riables but record the variables anyway SCM_EO gt show nvr COM1_PRINT_EN HP_COUNT HP QBB MASKO HP QBB MASK1 HP QBB MASK2 HP QBB MASK3 HP QBB MASK4 HP QBB MASK5 HP QBB MASK6 HP QBB MASK7 OOOO OON WNEF Remove all hardware partitions SCM_E0 gt set hp_ count 0 Note You do not need to zero the hp_qbb_maskn environment variables only the hp_count Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 19 5 Turn power on tothe system to allow SRM firmware execution The SRM codeis copied to memory on the partition primary QBB during the power up initialization sequence SRM code is executed out of memory not the SRM EEPROM on the standard I O module SCM_EO gt power on 6 Transfer control from the SCM toSRM firmware ifthe auto quit scm SCM environment variable is not set SCM_E0 gt quit POO gt gt gt 7 Usethe console show device command to determine which device is the CD ROM 8 PlacetheAlphaServer Firmware U pdate CD ROM inthe drive and boot P00 gt gt gt boot dqa0d The boot sequence provides firmware update overview information Use Return to scroll the text or press Ctrl C to skip the text After the overview information has been displayed the name of the default boot file is provided If it is the correct boot file press Return at the Boot file prompt Otherwise enter the name of the file from which you want to boot TheLFU help message shown in the
341. rives They areidentical except in the number of tape drives and the maximum capacity for tape cartridges 8 48 Configuring a Shared SCSI Bus for Tape Drive Use Each tape library comes configured with a robotic controller and bar code reader to obtain quick and accurate tape inventories The libraries have either three or six TZ89N AV drives The TL896 because it has a greater number of drives has a lower capacity for tape cartridge storage Each tape library utilizes bulk loading of bin packs with each bin pack containing a maximum of 11 cartridges Bin packs are arranged on an eight sided carousel that provides either two or three bin packs per face A library with three drives has a carousel three bin packs high A library with six drives has a carousel that is only two bin packs high This provides for a total capacity of 24 bin packs 264 cartridges for the TL 893 and 16 bin packs 176 cartridges for the TL896 The tape library specifications are as follows e TL893 TheTL893 ATL is a high capacity 264 cartridge tape library providing up to 18 4 TB of storage The TL893 uses three fast wide differential TZ89N AV DLT tape drives It has a maximum transfer rate of almost 10 MB per second compressed for each drive or a total of about 30 MB per second The TL893 comes configured for three SCSI 2 buses a three bus configuration The SCSI bus connector is high density 68 pin differential e TL896 TheTL896 ATL is a
342. rldwide name when it is manufactured An N_Port is connected directly to another N_Port in a point to point topology An N_Port is connected toan F_Portin a fabric topology In an arbitrated loop topology information is routed around a loop The information is repeated by each intermediate port until it reaches its destination The N_Port that contains this additional loop functionality is an NL_Port A switch or multiple interconnected switches that route frames between the originator node transmitter and destination node receiver The ports within the fabric fabric port This port is called an F_port Each F_port is assigned a 64 bit unique node name and a 64 bit unique port name when it is manufactured Together the node name and port name make up the worldwide name An F_Port containing the loop functionality is called an FL_Port Using Fibre Channel Storage 6 5 Link The physical connection between an N_Port and another N_Port or an N_Port and an F_Port A link consists of two connections one to transmit information and one to receive information The transmit connection on one node is the receive connection on the node at the other end of the link A link may be optical fiber coaxial cable or shielded twisted pair E Port An expansion port on a switch used to make a connection between two switches in the fabric 6 2 2 Fibre Channel Topologies Fibre Channel supports three different interconnect topologies e
343. rmination Section 4 3 3 3 resistor SIPs RM1 RM8 Figure 4 1 and KZPBA CB PCI to Ultra SCSI Differential Host Adapter User s Guide 2 Power down the member system Install KZPSA PCI to SCSI a KZPSA BB PCI to SCSI bus adapter or Storage Adapter KZPBA CB UltraSCSI host adapter in the PCI Installation and User s slot corresponding to the logical bus to be used for Guideand KZPBA CB the shared SCSI bus Ensure that the number PCl to Ultra SCSI of adapters are within limits for the system Differential H ost Adapter and that the placement is acceptable User s Guide 3 Install a BN21W 0B Y cable on each KZPSA BB or KZPBA CB host adapter 4 Install an H879 AA terminator on one leg ofthe BN21W OB Y cable of the member system that will be on the end of the shared SCSI bus 5 Power up the system and update the system Firmware release SRM console firmware and KZPSA BB host notes for the system bus adapter firmware from the latest Alpha Section 4 2 and Systems Firmware Update CD ROM Section 10 1 4 5 Note The SRM console firmware includes the SP1020 1040 based PCI option firmware which includes the KZPBA CB When you update the SRM console firmware you are enabling the KZPBA CB firmware to be updated On a powerup reset the SRM console loads KZPBA CB adapter firmware from the console system flash ROM into NVRAM for all Qlogic 1SP1020 1040 based PCI options including the KZPBA CB PClI to Ultra SCSI adapter
344. rom the CCM AB Memory Channel 2 PCI adapter tothe CCMFB optical converter Route the fiber optics cable to the remote system or hub Repeat steps 1 through 7 for the optical converter on the second system See Section 5 5 2 4 if you are installing an optical converter in an MC2 hub 5 6 Setting Up the Memory Channel Cluster Interconnect 5 4 Installing the Memory Channel Hub You may use a hub in a two node TruCluster Server cluster but the hub is not required When there are more than two systems in a cluster you must use a Memory Channel hub as follows For use with the MC1 or MC1 5 CCMAA adapter you must install the hub within 3 meters of each of the systems For use with the MC2 CCMAB adapter the hub must be placed within 4 or 10 meters the length of the BN 39B link cables of each system If fiber optics is used in conjunction with the MC2 adapter the hub may be placed up to 31 meters from the systems Ensure that the voltage selection switch on the back of the hub is set to select the correct voltage for your location 115V or 230V Ensure that the hub contains a linecard for each system in the cluster the hub comes with four linecards as follows CCMLA linecards for the CCMHA MC1 hub CCMLB linecards for the CCMHB MC2 hub Note that the linecards cannot be installed in the opto only slot If you have a four node cluster you may want to install an extra linecard for troubleshooting use If you have an eight
345. rs 3 9 bus isolation 2 12 description 2 12 installed in 2 12 3 9 4 7 9 29 10 3 internal termination 3 8 3 9 radial disconnect 2 12 SBB 3 9 SCSI ID 3 9 support on 3 9 Index 3 termpwr 3 9 transfer rate 2 12 DS DWZZH 05 3 8 3 10 bus connectors 3 10 bus isolation 2 12 configurations 3 15 description 2 12 fair arbitration 3 10 installed in 3 10 3 11 internal termination 3 8 3 9 radial disconnect 2 12 SBB 3 10 SCSI ID 3 10 termpwr 3 9 transfer rate 2 12 DS TZ89N TA cabling 8 9 setting SCSI ID 8 9 DS TZ89N VW cabling 8 8 setting SCSI ID 8 6 dual redundant controllers 1 13 DWZZA incorrect hardware revision 2 11 termination 9 3 9 16 upgrade 2 11 DW2ZZB termination 9 3 9 16 DWZZH 03 See DS DWZZH 03 E EMA12000 configuring 2 8 port configuration 2 8 transparent failover mode 2 8 unit configuration 2 8 emxmgr 6 62 displaying adapters 6 62 displaying target ID mapping 6 62 displaying topology 6 63 use 6 62 6 64 using interactively 6 65 Index 4 enterprise library See ESL9326D environment variable 7 10 bootdef_dev 6 50 6 53 6 56 6 57 hp_count 7 10 hp_qbb_maskn 7 10 N 6 44 scm_csb master eligible 7 5 7 12 wwid 6 44 ESA12000 configuring 2 8 port configuration 2 8 replacing controllers of 6 34 transparent failover mode 2 8 unit configuration 2 8 ESL9000 series tape library See ESL9326D ESL9326D cables 8
346. rt 6 SCSI Port 5 SCSI Port 4 Tape Drive 4 Sues SCSI Port 3 SCSI Port 2 Tape Drive 5 SCSI ID 1 SCSI Port 1 Tape Drive 6 SCSI ID 2 Terminator ZK 1397U Al 8 10 4 Upgrading a TL895 The TL985 DLT automated tape library can be upgraded from two or five tape drives to seven drives with multiple DS TL89X UA upgrade kits Besides the associated documentation the upgrade kit contains one TZ89N AV tape drive a SCSI bus terminator a SCSI bus jumper part number 6210567 so you can place more than one drive on the same SCSI bus and other associated hardware Before the drive is physically installed set the SCSI ID rotary switches on the library printed circuit board to the same SCSI ID that will be electronically set After the drive installation is complete set the Configuring a Shared SCSI Bus for Tape Drive Use 8 47 electronic SCSI ID using the Configure menu from the control panel see Section 8 10 2 The actual upgrade is beyond the scope of this manual See the TL895 Drive Upgrade Instructions manual for upgrade instructions 8 10 5 Connecting the TL895 Tape Library to the Shared SCSI Bus The TL895 tape library has up to 3 meters of internal SCSI cabling per SCSI bus Because of the internal SCSI cable lengths it is not possible to use a trilink connector or Y cable to terminate the SCSI bus external to the library as is done with other devices on the shared SCSI bus Each SCSI bus must be terminated intern
347. ry space allocation for Memory Channel depends on the J 3 jumper and can be 128 or 512 MB If two Memory Channel adapters are used as a failover pair to provide redundancy the address space allocated for the logical rail depends on the smaller window size of the physical adapters During a rolling upgrade see Section 5 7 from an MC1 failover pair to an MC2 failover pair the M C2 modules can be jumpered for 128 MB or 512 MB If jumpered for 512 MB the increased address space is not achieved until all MC PCI adapters have been upgraded and the use of 512 MB is enabled On one member system use the sysconfig command to reconfigure the Memory Channel kernel subsystem to initiate the use of 512 MB address space The configuration change is propagated to the other cluster member systems by entering the following command sbin sysconfig r rm rm use_512 1 Setting Up the Memory Channel Cluster Interconnect 5 3 See the TruCluster Server Cluster Administration manual for more information on failover pairs The MC2 jumpers are described in Table 5 2 Table 5 2 MC2 Jumper Configuration Jumper Description Example J 1 Hub Mode Standard Pins 1 to 2 a4 2 ao VHO Pins 2 to 3 4 ine oo VH1 None needed store the jumper on pin lor pin 3 iii 123 J 3 Window Size 512 MB Pins 2 to 3 Ba 123 128 MB Pins 1 to 2 123 J 4 Page Size 8 KB page size UNIX Pins 1 to 2 123 4 KB page size not used Pin
348. s see Figure 3 7 HSZ70 and Figure 3 8 HSZ80 and follow these steps 1 Install an H8863 AA VHDCI terminator on each of two H8861 AA VHDCI trilink connectors 3 22 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware Install H8861 AA VHDCI trilink connectors with terminators on e HSZ70 controller A and controller B e HSZ80 controller A Port 1 2 and controller B Port 1 2 Note You must use the same port on each HSZ80 controller Install the DS DWZZH 03 or DS DWZZH 05 UltraSCSI hubina DS BA356 BA356 with the required 180 watt power supply or BA370 storage shelf see Section 3 6 1 1 or Section 3 6 1 2 If you are using a e DS DWZZH 03 Install a BN37A VHDCI toVHDCI cable between the trilink connector on controller A HSZ70 or controller A Port 1 2 HSZ80 and any DS DWZZH 03 port Install a second BN37A cable between the trilink on controller B HSZ70 or controller B Port 1 2 HSZ80 and any port on the second DS DWZZH 03 e DS DWZZH 05 Verify that the fair arbitration switch isin the Fair position to enable fair arbitration see Section 3 6 1 2 2 Ensurethat the W1 jumper is removed to select wide addressing mode see Section 3 6 1 2 3 Install a BN37A cable between the DWZZH 05 controller port and the open trilink connector on HSZ70 controller A or HSZ80 controller A Port 1 2 Install a second BN37A cable between the second DWZZH 05 controller port and the open trilink
349. s 2 to 3 123 5 4 Setting Up the Memory Channel Cluster Interconnect Table 5 2 MC2 Jumper Configuration cont Jumper Description Example J 5 AlphaServer 8x00 mode selected 8x00 Mode Pins 1 to 23 123 8x00 mode not selected Pins 2 to3 i r ine o J10andJ11 Fiber Fiber Off Pins 1 to2 Optics Mode Enable N i Fiber On Pins 2 to 3 pins 3 a 1 a Increases the maximum sustainable bandwidth for 8x00 systems If the jumpers are in this position for other systems the bandwidth is decreased The MC2 linecard CCMLB has two jumpers J 2 and J 3 that are used to enable fiber optics mode The jumpers are located near the middle of the module as you view the jumper side of the module with the endplate in your left hand J umper J 2 is on the right The MC2 linecard jumpers are described in Table 5 3 Table 5 3 MC2 Linecard Jumper Configurations Jumper Description Example J 2 and J 3 Fiber Fiber Off Pins 2 to3 Mode 123 Fiber On Pins 1to2 123 Setting Up the Memory Channel Cluster Interconnect 5 5 5 2 Installing the Memory Channel Adapter Install the Memory Channel adapter in an appropriate peripheral component interconnect PCI slot see Section 2 2 Secure the module at the backplane Ensure that the screw is tight to maintain proper grounding The Memory Channel adapter comes with a straight extension plate This fits most systems however you may have to replace th
350. s has a BA356 with a DS TZ89N VW at SCSI ID 2 Table 8 2 shows the components used to create the cluster shown in Figure 8 2 8 8 Configuring a Shared SCSI Bus for Tape Drive Use 8 2 3 Setting the DS TZ89N TA SCSI ID The DS TZ89N TA has a push button counter switch on the rear panel to select the SCSI ID It is preset at the factory to 15 Push the button above the counter to increment the SCSI ID the maximum is 15 push the button below the switch to decrease the SCSI ID 8 2 4 Cabling the DS TZ89N TA Tape Drives You must connect the DS TZ89N TA tabletop model to a single ended segment of the shared SCSI bus It is connected toa differential portion of the shared SCSI bus with a DWZZB AA Figure 8 7 shows a configuration of a T885 for use on a shared SCSI bus J ust replace the TZ885 in the figure with a DS TZ89N TA and the DWZZA AA with a DWZZB AA To configure the shared SCSI bus for use with a DS TZ89N TA follow these steps 1 You will need one DWZZB AA for each DS TZ89N TA Ensure that the DWZZB jumpers W1 and W2 are installed to enable the single ended termination Remove the termination from the differential end by removing the five 14 pin SIP resistors Attach a trilink connector to the differential end of the DWZZB AA Connect the DWZZB AA single ended end to the DS TZ89N TA with a BN21K or BN21L cable 4 Install an H879 AA terminator on the other DS TZ89N TA SCSI connector 5 Connect the trilink to the differe
351. s the traditional SCSI bus priority Fair arbitration applies only to the member systems not to the storage controllers which are assigned higher priority than the member system host adapters You enable fair arbitration by placing the switch on the front of the DS DWZZH 05 UltraSCSI hub to the Fair position see Figure 3 4 Fair arbitration works as follows The DS DWZZH 05 UltraSCSI hub is assigned the highest SCSI ID whichis 7 Duringthe SCSI arbitration phase the hub because it has the highest priority captures the SCSI ID of all host adapters arbitrating for the bus The hub compares the SCSI IDs of the host adapters requesting use of the SCSI bus and then allows the device with the highest priority SCSI ID to take control of the SCSI bus That SCSI ID is removed from the group of captured SCSI IDs prior to the next comparison After the host adapter has been serviced if there are still SCSI IDs retained from the previous arbitration cycle the next highest SCSI ID is serviced When all devices in the group have been serviced the DS DWZZH 05 repeats the sequence at the next arbitration cycle Fair arbitration is disabled by placing the switch on the front of the DS DWZZH 05 UltraSCSI hub in the Disable position see Figure 3 4 With fair arbitration disabled the SCSI requests are serviced in the conventional manner the highest SCSI ID asserted during the arbitration cycle obtains use of the SCSI bus Note Host port SCSI I
352. segment that is terminated by the DW2ZZB single ended termination and the BA356 termination on the personality module The use of a 1 meter cable keeps the single ended 9 16 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices SCSI bus cable and BA356 under the 3 meter limit to still allow high speed operation If you are using a DWZZB VW install it in slot 0 of the BA356 9 4 1 3 Preparing an UltraSCS BA356 Storage Shelf for a TruCluster Configuration An UltraSCS I BA356 storage shelf is connected to a shared UltraSCSI bus and provides access to UltraSCSI devices on the internal single ended and wide UltraSCSI bus The interface between the buses is the DS BA35X DA personality module installed in the UltraSCSI BA356 To prepare an UltraSCS BA356 storage shelf for usage on a shared SCSI bus follow these steps 1 Ensurethat the BA35X MJ jumper module is installed behind slot 6 see Section 9 3 2 1 Figure 9 7 and Figure 9 8 2 Set the SCSI bus ID switches on the UltraSCS BA356 personality module DS BA35X DA Figure 9 3 as follows e If the UltraSCSI BA356 is to house disks with SCSI IDs in the range of 0 through 6 set the personality module address switches S3 1 through S3 7 to OFF e Ifthe UltraSCSI BA356 is to house disks with SCSI IDs in the range of 8 through 14 set personality module address switches S3 1 through S3 3 to ON and switches S3 4 through S3 7 to OFF 3 Disable th
353. selected and then press the Enter button to display the Configure submenu 5 Press the down arrow button until the Set SCSI item is selected and press the Enter button 6 Press the up or down arrow button to select the appropriate tape drive DLTO Bus ID DLT1 Bus ID DLT2 Bus ID and so on or library robotics Library Bus D for which you wish to change the SCSI bus ID Assuming that each base module has two tape drives the top base module contains DLTO and DLT1 The next base module down contains DLT2 and DLT3 The bottom base module contains DLT4 and DLT5 The default SCSI IDs after being reconfigured by the expansion unit are as follows e Library Bus D 0 e DLTOBus ID e DLT1Bus ID e DLT2 Bus ID e DLT3 Bus ID e DLT4Bus ID e DLT5 Bus D 6 7 Press Enter when you have the item selected for which you wish to change the SCSI ID 8 Usetheup and down arrows to select the desired SCSI ID Press the Enter button to save the new selection U B U N BE 9 Press the Escape button once to return to the Set SCSI submenu to select another tape drive or the library robotics and then repeat steps 6 7 and 8 toset the SCSI ID 10 If there are other items you wish to configure press the Escape button until the Configure submenu is displayed then select the item to be configured Repeat this procedure for each item you wish to configure 11 If there are no more items to be configured press the Escape button until the D
354. selecting the appropriate option shown in the following example When you start the emxmgr utility with no command line options the default device used is the first Fibre Channel adapter it finds If you want to perform functions for another adapter you must change the targeted adapter to the correct adapter For instance if emxo is present when you start the emxmgr interactively any commands executed to display information will provide the information for emxo Notes The emxmgr has an extensive help facility in the interactive mode Option 3 Change Target ID Mappings is a hold over from the Tru64 UNIX Version 4 0F product and has no use in the Tru64 UNIX Version 5 1 product Do not use this option An example using the emxmgr in the interactive mode follows emxmgr Now issuing commands to emx0 Select Option against emx0 1 View adapter s current Topology 2 View adapter s Target Id Mappings 3 Change Target ID Mappings d Display Attached Adapters a Change targeted adapter Using Fibre Channel Storage 6 65 emx0 SCSI target SCSI SCSI SCSI SCSI Select Op tgt id tgt id tgt id tgt id id assignments 0 portname nodename portname nodename portname nodename portname nodename tion against emx0 5000 1FE1 0000 0CB2 5000 1FE1 0000 0CBO 1000 0000 C920 A7AE 1000 0000 C920 A7AE 1000 0000 C920 CD9IC 1000 0000 C920 CD9IC 1000 0000 C921 0D00 1000 0000 C921 0D00
355. sing Fibre Channel Disks Fibre Channel Overview ccceecee eee eee eee teeta eens Basic Fibre Channel Terminology cceeeee eee eee Fibre Channel Topologies ccceeeeeee eee tenet aes Pohnt EO POINE soita eiea naa Perper Taiaha bovine Bes ae a NMN PAAPAA Q NNNOO TPP O A l OOA Contents v 6 2 2 2 6 2 2 3 PADI E E E TAA E A Arbitrated Loop Topology ssssssssesseseessesesrssres Example Fibre Channel Configurations Supported by TruCluster Server cccccccecceeeeseeeeeeseeeeeeeeeseeneeesenaeeres 6 3 1 Fibre Channel Cluster Configurations for Transparent Failover MOd 6 ciee cee ssceek cadet ene aa dese eyebhed eee 6 3 2 Fibre Channel Cluster Configurations for Multiple Bus Failover Modein el euena tiaa e etna eee iadaaa 6 4 Zoning and Cascaded Switches eececcecceccec tence teat ees 6 4 1 ZONING EE eka veiw tah eve device seve evieadiae reeeces 6 4 2 Cascaded Switches cc cece cece cnet eee eee eae eae 6 5 Installing and Configuring Fibre Channel Hardware 6 5 1 Installing and Setting Up the Fibre Channel Switch 6 5 1 1 Installing the Switch cece cece ee eee eee 6 5 1 2 Managing the Fibre Channel Switches 6 5 1 2 1 Using the Switch Front Panel seese 6 5 1 2 2 Setting the Ethernet IP Address and Subnet Mask from the Front Panel 0 cceeeee eee eeae ees 6 5 1 2 3 Setting the DS DSGG
356. sks and configure the storagesets For detailed information about installation and configuration see your storage shelf or RAID array controller documentation Note The following sections mention only the KZPBA CB UltraSCSI host bus adapter because it is needed to obtain UltraSCSI speeds for UltraSCSI configurations The KZPSA BB host bus adapter may be used in any configuration in place of the KZPBA CB without any cable changes providing that it is supported on the member system Be aware though the KZPSA BB is not an UltraSCSI device and therefore only works at fast wide speed 20 MB sec The following sections describe how to prepare and install cables for storage configurations on a shared SCSI bus using UltraSCSI hubs and the HSZ70 or HSZ80 RAID array controllers 3 16 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 7 1 Configuring Radially Connected TruCluster Server Clusters with UltraSCSI Hardware Radial configurations with RAID array controllers allow you to take advantage of the benefits of hardware mirroring and to achieve a no single point of failure NSPOF cluster Typical RAID array storage subsystems used in TruCluster Server cluster configurations are e RA7000 or ESA10000 with HSZ70 controller e RA7000 or ESA10000 with HSZ80 controller e RA8000 or ESA12000 with HSZ80 controller When used with TruCluster Server one advantage of using a RAID array controller is the ability to hard
357. slots in a BA356 StorageWorks enclosure The following sections describe how to prepare the TZ89 in more detail 8 2 1 Setting the DS TZ89N VW SCSI ID The DS TZ89N VW backplane connector makes a connection with the backplane in the middle of the three slots occupied by the drive If the switches are set to automatic to allow the backplane position to select the SCSI ID the ID corresponds to the backplane position of the middle slot For example if the DS TZ89N VW is installed in a BA356 in slots 1 2 and 3 the SCSI ID is 2 If it is installed in slots 3 4 and 5 the SCSI ID is 4 Figure 8 3 shows a view of the DS TZ89N VW showing the backplane interface connector and SCSI ID switch pack 8 6 Configuring a Shared SCSI Bus for Tape Drive Use Figure 8 3 DS TZ89N VW SCSI ID Switches Backplane Interface Connector SCSI ID Switch Pack Locking Handles DS TZ89N VW The SCSI ID is selected by switch positions which must be selected before the tape drive is installed in the BA356 Table 8 3 shows the switch settings for the DS TZ89N VW Table 8 3 DS TZ89N VW Switch Settings SCSI ID SCSI ID Selection Switches 1 2 3 4 5 6 7 8 Automatic Off Off Off Off On On On On 0 Off Off Off Off Off Off Off Off 1 On Off Off Off Off Off Off Off 2 Off On Off Off Off Off Off Off 3 On On Off Off Off Off Off Off 4 Off Off On Off Off Off Off Off Configuring a Shared SCSI Bus for Tape Drive Use 8 7 Tabl
358. sp Console Environment Variables To determine the console environment variables to use execute the show pk and show isp console commands Example 10 5 shows the pk console environment variables for an AlphaServer 4100 Example 10 5 Displaying the pk Console Environment Variables on an AlphaServer 4100 System P00 gt gt gt show pk pkaO_disconnect 1 pkaO_fast 1 pkaO_host_id 7 pkboO_ disconnect 1 pkbo fast 1 pkboO_host_id 7 pkcO_host_id 7 pkcO_ soft term diff pkd0_host_id 7 pkd0_soft_term on pke0_fast 1 pke0_host_id 7 pke0_termpwr 1 Configuring Systems for External Termination or Radial Connections to Non UltraSCSI Devices 10 13 Example 10 5 Displaying the pk Console Environment Variables on an AlphaServer 4100 System cont pkf0 fast 1 pkf0_host_id 7 pk 0_termpwr 1 Compare the show pk command display in Example 10 5 with the show config command in Example 10 1 and the show dev command in Example 10 2 Note that there are no pk devices in either display Example 10 2 shows e The NCR 53C810 SCSI controllers as nero and ncr1 with disk DKa and DKb pka and pkb e TheQlogicISP1020 devices K ZPBA CBs as ispo and isp1 with disks DKc and DKd pkc and pkd e TheKZPSA BBs with disks DKe and DKf pke and pk Example 10 5 shows two pk 0_soft_term environment variables pkc0_soft_term whichis on and pkd0_soft_term which is diff The pk 0_soft_term environment variable applies to systems using th
359. t HSZ70 or HSZ80 for transparent failover in a TruCluster Server configuration using a DS DWZZH 03 or DS DWZZH 05 UltraSCSI hub see Figure 3 5 HSZ70 or Figure 3 6 HSZ80 and follow these steps 1 You will need two H8861 AA VHDCI trilink connectors Install an H8863 AA VHDCI terminator on one of the trilinks 3 18 Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware Attach the trilink with the terminator to the controller that you want to be on the end of the shared SCSI bus Attach an H8861 AA VHDCI trilink connector to e HSZ70 controller A and controller B e HSZ80 Port 1 2 of controller A and Port 1 2 of controller B Note You must use the same port on each HSZ80 controller Install a BN37A cable between the trilinks on e HSZ70 controller A and controller B e HSZ80 controller A Port 1 2 and controller B Port 1 2 The BN37A 0C is a 0 3 meter cable and the BN37A 0E is a 0 5 meter cable Install the DS DWZZH 03 or DS DWZZH 05 UltraSCSI hub in an UltraSCSI BA356 non UltraSCS BA356 with the required 180 watt power supply or BA370 storage shelf see Section 3 6 1 1 or Section 3 6 1 2 If you are using a e DWZZH 03 Install a BN37A cable between any DWZZH 03 port and the open trilink connector on HSZ70 controller A B or HSZ80 controller A Port 1 2 or controller B Port 1 2 e DW2ZZH 05 Verify that the fair arbitration switch isin the Fair position to enable fair arbitration s
360. t PCI buses see Figure 2 1 PCIO for I O riser 0 Slots 0 0 1 0 2 and 0 3 PCI1 for I O riser 0 Slots 0 4 0 5 0 6 and 0 7 PCIO for I O riser 1 Slots 1 1 1 2 and 1 3 PCI1 for I O riser 1 Slots 1 4 1 5 1 6 and 1 7 Note Slot 0 0 1 in a primary PCI drawer contains the standard 1 O module Figure 2 1 PCI Backplane Slot Layout I O Riser 1 I O Riser 0 1 7 1 6 1 5 1 4 1 R 1 3 1 2 1 1 0 7 0 6 0 5 0 4 0 R 0 3 0 2 0 0 1 PCI 1 PCI O PCI 1 PCI O ZK 1748U AI e TruCluster Server does not support the XMI CIXCD on an AlphaServer 8x00 GS60 GS60E or GS140 system 2 2 Hardware Requirements and Restrictions 2 2 Memory Channel Restrictions The Memory Channel interconnect is used for cluster communications between the member systems There are currently three versions of the Memory Channel product Memory Channel 1 Memory Channel 1 5 and Memory Channel 2 The Memory Channel 1 and Memory Channel 1 5 products are very similar the PCI adapter for both versions is the CCMAA module and are generally referred to as MC1 throughout this manual The Memory Channel 2 product CCMAB module is referred toas MC2 Ensurethat you abide by the following Memory Channel restrictions The DS10 DS20 DS20E ES40 GS80 GS160 and GS320 systems only support M C2 hardware If redundant Memory Channel adapters are used with a DS10 they must be jumpered for 128 MB and not the default of 512 MB If you hav
361. t the PC or terminal from the DS DSGGB AA or DS DSGGC AA switch 6 5 1 2 4 Logging In to the Switch with a Telnet Connection Before you telnet to a Fibre Channel switch you must set the Ethernet IP address and subnet mask Note A serial port connection and a telnet session cannot both be active at the same time with the DS DSGGB AA and DS DSGGC AA switch The telnet session takes precedence and the serial port session is aborted when the telnet session is started You can use a telnet session to log in to the switch at one of three security levels The default user names shown from lowest security level to highest security level are shown in Table 6 1 Table 6 1 Telnet Session Default User Names for Fibre Channel Switches DSGGA DSGGB or Description DSGGC other n a Allows you to execute commands ending in Show such as dateShow and portShow user user Allows you to execute all commands ending in Show plus any commands from the help menu that do not change the state of the switch for example version and errDump You can change the passwords for all users up to and including the current user s security level admin admin Provides access to all the commands that show upin thehelp menu Most switch administration is done when logged in as admin n a root Gives users access to an extensive command set that can significantly alter system performance Root commands should only be used at the request of
362. tch type status temperature and a report of which QBBs are connected to the H switch In this example QBBs 0 1 2 and 3 are connected to the H switch Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 15 16 Console serial bus node ID for PCI drawers In this example the first PCI drawer has node ID 10 The second PCI drawer has node ID 11 Note that in this case the node ID switches are set to 0 and 1 The status of each of the four PCI buses in a PCI drawer An s indicates that a standard I O module is present Other modules present in a slot are identified by their power dissipation e 1 Lower power dissipation e M Medium power dissipation e H High power dissipation e Dash There is no module in that slot In this example the PCI modules with m medium power dissipation are Memory Channel and Fibre Channel to PCI host bus adapters The presence or absence of the I O riser modules in the PCI drawer An asterisk indicates that a module is present The status of the PCI drawer power supplies as follows e A P uppercase indicates that the power supply is powered on and passed self test e A p lowercase indicates that the power supply passed self test but has been powered off e An F uppercase indicates that the power supply is powered on and failed self test e An lowercase indicates that the power su
363. tches on the personality module DS BA35X DA determine whether the disks respond to SCSI IDs 0 through 6 slot 7 is the power supply or 8 through 14 slot 15 is the power supply To select SCSI IDs O through 6 set switches S3 1 through S3 7 to off To select SCSI IDs 8 through 14 set personality module address switches S3 1 through S3 3 toon and switches 3 4 through S3 7 to off The jumper module is positioned behind slot 6 as with the non UltraSCSI BA356 shown in Figure 9 7 For operation within a TruCluster Server cluster you must install the jumper You verify the presence or absence of the jumper or terminator modules the same as for the non UItraSCSI Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 13 BA356 as shown in Figure 9 8 With proper lighting you will be able to see aj or T near the hole where the pin sticks through Termination for both ends of the UltraSCS I BA356 internal single ended bus is on the personality module and is always active Termination for the differential UltraSCSI bus is also on the personality module and is controlled by the SCSI bus termination switches switch pack S4 DS BA35X DA termination is discussed in Section 9 1 2 2 9 4 Preparing the Storage for Configurations Using External Termination A TruCluster Server cluster provides you with high data availability through the cluster file system CFS the device request dispatcher DRD service fai
364. ted 3 2 SCSI bus with BA350 and BA356 9 18 SCSI bus with Two BA356s 9 20 SCSI bus with two UltraSCSI BA356s 9 22 SCSI buses Seeshared SCSI buses SCSI cables See cables requirement 2 13 SCSI controllers bus speed for 3 5 SCSI ID selection 9 17 BA356 9 16 SCSI IDs BA350 9 9 BA350 storage shelves 9 15 BA356 9 11 9 16 HSZ20 controller 9 24 HSZ40 controller 9 24 HSZ50 controller 9 24 in BA356 9 11 in UltraSCS BA356 9 13 RAID subsystem controllers 9 24 requirement 3 5 UltraSCS I BA356 9 13 9 17 SCSI targets number of 2 8 SCSI terminators supported 2 14 SCSI 2 bus 3 5 selecting BA356 disk SCSI IDs 9 11 selecting UltraSCS BA356 disk SCSI IDs 9 13 set bootdef_dev 6 50 6 56 6 57 set hp_count 7 10 set hp_qbb_maskn 7 10 set scm_csb_master_eligible 7 12 setting bus speed KZPSA 10 17 setting SCSI ID 20 40 GB DLT Tape Drive 8 10 40 80 GB DLT Drive 8 14 Compaq 20 40 GB DLT Tape Drive 8 10 Compaq 40 80 GB DLT Drive 8 14 DS TZ89N TA 8 9 DS TZ89N VW 8 6 KZPSA 10 17 Index 9 MUC 8 51 TL881 891 DLT MiniLibrary 8 72 TL891 8 23 TL892 8 23 TL893 8 51 TL894 8 37 TL896 8 51 TZ885 8 17 TZ887 8 20 TZ88N TA 8 5 TZ88N VA 8 2 setting SCSI IDs ESL9326D 8 75 setting the SCSI ID TL881 891 DLT MiniLibrary 8 62 shared SCSI buses 4 3 adding devices 9 6 assigning SCSI IDs 3 6 cable length restrictions 3 6 connecting devices 3 7 9 6 device addresses 3 5 differential 3
365. terminator at each end of the bus segment Up totwo UltraSCSI bus segments may be coupled together with UltraSCsl hubs or signal converters increasing the total length of the UltraSCSI bus 3 2 2 Transmission Methods Two transmission methods can be used in a SCSI bus e Single ended In a single ended SCSI bus one data lead and one ground lead are utilized for the data transmission A single ended receiver looks only at the signal wire as the input The transmitted signal arrives at the receiving end of the bus on the signal wire somewhat distorted by signal reflections The length and loading of the bus determine the magnitude of this distortion This transmission method is economical but is more susceptible to noise than the differential transmission method and requires short cables Devices with single ended SCSI devices include the following BA350 BA356 and UltraSCS BA356 storage shelves Single ended side of a SCSI signal converter or personality module e Differential Differential signal transmission uses two wires to transmit a signal The two wires are driven by a differential driver that places a signal on one wire SIGNAL and another signal that is 180 degrees out of phase SIGNAL on the other wire The differential receiver generates a signal output only when the two inputs are different As signal reflections occur virtually the same on both wires they are not seen by the receiver because it only sees differ
366. the HSG60 and HSG80 RAID controller support the 50 micron Gigabit Link Module GLM for fiber connections Therefore only the 50 micron multimode fiber optical cable is supported between the KGPSA and switch and the switch and HSG60 or HSG80 for cluster configurations You must install GBIC SW GBICsin the DSGGA and DSGGB Fibre Channel switches or one DSGGC open port for communication between the switches and KGPSA or HSG60 H SG80 Hardware Requirements and Restrictions 2 7 A maximum of three cascaded switches is supported with a maximum of two hops between switches The maximum hop length is 10 km longwave single mode or 500 meters via shortwave multimode F ibre Channel cable e Tru64 UNIX Version 5 1 limits the number of Fibre Channel targets to 126 e Tru64 UNIX Version 5 1 allows up to 255 LUNs per target e TheHSG60 and HSG80 supports transparent and multiple bus failover mode when used in a TruCluster Server Version 5 1 configuration Multiple bus failover is recommended for high availability in a cluster e A storage array with dual redundant HSG60 or HSG80 controllers in transparent mode failover is two targets and consumes four ports on a switch e A storage array with dual redundant HSG60 or HSG80 controllers in multiple bus failover is four targets and consumes 4 ports on a switch e Each KGPSA is one target e The HSG60 and HSG80 documentation refers to the controllers as Controllers A top and B bottom Each con
367. the KZPBA CB or KZPSA BB host bus adapter to each of the other two DS DWZZH 03 ports e DS DWZZH 05 Install a BN38C or BN38D HD68 to VHDCI cable between the K ZPBA CB or KZPSA BB host bus adapter on each system to a port on the DWZZH hub Ensure that the host bus adapter SCSI ID matches the SCSI ID assigned to the DWZZH 05 port it is cabled to 12 13 14 and 15 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 29 Figure 9 14 shows a sample configuration with radial connection of KZPSA BB PCl to SCSI adapters DS DWZZH 03 UltraSCSI hub and an HSZ50 RAID array controller Note that the KZPSA BBs could be replaced with KZPBA CB UltraSCSI adapters without any changes in cables Figure 9 14 TruCluster Server Cluster Using DS DWZZH 03 SCSI Adapter with Terminators Installed and HSZ50 Network Member Member System System 1 2 Memory Channel KZPSA BB ID 7 Memory Channel Interface Nemo Orama T KZPSA BB ID 6 DS DWZZH 03 ZK 1766U Al Table 9 4 shows the components used to create the cluster shown in Figure 9 14 Table 9 4 Hardware Components Used in Configuration Shown in Figure 9 14 Callout Number Description 1 BN38C cable gt 2 H885 AA HD68 trilink connector 3 H879 AA HD68 terminator 4 BN21K or BN21L cable a The maximum length of the BN 38C cable on one SCSI bus segment must not exceed 25 meters
368. the SCSI ID For a TruCluster Server cluster you will most likely have to set the SCSI ID for all KZPBA CB UltraSCSI adapters except one And if you are using a DS DWZZH 05 you will have to set the SCSI IDs for all KZPBA CB UltraSCSI adapters Notes You will have problems if you have two or more SCSI adapters at the same SCSI ID on any one SCSI bus If you are using a DS DWZZH 05 you cannot use SCSI ID 7 for aK ZPBA CB UltraSCSI adapter SCSI ID 7 is reserved for DS DWZZH 05 use If DS DWZZH 05 fair arbitration is enabled The SCSI ID of the host adapter must match the SCSI ID assigned to the hub port Mismatching or duplicating SCSI IDs will cause the hub to hang SCSI ID 7 is reserved for the DS DWZZH 05 whether fair arbitration is enabled or not Use the set console command as shown in Example 4 7 to set the SCSI ID In this example the SCSI ID is set for KZPBA CB pkc on the AlphaServer DS20 shown in Example 4 5 Example 4 7 Setting the KZPBA CB SCSI Bus ID P00 gt gt gt show pkcO_ host _id yi POO gt gt gt set pkcO host_id 6 P00 gt gt gt show pkcO_ host _id 6 4 3 3 3 KZPBA CB Termination Resistors The KZPBA CB internal termination is disabled by removing the termination resistors RM1 RM8 as shown in Figure 4 1 TruCluster Server System Configuration Using UltraSCSI Hardware 4 17 Figure 4 1 KZPBA CB Termination Resistors Internal Narrow Device Internal Wide Device Connector P2 Connector J2
369. the devices without affecting bus termination See Section 9 2 for more information Be careful when performing maintenance on any device that is ona shared bus because of the constant activity on the bus Usually to perform maintenance on a device without shutting down the cluster you must be able to isolate the device from the shared bus without affecting bus termination All supported UltraSCSI host adapters support UltraSCSI disks at UltraSCSI speeds in UltraSCSI BA356 shelves RA7000 or ESA10000 3 2 Shared SCSI Bus Requirements and Configurations Using UltraSCS I Hardware storage arrays HSZ70 and HSZ80 or RA8000 or ESA12000 storage arrays HSZ80 and HSG80 Older non UltraSCSI BA356 shelves are supported with UltraSCSI host adapters and host RAID controllers as long as they contain no UltraSCSI disks e UltraSCSI drives and fast wide drives can be mixed together in an UltraSCSI BA356 shelf see Chapter 9 e Differential UltraSCSI adapters may be connected to either or both a non UltraSCS BA356 shelf via a DWZZB VW and the UltraSCSI BA356 shelf via the DS BA35X DA personality module on the same shared SCSI bus The UltraSCSI adapter negotiates maximum transfer speeds with each SCSI device See Chapter 9 e TheHSZ70 and HSZ80 UltraSCSI RAID controllers have a wide differential UltraSCSI host bus with a Very High Density Cable Interconnect VH DCI connector HSZ70 and HSZ80 controllers will work with fast and wide differ
370. the physical interface Fibre Channel with its serial transmission method overcomes the limitations of parallel SCSI by providing e Data rates of 100 MB sec 200 MB sec and 400 MB sec e Support for multiple protocols e Better scalability Improved reliability serviceability and availability Fibre Channel uses an extremely high transmit clock frequency to achieve the high data rate Using optical fibre transmission lines allows the high frequency information to be sent up to 40 km the maximum distance between transmitter and receiver Copper transmission lines may be used for shorter distances 6 4 Using Fibre Channel Storage 6 2 1 Basic Fibre Channel Terminology The following list describes the basic Fibre Channel terminology Frame Node N_Port NL_Port Fabric F_Port FL_Port All data is transferred in a packet of information called a frame A frame is limited to 2112 bytes If the information consists of more than 2112 bytes it is divided up into multiple frames The source and destination of a frame A node may be a computer system a redundant array of independent disks RAID array controller or a disk device Each node has a 64 bit unique node name worldwide name that is built into the node when it is manufactured Each node must have at least one Fibre Channel port from which to send or receive data This node port is called an N_Port Each port is assigned a 64 bit unique port name wo
371. ther by depicting the required storage in storage shelves The storage shelves could be BA350 BA356 non UItraSCSl or UltraSCSI BA356s The BA350 is the oldest model and can only respond to SCSI IDs 0 6 The non Ultra BA356 can respond to SCSI Ds 0 6 or 8 14 see Section 3 2 The UltraSCSI BA356 also responds to SCSI Ds 0 6 or 8 14 but also can operate at UltraSCSI speeds see Section 3 2 Figure 1 3 shows a TruCluster Server configuration using an UltraSCSI BA356 storage unit The DS BA35X DA personality module used in the UltraSCSI BA356 storage unit is a differential to single ended signal converter and therefore accepts differential inputs Introduction 1 7 1 8 Figure 1 3 Minimum Two Node Cluster with UltraSCSI BA356 Storage Unit Network Member Member System System 1 Memory 2 Channel Memory Channel Memory Channel Interface Host Bus Adapter ID 6 Host Bus Adapter ID 7 _ z UltraSCSI SCSI BA356 SCSI Clusterwide lusr var DS BA35X DA Member 1 Personality Boot Disk Module Member 2 Boot Disk Clusterwide Data Disks Do not use for data disk May be used for redundant power supply ZK 1591U Al The configuration shown in Figure 1 3 might represent a typical small or training configuration with TruCluster Server Version 5 1 required disks In this configuration because of the TruCluster Server Version 5 1 disk requirements there will only
372. ths to the member system boot disk as follows a Obtain the device name and worldwide name for the Fibre Channel unit from where you will boot see Table 6 2 Ensure that you choose the correct device name for the entity you are booting cluster member system 2 cluster member system 3 and so on b Check the reachability display Example 6 7 provided by the wwidmgr quickset command for the device names that can access the storage unit from where you are booting Check the show dev command output to ensure the device name may be assigned tothe bootdef_dev console environment variable Notes You should choose device names that show up as both Yes and No in the reachability display connected column Keep in mind that for multiplebus failover only one controller is normally active for a storage unit You must ensure that the unit is reachable if the controllers have failed over If you have multiple Fibre Channel host bus adapters you should use device names for at least two host bus adapters For example to ensure that you have a connected boot path in case of a failed host bus adapter or controller failover choose device names for multiple host bus adapters and each controller port For example if you use the reachability display shown in Example 6 7 you could choose the following device names when setting the bootdef_dev console environment variable for the second cluster member system 6 56 Using Fibre Channel Storage
373. ting the Compaq 20 40 GB DLT Tape Drive SCSI ID Cabling the Compaq 20 40 GB DLT Tape Drive Compaq 40 80 GB DLT Drive sses Setting the Compaq 40 80 GB DLT Drive SCSI ID Cabling the Compaq 40 80 GB DLT Drive 55 Preparing the TZ885 for Shared SCSI Usage 0000 Setting the TZ885 SCSI ID eee eeeee eee eee eee eae ees Cabling the TZ885 Tape Drive cece cece eee eee eee Preparing the TZ887 for Shared SCSI Bus Usage Setting the TZ887 SCSI ID oo cece eects Cabling the TZ887 Tape Drive cece eee eee teeta Preparing the TL891 and TL892 DLT MiniLibraries for Shared SCSI USage 0 cce cece eee e eee eee aaa EAT ees Setting the TL891 or TL892 SCSI ID cc cece ee ees Cabling the TL891 or TL892 MiniLibraries Preparing the TL890 DLT MiniLibrary Expansion Unit TL890 DLT MiniLibrary Expansion Unit Hardware Preparing the DLT MiniLibraries for Shared SCSI Bus Usage enina Ne iets haere seaweed a e AO aE tte Cabling the DLT MiniLibraries ccceeeeees Configuring a Base Module as a Slave n n Powering Up the DLT MiniLibrary 085 Setting the TL890 TL891 T L892 SCSI ID Preparing the TL894 DLT Automated Tape Library for Shared SCSI BUS USAGE wate a aaa atin ATAT TL894 Robotic Controller Required Firmware Setting TL894 Robotics Controller and Tape Drive SCSI
374. tion 2 8 MA8000 configuring 2 8 port configuration 2 8 transparent failover mode 2 8 unit configuration 2 8 mc_cable 5 12 mc_diag 5 12 member systems improving performance 4 2 increasing availability 4 2 requirements 2 1 Memory Channel diagnostics 5 12 installation 5 2 5 6 interconnect 2 5 jumpers 5 2 optical converter installation 5 6 5 10 5 11 versions 2 3 Memory Channel diagnostics mc_cable 5 12 mc_diag 5 12 Memory Channel fiber optics optical converter installation 5 6 5 10 5 11 Memory Channel hub installation 5 7 Memory Channel interconnects restrictions 2 3 rolling upgrade 5 14 setting up 5 1 message bus hung 2 11 MiniLibrary TL881 8 57 TL891 8 57 minimum cluster configuration 1 4 MUC 8 49 setting SCSI ID 8 51 MUC switch functions TL893 8 50 TL896 8 50 Index 7 multi unit controller SeeMUC multimode fibre 6 17 multiple bus failover 1 14 3 18 3 22 6 30 changing from transparent failover 6 59 example configurations 6 12 NSPOF 3 18 setting 6 30 6 59 N N_Port 6 5 NL_Port 6 5 node name 6 33 non U Itra BA356 storage shelf preparing 9 15 NSPOF 1 12 3 18 O planning the hardware configuration 4 2 point to point 6 6 port name 6 33 power system manager SeePSM powering up TL881 891 DLT MiniLibrary 8 71 preparing storage shelves BA350 9 15 BA350 and BA356 9 18 BA356 9 16 9 20 UltraSCS I BA356 9 17 9 22 Prestoserve
375. tion Shown in Figure 8 5 cont Callout Number Description 9 199629 002 or 189636 002 68 pin high density to 50 pin high density 1 8 meter cables 10 341102 001 50 pin high density terminator a The maximum length of the BN38C or BN38D cable on one SCSI bus segment must not exceed 25 meters The maximum length of the BN37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters 8 4 Compaq 40 80 GB DLT Drive The Compaq 40 80 DLT Drive is a Digital Linear Tape DLT table top cartridge tape drive that can hold up to 80 GB of data per DLT IV cartridge using 2 1 compression It can store and retrieve data at a rate of up to 43 2 GB per hour using 2 1 compression The Compaq 40 80 DLT Drive uses DLT II1 DLT III XT or DLT IV media This tape drive works with either a single ended or low voltage differential LVD host bus adapter using 68 pin high density connectors The single ended voltages are either OV or 5V The low voltage differential voltages range from 2 5V to 2 5V a 5 0V differential It will not work with high voltage differential 5 0V to 5 0V host bus adapters Therefore you cannot connect the KZPSA BB or KZPBA CB host bus adapters directly to the Compaq 40 80 DLT Drive Instead you must use a DWZZB AA signal converter to convert the high voltage differential to single ended SCSI For more information on the Compaq 40 80 DLT Drive see the Compaq Stor
376. tion on an AlphaServer 8200 Displaying Devices on an AlphaServer 8200 0685 Displaying the pk Console Environment Variables on an AlphaServer DS20 System cccceceee eee e eee eee eee teen ees 4 6 Displaying Console Variables for a KZPBA CB on an AlphaServer 8x00 System cccce eect eee eee ee eae eee 4 7 Setting the KZPBA CB SCSI BuSID esee 9 28 9 28 10 13 10 13 10 16 10 17 10 18 10 18 Contents xi Figures xii 14 Contents Running the mc_cable Test cece eee eee eee eee eaten ene Determine HSG80 Connection Names cceeeeee eee eee Setting Up the Mirrorset cccceee eee ee eect eee eee eee Adding Units and Identifiers to the HSG80 Storagesets Displaying the UDID and Worldwide Names of Devices Known to the Console ez narret n a a aa deenne yeh anesaea ah Using the wwidmgr quickset Command to Set the Device Unit NUMBER otf peck eta cash ab as Gdonh eet hath a hn Qh mis Sample Fibre Channel Device Names c cee eee ee ee eae Setting Device Unit Number for Additional Member System Defining Hard Partitions with SCM Environment Variables Turning Partition Power ON ccceee eee eee e eee ee teens Displaying AlphaServer GS160 System Information Displaying Console Serial Bus Information 605 Displaying Configuration on an AlphaServer 4100 Displaying Devices
377. to Non UltraSCSI Devices This chapter describes the requirements for the shared SCSI bus using e Externally terminated TruCluster Server configurations e Radial configurations with non UltraSCSI RAID array controllers In addition to using only the supported hardware adhering to the requirements described in this chapter will ensure that your cluster operates correctly This chapter discusses the following topics e Using SCSI bus signal converters Section 9 1 e SCSI bus termination in externally terminated TruCluster Server configurations Section 9 2 e Overview of the BA350 BA356 and UltraSCSI BA356 disk storage shelves Section 9 3 e Preparing the storage configuration for external termination using Y cables and trilinks Section 9 4 Preparing the storage shelves for an externally terminated TruCluster Server configuration Section 9 4 1 Connecting multiple storage shelves for instance a BA350 anda BA356 two BA356s or two UltraSCSI BA356s Section 9 4 2 Using the HSZ20 HSZ40 or HSZ50 RAID array controllers Section 9 4 3 e Radial configurations using the HSZ40 or HSZ50 RAID array controllers Section 9 4 4 Introductory information covering SCSI bus configuration concepts SCSI bus speed data path and so on and SCSI bus configuration requirements can be found in Chapter 3 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices 9 1 9 1 Using SCSI Bus Signal Conv
378. torage units follow these steps 1 Shut down the operating systems on all host systems that are accessing the HSG80 controllers you want to change from transparent failover to multiple bus failover mode At the HSG80 set multiple bus failover as follows Note that before putting the controllers in multiple bus failover mode you must remove any previous failover mode HSG80 gt SET NOFAILOVER HSG80 gt SET MULTIBUS FAILOVER COPY THIS Note Use the controller known to have the good configuration information Execute the SHOW CONNECTION command to determine which connections have a nonzero offset as follows HSG80 gt SHOW CONNECTION Connection Unit Name Operating system Controller Port Address Status Offset NEWCON49 TRU64_ UNIX THIS 2 230813 OL this 100 HOST _ID 1000 0000 C920 DA01 ADAPTER_ID 1000 0000 C920 DA01 NEWCON50 TRU64_ UNIX THIS 1 230813 OL this 0 HOST _ID 1000 0000 C920 DA01 ADAPTER_ID 1000 0000 C920 DA01 NEWCON51 TRU64_ UNIX THIS 2 230913 OL this 100 HOST _ID 1000 0000 C920 EDEB ADAPTER_ID 1000 0000 C920 EDEB NEWCON52 TRU64_ UNIX THIS al 230913 OL this 0 HOST _ID 1000 0000 C920 EDEB ADAPTER_ID 1000 0000 C920 EDEB NEWCON53 TRU64_ UNIX OTHER al 230913 OL other 0 HOST _ID 1000 0000 C920 EDEB ADAPTER_ID 1000 0000 C920 EDEB NEWCON54 TRU64_ UNIX OTHER 1 230813 OL other 0 HOST _ID 1000 0000 C920 DA0 ADAPTER_ID 1000 0000 C920 DA01 NEWCO
379. traSCSI Hub cont Step Action Refer to Notes Ensure that the SCSI ID that you useis distinct from all other SCSI IDs on the same shared SCSI bus If you do not remember the other SCSI IDs or do not have them recorded you must determine these SCSI Ds If you are using a DS DWZZH 05 you cannot use SCSI ID 7 for a KZPBA CB UltraSCSI adapter SCSI ID 7 is reserved for DS DWZZH 05 use If you are using a DS DWZZH 05 and fair arbitration is enabled you must use the SCSI ID assigned to the hub port the adapter is connected to You will have problems if you have two or more SCSI adapters at the same SCSI ID on any one SCSI bus 6 Repeat steps 1 through 6 for any other K ZPBA CBs to be installed on this shared SCSI bus on other member systems 7 Connect a DS DWZZH 03 or DS DWZZH 05 Section 3 6 UltraSCSI hub to an HSZ70 or HSZ80 in transparent failover mode Section 3 7 1 1 HSZ70 or HSZ80 in multiple bus failover mode Section 3 7 1 2 4 3 2 Displaying KZPBA CB Adapters with the show Console Commands Usethe show config and show device console commands to display system configuration Use the output to determine which devices are KZPBA CBs and to determine their SCSI bus IDs Example 4 1 shows the output from the show config console command on an AlphaServer DS20 system Example 4 1 Displaying Configuration on an AlphaServer DS20 P00 gt gt gt show config AlphaServer DS20 500 MHz SRM Console T5 4 15
380. troller in a single controller configuration or if you must replace both HSG80 controllers ina dual redundant configuration simultaneously you have two options If the configuration has been saved to disk with the INITIALIZE DISKnnnn SAVE CONFIGURATION Or INITIALIZE storageset name SAVE_ CONFIGURATION option you can restore it from disk with the CONFIGURATION RESTORE command If you have not saved the configuration to disk but the label containing the worldwide name and checksum is still intact or you have recorded the worldwide name and checksum Section 6 5 3 1 and other configuration information you can use the command line interface CLI commands to configure the new controller and set the worldwide name Set the worldwide name as follows SET THIS NODETD nnnn nnnn nnnn nnnn checksum 6 6 Installing Tru64 UNIX and TruCluster Server Software Using Fibre Channel Storage After the hardware has been installed and configured there are preliminary steps that must be completed before you install Tru64 UNIX and TruCluster Server on Fibre Channel disks You may already know the physical devices on which you want to install Tru64 UNIX and TruCluster Server That is you probably know the location of the devices within the storage cabinet and are aware that the HSG80 show unit command displays the unit number of each of these devices F or example DISK10200 might be unit number D1 You need to equate the unit number identified
381. troller provides two ports left and right The HSG80 documentation refers to these ports as Port 1 and 2 respectively In transparent failover mode only one left port and one right port are active at any given time With transparent failover enabled assuming that the left port of the top controller and the right port of the bottom controller are active if the top controller fails in such a way that it can nolonger properly communicate with the switch then its functions will automatically fail over to the bottom controller and vice versa e In transparent failover mode you can configure which controller presents each HSG60 or HSG80 storage element unit to the cluster Ordinarily the left port of either controller serves the units designated DO through D99 and the right port serves those designated D100 through D199 e In multiple bus failover mode all units DO through D199 are visible to all host ports but accessible only through one controller at any specific time The host can control the failover process by moving unit s from one controller to the other controller 2 3 2 KZPSA BB SCSI Adapter Restrictions KZPSA BB SCSI adapters have the following restrictions e TheKZPSA BB requires A12 firmware e f you have a KZPSA BB adapter installed in an AlphaServer that supports the bus probe algorithm console variable for example the 2 8 Hardware Requirements and Restrictions AlphaServer 800 1000 1000A 2000 2100 or 2
382. two controllers In case of a host adapter Shared SCSI Bus Requirements and Configurations Using UltraSCSI Hardware 3 17 or SCSI bus failure the host can redistribute the load to the surviving controller In case of a controller failure the surviving controller will handle all units Notes Multiple bus failover does not support device partitioning with the HSZ70 or HSZ80 Partioned storagesets and partitioned single disk units cannot function in multiplebus failover dual redundant configurations Because they are not supported you must delete your partitions before configuring the HSZ70 or HSZ80 controllers for multiple bus failover Device partitioning is supported with HSG60 and HSG80 array controllers with ACS Version 8 5 Multiple bus failover does not support tape drives or CD ROM drives The following sections describe how to cable the HSZ70 or HSZ80 for TruCluster Server configurations See Chapter 6 for information regarding Fibre Channel storage 3 7 1 1 Preparing an HSZ70 or HSZ80 for a Shared SCSI Bus Using Transparent Failover Mode When using transparent failover mode Both controllers of an HSZ70 are connected to the same shared SCSI bus e For an HSZ80 Port 1 of controller A and Port 1 of controller B are on the same SCSI bus If used Port 2 of controller A and Port 2 of controller B are on the same SCSI bus HSZ80 targets assigned to Port 1 cannot be seen by Port 2 To cable a dual redundan
383. uCluster Server hardware configuration follow these steps 1 Plan your hardware configuration See Chapter 3 Chapter 4 Chapter 6 Chapter 9 and Chapter 10 Draw a diagram of your configuration Compare your diagram with the examples in Chapter 3 Chapter 6 and Chapter 9 4 Identify all devices cables SCSI adapters and so forth Use the diagram you just constructed 1 16 Introduction 10 11 12 Preparethe shared storage by installing disks and configuring any RAID controller subsystems see Chapter 3 Chapter 6 and Chapter 9 and the documentation for the StorageWorks enclosure or RAID controller Install signal converters in the StorageWorks enclosures if applicable see Chapter 3 and Chapter 9 Connect storage to the shared SCSI buses Terminate each bus Use Y cables or trilink connectors where necessary See Chapter 3 and Chapter 9 For a Fibre Channel configuration connect the HSG60 or HSG80 controllers to the switches You want the HSG60 or HSG80 to recognize the connections to the systems when the systems are powered on Prepare the member systems by installing e Additional Ethernet or Asynchronous Transfer Mode ATM network adapters for client networks e SCSI bus adapters Ensure that adapter terminators are set correctly Connect the systems to the shared SCSI bus see Chapter 4 or Chapter 10 e TheKGPSA host bus adapter for Fibre Channel configurations Ensure that the KGPSA is operating
384. ual modules into a single coordinated library robotics system The TL890 assumes control of the media maintaining an inventory of all media present in the system and controls movement of all media Thetape cartridges can move freely between the expansion unit and any of the base modules via the system s robotically controlled pass through mechanism The pass through mechanism is attached to the back of the expansion unit and each of the base modules For each TL891 TL892 base module beyond the first module the pass through mechanism must be extended by seven inches the height of each module with a DS TL800 AA pass through mechanism extension A seven inch gap may be left between base modules providing there is sufficient space but additional pass through mechanism extensions must be used For complete hardware installation instructions see the DLT MiniLibrary TL890 Expansion Unit User s Guide The combination of the TL890 expansion unit and the TL891 TL892 MiniLibrary modules is referred to as a DLT MiniLibrary for the remainder of this discussion 8 8 2 Preparing the DLT MiniLibraries for Shared SCSI Bus Usage The following sections describe how to prepare the DLT MiniLibraries in more detail It is assumed that the expansion unit base modules and pass through and motor mechanisms have been installed Configuring a Shared SCSI Bus for Tape Drive Use 8 29 8 8 2 1 Cabling the DLT MiniLibraries You must make the following
385. umber Description 1 BN38C or BN38D cable 2 BN37A cable 3 H8861 AA VHDCI trilink connector 4 H8863 AA VHDCI terminator 5 BN21W 0B Y cable 8 42 Configuring a Shared SCSI Bus for Tape Drive Use Table 8 10 Hardware Components Used to Create the Configuration Shown in Figure 8 12 cont Callout Number Description 6 H879 AA terminator 7 328215 00X BN21K or BN21L cable a The maximum length of the BN38C or BN38D cable on one SCSI bus segment must not exceed 25 meters The maximum length of the BN37A cable must not exceed 25 meters The maximum combined length of these cables must not exceed 25 meters 8 10 Preparing the TL895 DLT Automated Tape Library for Shared SCSI Bus Usage The topics in this section provide information on preparing the TL895 Digital Linear Tape DLT automated tape library for use on a shared SCSI bus Note To achieve system performance capabilities we recommend placing no more than two TZ89 drives on a SCSI bus segment We also recommend that storage be placed on shared SCSI buses that do not have tape drives This makes it easier to stop ASE services affecting the SCSI bus that the tape loaders are on The DS TL895 BA automated digital linear tape library consists of five TZ89N AV tape drives and 100 tape cartridge bins 96 storage bins in a fixed storage array FSA and 4 load port bins The storage bins hold either CompacTape III CompacTape III XT or CompacTape IV cartridges
386. used for the cluster root Cluster usr and cluster var file systems and the quorum disk Verify the mirrorset configuration and switches Ensure that the mirrorsets use the correct disks Create appropriately sized partitions in the BOOT MIR mirrorset using the percentage of the storageset that each partition will use These partitions will be used for the two member system boot disks 25 percent or 1 GB each and the Tru64 UNIX disk For the last partition the controller assigns the largest free space available to the partition which will be close to 50 percent or 2 GB Create appropriate sized partitions in the CROOT MIR mirrorset using the percentage of the storageset that each partition will use These partitions will be used for the quorum disk 5 percent cluster root partition 15 percent usr 40 percent and var file systems For the last partition var the controller assigns the largest free space available to the partition which will be close to 40 percent See the TruCluster Server Software Installation manual to obtain partition sizes Verify the BOOT MIR mirrorset partitions Ensure that the partitions are of the desired size The partition number is in the first column followed by the partition size and starting block Partition for member system 1 boot disk Partition for member system 2 boot disk Partition for Tru64 UNIX operating system disk Verify the CROOT MIR mirrorset partitions Ensure that the p
387. vel The example will be based on the use of four 4 GB disks used to create two mirrorsets RAID level 1 to provide reliability The mirrorsets will be partitioned to provide partitions of appropriate sizes Disks 30200 30300 40000 and 40100 will be used for the mirrorsets 6 36 Using Fibre Channel Storage Table 6 2 contains the necessary information to convert from the HSG80 unit numbers to dev disk dskn and device names for the example configuration A blank table Table A 1 is provided in Appendix A for usein an actual installation One mirrorset the BOOT MIR mirrorset will be used for the Tru64 UNIX and cluster member system boot disks The other mirrorset CROOT MIR will be used for the cluster root cluster usr cluster var and quorum disks To set up the example disks for operating system and cluster installation follow the steps in Example 6 2 Example 6 2 Setting Up the Mirrorset HSG80 gt RUN CONFIG 1 Config Local Program Invoked Config is building its table and determining what devices exist on the system Please be patient add disk DISK30200 add disk DISK30300 add disk DISK40000 add disk DISK40100 BB WW rFOWN oo0oo0oo Config Normal Termination HSG80 gt ADD MIRRORSET BOOT MIR DISK30200 DISK40000 2 HSG80 gt ADD MIRRORSET CROOT MIR DISK30300 DISK40100 2 HSG80 gt INITIALIZE BOOT MIR 3 HSG80 gt INITIALIZE CROOT MIR 3 HSG80 gt SHOW BOOT MIR 4
388. vices and can therefore support up to 16 disks in two BA356 shelves Also like the BA350 the SBB SCSI IDs are based upon the slot they are installed in The switches on the personality module BA35X M H determine whether the disks respond to SCSI IDs 0 through 6 slot 7 is the power supply or 8 through 14 slot 15 is the power supply To 9 10 Configurations Using External Termination or Radial Connections to Non UltraSCSI Devices select SCSI IDs 0 through 6 set the personality module address switches 1 through 7 to off To select SCSI IDs 8 through 14 set personality module address switches 1 through 3 toon and switches 4 through 7 to off Figure 9 7 shows the relative location of the BA356 SCSI bus jumper BA35X MF The jumper is accessed from the rear of the box For operation within a TruCluster Server cluster you must install the jumper in the normal position behind slot 6 Note that the SCSI bus jumper is not in the same position in the BA356 as in the BA350 Termination for the BA356 single ended bus is on the personality module and is active unless a cable is installed on J B1 to daisy chain the single ended SCSI bus in two BA356 storage shelves together In this case when the cable is connected to J B1 the personality module terminator is disabled Daisy chaining the single ended bus between two BA356s is not used in clusters We use DWZZB VWs with an attached H885 AA trilink connector in each BA356 to connect the wide di
389. vides an overview of how to update the firmware 7 5 1 Updating AlphaServer GS80 160 320 Firmware You can update the AlphaServer GS80 160 320 firmware with the loadable firmware update LF U utility by booting the AlphaServer Firmware U pdate CD ROM You can use the LFU to update the following firmware e Standard reference module SRM flash ROM on the standard I O module e The flash ROMs for the following console serial bus CSB microprocessors 7 18 Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration SCM Oneon the standard I O module of each primary PCI drawer Power system manager PSM One on the PSM module in each QBB PCI backplane manager PBM One on each PCI backplane Hierarchical switch power manager HPM One on the H switch PCI host bus adapter EEPROMS To update the AlphaServer GS80 160 320 firmware with theLFU utility follow these steps 1 2 At the console for each partition shut down the operating system At the master SCM turn power off to the system SCM_E0 gt power off You can turn power off to individual partitions if you want Ensure that power is turned off to all partitions SCM_EO gt power off par 0 SCM_EO gt power off par 1 Use the show nvr SCM command to display SCM environment variables Record the hp_count and hp_qbb_maskn environment variables as a record of the hardware partition configuration You do not change the hp_qbb_maskn environment va
390. w these steps 1 Connect a 328215 00X BN21K or BN21L between the last trilink connector on the bus to the leftmost connector as viewed from the rear of the MiniLibrary Install a 0 3 meter SCSI bus jumper between the rightmost robotics connector the second connector from the left and the left DLT1 connector the third connector from the left Install a 0 3 meter SCSI bus jumper between the rightmost DLT1 connector the fourth connector from the left and the left DLT2 connector the fifth connector from the left Install an HD68 differential H879 AA terminator on the right DLT2 connector the rightmost connector To connect the drive robotics and one drive to one shared SCSI bus and the second drive to a second shared SCSI bus follow these steps 1 Connect a 328215 00X BN21K or BN21L between the last trilink connector on one shared SCSI bus to the leftmost connector as viewed from the rear of the MiniLibrary Connect a 328215 00X BN21K or BN21L between the last trilink connector on the second shared SCSI bus tothe left DLT2 connector the fifth connector from the left Install a 0 3 meter SCSI bus jumper between the rightmost robotics connector the second connector from the left and the left DLT1 connector the third connector from the left Install an HD68 differential H879 AA terminator on the right DLT1 connector the fourth connector from the left and install another HD68 differential terminator o
391. ware mirror the clusterwide root file system member system boot disks swap disk and quorum disk When used in a dual redundant configuration Tru6 4 UNIX Version 5 1 supports both transparent failover which occurs automatically without host intervention and multiple bus failover which requires host intervention for some failures Note Enable mirrored cache for dual redundant configurations to further ensure the availability of unwritten cache data Use transparent failover if you only have one shared SCSI bus Both controllers are connected to the same host and device buses and either controller can service all of the units if the other controller fails Transparent failover compensates only for a controller failure and not for failures of either the SCSI bus or host adapters and is therefore not a NSPOF configuration Note Set each controller totransparent failover mode before configuring devices SET FAILOVER COPY THIS CONTROLLER To achieve a NSPOF configuration you need multiple bus failover and two shared SCSI buses You may use multiple bus failover SET MULTIBUS FAILOVER COPY THIS CONTROLLER to help achieve a NSPOF configuration if each host has two shared SCSI buses to the array controllers One SCSI bus is connected to one controller and the other SCSI bus is connected to the other controller Each member system has a host bus adapter for each shared SCSI bus The load can be distributed across the
392. widl 131 1 WWID 01000010 6000 1fe1 0000 0d60 0009 8080 0434 002 f wwid2 wwid3 P00 gt gt gt show n N1 50001fe100000d64 N2 50001fe100000d62 N3 50001fe100000d63 N4 50001fe100000d61 Example 6 6 provides sample device names as displayed by the show dev command after using the wwidmgr quickset command to set the device unit numbers 6 48 Using Fibre Channel Storage Example 6 6 Sample Fibre Channel Device Names P00 gt gt gt show dev dga131 1001 0 1 0 1 DGA131 HSG80 V8 5F dga131 1002 0 1 0 1 DGA131 HSG80 V8 5F dga131 1003 0 1 0 1 DGA131 HSG80 V8 5F dga131 1004 0 1 0 1 DGA131 HSG80 V8 5F dga133 1001 0 1 0 1 DGA133 HSG80 V8 5F dga133 1002 0 1 0 1 DGA133 HSG80 V8 5F dga133 1003 0 1 0 1 DGA133 HSG80 V8 5F dga133 1004 0 1 0 1 DGA133 HSG80 V8 5F dgb131 1001 0 2 0 1 DGA131 HSG80 V8 5F dgb131 1002 0 2 0 1 DGA131 HSG80 V8 5F dgb131 1003 0 2 0 1 DGA131 HSG80 V8 5F dgb131 1004 0 2 0 1 DGA131 HSG80 V8 5F dgb133 1001 0 2 0 1 DGA133 HSG80 V8 5F dgb133 1002 0 2 0 1 DGA133 HSG80 V8 5F dgb133 1003 0 2 0 1 DGA133 HSG80 V8 5F dgb133 1004 0 2 0 1 DGA133 HSG80 V8 5F dka0 0 0 1 1 DKAO COMPAQ BB00911CA0 3B05 dqa0 0 0 15 0 DQAO COMPAQ CDR 8435 0013 dva0 0 0 1000 0 DVAO ewa0 0 0 5 1 EWAO 08 00 2B C4 61 11 pga0 0 0 1 0 PGAO WWN 1000 0000 c920 eda0 pgb0 0 0 2 0 PGBO WWN 1000 0000 c920 da0l1 pka0 7 0 1 1 PKAO SCSI Bus ID 7 5 57 Note The only Fibre Channel devices displayed by the console show dev comma
393. will need one DWZZB AA for each shared SCSI bus with a Compaq 20 40 GB DLT Tape Drive Ensure that the DWZZB AA jumpers W1 and W2 are installed to enable the single ended termination Remove the termination from the differential end by removing the five 14 pin SIP resistors 2 Attach an H885 AA trilink connector or BN21W 0B Y cable to the differential end of the DWZZB AA 3 Connect the single ended end of the DWZZB AA to the Compaq 20 40 GB DLT Tape Drive with cable part number 199629 002 or 189636 002 1 8 meter cables 4 Install terminator part number 341102 001 on the other tape drive SCSI connector 5 Connect the trilink on the DWZZB AA to another trilink or Y cable on the differential shared SCSI bus with a 328215 00X BN21K or BN21L cable Keep the length of the differential segment below the 25 meter maximum length cable part number 328215 004 is a 20 meter Configuring a Shared SCSI Bus for Tape Drive Use 8 11 cable Ensure that the trilink or Y cable at both ends of the differential segment of the shared SCSI bus is terminated with an HD68 differential terminator such as an H879 AA The single ended SCSI bus may be daisy chained from one single ended tape drive to another with cable part number 146745 003 or 146776 003 0 9 meter cables as long as the SCSI bus maximum length of 3 meters fast SCSI is not exceeded Ensure that the tape drive on the end of the bus is terminated with terminator part number 341102 001
394. www compaq com support Select software amp drivers then select All Products under the Alpha Systems heading Select Alpha Firmware updates then select the appropriate system Alpha system reference manual SRM console firmware Version 5 7 or later must be installed on any cluster member that boots from a disk behind an HSZ80 HSG60 or HSG80 controller If the cluster member is using earlier firmware the member may fail to boot indicating Reservation Conflict errors TruCluster Server Version 5 1 supports eight member cluster configurations as follows FibreChannel Eight member systems may be connected to common storage over Fibre Channel in a fabric switch configuration Parallel SCSI Only four of the member systems may be connected to any one SCSI bus but you can have multiple SCSI buses connected to different sets of nodes and the sets of nodes may overlap We recommend you use a DS DWZZH 05 UltraSCSI hub with fair Hardware Requirements and Restrictions 2 1 arbitration enabled when connecting four member systems to a common SCSI bus e The following items pertain tothe AlphaServer GS80 160 320 systems Hot swapping modules is not supported High power peripheral component interconnect PCI modules approximately 25 watts or greater must be placed in PCI slots with 1 inch module pitch any slot except 0 5 0 6 1 5 and 1 6 A primary or expansion PCI drawer contains two 3 slot PCI buses and two 4 slo
395. x The organization of this manual has been restructured to provide a more streamlined manual The chapters that contained information on SCSI bus requirements and configuration and configuring hardware in previous versions of this manual have been split up into two sets of two chapters each One set Chapters 3 and 4 covers the UltraSCSI hardware and is geared towards radial configurations The other set Chapters 9 and 10 covers configurations using either external termination or radial connection to non UltraSCSI devices A brief description of the contents follows Chapte 1 Introduces the TruCluster Server product and provides an overview of setting up TruCluster Server hardware Chapter 2 Describes hardware requirements and restrictions Chapter 3 Contains information about setting up a shared SCSI bus SCSI bus requirements and how to connect storage to a shared SCSI bus using the latest UltraSCSI products DS DWZZH UltraSCSI hubs and HSZ70 and HSZ80 RAID array controllers Chapte 4 Describes how to prepare systems for a TruCluster Server configuration and how to connect host bus adapters to shared storage using the DS DWZZH UltraSCSI hubs and the newest RAID array controllers HSZ70 and HSZ80 Chapte 5 Describes how to set up the Memory Channel cluster interconnect and how to upgrade Memory Channel interconnects Chapter 6 Provides an overview of Fibre Channel and describes how to set up Fibre Channel hardware About This
396. xt base unit contains DLT4 and DLT5 The default SCSI IDs after being reconfigured by the expansion unit are as follows e Library Bus ID 0 e DLTOBusID 1 e DLT1BusiD 2 e DLT2BuslID 3 8 72 Configuring a Shared SCSI Bus for Tape Drive Use 10 11 e DLT3 Bus ID 4 e DLT4BusID 5 e DLT5 BusID 6 Press Enter when you have the item selected for which you wish to change the SCSI ID Use the up and down arrows to select the desired SCSI ID Press the Enter button to save the new selection Press the Escape button once to return to the Set SCSI Submenu to select another tape drive or the library robotics and then repeat steps 6 7 and 8 toset the SCSI ID If there are other items you wish to configure press the Escape button until the Configure submenu is displayed then select the item to be configured Repeat this procedure for each item you wish to configure If there are no more items to be configured press the Escape button until the Default window is displayed Note You do not have to cycle power to set the SCSI IDs 8 13 Compaq ESL9326D Enterprise Library The topics in this section provide an overview and hardware configuration information on preparing the ESL9326D Enterprise Library for use on a shared SCSI bus with the TruCluster Server 8 13 1 General Overview The Compag StorageWorks ESL9326D Enterprise Library is the first building block of the Compaq ESL 9000 series tape library For moreinfor
397. y between the DWZZH and storage shelf The DWZZH contains a differential to single ended signal converter for each hub port sometimes referred to as a DWZZA on a chip or DOC chip The single ended sides are connected together to form an internal single ended SCSI bus segment Each differential SCSI bus port is terminated internal to the DWZZH with terminators that cannot be disabled or removed Power for the DWZZH termination termpwr is supplied by the host bus adapter or RAID array controller connected to the DWZZH port If the member system or RAID array controller is powered down or the cable is removed from the host bus adapter RAID array controller or hub port the loss of termpwr disables the hub port without affecting the remaining hub ports or SCSI bus segments This is similar to removing a Y cable when using external termination The other end of the SCSI bus segment is terminated by the KZPSA BB or KZPBA CB onboard termination resistor SIPs or a trilink connector terminator combination installed on the HSZ40 or HSZ50 The KZPSA BB PClI to SCSI bus adapter e Is installed in a PCI slot of the supported member system see Section 2 3 2 e Isa fast wide differential adapter with only a single port so only one differential shared SCSI bus can be connected toa KZPSA BB adapter e Operates at fast or slow speed and is compatible with narrow or wide SCSI The fast speed is 10 MB sec for a narrow SCSI bus and 20 MB sec for
398. you may have to enable or disable device termination Unless you are using an UltraSCSI hub if you use a device s internal termination to terminate a shared bus and you disconnect the bus cable from the device the bus will not be terminated and cluster operation will be impaired Therefore unless you use an UltraSCS I hub you must use external termination enabling you to detach the device without affecting bus termination The use of UltraSCSI hubs with UltraSCSI devices is discussed in Section 3 5 and Section 3 6 The use of a DS DWZZH 03 UltraSCS I hub with externally terminated host bus adapters is discussed in Section 9 4 3 To be able to externally terminate a bus and connect and disconnect devices without affecting bus termination remove the device termination and use Y cables or trilink connectors to connect a device toa shared SCSI bus By attaching a Y cable or trilink connector to an unterminated device you can locate the device in the middle or at the end of the shared bus If the device is at the end of a bus attach an H879 AA terminator to the BN21W 0B Y cable or H885 AA trilink connector to terminate the bus F or UltraSCSI devices attach an H8863 AA terminator to the H 8861 trilink connector If you disconnect the Y cable or trilink connector from the device the shared bus is still terminated and the shared SCSI bus is still operable In addition you can attach a Y cable or a trilink connector toa properly terminated s
399. ystems may be connected to common storage over Fibre Channa in a fabric switch configuration The Fibre Channel RAID Array 8000 RA8000 midrange departmental storage subsystem and Fibre Channel Enterprise Storage Array 12000 ESA12000 house two HSG80 dual channel controllers There are provisions for six UltraSCSI channels A maximum of 72 disks is supported The StorageWorks Modular Array 6000 M A6000 is built with the new StorageWorks packaging which consists of A Compaq StorageWorks enclosure Model 2100 which houses dual redundant HSG60 controllers The 14 bay drive shelves Compaq StorageWorks enclosure M odel 4200 The Model 2100 enclosure with HSG60 controllers supports two SCSI buses which may be Twodrive shelves Model 4214R with up to 12 disk drives each The drive shelves use single bus mode one SCSI bus per drive shelf Onedrive shelf Model 4254 with up to 14 disk drives The drive shelf uses dual bus mode two SCSI buses each with 7 disk drives Hardware Requirements and Restrictions 2 5 Notes The Model 4124R disk enclosure is a single bus enclosure that has slots for 14 drives but only 12 drives are supported at the present time The maximum number of drives behind an HSG60 single or dual redundant pair using two single bus Model 4214R disk enclosures is 24 The maximum number of drives behind an HSG6O0 single or dual redundant pair using one dual bus Model 4254 disk enclosures
400. ystems use the same switch technology the same CPU memory and power modules and the same I O riser modules The GS160 and GS320 systems house the modules in up to two system boxes each with two QBBs in a cabinet The GS320 requires two cabinets for the system boxes The GS80 is a rack system with the system modules for each QBB ina drawer An 8 processor GS80 uses two drawers for the CPU memory and I O riser modules All the systems use the same type of PCI drawers for 1 O They are located in the GS160 GS320 power cabinet or in the GS80 RETMA cabinet Additional PCI drawers are mounted in expansion cabinets Using GS80 GS160 or GS320 Hard Partitions in a TruCluster Server Configuration 7 1 7 2 Hardware Requirements for a Hard Partition in a Cluster The TruCluster Server hardware requirements are the same for an AlphaServer GS80 160 320 hard partition as any other system in a cluster You must have e A supported host bus adapter connected to shared storage This may be a KZPBA CB for parallel SCSI or aK GPSA CA for Fibre Channel e Oneor more network connections A Memory Channel interface The AlphaServer GS80 160 320 system supports only the MC2 products Each AlphaServer GS80 160 320 hard partition that is used in a cluster must contain at least one QBB with a minimum of one CPU and one memory module Additionally there must be e Atleast one local I O riser module in the partition Figure 7 1 shows a portion of

Compaq AA-RHGWC-TE User's Manual

Contents

Download Pdf Manuals

Related Search

Related Contents