Home

Sun StorEdge™ T3 Disk Tray Configuration Guide

1. f Hub faa ST Joop Jae ao oor puoy no oo alles e lool laol doh lac oo n DO ogi agi ogi DO og o oo anseres Sl coh ooh ic EH a lea Bai Ve Bal IB BB IH f i EH BLL ss Se FM SM ME Application host SIHBA Hub fag oj Joo joo pao yao joo joo Ol HBA oo Woh lah la lotto M F 4 oo eyes ES lies ee ES TES lja Ba Bl Boi Ol ogi OO OO og o oo B 00 00 OO OO DO DO o po al leal BB al leal BB BB lla m m al els sis an O OO OO o Interconnect cables 2 wa 2 ri 8 So o So Bo Ethernet port di LAN Management host FIGURE 4 6 Single Host With Four Controller Units and Two Hubs Configured as Two Partner Groups Chapter 4 Configuration Examples 37 Single Host With Eight Controller Units and Two Hubs Configured as Four Partner Groups FIGURE 4 7 shows one application host connected through FC AL cables to two hubs and to eight Sun StorEdge T3 disk trays forming four partner groups This configuration is the maximum allo
2. 3 o Se f So c uo o E D f g I oO pol pal LAN FIGURE 4 7 Single Host With Eight Controller Units and Two Hubs Configured as Four SS p a ENS S Go S Wa S LS EN m rr a AQ ESA COLL zz ST d A a H 0 0 t 4 8 UN W is FA AN NIR 5 AW 5 SA WY ls H ER d TS a IAS Cae yip o o c c o o o 2 o D re 39 Configuration Examples Chapter 4 Partner Groups Dual Hosts With Four Controller Units and Two Hubs FIGURE 4 8 shows two application hosts connected through FC AL cables to two hubs and four Sun StorEdge T3 disk trays This configuration also known as a Multi Initiator configuration can be used for footprint and I O throughput The following limitations should be evaluated when proceeding with this configuration a Multi Initiator configurations are only supported with single tray T3 configurations no partner groups m Because only single trays are supported in Multi Initiator configurations to avoid the risk caused by any T3 disk tray or data p
3. GURE 4 1 GURE 4 2 GURE 4 3 GURE 4 4 GURE 4 5 GURE 4 6 GURE 4 7 GURE 4 8 GURE 4 9 GURE 4 10 GURE 4 11 GURE 5 1 Figures Controller Card and Ports 3 Interconnect Card and Ports 4 Sun StorEdge T3 Disk Tray Partner Group Configuration 5 Sun StorEdge T3 Disk Tray Standalone Configuration 6 Sun StorEdge T3 Disk Tray Partner Group 20 Connecting the Interconnect Cables 23 Fully Cabled Partner Group 24 Single Host Connected to One Controller Unit 28 Single Host With Two Controller Units Configured as a Partner Group 29 DMP or AP Failover Configuration 31 Single Host With Four Controller Units Configured as Two Partner Groups 33 Single Host With Eight Controller Units Configured as Four Partner Groups 35 Single Host With Four Controller Units and Two Hubs Configured as Two Partner Groups 37 Single Host With Eight Controller Units and Two Hubs Configured as Four Partner Groups 39 Dual Hosts With Four Controller Units and Two Hubs 41 Dual Hosts With Eight Controller Units and Two Hubs 44 Dual Hosts With Two Controller Units and Two Switches 46 Dual Hosts With Eight Controller Units and Two Switches 48 Sun Enterprise 6x00 5x00 4x00 3x00 SBus I O Board 50 xi xii FIGURE 5 2 FIGURE 5 3 FIGURE 5 4 FIGURE 6 1 FIGURE 6 2 FIGURE 6 3 Sun StorEdge PCI FC 100 Host Bus Adapter 51 Sun StorEdge SBus FC 100 Host Bus Adapter 52 Sun StorEdge PCI Single Fibre Channel Network Adapter 53 StorEdge Dis
4. E pu El 10BASE T MIA FC AL Ethernet port Management host LAN FIGURE 4 1 Single Host Connected to One Controller Unit Sun StorEdge T3 Disk Tray Configuration Guide March 2001 AMCU Interconnect cables Single Host With Two Controller Units Configured as a Partner Group FIGURE 4 2 shows one application host connected through FC AL cables to one Sun StorEdge T3 disk tray partner group which consists of two Sun StorEdge T3 disk trays The 10BASE T connection on the master controller is on a public or separate network and requires an IP address for the partner group In the event of a failover the alternate master controller will use the master controller s IP address and MAC address 10BASE T DOOR DER WTA Application host S HBA Ethernet port Management host T9 o LAN FIGURE 4 2 Single Host With Two Controller Units Configured as a Partner Group Note The dashed line indicates that an IP address is not necessary This controller will take over the IP address and the MAC address of the MCU if a failover occurs Chapter 4 Configuration Examples 29 Note This configuration is a recommended enterprise configuration for RAS functionality because there is no single point of failure This configuration supports Dynamic Mu
5. standalone storage unit or as a building block interconnected with other Sun StorEdge T3 disk trays and configured in various ways to provide a storage solution optimized to the host application The disk tray can be placed on a table top or rackmounted in a server cabinet or expansion cabinet The Sun StorEdge T3 disk tray expansion unit contains the same components as the Sun StorEdge T3 disk tray controller unit except for the internal RAID controller When connected to a controller unit the expansion unit enables you to increase your storage capacity See Appendix B in the Sun StorEdge T3 Disk Tray Installation Operation and Service Manual for an illustrated breakdown of the Sun StorEdge T3 disk tray and its component parts Connection Ports The Sun StorEdge T3 disk tray has the following ports m On the controller card a One Fibre Channel Arbitrated Loop FC AL port which provides data path connectivity to the application host system a One 10BASE T Ethernet host interface port RJ 45 This port provides the interface between the controller card and the management host system An unshielded twisted pair Ethernet cable connects the controller server to the site s network hub This interface enables the administration and management of the disk tray via the Sun StorEdge Component Manager software or the command line interface CLI a One RS 232 serial port RJ 11 6 This serial port is reserved for diagnostic procedure
6. Fibre Channel Arbitrated Loop FC AL See FC AL H HBA SOC 52 Sun StorEdge PCI FC 100 51 Sun StorEdge PCI Single Fibre Channel network adapter 53 Sun StorEdge SBus FC 100 52 hot spare default value 18 determining whether to use 15 I O boards Sun Enterprise SBus and Graphics 50 interconnect cards description 3 to 4 in partner groups 56 IP addresses for AMCU and MCU 5 L logical unit LUN See LUNs LUNs and applications 14 creating and labeling 16 default value 18 definition 13 determining how many are needed 14 guidelines for configuring 13 reconstruction rate setting 16 viewing 13 M MAC address 7 master controller unit MCU in a partner group 4 21 parameters controlled by 8 MCU See master controller unit media access control MAC address See MAC address media interface adapter MIA 5 20 P parameters tailored to I O workload 8 partner groups configuration 4 to 5 creating from new units 22 to 25 definition 19 direct host single host with eight controllers 34 to 35 single host with four controllers 32 to 33 single host with two controllers 29 to 30 how they work 21 hub host dual hosts with eight controllers 42 to 44 dual hosts with four controllers 40 to 41 single host with eight controllers 38 to 39 single host with four controllers 36 to 37 setting up before changing parameters 9 sharing parameter settings 8 switch host dual hosts with eigh
7. Size The data block size is the amount of data written to each drive when striping data across drives The block size is also known as the stripe unit size The block size can be changed only when there are no volumes defined The block size can be configured as 16 Kbyte 32 Kbyte or 64 Kbyte The default block size is 64 Kbyte 10 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 A cache segment is the amount of data being read into cache A cache segment is 1 8 of a data block Therefore cache segments can be 2 Kbyte 4 Kbyte or 8 Kbyte Because the default block size is 64 Kbyte the default cache segment size is 8 Kbyte Note The disk tray data block size is independent of I O block size Alignment of the two is not recommended Selecting a Data Block Size If the I O initiated from the host is 4 Kbyte a data block size of 64 Kbyte would force 8 Kbyte of internal disk I O wasting 4 Kbyte of the cache segment Therefore it would be best to configure 32 Kbyte block sizes causing 4 Kbyte physical I O from the disk If sequential activity occurs full block writes 32 Kbyte will take place For 8 Kbyte I O or greater from the host use 64 Kbyte blocks Applications benefit from the following data block or stripe unit sizes m 16 Kbyte data block size a Online Transaction Processing OLTP a Internet service provider ISP Enterprise Resource Planning ERP m 32 Kbyte data block size a NFS file system versi
8. T Ethernet administration path 56 connections 4 to 5 A administration path 56 alternate master controller unit AMCU definition 4 Alternate Pathing AP in configuration recommendations 7 in partner group configuration 30 to 31 auto cache mode 10 C cabling partner group configuration 59 single disk tray configuration 58 cache allocation configuring 12 for improving performance 9 mirrored enabling 12 setting cache modes 10 cache segment 11 cluster support See SunCluster 2 2 support configuration restrictions and recommendations 7 configurations direct host single host with eight controllers 34 to 35 single host with four controllers 32 to 33 single host with one controller 28 single host with two controllers 29 to 30 hot spare 15 hub host dual hosts with eight controllers 42 to 44 dual hosts with four controllers 40 to 41 single host with eight controllers 38 to 39 single host with four controllers 36 to 37 partner group 4 to 5 partner group cabling 59 single disk tray cabling 58 standalone 5 to 6 switch host dual hosts with eight controllers 47 to 48 dual hosts with two controllers 45 to 46 connections 10BASE T Ethernet 4 to 5 FC AL 4 RS 232 serial 2 D data block size definition 10 data path 55 Dynamic Multi Pathing DMP in configuration recommendations 7 in partner group configuration 30 to 31 Index 67 F FC AL connections 4 data path 55
9. et qui comprend la technologie relative aux polices de caract res est prot g par un copyright et licenci par des fournisseurs de Sun Des parties de ce produit pourront tre d riv es des syst mes Berkeley BSD licenci s par l Universit de Californie UNIX est une marque d pos e aux Etats Unis et dans d autres pays et licenci e exclusivement par X Open Company Ltd Sun Sun Microsystems le logo Sun AnswerBook2 Solstice DiskSuite docs sun com SunSolve OpenBoot JumpStart StorTools Sun Enterprise Sun StorEdge Sun Ultra Sun Fire et Solaris sont des marques de fabrique ou des marques d pos es ou marques de service de Sun Microsystems Inc aux Etats Unis et dans d autres pays Toutes les marques SPARC sont utilis es sous licence et sont des marques de fabrique ou des marques d pos es de SPARC International Inc aux Etats Unis et dans d autres pays Les produits portant les marques SPARC sont bas s sur une architecture d velopp e par Sun Microsystems Inc L interface d utilisation graphique OPEN LOOK et Sun a t d velopp e par Sun Microsystems Inc pour ses utilisateurs et licenci s Sun reconnait les efforts de pionniers de Xerox pour la recherche et le d veloppement du concept des interfaces d utilisation visuelle ou graphique pour l industrie de l informatique Sun d tient une licence non exclusive de Xerox sur l interface d utilisation graphique Xerox cette licence couvrant galement les licenci s
10. host connections for the Sun StorEdge T3 disk tray Chapter 6 describes disk tray cabling for the Sun StorEdge T3 disk tray Using UNIX Commands This document does not contain information on basic UNIX commands and procedures such as shutting down the system booting the system and configuring devices See one or more of the following sources for this information m AnswerBook2 online documentation for the Solaris operating environment m Other software documentation that you received with your system Typographic Conventions TABLE P 1 Typographic Conventions Typeface Meaning Examples AaBbCc123 The names of commands files Edit your login file and directories on screen Use 1s a to list all files computer output You have mail AaBbCc123 What you type when su contrasted with on screen Password computer output AaBbCc123 Book titles new words or terms Read Chapter 6 in the User s Guide words to be emphasized Command line variable replace with a real name or value These are called class options You must be superuser to do this To delete a file type rm filename iv Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Shell Prompts TABLE P 2 Shell Prompts Shell Prompt C shell machine_name C shell superuser Bourne shell and Korn shell machine_name Bourne shell and Korn shell superuser Related Documentation TABLE P 3 Application Site Prep
11. pair of interconnected controller units A FRU component in the Sun StorEdge T3 disk tray It contains a power supply cooling fans and an integrated UPS battery There are two power and cooling units in a Sun StorEdge T3 disk tray Glossary 63 R read caching redundant array of independent disks RAID reliability availability serviceability RAS S system area U uninterruptable power source UPS V volume Data for future retrieval to reduce disk I O as much as possible A configuration in which multiple drives are combined into a single virtual drive to improve performance and reliability A term to describe product features that include high availability easily serviced components and very dependable Located on the disk drive label the space that contains configuration data boot firmware and file system information A component within the power and cooling unit It supplies power from a battery in the case of an AC power failure Also called a LUN a volume is one or more drives grouped into a unit for data storage Glossary 64 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 W write caching Data used to build up stripes of data eliminating the read modify write overhead Write caching improves performance for applications that are writing to disk Glossary 65 Glossary 66 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Index NUMERICS 10BASE
12. set starting with target address 1 for the bottom disk tray and continuing to the top disk tray Use the port list command to verify that all T3 disk trays have a unique target address Refer to Appendix A 3 12 of the Sun StorEdge T3 Disk Tray Administrator s Guide for further details Sun StorEdge T3 Disk Tray Configuration Guide March 2001 The following two parameters must be set on the master controller as follows m cache mode auto m cache mirroring auto Note For information on setting these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Chapter 4 Configuration Examples 43 a 8 g 5 5 c r c c So c c e uo o 2 o E y SIL a Lit lt o iq hd em ea em ia c QI X QT r oO lt pa pa lt pa Ro 3 S A EE EH QE H E JO S E ASIE OL OL OL ES S al Sue ep Row Qi ROW S E El Si KO Sl O O LIGA 0 Ge FIGURE 4 9 Dual Hosts With Eight Controller Units and Two Hubs
13. to achieve a fully redundant configuration FIGURE 4 3 shows a DMP or AP failover configuration 30 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 LUN 1 AMCU Interconnect cables oe 10BASET Application host SIHBA Sal LUN O raha Ethernet port P d Management host LAN FIGURE 4 3 DMP or AP Failover Configuration Active LUN 1 Failover LUN 0 Active LUN 0 Failover LUN 1 Chapter 4 Configuration Examples 31 Single Host With Four Controller Units Configured as Two Partner Groups FIGURE 4 4 shows one application host connected through FC AL cables to four Sun StorEdge T3 disk trays configured as two separate partner groups This configuration can be used for capacity and I O throughput requirements Note This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure The following three parameters must be set on the master controller as follows m mp support rw m cache mode auto m cache mirroring auto Note For information on setting these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Host based alternate pathing such as VERITAS DMP or Sun Enterprise Server AP must also be installed on the host 32 Sun StorEdge T3 Disk Tray Configuration G
14. 009 E EE Ligne je FIGURE 4 11 Dual Hosts With Eight Controller Units and Two Switches LAN March 2001 Sun StorEdge T3 Disk Tray Configuration Guide 48 CHAPTER 5 Host Connections This chapter describes how to connect the Sun StorEdge T3 disk tray to the following devices m Sun Enterprise SBus and Graphics I O Boards on page 50 m Sun StorEdge PCI FC 100 Host Bus Adapter on page 51 m Sun StorEdge SBus FC 100 Host Bus Adapter on page 52 m Sun StorEdge PCI Single Fibre Channel Network Adapter on page 53 49 Sun Enterprise SBus and Graphics I O Boards The SBus and Graphics I O boards each provide mounting for two gigabit interface converters GBICs For more detailed information about these I O boards refer to the Sun Enterprise 6x00 5x00 4x00 3x00 Systems SBus and Graphics I O Boards Installation Guide part number 805 2704 FIGURE 5 1 shows an Enterprise 6x00 5x00 4x00 3x00 SBus I O board FIGURE 5 1 Sun Enterprise 6x00 5x00 4x00 3x00 SBus I O Board System Requirements Your system must meet the following hardware and software requirements m Sun Enterprise 6x00 5x00 4x00 3x00 system m An available I O board slot m OpenBoot PROM version 3 2 10 or later m Solaris 2 6 or higher version of the Solaris operating system 50 Sun S
15. March 2001 Sun StorEdge T3 Disk Tray Configuration Guide 44 Switch Host Connection Dual Hosts With Two Controller Units and Two Switches Configured as One Partner Group FIGURE 4 10 shows two application hosts connected through FC AL cables to two switches and one Sun StorEdge T3 disk tray partner group which consists of two Sun StorEdge T3 disk trays The 10BASE T connection on the master controller is on a public or separate network and requires an IP address for the partner group In the event of a failover the alternate master controller will use the master controller s IP address and MAC address Note This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure Each T3 disk tray needs to be assigned a unique target address using the port set command These target addresses can be any number between 1 and 125 At the factory the disk tray target addresses are set starting with target address 1 for the bottom disk tray and continuing to the top disk tray Use the port list command to verify that all T3 disk trays have a unique target address Refer to Appendix A 3 12 of the Sun StorEdge T3 Disk Tray Administrator s Guide for further details The following three parameters must be set on the master controller as follows m mp support rw m cache mode auto m cache mirroring auto Note For information on setting these parameters re
16. Partner Groups 23 ACLED P supply peus button LED Power Supp Add master 7 iz ZZ ch Il VO Power AC LED Power D D 5 Gu ume QE E venus C EI UN E ar Power connection cord i n Master unit 75 3 al amp Me i mi co 10BASE T 7 NL connection Power cord FC AL connection FIGURE 3 3 Fully Cabled Partner Group 2 Power on and verify the hardware configuration a Plug the other end of the power cords from the disk trays into AC outlets Use alternate power sources to make sure that power and cooling unit features are redundant b Verify that AC power is present on each power and cooling unit The AC LED on each power and cooling unit will be solid amber and the fans will turn at low speed c Press the power button on the power and cooling units to power on the disk trays The AC and power supply PS LEDs on the power and cooling units will be green 24 SunStorEdge T3 Disk Tray Configuration Guide March 2001 d Check the LEDs at the front and back of the unit to ensure that all components are receiving power and are functional While the drives are spinning up the LEDs will blink The disk tray boot time will take up to several minutes after which all LEDs should be solid green indicating that the unit is receivi
17. SS amp Sun microsystems Sun StorEdge T3 Disk Tray Configuration Guide Sun Microsystems Inc 901 San Antonio Road Palo Alto CA 94303 4900 U S A 650 960 1300 Part No 806 4210 12 March 2001 Revision A Send comments about this document to docfeedback sun com Copyright 2001 Sun Microsystems Inc 901 San Antonio Road Palo Alto CA 94303 4900 U S A All rights reserved This product or document is distributed under licenses restricting its use copying distribution and decompilation No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors if any Third party software including font technology is copyrighted and licensed from Sun suppliers Parts of the product may be derived from Berkeley BSD systems licensed from the University of California UNIX is a registered trademark in the U S and other countries exclusively licensed through X Open Company Ltd Sun Sun Microsystems the Sun logo AnswerBook2 Solstice DiskSuite docs sun com OpenBoot SunSolve JumpStart StorTools Sun Enterprise Sun StorEdge Sun Ultra Sun Fire and Solaris are trademarks registered trademarks or service marks of Sun Microsystems Inc in the U S and other countries All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International Inc in the U S and other countries Products bearing SPARC trademarks are ba
18. and Solaris 8 m VERITAS Volume Manager 3 0 4 and up with Dynamic Multi Pathing DMP m Sun Enterprise Server Alternate Pathing AP 2 3 1 8 Sun Cluster 2 2 Support Sun Cluster 2 2 is now supported with the following restrictions m 1 16A level controller firmware is required on each Sun StorEdge T3 disk tray m Partner groups are not supported m Switches are not supported m Hubs must be used m The Sun StorEdge SBus FC 100 SOC HBA and the onboard SOC interface in Sun Fire systems are supported m On Sun Enterprise 6x00 5x00 4x00 3x00 systems a maximum of 64 Sun StorEdge T3 disk trays are supported per cluster On Sun Enterprise 10000 systems a maximum of 256 Sun StorEdge T3 disk trays are supported per cluster m To ensure full redundancy host based mirroring software such as VERITAS Volume Manager 3 0 4 Solstice DiskSuite SDS 4 2 or SDS 4 2 1 must be used m Solaris 2 6 and Solaris 8 are the only supported operating systems Sun StorEdge T3 Disk Tray Configuration Guide March 2001 CHAPTER 2 Configuring Global Parameters When the Sun StorEdge T3 disk tray is shipped its global parameters are set to default values This chapter describes how to reconfigure your disk tray by changing these default values for the following parameters m Cache on page 9 m Logical Volumes on page 13 m Using RAID Levels to Configure Redundancy on page 17 Caution If you are planning to c
19. aration Installation overview Installing using and servicing the disk tray Administration Troubleshooting Release notes Disk drive specifications Related Documentation Title Sun StorEdge T3 Disk Tray Site Preparation and Planning Guide Sun StorEdge T3 Disk Tray Installation Task Map Sun StorEdge T3 Disk Tray Installation Operation and Service Manual Sun StorEdge T3 Disk Tray Administrator s Guide Sun StorEdge T3 Disk Tray Field Service Manual Sun StorEdge T3 Disk Tray Release Notes 18 Gbyte 1 Inch 10K rpm Disk Drive Specifications 36 4 Gbyte 10K rpm Disk Drive Specifications Part Number 806 4212 806 1061 806 1062 806 1063 806 4213 806 1497 806 1493 806 1491 Preface v TABLE P 3 Related Documentation Continued Application Title Part Number 73 Gbyte 10K rpm 1 6 Inch Disk Drive 806 4800 Specifications Configuration Rules Configuration Rules for Mission n a Critical Storage document also known as the Big Rules document Cluster installation and Sun Cluster 2 2 Hardware Service Manual 806 4749 service Accessing Sun Documentation Online You can access a select group of Sun technical documentation on the Web You can browse the documentation archive at http www sun com products n solutions hardware docs vi Sun Welcomes Your Comments We are interested in improving our documentation and welcome your comments and suggestions You
20. ath single point of failure Sun Microsystems Inc recommends that host based mirroring software such as VERITAS Volume Manager or Solaris Logical Volume Manager be used for host based mirroring of T3 volumes on the disk trays When configuring more than one partner group or single T3 disk tray to share a single FC AL loop as with a hub T3 disk tray target addresses need to be set to unique values m With 1 16 level controller firmware Sun Microsystems Inc recommends that RAID 0 T3 volumes not be used This is a release note bug refer to bug 4374280 listed in the Sun StorEdge T3 Disk Tray Release Notes Note This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure Note There are no hub port position dependencies when connecting a Sun StorEdge T3 disk tray to a hub A Sun StorEdge T3 disk tray can be connected to any available port on the hub Each T3 disk tray needs to be assigned a unique target address using the port set command These target addresses can be any number between 1 and 125 At the factory the disk tray target addresses are set starting with target address 1 for the bottom disk tray and continuing to the top disk tray Use the port list command to verify that all T3 disk trays have a unique target address Refer to Appendix A 3 12 of the Sun StorEdge T3 Disk Tray Administrator s Guide for further details The following t
21. ation If the application profile is configured for a 100 read environment then 100 of the cache is used for reads If the application profile has a high number of writes then the upper limit for writes is set to 80 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Logical Volumes Also called a logical unit number LUN a logical volume is one or more disk drives that are grouped together to form a single unit Each logical volume is represented to the host as a logical unit number Using the format utility on the application host you can view the logical volumes presented by the disk tray You can use this disk space as you would any physical disk for example to perform the following operations m Install a file system m Use the device as a raw device without any file system structure m Partition the device Note Individual physical disk drives are not visible from the application host Refer to the Sun StorEdge T3 Disk Tray Administrator s Guide for more information on creating logical volumes Guidelines for Configuring Logical Volumes Use the following guidelines when configuring logical volumes m The Sun StorEdge T3 disk tray s native volume management can support a maximum of two volumes per disk tray unit m The minimum number of drives is based on the RAID level as follows a RAID 0 and RAID 1 require a minimum of two drives a RAID 5 requires a minimum of three drives m Drive 9 can be d
22. can email your comments to us at docfeedback sun com Please include the part number 806 4210 12 of your document in the subject line of your email Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Contents Preface iii Sun StorEdge T3 Disk Tray Configuration Overview 1 Product Description 1 Connection Ports 2 FC AL Configurations 4 Partner Group Configuration 4 Standalone Configuration 5 Configuration Guidelines and Restrictions 7 Configuration Recommendations 7 Supported Platforms 8 Sun Cluster 2 2 Support 8 Configuring Global Parameters 9 Cache 9 Configuring Cache for Performance and Redundancy 10 Configuring Data Block Size 10 Selecting a Data Block Size 11 Enabling Mirrored Cache 12 Configuring Cache Allocation 12 vii Logical Volumes 13 Guidelines for Configuring Logical Volumes 13 Determining How Many Logical Volumes You Need 14 Determining Which RAID Level You Require 14 Determining Whether You Need a HotSpare 15 Creating and Labeling a Logical Volume 16 Setting the LUN Reconstruction Rate 16 Using RAID Levels to Configure Redundancy 17 RAIDO 17 RAID 1 18 RAID5 18 Configuring RAID Levels 18 3 Configuring Partner Groups 19 Understanding Partner Groups 19 How Partner Groups Work 21 Creating Partner Groups 22 4 Configuration Examples 27 Direct Host Connection 28 Single Host With One Controller Unit 28 Single Host With Two Controller Units Configured as a Partner Group 29 Host Multi Pat
23. created in two ways m From new units m From existing standalone units To Create a Partner Group From New Units To set up a partner group from two new Sun StorEdge T3 disk trays follow these steps before powering on the disk trays Caution If there is any customer data that needs to be preserved ensure that the data is backed up to tape before starting this procedure Note This procedure assumes that you have already connected the fiber optic cable media interface unit AC power cords and 10BASE T interface cables For specific instructions on connecting these cables refer to Chapter 2 of the Sun StorEdge T3 Disk Tray Installation Operation and Service Manual Use the interconnect cables to interconnect units as shown in figure FIGURE 3 2 Make sure you connect the cables to the correct interconnect loop card connectors exactly as shown in the FIGURE 3 2 Port 1 on the alternate master is always connected to port 2 on the master unit Tighten the retaining screws Sun StorEdge T3 Disk Tray Configuration Guide March 2001 ale master oQo oOo uni fa ES O Port 1 qe ego amp uo so Master unit E oOo ra Il DO co Close up of interconnect card port and interconnect cable FIGURE 3 2 Connecting the Interconnect Cables A fully cabled partner group is shown in FIGURE 3 3 Chapter 3 Configuring
24. d in Multi Initiator configurations to avoid the risk caused by any T3 disk tray or data path single point of failure Sun Microsystems Inc recommends that host based mirroring software such as VERITAS Volume Manager or Solaris Logical Volume Manager be used for host based mirroring of T3 volumes on the disk trays Note This configuration running host based mirroring features from VERITAS Volume Manager or Solaris Logical Volume Manager represents four trays of data mirrored to the other four trays using host based mirroring When configuring more than one partner group or single T3 disk tray to share a single FC AL loop as with a hub T3 disk tray target addresses need to be set to unique values m With 1 16 level controller firmware Sun Microsystems Inc recommends that RAID 0 T3 volumes not be used This is a release note bug refer to bug 4374280 listed in the Sun StorEdge T3 Disk Tray Release Notes This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure Note There are no hub port position dependencies when connecting a Sun StorEdge T3 disk tray to a hub A Sun StorEdge T3 disk tray can be connected to any available port on the hub Each 13 disk tray needs to be assigned a unique target address using the port set command These target addresses can be any number between 1 and 125 At the factory the disk tray target addresses are
25. d while a reconstruction operation is in process However the changes don t take effect until the current reconstruction has completed Using RAID Levels to Configure Redundancy The RAID level determines how the controller reads and writes data and parity on the drives The Sun StorEdge T3 disk tray can be configured with RAID level 0 RAID level 1 1 0 or RAID level 5 The factory configured LUN is a RAID 5 LUN Note The default RAID level 5 can result in very large volumes for example 128 Gbytes in a configuration of single 7 1 RAID 5 LUN plus hot spare with 18 Gbyte drives Some applications cannot use such large volumes effectively The following two solutions can be used separately or in combination m First use the partitioning utility available on the data host s operating system In the Solaris environment use the format utility which can create up to seven distinct partitions per volume Note that in the case of the configuration described above if each partition is equal in size this will result in 18 Gbyte partitions which still may be too large to be used efficiently by legacy applications m Second you can use third party software on the host system to create as many partitions as desired from a given volume In the Solaris environment you can use VERITAS Volume Manager or Solaris Logical Volume Management SLVM formerly known as Solstice DiskSuite SDS for this purpose Note For information on using
26. de Sun qui mettent en place l interface d utilisation graphique OPEN LOOK et qui en outre se conforment aux licences crites de Sun LA DOCUMENTATION EST FOURNIE EN L ETAT ET TOUTES AUTRES CONDITIONS DECLARATIONS ET GARANTIES EXPRESSES OU TACITES SONT FORMELLEMENT EXCLUES DANS LA MESURE AUTORISEE PARLA LOI APPLICABLE Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE A L APTITUDE A UNE UTILISATION PARTICULIERE OU A L ABSENCE DE CONTREFACON 5 cx A y Adobe PostScript Preface The Sun StorEdge T3 Disk Tray Configuration Guide describes the recommended configurations for the Sun StorEdge T3 disk tray for high availability the maximum performance and maximum storage capability This guide is intended for Sun field sales and technical support personnel Before You Read This Book Read the Sun StorEdge T3 Disk Tray Installation Operation and Service Manual for product overview information How This Book Is Organized Chapter 1 describes the connection ports and Fibre Channel loops for the Sun StorEdge T3 disk tray It also describes basic rules and recommendations for configuring the Sun StorEdge T3 disk tray Chapter 2 describes how to configure the Sun StorEdge T3 disk tray s global parameters Chapter 3 describes how to configure Sun StorEdge T3 disk trays into partner groups to form redundant storage systems Chapter 4 provides reference configuration examples Chapter 5 describes
27. e 9 is synchronized automatically with the entire LUN to reflect the data on drive 7 Once the failed drive 7 is replaced the controller unit will automatically copy the data from drive 9 to the new drive and drive 9 will become a hot spare again Tip Although they are not required hot spares are always recommended for mission critical configurations because they allow the controller unit to reconstruct the data from the RAID group and only take a performance hit while the reconstruction is taking place If a hot spare is not used the controller unit remains in write through cache mode until the failed drive is replaced and reconstruction is complete which could take an extended period of time During this time the disk tray is operating in degraded mode If there is no hot spare the reconstruction of the data will begin when the failed drive is replaced provided RAID 1 or RAID 5 is used Chapter 2 Configuring Global Parameters 15 For suggested hot spare configurations for the Sun StorEdge T3 disk tray based on RAID level RAID 1 versus RAID 5 and application size small medium versus medium large refer to the Configuration Rules for Mission Critical Storage Creating and Labeling a Logical Volume Creating and Labeling a Logical Volume You must set the RAID level and the hot spare disk when creating a logical volume For the Solaris operating system to recognize a volume it must be labeled with the format or
28. e LUN RAID level 5 redundancy and no hot spare Once a volume has been configured you cannot reconfigure it to change its size RAID level or hot spare configuration You must first delete the volume and create a new one with the configuration values you want 18 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 CHAPTER 3 Configuring Partner Groups Sun StorEdge T3 disk trays can be interconnected in partner groups to form a redundant and larger storage system Note Partner groups are not supported in Sun Cluster 2 2 This chapter describes how to configure Sun StorEdge T3 disk tray partner groups and it includes the following sections m Understanding Partner Groups on page 19 m Creating Partner Groups on page 22 Understanding Partner Groups A partner group consists of a master controller unit and a slave or alternate master controller unit These controllers are connected with interconnect cables as shown in FIGURE 3 1 Alternate master controller unit Master controller unit Ethernet P dd 9 port LAN Management host FIGURE 3 1 Sun StorEdge T3 Disk Tray Partner Group Note You must insert the media interface adapter MIA into the FC AL port prior to connecting the FC AL cable to the host bus adapter HBA on the application host The 10BASE T Ethernet connection is on t
29. ent host via a LAN for administration purposes m One serial interface to be used for service tasks by qualified service personnel only m Interconnect ports for configuring Sun StorEdge T3 disk trays into partner groups Data Path For the data path FC AL connection the only way to attach a controller unit to an application host is in direct attached mode The controller unit attaches directly to the host FC connector 55 56 Administration Path For the administration path each controller unit has a 1OBASE T Ethernet connector For each installed controller an Ethernet connection and IP address are required The administration server uses this link to set up and manage the Sun StorEdge T3 disk trays using the Sun StorEdge Component Manager facility Note In a partner group only one of the two Ethernet connections is active at any time The second Ethernet connection is used for redundancy Connecting Partner Groups The Sun StorEdge T3 disk tray also has two interconnect cards that connect the disk trays in a partner group These interconnect cards have two ports in and out Note Partner groups are not supported in Sun Cluster 2 2 Note In a standalone configuration these interconnect boards cannot be used to connect to the administrative console or to the application host These interconnect cards are used solely for ensuring redundancy and failover mechanisms in partner groups FIGURE 6 1 sh
30. ernet cables The partner group provides RAS plus failover mechanisms for controller pairs using mirrored caches and redundant FC AL host channels for continuous data availability and redundant Ethernet host connections to the management host FIGURE 1 3 shows a Sun StorEdge T3 disk tray partner group which includes two controller units configured as a master controller unit and an alternate master controller unit Note Partner groups are not supported in Sun Cluster 2 2 Note If you plan to configure a partner group install and set up the standalone units before you power up or configure the pair For information about configuring partner groups see Chapter 3 in this guide Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Management host Ethernet nut port LAN FIGURE 1 3 Sun StorEdge T3 Disk Tray Partner Group Configuration Note You must insert the media interface adapter MIA into the FC AL port prior to connecting the FC AL cable to the host bus adapter HBA on the application host The 10BASE T Ethernet connection is on the public or separate network and requires an IP address The dashed line indicates that an IP address is not required on the alternate master This controller will take over the IP address of the master controller unit if a failover occurs Standalone Configuration In a standalone co
31. esignated as a hot spare If designated drive 9 will be the hot spare for all volumes in the disk tray m A partial drive configuration is not allowed m Volumes cannot span disk tray units Consider the following questions when configuring logical volumes How many logical volumes do you need 1 or 2 a What RAID level do you require m Do you need a hot spare Chapter 2 Configuring Global Parameters 13 Determining How Many Logical Volumes You Need You can configure a volume into seven partitions also known as slices using the format 1M utility Alternatively you can configure virtually a large number of partitions also known as subdisks using VERITAS Volume Manager Therefore Sun StorEdge T3 disk trays are best configured as one large volume Applications benefit from the following logical volume or LUN configurations m Two LUNs per disk tray a OLTP a ISP a ERP a NES version 2 a Attribute intensive NFS version 3 m One LUN per disk tray a Data intensive NFS version 3 a DSS a DW a HPC Note If you are creating new volumes or changing the volume configuration you must first manually rewrite the label of the previous volume using the autoconfigure option of the format 1M UNIX host command For more information on this procedure refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Caution Removing and reconfiguring the volume will destroy all data previously stored there Deter
32. fer to the Sun StorEdge T3 Disk Tray Administrator s Guide Host based alternate pathing such as VERITAS DMP or Sun Enterprise Server AP must also be installed on the host Chapter 4 Configuration Examples 45 wo c oo Switch fan T HBA Application host A x funi E Dee cn HBA Application host B lo SHBA 90 000 AMCU GA NCAA RE A AS FC AL ma tae AS ET 7 Am z CANE Ss E s qu Ethernet FC AL ua 10BASE T port L N Management Host FIGURE 4 10 Dual Hosts With Two Controller Units and Two Switches 46 SunStorEdge T3 Disk Tray Configuration Guide March 2001 Dual Hosts With Eight Controller Units and Two Switches Configured as Four Partner Groups FIGURE 4 11 shows two application hosts connected through FC AL cables to two switches and four Sun StorEdge T3 disk tray partner groups which consist of eight Sun StorEdge T3 disk trays The 10BASE T connection on the master controller is on a public or separate network and requires an IP address for the partner group In the event of a failover the alternate master controller will use the master controller s IP address and MAC address Note This configuration is a recommended enterprise configuration for RAS functionality because the co
33. fmthard command previously stored there T Caution Removing and reconfiguring a logical volume will destroy all data Setting the LUN Reconstruction Rate Note When a failed drive is disabled the volume is operating without further redundancy protection so the failed drive needs to be replaced as soon as possible If the volume has a hot spare configured and that drive is available the data on the disabled drive is reconstructed on the hot spare drive When this operation is complete the volume is operating with full redundancy protection so another drive in the volume may fail without loss of data After a drive has been replaced the original data is automatically reconstructed on the new drive If no hot spare was used the data is regenerated using the RAID redundancy data in the volume If the failed drive data has been reconstructed onto a hot spare once the reconstruction has completed a copy back operation begins where the hot spare data is copied to the newly replaced drive You can also configure the rate at which data is reconstructed so as not to interfere with application performance Reconstruction rate values are low medium and high as follows m low is the slowest and has the lowest impact on performance m medium is the default m high is the fastest and has the highest impact on performance 16 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Note Reconstruction rates can be change
34. he public or private network and requires an IP address The dashed line indicates that an IP address is not required on the alternate master unit This controller will take over the IP address of the master controller unit if a failover occurs When two units are connected together they form a redundant partner group This group provides controller redundancy Because the controller is a single point of failure in a standalone configuration this redundancy allows an application host to access data even if a controller fails This configuration offers multipath and LUN failover features The partner group connection also allows for a single point of control The bottom unit will assume the role of the master and from its Ethernet connections it will be used to monitor and administer the unit installed above it 20 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 The master unit will set the global variables within this storage system including cache block size cache mode and cache mirroring Note For information about setting or changing these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Any controller unit will boot from the master unit s drives All configuration data including syslog information is located on the master unit s drives How Partner Groups Work If the master unit fails and the heartbeat between it and the alternate master stops this failure causes a contro
35. hing Management Software 30 Single Host With Four Controller Units Configured as Two Partner Groups 32 Single Host With Eight Controller Units Configured as Four Partner Groups 34 Hub Host Connection 36 Single Host With Four Controller Units and Two Hubs Configured as Two Partner Groups 36 viii Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Single Host With Eight Controller Units and Two Hubs Configured as Four Partner Groups 38 Dual Hosts With Four Controller Units and Two Hubs 40 Dual Hosts With Eight Controller Units and Two Hubs 42 Switch Host Connection 45 Dual Hosts With Two Controller Units and Two Switches Configured as One Partner Group 45 Dual Hosts With Eight Controller Units and Two Switches Configured as Four Partner Groups 47 Host Connections 49 Sun Enterprise SBus and Graphics I O Boards 50 System Requirements 50 Sun StorEdge PCI FC 100 Host Bus Adapter 51 System Requirements 51 Sun StorEdge SBus FC 100 Host Bus Adapter 52 System Requirements 52 Sun StorEdge PCI Single Fibre Channel Network Adapter 53 System Requirements 53 Disk Tray Cabling 55 Overview of Disk Tray Cabling 55 Data Path 55 Administration Path 56 Connecting Partner Groups 56 Single Disk Tray Configurations 58 Partner Group Configurations 59 Glossary 61 Contents ix x Sun StorEdge T3 Disk Tray Configuration Guide March 2001 GURE 1 1 GURE 1 2 GURE 1 3 GURE 1 4 GURE 3 1 GURE 3 2 GURE 3 3
36. iguration Guide March 2001 Glossary A alternate master controller unit auto cache mode auto disable E command line interface CLI controller unit The secondary disk tray unit in a partner group that provides failover capability from the master unit The default cache mode for the Sun StorEdge T3 disk tray In a fully redundant configuration cache is set to write behind mode In a nonredundant configuration cache is set to write through Read caching is always performed The Sun StorEdge T3 disk tray default that automatically disables a disk drive that has failed The interface between the Sun StorEdge T3 disk tray s pSOS operating system and the user in which the user types commands to administer the disk tray A disk tray that includes a controller card It can be used as a standalone unit or configured with other Sun StorEdge T3 disk trays Glossary 61 F Fibre Channel Arbitrated Loop FC AL field replaceable unit FRU G gigabit interface converter GBIC gigabyte GB or Gbyte H hot spare hot swappable I interconnect card interconnect cable Glossary 62 A 100 Mbyte second serial channel that allows connection of multiple devices disk drives and controllers A component that can be removed and replaced by a field service engineer or a system administrator An adapter used on an SBus card to convert fiber optic signal to copper One gigabyte
37. is equal to one billion bytes A drive in a RAID 1 or RAID 5 configuration that contains no data and acts as a standby in case another drive fails The ability to remove and replace a field replacable unit FRU while the system remains powered on and operational A disk tray component that contains the interface circuitry and two connectors for interconnecting multiple Sun StorEdge T3 disk tray units An FC AL cable with a unique switched loop architecture that is used to interconnect multiple Sun StorEdge T3 disk trays Sun StorEdge T3 Disk Tray Configuration Guide March 2001 L light emitting diode LED logical unit number LUN M master controller unit media access control MAC address media interface adapter MIA megabyte MB or Mbyte megabytes per second MB s P parity partner group power and cooling unit A device that converts electrical energy into light that is used to display activity One or more drives that can be grouped into a unit also called a volume The main controller unit in a partner group configuration A unique address that identifies a device on a network An adapter that converts fiber optic light signals to copper One megabyte is equal to one million bytes A performance measurement of the sustained data transfer rate Additional information stored with data on a disk that enables the controller to rebuild data after a drive failure A
38. k Tray Controller Card and Interconnect Cards 57 Single Disk Tray Configuration 58 Partner Group Tray Configuration 59 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 CHAPTER 1 Sun StorEdge T3 Disk Tray Configuration Overview This chapter describes the Sun StorEdge T3 disk tray and its connection ports and Fibre Channel connections It also describes basic rules and recommendations for configuring the disk tray and it lists supported hardware and software platforms This chapter is organized as follows m Product Description on page 1 m Configuration Guidelines and Restrictions on page 7 m Configuration Recommendations on page 7 m Supported Platforms on page 8 m Sun Cluster 2 2 Support on page 8 Note For installation and cabling information refer to the Sun StorEdge T3 Disk Tray Installation Operation and Service Manual For software configuration information refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Product Description The Sun StorEdge T3 disk tray is a high performance storage device that provides a redundant array of independent disks RAID architecture for modular scalable data storage The disk tray contains the controller card and nine disk drives with Fibre Channel connectivity to the data host The Sun StorEdge T3 disk tray includes redundant hot swappable components and automatic notification of failed components The disk tray can be used either as a
39. k tray configurations can be derived from FIGURE 6 3 Alternate master unit I RS 232 serial port Interconnect cables ER E Il J 10BASE T connection FC AL Master unit 1 2 R em EE A 2 CL FC AL connection FIGURE 6 3 Partner Group Tray Configuration The following rules configuration rules apply to partner group configurations The interconnect ports which are used only in partner group configurations cannot be used for host connections The FC AL connection provides a data path to the application host The 10BASE T Ethernet unshielded twisted pair connection provides a link to the management host The RS 232 serial port is used solely for diagnostics and service by qualified service personnel only Fiber optic cable lengths between 2 and 500 meters using short wave laser and 50 micron fiber optic cable are supported Chapter 6 Disk Tray Cabling 59 This configuration is optimal because it provides full redundancy to the application hosts Failover mechanisms are provided within the trays but the application host has to provide data path failover mechanisms such as Dynamic Multi Pathing from VERITAS Volume Manager or Alternate Pathing from Sun Enterprise Server Alternate Pathing 60 Sun StorEdge T3 Disk Tray Conf
40. ler Units Configured as Four Partner Groups on page 34 Hub Host Connection m Single Host With Four Controller Units and Two Hubs Configured as Two Partner Groups on page 36 m Single Host With Eight Controller Units and Two Hubs Configured as Four Partner Groups on page 38 m Dual Hosts With Four Controller Units and Two Hubs on page 40 m Dual Hosts With Eight Controller Units and Two Hubs on page 42 Switch Host Connection m Dual Hosts With Two Controller Units and Two Switches Configured as One Partner Group on page 45 m Dual Hosts With Eight Controller Units and Two Switches Configured as Four Partner Groups on page 47 Although there are many supported configurations these reference configurations provide the best solution for many installations 27 Direct Host Connection Single Host With One Controller Unit FIGURE 4 1 shows one application host connected through an FC AL cable to one Sun StorEdge T3 disk tray controller unit The 10BASE T connection connects the controller to a management host via a LAN on a public or separate network and requires an IP address You must insert the media interface adapter MIA into the FC AL connection port prior to connecting the FC AL cable to the HBA on the application host Note This configuration is not recommended for RAS functionality because the controller is a single point of failure Application host o Ej iG EED
41. ller failover where the alternate master assumes the role of the master unit The new master formerly the alternate master takes the IP address and the MAC address from the old master and begins to function as the administrator of the storage system It will also be able to access the former master unit s drives The former master unit s drives will still be used to store syslog information system configuration information and bootcode Should it become necessary to reboot the storage system while the master unit is inactive the alternate master will use the former master unit s drives to boot from Note After the failed master controller is back online it remains the alternate master controller and as a result the original configuration has been modified from its original state In a redundant partner group configuration the units can be set to do a path failover operation Normally the volumes or LUNs that are controlled by one unit are not accessible to the controller of the other The units can be set so that if a failure in one controller occurs the remaining one will accept I O for the devices that were running on the failed controller Note In order for a feature such as VERITAS DMP to access a LUN through both controllers in a redundant partner group the mp_support parameter must be set to rw to enable this feature Chapter 3 Configuring Partner Groups 21 22 Creating Partner Groups Partner groups can be
42. lti Pathing DMP or Alternate Pathing AP for failover only The following three global parameters must be set on the master controller as follows m mp support rw m cache mode auto W cache mirroring auto Note For information on setting these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Host Multi Pathing Management Software While the Sun StorEdge T3 disk tray is a redundant device that automatically reconfigures itself whenever a failure occurs on any of its internal components a host based solution is needed for a redundant data path Dynamic Multi Pathing DMP is provided by VERITAS Volume Manager version 3 0 4 and above Alternate Pathing AP is provided by Sun Enterprise Server Alternate Pathing AP 2 3 1 During normal operation I O moves on the host channel connected to the controller that owns the disks This path is an active path During failover operation DMP or AP directs all I O to the alternate channel s controller This path is the failover path When the master controller fails the alternate master controller becomes the master When the failed controller is repaired the new controller immediately boots goes online and becomes the alternate master controller The former alternate master controller remains as the current master controller Note DMP which is provided by VERITAS Volume Manager or AP must be installed on the application host
43. lways performed Auto caching mode provides the best performance while retaining full redundancy protection Auto is the default cache mode for the Sun StorEdge T3 disk tray m Write behind All read and write operations are written to cache An algorithm determines when the data is destaged or moved from cache to disk Write behind cache improves performance because a write to a high speed cache is faster than a write to a normal disk Use write behind cache mode with a standalone disk tray configuration when you want to force write behind caching to be used m Write through This cache mode forces write through caching to be used In write through cache mode data is written through cache in a serial manner and is then written to the disk Write through caching does not improve write performance However if a subsequent read operation needs the same data the read performance is improved because the data is already in cache None No reads or writes are cached Note For full redundancy set the cache mode and the mirror variable to auto for a partner group This ensures that the cache is mirrored between controllers and that write behind cache mode is in effect If a failure occurs the data is synchronized to disk and then write through mode takes effect Once the problem has been corrected and all internal components are again optimal the system will revert to operating in write behind cache mode Configuring Data Block
44. mining Which RAID Level You Require For a new installation of a Sun StorEdge T3 disk tray the default configuration is 8 1 RAID 5 without a hot spare In general RAID 5 is efficiently managed by the RAID controller hardware This efficiency is apparent when compared to RAID 5 software solutions such as VERITAS Volume Manager 14 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 The following applications benefit most from the RAID controller hardware of the Sun StorEdge T3 disk tray m Data intensive NFS file system version 3 m DSS m DW m HPC Note For more information about RAID levels see Using RAID Levels to Configure Redundancy later in this chapter For more detailed information about configuring RAID storage refer to the Configuration Rules for Mission Critical Storage document also known as the Big Rules document Determining Whether You Need a Hot Spare If you choose to include a hot spare disk drive in your configuration you must specify it when you create the first volume in the disk tray If you want to add a hot spare at a later date you must remove the existing volume s and recreate the configuration Note Only one hot spare is allowed per disk tray and it is only usable for the disk tray in which it is configured The hot spare must be configured as drive 9 Drive 9 will be the hot spare in the unit So for example should a drive failure occur on drive 7 driv
45. n configuration to link more than two controller units in a partner group Caution When configuring a partner group be sure to use the MAC address of the master controller unit Note Refer to the Configuration Rules for Mission Critical Storage document also known as the Big Rules document for further configuration rules Configuration Recommendations m Use partner groups partner groups are not supported in Sun Cluster 2 2 m Use host based software such as VERITAS Volume Manager VxVM 3 0 4 or Sun Enterprise Server Alternate Pathing AP 2 3 1 m Connect redundant paths to separate host adapters I O cards and system buses m Configure active paths over separate system buses to maximize bandwidth Chapter 1 Sun StorEdge T3 Disk Tray Configuration Overview 7 Caution The Sun StorEdge T3 disk tray and its global parameters must be tailored to match the I O workload for optimum performance Within a partner group both units will share the same volume configuration block size and cache mode That is all cache parameter settings are common to both units within a partner group Supported Platforms The Sun StorEdge T3 disk tray supports the following host platforms m Sun Ultra 60 and Ultra 80 workstations m Sun Enterprise 250 450 3x00 4x00 5x00 6x00 servers m Sun Enterprise 10000 server The Sun StorEdge T3 disk tray supports the following software versions m Solaris 2 6 Solaris 7
46. nfiguration one controller unit is connected to an application host through an FC AL cable The controller unit is connected to a management host through an Ethernet cable While this unit is fully populated with redundant hot swappable components and nine disk drives it is not a recommended configuration for high availability In the standalone configuration the controller unit and any device in the host to T3 data path hubs MIA HBA host to T3 data cable etc is a single point of failure Chapter 1 Sun StorEdge T3 Disk Tray Configuration Overview 5 FIGURE 1 4 shows the standalone disk tray configuration with one controller Application host COG esse S 5o ma a 9 HBA 7 10BASE T HBA MIA FC AL connection Ethernet port P E A 7 LAN Management host FIGURE 1 4 Sun StorEdge T3 Disk Tray Standalone Configuration 6 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Configuration Guidelines and Restrictions m Standalone controller unit The media access control MAC address is required to assign an IP address to the controller unit The MAC address uniquely identifies each node of a network The MAC address is available on the pull out tab on the front left side of the Sun StorEdge T3 disk tray behind the front cover m Partner group configuration You cannot connect a partner group to more than one host You cannot use a daisy chai
47. ng power and there is no drive activity For more information on LEDs and how to interpret them refer to the Sun StorEdge T3 Disk Tray Installation Operation and Service Manual Note The master unit is defined automatically upon power up Allow enough time for the alternate master to be booted up by the master Check that the following global parameters are set as follows m mp support rw m cache auto W mirror auto Note For information on setting these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Create the data volumes Refer to the Sun StorEdge T3 Disk Tray Administrator s Guide To Create a Partner Group From Existing Standalone Units Refer to Section 10 1 Connecting Single Controller Units to Form a Partner Group of the Sun StorEdge T3 Disk Tray Field Service Manual for detailed instructions on performing this procedure Chapter 3 Configuring Partner Groups 25 26 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 CHAPTER 4 Configuration Examples This chapter includes the following sample reference configurations for the Sun StorEdge T3 disk tray Direct Host Connection m Single Host With One Controller Unit on page 28 m Single Host With Two Controller Units Configured as a Partner Group on page 29 m Single Host With Four Controller Units Configured as Two Partner Groups on page 32 m Single Host With Eight Control
48. ntroller is not a single point of failure Each T3 disk tray needs to be assigned a unique target address using the port set command These target addresses can be any number between 1 and 125 At the factory the disk tray target addresses are set starting with target address 1 for the bottom disk tray and continuing to the top disk tray Use the port list command to verify that all T3 disk trays have a unique target address Refer to Appendix A 3 12 of the Sun StorEdge T3 Disk Tray Administrator s Guide for further details The following three parameters must be set on the master controller as follows m mp support rw m cache mode auto m cache mirroring auto Note For information on setting these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Host based alternate pathing such as VERITAS DMP or Sun Enterprise Server AP must also be installed on the host Chapter 4 Configuration Examples 47 lt o 2 E z E S o 3 3 g E A 5 lt lt lt lt s lle 8 z E E 2 9 1 S e s l l T NN NN UN NS 1 LE S LES S SS SS 3 NL Sem A ONE oe DE ra 2 GREG be Bell Soh e
49. on 2 a Attribute intensive NFS file system version 3 Chapter 2 Configuring Global Parameters 11 12 m 64 Kbyte data block size a Data intensive NFS file system version 3 Decision Support Systems DSS a Data Warehouse DW a High Performance Computing HPC Note The data block size must be configured before any logical volumes are created on the units Remember this block size is used for every logical volume created on the unit Therefore it is important to have similar application data configured per unit Note For more detailed information about configuring data block or stripe unit size refer to the Configuration Rules for Mission Critical Storage document also known as the Big Rules document Data block size is universal throughout a partner group Therefore you cannot change it after you have created a volume To change the data block size you must first delete the volume s change the data block size and then create new volume s Caution Unless you back up and restore the data on these volumes it will be lost Enabling Mirrored Cache By enabling mirrored cache you can safeguard cached data if a controller fails Note Mirrored cache is possible only in a redundant partner group configuration Configuring Cache Allocation Cache is allocated based on the read write mix and itis dynamically adjusted by the controller firmware based on the I O profile of the applic
50. onfigure a partner group from new units from the factory be sure to install and set up the units as a partner group before you power on and change any parameters or create change any logical volumes Refer to the Sun StorEdge T3 Disk Tray Installation Operation and Service Manual for more information Note For more information on changing global parameters for the Sun StorEdge T3 disk tray refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Cache Each controller unit has 256 Mbytes of data cache Writing to cache improves write performance by staging data in cache assembling the data into data stripes and then destaging the data from cache to disk when appropriate This method frees the data host for other operations while cache data is being destaged and it eliminates the read modify write delays seen in non cache systems Read cache improves performance by determining which data will be requested for the next read operation and prestaging this data into cache RAID 5 performance is also improved by coalescing writes Configuring Cache for Performance and Redundancy Cache mode can be set to the following values m Auto The cache mode is determined as either write behind or write through based on the I O profile If the disk tray has full redundancy available then caching operates in write behind mode If any disk tray component is non redundant the caching mode is set to write through Read caching is a
51. ows a Sun StorEdge T3 disk tray with its controller card and interconnect cards Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Controller card RS 232 serial port 10BASE T Ethernet management host interface port Interconnect FC AL application cards host interface port FIGURE 6 1 StorEdge Disk Tray Controller Card and Interconnect Cards Chapter6 Disk Tray Cabling 57 Single Disk Tray Configurations All single disk tray configurations can be derived from FIGURE 6 2 Bi 4 T o oo ED O END 0 o oO i FC AL connection port Interconnect ports 10BASE T RS 232 serial port Ethernet port o oo CED O E O FIGURE 6 2 Single Disk Tray Configuration The following configuration rules apply to single disk tray configurations m The interconnect ports which are used only in partner group configurations cannot be used for host connections m The FC AL connection provides a data path to the application host m The 10BASE T Ethernet unshielded twisted pair connection provides a link to the management host m The RS 232 serial port is used solely for diagnostics and service by qualified service personnel only m Fiber optic cable lengths between 2 and 500 meters using short wave laser and 50 micron fiber optic cable are supported 58 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Partner Group Configurations All partner group dis
52. r controller as follows m mp support rw m cache mode auto W cache mirroring auto Note For information on setting these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Host based alternate pathing such as VERITAS DMP or Sun Enterprise Server AP must also be installed on the host 34 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Interconnect cables AMCU Application host HBA HBA HBA Ethernet port Management host FIGURE 4 5 Single Host With Eight Controller Units Configured as Four Partner Groups Chapter 4 Configuration Examples 35 Hub Host Connection Single Host With Four Controller Units and Two Hubs Configured as Two Partner Groups FIGURE 4 6 shows one application host connected through FC AL cables to two hubs and two Sun StorEdge T3 disk tray partner groups which consist of four Sun StorEdge T3 disk trays The 10BASE T connection on the master controller is on a public or separate network and requires an IP address for the pa
53. rt m Solaris 2 6 or higher version of the Solaris operating system 52 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Sun StorEdge PCI Single Fibre Channel Network Adapter The Sun StorEdge PCI Single Fibre Channel network adapter is a Fibre Channel PCI card with one onboard optical receiver This network adapter is PCI Version 2 1 compliant For more detailed information about this product refer to the Sun StorEdge PCI Single Fibre Channel Network Adapter Installation Guide part number 806 7532 10 FIGURE 5 4 shows a Sun StorEdge PCI Single Fibre Channel network adapter FIGURE 5 4 Sun StorEdge PCI Single Fibre Channel Network Adapter System Requirements Your system must meet the following hardware and software requirements m An available PCI port m Solaris 7 or higher version of the Solaris operating system Chapter 5 Host Connections 53 54 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 CHAPTER 6 Disk Tray Cabling This chapter describes the disk tray configurations supported by the Sun StorEdge T3 disk tray and it includes the following sections m Overview of Disk Tray Cabling on page 55 m Single Disk Tray Configurations on page 58 m Partner Group Configurations on page 59 Overview of Disk Tray Cabling The Sun StorEdge T3 disk tray has the following connections m One FC AL interface to the application host m One 10BASE T Ethernet interface to the managem
54. rtner group In the event of a failover the alternate master controller will use the master controller s IP address and MAC address Note This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure Note There are no hub port position dependencies when connecting a Sun StorEdge T3 disk tray to a hub A Sun StorEdge T3 disk tray can be connected to any available port on the hub Each 13 disk tray needs to be assigned a unique target address using the port set command These target addresses can be any number between 1 and 125 At the factory the disk tray target addresses are set starting with target address 1 for the bottom disk tray and continuing to the top disk tray Use the port list command to verify that all T3 disk trays have a unique target address Refer to Appendix A 3 12 of the Sun StorEdge T3 Disk Tray Administrator s Guide for further details The following three parameters must be set on the master controller as follows m mp support rw m cache mode auto m cache mirroring auto Note For information on setting these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Host based alternate pathing such as VERITAS DMP or Sun Enterprise Server AP must also be installed on the host 36 SunStorEdge T3 Disk Tray Configuration Guide March 2001
55. s that can only be performed by qualified service personnel FIGURE 1 1 shows the controller card and its ports 2 SunStorEdge T3 Disk Tray Configuration Guide March 2001 RS 232 serial port RJ 11 6 10BASE T Ethernet management host interface port RJ 45 FC AL data connection port FIGURE 1 1 Controller Card and Ports m On the interconnect cards a Two interconnect ports one input and one output for interconnecting multiple Sun StorEdge T3 disk trays The interconnect card provides switch and failover capabilities as well as an environmental monitor for the disk tray Each disk tray contains two interconnect cards for redundancy thus providing a total of four interconnect ports FIGURE 1 2 shows a Sun StorEdge T3 disk tray interconnect card Chapter 1 Sun StorEdge T3 Disk Tray Configuration Overview 3 4 Output FIGURE 1 2 Interconnect Card and Ports FC AL Configurations Each disk tray uses Fibre Channel Arbitrated Loop FC AL connections to connect to the application host An FC AL connection is a 100 Mbyte second serial channel that allows multiple devices such as disk drives and controllers to be connected Partner Group Configuration In a partner group configuration two Sun StorEdge T3 disk trays are paired using interconnect cables The partner group is connected to one application host through two FC AL cables The partner group is connected to a management host through two 10BASE T Eth
56. sed upon an architecture developed by Sun Microsystems Inc The OPEN LOOK and Sun Graphical User Interface was developed by Sun Microsystems Inc for its users and licensees Sun acknowledges the pioneering efforts of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry Sun holds a non exclusive license from Xerox to the Xerox Graphical User Interface which license also covers Sun s licensees who implement OPEN LOOK GUIs and otherwise comply with Sun s written license agreements Federal Acquisitions Commercial Software Government Users Subject to Standard License Terms and Conditions DOCUMENTATION IS PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID Copyright 2001 Sun Microsystems Inc 901 San Antonio Road Palo Alto CA 94303 4900 Etats Unis Tous droits r serv s Ce produit ou document est distribu avec des licences qui en restreignent l utilisation la copie la distribution et la d compilation Aucune partie de ce produit ou document ne peut tre reproduite sous aucune forme par quelque moyen que ce soit sans l autorisation pr alable et crite de Sun et de ses bailleurs de licence s il y en a Le logiciel d tenu par des tiers
57. t controllers 47 to 48 dual hosts with two controllers 45 to 46 using AP 30 to 31 using DMP 30 to 31 RAID and applications 15 configuring for redundancy 17 default level 18 determining level required 14 levels defined 17 Index 68 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 S SOC HBA 52 stripe unit size See data block size Sun Cluster 2 2 support 8 Sun Enterprise SBus and Graphics I O boards See I O boards Sun StorEdge PCI FC 100 HBA 51 Sun StorEdge PCI Single Fibre Channel network adapter 53 Sun StorEdge SBus FC 100 HBA 52 Ww write behind cache mode 10 write through cache mode 10 Index 69 Index 70 Sun StorEdge T3 Disk Tray Configuration Guide March 2001
58. the format utility refer to the format 1M man page For more information on third party software or VERITAS Volume Manager refer to the documentation for that product RAID 0 Data blocks in a RAID 0 volume are striped across all the drives in the volume in order There is no parity data so RAID 0 uses the full capacity of the drives There is however no redundancy If a single drive fails all data on the volume is lost Chapter 2 Configuring Global Parameters 17 RAID 1 Each data block in a RAID 1 volume is mirrored on two drives If one of the mirrored pair fails the data from the other drive is used Because the data is mirrored in a RAID 1 configuration the volume has only half the capacity of the assigned drives For example if you create a 4 drive RAID 1 0 volume with 18 Gbyte drives the resulting data capacity is 4 x 18 2 36 Gbytes RAID 5 In a RAID 5 configuration data is striped across the drives in the volumes in segments with parity information being striped across the drives as well Because of this parity if a single drive fails data can be recovered from the remaining drives Two drive failures cause all data to be lost A RAID 5 volume has the data capacity of all the drives in the logical unit less one For example a 5 drive RAID 5 volume with 18 Gbyte drives has a capacity of 5 1 x 18 72 Gbytes Configuring RAID Levels The Sun StorEdge T3 disk tray is preconfigured at the factory with a singl
59. torEdge T3 Disk Tray Configuration Guide March 2001 Sun StorEdge PCI FC 100 Host Bus Adapter The Sun StorEdge PCI FC 100 host bus adapter is a 33 MHz 100 Mbytes second single loop Fibre Channel PCI host bus adapter with an onboard GBIC This host bus adapter is PCI Version 2 1 compliant For more detailed information about this product refer to the Sun StorEdge PCI FC 100 Host Adapter Installation Manual part number 805 3682 FIGURE 5 2 shows a Sun StorEdge PCI FC 100 host bus adapter FIGURE 5 2 Sun StorEdge PCI FC 100 Host Bus Adapter System Requirements Your system must meet the following hardware and software requirements m An available PCI port m Solaris 2 6 or higher version of the Solaris operating system Chapter 5 Host Connections 51 Sun StorEdge SBus FC 100 Host Bus Adapter The Sun StorEdge SBus FC 100 host bus adapter is a single width Fibre Channel SBus card with a Sun Serial Optical Channel SOC ASIC application specific integrated circuit You can connect up to two loops to each card using hot pluggable GBICs For more detailed information about this product refer to the Sun StorEdge SBus FC 100 Host Adapter Installation and Service Manual part namber 802 7572 FIGURE 5 3 shows a Sun StorEdge SBus FC 100 host bus adapter FIGURE 5 3 Sun StorEdge SBus FC 100 Host Bus Adapter System Requirements Your system must meet the following hardware and software requirements m An available SBus po
60. uide March 2001 AMCU Interconnect cables JOBASE T Application host SIHBA Ethernet port m Management host LAN FIGURE 4 4 Single Host With Four Controller Units Configured as Two Partner Groups Note You must insert the media interface adapter MIA into the FC AL port prior to connecting the FC AL cable to the HBA on the application host The 10BASE T connection is on a public or separate network and requires an IP address The dashed line indicates that an IP address is not necessary This controller will take over the IP address and the MAC address of the master unit if a failover occurs Chapter 4 Configuration Examples 33 Single Host With Eight Controller Units Configured as Four Partner Groups FIGURE 4 5 shows one application host connected through FC AL cables to eight Sun StorEdge T3 disk trays forming four partner groups This configuration is the maximum allowed in a 72 inch cabinet This configuration can be used for footprint and I O throughput Note This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure The following three parameters must be set on the maste
61. wed in a 72 inch cabinet This configuration can be used for footprint and I O throughput Note This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure Note There are no hub port position dependencies when connecting a Sun StorEdge T3 disk tray to a hub A Sun StorEdge T3 disk tray can be connected to any available port on the hub Each T3 disk tray needs to be assigned a unique target address using the port set command These target addresses can be any number between 1 and 125 At the factory the disk tray target addresses are set starting with target address 1 for the bottom disk tray and continuing to the top disk tray Use the port list command to verify that all T3 disk trays have a unique target address Refer to Appendix A 3 12 of the Sun StorEdge T3 Disk Tray Administrator s Guide for further details The following three parameters must be set on the master controller as follows m mp support rw m cache mode auto m cache mirroring auto Note For information on setting these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide Host based alternate pathing such as VERITAS DMP or Sun Enterprise Server AP must also be installed on the host 38 Sun StorEdge T3 Disk Tray Configuration Guide March 2001 Application host E Hub EE Bl
62. wo parameters must be set on the master controller as follows m cache mode auto m cache mirroring auto Note For information on setting these parameters refer to the Sun StorEdge T3 Disk Tray Administrator s Guide 40 SunStorEdge T3 Disk Tray Configuration Guide March 2001 Application host A Beeren tene n qua MIA 1 LOBASE T Ethernet port LAN Management host FIGURE 4 8 Dual Hosts With Four Controller Units and Two Hubs Chapter4 Configuration Examples 41 42 Dual Hosts With Eight Controller Units and Two Hubs FIGURE 4 9 shows two application hosts connected through FC AL cables to two hubs and eight Sun StorEdge T3 disk trays This configuration also known as a Multi Initiator configuration can be used for footprint and I O throughput The following limitations should be evaluated when proceeding with this configuration a Multi Initiator configurations are only supported with single tray T3 configurations no partner groups m Because only single trays are supporte

Sun StorEdge™ T3 Disk Tray Configuration Guide

Contents

Download Pdf Manuals

Related Search

Related Contents

Sun StorEdge&trade; T3 Disk Tray Configuration Guide

Contents

Download Pdf Manuals

Related Search

Related Contents

Sun StorEdge™ T3 Disk Tray Configuration Guide