Home

EMC FC5300 User's Manual

1. Storage Group ID or name Server hostname Dedicated Shared Q LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs Storage Group ID or name Server hostname Dedicated Shared O LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs Storage Group ID or name Server hostname Dedicated Shared LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs Planning Applications LUNs and Storage Groups 3 9 Planning File Systems and LUNs with Shared Switched Storage LUN 2 1 RAID 1 Part of a sample LUN and Storage Group worksheet follows 3_0 3_1 3_2 3_3 34 35 36 3_7 3_8 3_9 2_0 2_1 2_2 2_3 2_4 2_5 2_6 2_7 2_8 2_9 1_11_2 1_3 1_4 1_5 1_ 19 L RAID 5 UN 0 o_o o_1 0_2 030 o5 o6 lo 7 08 0o9 LUN 1 RAID 5 tora tem number orn _ SS1 Storage system numbe ang Se
2. SPA SPB l LUN Cluster l LUN Storage Group LUN Physical storage U systems with up to LUN 100 disks per storage Database Server LUN system Storage Group 4 LUN Path 1 Path 2 Figure 1 10 Sample SAN Configuration Access Control with Shared Storage Access control permits or restricts a server s access to shared storage There are two kinds of access control e Configuration access control e Data access control Configuration access control lets you restrict the servers through which a user can send configuration commands to an attached storage system Data access control is provided by Storage Groups During storage system configuration using a management utility the system administrator associates a server with one or more LUNs Each server sees its Storage Group as if it were an entire storage system and never sees the other LUNs on the storage system Therefore it cannot access or modify data on LUNs that are not part of its Storage Group However you can define a Storage Group to be accessible by more than one server if as shown above the servers run cluster software About Switched Shared Storage and SANs Storage Area Networks Ea About Fibre Channel Storage Systems and Networks SANs The following figure shows both data access control Storage Groups and configuration access control Each server has exclusive read and write access to it
3. Number of servers _1_ Adapters in servers _1__Hubs copper MIAs copper to optical DPE based and DAE only storage systems Rackmount DPEs SP LCC pairs PSs SPSs Rackmount cabinets Rackmount iDAEs __1 SPs __1 PSs 1__SPSs Rackmount cabinets __1_ Rackmount DAEs ___ 1 __ LCCs __1 PSs _1 Deskside DPEs SP LCC pairs DAE LCCs DPE PSs DAE PSs SPSs __ Deskside iDAEs SPs DAE LCCs PSs SPSs Deskside DAEs 30 slot 10 slot LCCs PSs Cables between server and storage system or between server and hub Cable A copper or optical Cable A Number __2Z Copper OOptical i Length__10___gy or ft Cable As Number Copper DOptical ii ceeeeeneetees Length mor ft Cable A Number Copper O Optical i ceeeeeneetnees Length mor ft Cables between hubs and storage systems Cable D copper or optical Cable D Number XKCopper DORtical i ceseeseeeeens Length m or ft Cable Do Number Copper UOptical i caeeeeneetees Length mor ft Cable D Number Copper FH Optical ceeeeeeeeeees Length mor ft Cables between storage systems or enclosures Cable E which connects LCCs or SP LCC between a DPE LCC or iDAE SP and a DAE LCC Cable E must be copper between DAE LCCs it can be copper or optical Cable E Number __2Z OCopperUOptical DAE to DAE only Length__1 mor Cable Es Number C
4. 5 3 Rackmount System with DPE and DAES i 5 4 Shared Storage System Siessen cats savse iii 5 5 Storage System Types for Unshared Storage 5 7 DPE Components Deskside Model i 5 8 Disks and Disk IDS alici 5 9 EMC Fibre Channel Storage System Configuration Planning Guide vii viii 5 8 5 9 5 10 5 11 5 12 5 13 5 14 5 15 5 16 5 17 6 1 6 2 Storage System with Two SPs Connected to the Same Server 5 10 Storage System with Two SPs Connected to Different Servers 5 10 Comparison Between Optical and Copper Cabling 5 21 Cable Identifier DPE Based System for Shared Storage 5 24 Sample Shared Storage Installation iii 5 26 Cable Identifier Unshared System without Hubs 5 28 Cable Identifier Unshared Full Fibre System with Hubs 5 29 Sample Unshared Deskside System Basic Configuration 5 31 Sample Unshared Deskside System Dual Adapter Dual SP Configuration iure ia 5 32 Sample Component Worksheet for DPE Based System with Hubs Two LOOPS ritiri ii ie taste 5 34 Sample Shared Switched Environment with Navisphere Manager 6 4 Sample Unshared Environment with Navisphere Manager 6 4 EMC Fibre Channel Storage System Config
5. 5 6 Disk rie 5 8 Storage Processor SP 5 9 Planning Your Hardware Components 5 11 Configuration Tradeoffs Shared Storage 5 11 Configuration Tradeoffs Unshared Storage 5 12 Hardware Data Sheets ei 5 14 DPE Data Sheet iaia 5 14 IDAE Data Sheet ernea alan 5 16 DAE Data Sheet nio iran 5 18 Cabinets for Rackmount ENClosures e 5 20 Cable and Configuration Guidelines 5 21 Hardware Planning Worksheets in 5 24 Hardware for Shared Storage n 5 24 Hardware Component Worksheet for Shared Storage 5 25 Hardware Component Worksheet for Shared Storage 5 27 Hardware for Unshared Storage 5 27 Hardware Component Worksheet for Unshared Storage 5 30 Hardware Component Worksheet for Unshared Storage 5 31 Hardware Component Worksheet for Unshared Storage 5 33 Hardware Component Worksheet for Unshared Storage 5 35 Chapter 6 Storage System Management Using Navisphere Manager Software 6 3 Storage Management Worksheets in 6 5 Index aaa i 1 EMC Fibre Channel Storage Systems Configuration Planning Guide EMC Fibre Channel Storage Systems Configuration Planning Guide 1 1 1 2 1 3 1 4 1 5 1 6 1 7 1
6. Cables between hubs and storage systems Cable D copper or optical Cable D Number Copper O Optical m or ft Cable Do Number Copper O Optical m or ft Cable Dm Number O Copper O Optical m or ft Cables between storage systems or enclosures Cable E which connects LCCs or SP LCC between a DPE LCC or iDAE SP and a DAE LCC Cable E must be copper between DAE LCCs it can be copper or optical Cable E Number __6___ Copper O0Optical DAE to DAE only Length__1 m or Cable Eo Number __2___ OCopper 1 Optical DAE to DAE only 5 Qnortt Hardware Planning Worksheets 5 33 Storage System Hardware 5 34 Server 1 Server 2 Cable between server and hub Cable between server and hub ol pae lo O O Q Q Cable between Cable between hub and storage Q Q storage systems or enclosures system n a 5 5 F lag i 3 oe E O O Cable between hub and storage Storage system 1 system ol pae lo O ol pae lo O Ql pae lo O O F gt Q DAE O O lo ol pre lo O O SPB SPA FC Loop 1 FC Loop 2 Storage system 2 Figure 5 17 Sample Component Worksheet for DPE Based System with Hubs Two Loo
7. ui 1 10 About Switched Shared Storage and SANs Storage Area Networks anfibi 1 11 Storage GIOUPpS znii iii 1 12 Storage System Hardware for Shared Storage 1 15 About Unshared Storage ie 1 16 Storage System Hardware for Unshared Storage 1 16 RAID Types and Tradeoffs Introducing RAID uuuiiaaia 2 2 Disk Stripinig aiar 2 2 Mirroring acacia 2 2 RAID Groups and LUNS 2 3 RAID Ty p son enone E E EEA E 2 4 RAID 5 Group Individual Access Array 2 4 RAID 3 Group Parallel Access Array n 2 5 EMC Fibre Channel Storage Systems Configuration Planning Guide it Chapter 3 Chapter 4 Chapter 5 RAID 1 Mirrored Pair i 2 7 RAID 0 Group Nonredundant Array 0 2 8 RAID 1 0 Group Mirrored RAID 0 Group 2 8 Individual Disk Unit 2 9 Hot Spate uri A sata 2 9 RAID Benefits and TradeoffS in 2 12 Performance na 2 13 storage Flex1bility a Mori aikaisesti tabs ieies 2 14 Data Availability and Disk Space Usage 2 14 Guidelines for RAID Types 2 17 Sample Applications for RAID Types u iii 2 19 Planning File Systems and LUNs with Shared Switched Storage Dual Paths t LUINS ss scceccseescocstepistccespiont cesesssooeduvissesessubuesseesbovdect
8. Hot spare A hot spare provides no data storage but enhances the availability of each RAID 5 RAID 3 RAID 1 and RAID 1 0 Groupin a storage system Use a hot spare where you must regain high availability quickly without human intervention if any disk in such a RAID Group fails A hot spare also minimizes the period of degraded performance after a RAID 5 or RAID 3 disk fails This chapter explained RAID Group types and tradeoffs To plan LUNs and file systems for shared storage continue to Chapter 3 or for unshared storage skip to Chapter 4 For details on storage system hardware shared and unshared skip to Chapter 5 For storage system management utilities skip to Chapter 6 EMC Fibre Channel Storage System Configuration Planning 3 Planning File Systems and LUNs with Shared Switched Storage This chapter shows a sample RAID LUN and Storage Group configuration with shared storage and then provides worksheets for planning your own shared storage installation Topics are ei Dual Paths to LUNS oonu ena neen 3 2 e Sample Shared Switched Installation estes 3 3 e Planning Applications LUNs and Storage Groups 3 6 Planning File Systems and LUNs with Shared Switched Storage at Planning File Systems and LUNs with Shared Switched Storage Dual Paths to LUNs A shared storage system includes two or more servers one or two Fibre Channel switches
9. 05 15 2 5 06 1_6 2 6 0_7 1_7 27 0_8 18 28 0_9 19 29 Storage system number LUN number RAID type ___ Cap Gb Disk IDs LUN number RAID type ___ Cap Gb _____ Disk IDs LUN number RAID type ___ Cap Gb _____ Disk IDs LUN number RAID type ___ Cap Gb _____ Disk IDs LUN number RAID type ___ Cap Gb _____ Disk IDs LUN number RAID type ___ Cap Gb _____ Disk IDs LUN number RAID type ___ Cap Gb _____ Disk IDs LUN number RAID type ___ Cap Gb Disk IDs RES EMC Fibre Channel Storage Systems Configuration Planning Guide Planning LUNs and File Systems with Unshared Direct Storage A sample LUN worksheet follows 20 21 2 2 2 3 12 412 a 26 2_7 112 8 29 LUN 10 1_1 1_2 1_3 14 1 a 16 17 18 19 RAID 1 LUN 0 00 o_1 0203 o Ns fos 07 os os LUN ID 5 RAID 5 144piskims 00 01 02 0 3 04 LUN number 0 RAID type 5 Cap Gb Diskips__0_5 0_6 0_7 0_8 0_9 Gb LUN number RAID type Cap Gb Gb Gb ha ha A A LUN number___2 RAID type 5 Cap Gb __36 Disk IDs 1 0 1 1 LUN number RAID type 1 Cap Gb _____ Disk IDs LUN number RAID type Cap Gb Disk IDs LUN number RAID type Cap Gb Disk IDs LUN number RAID type Cap Gb Disk IDs LUN number RAID type Cap Gb Disk IDs Completing the LUN Planning Worksheet As s
10. 8 or 16 Kbytes As a general guideline we suggest For a general purpose file server 8 Kbytes For a database application 2 or 4 Kbytes The ideal cache page size depends on the operating system and application Use memory for RAID 3 If you want to use the SP memory for RAID 3 check the box RAID Group LUN Entries Complete a RAID Group LUN entry for each LUN and hot spare LUN ID The LUN ID is a hexadecimal number assigned when you bind the disks into a LUN By default the ID of the first LUN bound is 0 the second 1 and so on Each LUN ID must be unique within the storage system regardless of its Storage Group or RAID Group The maximum number of LUNs supported on one host bus adapter depends on the operating system Some systems allow only eight LUNs numbers 0 through 7 For an operating system with this restriction if you want a hot spare assign the hot spare an ID above 7 for example 8 or 9 The operating system never accesses a hot spare so the ID is irrelevant to it RAID Group ID This is a hexadecimal number assigned when you create the RAID Group By default the number of the first RAID Group in a storage system is 0 the second 1 and so on up to the maximum of 1F 31 Size RAID Group size Enter the user available capacity in gigabytes Gbytes of the whole RAID Group You can determine the capacity as follows RAID 5 or RAID 3 Group disk size number of disks 1 RAID 1 0 or RAID 1 disk
11. Within one building connecting servers to storage systems adapter must support optical cable or connecting switches or hubs to storage systems 100 m 328 ft Within one complex connecting servers to storage systems adapter must support optical cable or connecting switches or hubs to storage 250 m 821 ft 15 mi systems 500 m 1642 ft 31 mi Optical cabling is 50 micron maximum length is 500 m 1 650 ft or 62 5 micron maximum length is 300 m 985 ft Both types are multimode dual SC and require a MIA on a DB 9 or hub connector The minimum length is 2 m 6 8 ft The minimum bend radius is 3 cm 1 2 in 5 22 EMC Fibre Channel Storage Systems Configuration Planning Guide Storage System Hardware Table 5 4 Cable Sizes Copper Length Typical Use 0 3 m 1 ft non equalized Connecting DPE DAE and DAE LCCs 1 0 m 3 3 ft non equalized Connecting a hub to an adjacent storage system 3 m 10 ft non equalized Connecting a hub to a storage system in the same cabinet or daisy chaining from one cabinet to an adjacent cabinet 5 m 16 5 ft non equalized Connecting a hub in one rack to a storage system in another cabinet 10 33 ft non equalized Connecting servers to hubs and or storage systems maximum length for non equalized copper cable maximum length between LCCs 30 m 98 5 ft equalized Connecting servers to hubs and or storage systems maximum length for copper cabl
12. adapter driver One or more servers can use a storage system For high availability in event of an adapter failure a server can have two adapters EMC1803 Depending on your server type you may have a choice of adapters The adapter is designed for a specific host bus for example a PCI bus or SBUS Some adapter types support copper or optical cabling some support copper cabling only Interconnect Components The interconnect components include the cables Fibre Channel switch for shared storage and Fibre Channel hub for unshared storage Depending on your needs you can choose copper or optical cables ia EMC Fibre Channel Storage System Configuration Planning About Fibre Channel Storage Systems and Networks SANs The maximum length of copper cable is 30 meters 99 feet between nodes or hubs The maximum length of optical cable between server and hub or storage system is much greater depending on the cable type For example 62 5 micron multimode cable can span up to 500 meters 1 640 feet while 9 micron single mode cable can span up to 10 kilometers 6 2 miles This ability to span great distances is a major advantage of optical cable Some nodes have connections that require a specific type of cable copper or optical Other nodes allow for the conversion from copper to optical using a conversion device called a GigaBit Interface Converter GBIC or Media Interface Adapter MIA In most cases a GB
13. host bus adapter driver package 1 4 hot spare defined 2 9 sample applications 2 20 when to use 2 18 hub description 1 8 planning system with 5 29 sample hardware worksheet 5 34 iDAE storage systems dimensions 5 16 site requirements 5 16 weight 5 16 image disk defined 2 2 individual access array see RAID 5 Group individual disk unit defined 2 9 disk space usage 2 16 performance 2 14 sample applications 2 20 when to use 2 18 installation types 1 10 tradeoffs 5 11 intelligent Disk Array Enclosure iDAE see iDAE storage systems interconnect components 5 1 cables hubs switches 1 4 interface kit see host bus adapter driver package L LCC link control card 5 8 logical volume see file system LUN logical unit configurations individual disk defined 2 9 RAID 0 defined 2 8 RAID 1 mirrored pair 2 7 RAID 1 0 Group defined 2 8 RAID 3 Group defined 2 5 RAID 5 Group defined 2 4 shared storage examples 3 3 disk mirror defined 2 2 in RAID Group 2 3 number on worksheet 3 8 3 15 4 13 4 14 paths to 3 2 4 2 planning 3 6 RAID types compared 2 12 guidelines 2 17 sample applications 2 19 SP control of 5 10 unshared storage examples 4 2 unshared examples 4 2 worksheets 3 13 4 10 4 12 M Manager utility 6 2 manual about 1 xi MIA media interface adapter about 1 5 mirrored pair see RAID 1 mirrored pair mirrored RAID 0 Group see RAID 1 0 Group mirroring defined 2 2 N Navisphere Manager utility 6 2
14. node defined 1 3 nonredundant array see also RAID 0 Group O operating system device name for disk unit 4 15 device name for LUN 3 16 software mirroring 2 2 optical cable types and sizes 5 22 organization of manual xii EMC Fibre Channel Storage Systems Configuration Planning Guide i 3 P page size cache 3 14 4 13 parallel access array see RAID 3 Group paths to LUNs 3 2 4 2 performance RAID Group 2 13 physical disk unit see LUN logical unit physical volume see LUN logical unit planning LUNs and file systems 3 6 plant requirements DAE 5 18 iDAE 5 16 plug types 5 20 power requirements DAE only storage system 5 18 DPEstorage system 5 14 iDAE storage system 5 16 power supplies PSs DPE storage system 5 8 R rackmount model DPE storage system DPE storage system rackmount model 5 3 RAID Group configurations compared 2 12 performance 2 13 planning 3 6 RAID types guidelines 2 17 sample applications 2 19 RAID 3 versus RAID 5 2 6 shared storage examples 3 3 types and tradeoffs see Chapter 2 unshared storage examples 4 2 RAID Groups and LUNs 2 3 RAID types guidelines 2 17 sample applications 2 19 RAID 0 Group defined 2 8 sample applications 2 20 when to use 2 18 RAID 1 mirrored pair defined 2 7 sample applications 2 19 when to use 2 17 RAID 1 0 Group defined 2 8 sample applications 2 20 when to use 2 17 RAID 3 Group defined 2 5 sample applications 2 19 when to use 2 17 RAID 5 Group
15. E5 Number Copper O Optical DAE to DAE only mor ft Please specify all storage system components you need even though you will not need to order them separately since most or all components will be included with the model of each system you order What Next This chapter explained hardware components of shared and unshared storage systems If you have completed the worksheets to your satisfaction you are ready to consider ordering some of this equipment Or you may want to read about storage management in the next chapter Hardware Planning Worksheets 5 35 Storage System Hardware Ea EMC Fibre Channel Storage Systems Configuration Planning Guide 6 Storage System Management This chapter explains the management applications you can use to manage storage systems from servers Topics are e Using Navisphere Manager Software 6 3 e Storage Management Worksheets 6 5 Storage System Management 6 1 Storage System Management Navisphere software lets you bind and unbind disks manipulate caches examine storage system status and logged events transfer control from one SP to another and examine events recorded in storage system event logs Navisphere products have two parts a graphical user interface GUI and an Agent application The GUIs run on a management station accessible from a common framework a
16. Hardware for Unshared Storage 5 6 e Planning Your Hardware Components 5 11 e Hardware Data SheetSs 5 14 e Cabinets for Rackmount Enclosures 5 20 e Cable and Configuration Guidelines n 5 21 e Hardware Planning Worksheets ii 5 24 Storage System Hardware 51 Storage System Hardware The storage systems attach to the server and the interconnect components described in Chapter 1 Unshared Direct Shared or Clustered Direct Shared Switched one server two servers multiple servers Server Server Server Server Server Server rver gt gt gt gt sS a a a SS a a SS SE olal ale S 2 2j B g glS o e es e e g lt g 8 Interconnect component Switch fabric eee S Cen ANA i V ee See Storage FC loop 1 Disk array storage systems FC loop 2 Figure 5 1 Shared and Unshared Storage 5 2 EMC Fibre Channel Storage Systems Configuration Planning Guide Hardware for Shared Storage The primary hardware component for shared storage is a ten slot Disk array Processor Enclosure DPE with two storage processors SP The DPE can support up to nine separate 10 slot enclosures called Disk Array Enclosures DAEs for a total of 100 disks S
17. RAID 3 If you want to use the SP memory for RAID 3 check the box RAID Group LUN Entries Complete a RAID Group LUN entry for each LUN and hot spare EMC Fibre Channel Storage System Configuration Planning Planning File Systems and LUNs with Shared Switched Storage LUN ID The LUN ID is a hexadecimal number assigned when you bind the disks into a LUN By default the ID of the first LUN bound is 0 the second 1 and so on Each LUN ID must be unique within the storage system regardless of its Storage Group or RAID Group The maximum number of LUNs supported on one host bus adapter depends on the operating system RAID Group ID This ID is a hexadecimal number assigned when you create the RAID Group By default the number of the first RAID Group in a storage system is 0 the second 1 and so on up to the maximum of 1F 31 Size RAID Group size Enter the user available capacity in gigabytes Gbytes of the whole RAID Group You can determine the capacity as follows RAID5 or RAID 3 Group disk size number of disks 1 RAID 1 0 or RAID 1 Group disk size number of disks 2 RAID 0 Group disk size number of disks Individual unit disk size For example e A five disk RAID 5 or RAID 3 Group of 36 Gbyte disks holds 144 Gbytes e An eight disk RAID 1 0 Group of 36 Gbyte disks also holds 144 Gbytes e A RAID 1 mirrored pair of 36 Gbyte disks holds 36 Gbytes and e An individual disk of an 36 Gbyte disk a
18. SP that will own the LUN SP A or SP B You can let the management program automatically select the SP to balance the workload between SPs to do so leave this entry blank RAID type Copy the RAID type from the previous worksheet For example RAID 5 or hot spare For a hot spare not strictly speaking a LUN at all skip the rest of this LUN entry and continue to the next LUN entry if any If this is a RAID 3 Group specify the amount of SP memory for that group To work efficiently each RAID 3 Group needs at least 6 Mbytes of memory Caching If you want to use caching entry on page 4 12 you can specify whether you want caching read and write read or write for this LUN Generally write caching improves performance far more than read caching The ability to specify caching on a LUN basis provides additional flexibility since you can use caching for only the 4 14 EMC Fibre Channel Storage Systems Configuration Planning Guide Table 4 1 units that will benefit from it Read and write caching recommendations follow Cache Recommendations for Different RAID Types Planning LUNs and File Systems with Unshared Direct Storage RAID 5 RAID 3 RAID 1 RAID 1 0 RAID 0 Individual Unit Highly Recommended Not allowed Recommended Recommended Recommended Recommended What Next Servers that can access this LUN Enter the name of each server that will be able to use the LUN Normally
19. Storage system complete this section once for each storage system Storage system number or name __1 Storage system installation type Xi Unshared Direct O Shared or Clustered Direct M Shared Switched SP FC AL address ID unshared only SP A SP B SP memory Mbytes SPA _128__ SP B _128__ LyUse for caching Read cache size _40_ MB Write cache size _80_ MBCache page size _2__KB Use for RAID 3 LUN ID __0_ RAID Group ID 0__Size GB _144 LUN size GB _144 Disk IDs9_9 0_1 0 2 0_3 0_4 SP YA OB RAID type XIRAID 5 ORAID 3 Memory MB RAID 1 mirrored pair ORAID 0 RAID 1 0 Individual disk Hot spare Caching XiRead and write OWrite NRead ONone Servers that can access this LUN _ Server1 Operating system information Device name File system partition or drive T LUN ID __1 RAID Group ID _1 Size GB _144_ LUN size GB _144_Disk IDs 0_5 0_6 0_7 0_8 0_9SP DA XB RAID type RAID 5 ORAID 3 Memory MB RAID 1 mirrored pair RAID 0 RAID 1 0 Individual disk Hot spare Caching Read and write OWrite DRead None Servers that can access this LUN Server1 Operating system information Device name File system partition or drive U__ LUN ID __2__ RAID Group ID _2_Size GB 7 _ LUN size GB _36 D
20. The stripe size is the stripe element size multiplied by the number of disks in a group For example assume a stripe element size of 128 sectors the default and a five disk group The group has five disks so you would multiply five by the stripe element size of 128 to yield a stripe size of 640 sectors The storage system uses disk striping with most RAID types Mirroring maintains a second and optionally through software a third copy of a logical disk image that provides continuous access if the original image becomes inaccessible The system and user applications continue running on the good image without interruption There are two kinds of mirroring hardware mirroring in which the SP synchronizes the disk images and software mirroring in which the operating system synchronizes the images Software mirroring consumes server resources since the operating system must mirror the images and has no offsetting advantages we mention it here only for historical completeness With a storage system you can create a hardware mirror by binding disks as a RAID 1 mirrored pair or a RAID 1 0 Group a mirrored RAID 0 Group the hardware will then mirror the disks automatically 22 EMC Fibre Channel Storage System Configuration Planning RAID Types and Tradeoffs RAID Groups and Some RAID types let you create multiple LUNs on one RAID Group LUNs You can then allot each LUN to a different user server or application For exampl
21. a RAID 1 0 Group mirrored nonredundant array for applications where e Data availability is critically important e Overall performance is very important Guidelines for RAID Types 2 17 RAID Types and Tradeoffs Use a RAID 0 Group nonredundant individual access array for applications where e High availability is not important e Overall performance is very important Use an individual unit for applications where e High availability is not important e Speed of write access is somewhat important Use a hot spare where e Inany RAID 5 RAID 3 RAID 1 0 or RAID 1 Group high availability is so important that you want to regain data redundancy quickly without human intervention if any disk in the Group fails e Minimizing the degraded performance caused by disk failure in a RAID 5 or RAID 3 Group is important EMC Fibre Channel Storage System Configuration Planning RAID Types and Tradeoffs Sample Applications for RAID Types This section describes some types of applications in which you would want to use a RAID 5 Group RAID 3 Group RAID 1 mirrored pair RAID 0 Group nonredundant array RAID 1 0 Group or individual unit RAID 5 Group individual access array Useful as a database repository or a database server that uses a normal or low percentage of write operations writes are 33 percent or less of all I O operations Use a RAID 5 Group where multitask applications perform I O transfers of different s
22. and storage system RAID 5 with individual access provides high read throughput for small requests blocks of 2 to 8 Kbytes by allowing simultaneous reads from each disk in the group RAID 5 write throughput is limited by the need to perform four I Os per request I Os to read and write data and parity information However write caching improves RAID 5 write performance RAID 3 with parallel access provides high throughput for sequential large block size requests blocks of more than 64 Kbytes With RAID 3 the system accesses all five disks in each request but need not read data and parity before writing advantageous for large requests but not for small ones RAID 3 employs SP memory without caching which means you do not need the second SP and BBU that caching requires Generally the performance of a RAID 3 Group increases as the size of the I O request increases Read performance increases rapidly with read requests up to 1Mbyte Write performance increases greatly for sequential write requests that are greater than 256 Kbytes For applications issuing very large I O requests a RAID 3 LUN provides significantly better write performance than a RAID 5 LUN RAID Benefits and Tradeoffs RAID Types and Tradeoffs Storage Flexibility We do not recommend using RAID 3 in the same storage system chassis with RAID 5 or RAID 1 0 A RAID 1 mirrored pair has its disks locked in synchronization but the SP
23. defined 2 4 sample applications 2 19 when to use 2 17 redundant array of independent disks RAID see RAID Group S server cabling guidelines 5 21 component 5 1 connection to storage system see cabling planning worksheet unshared storage 5 30 unshared storage example 4 2 service clearance DPE storage system 5 15 iDAEstorage system 5 17 shared storage components 5 3 disk structure example 3 3 hardware 1 15 switched defined 1 10 shared storage systems cabinets 5 20 hardware planning worksheets 5 24 shared or clustered direct installation defined 1 10 disk structure example 4 2 4 3 site requirements DAE 5 18 DAE only storage systems 5 18 DPE storage systems 5 14 iDAE storage systems 5 16 size cache 3 14 4 13 software mirroring defined 2 2 EMC Fibre Channel Storage Systems Configuration Planning Guide SP storage processor description 5 5 5 9 FC AL address ID 3 14 4 12 SPS standby power supply DPE storage system 5 8 storage components shared storage 5 3 storage managment worksheets 6 5 storage system caching onworksheet 4 14 storage system caching as feature 5 11 stripe with RAID 1 0 RAID 0 2 8 with RAID 5 RAID 3 2 4 stripe defined 2 2 switch description 1 5 in sample shared storage configuration 3 3 introduced 1 3 switch fabric introduced 1 3 T temperature requirements DAE only storage system 5 18 DPE storage system 5 14 iDAE storage system 5 16 terms RAID 2 2 tradeoffs installation t
24. many shared storage system features for example you can use multiple unshared storage systems with multiple servers However with multiple servers unshared storage offers less flexibility and security than shared storage since any user with write access to privileged server files can enable access to any storage system Types of Storage System for Unshared Storage For unshared storage there are four types of storage system each using the FC AL protocol Each type is available in a rackmount or deskside office version Disk array Processor Enclosure DPE storage systems A DPE is a 10 slot enclosure with hardware RAID features provided by one or two storage processors SPs In addition to its own disks a DPE can support up to 110 additional disks in 10 slot Disk Array Enclosures DAEs for a total of 120 disks This is the same kind of storage system used for shared storage but it uses a different storage processor SP Intelligent Disk Array Enclosure iDAE An iDAE like a DPE has SPs and thus all the features of a DPE but is thinner and has a limit of 30 disks Disk Array Enclosure DAE A DAE does not have SPs A DAE can connect to a DPE or an iDAE or you can use it without SPs A DAE used without an SP does not inherently include RAID but can operate as a RAID device using software running on the server system Such a DAE is also known as Just a Box of Disks or JBOD EMC Fibre Channel Storage Systems Configura
25. ne SP BE Storage systems Figure 1 3 To illustrate the comparison this figure shows just one adapter per server and one switch or hub Normally such installations include two adapters per server and two switches or hubs Switch and Hub Topologies Compared Switch Zoning Switch zoning defines paths between connected nodes Each zone encloses one or more adapters and one or more SPs A switch can have as many zones as it has ports The current connection limits are four SP ports to one adapter port the SPs fan in to the adapter and 15 adapters to one SP the SPs fan out to the adapters There are several zone types including the single initiator type which is the recommended type In the following figure Server 1 has access to one SP SP A in storage systems 1 and 2 it has no access to any other SP 1 6 EMC Fibre Channel Storage System Configuration Planning About Fibre Channel Storage Systems and Networks SANs i L u iz a z On D D 2 BS Dl 2 T SE Li 9 s P se Switch s fabric Wale Ta Zone ae ANN s Sy r 1 SP ISP _ f SP SP SP SP se Storage system 1 Storage system 2 Storage system 3 To illustrate switch zoning this figure shows just one HBA per server and one switch or hub Normally such installations will include two HBAs per server and two switches or hubs Figure 1 4 A S
26. on both loops SP memory Enter the amount of memory each SP has If a storage system has two SPs they will generally have the same amount of memory You can allocate this memory to storage system caching or RAID 3 use Use memory for caching You can use SP memory for read write caching or RAID 3 Using both caching and RAID 3 in the same storage system not recommended You can use different cache settings for different times of day for example for user I O during the day use more write cache for sequential batch jobs at night use more read cache You enable caching for specific LUNs allowing you to tailor your cache resources according to priority If you choose caching check the box and continue to the next step for RAID 3 skip to the RAID Group ID entry Read cache size If you want a read cache it should generally be about one third of the total available cache memory Write cache size The write cache should be two thirds of the total available Some memory is required for system overhead so you cannot determine a precise figure at this time For example for 256 Mbytes of total memory you might have 240 Mbytes available and ga EMC Fibre Channel Storage Systems Configuration Planning Guide Planning LUNs and File Systems with Unshared Direct Storage you would specify 80 Mbytes for the read cache and 160 Mbytes for the write cache Cache page size This applies to both read and write caches It can be 2 4
27. pair is useful for logging or record keeping applications because it requires fewer disks than a RAID 0 Group nonredundant array and provides high availability and fast write access Or you could use it to store daily updates to a database that resides on a RAID 5 Group and then during off peak hours copy the updates to the database on the RAID 5 Group Sample Applications for RAID Types 219 RAID Types and Tradeoffs What Next RAID 0 Group nonredundant individual access array Use a RAID 0 Group where the best overall performance is important In terms of high availability a RAID 0 Group is less available than an individual unit A RAID 0 Group like a RAID 5 Group requires a minimum of three disks A RAID 0 Group serves well for an application that uses short term data to which users need quick access RAID 1 0 Group mirrored RAID 0 Group A RAID 1 0 Group provides the best balance of performance and availability You can use it very effectively for any of the RAID 5 applications A RAID 1 0 Group requires a minimum of four disks Individual unit An individual unit is useful for print spooling user file exchange areas or other such applications where high availability is not important or where the information stored is easily restorable from backup The performance of an individual unit is slightly less than a standard disk not in an storage system The slight degradation results from SP overhead
28. system information Device name File system partition or drive LUN ID RAID Group ID __Size GB __ LUN size GB __Disk IDs SP AA OB RAID type A RAID 5 A RAID 3 Memory MB __ A RAID 1 mirrored pair ARAIDO A RAID 1 0 Q Individual disk A Hot spare Caching Read and write Write Read None Servers that can access this LUN Operating system information Device name File system partition or drive LUN ID RAID Group ID ___Size GB ___ LUN size GB ___Disk IDs SP AA OB RAID type ORAID5 A RAID 3 Memory MB A RAID 1 mirrored pair RAID O A RAID 1 0 Q Individual disk A Hot spare Caching QRead and write OWrite Read None Servers that can access this LUN Operating system information Device name File system partition or drive EMC Fibre Channel Storage System Configuration Planning Planning File Systems and LUNs with Shared Switched Storage LUN Details Worksheet Storage system complete this section once for each storage system Storage system number or name __ss1 Storage system installation type A Unshared Direct I Shared or Clustered Direct XI Shared Switched SP FC AL address ID unshared only SP A SP B SP memory Mbytes SP A _256__ SP B _256__ AUse for caching Read cache size _80_ MB Write cache size _160_ MB Cache page size _2__KB Use for RAID 3 LUN ID __o_ RAID Group ID _0__Size GB _72_ LUN size GB __72_ Disk IDs _0_0 0_1 0_2 0_3 0_4SP XAUB RAID type R
29. to a DPE it can include up to 11 DAE enclosures for a total of 120 disks If a EMC Fibre Channel Storage System Configuration Planning LUN Details Worksheet Storage Group will be dedicated not accessible by another system in a cluster mark the Dedicated box at the end of its line if the Storage Group will be accessible to one or more other servers in a cluster write the hostnames of all servers and mark the Shared box Use the following LUN details worksheet to plan the individual LUNs Complete as many of these as needed for all LUNs in your SAN Planning Applications LUNs and Storage Groups Planning File Systems and LUNs with Shared Switched Storage Planning File Systems and LUNs with Shared Switched Storage LUN Details Worksheet Storage system complete this section once for each storage system Storage system number or name Storage system installation type A Unshared Direct O Shared or Clustered Direct Shared Switched SP FC AL address ID unshared only SP A SP B SP memory Mbytes SPA SPB Use for caching Read cache size __ MB Write cache size __ MB Cache page size ___ KB Use for RAID 3 LUN ID RAID Group ID ___ Size GB ___ LUN size GB __Disk IDs SP JA IB RAID type ARAID 5 A RAID 3 Memory MB ___ A RAID 1 mirrored pair ARAIDO A RAID 1 0 Q Individual disk A Hot spare Caching Read and write Write Read None Servers that can access this LUN Operating
30. you want to run and the LUNs that will hold them The worksheets to help you do this include e Application and file system planning worksheet lets you outline your storage needs e LUN planning worksheet lets you decide on the disks that will compose the LUNs e LUN details worksheet lets you plan each LUN in detail Make as many copies of each blank worksheet as you need You will need this information later when you configure the shared storage system Sample file system Storage Group and LUN worksheets appear later in this chapter Application and LUN Planning Use the following worksheet to plan your file systems and RAID types For each application write the application name file system if any RAID type LUN ID ascending integers starting with 0 disk space required and finally the name of the servers and operating systems that will use the LUN RES EMC Fibre Channel Storage Systems Configuration Planning Guide Planning LUNs and File Systems with Unshared Direct Storage Application and LUN Planning Worksheet Disk space RAIDtypeof LUN required Server name and Application File system if any LUN ID hex Gbytes operating system A sample worksheet begins as follows Disk space RAIDtypeof LUN required Server name and Application File system if any LUN ID hex Gbytes operating system Mail 1
31. 2 SPB SPA Storage system Figure 5 13 Cable Identifier Unshared System without Hubs Ea EMC Fibre Channel Storage Systems Configuration Planning Guide Joidepy Storage System Hardware Server 1 Server n Al Jojdepy Jajdepy Jadepy Je depy Hub 1 a iDAE DPE SPB SPA Storage system 1 l 31 DAE N DAE 21 991 9 3971091 A 301 m 001 i E ol DAE lo O O ED FC Loop 1 Q IDAE DPE Q SPB SPA FC Loop 2 Storage system m Figure 5 14 Cable Identifier Unshared Full Fibre System with Hubs Hardware Planning Worksheets 5 29 Storage System Hardware Hardware Component Worksheet for Unshared Storage Number of servers Adapters in servers Hubs copper MIAs copper to optical DPE based and DAE only storage systems Rackmount DPEs SP LCC pairs PSs SPSs Rackmount cabinets Rackmount iDAEs SPs PSs SPSs Rackmount cabinets Rackmount DAEs LCCs PSs Deskside DPEs SP LCC pairs DAE LCCs DPE PSs DAE PSs SPSs __ Deskside iDAEs SPs DAE LCCs PSs SPSs Deskside DAEs 30 slot 10 slot LCCs PSs Cables between server and storage system or between server and hub Cable A copper or optical Cable A Number ____ OCopper Optical m or ft Cable Aj Numbe
32. 5 20 cabling guidelines 5 21 introduced 1 4 types and sizes 5 22 cache about 5 11 page size 4 13 cascading switches 1 6 CDE driver extensions software 6 2 CLI Command Line Interface 6 2 clustered installation disk structure example 4 3 communication with storage system see Chapter 6 configurations RAID compared 2 12 examples 4 2 planning 3 6 RAID types guidelines 2 17 shared storage examples 3 3 tradeoffs 5 12 unshared storage examples 4 2 installation 4 2 cooling requirements cabinet 5 20 DAE 5 19 DPE 5 15 iDAE 5 17 copper cable types and sizes 5 23 CRUs customer replaceable units DPE storage system 5 5 locating 5 8 SP 5 5 5 9 D DAE see also Disk Array Enclosure DAE DAE only storage systems dimensions 5 18 introduced 1 16 5 6 EMC Fibre Channel Storage Systems Configuration Planning Guide site requirements 5 18 weight 5 18 data sheets hardware 5 14 device name operating system 3 16 4 15 disk capacity defined 4 14 capacity defined 4 13 configuration types compared 2 12 configuration see also RAID Group IDs 3 4 4 2 LUN types planning 3 6 mirror defined 2 2 number on worksheet 4 14 RAID types guidelines 2 17 sample applications 2 19 shared storage examples 3 3 striping defined 2 2 unit number on worksheet 3 8 4 13 unshared storage example 4 2 examples 4 2 Disk Array Enclosure DAE introduced 5 6 site requirements 5 18 Disk Array Processor Enclosure DPE i
33. 9 1 10 1 11 1 12 1 13 2 2 2 3 2 5 2 6 3 1 4 1 4 2 5 1 5 3 5 4 5 6 5 7 Storage System Models iii 1 2 Nodes Initiator and Target iii 13 Switch and Hub Topologies Compared ui 1 6 A OWCA ZONE ri erp E aa 1 7 16 Port Switch Back View ii 1 7 Nine Port Hub irreali 1 8 Disk Array Processor Enclosure DPE ii 1 9 Types of Storage System Installation iii 1 10 Components of a SAN iii 1 11 Sample SAN Configuration iiii 1 13 Data and Configuration Access Control with Shared Storage 1 14 Storage System with a DPE and Three DAES in 1 15 Storage System Hardware for Unshared Storage 1 17 Multiple LUNs in a RAID Group 2 3 RAIDS GOUD siii aria 2 5 RAID 3 GrOUprcsrsiari liana 2 6 RAID 1 Mirrored Pair iii 2 7 RAID 1 0 Group Mirrored RAID 0 Group i 2 9 Howa Hot Spare Works ei 2 11 Disk Space Usage in the RAID Configurations uin 2 16 Sample Shared Switched High Availability installation 3 3 Unshared Direct Installation i 4 2 Sample Clustered Installation ui 4 3 Shared and Unshared Storage i 5 2 DPE Storage System Components Rackmount Model
34. AID 5 LY RAID 3 Memory MB O RAID 1 mirrored pair RAID O A RAID 1 0 Q Individual disk 1 Hot spare Caching YA Read and write AWrite ARead None Servers that can access this LUN __ Server1 Operating system information Device name File system partition or drive T LUN ID __1__ RAID Group ID 1 Size GB _72_ LUN size GB _72_ Disk IDg 9 9 6 0 7 0 8 0 vane RAID type MRAID5 A RAID 3 Memory MB O RAID 1 mirrored pair RAID O A RAID 1 0 Q Individual disk 1 Hot spare Caching X Read and write Write GRead None Servers that can access this LUN Server1 Operating system information Device name File system partition or drive U LUN ID __2__ RAID Group ID _2_ Size GB18 _ LUN size GB _18 Disk IDs 10 1_1 SP DA KiB RAID type X RAID 5 LY RAID 3 Memory MB ___ M RAID 1 mirrored pair RAID 0 A RAID 1 0 Q Individual disk A Hot spare Caching Read and write OWrite ARead None Servers that can access this LUN _ Server1 Operating system information Device name File system partition or drive vV Planning Applications LUNs and Storage Groups 3 13 Planning File Systems and LUNs with Shared Switched Storage Completing the LUN Details Worksheet Complete the header portion of the worksheet for each storage system as described below Copy the blank worksheet as needed Storage system entries Storage system installation type specify Shared Switched storage SP
35. EMC Enterprise Storage EMC Fibre Channel Storage Systems Models FC4500 FC5300 and FC5700 CONFIGURATION PLANNING GUIDE P N 014003039 02 EMC Corporation 171 South Street Hopkinton MA 01748 9103 Corporate Headquarters 508 435 1000 800 424 EMC2 Fax 508 435 5374 Service 800 SVC 4EMC Copyright EMC Corporation 2000 2001 All rights reserved Printed May 2001 No part of this publication may be reproduced or distributed in form or by any means or stored in a database or retrieval system without the prior written consent of EMC Corporation The information contained in this document is subject to change without notice EMC Corporation assumes no responsibility for any errors that may appear All computer software programs udine but not limited to microcode described in this document are furnished under a license and may be used or copied only in accordance with the terms of such license EMC either owns or has the right to license the computer software programs described in this document EMC Corporation retains all rights title and interest in the computer software programs EMC Corporation makes no warranties expressed or implied by operation of law or otherwise relating to this document the products or the computer software programs described herein EMC CORPORATION DISCLAIMS ALL IMPLIED WARRANTIES OF MERCHANTIBILITY AND FITNESS FOR A PARTICULAR PURPOSE In no event shall EMC Corporation be li
36. FC AL address ID This does not apply to shared storage in which the switch determines the address of each device Use memory for caching You can use SP memory for read write caching or RAID 3 Using both caching and RAID 3 in the same storage system is not recommended You can use different cache settings for different times of day for example for user I O during the day use more write cache for sequential batch jobs at night use more read cache You enable caching for specific LUNs allowing you to tailor your cache resources according to priority If you choose caching check the box and continue to the next step for RAID 3 skip to the RAID Group ID entry Read cache size If you want a read cache it should generally be about one third of the total available cache memory Write cache size The write cache should be two thirds of the total available Some memory is required for system overhead so you cannot determine a precise figure at this time For example for 256 Mbytes of total memory you might have 240 Mbytes available and you would specify 80 Mbytes for the read cache and 160 Mbytes for the write cache Cache page size This applies to both read and write caches It can be 2 4 8 or 16 Kbytes As a general guideline we suggest e Fora general purpose file server 8 Kbytes e Fora database application 2 or 4 Kbytes The ideal cache page size depends on the operating system and application Use memory for
37. Gbytes on four LUNs MS R5 ISP mail Planning File Systems and LUNs with Shared Switched Storage Unit O on five disks bound as a RAID 5 Group for 144 Gbytes of storage for the mail delivered via ISP A MS R5 ISP mail Unit P on five disks bound as a RAID 5 Group for MSR5 Users MS R5 Specs Database Server 416 Gbytes on four LUNs DS R5 Users DS R5 Dbase2 DS RI Logs DS R5 Dbase1 144 Gbytes of storage for the mail delivered via ISP B Unit Q on five disks bound as a RAID 5 Group for 144 Gbytes of storage for user directories and files Unit R on five disks bound as a RAID 5 Group for 144 Gbytes of storage for specifications Unit users on five disks bound as a RAID 5 Group for 144 Gbytes of storage for user directories Unit dbase2 on five disks bound as a RAID 5 Group for 144 Gbytes of storage for the second database system Unit logfiles on two disks bound as a RAID 1 mirrored pair for 36 Gbytes of storage for the database log files Unit dbase on six disks bound as a RAID 5 Group for 180 Gbytes of storage for the primary database system Sample Shared Switched Installation 35 Planning File Systems and LUNs with Shared Switched Storage 3 6 Planning Applications LUNs and Storage Groups This section helps you plan your shared storage use the applications to run the LUNs that will hold t
38. IC or MIA lets you substitute long distance optical connections for shorter copper connections With extenders optical cable can span up to 40 km 25 miles This ability to span great distances is a major advantage of optical cable Details on cable lengths and rules appear later in this manual Fibre Channel Switches A Fibre Channel switch which is a requirement for shared storage a Storage Area Network SAN connects all the nodes cabled to it using a fabric topology A switch adds serviceability and scalability to any installation it allows on line insertion and removal of any device on the fabric and maintains integrity if any connected device stops participating A switch also provides host to storage system access control in a multiple host shared storage environment A switch has several advantages over a hub it provides point to point connections as opposed to a hub s loop that includes all nodes and it offers zoning to specify paths between nodes in the switch itself Fibre Channel Storage Components 18 About Fibre Channel Storage Systems and Networks SANs You can cascade switches connect one switch port to another switch for additional port connections Switch topology point to point Hub topology loop Server Server Server gt a a 2 D 3 D kel 2 D D 2 Switch uses discrete gt gt ee 7 Hub uses connections between 47 loop between ports ports
39. Planning Guide Power cables single or dual ac inlet connector Deskside power cord Operating environment Temperature Relative humidity Altitude Heat dissipation max Air flow Service clearances Front Back Storage System Hardware TEC 320 C14 power inlet USA 1 8 m 6 0 ft NEMA 6 15P plug Outside USA Specific to country 10 C to 40 C 50 F to 104 F Noncondensing 20 to 80 40 C to 2 438 m 8 000 ft 37 C to 3 050 m 10 000 ft 30 slot 4 233 KJ hr 4 020 BTU hr 10 slot 1 411 KJ hr 1 340 BTU hr Front to back 30 3 cm 1 ft 60 6 cm 2 ft Hardware Data Sheets 5 19 Storage System Hardware Cabinets for Rackmount Enclosures Prewired 19 inch wide cabinets ready for installation are available in the following dimensions to accept rackmount storage systems Vertical Space Exterior Dimensions Comments 173 cm or 68 25 in Height 192 cm 75 3 in Accepts combinations of 39 NEMA units or Width 65 cm 25 5 in DPEs at 6 5 U U one Uis 1 75 in Depth 87 cm 34 25 in plus service IDAEs at 3 5 U clearances which are 90 cm 3 ft SPS units at 1 U 30 cm front and 60 cm back DAEs at 3 5 U each Switches or hubs at 1 U Requires 200 240 volts ac Plug options include L6 30 or L7 30 domestic and IEC 309 30 A international Each power strip has 12 IEC 320 CIS outlets Filler panels of various sizes are available W
40. RAI D5 0 72 Gb Serverl NT Mail 2 RAI D 5 1 72 Gb Serverl NT Database index RAI D 1 2 18 Gb Server2 NT Completing the Application and LUN Planning Worksheet Application Enter the application name or type File system partition or drive Write the drive letter for Windows only and the partition file system logical volume or drive letter Windows only name With a system such as Windows NT the LUNs are identified by drive letter only The letter does not help you identify the disk configuration such as RAID 5 We suggest that later when you use the operating system to create a partition on the unit you use the disk administrator software to assign a volume label that describes the Planning Applications and LUNs Planning LUNs and File Systems with Unshared Direct Storage RAID configuration For example for drive T assign the volume ID RAID5_T The volume label will then identify the drive letter RAID type of LUN is the RAID Group type you want for this partition file system or logical volume The features of RAID types are explained in Chapter 2 For a RAID 5 RAID 1 RAID 1 0 and RAID 0 Group you can create one or more LUNs on the RAID Group For other RAID types you can create only one LUN per RAID Group LUN ID is a hexadecimal number assigned when you bind the disks into a LUN By default the ID of the first LUN bound is 0 the second 1 and so on Each LUN ID must be unique within the storage syst
41. a central location for disk storage Centralizing disk storage among multiple servers has many advantages including e highly available data e flexible association between servers and storage capacity e centralized management for fast effective response to users data storage needs e easier file backup and recovery An EMC SAN is based on shared storage that is the SAN requires the Access Logix option to provides flexible access control to storage system LUNs Server Server Server Path 1 Path 2 Storage systems Components of a SAN Fibre Channel switches can control data access to storage systems through the use of switch zoning With zoning an administrator can specify groups called zones of Fibre Channel devices such as host bus adapters specified by worldwide name and SPs between which the switch will allow communication About Switched Shared Storage and SANs Storage Area Networks About Fibre Channel Storage Systems and Networks SANs About Fibre Channel Storage Systems and Networks SANs Storage Groups However switch zoning cannot selectively control data access to LUNs in a storage system because each SP appears as a single Fibre Channel device to the switch So switch zoning can prevent or allow communication with an SP but not with specific disks or LUNs attached to an SP For access control with LUNs a different solution is required Sto
42. able for a incidental indirect special or consequential damages or b any damages whatsoever resulting from the loss of use data or profits arising out of this document even if advised of the possibility of such damages Trademark Information EMC EMC MOSAIC 2000 Symmetrix CLARiiON and Navisphere are registered trademarks and EMC Enterprise Storage The Enterprise Storage Company The EMC Effect Connectrix EDM SDMS SRDF Timefinder PowerPath InfoMover FarPoint EMC Enterprise Storage Network EMC Enterprise Storage Specialist EMC Storage Logix Universal Data Tone E Infostructure Celerra Access Logix MirrorView and SnapView are trademarks of EMC Corporation All other trademarks mentioned herein are the property of their respective owners sa EMC Fibre Channel Storage Systems Configuration Planning Guide Preface Chapter 1 Chapter 2 Contents salda ieri Lia lia ia ia ei xi About Fibre Channel Storage Systems and Networks SANS Introducing EMC Fibre Channel Storage Systems 1 2 Fibre Channel Background ii 1 3 Fibre Channel Storage Components 1 4 Server Component Host Bus Adapter Driver Package with SONONE e EEEE 1 4 Interconnect Components iii 1 4 Storage Component Storage Systems Storage Processors SPs and Other HardWare i 1 9 Types of Storage System InstallationSs
43. ail 216 Gbytes Disk Temporary storage 36 Gbytes Sample Shared or Clustered Direct Installation Figure 4 2 Server 1 S1 a o o SPA SPB cS S2 Customers 2 RAID 5 5 a Storage system DO y ae I S1Dbase gt N oe SRAID5 2E Sample Clustered Installation Server 2 S2 Path 1 Path 2 If each disk holds 36 Gbytes then the storage system chassis provides Server 1 with 256 Gbytes of disk storage 220 Gbytes highly available it provides Server 2 with 216 Gbytes of storage all highly available Each server has its own SP which controls that server s LUNs those LUNs remain primary to that server The LUNs are as follows Planning LUNs and File Systems with Unshared Direct Storage Server1 LUNs S1 SP A 256 Gbytes Server2 LUNs S2 SP B 216 Gbytes Disk IDs RAID type storage type capacity Disk IDs RAID type storage type capacity 0_0 0_1 RAID 1 System disk 36 Gbytes 0 2 Disk Temporary storage 36 Gbytes 0_3 0_7 RAID 5 Database 144 Gbytes 0_8 0_9 RAID 1 Users 36 Gbytes 1_0 1_7 RAID 5 8 disks Cust Accounts 216 Gbytes Unshared Direct and Shared or Clustered Direct Storage Planning LUNs and File Systems with Unshared Direct Storage Planning Applications and LUNs This section helps you plan your unshared direct storage use applications
44. and one or more storage systems each with two SPs and Access Logix software With shared storage there are two paths to each LUN in the storage system The storage system software using optional software called Application Transparent Failover ATF can automatically switch to the other path if a device such as a host bus adapter or cable fails With unshared storage if the server has two adapters and the storage system has two SPs ATF software is available as an option With two adapters and two SPs ATF can perform the same function as with shared systems automatically switch to the other path if a device such as host bus adapter or cable fails EMC Fibre Channel Storage System Configuration Planning Planning File Systems and LUNs with Shared Switched Storage Sample Shared Switched Installation The following figure shows a sample shared switched high availability storage system connected to three servers two servers in a cluster and one server running a database management program Highly available cluster ee File Server FS Mail Server MS Database Server DS Operating Operating Operating system A system A system B SPA SPB Disk IDs i FS R5 FS R5 a Private storage i Files A Files B 4_0 4_9 MS R5 MS R5 ISP A mail ISP B mail 3 0 3 9 Cluster Sipra Graup MSR5 MSR5 2 0 2 9 Users Sp
45. can read data from the disk whose read write heads are closer to it Therefore RAID 1 read performance can be twice that of an individual disk while write performance remains the same as that of an individual disk A RAID 0 Group nonredundant individual access array or RAID 1 0 Group mirrored RAID 0 Group can have as many I O operations occurring simultaneously as there are disks in the group Since RAID 1 0 locks pairs of RAID 0 disks the same way as RAID 1 does the performance of RAID 1 0 equals the number of disk pairs times the RAID 1 performance number If you want high throughput for a specific LUN use a RAID 1 0 or RAID 0 Group A RAID 1 0 Group requires at least six disks a RAID 0 Group at least three disks An individual unit needs only one I O operation per read or write operation RAID types 5 1 1 0 and 0 allow multiple LUNs per RAID Group If you create multiple LUNs on a RAID Group the LUNs share the RAID Group disks and the I O demands of each LUN affect the I O service time to the other LUNs For best performance you may want to use one LUN per RAID Group Certain RAID Group types RAID 5 RAID 1 RAID 1 0 and RAID 0 let you create up to 32 LUNs in each group This adds flexibility particularly with large disks since it lets you apportion LUNs of various sizes to different servers applications and users Conversely with RAID 3 there can be only one LUN per RAID Group and the group must include five o
46. deskside system is a second power distribution unit PDU which lets you route ac power from an independent source Used this way the second PDU protects against failure in one of the two ac power sources With a rackmount system you can acquire a cabinet with one or two ac inlet cords The second inlet cord connected to a second ac power source provides the same advantage for all storage systems in the cabinet as the second PDU in the deskside storage system For deskside systems the optional high availability hardware fits into the deskside cabinet Deskside high availability options are as follows EMC Fibre Channel Storage Systems Configuration Planning Guide Storage System Hardware Table 5 1 High Availability Options Deskside Unshared Storage Deskside Power System Type HA Level PDUs SPs LCCs Supplies Disks SPS Units DPE Minimum 1 1 1 DPE 1 DPE 5 without write 0 without write 1 DAE 1 DAE cache cache 1 write cache Maximum 2 2 4 2 DPE 4 10 write cache 2 2 DAE 2 DPE or RAID 3 2 DAE iDAE Minimum 1 1 n a 10 slot 1 3 without write 0 without write 2 30 slot cache cache 5 write cache 1 write cache or RAID 3 Maximum 2 2 n a 10 slot 2 10 slot 5 write cache 2 4 30 slot 6 30 slot or RAID 3 DAE only Minimum 1 n a 1 1 No minimum n a Maximum 2 n a 2 2 No minimum n a For rackmount systems the standby power supp
47. disk on which users cannot store information A hot spare is global if any disk in a RAID 5 Group RAID 3 Group RAID 1 mirrored pair or RAID 1 0 Group fails the SP automatically rebuilds the failed disk s structure on the hot spare When the SP finishes rebuilding the disk group functions as usual using the hot spare instead of the failed disk When you RAID Types RAID Types and Tradeoffs RAID Types and Tradeoffs replace the failed disk the SP copies the data from the former hot spare onto the replacement disk When the copy is done the disk group consists of disks in the original slots and the SP automatically frees the hot spare to serve as a hot spare again A hot spare is most useful when you need the highest data availability It eliminates the time and effort needed for someone to notice that a disk has failed find a suitable replacement disk and insert the disk When you plan to use a hot spare make sure the disk has the capacity to serve in any RAID Group in the storage system chassis A RAID Group cannot use a hot spare that is smaller than a failed disk in the group You can have one or more hot spares per storage system chassis You can make any disk in the chassis a hot spare except for a disk that serves for Core Software storage or the write cache vault That is a hot spare can be any of the following disks DPE or iDAE system without write caching disks 3 119 DPE system with write cachin
48. e Copper cabling is shielded 75 ohm twin axial shield bonded to DB 9 plug connector shell 360 FC AL Standard Revision 4 4 or higher Component planning diagrams and worksheets follow Cable and Configuration Guidelines 5 23 Storage System Hardware Hardware Planning Worksheets Following are worksheets to note the hardware components you want There are two types of configuration e Shared storage e Unshared storage Hardware for Shared Storage Server 1 Server n A1 1 depy Ja depy 1 depy 1 depy Switch 1 ol pae lo C O 5 pae l5 e die 5 o OL o DPE lo PB SPA Storage system 1 T ci ol pae 6m 5 pae I5 odpo Path 1 Q DPE Q Path 2 SPB SPA Storage system m Figure 5 11 Cable Identifier DPE Based System for Shared Storage The cable identifiers used above apply to shared and unshared storage systems The worksheet applies to shared storage only 5 24 EMC Fibre Channel Storage Systems Configuration Planning Guide Storage System Hardware Hardware Component Worksheet for Shared Storage Number of servers Adapters in servers Switches 16 port 8 port Rackmount DPEs SP LCC pairs PSs SPSs Rackmount cabinets Rackmount DAEs LCCs PSs Cables b
49. e a five disk RAID 5 Group that uses 36 Gbyte disks offers 144 Gbytes of space You could bind three LUNs say with 24 60 and 60 Gbytes of storage capacity for temporary mail and customer files One disadvantage of multiple LUNs on a RAID Group is that I O to each LUN may affect I O to the others in the group that is if traffic to one LUN is very heavy I O performance with other LUNs may degrade The main advantage of multiple LUNs per RAID Group is the ability to divide the enormous amount of disk space provided by RAID Groups on newer high capacity disks RAID Group LUN 0 LUN 0 LUN 0 LUN 0 LUN 0 temp temp temp temp temp LUN 1 LUN 1 LUN 1 LUN 1 LUN 1 mail mail mail mail mail LUN LUN2 LUN2 LUN2 LUN 2 customers customers customers customers customers Disk Disk Disk Disk Disk EMC1814 Figure 2 1 Multiple LUNs in a RAID Group Introducing RAID RAID Types and Tradeoffs RAID Types You can choose from the following RAID types RAID 5 RAID 3 RAID 1 RAID 0 RAID 1 0 individual disk unit and hot spare RAID 5 Group Individual Access Array A RAID 5 Group usually consists of five disks but can have three to sixteen A RAID 5 Group uses disk striping With a RAID 5 Group on a full fibre storage system you can create up to 32 RAID 5 LUNs to apportion disk space to different users servers and applications The storage system writes parity information that lets the group continue operating if a di
50. e enhancement Read caching is available with one or two SPs Mirrored write caching particularly helpful with RAID 5 I O requires two SPs to mirror one another for cache integrity and a Standby Power Supply SPS to enable the SPs to write their cached data to disk if power fails This section helps you plan the hardware components adapters switches or hubs cables storage systems and site requirements for each server in your installation For shared storage you must use a DPE rackmount system with two SPs and high availability options We assume you have some idea of how many servers adapters switches or hubs storage systems and SPs you want Skip to the component data sheets following For unshared storage you can use one or two SPs and you can choose among storage system configurations This section assumes you have examined the configurations shown starting on page 4 2 and have some idea of how many servers adapters switches or hubs storage systems and SPs you want It ends with blank worksheets and sample worksheets Shared Storage The hardware configuration required for shared storage is very specific two host bus adapters in each attached server two Fibre Channel switches and two SPs per storage system Choices you can make with shared storage systems include the number of storage systems up to 15 are allowed and for each storage system the cache configuration maximum or minimum and one or two sta
51. e Channel Storage Systems and Networks SANs About Fibre Channel Storage Systems and Networks SANs About Unshared Storage Unshared storage systems are less costly and less complex than shared storage systems They offer many shared storage system features for example you can use multiple unshared storage systems with multiple servers However with multiple servers unshared storage offers less flexibility and security than shared storage since any user with write access to a privileged server s files can enable access to any storage system Storage System Hardware for Unshared Storage For unshared storage there are four types of storage system each using the FC AL protocol Each type is available in a rackmount or deskside office version Disk array Processor Enclosure DPE storage systems A DPE is a 10 slot enclosure with hardware RAID features provided by one or two storage processors SPs In addition to its own disks a DPE can support up to 110 additional disks in 10 slot Disk Array Enclosures DAEs for a total of 120 disks This is the same type of storage system used for shared storage but it has a different SP and different Core Software Intelligent Disk Array Enclosure iDAE An iDAE like a DPE has SPs and thus all the features of a DPE but is thinner and has a limit of 30 disks Disk Array Enclosure DAE A DAE does not have SPs A DAE can connect to a DPE or an iDAE or you can use it with
52. e LUN per RAID 3 Group The storage system writes parity information that lets the group continue operating if a disk fails When you replace the failed disk the SP rebuilds the group using the information stored on the working disks Performance is degraded while the SP rebuilds the group However the storage system continues to function and gives users access to all data including data stored on the failed disk RAID Types RAID Types and Tradeoffs RAID Types and Tradeoffs Stripe element size Stripe size Figure 2 3 The following figure shows user and parity data with a data block size of 2 Kbytes in a RAID 3 Group Notice that the byte addresses proceed from the first disk to the second third and fourth then the first and so on C User data Parity data Parity Parity Parity EMC1816 RAID 3 Group RAID 3 differs from RAID 5 in several important ways First in a RAID 3 Group the hardware processes disk requests serially whereas in a RAID 5 Group the hardware can interleave disk requests Second with a RAID 3 Group the parity information is stored on one disk with a RAID 5 Group it is stored on all disks Finally with a RAID 3 Group the I O occurs in small units one sector to each disk A RAID 3 Group works well for single task applications that use I Os of blocks larger than 64 Kbytes Each RAID 3 Group requires some dedicated SP memory 6 Mbytes recommended per group This me
53. ecs a DS R5 DS RS 1_0 1_9 Database Server Users 995 Storage Group Ep Elgips Rs 6 ee oD S disks Dbasetl Path 1 Path 2 Figure 3 1 Sample Shared Switched High Availability installation Sample Shared Switched Installation Planning File Systems and LUNs with Shared Switched Storage The storage system disk IDs and server Storage Group LUNs are as follows Clustered System LUNs File Server LUNs FS SP B Mail Server LUNs MS SP A Database Server LUNs DS SP A Disk IDs RAID type storage type Disk IDs RAID type storage type Disk IDs RAID type storage type 4_0 4_4 RAID 5 Files A 4_5 4_9 RAID 5 Files B 2_0 2_4 RAID 5 ISP A mail 2_5 2_9 RAID 5 ISP B mail 3_0 3_4 RAID 5 Users 3_5 3_9 RAID 5 Specs 0_0 0_1 RAID 1 Log file for database Dbase1 0_4 0_9 RAID 5 6 disks Dbase1 1_0 1_4 RAID 5 Users 1_5 1_9 RAID 5 Dbase2 6_0 6_1 Hot spare automatically replaces a failed disk in any server s LUN With 36 Megabyte disks the LUN storage capacities and drive names are as follows File Server 288 Gbytes on two LUNs FS R5 FilesA Unit U on five disks bound as a RAID 5 Group for 144 Gbytes of storage for file storage FS R5 FilesB Unit V on five disks bound as a RAID 5 Group for 144 Gbytes of storage for file storage EMC Fibre Channel Storage System Configuration Planning Mail Server 576
54. eight empty 134 kg 296 Ib As an example a rackmount storage system that supports 100 disk modules has the following requirements Category Requirement Vertical cabinet space in NEMA units U one U is Bottom to top One SPS 1 U one DPE 6 5 U and nine DAEs 9 3 5 U equals 31 5 U for a total of 39 U 1 75 in Weight 516 kg 1 137 Ib including the cabinet 134 kg DPE 52 kg SPS 11 kg and nine DAEs 9 35 4 kg equals 319 kg Power 4 500 VA max including the DPE 800 VA SPS 100 VA and nine DAEs 9 400 VA equals 3600 VA Cooling 15 484 KJ hour 14 700 BTU hr including the DPE 2 520 KJ hr SPS 265 KJ hour estimated and nine DAEs 9 1 411 KJ hr equals 12 699 KJ hr EMC Fibre Channel Storage Systems Configuration Planning Guide Storage System Hardware Cable and Configuration Guidelines We recommend that all copper interconnected nodes be connected to a common ground grid The common grid is not needed for optical interconnections Copper cable allows up to 30 meters 99 feet between nodes or switches and hubs Optical cable allows significantly longer distances This is a major advantage of optical cable However you can use optical cable from a server only if the server s adapter supports optical cable otherwise you must use copper Not all adapters support optical cable To connect a DPE to a DAE you must use copper cable whose maxim
55. em regardless of its Storage Group or RAID Group The maximum number of LUNs supported on one host bus adapter depends on the operating system Some systems allow only eight LUNs numbers 0 through 7 For an operating system with this restriction if you want a hot spare assign the hot spare an ID above 7 for example 8 or 9 The operating system never accesses a hot spare so the ID is irrelevant to it Disk space required Gbytes Consider the largest amount of disk space this application will need then add a factor for growth Server hostname and operating system Enter the server hostname or if you don t know the name a short description that identifies the server and the operating system name if you know it If this storage system will be used by two servers provide a copy of this worksheet to the other server This is particularly important where one server may take over the other s LUNs If a LUN will be shared on the Notes section of the LUN details worksheet write Primary to server name or Secondary to server name LUN Planning Worksheet Use one of the following worksheets Rackmount or Deskside to select the disks that will make up the LUNs Depending on model a full fibre rackmount storage system can include up to 100 disks numbered 0 through 99 left to right from the bottom up Again depending on model a deskside storage system can hold ten 20 or 30 disks EMC Fibre Channel Storage Systems Conf
56. es Front Back Storage System Hardware TEC 320 C14 power inlet USA 1 8 m 6 0 ft NEMA 6 15P plug Outside USA Specific to country 10 C to 40 C 50 F to 104 F Noncondensing 20 to 80 40 C to 2 438 m 8 000 ft 37 C to 3 050 m 10 000 ft 30 slot 4 233 KJ hr 4 020 BTU hr 10 slot 1 411 KJ hr 1 340 BTU hr Front to back 30 3 cm 1 ft 60 6 cm 2 ft Hardware Data Sheets 5 17 Storage System Hardware DAE Data Sheet the following figure Deskside 30 slot model disks SPs Power requirements Voltage rating Current draw Power consumption Deskside 10 slot model The DAE storage system dimensions and requirements are shown in Dimensions and Requirements DAE Rackmount model Width i 25 cm Width one 52 1 cm _ Depth DE in Width 30 in 20 6 in Kaom S Depth 7 44 5cm ae 63 3 cm 17 5 in a 24 9 in f C sil g p Ai Height 4 AK 68cm ff n 26 8 in 2 Height o 15 4 cm 6 1 in 3 5 U Weight without packaging Deskside 30 Deskside 10 Rackmount Maximum max 144 kg 316 lb 60 kg 132 1b 35 4 kg 78 1b 100 V ac to 240 V ac 10 single phase 47 Hz to 63 Hz power supplies are auto ranging At 100 v ac input 30 slot 12 0 A 10 slot 4 0 A SPS 1 0 A max per unit during charge 30 slot 1200 10 slot 400 VA SPS 1 0 VA per unit during charge EMC Fibre Channel Storage Systems Configuration
57. es are connected by optical cables An optical cable can transmit data over great distances for connections that span entire enterprises and can support remote disaster recovery systems Copper cable serves well for local connections its length is limited to 30 meters 99 feet Each connected device in a switched fabric or arbitrated loop is a server adapter initiator or a target storage system The switches and hubs are not considered nodes Server Adapter initiator Storage System target Connection EMC1802 Figure 1 2 Nodes Initiator and Target Fibre Channel Background About Fibre Channel Storage Systems and Networks SANs Cables Fibre Channel Storage Components A Fibre Channel storage system has three main components e Server component host bus adapter driver package with adapter and software e Interconnect components cables based on Fibre Channel standards switches and hubs e Storage components storage system with storage processors SPs and power supply and cooling hardware Server Component Host Bus Adapter Driver Package with Software The host bus adapter driver package includes a host bus adapter and support software The adapter is a printed circuit board that slides into an I O slot in the server s cabinet It transfers data between server memory and one or more disk array storage systems over Fibre Channel as controlled by the support software
58. etween server and switch Cable A optical only Cable A Optical Number ____ Cable Ag Optical Number ____ Cable A Optical Number Cables between switches and storage systems Cable D copper or optical Cable D4 Optical Number m or ft Cable Do Optical Number m or ft Cable Dm Optical Number m or ft Cables between enclosures Cable E which connects LCCs between a DPE LCC and a DAE LCC Cable E must be copper between DAE LCCs it can be copper or optical Cable E Number Copper LOptical for DAE to DAE only Length m or ft Cable E gt 5 Number Copper O Optical for DAE to DAE only m or ft Hardware Planning Worksheets 5 25 Storage System Hardware Highly available cluster eaaa A File Server Mail Server Database Server ee a2 Cable between server and Cable between storage systems or enclosures Cable between switch and storage system DAE 291 991 9291 291 291 9291 991 DIOTYOOYOOW OO WOOW9O1W9971 Storage system Figure 5 12 Sample Shared Storage Installation 5 26 EMC Fibre Channel Storage Systems Configuration Planning Guide Storage System Hardware Hardware Component Worksheet for Shared Storage Number of servers __3_ Adapters in servers __6_ Switches 16 port 8 po
59. g disks 9 119 iDAE system with write caching disks 5 29 30 slot SCSI disk system disks A1 E1 A2 E2 B3 E3 A4 E4 An example of hot spare usage for a deskside DPE storage system follows EMC Fibre Channel Storage System Configuration Planning Figure 2 6 RAID Types and Tradeoffs RSI r A O LWT Wi RW We 3 Hot spare 1 RAID 5 group consists of disk modules 0 4 RAID 1 mirrored pair is modules 5 and 6 hot spare is module 9 2 Disk module 3 fails 3 RAID 5 group becomes modules 0 1 2 9 and 4 now no hot spare is available 4 System operator replaces failed module 3 with a functional module 5 RAID 5 group once again is 0 4 and hot spare is 9 How a Hot Spare Works RAID Types RAID Types and Tradeoffs RAID Benefits and Tradeoffs This section reviews RAID types and explains their benefits and tradeoffs You can create seven types of LUN RAID 5 Group individual access array RAID 3 Group parallel access array RAID 1 mirrored pair RAID 1 0 Group mirrored RAID 0 Group a RAID 0 Group mirrored by the storage system hardware RAID 0 Group nonredundant individual access array no inherent high availability features but can be software mirrored if the operating system supports mirroring Individual unit no inherent high availability features but can be software mirrored if the operating system supports
60. hared storage requires two SPs and the Access Logix software option A DPE with a DAE is available as a deskside system but with a capacity of 20 disks this cannot provide the expandability and total storage capacity needed for a SAN storage area network So this section does not cover the deskside version Storage Hardware Rackmount DPE Based Storage Systems The DPE rackmount enclosure is a sheet metal housing with a front door a midplane and slots for the storage processors SPs link control cards LCCs disk modules power supplies and fan packs All components can be replaced under power The DPE rackmount model looks like the following figure Front Back Disk modules front door removed for clarity FC ports with GBICs detached for clarity Figure 5 2 Power supplies LCC Link control card LCC Storage processors SPs DPE Storage System Components Rackmount Model A separate standby power supply SPS is required to support write caching All the shared storage components rackmount DPE DAEs SPSs and cabinet are shown in the following figure Hardware for Shared Storage Storage System Hardware Storage System Hardware Standby power wa supplies SPSs Front Rear Figure 5 3 Rackmount System with DPE and DAEs Disks The disks available in diffe
61. he SP recreates the second image after a failure With a RAID 1 mirrored pair the storage system writes the same data to both disks as follows User data Second disk 0 1 2 3 4 O O O EMC1817 Figure 2 4 RAID 1 Mirrored Pair RAID Types RAID Types and Tradeoffs RAID 0 Group Nonredundant Array A RAID 0 Group consists of three to a maximum of sixteen disks A RAID 0 Group uses disk striping in which the hardware writes to or reads from multiple disks simultaneously In a full fibre storage system you can create up to 32 LUNs per RAID Group Unlike the other RAID levels with RAID 0 the hardware does not maintain parity information on any disk this type of group has no inherent data redundancy RAID 0 offers enhanced performance through simultaneous I O to different disks If the operating system supports software mirroring you can use software mirroring with the RAID 0 Group to provide high availability A desirable alternative to RAID 0 is RAID 1 0 RAID 1 0 Group Mirrored RAID 0 Group A RAID 1 0 Group consists of four six eight ten twelve fourteen or sixteen disks These disks make up two mirror images with each image including two to eight disks The hardware automatically mirrors the disks A RAID 1 0 Group uses disk striping It combines the speed advantage of RAID 0 with the redundancy advantage of mirroring With a RAID 1 0 Group on a full fibre storage system you can create u
62. hem and the Storage Groups that will belong to each server The worksheets to help you do this include e Application and LUN planning worksheet lets you outline your storage needs e LUN and Storage Group planning worksheet lets you decide on the disks to compose the LUNs and the LUNs to compose the Storage Groups for each server e LUN details worksheet lets you plan each LUN in detail Make as many copies of each blank worksheet as you need You will need this information later when you configure the shared storage system Sample worksheets appear later in this chapter Application and LUN Planning Use the following worksheet to list the applications you will run and the RAID type and size of LUN to hold them For each application that will run in the SAN write the application name file system if any RAID type LUN ID ascending integers starting with 0 disk space required and finally the name of the servers and operating systems that will use the LUN EMC Fibre Channel Storage System Configuration Planning Planning File Systems and LUNs with Shared Switched Storage Application and LUN Planning Worksheet Disk space File system RAID typeof LUN required Server name and Application partition or drive LUN ID hex Gbytes operating system A sample worksheet begins as follows Disk space File system RAID ty
63. hown draw circles around the disks that will compose each LUN and within each circle specify the RAID type for example RAID 5 and LUN ID This is information you will use to bind the disks into LUNs For disk IDs use the form shown This form is enclosure_diskID where enclosure is the enclosure number the bottom one is 0 above it 1 and so on and diskID is the disk position left is 0 next is 1 and so on None of the disks 0_0 through 0_8 may be used as a hot spare Next complete as many of the LUN sections as needed for each storage system Copy the blank worksheet as needed for all LUNs in each storage system A storage system is any group of enclosures connected to a DPE a full fibre system can include up to nine DAE enclosures for a total of 100 disks LUN Details Worksheet Use the following LUN details worksheet to plan the individual LUNs Complete as many of these as needed for all LUNs Planning Applications and LUNs 49 Planning LUNs and File Systems with Unshared Direct Storage LUN Details Worksheet Storage system complete this section once for each storage system Storage system number or name Storage system installation type T Unshared Direct O Shared or Clustered Direct 4 Shared Switched SP FC AL address ID unshared only SP A SP B SP memory Mbytes SPA SP B Use for caching Read cache size ___ MB_ Wri
64. icer rita 2 2 RAID Ty Pes istic ss iaia alla 2 4 e RAID Benefits and TradeoffS 2 12 e Guidelines for RAID Types 2 17 e Sample Applications for RAID Types in 2 19 This chapter applies primarily to storage systems with storage processors SPs For a storage system without SPs a DAE only or JBOD system RAID types are limited by the RAID software you run on the server The RAID terms and definitions used here conform to generally accepted standards RAID Types and Tradeoffs 21 RAID Types and Tradeoffs Introducing RAID Disk Striping Mirroring The storage system uses RAID redundant array of independent disks technology RAID technology groups separate disks into one logical unit LUN to improve reliability and or performance The storage system supports five RAID levels and two other disk configurations the individual unit and the hot spare global spare You group the disks into one RAID Group by binding them using a storage system management utility Four of the RAID types use disk striping and two use mirroring Using disk stripes the storage system hardware can read from and write to multiple disks simultaneously and independently By allowing several read write heads to work on the same task at once disk striping can enhance performance The amount of information read from or written to each disk makes up the stripe element size
65. iguration Planning Guide Planning LUNs and File Systems with Unshared Direct Storage LUN Planning Worksheet Rackmount Full fibre storage system 11_0 11_1 11_2 11_3 11 411 51 611 7 11 8 11 9 o_o 10_1 10_2 10_3 10_4 10_5 10_6 10_7 10_8 10_9 9O9 1 9219 319 419519 6 197 9_8 9_9 70 7_1 72 7_3 7_4 7_5 7_6 7_7 7_8 7_9 1_0 1_1 1_2 13 1_4 15 1_6 1_7 1_8 1_9 LUN number RAID type __ Cap Gb _____ Disk IDs LUN number RAID type ___ Cap Gb _____ Disk IDs LUN number RAID type ___ Cap Gb Disk IDs LUN number RAID type___ Cap Gb _____ Disk IDs LUN number RAID type ___ Cap Gb ___ s Diisk IDs LUN number RAID type ___ Cap Gb ___ s dDiisk IDs LUN number RAID type ___ Cap Gb _____ Disk IDs LUN number RAID type __ Cap Gb _____ Disk IDs Planning Applications and LUNs 4 7 Planning LUNs and File Systems with Unshared Direct Storage LUN Planning Worksheet Deskside Full fibre storage system 0_0 1_0 2_0 0_1 11 21 0_2 12 22 0_3 13 23 04 14 24
66. isk IDs 1_0 11 SP A OB RAID type RAID 5 RAID 3 Memory MB KIRAID 1 mirrored pair RAID 0 RAID 1 0 Individual disk Hot spare Caching KiRead and write Write DRead ONone Servers that can access this LUN _ Server1 Operating system information Device name File system partition or drive vV Planning LUNs and File Systems with Unshared Direct Storage Planning Applications and LUNs RSI Planning LUNs and File Systems with Unshared Direct Storage Completing the LUN Details Worksheet Complete the header portion of the worksheet for each storage system as described below Copy the blank worksheet as needed Sample completed LUN worksheets appear later Storage System Entries Storage system configuration Specify Unshared Direct one server or Shared or Clustered Direct two servers For any multiple server configuration each server will need cluster software SP FC AL address ID For unshared storage which uses FC AL addressing each SP and each other node on a Fibre Channel loop must have a unique FC AL address ID You set the SP FC AL address ID using switches on the back panel of the SP The valid FC AL address ID range is a number 0 through 125 decimal which is 0 through 7D hexadecimal For any number above 9 we suggest hexadecimal since the switches are marked in hexadecimal If you have two FC AL loops we suggest a unique FC AL address ID for each SP
67. izes Write caching can significantly enhance the write performance of a RAID 5 Group For example a RAID 5 Group is suitable for multitasking applications that require a large history database with a high read rate such as a database of legal cases medical records or census information A RAID 5 Group also works well with transaction processing applications such as an airline reservations system where users typically read the information about several available flights before making a reservation which requires a write operation You could also use a RAID 5 Group in a retail environment such as a supermarket to hold the price information accessed by the point of sale terminals Even though the price information may be updated daily requiring many write operations it is read many more times during the day RAID 3 Group A RAID 3 Group parallel access array works well with a single task application that uses large I O transfers more than 64 Kbytes aligned to start at a disk address that is a multiple of 2 Kbytes from the beginning of the logical disk RAID 3 Groups can use SP memory to great advantage without the second SP and battery backup unit required for storage system caching You might use a RAID 3 Group for a single task application that does large I O transfers like a weather tracking system geologic charting application medical imaging system or video storage application RAID 1 mirrored pair A RAID 1 mirrored
68. ligence of the storage system Using its own operating system called Core Software the SP processes the data written to or read from the disk modules and monitors the modules themselves An SP consists of a printed circuit board with memory modules DIMMs status lights and switches for setting FC AL addresses For high availability a storage system can support a second SP A second SP provides a second route to a storage system so both SPs can connect to the same server or two different servers as follows Hardware for Unshared Storage Storage System Hardware Storage System Hardware Server Storage system DAE s FC loop 1 FC loop 2 Figure 5 8 Storage System with Two SPs Connected to the Same Server Highly available cluster Server 1 Server 2 Storage system DAE s DPE SPA SP B FC loop 1 FC loop 2 Figure 5 9 Storage System with Two SPs Connected to Different Servers Either SP can control any LUN in the storage system but only one SP at a time can control a LUN If one SP cannot access a LUN it controlled because of a failure you can transfer control of the LUN to the other SP manually or via software 5 10 EMC Fibre Channel Storage Systems Configuration Planning Guide Planning Your Hardware Components Configuration Tradeoffs Storage System Hardware Storage system caching provides significant performanc
69. ll its disk space is available for user data as shown in the figure above EMC Fibre Channel Storage System Configuration Planning RAID Types and Tradeoffs Guidelines for RAID Types To decide when to use a RAID 5 Group RAID 3 Group mirror that is a RAID 1 mirrored pair or RAID 1 0 Group a RAID 0 Group individual disk unit or hot spare you need to weigh these factors e Importance of data availability e Importance of performance e Amount of data stored e Cost of disk space The following guidelines will help you decide on RAID types Use a RAID 5 Group individual access array for applications where e Data availability is very important e Large volumes of data will be stored e Multitask applications use I O transfers of different sizes e Good read and moderate write performance are important write caching can improve RAID 5 write performance e You want the flexibility of multiple LUNs per RAID Group Use a RAID 3 Group parallel access array for applications where e Data availability is very important e Large volumes of data will be stored e Asingle task application uses large I O transfers more than 64 Kbytes The operating system must allow transfers aligned to start at disk addresses that are multiples of 2 Kbytes from the start of the LUN Use a RAID 1 mirrored pair for applications where e Data availability is very important e Speed of write access is important and write activity is heavy Use
70. lso holds 36 Gbytes Each disk in the RAID Group must have the same capacity otherwise you will waste disk storage space LUN size Enter the user available capacity in gigabytes Gbytes of the LUN You can make this the same size as the RAID Group above Or fora RAID 5 RAID 1 RAID 1 0 or RAID 0 Group you can make the LUN smaller than the RAID Group You might do this if you wanted a RAID 5 Group with a large capacity and wanted to place many smaller capacity LUNs on it for example to specify a LUN for each user However having multiple LUNs Planning Applications LUNs and Storage Groups 3 15 Planning File Systems and LUNs with Shared Switched Storage per RAID Group may adversely impact performance If you want multiple LUNs per RAID Group then use a RAID Group LUN series of entries for each LUN Disk IDs Enter the ID s of all disks that will make up the LUN or hot spare These are the same disk IDs you specified on the previous worksheet For example for a RAID 5 Group in the DPE enclosure 0 disks 2 through 6 enter 0_2 0_3 0_4 0_5 and 0_6 SP Specify the SP that will own the LUN SP A or SP B You can let the management program automatically select the SP to balance the workload between SPs to do so leave this entry blank RAID type Copy the RAID type from the previous worksheet For example RAID 5 or hot spare For a hot spare not strictly speaking a LUN at all skip the rest of this LUN e
71. ly or supplies SPS or BBU must be placed in a tray directly beneath the storage system Typically any hubs in the cabinet mount at the top or bottom of the cabinet Rackmount options are as follows Table 5 2 High Availability Options Rackmount Unshared Storage Rackmount Power System Type HA Level SPs LCCs Supplies Disks SPS Units DPE Minimum 1 1 1 5 without write 0 without write cache cache 1 write cache Maximum 2 2 DPE 2 DPE 10 write cache or 2 18 with 9 11 with 9 RAID 3 DAEs DAEs iDAE Minimum 1 n a 10 slot 1 3 without write 0 without write 4 with two cache cache DAEs 5 write cache or 1 write cache RAID 3 Maximum 2 n a 2 5 write cache or 2 RAID 3 DAE only Minimum n a 1 1 No minimum n a Maximum n a 2 2 No minimum n a Planning Your Hardware Components Storage System Hardware Hardware Data Sheets sheets DPE Data Sheet Deskside model Width 74 7 cm 20 6 in gt Weight without packaging LCCs PSs with 2 SPSs ore N 0 In Pa LA Maximum max disks SPs The hardware data sheets shown in this section provide the plant requirements including dimensions footprint weight power requirements and cooling needs for DPE iDAE DAE and 30 slot SCSI disk systems Sections on cabinets and cables follow the data For shared storage a rackmount DPE and one or more rackmount DAEs are required For u
72. mirroring Hot spare serves only as an automatic replacement for any disk in a RAID type other than 0 does not store data during normal system operations Plan the disk unit configurations carefully After a disk has been bound into a LUN you cannot change the RAID type of that LUN without unbinding it and this means losing all data on it The following table compares the read and write performance tolerance for disk failure and relative cost per megabyte Mbyte of the RAID types Figures shown are theoretical maximums 272 EMC Fibre Channel Storage System Configuration Planning Performance Performance Availability and Cost of RAID Types Individual Unit 1 0 RAID Types and Tradeoffs Relative read Relative write Relative performance performance cost per Disk configuration without cache without cache Mbyte RAID 5 Group with Up to 5 with five disks Up to 1 25 with five disks 1 25 fivedisks for small I O requests 2 for small I O requests 2 to to 8 Kbytes 8 Kbytes RAID 3 Group with Up to 4 for large I O Up to 4 for large I O 1 25 five disks requests requests RAID 1 mirrored pair Up to 2 Up to 1 2 RAID 1 0 Group with Up to 10 Up to 5 10 disks Individual unit 1 1 1 Notes These performance numbers are not based on storage system caching With caching the performance numbers for RAID 5 writes improve significantly Performance multipliers vary with load on server
73. mory is allocated when you create the group and becomes unavailable for storage system caching For top performance we suggest that you do not use RAID 3 Groups with RAID 5 RAID 1 0 or RAID 0 Groups since SP processing power and memory are best devoted to the RAID 3 Groups RAID 1 mirrored pairs and individual units require less SP processing power and therefore work well with RAID 3 Groups EMC Fibre Channel Storage System Configuration Planning RAID Types and Tradeoffs For each write to a RAID 3 Group the storage system 1 Calculates the parity data 2 Writes the new user and parity data RAID 1 Mirrored Pair A RAID 1 Group consists of two disks that are mirrored automatically by the storage system hardware RAID 1 hardware mirroring within the storage system is not the same as software mirroring or hardware mirroring for other kinds of disks Functionally the difference is that you cannot manually stop mirroring on a RAID 1 mirrored pair and then access one of the images independently If you want to use one of the disks in such a mirror separately you must unbind the mirror losing all data on it rebind the disk in as the type you want and software format the newly bound LUN With a storage system RAID 1 hardware mirroring has the following advantages e automatic operation you do not have to issue commands to initiate it e physical duplication of images e arebuild period that you can select during which t
74. nager and Navisphere Agent Navisphere Agent and CLI List all the servers this host will manage Each managed server must run an Agent of the same type as its operating system Server Oper sys Server Oper sys Server Oper sys Server Oper sys Server Oper sys Server Oper sys Server Oper sys Server Oper sys Hostname Operating system Storage system type ODPE based IDAE based Software O Navisphere Manager and Navisphere Agent O Navisphere Agent and CLI List all the servers this host will manage Each managed server must run an Agent of the same type as its operating system Server Oper sys Server Oper sys Server Oper sys Server Oper sys Server Oper sys Server Oper sys Server Oper sys Server Oper sys Storage Management Worksheets Storage System Management 6 8 EMC Fibre Channel Storage System Configuration Planning A ac power requirements DAE only storage system 5 18 DPE storage system 5 14 iDAE storage system 5 16 application planning shared storage 3 6 unshared storage 4 4 application worksheet completing shared 3 6 4 4 unshared or clustered direct 4 4 applications for RAID Groups sample 2 19 LUN and file system planning 3 6 application transparent failover ATF software array see disk array storage system attach kit see host bus adapter driver package audience for manual xi C cabinets for rackmount storage systems
75. nd communicate with storage systems through the Agent that runs on each server The Navisphere products are e Navisphere Manager which lets you manage multiple storage systems on multiple servers simultaneously e Navisphere Analyzer which lets you measure compare and chart the performance of SPs LUNs and disks e Navisphere Integrator which provides an interface between Navisphere products and HP OpenView CA Unicenter and Tivoli e Navisphere Event Monitor which checks storage systems for fault conditions and can notify you and or customer service if any fault condition occurs e Navisphere failover software Application Transparent Failover ATF is an optional software package for high availability installations ATF software lets applications continue running after the failure anywhere in the path to a LUN a host bus adapter cable switch or SP ATF is required for any server that has two host bus adapters connected to the same storage system Another failover product is CDE Driver Extensions software which has limited failover features CDE is included with each host bus adapter driver package e Navisphere Agent which is included with each storage system and Navisphere CLI Command Line Interface which lets you bypass the GUI and type commands directly to storage systems The Agent runs on any of several different platforms including Windows and popular UNIX platforms the other products run on Window
76. ndby power supplies SPS units The number of storage systems in the SAN depends on the servers processing demands For each system the larger cache improves write performance for very large processing loads the redundant SPS lets write caching continue if one SPS fails Planning Your Hardware Components 51 Storage System Hardware Configuration Tradeoffs Unshared Storage For each storage system enclosure you have two important areas of choice rackmount or deskside model and high availability options Generally rackmount systems are more versatile you can add capacity in a cabinet without consuming more floor space However rackmount systems require additional hardware such as cabinets and mounting rails and someone must connect power cords and cables within them For large storage requirements rackmount systems may be more economical than deskside systems Deskside systems are more convenient they ship with all internal cabling in place and require only ac power and connection to the servers For high availability there are many variations The most important high availability features are a second SP LCC pair second power supply and standby power supply SPS The second SP LCC and SPS let you use write caching to enhance performance the second SP provides continuous access to storage system disks if one SP or LCC fails Another high availability option is a redundant SPS Yet another option for a
77. nshared storage you can use a rackmount or deskside DPE and DAE s The DPE dimensions and requirements are shown in the following figure DPE Dimensions and Requirements Rackmount model Width 44 5 cm Depth SP 17 5 in _ height 4 44 cm 1 75 in 1 U depth 54 1 cm 21 3 in Deskside Rackmount 144 kg 316 1b 52 kg 115 1b 165 kg 364 Ib 74 kg 163 Ib EMC Fibre Channel Storage Systems Configuration Planning Guide Power requirements Voltage rating Current draw Power consumption Power cables single or dual ac inlet connector Deskside power cord Operating environment Temperature Relative humidity Altitude Heat dissipation max Air flow Service clearances Front Back Storage System Hardware 100 V ac to 240 V ac 10 15 single phase 47 Hz to 63 Hz power supplies are auto ranging At 100 v ac input Deskside DPE DAE 12 0 A Rackmount DPE 8 0 A max SPS 1 0 A max per unit during charge Deskside DPE DAE 1200 VA Rackmount DPE 800 VA max SPS 1 0 A per unit during charge IEC 320 C14 power inlet USA 1 8 m 6 0 ft NEMA 6 15P plug Outside USA Specific to country 10 C to 40 C 50 F to 104 F Noncondensing 20 to 80 40 C to 2 438 m 8 000 ft 37 C to 3 050 m 10 000 ft Deskside DPE DAE 3931x103 J hr 2730 BTU hr max estimated Rackmount DPE 2520x109 J hr 2390 BTU hr max estimated Front to back 30 3 cm 1 ft 60 6 cm 2 f
78. ntroduced 5 6 Disk Array Processor Enclosure DPE see DPE storage system disk array storage system communicating with see Chapter 6 hardware shared storage 1 15 unshared storage 1 16 installation types 1 10 managing see Chapter 6 DPE storage systems components 5 3 dimensions 5 14 site requirements 5 14 weight 5 14 driver extensions software CDE 6 2 dual paths to LUNs 3 2 4 2 E enclosure address EA DPE 5 4 5 8 F fabric switch introduced 1 3 Fibre Channel adapter 1 4 components 1 4 defined 1 3 hub description 1 8 switch description 1 5 switch see switch file system name 3 17 4 15 worksheet completing 3 13 4 12 footprint DAE only storage system 5 18 DPE storage systems 5 14 iDAE storage systems 5 16 rackmount cabinet 5 20 G GBIC Gigabit Interface Converter about 1 5 global spare see hot spare grounding requirements 5 21 GUI in storage system management utilities 6 3 H hardware data sheets 5 14 mirroring 2 2 planning worksheets shared storage 5 24 shared storage 1 15 5 3 unshared storage 1 16 heat dissipation DAE only storage system 5 18 DPE storage system 5 14 iDAE storage system 5 16 height DAE only storage systems 5 18 DPE storage system 5 14 EMC Fibre Channel Storage Systems Configuration Planning Guide iDAEstorage system 5 16 high availability options for unshared storage 5 13 shared switched instllation 1 10 host see also server host bus adapter HBA introduced 1 4
79. ntry and continue to the next LUN entry if any If this is a RAID 3 Group specify the amount of SP memory for that group To work efficiently each RAID 3 Group needs at least 6 Mbytes of memory Caching If you want to use caching entry on page 3 14 you can specify whether you want caching read and write read or write for this LUN Generally write caching improves performance far more than read caching The ability to specify caching on a LUN basis provides additional flexibility since you can use caching for only the units that will benefit from it Read and write caching recommendations follow Table 3 1 Cache Recommendations for Different RAID Types RAID 5 RAID 3 RAID 1 RAID 1 0 RAID 0 Individual Unit Highly Recommended Not allowed Recommended Recommended Recommended Recommended Servers that can access this LUN Enter the name of each server copied from the LUN and Storage Group worksheet Operating system information Device name Enter the operating system device name if this is important and if you know it Depending on your operating system you may not be able to complete this field now EMC Fibre Channel Storage System Configuration Planning Planning File Systems and LUNs with Shared Switched Storage File system partition or drive Write the name of the file system partition or drive letter you will create on this LUN This is the same name you wrote on the applica
80. o a LUN By default the ID of the first LUN bound is 0 the second 1 and so on Each LUN ID must be unique within the storage system regardless of its Storage Group or RAID Group The maximum number of LUNs supported on one host bus adapter depends on the operating system Disk space required Gbytes Consider the largest amount of disk space this application will need then add a factor for growth Server hostname and operating system Enter the server hostname or if you don t know the name a short description that identifies the server and the operating system name if you know it LUN and Storage Group Planning Worksheet Use the following worksheet to select the disks that will make up the LUNs and Storage Groups in the SAN A shared storage system can include up to 100 disks numbered 0 through 99 left to right from the bottom up EMC Fibre Channel Storage System Configuration Planning Planning File Systems and LUNs with Shared Switched Storage LUN and Storage Group Planning Worksheet 11_0 11_4 11_411_alt1_4 t1_5 t1_6 11_7 11_gh19 0_o 10_1 10_4ho_3 fo_4 f0_5 10_6 10_7 h0_s o_9 1_0 1_1 1_2 1_3 1_4 1_5 1_6 1_7 1_8 1_9 Storage system number or name
81. opper O Optical DAE to DAE only Length mor ft Hardware Planning Worksheets 5 31 Storage System Hardware Server A1 Cable between server and storage system E1 Cable between storage systems or enclosures included with deskside DPE E2 Cable between storage systems or enclosures FC Loop 1 Storage system FC Loop 2 Figure 5 16 Sample Unshared Deskside System Dual Adapter Dual SP Configuration 5 32 EMC Fibre Channel Storage Systems Configuration Planning Guide Storage System Hardware Sample Component Worksheet Hardware Component Worksheet for Unshared Storage Number of servers _1_ Adapters in servers __2__ Hubs copper MIAs copper to optical DPE based and DAE only storage systems Rackmount DPEs SP LCC pairs PSs SPSs Rackmount cabinets ___ Rackmount iDAEs SPs PSs SPSs Rackmount cabinets ___ Rackmount DAEs LCCs PSs Deskside DPEs __21_SP LCC pairs __2 DAELCCs __2__DPEPSs _2_ DAE PSs _2_ SPSs _1_ Deskside iDAEs SPs DAE LCCs PSs SPSs Deskside DAEs 30 slot__1 10 slot LCCs __ 6__ PSs __ 6 Cables between server and storage system or between server and hub Cable A copper or optical Cable A Number _2 _ K Copper UOptical Length__10___ for ft Cable As Number ICopper COptical m or ft Cable A Number Copper O Optical m or ft
82. out SPs A DAE used without an SP does not inherently include RAID but can operate as a RAID device using software running on the server system Such a DAE is also known as Just a Box of Disks or JBOD EMC Fibre Channel Storage System Configuration Planning About Fibre Channel Storage Systems and Networks SANs Disk array processor enclosure DPE Rackmount DPE one enclosure e lL 1 i P Intelligent disk array enclosure iDAE 30 slot deskside 10 slot deskside Rackmount Figure 1 13 Storage System Hardware for Unshared Storage What Next For information about RAID types and RAID tradeoffs continue to the next chapter To plan LUNs and file systems for shared storage skip to Chapter 3 or for unshared storage Chapter 4 For details on the storage system hardware shared and unshared skip to Chapter 5 For storage system management utilities skip to Chapter 6 About Unshared Storage 1 17 About Fibre Channel Storage Systems and Networks SANs 1 18 EMC Fibre Channel Storage System Configuration Planning 2 RAID Types and Tradeoffs This chapter explains RAID types you can choose for your storage system LUNs If you already know about RAID types and know which ones you want you can skip this background information and skip to Chapter 5 Topics are Introducing RAID iii r
83. p to 32 RAID 5 LUNs to apportion disk space to different users servers and applications The following figure shows the distribution of user data with the default stripe element size of 128 sectors 65 536 bytes in a six disk RAID 1 0 Group Notice that the disk block addresses in the stripe proceed sequentially from the first mirrored disks first and fourth disks to the second mirrored disks second and fifth disks to the third mirrored disks third and sixth disks and then from the first mirrored disks and so on 2 8 EMC Fibre Channel Storage System Configuration Planning Stripe 2 size Stripe element size Figure 2 5 Individual Disk Unit Hot Spare 0 127 384 511 768 895 1152 1279 1536 1663 256 383 1 640 767 1024 1151 1408 1535 1792 1919 User data 128 255 512 639 a ad 1664 1791 EMC1818 RAID 1 0 Group Mirrored RAID 0 Group A RAID 1 0 Group can survive the failure of multiple disks providing that one disk in each image pair survives An individual disk unit is a disk bound to be independent of any other disk in the cabinet An individual unit has no inherent high availability but you can make it highly available by using software mirroring with another individual unit You can create one LUN per individual disk unit If you want to apportion the disk space you can do so using partitions file systems or user directories A hot spare is a dedicated replacement
84. peof LUN required Server name and Application partition or drive LUN ID hex Gbytes operating system Mail 1 RAID 5 0 72 Gb Serveri NT Mail 2 RAID 5 1 72 Gb Serverl NT Database index RAID 1 2 18 Gb Server2 NT Completing the Application and LUN Planning Worksheet Application Enter the application name or type File system partition or drive Write the drive letter for Windows only and the partition file system logical volume or drive letter name if any With a Windows operating system the LUNs are identified by drive letter only The letter does not help you identify the disk configuration such as RAID 5 We suggest that later when you use the operating system to create a partition on a LUN you use the disk administrator software to assign a volume label that describes the RAID configuration For example for drive T assign the volume ID RAID5_T The volume label will then identify the drive letter Planning Applications LUNs and Storage Groups Planning File Systems and LUNs with Shared Switched Storage RAID type of LUN This is the RAID Group type you want for this partition file system or logical volume The features of RAID types are explained in Chapter 2 For a RAID 5 RAID 1 RAID 1 0 and RAID 0 Group you can create one or more LUNs on the RAID Group For other RAID types you can create only one LUN per RAID Group LUN ID The LUN ID is a hexadecimal number assigned when you bind the disks int
85. ps EMC Fibre Channel Storage Systems Configuration Planning Guide Storage System Hardware Hardware Component Worksheet for Unshared Storage Number of servers _2_ Adapters in servers ___ 4 Hubs ___2 MIAs optical to copper DPE based and DAE only storage systems Rackmount DPEs SP LCC pairs _4 PSs 4 SPSs _2__ Rackmount cabinets _2__ Rackmount iDAEs SPs PSs SPSs Rackmount cabinets ___ Rackmount DAEs 8 ___ LCCs __16 PSs __16 Deskside DPEs SP LCC pairs DAE LCCs DPE PSs DAE PSs SPSs __ Deskside iDAEs SPs DAE LCCs PSs SPSs Deskside DAEs 30 slot 10 slot LCCs PSs Cables between server and storage system or between server and hub Cable A copper or optical Cable A Number __2__ X Copper O Optical Length_20 O or ft Cable Ap Number __2__XiCopper DOptical Length_10 O or ft Cable Ap Number __ OCopper O Optical m or ft Cables between hubs and storage systems Cable D copper or optical Cable D Number __2__ X Copper O Optical Length__20__ _ orft Cable Do Number __2__ Copper O Optical Length__20__gorft Cable Dmw Number ___ OCopper O Optical m or ft Cables between storage systems or enclosures Cable E which connects LCCs or SP LCC between a DPE LCC or iDAE SP anda DAE LCC Cable E must be copper between DAE LCCs it can be copper or optical Cable E Number _16__ Copper O Optical DAE to DAE only Length_ 1 m ort Cable
86. r ____ Copper COptical mor ft Cable A Number ___UCopper O Optical mor ft Cables between hubs and storage systems Cable D copper or optical Cable D Number O Copper DOptical mor ft Cable Do Number O Copper U1 Optical mor ft Cable D Number O Copper O Optical mor ft Cables between storage systems or enclosures Cable E which connects LCCs or SP LCC between a DPE LCC or iDAE SP and a DAE LCC Cable E must be copper between DAE LCCs it can be copper or optical Cable E Number Copper O Optical DAE to DAE only m or ft Cable Es Number Copper O Optical DAE to DAE only m or ft Please specify all storage system components you need even though you will not need to order them separately since most or all components will be included with the model of each system you order Ea EMC Fibre Channel Storage Systems Configuration Planning Guide Storage System Hardware Server A1 Cable between server and storage system E1 Cable between storage ai Q DAE systems or enclosures O Q Included with deskside S IDAE DPE DPE SP A Figure 5 15 Sample Unshared Deskside System Basic Configuration Sample Component Worksheet Hardware Component Worksheet for Unshared Storage
87. r nine disks a sizable block of storage to devote to one server application or user However the nature of RAID 3 makes it ideal for that single threaded type of application Data Availability and Disk Space Usage If data availability is critical and you cannot afford to wait hours to replace a disk rebind it make it accessible to the operating system and load its information from backup then use a redundant RAID Group RAID 5 RAID 3 RAID 1 mirrored pair or RAID 1 0 Or bind a RAID 0 Group or individual disk unit that you will later mirror with software mirroring If data availability is not critical or disk 2 14 EMC Fibre Channel Storage System Configuration Planning RAID Types and Tradeoffs space usage is critical bind an individual unit or RAID 0 Group without software mirroring A RAID 1 mirrored pair or RAID 1 0 Group provides very high data availability They are more expensive than RAID 5 or RAID 3 Groups since only 50 percent of the total disk capacity is available for user data as shown on page 2 13 A RAID 5 or RAID 3 Group provides high data availability but requires more disks than a mirrored pair In a RAID 5 or RAID 3 Group of five disks 80 percent of the disk space is available for user data So RAID 5 and RAID 3 Groups use disk space much more efficiently than a mirrored pair A RAID 5 or RAID 3 Group is usually more suitable than a RAID 1 mirrored pair for applications where high data availabili
88. rage Groups A Storage Group is one or more LUNs logical units within a storage system that is reserved for one or more servers and is inaccessible to other servers Storage Groups are the central component of shared storage storage systems that are unshared do not use Storage Groups When you configure shared storage you specify servers and the Storage Group s each server can read from and or write to The Base Software firmware running in each storage system enforces the server to Storage Group permissions A Storage Group can be accessed by more than one server if all the servers run cluster software The cluster software enforces orderly access to the shared Storage Group LUNs The following figure shows a simple shared storage configuration consisting of one storage system with two Storage Groups One Storage Group serves a cluster of two servers running the same operating system and the other Storage Group serves a UNIX database server Each server is configured with two independent paths to its data including separate host bus adapters switches and SPs so there is no single point of failure for access to its data EMC Fibre Channel Storage System Configuration Planning About Fibre Channel Storage Systems and Networks SANs Highly available cluster n Aa File Server Mail Server Database Server Operating Operating Operating system A system A system B
89. rating system Software O Navisphere Manager Agent O Navisphere Analyzer O Navisphere Event Monitor List all the servers this host will manage Each managed server must run an Agent and ATF software of the same type as its operating system Server Op sys Server Op sys Server Op sys Server Op sys Server Op sys Server Op sys Server Op sys Server Op sys Management station hostname Storage Group number or name Storage Group number or name Storage Group number or name Storage Group number or name Storage Group number or name Storage Group number or name Storage Group number or name Storage Group number or name Operating system Config Access Config Access Config Access Config Access Config Access Config Access Config Access Config Access Software O Navisphere Manager Agent O Navisphere Analyzer O Navisphere Event Monitor List all the servers this host will manage Each managed server must run an Agent and ATF software of the same type as its operating system Server Op sys Server Op sys Server Op sys Server Op sys Server Op sys Server Op sys Server Op sys Server Op sys Storage Group number or name Storage Group number or name Storage Group number or name Storage Group number or name Storage Group number or name Storage Group number or name Storage Group number or name S
90. ring capacities fit into slots in the enclosure Each module has a unique ID that you use when binding or monitoring its operation The ID is derived from the enclosure address always 0 for the DPE settable on a DAE and the disk module slot numbers 5 4 EMC Fibre Channel Storage Systems Configuration Planning Guide Storage System Hardware Disk Modules and Module IDs Rackmount DPE Based System Storage Processor SP The SP provides the intelligence of the storage system Using its own operating system called Core Software the SP processes the data written to or read from the disk modules and monitors the modules themselves An SP consists of a printed circuit board with memory modules DIMMs and status lights For high availability a storage system can support a second SP The second SP provides a second route to a storage system and also lets the storage system use write caching for enhanced write performance Two SPs are required for shared storage Server Server Server Path 1 Path 2 Storage systems Figure 5 4 Shared Storage Systems See Chapter 3 for more examples of shared storage Hardware for Shared Storage 5 5 Storage System Hardware Hardware for Unshared Storage Unshared storage systems are less costly and less complex than shared storage systems They offer
91. rt __2 Rackmount DPEs __ 2___SP LCC pairs __2___ PSs 2__SPSs __2__ Rackmount cabinets _Z _ Rackmount DAEs 6___ LCCs 12_ PSs 12 Cables between server and switch Cable A optical only Cable A Optical Number Cable A Optical Number __4__ Cable An Optical Number Cables between switches and storage systems Cable D copper or optical Cable D4 Optical Number __2___ Cable Do Optical Number m or ft Cable Dm Optical Number m or ft Cables between enclosures Cable E which connects LCCs between a DPE LCC and a DAE LCC Cable E must be copper between DAE LCCs it can be copper or optical Cable E Number __12___ iCopper DOptical for DAE to DAE only Length__1_m off Cable Es Number Copper O Optical for DAE to DAE only Length m or ft Hardware for Unshared Storage The cable identifiers used in the following figure and on the following worksheets apply to all types of unshared storage systems So if you want to plan a site with different types of systems you can consolidate all your unshared storage component entries from the different system types on a single worksheet Hardware Planning Worksheets 5 27 Storage System Hardware Server 1 Server 2 AI Jajdepy Jojdepy Jajdepy ol pae I5 PEZZO SI pae I5 O O Ol iDAE DPE Q FC Loop 1 ton O FC Loop
92. rverl Storage Group ID or name Server hostname Dedicated Shared LUN ID or name LUN ID orname__1 RAID type __ Cap Gb _72_ DiskIbs0_0 0_1 0_2 0_3 0 4 RAID type gt Cap Gb _72__ DiskIDs 0_5 0_6 0_7 0_8 0_9 LUN ID or name RAID type ___ Cap Gb Disk IDs LUN ID or name RAID type ___ Cap Gb Disk IDs Storage Group ID or name 24 2 server hostname _ Server2 Dedicated Shared O LUN ID or name_2 LUN ID or name LUN ID or name LUN ID or name RAID type 1__ Cap Gb 48 __ DiskIbs_1_0 1_1 RAID type ___ Cap Gb Disk IDs RAID type ___ Cap Gb Disk IDs RAID type ___ Cap Gb Disk IDs Completing the LUN and Storage Group Planning Worksheet As shown draw circles around the disks that will compose each LUN and within each circle specify the RAID type for example RAID 5 and LUN ID This is information you will use to bind the disks into LUNs For disk IDs use the form shown This form is enclosure_diskID where enclosure is the enclosure number the bottom one is 0 above it 1 and so on and diskID is the disk position left is 0 next is 1 and so on None of the disks 0_0 through 0_8 may be used as a hot spare Next complete as many of the Storage System sections as needed for all the Storage Groups in the SAN Copy the blank worksheet as needed for all Storage Groups in each storage system A storage system is any group of enclosures connected
93. s designated Storage Group Of the four servers connected to the SAN only the Admin server can send configuration commands to the storage system Highly available cluster ee Admin server Inventory server E mail server Web server Operating i Operating T lt Switch fabric Switch fabric Admin Storage Group Dedicated Data access by adapters 01 02 Inventory Storage Group Dedicated Data access by adapters 03 04 adapters 01and 02 Admin server only E mail and Web server Storage Group Shared Data access by adapters 05 06 07 08 Figure 1 11 Data and Configuration Access Control with Shared Storage EMC Fibre Channel Storage System Configuration Planning Configuation access by Storage System Hardware for Shared Storage For shared storage you need a Disk array Processor Enclosure DPE storage system A DPE is a 10 slot enclosure with hardware RAID features provided by one or two storage processors SPs For shared storage two SPs are required In addition to its own disks a DPE can support up to nine 10 slot Disk Array Enclosures DAEs for a total of 100 disks DAE DAE DAE Standby power supply SPS Figure 1 12 Storage System with a DPE and Three DAEs EMC1741 About Switched Shared Storage and SANs Storage Area Networks About Fibr
94. s platforms only 6 2 EMC Fibre Channel Storage System Configuration Planning Storage System Management Using Navisphere Manager Software Navisphere Manager software Manager lets you manage multiple storage systems connected to servers on a TCP IP network Manager offers extensive management features and includes comprehensive on line help Manager is required for shared storage and optional for unshared storage Manager runs on a management station which is a Windows NT or Windows 2000 host The servers connected to a storage system can run Windows or one of several UNIX operating systems With shared storage servers connected to the SAN can run different operating systems with direct unshared direct or shared or clustered storage servers connected to the same storage system must run the same operating system The following figures show Navisphere Manager in shared and unshared environments Using Navisphere Manager Software Storage System Management station and server File Server Management Operating system A Figure 6 1 Mail Server Management station and server Database Server Operating system A Operating Path 1 Path 2 Production Server Navisphere Navisphere P i o system B noe Tr Navisphere Navisphere Navisphere AA Agent Agent Agent Agen
95. s to LUNs If a storage system has two SPs there are two routes to its LUNs If the server has two adapters and the storage system has two SPs Application Transparent Failover ATF ATF can automatically switch to the other path without disrupting applications if a device such as a host bus adapter cable or SP fails Unshared Direct and Shared or Clustered Direct Storage This section explains the direct unswitched options available for connecting storage systems to servers As needs change you may want to change a configuration You can do so without changing your LUN configuration or losing user data There are two types of installation e Unshared direct with one server is the simplest and least costly e Shared or clustered direct lets two clustered servers share storage resources with high availability Sample Unshared Direct Installation Disk IDs SPA SPB Database Users 100 109 RAID 5 RAID 5 Path 1 Path 2 Sys Clients mail 019 013 RAID 1 RAID 5 Figure 4 1 Unshared Direct Installation EMC1825 EMC Fibre Channel Storage Systems Configuration Planning Guide The storage system disk IDs and LUNs are as follows The LUN capacities shown assume 36 Gbyte disks LUNs SP A and SP B 422 Gbytes Disk IDs RAID type storage type capacity 0_0 0_1 RAID 1 System disk 36 Gbytes 1_0 1_4 RAID 5 Database 144 Gbytes 15 0_2 0 9 RAID 5 8 disks Clients and M
96. size number of disks 2 Group RAID 0 Group disk size number of disks Individual unit disk size Planning Applications and LUNs ga Planning LUNs and File Systems with Unshared Direct Storage For example e A five disk RAID 5 or RAID 3 Group of 36 Gbyte disks holds 144 Gbytes e Aneight disk RAID 1 0 Group of 36 Gbyte disks also holds 144 Gbytes e A RAID 1 mirrored pair of 36 Gbyte disks holds 36 Gbytes and e An individual disk of a 36 Gbyte disk also holds 36 Gbytes Each disk in the RAID Group must have the same capacity otherwise you will waste disk storage space LUN Size Enter the user available capacity in gigabytes Gbytes of the LUN You can make this the same size as the RAID Group above Or for a RAID 5 RAID 1 RAID 1 0 or RAID 0 Group you can make the LUN smaller than the RAID Group You might do this if you wanted a RAID 5 Group with a large capacity and wanted to place many smaller capacity LUNs on it for example to specify a LUN for each user However having multiple LUNs per RAID Group may adversely impact performance If you want multiple LUNs per RAID Group then use a RAID Group LUN series of entries for each LUN Disk IDs Enter the ID s of all disks that will make up the LUN or hot spare These are the same disk IDs you specified on the previous worksheet For example for a RAID 5 Group in the DPE enclosure 0 disks 2 through 6 enter 0_2 0_3 0_4 0_5 and 0_6 SP Specify the
97. sk fails When you replace the failed disk the SP rebuilds the group using the information stored on the working disks Performance is degraded while the SP rebuilds the group However the storage system continues to function and gives users access to all data including data stored on the failed disk The following figure shows user and parity data with the default stripe element size of 128 sectors 65 536 bytes in a five disk RAID 5 Group The stripe size comprises all stripe elements Notice that the disk block addresses in the stripe proceed sequentially from the first disk to the second third and fourth then back to the first and so on EMC Fibre Channel Storage System Configuration Planning Stripe element size Stripe 2 size Figure 2 2 First disk 0 127 512 639 1024 11511536 1663 Parity 2048 2175 256 383 768 895 Parity i I I I I I I I I I 128 255 640 767 1152 1279 Parity O I I I i 1664 1791 2176 2303 I Hue O I User data Parity data EMC1815 RAID 5 Group RAID 5 Groups offer excellent read performance and good write performance Write performance benefits greatly from storage system caching RAID 3 Group Parallel Access Array A RAID 3 Group consists of five or more disks The hardware always reads from or writes to all the disks A RAID 3 Group uses disk striping To maintain the RAID 3 performance you can create only on
98. stems correctly EMC Fibre Channel Storage System Configuration Planning Guidexi xi Organization of the Manual Chapter 1 Provides background information on the Fibre Channel protocols and explains the major installation types Chapter 2 Describes the RAID Groups and the different ways they store data Chapter 3 Describes installations for shared switched storage Chapter 4 Describes installations for unshared direct and shared or clustered direct and shared switched storage Chapter 5 Describes hardware components Chapter 6 Describes storage system management utilities xii EMC Fibre Channel Storage System Configuration Planning Guide I About Fibre Channel Storage Systems and Networks SANs This chapter introduces Fibre Channel disk array storage systems and storage area networks SANs Major sections are e Introducing EMC Fibre Channel Storage Systems 1 2 e Fibre Channel Background er 1 3 e Fibre Channel Storage ComponentsS iii 1 4 e About Switched Shared Storage and SANs Storage Area NETWOLKS c ola 1 11 e About Unshared Storage i 1 16 About Fibre Channel Storage Systems and Networks SANS ait About Fibre Channel Storage Systems and Networks SANs Introducing EMC Fibre Channel Storage Systems EMC Fibre Channel disk array storage systems provide terabytes of disk storage capacit
99. t Hardware Data Sheets 5 15 Storage System Hardware iDAE Data Sheet Deskside 30 slot model Width cath Bn 30 in 20 6 in a You can use a rackmount or deskside DPE and DAE s for unshared storage The iDAE dimensions and requirements are shown in the following figure Dimensions and Requirements iDAE Deskside 10 slot model Rackmount model Width 25cm Depth 9 8 in 74 7em lt __ M 30 in Depth 63 3cm 17 5 in a A Tna ail Height e i 68 cm x Hy i ALI DI 26 8 in FSS Nt Height 77 SPS mounting tray eon height 4 44 cm 35U 1 75 in 1 U depth 69 9 cm 27 5 in Weight without packaging Deskside 30 Deskside 10 Rackmount Maximum max disks SPs Power requirements Voltage rating Current draw Power consumption 144 kg 316 Ib 60 kg 1321b 35 4 kg 78 Ib 100 V ac to 240 V ac 10 single phase 47 Hz to 63 Hz power supplies are auto ranging At 100 v ac input 30 slot 12 0 A 10 slot 4 0 A SPS 1 0 A max per unit during charge 30 slot 1200 10 slot 400 VA SPS 100 VA per unit during charge EMC Fibre Channel Storage Systems Configuration Planning Guide Power cables single or dual ac inlet connector Deskside power cord Operating environment Temperature Relative humidity Altitude Heat dissipation max Air flow Service clearanc
100. t ere Failover Failover Failover Failover software software software software Sample Shared Switched Environment with Navisphere Manager Accts Server Management station and server Development Server Management Database Server station and server Supervisor Navisphere Agent Figure 6 2 Navisphere Agent Operating Operating Operating system A system B system C LAN Navisphere Navisphere Supervisor Navisphere Agent UL Sample Unshared Environment with Navisphere Manager EMC Fibre Channel Storage System Configuration Planning Storage Management Worksheets This section includes two worksheets one for shared storage and one for unshared storage The following worksheet will help you plan your storage system management environment For each host complete a section For the shared storage worksheet complete the management station hostname and operating system then decide whether you want the Navisphere Analyzer and or Event Monitor and if so mark the appropriate boxes Then write the name of each managed server with operating system Storage Group and configuration access specification You can copy much of the needed information from the LUN and Storage Group planning worksheet in Chapter 3 or 4 Management Utility Worksheet Shared Storage Management station hostname Ope
101. te cache size __MB Cache page size ___ KB Use for RAID 3 LUN ID RAID Group ID ___Size GB ____ LUN size GB ____ Disk IDs SP DA OB RAID type RAID 5 RAID 3 Memory MB RAID 1 mirrored pair RAID 0 RAID 1 0 Individual disk Hot spare Caching DRead and write OWrite DRead None Servers that can access this LUN Operating system information Device name File system partition or drive LUN ID RAID Group ID ___Size GB ___ LUN size GB ____ Disk IDs SP DA OB RAID type RAID 5 RAID 3 Memory MB ___ RAID 1 mirrored pair RAID 0 ORAID 1 0 O Individual disk OHot spare Caching DRead and write Write Read None Servers that can access this LUN Operating system information Device name File system partition or drive LUN ID RAID Group ID ___ Size GB ____ LUN size GB ___ Disk IDs SP DA OB RAID type RAID 5 RAID 3 Memory MB ____ RAID 1 mirrored pair RAID 0 RAID 1 0 O Individual disk OHot spare Caching DRead and write Write DRead UNone Servers that can access this LUN Operating system information Device name File system partition or drive 4 10 EMC Fibre Channel Storage Systems Configuration Planning Guide LUN Details Worksheet
102. tion Planning Guide Storage System Hardware Disk array processor enclosure DPE Rackmount DPE one enclosure Deskside DPE with DAE supports up to 9 DAEs Intelligent disk array enclosure iDAE 30 slot deskside 10 slot deskside Rackmount Figure 5 5 Storage System Types for Unshared Storage Hardware for Unshared Storage Storage System Hardware The following figure shows some components of a deskside DPE Components for rackmount types are similar Front Back fans and cables omitted for clarity DAE link control ll card LCC FC ports DPE LCC DAE power supplies DPE power supplies SP fan cover covers SP A Front d bie a fan pack eee awdis m distribution DPE LCC SPS UNE DAE LCC Figure 5 6 DPE Components Deskside Model Disks The disks available in differing capacities fit into slots in the enclosure Each disk has a unique ID that you use when binding it or monitoring its operation The ID is the enclosure address always 0 for the DPE settable on a DAE and the disk slot number 5 8 EMC Fibre Channel Storage Systems Configuration Planning Guide Figure 5 7 Storage Processor SP 0 1 2 3 4 5 Gil 7 8 9 Disks and Disk IDs The SP provides the intel
103. tion worksheet On the following line write any pertinent notes for example the file system mount or graft point directory pathname from the root directory If this storage system s chassis will be shared with another server and the other server is the primary owner of this disk write secondary As mentioned earlier if the storage system will be used by two servers we suggest you complete one of these worksheets for each server What Next This chapter outlined the planning tasks for shared storage systems If you have completed the worksheets to your satisfaction you are ready to learn about the hardware needed for these systems as explained in Chapter 5 Planning Applications LUNs and Storage Groups 3 17 Planning File Systems and LUNs with Shared Switched Storage Eg EMC Fibre Channel Storage System Configuration Planning 4 Planning LUNs and File Systems with Unshared Direct Storage This chapter shows sample RAID and LUN configurations with direct storage installations and then provides worksheets for planning your own storage installation Topics are e Dual SPs and Paths to LUNS i 4 2 e Unshared Direct and Shared or Clustered Direct Storage 4 2 e Planning Applications and LUNS in 4 4 Planning LUNs and File Systems with Unshared Direct Storage at Planning LUNs and File Systems with Unshared Direct Storage Dual SPs and Path
104. torage Group number or name Config Access Config Access Config Access Config Access Config Access Config Access Config Access Config Access Storage Management Worksheets Storage System Management Storage System Management For unshared storage unshared direct or shared or clustered direct for each host choose a Navisphere product The host may be a management station that is not a server complete only the Manager section it may be a management station that is a server complete the Manager section and mark the Agent box or it may be a server mark the Agent box 6 6 EMC Fibre Channel Storage System Configuration Planning Storage System Management Management Utility Worksheet Unshared Storage Hostname Operating system Storage system type ODPE based iDAE based Software Navisphere Manager Agent O Navisphere Analyzer O Navisphere Event Monitor List all the servers this host will manage Each managed server must run an Agent of the same type as its operating system Server Oper sys Server Oper sys Server Oper sys Server Oper sys Server ____ Opersysi __ _ Server Oper sys Server Opersyss __ _ Server Oper sys Hostname Operating system Storage system type ODPE based IDAE based Software Navisphere Ma
105. ty good performance and efficient disk space usage are all of relatively equal importance RAID Benefits and Tradeoffs ga RAID Types and Tradeoffs RAID 5 Group 1st disk user and parity data 2nd disk user and parity data 3rd disk user and parity data 4th disk user and parity data 5th disk user and parity data Lil RAID 3 Group 1st disk user data 2nd disk user data 3rd disk user data Ath disk user data su 5th disk parity data J Disk Mirror RAID 1 mirrored pair 1st disk user data 50 user data gt O 2nd disk 50 redundant data user data Individual Disk Unit 80 user data 20 parity data 100 user data lt 50 user data 50 redundant data Hot Spare Figure 2 7 Disk Space Usage in the RAID Configurations RAID 0 Group nonredundant array ihk 1st disk user data 2nd disk user data 3rd disk user data RAID 1 0 Group 1st disk user data i 2nd disk user data 3rd disk user data Ath disk user data 5th disk user data 6th disk user data r RR A RAID 0 Group nonredundant individual access array provides all its disk space for user files but does not provide any high availability features A RAID 1 0 Group provides the best combination of performance and availability at the highest cost per Mbyte of disk space An individual unit like a RAID 0 Group provides no high availability features A
106. um length is 10 meters 33 ft So the distance between a DPE and the DAEs it controls cannot exceed 10 meters 33 ft The host bus adapters and SPs used with shared storage systems require optical cable as does the switch between adapters and SPs The SPs used with unshared storage systems support copper cables and with MIAs optical cables A hub itself supports copper or with a MIA optical So you can use a copper cable or with two MIAs per cable optical cable between any hub and SP For optical cable to work between an adapter and hub or SP then the adapter must support optical cable Server Server Maximum distance Copper cable 30 m Optical cable 500 m or more Jajdepy Maximum distance Copper cable 30 m C Storage system Storage system Figure 5 10 Comparison Between Optical and Copper Cabling Cable and Configuration Guidelines 5 21 Storage System Hardware You can use any existing FDDI multimode 62 5 micron cable with good connections to attach servers switches or hubs and storage systems These cables must be dedicated to storage system I O Table 5 3 Cable Sizes Optical Length Typical Use 5 m 16 5 ft or Within one room connecting servers to storage systems adapter 10 m 33 ft must support optical cable or connecting switches or hubs to storage systems 50 m 164 ft
107. units o i o E The nine pin port can connect to a server storage system or another hub o i o do o i o i o i o i Nine Port Hub If your servers and storage systems will be far apart you can place the hubs closer to the servers or the storage systems as convenient NE EMC Fibre Channel Storage System Configuration Planning Storage Component Storage Systems Storage Processors SPs and Other Hardware Figure 1 7 EMC disk array storage systems with their storage processors power supplies and cooling hardware form the storage component of a Fibre Channel system The controlling unit a Disk array Processor Enclosure DPE looks like the following figure Disk modules EMC1808 Disk Array Processor Enclosure DPE DPE hardware details appear in a later chapter Fibre Channel Storage Components About Fibre Channel Storage Systems and Networks SANs About Fibre Channel Storage Systems and Networks SANs Types of Storage System Installations You can use a storage systems in any of several types of installation e Unshared direct with one server is the simplest and least costly e Shared or clustered direct lets two clustered servers share storage resources with high availability FC4500 storage systems and e Shared switched with one or two switch fabrics lets two to 15 servers share the reso
108. uration Planning Guide 2 1 3 1 4 1 5 1 5 2 5 3 Tables Performance Availability and Cost of RAID Types Individual Unit L0 seesinane aa 2 13 Cache Recommendations for Different RAID Types 3 16 Cache Recommendations for Different RAID Types 4 15 High Availability Options Deskside Unshared Storage 5 13 High Availability Options Rackmount Unshared Storage 5 13 Cable Sizes Optical ica 5 22 Cable sizes Gopper ssi 5 23 EMC Fibre Channel Storage System Configuration Planning Guide i EMC Fibre Channel Storage System Configuration Planning Guide Preface This planning guide provides an overview of Fibre Channel disk array storage system models and offers essential background information and worksheets to help you with the installation and configuration planning Please read this guide e if you are considering purchase of an EMC Fibre Channel disk array storage system and want to understand its features or e before you plan the installation of a storage system Audience for the Manual You should be familiar with the host servers that will use the storage systems and with the operating systems of the servers After reading this guide you will be able to e determine the best storage system components for your installation e determine your site requirements e configure storage sy
109. urces of several storage systems in a Storage Area Network SAN Shared switched installations are available in a high availability HA version with two HBAs per server with two switches or with one HBA per server and one switch Unshared Direct Shared or Clustered Direct Shared Switched one or two servers two servers multiple servers Server Server Server Server Server Server Ja depy Ja depy 1 depy Je depy Jeidepy Ja depy Ja depy Ja depy Ja depy Switch fabric Path 1 Path 2 Disk array storage systems Figure 1 8 Types of Storage System Installation Storage systems for any shared installation require EMC Access Logix software to control server access to the storage system LUNs The Shared or clustered direct installation may be either shared that is use Access Logix to control LUN access or clustered without Access Logix using cluster software to control LUN access depending on the hardware model 1 10 EMC Fibre Channel Storage System Configuration Planning About Switched Shared Storage and SANs Storage Area Networks Figure 1 9 This section explains the features that let multiple servers share disk array storage systems on a SAN storage area network ASAN is a collection of storage devices connected to servers via Fibre Channel switches to provide
110. vn ess 3 2 Sample Shared Switched Installation tee eeeee 3 3 Planning Applications LUNs and Storage Groups 3 6 Application and LUN Planning eee seeeeeesseeeeeeeeees 3 6 Application and LUN Planning Worksheet 3 7 LUN and Storage Group Planning Worksheet 3 8 LUN Details Worksheet 3 11 Planning LUNs and File Systems with Unshared Direct Storage Dual SPs and Paths to LUNS 4 2 Unshared Direct and Shared or Clustered Direct Storage 4 2 Sample Unshared Direct Installation 4 2 Sample Shared or Clustered Direct Installation 4 3 Planning Applications and LUNS cccccescesestetsteteseseeteeseeeens 4 4 Application and LUN Planning 44 Application and LUN Planning Worksheet 4 5 LUN Planning Worksheet ssssssssosssesrereesseressoresveressersseroesseresss 4 6 Completing the LUN Details Worksheet 4 12 Storage System Hardware Hardware for Shared Storage iii 5 3 Storage Hardware Rackmount DPE Based Storage SYStemSsisrar gini ionici i 5 3 Disk 5 4 Storage Processor 5P iii iii 5 5 EMC Fibre Channel Storage Systems Configuration Planning Guide Hardware for Unshared Storage i 5 6 Types of Storage System for Unshared Storage
111. witch Zone If you do not define a zone in a switch all adapter ports connected to the switch can communicate with all SP ports connected to the switch However access to an SP does not necessarily provide access to the SP s storage access to storage is governed by the Storage Groups you create defined later Fibre Channel switches are available with 16 or 8 ports They are compact units that fit in 2 U 3 5 inches for the 16 port or 1 U 1 75 inches for the 8 port They are available to fit into a rackmount cabinet or as small deskside enclosures EMC1807 Figure 1 5 16 Port Switch Back View Fibre Channel Storage Components 1 7 About Fibre Channel Storage Systems and Networks SANs Fibre Channel Hubs Figure 1 6 If your servers and storage systems will be far apart you can place the switches closer to the servers or the storage systems as convenient A switch is technically a repeater not a node in a Fibre Channel loop However it is bound by the same cabling distance rules as a node A hub connects all the nodes cabled to it into a single logical loop A hub adds serviceability and scalability to any loop it allows on line insertion and removal of any device on the loop and maintains loop integrity if any connected device stops participating Fibre channel hubs are compact units that fit in 1 U 1 75 inches of storage space They are available to fit into a rackmount cabinet or as small deskside
112. y high transfer rates flexible configurations and highly available data at low cost A storage system package includes a host bus adapter driver package with hardware and software to connect with a server storage management software Fibre Channel interconnect hardware and one or more storage systems gt I ll Figure 1 1 Storage System Models NE EMC Fibre Channel Storage System Configuration Planning About Fibre Channel Storage Systems and Networks SANs Fibre Channel Background Fibre Channel is a high performance serial protocol that allows transmission of both network and I O channel data It is a low level protocol independent of data types and supports such formats as SCSI and IP The Fibre Channel standard supports several physical topologies including switched fabric point to point and arbitrated loop FC AL The topologies used by the Fibre Channel storage systems described in this manual are switched fabric and FC AL A switch fabric is a set of point to point connections between nodes the connection being made through one or more Fibre Channel switches Each node may have its own unique address but the path between nodes is governed by a switch The nodes are connected by optical cable A Fibre Channel arbitrated loop is a circuit consisting of nodes Each node has a unique address called a Fibre Channel arbitrated loop address The nod
113. you need to restrict access by establishing SP ownership of LUNs when you bind them Operating system information Device name Enter the operating system device name if this is important and if you know it Depending on your operating system you may not be able to complete this field now File system partition or drive Write the name of the file system partition or drive letter you will create on this LUN This is the same name you wrote on the application worksheet On the following line write any pertinent notes for example the file system mount or graft point directory pathname from the root directory If this storage system s chassis will be shared with another server and the other server is the primary owner of this disk write secondary If the storage system will be used by two servers we suggest you complete one of these worksheets for each server This chapter outlined the planning tasks for unshared storage systems If you have completed the worksheets to your satisfaction you are ready to learn about the hardware needed for these systems as explained in Chapter 5 Planning Applications and LUNs Planning LUNs and File Systems with Unshared Direct Storage ga EMC Fibre Channel Storage Systems Configuration Planning Guide 5 Storage System Hardware This chapter describes the storage system hardware components Topics are e Hardware for Shared Storage iii 5 3 e
114. ypes 5 11 RAID types 2 12 U unshared direct installation defined 1 10 disk structure example 4 2 unshared storage disk structure example 4 2 hardware 1 16 hardware planning worksheets 5 27 installation types 4 2 V vault disks 2 10 volume name 3 17 W weight DAE only storage systems 5 18 DPE storage system 5 14 iDAE storage system 5 16 storage system installation 5 20 worksheet application 3 6 completing 3 6 component planning unshared storage 5 29 LUN 3 13 4 10 4 11 4 12 worksheets component planning shared storage 5 24 unshared storage 5 27 storage management 6 5 EMC Fibre Channel Storage Systems Configuration Planning Guide i EMC Fibre Channel Storage Systems Configuration Planning Guide

EMC FC5300 User's Manual

Contents

Download Pdf Manuals

Related Search

Related Contents