Home

LSI MegaRAID SCSI 320-2 RAID Controller Series 518 User's Manual

1. Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number 5 6 Configuring Physical Drives Arrays and Logical Drives Copyright 2002 by LSI Logic Corporation All rights reserved Table 5 3 Physical Device Layout Cont Channel 0 Channel 1 Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Configuring SCSI Physical Drives 5 7 Copyright 2002 by LSI Logic Corporation All rights reserved Table 5 3 Physical Device Layout Cont Channel 0 Channel 1 Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number
2. Maximize hard drive performance and throughput Number of hot spares Amount of cache memory installed on MegaRAID SCSI 320 1 Are all of the disk drives and the server protected by an uninterruptible power supply 5 5 1 Using the Array Configuration Planner Table 5 9 lists the possible RAID levels fault tolerance and effective capacity for all possible drive configurations for an array consisting of one to eight drives This table does not take into account any hot spare standby drives You should always have a hot spare drive in case of drive failure RAID 1 requires two drives RAID 10 at least four and RAID 50 at least six 5 14 Configuring Physical Drives Arrays and Logical Drives Copyright 2002 by LSI Logic Corporation All rights reserved Use Table 5 9 to plan the array configuration Table 5 9 Array Configuration Planner Possible Relative Fault Effective of Drives RAID Levels Performance Tolerance Capacity 1 RAID 0 Excellent No 100 RAID 0 Excellent 100 RAID 0 Excellent W mM N wo RAID 5 Good RAID 0 Excellent RAID 5 Good RAID 10 Excellent RAID 0 Excellent 4 4 4 5 5 RAID 5 Good o gt RAID 0 Excellent RAID 5 Good RAID 10 Excellent RAID 50 Good RAID 0 Excellent NIN O OO Q RAID 5 Good RAID 0 Excellent RAID 5 Good RAID 10 Excellent ao oy oO o RAID 50 Good Planning the Array Configuratio
3. Bus Based The array controller resides on the bus for example a PCI or EISA bus in the host computer and has its own CPU to generate parity and handle other RAID functions A bus based controller can transfer data at the speed of the host bus but is limited to the bus it is designed for MegaRAID SCSI 320 2 resides on a PCI bus which can handle data transfer at up to 132 Mbytes s With MegaRAID SCSI 320 2 the channel can handle data transfer rates up to 320 Mbytes s per SCSI channel 2 3 15 Enclosure Management Enclosure management is the intelligent monitoring of the disk subsystem by software and or hardware The disk subsystem can be part of the host computer or can be separate from it Enclosure management helps you stay informed of events in the disk subsystem such as a drive or power supply failure Enclosure management increases the fault tolerance of the disk subsystem RAID Overview 2 11 Copyright 2002 by LSI Logic Corporation All rights reserved 2 12 Introduction to RAID Copyright 2002 by LSI Logic Corporation All rights reserved Chapter 3 RAID Levels This chapter describes each supported RAID level and the factors to consider when choosing a RAID level It contains the following sections e Section 3 1 Selecting a RAID Level e Section 3 2 RAID 0 e Section 3 3 RAID 1 e Section 3 4 RAID 5 e Section 3 5 RAID 10 e Section 3 6 RAID 50 3 1 Selecting
4. Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Configuring Physical Drives Arrays and Logical Drives Copyright 2002 by LSI Logic Corporation All rights reserved Table 5 3 Physical Device Layout Cont Channel 0 Channel 1 Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level 5 2 Configuring Arrays Connect the physical drives to the MegaRAID SCSI 320 2 configure the drives then initialize them The number of physical disk drives that an array can support depends on the firmware version For the MegaRAID SCSI 320 2 an array can consist of up to 30 physical disk drives depending on the RAID level see Chapter 3 for more information This controller supports up to 40 logical drives per controller The number of drives in an array determines the RAID levels that can be supported 5 2 1 Arranging Arrays You must arrange the arrays to provide additional organization for the drive array You must arrange arrays so that you can create system drives that can function as boot devices
5. 2002 by LSI Logic Corporation All rights reserved Ground A 9 Table A 4 68 Pin Connector Pinout for LVD SCSI Cont Connector Cable Cable Connector Pin Pin Pin Note The connector pin in the table refers to the conductor position when using flat ribbon cable SCSI Cables and Connectors Copyright 2002 by LSI Logic Corporation All rights reserved Appendix B Audible Warnings The MegaRAID SCSI 320 1 RAID controller has an onboard tone generator that indicates events and errors Note This is available only if the optional series 502 Battery Backup Unit BBU is installed Table B 1 Tone Pattern Three seconds on and one second off Meaning A logical drive is offline Audible Warnings and Descriptions Examples One or more drives in a RAID 0 configuration failed Two or more drives in a RAID 1 or 5 configuration failed One second on and one second off A logical drive is run ning in degraded mode One drive in a RAID 5 configura tion failed One second on and three seconds off An automatically initi ated rebuild has been completed MegaRAID SCSI 320 2 Hardware Guide Copyright 2002 by LSI Logic Corporation All rights reserved While you were away from the system a disk drive in a RAID 1 or 5 configuration failed and was rebuilt B 1 B 2 Audible Warnings Copyright 2002
6. Drives 6 to 30 The initiator takes one ID per channel This leaves 15 IDs available for each channel Figure 3 5 shows a RAID 50 array with six disk drives Figure 3 5 RAID 50 Array MegaRAID Controller Data Flow 1 Segment 1 Segment 2 Parity 1 2 1 Segment 3 Segment 4 Parity 3 4 ly 1 Segment 6 Parity 5 6 Segment 5 1 Segment 8 Parity 7 8 Segment 7 i l i i Parity 9 10 Segment 9 Segment 10 i Parity 11 12 Segment 11 Segment 12 l i J 7 Proc cc cc ecco ee ee ee er ee eH eee Ht Se HH eH ee ee ee ee eee ee eee eee I RAID 0 l le aa T el dee passe aa oe aaa ects Hemet ete a aa aay sel haa da aaa lacy ca aa ims Zama veto eat fea Aan acl saat eS has ales ASS a aa Mem bs each a a Aa aa S a hey wes Pa ca cee 7 3 8 RAID Levels Copyright 2002 by LSI Logic Corporation All rights reserved Chapter 4 Features This chapter explains the features of the MegaRAID SCSI 320 2 It contains the following sections e Section 4 1 SMART Technology e Section 4 2 Configuration on Disk e Section 4 3 Configuration Features e Section 4 4 Array Performance Features e Section 4 5 RAID Management Features e Section 4 6 Fault Tolerance Features e Section 4 7 Software Utilities e Section 4 8 Operating System Software Drivers e Section 4 9 MegaRAID SCSI 320 2 Specifications e Section 4 10 MegaRAID Components e Section 4 11 RAID Management e Sect
7. Figure 6 4 Terminating External Disk Arrays External SCSI Drives Termination Enabled 6 2 5 4 Terminating Internal and External Disk Arrays You can use both internal and external drives with the MegaRAID SCSI 320 2 You still must make sure that the proper SCSI termination and termination power is preserved as shown in Figure 6 5 6 10 Hardware Installation Copyright 2002 by LSI Logic Corporation All rights reserved Figure 6 5 Terminating Internal and External Disk Arrays N Host Computer l l External SCSI Drives i D1 No Termination l IDO IDO Boot Drive i ID 1 No Termination i ID2 ID3 i l ID 4 ID5 ID 6 i i l Note Termination enabled from i 1 last SCSI drive i i l l MegaRAID 320 2 1 l J Installation Steps 6 11 Copyright 2002 by LSI Logic Corporation All rights reserved 6 2 5 5 Connecting Non Disk SCSI Devices SCSI tape drives and SCSI CD ROM drives must each have a unique SCSI ID regardless of the SCSI channel they are attached to The general rule for Unix systems is e Tape drive set to SCSI ID 2 e CD ROM drive set to SCSI ID 5 Make sure that no hard drives are attached to the same SCSI Channel as the non disk SCSI devices Drive performance will be significantly degraded if SCSI hard disk drives are attached to this channel Figure 6 6 Connecting N
8. features Feature FlexRAID RAID level migration on the fly FlexRAID online capacity expansion Remote configuration and management over the Internet Graphical user interface Diagnostic utility Management utility Bootup configuration using MegaRAID Manager Online read write and cache policy switching 4 6 Features Copyright 2002 by LSI Logic Corporation All rights reserved 4 8 Operating System Software Drivers MegaRAID SCSI 320 2 includes a DOS software configuration utility and drivers for Windows NT 4 0 Windows 2000 Windows NET Windows XP Novell NetWare 5 1 6 0 Red Hat Linux 7 2 7 3 DOS version 6 xx or later The DOS drivers for MegaRAID are contained in the firmware on the MegaRAID controller except for the DOS ASPI and CD drivers Call your LSI OEM support representative or access the web site at www lsilogic com for information about drivers for other operating systems 4 9 MegaRAID SCSI 320 2 Specifications Table 4 6 lists the specifications for the SCSI 320 2 Table 4 6 MegaRAID SCSI 320 2 Specifications Parameter Specification Card size 6 875 x 4 2 half length PCl Processor Intel 80303 100 MHz SCSI processor One LSI Logic 53C1030 SCSI controller Bus type PCI 2 2 Bus data transfer rate Up to 266 Mbytes s Cache configuration 64 or 128Mbyte DIMM Firmware 1 MB 8 flash ROM Operating System Software Drivers
9. 2002 by LSI Logic Corporation All rights reserved 5 Repeat step 1 step 4 to install the device driver on the second system After the cluster is installed and both nodes are in the Microsoft Windows 2000 Advanced Server installation will detect a SCSI processor device 6 On the Found New Hardware Wizard prompt choose to display a list of the known drivers so that you can select a specific driver 7 Click on Next 8 Select the driver that you want to install for the device If you have a disk with the driver you want to install click on Have Disk 9 Select Other devices from the list of hardware types then click on Next 10 Insert the disk containing the driver into the selected drive and click on OK 11 Select the processor device and click on Next 12 On the final screen click on Finish to complete the installation 13 Repeat the process on the peer system 7 3 2 Network Requirements The network requirements for clustering are e A unique NetBIOS cluster name e Five unique static IP addresses Two addresses are for the network adapters on the internal network Two addresses are for the network adapters on the external network One address is for the cluster itself e A domain user account for Cluster Service all nodes must be part of the same domain e Two network adapters for each node one for connection to the external network and the other for the node to node internal clus
10. You can sequentially arrange arrays with an identical number of drives so that the drives in the group are spanned Spanned drives can be treated as one large drive Data can be striped across multiple arrays as one logical drive You can create spanned drives by using the MegaRAID Configuration Utility or the MegaRAID Manager See the MegaRAID Configuration Software Guide for additional information Configuring Arrays 5 9 Copyright 2002 by LSI Logic Corporation All rights reserved 5 2 2 Creating Hot Spares Any drive that is present formatted and initialized but is not included in a array or logical drive is automatically designated as a hot spare You can also designate drives as hot spares using the MegaRAID BIOS Configuration Utility the MegaRAID Manager or Power Console Plus See the MegaRAID Configuration Software Guide for additional information 5 3 Creating Logical Drives 5 3 1 5 3 1 1 5 10 Logical drives are arrays or spanned arrays that are presented to the operating system You must create one or more logical drives The logical drive capacity can include all or any portion of an array The logical drive capacity can also be larger than an array by using spanning The MegaRAID SCSI 320 2 supports up to 40 logical drives Configuration Strategies The most important factors in RAID array configuration are drive capacity drive availability fault tolerance and drive performance You cannot configu
11. disks called an array to improve performance and reliability A RAID disk subsystem improves I O performance on a server using only a single drive The RAID array appears to the host server as a single storage unit I O is expedited because several disks can be accessed simultaneously A style of redundancy applied to a logical drive It can increase the performance of the logical drive and can decrease usable capacity Each logical drive must have a RAID level assigned to it The RAID level drive requirements are RAID 0 requires one or more physical drives RAID 1 requires exactly two physical drives RAID 5 requires at least three physical drives RAID levels 10 and 50 result when logical drives span arrays RAID 10 results when a RAID 1 logical drive spans arrays RAID 50 results when a RAID 5 logical drive spans arrays RAID migration is used to move between optimal RAID levels or to change from a degraded redundant logical drive to an optimal RAID 0 In Novell the utility used for RAID migration is MEGAMGR in Windows NT it is Power Console Plus If a RAID 1 array is being converted to a RAID 0 array instead of performing RAID migration one drive can be removed and the other reconfigured on the controller as a RAID 0 This is due to the same data being written to each drive A memory caching capability in some adapters that allows them to read sequentially ahead of requested data and store the additional data in cache memory anticipa
12. 3 Ground High Density 68 Pin Connector Pinout SE SCSI Connector Pin e Cable Pin Cable Connector Pin DB 12 Ground DB 13 Ground DB 14 Ground DB 15 Ground DB P1 Ground DB 0 Ground DB 1 Ground DB 2 Ground oO OC NI OD a A I wy PY DB 3 Ground i oO DB 4 Ground k DB 5 Ground 4 N DB 6 Ground 4 wo DB 7 Ground e A DB P Ground oa SWAP L Ground SHELF_OK TERMPWR TERMPWR TERMPWR TERMPWR Reserved Reserved Ground FAULT_CLK H Ground High Density 68 Pin Connector Pinout for SE SCSI Copyright 2002 by LSI Logic Corporation All rights reserved ATN A 7 Table A 3 High Density 68 Pin Connector Pinout SE SCSI Connector Cable Cable Connector Pin Pin Pin Ground FAULT_DATA H Ground BSY Ground ACK Ground RST Ground MSG Ground SEL Ground C D Ground REQ Ground I O Ground DB 8 Ground DB 9 Ground DB 10 Ground DB 11 The following applies to the high density SCSI connector described in Table A 3 e A hyphen before a signal name indicates that signal is active low e The connector pin refers to the conductor position when using 0 025 inch centerline flat ribbon cable with a high den
13. 320 2 Hardware Guide The Hardware Guide contains the RAID overview RAID planning and RAID system configuration information you need first Read this document first 1 7 2 MegaRAID Configuration Software Guide This manual describes the software configuration utilities that you can use to configure and modify RAID systems e MegaRAID BIOS Configuration Utility e WebBIOS Configuration Utility e MegaRAID Manager e Power Console Plus 1 7 3 MegaRAID Operating System Driver Installation Guide This manual provides detailed information about installing the MegaRAID SCSI 320 2 operating system drivers 1 4 Overview Copyright 2002 by LSI Logic Corporation All rights reserved Chapter 2 Introduction to RAID This chapter introduces important RAID concepts It contains the following sections e Section 2 1 RAID Benefits e Section 2 2 MegaRAID SCSI 320 2 Host Based RAID Solution e Section 2 3 RAID Overview RAID Redundant Array of Independent Disks is a data storage method in which data along with parity information is distributed among two or more hard disks called an array to improve performance and reliability The RAID array appears to the host computer as a single storage unit or as multiple logical units I O is expedited because several disks can be accessed simultaneously RAID systems provide improved data storage reliability and fault tolerance compared to single drive computers If a disk d
14. 6 Disk Mirroring MegaRAID SCSI 320 2 Hardware Guide Copyright 2002 by LSI Logic Corporation All rights reserved E 12 12 1 2 1 2 1 3 1 3 1 4 1 4 2 1 2 1 2z ore 2 2 2 3 2 3 2 3 2 3 2 4 2 4 2 4 2 6 XV Chapter 3 RAID Levels Chapter 4 Features Xvi 28 7 Disk Spanning 2 3 8 Parity 2 3 9 Hot Spares 2 3 10 Hot Swapping 2 3 11 Disk Rebuild 2 3 12 Logical Drive States 2 3 13 SCSI Drive States 2 3 14 Disk Array Types 2 3 15 Enclosure Management 3 1 Selecting a RAID Level 3 2 RAIDO 3 3 RAID 1 3 4 RAID 5 3 5 RAID 10 3 6 RAID 50 4 1 SMART Technology 4 2 Configuration on Disk 4 3 Configuration Features 4 4 Array Performance Features 4 5 RAID Management Features 4 6 Fault Tolerance Features 4 7 Software Utilities 4 8 Operating System Software Drivers 4 9 MegaRAID SCSI 320 2 Specifications 4 10 MegaRAID Components 4 10 1 CPU 4 10 2 Cache Memory 4 10 3 MegaRAID BIOS 4 10 4 Onboard Speaker 4 10 5 Serial Port 4 10 6 SCSI Bus Contents Copyright 2002 by LSI Logic Corporation All rights reserved ae 2 8 2 8 29 2 9 2 10 2 10 2 11 211 3 1 3 2 3 3 3 4 3 6 3 7 4 3 4 3 4 5 4 5 4 6 4 6 4 7 4 7 4 8 4 8 4 9 4 9 4 9 4 10 4 12 Chapter 5 4 10 7 SCSI Connectors 4 10 8 SCSI Termination 4 10 9 SCSI Firmware RAID Management 4 11 1 MegaRAID BIOS Configuration Utility 4 11 2 WebBIOS Configuration Utility 4 11 3 Power Console Plus 4 11 4 MegaRA
15. C 2 Disk striping 2 4 C 2 Disk subsystem C 3 Disposing of a Battery Pack 6 15 Documentation 1 3 DOS 4 7 Double buffering C 3 Drive roaming 4 3 Drivers 6 21 E Enclosure management 2 11 F Fail 2 10 Failed 2 10 Failed drive C 3 Fast SCSI C 3 Fault tolerance 2 4 Fault tolerance features 4 6 Features 4 1 Firmware 4 7 C 3 Flash ROM 1 2 FlexRAID Power Fail option C 3 Format C 3 G GB C 3 Glossary C 1 GWC A 6 H Hardware Installation 6 1 High density 68 pin SCSI connector pinout A 7 High density single ended connector A 8 Host computer C 4 Host based array C 3 Host based RAID solution 2 2 Hot spare 2 8 2 10 C 4 Using during disk rebuild 2 9 Hot swap 2 9 C 4 VO driver C 4 Initialization C 4 Install Cache Memory 6 4 Install Drivers 6 21 Installation steps Custom 6 2 IX 2 Index J J10 External Battery 6 7 Jumpers Setting 6 5 L Linux Red Hat 4 7 Logical disk C 4 Logical drive 2 3 C 4 Logical drive states 2 10 Mapping C 4 MB C 5 MegaRAID BIOS 4 9 MegaRAID BIOS Configuration Utility 4 11 MegaRAID Manager 4 12 6 15 MegaRAID SCSI 320 1 card Installing 6 16 MegaRAID SCSI 320 1 card layout 6 5 MegaRAID Specifications Bus Data Transfer Rate 4 7 Bus Type 4 7 Cache Configuration 4 7 Card Size 4 7 Devices per SCSI Channel 4 8 Firmware 4 7 Nonvolatile RAM 4 8 Operating Voltage 4 8 Processor 4 7 RAID Levels Supported 4 8 SCSI Bus 4 8 SCSI cables 4 8 SCSI Connectors 4 8 SCSI Co
16. Position IDC o o 63 48 Receptacle Female 30 e 49 AMP 499252 4 1 746285 0 0 1 746288 0 Table 1 Connector Contact Connection for Wide to Non Wide Conversion Wire Twisted Pair Flat Cable or Laminated Discrete Wire Cable 25 Pair 0 050 Centerline 28 AWG A 4 SCSI Cables and Connectors Copyright 2002 by LSI Logic Corporation All rights reserved A 1 4 Converting Internal Wide to Internal Non Wide Type 30 The cable assembly for converting internal Wide SCSI connectors to internal non Wide Type 30 SCSI connectors is shown below Pin 1 Connector A 68 Position Plug Male AMP 749925 5 A opoo000r 0c C 0 Cc OC 0E2 C C O O0CC O O0C O CCOC 0r0O0000 OooogogogogooooooOoooo0o0o000000o0o00o0o00o0o00000 PERE REEE EERE EERE COUP CUCUEEUEU EE CLt MAAA SEESE EEEEEEEELESSSI AAAA SEESE EEEEEEEESESESI SEESE yuan nya vanna PEEUTET TATE TEAL Connector B 50 Position Plug Male AMP 749925 3 TEEEELTTL ETAT PEECET EEA TTT TELE a PETTITT ELITE PEELED E ETAT TEU PETETTET TTT EATIT TLE PETE E LETTE Pin 1 AAAA AAAAAAAAAAAAAAAAA A DoooogogooooooooooooooooooO Oooooogoooooo0oo0o00000000000 Wire Twisted Pair Flat Cable or Laminated Discrete Wire Cable 25 Pair 0 050 Centerline 28 AWG A 1 5 Converting from Internal Wide to Internal Non Wide Type 3 The cable assembly for
17. SCSI 320 2 has an onboard tone generator for audible warnings when system errors occur Audible warnings can be generated through this speaker The audible warnings are listed in Appendix B 4 10 5 Serial Port The MegaRAID SCSI 320 2 has a 3 pin RS232C compatible serial port connector which is used for test purposes only MegaRAID Components 4 9 Copyright 2002 by LSI Logic Corporation All rights reserved 4 10 6 SCSI Bus The MegaRAID SCSI 320 2 controller has two Ultra320 Wide SCSI channels that support low voltage differential SCSI devices with active termination Both synchronous and asynchronous devices are supported The MegaRAID controller provides automatic termination disable via cable detection Each channel supports up to 15 wide or seven non wide SCSI devices at speeds up to 320 Mbytes s per SCSI channel The MegaRAID controller supports up to six non disk devices per controller The SCSI bus mode defaults to LVD for each SCSI channel If a single ended device is attached to a SCSI channel the MegaRAID controller automatically switches to SE mode for that SCSI channel 4 10 7 SCSI Connectors The MegaRAID SCSI 320 2 has two types of SCSI connectors e Two 68 pin high density internal connectors e Two 68 pin very high density external connectors 4 10 8 SCSI Termination The MegaRAID SCSI 320 2 uses active termination on the SCSI bus conforming to Alternative 2 of the SCSI 2 specifications Termination enable di
18. The cable assemblies that interface with the 68 pin connector are e Flat ribbon or twisted pair cable for connecting internal Wide SCSI devices e Round shielded cable for connecting external Wide SCSI devices MegaRAID SCSI 320 2 Hardware Guide A 1 Copyright 2002 by LSI Logic Corporation All rights reserved A 1 1 Cable Assembly for Internal Wide SCSI Devices The cable assembly for connecting internal Wide SCSI devices is shown below Pin 1 oonooooooonoonooooooonooooooonoooo Connectors 68 Position Plug Male ooooooooonoooooooooononononoononnonn AMP 786090 7 AAAA THO OMOU PLO ei Piven iD a twain Ab Cable Flat Ribbon or Twisted Pair Mii Aeir MMT TOTO MeN ROR Flat Cable ema 68 Conductor 0 025 Centerline Rta ER ee 30 AWG oOoo0gogogogoooOoooOooOoOooooo0o000000o00o0000 gooo0gogogogoooOoooOooOoOoooo0o0o000000o000o000o0 OQooogooooooOo0o0o0000000000000000o000000 ooo00g00g go ooOooOoOooOooooo0o0000000oo000000 SCSI Cables and Connectors Copyright 2002 by LSI Logic Corporation All rights reserved A 1 2 Connecting Internal and External Wide Devices The cable assembly for connecting internal Wide and external Wide SCSI devices is shown below A O ciccccccccteccneeereneentecnnenens Ping fe Connector A 68 Position Panel Pruneeccenieritcrvereeceeviiirisriereeaei iii Mount Receptacle with 4 40 Holes E aA AEA Meo MNEs oa Wi Lime homie cued bob Female a AMP 786096 7 nt E N
19. a RAID Level To ensure the best performance you should select the optimal RAID level when you create a system drive The optimal RAID level for your disk array depends on a number of factors e The number of drives in the disk array e The capacity of the drives in the array e The need for data redundancy e The disk performance requirements MegaRAID SCSI 320 2 Hardware Guide 3 1 Copyright 2002 by LSI Logic Corporation All rights reserved 3 2 RAID 0 3 2 RAID 0 provides disk striping across all drives in the RAID subsystem RAID 0 does not provide any data redundancy but does offer the best performance of any RAID level RAID 0 breaks up data into smaller blocks and then writes a block to each drive in the array The size of each block is determined by the stripe size parameter set during the creation of the RAID set RAID 0 offers high bandwidth By breaking up a large file into smaller blocks MegaRAID SCSI 320 2 can use several drives to read or write the file faster RAID 0 involves no parity calculations to complicate the write operation This makes RAID 0 ideal for applications that require high bandwidth but do not require fault tolerance RAID 0 provides high data throughput especially for large files Suitable for any environment that does not require fault tolerance Strong Points Provides increased data throughput for large files No capacity loss penalty for parity Weak Points Does not provide fa
20. battery pack with mounting brackets You install the battery pack by attaching it to the controller board through the backside of the board using the three holes in the board Then connect the three wires from the battery pack to J10 the external battery connector the black wire connects to pin 1 Figure 6 7 shows an installed battery pack upper right corner Installation Steps 6 13 Copyright 2002 by LSI Logic Corporation All rights reserved Figure 6 7 MegaRAID Controller with Backup Battery Module 6 2 7 1 Configuring the Battery Pack After you install the MegaRAID controller you must configure the battery pack in the BIOS Configuration Utility To do this you select the Objects menu then select Battery Backup Table 6 6 explains the battery backup menu options Table 6 6 Backup Battery Menu Options Menu Item Explanation Battery Pack PRESENT appears if the battery pack is properly installed ABSENT if it is not Temperature GOOD appears if the temperature is within the normal range HIGH appears if the module is too hot Voltage GOOD appears if the voltage is within the normal range BAD appears if the voltage is out of range Fast Charging COMPLETED appears if the fast charge cycle is done CHARGING appears if the battery pack is charging No of Cycles Must be configured when you first install a battery pack When you select this option a small pop up window appears asking if you want to r
21. cables that interconnect the MegaRAID SCSI 320 2 to external SCSI devices 6 2 Installation Steps The MegaRAID SCSI 320 2 provides extensive customization options If you need only basic MegaRAID SCSI 320 2 features and your computer does not use other adapter cards with resource settings that may conflict with MegaRAID SCSI 320 2 settings even custom installation can be quick and easy Table 6 1 lists the hardware installation steps Each step is described in detail in the following pages Table 6 1 Hardware Installation Steps Action Additional Information Unpack the MegaRAID controller and If damaged call your LSI inspect for damage Make sure all items Logic OEM support are in the package representative Turn the computer off and remove the power cord and remove the cover Install cache memory on the MegaRAID 32 Mbytes minimum cache card memory is required Check the jumper settings on the See page 6 5 for the MegaRAID SCSI 320 2 controller MegaRAID SCSI 320 2 jumper settings e Ser scsi pve 7 8 9 Connect the battery harness Optional Install the MegaRAID SCSI 320 2 card Connect the SCSI cables to SCSI devices 10 Set the target IDs for the SCSI devices 6 2 Hardware Installation Copyright 2002 by LSI Logic Corporation All rights reserved Table 6 1 Hardware Installation Steps Cont EA Action Additional Information Replace the computer cover and turn the Be
22. can use private networks for cluster status signals and cluster management This provides more security than using a public network for these roles In addition you can use a public network for cluster management or you can use a mixed network for both private and public communications In any case verify that at least two networks are used for cluster communication using a single network for node to node communication creates a potential single point of failure We recommend that you use multiple networks with at least one network configured as a private link between nodes and other connections through a public network If you use more than one private network make sure that each uses a different subnet as Cluster Service recognizes only one network interface per subnet This document assumes that only two networks are in use It describes how you can configure these networks as one mixed and one private network Cluster Installation 7 19 Copyright 2002 by LSI Logic Corporation All rights reserved The order in which the Cluster Service Configuration Wizard presents these networks can vary In this example the public network is presented first Follow these steps to configure the clustered disks 1 The Add or Remove Managed Disks dialog box specifies disks on the shared SCSI bus that will be used by Cluster Service Add or remove disks as necessary then click on Next Cluster Service Configuration Wizard Add or Remo
23. controller in the computer Follow the instructions in this chapter 9 Replace the computer cover and turn the computer power on 6 2 3 2 Recommended Memory Vendors Call LSI Logic Technical Support at 678 728 1250 for a current list of recommended memory vendors 6 2 4 Step 4 Check Jumper Settings Make sure the jumper settings on the MegaRAID SCSI 320 2 card are correct The jumpers are set at the factory and you probably do not need to change them Table 6 2 lists the jumpers that you should check Table 6 2 Jumpers for the MegaRAID SCSI 320 2 tem Description Type SCSI activity LED connector 4 pin header Write pending indicator 2 pin header SCSI Termination Enable Channel 0 3 pin header SCSI Termination Enable Channel 1 3 pin header Battery connector 3 pin header J16 BIOS Enable 2 pin header J17 Termination Power Channel 0 2 pin header J18 Termination Power Channel 1 2 pin header Figure 6 2 shows the location of these items on the MegaRAID SCSI 320 2 controller Installation Steps 6 5 Copyright 2002 by LSI Logic Corporation All rights reserved Figure 6 2 MegaRAID SCSI 320 2 Controller Layout J4 J5 Internal High Densit SCSI Connectors y J2 e J3 e Channel 0 Channel 1 DIMM Socket External Very High Density C SCSI Connectors L Channel 1 6 2 4 1 J2 SCSI Activity LED J2 is a four pin connector that attaches to a c
24. converting internal Wide SCSI connectors to internal non Wide Type 3 SCSI connectors is shown below Pin 1 A o0o00000000000000000000000000000000 0000000000000000000000000000000000 ee Connector A 68 Position Plug Male AMP 786090 7 mannanna Connector B 50 Position Plug Male Pind PE aint canine nein AMP 786090 7 Wire Flat Ribbon or Twisted Pair Flat OoOoooooooooo0ooo0o0000000000 a Cable 50 Conductor 0 025 Centerline 30 AWG 68 Pin High Density SCSI Internal Connector Copyright 2002 by LSI Logic Corporation All rights reserved A 2 SCSI Cable and Connector Vendors Table A 1 lists SCSI cable vendors and contact information Table A 1 SCSI Cable Vendors Manufacturer Cables To Go Telephone Number Voice 800 826 7904 Fax 800 331 2841 System Connection Voice 800 877 1985 Technical Cable Concepts Voice 714 835 1081 GWC Voice 800 659 1599 Table A 2 table lists SCSI connector vendors Table A 2 SCSI Connector Vendors Manufacturer AMP Connector Part Number 749111 4 Back Shell Part Number 749193 1 Fujitsu FCN 237R050 G F FCN 230C050 D E Honda PCS XE50MA A 6 SCSI Cables and Connectors Copyright 2002 by LSI Logic Corporation All rights reserved PCS E50LA A 3 High Density 68 Pin Connector Pinout for SE SCSI Table A 3 lists the pinout for the high density 68 pin connectors for single ended SCSI Table A
25. data accessible over a network When data is read from or written to main memory a copy is also saved in cache memory with the associated main memory address The cache memory software monitors the addresses of subsequent reads to see if the required data is already stored in cache memory If it is already in cache memory a cache hit the data is read from cache memory immediately and the main memory read is aborted or not started If the data is not cached a cache miss it is fetched from main memory and saved in cache memory MegaRAID SCSI 320 2 Hardware Guide C 1 Copyright 2002 by LSI Logic Corporation All rights reserved Channel Consistency Check Cold Swap Data Transfer Capacity Degraded Disk Disk Array Disk Duplexing Disk Mirroring Disk Spanning Disk Striping C 2 An electrical path for the transfer of data and control information between a disk and a disk controller An examination of the disk system to determine whether all conditions are valid for the specified configuration such as parity A cold swap requires that you turn the power off before replacing a defective disk drive in a disk subsystem The amount of data per unit time moved through a channel For disk I O data transfer capacity bandwidth is expressed in megabytes per second Mbytes s Used to describe a disk drive that has become non functional or has decreased in performance A nonvolatile randomly addressable re
26. rebuild disk drives in RAID 1 5 10 or 50 systems If a hot spare is not available the failed disk drive must be replaced with a new disk drive so the data on the failed drive can be rebuilt The MegaRAID SCSI 320 2 controller automatically and transparently rebuilds failed drives with user definable rebuild rates If a hot spare is available the rebuild starts automatically when a drive fails MegaRAID SCSI 320 2 automatically restarts the system and the rebuild if the system goes down during a rebuild Rebuild Rate The rebuild rate is the fraction of the compute cycles dedicated to rebuilding failed drives A rebuild rate of 100 means the system is RAID Overview 2 9 Copyright 2002 by LSI Logic Corporation All rights reserved totally dedicat 2 rebuild rate ed to rebuilding the failed drive The MegaRAID SCSI 320 can be configured between 0 and 100 At 0 the rebuild is only done if the system is not doing anything else At 100 the rebuild has a higher priority than any other system activity 2 3 12 Logical Drive States Table 2 2 describes the logical drive states Table 2 2 Logical Drive States Optimal Drive operating condition is good All configured drives are online Degraded Drive operating condition is not optimal A configured drive has failed or is offline Failed Drive has failed Offline 2 3 13 SCSI Drive States Drive is not available to MegaRAID SCSI 320 2 A S
27. step 4 step 7 for the second controller Power down the second server Attach the cables for the second controller to the shared enclosure and power up the second server If a configuration mismatch occurs enter the lt Ctrl gt lt M gt utility then go to the Configure gt View Add Configuration gt View Disk menu to view the disk configuration Save the configuration Proceed to the driver installation for a Microsoft cluster environment 7 3 1 Driver Installation Instructions under Microsoft Windows 2000 Advanced Server After the hardware is set up for the MS cluster configuration perform the following procedure to configure the driver under Microsoft Windows 2000 Advanced Server When the controller is added after a Windows 2000 Advanced Server installation the operating system detects the controller 1 When the Found New Hardware Wizard screen displays the detected hardware device click on Next 2 When the next screen appears select Search for a suitable driver and click on Next The Locate Driver Files screen appears 3 Insert the floppy diskette with the appropriate driver disk for Windows 2000 then select Floppy disk drives on the screen and click on Next The Wizard detects the device driver on the diskette and the Completing the upgrade device driver wizard displays the name of the controller 4 Click on Finish to complete the installation Installation and Configuration 7 3 Copyright
28. sure the SCSI devices power on are powered up before or at the same time as the host computer Run the MegaRAID BIOS Configuration Optional Utility 13 Install software drivers for the desired operating systems 6 2 1 Step 1 Unpack Unpack and install the hardware in a static free environment Remove the MegaRAID SCSI 320 2 controller card from the anti static bag and inspect it for damage If the card appears damaged or if any item listed below is missing contact LSI Logic or your MegaRAID OEM support representative The MegaRAID SCSI 320 2 controller is shipped with the following e The Driver and Documentation CD which contains these items The MegaRAID Configuration Software Guide The MegaRAID Operating System Driver Installation Guide The MegaRAID SCSI 320 2 Hardware Guide The software license agreement The MegaRAID configuration utilities for DOS e The warranty registration card 6 2 2 Step 2 Power Down Turn off the computer remove the power cord then remove the cover Make sure the computer is turned off and disconnected from any networks before installing the controller card Installation Steps 6 3 Copyright 2002 by LSI Logic Corporation All rights reserved 6 2 3 Step 3 Install Cache Memory Important A minimum of 32 Mbytes of cache memory is required The cache memory must be installed before the MegaRAID controller is operational Install cache memory DIMMs on t
29. the drives IDs on each channel to make sure each device has a different ID Check the termination The device at the end of the channel must be terminated Replace the drive cable Multiple drives connected to the MegaRAID SCSI 320 2 use the same power supply There is a problem spinning the drives all at once Set the drives to spin on command This will allow MegaRAID SCSI 320 2 to spin two devices simultaneously Pressing lt Ctrl gt lt M gt or running megaconf exe does not display the Management Menu At system power up with the MegaRAID installed the screen display is garbled These utilities require a color monitor At least 32 Mbytes of memory must be installed before power up Cannot flash or update the EEPROM You may need a new EEPROM Firmware Initializing appears and remains on the screen What is the maximum number of MegaRAID adapters per computer Make sure that TERMPWR is being properly provided to each peripheral device populated channel Make sure that each end of the channel chain is properly terminated using the recommended terminator type for the peripheral device The channel is automatically terminated at the MegaRAID SCSI 320 2 card if only one cable is connected to a channel Make sure that memory modules are PC100 or faster Make sure that the MegaRAID SCSI 320 2 controller is properly seated in the PCI slot Currently all the utilities and drivers support up
30. the group Disk Group 1 and select the option Move This option moves the group and all its resources to another node After a short period of time the Disk F G will be brought online on the second node If you watch the screen you will see this shift Close the Cluster Administrator snap in Congratulations You have completed installing Cluster Service on all nodes The server cluster is fully operational Now you are ready to install cluster resources such as file shares printer spoolers cluster aware services like IIS Message Queuing Distributed Transaction Coordinator DHCP WINS or cluster aware applications like Exchange or SQL Server Installing SCSI Drives This information is provided as a generic instruction set for SCSI drive installations If the SCSI hard disk vendor s instructions conflict with the instructions in this section always use the instructions supplied by the vendor Installing SCSI Drives 7 27 Copyright 2002 by LSI Logic Corporation All rights reserved 7 5 1 The SCSI bus listed in the hardware requirements must be configured prior to installation of Cluster Services This includes e Configuring the SCSI devices e Configuring the SCSI controllers and hard disks to work properly on a shared SCSI bus e Properly terminating the bus The shared SCSI bus must have a terminator at each end of the bus It is possible to have multiple shared SCSI buses between the nodes of a cluster In additi
31. trademarks or registered trademarks of LSI Logic Corporation Intel is a registered trademark of Intel Corporation MS DOS Microsoft Windows and Windows NT are registered trademarks of Microsoft Corporation UNIX is a registered trademark of the Open Group Novell NetWare is a registered trademark of Novell Corporation ASPI is a registered trademark of Adaptec Inc All other brand and product names may be trademarks of their respective companies CD To receive product literature visit us at http www I silogic com For a current list of our distributors sales offices and design resource centers view our web page located at http www Isilogic com contacts index html Copyright 2002 by LSI Logic Corporation All rights reserved FCC Regulatory Statement This device complies with Part 15 of the FCC Rules Operation is subject to the following two conditions 1 this device may not cause harmful interference and 2 this device must accept any interference received including interference that may cause undesired operation Warning Changes or modifications to this unit not expressly approved by the party responsible for compliance could void the user s author ity to operate the equipment This equipment has been tested and found to comply with the limits for a Class B digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference in a residential
32. 0 Advanced Server or Windows 2000 Datacenter Server and the Cluster Service are installed and running on one node before you start an operating system on another node If the operating system is started on other nodes before you install and configure Cluster Service and run it on at least one node the cluster disks will have a high chance of becoming corrupted To continue power off all nodes Power up the shared storage devices Once the shared storage device is powered up power up node one 7 4 10 1 Quorum Disk The quorum disk stores cluster configuration database checkpoints and log files that help manage the cluster Windows 2000 makes the following quorum disk recommendations Cluster Installation 7 13 Copyright 2002 by LSI Logic Corporation All rights reserved Create a small partition Use a minimum of 50 Mbytes as a quorum disk Windows 2000 generally recommends a quorum disk to be 500 Mbytes Dedicate a separate disk for a quorum resource The failure of the quorum disk would cause the entire cluster to fail therefore Windows 2000 strongly recommends that you use a volume on a RAID disk array During the Cluster Service installation you have to provide the drive letter for the quorum disk Note For our example we use the letter E for the quorum disk drive letter 7 4 11 Configuring Shared Disks 7 14 Perform the following steps to configure the shared disks 1 2 3 4 7 8 9 Right click o
33. 2 bit 80960 Jx RISC processor that runs at 100 MHz This processor directs all functions of the controller including command processing PCI and SCSI bus Features Copyright 2002 by LSI Logic Corporation All rights reserved transfers RAID processing drive rebuilding cache management and error recovery 4 10 2 Cache Memory Cache memory resides in a single 72 bit DIMM socket that requires one unbuffered 3 3 V SDRAM single sided or double sided DIMM Possible configurations are 32 64 128 or 256 Mbytes MegaRAID supports write through or write back caching which can be selected for each logical drive To improve performance in sequential disk accesses MegaRAID does not use read ahead caching for the current logical drive The default setting for the read policy is Normal meaning no read ahead caching You can disable read ahead caching Warning Write caching is not recommended for the physical drives When write cache is enabled loss of data can occur when power is interrupted 4 10 3 MegaRAID BIOS The BIOS resides on a 1 MB or 2 MB 8 flash ROM for easy upgrade The MegaRAID BIOS supports INT 13h calls to boot DOS without special software or device drivers The MegaRAID BIOS provides an extensive setup utility that can be accessed by pressing lt Ctrl gt lt M gt at BIOS initialization The MegaRAID Configuration Utility is described in the MegaRAID Configuration Software Guide 4 10 4 Onboard Speaker The MegaRAID
34. 4 7 Copyright 2002 by LSI Logic Corporation All rights reserved Table 4 6 Parameter Nonvolatile RAM MegaRAID SCSI 320 2 Specifications Cont Specification 32 KB 8 for storing RAID configuration Memory type One 72 bit 168 pin SDRAM DIMM socket provides write through or write back caching on a logical drive basis It also provides adaptive read ahead Operating voltage 5 00 V 0 25 V and 3 3 V 0 3 V SCSI controller 2 SCSI controllers for Ultra320 and Wide support SCSI data transfer rate Up to 320 Mbytes s SCSI bus Low voltage differential or SE SCSI termination Active low voltage differential or single ended Termination disable Automatic through cable detection Devices per SCSI channel Up to 15 wide or seven non wide SCSI devices Up to 6 non disk SCSI drives per MegaRAID controller SCSI device types supported Synchronous or Asynchronous Disk and non disk RAID levels supported 0 1 5 10 and 50 SCSI connectors Two 68 pin internal high density connectors for 16 bit SCSI devices Two ultra high density 68 pin external connectors SCSI cables Up to 25 m if using low voltage differential Serial port 3 pin RS232C compatible connector used for test purposes only 4 10 MegaRAID Components 4 10 1 CPU 4 8 The MegaRAID SCSI 320 2 controller uses the 64 bit Intel 80303 Intelligent I O processor with an embedded 3
35. AID system It is independent of any operating system See the MegaRAID Configuration Software Guide for additional information 4 11 2 WebBIOS Configuration Utility The WebBIOS Configuration Utility is an HTML based utility used to configure and maintain RAID arrays format hard drives and manage the RAID system It is independent of any operating system See the MegaRAID Configuration Software Guide for additional information RAID Management 4 11 Copyright 2002 by LSI Logic Corporation All rights reserved 4 11 3 Power Console Plus Power Console Plus runs in Windows NT 2000 XP and NET It configures monitors and maintains multiple RAID servers from any network node or a remote location See the MegaRAID Configuration Software Guide for additional information 4 11 4 MegaRAID Manager MegaRAID Manager is a character based non GUI utility for Linux and Novell NetWare that changes policies and parameters and monitors RAID systems See the MegaRAID Configuration Software Guide for additional information 4 12 Compatibility MegaRAID SCSI 320 2 compatibility issues include e Server management e SCSI device compatibility e Software compatibility 4 12 1 Server Management As a simple network management protocol SNMP agent MegaRAID SCSI 320 2 supports all SNMP managers 4 12 2 SCSI Device Compatibility The MegaRAID SCSI 320 2 supports SCSI hard drives CD ROM drives and tape drives 4 12 3 Software All
36. All rights reserved MegaRAID Problem Report Form Cont System Information Motherboard BIOS manufacturer Operating System BIOS Date Op Sys Ver Video Adapter MegaRAID CPU Type Speed Driver Ver Network Card System Memory Other disk controllers Other adapter cards installed Installed Description of problem Steps necessary to re create problem Preface vil Copyright 2002 by LSI Logic Corporation All rights reserved Logical Drive Configuration Use this form to record the configuration details for your logical drives Logical Drive Configuration Logical Logical Drive of Physical Drive Size Drives viii Preface Copyright 2002 by LSI Logic Corporation All rights reserved Logical Drive Configuration Cont Logical Stripe Drive Size Logical Drive Size of Physical Drives Preface Copyright 2002 by LSI Logic Corporation All rights reserved Physical Device Layout Use this form to record the physical device layout Physical Device Layout Channel 0 Channel 1 Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firm
37. CSI devices See the manual for each SCSI device to disable termination SCSI Termination You can let the card automatically provide SCSI termination at one end of the SCSI bus You can terminate the other end of the SCSI bus by attaching an external SCSI terminator module to the end of the cable or by attaching a SCSI device that internally terminates the SCSI bus at the end of the SCSI channel Use standard external SCSI terminators on a SCSI channel operating at 10 Mbytes s or higher synchronous data transfer Terminating Internal SCSI Disk Arrays Set the termination so that SCSI termination and termination power are intact when any hard drive is removed from a SCSI channel as shown in Figure 6 3 Also jumpers J4 and J5 should always be set to allow the termination to be controlled by software See Section 6 2 4 3 J4 J5 Termination Enable page 6 6 Hardware Installation Copyright 2002 by LSI Logic Corporation All rights reserved Figure 6 3 Termination of Internal SCSI Disk Arrays IDO Boot Drive No Termination MegaRAID SCSI 320 2 Controller 6 2 5 3 Terminating External Disk Arrays In most array enclosures the end of the SCSI cable has an independent SCSI terminator module that is not part of any SCSI drive In this way Installation Steps 6 9 Copyright 2002 by LSI Logic Corporation All rights reserved SCSI termination is not disturbed when any drive is removed as shown in Figure 6 4
38. CSI cable length and number of disk drives that you can use depending on the SCSI speeds and type of device Table 1 1 Maximum Cable Length for SCSI Standards Single Ended Low Voltage Maximum of Standard SCSI Differential SCSI Drives Ultra SCSI Ultra SCSI Wide Ultra SCSI Wide Ultra SCSI Wide Ultra SCSI Overview Copyright 2002 by LSI Logic Corporation All rights reserved Table 1 1 Maximum Cable Length for SCSI Standards Cont Single Ended Low Voltage Maximum of Standard SCSI Differential SCSI Drives Ultra 2 SCSI Ultra 2 SCSI Wide Ultra 2 SCSI Wide Ultra 2 SCSI Ultra320 1 6 SCSI Bus Widths and Maximum Throughput Table 1 2 lists the SCSI bus widths and maximum throughput based on the SCSI speeds Table 1 2 SCSI Bus Widths and Maximum Throughput SCSI Standard SCSI Bus Width SCSI Throughput Fast Wide SCSI 16 bits 20 Mbytes s Wide Ultra SCSI 16 bits 40 Mbytes s Wide Ultra 2 SCSI 16 bits 80 Mbytes s Wide Ultra 160 SCSI 16 bits 160 Mbytes s Ultra 320 SCSI 16 bits 320 Mbytes s 1 7 Documentation The MegaRAID SCSI 320 2 documentation set includes e The MegaRAID SCSI 320 2 Hardware Guide e The MegaRAID Configuration Software Guide e The MegaRAID Operating System Driver Installation Guide SCSI Bus Widths and Maximum Throughput 1 3 Copyright 2002 by LSI Logic Corporation All rights reserved 1 7 1 MegaRAID SCSI
39. CSI disk drive can be in one of the states described in Table 2 3 Table 2 3 SCSI Drive States Online ONLIN The drive is functioning normally and is a part of a configured logical drive Ready READY The drive is functioning normally but is not part of a configured logical drive and is not designated as a hot spare Hot Spare HOTSP The drive is powered up and ready for use as a Spare in case an online drive fails Fail FAIL A fault has occurred in the drive placing it out of service Rebuild REB 2 10 Introduction to The drive is being rebuilt with data from a failed drive RAID Copyright 2002 by LSI Logic Corporation All rights reserved 2 3 14 Disk Array Types Table 2 4 describes the RAID disk array types Table 2 4 Disk Array Types Type Description Software The array is managed by software running in a host computer Based using the host CPU bandwidth The disadvantages associated with this method are the load on the host CPU and the need for different software for each operating system SCSI to SCSI The array controller resides outside of the host computer and communicates with the host via a SCSI adapter in the host Array management software runs in the controller It is transparent to the host and independent of the host operating system The disadvantage is the limited data transfer rate of the SCSI channel between the SCSI adapter and the array controller
40. Chapter 8 Troubleshooting This chapter provides troubleshooting information for the MegaRAID SCSI 320 2 controller It contains the following sections e Section 8 1 General Troubleshooting e Section 8 2 BIOS Boot Error Messages e Section 8 3 Other BIOS Error Messages e Section 8 4 Other Potential Problems 8 1 General Troubleshooting Table 8 1 lists the general problems that can occur along with suggested solutions Table 8 1 General Problems and Suggested Solutions Problem Suggested Solution Some operating systems do not loadin Check the system BIOS configuration for PCI interrupt a computer with a MegaRAID SCSI assignments Make sure some Interrupts are assigned for 320 2 controller PCI Initialize the logical drive before installing the operating system One of the hard drives in the array fails Check the drive error counts using Power Console Plus often See the MegaRAID Configuration Software Guide for more information Format the drive Rebuild the drive If the drive continues to fail replace it with another drive with the same capacity MegaRAID SCSI 320 2 Hardware Guide 8 1 Copyright 2002 by LSI Logic Corporation All rights reserved Table 8 1 General Problems and Suggested Solutions Cont Problem Suggested Solution Pressed lt Ctrl gt lt M gt Ran Megaconf exe and tried to make a new configuration The system hangs when scanning devices Check
41. Copyright 2002 by LSI Logic Corporation All rights reserved 5 1 2 Basic Configuration Rules You should observe the following guidelines when connecting and configuring SCSI devices in a RAID array e Attach non disk SCSI devices to a single SCSI channel that does not have any disk drives e Distribute the SCSI hard disk drives equally among all available SCSI channels except any SCSI channel that is being reserved for non disk drives e You can place up to 30 physical disk drives in a logical array depending on the RAID level e An array can contain SCSI devices that reside on an array on any channel e Include all drives that have the same capacity in the same array e Make sure any hot spare has a capacity that is at least as large as the largest drive that may be replaced by the hot spare e When replacing a failed drive make sure that the replacement drive has a capacity that is at least as large as the drive being replaced Note Be sure to back up your data regularly even when using RAID 5 1 3 Current Physical Device Configuration Use Table 5 1 to record the current configuration for your physical devices on SCSI channels 0 and 1 Table 5 1 Physical Device Configuration SCSI ID Device Description Termination SCSI Channel 0 5 2 Configuring Physical Drives Arrays and Logical Drives Copyright 2002 by LSI Logic Corporation All rights reserved Table 5 1 Physical Device Conf
42. HARDWARE GUIDE MegaRAID SCSI 320 2 RAID Controller November 2002 LSIERA This document contains proprietary information of LSI Logic Corporation The information contained herein is not to be used by or disclosed to third parties without the express written permission of an officer of LSI Logic Corporation LSI Logic products are not intended for use in life support appliances devices or systems Use of any LSI Logic product in such applications without written consent of the appropriate LSI Logic officer is prohibited Document DB15 000259 00 First Edition November 2002 This document describes the initial release of LSI Logic Corporation s MegaRAID SCSI 320 2 Controller and will remain the official reference source for all revisions releases of this product until rescinded by an update LSI Logic Corporation reserves the right to make changes to any products herein at any time without notice LSI Logic does not assume any responsibility or liability arising out of the application or use of any product described herein except as expressly agreed to in writing by LSI Logic nor does the purchase or use of a product from LSI Logic convey a license under any patent rights copyrights trademark rights or any other of the intellectual property rights of LSI Logic or third parties Copyright 2002 by LSI Logic Corporation All rights reserved TRADEMARK ACKNOWLEDGMENT LSI Logic the LSI Logic logo design and MegaRAID are
43. I device to set the TIDs The MegaRAID SCSI 320 2 controller Hardware Installation Copyright 2002 by LSI Logic Corporation All rights reserved automatically occupies TID 7 on each SCSI channel Eight bit SCSI devices can only use the TIDs from 0 to 6 16 bit devices can use the TIDs from 0 to 15 The arbitration priority for a SCSI device depends on its TID Table 6 7 shows the relative priority of each Target ID Table 6 7 Priority of Target IDs Priority Highest Lowest TID 0 15 14 Important Non disk devices CD ROM or tape drive should have unique SCSI IDs regardless of the channel they are connected to ID 0 cannot be used for non disk devices because they are limited to IDs 1 through 6 There is a limit of six IDs per controller for non disk devices 6 2 10 1 Example of MegaRAID SCSI 320 2 ID Mapping Table 6 8 provides an example of ID mapping for the SCSI 320 2 Table 6 8 Example of Mapping for SCSI 320 2 Channel 0 Channel 1 A2 3 A2 6 A3 1 A4 1 Tape Optical A5 1 Reserved Reserved A5 2 A5 3 2 3 4 5 6 7 8 9 A5 6 A5 7 i oO A6 1 A6 2 i A6 4 Installation Steps A6 5 6 19 Copyright 2002 by LSI Logic Corporation All rights reserved 6 2 11 Step 11 6 2 12 Step 12 6 20 Table 6 8 Example of Mapping for SCSI 320 2 Cont Channel 0 Channel 1 Power Up Repla
44. ID Manager Compatibility 4 12 1 Server Management 4 12 2 SCSI Device Compatibility 4 12 3 Software Configuring Physical Drives Arrays and Logical Drives 5 1 Configuring SCSI Physical Drives 5 1 1 Distributing Drives 5 12 Basic Configuration Rules 5 1 3 Current Physical Device Configuration 5 1 4 Logical Drive Configuration B15 Physical Device Layout 5 2 Configuring Arrays 5 2 1 Arranging Arrays 5 2 2 Creating Hot Spares 5 3 Creating Logical Drives 5 3 1 Configuration Strategies 5 3 2 Assigning RAID Levels 5 4 Configuring Logical Drives 5 4 1 Optimizing Data Storage 5 5 Planning the Array Configuration 5 5 1 Using the Array Configuration Planner Chapter 6 Hardware Installation 6 1 Hardware Requirements 6 1 1 Optional Equipment 6 2 Installation Steps Contents Copyright 2002 by LSI Logic Corporation All rights reserved 4 10 4 10 4 10 4 11 4 11 4 11 4 12 4 12 4 12 4 12 4 12 4 12 5 1 S 5 2 5 2 5 4 5 6 5 9 5 9 5 10 5 10 5 10 5 12 5 13 5 13 5 14 5 14 6 1 6 2 xvii Chapter 7 6 2 1 Step 1 Unpack 6 2 2 Step 2 Power Down 6 2 3 Step 3 Install Cache Memory 6 2 4 Step 4 Check Jumper Settings 6 2 5 Step 5 Set Termination 6 2 6 Step 6 Set SCSI Terminator Power 6 2 7 Step 7 Install Battery Pack Optional 6 2 8 Step 8 Install MegaRAID SCSI 320 2 6 2 9 Step 9 Connect SCSI Devices 6 2 10 Step 10 Set Target IDs 6 2 11 Step 11 Power Up 6 2 12 Step 12 Run the MegaRAID BIOS Conf
45. Logic Corporation All rights reserved 2 Click on Next in the Configure Cluster Networks dialog box 3 Verify that the network name and IP address correspond to the network interface for the public network 4 Check the box Enable this network for cluster use Select the option All communications mixed network as shown below and click on Next Cluster Service Configuration Wizard Network Connections Type the network name and specify whether this network will perform as a public private or mixed network Network name public Device rte PRO 100 Management Adapter IP address fi 55 100 0 141 JV Enable this network for cluster use This network performs the following role in the cluster Client access only public network Intemal cluster communications only private network All communications mixed network lt Back Cancel The next dialog box configures the private network Make sure that the network name and IP address correspond to the network interface used for the private network 6 Check the box Enable this network for cluster use 7 Select the option Internal cluster communications only then click on Next Cluster Installation 7 21 Copyright 2002 by LSI Logic Corporation All rights reserved Cluster Service Configuration Wizard Network Connections Type the network name and specify whether this network will perform as a public private or mixed netw
46. P Spanning Spare Stripe Size Stripe Width Striping Terminator C 8 The Service Provider SP is a program that resides in the desktop system or server and is responsible for all DMI activities This layer collects management information from products whether system hardware peripherals or software stores that information in the DMI database and passes it to management applications as requested Simple Network Management Protocol The most widely used protocol for communicating management information between the managed elements of a network and a network manager SNMP focuses primarily on the network backbone The Internet standard protocol that manages nodes on an Internet Protocol IP network Array spanning by a logical drive combines storage space in two arrays of disk drives into a single contiguous storage space in a logical drive MegaRAID logical drives can span consecutively numbered arrays that each consist of the same number of disk drives Array spanning promotes RAID levels 1 and 5 to RAID levels 10 and 50 respectively See also Disk Spanning A disk drive available to back up the data of other drives The amount of data contiguously written to each disk You can specify stripe sizes of 4 8 16 32 64 and 128 Kbytes for each logical drive For best performance choose a stripe size equal to or smaller than the block size used by the host computer The number of disk drives across which the data is
47. RAID intelligence on an adapter card that is installed in a network server A host based RAID product provides the best performance MegaRAID SCSI 320 2 is part of the file server so it can transmit data directly across the computer s buses at data transfer speeds up to 532 Mbytes s The available sequential data transfer rate is determined by the following factors e The sustained data transfer rate on the motherboard PCI bus e The sustained data transfer rate on the PCI to PCl bridge e The sustained data transfer rate of the SCSI controller e The sustained data transfer rate of the SCSI devices e The number of SCSI channels e The number of SCSI disk drives Host based solutions must provide operating system specific drivers Introduction to RAID Copyright 2002 by LSI Logic Corporation All rights reserved 2 2 2 SCSI to SCSI External RAID A SCSI to SCSI external RAID product puts the RAID intelligence inside the RAID chassis and uses a plain SCSI host adapter installed in the network server The data transfer rate is limited to the bandwidth of the SCSI channel A SCSI to SCSI external RAID product that has two Wide SCSI channels operating at speeds up to 320 Mbytes s must squeeze the data into a single Wide SCSI 320 Mbytes s channel back to the host computer In SCSI to SCSI external RAID products the disk drive subsystem uses only a single SCSI ID which allows you to connect multiple drive subsystems to a single SCSI cont
48. SCSI backup and utility software should work with the MegaRAID SCSI 320 2 This software is not provided with the MegaRAID controller 4 12 Features Copyright 2002 by LSI Logic Corporation All rights reserved Chapter 5 Configuring Physical Drives Arrays and Logical Drives This chapter explains how to configure SCSI physical drives arrays and logical drives connected to the MegaRAID SCSI 320 2 controller It contains the following sections e Section 5 1 Configuring SCSI Physical Drives e Section 5 2 Configuring Arrays e Section 5 3 Creating Logical Drives e Section 5 4 Configuring Logical Drives e Section 5 5 Planning the Array Configuration 5 1 Configuring SCSI Physical Drives SCSI physical drives must be organized into logical drives The arrays and logical drives that you construct must be able to support the RAID level that you select The MegaRAID SCSI 320 2 controller has two SCSI channels 5 1 1 Distributing Drives Distribute the disk drives across all channels for optimal performance It is best to stripe across channels instead of down channels Performance is most affected for sequential reads and writes The MegaRAID SCSI 320 2 controller supports SCSI CD ROM drives SCSI tape drives and other SCSI devices as well as SCSI hard disk drives For optimal performance all non disk SCSI devices should be attached to one SCSI channel MegaRAID SCSI 320 2 Hardware Guide 5 1
49. SCSI devices cannot be connected to a SCSI 1 bus Like Fast SCSI Wide SCSI supports transfer rates up to 20 Mbytes s C 9 Copyright 2002 by LSI Logic Corporation All rights reserved C 10 Glossary Copyright 2002 by LSI Logic Corporation All rights reserved Index Numerics 0 DIMM socket 6 4 160M and Wide SCSI 4 1 68 pin connector pinout for LVD SCSI A 9 68 Pin High Density Connectors A 1 A AMI Part Number Battery 6 13 AMPLIMITE 050 Series connectors A 8 Array C 1 Array Configuration Planner 5 15 Array management software C 1 Array performance features 4 5 Array spanning C 1 Assigning Drive Letters 7 15 Assigning RAID levels 5 12 Asynchronous operations C 1 Audible Warnings B 1 Automatic failed drive detection and rebuild 4 6 Battery Pack 6 13 BIOS Boot Error Messages 8 3 BIOS Configuration Utility 6 20 BIOS message 6 20 Bus Data Transfer Rate 4 7 Bus Type 4 7 Bus based 2 11 c Cable assembly for internal Wide SCSI devices A 2 Cables To Go A 6 Cache Configuration 4 7 Cache I O C 1 Cache Memory 4 9 Installing 6 4 Card Size 4 7 Changing DRAM Modules 6 15 Changing the Battery Pack 6 15 Channel C 2 Charging the Battery Pack 6 15 Cluster Configuration Wizard 7 16 Cluster Disks Configuration 7 18 Cluster Installation 7 5 Overview 7 5 Validation 7 25 Cluster Node Network Adapter Configuration 7 8 Cluster Service Assigning Drive Letters 7 15 Cluster Node Network Adapter 7 8 Cluster User A
50. able that connects to the hard disk LED mounted on the computer enclosure The LED indicates data transfers SCSI bus activity 6 2 4 2 J3 Dirty Cache LED J3 is a two pin header for the dirty cache LED This can be connected to an LED on the computer enclosure The LED will be lit when data in the cache has not yet been written to the storage device 6 2 4 3 J4 J5 Termination Enable J4 and J5 are three pin headers that specify the type of SCSI termination for channel 0 and channel 1 respectively Table 6 3 shows the jumper 6 6 Hardware Installation Copyright 2002 by LSI Logic Corporation All rights reserved settings Leave at the default setting jumper on pins 1 and 2 to allow the MegaRAID controller to automatically set its own SCSI termination Table 6 3 Pinout for J4 J5 Termination Enable Type of SCSI Termination J4 J5 Setting Software control of SCSI termination using drive Short pins 1 2 detection default Permanently disable all onboard SCSI termination Short pins 2 3 Permanently enable all onboard SCSI termination OPEN 6 2 4 4 J10 Battery Pack Connector J10 is a 3 pin connector that attaches to the optional battery pack Table 6 4 displays the J10 pinout Table 6 4 J10 External Battery Pinout Pin Signal Description 3 BATT Terminal red wire 2 Thermistor white wire 1 BATT Terminal black wire 6 2 4 5 J16 Onboard BIOS Enable J16 is a 2 pin header that en
51. ables or disables the MegaRAID onboard BIOS The onboard BIOS should be enabled J16 unjumpered for normal board operation Table 6 5 shows the jumper settings Table 6 5 Pinout for J16 BIOS Enable J16 Setting Onboard BIOS Status Unjumpered Enabled Jumpered Disabled Installation Steps 6 7 Copyright 2002 by LSI Logic Corporation All rights reserved 6 2 4 6 J17 J18 SCSI Bus Termination Power J17 and J18 are 2 pin jumpers that control the termination power setting for channel 0 and channel 1 respectively Leave both jumpers at the default setting jumper installed on pins 1 and 2 to allow the PCI bus to provide termination power When the jumpers are removed the SCSI bus provides termination power 6 2 5 Step 5 Set Termination 6 2 5 1 6 2 5 2 6 8 Each MegaRAID SCSI channel can be individually configured for termination enable mode by setting the J4 and J5 jumpers You must terminate the SCSI bus properly Set termination at both ends of the SCSI cable The SCSI bus is an electrical transmission line and must be terminated properly to minimize reflections and losses For a disk array set SCSI bus termination so that removing or adding a SCSI device does not disturb termination An easy way to do this is to connect the card to one end of the SCSI cable and to connect a terminator module at the other end of the cable The connectors between the two ends can connect SCSI devices Disable termination on the S
52. ace or rebuild any drive that is not responding 1 Logical Drive Degraded Insufficient memory to run BIOS Press any key to continue Insufficient Memory A logical drive signed on in a degraded state Not enough MegaRAID memory to run MegaRAID BIOS Not enough memory on the MegaRAID adapter to support the current configuration Make sure all physical drives are properly connected and are powered on Run MegaRAID Manager to find out if any physical drives are not responding Reconnect replace or rebuild any drive that is not responding Make sure MegaRAID memory has been properly installed Make sure MegaRAID memory has been properly installed The following SCSI IDs are not responding Channel x a b c 8 4 The physical drives with SCSI IDs a b and c are not responding on SCSI channel x Troubleshooting Make sure the physical drives are properly connected and are powered on Copyright 2002 by LSI Logic Corporation All rights reserved 8 3 Other BIOS Error Messages Table 8 3 describes other BIOS error messages their meaning and suggested solutions Table 8 3 Message Following SCSI disk not found and no empty slot available for mapping it Other BIOS Error Messages Problem The physical disk roaming feature did not find the physical disk with the displayed SCSI ID No slot is available to map the physical drive MegaRAID cannot resolve the physical dri
53. ain controllers and member servers in a cluster is not acceptable 7 6 Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved 7 4 2 Installing Microsoft Windows 2000 Install Microsoft Windows 2000 on each node See your Windows 2000 manual for information Log on as administrator before you install the Cluster Services 7 4 3 Setting Up Networks Note Do not allow both nodes to access the shared storage device before the Cluster Service is installed In order to prevent this power down any shared storage devices and then power up nodes one at a time Install the Clustering Service on at least one node and make sure it is online before you power up the second node Install at least two network card adapters per each cluster node One network card adapter card is used to access the public network The second network card adapter is used to access the cluster nodes The network card adapter that is used to access the cluster nodes establishes the following e Node to node communications e Cluster status signals e Cluster Management Check to make sure that all the network connections are correct Network cards that access the public network must be connected to the public network Network cards that access the cluster nodes must connect to each other Verify that all network connections are correct with private network adapters connected to other private network adapters only a
54. ble termination on any SCSI device that does not sit at the end of the SCSI bus Configure all SCSI devices to supply TermPWR Set proper target IDs TIDs for each SCSI device Distribute SCSI devices evenly across the SCSI channels for optimum performance Do not exceed the maximum cable length for the number and type of SCSI devices you are using See Table 1 1 for details Try to connect all non disk SCSI devices to a SCSI channel that has no SCSI disk drives connected to it Cable Suggestions System throughput problems can occur if SCSI cable use is not maximized Here are some cabling guidelines Use the shortest SCSI cables LVD mode cable lengths should be no more than 25 meters with two devices and no more than 12 meters with eight devices Use active termination Avoid clustering the stubs Cable stub length should be no more than 0 1 meter 4 inches Route SCSI cables carefully Use high impedance cables Do not mix cable types choose flat cable for inside the enclosure and round shielded cables for outside the enclosure Ribbon cables have fairly good cross talk rejection characteristics 6 2 10 Step 10 Set Target IDs 6 18 Set target identifiers TIDs on the SCSI devices Each device in a specific SCSI channel must have a unique TID in that channel Non disk devices CD ROM or tapes should have unique SCSI IDs regardless of the channel where they are connected See the documentation for each SCS
55. by LSI Logic Corporation All rights reserved Array Array Management Software Array Spanning Asynchronous Operations Cache I O Appendix C Glossary A grouping of individual disk drives that combines the storage space on the disk drives into a single segment of contiguous storage space MegaRAID can group disk drives on one or more SCSI channels into an array Software that provides common control and management for a disk array Array management software most often executes in a disk controller or intelligent host bus adapter but it can also execute in a host computer When array management software executes in a disk controller or adapter it is often called firmware Array spanning by a logical drive combines storage space in two arrays of disk drives into a single contiguous storage space in a logical drive MegaRAID logical drives can span consecutively numbered arrays that have the same number of disk drives Array spanning promotes RAID levels 1 and 5 to RAID levels 10 and 50 respectively See also Disk Spanning Operations that bear no relationship to each other in time and can overlap The concept of asynchronous I O operations is central to independent access arrays in throughput intensive applications A small amount of fast memory that holds recently accessed data Caching speeds subsequent access to the same data It is most often applied to processor memory access but it can also be used to store a copy of
56. ccount 7 12 Configuring Cluster Disks 7 18 Connectivity and Name Resolution 7 11 Disk Access and Functionality 7 15 Domain Membership 7 12 SCSI Drive Installations 7 27 Setting Up Networks 7 7 Shared Disks Configuration 7 14 Shared Disks Setup 7 13 Software Installation 7 16 Validating the Cluster Installation 7 25 Cluster User Account Setup 7 12 Clustering Network Requirements 7 4 Shared Disk Requirements 7 5 Cold swap C 2 Compatibility 4 12 Components 4 8 Configuration on Disk 4 3 Configuration Strategies 5 10 Configuring Arrays 5 9 Configuring Logical Drives 5 13 Configuring SCSI Physical Drives Distributing Drives 5 1 Configuring SCSI physical drives 5 1 Connecting internal and external Wide devices A 3 Consistency check 2 4 C 2 Converting from internal Wide to internal non Wide Type 3 A 5 Converting internal Wide to internal non Wide A 4 Converting internal Wide to internal non Wide Type 30 A 5 CPU 4 8 Creating hot spares 5 10 Creating logical drives 5 10 D Data redundancy Using mirroring 2 6 Data transfer capacity C 2 Dedicated parity 2 8 Degraded 2 10 C 2 Devices per SCSI Channel 4 8 DIMM socket 6 4 DIMMs 6 4 MegaRAID SCSI 320 2 Hardware Guide IX 1 Copyright 2002 by LSI Logic Corporation All rights reserved Disconnect reconnect 4 10 Disk C 2 Disk Access and Functionality 7 15 Disk array C 2 Disk Array Types 2 11 Disk duplexing C 2 Disk mirroring 2 6 C 2 Disk rebuild 2 9 Disk spanning 2 7
57. ce the computer cover and reconnect the AC power cords Turn power on to the host computer Set up the power supplies so that the SCSI devices are powered up at the same time as or before the host computer If the computer is powered up before a SCSI device the device might not be recognized During boot the MegaRAID SCSI 320 2 BIOS message appears MegaRAID SCSI 320 2 Disk Array Adapter BIOS Version x xx date Copyright c LSI Logic Corporation Firmware Initializing Scanning SCSI Device etc The firmware takes several seconds to initialize During this time the adapter scans the SCSI channel s When ready the following appears Host Adapter 1 Firmware Version x xx DRAM Size 16 MB 0 Logical Drives found on the Host Adapter 0 Logical Drives handled by BIOS Press lt Ctrl gt lt M gt to run MegaRAID BIOS Configuration Utility The lt Ctrl gt lt M gt utility prompt times out after several seconds The MegaRAID SCSI 320 2 host adapter controller number firmware version and cache DRAM size are displayed in the second portion of the BIOS message The numbering of the controllers follows the PCI slot scanning order used by the host motherboard Run the MegaRAID BIOS Configuration Utility Press lt Ctrl gt lt M gt to run the MegaRAID BIOS Configuration Utility See the MegaRAID Configuration Software Guide for more information Hardware Installation Copyright 2002 by LSI Logic Corporation All rights re
58. ddressing schemes especially conversions between member disk block addresses and block addresses of the virtual disks presented to the operating environment by array management software Glossary Copyright 2002 by LSI Logic Corporation All rights reserved Mbyte Multi threaded Operating Environment Parity Partition Physical Disk Physical Disk Roaming Protocol Megabyte An abbreviation for 1 000 000 10 to the sixth power bytes One Mbyte equals 1 000 Kbytes kilobytes Having multiple concurrent or pseudo concurrent execution sequences Used to describe processes in computer systems Multi threaded processes allow throughput intensive applications to efficiently use a disk array to increase I O performance The operating environment includes the host computer where the array is attached any I O buses and adapters the host operating system and any additional software required to operate the array For host based arrays the operating environment includes 1 O driver software for the member disks but does not include array management software which is regarded as part of the array itself Parity is an extra bit added to a byte or word to reveal errors in storage in RAM or disk or transmission Parity is used to generate a set of redundancy data from two or more parent data sets The redundancy data can be used to reconstruct one of the parent data sets although it does not fully duplicate the parent data s
59. e you must create the cluster itself 10 Select the first node in the cluster as shown below and then click on Next Cluster Service Configuration Wizard ae 5 x Create or Join a Cluster You can create a new cluster or you can join an existing one This server is The first node in the cluster If this server is the first node in a cluster you are creating a new cluster C The second or next node in the cluster If at least one other node already exists you are joining an existing cluster lt Back Cancel 11 Enter a name for the cluster up to 15 characters and click on Next In our example the cluster is named ClusterOne 12 Type the user name of the Cluster Service account that you created during the pre installation In our example the user name is cluster Do not enter a password 13 Type the domain name then click on Next At this point the Cluster Service Configuration Wizard validates the user account and password Cluster Installation 7 17 Copyright 2002 by LSI Logic Corporation All rights reserved Cluster Service Configuration Wizard KE E xj Select an ccount For security purposes the Cluster service must use a domain account Type the user name and password for the domain account you want the Cluster service to use This account is given special security privileges on each cluster node User name fester Password aie Domain DOMAIN2 7 lt Bac
60. e Section 1 7 Documentation The MegaRAID SCSI 320 2 controller has two SCSI channels Throughput on each SCSI channel can be as high as 320 Mbytes s MegaRAID supports a low voltage differential SCSI bus or a single ended SCSI bus The MegaRAID SCSI 320 2 is a high performance intelligent PCl to SCSI host adapter with RAID control capabilities The MegaRAID SCSI 320 2 requires no special motherboard PCI expansion slot The card includes an Intel 80303 processor MegaRAID provides reliability high performance and fault tolerant disk subsystem management SCSI Channels The MegaRAID SCSI 320 2 has two Ultra320 SCSI channels One LSI Logic dual SCSI controller supports both channels Each SCSI channel supports up to fifteen SCSI devices MegaRAID SCSI 320 2 Hardware Guide Copyright 2002 by LSI Logic Corporation All rights reserved 1 1 1 2 1 3 1 4 1 5 1 2 NVRAM and Flash ROM A 32 KB x 8 NVRAM stores RAID system configuration information The MegaRAID SCSI 320 2 firmware is stored in flash ROM for easy upgrade SCSI Connectors The MegaRAID SCSI 320 2 has two ultra high density 68 pin external SCSI connectors and two 68 pin internal SCSI connectors for internal SCSI drives Single Ended and Differential SCSI Buses The SCSI standard defines two electrical buses e Single ended bus e Low voltage differential bus Maximum Cable Length for SCSI Standards Table 1 1 lists the maximum S
61. e cluster installation 1 Click on Start 2 Click on Programs 3 Click on Administrative Tools 4 Click on Cluster Administrator The Cluster Administrator screen displays If your snap in window is similar to the one shown in the screen your Cluster Service was successfully installed on the first node You are now ready to install Cluster Service on the second node 7 4 17 Configuring the Second Node Note For this procedure have node one and all shared disks powered on then power up the second node Cluster Installation 7 25 Copyright 2002 by LSI Logic Corporation All rights reserved Installation of Cluster Service on the second node takes less time than on the first node Setup configures the Cluster Service network settings on the second node based on the configuration of the first node Installation of Cluster Service on the second node begins the same way as installation on the first node The first node must be running during installation of the second node Follow the same procedures used to install Cluster Service on the first node with the following differences 1 In the Create or Join a Cluster dialog box select The second or next node in the cluster then click Next Enter the cluster name that was previously created it is MyCluster in this example and click Next Leave Connect to cluster as unchecked The Cluster Service Configuration Wizard automatically supplies the name of the user accou
62. e operating system The FlexRAID Power Fail option allows a reconstruction to restart if a power failure occurs This is the advantage of this option The disadvantage is once the reconstruction is active the performance is slower because an additional activity is added The process of writing zeros to all data fields in a physical drive disk drive to map out unreadable or bad sectors Because most disk drives are factory formatted formatting is usually only done if a hard disk generates many media errors Gigabyte Shorthand for 1 000 000 000 10 to the ninth power bytes One Gbyte is equivalent to 1 000 Mbytes A disk array with an array management software in its host computer rather than in a disk subsystem C 3 Copyright 2002 by LSI Logic Corporation All rights reserved Host Computer Hot Spare Hot Swapping 1 O Driver Initialization Logical Disk Logical Drive Mapping Ca Any computer to which disks are directly attached Mainframes servers workstations and personal computers can all be considered host computers A stand by disk drive ready for use if a drive in an array fails A hot spare does not contain any user data Up to eight disk drives can be assigned as hot spares for an adapter A hot spare can be dedicated to a single redundant array or it can be part of the global hot spare pool for all arrays controlled by the adapter The substitution of a replacement unit in a disk subsystem f
63. e the following procedure to install and configure your system as part of a cluster 1 2 Unpack the controller following the instructions in Chapter 6 Set the hardware termination for the controller as always on See Section 6 2 4 3 J4 J5 Termination Enable page 6 6 for more information Configure the IDs for the drives in the enclosure Install one controller at a time Press lt Ctrl gt lt M gt at BIOS initialization to configure the options in step 5 step 11 Do not attach the disks yet Set the controller to Cluster Mode in the Objects gt Adapter gt Cluster Mode menu Disable the BIOS in the Objects gt Adapter gt Enable Disable BIOS menu Change the initiator ID in the Objects gt Adapter gt Initiator ID menu Power down the first server Attach the controller to the shared array Configure the first controller to the desired arrays using the Configure gt New Configuration menu Note Use the whole array size of any created array Do not create partitions of different sizes on the RAID arrays from the BIOS Configuration Utility lt Ctrl gt lt M gt because they Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved 11 12 13 14 15 16 17 cannot be failed over individually when assigned driver letters in Windows 2000 Follow the on screen instructions to create arrays and save the configuration Repeat
64. ed Try moving the MegaRAID card to another PCI slot Run the MegaRAID Manager Diagnostics to verify that MegaRAID is functioning properly Configuration of nonvolatile RAM NVRAM and drives mismatch Run View Add Configuration option of Configuration Utility Press any key to run the Configuration Utility The configuration stored in the MegaRAID SCSI 320 2 adapter does not match the configuration stored in the drives 1 Press a key to run MegaRAID Manager 2 Select View Add Configuration from the Configure menu 3 Use View Add Configuration to examine both the configuration in NVRAM and the configuration stored on the disk drives Resolve the problem by selecting one of the configurations 1 Logical Drive Failed A logical drive failed to sign on BIOS Boot Error Messages Copyright 2002 by LSI Logic Corporation All rights reserved Make sure all physical drives are properly connected and are powered on Run MegaRAID Manager to find out if any physical drives are not responding Reconnect replace or rebuild any drive that is not responding 8 3 Table 8 2 Message X Logical Drives Degraded Problem x number of logical drives signed on ina degraded state BIOS Boot Error Messages Cont Suggested Solution Make sure all physical drives are properly connected and are powered on Run MegaRAID Manager to find if any physical drives are not responding Reconnect repl
65. edia Error and Other Error options select the Objects menu then Physical Drive Select a physical drive and press lt F2 gt The windows displays the number of errors A Media Error is an error that occurred while actually transferring data An Other Error is an error that occurs at the hardware level because of a device failure poor cabling bad termination signal loss etc Virtual sizing The FlexRAID virtual sizing option enables RAID expansion FlexRAID virtual sizing must be enabled to increase the size of a logical drive or add a physical drive to an existing logical drive Run MegaRAID Manager by pressing lt Ctrl gt lt M gt to enable FlexRAID virtual sizing Select the Objects menu then select the Logical Drive menu Select View Update Parameters Set FlexRAID Virtual Sizing to Enabled BSD Unix We do not provide a driver for BSDI Unix MegaRAID SCSI 320 2 does not support BSDI Unix Multiple LUNs MegaRAID SCSI 320 2 supports one logical unit number LUN per each target ID No multiple LUN devices are supported MegaRAID power The maximum MegaRAID SCSI 320 2 power requirements are 15 W at 5 V requirements and 3 A SCSI bus The ANSI specification dictates the following requirements e The maximum signal path length between terminators is 3 meters when using up to 4 maximum capacitance 25 pF devices and 1 5 meters when using more than 4 devices SCSI devices should be uniformly spaced between terminators wit
66. er communication private networks Position the primary network first and then position additional networks in descending order of importance To move a name in the list select the name and then click Up or Down Networks Si Up se Down lt Back Cancel 9 Enter the unique cluster IP address and Subnet mask for your network then click on Next The Cluster Service Configuration Wizard shown below automatically associates the cluster IP address with one of the public or mixed networks It uses the subnet mask to select the correct network Cluster Service Configuration Wizard Cluster IP Address The IP address identifies the cluster to the network Type the IP address for management of the cluster The subnet mask may be supplied automatically IP address 155 100 0 145 Subnet mask 255 255 255 0 Select the public network from which clients gain access to the cluster Network public y Best 10 Click Finish to complete the cluster configuration on the first node Cluster Installation 7 23 Copyright 2002 by LSI Logic Corporation All rights reserved Cluster Service Configuration Wizard i Sa xj Completing the Cluster Service Configuration Wizard You have successfully completed the Cluster Service Configuration wizard To complete the configuration click Finish The Cluster Service Setup Wizard completes the setup process for the first node by co
67. erved V Virtual sizing C 9 WwW WebBIOS Configuration Utility 4 11 Wide SCSI C 9 Windows NET 6 21 Windows 2000 6 21 Windows NT 4 7 6 21 Windows XP 6 21 Write back caching 6 15 IX 4 Index Copyright 2002 by LSI Logic Corporation All rights reserved LSI Logic Confidential Customer Feedback We would appreciate your feedback on this document Please copy the following page add your comments and fax it to us at the number shown If appropriate please also fax copies of any marked up pages from this document Important Please include your name phone number fax number and company address so that we may contact you directly for Clarification or additional information Thank you for your help in improving the quality of our documents MegaRAID SCSI 320 2 Hardware Guide 1 1 Copyright 2002 by LSI Logic Corporation All rights reserved LSI Logic Confidential Reader s Comments 1 2 Fax your comments to LSI Logic Corporation Technical Publications M S E 198 Fax 408 433 4333 Please tell us how you rate this document MegaRAID SCSI 320 2 Hard ware Guide Place a check mark in the appropriate blank for each cate gory Excellent Good Average Fair Poor Completeness of information Clarity of information Ease of finding information Technical content Usefulness of examples and illustrations Overall manual What could we do to improve this document If you
68. erved e Chapter 6 Hardware Installation explains how to install the MegaRAID SCSI 320 2 controller e Chapter 7 Installing and Configuring Clusters explains how to implement clustering to enable two independent servers to access the same shared data storage e Chapter 8 Troubleshooting provides troubleshooting information for the MegaRAID SCSI 320 2 controller e Appendix A SCSI Cables and Connectors describes the SCSI cables and connectors used with the MegaRAID SCSI 320 2 controller e Appendix B Audible Warnings explains the meaning of the warning tones generated by the MegaRAID SCSI 320 2 controller e Appendix C Glossary defines many terms used in this manual Technical Support If you need help installing configuring or running the MegaRAID SCSI 320 2 Controller you may be able to find the information you need at the MegaRAID support page at http megaraid silogic com If this does not resolve your problem you can call your LSI Logic OEM Technical Support representative at 678 728 1250 Before you call please complete the MegaRAID Problem Report form MegaRAID Problem Report Form Customer Information MegaRAID Information Name Today s Date Company Date of Purchase Address Invoice Number City State Serial Number Country Email Address Cache Memory Phone Firmware Version Fax BIOS Version vi Preface Copyright 2002 by LSI Logic Corporation
69. eset the charge cycles Select YES to reset the number of cycles to zero After 1100 charge cycles the life of the battery pack is assumed to be over and you must replace it 6 14 Hardware Installation Copyright 2002 by LSI Logic Corporation All rights reserved 6 2 7 2 6 2 7 3 6 2 7 4 Charging the Battery Pack The battery pack is shipped uncharged and you must charge it for 6 hours before you can use it The battery pack will not supply power for the full data retention time until it is fully charged It is a good idea to set the MegaRAID controller cache write policy option to Write Through during the battery pack charging period After the battery pack is fully charged you can change the cache write policy to Write Back Changing the Battery Pack The MegaRAID configuration software warns you when the battery pack must be replaced A new battery pack should be installed every 1 to 5 years The procedure for changing the battery pack is as follows 1 Bring down the operating system properly Make sure that cache memory has been flushed You must perform a system reset if operating under DOS When the computer reboots the MegaRAID SCSI 320 2 Ultra320 controller flushes cache memory 2 Turn the computer power off and remove the computer cover Remove the MegaRAID controller 4 Disconnect the battery pack cable or harness from J10 on the MegaRAID SCSI 320 2 Ultra320 controller 5 Install a new battery
70. ets In RAID this method is applied to entire drives or stripes across all disk drives in an array Parity data is distributed among all the drives in the system If a single disk drive fails the drive can be rebuilt from the parity of the respective data on the remaining drives An array virtual disk made up of logical disks rather than physical ones Also known as logical volume A hard disk drive that stores data A hard disk drive consists of one or more rigid magnetic discs rotating about a central axle with associated read write heads and electronics The ability of some adapters to detect when disk drives have been moved to a different slot in the computer for example after a hot swap A set of formal rules describing how to transmit data especially across a network Low level protocols define the electrical and physical standards to be observed bit and byte ordering and the transmission and error detection and correction of the bit stream High level protocols deal with the data formatting including the message syntax the terminal to computer dialogue character sets and sequencing of messages C 5 Copyright 2002 by LSI Logic Corporation All rights reserved RAID RAID Levels RAID Migration Read Ahead Ready State Rebuild Rebuild Rate Reconstruct C 6 Redundant Array of Independent Disks A data storage method in which data along with parity information is distributed among two or more hard
71. found errors in this document please specify the error and page number If appropriate please fax a marked up copy of the page s Please complete the information below so that we may contact you directly for clarification or additional information Name Date Telephone Fax Title Department Mail Stop Company Name Street City State Zip Customer Feedback Copyright 2002 by LSI Logic Corporation All rights reserved
72. gical drive Table 5 7 shows the drives required per RAID level Table 5 7 Number of Physical Drives per RAID Level Minimum of Physical Drives Maximum of Physical Drives 5 12 Configuring Physical Drives Arrays and Logical Drives Copyright 2002 by LSI Logic Corporation All rights reserved 5 4 Configuring Logical Drives After you have installed the MegaRAID SCSI 320 2 controller in the server and have attached all physical disk drives perform the following actions to prepare a RAID array 1 Optimize the MegaRAID SCSI 320 2 controller options for your system See Chapter 3 for additional information Press lt Ctrl gt lt M gt to run the MegaRAID Manager If necessary perform a low level format of the SCSI drives that will be included in the array and the drives to be used for hot spares 4 Customize the RAID array and define and configure one or more logical drives by selecting Easy Configuration or New Configuration 5 Create and configure one or more system drives logical drives by selecting the RAID level cache policy read policy and write policy 6 Save the configuration 7 Initialize the system drives After initialization you can install the operating system 5 4 1 Optimizing Data Storage 5 4 1 1 Data Access Requirements Each type of data stored in the disk subsystem has a different frequency of read and write activity If you know the data access requirements you can mo
73. h the end devices located as close as possible to the terminators The characteristic impedance of the cable should be 90 6 ohms for the REQ and ACK signals and 90 10 ohms for all other signals The stub length the distance from the controller s external connector to the mainline SCSI bus shall not exceed 0 1m approximately 4 inches The spacing of devices on the mainline SCSI bus should be at least three times the stub length All signal lines shall be terminated once at both ends of the bus powered by the TERMPWR line 8 6 Troubleshooting Copyright 2002 by LSI Logic Corporation All rights reserved Table 8 4 Other Potential Problems Cont Information Windows NT When Windows NT is installed using a bootable CD the devices on the Installation MegaRAID SCSI 320 2 are not recognized until after the initial reboot The Microsoft documented workaround is in SETUP TXT which is on the CD Perform the following steps to install drivers when Setup recognizes a supported SCSI host adapter but doesn t make the devices attached to it available for use 1 Restart Windows NT Setup 2 Press lt F6 gt to prevent Windows NT Setup from performing disk controller detection when Windows NT Setup displays the following Setup is inspecting your computer s hardware configuration This allows you to install the driver from the drivers disk you created All SCSI adapters must be installed manually Press lt S gt to di
74. he MegaRAID controller card in the cache memory socket Use a 72 bit 3 3 V single sided or double sided 168 pin unbuffered DIMM Lay the controller card component side up on a clean static free surface The memory socket is mounted flush with the MegaRAID card so the DIMM is parallel to the MegaRAID card when properly installed The DIMM clicks into place indicating proper seating in the socket The MegaRAID card is shown lying on a flat surface below Figure 6 1 Installing DIMM Memory 6 2 3 1 Installing or Changing Memory Important The battery pack harness or cable must be disconnected from J10 on the MegaRAID SCSI 320 2 Ultra320 card before you add or remove memory Perform the following steps to install or change memory 1 Bring down the operating system properly Make sure that cache memory has been flushed You must perform a system reset if operating under DOS When the computer reboots the MegaRAID controller will flush cache memory 2 Turn the computer power off Disconnect the power cables from the computer Remove the computer cover 4 Disconnect the battery pack cable from the MegaRAID controller 5 Remove the MegaRAID controller 6 4 Hardware Installation Copyright 2002 by LSI Logic Corporation All rights reserved 6 You can now add or remove DRAM modules from the MegaRAID controller as described above 7 Reattach the battery pack harness to J10 on the MegaRAID controller 8 Reinstall the MegaRAID
75. he first network adapter Local Area Connection is connected to the public network and the second network adapter Local Area Connection 2 is connected to the private cluster network This may not be the case in your network Renaming the Local Area Connections In order to make the network connection more clear you can change the name of the Local Area Connection 2 Renaming it will help you identify Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved the connection and correctly assign it Follow these steps to change the name 1 Right click on the Local Area Connection 2 icon Click on Rename In the text box type Private Cluster Connection and then press Enter Repeat steps 1 3 to change the name of the public LAN network adapter to Public Cluster Connection The renamed icons should look like those in the picture above Close the Networking and Dial up Connections window The new connection names automatically replicate to other cluster servers as the servers are brought online 7 4 5 Setting Up the First Node in Your Cluster Follow these steps to set up the first node in your cluster 1 Right click on My Network Places then click on Properties 2 Right click the Private Connection icon 3 Click on Status The Private Connection Status window shows the connection status as well as the speed of connection If the window shows that the network is d
76. iguration Utility 6 2 13 Step 13 Install the Operating System Driver 6 3 Summary Installing and Configuring Clusters xviii fal Overview 7 2 Benefits of Clusters 7 3 Installation and Configuration Driver Installation Instructions under Microsoft Windows 7 3 1 7 3 2 7 3 3 2000 Advanced Server Network Requirements Shared Disk Requirements 7 4 Cluster Installation 7 4 1 7 4 2 7 4 3 7 4 4 7 4 5 7 4 6 7 4 7 7 4 8 7 4 9 7 4 10 7 4 11 7 4 12 Contents Installation Overview Installing Microsoft Windows 2000 Setting Up Networks Configuring the Cluster Node Network Adapter Setting Up the First Node in Your Cluster Configuring the Public Network Adapter Verifying Connectivity and Name Resolution Verifying Domain Membership Setting Up a Cluster User Account Setting Up Shared Disks Configuring Shared Disks Assigning Drive Letters Copyright 2002 by LSI Logic Corporation All rights reserved 6 3 6 3 6 4 6 5 6 8 6 13 6 13 6 16 6 17 6 18 6 20 6 20 6 21 6 21 TA 72 7 2 72 7 4 7 5 7 5 7 5 77 7 7 7 8 7 9 7 10 zii 7 12 742 zig 7 14 7 15 7 4 13 Verifying Disk Access and Functionality 7 4 14 Installing Cluster Service Software 7 4 15 Configuring Cluster Disks 7 4 16 Validating the Cluster Installation 7 4 17 Configuring the Second Node 7 4 18 Verifying Installation 7 5 Installing SCSI Drives Tl Configuring the SCSI Devices 752 Terminating the Shared SCSI Bus Chap
77. iguration Cont SCSI ID Device Description Termination SCSI Channel 1 oO aoa oa a AJ Ww dw oO k ars n N oo Configuring SCSI Physical Drives 5 3 Copyright 2002 by LSI Logic Corporation All rights reserved Table 5 1 Physical Device Configuration Cont SCSI ID Device Description 14 15 5 1 4 Logical Drive Configuration Use Table 5 2 to record the configuration for your logical drives Table 5 2 Logical Drive Configuration Logical Logical Drive of Physical Drive Size Drives 5 4 Configuring Physical Drives Arrays and Logical Drives Copyright 2002 by LSI Logic Corporation All rights reserved Table 5 2 Logical Drive Configuration Cont Logical Stripe Logical Drive of Physical Drive Size Size Drives Configuring SCSI Physical Drives 5 5 Copyright 2002 by LSI Logic Corporation All rights reserved 5 1 5 Physical Device Layout Use Table 5 3 to record the physical device layout Table 5 3 Physical Device Layout Channel 0 Channel 1 Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number
78. information is written to several drives RAID 5 is best suited for networks that perform many small I O transactions simultaneously RAID 5 addresses the bottleneck issue for random I O operations Since each drive contains both data and parity numerous writes can take place concurrently In addition robust caching algorithms and hardware based RAID Levels Copyright 2002 by LSI Logic Corporation All rights reserved exclusive or assist make RAID 5 performance exceptional in many different environments Provides high data throughput especially for large files Use RAID 5 for transaction processing applications because each drive can read and write independently If a drive fails the MegaRAID SCSI 320 2 uses the distributed parity data to recreate all missing information Use also for office automation and online customer service that requires fault tolerance Use for any application that has high read request rates but low write request rates Strong Points Provides data redundancy and good performance in most environments Weak Points Disk drive performance is reduced if a drive is being rebuilt Environments with few processes do not perform as well because the RAID overhead is not offset by the performance gains in handling simultaneous processes Drives 3 to 30 Figure 3 3 shows a RAID 5 array with six disk drives Figure 3 3 RAID 5 Array Note Parity is distributed across drives in the array Segme
79. installation This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not occur in a specific installation If this equipment does cause harmful interference to radio or television reception which can be determined by turning the equipment off and on try to correct the interference by one or more of the following measures 1 Reorient or relocate the receiving antenna 2 Increase the separation between the equipment and the receiver 3 Connect the equipment into an outlet on a circuit different from that to which the receiver is connected 4 Consult the dealer or an experienced radio TV technician for help Shielded interface cables must be used with this product to ensure compliance with the Class B FCC limits Model Number Series 518 Disclaimer LSI Logic certifies only that this product will work correctly when this product is used with the same jumper settings the same system configuration the same memory module parts and the same peripherals that were tested by LSI Logic with this product The complete list of tested jumper settings system Configurations peripheral devices and memory modules are documented in the LSI LOGIC Compatibility Report for this product Call your LSI Logic sales representative for a copy of the Compatibility Re
80. ion All rights reserved Figure 3 4 RAID 10 Array MegaRAID Controller Data Flow I I I I I I I I I I I I Segment 5 Segment 5 I R Segment 1 Segment 1 Segment 2 Segment 2 Segment 3 Segment 3 Segment 4 Segment 4 Segment 6 Segment 6 ue nt Cie ere ADO Gs oa ee aes a a a ee 3 6 RAID 50 RAID 50 provides the features of both RAID 0 and RAID 5 including both parity and disk striping across multiple drives RAID 50 is best implemented on two RAID 5 disk arrays with data striped across both disk arrays RAID 50 breaks up data into smaller blocks and then stripes the blocks of data to each RAID 5 RAID set RAID 5 breaks up data into smaller blocks calculates parity by performing an exclusive or on the blocks and then writes the blocks of data and parity to each drive in the array The size of each block is determined by the stripe size parameter which is set during the creation of the RAID set RAID 50 Copyright 2002 by LSI Logic Corporation All rights reserved RAID 50 can sustain one to four drive failures while maintaining data integrity if each failed disk is in a different RAID 5 array Works best when used with data that requires high reliability high request rates high data transfer and medium to large capacity Strong Points Provides high data throughput data redundancy and very good performance Weak Points Requires 2 to 4 times as many parity drives as RAID 5
81. ion 4 12 Compatibility MegaRAID is a family of high performance intelligent PCl to SCSI host adapters with RAID control capabilities The MegaRAID SCSI 320 2 has two SCSI channels that support Ultra320 and Wide SCSI with data transfer rates of up to 320 Mbytes s Each SCSI channel supports up to 15 Wide devices and up to seven non Wide devices MegaRAID SCSI 320 2 features include e Remote configuration and array management through MegaRAID WebBIOS e High performance I O migration path while preserving existing PCI SCSI software MegaRAID SCSI 320 2 Hardware Guide 4 1 Copyright 2002 by LSI Logic Corporation All rights reserved 4 2 e SCSI data transfers up to 320 Mbytes s e Synchronous operation on a wide LVD SCSI bus e Up to 15 LVD SCSI devices on each of the Wide buses e Up to 256 Mbytes of 3 3 V PC100 or faster SDRAM cache memory in one single sided or double sided DIMM socket Cache memory is used for read and write back caching and for RAID 5 parity generation e Non volatile random access memory NVRAM storage for RAID configuration data e Audible alarm e Direct memory access DMA chaining support e Separate DRAM bus e Support for differential or single ended SCSI with active termination e Up to 12 MegaRAID 320 2 cards per system e Support for up to 15 SCSI devices per channel e Support for RAID levels 0 1 5 10 and 50 e Support for scatter gather and tagged command queuing e Ability to mul
82. isconnected examine cables and connections to resolve the problem before proceeding 4 Click on Close 5 Right click Private Connection again 6 Click on Properties 7 Click on Configure 8 Click on Advanced The network card adapter properties window displays 9 You should set network adapters on the private network to the actual speed of the network rather than the default automated speed selection Cluster Installation 7 9 Copyright 2002 by LSI Logic Corporation All rights reserved 10 11 12 13 14 15 16 17 18 Select the network speed from the drop down list Do not use Auto select as the setting for speed Some adapters can drop packets while determining the speed Set the network adapter speed by clicking the appropriate option such as Media Type or Speed Configure identically all network adapters in the cluster that are attached to the same network so they use the same Duplex Mode Flow Control Media Type and so on These settings should stay the same even if the hardware is different Click on Transmission Control Protocol Internet Protocol TCP IP Click on Properties Click on the radio button for Use the following IP address Enter the IP addresses you want to use for the private network Type in the subnet mask for the network Click the Advanced radio button then select the WINS tab Select Disable NetBIOS over TCP IP Click OK to return to the previous menu Perfor
83. itions and must have a drive letter assigned to it Right click on the desired partition and select Change Drive Letter and Path Select a new drive letter Repeat steps 1 and 2 for each shared disk Close the Computer Management window 7 4 13 Verifying Disk Access and Functionality Perform the following steps to verify disk access and functionality 1 Click on Start Click on Programs Click on Accessories then click on Notepad 3 Type some words into Notepad and use the File Save As command to save it as a test file called test txt Close Notepad 4 Double click on the My Documents icon 5 Right click on test txt and click on Copy 6 Close the window 7 Double click on My Computer 8 Double click on a shared drive partition 9 Click on Edit and click on Paste 10 A copy of the file should now exist on the shared disk 11 Double click on test txt to open it on the shared disk 12 Close the file Cluster Installation 7 15 Copyright 2002 by LSI Logic Corporation All rights reserved 13 Highlight the file and press the Del key to delete it from the clustered disk 14 Repeat the process for all clustered disks to make sure they can be accessed from the first node After you complete the procedure shut down the first node power on the second node and repeat the procedure above Repeat again for any additional nodes After you have verified that all nodes can read and write from the disks tur
84. k if that disk is not yet protected by the cluster software Cluster Installation 7 5 Copyright 2002 by LSI Logic Corporation All rights reserved Table 7 1 shows which nodes and storage devices should be powered on during each step Table 7 1 Nodes and Storage Devices Storage Commenis Set Up Networks Make sure that power to all storage devices on the shared bus is turned off Power on all nodes Set up Shared Disks Power down all nodes Next power on the shared storage then power on the first node Verify Disk Configuration Shut down the first node Power on the second node Configure the First Node Shut down all nodes Power on the first node Configure the Second Power on the second node after the first Node node was successfully configured Post installation All nodes should be active Before installing the Cluster Service software you must follow the steps below e Install Windows 2000 Advanced Server or Windows 2000 Datacenter Server on each node e Set up networks e Set up disks Note These steps must be completed on every cluster node before proceeding with the installation of Cluster Service on the first node To configure the Cluster Service on a Windows 2000 based server you must be able to log on as administrator or have administrative permissions on each node Each node must be a member server or must be a domain controller inside the same domain A mix of dom
85. k Cancel 14 Click on Next The Add or Remove Managed Disks screen displays next This screen is in the following section about configuring cluster disks 7 4 15 Configuring Cluster Disks 7 18 Windows 2000 Managed Disks displays all SCSI disks as shown on the screen below It displays SCSI disks that do not reside on the same bus as the system disk Because of this a node that has multiple SCSI buses will list SCSI disks that are not to be used as shared storage You must remove any SCSI disks that are internal to the node and not to be shared storage Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved Cluster Service Configuration Wizard Add or Remove Managed Disks The disks that Cluster service controls access to are known as managed disks Add the disks that you want the cluster to manage Remove those disks that you do not want the cluster to manage Unmanaged disks Managed disks Add Disk 1 MEGARAID LD Ob E New Volume Disk 2 MEGARAID LD 1b F New Volume lt Remove i gt i Caution The likelihood of corruption of unmanaged NTFS disks on a shared bus is very high It is recommended that you use Cluster service to manage these disks lt Back Cancel In production clustering scenarios you need to use more than one private network for cluster communication to avoid having a single point of failure Cluster Service
86. l rights reserved 2 3 7 Disk Spanning Disk spanning allows multiple disk drives to function like one big drive Spanning overcomes lack of disk space and simplifies storage management by combining existing resources or adding relatively inexpensive resources For example four 60 Gbyte disk drives can be combined to appear to the operating system as one single 240 Gbyte drive Disk spanning alone does not provide reliability or performance enhancements Spanned logical drives must have the same stripe size and must be contiguous In Figure 2 3 two RAID 1 arrays are turned into a RAID 10 array Figure 2 3 Disk Spanning MegaRAID Coniroller Data Flow l i l l Li l i V1 l i LI 1 ty 11 i ty 11 i oy LI 1 toy 11 i ty 11 i i l i l l l l Il l l i 1 Segment 1 Segment 1 i 1 Segment 2 Segment 2 i Segment 3 Segment 3 Segment 4 Segment 4 ri i Segment 5 Segment 5 I i Segment 6 Segment 6 1 ieee ORE OOO OEE Os SPU PRESLEY Cee AE eee a SPE ROO OD ANERE EEEE EA a1 l RAID 0 1 The controller supports a span depth of eight This means that eight RAID 1 3 or 5 arrays can be spanned to create one logical drive RAID Overview 2 7 Copyright 2002 by LSI Logic Corporation All rights reserved 2 3 8 Parity Table 2 1 describes how disk spanning is used for RAID 10 and RAID 50 Table 2 1 Spanning for RAID 10 and RAID 50 Configure RAID 10 by spanning two contiguous RAID 1 logical drives The RAID 1 logical d
87. l rights reserved Disk Subsystem Double Buffering Failed Drive Fast SCSI Firmware FlexRAID Power Fail Option Format GByte Host based Array provides high I O performance at low cost but provides lowers data reliability than any of its member disks A collection of disks and the hardware that connects them to one or more host computers The hardware can include an intelligent controller or the disks can attach directly to a host computer I O bus adapter A technique that achieves maximum data transfer bandwidth by constantly keeping two I O requests for adjacent data outstanding A software component begins a double buffered I O stream by issuing two requests in rapid sequence Thereafter each time an I O request completes another is immediately issued If the disk subsystem is capable of processing requests fast enough double buffering allows data to be transferred at the full volume transfer rate A drive that has ceased to function or consistently functions improperly A variant on the SCSI 2 standard It uses the same 8 bit bus as the original SCSI 1 but runs at up to 10 Mbytes double the speed of SCSI 1 Software stored in read only memory ROM or Programmable ROM PROM Firmware often controls the behavior of a system when it is first turned on A typical example would be a monitor program in a computer that loads the full operating system from disk or from a network and then passes control to th
88. le 4 2 lists the array performance features Table 4 2 Specification Array Performance Features Feature Host data transfer rate 532 Mbytes s Drive data tra nsfer rate 320 Mbytes s Stripe sizes 2 4 8 16 32 64 or 128 Kbytes 4 5 RAID Management Features Table 4 3 lists the RAID management features Table 4 3 Specification Support for SNMP RAID Management Features Feature Performance Monitor provided Remote control and monitoring Drive roaming Support for concurrent multiple stripe sizes Windows NT client utility 2000 XP and NET server support using a GUI Array Performance Features 4 5 Copyright 2002 by LSI Logic Corporation All rights reserved 4 6 Fault Tolerance Features Table 4 4 lists the fault tolerance features Table 4 4 Fault Tolerance Features Specification Support for SMART Feature Yes Optional battery backup for cache memory Standard Provided on the MegaRAID Controller Up to 72 hours data retention Enclosure management SCSl accessed fault tolerant enclosure SAF TE compliant Drive failure detection Automatic Drive rebuild using hot spares Automatic and transparent Parity generation and checking 4 7 Software Utilities Table 4 5 lists the software utility Table 4 5 Software Utilities Specification FlexRAID reconfiguration on the fly Software and hardware
89. m this step for the private network adapter only 7 4 6 Configuring the Public Network Adapter 7 10 Note Itis strongly recommended that you use static IP addresses for all network adapters in the cluster This includes both the network adapter used to access the cluster nodes and the network adapter used to access the LAN Local Area Network If you must use a dynamic IP address through DHCP access to the cluster could be terminated and become unavailable if the DHCP server goes down or goes offline The use of long lease periods is recommended to assure that a dynamically assigned IP address remains valid in the event that the DHCP server is temporarily lost In all cases set static IP addresses for the private network connector Note that Cluster Service will recognize only one network interface per subnet Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved 7 4 7 Verifying Connectivity and Name Resolution Perform the following steps to verify that the network adapters are working properly OV Be o O a Note Before proceeding you must know the IP address for each network card adapter in the cluster You can obtain it by using the IPCONFIG command on each node Click on Start Click on Run Type cmd in the text box Click on OK Type ipconfig all and press Enter IP information displays for all network adapters in the machine If you do not already have the c
90. n 5 15 Copyright 2002 by LSI Logic Corporation All rights reserved 5 16 Configuring Physical Drives Arrays and Logical Drives Copyright 2002 by LSI Logic Corporation All rights reserved Chapter 6 Hardware Installation This chapter explains how to install the MegaRAID SCSI 320 2 controller It contains the following sections e Section 6 1 Hardware Requirements e Section 6 2 Installation Steps e Section 6 3 Summary 6 1 Hardware Requirements You must have the following in order to install the MegaRAID SCSI 320 1 controller and create arrays e A host computer with the following A motherboard with 5 V 3 3 V PCI expansion slots that has an available expansion slot Support for PCI version 2 2 or later ntel Pentium Pentium Pro or more powerful CPU Floppy drive color monitor VGA adapter card mouse and keyboard e The MegaRAID SCSI 320 2 Installation CD e The necessary internal and or external SCSI cables and terminators this depends on the number and type of SCSI devices to be attached e An Uninterruptible Power Supply UPS for the entire system e Ultra320 SCSI disk drives and other SCSI devices as desired Important The MegaRAID SCSI 320 2 controller must be installed in a PCI expansion slot MegaRAID SCSI 320 2 Hardware Guide 6 1 Copyright 2002 by LSI Logic Corporation All rights reserved 6 1 1 Optional Equipment You may also want to install SCSI
91. n My Computer Click on Manage then click on Storage Double click on Disk Management Make sure that all shared disks are formatted as NTFS and are designated as Basic If you connect a new drive the Write Signature and Upgrade Disk Wizard starts automatically If this occurs click on Next to go through the wizard The wizard sets the disk to dynamic but you can uncheck it at this point to set it to basic To reset the disk to Basic right click on Disk where identifies the disk that you are working with and click on Revert to Basic Disk Right click on unallocated disk space Click on Create Partition The Create Partition Wizard begins Click on Next twice Enter the desired partition size in Mbytes and click on Next Accept the default drive letter assignment by clicking on Next 10 Click on Next to format and create a partition Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved 7 4 12 Assigning Drive Letters After you have configured the bus disks and partitions you must assign drive letters to each partition on each clustered disk Follow these steps to assign drive letters 4 Note Mountpoints is a feature of the file system that lets you mount a file system using an existing directory without assigning a drive letter Mountpoints is not supported on clusters Any external disk that is used as a cluster resource must be partitioned using NTFS part
92. n off all nodes except the first and continue with this guide 7 4 14 Installing Cluster Service Software 7 16 Before you begin the Cluster Service Software installation on the first node make sure that all other nodes are either powered down or stopped and that all shared storage devices are powered on To create the cluster you must provide the cluster information The Cluster Configuration Wizard allows you to input this information Follow these steps to use the Wizard Click on Start Click on Settings then click on Control Panel Double click on Add Remove Programs Double click on Add Remove Windows Components De g O Select Cluster Service then click on Next Cluster Service files are located on the Windows 2000 Advanced Server or Windows 2000 Datacenter Server CD ROM 6 Enter x i386 where x is the drive letter of your CD ROM If you installed Windows 2000 from a network enter the appropriate network path instead If the Windows 2000 Setup flashscreen displays close it 7 Click on OK The Cluster Service Configuration Window displays 8 Click on Next The Hardware Configuration Certification window appears Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved 9 Click on I Understand to accept the condition that Cluster Service is supported only on hardware listed on the Hardware Compatibility List This is the first node in the cluster therefor
93. nd public network adapters connected to the public network View the Network and Dial up Connections screen to check the connections Cluster Installation 7 7 Copyright 2002 by LSI Logic Corporation All rights reserved EY Network and Dial up Connections File Edit View Favorites Tools Advanced Help Kal Back gt E search Gyrolders GBristory Ay GE X A Ea Address E Network and Dial up Connections Go el Public Adapter Status Enabled Name Make New Connection Network and Dial Private LAN up Connections Type LAN Connection Intel R PRO 100 Management Intel R PRO 100 Management Adapter a Note Use crossover cables for the network card adapters that access the cluster nodes If you do not use the crossover cables properly the system will not detect the network card adapter that accesses the cluster nodes If the network card adapter is not detected then you cannot configure the network adapters during the Cluster Service installation However if you install Cluster Service on both nodes and both nodes are powered on you can add the adapter as a cluster resource and configure it properly for the cluster node network in Cluster Administrator 7 4 4 Configuring the Cluster Node Network Adapter 7 4 4 1 7 8 Note The wiring determines which network adapter is private and which is public For the purposes of this chapter t
94. nt 1 Segment 7 Parity 9 12 MegaRAID Coniroller Data Flow Segment 2 Segment 3 Segment 4 Segment 5 Segment 6 Segment 8 Segment 9 Segment 10 Segment 11 Segment 12 Parity 5 8 Parity 1 4 RAID 5 3 5 Copyright 2002 by LSI Logic Corporation All rights reserved 3 5 RAID 10 3 6 RAID 10 is a combination of RAID 0 and RAID 1 RAID 10 has mirrored drives RAID 10 breaks up data into smaller blocks and then stripes the blocks of data to each RAID 1 RAID set Each RAID 1 RAID set then duplicates its data to its other drive The size of each block is determined by the stripe size parameter which is set during the creation of the RAID set RAID 10 can sustain one to four drive failures while maintaining data integrity if each failed disk is in a different RAID 1 array Works best for data storage that must have 100 redundancy of mirrored arrays and that also needs the enhanced I O performance of RAID 0 striped arrays RAID 10 works well for medium sized databases or any environment that requires a higher degree of fault tolerance and moderate to medium capacity Strong Points Provides both high data transfer rates and complete data redundancy Weak Points Requires twice as many drives as all other RAID levels except RAID 1 Drives Figure 3 4 shows RAID Levels 4 to 30 must be a multiple of 2 a RAID 10 array with four disk drives Copyright 2002 by LSI Logic Corporat
95. nt selected when you installed the first node Always use the same account you used when you set up the first cluster node Enter the password for the account if there is one then click Next At the next dialog box click Finish to complete configuration The Cluster Service will start Click OK Close Add Remove Programs If you install additional nodes repeat the preceding steps to install Cluster Service on all other nodes 7 4 18 Verifying Installation 7 26 There are several ways to verify that Cluster Service was successfully installed Here is a simple one 1 Click Start click Programs click Administrative Tools then click Cluster Administrator The presence of two nodes pictured below shows that a cluster exists and is in operation Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved amp Cluster Administrator CLUSTERONE ey File view Window Help lel x Name State Description a Groups E Groups i Cluster Group Resources Disk Group 1 Cluster Configuration Resources H BENCH4SERVER1 Up d Cluster Configuration aqe server2 Up 9 Resource Types a Networks interconnect public 9 Network Interfaces Ela B4SERVERZ 9 Active Groups DD Active Resources C Network Interfaces El BENCH4SERVER1 9 Active Groups I Active Resources 9 Network Interfaces For Help press F1 A 2 Right click
96. ntroller 4 8 SCSI Data Transfer Rate 4 8 SCSI Device Types Supported 4 8 Serial Port 4 8 Termination Disable 4 8 Mirroring 2 6 MS DOS 6 21 Multi threaded C 5 Multi threading 4 11 N Nonvolatile RAM 4 8 Novell NetWare 4 7 6 21 NVRAM 1 2 0 Offline 2 10 Onboard Speaker 4 9 Online Drive state 2 10 Operating environment C 5 Operating system software drivers 4 7 Operating Voltage 4 8 Optimal 2 10 Optimizing Data Storage 5 13 Copyright 2002 by LSI Logic Corporation All rights reserved OS 2 2 x 4 12 Other BIOS error messages 8 5 P Parity 2 8 C 5 Partition C 5 Physical array 2 3 Physical disk C 5 Physical disk roaming C 5 Physical drive 2 3 Power Console Plus 4 12 6 15 Processor 4 7 Product specifications 4 7 Protocol C 5 R RAID C 6 Benefits 2 1 Introduction to 2 1 RAID 0 3 2 RAID 1 3 3 Spanning to configure RAID 10 2 8 RAID 10 3 6 Configuring 2 8 RAID 5 3 4 Spanning to make RAID 50 2 8 RAID 50 3 7 Configuring 2 8 RAID benefits Improved I O 2 1 Increased reliability 2 2 RAID levels 1 v 3 1 C 6 RAID Levels Supported 4 8 RAID management 4 11 RAID management features 4 5 RAID migration C 6 RAID overview 2 3 Read ahead C 6 Ready 2 10 Ready state C 6 Rebuild 2 10 4 11 Rebuild rate 2 10 C 6 Rebuilding a disk 2 9 Reconnect 4 10 Reconstruct C 6 Reconstruction C 6 Red Hat Linux 6 21 RedAlert 4 12 Redundancy C 7 Replacement disk C 7 Replacement unit C 7 S SAF TE C 7 Sca
97. o downtime The MegaRAID SCSI 320 2 RAID Management software allows you to specify physical drives as hot spares When a hot spare is needed the MegaRAID SCSI 320 2 controller assigns the hot spare that Introduction to RAID Copyright 2002 by LSI Logic Corporation All rights reserved has a capacity closest to and at least as great as that of the failed drive to take the place of the failed drive Note Hot spares are used only in arrays with redundancy for example RAID levels 1 5 10 and 50 A hot spare connected to a specific MegaRAID SCSI 320 2 controller can be used only to rebuild a drive that is connected to the same controller 2 3 10 Hot Swapping Hot swapping is the manual replacement of a defective physical disk unit while the computer is still running When a new drive has been installed you must issue a command to rebuild the drive The MegaRAID controller can be configured to detect the new disks and to rebuild the contents of the disk drive automatically 2 3 11 Disk Rebuild 2 3 11 1 You rebuild a disk drive by recreating the data that had been stored on the drive before the drive failed Rebuilding can be done only in arrays with data redundancy such as RAID level 1 5 10 and 50 Standby warm spare rebuild is employed in a mirrored RAID 1 system If a disk drive fails an identical drive is immediately available The primary data source disk drive is the original disk drive A hot spare can be used to
98. ommand prompt on your screen click on Start Click on Run In the text box type cmd Click on OK Type ping ipaddress where ipaddress is the IP address for the corresponding network adapter in the other node For example assume that the IP addresses are set as follows Network Name Network Adapter IP Address Public Cluster Connection 192 168 0 171 Private Cluster Connection 10 1 1 1 Public Cluster Connection 192 168 0 172 Private Cluster Connection 10 1 1 2 In this example you would type Cluster Installation 7 11 Copyright 2002 by LSI Logic Corporation All rights reserved Ping 192 168 0 172 and Ping 10 1 1 1 from Node 1 Then you would type Ping 192 168 0 172 and 10 1 1 1 from Node 2 To confirm name resolution ping each node from a client using the node s machine name instead of its IP number 7 4 8 Verifying Domain Membership All nodes in the cluster have to be members of the same domain and capable of accessing a domain controller and a DNS Server You can configure them as either member servers or domain controllers If you plan to configure one node as a domain controller you should configure all other nodes as domain controllers in the same domain as well 7 4 9 Setting Up a Cluster User Account 7 12 The Cluster Service requires a domain user account that the Cluster Service can run under You must create the user account before installing the Cluste
99. on Disk SCSI Devices eee ee er ee ee ee ee ee ee ee ee ee er ee ee IDO Boot Drive No Termination ID1 No Termination ID2 Termination Enabled SSS es eo Se a ee a ee to ee ee a Fa E Mss ee ess ra Na a a a Pe As a aaa Pina aah ee EE SEN sy jel ce la Na E A a pice E Termination No Termination Enabled External SCSI External SCSI CD ROM Drive Tape Drive 6 12 Hardware Installation Copyright 2002 by LSI Logic Corporation All rights reserved 6 2 6 Step 6 Set SCSI Terminator Power J17 and J18 control the termination power setting for the MegaRAID 320 2 SCSI channels as explained in Section 6 2 4 6 J17 J18 SCSI Bus Termination Power page 6 8 By default jumper installed on pins 1 and 2 of J17 and J18 the PCI bus supplies termination power See the documentation for each SCSI device for information about enabling TermPWR Important The SCSI channels need Termination power to operate If a channel is not being used and no auxiliary power source is connected change the jumper setting for that channel to supply TermPWR from the PCI bus 6 2 7 Step 7 Install Battery Pack Optional You can install a battery pack on the RAID controller using the J10 connector The battery pack provides emergency power to the MegaRAID 320 2 SCSI controller in the event of power failure e LSI Logic Part Number BAT NIMH 3 6 02 e Description Battery NIMH 3 6 V 600 mA onboard
100. on features for the MegaRAID 320 2 Table 4 1 Configuration Features Specification Feature RAID levels 0 1 5 10 and 50 SCSI channels 2 Maximum number of drives per channel 15 Array interface to host PCI 2 2 PCI bus master Supports write invalidate Drive interface Wide Ultra320 Upgradable cache memory sizes 32 64 128 or 256 Mbytes Cache function Write back Write through Adaptive Read Ahead Non Read Ahead Read Ahead SMART Technology 4 3 Copyright 2002 by LSI Logic Corporation All rights reserved Table 4 1 Configuration Features Cont Specification Feature Multiple logical drives arrays per Up to 40 logical drives per controller controller Maximum number of MegaRAID 12 controllers per system Online capacity expansion Hot spare support Flashable firmware Hot swap devices supported Non disk devices supported Mixed capacity hard drives Number of internal SCSI connectors Number of external SCSI connectors Support for hard drives with capacities of more than 8 Gbytes Clustering support Failover control Online RAID level migration No reboot necessary after expansion More than 200 Qtags per physical drive Hardware clustering support on the board User specified rebuild rate Features Copyright 2002 by LSI Logic Corporation All rights reserved 4 4 Array Performance Features Tab
101. on to the information on the next page refer to the documentation from the SCSI device manufacturer or the SCSI specifications which can be ordered from the American National Standards Institute ANSI The ANSI web site contains a catalog that you can search for the SCSI specifications Configuring the SCSI Devices Each device on the shared SCSI bus must have a unique SCSI ID Since most SCSI controllers default to SCSI ID 7 part of configuring the shared SCSI bus will be to change the SCSI ID on one controller to a different SCSI ID such as SCSI ID 6 If there is more than one disk that will be on the shared SCSI bus each disk must also have a unique SCSI ID Some SCSI controllers reset the SCSI bus when they initialize at boot time If this occurs the bus reset can interrupt any data transfers between the other node and disks on the shared SCSI bus Therefore SCSI bus resets should be disabled if possible 7 5 2 Terminating the Shared SCSI Bus 7 28 You can connect Y cables to devices if the device is at the end of the SCSI bus You can then attach a terminator to one branch of the Y cable to terminate the SCSI bus This method of termination requires either disabling or removing any internal terminators the device has Note Any devices that are not at the end of the shared bus must have their internal termination disabled Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved
102. or a defective one where the substitution can be performed while the subsystem is running Hot swaps are done manually A host computer software component usually part of the operating system that controls the operation of peripheral controllers or adapters attached to the host computer I O drivers communicate between applications and I O devices and in some cases they participate in data transfer The process of writing zeros to the data fields of a logical drive and generating the corresponding parity to put the logical drive in a Ready state Initializing erases previous data and generates parity so that the logical drive will pass a consistency check Arrays can work without initialization but they can fail a consistency check because the parity fields have not been generated A set of contiguous chunks on a physical disk Logical disks are used in array implementations as constituents of logical volumes or partitions Logical disks are normally transparent to the host environment except when the array containing them is being configured A virtual drive within an array that can consist of more than one physical drive Logical drives divide the contiguous storage space of an array of disk drives or a spanned group of arrays of drives The storage space in a logical drive is spread across all the physical drives in the array or spanned arrays Configure at least one logical drive for each array The conversion between multiple data a
103. ork Network name finterconnest Device Intel R PRO 100 Management Adapter 2 IP address 200 200 200 125 JV Enable this network for cluster use This network performs the following role in the cluster Client access only public network All communications mixed network lt Back Cancel In this example both networks are configured so that both can be used for internal cluster communication The next dialog window offers an option to modify the order in which the networks are used Because Private Cluster Connection represents a direct connection between nodes it remains at the top of the list In normal operation this connection is used for cluster communication In case of the Private Cluster Connection failure Cluster Service automatically switches to the next network on the list in this case Public Cluster Connection 8 Verify that the first connection in the list is the Private Cluster Connection then click on Next Note Always set the order of the connections so that the Private Cluster Connection is first in the list 7 22 Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved Cluster Service Configuration Wizard Internal Cluster Communication Specify the priority in which the available networks should be used for communication within the cluster The following list displays the networks available for internal clust
104. ot swap drives MegaRAID SCSI 320 2 provides hot swapping through the hot spare feature A hot spare drive is an unused online available drive that MegaRAID SCSI 320 2 instantly plugs into the system when an active drive fails After the hot spare is automatically moved into the RAID subsystem the failed drive is automatically rebuilt The RAID disk array continues to handle request while the rebuild occurs 2 3 5 Disk Striping 2 4 Disk striping writes data across multiple disk drives instead of just one disk drive as shown in Figure 2 1 Introduction to RAID Copyright 2002 by LSI Logic Corporation All rights reserved Figure 2 1 Disk Striping MegaRAID Coniroller Segment 1 Segment 2 Segment 3 Segment 4 Segment 5 Segment 6 Segment 7 Segment 8 Segment 9 Segment 10 Segment 11 Segment 12 Disk striping involves partitioning each disk drive s storage space into stripes that can vary in size from 2 to 128 Kbytes These stripes are interleaved in a repeated sequential manner The combined storage space is composed of stripes from each drive MegaRAID SCSI 320 2 supports stripe sizes of 2 4 8 16 32 64 or 128 Kbytes For example in a four disk system using only disk striping as in RAID level 0 segment 1 is written to disk 1 segment 2 is written to disk 2 and so on Disk striping enhances performance because multiple drives are accessed simultaneously but disk striping does not provide data redundancy 2 3 5 1 St
105. ote To convert to 2 56 holes use Pini screwlock kit 749087 1 749087 2 or 750644 1 from ooo0o0r0r0r00r00C0O00C 0O C C O OC OC OC CO 0O C0C OCC0OO AMP Oooooo00o00000000000000000000000000 AAAA AAAA AAAA AAAA AAAA teeter Connectors B 68 Position Plug raaa aaa Male a AMP 786090 7 mint css AME LENE L cable Fat ion or Tite ar Prdedeeeeeriricteeeeateteniiriereeteneeeiiieiii Flat Cable 68 Conductor 0 025 Centerline ooooogogogooooOooo0oo0o00000000o000o0R0o0000o00 30 AWG Ooogogogogocooocoo0o0o00o000000000000000000 68 Pin High Density SCSI Internal Connector A 3 Copyright 2002 by LSI Logic Corporation All rights reserved A 1 3 Converting Internal Wide to Internal Non Wide Type 2 The cable assembly for converting internal Wide SCSI connectors to internal non Wide Type 2 SCSI connectors is shown below 68 Position 50 Position Pin 1 Connector Connector Contact Number Contact Number 6 e _ __ e 40 e _ _ _e 7 e _ _ 41 eo _ _ _ __e TUTTE AAAA VETTE AVVVVVDYV NUON TITEL VVVVVVDVVN NUEVAS TUTTE TTT AAAA RONM TUTTE LTD AAA Pin 1 PTT vna m PTE vanna a KAUAE roop ponon e 49 e _____ _e 20 16 e _e 21 ficient ari nino 17 Open 23 P A a 51 Open 24 A n a 18 Open 25 m a ne 52 e _ _ _ __e 26 o _____ za 19 27 Connector A 68 Position Plug Male AMP 749925 5 29 47 Connector B 50
106. pack and connect the new battery pack to J10 6 Disable write back caching using MegaRAID Manager or Power Console Plus Disposing of a Battery Pack Warning Do not dispose of the MegaRAID battery pack by fire Do not mutilate the battery pack Do not damage it in any way Toxic chemicals can be released if it is damaged Do not short circuit the battery pack The material in the battery pack contains heavy metals that can contaminate the environment Federal state and local laws prohibit disposal of some rechargeable batteries in public landfills These Installation Steps 6 15 Copyright 2002 by LSI Logic Corporation All rights reserved batteries must be sent to a specific location for proper disposal Call the Rechargeable Battery Recycling Corporation at 352 376 6693 FAX 352 376 6658 for an authorized battery disposal site near you For a list of battery disposal sites write to Rechargeable Battery Recycling Corporation 2293 NW 41st Street Gainesville FL 32606 Voice 352 376 6693 FAX 352 376 6658 Important Most used Nickel Metal Hydride batteries are not classified as hazardous waste under the federal RCRA Resource Conservation and Recovery Act Although Minnesota law requires that Nickel Metal Hydride batteries be labeled easily removable from consumer products and that Nickel Metal Hydride batteries must be collected by manufacturers the Minnesota Pollution Control Agency MPCA has granted a tempora
107. port for this product iii Copyright 2002 by LSI Logic Corporation All rights reserved iv Copyright 2002 by LSI Logic Corporation All rights reserved Audience Organization Preface This book is the primary reference and Hardware Guide for the LSI Logic MegaRAID SCSI 320 2 Controller It contains instructions for installing the MegaRAID controller and for configuring RAID arrays It also contains background information on RAID The MegaRAID SCSI 320 2 controller supports single ended and low voltage differential LVD SCSI devices on two Ultra320 and Wide SCSI channels with data transfer rates up to 320 Mbytes s This document is intended for people who need to install the MegaRAID SCSI 320 2 Controller in a server and then create and configure RAID arrays This document has the following chapters and appendixes e Chapter 1 Overview provides an overview of the MegaRAID SCSI 320 2 and basic SCSI features e Chapter 2 Introduction to RAID introduces important RAID concepts e Chapter 3 RAID Levels describes each supported RAID level and the factors to consider when choosing a RAID level e Chapter 4 Features explains the features of the MegaRAID SCSI 320 2 e Chapter 5 Configuring Physical Drives Arrays and Logical Drives explains how to configure SCSI physical drives arrays and logical drives MegaRAID SCSI 320 2 Hardware Guide v Copyright 2002 by LSI Logic Corporation All rights res
108. pying the files needed to complete the installation of Cluster Service Windows Components Wizard Configuring Components Setup is making the configuration changes you requested Please wait while Setup configures the components This may take several minutes depending on the components selected Status Configuring Cluster service After the files are copied the Cluster Service registry entries are created the log files on the quorum resource are created and the Cluster Service is started on the first node 7 24 Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved 11 When a dialog box appears telling you that Cluster Service has started successfully Click on OK Cluster Service Configuration Wizard xj Completing the Cluster Service Configuration Wizard You have successfully completed the Cluster Service Configuration wizard Starting the Cluster service ETRENLECERIRCRERAEE Cluster Service Configuration Wizard ED x Ca Cluster service has started successfully To manage the cluster use Cluster Administrator You can locate this tool by opening Control Panel and clicking Administrative Tools lt Back Finish 12 Close the Add Remove Programs window 7 4 16 Validating the Cluster Installation Use the Cluster Administrator snap in to validate the Cluster Service installation on the first node Follow these steps to validate th
109. r Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level xii Preface Copyright 2002 by LSI Logic Corporation All rights reserved Physical Device Layout Cont Channel 0 Channel 1 Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Preface xiii Copyright 2002 by LSI Logic Corporation All rights reserved xiv Preface Copyright 2002 by LSI Logic Corporation All rights reserved Contents Chapier 1 Overview 4 1 2 1 3 1 4 1 5 1 6 7 Chapter 2 Introduction to RAID 2 1 2 2 2 3 SCSI Channels NVRAM and Flash ROM SCSI Connectors Single Ended and Differential SCSI Buses Maximum Cable Length for SCSI Standards SCSI Bus Widths and Maximum Throughput Documentation LEA MegaRAID SCSI 320 2 Hardware Guide Le MegaRAID Configuration Software Guide LAS MegaRAID Operating System Driver Installation Guide RAID Benefits 2 1 1 Improved I O 2 12 Increased Reliability MegaRAID SCSI 320 2 Host Based RAID Solution Peel Host Based RAID 2 2 2 SCSl to SCSI External RAID RAID Overview 2 3 1 Physical Array Aaa Logical Drive 20 0 Consistency Check 2 3 4 Fault Tolerance 2 3 5 Disk Striping 2 3
110. r Service The reason for this is that setup requires a user name and password This user account should not belong to a user on the domain Follow these steps to set up a cluster user account 1 Click on Start 2 Point to Programs then point to Administrative Tools 3 Click on Active Directory Users and Computers 4 Click the plus sign to expand the domain name if it is not already expanded 5 Click on Users Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved N 11 12 13 14 15 Right click on Users Point to New and click on User Type in the cluster name and click on Next Set the password settings to User Cannot Change Password and Password Never Expires Click on Next then click on Finish to create this user Note If your company s security policy does not allow the use of passwords that never expire you must renew the password on each node before password expiration You must also update the Cluster Service configuration Right click on Cluster in the left pane of the Active Directory Users and Computers snap in Select Properties from the context menu Click on Add Members to a Group Click on Administrators and click on OK This gives the new user account administrative privileges on this computer Close the Active Directory Users and Computers snap in 7 4 10 Setting Up Shared Disks Warning Make sure that Windows 200
111. rance Table 5 5 describes the levels of fault tolerance for the RAID levels Table 5 5 Fault Tolerance for RAID Levels RAID Level Fault Tolerance Protection No fault tolerance 100 protection through data mirroring 100 protection through striping and parity The data is striped and parity data is written across a number of physical disk drives 100 protection through data mirroring 100 protection through data striping and parity All data is striped and parity data is written across all drives in two or more arrays Creating Logical Drives Copyright 2002 by LSI Logic Corporation All rights reserved 5 3 1 3 Maximizing Drive Performance You can configure an array for optimal performance But optimal drive configuration for one type of application will probably not be optimal for any other application Table 5 6 lists basic guidelines for the performance characteristics for RAID drive arrays at each RAID level Table 5 6 Performance Characteristics for RAID Levels RAID Level Performance Characteristics Excellent for all types of I O activity but provides no data security Provides data redundancy and good performance Provides data redundancy and good performance in most environments Provides data redundancy and excellent performance Provides data redundancy and very good performance 5 3 2 Assigning RAID Levels Only one RAID level can be assigned to each lo
112. re a logical drive that optimizes all three factors but it is easy to choose a logical drive configuration that maximizes one factor at the expense of the other two factors although needs are seldom that simple Maximize Capacity RAID 0 achieves maximum drive capacity but does not provide data redundancy Maximum drive capacity for each RAID level is shown below OEM level firmware that can span up to 4 logical drives is Configuring Physical Drives Arrays and Logical Drives Copyright 2002 by LSI Logic Corporation All rights reserved assumed Table 5 4 describes the RAID levels including the number of drives required and the capacity Table 5 4 Drives Description Required Striping without parity Capacity for RAID Levels Capacity Number of disks X capacity of smallest disk Mirroring Capacity of smallest disk X 1 Striping with floating parity drive Number of disks X capacity of smallest disk capacity of 1 disk Mirroring and Striping 4 30 Must be a multiple of 2 Number of disks X capacity of smallest disk 2 RAID 5 and Striping 6 30 Must be a multiple of the of Number of disks X capacity of smallest disk capacity of 1 disk X number of arrays arrays 5 3 1 2 Maximizing Drive Availability You can maximize the availability of data on the physical disk drive in the logical array by maximizing the level of fault tole
113. re successfully determine a strategy for optimizing the disk subsystem capacity availability and performance Servers that support Video on Demand typically read the data often but write data infrequently Both the read and write operations tend to be long Data stored on a general purpose file server involves relatively short read and write operations with relatively small files 5 4 1 2 Array Functions You must first define the major purpose of the disk array Will this disk array increase the system storage capacity for general purpose file and print servers Does this disk array support any software system that Configuring Logical Drives 5 13 Copyright 2002 by LSI Logic Corporation All rights reserved must be available 24 hours per day Will the information stored in this disk array contain large audio or video files that must be available on demand Will this disk array contain data from an imaging system You must identify the purpose of the data to be stored in the disk subsystem before you can confidently choose a RAID level and a RAID configuration 5 5 Planning the Array Configuration Fill out Table 5 8 to help plan this array Table 5 8 Factors for Planning the Array Configuration Question Answer Number of MegaRAID SCSI channels Number of physical disk drives in the array Purpose of this array Rank the following factors Maximize drive capacity Maximize the safety of the data fault tolerance
114. ripe Width Stripe width is a measure of the number of disks involved in an array where striping is implemented For example a four disk array with disk striping has a stripe width of four RAID Overview 2 5 Copyright 2002 by LSI Logic Corporation All rights reserved 2 3 5 2 Stripe Size The stripe size is the length of the interleaved data segments that MegaRAID SCSI 320 2 writes across multiple drives MegaRAID SCSI 320 2 supports stripe sizes of 2 4 8 16 32 64 or 128 Kbytes 2 3 6 Disk Mirroring With disk mirroring used in RAID 1 data written to one disk drive is simultaneously written to another disk drive as shown in Figure 2 2 Figure 2 2 Disk Mirroring MegaRAID Coniroller Segment 1 Segment 1 Duplicated Segment 2 Segment 2 Duplicated Segment 3 Segment 3 Duplicated Segment 4 Segment 4 Duplicated If one disk drive fails the contents of the other disk drive can be used to run the system and reconstruct the failed drive The primary advantage of disk mirroring is that it provides 100 data redundancy Since the contents of the disk drive are completely written to a second drive it does not matter if one of the drives fails Both drives contain the same data at all times Either drive can act as the operational drive Although disk mirroring provides 100 redundancy it is expensive because each drive in the system must be duplicated 2 6 Introduction to RAID Copyright 2002 by LSI Logic Corporation Al
115. rive in a RAID array fails data can be reconstructed from the data and parity information on the remaining disk drives 2 1 RAID Benefits RAID is widely used because it improves I O performance and increases storage subsystem reliability RAID provides data security through fault tolerance and redundant data storage The MegaRAID SCSI 320 2 management software configures and monitors RAID disk arrays 2 1 1 Improved I O Although disk drive capabilities have improved drastically actual performance of individual disk drives has been improved only three to four times in the last decade RAID provides a way to achieve much better data throughput MegaRAID SCSI 320 2 Hardware Guide 2 1 Copyright 2002 by LSI Logic Corporation All rights reserved 2 1 2 Increased Reliability The electromechanical components of a disk subsystem operate more slowly require more power and generate more noise and vibration than electronic devices These factors reduce the reliability of data stored on disks RAID provides a way to achieve much better fault tolerance and data reliability 2 2 MegaRAID SCSI 320 2 Host Based RAID Solution 2 2 1 2 2 RAID products are either host based or external The MegaRAID SCSI 320 2 controller is a host based RAID solution The MegaRAID SCSI 320 2 is a PCI adapter card that is installed in any available PCI expansion slot in a host system Host Based RAID A host based RAID product puts all of the
116. rives must have the same stripe size Configure RAID 50 by spanning two contiguous RAID 5 logical drives The RAID 5 logical drives must have the same stripe size Note Spanning two contiguous RAID 0 logical drives does not produce a new RAID level or add fault tolerance It does increase the size of the logical volume and improves performance by doubling the number of spindles Parity generates a set of redundancy data from two or more parent data sets The redundancy data can be used to reconstruct one of the parent data sets Parity data does not fully duplicate the parent data sets In RAID this method is applied to entire drives dedicated parity or to stripes across all disk drives in an array distributed parity RAID 5 combines distributed parity with disk striping If a single disk drive fails it can be rebuilt from the parity and the data on the remaining drives Parity provides redundancy for one drive failure without duplicating the contents of entire disk drives but parity generation can slow the write process 2 3 9 Hot Spares 2 8 A hot spare is an extra unused disk drive that is part of the disk subsystem It is usually in standby mode ready for service if a drive fails Hot spares permit you to replace failed drives without system shutdown or user intervention MegaRAID SCSI 320 2 implements automatic and transparent rebuilds using hot spare drives providing a high degree of fault tolerance and zer
117. roller 2 3 RAID Overview RAID is a collection of specifications that describes a system for ensuring the reliability and stability of data stored on large disk subsystems A RAID system can be implemented in a number of different versions or RAID levels MegaRAID SCSI 320 2 supports standard RAID levels 0 1 and 5 and RAID levels 10 and 50 special RAID versions supported by the MegaRAID controller 2 3 1 Physical Array A RAID array is a collection of physical disk drives governed by the RAID management software A RAID array appears to the host computer as one or more logical drives 2 3 2 Logical Drive A logical drive is a partition in a physical array of disks that is made up of contiguous data segments on the physical disks A logical drive can consist of any of the following e An entire physical array e More than one entire physical array e A part of an array e Parts of more than one array RAID Overview 2 3 Copyright 2002 by LSI Logic Corporation All rights reserved e A combination of any two of the above conditions 2 3 3 Consistency Check A consistency check verifies the correctness of redundant data in a RAID array For example in a system with distributed parity checking consistency means computing the parity of the data drives and comparing the results to the contents of the parity drives 2 3 4 Fault Tolerance Fault tolerance is achieved through cooling fans power supplies and the ability to h
118. ry exemption from these requirements LSI Logic reminds you that you must comply with all applicable battery disposal and hazardous material handling laws and regulations in the country or other jurisdiction where you are using an optional battery pack on the MegaRAID SCSI 320 2 controller 6 2 8 Step 8 Install MegaRAID SCSI 320 2 6 16 Select a 3 3 V or 5 V PCI slot and align the MegaRAID SCSI 320 1 controller bus connector with the slot Insert the MegaRAID SCSI 320 2 card in the PCI slot as shown in Figure 6 8 Press down gently but firmly to make sure that the card is properly seated in the slot The bottom edge of the controller card should be flush with the slot Attach the bracket to the computer frame with the bracket screw Hardware Installation Copyright 2002 by LSI Logic Corporation All rights reserved Figure 6 8 Installing the MegaRAID SCSI 320 2 Controller Pi slots 5 V 6 2 9 Step 9 Connect SCSI Devices Use SCSI cables to connect SCSI devices to the MegaRAID SCSI 320 1 The MegaRAID SCSI 320 2 has the following connectors e Two internal high density 68 pin SCSI connectors J7 is for SCSI channel 0 J8 is for SCSI channel 1 Two external very high density 68 pin SCSI connector J9 is for SCSI channel 0 J19 is for SCSI channel 1 Installation Steps 6 17 Copyright 2002 by LSI Logic Corporation All rights reserved 6 2 9 1 Use this procedure to connect SCSI devices 1 Disa
119. sable is automatic through cable detection 4 10 9 SCSI Firmware The MegaRAID SCSI 320 2 firmware handles all RAID and SCSI command processing and also supports the features listed in Table 4 7 Table 4 7 SCSI Firmware Feature Disconnect reconnect Description Optimizes SCSI bus seek Tagged command queuing Multiple tags to improve random access Scatter gather 4 10 Features Multiple address count pairs Copyright 2002 by LSI Logic Corporation All rights reserved Table 4 7 SCSI Firmware Cont Feature Description Multi threading Up to 255 simultaneous commands with elevator sorting and concatenation of requests per SCSI channel Stripe size Variable for all logical drives 2 4 8 16 32 64 or 128 Kbytes Rebuild Multiple rebuilds and consistency checks with user definable priority 4 11 RAID Management RAID management is provided by software utilities that manage and configure the RAID system and MegaRAID SCSI 320 2 create and manage multiple disk arrays control and monitor multiple RAID servers provide error statistics logging and provide online maintenance They include e MegaRAID BIOS Configuration Utility e WebBIOS Configuration Utility e Power Console Plus e MegaRAID Manager 4 11 1 MegaRAID BIOS Configuration Utility The BIOS Configuration Utility lt Ctrl gt lt M gt is used to configure and maintain RAID arrays format hard drives and manage the R
120. served 6 2 13 Step 13 Install the Operating System Driver MegaRAID can operate under MS DOS or any DOS compatible operating system using the standard AT BIOS INT 13h Hard Disk Drive interface To operate with other operating systems you must install software drivers MegaRAID provides software drivers on the Driver and Documentation CD for the following operating systems e MS DOS version 6 xx or later e Microsoft Windows NT 4 0 Windows 2000 Windows XP Windows NET e Novell NetWare 5 1 6 0 e Red Hat Linux 7 2 7 3 Note Refer to the MegaRAID Driver Installation Guide for the procedures used to install operating system drivers 6 3 Summary This chapter discussed hardware installation Configure the RAID system using software configuration utilities See the MegaRAID Configuration Software Guide for all information about MegaRAID SCSI 320 2 software utilities Table 6 9 lists these utility programs Table 6 9 Configuration Utilities and Operating Systems Configuration Utility Operating System MegaRAID BIOS Configuration Utility Independent of the operating system WebBlOS Configuration Utility Independent of the operating system MegaRAID Manager DOS Red Hat Linux 7 2 7 3 Novell NetWare 5 1 6 0 Power Console Plus Microsoft Windows NT Windows 2000 Windows XP Windows NET Summary 6 21 Copyright 2002 by LSI Logic Corporation All rights reserved 6 22 Hardware Installation Copyright 2002 b
121. sity connector AMPLIMITE 050 Series connectors e Eight bit devices connected to the P Cable must leave the following signals open DB 8 DB 9 DB 10 DB 11 DB 12 DB 13 DB 14 DB 15 and DB P1 e All other signals should be connected as defined Caution Lines labeled RESERVED should be connected to Ground in the bus terminator assemblies or in the end devices on the SCSI cable RESERVED lines should be open in the other SCSI devices but can be connected to Ground SCSI Cables and Connectors Copyright 2002 by LSI Logic Corporation All rights reserved A 4 68 Pin Connector Pinout for LVD SCSI Table A 4 lists the pinout for the 68 pin connector for LVD SCSI Table A 4 DB 12 Connector Pin Cable Pin Cable Pin 68 Pin Connector Pinout for LVD SCSI Connector Pin DB 12 DB 13 DB 13 DB 14 DB 14 DB 15 DB 15 DB P1 DB P1 DB 0 DB 0 DB 1 DB 1 DB 2 DB 2 DB 3 Oo OI IN oO oa AJ OJN DB 3 DB 4 en DB 4 DB 5 k i DB 5 DB 6 4 N DB 6 DB 7 w DB 7 DB P i A DB P Ground 4 ol Ground DIFFSENS Ground TERMPWR TERMPWR TERMPWR TERMPWR Reserved Reserved Ground Ground ATN ATN Ground 68 Pin Connector Pinout for LVD SCSI Copyright
122. splay a list of supported SCSI host adapters when Windows NT Setup displays the following Setup could not determine the type of one or more mass storage devices installed in your system or you have chosen to manually specify an adapter Select Other from the bottom of the list Insert the drivers disk you made when prompted to do so and select Mega RAID from this list In some cases Windows NT Setup repeatedly prompts to swap disks Windows NT will recognize any devices attached to this adapter Repeat this step for each host adapter not already recognized by Windows NT Setup Other Potential Problems 8 7 Copyright 2002 by LSI Logic Corporation All rights reserved 8 8 Troubleshooting Copyright 2002 by LSI Logic Corporation All rights reserved Appendix A SCSI Cables and Connectors The MegaRAID SCSI 320 2 provides several different types of SCSI connectors The connectors are e Two 68 pin high density internal connectors e Two 68 pin very high density external connectors A 1 68 Pin High Density SCSI Internal Connector Each SCSI channel on the MegaRAID SCSI 320 2 controller has a 68 pin high density 0 050 inch pitch unshielded connector These connectors provide all signals needed to connect the MegaRAID SCSI 320 2 to Wide SCSI devices The connector pinouts are for a single ended primary bus P CABLE as specified in SCSI 3 Parallel Interface X3T9 2 Project 885 D revision 12b dated July 2 1993
123. striped Segmentation of logically sequential data such as a single file so that segments can be written to multiple physical devices in a round robin fashion This technique is useful if the processor can read or write data faster than a single disk can supply or accept it While data is being transferred from the first disk the second disk can locate the next segment Data striping is used in some modern databases and in certain RAID devices A resistor connected to a signal wire in a bus or network for impedance matching to prevent reflections for example a 50 ohm resistor connected across the end of an Ethernet cable SCSI buses and some LocalTalk wiring schemes also require terminators Glossary Copyright 2002 by LSI Logic Corporation All rights reserved Ultra320 Virtual Sizing Wide SCSI A subset of Ultra3 SCSI that allows a maximum throughput of 320 Mbytes s which is twice as fast as Wide Ultra2 SCSI Ultra320 SCSI provides 320 Mbytes s on a 16 bit connection FlexRAID virtual sizing is used to create a logical drive up to 80 Gbytes A maximum of 40 logical drives can be configured on a RAID controller and RAID migration is possible for all logical drives except the fortieth Because it is not possible to do migration on the last logical drive the maximum space available for RAID migration is 560 Gbytes A variant on the SCSI 2 interface Wide SCSI uses a 16 bit bus double the width of the original SCSI 1 Wide
124. ter network If you do not use two network adapters for each node your 7 4 Installing and Configuring Clusters Copyright 2002 by LSI Logic Corporation All rights reserved configuration is unsupported HCL certification requires a separate private network adapter 7 3 3 Shared Disk Requirements Disks can be shared by the nodes The requirements for sharing disks are as follows Physically attach all shared disks including the quorum disk to the shared bus Make sure that all disks attached to the shared bus are seen from all nodes You can check this at the setup level in lt Ctrl gt lt M gt the BIOS configuration utility See Section 7 5 Installing SCSI Drives page 7 27 for installation information Assign unique SCSI identification numbers to the SCSI devices and terminate the devices properly Refer to the storage enclosure manual for information about installing and terminating SCSI devices Configure all shared disks as basic not dynamic Format all partitions on the disks as NTFS It is best to use fault tolerant RAID configurations for all disks This includes RAID levels 1 5 10 or 50 7 4 Cluster Installation 7 4 1 Installation Overview During installation some nodes are shut down and other nodes are rebooted This is necessary to ensure uncorrupted data on disks attached to the shared storage bus Data corruption can occur when multiple nodes try to write simultaneously to the same dis
125. ter 8 Troubleshooting 8 1 General Troubleshooting 8 2 BIOS Boot Error Messages 8 3 Other BIOS Error Messages 8 4 Other Potential Problems Appendix A SCSI Cables and Connectors A 1 68 Pin High Density SCSI Internal Connector A 1 1 Cable Assembly for Internal Wide SCSI Devices A 1 2 Connecting Internal and External Wide Devices A 1 3 Converting Internal Wide to Internal Non Wide Type 2 A 1 4 Converting Internal Wide to Internal Non Wide Type 30 A 1 5 Converting from Internal Wide to Internal Non Wide Type 3 A 2 SCSI Cable and Connector Vendors A 3 High Density 68 Pin Connector Pinout for SE SCSI A 4 68 Pin Connector Pinout for LVD SCSI Appendix B Audible Warnings Appendix C Glossary Contents Copyright 2002 by LSI Logic Corporation All rights reserved 7 19 7 16 7 18 7 25 7 25 7 26 7 27 7 28 7 28 8 1 8 3 8 5 8 5 A 1 A 2 A 3 A 4 A 5 A 5 A 6 A 7 XIX XX Index Customer Feedback Contents Copyright 2002 by LSI Logic Corporation All rights reserved 1 1 Chapter 1 Overview This chapter provides an overview of the MegaRAID SCSI 320 2 controller It contains the following sections e Section 1 1 SCSI Channels e Section 1 2 NVRAM and Flash ROM e Section 1 3 SCSI Connectors e Section 1 4 Single Ended and Differential SCSI Buses e Section 1 5 Maximum Cable Length for SCSI Standards e Section 1 6 SCSI Bus Widths and Maximum Throughput
126. ting that the additional data will be needed soon Read Ahead supplies sequential data faster but it is not as effective when accessing random data A condition in which a workable disk drive is neither online nor a hot spare and is available to add to an array or to designate as a hot spare The regeneration of all data from a failed disk in a RAID level 1 or 5 array to a replacement disk A disk rebuild normally occurs without interruption of application access to data stored on the array virtual disk The percentage of CPU resources devoted to rebuilding The act of remaking a logical drive after changing RAID levels or adding a physical drive to an existing array Glossary Copyright 2002 by LSI Logic Corporation All rights reserved Redundancy Replacement Disk Replacement Unit SAF TE SCSI SCSI Channel SCSI Drive State The provision of multiple interchangeable components to perform a single function to cope with failures or errors Redundancy normally applies to hardware disk mirroring is a common form of hardware redundancy A disk available to replace a failed member disk in a RAID array A component or collection of components in a disk subsystem that is always replaced as a unit when any part of the collection fails Typical replacement units in a disk subsystem includes disks controller logic boards power supplies and cables Also called a hot spare SCSl accessed fault tolerant enclosure An ind
127. tithread up to 256 commands simultaneously e Support for multiple rebuilds and consistency checks with transparent user definable priority setting e Support for variable stripe sizes for all logical drives e Automatic detection of failed drives e Automatic and transparent rebuild of hot spare drives e Hot swap of new drives without taking the system down e Optional battery backup for up to 72 hours of data retention e Server clustering support e Optional firmware provides multi initiator support e Server failover e Software drivers for major operating systems Features Copyright 2002 by LSI Logic Corporation All rights reserved 4 1 SMART Technology The MegaRAID Self Monitoring Analysis and Reporting Technology SMART feature detects up to 70 of all predictable drive failures SMART monitors the internal performance of all motors heads and drive electronics You can recover from drive failures through online physical drive migration 4 2 Configuration on Disk Configuration on Disk drive roaming saves configuration information both in nonvolatile random access memory NVRAM on the MegaRAID SCSI 320 2 and on the disk drives it controls If the MegaRAID SCSI 320 2 is replaced the new MegaRAID controller can detect the actual RAID configuration maintaining the integrity of the data on each drive even if the drives have changed channel and or target ID 4 3 Configuration Features Table 4 1 contains the configurati
128. to 12 MegaRAID adapters per system What SCSI IDs can a non hard disk device have and what is maximum number allowed per adapter Why does a failed logical array still get a drive assignment Non hard disk devices can accommodate only SCSI IDs 1 2 3 4 5 or 6 regardless of the channel used A maximum of six non hard disk devices are supported per MegaRAID SCSI 320 2 adapter To maintain the DOS Path statement integrity 8 2 Troubleshooting Copyright 2002 by LSI Logic Corporation All rights reserved 8 2 BIOS Boot Error Messages Table 8 2 describes BIOS error messages that can display when you boot the system and suggested solutions Table 8 2 Message Adapter BIOS Disabled No Logical Drives Handled by BIOS BIOS Boot Error Messages Problem The MegaRAID BIOS is disabled Sometimes the BIOS is disabled to prevent booting from the BIOS Suggested Solution Enable the BIOS using the MegaRAID BIOS Configuration Utility Host Adapter at Baseport xxxx Not Responding The BIOS cannot communicate with the adapter firmware Make sure the MegaRAID SCSI 320 2 is properly installed Try moving the MegaRAID controller to another slot Run the MegaRAID Manager Diagnostics to verify that the MegaRAID controller is functioning properly No MegaRAID SCSI 320 2 Adapter The BIOS cannot communicate with the adapter firmware Make sure the MegaRAID SCSI 320 2 is properly install
129. tter gather 4 10 SCO Unix 4 12 SCSI C 7 SCSI backup and utility software 4 12 SCSI Bus 4 8 4 10 SCSI bus 4 10 SCSI bus widths and maximum throughput 1 3 SCSI buses 1 2 Index SCSI Cable Vendors A 6 SCSI cables 4 8 Connecting 6 17 SCSI cables and connectors A 1 SCSI channel C 7 SCSI Connector Vendors A 6 SCSI Connectors 4 8 SCSI connectors 4 10 SCSI Controller 4 8 SCSI Data Transfer Rate 4 8 SCSI Device Compatibility 4 12 SCSI Device Types Supported 4 8 SCSI Devices Configuration 7 28 SCSI Drive Installations 7 27 SCSI Drive State C 7 SCSI firmware 4 10 SCSI Termination 4 8 SCSI termination 4 10 6 8 Set 6 8 SCSI terminator power TermPWR Setting 6 13 SCSI to SCSI 2 11 SCSI to SCSI RAID product 2 3 Serial Port 4 8 Serial port 4 9 Server management 4 12 Service provider C 8 Setting SCSI termination 6 8 Shared Disks Configuration 7 14 Setup 7 13 Shared SCSI Bus Termination 7 28 SMART Technology 4 3 SNMP C 8 SNMP agent 4 12 SNMP managers 4 12 Software utilities 4 6 Software based 2 11 Spanning 2 7 C 8 Spare C 8 Standby rebuild 2 9 Stripe size 2 6 4 11 C 8 Stripe width 2 5 C 8 Striping C 8 System Connection A 6 T Tagged command queuing 4 10 Target IDs Setting 6 18 Technical Cable Concepts A 6 Technical Support 1 vi Termination Disable 4 8 Terminator C 8 Troubleshooting 8 1 U Ultra3 SCSI 320M C 9 UnixWare 4 12 Unpack 6 3 IX 3 Copyright 2002 by LSI Logic Corporation All rights res
130. ult tolerance All data lost if any drive fails Drives Figure 3 1 shows RAID Levels 1 to 30 The initiator takes one ID per channel This leaves 15 IDs available for each channel a RAID 0 array with four disk drives Copyright 2002 by LSI Logic Corporation All rights reserved Figure 3 1 RAID 0 Array MegaRAID Controller Segment 1 Segment 2 Segment 3 Segment 4 Segment 5 Segment 6 Segment 7 Segment 8 Segment 9 Segment 10 Segment 11 Segment 12 3 3 RAID 1 In RAID 1 the MegaRAID SCSI 320 2 duplicates all data from one drive to a second drive RAID 1 provides complete data redundancy but at the cost of doubling the required data storage capacity Uses Use RAID 1 for small databases or any other environment that requires fault tolerance but small capacity Strong Points Provides complete data redundancy RAID 1 is ideal for any application that requires fault tolerance and minimal capacity Weak Points Requires twice as many disk drives Performance is impaired during drive rebuilds Drives 2 Figure 3 2 shows a RAID 1 array RAID 1 3 3 Copyright 2002 by LSI Logic Corporation All rights reserved 3 4 RAID 5 3 4 Figure 3 2 RAID 1 Array MegaRAID Controller Segment 1 Segment 1 Duplicated Segment 2 Segment 2 Duplicated Segment 3 Segment 3 Duplicated Segment 4 Segment 4 Duplicated RAID 5 includes disk striping at the byte level and parity In RAID 5 the parity
131. ustry protocol for managing RAID enclosures and reporting enclosure environmental information Small computer system interface A processor independent standard for system level interfacing between a computer and intelligent devices including hard disks floppy disks CD ROM printers scanners etc Multiple SCSI devices can be connected to a single host adapter on the computer s bus SCSI transfers eight or 16 bits in parallel and can operate in either asynchronous or synchronous modes The synchronous transfer rate is up to 320 Mbytes s for Ultra320 SCSI SCSI connections normally use single ended drivers as opposed to differential drivers MegaRAID controls the disk drives through SCSI 2 buses channels over which the system transfers data in either Fast and Wide or Ultra SCSI mode Each adapter can control up to three SCSI channels Internal and external disk drives can be mixed on channels 0 and 1 but not on channel 2 A SCSI physical drive can be in one of these states e Online Powered on and operational e Ready Functioning normally but not part of a configured logical drive and not designated as a hot spare e Hot Spare Powered on stand by disk drive ready for use if an online disk fails e Fail Out of service due to a fault occurring on the drive e Rebuild Currently being rebuilt with data from a failed drive C 7 Copyright 2002 by LSI Logic Corporation All rights reserved Service Provider SNM
132. ve Managed Disks The disks that Cluster service controls access to are known as managed disks Add the disks that you want the cluster to manage Remove those disks that you do not want the cluster to manage Unmanaged disks Managed disks dd gt El Disk 1 MEGARAID LD Ob E New Volume 4 Remove Disk 2 MEGARAID LD 1b F New Volume gt Caution The likelihood of corruption of unmanaged NTFS disks on a shared bus is very high It is recommended that you use Cluster service to manage these disks lt Back Cancel The following screen displays Cluster Service Configuration Wizard Configure Cluster Networks It is recommended that you use more than one private network for cluster communications Using only one network creates a single point of failure Cluster service can use private networks for cluster status signals and cluster management This provides more security than using a public network If you prefer you can use a public network for cluster management or you can use a mixed network for both private and public communications Make sure you don t select a public network for private communications or a private network for public communications Either selection prevents other computers from joining the cluster To continue setting up your cluster click Next lt Back Cancel 7 20 Installing and Configuring Clusters Copyright 2002 by LSI
133. ves into the current configuration Suggested Solution Reconfigure the array Following SCSI IDs have the same data y z Channel x a b c The physical drive roaming feature found the same data on two or more physical drive on channel x with SCSI IDs a b and c MegaRAID cannot determine the drive that has the duplicate information Remove the drive or drives that should not be used Unresolved configuration mismatch between disks and NVRAM on the adapter The configuration stored in the MegaRAID NVRAM does not match the configuration stored on the drives 8 4 Other Potential Problems Press a key to run MegaRAID Manager Select View Add Configuration from the Configure menu Use View Add Configuration to examine both the configuration in NVRAM and the configuration stored on the disk drives Resolve the problem by selecting one of the configurations Table 8 4 describes other potential problems Table 8 4 Other Potential Problems fee DOS ASPI MEGASPI SYS the MegaRAID DOS ASPI manager uses 6 Kbytes of system memory once it is loaded 8 5 Other BIOS Error Messages Copyright 2002 by LSI Logic Corporation All rights reserved Table 8 4 Other Potential Problems Cont Information CD drives under At this time copied CDs are not accessible from DOS even after loading DOS MEGASPI SYS and MEGACDR SYS Physical drive errors To display the MegaRAID Manager M
134. ware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type x Preface Copyright 2002 by LSI Logic Corporation All rights reserved Physical Device Layout Cont Channel 0 Channel 1 Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Preface xi Copyright 2002 by LSI Logic Corporation All rights reserved Physical Device Layout Cont Channel 0 Channel 1 Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacturer Model number Firmware level Target ID Device type Logical drive number Drive number Manufacture
135. writable mass storage device including both rotating magnetic and optical disks and solid state disks or nonvolatile electronic storage elements It does not include specialized devices such as write once read many WORM optical disks nor does it include so called RAM disks implemented using software to control a dedicated portion of a host computer volatile random access memory A collection of disks from one or more disk subsystems combined with array management software The software controls the disks and presents them to the array operating environment as one or more virtual disks A variation on disk mirroring in which a second disk adapter or host adapter and redundant disk drives are present Writing duplicate data to more than one usually two disk drives to protect against data loss in the event of device failure Disk mirroring is a common feature of RAID systems Disk spanning allows multiple disk drives to function like one big drive Spanning overcomes lack of disk space and simplifies storage management by combining existing resources or adding relatively inexpensive resources For example four 36 Gbyte disk drives can be combined to appear to the operating system as one single 144 Gbyte drive See also Array Spanning and Spanning A type of disk array mapping Consecutive stripes of data are mapped round robin to consecutive array members A striped array RAID 0 Glossary Copyright 2002 by LSI Logic Corporation Al
136. y LSI Logic Corporation All rights reserved Chapter 7 Installing and Configuring Clusters This chapter explains how clusters work and how to install and configure them It has the following sections e Section 7 1 Overview e Section 7 2 Benefits of Clusters e Section 7 3 Installation and Configuration e Section 7 4 Cluster Installation e Section 7 5 Installing SCSI Drives 7 1 Overview Physically a cluster is a grouping of two independent servers that can access the same shared data storage and provide services to a common set of clients With current technology this usually means servers connected to common I O buses and a common network for client access Logically a cluster is a single management unit Any server can provide any available service to any authorized client The servers must have access to the same shared data and must share a common security model Again with current technology this generally means that the servers in a cluster will have the same architecture and run the same version of the same operating system MegaRAID SCSI 320 2 Hardware Guide 7 1 Copyright 2002 by LSI Logic Corporation All rights reserved 7 2 Benefits of Clusters 7 3 7 2 Clusters provide three basic benefits Improved application and data availability Scalability of hardware resources Simplified management of large or rapidly growing systems Installation and Configuration Us

LSI MegaRAID SCSI 320-2 RAID Controller Series 518 User's Manual

Contents

Download Pdf Manuals

Related Search

Related Contents