Home

LSI 500 Network Card User Manual

1. LAN Network and Dial ah Private LAN up Connections Public Type LAN Connection Status Enabled Intel R PRO 100 Management Adapter Biggs Ne Ba Intel R PRO 100 Management Adapter Use crossover cables for the network card adapters that access the cluster nodes If you do not use the crossover cables properly the system will not detect the network card adapter that accesses the cluster nodes If the network card adapter is not detected then you cannot configure the network adapters during the Cluster Service installation However if you install Cluster Service on both nodes and both nodes are powered on you can add the adapter as a cluster resource and configure it properly for the cluster node network in Cluster Administrator MegaRAID Express 500 Hardware Guide Configuring the Cluster Node Network Adapter Note Which network adapter is private and which is public depends upon your wiring For the purposes of this chapter the first network adapter Local Area Connection is connected to the public network and the second network adapter Local Area Connection 2 is connected to the private cluster network This may not be the case in your network Renaming the Local Area Connections In order to make the network connection more clear you can change the name of the Local Area Connection 2 Renaming it will help you identify the connection and correctly assign it Follow the steps below to change the n
2. Caution The likelihood of corruption of unmanaged NTFS disks on a shared bus is very high It is recommended that you use Cluster service to manage these disks lt Back Cancel The following screen displays Click on Next in the Configure Cluster Networks dialog box Cluster Service Configuration Wizard Configure Cluster Networks It is recommended that you use more than one private network for cluster communications Using only one network creates a single point of failure Cluster service can use private networks for cluster status signals and cluster management This provides more security than using a public network If you prefer you can use a public network for cluster management or you can use a mixed network for both private and public communications Make sure you don t select a public network for private communications or a private network for public communications Either selection prevents other computers from joining the cluster To continue setting up your cluster click Next Cancel Verify that the network name and IP address correspond to the network interface for the public network Check the box Enable this network for cluster use Select the option All communications mixed network as shown below and click on MegaRAID Express 500 Hardware Guide Next Cluster Service Configuration Wizard Network Connections Type the network name and
3. 32 6 6 66 DBO DBd0 33 65 66 67 Bao Ban 34 6 68 68 Ban Quo gt X Note The conductor number refers to the conductor position when using flat ribbon cable Appendix A SCSI Cables and Connectors 115 116 MegaRAID Express 500 Hardware Guide B Audible Warnings The MegaRAID Express 500 RAID controller has an onboard tone generator that indicates events and errors Three seconds on and one second off One second on and one second off One second on and three seconds off A logical drive is offline A logical drive is running in degraded mode An automatically initiated rebuild has been completed One or more drives in a RAID 0 configuration failed Two or more drives in a RAID 1 3 or 5 configuration failed One drive in a RAID 3 or 5 configuration failed While you were away from the system a disk drive in a RAID 1 3 or 5 configuration failed and was rebuilt Appendix B Audible Warnings 117 118 MegaRAID Express 500 Hardware Guide C Cluster Configuration with a Crossover Cable When you are installing the Cluster Service on the first node in a server cluster Setup may not detect the network adapter that is connected with a crossover cable The icon in Network and Dial up Connections that represents the network adapter connected to the crossover cable is displayed with a red X and the Network cable unplugged icon in displayed
4. A cold swap requires that you turn the power off before replacing a defective hard drive in a disk subsystem Data Transfer Capacity The amount of data per unit time moved through a channel For disk I O Degraded Disk Disk Array Disk Duplexing Disk Mirroring Disk Spanning bandwidth is expressed in megabytes per second MB s A drive that has become non functional or has decreased in performance A non volatile randomly addressable rewritable mass storage device including both rotating magnetic and optical disks and solid state disks or non volatile electronic storage elements It does not include specialized devices such as write once read many WORM optical disks nor does it include so called RAM disks implemented using software to control a dedicated portion of a host computer volatile random access memory A collection of disks from one or more disk subsystems combined with array management software It controls the disks and presents them to the array operating environment as one or more virtual disks A variation on disk mirroring where a second disk adapter or host adapter and redundant disk drives are present Writing duplicate data to more than one usually two hard disks to protect against data loss in the event of device failure It is a common feature of RAID systems Disk spanning allows multiple disk drives to function like one big drive Spanning overcomes lack of disk space and simplifies storage mana
5. During boot the MegaRAID Express 500 BIOS message appears MegaRAID Express 500 Disk Array Adapter BIOS Version x xx date Copyright c LSI Logic Corporation Firmware Initializing Scanning SCSI Device etc The firmware takes several seconds to initialize During this time the adapter will scan the SCSI channel When ready the following appears Host Adapter 1 Firmware Version x xx DRAM Size 4 MB 0 Logical Drives found on the Host Adapter 0 Logical Drives handled by BIOS Press lt Ctrl gt lt M gt to run MegaRAID Express 500 BIOS Configuration Utility The lt Ctrl gt lt M gt utility prompt times out after several seconds The MegaRAID Express 500 host adapter controller number firmware version and cache DRAM size are displayed in the second portion of the BIOS message The numbering of the controllers follows the PCI slot scanning order used by the host motherboard Step 11 Run MegaRAID BIOS Setup Press lt Ctrl gt M to run the MegaRAID BIOS Setup utility See the MegaRAID Configuration Software Guide for information about running MegaRAID BIOS Setup 64 MegaRAID Express 500 Hardware Guide Step 12 Install the Operating System Driver Important When booting the system from a drive connected to a MegaRAID controller and using EMM386 EXE MEGASPI SYS must be loaded in CONFIG SYS before EMM386 EXE is loaded If you do not do this you cannot access the boot drive after EMM386 is loaded DOS AS
6. LSIfEC te MegaRAID Express 500 Hardware Guide Copyright 2001 LSI Logic Corporation All rights reserved LSI Logic Corporation 6145 D Northbelt Parkway Norcross GA 30071 This publication contains proprietary information which is protected by copyright No part of this publication can be reproduced transcribed stored in a retrieval system translated into any language or computer language or transmitted in any form whatsoever without the prior written consent of the publisher LSI Logic Corporation LSI Logic Corporation acknowledges the following trademarks Intel is a registered trademark of Intel Corporation Sytos 300 is a registered trademark of Sytron Corporation MS DOS and Microsoft are registered trademarks of Microsoft Corporation Windows 95 Microsoft Windows and Windows NT are trademarks of Microsoft Corporation SCO UnixWare and Unix are registered trademarks of the Santa Cruz Operation Inc Novell NetWare is a registered trademark of Novell Corporation IBM AT VGA PS 2 and OS 2 are registered trademarks and XT and CGA are trademarks of International Business Machines Corporation NEC is a registered trademark of Nippon Electric Corporation Sony is a registered trademark of Sony Corporation Toshiba is a registered trademark of Toshiba America Corporation Archive and Python are registered trademarks of Archive Corporation Quantum is a registered trademark of Quantum Corporation Seagate is a r
7. SCSI Connectors One 68 pin internal high density connector for 16 bit SCSI devices One ultra high density 68 pin external connector for Ultra and Wide SCSI 3 pin RS232C compatible berg PCI Bridge CPU MegaRAID Express 500 uses the Intel i960RM PCI bridge with an embedded 80960JX RISC processor running at 100 MHz The RM bridge handles data transfers between the primary host PCI bus the secondary PCI bus cache memory and the SCSI bus The DMA controller supports chaining and unaligned data transfers The embedded 80960JX CPU directs all controller functions including command processing SCSI bus transfers RAID processing drive rebuilding cache management and error recovery 32 MegaRAID Express 500 Hardware Guide Cache Memory MegaRAID Express 500 cache memory resides in a memory bank that uses 2 M x 72 16 MB 4 M x 72 32 MB 8 M x 72 64 MB or 16 M x 72 128 MB unbuffered 3 3V SDRAM Possible configurations are 16 32 64 or 128 MB The maximum achievable memory bandwidth is 528 MB s MegaRAID supports write through or write back caching which can be selected for each logical drive To improve performance in sequential disk accesses MegaRAID does not use read ahead caching for the current logical drive The default setting for the read policy is Normal meaning no read ahead caching You can disable read ahead caching aA Warning Write caching is not recommended for the physical drives When wri
8. ASPI Drivers 65 ASPI manager 104 Assigning Drive Letters 84 Assigning RAID Levels 45 Asynchronous Operations 121 Audible Warnings 117 Automatic Failed Drive Detection and Rebuild 35 B BIOS 32 BIOS Boot Error Messages 101 BIOS Setup 64 Bus Data Transfer Rate 32 Bus Type 32 Bus Based 16 C Cable Assembly for Internal Wide SCSI Devices 108 Cable Length 2 Cables To Go 112 Cache Configuration 32 Cache I O 121 Cache Memory 33 Installation 52 Card Size 32 CD ROM Driver 66 Channel 121 Cluster Configuration 69 Windows 2000 67 Cluster Configuration with Crossover Cable 119 Cluster Configuration Wizard 86 Cluster Disks Configuration 89 Cluster Installation 69 76 Hardware requirements 68 Overview 76 Software requirements 67 Validation 95 Cluster Node Network Adapter Configuration 79 Cluster Service 67 Assigning Drive Letters 84 Cluster Node Network Adapter 79 Cluster User Account 82 Configuring Cluster Disks 89 Connectivity and Name Resolution 80 Disk Access and Functionality 85 Domain Membership 81 Public Network Adapter 79 SCSI Drive Installations 97 Setting Up Networks 77 Shared Disks Configuration 84 Shared Disks Setup 83 Software Installation 86 Validating the Cluster Installation 95 Cluster User Account Setup 82 Clustering Network Requirements 75 Shared Disk Requirements 75 Clusters 67 Benefits 67 Cold Swap 122 Compatibility 36 Configuration Fea
9. CONNECTOR CONTACT CONNECTION FOR WIDE TO NON WIDE CONVERSION pin 1 pin 1 JN NW 3 i W AA EE EE BD ES EE ooo eo janan an anan an anan an anan an aaan mn TO EE LU VINA H JUI DN M H paonon jantan an n tans an an am an sn an mn m en Tmn pol Connector A 68 position plug male AMP 749925 5 Connector B 50 position IDC receptacle female AMP 499252 4 1 746285 0 1 746288 0 Wire Twisted Pair Flat Cable or Laminated Discrete Wire Cable 25 pair 0 050 centerline 28 AWG MegaRAID Express 500 Hardware Guide Cont d 68 Pin High Density Connectors Continued Converting Internal Wide to Internal Non Wide Type 30 The cable assembly for connecting internal wide SCSI devices to internal non wide SCSI devices is shown below pin 1 Tg A agagaaaaagaagaaagaaagaaaggagaanmagaaanna aaagaaaaagaaaaaagaaagaaagagagdagmuaaanga pin 1 naaogpnaapaggogaoagagogaaggaagagdgaud ooo0o00o00000000000000 Connector A 68 position plug male AMP 749925 5 Connector B 50 position plug male AMP 749925 3 Wire Twisted Pair Flat Cable or Laminated Discrete Wire Cable 25 pair 0 050 centerline 28 AWG Cont d Appendix A SCSI Cab
10. Express 500 memory to run MegaRAID BIOS Not enough memory on the MegaRAID Express adapter to support the current configuration The physical drives with SCSI IDs a b and c are not responding on SCSI channel x MegaRAID Express 500 Hardware Guide Make sure all physical drives are properly connected and are powered on Run MegaRAID Manager to find out if any physical drives are not responding Reconnect replace or rebuild any drive that is not responding Make sure MegaRAID Express 500 memory has been properly installed Make sure MegaRAID Express memory has been properly installed Make sure the physical drives are properly connected and are powered on Other BIOS Error Messages Suggested Solution Following SCSI disk not found and no empty slot available for mapping it Following SCSI IDs have the same data y z Channel x a b c Unresolved configuration mismatch between disks and NVRAM on the adapter The physical disk roaming feature did not find the physical disk with the displayed SCSI ID No slot is available to map the physical drive MegaRAID Express cannot resolve the physical drives into the current configuration The physical drive roaming feature found the same data on two or more physical drive on channel x with SCSI IDs a b and c MegaRAID Express cannot determine the drive that has the duplicate information The configuration stored in the MegaRAID Express NVRAM doe
11. SCSI to SCSI 16 SCSI to SCSI RAID Product 7 Serial Port 33 Serial port connector 53 Server Management 36 Service Provider 129 Set SCSI Termination 56 Shared Disks Configuration 84 Setup 83 Shared SCSI Bus Termination 97 SLED 5 SMART Technology 27 SNMP 129 SNMP agent 36 SNMP managers 36 Glossary 133 Software Utilities 31 Software Based 16 Spanning 14 129 Spare 130 Standby rebuild 9 Stripe Size 12 34 130 Stripe Width 12 130 Striping 130 System Connection 112 T Tagged Command Queuing 34 Target IDs Setting 62 Technical Cable Concepts 112 Technical Support viii Termination Disable 32 Terminator 130 Troubleshooting 99 134 MegaRAID Express 500 Hardware Guide U Ultra SCSI 130 Ultra2 SCSI 130 Ultra3 SCSI 160M 130 UnixWare 35 Unpack 51 V Virtual Sizing 130 W WebBIOS Guide 3 Wide SCSI 130 Windows 2000 Cluster Configuration 67 Windows 2000 Advanced Server Driver Installation 70 Windows 2000 Operating System Installation 77 Windows NT 31
12. Server After the hardware is set up for the MS cluster configuration perform the following procedure to configure the driver ETJ Action When the controller is added to an existing Windows 2000 Advanced Server installation the operating system detects the controller The following screen displays the detected hardware device Click on Next Welcome to the Found New Hardware Wizard This wizard helps you install a device driver for a hardware device Found New Hardware S RAID Controller Installing To continue click Next lt Back Next gt Cancel The following screen appears This screen is used to locate the device driver for the hardware device Select Search for a suitable driver and click on Next Found New Hardware Wizard S Install Hardware Device Drivers x4 amp device driver is a software program that enables a hardware device to work with ey an operating system This wizard will complete the installation for this device oy RAID Controller amp device driver is a software program that makes a hardware device work Windows needs driver files for your new device To locate driver files and complete the installation click Next What do you want the wizard to do Display a list of the known drivers for this device so that can choose a specific driver lt Back Cancel 70 MegaRAID Express 500 Hardware Guide The following screen displays Insert the flo
13. bit and byte ordering and the transmission and error detection and correction of the bit stream High level protocols deal with the data formatting including the message syntax the terminal to computer dialogue character sets and sequencing of messages Redundant Array of Independent Disks originally Redundant Array of Inexpensive Disks is an array of multiple small independent hard disk drives that yields performance exceeding that of a Single Large Expensive Disk SLED A RAID disk subsystem improves I O performance on a server using only a single drive The RAID array appears to the host server as a single storage unit I O is expedited because several disks can be accessed simultaneously Cont d 126 MegaRAID Express 500 Hardware Guide Glossary Continued RAID Levels A style of redundancy applied to a logical drive It can increase the performance of the logical drive and can decrease usable capacity Each logical drive must have a RAID level assigned to it The RAID level drive requirements are RAID 0 requires one or more physical drives RAID 1 requires exactly two physical drives RAID 3 requires at least three physical drives RAID 5 requires at least three physical drives RAID levels 10 30 and 50 result when logical drives span arrays RAID 10 results when a RAID 1 logical drive spans arrays RAID 30 results when a RAID 3 logical drive spans arrays RAID 50 results when a RAID 5 logical drive spans arrays RAI
14. communicate with the adapter firmware The configuration stored in the MegaRAID Express 500 adapter does not match the configuration stored in the drives A logical drive failed to sign on x number of logical drives signed on in a degraded state Enable the BIOS via the MegaRAID BIOS Setup utility Make sure MegaRAID Express 500 is properly installed Make sure MegaRAID Express 500 is properly installed Press a key to run MegaRAID Manager Choose View Add Configuration from the Configure menu Use View Add Configuration to examine both the configuration in NVRAM and the configuration stored on the disk drives Resolve the problem by selecting one of the configurations Make sure all physical drives are properly connected and are powered on Run MegaRAID Manager to find out if any physical drives are not responding Reconnect replace or rebuild any drive that is not responding Make sure all physical drives are properly connected and are powered on Run MegaRAID Manager to find if any physical drives are not responding Reconnect replace or rebuild any drive that is not responding Chapter 8 Troubleshooting 101 102 Suggested Solution 1 Logical Drive Degraded Insufficient memory to run BIOS Press any key to continue Insufficient Memory The following SCSI IDs are not responding Channel x a b c A logical drive signed on in a degraded state Not enough MegaRAID
15. configuration guide for information Install one controller at a time Press lt Ctrl gt lt M gt at BIOS initialization to configure the options in the steps 5 11 Do not attach the disks yet Set the controller to Cluster Mode in the Objects gt Adapter gt Cluster Mode menu Disable the BIOS in the Objects gt Adapter gt Enable Disable BIOS menu Change the initiator ID in the Objects gt Adapter gt Initiator ID menu Power down the first system Attach the controller to the shared array Configure the first controller to the desired arrays using the Configure gt New Configuration menu Follow the on screen instructions to create arrays and save the configuration Initialize the logical drives before powering off the system Power down the first system Repeat steps 4 7 for the second controller N vA Note Do not have the cables for the second controller attached to the shared enclosure yet 15 Attach the cables for the E controller to the shared enclosure and power up the second system If a configuration mismatch occurs enter the Ctrl lt M gt utility Go to the Configure gt View Add Configuration gt View Disk menu to view the disk configuration Save the configuration Proceed to the driver installation for a Microsoft cluster environment U 6 7 8 Ba x 14 Chapter 7 Cluster Installation and Configuration Driver Installation Instructions under Microsoft Windows 2000 Advanced
16. configuration of the first node Installation of Cluster Service on the second node begins the same way as installation on the first node The first node must be running during installation of the second node Follow the same procedures used to install Cluster Service on the first node with the following differences 1 Inthe Create or Join a Cluster dialog box select The second or next node in the cluster then click Next 2 Enter the cluster name that was previously created it is MyCluster in this example and click Next 3 Leave Connect to cluster as unchecked The Cluster Service Configuration Wizard automatically supplies the name of the user account selected when you installed the first node Always use the same account you used when you set up the first cluster node 4 Enter the password for the account if there is one then click Next 5 At the next dialog box click Finish to complete configuration 6 The Cluster Service will start Click OK 7 Close Add Remove Programs If you install additional nodes repeat these steps to install Cluster Service on all other nodes Chapter 7 Cluster Installation and Configuration 95 Verify Installation There are several ways to verify that Cluster Service was successfully installed Here is a simple one 1 Click Start click Programs click Administrative Tools then click Cluster Administrator The presence of two nodes pictured below shows that a cluster e
17. that is at least as large as the drive being replaced Chapter 5 Configuring MegaRAID Express 500 37 Current Configuration SCSI ID Device Description SCSI Channel 1 LIBOER Wu de ipu oe s re she s 38 MegaRAID Express 500 Hardware Guide Drive pe Size Size Policy Policy He Drives ee es Era M oq cw Tan Ep o gr dn a a Lern pool qr o0 a Ee Dp gl o xpo cca xj pps po qno spo uo eo ose sy EDO yr occ c on d one oso prp uro ode s ul ee ERAS cs PRE o ds ee ee See pe a ss Cont d Chapter 5 Configuring MegaRAID Express 500 39 Physical Device Layout DO TO Cima E LL Device Type Cd o Logical Drive Number Dre Number ManufictwrerModelNumber LFmwarelewl S LL Tage S Device Type LL Losical Drive Number Drie Number ManuicturerModelNumber o LFmwarelewl S LL Ple TT Device Type o o Logical Drive Number Dive Number Manufactorer Mode Number o LFmwarelewl S LL Tage SS Device Type SSC o o Logical Drive Number Drive Number Manufactorer Modei Number LFimwarelewl S LL Plgelb S Device Type LL Logical Drive Number Dre Number ManucturerModelNumber o LFmmwarelewl S LL Tage S Device Ty LL Losical Drive Number Drive Number ManuicturerModelNumber o LFmwarelewl S LL Pel TT Device Type o o Logical Drive Number Dive Nombr Mam curerModel Number o LF
18. 1 provides complete data redundancy RAID 1 is ideal for any application that requires fault tolerance and minimal capacity Weak Points RAID 1 requires twice as many disk drives Performance is impaired during drive rebuilds Drives Two Segment 1 Segment 2 Segment 3 Segment 4 etc 20 MegaRAID Express 500 Hardware Guide Segment 1 duplicate Segment 2 duplicate Segment 3 duplicate Segment 4 duplicate etc RAID 3 Uses Strong Points Weak Points Drives RAID 3 provides disk striping and complete data redundancy though a dedicated parity drive The stripe size must be 64 KB if RAID 3 is used RAID 3 handles data at the block level not the byte level so it is ideal for networks that often handle very large files such as graphic images RAID 3 breaks up data into smaller blocks calculates parity by performing an exclusive or on the blocks and then writes the blocks to all but one drive in the array The parity data created during the exclusive or is then written to the last drive in the array The size of each block is determined by the stripe size parameter which is set during the creation of the RAID set Ifa single drive fails a RAID 3 array continues to operate in degraded mode If the failed drive is a data drive writes will continue as normal except no data is written to the failed drive Reads reconstruct the data on the failed drive by performing an exclusive or operation on the remaining data in the stri
19. 126 Physical drive 9 Power Console 35 Power Down 51 Processor 32 Product Specifications 32 Protocol 126 Public Network Adapter Configuration 79 R RAID 126 Benefits 5 Introduction to 5 RAID 0 19 RAID 1 20 Spanning to configure RAID 10 14 RAID 10 24 Configuring 14 RAID 3 21 Parity disk 11 Spanning to configure RAID 30 14 RAID 30 25 Configuring 14 RAID 5 23 Spanning to make RAID 50 14 RAID 50 26 Configuring 14 RAID Benefits Improved I O 5 Increased Reliability 5 RAID Levels 17 127 RAID Levels Supported 32 RAID Management 35 RAID Management Features 30 RAID Migration 127 RAID Overview 8 Read Ahead 127 Ready 15 Ready State 127 Rebuild 15 34 Rebuild Rate 9 127 Rebuilding a disk 9 Reconnect 34 Reconstruct 128 Reconstruction 127 RedAlert 36 Redundancy 128 Replacement Disk 128 Replacement Unit 128 S SAF TE 128 Scatter Gather 34 SCO Open Server R5 0x 31 SCO Unix 35 SCO UnixWare 2 1x 31 SCSI 128 SCSI backup and utility software 36 SCSI Bus 32 34 SCSI Buses 2 SCSI Cable Vendors 112 SCSI Cables Connecting 61 SCSI Channel 128 SCSI Connectors 32 34 107 SCSI Connectors Vendors 112 SCSI Controller 32 SCSI Data Transfer Rate 32 SCSI Device Compatibility 36 SCSI Device Types Supported 32 SCSI Devices Configuration 97 SCSI Drive Installations 97 SCSI Drive State 15 SCSI Firmware 34 SCSI ID 129 SCSI Termination 32 34 57 Set 56
20. 8 16 32 64 or 128 MB of SDRAM cache memory in a DIMM socket used for read and write back caching and RAID 5 parity generation The MegaRAID Express 500 upgrade card includes one Ultra3 SCSI channel The channel is powered by a Q Logic ISP10160A 160M SCSI processor NVRAM and Flash ROM A 32 KB x 8 NVRAM stores RAID system configuration information The MegaRAID Express 500 firmware is stored in flash ROM for easy upgrade SCSI Connectors MegaRAID Express 500 has one ultra high density 68 pin external connector for external storage subsystem and one high density 68 pin internal connector Chapter 1 Overview 1 Single Ended and Differential SCSI Buses The SCSI standard defines two electrical buses e asingle ended bus e low voltage differential bus Maximum Cable Length for SCSI Standards Standard Single ended LVD Maximum Number of Drives WideUlraSCSI tm 1 Wide Ulta scsi 15m 12m J 7 Wide Ulta scsi 3m Dm 53 Ulm2SCSI 25m 1 Ulta2SCS Dm A357 WideUlra2SCSI 25m 1 Wide Ultra scs Dm o as X Ul3SCSI 25m 1 Ula3SCS 2m P7 WideUlra3 CSI 25m 1 WideUlra3SCSI am 15 SCSI Bus Widths and Maximum Throughput 2 MegaRAID Express 500 Hardware Guide Documentation The MegaRAID Express 500 technical documenta
21. Data loss because of a disk drive failure can be recovered by reconstructing missing data from the remaining data and parity drives RAID Benefits Improved I O RAID has gained popularity because it improves I O performance and increases storage subsystem reliability RAID provides data security through fault tolerance and redundant data storage The MegaRAID Express 500 management software configures and monitors RAID disk arrays Although disk drive capabilities have improved drastically actual performance has been improved only three to four times in the last decade Computing performance has been improved over 50 times during the same time period Increased Reliability The electromechanical components of a disk subsystem operate more slowly require more power and generate more noise and vibration than electronic devices These factors reduce the reliability of data stored on disks Chapter 2 Introduction to RAID 5 In This Chapter The following topics are discussed Major Topic Host based RAID solution page RAID overview page Consistency check Fault tolerance Disk rebuild Hot spares Hot swaps Parity Disk striping Disk mirroring Disk spanning Logical drive Logical drive states SCSI drive states Disk array types Enclosure management page E ra 0 Ea enm 6 MegaRAID Express 500 Hardware Guide MegaRAID Express 500 Host Based RAID Solution Host Based SCSI to SCSI
22. Device Driver Which driver do you want to install for this device Select the manufacturer and model of your hardware device and then click Next If you have a disk that contains the driver you want to install click Have Disk Manufacturers Altec Lansing AMI MegaProcessor SCSI Processor Device AMI MegaRAID Controller Component Version 5 21 0 0 AMI MegaRAID Controller Component Version 5 21 0 0 1 AMI MegaRAID Enterprise 1500 RAID Controller AMI MegaRAID Express 300 RAID Controller MALAS AID Famenne he MAID Ont The following window displays Insert the disk containing the driver into the selected drive and click on OK Found New Hardware Wizard Select a Device Driver Which driver do you want to install for this device Install From Disk Insert the manufacturer s installation disk into the drive selected and then click OK Copy manufacturer s files from Browse lt Back Next gt Cancel Chapter 7 Cluster Installation and Configuration 73 The following screen displays Select the processor device and click on Next Found New Hardware Wizard E Select a Device Driver 4 Which driver do you want to install for this device Sy Select the manufacturer and model of your hardware device and then click Next If you have a disk that contains the driver you want to install click Have Disk Manufacturers Models American Megatrends Inc r Device American Megatrends Inc AMI Meg
23. Number Fimwarelevel a TT Deen LL Logical Drive Number Drive Number Manufacturer Model Number Fimvarckvl ET SS Deen LL Logical Drive Number Dive Number Manufacturer Model Number Fimwarelevel Frugi TT Device Type LL Logical Drive Number Drive Number Manufacturer Model Number Fimvarckvl ET SS Deen TT Logical Drive Nube Dive Number 1 Manufacturer Model Number Fimwarelevel Sd SS xii MegaRAID Express500 Hardware Guide Preface Continued Disclaimer This manual describes the operation of the LSI Logic MegaRAID Express 500 Disk Array Controller Although efforts have been made to assure the accuracy of the information contained here LSI Logic expressly disclaims liability for any error in this information and for damages whether direct indirect special exemplary consequential or otherwise that may result from such error including but not limited to the loss of profits resulting from the use or misuse of the manual or information contained therein even if LSI Logic has been advised of the possibility of such damages Any questions or comments regarding this document or its contents should be addressed to LSI Logic at the address shown on the cover LSI Logic Corporation provides this publication as is without warranty of any kind either expressed or implied including but not limited to the implied wa
24. Pin SCSI Connector and P Cable Single Ended Cable Pinouts 113 115 High Density Connector 114 Host Computer 124 132 MegaRAID Express 500 Hardware Guide Host based Array 124 Host Based RAID Solution 7 Hot spare Using during disk rebuild 9 Hot Spare 10 15 124 Hot Swap 10 35 124 I O Driver 124 Initialization 124 Install Drivers 65 Installation Steps Custom 50 J JI Termination Enable 54 J10 Term Power 55 J11 61 J13 53 61 J15 53 55 J16 55 J16 Channel 1 WIDE 16 bit SCSI connector 53 J17 55 J18 Disk Activity LED 53 J5 Serial Port 54 J8 Hard Disk LED 55 J9 I2C Interface Connector 54 Jumpers 53 on motherboard 51 L Logical Disk 125 Logical Drive 15 125 Logical Drive States 15 Mapping 125 MB 125 MegaRAID BIOS 33 MegaRAID BIOS Setup 35 MegaRAID Express 500 Card Installing 60 MegaRAID Express 500 Card Layout 53 MegaRAID Manager 35 Mirroring 13 Motherboard Jumpers 51 Multi threaded 125 Multi threading 34 N Nonvolatile RAM 32 Novell NetWare 31 NVRAM 1 O Offline 15 Onboard Speaker 33 Online Drive state 15 Operating Environment 125 Operating System Software Drivers 31 Operating Voltage 32 Optimal 15 Optimizing Data Storage 46 OS 2 2 x 35 Other BIOS Error Messages 103 P Package Contents viii packing slip viii Parity 11 126 Partition 126 PCI Controller 32 Physical Array 9 Physical Disk 126 Physical Disk Roaming
25. Power down all nodes Next power on the shared storage then power on the first node Verify Disk Configuration Off On On eva the first node Power on the second Configure the First Node On Off On Shutdown all nodes Power on the first node Configure the Second Power on the second node after the first node was successfully configured Post installation On On On All nodes should be active Note 76 MegaRAID Before installing the Cluster Service software you must follow the steps below e Install Windows 2000 Advanced Server or Windows 2000 Datacenter Server on each node e Setup networks e Setup disks These steps must be completed on every cluster node before proceeding with the installation of Cluster Service on the first node To configure the Cluster Service on a Windows 2000 based server you must be able to log on as administrator or have administrative permissions on each node Each node must be a member server or be domain controllers inside the same domain A mix of domain controllers and member servers in a cluster is not acceptable Express 500 Hardware Guide Installing the Windows 2000 Operating System Install Microsoft Windows 2000 to each node See your Windows 2000 manual on how to install the Operating System Log on as administrator before you install the Cluster Services Setting Up Networks Note Do not allow both nodes to access the shared storage device before
26. Set the password settings to User Cannot Change Password and Password Never Expires Click on Next then click on Finish to create this user Note If your company s security policy does not allow the use of passwords that never expire you must renew the password on each node before password expiration You must also update the Cluster Service configuration 11 Right click on Cluster in the left pane of the Active Directory Users and Computers snap in 12 Select Properties from the context menu 13 Click on Add Members to a Group 14 Click on Administrators and click on OK This gives the new user account administrative privileges on this computer 15 Close the Active Directory Users and Computers snap in MegaRAID Express 500 Hardware Guide Setting Up Shared Disks Ad warning Make sure that Windows 2000 Advanced Server or Windows 2000 Datacenter Server and Quorum Disk Note the Cluster Service are installed and running on one node before you start an operating system on another node If the operating system is started on other nodes before you install and configure Cluster Service and run it on at least one node the cluster disks will have a high chance of becoming corrupted To continue power off all nodes Power up the shared storage devices Once the shared storage device is powered up power up node one The quorum disk stores cluster configuration database ch
27. and Ping 10 1 1 1 from Node 1 MegaRAID Express 500 Hardware Guide They you would type Ping 192 168 0 172 and L0 1 L l from Node 2 To confirm name resolution ping each node from a client using the node s machine name instead of its IP number Verifying Domain Membership All nodes in the cluster have to be members of the same domain and capable of accessing a domain controller and a DNS Server You can configure them as either member servers or domain controllers If you plan to configure one node as a domain controller you should configure all other nodes as domain controllers in the same domain as well Chapter 7 Cluster Installation and Configuration 81 Setting Up a Cluster User Account 82 The Cluster Service requires a domain user account that the Cluster Service can run under You must create the user account before installing the Cluster Service The reason for this is that setup requires a user name and password This user account should not belong to a user on the domain Step 1 Description Click on Start Point to Programs then point to Administrative Tools Click on Active Directory Users and Computers Click the plus sign to expand the domain name if it is not already expanded Click on Users Right click on Users Point to New and click on User Type in the cluster name and click on Next OO CO NI DI NM BR WwW ho
28. drive REB Chapter 2 Introduction to RAID 15 Disk Array Types The RAID disk array types are listed in the following table Software The array is managed by software running in a host computer using Based the host CPU bandwidth The disadvantages associated with this method are the load on the host CPU and the need for different software for each operating system SCSI to SCSI The array controller resides outside of the host computer and communicates with the host through a SCSI adapter in the host The array management software runs in the controller It is transparent to the host and independent of the host operating system The disadvantage is the limited data transfer rate of the SCSI channel between the SCSI adapter and the array controller Bus Based The array controller resides on the bus for example a PCI or EISA bus in the host computer and has its own CPU to generate the parity and handle other RAID functions A bus based controller can transfer data at the speed of the host bus PCI ISA EISA VL Bus but is limited to the bus it is designed for MegaRAID Express 500 resides on a PCI bus which can handle data transfer at up to 132 MB s With MegaRAID Express 500 the channel can handle data transfer rates up to 160 MB s per SCSI channel Enclosure Management 16 Enclosure management is the intelligent monitoring of the disk subsystem by software and or hardware The disk subsystem can be par
29. hard disk LED mounted on the computer enclosure The LED indicates data transfers Pin Description VCC through pullup SCSI Activity Signal SCSI Activity Signal VCC through pullup J10 Term Power J10 is a 2 pin jumper The factory setting 1s Pins 1 2 shorted Pins 1 2 should always be shorted for J10 to enable onboard term power J15 RUBI Slot Interrupt Steering J15 is a 3 pin jumper You can short the pins for a standard PCI slot or a PCI RUBI slot Neue S m c Standard PCI slot PCI RUBI slot J16 J17 RUBI Slot Interrupt Steering J16 and J17 are 3 pin jumpers You can short them for a one channel or two channel motherboard Short For Pins 1 2 on both jumpers 2 channel motherboard RAID Pins 2 3 on both jumpers 1 channel motherboard Chapter 6 Hardware Installation 55 Step 6 Set Termination You must terminate the SCSI bus properly Set termination at both ends of the SCSI cable The SCSI bus is an electrical transmission line and must be terminated properly to minimize reflections and losses Termination should be set at each end of the SCSI cable s as shown below MZ E Zr I Nom Termination on controller SCSI devices enabled termination enabled on both Setup using one connector for one channel For a disk array set SCSI bus termination so that removing or adding a SCSI device does not disturb termination An easy way to do this is t
30. means servers connected to common I O buses and a common network for client access Logically a cluster is a single management unit Any server can provide any available service to any authorized client The servers must have access to the same data and must share a common security model Again with current technology this generally means that the servers in a cluster will have the same architecture and run the same version of the same operating system The Benefits of Clusters Clusters provide three basic benefits e improved application and data availability e scalability of hardware resources e simplified management of large or rapidly growing systems Software Requirements The software requirments for cluster installation are e MS Windows 2000 Advanced Server or Windows 2000 Datacenter Server must be installed e You must use a name resolution method such as Domain Naming System DNS Windows Internet Naming System WINS or HOSTS e Using a Terminal Server for remote cluster administration is recommended Chapter 7 Cluster Installation and Configuration 67 Hardware Requirements 68 The hardware requirements for the Cluster Service node can be found at the following web site http www microsoft com windows2000 upgrade compat default asp e The cluster hardware must be on the Cluster Service Hardware Compatibility List HCL To see the latest version of the Cluster Service HCL go to the following web sit
31. mouse and a keyboard Configuration Features 15 Drive interface Fast and Wide Ultra 160M SE and LVD Upgradable cache size 16 MB 32 MB 64 MB or 128 MB Cache Function Write through write back ARA NRA RA Multiple logical drives arrays per Up to 40 logical drives per controller e ps Maximum number of MegaRAID Express Dedicated and pool hot spare Flashable firmware i i i Support for hard disk drives with Yes epceamerdm dn No reboot necessary after expansion More than 200 Qtags per physical drive Hardware clustering support on the board User specified rebuild rate 28 MegaRAID Express 500 Hardware Guide Hardware Architecture Features The hardware architecture features include Double sided DIMMs Yes Auxiliary TemPWRsouce No Array Performance Features The array performance features include Stripe Sizes 2 KB 4 KB 8 KB 16 KB 32 KB 64 ia Maximum number of concurrent 255 REM E Chapter 4 Features 29 RAID Management Features The RAID management features include sizes Windows NT and NetWare server Yes emana _ SCO Unix OS 2 and UnixWare Yes ES RS PMtsupport o Ye Management through an industry Not released yet standard browser Fault Tolerance Features The fault tolerance features include Support for SMART SAF TE compliant Drive failure detection Drive rebuild using hot spares Parity Generation and checking 30 MegaRAID Exp
32. on Create Partition The Create Partition Wizard begins Click on Next twice Enter the desired partition size in MB and click on Next WO CO A Nn Accept the default drive letter assignment by clicking on Next Oo Click on Next to format and create a partition Assigning Drive Letters X Note 84 After you have configured the bus disks and partitions you must assign drive letters to each partition on each clustered disk Mountpoints is a feature of the file system that lets you mount a file system using an existing directory without assigning a drive letter Mountpoints is not supported on clusters Any external disk that is used as a cluster resource must be partitioned using NTFS partitions and have a drive letter assigned to it Use the procedure below to assign driver letters Step 1 Description Right click on the desired partition and select Change Drive Letter and Path Select a new drive letter Repeat steps 1 and 2 for each shared disk 2 3 4 Close the Computer Management window MegaRAID Express 500 Hardware Guide Verifying Disk Access and Functionality Perform the steps below to verify disk access and functionality Step Description Click on Start Click on Programs Click on Accessories then click on Notepad Type some words into Notepad and use the File Save As command to save it as a test file called tes
33. on the taskbar You may also receive one of the following error messages During installation Only a singled Adapter is configured for internal cluster use If you have multiple adapters you may reconfigure them to avoid a single point of failure Or depending on the network role designated on other network adapters that are detected No network adapter was configured for internal cluster use The reason for this is because Media Sense is a default feature in Windows 2000 that removes bound protocols from an adapter sensed as down or disconnected Because the second node is powered off to avoid contention on the shared disk Media Sense flags the network as disconnected because there is no end to end signal During installation the Cluster Service does not detect the adapter because there are no protocols bound to the adapter Appendix C Cluster Configuration with a Crossover Cable 119 Solution Note 120 Using Registry Editor incorrectly can cause serious problems that may require you to reinstall your operating system Use Registry Editor at your own risk You should back up the registry before you edit it If you are running Windows NT or Windows 2000 you should also update your Emergency Repair Disk ERD Disable the Media Sense feature Start Registry Editor Regedt32 exe Locate the following key in the registry HKEY LOCAL MACHINE System CurrentControlSet Services Tcpip Parameters On the Edit menu click Ad
34. the Cluster Service is installed In order to prevent this power down any shared storage devices and then power up nodes one at a time Install the Clustering Service on at least one node and make sure it is online before you power up the second node Install at least two network card adapters per each cluster node One network card adapter card is used to access the public network The second network card adapter is used to access the cluster nodes The network card adapter that is used to access the cluster nodes establishes the following e Node to node communications e Cluster status signals e Cluster Management Check to make sure that all the network connections are correct Network cards that access the public network must be connected to the public network Network cards that access the cluster nodes must connect to each other Cont d Chapter 7 Cluster Installation and Configuration 77 Setting Up Networks Continued Note 78 Verify that all network connections are correct with private network adapters connected to other private network adapters only and public network adapters connected to the public network View the Network and Dial up Connections screen to check the connections 1 Network and Dial up Connections Back search Eyrolders History US GS X A Ed Address E Network and Dial up Connections Go E Make New Connection E File Edit View Favorites Tools Advanced Help
35. the previous page e A hyphen before a signal name indicates that signal is active low e The connector pin refers to the conductor position when using 0 025 inch centerline flat ribbon cable with a high density connector AMPLIMITE 050 Series connectors e Eight bit devices connected to the P Cable must leave the following signals open DB 8 DB 9 DB 10 DB 11 DB 12 DB 13 DB 14 DB 15 and DB P1 e All other signals should be connected as defined y Y Caution Lines labeled RESERVED should be connected to Ground in the bus terminator assemblies or in the end devices on the SCSI cable RESERVED lines should be open in the other SCSI devices but can be connected to Ground 114 MegaRAID Express 500 Hardware Guide 68 Pin Connector Pinout for LVD SCSI Connector Cable Cable Connector Pin Pin Pin Pin LB 1 1 2 35 DB DB 2 3 4 236 D DB 3 5 6 37 Bap 3DBIS 4 7 8 3 B05 DBPD 5 9 10 39 DBED DBO 6 n 2 40 DB DB 1 DB 1 DBO 8 15 16 4 DBO DB3 9 m7 18 43 DBO DB 4 DB 4 DB 5 DB 5 DB 6 DB 6 DB 7 DB 7 DB P DB P Grund 15 29 30 49 Ground DIFFSENS Ground TERMPWR 17 33 34 5i TERMPWR TERMPWR 18 35 36 52 TERMPWR Reserved Reserved Ground 20 39 40 54 Ground ATN round Ground msg 26 st 532 60 MSG wo 30 5 60 6 dO DBO
36. D Configuration Software Guide for additional information Power Console 500 Power Console 500 runs in Windows NT It configures monitors and maintains multiple RAID servers from any network node or a remote location See the MegaRAID Configuration Software Guide for additional information MegaRAID Manager This is a character based utility that works in DOS SCI Unix SVR3 2 R4 2 SCO UnixWare OS 2 2 x OS 2 Warp Linux Red Hat 6 x and Novell NetWare 3 x and 4 x See the MegaRAID Configuration Software Guide for additional information Fault Tolerance Features The MegaRAID Express 500 fault tolerance features are e automatic failed drive detection e automatic failed drive rebuild with no user intervention required e hot swap manual replacement without bringing the system down e SAF TE compliant enclosure management Detect Failed Drive The MegaRAID Express 500 firmware automatically detects and rebuilds failed drives This can be done transparently with hot spares Hot Swap MegaRAID Express 500 supports the manual replacement of a disk unit in the RAID subsystem without system shutdown Chapter 4 Features 35 Compatibility MegaRAID Express 500 compatibility issues include e server management e SCSI device compatibility e software compatibility Server Management As an SNMP agent MegaRAID Express 500 supports all SNMP managers and RedAlert from Storage Dimensions SCSI Device Compatibility MegaRAID Express 500 sup
37. D Express 500 Hardware Guide Disk Rebuild Rebuild Rate Physical Array You rebuild a disk drive by recreating the data that had been stored on the drive before the drive failed Rebuilding can be done only in arrays with data redundancy such as RAID level 1 3 5 10 30 and 50 Standby warm spare rebuild is employed in a mirrored RAID 1 system If a disk drive fails an identical drive is immediately available The primary data source disk drive is the original disk drive A hot spare can be used to rebuild disk drives in RAID 1 3 5 10 30 or 50 systems If a hot spare is not available the failed disk drive must be replaced with a new disk drive so that the data on the failed drive can be rebuilt The MegaRAID Express 500 controller automatically and transparently rebuilds failed drives with user definable rebuild rates If a hot spare is available the rebuild starts automatically when a drive fails MegaRAID Express 500 automatically restarts the system and the rebuild if the system goes down during a rebuild The rebuild rate is the fraction of the compute cycles dedicated to rebuilding failed drives A rebuild rate of 100 percent means the system is totally dedicated to rebuilding the failed drive The MegaRAID Express 500 rebuild rate can be configured between 0 and 100 At 0 the rebuild is only done if the system is not doing anything else At 100 the rebuild has a higher priority than any other system activi
38. D Migration RAID migration is used to move between optimal RAID levels or to change from a Read Ahead Ready State Rebuild Rebuild Rate degraded redundant logical drive to an optimal RAID 0 In Novell the utility used for RAID migration is MEGAMGR and in Windows NT its Power Console If a RAID 1 is being converted to a RAID 0 instead of performing RAID migration one drive can be removed and the other reconfigured on the controller as a RAID 0 This is due to the same data being written to each drive A memory caching capability in some adapters that allows them to read sequentially ahead of requested data and store the additional data in cache memory anticipating that the additional data will be needed soon Read Ahead supplies sequential data faster but is not as effective when accessing random data A condition in which a workable hard drive is neither online nor a hot spare and is available to add to an array or to designate as a hot spare The regeneration of all data from a failed disk in a RAID level 1 3 4 5 or 6 array to a replacement disk A disk rebuild normally occurs without interruption of application access to data stored on the array virtual disk The percentage of CPU resources devoted to rebuilding Cont d Glossary 127 Glossary Continued Reconstruct Redundancy The act of remaking a logical drive after changing RAID levels or adding a physical drive to an existing array The provision of multi
39. I adapters must be installed manually When Windows NT Setup displays Setup could not determine the type of one or more mass storage devices installed in your system or you have chosen to manually specify an adapter press S to display a list of supported SCSI host adapters Select Other from the bottom of the list Insert the Drivers Disk you made when prompted to do so and select MegaRAID Express 500 from this list In some cases Windows NT Setup repeatedly prompts to swap disks Windows NT will now recognize any devices attached to this adapter Repeat this step for each host adapter not already recognized by Windows NT Setup MegaRAID Express 500 Hardware Guide A SCSI Cables and Connectors SCSI Connectors MegaRAID Express 500 provides several different types of SCSI connectors The connectors are e one 68 pin high density internal connector e one 68 pin ultra high density external connector 68 Pin High Density SCSI Internal Connector The SCSI channel on the MegaRAID Express 500 Controller has a 68 pin high density 0 050 inch pitch unshielded connector This connector provides all signals needed to connect MegaRAID Express 500 to wide SCSI devices The following connector pinouts are provided for both single ended and differential primary bus P CABLE as specified in the SPI SCSI Parallel Interface documentation The cable assemblies that interface with the 68 pin connector are e flat ribbon or tw
40. PI Driver The MegaRAID Express ASPI driver can be used under DOS Windows 3 x and Windows 95 The DOS ASPI driver supports e upto six non disk SCSI devices each SCSI device must use a unique SCSI ID regardless of the SCSI channel it resides on SCSI IDs 1 through 6 are valid e upto six MegaRAID Express adapters you should configure only one MegaRAID adapter per system if possible ASPI Driver The ASPI driver is MEGASPI SYS It supports disk drives tape drives CD ROM drives Parameters etc You can use it to run CorelSCSI Novaback PC Tools and other software that requires an ASPI driver CorelSCSI Novaback and PC Tools are not provided with MegaRAID Express Copy MEGASPI SYS to your hard disk drive Add the following line to CONFIG SYS MEGASPI SYS must be loaded in CONFIG SYS before EMM386 EXE is loaded device lt path gt MEGASPI SYS v The MEGASPI SYS parameters are INT 13h support is not provided Verbose mode All message are displayed on the screen Physical drive access mode Permits access to physical drives Quiet mode All message except error message are suppressed Cont d Chapter 6 Hardware Installation 65 Step 12 Install Operating System Driver Continued CD ROM Driver A device driver is provided with MegaRAID Express 500 for CD ROM drives operating under DOS Windows 3 x and Windows 95 The driver filename is AMICDROM SYS The MEGASPI SYS ASPI manager must be added to the CONFIG SYS file b
41. RAID products are either e host based or e SCSI to SCSI The MegaRAID Express 500 controller is a host based RAID solution MegaRAID Express 500 is a PCI adapter card that is installed in any available PCI expansion slot in a host system A host based RAID product puts all of the RAID intelligence on an adapter card that is installed in a network server A host based RAID product provides the best performance MegaRAID Express 500 is part of the file server so it can transmit data directly across the computer s buses at data transfer speeds up to 132 MB s The available sequential data transfer rate is determined by the following factors the sustained data transfer rate on the motherboard PCI bus the sustained data transfer rate on the 1960RM PCI to PCI bridge the sustained data transfer rate of the SCSI controller the sustained data transfer rate of the SCSI devices the number of SCSI channels the number of SCSI disk drives Host based solutions must provide operating system specific drivers A SCSI to SCSI RAID product puts the RAID intelligence inside the RAID chassis and uses a plain SCSI Host Adapter installed in the network server The data transfer rate is limited to the bandwidth of the SCSI channel A SCSI to SCSI RAID product that has two wide SCSI channels operating at speeds up to 160 MB s must squeeze the data into a single wide SCSI 160 MB s channel back to the host computer In SCSI to SCSI RAID products the hard d
42. S or this driver is used with a BIOS that is MegaRAID Express logical earlier than v1 10 or no logical drives are configured drives 104 MegaRAID Express 500 Hardware Guide Other Potential Problems 6 KB of system memory once it is loaded CD ROM drives At this time copied CDs are not accessible from DOS even under DOS after loading MEGASPI SYS and AMICDROM SYS Physical Drive Errors To display the MegaRAID Manager Media Error and Other Error options press lt F2 gt after selecting a physical drive under the Physical Drive menu selected from the Objects menu A Media Error is an error that occurred while actually transferring data An Other Error is an error that occurs at the hardware level because of a device failure poor cabling bad termination signal loss etc Virtual Sizing The Virtual Sizing option enables RAID expansion Virtual Sizing must be enabled to increase the size of a logical drive or add a physical drive to an existing logical drive Run MegaRAID Manager by pressing lt Ctrl gt lt M gt to enable Virtual Sizing Select the Objects menu then select the Logical Drive menu Select View Update Parameters Set Virtual Sizing to Enabled Express 500 does not support BSDI Unix ID No multiple LUN devices are supported er Requirement Power Requirements requirements are 15 watts at 5V and 3 Amps SCSI Bus The ANSI specification dictates the following Requirements The maximum signal path length between termi
43. Segment 4 Segment 5 Segment 9 Segment 10 Segment 11 Parity 5 8 Parity 1 4 Parity is distributed across all drives in the array Segment 8 Chapter 3 RAID Levels 23 RAID 10 Uses Strong Points Weak Points Drives RAID 10 is a combination of RAID 0 and RAID 1 RAID 10 has mirrored drives RAID 10 breaks up data into smaller blocks and then stripes the blocks of data to each RAID 1 raid set Each RAID 1 raid set then duplicates its data to its other drive The size of each block is determined by the stripe size parameter which is set during the creation of the RAID set RAID 10 can sustain one to four drive failures while maintaining data integrity if each failed disk is in a different RAID 1 array RAID 10 works best for data storage that must have 100 redundancy of mirrored arrays and that also needs the enhanced I O performance of RAID 0 striped arrays RAID 10 works well for medium sized databases or any environment that requires a higher degree of fault tolerance and moderate to medium capacity RAID 10 provides both high data transfer rates and complete data redundancy RAID 10 requires twice as many drives as all other RAID levels except RAID 1 Four to 14 must be a multiple of two O ngirr Data flow Segment 2 duplicate Segment 4 Segment 4 duplicate Segment 6 Segment 6 duplicate 24 MegaRAID Express 500 Hardware Guide RAID 30 Uses Strong Points Weak Points Driv
44. T TOM SDRAM pav reao Ye sms Ye ixo SoM Important Ifthe DIMM SDRAM is not installed when you receive your MegaRAID Express 500 RAID controller you must call the manufacturer for a list of approved DIMM vendors You must use an approved DIMM only Call LSI Logic Technical Support at 678 728 1250 for the latest list of approved memory vendors Install cache memory on the MegaRAID Express 500 card in the DIMM socket This socket accepts a 168 pin DIMM Lay the controller card component side up on a clean static free surface to install the DIMM The memory socket is a right angle connector and is mounted flush with the MegaRAID card The DIMM card when properly installed will be parallel to the MegaRAID card The DIMM clicks into place indicating proper seating in the socket as shown below The MegaRAID card is shown laying on a flat surface in the illustration below ee 52 MegaRAID Express 500 Hardware Guide Step 5 Set Jumpers Make sure the jumper settings on the MegaRAID Express 500 card are correct The jumpers and connectors are MegaRAID Express 500 Card Layout J10 SCSI bus termination power J13 External SCSI connector J15 RUBI slot interrupt stearing J16 RUBI slot interrupt steering J17 RUBI slot interrupt steering J1 SCSI bus J3 NVRAM J6 Write Pending termination Clear J7 Bios enable enable control ae MA J4 Serial J8 User activ
45. a high density connector Both connector types can be used for the SCSI channel SCSI Termination MegaRAID Express 500 uses active termination on the SCSI bus conforming to Alternative 2 of the SCSI 2 specifications Termination enable disable is automatic through cable detection SCSI Firmware The MegaRAID Express 500 firmware handles all RAID and SCSI command processing and also supports Disconnect Optimizes SCSI Bus seek Es Tagged Command Multiple tags to improve random access nes Scatter Gather Multiple address count pairs Multi threading Up to 255 simultaneous commands with elevator sorting and concatenation of requests per SCSI channel Stripe Size Variable for all logical drives 2 KB 4 KB 8 KB 16 KB 32 KB 64 KB or 128 KB Rebuild Multiple rebuilds and consistency checks with user definable priority 34 MegaRAID Express 500 Hardware Guide RAID Management RAID management is provided by software utilities that manage and configure the RAID system and MegaRAID Express 500 create and manage multiple disk arrays control and monitor multiple RAID servers provide error statistics logging and provide online maintenance They include e MegaRAID BIOS Setup e Power Console 500 e MegaRAID Manager e General Alert Module MegaRAID BIOS Setup BIOS Setup configures and maintains RAID arrays formats disk drives and manages the RAID system It is independent of any operating system See the MegaRAI
46. aRAID Controller Component DELL AMI MegaRAID Virtual Device Gateway Hewlett Packard JMR Electric nStor Have Disk ea On the final screen click on Finish to complete the installation Repeat the process on the peer system Found New Hardware Wizard Start Device Driver Installation CN The device driver will be installed with the default settings ey The wizard is ready to install the driver for the following hardware device m AMI MegaProcessor SCSI Processor Device Windows will use default settings to install the software for this hardware device To install the software for your new hardware click Next lt Back Cancel 74 MegaRAID Express 500 Hardware Guide Network Requirements The network requirements for clustering are A unique NetBIOS cluster name Five unique static IP addresses e two are for the network adapters on the internal network e two are for the network adapters on the external network e one is for the cluster itself A domain user account for Cluster Service all nodes must be part of the same domain Two network adapters for each node one for connection to the external network and the other for the node to node internal cluster network If you do not use two network adapters for each node your configuration is unsupported HCL certification requires a separate private network adapter Shared Disk Requirements Disks can be shared by the nodes The requireme
47. al wide and external wide SCSI devices is shown below BERR RRR RRR RRR RRR A BERBER RR RRR RRR pin 1 pin 1 d000000000000000000000000000000000 B d000000000000000000000000000000000 pin 1 d000000000000000000000000000000000 d000000000000000000000000000000000 Connector A 68 position panel mount receptacle with 4 40 holes female AMP 786096 7 NOTE To convert to 2 56 holes use screwlock kit 749087 1 749087 2 or 750644 1 from AMP Connector B 68 position plug male AMP 786090 7 Cable Flat Ribbon or Twisted Pair Flat Cable 68 Conductor 0 025 Centerline 30 AWG Cont d Appendix A SCSI Cables and Connectors 109 68 Pin High Density Connectors Continued Converting Internal Wide to Internal Non Wide Type 2 The cable assembly for converting internal 110 wide SCSI connectors to internal non wide SCSI connectors is shown below 68 POSITION 50 POSITION CONNECTOR CONNECTOR CONTACT NUMBER CONTACT NUMBER 6 gt 1 409 e 5 2 7T e 3 4 eK 5 4 49 es 16 en 50 o 2 17 OPEN 23 51 OPEN 24 18 OPEN 25 5 es 2 19 o e 2 2 es a 6 o 48 30 o 49 64 o e 50 TABLE 1
48. ame Step 1 Description Right click on the Local Area Connection 2 icon Click on Rename Type Private Cluster Connection into the textbox then press Enter 2 3 4 Repeat steps 1 3 to change the name of the public LAN network adapter to Public Cluster Connection The renamed icons should look like those in the picture above Close the Networking and Dial up Connections window The new connection names automatically replicate to other cluster servers as the servers are brought online Setting up the First Node in your Cluster Follow the steps below to setup the first node in your cluster Step 1 Description Right click on My Network Places then click on Properties 2 Right click the Private Connection icon 3 Click on Status The Private Connection Status window shows the connection status as well as the speed of connection If the window shows that the network is disconnected examine cables and connections to resolve the problem before proceeding Click on Close Right click Private Connection again Click on Properties Click on Configure Click on Advanced The network card adapter properties window displays oo A3 O tn BR BR You should set network adapters on the private network to the actual speed of the network rather than the default automated speed selection Select the network speed from the drop down list Do not use Auto sel
49. and remains on the screen Make sure that each end of the channel chain is properly terminated using the recommended terminator type for the peripheral device The channel is automatically terminated at the MegaRAID Express 500 card if only one cable is connected to a channel Make sure on a channel basis only two types of cables are connected at any one time Make sure that the MegaRAID Express 500 controller is properly seated in the PCI slot What SCSI IDs can a non hard disk Non hard disk devices can accommodate only device have and what is maximum SCSI IDs 1 2 3 4 5 or 6 regardless of the number allowed per adapter channel used A maximum of six non hard disk devices are supported per MegaRAID Express 500 adapter Why does a failed logical array still To maintain the DOS Path statement integrity get a drive assignment 100 MegaRAID Express 500 Hardware Guide BIOS Boot Error Messages Adapter BIOS Disabled No Logical Drives Handled by BIOS Host Adapter at Baseport xxxx Not Responding No MegaRAID Express 500 Adapter Configuration of NVRAM and drives mismatch Run View Add Configuration option of Configuration Utility Press any key to run the Configuration Utility 1 Logical Drive Failed X Logical Drives Degraded The MegaRAID BIOS is disabled Sometimes the BIOS is disabled to prevent booting from the BIOS The BIOS cannot communicate with the adapter firmware The BIOS cannot
50. at you can choose a specific driver Click on Next Found New Hardware Wizard Install Hardware Device Drivers a device driver is a software program that enables a hardware device to work with ey an operating system This wizard will complete the installation for this device e AMI MegaProcessor SCSI Processor Device amp device driver is a software program that makes a hardware device work Windows needs driver files for your new device To locate driver files and complete the installation click Next What do you want the wizard to do Search for a suitable driver for my device recommended Display a list of the known drivers for this device so that can choose a specific driver The following screen displays Select Other devices from the list of hardware types Click on Next Found New Hardware Wizard Hardware Type What type of hardware do you want to install Select a hardware type and then click Next Hardware types amp Memory technology driver Modems SD Multi port serial adapters EB Network adapters 9 Other d S QD PCMCIA adapters ay Ports COM amp LPT d Printers amp SCSI and RAID controllers gt lt Back Cancel 72 MegaRAID Express 500 Hardware Guide The following screen displays Select the driver that you want to install for the device If you have a disk with the driver you want to install click on Have Disk Found New Hardware Wizard Select a
51. ate Cluster Connection represents a direct connection between nodes it remains at the top of the list In normal operation this connection is used for cluster communication In case of the Private Cluster Connection failure Cluster Service automatically switches to the next Chapter 7 Cluster Installation and Configuration 91 92 network on the list in this case Public Cluster Connection Verify that the first connection in the list is the Private Cluster Connection then click on Next Note Always set the order of the connections so that the Private Cluster Connection is first in the list Cluster Service Configuration Wizard Internal Cluster Communication Specify the priority in which the available networks should be used for communication within the cluster The following list displays the networks available for internal cluster communication private networks Position the primary network first and then position additional networks in descending order of importance To move a name in the list select the name and then click Up or Down Networks Up Down Enter the unique cluster IP address and Subnet mask for your network then click on Next The Cluster Service Configuration Wizard shown below automatically associates the cluster IP address with one of the public or mixed networks It uses the subnet mask to select the correct network Cluster Service Configuration Wi
52. ble click on Add Remove Programs 4 Double click on Add Remove Windows Components The following window displays Windows Components Wizard s x Windows Components You can add or remove components of Windows 2000 To add or remove a component click the checkbox 4 shaded box means that only part of the component will be installed To see what s included in a component click Details Components ig Accessories and Utilities O A Certificate Services Clust ice GP Indexing Service 0 0 MB BB Internet Information Services IMISI 221 MR z Description Enables servers to work together as a cluster to keep server based applications highly available regardless of individual component failures Total disk space required 0 1 MB Delos Space available on disk 1860 0 MB E lt Back Cancel 5 Select Cluster Service then click on Next 6 Cluster Service files are located on the Windows 2000 Advanced Server or Windows 2000 Datacenter Server CD ROM Enter x i386 where x is the drive letter of your CD ROM If you installed Windows 2000 from a network enter the appropriate network path instead If the Windows 2000 Setup flashscreen displays close it 7 Click on OK The following screen displays 86 MegaRAID Express 500 Hardware Guide Cluster Service Configuration Wizard q xj Welcome to the Cluster Service Configuration Wizard This wizard helps you cr
53. bus will then operate in single ended mode Host Computer Internal SCSI Drives Q Logic Express 500 SCSI ID 7 No Termination C L mm SCSI Tape Drive SCSI CD ROM ID2 n2 Scanner ID5 ID Chapter 6 Hardware Installation 59 Step 7 Install MegaRAID Express 500 Choose a 3 3 V or 5 V PCI slot and align the MegaRAID Express 500 controller card bus connector to the slot Press down gently but firmly to make sure that the card is properly seated in the slot The bottom edge of the controller card should be flush with the slot PCI expansion slots I edge of motherboard Insert the MegaRAID Express 500 card in a PCI slot as shown below nr m M Screw the bracket to the computer frame 60 MegaRAID Express 500 Hardware Guide Step 8 Connect SCSI Cables Connect SCSI cables to SCSI devices MegaRAID Express 500 provides two SCSI connectors J11 the SCSI channel internal high density 68 pin connector for Wide 16 bit SCSI and J13 the SCSI channel external ultra high density 68 pin connector for Wide 16 bit SCSI Didi mr eee re e ee DIDI IE Connect SCSI Devices Use the following procedure to connect SCSI devices Action Disable termination on any SCSI device that does not sit at the end ofthe SCSI bus 2 Configure all SCSI devices to supply Ter
54. critical data that requires high performance Data duplicated on another disk mirroring Use for read intensive fault tolerant systems Disk striping with a dedicated parity drive Use for non interactive apps that process large files sequentially Disk striping and parity data across all drives Use for high read volume but low write volume such as transaction processing Data striping and mirrored drives Disk striping with a dedicated parity drive Disk striping and parity data across all drives MegaRAID Express 500 Hardware Guide High data throughput for large files 100 data redundancy Achieves data redundancy at low cost Achieves data redundancy at low cost High data transfers complete redundancy High data transfers redundancy High data transfers redundancy Maximum Fault Physical Tolerant Drives No fault One to 15 tolerance All data lost if any drive fails Doubles disk 2 Yes space Reduced performance during rebuilds Performance Three to 15 Yes not as good as RAID 1 Performance Three to 15 Yes not as good as RAID 1 More Four to 14 complicated must be a multiple of two More Six tol5 complicated More Six to 15 complicated RAID 0 Uses Strong Points Weak Points Drives RAID 0 provides disk striping across all drives in the RAID subsystem RAID 0 does not provide any data redundancy but does offer the best performance o
55. d Value and then add the following registry value Value Name DisableDHCPMediaSense Data Type REG DWORD Value 1 Quit Registry Editor and then restart the computer The network adapter still shows the disconnected status but the cluster installation process can detect the adapter as available for cluster communication Alternatively when you install the Cluster Service on the first node you can have the second node powered up to the Control M lt Ctrl gt lt M gt menu On the first node a network connection will be detected for the private network MegaRAID Express 500 Hardware Guide Glossary Array A grouping or array of disk drives combines the storage space on the disk drives into a single segment of contiguous storage space MegaRAID can group disk drives on one or more SCSI channels into an array A hot spare drive does not participate in an array Array Management Software Software that provides common control and management for a disk array Array Management Software most often executes in a disk controller or intelligent host bus adapter but can also execute in a host computer When it executes in a disk controller or adapter Array Management Software is often called firmware Array Spanning Array spanning by a logical drive combines storage space in two arrays of disk drives into a single contiguous storage space in a logical drive MegaRAID logical drives can span consecutively numbered arrays that
56. device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference in a residential installation This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not occur in a specific installation If this equipment does cause harmful interference to radio or television reception which can be determined by turning the equipment off and on try to correct the interference by one or more of the following measures 1 Reorient or relocate the receiving antenna 2 Increase the separation between the equipment and the receiver 3 Connect the equipment into an outlet on a circuit different from that to which the receiver is connected 4 Consult the dealer or an experienced radio TV technician for help Shielded interface cables must be used with this product to ensure compliance with the Class B FCC limits LSI Logic MegaRAID Express 500 PCI RAID Controller Model Number Series 475 FCC ID Number IUESER475 Disclaimer LSI Logic certifies only that this product will work correctly when this product is used with the same jumper settings the same system configuration the same memory module parts and the same peripherals that were tested by LSI Logic with this product The complete list of test
57. e http www microsoft com hcl default asp and search using the word Cluster e Two HCL approved computers each with the following e A boot disk that has Windows 2000 Advanced Server or Windows 2000 Datacenter Server installed You cannot put the boot disk on the shared storage bus described below e Aseparate PCI storage host adapter SCSI or Fibre Channel is required for the shared disks This is along with the boot disk adapter e Each machine in the cluster needs two PCI network adapters e An HCL approved external disk storage unit connected to all the computers in the cluster This is used as the clustered disk RAID redundant array of independent disks is recommended for this storage unit e Storage cables are needed to attach the shared storage device to all the computers in the cluster e Make sure that all hardware is identical slot for slot card for card for all nodes This will make it easier to configure the cluster and eliminate potential compatibility problems MegaRAID Express 500 Hardware Guide Installation and Configuration Use the following procedures to install and configure your system as part of a cluster Unpack the controller following the instructions onpageb1 Set the hardware termination for the controller as always on Refer to the J1 Termination Enable jumper settings on page 54 for more information Configure the IDs for the drives in the enclosure See the enclosure
58. each consist of the same number of disk drives Array spanning promotes RAID levels 1 3 and 5 to RAID levels 10 30 and 50 respectively See also Disk Spanning Asynchronous Operations Operations that bear no relationship to each other in time and can overlap The Cache I O Channel concept of asynchronous I O operations is central to independent access arrays in throughput intensive applications A small amount of fast memory that holds recently accessed data Caching speeds subsequent access to the same data It is most often applied to processor memory access but can also be used to store a copy of data accessible over a network When data is read from or written to main memory a copy is also saved in cache memory with the associated main memory address The cache memory software monitors the addresses of subsequent reads to see if the required data is already stored in cache memory If it is already in cache memory a cache hit it is read from cache memory immediately and the main memory read is aborted or not started If the data is not cached a cache miss it is fetched from main memory and saved in cache memory An electrical path for the transfer of data and control information between a disk and a disk controller Cont d Glossary 121 Glossary Continued Consistency Check An examination of the disk system to determine whether all conditions are valid for the Cold Swap specified configuration such as parity
59. eate and configure a cluster cluster is a group of servers that work together to provide high reliability IF a program fails on one server it is moved to another one Before you continue close any open programs To continue click Next lt Back Cancel Click on Next The Hardware Configuration Certification window appears Click on I Understand to accept the condition that Cluster Service is supported only on hardware listed on the Hardware Compatibility List Cluster Service Configuration Wizard Xl Hardware Configuration Your hardware configuration must be tested for compatability with the Cluster service Microsoft does not support hardware configurations other than those listed in the Cluster category of the Hardware Compatibility List HCL located at http www microsoft com hwtest hel To indicate that you understand that Microsoft does not support hardware configurations that are not listed in the Cluster category of the HCL click Understand Understand lt Back Next gt Cancel 10 This is the first node in the cluster therefore you must create the cluster itself Select The first node in the cluster as shown below and then click on Next Chapter 7 Cluster Installation and Configuration 87 88 Cluster Service Configuration Wizard ik i x Create or Join a Cluster You can create a new cluster or you can join an existing
60. eates a potential single point of failure We recommend that you use multiple networks with at least one network configured as a private link between nodes and other connections through a public network If you use more than one private network make sure that each uses a different subnet as Cluster Service recognizes only one network interface per subnet This document assumes that only two networks are in use It describes how you can configure these networks as one mixed and one private network The order in which the Cluster Service Configuration Wizard presents these networks can vary In this example the public network is presented first Cont d Chapter 7 Cluster Installation and Configuration 89 Configuring Cluster Disks Continued 90 Use the following procedure to configure the clustered disks Step 1 Description The Add or Remove Managed Disks dialog box specifies disks on the shared SCSI bus that will be used by Cluster Service Add or remove disks as necessary then click on Next Cluster Service Configuration Wizard ET E xj Add or Remove Managed Disks The disks that Cluster service controls access to are known as managed disks Add the disks that you want the cluster to manage Remove those disks that you do not want the cluster to manage Unmanaged disks Managed disks Disk 1 MEGARAID LD Ob E New Volume Disk 2 MEGARAID LD 1h F New Volume Add gt 1
61. eckpoints and log files that help manage the cluster Windows 2000 makes the following quorum disk recommendations e Create a small partition Use a minimum of 50 megabytes MB as a quorum disk Windows 2000 generally recommends a quorum disk to be 500 MB e Dedicate a separate disk for a quorum resource The failure of the quorum disk would cause the entire cluster to fail therefore Windows 2000 strongly recommends that you use a volume on a RAID disk array During the Cluster Service installation you have to provide the drive letter for the quorum disk For our example we use the letter E for the quorum disk drive letter Chapter 7 Cluster Installation and Configuration 83 Configuring Shared Disks Perform the following procedure to configure the shared disks Step 1 Description Right click on My Computer Click on Manage then click on Storage Double click on Disk Management 2 3 4 Make sure that all shared disks are formatted as NTFS and are designated as Basic If you connect a new drive the Write Signature and Upgrade Disk Wizard starts automatically If this occurs click on Next to go through the wizard The wizard sets the disk to dynamic but you can uncheck it at this point to set it to basic To reset the disk to Basic right click on Disk where identifies the disk that you are working with and click on Revert to Basic Disk Right click on unallocated disk space Click
62. ect as the setting for speed Some adapters can drop packets while determining the speed Set the network adapter speed by clicking the appropriate option such as Media Type or Speed Configure identically all network adapters in the cluster that are attached to the same network so they use the same Duplex Mode Flow Control Media Type and so on These settings should stay the same even if the hardware is different 10 Click on Transmission Control Protocol Internet Protocol TCP IP 11 Click on Properties 12 Click on the radio button for Use the following IP address 13 Enter the IP addresses you want to use for the private network 14 Type in the subnet mask for the network 15 Click the Advanced radio button then select the WINS tab 16 Select Disable NetBIOS over TCP IP 17 Click OK to return to the previous menu Perform this step for the private network adapter only Chapter 7 Cluster Installation and Configuration 79 Configuring the Public Network Adapter Note It is strongly recommended that you use static IP addresses for all network adapters in the cluster This includes both the network adapter used to access the cluster nodes and the network adapter used to access the LAN Local Area Network If you must use a dynamic IP address through DHCP access to the cluster could be terminated and become unavailable if the DHCP server goes down
63. ed for PCI Initialize the logical drive before installing the operating system One of the hard drive in the array Check the drive error counts using Power fails often Console 500 Format the drive Rebuild the drive If the drive continues to fail replace the drive with another drive with the same capacity Pressed Ctrl M Ran Check the drives IDs on each channel to make Megaconf exe and tried to make a sure each device has a different ID new configuration The system hangs when scanning devices Check the termination The device at the end of the channel must be terminated Replace the drive cable Multiple drives connected to Set the drives to spin on command This will MegaRAID Express 500 using the allow MegaRAID Express 500 to spin two same power supply There is a devices simultaneously problem spinning the drives all at once Pressing Ctrl M or running These utilities require a color monitor megaconf exe does not display the Management Menu At system power up with the For proper cache memory operation you must MegaRAID Express 500 installed install at least 16 MB of memory in the screen display is garbled or does MegaRAID Express 500 not appear at all Cannot flash or update the You may need a new EEPROM EEPROM Chapter 8 Troubleshooting Suggested Solution Make sure that TERMPWR is being properly provided to each peripheral device populated channel Firmware Initializing appears
64. ed jumper settings system configurations peripheral devices and memory modules are documented in the LSI Logic Compatibility Report for this product Call your LSI Logic sales representative for a copy of the Compatibility Report for this product xiv MegaRAID Express500 Hardware Guide 1 Overview Features SCSI Channel The MegaRAID Express 500 PCI RAID controller is a high performance intelligent PCI to SCSI host adapter with RAID control capabilities The MegaRAID Express 500 provides reliability high performance and fault tolerant disk subsystem management The MegaRAID Express 500 is part of the LSI Logic Intel i960RM RS based MegaRAID controller family The MegaRAID Express 500 is an entry level to mid range RAID controller solution MegaRAID Express 500 offers a cost effective way to implement RAID in a server The MegaRAID Express 500 has a 160M Ultra and Wide SCSI channel supporting data transfer rates up to 160 megabytes per second MB s per channel The SCSI channel supports up to fifteen non Ultra SCSI devices MegaRAID Express 500 includes MegaRAID features and performance MegaRAID Express 500 provides a high performance I O migration path while preserving existing PCI SCSI software performs SCSI data transfers up to 160 MB s performs synchronous operation on a wide LVD SCSI bus allows up to 15 LVD SCSI devices on the wide bus includes an Intel 1960RM that performs RAID calculations and routing supports
65. efore you can install the CD ROM device driver See the instructions on the previous page for adding the MEGASPI SYS driver Copy AMICDROM SYS to the root directory of the C drive Add the following line to CONFIG SYS making sure it is preceded by the line for MEGASPI SYS DEVICE C AMICDROM SYS Add the following to AUTOEXEC BAT Make sure it precedes the SMARTDRV EXE line MSCDEX D MSCD001 MSCDEX is the CD ROM drive extension file that is supplied with MS DOS and PC DOS Version 5 0 or later See your DOS manual for the command line parameters for MSCDEX Summary This chapter discussed hardware installation Configure the RAID system via software configuration utilities See the MegaRAID Configuration Software Guide for all information about MegaRAID Express 500 software utilities The utility programs for configuring MegaRAID Express 500 are MegaRAID Manager DOS Linux Red Hat 6 x OS 2 2 x OS 2 Warp SCO UNIX SVR3 2 SCO UnixWare Novell NetWare 3 x 4 x Power Console 500 Microsoft Windows NT peus eee il 66 MegaRAID Express 500 Hardware Guide 7 Cluster Installation and Configuration Overview Clusters This chapter contains the procedures for installing Cluster Service for servers running the Windows 2000 server operating system Physically a cluster is a grouping of two independent servers that can access the same data storage and provide services to a common set of clients With current technology this usually
66. egaRAID Express 500 controller automatically occupies TID 7 in the SCSI channel Eight bit SCSI devices can only use the TIDs from 0 to 6 16 bit devices can use the TIDs from 0 to 15 The arbitration priority for a SCSI device depends on its TID Highest Lowest Important Non disk devices CD ROM or tapes should have unique SCSI IDs regardless of the channel they are connected to ID 0 cannot be used for non disk devices because they are limited to IDs 1 through 6 There is a limit of six IDs for non disk devices per controller MegaRAID Express 500 Hardware Guide Device Identification on MegaRAID Express 500 Example of MegaRAID Express 500 ID Mapping ID Channel O o CM Oes an EE ES oase As Presented to the Operating System DID LUN Device ID LUN Device o O0 Disk Al x 1 0 Seamer ERES 2 0 o 2 Disk A3 x 3 0 Tape o 3 Disk A4 x 4 0 0 4 Disk AS X 5 0 Tape O 5 Dik A6X 6 O0 Optical 0 6 Disk A7 x J o 7 Dik ASOO Chapter 6 Hardware Installation 63 Step 10 Power Up Replace the computer cover and reconnect the AC power cords Turn power on to the host computer Set up the power supplies so that the SCSI devices are powered up at the same time as or before the host computer If the computer is powered up before a SCSI device the device might not be recognized
67. egistered trademark of Seagate Corporation SyQuest is a trademark of SyQuest Corporation Panasonic is a registered trademark of Panasonic Corporation Hewlett Packard is a registered trademark of Hewlett Packard Corporation Amphenol is a trademark of Amphenol Corporation Siemens is a registered trademark of Siemens Corporation AMP is a trademark of AMP Corporation Revision History 4 14 00 Initial release 4 11 01 Corrected RAID 0 graphic and Array Configuration Planner table 6 13 01 Make corrections such as cache size 16 MB is smallest option and the number of physical disk drives supported at various RAID levels ii MegaRAID Express500 Hardware Guide Table of Contents Preface iii Table of Contents Continued iv MegaRAID Express500 Hardware Guide Table of Contents Continued onfiguring Shared Disks igning Drive Letters Preface Table of Contents Continued vi MegaRAID Express500 Hardware Guide Preface The MegaRAID Express 500 PCI RAID Controller supports all single ended and low voltage differential LVD SCSI devices on a 160M Ultra and Wide SCSI channel with data transfer rates up to 160 MB s Megabytes per second This manual describes MegaRAID Express 500 Limited Warranty The buyer agrees if this product proves to be defective that LSI Logic is obligated only to repair or replace this product at LSI Logic s discretion according to the terms and conditions of the warranty re
68. erates a set of redundancy data from two or more parent data sets The redundancy data can be used to reconstruct one of the parent data sets Parity data does not fully duplicate the parent data sets In RAID this method is applied to entire drives or stripes across all disk drives in an array The types of parity are Dedicated Parity The parity of the data on two or more disk drives is stored on an additional disk Distributed The parity data is distributed across all drives in the Parity system If a single disk drive fails it can be rebuilt from the parity and the data on the remaining drives RAID level 3 combines dedicated parity with disk striping The parity disk in RAID 3 is the last logical drive in a RAID set RAID level 5 combines distributed parity with disk striping Parity provides redundancy for one drive failure without duplicating the contents of entire disk drives but parity generation can slow the write process A dedicated parity scheme during normal read write operations is shown below Generator Chapter 2 Introduction to RAID 11 Disk Striping Disk striping writes data across multiple disk drives instead of just one disk drive Disk striping involves partitioning each drive storage space into stripes that can vary in size from 2 KB to 128 KB These stripes are interleaved in a repeated sequential manner The combined storage space is composed of stripes from each drive MegaRAID Express 500 support
69. es RAID 30 is a combination of RAID 0 and RAID 3 RAID 30 provides high data transfer speeds and high data reliability RAID 30 is best implemented on two RAID 3 disk arrays with data striped across both disk arrays RAID 30 breaks up data into smaller blocks and then stripes the blocks of data to each RAID 3 raid set RAID 3 breaks up data into smaller blocks calculates parity by performing an exclusive or on the blocks and then writes the blocks to all but one drive in the array The parity data created during the exclusive or is then written to the last drive in each RAID 3 array The size of each block is determined by the stripe size parameter which is set during the creation of the RAID set RAID 30 can sustain one to four drive failures while maintaining data integrity if each failed disk is in a different RAID 3 array Use RAID 30 for sequentially written and read data pre press and video on demand that requires a higher degree of fault tolerance and medium to large capacity Provides data reliability and high data transfer rates Requires 2 4 times as many parity drives as RAID 3 Six to 15 The initiator takes one ID per channel This leaves 15 IDs available for one channel Parity 1 2 Segment 3 Segment 4 Parity 3 4 Parity 5 6 Segment 7 Segment 8 Parity 7 8 Parity 9 10 Segment11 Segment12 Parity 11 12 ipee t 341 Chapter 3 RAID Levels 25 RAID 50 Uses Strong Points Weak Point
70. ess 500 Hardware Guide RAID 5 Uses Strong Points Weak Points Drives Disk 1 Segment 1 Segment Parity 9 12 RAID 5 includes disk striping at the byte level and parity In RAID 5 the parity information is written to several drives RAID 5 is best suited for networks that perform a lot of small I O transactions simultaneously RAID 5 addresses the bottleneck issue for random I O operations Since each drive contains both data and parity numerous writes can take place concurrently In addition robust caching algorithms and hardware based exclusive or assist make RAID 5 performance exceptional in many different environments RAID 5 provides high data throughput especially for large files Use RAID 5 for transaction processing applications because each drive can read and write independently Ifa drive fails MegaRAID Express 500 uses the parity drive to recreate all missing information Use also for office automation and online customer service that requires fault tolerance Use for any application that has high read request rates but low write request rates Provides data redundancy and good performance in most environments Disk drive performance will be reduced if a drive is being rebuilt Environments with few processes do not perform as well because the RAID overhead is not offset by the performance gains in handling simultaneous processes Three to 15 4 Disk 2 Segment 6 Segment 12
71. ess 500 has a SCSI channel that supports 160M Ultra and Wide SCSI at data transfer rates up to 160 MB s The SCSI channel supports up to 15 Wide devices and up to seven non Wide devices In This Chapter Topics described in this chapter include new features configuration features hardware architecture features array performance features RAID management features fault tolerance features utility programs software drivers SMART Technology The MegaRAID Express 500 Self Monitoring Analysis and Reporting Technology SMART detects up to 70 of all predictable drive failures SMART monitors the internal performance of all motors heads and drive electronics Configuration on Disk Configuration on Disk drive roaming saves configuration information both in NVRAM on MegaRAID Express 500 and on the disk drives connected to MegaRAID Express 500 If MegaRAID Express 500 is replaced the new MegaRAID Express 500 controller can detect the actual RAID configuration maintaining the integrity of the data on each drive even if the drives have changed channel and or target ID Chapter 4 Features 27 Hardware Requirements MegaRAID Express 500 can be installed in an IBM AT compatible or EISA computer with a motherboard that has 5 volt 3 3 volt PCI expansion slots The computer must support PCI version 2 1 or later The computer should have an Intel Pentium Pentium Pro or more powerful CPU a floppy drive a color monitor and VGA adapter card a
72. f any RAID level RAID 0 breaks up data into smaller blocks and then writes a block to each drive in the array The size of each block is determined by the stripe size parameter set during the creation of the RAID set RAID 0 offers high bandwidth By breaking up a large file into smaller blocks MegaRAID Express 500 can use several drives to read or write the file faster RAID 0 involves no parity calculations to complicate the write operation This makes RAID 0 ideal for applications that require high bandwidth but do not require fault tolerance RAID 0 provides high data throughput especially for large files Any environment that does not require fault tolerance Provides increased data throughput for large files No capacity loss penalty for parity Does not provide fault tolerance All data lost if any drive fails One to 15 The initiator takes one ID per channel This leaves 15 IDs available for one channel Segment 1 stripe Segment 2 stripe Segment 3 stripe Segment 4 stripe Segment stripe Segment 6 stripe Segment 7 stripe Segment 8 stripe etc etc Chapter 3 RAID Levels 19 RAID 1 In RAID 1 MegaRAID Express 500 duplicates all data from one drive to a second drive RAID 1 provides complete data redundancy but at the cost of doubling the required data storage capacity Uses Use RAID 1 for small databases or any other environment that requires fault tolerance but small capacity Strong Points RAID
73. figure RAID 50 by spanning two contiguous RAID 5 logical drives The RAID 5 logical drives must have the same stripe size Spanning two contiguous RAID 0 logical drives does not produce a new RAID level or add fault tolerance It does increase the size of the logical volume and improves performance by doubling the number of spindles 14 MegaRAID Express 500 Hardware Guide Logical Drive A logical drive is a partition in a physical array of disks that is made up of contiguous data segments on the physical disks A logical drive can consist of an entire physical array more than one entire physical array a part of an array parts of more than one array or a combination of any two of the above conditions Logical Drive States The drive operating condition is good All configured drives are online Degraded The drive operating condition i is not optimal One of the configured Kl RM Failed Failed The drive has failed The drive is not available to MegaRAID Express 500 SCSI Drive States A SCSI disk drive can be in one of these states Online The drive is functioning normally and is a part of a configured Ready The drive is functioning normally but is not part of a configured Hot Spare The drive is powered up and ready for use as a spare in case an HOTSP online drive fails Fail A fault has occurred in the drive placing it out of service FAIL Rebuild The drive is being rebuilt with data from a failed
74. gement by combining existing resources or adding relatively inexpensive resources For example four 400 MB disk drives can be combined to appear to the operating system as one single 1600 MB drive See also Array Spanning and Spanning Cont d 122 MegaRAID Express 500 Hardware Guide Glossary Continued Disk Striping A type of disk array mapping Consecutive stripes of data are mapped round robin to consecutive array members A striped array RAID Level 0 provides high I O performance at low cost but provides lowers data reliability than any of its member disks Disk Subsystem A collection of disks and the hardware that connects them to one or more host computers The hardware can include an intelligent controller or the disks can attach directly to a host computer I O a bus adapter Double Buffering A technique that achieves maximum data transfer bandwidth by constantly keeping two Failed Drive Fast SCSI Firmware I O requests for adjacent data outstanding A software component begins a double buffered I O stream by issuing two requests in rapid sequence Thereafter each time an I O request completes another is immediately issued If the disk subsystem is capable of processing requests fast enough double buffering allows data to be transferred at the full volume transfer rate A drive that has ceased to function or consistently functions improperly A variant on the SCSI 2 bus It uses the same 8 bit bus as the orig
75. gistration card that accompanies this product LSI Logic shall not be liable in tort or contract for any loss or damage direct incidental or consequential resulting from the use of this product Please see the Warranty Registration Card shipped with this product for full warranty details Limitations of Liability LSI Logic Corporation shall in no event be held liable for any loss expenses or damages of any kind whatsoever whether direct indirect incidental or consequential whether arising from the design or use of this product or the support materials provided with the product No action or proceeding against LSI Logic Corporation may be commenced more than two years after the delivery of product to Licensee of Licensed Software Licensee agrees to defend and indemnify LSI Logic Corporation from any and all claims suits and liabilities including attorney s fees arising out of or resulting from any actual or alleged act or omission on the part of Licensee its authorized third parties employees or agents in connection with the distribution of Licensed Software to end users including without limitation claims suits and liability for bodily or other injuries to end users resulting from use of Licensee s product not caused solely by faults in Licensed Software as provided by LSI Logic to Licensee Cont d Preface vii Preface Continued Package Contents You should have received a MegaRAID Express 500 PCI RAID Controlle
76. ible Terminating the Shared SCSI Bus Note You can connect Y cables to devices if the device is at the end of the SCSI bus You can then attach a terminator to one branch of the Y cable to terminate the SCSI bus This method of termination requires either disabling or removing any internal terminators the device has Trilink connectors can be connected to certain devices If the device is at the end of the bus you can use a trilink connector to terminate the bus This method of termination requires either disabling or removing any internal terminators the device contains Y cables and trilink connectors are the recommended termination methods as they provide termination even when one node is not online Any devices that are not at the end of the shared bus must have their internal termination disabled Chapter 7 Cluster Installation and Configuration 97 98 MegaRAID Express 500 Hardware Guide 8 Troubleshooting The system hangs during the boot Make sure the SCSI BIOS on the motherboard process after installation has been disabled The system hangs during the boot Make sure the MegaRAID Express 500 process after installation adapter card is installed in the proper PCI expansion slot It must be installed in the RAID Upgrade PCI slot Some operating systems do not load Check the system BIOS configuration for PCI in a computer with a MegaRAID interrupt assignments Make sure some Express 500 adapter Interrupts are assign
77. ides data redundancy and very good performance 44 MegaRAID Express 500 Hardware Guide Assigning RAID Levels Only one RAID level can be assigned to each logical drive The drives required per RAID level is RAID Minimum Number of Maximum Number of Physical Level Physical Drives Drives X Note The maximum number of physical drives supported by the controller is 15 Configuring Logical Drives After you have installed the MegaRAID Express 500 controller in the server and have attached all physical disk drives perform the following actions to prepare a RAID disk array 1 Optimize the MegaRAID Express 500 controller options for your system Store tation matin PD n 2 Perform a low level format the SCSI drives that will be included in the EE array and the drives to be used for hot spares 3 Press Ctrl lt M gt to run the MegaRAID Manager Define and configure one or more logical drives Select Easy Configuration in MegaRAID Manager or select New Configuration to customize the RAID array RAID level cache policy read policy and write policy 6 Save the configuration Initialize the system drives After initialization you can install the operating system Create and configure one or more system drives logical drives Select the Chapter 5 Configuring MegaRAID Express 500 45 Optimizing Data Storage Data Access Requirements Each type of data stored in the disk subsystem has a different freque
78. inal SCSI 1 but runs at up to 10 MB double the speed of SCSI 1 Software stored in read only memory ROM or Programmable ROM PROM Firmware is often responsible for the behavior of a system when it is first turned on A typical example would be a monitor program in a computer that loads the full operating system from disk or from a network and then passes control to the operating system FlexRAID Power Fail Option The FlexRAID Power Fail option allows a reconstruction to restart if a power failure occurs This is the advantage of this option The disadvantage is once the reconstruction is active the performance is slower because an additional activity is added Cont d Glossary 123 Glossary Continued Format GB The process of writing zeros to all data fields in a physical drive hard drive to map out unreadable or bad sectors Because most hard drives are factory formatted formatting is usually only done if a hard disk generates many media errors Shorthand for 1 000 000 000 10 to the ninth power bytes It is the same as 1 000 MB megabytes Host based Array A disk array with an Array Management Software in its host computer rather than in a Host Computer Hot Spare Hot Swap I O Driver Initialization disk subsystem Any computer that disks are directly attached to Mainframes servers workstations and personal computers can all be considered host computers A stand by drive ready for use if an
79. ine E Device Type Sid CS Togieal Drive Number Drive Number Manufacturer Model Number Fimwaree S S O Taea oo Device Type SCS Logical Drive Number Drive Nambr Manufacturer Mode Number LFmwarlewl S O e TT Device Type TT Togieal Drive Number Drive Number Manufacturer Model Number LFmwarlewl OOO O O O O Taea oo TT DekeType o Logical Drive Number Drive Number Manufacturer Model Number Firmwarelevel S a TT Device Type o Logical Drive Number Drive Number Manufacturer Mode Number LFmwarlewl S S O EEN Device Type TT Logical Drive Number Drive Number Manufacturer Model Number LFmwarlewl OOOO S O Hg TT Device Type o Logical Drive Number Drive Number Manufacturer Model Number LFmwarlewl O O O Taa TT Device Type CCS Logical Drive Number Drive Number Manufacturer Model Number LFmwarelewl S S O Hug TT Device Type o Logical Drive Number Drive Number Manufacturer Model Number LFmwarlewl S O O Taea TT Desery SSCS Logical Drive Number Drive Nambr Manufacturer Model Number Firmwarelevel OOO O O Target ID E Device Type Preface xi DO TO sai Loss Drive Number Dive Number OOOO oooi Manufacturer Model
80. isted pair cable for connecting internal wide SCSI devices e flat ribbon or twisted pair cable for connecting internal and external wide SCSI devices e cable assembly for converting from internal wide SCSI connectors to internal non wide Type 2 connectors e cable assembly for converting from internal wide to internal non wide SCSI connectors Type 30 e cable assembly for converting from internal wide to internal non wide SCSI connectors Cont d Appendix A SCSI Cables and Connectors 107 68 Pin High Density Connectors Continued Cable Assembly for Internal Wide SCSI Devices The cable assembly for connecting internal wide SCSI devices is shown below pin 1 DODOD0ODDODO0ODODODODDDDDDODDDDODDDDDO 0000000000000000000000000000000000 pin 1 pin 1 BS D00o0000000000000000000000000000000 d000000000000000000000000000000000 Connectors 68 position plug male AMP 786090 7 Cable Flat Ribbon or Twisted Pair Flat Cable 68 Conductor 0 025 Centerline 30 AWG Cont d 108 MegaRAID Express 500 Hardware Guide 68 Pin High Density Connectors Continued Connecting Internal and External Wide Devices The cable assembly for connecting intern
81. ity Jit Internal 5 CPLD EPROM LED straddle mount E oo EX gt oD ap Go ooo Ji z J3 J4 J5 J6 J7 J8 J9 Connector for battery backup unit a n JI5 J17 Non buffered 3 3V DIMM socket J16 gl LLL L ITI a o o 1C 3C 03 10310310 10 10360 e a 1 e Tn x UTE O ELIT Chapter 6 Hardware Installation Programming J5 Serial port J9 12C Connector Cont d 53 Step 5 Set Jumpers Continued J1 Termination Enable J1 is a three pin header that specifies hardware or software control of SCSI termination Type of SCSI Termination J10 Setting Software control of SCSI termination via drive detection Short Pins 1 2 Permanently disable all onboard SCSI termination Short Pins 2 3 Permanently enable all onboard SCSI termination OPEN J9 I2C Interface Connector J9 is a four pin header that allows the 1960JX core processor to serve as a master and slave device that resided on the I2C bus when used with the I2C Bus Interface Unit Attach a four wire cable from J9 to the I2C Bus Interface Unit Pin Description J5 Serial Port J5 is a 3 pin berg that attaches to a serial cable The pinout is Pin Signal Description Pin Signal Description dc I Si E Cont d 54 MegaRAID Express 500 Hardware Guide Step 5 Set Jumpers Continued J8 Hard Disk LED J8 is a four pin connector that attaches to a cable that connects to the
82. le PCI expansion slot the MegaRAID Express 500 Installation CD the necessary SCSI cables and terminators this depends on the number and type of SCSI devices to be attached an Uninterruptible Power Supply UPS for the entire system 160M Ultra Fast SCSI 2 or Wide SCSI hard disk drives Optional Equipment You may also want to install SCSI cables that connect MegaRAID Express 500 to external SCSI devices Checklist 1 Turn all power off to the server and all hard disk drives oor 2 Prepare the host system See the host system technical TO acima iii 3 Determine the SCSI ID and SCSI termination requirements 4 Make sure the jumper settings on the MegaRAID Express 500 controller are correct Install the cache memory 5 Install the MegaRAID in the server and attach the SCSI cables and terminators as needed Make sure Pin 1 on the cable matches Pin 1 on the connector Make sure that the SCSI cables you use conform to all SCSI specifications Perform a safety check Make sure all cables are properly attached Make sure the MegaRAID card is properly installed Turn power on after completing the safety check 7 Install and configure the MegaRAID software utilities and drivers 8 Formatthe hard disk drives as needed __ _ 9 Configure system drives logical drives 10 Initialize the logical drives oo 1I Install the network operating system drivers as needed Chapter 6 Hardware Installatio
83. les and Connectors 111 68 Pin High Density Connectors Continued Converting from Internal Wide to Internal Non Wide Type 3 The cable assembly for connecting internal wide SCSI devices to internal non wide Type 3 SCSI devices is shown below pin 1 E E pin 1 Sa Rs B Rs Connector A 68 position plug male AMP 786090 7 Connector B 50 position plug male AMP 786090 7 Wire Flat ribbon or twisted pair flat cable 50 conductor 0 025 centerline 30 AWG SCSI Cable Vendors Telephone Number Cables To Go Voice 800 826 7904 Fax 800 331 2841 Voice 800 877 1985 Technical Cable Concepts Voice 714 835 1081 Voice 800 659 1599 SCSI Connector Vendors Connector Part Number Back Shell Part Number 749111 4 749193 1 FCN 237R050 G F FCN 230C050 D E PCS XE50MA PCS ESOLA 112 MegaRAID Express 500 Hardware Guide High Density 68 Pin SCSI Connector Pinout Signal Connector Cable Cable Connector Signal ee re E ee oe n 6 37 BCA 8 38 DB 5 Ground 5 9 Grund 6 un Grund 8 i5 Grouwa 9 7 52 6 MSG eo e mvo O 64 66 DBO es 6a DBE O 68 68 Dan Cont d Appendix A SCSI Cables and Connectors 113 68 Pin SCSI Connector Pinout Continued High Density Single Ended Connector The following applies to the high density SCSI connector table on
84. ll of the disk drives and the server protected by a UPS GENS 46 MegaRAID Express 500 Hardware Guide Array Configuration Planner Using the Array Configuration Planner The following table lists the possible RAID levels fault tolerance and effective capacity for all possible drive configurations for an array consisting of one to seven drives This table does not take into account any hot spare standby drives You should always have a hot spare drive in case of drive failure RAID 1 requires two physical drives RAID 3 and RAID 5 require at least three drives RAID 10 requires at least four drives while RAID 30 and RAID 50 require at least six drives Number of Possible Relative to Ne eee FE E cS m 1 RADO Excellent No 1006 2 None Exelet No 1006 2 RADO Excelem No 1006 2 RADI God Yes 506 3 Noe Exelet No 1006 3 RADO Excellent No 1006 ese RAIDS Goda Ys GM A 3 RADS God Ye 676 4 Noe Excellent No 1006 4 RADO Excellent No 1006 RAID3 God Ye 75 AJwlw w w NININ AB 6 BER IND E o6 p a e 6 6 EE HENI 8 EEE 48 1 ES 8 Chapter 5 Configuring MegaRAID Express 500 47 48 MegaRAID Express 500 Hardware Guide 6 Hardware Installation Requirements You must have the following a MegaRAID Express 500 Controller a host computer with an availab
85. ller card and inspect it for damage If the card appears damaged or if any item listed below is missing contact LSI Logic or your MegaRAID OEM support representative The MegaRAID Express 500 Controller is also shipped with the following on CD e the MegaRAID Configuration Software Guide e the MegaRAID Operating System Drivers Guide e the MegaRAID Express 500 Hardware Guide e the software license agreement the MegaRAID Express 500 Configuration Utilities for DOS e the warranty registration card Step 2 Power Down Turn off the computer and remove the cover Make sure the computer is turned off and disconnected from any networks before installing the controller card Step 3 Configure Motherboard Make sure the motherboard is configured correctly for MegaRAID Express 500 MegaRAID Express 500 is essentially a SCSI Controller Each MegaRAID Express 500 card you install will require an available PCI IRQ make sure an IRQ is available for each controller you install Chapter 6 Hardware Installation 51 Step 4 Install Cache Memory SDRAM Use 72 bit 3 3V unbuffered SDRAM only The maximum memory bandwidth is 528 MB s with an SDRAM DIMM Important A minimum of 16 MB of cache memory is required The cache memory must be installed before MegaRAID Express 500 is operational SDRAM specifications are specified below Memory Volt Speed Parity Type BankI Total Memory Type BR SDRAM Ew VICUS Ye sms Ye ES
86. ls that can be supported Arranging Arrays You must arrange the arrays to provide additional organization for the drive array You must arrange arrays so that you can create system drives that can function as boot devices You can sequentially arrange arrays with an identical number of drives so that the drives in the group are spanned Spanned drives can be treated as one large drive Data can be striped across multiple arrays as one logical drive You can create spanned drives by using the MegaRAID BIOS Setup utility or the MegaRAID Manager Creating Hot Spares Any drive that is present formatted and initialized but is not included in a array or logical drive is automatically designated as a hot spare You can also designate drives as hot spares via MegaRAID BIOS Setup the MegaRAID Manager or Power Console 500 Creating Logical Drives Logical drives are arrays or spanned arrays that are presented to the operating 42 system You must create one or more logical drives The logical drive capacity can include all or any portion of an array The logical drive capacity can also be larger than an array by using spanning MegaRAID Express 500 supports up to 40 logical drives MegaRAID Express 500 Hardware Guide Configuration Strategies The most important factors in RAID array configuration are drive capacity drive availability fault tolerance and drive performance You cannot configure a logical drive that optimizes all
87. mwarelewl S O O O Taea o Desery o Losical Drive Number Drive Number Manufactorer Modei Number LFmwarelewl S LL FPlgelb TT Dee Type Sid o o Logical Drive Number Dive Number ManuicturerModelNumber o LFmwarelewl S LL raged LS Device Type LL Losical Drive Number Drie Number ManuicturerModeiNumber o LFmwarelewl S LL Target ID ED Device Type 40 MegaRAID Express 500 Hardware Guide ene 7 Los Drive Number Dive Number LLL ManufactureriModel Number Fimvarckvl a TT Deviee Type SSC Logical Drive Number Dive Number Manufacturer Model Number Fimwarelevel maae oooO o Dece LL Lorie Drive Number Dive Number 1 ManufcmrerModeNumber LFmmwae iwl d Tage LL Deiee Type LL Logical Drive Number Dive Number Manufacturer Model Number Fimwarelevel LL Plug TT Deviee Type LL LLosicil Drive Number Dive Number Manufacturer Model Number Fimwarelevel Chapter 5 Configuring MegaRAID Express 500 41 Configuring Arrays Organize the physical disk drives in arrays after the drives are connected to MegaRAID Express 500 formatted and initialized An array can consist of up to 15 physical disk drives depending on the RAID level MegaRAID Express 500 supports up to eight arrays The number of drives in an array determines the RAID leve
88. n 49 Installation Steps 50 MegaRAID Express 500 provides extensive customization options If you need only basic MegaRAID Express 500 features and your computer does not use other adapter cards with resource settings that may conflict with MegaRAID Express 500 settings even custom installation can be quick and easy Additional Information Unpack the MegaRAID controller and If damaged call your LSI inspect for damage Make sure all items are Logic OEM support in the package representative E cu ee ee MM MN cover EI c cdd NN NS are correct 4 Install cache memory on the MegaRAID 16 MB minimum cache 5 Check the jumper settings on the 52 for the MegaRAID Express 500 controller MegaRAID Express 500 ie jumper settings 6 Ser SCST eminin o 7 Install the MegaRAID Express 500 card Connect the SCSI cables to SCSI devices Set the target IDs for the SCSI devices power on are powered up before or at the same time as the host computer Run MegaRAID BIOS Setup 12 Install software drivers for the desired operating systems Each step is described in detail below Replace the computer cover and tum the Be sure the SCSI devices MegaRAID Express 500 Hardware Guide Cont d Step 1 Unpack Unpack and install the hardware in a static free environment The MegaRAID Express 500 controller card is packed inside an anti static bag between two sponge sheets Remove the contro
89. nPWR Set proper target IDs TIDs for all SCSI devices p The cable length should not exceed three meters for Fast SCSI 10 MB s devices or single ended 1 5 meters for Ultra SCSI devices The cable length can be up to 12 meters for LVD devices 5 The cable length should not exceed six meters for non Fast SCSI devices Cont d Chapter 6 Hardware Installation 61 Step 8 Connect SCSI Cables Continued Cable Suggestions System throughput problems can occur if SCSI cable use is not maximized You should you can use cables up to 12 meters for LVD devices for single ended SCSI devices use the shortest SCSI cables no more than 3 meters for Fast SCSI no more than 1 5 meters for an 8 drive Ultra SCSI system and no more than 3 meters for a 6 drive Ultra SCSI system use active termination avoid clustering the cable nodes cable stub length should be no more than 0 1 meter 4 inches route SCSI cables carefully use high impedance cables do not mix cable types choose either flat or rounded and shielded or non shielded ribbon cables have fairly good cross talk rejection characteristics Step 9 Set Target IDs 62 Set target identifiers TIDs on the SCSI devices Each device in a specific SCSI channel must have a unique TID in that channel Non disk devices CD ROM or tapes should have unique SCSI IDs regardless of the channel where they are connected See the documentation for each SCSI device to set the TIDs The M
90. nators is 3 meters when using up to 4 maximum capacitance 25 pF devices and 1 5 meters when using more than 4 devices SCSI devices should be uniformly spaced between terminators with the end devices located as close as possible to the terminators The characteristic impedance of the cable should be 90 6 ohms for the REQ and ACK signals and 90 10 ohms for all other signals The stub length the distance from the controller s external connector to the mainline SCSI bus shall not exceed 1m approximately 4 inches The spacing of devices on the mainline SCSI bus should be at least three times the stub length All signal lines shall be terminated once at both ends of the bus powered by the TERMP WR line Chapter 8 Troubleshooting 105 106 Windows NT When Windows NT is installed via a bootable CD the Installation devices on the MegaRAID Express 500 will not be recognized until after the initial reboot The Microsoft documented workaround is in SETUP TXT SETUP TXT is on the CD To install drivers when Setup recognizes one of the supported SCSI host adapters without making the devices attached to it available for use 1 Restart Windows NT Setup 2 When Windows NT Setup displays Setup is inspecting your computer s hardware configuration press lt F6 gt to prevents Windows NT Setup from performing disk controller detection This allows you to install the driver from the Drivers disk you created All SCS
91. ncy of read and write activity If you know the data access requirements you can more successfully determine a strategy for optimizing the disk subsystem capacity availability and performance Servers that support Video on Demand typically read the data often but write data infrequently Both the read and write operations tend to be long Data stored on a general purpose file server involves relatively short read and write operations with relatively small files Array Functions You must first define the major purpose of the disk array Will this disk array increase the system storage capacity for general purpose file and print servers Does this disk array support any software system that must be available 24 hours per day Will the information stored in this disk array contain large audio or video files that must be available on demand Will this disk array contain data from an imaging system You must identify the purpose of the data to be stored in the disk subsystem before you can confidently choose a RAID level and a RAID configuration Planning the Array Configuration Answer the following questions about this array Number of physical disk drives in the array EEE Purpose of this array Rank the following factors Maximize drive capacity Maximize the safety of the data fault tolerance Maximize hard drive performance and throughput How many hot spares Do Amount of cache memory installed on MegaRAID Express 500 Are a
92. nd some LocalTalk wiring schemes also require terminators An extension of SCSI 2 that doubles the transfer speed of Fast SCSI providing 20 MBs on an 8 bit connection and 40 MBs on a 16 bit connection An extension of SCSI 2 that doubles the transfer speed of Ultra SCSI providing 40 MBs on an 8 bit connection and 80 MBs on a 16 bit connection Ultra3 SCSI or 160M An extension of SCSI 2 that doubles the transfer speed of Ultra2 SCSI providing Virtual Sizing Wide SCSI 80MBs on an 8 bit connection and 160 MBs on a 16 bit connection FlexRAID Virtual Sizing is used to create a logical drive up to 80 GB A maximum of eight logical drives can be configured on a RAID controller and RAID migration is possible for all logical drives except the eighth Because it is not possible to do migration on the last logical drive the maximum space available for RAID migration is 560 GB A variant on the SCSI 2 interface Wide SCSI uses a 16 bit bus double the width of the original SCSI 1 Wide SCSI devices cannot be connected to a SCSI 1 bus Wide SCSI supports transfer rates up to 20 MB s like Fast SCSI 130 MegaRAID Express 500 Hardware Guide Index 1 160M and Wide SCSI 27 6 68 Pin High Density Connectors 107 A AMICDROM SYS 66 AMPLIMITE 050 Series connectors 114 Array 121 Array Configuration Planner 47 Array Management Software 121 Array Performance Features 29 Array Spanning 121 ASPI Driver Error Messages 104
93. ns conflict with the instructions in this section always use the instructions supplied by the vendor The SCSI bus listed in the hardware requirements must be configured prior to installation of Cluster Services This includes e Configuring the SCSI devices e Configuring the SCSI controllers and hard disks to work properly on a shared SCSI bus e Properly terminating the bus The shared SCSI bus must have a terminator at each end of the bus It is possible to have multiple shared SCSI buses between the nodes of a cluster In addition to the information on the next page refer to the documentation from the SCSI device manufacturer or the SCSI specifications which can be ordered from the American National Standards Institute ANSI The ANSI web site contains a catalog that you can search for the SCSI specifications Configuring the SCSI Devices Each device on the shared SCSI bus must have a unique SCSI ID Since most SCSI controllers default to SCSI ID 7 part of configuring the shared SCSI bus will be to change the SCSI ID on one controller to a different SCSI ID such as SCSI ID 6 If there is more than one disk that will be on the shared SCSI bus each disk must also have a unique SCSI ID Some SCSI controllers reset the SCSI bus when they initialize at boot time If this occurs the bus reset can interrupt any data transfers between the other node and disks on the shared SCSI bus Therefore SCSI bus resets should be disabled if poss
94. nts for sharing disks are as follows Physically attach all shared disks including the quorum disk to the shared bus Make sure that all disks attached to the shared bus are seen from all nodes You can check this at the setup level in lt Ctrl gt lt M gt the BIOS configuration utility See page oo for installation information Assign unique SCSI identification numbers to the SCSI devices and terminate the devices properly Refer to the storage enclosure manual about installing and terminating SCSI devices Configure all shared disks as basic not dynamic Format all partitions on the disks as NTFS It is best to use fault tolerant RAID configurations for all disks This includes RAID levels 1 5 10 30 or 50 Chapter 7 Cluster Installation and Configuration 75 Cluster Insta llation Installation Overview During installation some nodes are shut down and other nodes are rebooted This is necessary to ensure uncorrupted data on disks attached to the shared storage bus Data corruption can occur when multiple nodes try to write simultaneously to the same disk if that disk is not yet protected by the cluster software The table below shows which nodes and storage devices should be powered on during each step Step Node 1 Node 2 Storage Comments Make sure that power to all storage devices on Node Set Up Ne Works ao n on the shared bus is turned off Power on all nodes Set up Shared Disks On off On
95. o connect the MegaRAID Express 500 card to one end of the SCSI cable and to connect an external terminator module at the other end of the cable The connectors between the two ends can connect SCSI devices Disable termination on the SCSI devices See the manual for each SCSI device to disable termination 56 MegaRAID Express 500 Hardware Guide SCSI Termination The SCSI bus is an electrical transmission line and it must be terminated properly to minimize reflections and losses You complete the SCSI bus by setting termination at both ends You can let MegaRAID Express 500 automatically provide SCSI termination at one end of the SCSI bus You can terminate the other end of the SCSI bus by attaching an external SCSI terminator module to the end of the cable or by attaching a SCSI device that internally terminates the SCSI bus at the end of the SCSI channel Selecting a Terminator Use standard external SCSI terminators on a SCSI channel operating at 10 MB s or higher synchronous data transfer Terminating Internal SCSI Disk Arrays Set the termination so that SCSI termination and termination power are intact when any disk drive is removed from a SCSI channel as shown below Host Computer Internal SCSI Drives No Termination c AME No Termination Express 500 Termination SCSI ID 7 pe Enabled Cont d Chapter 6 Hardware Installation 57 SCSI Termination Continued Terminating External Disk Arrays In mos
96. one This server is The first node in the cluster If this server is the first node in a cluster you are creating a new cluster C The second or next node in the cluster If at least one other node already exists you are joining an existing cluster lt Back Cancel 11 Enter a name for the cluster up to 15 characters and click on Next In our example the cluster is named ClusterOne 12 Type the user name of the Cluster Service account that you created during the pre installation In our example the user name is cluster Do not enter a password Type the domain name then click on Next At this point the Cluster Service Configuration Wizard validates the user account and password Cluster Service Configuration Wizard Select an ccount For security purposes the Cluster service must use a domain account Type the user name and password for the domain account you want the Cluster service to use This account is given special security privileges on each cluster node User name htm 000 Password pec ooo R Domain DOMAIN2 ERU 13 Click on Next The Add or Remove Managed Disks screen displays next This screen is in the following section about configuring cluster disks MegaRAID Express 500 Hardware Guide Configuring Cluster Disks Windows 2000 Managed Disks displays all SCSI disks as shown on the screen below It displays SCSI disks that do n
97. ontrols the disk drives via SCSI 2 buses channels over which the system transfers data in either Fast and Wide or Ultra SCSI mode Each adapter can control up to three SCSI channels Internal and external disk drives can be mixed on channels 0 and 1 but not on channel 2 Cont d 128 MegaRAID Express 500 Hardware Guide Glossary Continued SCSI ID A SCSI physical drive can be in one of these states e Online Powered on and operational e Hot Spare Powered on stand by disk drive ready for use if an online disk fails e Rebuild A disk drive to which one or more logical drives is restoring data e Not Responding The disk drive is not present is not powered on or has failed Service Provider The Service Provider SP is a program that resides in the desktop system or server and is SNMP Spanning responsible for all DMI activities This layer collects management information from products whether system hardware peripherals or software stores that information in the DMI database and passes it to management applications as requested Simple Network Management Protocol the most widely used protocol for communication management information between the managed elements of a network and a network manager SNMP focuses primarily on the network backbone The Internet standard protocol that manages nodes on an Internet Protocol IP network Array spanning by a logical drive combines storage space in two arrays of disk drive
98. or goes offline The use of long lease periods is recommended to assure that a dynamically assigned IP address remains valid in the event that the DHCP server is temporarily lost In all cases set static IP addresses for the private network connector Note that Cluster Service will recognize only one network interface per subnet Verifying Connectivity and Name Resolution Note 80 In order to verify that the network adapters are working properly perform the following steps Before proceeding you must know the IP address for each network card adapter in the cluster You can obtain it by using the IPCONFIG command on each node Step Description 1 Click on Start 2 Click on Run 3 Type cmd in the text box 4 Click on OK 5 Type ipconfig all and press Enter IP information displays for all network adapters in the machine 6 If you do not already have the command prompt on your screen click on Start 7 Click on Run 8 Type cmd in the text box 9 Click on OK 10 Type ping ipaddress where ipaddress is the IP address for the corresponding network adapter in the other node For example assume that the IP addresses are set as follows Node Network Name Network Adapter IP Address 1 Public Cluster Connection 192 168 0 171 1 Private Cluster Connection 10 1 1 1 2 Public Cluster Connection 192 168 0 172 2 Private Cluster Connection 10 1 1 2 In this example you would type Ping 192 168 0 172
99. ot reside on the same bus as the system disk Because of this a node that has multiple SCSI buses will list SCSI disks that are not to be used as shared storage You must remove any SCSI disks that are internal to the node and not to be shared storage Cluster Service Configuration Wizard NS E x Add or Remove Managed Disks The disks that Cluster service controls access to are known as managed disks Add the disks that you want the cluster to manage Remove those disks that you do not want the cluster to manage Unmanaged disks Managed disks Add El Disk 1 MEGARAID LD Ob E New Volume E Disk 2 MEGARAID LD 1b F New Volume z Remove Caution The likelihood of corruption of unmanaged NTFS disks on a shared bus is very high It is recommended that you use Cluster service to manage these disks lt Back Cancel In production clustering scenarios you need to use more than one private network for cluster communication to avoid having a single point of failure Cluster Service can use private networks for cluster status signals and cluster management This provides more security than using a public network for these roles In addition you can use a public network for cluster management or you can use a mixed network for both private and public communications In any case verify that at least two networks are used for cluster communication using a single network for node to node communication cr
100. other drive fails It does not contain any user data Up to eight disk drives can be assigned as hot spares for an adapter A hot spare can be dedicated to a single redundant array or it can be part of the global hot spare pool for all arrays controlled by the adapter The substitution of a replacement unit in a disk subsystem for a defective one where the substitution can be performed while the subsystem is running performing its normal functions Hot swaps are manual A host computer software component usually part of the operating system that controls the operation of peripheral controllers or adapters attached to the host computer I O drivers communicate between applications and I O devices and in some cases participates in data transfer The process of writing zeros to the data fields of a logical drive and generating the corresponding parity to put the logical drive in a Ready state Initializing erases previous data and generates parity so that the logical drive will pass a consistency check Arrays can work without initializing but they can fail a consistency check because the parity fields have not been generated Cont d 124 MegaRAID Express 500 Hardware Guide Glossary Continued Logical Disk Logical Drive Mapping MB Multi threaded A set of contiguous chunks on a physical disk Logical disks are used in array implementations as constituents of logical volumes or partitions Logical disks are normally tran
101. pe and the parity for that stripe If the failed drive is a parity drive writes will occur as normal except no parity is written Reads retrieve data from the disks Best suited for applications such as graphics imaging or video that call for reading and writing huge sequential blocks of data Provides data redundancy and high data transfer rates The dedicated parity disk is a bottleneck with random I O Three to 15 j Parity Drive Segment 1 Segment 1 Segment 2 Segment 3 Segment 4 Segment 2 Segment5 Segment 6 Segment 3 Segment 7 Segment 8 Segment 4 etc etc etc Cont d Chapter 3 RAID Levels 21 RAID 3 Continued RAID 5 vs RAID 3 You may find that RAID 5 is preferable to RAID 3 even for applications characterized by sequential reads and writes because MegaRAID Express 500 has very robust caching algorithms The benefits of RAID 3 disappear if there are many small I O operations scattered randomly and widely across the disks in the logical drive The RAID 3 fixed parity disk becomes a bottleneck in such applications For example The host attempts to make two small writes and the writes are widely scattered involving two different stripes and different disk drives Ideally both writes should take place at the same time But this is not possible in RAID 3 since the writes must take turns accessing the fixed parity drive For this reason RAID 5 is the clear choice in this scenario 22 MegaRAID Expr
102. ple interchangeable components to perform a single function to cope with failures or errors Redundancy normally applies to hardware a common form of hardware redundancy is disk mirroring Replacement Disk A disk available to replace a failed member disk in a RAID array Replacement Unit A component or collection of components in a disk subsystem that are always replaced SAF TE SCSI SCSI Channel as a unit when any part of the collection fails Typical replacement units in a disk subsystem includes disks controller logic boards power supplies and cables Also called a hot spare SCSI Accessed Fault Tolerant Enclosure An industry protocol for managing RAID enclosures and reporting enclosure environmental information Small Computer System Interface A processor independent standard for system level interfacing between a computer and intelligent devices including hard disks floppy disks CD ROM printers scanners etc SCSI can connect up to 7 devices to a single adapter or host adapter on the computer s bus SCSI transfers eight or 16 bits in parallel and can operate in either asynchronous or synchronous modes The synchronous transfer rate is up to 40 MB s SCSI connections normally use single ended drivers as opposed to differential drivers The original standard is now called SCSI 1 to distinguish it from SCSI 2 and SCSI 3 which include specifications of Wide SCSI a 16 bit bus and Fast SCSI 10 MB s transfer MegaRAID c
103. ports SCSI hard disk drives CD ROMs tape drives optical drives DAT drives and other SCSI peripheral devices Software All SCSI backup and utility software should work with MegaRAID Express 500 Software that has been tested and approved for use with MegaRAID Express 500 includes Cheyenne CorelSCSI Arcserve and Novaback This software is not provided with MegaRAID Express 500 Summary MegaRAID Express 500 Features were discussed in this chapter Configuring MegaRAID Express 500 is discussed in Chapter 5 36 MegaRAID Express 500 Hardware Guide 5 Configuring MegaRAID Express 500 Configuring SCSI Physical Drives SCSI Channel Physical SCSI drives must be organized into logical drives The arrays and logical drives that you construct must be able to support the RAID level that you select Your MegaRAID Express 500 adapter has one SCSI channel Basic Configuration Rules You should observe the following guidelines when connecting and configuring SCSI devices in a RAID array e attach non disk SCSI devices to a single SCSI channel that does not have any disk drives e you can place up to 15 physical disk drives in an array depending on the RAID level e include all drives that have the same capacity to the same array e make sure any hot spare has a capacity that is at least as large as the largest drive that may be replaced by the hot spare e when replacing a failed drive make sure that the replacement drive has a capacity
104. ppy diskette with the appropriate driver disk for Windows 2000 Select Floppy disk drives in the screen below and click on Next Found New Hardware Wizard Locate Driver Files ee Where do you want Windows to search for driver files ey Search for driver files for the following hardware device e RAID Controller The wizard searches for suitable drivers in its driver database on your computer and in any of the following optional search locations that you specify To start the search click Next If you are searching on a floppy disk or CD ROM drive insert the floppy disk or CD before clicking Next ptional search locations IV Floppy disk drives ri Specify a location Microsoft Windows Update The Wizard detects the device driver on the diskette and the Completing the upgrade device driver wizard displays the name of the controller Click on Finish to complete the installation After the cluster is installed and both nodes are booted to the Microsoft Windows 2000 Advanced Server installation will detect a SCSI processor Welcome to the Found New Hardware Wizard This wizard helps you install a device driver for a hardware device Found New Hardware sa AMI MegaProcessor SCSI Processor Device Installing To continue click Next Back Next gt Cancel Chapter 7 Cluster Installation and Configuration 71 On the screen below choose to display a list of the known drivers so th
105. r a CD with drivers utilities and documentation a MegaRAID Express 500 Hardware Guide on CD a MegaRAID Configuration Software Guide on CD a MegaRAID Operating System Drivers Guide on CD software license agreement on CD a warranty registration card on CD Technical Support If you need help installing configuring or running the MegaRAID Express 500 PCI RAID Controller call your LSI Logic OEM Technical Support representative at 678 728 1250 Before you call please complete the MegaRAID Problem Report form on the next page Web Site We invite you to access the LSI Logic world wide web site at http www Isil com viii MegaRAID Express500 Hardware Guide MegaRAID Problem Report Form Cony o Motherboard CPU Type Speed System Memory Other disk controllers Other adapter cards installed installed Description of problem Steps necessary to re create problem Preface Drive ee Size Size Policy Policy He Drives 00 J O T pp p oq wu lao 5 1D2 o ST P P ST Da qoc qr oW ER 3e 2E 2 Hag o xp gra xj EDS po cao dogs 1026 P Po P 7 tr po qp qto ps P Po P ES MI SAS Bo Jo fl Self tools rpg E LR 3e 2E o 1D2 T Po Po S pem po qu datos Ip44 P Po P LEDSS o qe o a e o 0 1o36 o T j j Bp NNE 4a 4j BE Jd cuc dp oec cs O prey qu 9 0 dedos x MegaRAID Express500 Hardware Guide Physical Device Layout s
106. ress 500 Hardware Guide Software Utilities The software utility features include Specification Graphical user interface Management utility Bootup configuration via MegaRAID Manager Online Read Write and cache policy switching Internet and intranet support through TCP IP Operating System Software Drivers Operating System Drivers MegaRAID Express 500 includes a DOS software configuration utility and drivers for Windows NT V4 0 Novell NetWare 4 x OS 2 SCO UnixWare 2 1x SCO Open Server R5 0x The DOS drivers for MegaRAID Express 500 are contained in the firmware on MegaRAID Express 500 except the DOS ASPI and CD ROM drivers Call your LSI Logic OEM support representative for information about drivers for other operating systems Chapter 4 Features MegaRAID Express 500 Specifications 5 875 x 4 2 half length PCI Cache Configuration 16 32 64 or 128 MB ECC through a 66MHz 72 bit unbuffered 3 3 V SDRAM 1 MB x 8 flash ROM Nonvolatile RAM 32 KB x 8 for storing RAID configuration Operating Voltage 5 00 V 0 25 V support Rate SCSI Bus LVD or single ended SCSI Termination Termination Disable Automatic through cable and device detection Devices per SCSI Up to 15 wide or seven non wide SCSI devices Up Channel to 6 non disk SCSI drives per MegaRAID Express 500 controller SCSI Device Types Synchronous or Asynchronous Disk and non disk Supported RAID Levels Supported 0 1 3 5 10 30 and 50
107. rive subsystem uses only a single SCSI ID which allows you to connect multiple drive subsystems to a single SCSI controller Chapter 2 Introduction to RAID 7 RAID Overview RAID Redundant Array of Independent Disks is a collection of specifications that describe a system for ensuring the reliability and stability of data stored on large disk subsystems A RAID system can be implemented in a number of different versions or RAID Levels The standard RAID levels are 0 1 3 and 5 MegaRAID Express 500 supports all standard RAID levels and RAID levels 10 30 and 50 special RAID versions supported by MegaRAID Express 500 Fault Tolerance Fault tolerance is achieved through cooling fans power supplies and the ability to hot swap drives MegaRAID Express 500 provides hot swapping through the hot spare feature A hot spare drive is an unused online available drive that MegaRAID Express 500 instantly plugs into the system when an active drive fails After the hot spare is automatically moved into the RAID subsystem the failed drive is automatically rebuilt The RAID disk array continues to handle request while the rebuild occurs Consistency Check 8 In RAID check consistency verifies the correctness of redundant data in an array For example in a system with dedicated parity checking consistency means computing the parity of the data drives and comparing the results to the contents of the dedicated parity drive MegaRAI
108. rranties of merchantability or fitness for a specific purpose Some states do not allow disclaimer of express or implied warranties or the limitation or exclusion of liability for indirect special exemplary incidental or consequential damages in certain transactions therefore this statement may not apply to you Also you may have other rights which vary from jurisdiction to jurisdiction This publication could include technical inaccuracies or typographical errors Changes are periodically made to the information herein these changes will be incorporated in new editions of the publication LSI Logic may make improvements and or revisions in the product s and or the program s described in this publication at any time Requests for technical information about LSI Logic products should be made to your LSI Logic authorized reseller or marketing representative Preface xiii FCC Regulatory Statement This device complies with Part 15 of the FCC Rules Operation is subject to the following two conditions 1 this device may not cause harmful interference and 2 this device must accept any interference received including interference that may cause undesired operation A Warning Changes or modifications to this unit not expressly approved by the party responsible for compliance could void the user s authority to operate the equipment 4 X Note This equipment has been tested and found to comply with the limits for a Class B digital
109. ry 125 Glossary Continued Parity Partition Physical Disk Parity is an extra bit added to a byte or word to reveal errors in storage in RAM or disk or transmission Parity is used to generate a set of redundancy data from two or more parent data sets The redundancy data can be used to reconstruct one of the parent data sets However parity data does not fully duplicate the parent data sets In RAID this method is applied to entire drives or stripes across all disk drives in an array Parity consists of dedicated parity in which the parity of the data on two or more drives is stored on an additional drive and distributed parity in which the parity data are distributed among all the drives in the system If a single drive fails it can be rebuilt from the parity of the respective data on the remaining drives An array virtual disk made up of logical disks rather than physical ones Also known as logical volume A hard disk drive that stores data A hard disk drive consists of one or more rigid magnetic discs rotating about a central axle with associated read write heads and electronics Physical Disk Roaming The ability of some adapters to detect when hard drives have been moved to a Protocol RAID different slots in the computer for example after a hot swap A set of formal rules describing how to transmit data especially across a network Low level protocols define the electrical and physical standards to be observed
110. s Drives RAID 50 provides the features of both RAID 0 and RAID 5 RAID 50 includes both parity and disk striping across multiple drives RAID 50 is best implemented on two RAID 5 disk arrays with data striped across both disk arrays RAID 50 breaks up data into smaller blocks and then stripes the blocks of data to each RAID 5 raid set RAID 5 breaks up data into smaller blocks calculates parity by performing an exclusive or on the blocks and then writes the blocks of data and parity to each drive in the array The size of each block is determined by the stripe size parameter which is set during the creation of the RAID set RAID 50 can sustain one to four drive failures while maintaining data integrity if each failed disk is in a different RAID 5 array RAID 50 works best when used with data that requires high reliability high request rates and high data transfer and medium to large capacity RAID 50 provides high data throughput data redundancy and very good performance Requires 2 to 4 times as many parity drives as RAID 5 Six to 15 The initiator takes one ID per channel This leaves 15 IDs available for one channel Segment 1 Segment 2 Parity 1 2 Segment 3 Segment6 Parity 5 6 Segment 5 Segment 8 Parity 9 10 Segment 9 Segment 10 26 MegaRAID Express 500 Hardware Guide 4 Features MegaRAID is a family of high performance intelligent PCI to SCSI host adapters with RAID control capabilities MegaRAID Expr
111. s into a single contiguous storage space in a logical drive MegaRAID logical drives can span consecutively numbered arrays that each consist of the same number of disk drives Array spanning promotes RAID levels 1 3 and 5 to RAID levels 10 30 and 50 respectively See also Disk Spanning and Spanning Cont d Glossary 129 Glossary Continued Spare Stripe Size Stripe Width Striping Terminator Ultra SCSI Ultra2 SCSI A hard drive available to back up the data of other drives The amount of data contiguously written to each disk You can specify stripe sizes of 4 KB 8 KB 16 KB 32 KB 64 KB and 128 KB for each logical drive For best performance choose a stripe size equal to or smaller than the block size used by the host computer The number of disk drives across which the data are striped Segmentation of logically sequential data such as a single file so that segments can be written to multiple physical devices in a round robin fashion This technique is useful if the processor can read or write data faster than a single disk can supply or accept it While data is being transferred from the first disk the second disk can locate the next segment Data striping is used in some modern databases and in certain RAID devices A resistor connected to a signal wire in a bus or network for impedance matching to prevent reflections e g a 50 ohm resistor connected across the end of an Ethernet cable SCSI chains a
112. s not match the configuration stored on the drives Reconfigure the array Remove the drive or drives that should not be used Press a key to run MegaRAID Manager Choose View Add Configuration from the Configure menu Use View Add Configuration to examine both the configuration in NVRAM and the configuration stored on the disk drives Resolve the problem by selecting one of the configurations Chapter 8 Troubleshooting 103 DOS ASPI Driver Error Messages Corrective Action NOT been loaded codes listed below is displayed next Controller setup FAILED Correct the condition that caused the failure The failure error code 0xab codes are 0x40 No MegaRAID adapters found 0x80 Timed out waiting for interrupt to be posted 0x81 Timed out waiting for MegaRAID Express 500 Response command 0x82 Invalid command completion count 0x83 Invalid completion status received 0x84 Invalid command ID received 0x85 No MegaRAID Express adapters found or no PCI BIOS support 0x90 Unknown Setup completion error No non disk devices were The driver did not find any non hard drive devices located during scanning A SCSI device that is not a hard disk drive such as a tape drive or CD ROM drive must be attached to this SCSI channel The SCSI ID must be unique for each adapter and cannot be SCSI ID 0 The supported SCSI IDs are 1 2 3 4 5 and 6 ERROR VDS support is The h option is appended to driver in INACTIVE for CONFIG SY
113. s stripe sizes of 2 KB 4 KB 8 KB 16 KB 32 KB 64 KB or 128 KB For example in a four disk system using only disk striping as in RAID level 0 segment 1 is written to disk 1 segment 2 is written to disk 2 and so on Disk striping enhances performance because multiple drives are accessed simultaneously but disk striping does not provide data redundancy Segment 1 Segment 2 Segment 3 Segment 4 Segment 5 Segment 6 Segment 7 Segment 8 Segment 9 Segment 10 Segment 11 Segment 1 Stripe Width Stripe width is a measure of the number of disks involved in an array where striping is implemented For example a four disk array with disk striping has a stripe width of four Stripe Size The stripe size is the length of the interleaved data segments that MegaRAID Express 500 writes across multiple drives MegaRAID Express 500 supports stripe sizes of 2 KB 4 KB 8 KB 16 KB 32 KB 64 KB or 128 KB 12 MegaRAID Express 500 Hardware Guide Disk Mirroring With mirroring used in RAID 1 data written to one disk drive is simultaneously written to another disk drive If one disk drive fails the contents of the other disk drive can be used to run the system and reconstruct the failed drive The primary advantage of disk mirroring is that it provides 100 data redundancy Since the contents of the disk drive are completely written to a second drive it does not matter if one of the drives fails Both drives contain the same da
114. sfully Click on OK Chapter 7 Cluster Installation and Configuration 93 94 Cluster Service Configuration Wizard Completing the Cluster Service Configuration Wizard You have successfully completed the Cluster Service Configuration wizard Starting the Cluster service Cluster service has started successfully To manage the cluster use Cluster Administrator You can locate this tool by opening Control Panel and clicking Administrative Tools Back Finish Lees 11 Close the Add Remove Programs window MegaRAID Express 500 Hardware Guide Validating the Cluster Installation Use the Cluster Administrator snap in to validate the Cluster Service installation on the first node Step Description 1 Click on Start Click on Programs Click on Administrative Tools Click on Cluster Adminstrator WI Seo The following screen displays If your snap in window is similar to that shown above below your Cluster Service was successfully installed on the first node You are now ready to install Cluster Service on the second node Configuring the Second Node Note For this procedure have node one and all shared disks powered on then power up the second node Installation of Cluster Service on the second node takes less time than on the first node Setup configures the Cluster Service network settings on the second node based on the
115. sparent to the host environment except when the array containing them is being configured A virtual drive within an array that can consist of more than one physical drive Logical drives divide the contiguous storage space of an array of disk drives or a spanned group of arrays of drives The storage space in a logical drive is spread across all the physical drives in the array or spanned arrays Configure at least one logical drive for each array The conversion between multiple data addressing schemes especially conversions between member disk block addresses and block addresses of the virtual disks presented to the operating environment by Array Management Software Megabyte An abbreviation for 1 000 000 10 to the sixth power bytes It is the same as 1 000 KB kilobytes Having multiple concurrent or pseudo concurrent execution sequences Used to describe processes in computer systems Multi threaded processes allow throughput intensive applications to efficiently use a disk array to increase I O performance Operating Environment The operating environment includes the host computer where the array is attached any I O buses and adapters the host operating system and any additional software required to operate the array For host based arrays the operating environment includes I O driver software for the member disks but does not include Array Management Software which is regarded as part of the array itself Cont d Glossa
116. specify whether this network will perform as a public private or mixed network Network name pubic 700000000 Device Intel R PRO 100 Management Adapter IP address 155 100 0 141 v Enable this network for cluster use This network performs the following role in the cluster C Client access only public network C Internal cluster communications only private network All communications mixed network The next dialog box configures the private network Make sure that the network name and IP address correspond to the network interface used for the private network Check the box Enable this network for cluster use Select the option Internal cluster communications only then click on Next Cluster Service Configuration Wizard Network Connections Type the network name and specify whether this network will perform as a public private or mixed network Network name interconnect Device intem PRO 100 Management Adapter 2 IP address 200 200 200 125 IV Enable this network for cluster use This network performs the following role in the cluster Client access only public network All communications mixed network lt Back Cancel In this example both networks are configured so that both can be used for internal cluster communication The next dialog window offers an option to modify the order in which the networks are used Because Priv
117. t array enclosures the end of the SCSI cable has an independent SCSI terminator module that is not part of any SCSI drive In this way SCSI termination is not disturbed when any drive is removed as shown below External SCSI Drives Express 500 t ias enabled SCSI ID 7 from last SCSI drive Terminating Internal and External Disk Arrays You can use both internal and external drives with MegaRAID Express 500 You still must make sure that the proper SCSI termination and termination power is preserved as shown below External SCSI Drives Termination enabled from last drive 58 MegaRAID Express 500 Hardware Guide Host computer Internal SCSI Drives Express 500 SCSI ID 7 Cont d SCSI Termination Continued Connecting Non Disk SCSI Devices SCSI Tape drives scanners CD ROM drives and other non disk drive devices must each have a unique SCSI ID regardless of the SCSI channel they are attached to The general rule for Unix systems is e tape drive set to SCSI ID 2 e CD ROM drive set to SCSI ID 5 Make sure that no hard disk drives are attached to the same SCSI channel as the non disk SCSI devices Drive performance will be significantly degraded if SCSI hard disk drives are attached to this channel Warning Since all non disk SCSI devices are single ended it is not advisable to attach a non disk device to a MegaRAID Express 500 RAID controller if LVD disk drives are also attached because the SCSI
118. t of the host computer or separate from it Enclosure management helps you stay informed of events in the disk subsystem such as a drive or power supply failure Enclosure management increases the fault tolerance of the disk subsystem MegaRAID Express 500 Hardware Guide 3 RAID Levels There are six official RAID levels RAID 0 through RAID 5 MegaRAID Express 500 supports RAID levels 0 1 3 and 5 LSI Logic has designed three additional RAID levels 10 30 and 50 that provide additional benefits The RAID levels that MegaRAID Express 500 supports are pT Standard page lo pot Standard pagepo 3 o Sindara pagepi 5 Standard page3 10 MegaRAID Express 500 only pagep4 30 MegaRAID Express S00 only pagePs 50 MegaRAID Express S00 only pagep Select RAID Level To ensure the best performance you should select the optimal RAID level when you create a system drive The optimal RAID level for your disk array depends on a number of factors e the number of drives in the disk array e thecapacity of the drives in the array e the need for data redundancy e the disk performance requirements Selecting a RAID Level The factors you need to consider when selecting a RAID level are listed on the next page Chapter 3 RAID Levels 17 Selecting a RAID Level 18 Description and Use Data divided in blocks and distributed sequentially pure striping Use for non
119. t txt Close Notepad Double click on the My Documents icon Right click on test txt and click on Copy Close the window Double click on My Computer Double click on a shared drive partition Click on Edit and click on Paste A copy of the file should now exist on the shared disk Double click on test txt to open it on the shared disk Close the file Highlight the file and press the Del key to delete it from the clustered disk Repeat the process for all clustered disks to make sure they can be accessed from the first node After you complete the procedure shut down the first node power on the second node and repeat the procedure above Repeat again for any additional nodes After you have verified that all nodes can read and write from the disks turn off all nodes except the first and continue with this guide Chapter 7 Cluster Installation and Configuration 85 Cluster Service Software Installation Before you begin the Cluster Service Software installation on the first node make sure that all other nodes are either powered down or stopped and that all shared storage devices are powered on Cluster Configuration Wizard To create the cluster you must provide the cluster information The Cluster Configuration Wizard will allow you to input this information Step Description 1 Click on Start Click on Settings then click on Control Panel 2 3 Dou
120. ta at all times Either drive can act as the operational drive Disk mirroring provides 100 redundancy but is expensive because each drive in the system must be duplicated Segment 1 Segment 1 Duplicate Segment 2 Segment 2 Duplicate Segment 3 Segment 3 Duplicate Segment 4 Segment 4 Duplicate Chapter 2 Introduction to RAID 13 Disk Spanning Disk spanning allows multiple disk drives to function like one big drive Spanning overcomes lack of disk space and simplifies storage management by combining existing resources or adding relatively inexpensive resources For example four 400 MB disk drives can be combined to appear to the operating system as one single 1600 MB drive Spanning alone does not provide reliability or performance enhancements Spanned logical drives must have the same stripe size and must be contiguous In the following graphic RAID 1 array is turned into a RAID 10 array This controller supports a span depth of eight That means that eight RAID 1 3 or 5 arrays can be spanned to create one logical drive an be accessed as one 4 GB drive as one 4 GB drive Spanning for RAID 10 RAID 30 or RAID 50 10 Configure RAID 10 by spanning two contiguous RAID 1 logical drives The RAID 1 logical drives must have the same stripe size 30 Configure RAID 30 by spanning two contiguous RAID 3 logical drives The RAID 3 logical drives must have the same stripe size Con
121. te cache is enabled loss of data can occur when power is interrupted MegaRAID BIOS The BIOS resides on a 1 MB x 8 flash ROM for easy upgrade The MegaRAID BIOS supports INT 13h calls to boot DOS without special software or device drivers The MegaRAID BIOS provides an extensive setup utility that can be accessed by pressing lt Ctrl gt lt M gt at BIOS initialization MegaRAID BIOS Setup is described in the MegaRAID Configuration Software Guide Onboard Speaker The MegaRAID Express 500 controller has an onboard tone generator for audible warnings when system errors occur Audible warnings can be generated through this speaker The audible warnings are listed on page Serial Port MegaRAID Express 500 includes a 3 pin RS232C compatible serial port berg connector which can connect to communications devices Chapter 4 Features 33 SCSI Bus MegaRAID Express 500 has a Fast and Wide Ultra 160M SCSI channel that supports both LVD and single ended devices with active termination Synchronous and asynchronous devices are supported MegaRAID Express 500 provides automatic termination disable via cable detection The SCSI channel supports up to 15 wide or seven non wide SCSI devices at speeds up to 160 MB s MegaRAID Express 500 supports up to six non disk devices per controller SCSI Connectors MegaRAID Express 500 has two types of SCSI connectors e a68 pin high density internal connector e a68 pin external ultr
122. three factors but it is easy to choose a logical drive configuration that maximizes one factor at the expense of the other two factors although needs are seldom that simple Maximize Capacity RAID 0 achieves maximum drive capacity but does not provide data redundancy Maximum drive capacity for each RAID level is shown below OEM level firmware that can span up to 4 logical drives is assumed RAID Description Drives Capacity Level Required Striping 1 15 Number of disks X capacity of without parity smallest disk Capacity of smallest disk X 1 Striping with Number of disks X capacity of fixed parity smallest disk capacity of 1 disk drive Striping with 3 15 Number of disks X capacity of floating parity smallest disk capacity of 1 disk drive Mirroring and 4 14 Must Number of disks X capacity of Striping be a multiple smallest disk 2 of 2 RAID 3 and 6 15 Must Number of disks X capacity of Striping be a multiple smallest disk capacity of 1 disk X of arrays number of Arrays 1 3 5 10 30 0 5 RAID 5 and 6 15 Must Number of disks X capacity of Striping be a multiple smallest disk capacity of 1 disk X of arrays number of Arrays X Note The maximum number of physical drives supported per controller is 15 Cont d Chapter 5 Configuring MegaRAID Express 500 43 Configuration Strategies Continued Maximizing Drive Availability You can maximize the a
123. tion set includes e the MegaRAID Elite 1600 Hardware Guide e the MegaRAID Configuration Software Guide e the MegaRAID Operating System Drivers Guide MegaRAID Configuration Hardware Guide This manual contains the RAID overview RAID planning and RAID system configuration information you will need first Read the MegaRAID Express 500 Hardware Guide first MegaRAID Configuration Software Guide This manual describes the software configuration utilities that configure and modify RAID systems MegaRAID Operating System Drivers Guide This manual provides detailed information about installing the MegaRAID Express 500 operating system drivers Chapter 1 Overview 3 MegaRAID Express 500 Block Diagram SCSI Controller LVD SE Local PCI Bus 16 MB NVRAM Flash a Cache ROM Local ROM DRAM Bus Host PCI Bus 4 MegaRAID Express 500 Hardware Guide 2 Introduction to RAID RAID Redundant Array of Independent Disks is an array of multiple independent hard disk drives that provide high performance and fault tolerance A RAID disk subsystem improves I O performance over a computer using only a single drive The RAID array appears to the host computer as a single storage unit or as multiple logical units I O is expedited because several disks can be accessed simultaneously RAID systems improve data storage reliability and fault tolerance compared to single drive computers
124. tures 28 Configuration on Disk Configuration 27 Configuration Strategies 43 Configuring Logical Drives 45 Connecting Internal and External Wide Devices 109 Consistency check 8 Consistency Check 122 Converting from Internal Wide to Internal Non Wide Type 3 112 Converting Internal Wide to Internal Non Wide 110 Converting Internal Wide to Internal Non Wide Type 30 111 CPU 32 Crossover Cable 119 D Data redundancy Using mirroring 13 Data Transfer Capacity 122 Dedicated Parity 11 Degraded 15 122 Index 131 Devices per SCSI Channel 32 DIMMs 52 Disconnect Reconnect 34 Disk 122 Disk Access and Functionality 85 Disk Activity LED 53 Disk Array 122 Disk Array Types 16 Disk Duplexing 122 Disk Mirroring 13 122 Disk Rebuild 9 Disk Spanning 14 122 Disk Striping 12 123 Disk Subsystem 123 Distributed Parity 11 DOS ASPI driver 65 Double Buffering 123 Drive roaming 27 Drive States 15 Drivers 65 E Enclosure Management 16 Error Failure codes 104 Error Messages ASPI Driver 104 F Fail 15 Failed 15 Failed Drive 123 Fast SCSI 123 Fault Tolerance 8 Fault Tolerance Features 30 Fault Tolerance 35 Features 27 Firmware 32 123 Flash ROM 1 FlexRAID Power Fail Option 123 Format 124 FTP Site viii G GB 124 Glossary 121 GWC 112 H Hardware Architecture Features 29 Hardware Installation 49 Hardware Requirements 28 High Density 68
125. ty A RAID array is a collection of physical disk drives governed by the RAID management software A RAID array appears to the host computer as one or more logical drives Chapter 2 Introduction to RAID 9 Hot Spares A hot spare is an extra unused disk drive that is part of the disk subsystem It is usually in standby mode ready for service if a drive fails Hot spares permit you to replace failed drives without system shutdown or user intervention MegaRAID Express 500 implements automatic and transparent rebuilds using hot spare drives providing a high degree of fault tolerance and zero downtime The MegaRAID Express 500 RAID Management software allows you to specify physical drives as hot spares When a hot spare is needed the MegaRAID Express 500 controller assigns the hot spare that has a capacity closest to and at least as great as that of the failed drive to take the place of the failed drive Important Hot spares are employed only in arrays with redundancy for example RAID levels 1 3 5 10 30 and 50 A hot spare connected to a specific MegaRAID Express 500 controller can be used only to rebuild a drive that is connected to the same controller Hot Swap A hot swap is the manual replacement of a defective physical disk unit while the computer is still running When a new drive has been installed you must issue a command to rebuild the drive 10 MegaRAID Express 500 Hardware Guide Parity Parity gen
126. vailability of data on the physical disk drive in the logical array by maximizing the level of fault tolerance The levels of fault tolerance provided by the RAID levels are RAID Level Fault Tolerance Protection No fault tolerance Disk mirroring which provides 100 data redundancy E 100 protection through a dedicated parity drive 100 protection through striping and parity The data is striped and parity data is written across a number of physical disk drives 10 100 protection through data mirroring 100 protection through data striping All data is striped otis iniveormoreanms m 100 protection through data striping and parity All data is striped and parity data is written across all drives in two or more arrays Maximizing Drive Performance You can configure an array for optimal performance But optimal drive configuration for one type of application will probably not be optimal for any other application A basic guideline of the performance characteristics for RAID drive arrays at each RAID level is RAID Level Performance Characteristics Excellent for all types of I O activity but provides no data security Provides data redundancy and good performance Provides data redundancy 5 Provides data redundancy and good performance in most environments Provides data redundancy and excellent performance 30 Provides data redundancy and good performance in most environments Prov
127. xists and is in operation amp Cluster Administrator CLUSTERONE e File View Window Help fa xl be 2 Cluster Group Resources l Disk Group 1 C3 Cluster Configuration C3 Resources SJBENCH4SERVER1 Up Cluster Configuration H B4SERVERZ Up C Resource Types C Networks interconnect public of Network Interfaces El p B4SERVER2 Q Active Groups Active Resources 1g Network Interfaces E E BENCH4SERVER 1 O Active Groups i Active Resources Z Network Interfaces For Help press F1 2 Right click the group Disk Group 1 and select the option Move This option moves the group and all its resources to another node After a short period of time the Disk F G will be brought online on the second node If you watch the screen you will see this shift Close the Cluster Administrator snap in Congratulations You have completed installing Cluster Service on all nodes The server cluster is fully operational Now you are ready to install cluster resources such as file shares printer spoolers cluster aware services like IIS Message Queuing Distributed Transaction Coordinator DHCP WINS or cluster aware applications like Exchange or SQL Server 96 MegaRAID Express 500 Hardware Guide SCSI Drive Installations This information is provided as a generic instruction set for SCSI drive installations If the SCSI hard disk vendor s instructio
128. zard Cluster IP Address The IP address identifies the cluster to the network Type the IP address for management of the cluster The subnet mask may be supplied automatically IP address 155 100 0 145 Subnet mask 255 255 255 0 Select the public network from which clients gain access to the cluster Network public v Bs Click Finish to complete the cluster configuration on the first node MegaRAID Express 500 Hardware Guide Cluster Service Configuration Wizard E E x Completing the Cluster Service Configuration Wizard You have successfully completed the Cluster Service Configuration wizard To complete the configuration click Finish The Cluster Service Setup Wizard completes the setup process for the first node by copying the files needed to complete the installation of Cluster Service Windows Components Wizard Configuring Components Setup is making the configuration changes you requested Please wait while Setup configures the components This may take several minutes depending on the components selected Status Configuring Cluster service aaa lt Back Next gt 10 After the files are copied the Cluster Service registry entries are created the log files on the quorum resource are created and the Cluster Service is started on the first node A dialog box appears telling you that Cluster Service has started succes

LSI 500 Network Card User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents