Home

AMCC 9000 User's Manual

image

Contents

1. 0 000 cece ee eee 8 What You Need Tools and Equipment 0 00 10 Salety Factors ics rna e t ke Speke We a Aethale woh dep eee lt 10 Personal Safety 0 0 c cece eee tees 10 Protecting Equipment and Data 200 0000005 10 Installing a Serial ATA RAID Controller 00200005 12 To connect serial cables to the controller 16 To install the controller in the computer 45 17 To connect the interface cables to the drives 18 Installing a Serial ATA RAID Controller with Multi lane Internal Connectors 00000e0 ees 19 To connect the multi lane cables 00 00000000 20 To install the controller in the computer 55 21 To install the drives 0 aa a aE eee 21 FINISHING WP istic ds tng a hae ee ee eee ea eS 22 Check your Installation and Close the Case 22 Configure your RAID ArrayS 2 0 eee 22 Moving Units from an 8000 Controller to a 9000 Controller 23 Moving Legacy JBOD Units to a 9000 Controller 24 Configuring Units 0 eee eee 27 Understanding RAID Concepts and Levels 0 0 eee 28 Other Important Concepts 00 cece eee eee ee 31 Determining What RAID Level to Use 0000000 31 www 3ware com i Working with the 3ware BIOS Manager 3BM 0 5 34 Starting SBM soen ea
2. mount dev cdrom cdrom cp cdrom packages drivers linux suse 3w 9xxx lib modules lt kernel string gt kernel drivers scsi sbin insmod lib modules lt kernel string gt kernel drivers scsi 3w 9xxx ko If the driver installation fails confirm that the correct driver was installed from the CD ROM If a driver is not available for your system you will need to compile your own driver as described below Run sbin depmod a Type sbin mkinitrd 3ware 9000 Series Serial ATA RAID Controller Installation Guide 7 Driver Installation Under SUSE Linux If you are using the GRUB boot loader you are finished If you are using the LILO boot loader run LILO to update the boot record on disk by typing the following sbin lilo The output should be similar to Added linux Compiling a 3ware Driver for SUSE Linux For Experts Only If you wish to compile the driver yourself for a different kernel version that you are running then perform the following steps Note that the steps vary somewhat for 2 4 kernels and 2 6 kernels instructions are provided for each You must have a full Linux kernel source tree in usr src linux in order to do the compile To compile a 3ware driver for SUSE Linux 2 4 kernels 1 Download the 3ware 2 4 driver source from the 3ware website www 3ware com or copy the driver source from the CD into a working directory Install the Kernel source under usr src Create a sym
3. 0 0000 c cee eee 97 Appendix A Installing the Battery Backup Unit 99 Tools and equipment required 0 cee ee eee 100 Installation Overview 0 000 c eee eee neee 100 Installation Instructions 0 0 0 0 cee ee 102 Replacing the Battery 2 2 cece eee eee eee 107 Appendix B Compliance and Conformity Statements 109 Federal Communications Commission Radio Frequency Interference Statement xin sated Alesse Peas Gre es ey ht ak a 109 Microsoft Windows Hardware Quality Lab WHQL 110 European Community Conformity Statement 005 110 Appendix C Warranty Technical Support and Service 112 Limited Warranty 2 0 2 0 0020 e eee eee 112 EXCIUSIONS odee 2 202 6 eee Se eed elk ele Ate ack Goa wks Greets ado Nae are 113 State Law Provisions 00 0 0 c cece cette eee 113 Obtaining Warranty Protection 0 0 0 0 cece eee 114 AMCC s Technical Support and Services for 3ware RAID Controllers 114 Sales and Ordering Information 00 00 e eee eee eee 115 Feedback on this manual 0 0 00 eee eee 115 UNCON n ei re ndtave tere eta ete he niki tee Saree Seo Se ee 117 www 3ware com iii iv 3ware 9000 Series Serial ATA RAID Controller Installation Guide About this Guide This guide describes how to install the 3ware 9000 series RAID controller configure arrays and make the arrays available to your operating system Microsoft Windows Red
4. Note You must attach drives before you can configure RAID controller the 3ware BIOS will not be installed Understanding RAID Concepts and Levels The following concepts are important to understand when selecting the appropriate RAID level for a system 28 Arrays and Units In the storage industry the term array is used to describe two or more disk drives that appear to the operating system as a single unit When you work with 3ware software unit is the term used to refer to an array of disks that is configured and managed through the 3ware software Single disk units can also be configured in the 3ware software Mirroring Mirrored arrays write data to paired drives simultaneously If one drive fails the data is preserved on the paired drive Mirroring provides data protection through redundancy In addition mirroring using a 3ware RAID controller provides improved performance because 3ware s TwinStor technology reads from both drives simultaneously Striping Striping across disks allows data to be written and accessed on more than one drive at the same time Striping combines each drive s capacity into one large volume Striped 3ware 9000 Series Serial ATA RAID Controller Installation Guide Understanding RAID Concepts and Levels disk arrays achieve highest transfer rates and performance at the expense of fault tolerance m Distributed Parity Parity works in combination with striping on RAID 5 a
5. Figure 24 Completing Found New Hardware Wizard After the driver has been installed continue with the instructions below under Making Units Managed by a 3ware Controller Available to Windows on page 63 62 3ware 9000 Series Serial ATA RAID Controller Installation Guide Making Units Managed by a 3ware Controller Available to Windows Making Units Managed by a 3ware Controller Available to Windows After the 3ware driver has been installed you need to partition and format the new units or disks 1 Remove the driver diskette or CD reboot the system and log in as the system administrator 2 Use Disk Administrator to partition and format the new arrays or disks a From the Start menu choose Administrative Tools gt Computer Management b Inthe Computer Management window under Storage select Disk Management C computer Management E File Action Yiew Window t e Am e AKR Computer Management Local System Tools fa Event Viewer Si Shared Folders amp Performance Logs and Alerts a Device Manager amp Storage Removable Storage Disk Defragmenter i E3 Services and Applications Figure 25 Computer Management Screen 3 Follow the steps that appear on the screen to write a signature to the drive 4 Right click on the drive and select Create Volume 5 Follow the steps the appear on screen to create a volume and to assign a drive letter www 3ware com 63 Driver In
6. 2 When the 3ware Escalade Menu appears click Driver and Firmware Disks 54 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing the 3ware Driver and Windows on a New Unit 3 In the 3ware Driver amp Firmware Images menu click the appropriate button to create the driver diskette that you need Note that there are both 32 bit and 64 bit AMD drivers available for Windows Be sure to select the correct one 4 When the confirm message appears insert a blank diskette into a floppy drive and click the Yes button to begin the process Installing the 3ware Driver and Windows ona New Unit If you want to install Windows on a new drive configuration managed by the 3ware RAID controller follow the instructions in this section If Windows is already installed on another drive turn to Installing the Driver on a System that Boots from a Different Device on page 56 To install Windows and the 3ware driver 1 Boot from the Windows 2000 Windows XP or Windows Server 2003 CD and press F6 when you see the message Press F6 if you need to install a 3rd party SCSI or RAID driver at the bottom of the display 2 When you see the message Setup could not determine the type of one or more mass storage devices or you have chosen to manually specify an adapter Type S to specify that you have an additional 3ware RAID controller 3 Insert the 3ware driver diskette and press Enter 4 When a box with A
7. Installing the Hardware Installing a Serial ATA RAID Controller Figure 1 shows a 3ware Serial ATA RAID controller with twelve ports Up to twelve drives can be attached to this particular controller through serial ATA cables Overall LED drive status 12C Serial ports are double indicator the last two pins connector Stacked connectors ae of J9 The anode is the Odd numbered ports 1 LED indicators for lower of the two pins and through 11 are located individual drives on the cathode is the upper below even numbered ports J7 J8 and J9 0 through 10 Ports 104 Ports and 11 6 and7 Ports 8 and 9 4and5 2 and 3 2 3ware 0 andl Serial number on plate SODIMM BBU Battery LED connector details memory Backup Unit J7 is for drives 0 1 2 3 left to right The last two pins on module connector J8 is for drives 4 5 6 7 left to right J7 and J8 are unused J9 is for drives 8 9 10 11 left to right For more details see page 13 Figure 1 12 Port 3ware 9500S 12 Serial ATA RAID Controller Figures 2 and 3 show 3ware Serial ATA RAID controllers with 8 ports there are two versions of the 9500S 8 controller The earlier models use Pchip v1 4 and are not BBU compatible The more recent models use Pchip v1 5 and are BBU compatible Although the controllers look very similar the location of the overall LED drive status indicator is different on the two versions as shown in the respective figures If you are not certain which v
8. Serial ATA interface cables one per port Cables are not included in 9500S 8MI and 9500S 12MI 3ware installation CD with the following 3DM 2 drivers Command Line Interface CLI and 3ware 9000 Series Serial ATA RAID Controller User Guide pdf format 3ware Release Notes 3ware 9000 Series Serial ATA RAID Controller Installation Guide this guide 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installation Overview Details about each step in the installation process are included in this guide For your reference the list below provides an overview of the main steps required m If you have a Battery Backup Unit BBU install it on the controller For details see Appendix A Installing the Battery Backup Unit on page 99 m Install the controller cables and drives The basic steps are listed here For details see Installing the Hardware on page 7 a Connect the interface cables to the controller card Turn off power switches and unplug power cords for the equipment with which you are working c Make sure you are grounded to avoid electrostatic dis charge which could damage computer components or accessories d Insert the controller card into the computer e Ifthe drives are not already installed in the computer install them f Connect the interface cables to the drives g Close up the case m Power on the system www 3ware com 5 Installation Overview m Chec
9. However a product s software drivers are typically submitted for certification at nearly the same time as their release to market Since the certification process may lag behind the release of the drivers please refer to our website at www 3ware com for current certification information European Community Conformity Statement The StorS witch Controller Card Model StorSwitch 4D is in conformity with the following Common Technical Regulations and or normative documents EN 55022 Limits and methods of measurements of radio interference characteristics of information technology equipment 110 3ware 9000 Series Serial ATA RAID Controller Installation Guide European Community Conformity Statement EN 61000 4 2 Electromagnetic compatibility EMC Part 4 Testing and measurement techniques Section 2 Electrostatic discharge immunity test EN 61000 4 3 Electromagnetic compatibility EMC Part 4 Testing and measurement techniques Section 3 Radiated Radio Frequency Electromagnetic Field Immunity Test EN 61000 4 4 Electromagnetic compatibility EMC Part 4 Testing and measurement techniques Section 4 Electrical fast transient burst immunity test EN 60950 Safety of information technology equipment including electrical business equipment following the provisions of the Electromagnetic Compatibility Directive 89 23 EEC Low Voltage Directive CE www 3ware com 111 Appendix C Warranty Technical Support and Service Appendix
10. SFF 8470 use the InfiniBand 4x cable which has multi lane connectors on each end as shown in Figure 6 www 3ware com 19 Installing the Hardware Figure 6 Multi lane Cable InfiniBand 4x SFF 8470 For use with a backplane that has individual SATA connectors or individual serial ATA drives use the break out cable which has a multi lane connector on one end and four individual SATA connectors on the other end To connect the multi lane cables Depending on the model of the controller and the number of drives you will be connecting you will connect two or three multi lane cables Each cable supports up to four serial ATA ports 1 20 Connect each interface cable to a multi lane connector on the controller See Figure 5 When the cable is inserted correctly you will feel it click into place If your enclosure has a backplane connect the other end of each interface cable to the backplane If you are using a standard enclosure connect each of the individual SATA connectors to a drive 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing a Serial ATA RAID Controller with Multi lane Internal Connectors To install the controller in the computer 1 To If the computer is running shut it down Turn off power to the computer and disconnect the power cord from the outlet Open the computer case according to the manufacturer s instructions Find the PCI slot you want to use for the
11. Server 2003 Windows 2003 64 bit for AMD Opteron is also supported It is recommended that you upgrade to the latest service pack available A drive or unit managed by the 3ware RAID controller may be configured to be your system s boot device Or you can use another device as your boot device such as a disk attached to the motherboard This chapter contains instructions for how to Create a driver diskette for the 3ware RAID controller Install the 3ware driver and Windows on a new drive or unit Install the 3ware driver when Windows is already installed on a different device Note You must have administrator privileges for your system to install the Windows operating system and the 3ware driver www 3ware com 53 Driver Installation Under Windows Materials Required 3ware software CD ROM Microsoft Windows 2000 XP or Server 2003 installation CD ROM Not required if Windows is already installed on another drive m Floppy diskette to create a driver diskette If you are installing Windows you must create a 3ware driver diskette If Windows is already installed on another device you may install the 3ware driver from either the 3ware software CD ROM or from a diskette Creating a 3ware Driver Diskette If you are installing Windows on a new unit or drive managed by the 3ware RAID controller you must create a 3ware driver diskette To create a driver diskette 1 Insert the 3ware software CD into your system
12. etc modules conf alias scsi_hostadapter 3w 9xxx 6 Update the modules dep file by issuing the following command Run sbin depmod a 7 Load the driver manually Type modprobe 3w 9xxx You can also incorporate the insmod command into a startup script 76 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under Red Hat Linux Compiling a 3ware Driver for Red Hat Linux For Experts Only If necessary you can compile the 3ware driver yourself For example if you are running a different kernel version Notes You must have a full Linux kernel source tree in usr src linux in order to do the compile In addition you must boot to the UP kernel to use the make targets Otherwise errors will result that will cause the driver build to fail The instructions below are for compiling the driver under a 2 4 kernel For information about compiling the driver under a 2 6 kernel see the Knowledgebase on the website at www 3ware com 1 Download the 3ware driver source from 3ware s website 2 Copy the driver source into a working directory The latest 3ware driver source is bundled with the latest firmware 3 Untar the driver source with this command tar zxfv 3w 9xxx tgz The driver source will be output to a directory called driver 4 Change directory to driver cd driver 5 Red Hat 7 2 and later support multiple build targets from makefile Boot to UP version of kernel to build all
13. 3ware 9000 Series Serial ATA RAID Controller User Guide Press the F8 or Esc key to save and exit www 3ware com 25 Installing the Hardware 26 3ware 9000 Series Serial ATA RAID Controller Installation Guide Configuring Units After you have physically installed your 3ware RAID controller and connected it to your disk drives you configure how the drives connected to the controller will be used in RAID arrays This section includes the following topics Understanding RAID Concepts and Levels on page 28 Determining What RAID Level to Use on page 31 Working with the 3ware BIOS Manager 3BM on page 34 Specifying the Unit Configuration on page 40 Initializing Units on page 49 Checking the Motherboard Boot Sequence on page 51 Installing Drivers and Making the Units Available For Use on page 52 If you already know the RAID configuration you want turn to Specifying the Unit Configuration on page 40 www 3ware com 27 Configuring Units f Note This section describes how to configure your RAID arrays as part of the installation process For complete information about using 3ware BIOS Manager 3BM including how to use it to change existing configurations and for information about how to define and change the configuration using 3ware Disk Manager 3DM 2 see the 3ware 9000 Series Serial ATA RAID Controller User Guide RAID arrays If no drives are attached to the 3ware
14. 7 11 21 2004 A This driver is not digitally signed l Have Disk N nt Figure 18 Completing Found New Hardware Wizard 5 If the Completing screen similar to Figure 18 indicates that you should restart your computer do so now 58 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing the Driver on a System that Boots from a Different Device 6 When the Install Hardware Device Drivers screen appears Figure 19 click Next and follow the prompts on the screen to install the second driver Hardware Update Wizard Select the device driver you want to install for this hardware D Select the manufacturer and model of your hardware device and then click Next If you have a disk that contains the driver you want to install click Have Disk v Show compatible hardware Model AMCC ware 9000 Series SATA RAID Controller A This driver is not digitally signed Have Disk Tell me why driver signing is important lt Back Next gt N Cancel Figure 19 Install Hardware Device Drivers 7 When the second Completing the Found New Hardware screen appears click Finish Found New Hardware Wizard Completing the Found New Hardware Wizard Q AMCC SATA RAID 9000 Manager Windows has finished installing the software for this device To close this wizard click Finish J Caricel Figure 20 Completing Found New Hardware Wizard www 3ware c
15. Guide Exclusions For detailed terms and conditions please see the Limited Hardware Warranty and Software License Agreement at our website http www 3ware com support rma_form asp AMCC warranty service is provided by returning the defective product to AMCC Exclusions This warranty does not cover any damage to this product which results from accident abuse misuse natural or personal disaster or any unauthorized disassembly repair or modification AMCC shall not be liable for any incidental or consequential damages including but not limited to loss of profits other loss damage or expense directly or indirectly arising from the customer s misuse of or inability to use the product either separately or in combination with other equipment regardless of whether AMCC has been advised of the possibility of such damages AMCC is not liable for and does not cover under warranty any costs associated with servicing and or the installation of AMCC products This warranty sets for the entire liability and obligations of AMCC with respect to breach of warranty and the warranties set forth or limited herein are the sole warranties and are in lieu of all other warranties expressed or implied including warranties or fitness for particular purpose and merchantability State Law Provisions This warranty gives you specific legal rights and you may have other rights which vary from state to state Some states do not allow the exclusion of i
16. Hat Linux SuSE Linux or FreeBSD For more complete information about managing and using arrays connected to the 3ware RAID controller see 3ware 9000 Series Serial ATA RAID Controller User Guide You may also want to refer to the Knowledgebase available at the 3ware website at http www 3ware com support Conventions Used in This Guide The following conventions are used throughout this guide 3BM refers to the 3ware BIOS Manager 3DM refers to the 3ware Disk Manager version 2 Unit refers to one or more disks configured through 3ware software to be treated by the operating system as a single drive Also known as an array Array and unit are used interchangeably throughout this manual Boldface is used for buttons fields and settings that appear on the screen E Monospace font is used for code and to indicate things you type www 3ware com vV About this Guide vi 3ware 9000 Series Serial ATA RAID Controller Installation Guide About the 3ware RAID Controller This section includes the following topics Product Features What s New with the 3ware 9000 Series Controllers About 3ware Driver Versions System Requirements Package Contents Product Features The 3ware 9000 Series Serial ATA family includes 9500S 4LP 9500S 8 9500S 12 9500S 8MI and 9500S 12MI Features of the 3ware 9000 series controllers include m Advanced RAID features for greater data protection and management Support for bat
17. User Guide replaced by an incorrect type To obtain a replacement 9 Caution There is a risk of explosion if the battery is battery contact AMCC For proper battery disposal resources contact RBRC The Rechargeable Battery Recycling Corporation www rbrc com To replace the battery 1 Make sure the system is powered down that you are grounded and follow all appropriate safety procedures 2 If necessary remove the 3ware RAID controller from your system www 3ware com 107 Appendix A Installing the Battery Backup Unit 3 Disconnect the battery power cable from the BBU To do so press down on the lever like clip on the battery power connector and slide it out of the slot Figure 11 Power cable from the battery to the BBU 4 Slide the battery out of the plastic 5 Insert the new battery and cable it up 6 If necessary reinstall the 3ware RAID controller close up your system and restart it 7 Runa battery test to compute the estimated battery capacity of this new battery You can run the battery test from the BBU page of either 3BM or 3DM 2 For detailed instructions see the 3ware 9000 Series Serial ATA RAID Controller User Guide 108 3ware 9000 Series Serial ATA RAID Controller Installation Guide Appendix B Compliance and Conformity Statements Federal Communications Commission Radio Frequency Interference Statement This equipment has been tested and found to comply with the limits for a Clas
18. a RAID configuration which has started initializing press Esc to cancel the progress box You can then exit 3BM and boot to the operating system before the process of writing zeroes to the drives is complete Once you have booted to the operating system initialization of the RAID 5 or RAID 50 unit will begin after a delay of up to ten minutes When initializing is done after booting to the operating system the process of initializing takes longer than it does if initialization is done by writing zeroes to the array in the BIOS Consequently it will be a longer period of time until the performance of the unit is fully optimal Data remains intact when initialization is done in the operating system For RAID 1 and RAID 10 RAID 1 and RAID 10 units are not initialized when they are created and are immediately available for use with full performance when created Initialization of RAID 1 RAID 10 RAID 5 with 3 or 4 disks RAID 50 with 6 8 or 9 drives and RAID 50 with 12 drives configured in 3 subunits of 4 each or 4 subunits of 3 each will take place the first time the array is verified either via 3BM through 3ware 3DM 2 or through the 3ware CLI The steps below describe how to do this through the BIOS 3BM For information about using 3DM 2 see 3ware 9000 Series Serial ATA RAID Controller User Guide For information about using the CLI see 3ware Escalade 9000 Series Serial ATA RAID Controller CLI Guide To start initialization thr
19. after installing a 3ware RAID controller Windows recognizes it as a Plug and Play device and brings up the Found New Hardware Wizard This wizard guides you through installing the 3ware drivers see Figure 17 Note that you will see screens for the installation of two drivers during this process Found New Hardware Wizard Welcome to the Found New Hardware Wizard ya This wizard helps you install a device driver for a hardware device To continue click Next Back Cancel Figure 17 Found New Hardware Wizard Windows 2000 1 Click the Next button and respond to the questions the Wizard displays using the default selections 2 When the Wizard prompts you to select a device driver click Have Disk and then indicate that it is on the CD or floppy 3 Ifthe Digital Signature Not Found message appears click Yes to continue the installation www 3ware com 57 Driver Installation Under Windows 4 When the Completing the Found New Hardware Wizard screen appears Figure 18 click Finish Hardware Update Wizard Select the device driver you want to install for this hardware Select the manufacturer and model of your hardware device and then click Next If you havea disk that contains the driver you want to install click Have Disk E Show compatible hardware Model AMCC 3ware 9000 Series SATA RAID Controller Version 2 4 2 40 8 10 2004 AMCC 3ware 9000 Series SATA RAID Controller Version 2 6 3
20. cd sys modules twa Uncomment or comment the following line in Makefile based on whether or not you intend to bundle the firmware image with the driver TWA_FLASH_FIRMWARE 1 If you intend to enable printing of debug messages in the driver uncomment the following line in Makefile CFLAGS DTWA_DEBUG lt number from 0 to 10 gt Specifying 0 in the above line prints no debug messages whereas specifying 10 prints a LOT of debug messages Build the driver make clean make depend make Copy the driver to the appropriate directory For FreeBSD 4 x copy it to cp twa ko modules twa ko For FreeBSD 5 x copy it to cp twa ko boot kernel twa ko Unload the existing driver if any kldunload twa ko Load the new driver kldload twa ko www 3ware com 95 Driver Installation Under FreeBSD 96 3ware 9000 Series Serial ATA RAID Controller Installation Guide Troubleshooting Problems and Solutions This chapter includes solutions to problems users sometimes encounter when using 3ware RAID controllers For support troubleshooting tips frequently asked questions software releases and compatibility information related to 3ware RAID controllers refer to m 3ware support page at http www 3ware com support m 3ware knowledgebase http www 3ware com KB kb asp m 3ware software downloads http www 3ware com support download asp m 3ware documentation http www 3ware com support userdocs asp m 3ware C
21. grooves in the slot and all pins make proper contact with the PCI slot pins when pushed into place The 3ware RAID controller is keyed to ensure proper installation into a full sized PCI slot Make sure that the contacts will mate with the grooves in the slot www 3ware com 17 Installing the Hardware To 18 Press down gently on the edge of the 3ware RAID controller directly above the slot until it is fully seated Check that the 3ware RAID controller s metal bracket covers the hole in the case and secure the bracket with the screw that was used to secure the filler bracket in step 5 connect the interface cables to the drives If your drives are not already installed in the computer chassis or hot swap carriers install them now Be sure that the drives are connected to the power supply either by cable or through the drive cage For each drive select the end of an interface cable not connected to the 3ware RAID Controller and plug it into the drive or drive carrier One edge of each interface cable connector is keyed to ensure proper installation Optional Connect the drive activity LED connectors See the connection details on Figure 1 For a discussion of whether to make these connections see Whether to Use the LED Status Connector on page 9 and To connect serial cables to the controller on page 16 Optional If staggered spinup is desired and supported by your hard drives set the appropriat
22. or DVD When installing SuSE press the F6 key You will then be prompted to insert the driver disk Insert the 3ware Linux driver installation diskette Click OK and continue with installation Installing the 3ware Driver on a SuSE Linux System that Boots from a Different Device 1 2 Log in as root Edit etc sysconfig kernel and make sure the file contains the following line INITRD_MODULES reiserfs 3w 9xxx 9xxx depending on the installation You may see entries like reiserfs ext3 or scsi_mod If present leave them ensuring there is a space between each module name since the system needs them to boot properly 3 Note Other modules may be listed before or after 3w www 3ware com 81 Driver Installation Under Linux lt kernel string gt with the kernel version you are using i e 2 6 etc replace with your version of SuSE Note about variables In the instruction below replace In addition replace 3w 9xxx with the appropriate module file for your kernel The available module files are For UP kernels 3w 9xxx ko For SMP kernels 3w 9xxx smp For BigSMP high memory kernels 3w 9xxx big 82 If you are using SuSE 9 1 or earlier after the existing 3w xxx entry add 3w 9xxx to lib modules lt kernel string gt modules dep file Mount the CD ROM copy and install the appropriate driver for your system Note The AMD 64 bit driver is also used for 64 bit Intel Xeon systems
23. size slot of the 3ware card and whether or not BBU support is available Shift F5 Return to the main 3ware BIOS Manager screen from the Advanced Details screen Any key Move a highlighted unit up or down in the list of exportable units The top most unit will become the bootable unit if you install the OS Page Up Page Down Available only when there are multiple units and a unit is highlighted Display context sensitive help F1 or Alt F1 If you have multiple 3ware controllers in your system return to the board selection screen Esc www 3ware com 39 Configuring Units Table 4 Working in 3BM To do this Use these keys Exit the utility and save or abandon Esc all changes Exit the utility and save all changes F8 Specifying the Unit Configuration You can implement one or more units of supported RAID levels on a single controller depending on the number of drives that the specific 3ware RAID controller supports and the number of drives attached Basic Steps for Creating a Unit The process of configuring your RAID units includes these main steps which are detailed in the step by step example m Select the drives to be included and indicate that you want to create a disk unit m Choose the desired RAID configuration m Set other parameters depending on the type of RAID configuration Confirm the unit configuration m Save your changes To sel
24. te cee hk Pew a She ede 34 Exiting BBM 2 6064 ec ese a ai a ood ea es cee ee eee 36 Working in the 3BM Screens 0 0 eee eee eee 37 Specifying the Unit Configuration 0 00 eee eee 40 Basic Steps for Creating a Unit 00 0 e eee eee 40 Specifying a Hot Spare 2 0 0 0 0 0 c eee 46 Enabling Auto Carving for Units Larger Than2TB 47 Leaving Individual Drives as JBODs 00 000 e eee 48 Initializing Units se sore ga ae he Ra Se ee ee eg 49 RAIDO UNIS fa 5 0S ett tee el etl ge ld bie E Setatolet lye 49 For RAID 5 and RAID 50 Units 000 02 eeee 49 For RAID 1 and RAID 10 0 0 00 eee 50 Checking the Motherboard Boot Sequence 005 51 Installing Drivers and Making the Units Available For Use 52 Driver Installation Under Windows 2 2 5 53 Materials Required 2 2 0 cece ene 54 Creating a 3ware Driver Diskette 0000 cece eee 54 Installing the 3ware Driver and Windows on a New Unit 55 Installing the Driver on a System that Boots from a Different Device 56 Making Units Managed by a 3ware Controller Available to Windows 63 Finishing Up eisc soievey aes Geese ie be a ea id ee ke 64 Driver Installation Under Linux 20000005 65 Obtaining 3ware Linux Drivers 0 0 000 c eee 66 Be Sure to Use the Correct Drivers 00 0 c eee eee 66 Determining the Curr
25. the 3ware BIOS from installing If drives are attached and you do not want to install the 3ware BIOS press Alt b to bypass the BIOS installation when you start the system This is useful when booting temporarily from another device if the operating system is already installed on the 3ware unit This saves the step of changing the boot order in 3BM and having to change it back again 3ware 9000 Series Serial ATA RAID Controller Installation Guide Appendix A Installing the Battery Backup Unit The Battery Backup Unit BBU is an add on that can be attached to a 3ware 9000 RAID controller to supply power to the memory module from an attached battery pack in the event of a system power loss This allows the controller to use write caching for optimal performance and not be exposed to data loss in the event of a system power failure When fully charged the battery preserves the contents of the controller cache memory for a limited period of time up to 72 hours When power is restored cached data is flushed to disks Caution Both the 3ware RAID controller and the Battery Backup Unit are sensitive electronic equipment and can be damaged through electrostatic discharge When installing the BBU on the controller be sure you are grounded Use a grounding strap or work on an ESD protective mat m Do not remove the 3ware controller or BBU from their protective bags until you are properly grounded m Handle the 3ware RAID controller by
26. 101 Appendix A Installing the Battery Backup Unit Installation Instructions 1 For full height controllers turn the controller memory side down on a flat surface 2 Remove the screws that connect the PCI bracket to the controller and set the bracket aside i Half height board Full height board bracket bracket unscrews from unscrews from bottom side of top side of board board Figure 4 Removing the screws from the PCI bracket 3 For full height controllers turn the controller memory side up 102 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installation Instructions 4 Make sure the battery cable is fastened under the cable management clips as shown in Figure 5 Cable management clips Figure 5 Battery cable inserted through cable management clips 5 Match the clips on the end of the BBU to the slots on the edge of the controller to create a hinge and rotate the BBU to position it over the card as shown in Figures 6 and 7 Hole for post Figure 7 BBU rotates into position on the controller www 3ware com 103 Appendix A Installing the Battery Backup Unit 6 Align the Battery Backup Unit to the controller with these connectors m Mate the connector on the BBU with the receptacle on the controller m Match the plastic post on the BBU with the hole on the controller 7 Press down gently until the BBU is seated Figure 8 BBU attached to controller 8 Reconnect th
27. AMG STORAGE 3ware SATA RAID Controller Supports the 9000 Series PN 720 0117 01 March 2005 Installation Guide Copyright 2004 2005 AMCC All rights reserved No part of this publication may be reproduced stored in a retrieval system or transmitted in any form by any means electronic mechanical photocopying recording or otherwise without the proper written consent of AMCC 455 West Maude Ave Sunnyvale CA 94085 Trademarks 3ware Escalade and 3DM are all registered trademarks of AMCC The 3ware logo 3BM StorSwitch TwinStor and R5 Fusion are all trademarks of AMCC All other trademarks herein are property of their respective owners Disclaimer AMCC assumes no responsibility for errors or omissions in this document nor does AMCC make any commitment to update the information contained herein Table of Contents About this Guide 00 000 cece eee eee v Conventions Used in This Guide nanana anaana v About the 3ware RAID Controller 055 1 Product Fedi oS a a cece eee 1 What s New With the 3ware 9000 Series Controllers 2 System Requirements 0 0c e eee eee teen eee 2 Rackage Contents ss ic steed nl ieee date eee ahs Redes eda 4 Installation Overview 00 0 cee ee eee ee eee 5 Installing the Hardware 0200 eee eee eee eeee 7 Before You Beg itt sis cece rena trae E atthe em aaed aa ates 8 Installation Considerations
28. C Warranty Technical Support and Service Limited Warranty RAID Controller Hardware 3 Year Hardware Warranty AMCC warrants this product against defects in material and workmanship for a period of thirty six 36 months from the date of original purchase AMCC at no charge and at its option will repair or replace any part of this product which proves defective by reason of improper workmanship or materials Repair parts or replacement products will be provided by AMCC on an exchange basis and will be either new or refurbished to be functionally equivalent to new Products or parts replaced under this provision shall become the property of AMCC Battery Backup Unit BBU Hardware 1 Year Hardware Warranty AMCC warrants this product against defects in material and workmanship for a period of twelve 12 months from the date of original purchase AMCC at no charge and at its option will repair or replace any part of this product which proves defective by reason of improper workmanship or materials Repair parts or replacement products will be provided by AMCC on an exchange basis and will be either new or refurbished to be functionally equivalent to new Products or parts replaced under this provision shall become the property of AMCC Software Warranty AMCC will replace a defective media purchased with this product for a period of up to 30 days from the date of purchase 112 3ware 9000 Series Serial ATA RAID Controller Installation
29. D Controller Installation Guide System Requirements Drives Depending on the particular model the 3ware RAID controller may be connected to up to four eight or twelve SATA drives using the supplied interface cables Drives must meet serial ATA 150 SATA J or serial ATA 300 SATA 2 Gb s standards Drives may be of any capacity or physical form factor The length of both shielded and unshielded interface cables may not exceed 1M 39 for serial ATA controllers Operating System 3ware RAID controllers may be used with m Windows 2000 Professional Server Advanced Server SP3 or newer Windows XP Professional SP1 or newer Windows Server 2003 Standard Enterprise Windows XP x64 Edition Windows Server 2003 x64 Edition Red Hat Linux 32 bit and 64 bit x86 SuSE Linux 32 bit and 64 bit x64 Other versions of Linux using the open source Linux driver m FreeBSD m Other Requirements m Adequate air flow and cooling m Adequate power supply for drives For a complete listing of features and system requirements refer to the 9000 Series Datasheet available from the website at www 3ware com products serial_ata9000 asp www 3ware com 3 About the 3ware RAID Controller Package Contents If your package is missing any of the items listed below contact 3ware before proceeding with installation disk drives and disk mounting brackets are not included 3ware Serial ATA RAID Controller in an ESD protective bag
30. L120AVVA0 7 0 RAID Array s Write conf iguration Cache State Continue on Stripe Size source error during rebuild Figure 11 Create Disk Array Display RAID 0 Example Note Creating an array will overwrite e ting data on its drives Create a disk array from these drives Port 0 IC35L120AVVA07 0 Port 1 IC35L120AVVA0 7 0 Port 2 IC3SL1Z0AVVA0 O Port 3 IC3SL120AVVA0 0 RAID Array s Write conf igurati Cache State Continue on Stripe Size source error during rebuild Figure 12 Create Disk Array Display RAID 5 Example 42 3ware 9000 Series Serial ATA RAID Controller Installation Guide Specifying the Unit Configuration To select the desired RAID configuration 1 Press Enter in the RAID Configuration field to display the available RAID levels for the number of drives you selected Select RAID configuration Single Drive RAID 5 RAID 10 Figure 13 List of Configuration Choices for Four Drives Use the arrow keys to highlight the desired RAID configuration and press Enter For information about the different RAID levels and when to use each see Understanding RAID Concepts and Levels on page 28 To enable or disable write cache and set striping size The write cache and striping size parameters depend on the type of RAID level you selected later without affecting the configuration However you Note You can enable or disable the write cache again cannot change the stripe size la
31. MCC 3ware Series ATA RAID Controller appears press Enter to select it www 3ware com 55 Driver Installation Under Windows 5 Type S if you have additional devices to add Otherwise press Enter 6 If the Digital Signature Not Found message appears click Yes to continue the installation If there are multiple controllers in the system you will see this message once for each controller 7 Continue with the normal Windows installation at this point There are no instructions after installing the driver that are specific to 3ware If you need additional instructions refer to the Windows 2000 Windows XP or Windows Server 2003 documentation supplied by Microsoft 8 Turn to page 56 and follow the instructions for Making Units Managed by a 3ware Controller Available to Windows Installing the Driver on a System that Boots from a Different Device If you are installing the 3ware RAID controller on a system that already has the operating system installed on another drive follow the instructions in this section depending on the version of Windows installed on your system m To install the 3ware driver under Windows 2000 on page 57 To install the 3ware driver under Windows XP or 2003 on page 60 56 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing the Driver on a System that Boots from a Different Device To install the 3ware driver under Windows 2000 When you start Windows
32. Serial ATA RAID Controller User Guide Note If you make changes on the Policy screen 36 3ware 9000 Series Serial ATA RAID Controller Installation Guide Working with the 3ware BIOS Manager 3BM Working in the 3BM Screens Available Drives Port IC35L1Z20AYYA07 0 115 03 GB Port 1 IC35L1Z20AYYA07 0 115 03 GB Port 2 IC35L1Z20AYYA07 0 115 03 GB Port 3 IC35L1Z20AYYA07 0 115 03 GB Alt F1 te F6 Figure 9 3BM Configuration Utility Main Display The main 3BM screen shows a list of available drives After you have configured one or more drives it also lists the existing configuration m Available Drives lists the drives that are available to create units and hot spares Exportable Units lists any existing units along with the drives contained in the units Incomplete Drives and Others If you connected drives to the controller that were previously used on a 7000 8000 series 3ware RAID controller they may appear in a section titled Incomplete Drives and Others Before you can use these drives they must be deleted For more information see the discussion of Deleting Units in 3ware 9000 Series Serial ATA RAID Controller User Guide www 3ware com 37 Configuring Units m Unusable Units Any unit that is missing too many drives to be constructed properly will be listed here Table 4 lists how to move around and select information in the 3BM screens Table 4 Working in 3BM To do this Use these ke
33. Use the Correct Drivers The Linux 3w 9xxx drivers included on the 3ware CD are only for 3ware 9000 series controllers 3ware 7 8000 series controllers use a Linux driver labeled 3w xxxx The drivers for the 9000 series controllers and the 7 8000 series controllers are not interchangeable but can be used together when both controller types are installed in the same system The examples in this manual 66 3ware 9000 Series Serial ATA RAID Controller Installation Guide Obtaining 3ware Linux Drivers refer only to the 9000 series driver For information about using the 7 8000 driver and controller refer to the user guide or installation procedure for the 7 8000 series controller Warning Be sure to use the correct driver for your AN processor Be sure you load the correct driver on your system It is possible to load the wrong driver onto a system however when you boot such systems they will not work For Red Hat AMCC offers the following drivers m x86 32 bit for Intel x86 m x86 32 bit for AMD Athlon m amd 64 bit used for both AMD Opteron and Intel 64 bit Xeon EM64T For SuSE AMCC offers the following drivers m x86 32 bit for Intel x86 and AMD Athlon m amd 64 bit for AMD Opteron and Intel 64 bit Xeon EM64T www 3ware com 67 Driver Installation Under Linux Determining the Current Version of your 3ware Driver If you already have a 3ware controller installed you can check the current driver version If you h
34. add alias scsi_hostadapter 3w 9xxx 13 Load the module modprobe 3w 9xxx 86 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under FreeBSD Note Before installing the 3ware driver you must have already installed your 3ware RAID controller in the system A drive or unit managed by the 3ware RAID controller may be configured to be your system s boot device Or you can use another device as your boot device such as a disk attached to the motherboard The steps you follow to install the driver and make your RAID unit available depend on whether it will be your boot device This chapter provides step by step instructions for the following situations m Installing the Driver While Installing FreeBSD on the 3ware RAID Controller on page 88 m Installing the 3ware Driver on a FreeBSD System that Boots from a Different Device on page 92 www 3ware com 87 Driver Installation Under FreeBSD Obtaining 3ware FreeBSD Drivers FreeBSD 4 10 and later have 9 xxx driver support built in No driver installation is required If you are using FreeBSD 4 8 or 4 9 you will need to install the 3ware FreeBSD driver as described below The 3ware software CD ROM that came with the 3ware RAID controller includes compiled and tested drivers for FreeBSD 4 8 and 4 9 To see if a more recent driver is available please see the 3ware web site Materials Required m 3ware driver The driver an
35. ailed drive without user intervention To specify a hot spare 1 In the list of Available Drives highlight the drive to use 2 Type s to specify that the selected drive will be the hot spare You ll see the words Hot Spare appear next to the drive in the Available Drives list Available Drives Exportable Units Unit 34 Port 0 Forts Port 2 r t Alt F1 te Alt i Enter F6 Esc F8 s Figure 16 Hot Spare Indicated 46 3ware 9000 Series Serial ATA RAID Controller Installation Guide Specifying the Unit Configuration If a hot spare is already enabled you can disable it by following the same process unit a hot spare drives must have the same or larger Note In order to replace a failed drive in a degraded storage capacity than the failed drive Enabling Auto Carving for Units Larger Than 2 TB If the capacity of your unit exceeds 2TB and you are using one of the following operating systems you will need to enable auto carving in order to make use of the full capacity Windows 2000 Windows XP Linux 2 4 FreeBSD 4 x You must turn on the 2TB Auto Carving policy before creating the unit Units created with this policy turned off will not be affected If the policy is turned off later units that have been carved into volumes will retain their individual volumes existing data is not affected To enable auto carving 1 At the main 3BM screen tab to Policy and press Enter 2 On the Policy sc
36. aterial contents of the box when exchanging or returning a product For information about the status of a replacement please contact AMCC Technical Support AMCC s Technical Support and Services for 3ware RAID Controllers Product information Frequently Asked Questions software upgrades driver files and other support are available through the 3ware World Wide Web site at http www 3ware com 114 3ware 9000 Series Serial ATA RAID Controller Installation Guide Sales and Ordering Information The 3ware software library is accessible at http www 3ware com support download asp Web based software downloads feature upgrading multiple switches simultaneously For specific answers to questions or to give feedback about the product visit our Web site at http www 3ware com support and use our convenient e mail form AMCC also offers toll free 800 945 7273 and 408 523 1145 direct phone support during normal business hours Sales and Ordering Information For sales information send an electronic mail message to 3wareSales amcc com Feedback on this manual Your feedback is welcome If anything in the guide seems unclear please let us know by sending e mail to 3wareSupport amcc com www 3ware com 115 Appendix C Warranty Technical Support and Service 116 3ware 9000 Series Serial ATA RAID Controller Installation Guide Index Numerics 3BM BIOS Manager 34 configuration utility 34 navigating 38 shortcut keys w
37. ave a 2 4 kernel or earlier type the following command cat proc scsi 3w 9xxx where the asterisk represents SCSI host ID and 9xxx represents the family of the controller For example cat proc scsi 3w 9xxx 0 If you have a 2 6 kernels with sysfs type the following command cat sys class scsi_host lt hostid gt stats where lt hostid gt is usually host0 unless other SCSI devices are available in which case it may be host or higher If you have a 2 6 kernel without sysfs type the following command dmesg grep 3w dmesg can also be used with earlier kernel versions Driver Installation Under Red Hat Linux Materials Required 3ware software CD ROM Floppy diskette if you need to create a driver diskette Red Hat Linux installation CD ROM and boot disk Not required if Red Hat Linux is already installed on another drive 68 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under Red Hat Linux Creating a Red Hat Linux Driver Diskette If you are installing Linux on the new drive or unit managed by the 3ware RAID controller you must create a 3ware driver diskette If Linux is already installed on another device you may install the 3ware driver from either the 3ware software CD ROM or make a driver diskette To create a driver diskette 1 Insert the 3ware software CD into your system 2 When the 3ware Escalade Menu appears click the Driver amp Firmware Disks but
38. bolic link ln s usr src lt Kernel Src Dir gt usr src linux Change the directory to cd usr src linux www 3ware com 83 Driver Installation Under Linux 10 11 12 13 84 Copy the config file for the kernel you want to build module for from the appropriate usr src linux arch directory listed below to usr src linux config kernel directory x86 UP usr src linux arch i386 defconfig default x86 SMP usr src linux arch i386 defconfig smp4g x86 ATHLON usr src linux arch i386 defconfig athlon Make oldconfig Untar the driver source with this command tar zxfv 3w 9xxx tgz The driver source will be output to a directory called driver Change directory to driver cd driver To build UP module boot to desired UP kernel type make f Makefile oth The created file is 3w 9xxx o To build SMP module boot to desired SMP kernel type make smp f Makefile oth The created file is 3w 9xxx smp Copy the module 3w 9xxx o to the scsi directory 1ib modules lt kernel string gt kernel drivers scsi 3w 9XXX 0 Edit etc modprobe conf and add alias scsi_hostadapter 3w 9xxx Load the module modprobe 3w 9xxx 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under SUSE Linux To compile a 3ware driver for SUSE Linux 2 6 kernels 1 Download the 3ware 2 6 driver source from the 3ware website Www 3ware com Copy the driver sou
39. cator Pin Positions on page 14 Drive Installation Considerations m Selecting an enclosure If you are planning to use RAID 1 5 10 or 50 you may want to consider installing drives into hot swappable enclosures so that they can be easily removed in the event of a drive failure When to install the drive If the drives are not already installed in your computer you can choose to install them either before or after connecting the interface cables to them www 3ware com 9 Installing the Hardware What You Need Tools and Equipment Tools Required You will need the following tools during installation m An ESD grounding strap or mat m Standard hand tools to open your system s case and install the 3ware RAID controller into an available PCI expansion slot Safety Factors Be sure to follow the guidelines presented on the next few pages to insure your own safety and that of your equipment Personal Safety Warning High voltages may be found inside computer A equipment Before installing any of the hardware in this package or removing the protective covers of any computer equipment turn off power switches and disconnect power cords Do not reconnect the power cords until you have replaced the covers Protecting Equipment and Data Backing Up Your Data Back up your data Creating or deleting disk arrays AN destroys existing files on the member drives If your drives contain valuable data back them u
40. city into multiple chunks of 2 TB or smaller that can be addressed by the operating systems as separate volumes For more information see Enabling Auto Carving for Units Larger Than 2 TB on page 47 and in 3ware 9000 Series Serial ATA RAID Controller User Guide see Multi LUN Support and Auto Carving www 3ware com 33 Configuring Units Working with the 3ware BIOS Manager 3BM This section describes the basics of working with the 3ware BIOS Manager 3BM configuration utility It includes the following sections m Starting the 3BM configuration utility m Exiting the 3BM configuration utility m Working in the 3BM configuration screens Starting 3BM You access the 3BM configuration utility during the start up process for your computer To start 3BM 1 Power up or reboot your system 2 While the system is starting watch for a screen similar to Figure 7 3ware ATA RAID Controller Escalade 9500S 12 BIOS BEQX X XX Firmware FE9X X XX XX Mirror 111 74GB IC35L120AVVA07 0 15 0 IC35L120AVVA07 0 115 03 Following drives will not be exported to OS IC35L120AVVA07 0 115 03 GB Unconfigured Disk IC35L120AVVA07 0 115 03 GB Unconfigured Diski Press lt Alt 3 gt to access 3ware BIOS Manager Figure 7 3ware BIOS Screen 3 Press Alt 3 immediately to bring up the 3BM configuration utility display 34 3ware 9000 Series Serial ATA RAID Controller Installation Guide Working with the 3wa
41. d New Hardware Wizard screen appears Figure 22 click Finish Found New Hardware Wizard Completing the Found New Hardware Wizard The wizard has finished installing the software for amp AMCC 3ware 9000 Series SATA RAID Controller Click Finish to close the wizard Barc Finish N Figure 22 Completing Found New Hardware Wizard 5 Ifthe Completing screen similar to Figure 22 indicates that you should restart your computer do so now 6 When the Welcome to the Found New Hardware Wizard screen appears again Figure 23 click Next and follow the prompts on the screen to install the second driver www 3ware com 61 Driver Installation Under Windows Found New Hardware Wizard Welcome to the Found New Hardware Wizard This wizard helps you install software for AMCC SATA RAID 9000 Manager gt If your hardware came with an installation CD gt or floppy disk insert it now What do you want the wizard to do Install the software automatically Recommended Install from a list or specific location Advanced Click Next to continue Cancel Figure 23 Welcome to the Found New Hardware Wizard 7 When the second Completing the Found New Hardware screen appears click Finish Found New Hardware Wizard Completing the Found New Hardware Wizard The wizard has finished installing the software for vg g AMCC SATA RAID 9000 Manager I Click Finish to close the wizard Finish X
42. d the corresponding source files can be found on the 3ware CD ROM at packages drivers freebsd lt OS version gt and packages drivers freebsd src lt OS version gt where OS version is either 4 x or 5 x You can also download the FreeBSD driver from the 3ware web site http www 3ware com FreeBSD installation CD ROM or diskette Installing the Driver While Installing FreeBSD on the 3ware RAID Controller larger than 1 TByte If you want to create an array larger than 1 TByte check to make sure that the version of FreeBSD you have supports it Note Some versions of FreeBSD cannot boot to arrays 88 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing the Driver While Installing FreeBSD on the 3ware RAID Controller To install the driver as a module 1 2 Boot with the FreeBSD CD ROM or diskette In the sysinstall menu select Configure gt Load KLD module Note Immediately after the OS starts booting from the CD insert an MS DOS floppy with the 3ware driver twa ko into the floppy drive If you do not insert it immediately sysinstall may fail to recognize the floppy drive Load the driver from the floppy drive Run the FreeBSD installation and reboot For instructions on how to install FreeBSD see the FreeBSD website at http www freebsd org Remove the floppy disk and the CD On reboot escape to the loader menu Note Once again immediately after the OS
43. e PCI bracket using the phillips screws you removed in Step 2 For the full height board the bracket sits on top of the board and screws are inserted from the bottom For the half height board the bracket sits on the bottom of the board with screws inserted from the top 104 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installation Instructions 9 Insert the battery power connector into the power receptacle on the BBU Figure 9 Battery power connector and power receptacle The controller is now ready to install in your system Figures 10 and 11 show the BBU fully installed on 3ware controllers You can check the status of the battery and run a battery test to determine if the battery needs to be replaced For details see 3ware 9000 Series Serial ATA RAID Controller User Guide www 3ware com 105 Appendix A Installing the Battery Backup Unit Z 3ware POTN mar of A FOSTI POW Asana yqeolgg POLL ALT Em 3ware mat woo OM Ioro PPN meg QS o rT ALE ETI Figure 10 BBU installed on controllers 106 3ware 9000 Series Serial ATA RAID Controller Installation Guide Replacing the Battery Replacing the Battery The Battery Backup Unit BBU will last for many years The battery has an expected life span of one to two years depending on usage You can check the current status of the battery and test it For details see instructions in 3ware 9000 Series Serial ATA RAID Controller
44. e driver on a system that boots SuSE Linux from a different device page 81 www 3ware com 65 Driver Installation Under Linux If you are using a Linux distribution for which there is not a compiled driver available from 3ware you can copy the source from the 3ware software CD or download the source from the 3ware website and compile a new driver For more information see Compiling a 3ware Driver for Red Hat Linux on page 77 and Compiling a 3ware Driver for SuSE Linux on page 83 For information about upgrading a driver that is already loaded see 3ware 9000 Series Serial ATA RAID Controller User Guide Obtaining 3ware Linux Drivers Obtain the 3ware driver for Linux from one of these two sources 3ware software CD ROM Compiled and tested drivers for Red Hat and SuSE Linux are included on this CD m 3ware web site You can download the latest compiled and tested driver for RedHat or SuSE Linux from the 3ware web site at http www 3ware com Included in these downloads is the Linux driver source which you can use to compile the latest driver for RedHat SuSE and other versions of Linux Although the drivers are also available in external Linux distributions and from open source at www kernel org those drivers do not include the firmware image which updates the BIOS in the controller It is recommended that you use the drivers from the 3ware CD or web site because they have a bundled firmware image Be Sure to
45. e following sbin mkinitrd v f boot initrd lt kernel string gt img lt kernel string1 gt where lt kernel string1 gt is the lib modules directory from which to copy the 3w 9xxx driver Example sbin mkinitrd v f boot initrd 2 4 18 14 img 2 4 18 14 If you are using the GRUB boot loader skip to Step 5 If you are using the LILO boot loader run LILO to update the boot record on disk by typing the following sbin lilo The output should be similar to Added linux Reboot The 3ware driver will be loaded from the ram disk automatically at boot time To install the 3ware driver and load the driver manually instead of using a RAM disk 1 2 74 Log in as root and open a console window Mount the CD which contains the 3ware driver To mount the CD type mount dev cdrom and press Enter 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under Red Hat Linux 3 Copy the driver For Redhat workstation on Intel x86 type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_intel 3w 9xxx lib modules lt put kernel string here gt kernel drivers scsi 3w 9xXxXx O If prompted to overwrite type y For Redhat workstation on AMD Athlon 32 bit type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_athlon 3w 9xxx lib modules lt put kernel string here gt kernel drivers scsi 3w 9xXxXx O If prompted to overwrite type y For Redhat works
46. e jumpers on your hard drives to enable staggered spinup Later you will need to enable staggered spinup and specify the staggered method ATA 6 or SATA OOB in the 3ware BIOS Manager 3BM For more information see the 3ware 9000 Series Serial ATA RAID Controller User Guide Turn to Check your Installation and Close the Case on page 22 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing a Serial ATA RAID Controller with Multi lane Internal Connectors Installing a Serial ATA RAID Controller with Multi lane Internal Connectors 12C LED indicators for The overall LED drive status connector individual drives on indicator is on the last two J7 J8 and J9 pins of J7 Ports 8 to 11 Ports 4to7 Ports 0 to 3 Serial BBU Battery LED connector details number Backup Unit J7 is for drives 0 1 2 3 top to bottom The last two on plate connector J8 is for drives 4 5 6 7 top to bottom pins on J8 and SODIMM memory J9 is for drives 8 9 10 11 top to bottom J9 are unused module For more details see page 16 Figure 5 12 Port 3ware 9500S 12Ml Serial ATA RAID Controller Models 9500S 12MI and 9500S 8MI have multi lane internal connectors each of which can handle up to four drives These controllers can be installed in an enclosure with a backplane The type of cable you need will depend on the type of enclosure you have m For use with a backplane that has the InfiniBand 4x connectors
47. e utility This utility is not required for legacy JBOD units Do not remove the 8000 board from your system until you have converted the units The units must be attached to the 8000 controller when you run the utility with older 3ware controllers non 3ware controllers or directly on the motherboard without first deleting the existing configuration to unlock the drive in read only mode i Warning Drives configured on the 9000 cannot be used www 3ware com 23 Installing the Hardware To move units under Linux or FreeBSD 1 Upgrade your driver to the 9000 series driver For details refer to the Linux or FreeBSD Driver Installation section Run the conversion utility to convert the units Power down the system disconnect the drives from the 8000 controller and remove the controller from the system Install the 9000 controller and attach the drives to the 9000 board as described earlier in this section To move units under Windows 1 Install the 9000 controller in your system while leaving the 8000 controller installed Install the Windows driver For details see Driver Installation Under Windows on page 53 Run the conversion utility to convert the units Power down the system disconnect the drives from the 7 8000 controller and remove that controller from the system Attach the drives to the 9000 board Moving Legacy J BOD Units to a 9000 Controller To move legacy JBOD units under Linu
48. ect the drives and create a disk unit 1 Select the drives to be included by highlighting each one and pressing Enter to select it When you select a drive an asterisk appears next to it in the left most column see Figure 10 40 3ware 9000 Series Serial ATA RAID Controller Installation Guide Specifying the Unit Configuration You may include from one to twelve drives in the unit depending on the number available For information about how many drives to select for a given RAID level see Table 2 on page 31 Note To include drives that are part of an existing unit you must first delete the other unit Be cautious in doing this as any existing data on that unit will be overwritten Available Drives Port 0 IC35L1Z0AYYA07 0 115 03 GB Port 1 IC35L1Z20AYYA07 0 115 03 GB Port 2 IC35L1Z0AYUA07 0 115 03 GB Port 3 IC35L1Z0AYYA07 0 115 03 GB Alt F1 He Alt a Enter F6 Esc Fe Figure 10 Asterisks Next to Selected Drives 2 After all drives for the unit are selected use the Tab or Right Arrow key to move to the Create Unit button and press Enter The Create Disk Array screen appears see Figure 11 and Figure 12 for examples 3 Make sure that the proper drives are listed www 3ware com 41 Configuring Units Note Creating an array will overwrite ex ing data Create a disk array from these drives Port IC35L1Z0AVYA07 0 Port 1 IC35L1Z20AVYA07 0 Port 2 IC35L1Z0AVVAO0 7 O Port 3 IC35
49. ent Version of your 3ware Driver 68 Driver Installation Under Red Hat Linux 200 68 Materials Required 1 0 cece eee 68 Creating a Red Hat Linux Driver Diskette 69 Installing the 3ware Driver and Red Hat Linux on a New Unit 69 Installing the 3ware Driver on a Red Hat Linux System that Boots From a Different Device 70 Compiling a 3ware Driver for Red Hat Linux 77 Driver Installation Under SuSE Linux 20000 0 eee 80 Creating a SuSE Linux Driver Diskette 80 Installing the 3ware Driver and SuSE Linux with YaST2 on a New Unit 2 005 81 Installing the 3ware Driver on a SuSE Linux System that Boots from a Different Device 81 Compiling a 3ware Driver for SUSE Linux 83 ii 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under FreeBSD 0005 87 Obtaining 3ware FreeBSD Drivers 000 0c eee eee eee 88 Materials Required 0 0002 eee eee eee 88 Installing the Driver While Installing FreeBSD on the 3ware RAID Controller 2 00 88 Installing the 3ware Driver on a FreeBSD System that Boots from a Different Device 0 00000 ee 92 Compiling the Driver as a Loadable Module 94 Troubleshooting Problems and Solutions 97 Hardware installation
50. erial ports are double LED indicators indicator the last two pins connector stacked connectors for individual of J9 The anode is the Odd numbered ports 1 drives on J7 lower of the two pins and through 7 are located and J8 the cathode is the upper below even numbered ports 0 through 6 Ports 6 and 7 4and5 2 and 3 0 and 1 Serial number on plate b SODIMM memory LED connector details module J7 is for drives 0 1 2 3 left to right The last two pins on J8 is for drives 4 5 6 7 left to right J7 and J8 are unused Figure 3 8 Port 3ware 9500S 8 Serial ATA RAID Coniroller Pchip v1 4 Non BBU Compatible www 3ware com 15 Installing the Hardware Overall LED drive status 12c Serial ports are LED indicators for indicator the last two pins connector double stacked individual drives of J3 The anode is the connectors Odd on J3 0 1 2 3 lower of the two pins and numbered ports 1 left to right the cathode is the upper and 3 are located below even numbered ports 0 and 2 Ports 2 and 3 0 and 1 Serial number on plate SODIMM memory BBU Battery Backup module Unit connector Figure 4 4 Port 3ware 9500S 4 Serial ATA RAID Controller To connect serial cables to the controller 1 Take out the serial cables provided with the 3ware SATA RAID controller 3ware serial controllers are supplied with serial interface cables one for each port on the controller One edge of each i
51. ersion you have you can use the 3ware CLI to determine the Pchip version tw_cli c0 show pchip 12 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing a Serial ATA RAID Controller LED indicators Overall LED drive status 12c Serial ports are double for individual indicator the last two pins connector stacked connectors drives on J7 of J7 The anode is the Odd numbered ports 1 and J8 lower of the two pins and through 7 are located the cathode is the upper below even numbered ports 0 through 6 Ports 6 and 7 4and5 2 and 3 0 and 1 SODIMM BBU Battery LED connector details memory Backup Unit J7 is for drives 0 1 2 3 left to right The last two pins on module connector J8 is for drives 4 5 6 7 left to right J7 and J8 are unused Figure 2 8 Port 3ware 9500S 8 Serial ATA RAID Coniroller Pchip v1 5 BBU compatible Additional Details About the LED Status Connectors As shown in Figures 1 through 5 LED connectors for individual drives are on J7 J8 and J9 for the full size cards and on J3 for the half size 4 port card Pin 1 is located in the lower left hand corner of each 10 pin connector The odd numbered pins located on the bottom row are 3 3V for the anode side of each LED to be connected The even numbered pins are the return or cathode side Table 1 summarizes the LED indicator pin positions for the different controllers www 3ware com 13 Installing the Hardware Wa
52. es 92 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing the 3ware Driver on a FreeBSD System that Boots from a Differ Note Since twa ko behaves like a SCSI driver the units that it controls are seen as da0 dal etc To make the driver part of the kernel Create the directory sys dev twa mkdir sys dev twa Copy the 3ware driver source file archive twa tgz to the directory you created in step 1 Unpack the 3ware driver source files cd sys dev twa tar xzvf twa tgz Change the kernel build infrastructure to include the 3ware driver sources 1 2 3 4 a b c d f 8 Change to the following directory cd usr src sys i386 conf Copy the configuration file to a custom file For example if the configuration file is GENERIC type cp GENERIC custom Edit the custom file and add the lines shown below under RAID controllers device twa 3ware Escalade 9000 series Save the file Change to the following directory cd sys conf Edit the file files 1i386 and add the lines shown below dev twa tw_cl_fwimg c optional twa dev twa w_cl_init c optional twa dev twa tw_cl_intr c optional twa dev twa tw_cl_io c optional twa dev twa tw_cl_misc c optional twa dev twa tw_osl_cam c optional twa dev twa tw_osl_freebsd c optional twa Save the file www 3ware com 93 Driver Installation Under FreeBSD Add the following line to Makefile i386 CFLAGS I
53. hile working in 38 A Accelerated Graphics Port AGP 8 auto carving 33 47 B backplane using with multi lane connectors 19 BBU battery backup unit installation 99 replacing the battery 99 BIOS Manager 34 C cable length routing space air flow 8 Compliance and Conformity 109 configuring BIOS Manager 34 determining RAID level to use 31 initializing units 49 RAID concepts and levels 28 units 40 using 3BM 38 D distributed parity 29 www 3ware com drive capacity 32 drive coercion 33 drive installation considerations 9 drive types 3 driver compiling as a loadable module for FreeBSD 94 compiling for Red Hat 77 compiling for SuSE Linux 83 installing under FreeBSD 87 installing under Linux 65 installing under Windows 53 driver diskette creating Red Hat 69 creating SuSE Linux 80 creating Windows 54 drivers obtaining for FreeBSD 88 obtaining for Linux 66 F FreeBSD installing driver under 87 H hardware troubleshooting 97 hot spare 29 hot spare specifying 46 hot swap 29 l initializing units 49 installing cables 8 drive considerations 9 driver under FreeBSD 87 117 Index driver under Linux 65 driver under Red Hat Linux 68 driver under SuSE Linux 80 driver Windows 53 formatting 63 hardware 7 LED status connectors 9 making units available 63 overview 5 partitioning 63 RAID controller 7 safety 10 serial ATA RAID controller 12 serial ATA RAID controller with mu
54. hitecture of the PCI bus These slots typically give the best performance m Slots closest to the Accelerated Graphics Port AGP if included m 64 bit PCI slots Although the controller fits in both 32 bit and 64 bit PCI or PCI X slots with 5V as well as with 3 3V install it in a 64 bit slot to take full advantage of the controller s performance 8 3ware 9000 Series Serial ATA RAID Controller Installation Guide Before You Begin Whether to Use the LED Status Connector 3ware RAID controllers include two types of LED status connectors m Overall indicator which lights when any drive is active m Individual LED indicators for each drive Not supported on chassis that have a common ground If you are building a system from scratch you may want to consider using a chassis or drive carrier that is compatible with the 3ware RAID controller activity LEDs such as the AMCC RDC 400 drive carrier available through AMCC Please check the 3ware web site www 3ware com for chassis and drive carrier compatibility list For more information see Additional Details About the LED Status Connectors on page 13 Most chassis have a single drive activity cable that you can connect to the overall activity indicator on the 3ware 9000 controller For the location of the overall drive activity connector see the figure for the appropriate controller in the installation sections starting on page 12 and refer to Table 1 LED Indi
55. ing steps to complete the hardware installation Check your Installation and Close the Case 1 Verify that the cables do not interfere with the operation of any other components in the case or block the flow of cooling air 2 Close the case and reconnect the power cables Configure your RAID Arrays Turn to Configuring Units on page 27 for information about configuring the RAID arrays 22 3ware 9000 Series Serial ATA RAID Controller Installation Guide Moving Units from an 8000 Controller to a 9000 Controller Moving Units from an 8000 Controller to a 9000 Controller It is possible to move your 8000 storage units to a 9000 series controller You will then have the advantages of the 9000 series controller The drive units must be in normal mode before moving the units Incomplete degraded rebuilding or initializing units cannot be converted In addition RAID 0 10 and 5 units must use a standard 64 KB stripe size The procedure to move from the 8000 to the 9000 series depends on the type of storage unit that you have For most units follow the steps below For units using JBOD see Moving Units from an 8000 Controller to a 9000 Controller on page 23 Note In order to preserve the data that is on the units attached to the 8000 you will need to run a special utility available from 3ware Technical Support to convert the units to a format that the 9000 controller can use Contact Technical Support to obtain th
56. its edges or by the black rail and metal bracket at its two ends m Do not touch any pin contact lead or component on the 3ware RAID controller The cooler the battery the longer the battery lasts If possible place the controller with the BBU in a slot with good airflow away from components that generate the most heat in the system such as video cards i Important The battery is a heat sensitive component www 3ware com 99 Appendix A Installing the Battery Backup Unit Tools and equipment required Phillips head screwdriver Grounding strap Battery Backup Unit BBU and battery 3ware 9000 series controller Installation Overview The Battery Backup Unit BBU attaches to the controller at three points as illustrated in Figures 1 through 3 a Slots on the edge of the controller visible after removing the PCI bracket match to clips on the BBU b Receptacle on the controller matches to connector on the BBU c Post hole on the controller mates to post on the BBU a Clips b BBU connector c post Figure 1 Points of connection on the BBU bottom view 100 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installation Overview a Slots on the edge b BBU receptacle c Hole for post Figure 3 Points of connection on the half height controller top view BBU receptacle contact technical support for Note If your 9000 series controller does not have the assistance www 3ware com
57. ive Capacity RAID Level Capacity RAID 0 number of drives X capacity of the smallest drive RAID 1 capacity of the smallest drive 32 3ware 9000 Series Serial ATA RAID Controller Installation Guide Determining What RAID Level to Use Table 3 Drive Capacity RAID Level Capacity RAID 5 number of drives 1 X capacity of the smallest drive Storage efficiency increases with the number of disks storage efficiency number of drives 1 number of drives RAID 10 number of drives 2 X capacity of smallest drive RAID 50 number of drives number of subunits X capacity of the smallest drive Through drive coercion the capacity used for each drive is rounded down so that drives from differing manufacturers are more likely to be able to be used as spares for each other The capacity used for each drive is rounded down to the nearest GB for drives under 45 GB 45 000 000 000 and rounded down to the nearest 5 GBytes for drives over 45 GB For example a 44 3 GB drive will be rounded down to 44 GBytes and a 123 GB drives will be rounded down to 120 GBytes Support for Over 2 Terabytes Windows 2000 Windows XP Linux 2 4 and FreeBSD 4 x do not currently recognize unit capacity in excess of 2 TB If the combined capacity of the drives to be connected to a unit exceeds 2 Terabytes TB you can enable auto carving when you configure your units Auto carving divides the available unit capa
58. k the motherboard boot sequence Refer to your system BIOS guide for more details m Configure RAID units The basic steps are listed here For details see Configuring Units on page 27 a e f Start 3BM the 3ware BIOS Manager Select the drives to be included and indicate that you want to create a disk array Select the desired RAID configuration Set other parameters depending on the type of RAID con figuration Confirm the array configuration Save your changes and exit Specify a hot spare optional Install the 3ware driver and make the units available to the operating system For details see one of the following Driver Installation Under Windows on page 53 Driver Installation Under Linux on page 65 Driver Installation Under FreeBSD on page 87 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing the Hardware This section describes the physical installation of the 3ware 9000 RAID controllers It contains the following topics Before You Begin provides important information about things you should consider before starting installation and tools and equipment you will need m Safety Factors describes important precautions for your personal safety and to protect your equipment and data Be sure to read this section Installing a Serial ATA RAID Controller and Installing a Serial ATA RAID Controller with Multi lane Internal Co
59. keyboard types for your locality If asked for what type of media select Local CD ROM since you are installing from the Red Hat CD ROM Installing the 3ware Driver on a Red Hat Linux System that Boots From a Different Device The steps for installing the 3ware driver vary slightly depending on your specific installation requirements Select the appropriate set of steps below based on whether m You want to update the RAM disk m You prefer to load the driver manually or from a script instead 70 of updating the RAM disk 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under Red Hat Linux About Variables In the Driver Installation Instructions These conventions are used for variable text for kernel strings and module names in the instructions on the following pages Kernel String Conventions lt kernel string gt refers to the kernel version The kernel string will have different endings depending on the kernel you are using m Foran SMP kernel multi processor the kernel string will end in smp For example 2 4 18 14smp m For an Enterprise kernel the kernel string will end in enterprise For example 2 4 18 14enterprise m Fora Bigmem kernel the kernel string will end in bigmem For example 2 4 18 14bigmem m Fora Hugemem kernel the kernel string will end in hugemen For example 2 4 18 14hugmem Module Naming Conventions 3w 9xxx refers to the specific module you wi
60. ks contain 3ware Disk Control Block DCB information and are seen by the OS as available units Single drives are not fault tolerant and therefore not recommended for high availability systems unless additional precautions are take to prevent system hangs and data loss JBOD A JBOD is an unconfigured disk attached to your 3ware RAID controller JBOD configuration is no longer supported in the 3ware 9000 series AMCC recommends that you use Single 3ware 9000 Series Serial ATA RAID Controller Installation Guide Determining What RAID Level to Use Disk as a replacement for JBOD to take advantage of advanced features such as OCE and RLM JBOD units are not fault tolerant and therefore not recommended for high availability systems unless additional precautions are taken to prevent system hangs and data loss Hot Spare A single drive available online so that a redundant array can be automatically rebuilt in case of drive failure For additional information about RAID levels see the article RAID Primer on the 3ware website at http www 3ware com products pdf RAID_Primer pdf Other Important Concepts Write Cache Used to store data locally on the drive before it is written to the disk allowing the computer to continue with its next task Enabling write cache results in the most efficient access times for your computer system However there may be instances when you always want the computer to wait for the drive to
61. l twa dev twa tw_osl_cam c optional twa dev twa tw_osl_freebsd c optional twa Save the file Add the following line to Makefile i386 CFLAGS I sys dev twa If you intend to bundle the firmware image with the driver add the following line to sys conf options www 3ware com 91 Driver Installation Under FreeBSD TWA_FIRMWARE_FLASH opt_twa h and the following line to your kernel configuration file custom in the example above options TWA_FLASH_ FIRMWARE j If you intend to enable printing of debug messages in the driver add the following line to sys conf options TWA_DEBUG opt_twa h and the following line to your kernel configuration file custom in the example above options TWA_DI EBUG lt number from 0 to 10 gt Specifying 0 in the above line prints no debug messages whereas specifying 10 prints a LOT of debug messages 11 Rebuild the kernel and install the new kernel 12 Reboot with the rebuilt kernel Installing the 3ware Driver ona FreeBSD System that Boots froma Different Device To install the 3ware driver as a module 1 Copy the driver from the 3ware CD ROM at packages drivers fr bsd lt OS version gt For FreeBSD 4 x copy the driver into modules For FreeBSD 5 x copy the driver into boot kernel 2 Load the driver kldload twa ko If units are present you should see unit information in the system log usually var log messag
62. ll copy in the examples shown in steps 3 and 4 The name of the module you will copy 3w 9xxx varies depending on the kernel however you will always copy it to a file named 3w 9xxx o for 2 4 kernels or 3w 9xxx ko for 2 6 kernels The available module files are For UP kernels 3w 9xxx 0 For SMP kernels 3w 9xxx smp For Enterprise kernels 3w 9xxx ent For Bigmem kernels 3w 9xxx big For Hugemem kernels 3w 9xxx hug For IA32E kernels 3w 9xxx i32 www 3ware com 71 Driver Installation Under Linux To install the 3ware driver and update the RAM disk 1 Log in as root and open a console window 2 Mount the CD which contains the 3ware driver To mount the CD type mount dev cdrom and press Enter 3 Copy the driver For Redhat workstation on Intel x86 type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_intel 3w 9xxx lib modules lt put kernel string here gt kernel drivers scsi 3w 9XXxX 0O If prompted to overwrite type y For Redhat workstation on AMD Athlon 32 bit type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_athlon 3w 9xxx lt put kernel string here gt kernel drivers scsi 3w 9xXxXX O If prompted to overwrite type y For Redhat workstation on AMD Opteron and Intel EM64T type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_64 3w 9xxx lt put kernel string here gt kernel drivers scsi 3w 9xxx ko If prompted to overwrite type y 72 3ware 9000 Serie
63. loppy disk and the CD Go through OS installation Make sure you install the kernel sources during this step On reboot escape to the loader menu Note Immediately after the OS starts booting insert an MS DOS floppy with the 3ware driver twa ko into the floppy 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing the Driver While Installing FreeBSD on the 3ware RAID Controller drive If you do not insert it immediately the loader may fail to recognize the floppy drive At the loader prompt run Isdev to make sure the floppy drive has been discovered 8 Run load disk0 twa ko assuming diskO is the floppy drive Run boot The system should now be able to boot 10 After the system boots up change the kernel build infrastructure to include the 3ware driver sources a b Change to the following directory cd usr src sys i386 conf Copy the configuration file to a custom file For exam ple if the configuration file is GENERIC type cp GENERIC custom Edit the custom file and add the lines shown below under RAID controllers device twa 3ware Escalade 9000 series Save the file Change to the following directory cd sys conf Edit the file files 1386 and add the lines shown below dev twa tw_cl_fwimg c optional twa dev twa w_cl_init c optional twa dev twa tw_cl_intr c optional twa dev twa tw_cl_io c optional twa dev twa tw_cl_misc c optiona
64. lti lane internal connectors 19 slot location 8 tools and equipment 10 troubleshooting 97 J JBOD 48 K kernel strings for RedHat 71 L LED Status Connector details about connecting 13 whether to use 9 LED status connectors 9 Linux installing driver under 65 M mirrored array 28 module names for RedHat Linux 71 motherboard boot sequence 51 multilane cable with individual SATA connectors 20 multilane cable with multilane connectors on each end 847 20 P PCI slots 8 R RAID concepts and levels 28 RAID level to use determining 31 Red Hat Linux installing driver under 68 RedHat kernel strings 71 RedHat module names 71 S safety factors during installation 10 serial controller installing 12 slot location 8 stripe size setting 43 striping 28 SuSE Linux installing driver under 80 System Requirements 2 system requirements 2 T Technical Support 112 tools and equipment 10 tools required for installation 10 Troubleshooting 97 troubleshooting 97 U units configuring 27 40 initializing 49 WwW Warranty 112 Windows installing driver under 53 write cache enabling or disabling 43 118 3ware 9000 Series Serial ATA RAID Controller Installation Guide
65. modules www 3ware com 77 Driver Installation Under Linux 78 Note In the commands below remember that the text you enter is case sensitive Be sure to type Makefile rh not makefile rh To build UP module type make f Makefile rh The file created is 3w 9xxx o for 2 4 kernels and 3w 9xxx ko for 2 6 kernels To build SMP module type make smp f Makefile rh The file created is 3w 9xxx smp To build Enterprise module type mak nt f Makefile rh The file created is 3w 9xxx ent To build Bigmem module type make big f Makefile rh The file created is 3w 9xxx big To build Hugemem module type make hug f Makefile rh The file created is 3w 9xxx hug To build Boot module this is used when creating a driver for the 32 bit driver diskette type make bot f Makefile rh The file created is 3w 9xxx bot 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under Red Hat Linux To build IA32E module this is used when creating a driver for the x86_64 EM64T 64 bit driver diskette type make ia32 f Makefile rh The file created is 3w 9xxx i32 6 Copy the module as follows For 2 4 kernels copy module to lib modules lt kernel string gt kernel drivers scsi 3w 9XXX O 7 If you installed a previous driver when you installed your operating system then perform this step to copy the driver into the update directory as well lib mod
66. ncidental or consequential damages or allow limitation of implied warranties or their duration so that the above exclusions or limitations may not apply www 3ware com 113 Appendix C Warranty Technical Support and Service Obtaining Warranty Protection To obtain warranty service during the warranty period call AMCC toll free at 800 945 7273 or 408 523 1145 direct as soon as you have identified a problem with your AMCC 3ware Serial ATA RAID controller unit You will be issued a return material authorization RMA number AMCC will send a replacement in approximately two business days after receipt of the defective unit transit time not included Advanced replacement is available with a credit card number with authorization in the amount equaling the then current list price of the AMCC 3ware Serial ATA RAID Controller including shipping costs As soon as practicable thereafter AMCC will ship the advanced replacement to you at the address of your choosing Upon receipt of the advanced replacement we ask that you immediately ship the defective 3ware RAID Controller to AMCC RAID Products RMA DEPT 6290 Sequence Drive San Diego CA 92121 If AMCC receives the defective AMCC 3ware Serial ATA RAID Controller from you within thirty 30 days of the date of shipment of the advanced replacement AMCC will destroy your credit card authorization and you will not be charged for the advanced replacement Please use the original packing m
67. nd RAID 50 Parity information is written to each of the striped drives in rotation Should a failure occur the data on the failed drive can be reconstructed from the data on the other drives Hot Spare A single drive that is not used for user data but rather as an extra drive that is online and available to automatically take the place of any drive that fails in a redundant unit Used with RAID 1 5 10 and 50 m Hot Swap The process of exchanging a drive without having to shut down the system This is useful when you need to exchange a degraded drive It is also useful if you want to add disk drives to configure into a unit without shutting down the system first Configurations Available with the 3ware RAID Controller The following RAID levels and configurations are available for drives attached to a 3ware RAID controller m RAID 0 Provides striping but no mirroring or redundancy of any kind Striped disk arrays achieve high transfer rates because they can read and write data on more than one drive simultaneously The stripe size is configurable in 3ware BIOS Manager 3BM Requires a minimum of two drives When drives are configured in a striped disk array large files are distributed across the multiple disks using RAID 0 techniques Striped disk arrays give exceptional performance particularly for data intensive applications such as video editing computer aided design and geographical information systems RAID 0 arra
68. nnectors provide step by step instructions for installing a serial ATA RAID controller Finishing Up describes the final steps required when installing a serial controller Moving Units from an 8000 Controller to a 9000 Controller describes the process to follow when you change from one controller to another Note If you have a BBU Battery Backup Unit install it first For details see Appendix A Installing the Battery Backup Unit on page 99 www 3ware com 7 Installing the Hardware Before You Begin The next few pages describe some factors you may want to consider during installation and the tools and equipment you will need Installation Considerations Cable Length Routing Space and Air Flow When you are installing multiple drives with a controller make sure there is adequate space in the chassis for the required cables It is important that the cables do not obstruct the air flow or prevent proper ventilation of the system Selecting the Slot in Which to Install the Controller Consider these factors when deciding on the slot in which to insert the controller m Cable routing may be easier if you install the 3ware RAID controller next to an open slot The amount of clearance you need will depend on the number of drives you will be connecting to the controller m While the 3ware RAID Controller runs properly in any PCI or PCI X slot not all slots give equal performance due to the arc
69. nterface cable connector is keyed so that it can only be inserted in one direction This helps to ensure proper orientation and installation 2 Align the cable connector with the connector on the controller matching the slotted key and carefully mate the connectors 16 3ware 9000 Series Serial ATA RAID Controller Installation Guide To Installing a Serial ATA RAID Controller Note The connectors on the end of the serial controller and the drive are susceptible to damage from excessive bending Be careful not to insert or remove the serial cable connector at an angle Repeat steps 2 and 3 for each additional interface cable You will connect one cable for each hard drive you will attach install the controller in the computer If the computer is running shut it down Turn off power to the computer and disconnect the power cord from the outlet Make sure you are properly grounded For details about safety precautions see page 10 Open the computer case according to the manufacturer s instructions Find the PCI slot you want to use for the serial 3ware RAID controller For a discussion of which slot to use see Selecting the Slot in Which to Install the Controller on page 8 Remove the metal filler bracket for the slot Save this screw it will be used to secure the serial 3ware RAID controller after you have seated it in the slot Position the card in the slot so that the contacts will mate with the
70. om 59 Driver Installation Under Windows After the driver has been installed continue with the instructions under Making Units Managed by a 3ware Controller Available to Windows on page 63 To install the 3ware driver under Windows XP or 2003 When you start Windows after installing a 3ware RAID controller Windows recognizes it as a Plug and Play device and brings up the Found New Hardware Wizard This wizard guides you in installing the 3ware drivers see Figure 21 Note that you will see screens for the installation of two drivers during this process Found New Hardware Wizard Welcome to the Found New Hardware Wizard This wizard helps you install software for RAID Controller If your hardware came with an installation CD gt or floppy disk insert it now What do you want the wizard to do Install from a list or specific location Advanced Click Next to continue Figure 21 Found New Hardware Wizard Windows XP and 2003 1 Click the Next button and respond to the questions the Wizard displays 2 When the Wizard prompts you to select a device driver click Have Disk and then indicate that it is on the CD or floppy 3 If the Digital Signature Not Found message appears click Yes to continue the installation 60 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing the Driver on a System that Boots from a Different Device 4 When the Completing the Foun
71. ompatibility Lists http www 3ware com support sys_compatibility asp Hardware installation Q1 The rail on the 3ware RAID controller doesn t fit in the case www 3ware com 97 Troubleshooting Problems and Solutions Q2 Q3 Q4 Q5 98 Use a screwdriver to remove the black end rail It aligns and secures the 3ware RAID controller in the computer chassis but is not critical for operation The system doesn t begin booting no BIOS runs when the 3ware RAID controller is installed but boots OK when the controller is removed Check the cabling between the drives and the 3ware RAID controller A cable plugged in upside down can prevent your system from running its BIOS The 3ware BIOS screen never appears The 3ware RAID controller is not installed properly Reinstall the hardware and reboot There may also be a problem with the motherboard Please check the Motherboard Compatibility List on the 3ware website at http www 3ware com products compatibility asp to see if you motherboard has been tested by 3ware Some of the drives do not appear in the Disk Array Configuration Utility s main display Your drives are not connected properly to the 3ware RAID controller Check that both the power and ATA cables are connected properly and that the drives are all properly jumpered To operate properly the 3ware RAID controller requires that drives be set as Single if available on your drive or Master Preventing
72. oot sequence If you have other disks installed on the motherboard the 3ware RAID controller should precede them in boot order If you will install your OS on a disk or array attached to the 3ware RAID controller specify the controller as the boot device Note that if you configured more than one unit the drive s specified as Unit 0 will be treated as the boot disk www 3ware com 51 Configuring Units Installing Drivers and Making the Units Available For Use The final steps in setting up your RAID arrays are to load the 3ware drivers and make the units available to your operating system m Will the unit you have created be your system s boot device If so you will install the driver for the controller as you install the operating system m Is the OS already installed on a unit connected to another controller or to the motherboard If so you will start the OS and then install the driver Details for both situations are described in the next sections of this guide under Windows Installation see page 53 Linux Installation see page 65 and FreeBSD Installation see page 87 52 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under Windows Note Before installing the 3ware driver you must have already installed your 3ware RAID controller in the system The 3ware RAID controller can be used with Microsoft Windows 2000 SP3 or newer Windows XP SP1 or newer and Windows
73. ough Verify in 3BM 1 Reboot and restart 3BM 2 Select the array you want to verify Highlight it and press Enter 3 Tab to Maintain Array and press Enter 50 3ware 9000 Series Serial ATA RAID Controller Installation Guide Checking the Motherboard Boot Sequence 4 On the Maintain Disk Array screen Tab to Verify Array and change the selection to Yes 5 Tab to OK and press Enter Initialization of the unit begins Initialization of a RAID 1 unit results in data from one disk the disk on the lower channel number being copied to the other disk In RAID 10 units data from one half of the array is copied to the other half After the initial verification subsequent verifies to a RAID 1 or 10 unit check for data consistency by comparing the data from one drive or set of drives to the other drive or set of drives Checking the Motherboard Boot Sequence Using your computer s Setup utility ensure that it shows the appropriate boot device After installing the 3ware 9000 controller in your system go into the BIOS for your computer system to check and change the boot order This is necessary because most systems automatically change the boot order when they detect a newly installed controller and device Refer to the documentation for your system for information about starting the system BIOS m If the OS is already installed on a unit connected to the system be sure that device precedes the 3ware RAID controller in the b
74. p and save the data elsewhere before attaching the drives to the controller 10 3ware 9000 Series Serial ATA RAID Controller Installation Guide Safety Factors ESD Electrostatic Discharge Precautions To avoid damaging computer components and accessories when installing or removing the 3ware RAID controller follow standard electrostatic discharge ESD precautions When your computer case is open and its internal parts are exposed do not touch any internal part unnecessarily Always wear a grounded strap or work on an ESD protective mat Do not remove the 3ware RAID controller from its protective bag until you are properly grounded Handle the 3ware RAID controller by its edges or by the black rail and metal bracket at its two ends Do not touch any pin contact lead or component on the 3ware RAID controller Things to Watch Out For Be careful when installing the 3ware RAID controller into your system Excessive force can damage the board or your system Be sure the board is aligned with its slot on the motherboard before installing Do not flex the board excessively Interface cable connectors must be mated carefully with the connectors in the controller The connectors provided are keyed to prevent you from inserting them upside down Interface cables are fragile and must not be crimped or pinched Ensure that they do not impede the flow of cooling air from fans or heat sinks in the system case www 3ware com 11
75. rce into a working directory The latest 3ware driver source is bundled with the latest firmware and is in the src sub directory Install the Kernel source under usr src Create a symbolic link ln s usr src lt Kernel Src Dir gt usr src linux Change the directory to cd usr src linux Copy the config file for the kernel you want to build module for from the appropriate usr src linux arch directory listed below to usr src linux config kernel directory x86 UP usr src linux arch i386 defconfig default x86 SMP usr src linux arch i386 defconfig smp x86 Big SMP usr src linux arch i386 defconfig bigsmp x86_64 UP usr src linux arch x86_64 defconfig default x86_64 SMP usr src linux arch x8 6_64 defconfig smp Make oldconfig Untar the driver source with this command tar zxfv 3w 9xxx tgz The driver source will be output to a directory called driver www 3ware com 85 Driver Installation Under Linux 9 Change directory to driver cd driver 10 To build the module type make The 3w 9xxx ko module will be built and output to the driver directory created when you untared the 3w 9xxx tgz file This will take a while since the 2 6 build process exports our module to the kernel module list and then builds all kernel modules 11 Copy the module 3w 9xxx ko to lib modules lt kernel string gt kernel drivers scsi 3w 9xxx ko 12 Edit etc modprobe conf and
76. re BIOS Manager 3BM A message warns you that changing your disk array configuration may overwrite data on the disks Available Drives Port 9 IC35L1Z20AVYA07 0 115 03 GB When you configure your disk array s existing data on some When you hit the key you will be notified which drives will be overwritten and offered the option of abandoning the new settings before any data is lost If you are concerned about lofing data hit to stop configuring and first Press to continue Figure 8 Warning Message When you Start 3BM 4 Ifyou need to backup data before continuing press ESC and do so now Otherwise press any key to continue www 3ware com 35 Configuring Units Exiting 3BM When you are ready to exit the 3BM configuration utility you have the option to save the configuration changes you have made or to discard the changes To save your configuration modifications 1 Press the F8 or Esc key A list of affected drives appears and a message asks you to confirm the configuration 2 Type Y 3BM closes and the booting process resumes To exit without saving changes 1 Press Esc If you have made changes that you have not saved you are asked whether to save them or not 2 Select No to discard your changes those changes are saved when you leave the Policy screen Whether you press F8 or Esc to leave 3BM will not have an effect on those changes For more information see the 3ware 9000 Series
77. reen tab to 2TB Auto Carving and change the setting to Enabled www 3ware com 47 Configuring Units te Changing policy will cause all newly modified configuration lost Export JBOD disks Staggered spin up works only if the drives support it Staggered spin up Number of drive per spinup NAA Delay between spinup Disable write cache on degraded array Staggered method 2TB Auto Carving enabiea 3 Tab to OK and press Enter After you start your system you will see multiple volumes available in the operating system 2 TB each plus one volume with any remaining storage beyond the multiple of 2TB In this release 3BM does not show individual volumes Leaving Individual Drives as J BODs By default if you leave individual drives unconfigured JBODs they will not be available to the operating system If you want to be able to use individual drives configure them as single disk units If you have JBODs attached to an 8000 controller that you want to use with the 9000 controller see Moving Units from an 8000 Controller to a 9000 Controller on page 23 48 3ware 9000 Series Serial ATA RAID Controller Installation Guide Initializing Units Initializing Units Performance of RAID 5 units with 5 or more disks and RAID 50 units with 10 or 12 disks configured into two subunits will improve after the unit has been initialized For these configurations foreground initialization al
78. rning A common or shared LED ground on a chassis is not supported and can damage the 3ware controller Check with your chassis documentation before connecting Table 1 LED Indicator Pin Positions LED Coniroller Pin Pair Comment Header 9500S 4LP J3 Orientation Horizontal 0123 All Port number All all activity indicator k cathode minus is on the top a anode plus is on the bottom 9500S 8 J7 Orientation Horizontal Pchip v1 4 0 12 3 NU Port number NU Not Used J8 HA Orientation Horizontal 4 5 6 7 NU Port number NU Not Used J9 Orientation Horizontal NU NU NU NU A11 Not used All all activity indicator k cathode minus is on the top a anode plus is on the bottom 9500S 8 J7 Orientation Horizontal Pchip v1 5 0123 ATI Port number All all activity indicator J8 Orientation Horizontal 45 67 NU Port number NU Not Used k cathode minus is on the top a anode plus is on the bottom 14 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing a Serial ATA RAID Controller Table 1 LED Indicator Pin Positions Coniroller LED Pin Pair Comment Header 9500S 12 J7 eae ae io Orientation Horizontal 0123NU Port number NU Not Used J8 ee woe Orientation Horizontal 4567NU Port number NU Not Used J9 i ob a Orientation Horizontal 8 9 10 11 All Port number All all activity indicator k cathode minus is on the top a anode plus is on the bottom Overall LED drive status 12C S
79. s B digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference in a residential installation This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instructions may cause harmful interference to radio communications However there is no guarantee that interference will not occur in a particular installation If this equipment does cause harmful interference to radio or television reception which can be determined by turning the equipment off and on the user is encouraged to try to correct the interference by one or more of the following measures m Reorient or relocate the receiving antenna m Increase the separation between the equipment and receiver m Connect the equipment into an outlet on a circuit different from that to which the receiver is connected www 3ware com 109 Appendix B Compliance and Conformity Statements Consult the dealer or an experienced radio TV technician for help To maintain compliance with FCC radio frequency emission limits use shielded cables and connectors between all parts of the computer system 3ware Inc Model DiskSwitch 4D Tested to Comply C With FCC Standards FOR HOME OR OFFICE USE Microsoft Windows Hardware Quality Lab WHQL AMCC is committed to Microsoft Windows Hardware Quality Labs WHQL certification for all its products
80. s Serial ATA RAID Controller Installation Guide 4 Driver Installation Under Red Hat Linux If you installed a previous driver when you installed your operating system then perform this step to copy the driver into the update directory as well Otherwise go on to Step 5 For Redhat workstation on Intel x86 type cp mnt cdrom packages drivers linux redhat ws3_us x86_intel 3w 9xxx lib modules lt put kernel string here gt update 3w 9xxx o If prompted to overwrite type y For Redhat workstation on AMD Athlon 32 bit type cp mnt cdrom packages drivers linux redhat ws3_us x86_athlon 3w 9xxx lib modules lt put kernel string here gt update 3w 9xxx o If prompted to overwrite type y For Redhat workstation on AMD Opteron and EM64T type cp mnt cdrom packages drivers linux redhat ws3_us x86_64 3w 9xxx lib modules lt put kernel string here gt update 3w 9xxx ko If prompted to overwrite type y Note Use the appropriate module name and kernel string as described under About Variables In the Driver Installation Instructions on page 71 For 2 4 Kernels add the following line to etc modules conf alias scsi_hostadapter 3w 9xxx o For 2 6 Kernels add the following line to etc modprobe conf alias scsi_hostadapter 3w 9xxx ko www 3ware com 73 Driver Installation Under Linux Update the modules dep file by issuing the following command Run sbin depmod a Run mkinitrd by entering th
81. serial RAID controller Remove the metal filler bracket for the slot Save this screw it will be used to secure the 3ware RAID Controller after you have seated it in the slot Position the card in the slot so that the contacts will mate with the grooves in the slot and all pins make proper contact with the PCI slot pins when pushed into place The 3ware controller is keyed to ensure proper installation into a full sized PCI slot Make sure that the contacts will mate with the grooves in the slot Press down gently on the edge of the 3ware RAID controller directly above the slot until it is fully seated Check that the 3ware RAID controller s metal bracket covers the hole in the case and secure the bracket with the screw that was used to secure the filler bracket in step 4 install the drives If your drives are not already installed install them now either by attaching them to the backplane or by installing them in the computer chassis Be sure that the power supply is connected to either the backplane or the individual drives www 3ware com 21 Installing the Hardware 3 Power down the system disconnect the drives from the 7 8000 controller and remove the controller from the system 4 Attach the drives to the 9000 controller as described earlier in this section Finishing Up After you have installed the controller in the computer and attached appropriate cables to the controller and drives complete the follow
82. so known as zeroing starts immediately If you want to begin using the units right away you can halt the zeroing process and initialize them in the background later after the operating system is booted The initialization process can take several hours depending on the size of your drives The disadvantage of initializing the units later in the background is that the performance RAID 5 and RAID 50 arrays will be lower until initialization is complete Information about initialization for each of the different RAID types is described below RAID 0 Units RAID 0 units do not need to be initialized and are immediately available for use with full performance when created For RAID 5 and RAID 50 Units RAID 5 units with 3 or 4 disks do not need to be initialized and are fault tolerant upon creation Similarly RAID 50 units with 6 8 or 9 disks and RAID 50 with 12 disks configured into 3 subunits of 4 or 4 subunits of 3 do not need to be initialized This is because these configurations use an optimized writing technique which does not have to be valid to provide fault tolerance RAID 5 units with 5 or more disks and RAID 50 units with 10 or 12 disks configured into two subunits do need to be initialized for full performance For these configurations initialization begins automatically after you create them in the 3BM utility Zeroes are written to all unit members www 3ware com 49 Configuring Units If you want to use
83. stallation Under Windows Finishing Up Your RAID unit is now ready for use You may also want to install 3ware s browser based Disk Management tool 3DM 2 or the 3ware Command Line Interface CLD With 3DM 2 and CLI you can maintain your RAID units while running Windows For more information see the 3ware 9000 Series Serial ATA RAID Controller User Guide and the 3ware Escalade 9000 Series Serial ATA RAID Controller CLI Guide 64 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under Linux Note Before installing the 3ware driver you must have already installed your 3ware RAID controller in the system A drive or unit managed by the 3ware RAID controller may be configured to be your system s boot device Or you can use another device as your boot device such as a disk attached to the motherboard The steps you follow to install the driver and make your RAID unit available depend on which version of Linux you are using and whether it will be your boot device This chapter provides step by step instructions for the following situations m Red Hat Linux Installation m Installing the 3ware driver and Red Hat Linux on a new drive or unit page 68 m Installing the 3ware driver on a system that boots Red Hat Linux from a different device page 70 m SuSE Linux Installation m Installing the 3ware driver and SuSE Linux with YaST2 on a new drive or unit page 81 m Installing the 3war
84. starts booting insert an MS DOS floppy with the 3ware driver twa ko into the floppy drive If you do not insert it immediately the loader may fail to recognize the floppy drive At the loader prompt run Isdev to make sure the floppy drive has been discovered Load the driver from the floppy For example if the floppy drive is diskO type load disk0O twa ko Run boot The system should now be able to boot 10 After the system boots up do the following a Create a directory for the floppy mkdir floppy www 3ware com 89 Driver Installation Under FreeBSD b Mount the floppy mount t msdos dev fd0 floppy c Copy the driver file to the appropriate directory For FreeBSD 4 x copy the files to cp floppy twa ko modules twa ko For FreeBSD 5 x copy the files to cp floppy twa ko boot kernel twa ko d Add line twa_load YES to the file boot loader conf Eject the floppy disk and reboot The 3ware driver twa ko should be automatically loaded at reboot time To make the driver part of the kernel 1 2 90 Boot with the FreeBSD CD ROM or diskette In the sysinstall menu select Configure gt Load KLD module Note Immediately after the OS starts booting from the CD insert an MS DOS floppy with the 3ware driver twa ko into the floppy drive If you do not insert it immediately the sysinstall may fail to recognize the floppy drive Load the driver from the floppy drive Remove the f
85. sys dev twa If you intend to bundle the firmware image with the driver add the following line to sys conf options TWA_FIRMWARE_FLASH opt_twa h and the following line to your kernel configuration file custom in the example above options TWA_FLASH_FIRMWARE If you intend to enable printing of debug messages in the driver add the following line to sys conf options TWA_DEBUG opt_twa h and the following line to your kernel configuration file custom in the example above options TWA_DEBUG lt number from 0 to 10 gt Specifying 0 in the above line prints no debug messages whereas specifying 10 prints a LOT of debug messages 5 Rebuild the kernel and install the new kernel 6 Reboot with the rebuilt kernel Compiling the Driver as a Loadable Module If you wish to compile the driver yourself for a different kernel version that you are running then perform the following steps 1 94 Create the directories sys modules twa and sys dev twa mkdir sys modules twa mkdir sys dev twa Copy the 3ware driver source file archive twa tgz to sys dev twa 3ware 9000 Series Serial ATA RAID Controller Installation Guide Installing the 3ware Driver on a FreeBSD System that Boots from a Differ 10 11 Unpack the driver source files cd sys dev twa tar xzvf twa tgz Move the Makefile to sys modules twa mv Makefile sys modules twa Change the directory to sys modules twa
86. tation on AMD Opteron and EM64T type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_64 3w 9xxx lib modules lt put kernel string here gt kernel drivers scsi 3w 9xxx ko If prompted to overwrite type y Note Use the appropriate module name and kernel string as described under About Variables In the Driver Installation Instructions on page 71 4 Ifyou installed a previous driver when you installed your operating system then perform this step to copy the driver into the update directory as well Otherwise go on to Step 5 For Redhat workstation on Intel x86 type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_intel 3w 9xxx lib modules lt put kernel string here gt update 3w 9xxx o If prompted to overwrite type y www 3ware com 75 Driver Installation Under Linux For Redhat workstation on AMD Athlon 32 bit type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_athlon 3w 9xxx lib modules lt put kernel string here gt update 3w 9xxx o If prompted to overwrite type y For Redhat workstation on AMD Opteron and EM64T type cp mnt cdrom packages drivers linux redhat ws3_u3 x86_64 3w 9xxx lib modules lt put kernel string here gt update 3w 9xxx ko If prompted to overwrite type y Note Use the appropriate module name and kernel string as described under About Variables In the Driver Installation Instructions on page 71 5 Add the following line to
87. ter without reconfiguring the unit Use the arrow keys or press Tab to move to the field Array s Write Cache State Select whether you want the write cache to be enabled or disabled for this unit The default is for write cache to be enabled For more information about write cache see page 31 Press Tab to move to the field Stripe Size and select the desired stripe size 16KB 64KB or 256KB www 3ware com 43 Configuring Units Note Striping size is not applicable for RAID 1 because it is a mirrored array without striping In general use smaller stripe sizes for sequential access such as video access and larger stripe sizes for random access such as a database Note C ting an array will overwrite existing data on its drives Create a disk array from these drives Port IC35L1Z0AVYA07 0 115 03 GB Port 1 IC35L1ZOAVYAD O 115 03 GB Port 2 IC35L1Z0AVVAO O 115 03 GB RAID Array s Write conf iguration Cache State Continue on Stripe Size source error during rebuild Figure 14 Stripe Sizes for a RAID 5 For information about the field Continue on Source Error see the 3ware 9000 Series Serial ATA RAID Controller User Guide To confirm unit configuration 1 44 Press Tab to select the OK button and press Enter to confirm creation of the unit Or if you want to cancel the creation of the unit tab to Cancel and press Enter The unit is not actually created and no data is over
88. tery backup provides added data protection in the event of a power outage Battery Backup Unit sold separately Support for RAID units greater than 2 terabytes with 64 bit LBA support www 3ware com About the 3ware RAID Controller An enhanced firmware platform allows future upgrades Anticipated upgrades include Enclosure Management Services EMS AMCC s remote management software 3ware Disk Manager 2 3DM 2 simplifies storage configuration and management via a Web browser What s New With the 3ware 9000 Series Controllers Enhancements and changes from the 7000 8000 Series controllers to the 9000 series controllers include the following MultiLUN support with auto carving of units greater than 2 terabytes into 2 terabyte volumes RAID Level Migration RLM and Online Capacity Expansion OCE Unit naming and unit serial number support Improved write performance in writes with multiple concurrent streams using Stream Fusion technology Extended drive and unit status information System Requirements 3ware RAID controllers require the following A workstation class or server class motherboard which meets the following criteria m PCI slots comply with PCI 2 2 or above standards m PCI slot that meets the Plug and Play and PC99 specifications Note For all 3ware 9000 series models install the card in a 64 bit 66MHz PCI or PCI X slot for best performance 3ware 9000 Series Serial ATA RAI
89. ton 3 Inthe 3ware Driver amp Firmware Disk Images menu click the button for the driver disk you want to create A confirmation window opens 4 Insert a blank diskette into a drive and click the Yes button to begin creating the driver floppy diskette Installing the 3ware Driver and Red Hat Linux on a New Unit Note If Red Hat Linux is already installed and bootable on another drive turn to Installing the 3ware Driver on a Red Hat Linux System that Boots From a Different Device on page 70 drive connected to the motherboard interfered with using a drive or unit managed by the 3ware RAID controller as a boot device Disconnecting the IDE drive while installing Linux will eliminate this problem After Linux is installed the drive can be reconnected Note We have tested some older systems where an IDE www 3ware com 69 Driver Installation Under Linux 3 Boot with the Red Hat CD or diskette a Insert either the Red Hat CD ROM disk or a Red Hat boot diskette into your computer b Start or reboot your computer When the Welcome to Red Hat display appears type expert at the boot prompt boot expert A number of files will load and then a message will prompt you to insert your driver disk Install the driver Insert the driver diskette containing the 3ware driver for Red Hat and press Enter The system automatically reports Loading 3w 9xxx driver When prompted select the proper language and
90. ules lt kernel string gt update 3w 9xxx o www 3ware com 79 Driver Installation Under Linux Driver Installation Under SUSE Linux Materials required 3ware software CD ROM Floppy diskette if you need to make a driver diskette SuSE Linux Installation CD ROM DVD Not required if SuSE Linux is already installed on another drive Creating a SuSE Linux Driver Diskette If you are installing Linux on the new drive or unit managed by the 3ware RAID controller you must create a 3ware driver diskette If Linux is already installed on another device you may install the 3ware driver from the 3ware software CD ROM To create a driver diskette 1 2 80 Insert the 3ware software CD into your system When the 3ware Escalade Menu appears click Driver and Firmware Disks In the 3ware Driver and Firmware Disk Images menu click the button for the driver disk you want to create A confirmation window opens Insert a blank diskette into a drive and click the Yes button to begin copying the driver to the floppy diskette 3ware 9000 Series Serial ATA RAID Controller Installation Guide Driver Installation Under SuSE Linux Installing the 3ware Driver and SuSE Linux with YaST2 on a New Unit turn to Installing the 3ware Driver on a SuSE Linux Note If SuSE Linux is already installed on another drive System that Boots from a Different Device on page 81 3 4 Boot directly from the SuSE installation CD 1
91. write all the data to disk before going on to its next task In this case you must disable the write cache Determining What RAID Level to Use The RAID configurations available to you are determined by the number of ports on your controller and the number of drives attached to those ports You can configure all drives in one array or you can configure multiple arrays if you have enough drives Table 2 Possible Configurations Based on Number of Drives Drives Possible Configurations 1 Single drive or hot spare www 3ware com 31 Configuring Units Table 2 Possible Configurations Based on Number of Drives Possible Configurations Drives 2 RAID 0 or RAID 1 3 RAID 0 RAID 1 with hot spare RAID 5 4 RAID 5 hot spare RAID 10 Combination of RAID 0 RAID 1 single disks 5 RAID 5 hot spare RAID 10 hot spare Combination of RAID 0 RAID 1 hot spare or single disks 6or more RAID 50 Depending on the number of drives a RAID 50 may contain from 2 to 4 subunits For example with 12 drives possible RAID 50 configurations include 2 subunits of 6 3 subunits of 4 or 4 subunits of 3 With 10 drives a RAID 50 will contain 2 subunits of 5 drives each Combination of RAID 0 1 5 10 hot spare or single disks Drive Capacity Considerations The capacity of each drive is limited to the capacity of the smallest drive in the array The total array capacity is defined as follows Table 3 Dr
92. written until you have finished making all your changes and press F8 3ware 9000 Series Serial ATA RAID Controller Installation Guide 2 Specifying the Unit Configuration If you have additional drives go ahead and configure an additional RAID unit or designate a hot spare Then continue on with the next section For details about hot spares see page 46 If you configured more than one unit and you plan to install the operating system on one of them make that unit be the first unit Unit 0 in the list of Exportable Units To move a unit up in the list highlight it and press the Page Up key When you are finished configuring units press F8 to save the changes and exit 3BM A warning message asks you to confirm that all existing data on the drives will be deleted Data on the following drives will be destroyed Create Unit Alt F1 Ho Enter F6 Figure 15 Confirmation Message when Saving and Exiting Type Y to continue delete any existing data on the drives and create the unit www 3ware com 45 Configuring Units Depending on the RAID configuration you are creating initialization of the unit may begin immediately For details see Initializing Units on page 49 Specifying a Hot Spare You can designate one of the Available Drives as a hot spare in 3BM If a hot spare is specified and a redundant unit degrades an event notification will be generated The hot spare will automatically replace the f
93. x or FreeBSD 1 2 24 Upgrade your driver to the 9000 series driver Power down the system disconnect the drives from the 8000 controller and remove the controller from the system Install the 9000 controller and attach the drives to the 9000 board as described earlier in this section 3ware 9000 Series Serial ATA RAID Controller Installation Guide 4 5 Moving Units from an 8000 Controller to a 9000 Controller Reboot the system and enter the 3ware 9000 series BIOS 3BM by pressing Alt 3 Enable the Export JBOD policy on the Policy screen The next section in this guide Configuring Units describes how to work in 3BM Additional information about 3BM is available in 3ware 9000 Series Serial ATA RAID Controller User Guide Press the F8 or Esc key to save and exit To move legacy JBOD units under Windows 1 Install the 9000 controller in your system while leaving the 8000 controller installed Install the Windows driver For details see Driver Installation Under Windows on page 53 Power down the system disconnect the drives from the 8000 controller and remove that controller from the system Attach the drives to the 9000 board Reboot the system and enter the 3ware 9000 series BIOS 3BM by pressing Alt 3 Enable the Export JBOD policy on the Policy screen The next section in this guide Configuring Units describes how to work in 3BM Additional information about 3BM is available in
94. ys Move between units or drives ina Up and Down Arrow Keys list and between fields and buttons OR Left and Right Arrow Keys OR Tab and Shift Tab Select or unselect what is currently Enter or the Spacebar highlighted A selection may be a drive in a list of drives a button at the bottom of the screen or a field in the middle of the screen In lists an asterisk appears to the left of selected drives or units Display a drop down list of available Enter choices in a field Move between choices in a field list Up and Down Arrow Keys Select all available drives Alt A Highlight one of the primary buttons on the main screen Create Alt C Delete Alt D Maintain Alt M Rebuild Alt R Policy Alt P BBU Alt B 38 3ware 9000 Series Serial ATA RAID Controller Installation Guide Working with the 3ware BIOS Manager 3BM Table 4 Working in 3BM To do this Use these keys Specify or unspecify a drive as a S hot spare Unlock the drives in a unit so that R Remove they can be removed and used with a controller other than a 9000 series controller Return to starting values for this F6 session in the 3ware BIOS Manager Note F6 cannot bring back previous policy settings they are saved when you exit the Policy screen Display the Advanced Detail screen where you can see the software versions BIOS Firmware monitor serial number controller and model number cache memory
95. ys are not fault tolerant the loss of any drive results in the loss of all the data in that array and can even www 3ware com 29 Configuring Units 30 cause a system hang depending on your operating system RAID 0 arrays are not recommended for high availability systems unless additional precautions are taken to prevent system hangs and data loss RAID 1 Also known as a mirrored array Mirroring is done on pairs of drives Mirrored disk arrays write data to two drives using RAID 1 algorithms This gives your system fault tolerance by preserving the data on one drive if the other drive fails Fault tolerance is a basic requirement for mission critical systems like web and database servers RAID 5 Combines striping data with parity exclusive OR to restore data in case of a drive failure This array type provides performance fault tolerance high capacity and storage efficiency Requires a minimum of three drives RAID 10 This array is a combination of RAID 1 with RAID 0 Striped and mirrored arrays for fault tolerance and high performance Requires a minimum of four drives to use both RAID 0 and RAID 1 techniques RAID 50 This array is a combination of RAID 5 with RAID 0 This array type provides fault tolerance and high performance Requires a minimum of six drives Single Disk A single drive that has been configured as a unit through 3ware software 3BM 3DM 2 or CLI Like disks in other RAID configurations single dis

Download Pdf Manuals

image

Related Search

Related Contents

VAIO User Guide  カラードームカメラ(IR 投光器付) KBI  ENGLISH - GearZone  User Manual  Studio 2 pers.  FLEX Polyclonal Rabbit Anti-Human Myeloperoxidase    Uniden PRO520XL Owner's Manual  Centrale Double flux DFS, DFS+ et DFST  

Copyright © All rights reserved.
Failed to retrieve file