Home

Dell 10g Deployment Guide

1. Configuring the Listener Creating the Seed Database Configuring and Deploying Oracle Database 10g Single Node 205 Installing Oracle Clusterware Version 10 2 0 1 Installing Oracle10g Database With Real Application Clusters 10 2 0 1 Installing Patchset 10 204 Configuring the Listener Creating the Seed Database Adding a New Node to an Existing Oracle 10g RAC Cluster o o e 254 See 8s eae ee ees Preparing the Node to be Added toa Cluster Adding Nodes at the Oracle Clusterware Layer Adding Nodes at the Oracle RAC Database Layer Adding Database Instances to New Nodes Troubleshooting 2 4 Working Around Clusterware Installation Failure Uninstalling Oracle Clusterware Additional Troubleshooting GettingHelp Dell SuppoTt scr si AA aa Del ged Oracle Support 44 45 41 48 52 52 54 55 57 58 61 61 62 63 64 Contents Contents This document provides information for installing configuring reinstalling and using your Oracle Database 10g R2 software following Dell s Supported Configurations for Oracle Use this document in conjunction with the Dell Deployment CD to install your software If you install your operating system using only the operating system CDs the steps in this document may not be ap
2. c Select the Adapter and Bindings tab d Ensure that the network adapters are listed in the following order Public Private lt Any other network adapter gt K NOTE Click the up and down arrow keys to change the adapter order e Click OK f Close the Network Connections window Deployment Guide 23 24 On all nodes add the public private and virtual IP addresses and host name to the SystemRoot system32 drivers etc hosts file K NOTE Add the public and virtual IP addresses to the hosts file only if they are not registered with the DNS server For example the following entries use the adapter IP and host name as shown in Table 1 7 IP AddressNode Name 155 16 170 1racl 155 16 170 2rac2 10 10 10 1lracl priv 10 10 10 2rac2 priv 155 16 170 201lracl vip 155 16 170 202rac2 vip K NOTE Registering the private IP addresses with the DNS server is not required because the private network IP addresses are not accessible from the public network Repeat step 1 through step 4 on the remaining nodes Ensure that the cluster nodes can communicate with the public and private networks a On node 1 open a command prompt window b At the command prompt enter ping lt public_host_name gt ping lt private_host_name gt where lt public_host_name gt and lt private_host_name gt are the host names for the public and private network adapters in the remaining node If the node s network adapters do not r
3. e Click the Teaming tab f Select Team with other Adapters and then select New Team Specify a name for NIC team and click Next lt 2 In the Select the adapters to include in this team box select the remaining network adapters that you identified for NIC teaming and click Next i In the Select a team mode list box select Adaptive Load Balancing j Click Finish to complete the teaming k Inthe Team Properties window click OK In the Intel NIC s Properties window click OK m Close the Computer Management window If node 1 is configured with Broadcom NICs configure NIC teaming by performing the following steps If not go to step 5 NOTE Before you run the Broadcom Advanced Control Suite BACS to team the adapters make sure your system has the Microsoft NET Framework version 2 0 installed a Click Start gt Programs Broadcom Broadcom Advanced Control Suite 3 The Broadcom Advanced Control Suite 3 window appears b Highlight Team Management and click Teams and select Create a Team The Broadcom Teaming Wizard window appears c Click Next d Inthe Enter the name for the team field enter Private and click Next e Inthe Team Type field select Smart Load Balancing TM and Failover SLB and click Next f Inthe Assigning Team Members window in the Available Adapters box select the network adapters you identified for NIC teaming and add them to the Team Members box K NOTE In case of PowerEdge 68
4. 1 54 Stop nodeapps on all nodes Enter the following Deployment Guide sSystemDrive CRS HOME bin gt srvctl stop nodeapps n lt node_name gt where SystemDrive is the user s local drive 2 Stop all the Oracle services on all the nodes Click Start gt Programs A dministrator Tools Services Locate all Oracle services and stop them on both nodes Installing the Patchset K NOTE You must install the patchset software from the node where the Oracle RAC 10g R2 software was installed If this is not the node where you are running the OUI exit and install the patchset from that node 1 Start the OUI located in the patchset folder 2 Inthe Welcome window click Next In the Specify home details window select the name as OraCr10g_home install the patchset to the Clusterware home and click Next 4 In the Specify Hardware Cluster Installation Mode Window click Next In the Summary window click Install At the End of installation window perform all the steps listed in the Summary window except step 1 7 Atthe End of installation screen click Exit and then click Yes to exit from the OUI Installing Patchset 10 2 0 4 for Oracle 10g Database K NOTE Complete the following steps before creating a listener and a seed database Ensure that all the Oracle services are running 4 NOTE You must install the patchset software from the node where the Oracle RAC 10g R2 software was installed If this is n
5. The Welcome to the New Partition Wizard appears c Click Next d Inthe Select Partition Type window select Logical drive and click Next e Inthe Specify Partition Size window in the Partition size in MB field enter the appropriate size and click Next f In the Assign Drive Letter or Path window select Do not assign a drive letter or drive path and click Next g Inthe Format Partition window select Do not format this partition and click Next h Click Finish 2 On node 1 create one logical drive for the Flash Recovery Area a Locate the disk that is assigned for the Flash Recovery Area b Perform step b through step h in step 1 3 Restart all other nodes and login as the administrator Deployment Guide 29 Preparing the Database Disk and Flash Recovery Area for Database Storage With ASM This section provides information about creating logical drives that will be used to create ASM disk storage ASM disk storage consists of one or more disk groups that can span multiple disks K NOTE If you are creating the logical drives that are used to create the OCFS storage disk ignore the following steps and follow the procedures in Preparing the Database Disk and Flash Recovery Area for Database Storage With OCFS on page 29 1 Create one logical drive for the Database a b h Locate the disk that is assigned for the Oracle database On the disk partition area right click the free space and select New Logical Driv
6. Verify that the paths to the Temp and Tmp directories have been set correctly Repeat the following steps for all nodes in the cluster 1 Click Start gt Run 2 Inthe Open field enter cmd and click OK 3 At the command prompt enter echo Temp The following path appears 14 Deployment Guide SystemDrive Temp where 3SystemDrive is the user s local drive 4 Repeat all steps in this section for all nodes in the cluster Verifying Cluster Hardware and Software Configurations Before you begin the cluster setup ensure that you have the minimum hardware installed as shown in Table 1 2 This section provides setup information for hardware and software cluster configurations Each node must have the following software installed e Windows Server 2003 SP2 Standard Enterprise x64 Edition see Table 1 1 e HBA drivers The storage must be configured with a minimum of four virtual disks LUNs two for the redundant Voting Disk and Oracle Cluster Registry and two for the database and Flash Recovery area assigned to cluster nodes Table 1 4 Virtual Disk LUN Configuration and Sizes Virtual Minimum Size Number of Partitions Used for Disk LUN 1 2 GB 5 3 x 50 MB and Voting disk 3 x 50 MB 2x20 MB Oracle Registry 2 x 120 MB 2 Larger than the database 1 Database 3 At least twice the size of 1 Flash Recovery Area the database Setting Up Your Fibre Channel Cluster After a Dell Managed Services represent
7. 1 3 4 On node 1 launch the Services console a Click Start gt Run b In the Run field enter the following and click OK services msc The Services window appears Identify and delete any remaining Oracle services To delete a service a Click Start gt Run b Inthe Run field enter cmd and click OK c Open a command prompt enter the following sc delete lt oracle_service_name gt d Repeat step c for each additional service that you need to remove Restart node 1 and log in as the administrator Restart each of the other nodes and log in as the administrator Cleaning the Storage Devices 66 1 Clean the partitions that will be configured for the OCR registry OCRCFG OCRMIRROCFG and the voting disks Votedsk1 Votedsk2 and Votedsk3 a Click Start Run b Inthe Run field enter cmd and click OK c At the command prompt enter the following SystemDrive oracle product 10 2 0 crs bin Ex portSYMLinks Deployment Guide where 3SystemDrive is the user s local drive The Oracle Symbolic Link Exporter ExportS YMLinks imports the symbolic links to the SYMMAP TBL file to your current directory d At the command prompt enter the following notepad SYMMAP TBL 2 Ensure that OCRCFG OCRMIRRORCKG Votedsk1 Votedsk2 and Votedsk3 appear in the file If OCRCFG OCRMIRRORCKG Votedsk1 Votedsk2 and Votedsk3 do not appear in the file assign OCRCFG OCRMIRRORCKG Votedsk1 Votedsk2 and Votedsk
8. Intel Xeon processor family 1 GB of RAM Two 73 GB hard drives connected to an internal RAID controller NOTE Dell recommends two 73 GB hard drives RAID 1 connected to an internal RAID controller based on your system See your PowerEdge system documentation for more details Three Gigabit Network Interface Cards NICs Two Host Bus Adapters HBAs 1 QLE2462 or QLE2562 dual port HBA for use with PowerEdge 1950 or 1950 HI 1 QME2472 QME2572 LPe1105 M4 or LPe1205 M dual port HBA for use with PowerEdge M600 Dell PowerEdge system up to eight nodes using Automatic Storage Management ASM or Oracle Cluster File System OCFS AMD Opteron processor family 1 GB of RAM Two 73 GB hard drives connected to an internal RAID controller NOTE Dell recommends two 73 GB hard drives RAID 1 connected to an internal RAID controller based on your system See your PowerEdge system documentation for more details Three Gigabit Network Interface Cards NICs Two host bus adapters HBAs for use with PowerEdge 6950 or 2970 1 QME2472 QME2572 LPe1105 M4 or LPe1205 M dual port HBA for use with PowerEdge M605 M805 M905 Deployment Guide 9 Table 1 2 Minimum Hardware Requirements Fibre Channel Cluster Configurations Hardware Component Configuration Gigabit Ethernet switch two required See dell com 10g for information on supported configurations For Fibre Channel See the
9. perform the following steps a Select Specify Flash Recovery Area b Click Browse c Select the FLASH disk group that you created in step 17 and click OK d Inthe Flash Recovery Area Size text box enter the total size of the flash disk group created in step 17 e Select Enable Archiving f Click Edit Archive Mode Parameters Deployment Guide 59 20 21 22 23 24 25 26 27 g Inthe Edit Archive Mode Parameters window ensure that the path listed under the Archive Log Destinations is as follows FLASH where FLASH is the Flash Recovery Area disk group name that you specified in step a of step 17 h Click Next In the Database Content window click Next In the Database Services window click Next In the Initialization Parameters window click Next In the Database Storage window click Next In the Creation Options window click Finish In the Summary window click OK The Database Configuration Assistant window appears and the Oracle software creates the database K NOTE This procedure may take several minutes to complete When completed the Database Configuration Assistant window provides database configuration information Record the information in the Database Configuration Assistant window for future database administration Click Exit The Start Cluster Database window appears and the cluster database starts Adding a New Node to an Existing Oracle 10g RAC Cluster The following describes h
10. 4 from the Oracle Metalink website located at metalink oracle com Unzip the patchset to the following location SystemDrive where SystemDrive is the user s local drive Installing Patchset 10 2 0 4 for Oracle 10g Clusterware Before You Begin 1 Stop nodeapps on all nodes Enter the following SystemDrives SCRS HOME bin gt srvctl stop nodeapps n lt node_name gt where 3SystemDrive is the user s local drive Stop all the oracle services on all the nodes Click Start gt Programs lt A dministrator Tools Services Locate all Oracle services and stop them on both nodes Installing the Patchset K NOTE You must install the patchset software from the node where the Oracle RAC 10g R2 software was installed If this is not the node where you are running the OUI exit and install the patchset from that node Start the OUI located in the patchset folder In the Welcome window click Next In the Specify home details window select the name as OraCr10g_home and install the patchset to the Clusterware home and click Next In the Specify Hardware Cluster Installation Mode Window click Next Deployment Guide 45 In the Summary window click Install At the End of installation window perform all the steps listed in the Summary window except step 1 At the End of installation screen click Exit and then click Yes to exit from the OUI Installing Patchset 10 2 0 4 for Oracle 10g Database
11. Configuration window select Place Voting Disk on this partition and click OK Deployment Guide 12 13 14 15 16 Click Next Ignore the warning messages and click OK In the Summary window click Install to start the installation procedure K NOTE If a failure occurs in the Configuration Assistant window perform the following steps and see Troubleshooting on page 64 and Working Around Clusterware Installation Failure on page 64 The Install window appears displaying an installation progression bar The Configuration Assistant window appears and the OUI runs a series of configuration tools The End of Installation window appears Click Exit to finish the OUI session In the Exit window click Yes Installing Oracle10g Database With Real Application Clusters 10 2 0 1 1 Insert the Oracle Database 10g Release 2 CD into the CD drive The OUI starts and the Welcome screen appears If the Welcome screen does not appear a Click Start Run b Inthe Run field enter CD driveS autorun autorun exe where CD drive is the drive letter of your CD drive Click OK to continue The OUI starts and the Welcome window appears Click Next In the Select Installation Type window click Enterprise Edition and click Next In the Specify Home Details window under Destination verify the following e Inthe Name field the Oracle database home name is OraDb10g_homel Deployment Guide 53 10 11 12 e In the
12. Dell EMC SAN Attached Fibre Channel Cluster Cluster node 1 Cluster node 2 HBA ports 2 HBA ports 2 01 sw1 SP B SP A Storage processor B Storage processor A CX3 20 storage system Use the following procedure to configure your Oracle cluster storage system in a four port SAN attached configuration 1 Connect one optical cable from SP A port 0 to Fibre Channel switch 0 Connect one optical cable from SP A port 1 to Fibre Channel switch 1 Connect one optical cable from SP B port 0 to Fibre Channel switch 1 Connect one optical cable from SP B port 1 to Fibre Channel switch 0 Connect one optical cable from HBA 0 on node 1 to Fibre Channel switch 0 Connect one optical cable from HBA 1 on node 1 to Fibre Channel switch 1 oO oO FF Ww BD Connect one optical cable from HBA 0 of each additional node to Fibre Channel switch 0 8 Connect one optical cable from HBA 1 of each additional node to Fibre Channel switch 1 18 Deployment Guide Configuring Networking and Storage for Oracle RAC 10g R2 This section provides the following information about network and storage configuration K Configuring the public and private networks Verifying the storage configuration Configuring the shared storage for Oracle Clusterware and the Oracle Database NOTE Oracle RAC 10g R2 is a complex database configuration that requires an ordered list of procedures To configure networking and storage in a minimal amount
13. Hardware Requirements 8 Minimum Software Requirements 8 Minimum Hardware Requirements 8 Installing and Configuring the Operating System 10 Installing the Operating System Using the Deployment CD DVDs 10 Verifying the Temporary Directory Paths 14 Verifying Cluster Hardware and Software Configurations 15 Setting Up Your Fibre Channel Cluster 16 Before You Begin aoa aaa aaa aaa 17 Cabling Your Dell EMC Fibre Channel Storage 18 Configuring Networking and Storage for OracleRAC10gA2 4 19 Configuring the Public and Private Networks 19 Installing the Host Based Software Needed for Storage 25 Verifying the Storage Assignment to the Nodes 25 Preparing the Disks for Oracle Clusterware 26 Removing the Assigned Drive Letters 31 Installing Oracle RAC 10g R2 Using OCFS 31 Installing Oracle Clusterware Version 10 2 0 1 32 Installing Oracle Database 10g R2 with Real Application Clusters 10 20 11 35 Installing Oracle 10gR2 Patchset 10 2 0 4 36 Contents Downloading the Latest Oracle Patches Configuring the Listener Creating the Seed Database Installing Oracle RAC 107R2 Using ASM Installing Oracle Clusterware Version 10 2 0 1 Installing Oracle10g Database With Real Application Clusters 10 2 0 1 Installing Patchset 10 204
14. Inthe Run field enter the following and click OK SystemDrive Oracle product 10 2 0 crs bin vipca where 3SystemDrive is the user s local drive 3 Follow the steps in VIPCA by selecting the interface appropriate for the public interface and specifying the correct VIP address to be used 4 When done click Finish Uninstalling Oracle Clusterware K NOTE Copy the GUlOraObJman folder to a different location before uninstalling Clusterware Utilities in this folder can be used to clean the share disks later You may be required to uninstall Oracle Clusterware to troubleshoot the following issues e The Oracle Clusterware installation procedure failed e The Configuration Assistant failed to install successfully To uninstall Oracle Clusterware run OUI on the cluster node delete any remaining Oracle services and clean the storage devices Running OUI 1 On node 1 open an Explorer window and navigate to the following directory SystemDrive oracle product 10 2 0 crs oui bin where 3SystemDrive is the user s local drive Double click setup exe to launch the OUI In the Welcome window click Deinstall Products In the Inventory window select OraCr10g_home and then click Remove oF W N In the Confirmation window click Yes If an error message appears click Cancel Deployment Guide 65 6 Inthe Welcome window click Cancel 7 When prompted click Cancel and then click Yes Deleting Oracle Services
15. Path field the complete Oracle home path is eSystemDrive oracle product 10 2 0 db_ 1 where SystemDrive is the user s local drive K NOTE Record the path for later use K NOTE The Oracle home path must be different from the Oracle home path that you selected in the Oracle Clusterware installation procedure You cannot install the Oracle Database 10g R2 Standard x64 Edition with RAC and Clusterware in the same home directory Click Next In the Specify Hardware Cluster Installation Mode window click Local Installation and click Next In the Product Specific Prerequisite Checks window click Next In the Select Configuration Option window select Install database Software only and click Next In the Summary window click Install In the End of Installation window perform the steps as listed K NOTE You should perform the steps as listed in the window before proceeding with the next step Click Exit Installing Patchset 10 2 0 4 K NOTE The following patchset installation steps install only Oracle softwares such as 10 2 0 1 Clusterware and 10 2 0 1 Database binaries with seed database that are not yet created on your system Download the patchset 10 2 0 4 from the Oracle Metalink website located at metalink oracle com Unzip the patchset to the following location SystemDrive where SystemDrive is the user s local drive Installing Patchset 10 2 0 4 for Oracle 10g Clusterware Before You Begin
16. Version 10 2 0 1 on page 31 d Click OK e Inthe Flash Recovery Area Size text box enter the total amount of size that was created in step 2 in Preparing the Database Disk and Flash Recovery Area for Database Storage With OCFS on page 29 for Flash Recovery Area Select Enable Archiving Click Edit Archive Mode Parameters In the Edit Archive Mode Parameters window ensure that the path listed under the Archive Log Destinations is as follows X where X is the CFS drive letter created in step 2 in Preparing the Database Disk and Flash Recovery Area for Database Storage With OCFS on page 29 for Flash Recovery Area Deployment Guide 16 17 18 19 20 21 22 23 24 25 b Click OK Click Next In the Database Content window accept the default values and click Next In the Database Services window click Next In the Initialization Parameters window click Next In the Database Storage window click Next In the Creation Options window accept the default values and click Finish In the Summary window click OK The Database Configuration Assistant window appears and the Oracle software creates the database K NOTE This procedure may take several minutes to complete In the Database Configuration Assistant window click Yes When completed the Database Configuration Assistant window provides database configuration information Record the information in the Database Configuration Assistant window fo
17. and hardware requirements for Dell s Supported Configurations for Oracle Minimum Software Requirements Table 1 1 lists the minimum software requirements K NOTE Your Dell configuration includes a 30 day trial license of Oracle software If you do not have a license for this product contact your Dell sales representative Table 1 1 Software Requirements Software Component Configuration Microsoft Windows Server 2003 R2 Standard Enterprise x64 Editions Oracle10g R2 Version 10 2 0 1 Enterprise Edition including the RAC option for clusters Oracle Patchset 10 2 0 4 EMC PowerPath Version 5 2 Fibre Channel clusters only Minimum Hardware Requirements Table 1 2 lists the minimum hardware requirements for fibre channel cluster configurations For more information on specific hardware components see the documentation included with your system K NOTE Depending on the number of users the application you use your batch processes and other factors you may need a system that exceeds the minimum hardware requirements to achieve your desired performance K NOTE The hardware configuration of all the cluster nodes should be identical 8 l Deployment Guide Table 1 2 Minimum Hardware Requirements Fibre Channel Cluster Configurations Hardware Component Configuration Dell PowerEdge system up to eight nodes using Automatic Storage Management ASM or Oracle Cluster File System OCFS
18. instance addition operation the DBCA displays a dialog asking whether you want to perform another operation 12 Click No and exit the DBCA or click Yes to perform another operation Troubleshooting Working Around Clusterware Installation Failure Oracle Clusterware Configuration Assistant Fails In the Configuration Assistants window if the installation fails using the Oracle Clusterware Configuration Assistant then perform the following 1 Open the file ORA_CLUSTERWARE_ HOME cfgtoollogs configToolFail edCommands where 3ORA_CLUSTERWARE_HOME is the CRS home directory that you created in Installing Oracle Clusterware Version 10 2 0 1 on page 31 2 Copy and run the first three commands with the parameters listed in the file from the DOS command prompt 3 Follow the section Virtual Private IP Configuration Assistant Fails on page 64 below to run the failed virtual private IP configuration assistants VIPCA Virtual Private IP Configuration Assistant Fails If the VIPCA fails during the installation of Oracle Clusterware the following message may display Virtual Private IP Configuration Assistant failed 64 Deployment Guide If this occurs perform the following steps to work around the error These steps are detailed in Metalink Note ID 338924 1 This generally occurs if the Public interface is configured with an IP address in the networks 10 0 0 0 8 172 16 0 0 16 or 192 168 1 0 24 1 Click Start gt Run 2
19. message Failed to retrieve network listener resources appears click Yes to allow DBCA to create the appropriate listener resources In the ASM Disk Groups window click Create New In the Create Disk Group window enter the information for the database files g h In the Disk Group Name field enter a name for the new disk group For example DATABASE In the Redundancy box select External Click Stamp Disks Select Add or change label and click Next In the Select disks screen select the disks that you plan to use for the database files Note that the Status is marked as Candidate device In the Generate stamps with this prefix field keep the default settings and click Next In the Stamp disks window click Next Click Finish to save your settings Select the check boxes next to the available disks and click OK In the ASM Disk Groups window click Create New In the Create Disk Group window enter the information for the Flash Recovery Area In the Disk Group Name field enter a name for the new disk group For example FLASH In the Redundancy box select External Click Stamp disks In the Select disks screen select the disk which you plan to use for the Flash Recovery Area Note that the Status is marked as Candidate device Deployment Guide 49 50 21 22 23 24 25 e Inthe Generate stamps with this prefix field enter FLASH and click Next f In the Stamp disks window click Next g Clic
20. optic cables connected to the cluster nodes and storage system are installed correctly See Cabling Your DellIEMC Fibre Channel Storage on page 17 for more information e PROBLEM The VIPCA configuration fails CAUSE The public network adapter interface or the network interface assigned for VIP in case 4 network interfaces name is not identical on both cluster nodes RESOLUTION Ensure that the public network adapter interface name is identical on both cluster nodes To verify the public network adapter interface name On node 1 click Start and select Settings Control Panel Network Connections In the Network Connections window right click the public network adapter that you want to rename and select Rename Repeat step a and step b on each of the remaining nodes Uninstall Oracle Clusterware e PROBLEM Configuration assistant fails to install 74 CAUSE Previous installation is not completely removed RESOLUTION Even though Oracle is uninstalled using the GUI the empty directories in Oracle home and the Oracle folder under Program Files remain you must manually delete these folders Deployment Guide Getting Help Dell Support For detailed information about using your system see the documentation that came with your system components For white papers Dell Supported Configurations and general information visit dell com 10g For Dell technical support for your hardware and operating system software and
21. output indicated above does not appear enter crsct1 start crs c Close the cmd window by entering exit On node 1 click Start gt Run In the Run field enter the following and click OK dbca The Database Configuration Assistant starts In the Welcome window select Oracle Real Application Clusters database and click Next In the Operations window click Create a Database and click Next In the Node Selection window click Select All and click Next In the Database Templates window click Custom Database and click Next In the Database Identification window in the Global Database Name field enter a name such as racdb and click Next In the Management Options window click Next In the Database Credentials window click Use the Same Password for All Accounts enter a new password in the appropriate fields and click Next K NOTE Record your new password because you will need this information later for database administration In the Storage Options window select Automatic Storage Management ASM and click Next In the Create ASM Instance window perform the following steps a Inthe SYS password field enter a new password in the appropriate fields b Select Create initialization parameter file IFILE c Click Next Deployment Guide 13 In the Database Configuration Assistant window click OK 14 15 16 17 The ASM Creation window appears and the ASM Instance is created K NOTE If the warning
22. procedure Preparing the OCR and Voting Disks for Clusterware on page 27 Select the first partition and click Edit In the Specify Disk Configuration window select Place Voting Disk on this partition and click OK Repeat steps b and c on the remaining Voting Disk partitions In the Cluster Configuration Storage window perform the following steps for the database f Locate the partition created in step 1 of Preparing the Database Disk and Flash Recovery Area for Database Storage With OCFS on page 29 Select the partition and click Edit In the Specify Disk Configuration window select Format partition with CFS Ensure that the Use partition for data storage is selected Use the pull down menu of the Assign Drive Letter option to assign a drive letter to the partition Click OK In the Cluster Configuration Storage window perform the following steps for flash recovery Locate the partition created in step 2 of Preparing the Database Disk and Flash Recovery Area for Database Storage With OCFS on page 29 Select the partition and click Edit In the Specify Disk Configuration window select Format partition with CFS Ensure that Use partition for data storage is selected Deployment Guide 33 e Use the pull down menu of the Assign Drive Letter option to assign a drive letter to the partition f Click OK 14 Inthe Cluster Configuration Storage window click Next 15 Ignore the warning messages and c
23. the following e An alternate cluster name if desired e The public and private network host names for both cluster nodes Click Add to specify additional nodes e In the Add a new node to the existing cluster window enter the public private and virtual host name and click OK K NOTE Ensure that the network host names do not include a domain name extension Click Next The Specify Network Interface Usage window appears displaying a list of cluster wide network interfaces If required change the public Interface Type to Public if shown as Private by performing the following steps a Select the Interface Name and click Edit b Select the correct interface and click OK In the Specify Network Interface Usage window click Next In the Cluster Configuration Storage window perform the following steps for the OCR disk a Locate the two 120 MB partitions created in the procedure Preparing the OCR and Voting Disks for Clusterware on page 27 b Select the first partition and click Edit Deployment Guide 11 12 13 In the Specify Disk Configuration window select Place OCR Primary on this partition and click OK Select the second partition and click Edit In the Specify Disk Configuration window select Place OCR Mirror on this partition and click OK In the Cluster Configuration Storage window perform the following steps for the voting disk d Locate the three 50 MB partitions created in the
24. the patch already be installed On node 1 perform the following steps 1 Click Start gt Run and enter netca then click OK 2 Inthe Real Application Clusters Configuration window select Cluster configuration and click Next 3 Inthe Real Application Clusters Active Nodes window select Select all nodes and click Next 4 Inthe Welcome window select Listener configuration and click Next 38 Deployment Guide 10 11 In the Listener Configuration Listener window select Add and click Next In the Listener Configuration Listener Name window in the Listener name field accept the default setting and click Next In the Listener Configuration Select Protocols window in the Selected protocols field select TCP and click Next In the Listener Configuration TCP IP Protocol window select Use the standard port number of 1521 and click Next In the Listener Configuration More Listeners window select No and click Next In the Listener Configuration Done window click Next In the Welcome window click Finish Creating the Seed Database This section contains procedures for creating the seed database using OCFS and verifying the seed database K NOTE The procedure in this section requires that the patch already be installed Perform the following steps to create the seed database using OCFS 1 2 On node 1 click Start Run In the Run field enter dbca and click OK The Database Configuration Assistant sta
25. to New Nodes Execute the following procedures for each new node to add instances 1 Click Start gt Programs Oracle HOME_NAME gt Configuration and Migration Tools Database Configuration Assistant 2 The DBCA displays the Welcome page for RAC Click Help on any DBCA page for additional information 3 Select Real Application Clusters database click Next and the DBCA displays the Operations page 4 Select Instance Management click Next and the DBCA displays the Instance Management page 5 Select Add Instance and click Next The DBCA displays the List of Cluster Databases page that shows the databases and their current status such as ACTIVE or INACTIVE 6 From the List of Cluster Databases page select the active RAC database to which you want to add an instance 7 Click Next to add a new instance The DBCA displays the Adding an Instance page 8 On the Adding an Instance page enter the instance name in the field at the top of this page Then select the new node name from the list click Next and the DBCA displays the Services Page 9 Enter the services information for the new node s instance click Next and the DBCA displays the Instance Storage page 10 Click Finish and the DBCA displays a Summary dialog Deployment Guide 63 11 Review the information on the Summary dialog and click OK The DBCA displays a progress dialog showing the DBCA performing the instance addition operation When the DBCA completes the
26. 3 to the appropriate disk and save the file Use the Oracle Symbolic Link Importer ImportSYMLinks to import the symbolic links into the assigned storage disks OCRCFG OCRMIRRORCKG Votedsk1 Votedsk2 and Votedsk3 At the command prompt enter the following SystemDrive oracle product 10 2 0 crs bin Impor tSYMLinks where 3SystemDrive is the user s local drive 3 Using the Oracle Logical Partition Formatter LogPartFormat format the OCRCFG OCRMIRRORCKG Votedsk1 Votedsk2 and Votedsk3 partitions on both nodes At the command prompt enter SystemDrive oracle product 10 2 0 crs bin LogPa rtFormat OCRCFG Then enter SystemDrive oracle product 10 2 0 crs bin LogPa rtFormat Votedskl where 3SystemDrive is the user s local drive 4 The following message appears Are you sure you want to continue Y N Enter y to continue Deployment Guide 67 68 5 Launch the Oracle GUI Object Manager At the command prompt enter the following SystemDrive ora_bin_utils GUIOracleOBJManager e xe where 3SystemDrive is the user s local drive The Oracle Object Manager window appears Delete the symlinks for the OCR OCRCFG and OCRMIRRORCFG and the voting disks Votedsk1 Votedsk2 and Votedsk3 a Select OCRCFG OCRMIRRORCKG Votedsk1 Votedsk2 and Votedsk3 b Click Options and select Commit If successful the OCRCFG OCRMIRRORCIG Votedsk1 Votedsk2 and Votedsk3 entries di
27. 50 systems when configuring integrated Broadcom NICs into a team the following warning message will be displayed Deployment Guide 21 Including this adapter in a team will disrupt the system management features Click Yes to proceed Click Next In the Designating Standby Member window select Do not configure a Standby Member and click Next In the Configuring Live Link window select No and click Next In the Creating Modifying a VLAN window select Skip Manage VLAN and click Next In the last window click Preview to verify the NIC team and the adapters Once verified select Commit changes to system and exit the wizard Click Finish In the information message window click Yes to proceed In the Broadcom Advanced Control Suite 3 window click File then Exit 5 Repeat step 1 through step 4 on the remaining nodes Configuring the IP Addresses for Your Public and Private Network Adapters K NOTE The TOE functionality of TOE capable NIC is not supported in this solution 1 Update the adapter s network interface name if required Otherwise go to step 3 On node 1 click Start gt Settings Control Panel Network Connections In the Network Connections window right click the public network adapter you want to rename and select Rename K NOTE When you configure your network adapters on the cluster nodes use identical names for the public adapters and the private adapters on all cluster nodes Otherwise t
28. C Fibre Channel Two CAT 5e 6 cables connected to LAN one from storage system each storage processor One to four optical connections to each Fibre Channel switch in a SAN attached configuration See Cabling Your DellIEMC Fibre Channel Storage on page 17 for more information DellIEMC Fibre Channel One optical connection to each PowerEdge system s switch HBA and one optical connection to a port on each storage processor Gigabit Ethernet switch One Cat 5e 6 connection to the private Gigabit NIC on each PowerEdge system One Cat 5e 6 connection to the other Gigabit Ethernet switch Before You Begin Verify that the following tasks have been completed for your cluster e All hardware is installed in the rack e All hardware interconnections are configured e All virtual disks LUNs RAID groups and storage groups are created on the storage system e Storage groups are assigned to the cluster nodes LS CAUTION Before you perform the procedures in the following sections ensure that the system hardware and cable connections are installed correctly Cabling Your Dell EMC Fibre Channel Storage You can configure your Oracle cluster storage system in a four port SAN attached configuration depending on your needs See the following procedures for both configurations Figure 1 2 illustrates the hardware connections used in setting up a SAN attached Fibre Channel cluster Deployment Guide 17 Figure 1 2 Cabling in a
29. DELL You can also obtain the corresponding source files from the following website www dell com oracle Deployment Guide 75 76 Deployment Guide Index C cluster fibre channel 9 16 Clusterware installing 42 52 preparing disks 26 uninstalling 66 D database disk 29 disks database 29 flash recovery 27 voting 26 E EMC Naviagent 25 PowerPath 8 14 F fibre channel DelllEMC 17 SAN attached 16 setting up 16 flash recovery area 29 disks 27 H hardware connections 16 17 requirements 9 help 76 Dell support 76 Oracle support 76 IP addresses configuring 22 L listener configuring 39 47 57 Multi Path 26 driver 26 Index 87 N Naviagent 25 network configuring 19 NIC port assignments 20 0 OCFS 29 creating seed database 40 installing Oracle using 31 OCR disk 26 Oracle preparing disks for Clusterware 26 Oracle Database 10g configuring 52 deploying 52 OUI running 66 P partitions creating 27 patches downloading 39 installing 37 patchset installing 45 55 88 Index PowerPath installing 26 S seed database creating 40 storage configuring 19 TOE 20 V voting disk 27 creating logical drive 28 W Windows configuring 10 installing 10
30. Dell PowerEdge Systems Dell Oracle Database 10g R2 Enterprise Edition on Microsoft Windows Server 2003 R2 with SP2 Standard or Enterprise x64 Edition Deployment Guide Version 4 0 DOLL Notes and Notices K NOTE A NOTE indicates important information that helps you make better use of your computer A CAUTION A CAUTION indicates potential damage to hardware or loss of data if instructions are not followed Information in this document is subject to change without notice 2008 Dell Inc All rights reserved Reproduction of these materials in any manner whatsoever without the written permission of Dell Inc is strictly forbidden Trademarks used in this text Dell the DELL logo OpenManage PowerEdge and PowerVault are trademarks of Dell Inc Intel and Xeon are registered trademarks of Intel Corporation EMC Navisphere and PowerPath are registered trademarks of EMC Corporation Microsoft Windows and Windows Server are either trademarks or registered trademarks of Microsoft Corporation in the United States and or other countries AMD and Opteron are trademarks of AMD Corporation Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products Dell Inc disclaims any proprietary interest in trademarks and trade names other than its own October 2008 Rev A08 Contents Terminology Used inthis Document 7 Software and
31. Dell EMC system documentation DellIEMC CX3 10C CX3 20 CX3 20F fOr more details CX3 40 CX3 40F CX3 80 CX4 120 CX4 240 CX4 480 CX4 960 AX4 5F Fibre Channel storage system Installing and Configuring the Operating System A CAUTION To ensure thatthe operating system is installed correctly disconnect all external storage from the system before you install the operating system This section provides information about installing and configuring the Windows Server 2003 SP2 Standard Enterprise x64 Edition operating system for Oracle deployment Installing the Operating System Using the Deployment CD DVDs Repeat the steps in this section for all nodes in the cluster K NOTE See the Dell Support website at support dell com for the latest BIOS firmware and driver updates 1 Shut down your system 2 Disconnect all external storage devices from your system Locate the Microsoft Windows Server 2003 R2 Standard Enterprise x64 Edition SP2 CD and the Dell Systems Management Tools and Documentation version 5 5 DVD for your Dell Server K NOTE The De Systems Management version 5 5DVD is packaged with your Dell server 4 Start up your system 5 Insert the Dell Systems Management version 5 5 DVD in your system drive K NOTE If your server does not have a CD DVD drive you can use an externally attached USB CD DVD drive The boot menu screen appears 10 Deployment Guide 6 In the Select Language screen select E
32. K NOTE Complete the following steps before creating a listener and a seed database Ensure that all the Oracle services are running NOTE You must install the patchset software from the node where the Oracle RAC 10g R2 software was installed If this is not the node where you are running the OUI exit and install the patchset from that node Patchset Installation Steps 46 1 2 3 Start the OUI located in the patchset folder In the Welcome window click Next In the Specify home details window select the name as OraDb10g_home1 from the drop down list to install the patchset to Oracle home and click Next In the Specify Hardware Cluster Installation Mode window click Next In the Summary window click Install During the installation the following error message may appear Error in writing to file oci d11 To work around this issue perform the following steps a Cancel the patchset installation b Rename the Oracle home BIN directory to bin_save Reboot the system d After the reboot rename the bin_ save file to bin e Run the setup exe file from the patchset folder Allow all the Oracle default services to run From the End of Installation screen perform the necessary steps listed in the Summary windows At the End of Installation screen click Exit and then click Yes to exit the OUI Deployment Guide Configuring the Listener This section contains procedures to configure the listener which i
33. Path installation fails NIC Teaming e PROBLEM Broadcom NIC teaming fails CAUSE The following steps may result in a NIC teaming failure e One of the Broadcom NICs that was used in the NIC teaming fails or is disabled Due to the availability of the second NIC the private network is still active on this node through the second NIC e When the first NIC is still down or disabled the second NIC in the teaming also fails or is disabled This failure causes the private network to go down completely on this node The private IP address on this node cannot be pinged e When the second NIC that failed or was disabled becomes enabled the private network of this node remains inactive K NOTE A private network becomes inactive only if the failed second NIC becomes enabled If the first failed NIC becomes enabled the private network becomes active RESOLUTION The most likely cause of this issue is a Spanning Tree Protocol on your switch If this issue is caused by a Spanning Tree Protocol perform one of the following procedures Deployment Guide 69 e Turn off Spanning Tree on the switch e Enable Port Fast Learning or equivalent which may be called something different depending on the brand of switch on the ports of the switch to which your teamed NICs are attached e Use Broadcom s LiveLink feature by right clicking the team choosing Enable LiveLink and following the instructions in the window K NOTE Thoug
34. appear as unreachable CAUSE On the Windows desktop when you right click My Computer select Computer Management and then click Disk Management the disks appear unreachable Potential causes are that the LUNs are not assigned to the cluster nodes cabling is incorrectly installed or the HBA drivers are not installed on the cluster node s RESOLUTION Ensure that the storage LUNs are assigned to both cluster nodes and that the fiber optic cables connected to the cluster nodes and storage system are installed correctly See Cabling Your DellIEMC Fibre Channel Storage on page 17 for more information e PROBLEM SCSI disk devices do not appear CAUSE On the Windows desktop when you right click My Computer select Computer Management and then click Disk drivers the SCSI disk devices do not appear Possible causes are that the LUNs are not assigned to the cluster nodes cabling is incorrectly installed or the HBA drivers are not installed on the cluster node s RESOLUTION First ensure that the storage LUNs are assigned to both cluster node by performing the following steps On the Windows desktop right click My Computer and select Manage In the Manage window expand Device Manager In the right window pane right click the host computer name and select Scan for hardware changes Repeat step c until the disk devices appear Restart the system if required Deployment Guide 73 VIPCA Next ensure that the fiber
35. ative completes the setup of your Fibre Channel cluster verify the hardware connections and the hardware and software configurations as described in this section Figure 1 1 Figure 1 2 and Table 1 5 illustrate the required cluster connections for a storage area network SAN attached Fibre Channel cluster with two nodes Deployment Guide 15 Figure 1 1 Hardware Connections for a SAN attached Fibre Channel Cluster Public network Gb Ethernet switches pri Oracle database e Dell EMC Fibre Channel switches SAN CAT 5e 6 copper Gigabit NIC CAT 5e 6 copper Gigabit NIC Fiber optic cables Additional fiber optic cables Dell EMC CX3 10c CX3 20 CX3 20F CX3 40 CX3 40F CX3 80 CX4 120 CX4 240 CX4 480 CX4 960 and AX4 5F Fibre Channel storage systems Table 1 5 Fibre Channel Hardware Interconnections Cluster Component Connections PowerEdge system One CAT 5e 6 cable from public NIC to the local area node network LAN One CAT 5e 6 cable from private Gigabit NIC to Gigabit Ethernet switch private network One CAT 5e 6 cable from redundant private Gigabit NIC to redundant Gigabit Ethernet switch private network One optical cable from optical HBA 0 to Fibre Channel switch 0 and one optical cable from HBA 1 to switch 1 16 Deployment Guide Table 1 5 Fibre Channel Hardware Interconnections continued Cluster Component Connections DellIEM
36. base data disk and saving the backup and log data backup disk During the cluster configuration described in this document you will create partitions on your shared storage When you create the partitions ensure that the cluster nodes can detect the LUNs or logical disks that are created in the attached storage system To prepare the disks for Oracle Clusterware identify the OCR voting data and flash recovery area disks After you identify the appropriate disks perform the following steps on node 1 Enabling the Automount Option for the Shared Disks 1 On node 1 click Start gt Run 26 Deployment Guide 5 6 7 In the Run field enter cmd and click OK At the command prompt enter diskpart At the DISKPART command prompt enter automount enable The following message appears Automatic mounting of new volumes enabled At the DISKPART command prompt enter exit Close the command prompt Repeat step through step 6 on each of the remaining nodes Preparing the OCR and Voting Disks for Clusterware 1 2 On the Windows desktop right click My Computer and select Manage Expand Storage and click Disk Management The storage disk that you initialized in the Verifying Multi Path Driver Functionality on page 26 appears as Unallocated Right click the partition area of the first shared disks assigned to the cluster nodes and select New Partition The Welcome to the New Partition Wizard appears Click Next In
37. cify Partition Size window in the Partition size in MB field enter 50 and click Next In the Assign Drive Letter or Path window select Do not assign a drive letter or drive path and click Next In the Format Partition window select Do not format this partition and click Next Click Finish Repeat steps a through g two times to create two additional voting disk partitions NOTE If you are using Redundant Voting Disk and OCR repeat the steps outlined in step 9 and step 10 for the redundant Voting Disk and OCR Deployment Guide Preparing the Database Disk and Flash Recovery Area for Database Storage With OCFS This section provides information for creating logical drives that will be used to create the Oracle s Clustered File System OCFS storage disk K NOTE When using ASM storage management the ASM data disk group should be larger than your database multiple LUNs and the ASM Flash Recovery Area disk group should be at least twice the size of your data disk group K NOTE If you are creating the logical drives that are used to create the Automatic Storage Management ASM storage disk ignore the following steps and see Preparing the Database Disk and Flash Recovery Area for Database Storage With ASM on page 30 1 On node 1 create one logical drive for the Database a Locate the disk that is assigned for the Oracle Database b On the disk partition area right click the free space and select New Logical Drive
38. e The Welcome to the New Partition Wizard appears Click Next In the Select Partition Type window select Logical drive and click Next In the Specify Partition Size window enter the appropriate size in the Partition size in MB field and click Next In the Assign Drive Letter or Path window select Do not assign a drive letter or drive path and click Next In the Format Partition window select Do not format this partition and click Next Click Finish 2 Create one logical drive for the Flash Recovery Area a b Locate the disk that is assigned for the Flash Recovery Area Perform step b through step h in step 1 3 Restart all other nodes and log in as the administrator Removing the Assigned Drive Letters 1 On the Windows desktop for each node right click My Computer and select Manage 2 Inthe Computer Management window expand Storage and click Disk Management 30 Deployment Guide If you find any drive letters assigned to the drives that you created in Preparing the OCR and Voting Disks for Clusterware on page 27 perform the following steps a Right click the logical drive and select Change Drive Letter and Paths b Inthe Change Drive Letter and Paths window select the drive letter and click Remove c In the Confirm window click Yes d Repeat step a through step c for the remaining logical drives on the storage partition Installing Oracle RAC 10g R2 Using OCFS K NOTE If you are installi
39. e Host Based Software Needed for Storage on page 25 and Verifying Multi Path Driver Functionality on page 26 Repeat step a through step n and reset each Oracle service back to its original setting System Blue Screen PROBLEM The cluster nodes generate a blue screen 72 CAUSE The cluster nodes cannot access the voting disk RESOLUTION Perform the following steps Ensure that the HBA connection mode firmware settings are configured properly for your storage configuration e If your cluster nodes and storage system are configured in a direct attached configuration configure Connection mode as 0 loop only e If your cluster nodes and storage system are connected to each other through a Fibre Channel switch configure the Connection mode as 2 loop preferred otherwise point to point If the problem persists increase the CSS misscount to a value greater than 120 Perform the following 1 Shut down all nodes except node 1 2 On node 1 open a command prompt 3 Enter the following ORA_CLUSTERWARE HOME bin where SORA _CLUSTERWARE HOMES is the CRS home directory that you created in Installing Oracle Clusterware Version 10 2 0 1 on page 42 4 At the command prompt enter the following Deployment Guide d Storage crsctl set css misscount n where nisa value greater than 120 Restart node 1 and log on as administrator Restart each of the other nodes and log on as administrator e PROBLEM Disks
40. elect Installation Type window click Enterprise Edition and click Next In the Specify Home Details window under Destination verify the following e Inthe Name field the Oracle database home name is OraDb10g_homel1 e In the Path field the complete Oracle home path is SystemDrive oracle product 10 2 0 db_1 where 3SystemDrive is the user s local drive K NOTE Record the path for later use K NOTE The Oracle home path must be different from the Oracle home path that you selected in the Oracle Clusterware installation procedure You cannot install the Oracle Database 10g R2 Enterprise x64 Edition with RAC and Clusterware in the same home directory Click Next In the Specify Hardware Cluster Installation Mode window click Select All and click Next In the Product Specific Prerequisite Checks window click Next In the Select Configuration Option window select Install database Software only and click Next In the Summary window click Install In the End of Installation window perform the steps as listed l Deployment Guide 12 K NOTE You should perform the steps as listed in the window before proceeding with the next step Click Exit Installing Patchset 10 2 0 4 K NOTE The following patchset installation steps install only the Oracle softwares like 10 2 0 1 Clusterware and 10 2 0 1 Database binaries with seed database that are not yet created on your system Download the patchset 10 2 0
41. espond to ping commands check your network configuration and then repeat this step K NOTE Virtual internet protocol VIP is configured later and cannot be pinged atthis point c Repeat step a through step b on the remaining nodes Deployment Guide Installing the Host Based Software Needed for Storage To install the EMC Naviagent software using the EMC software that came with your DellIEMC system follow the procedures in your DellIEMC documentation Verifying the Storage Assignment to the Nodes 1 2 3 4 7 On the Windows desktop right click My Computer and select Manage In the Computer Management window click Device Manager Expand Disk drives Under Disk drives ensure that four small computer system interface SCSI disk devices appear for each LUN virtual disk assigned in the storage Expand Storage and click Disk Management If the Welcome to the Initialize and Convert Disk Wizard appears perform step a through step d Otherwise go to step 6 a In the Welcome to the Initialize and Convert Disk Wizard window click Next b Inthe Select Disks to Initialize window in the Disks window select the disks that are associated with your storage LUNs Vvirtual disks and click Next c In the Select Disks to Convert window deselect the disk s that you selected in step b and click Next K NOTE This procedure ensures that your disks are configured as Basic disks d Click Finish In the Disk Management
42. et For example SystemDrive Oracle patch setup exe where SystemDrive is the drive on which you unzipped the Oracle patchset 2 Inthe Welcome screen click Next Deployment Guide 37 3 Inthe Specify Home Details window select the name as OraDb10g_homel from the drop down list and click Next In the Specify Hardware Cluster Installation Mode window click Next In the Product Specific Prerequisite Checks window click Next In the Oracle Configuration Manager Registration window click Next In the Summary window click Install o Nn 0O 0a A In the End of Installation window perform all the steps listed in the Summary window Do not perform the step instructing you to stop the Oracle services you should have already completed that step before you began installing the patchset as mentioned in Before You Begin 9 Inthe End of Installation window click Exit 10 Click Yes to exit from the OUI Downloading the Latest Oracle Patches Oracle may provide additional patches that were not included when you first downloaded the patchset To download additional patches 1 Open a Web browser 2 Navigate to the Oracle Metalink website at www metalink oracle com 3 Download any patches appropriate for your installation Configuring the Listener This section describes the steps to configure the listener which is required for a remote client connection to a database K NOTE The procedure in this section requires that
43. for more information e PROBLEM The Configuration Assistant fails to install successfully a b c CAUSE One or more storage devices need to be reformatted RESOLUTION Perform the following procedures Uninstall Oracle Clusterware using OUI Uninstall any remaining Oracle services Clean the storage devices See Uninstalling Oracle Clusterware on page 65 for more information Oracle Clusterware e PROBLEM The cluster node restarts with a blue screen a 0 a o CAUSE The cluster node cannot communicate with the storage disks RESOLUTION Perform the following steps Restart the cluster node During POST press lt F8 gt In the Windows Advanced Options Menu screen select Safe Mode Select the appropriate operating system Log on to the system In the Desktop screen click OK On the Windows desktop right click My Computer and select Manage In the Computer Management window expand Services and Applications Click Services Right click the first Oracle service and select Properties Click the Startup drop down menu and record the default startup type for this service In the Startup drop down menu select Disabled Repeat step 10 through step 12 for all remaining Oracle services Deployment Guide 71 Verify the following e The storage system is functioning properly e All fiber optic cables are connected and secure e The cluster node can access the shared storage disks See Installing th
44. gle Node configuration and click Next In the Welcome window select Listener configuration and click Next In the Listener Configuration Listener window select Add and click Next In the Listener Configuration Listener Name window select the default setting in the Listener name field and click Next Deployment Guide 10 11 In the Listener Configuration Select Protocols window select TCP in the Selected protocols field and click Next In the Listener Configuration TCP IP Protocol window select Use the standard port number of 1521 and click Next In the Listener Configuration More Listeners window select No and click Next In the Listener Configuration Done window click Next In the Welcome window click Finish Creating the Seed Database Perform the following steps to create the seed database using Oracle ASM 1 Verify the Oracle Clusterware is running a Open a command prompt window Click Start gt Run and enter cmd b Entercrsctl check crs The following output should appear CSS appears healthy CRS appears healthy EVM appears healthy K NOTE If the output indicated above does not appear enter crsct1 start crs c Close the cmd window by entering exit On node 1 click Start gt Run In the Run field enter dbca and click OK The Database Configuration Assistant starts In the Welcome window click Next In the Operations window click Create a Database and click Next In the Database Temp
45. h the suggested solutions may fix the above mentioned issue be aware of the implications or issues that may arise from enabling Port Fast Learning or turning off Spanning Tree on your switches Installing Oracle Clusterware 70 e PROBLEM During Clusterware installation you get the error message The specified nodes are not clusterable CAUSE The administrative or the account used to install Oracle has a blank password associated with it RESOLUTION Perform the following steps a Right click My Computer and select Manage b In the Computer Management window in the left pane expand System Tools and Local Users and then expand Groups c Click Users in the left pane d Inthe right pane right click the administrative account being used to install Oracle and select Set Password e A warning window displays Ignore the message and click Proceed f In the Set Password window enter the passwords and click OK g Log off the machine and log back in with the administrative account you just changed assigned the password for h Restart the Clusterware installation PROBLEM The Oracle Clusterware installation fails CAUSE The symlinks for OCRCFG and or Votedsk1 are unavailable RESOLUTION Perform the following procedures a Uninstall Oracle Clusterware using OUI b Uninstall any remaining Oracle services Deployment Guide c Clean the storage devices See Uninstalling Oracle Clusterware on page 65
46. he Oracle RAC Database Layer 62 1 From the 7 ORACLE_HOME oui bin directory run the addNode bat script The OUI starts in the Add Node mode and displays the OUI Welcome page Click Next on the Welcome page and the OUI displays the Specify Cluster Nodes for Node Addition page The Specify Cluster Nodes for Node Addition page has a table showing the existing nodes associated with the Oracle home from which you launched the OUI A node selection table appears on the bottom of this page showing the nodes that are available for addition Select the nodes that you want to add and click Next If all of the checks succeed then the OUI displays the Node Addition Summary page Click Finish and the OUI displays the Cluster Node Addition Progress page After the OUI displays the End of Node Addition page click Exit to end the OUI session Deployment Guide 6 Execute the VIPCA utility from the bin subdirectory of the Oracle home using the nodelist option with the following syntax that identifies the complete set of nodes that are now part of your RAC database beginning with Node and ending with NodeN vipca nodelist Nodel Node2 Node3 NodeN 7 Add a listener to the new node only by running the Net Configuration Assistant NetCA After completing the procedures in the previous section the new nodes are defined at the cluster database layer New database instances can now be added to the new nodes Adding Database Instances
47. he Oracle database installer generates an error and prevents you from completing the installation procedure Rename the public adapter name to Public and press lt Enter gt Right click the Private NIC team you want to rename and select Rename Rename the Private NIC team to Private and press lt Enter gt Deployment Guide 2 Configure the IP addresses K NOTE You must set a default gateway for your public interface otherwise the Clusterware installation may fail a Click Start Settings gt Control Panel Network Connections gt Public Properties b Double click Internet Protocol TCP IP c Click Use the following IP address enter the required IP address default gateway address and the DNS server IP address and click OK d Inthe Public Properties window select Show icon in notification area when connected The network adapter status will appear in the system tray after you perform the procedures in this section e Click OK f In the Properties window click Close g Repeat step a through step f for the Private NIC team K NOTE Private NIC team does not require a default gateway address and DNS server entry 3 Ensure that the public and private network adapters appear in the appropriate order for access by network services a On the Windows desktop click Start Settings Control Panel gt Network Connections b Inthe Network Connections window click Advanced and select Advanced Settings
48. he Status is marked as Candidate device f In the Generate stamps with this prefix field keep the default settings and click Next g Inthe Stamp disks window click Next h Click Finish to save your settings i Select the check boxes next to the available disks and click OK In the ASM Disk Groups window click Create New Deployment Guide 16 17 18 19 In the Create Disk Group window enter the following information for the Flash Recovery Area a Inthe Disk Group Name field enter a name for the new disk group For example FLASH b In the Redundancy box select External c Click Stamp disks d In the Select disks screen select the disk which you plan to use for the Flash Recovery Area Note that the Status is marked as Candidate device e Inthe Generate stamps with this prefix field enter FLASH and click Next f In the Stamp disks window click Next g Click Finish to save your settings h Select the check boxes next to the available disks and click OK The ASM Disk Group Window appears indicating that the software is creating the disk group When completed the FLASH disk group appears in the Disk Group Name column Select only the Disk Group Name that you assigned to the database in step 15 for example DATABASE and click Next In the Database File Locations window select Use Oracle Managed Files and Multiplex Redo Logs and Control Files and click Next In the Recovery Configuration window
49. k Finish to save your settings h Select the check boxes next to the available disks and click OK The ASM Disk Group Window appears indicating that the software is creating the disk group When completed the FLASH disk group appears in the Disk Group Name column Select only the Disk Group Name that you assigned to the database in step 15 for example DATABASE and click Next In the Database File Locations window select Use Oracle Managed Files and Multiplex Redo Logs and Control Files and click Next In the Recovery Configuration window perform the following steps a Select Specify Flash Recovery Area b Click Browse c Select the FLASH disk group that you created in step 17 and click OK d Inthe Flash Recovery Area Size text box enter the total size of the flash disk group created in step 17 e Select Enable Archiving f Click Edit Archive Mode Parameters g Inthe Edit Archive Mode Parameters window ensure that the path listed under the Archive Log Destinations is as follows FLASH where FLASH is the Flash Recovery Area disk group name that you specified in step a of step 17 h Click Next In the Database Content window click Next In the Database Services window click Next In the Initialization Parameters window click Next In the Database Storage window click Next In the Creation Options window click Finish Deployment Guide 26 27 28 In the Summary window click OK The Database C
50. lates window click Custom Database and click Next In the Database Identification window in the Global Database Name field enter a name such as singledb and click Next In the Management Options window click Next Deployment Guide 57 58 15 In the Database Credentials window click Use the Same Password for All Accounts enter a new password in the appropriate fields and click Next K NOTE Record your new password for later use in database administration In the Storage Options window select Automatic Storage Management ASM and click Next In the Create ASM Instance window perform the following steps a Inthe SYS password field enter a new password in the appropriate fields b Click Next In the Database Configuration Assistant window click OK The ASM Creation window appears and the ASM Instance is created K NOTE If the warning message Failed to retrieve network listener resources appears click Yes to allow DBCA to create the appropriate listener resources In the ASM Disk Groups window click Create New In the Create Disk Group window enter the following information for the database files a Inthe Disk Group Name field enter a name for the new disk group For example DATABASE b In the Redundancy box select External c Click Stamp Disks d Select Add or change label and click Next e Inthe Select disks screen select the disks which you plan to use for the database files Note that t
51. lick OK 16 Inthe Summary window click Install to start the installation procedure The Install window appears displaying an installation progression bar The Configuration Assistant window appears and the OUI runs a series of configuration tools The End of Installation window appears K NOTE If a failure occurs in the Configuration Assistant window perform the following steps and see Troubleshooting on page 64 and Working Around Clusterware Installation Failure on page 64 a In the error window click OK b In the Configuration Assistant window click Next c Ignore the warning message and click OK d Click Exit to finish the OUI session e In the Exit window click Yes If you are installing Oracle using ASM go to Installing Oracle RAC 10g R2 Using ASM on page 41 otherwise continue to Installing Oracle RAC 10g R2 Using OCFS Installing Oracle Database 10g R2 with Real Application Clusters 10 2 0 1 34 1 On node 1 insert the Oracle Database 10g Release 2 for Microsoft Windows CD into the CD drive The Oracle Database 10g Autorun window displays If the Oracle Database 10g Autorun window does not appear a Click Start Run b In the Run field enter the following and click OK CD ROM drive autorun autorun exe Deployment Guide 10 11 where CD ROM drive is the drive letter of your CD drive In the Oracle Database 10g Autorun window click Install Deinstall Products This will s
52. llowing steps a Verify the public private and virtual Host names for the primary node b Ifyou want to change these values click Edit and enter the desired values and click OK c Click Add d Enter the public private and virtual Host names for the second node and click OK Click Next The Specify Network Interface Usage window appears displaying a list of cluster wide network interfaces In the Interface Type drop down menus configure the public Interface Type as Public and the private Interface Type as Private if required by selecting the Interface Name and clicking Edit Select the correct Interface Type and click OK Click Next In the Cluster Configuration Storage screen perform the following steps for the OCR disk Deployment Guide a Locate the two 120 MB partitions that you created in the subsection Preparing the OCR and Voting Disks for Clusterware on page 27 b Select the first partition and click Edit c In the Specify Disk Configuration window select Place OCR Primary on this partition and click OK d Select the second partition and click Edit e In the Specify Disk Configuration window select Place OCR Mirror on this partition and click OK 11 In the Cluster Configure Storage screen perform the following steps for the Voting disk a Locate the three 50 MB partitions that you created in the subsection Preparing the OCR and Voting Disks for Clusterware on page 27 b Select the firs
53. n and click Next 11 In the Computer Name and Administrator password fields enter the appropriate information and click Next 12 Deployment Guide 12 13 14 15 16 17 18 19 K VAN CAUTION Do not leave the administrator password blank K NOTE To configure the public network properly the computer name and public host name must be identical K NOTE Record the logon password that you created in this step You will need this information in step 14 When the installation procedure completes the Welcome to Windows window appears Shut down the system reconnect all external storage devices and restart the system In the Welcome to Windows window press lt Ctrl gt lt Alt gt lt Delete gt to continue The Log On window appears In the Password field enter the administrator password that you created in step 11 in this procedure and click OK You are prompted to insert the Windows Server CD2 You can insert the Windows Server CD2 or select Cancel NOTE If you insert the Windows Server CD2 follow the prompts through the normal installation process The following process assumes you are not inserting the Windows Server CD2 Select Cancel you will be prompted that media on Windows Server CD2 will not be installed Select OK you are prompted to configure Windows Server Post Setup optional Select Finish you are prompted to close the page Select Yes The Manage Your Server windows management
54. ng Oracle using ASM ignore the following steps and follow the procedures in Installing Oracle RAC 10g R2 Using ASM on page 41 This section provides information about installing the Oracle RAC 10g R2 software The following topics are covered Installing Oracle Clusterware Version 10 2 0 1 Installing Oracle Database 10g R2 with Real Application Clusters 10 2 0 1 Installing 10 2 0 4 Patchset Configuring the Listener Creating the Seed Database Installing Oracle Clusterware Version 10 2 0 1 1 On node 1 insert the Oracle Clusterware 10g Release 2 for Microsoft Windows CD into the CD drive The Oracle Clusterware Autorun window displays If the Oracle Clusterware Autorun window does not appear a Click Start Run b Inthe Run field enter the following and click OK CD ROM drive autorun autorun exe where CD ROM drive is the drive letter of your CD drive Deployment Guide 31 32 In the Oracle Clusterware Autorun window click Install Deinstall Products This will start the Oracle Universal Installer OUI and the Welcome screen appears Click Next In the Specify Home Details window accept the default settings and click Next K NOTE Record the OraCR10g_home CRS Home path because you will need this information later In the Product Specification Prerequisite Checks window make sure all the checks are completed successfully and then click Next In the Specify Cluster Configuration window enter
55. nglish 7 On the Software License Agreement page click Accept The Systems Build and Update Utility home page appears 8 From the Dell Systems Build and Update Utility home page click Server OS Installation The Server OS Installation screen appears The Server Operating System Installation SOI module in the Dell Systems Build and Update Utility enables you to install Dell supported operating systems on your Dell systems K NOTE For more information on using the specific SOI screens see the Dell Systems Build and Update Utility online help The following steps will guide you through the SOI Set Date and Time a Set the current date and time and the time zone and click Continue Select Operation System b Select Microsoft Windows Server 2003 Service Pack 2 x64 Edition c Select Yes for Create Utility Partition d Click Continue Configure RAID K NOTE This menu may not appear depending on the system e Choose default selections and click Continue Configure Physical disk f Choose the default selections and click Continue Network Configuration g Choose the default selections and click Continue K NOTE To configure the public network properly the computer name and public host name must be identical Deployment Guide 11 Enter OS Information h Enter the appropriate User Name Organization and Product ID i Enter all other necessary information j Click Install SNMP default K NOTE If y
56. odes K NOTE The two bonded NIC ports for a private network should be on separate PCI buses For example a bonded pair can consist of one on board NIC and one add on NIC card Table 1 7 Network Configuration Example for a Two Node Cluster Host Name Type IP Address Registered In racl Public 155 16 170 1 SystemRoot system32 drivers etc hosts rac2 Public 155 16 170 2 SystemRoot system32 drivers etc hosts racl vip Virtual 155 16 170 201 SystemRoot system32 drivers etc hosts rac2 vip Virtual 155 16 170 202 SystemRoot system32 drivers etc hosts racl priv Private 10 10 10 1 SystemRoot system32 drivers etc hosts rac2 priv Private 10 10 10 2 SystemRoot system32 drivers etc hosts Configuring NIC Teaming For Your Private Network Adapters K NOTE TCP Offload Engine TOE functionality of a TOE capable NIC is not supported in this solution 1 On node 1 identify two network adapters that will be used for NIC teaming 2 Connect an Ethernet cable from each selected network adapter to the private network switch 3 If node 1 is configured with Broadcom NICs go to step 4 If node 1 is configured with Intel NICs configure NIC teaming by performing the following steps a Right click My Computer and select Manage b In the Computer Management window select Device Manager c Expand the Network Adapters tab 20 Deployment Guide d Right click the Intel NIC which is identified for NIC teaming and select Properties
57. of time perform the following procedures in order Configuring the Public and Private Networks K NOTE Each node requires a unique public and private internet protocol IP address and an additional public IP address to serve as the virtual IP address for the client connections and connection failover The virtual IP address must belong to the same subnet as the public IP address All public IP addresses including the virtual IP address should be registered with the domain naming system DNS If a DNS server is not available IP addresses have to be registered in the hosts file on all cluster nodes Depending on the number of NIC ports available configure the public and private interfaces as shown in Table 1 6 Table 1 6 NIC Port Assignments NIC Port Three Ports Available Four Ports Available 1 Public IP and virtual IP Public IP 2 Private IP NIC team Private IP NIC team 3 Private IP NIC team Private IP NIC team 4 NA Optional Public team or 3 member Private Team Deployment Guide 19 Configuring and Teaming the Private Network Before you deploy the cluster assign a private IP address and host name to each cluster node This procedure ensures that the nodes can communicate with each other through the private interface Table 1 7 provides an example of a network configuration for a two node cluster K NOTE This example assumes all the IP addresses are registered in the hosts file of all cluster n
58. onfiguration Assistant window appears and the Oracle software creates the database K NOTE This procedure may take several minutes to complete When completed the Database Configuration Assistant window provides database configuration information Record the information in the Database Configuration Assistant window for future database administration Click Exit The Start Cluster Database window appears and the cluster database starts Configuring and Deploying Oracle Database 10g Single Node This section provides information about installing the Oracle 10g R2 software on a single node This section covers the following topics Installing Oracle Clusterware Version 10 2 0 1 Installing Oracle 10g Database with Real Application Clusters 10 2 0 1 Installing the Oracle Database 10g 10 2 0 4 Patchset Configuring the Listener Creating the Seed Database Installing Oracle Clusterware Version 10 2 0 1 1 On node 1 insert the Oracle Clusterware CD into the CD drive The Oracle User Interface OUI starts and the Welcome screen appears If the Welcome screen does not appear a Click Start Run b Inthe Run field enter the following and click OK CD drive autorun autorun exe where CD drive is the drive letter of your CD drive 2 Inthe Oracle Clusterware window click Install Deinstall Products Deployment Guide 51 52 In the Welcome screen click Next In the Specify Home Details window accept the defa
59. ot the node where you are running the OUI exit and install the patchset from that node Patchset Installation Steps 1 Start the OUI located in the patchset folder 2 Inthe Welcome window click Next Deployment Guide 55 In the Specify home details window select the name as OraDb10g_homel from the drop down list to install the patchset to Oracle home and click Next In the Specify Hardware Cluster Installation Mode window select Local Installation and click Next In the Summary window click Install During the installation the following error message may appear Error in writing to file oci dll To work around this issue perform the following steps a Cancel the patchset installation b Rename the Oracle home BIN directory to bin_save c Reboot the system d After the reboot rename the bin_ save file to bin e Run the setup exe file from the patchset folder Allow all the Oracle default services to run From the End of Installation screen perform the necessary steps listed in the Summary windows At the End of Installation screen click Exit and then click Yes to exit the OUI Configuring the Listener This section contains procedures to configure the listener which is required to establish a remote client connection to a database Perform the following steps on node 1 1 2 3 56 Click Start gt Run and enter net ca Click OK In the Real Application Clusters Configuration window select Sin
60. ou have the De OpenManage CD and want to install it during your OS install select Install Server Administrator The Server Administrator can be installed anytime after the OS is installed Installation Summary k Click Eject CD DVD Automatically default K NOTE Once you click Continue the installation begins and you cannot change the configuration details of your system I Click Continue The Microsoft Windows Server 2003 Service Pack 2 x64 Edition Installation Wizard appears and the installation begins K NOTE This procedure may take several minutes to complete m When prompted insert the Windows Server 2003 Service Pack 2 x64 Edition CD in the CD drive K NOTE This procedure may take several minutes to complete K NOTE If you selected Install Server Administrator in the OS installation steps the prompt will ask you to insert the De OpenManage CD prior to installing the Windows Server 2003 Service Pack 2 x64 Edition CD n When the installation is completed remove the CD from the CD DVD drive and click Finish The system reboots copying the OS information to the Deployment partition and the installation continues K NOTE This procedure may take several minutes to complete 9 Inthe Personalize Your Software window in the Name and Organization fields enter the appropriate information and click Next 10 When prompted enter your Product Key for Windows Server 2003 SP2 Standard Enterprise x64 Editio
61. ow to add nodes and instances to Oracle RAC databases on Windows Preparing the Node to be Added to a Cluster Perform the following steps on the node s that you want to add to an existing cluster 1 Install and configure the operating system using the Deployment CDs 2 Configure the networking and fiber channel storage subsystem 60 Deployment Guide Make sure that you can execute the following command from each of the existing nodes of your cluster where the host_ name is the public network name of the new node NET USE host_name Cs You have the required administrative privileges on each node if the operating system responds with Command completed successfully K NOTE If you are using ASM then make sure that the new nodes can access the ASM disks with the same permissions as the existing nodes K NOTE If you are using Oracle Cluster File Systems then make sure that the new nodes can access the cluster file systems in the same way that the other nodes access them Now the node s is ready to be added to an existing cluster The steps to add a node to an existing cluster can be summarized as below 1 Adding Nodes at the Oracle Clusterware Layer 2 Adding Nodes at the Oracle RAC Database Layer 3 Adding Database Instances to New Nodes Adding Nodes at the Oracle Clusterware Layer Perform the following steps 1 Onone of the existing nodes go to the CRS home oui bin directory Run the addNode bat script to
62. patchset from that node Start the OUI located in the patchset folder For example Deployment Guide sSystemDrive Oracle patch setup exe where SystemDrive is the drive on which you unzipped the Oracle patchset 2 Inthe Welcome screen click Next ow In the Specify home details window select name as OraCr10g_home from the drop down list and click Next In the Specify Hardware Cluster Installation Mode window click Next In the Product Specific Prerequisite Checks window click Next In the Summary window click Install u oO 0 A In the End of Installation window perform all the steps listed in the Summary window Do not perform the step instructing you to stop the Oracle services you should have already completed that step before you began installing the patchset as mentioned in Before You Begin on page 36 On the End of Installation window click Exit 9 Click Yes to exit from the OUI Installing Patchset 10 2 0 4 for Oracle 10g Database K NOTE Before you install the patchset ensure that all the Oracle services are running Complete the following procedures before creating a listener and a seed database Installing the Patchset K NOTE You must install the patchset software from the node where the RAC 10g R2 software was installed If this node is not the one where you are running the OUI exit and install the patchset from that node 1 Start the OUI located in the unzipped area of the patchs
63. plicable This document covers the following topics e Software and hardware requirements e Installing and configuring Microsoft Windows Server 2003 R2 with SP2 Standard Enterprise x64 Edition e Verifying cluster hardware and software configurations e Configuring networking and storage for Oracle Database Real Application Clusters RAC 10g R2 e Installing Oracle Database RAC 10g R2 10 2 0 4 patchset and software updates e Supported software stack e Troubleshooting e Getting help For more information on Dell s Supported Configurations for Oracle see the Dell and Oracle website at dell com 10g If you purchased the Oracle Database RAC 10g Deployment Service your Dell Professional Services representative will assist you with the following e Verifying cluster hardware and software configurations e Configuring networking and storage e Installing Oracle Database RAC 10g R2 10 2 0 4 patchset and software updates Terminology Used in this Document This document uses the terms logical unit number LUN and virtual disk These terms are synonymous and can be used interchangeably The term LUN is commonly used in a DellIEMC Fibre Channel storage system environment and Deployment Guide 7 virtual disk is commonly used in a Direct attached SAS Dell MD3000 MD30001 and Dell MD3000 MD3000i with MD1000 expansion storage environment Software and Hardware Requirements The following sections describe the minimum software
64. proceeding to the next step After completing the required procedures as listed in the End of Installation window click Exit In the Exit Window click Yes Installing Oracle 10g R2 Patchset 10 2 0 4 1 Ensure that only 10 2 0 1 Clusterware and 10 2 0 1 Database binaries are installed on your system and that the seed database is not created yet Download the patchset 10 2 0 4 from the Oracle Metalink website at metalink oracle com Search for patch number 6810189 and select Microsoft Windows Server 2003 AMD64 and EM64T as the platform or language 3 Unzip the patchset to SystemDrive Installing Patchset 10 2 0 4 for Oracle 10g Clusterware Before You Begin Before you install patchset 10 2 0 4 for Oracle 10g Clusterware on your system perform the following steps 1 Stop nodeapps on all the nodes Enter the following sSystemDrive CRS_HOME bin gt srvctl stop nodeapps n lt node name gt where SystemDrive is the drive on which Oracle home is configured and CRS HOME is the home directory that you created in step 4 in Installing Oracle Clusterware Version 10 2 0 1 on page 42 Click Start gt Programs Administrator Tools Services to locate all Oracle services and stop them on both nodes Installing the Patchset K NOTE You must install the patchset software from the node where the RAC 10g R2 36 software was installed If this is not the node where you are running the OUI exit and install the
65. r future database administration Click Exit The Start Cluster Database window appears and the cluster database starts Installing Oracle RAC 10g R2 Using ASM K NOTE If you are installing Oracle using OCFS ignore the following steps and follow the procedures in Installing Oracle RAC 10g R2 Using OCFS on page 31 This section provides information about installing the Oracle RAC 10g R2 software The following topics are covered Installing Oracle Clusterware Version 10 2 0 1 Installing Oracle 10g Database with Real Application Clusters 10 2 0 1 Installing Patchset 10 2 0 4 Configuring the Listener Creating the Seed Database Deployment Guide 41 Installing Oracle Clusterware Version 10 2 0 1 1 42 On node 1 insert the Oracle Clusterware CD into the CD drive The OUI starts and the Welcome screen appears If the Welcome screen does not appear a Click Start gt Run b Inthe Run field enter the following and click OK CD drive autorun autorun exe where CD drive is the drive letter of your CD drive In the Oracle Clusterware window click Install Deinstall Products In the Welcome screen click Next In the Specify Home Details window accept the default settings and click Next K NOTE Record the OraCR10g_home CRS Home path because you will need this information later In the Product Specific Prerequisite Checks window click Next In the Specify Cluster Configuration window perform the fo
66. rts In the Welcome window select Oracle Real Application Clusters database and click Next In the Operations window click Create a Database and click Next In the Node Selection window click Select All and click Next In the Database Templates window click Custom Database and click Next In the Database Identification window in the Global Database Name field enter a name such as racdb and click Next In the Management Options window accept the default selections and click Next Deployment Guide 39 40 11 In the Database Credentials window click Use the Same Password for All Accounts enter a new password in the appropriate fields and click Next K NOTE Record your new password for later use in database administration In the Storage Options window select Cluster File System and click Next In the Database File Locations window select the location for storing database files a Select Use Common Location for All Database Files b Click Browse c Inthe Directory Browse window use the pull down menu and select the CFS drive created in step e in step 12 in Installing Oracle Clusterware Version 10 2 0 1 on page 31 d Click OK Click Next In the Recovery Configuration window perform the following steps a Select Specify Flash Recovery Area b Click Browse c Inthe Directory Browse window use the pull down menu and select the CFS drive created in step e in step 13 in Installing Oracle Clusterware
67. s required to establish a remote client connection to a database Perform the following steps on node 1 1 2 3 10 11 12 Click Start gt Run and enter net ca Click OK In the Real Application Clusters Configuration window select Cluster configuration and click Next In the Real Application Clusters Active Nodes window select Select All nodes and click Next In the Welcome window select Listener configuration and click Next In the Listener Configuration Listener window select Add and click Next In the Listener Configuration Listener Name window select the default setting in the Listener name field and click Next In the Listener Configuration Select Protocols window select TCP in the Selected protocols field and click Next In the Listener Configuration TCP IP Protocol window select Use the standard port number of 1521 and click Next In the Listener Configuration More Listeners window select No and click Next In the Listener Configuration Done window click Next In the Welcome window click Finish Creating the Seed Database Perform the following steps to create the seed database using Oracle ASM 1 Verify the Oracle Clusterware is running a Open a command prompt window Click Start gt Run and enter cmd b Entercrsctl check crs The following output should appear CSS appears healthy CRS appears healthy Deployment Guide 47 48 on Oo ol EVM appears healthy K NOTE If the
68. sappear c Click Options and select Exit to close the Oracle Object Manager Launch the Computer Management Console a On the Windows desktop click Start and select Run b Inthe Run field enter the following compmgmt msc The Computer Management Console window appears Delete the ASM or OCFS partitions a Inthe Computer Management Console window click Storage and select Disk Management b Right click the first partition and select Delete Logical Drive c When prompted click Yes d Repeat step b and step c for each remaining partition until all partitions including the original extended partition have been deleted Restart node 1 and log in as administrator After you are logged in as administrator on node 1 restart each of the remaining nodes and log in as administrator l Deployment Guide 11 Repeat the procedures Preparing the Disks for Oracle Clusterware on page 26 and Removing the Assigned Drive Letters on page 30 to recreate your logical partitions and the procedure Installing Oracle RAC 10g R2 Using OCFS on page 31 to re install Oracle RAC for OCFS or Installing Oracle RAC 10g R2 Using ASM on page 41 to re install Oracle RAC for ASM Additional Troubleshooting This section provides recommended actions for additional problems that you may encounter PowerPath Installation PROBLEM PowerPath installation fails CAUSE Unknown installation error RESOLUTION Reboot the system on which the Power
69. start the OUI 2 The OUI runs in the add node mode and the OUI Welcome page appears Click Next and the Specify Cluster Nodes for Node Addition page appears 3 The upper table on the Specify Cluster Nodes for Node Addition page shows the existing nodes associated with the CRS home from which you launched the OUI Use the lower table to enter the public and private node names of the new nodes 4 If all the checks succeed then the OUI displays the Node Addition Summary page 5 Click Next and the OUI displays the Cluster Node Addition Progress page 6 Oncompletion click Exit to end the OUI session After the OUI displays the End of Node Addition page click Exit to end the OUI session Deployment Guide 61 Execute the following command to identify the node names and node numbers that are currently in use CRS home bin olsnodes n Execute the crssetup exe command using the next available node names and node numbers to add CRS information for the new nodes For example crssetup exe add nn publicnode3 3 pn pvtnode3 3 vn vipnode3 3 Execute the racgons utility from the bin subdirectory of the CRS home to configure the Oracle Notification Services ONS port number as follows racgons add_config new_node_name 4948 After you have completed the procedures in this section for adding nodes at the Oracle Clusterware layer you have successfully extended the CRS home from your existing CRS home to the new nodes Adding Nodes at t
70. t partition and click Edit c Inthe Specify Disk Configuration window select Place Voting Disk on this partition and click OK d Repeat steps b and c on the remaining Voting Disk partitions 12 Click Next 13 Ignore the warning messages and click OK 14 In the Summary window click Install to start the installation procedure K NOTE If a failure occurs in the Configuration Assistant window perform the following steps and see Troubleshooting on page 64 and Working Around Clusterware Installation Failure on page 64 of this document The Install window appears displaying an installation progression bar The Configuration Assistant window appears and the OUI runs a series of configuration tools The End of Installation window appears 15 Click Exit to finish the OUI session 16 In the Exit window click Yes Installing Oracle10g Database With Real Application Clusters 10 2 0 1 K NOTE If you are installing Oracle using OCFS skip these steps and go to Installing Oracle RAC 10g R2 Using OCFS on page 31 Deployment Guide 43 44 10 11 Insert the Oracle Database 10g Release 2 CD into the CD drive The OUI starts and the Welcome screen appears If the Welcome screen does not appear a Click Start gt Run b Inthe Run field enter CD drives autorun autorun exe where CD drive is the drive letter of your CD drive Click OK to continue The OUI starts and the Welcome window appears Click Next In the S
71. tart the OUI and the Welcome screen appears Click Next In the Select Installation Type window select Enterprise Edition and click Next In the Specify Home Details window under Destination verify the following e Inthe Name field the Oracle database home name is OraDb10g_homel e In the Path field the complete Oracle home path is SystemDrive oracle product 10 2 0 db_1 where 3SystemDrive is the user s local drive By default OUI chooses one of CFS shared drive for copying the database files Change the drive to the Syst emDrive by changing the drive letter in the Path field K NOTE Record the path for later use K NOTE The Oracle home path must be different from the Oracle home path that you selected in the Oracle Clusterware installation procedure You cannot install the Oracle10g Enterprise x64 Edition with RAC and Clusterware in the same home directory Click Next In the Specify Hardware Cluster Installation Mode window select Select All and click Next In the Product Specific Prerequisite Checks window make sure all the checks are completed successfully and click Next In the Select Configuration Option window select Install Database Software Only and click Next In the Summary window click Install In the End of Installation window perform the procedure as listed in the window Deployment Guide 35 12 13 K NOTE You must perform the procedures as listed in the window before
72. the Select Partition Type window select Extended partition and click Next In the Specify Partition Size window accept the default partition size and click Next Click Finish The disk partition area you selected in step 3 is configured as an extended partition Repeat step 3 through step 7 on all shared disks that are assigned to the cluster nodes Create a logical drive for the OCR disk a On the partition area of the disk identified for OCR and voting disk 1 GB LUN virtual disk right click the free space and select New Logical Drive Deployment Guide 27 28 10 g h The Welcome to the New Partition Wizard appears Click Next In the Select Partition Type window select Logical drive and click Next In the Specify Partition Size window enter 120 in the Partition size in MB field and click Next In the Assign Drive Letter or Path window select Do not assign a drive letter or drive path and click Next In the Format Partition window select Do not format this partition and click Next Click Finish Repeat steps a through g to create an additional OCR disk Create a logical drive for the Voting Disk On the partition area of the disk identified for the OCR and voting disk 1 GB LUN virtual disk right click the free space and select New Logical Drive The Welcome to the New Partition Wizard appears Click Next In the Select Partition Type window select Logical drive and click Next In the Spe
73. to download the latest updates for your system visit the Dell Support website at support dell com Information about contacting Dell is provided in your system Installation and Troubleshooting Guide Dell Enterprise Training and Certification is now available see dell com training for more information This training service may not be offered in all locations Oracle Support For information about Oracle software and application clusterware training and contacting Oracle see the Oracle website at www oracle com or your Oracle documentation Technical support downloads and other technical information are available at the Oracle MetaLink website at www metalink oracle com Obtaining and Using Open Source Files The software contained on the Deployment CD is an aggregate of third party programs as well as Dell programs Use of the software is subject to designated license terms All software that is designated as under the terms of the GNU GPL may be copied distributed and or modified in accordance with the terms and conditions of the GNU General Public License Version 2 June 1991 All software that is designated as under the terms of the GNU LGPL or Lesser GPL may be copied distributed and or modified in accordance with the terms and conditions of the GNU Lesser General Public License Version 2 1 February 1999 Under these GNU licenses you are also entitled to obtain the corresponding source files by contacting Dell at 1 800 WWW
74. ult settings and click Next K NOTE Record the OraCR10g_home CRS Home path because you will need this information later In the Product Specific Prerequisite Checks window click Next In the Specify Cluster Configuration window perform the following steps a Verify the public private and virtual Host names for the primary node b Ifyou want to change these values click Edit and enter the desired values and click OK Click Next The Specify Network Interface Usage window appears displaying a list of cluster wide network interfaces In the Interface Type drop down menus configure the public Interface Type as Public and the private Interface Type as Private if required by selecting the Interface Name and clicking Edit Select the correct Interface Type and click OK Click Next In the Cluster Configuration Storage screen perform the following steps for the OCR disk a Locate the 120 MB partition that you created in the subsection Preparing the OCR and Voting Disks for Clusterware on page 27 b Select the partition and click Edit c Inthe Specify Disk Configuration window select Place OCR Primary on this partition and click OK In the Cluster Configure Storage screen perform the following steps for the Voting disk a Locate the 50 MB partition that you created in the subsection Preparing the OCR and Voting Disks for Clusterware on page 27 b Select the partition and click Edit c Inthe Specify Disk
75. window displays Close the window NOTE To use the Broadcom Advanced Control Suite 3 BACS install Microsoft NET Framework 2 0 The Microsoft NET Framework 2 0 can be downloaded from www microsoft com Installing the Resource CD 20 21 Insert the CD labeled Dell RCD x64 v4 0 Go to My Computer and double click your CD ROM drive Deployment Guide 13 22 Run install_drivers bat K NOTE This procedure may take several minutes to complete 23 Press any key to continue 24 If your current system is a Dell PowerEdge Server M600 M605 M805 or M905 see Table 1 3 on page 14 for information on manually installing the HBA drivers Otherwise skip to step 25 25 Check the logs to verify that all drivers were installed correctly K NOTE Log information can be found at C Dell_Resource_CD logs 26 When installation is complete remove the CD from the CD drive 27 Reboot your system Table 1 3 HBA Driver Installation Utility HBA Type System Type File Name Emulex LPe1205 M M600 M605 Emulex storport64 FC8M FC8 DUP exe M805 M905 Emulex storport64 DUP exe Emulex LPe1105 M600 M605 M805 Emulex storport64 DUP exe M4 FC4 M905 Qlogic QME2572 M600 M605 M805 Qlogic storport64 FC8M FC8 M905 DUP exe Qlogic QME2472 M600 M605 M805 Qlogic storport64 DUP exe FC4 M905 K NOTE The HBA driver installation utilities are located at C Dell_Resource_CD Utilities Verifying the Temporary Directory Paths
76. window verify that four disks appear The disks should be similar in size to each other and to the LUNs virtual disks that are assigned to the nodes in the storage system Repeat step 1 through step 6 on the remaining nodes Installing Multi Path Software for Storage Follow the documentation accompanying the storage device to install the appropriate multi path software Deployment Guide 25 Installing PowerPath for Dell EMC Systems 1 On node 1 install EMC PowerPath K NOTE For more information see the EMC PowerPath documentation that came with your Dell EMC storage system 2 When the installation procedure is complete restart your system 3 Repeat step 1 and step 2 on the remaining nodes Verifying Multi Path Driver Functionality 1 Right click My Computer and select Manage 2 Expand Storage and click Disk Management One disk appears for each LUN assigned in the storage 3 Ensure that each LUN is configured as a Basic disk 4 Repeat step 1 through step 3 on the remaining nodes Preparing the Disks for Oracle Clusterware This section provides information for creating the logical drives for the following disks e Oracle Cluster Registry disk OCR Contains the cluster configuration information e Voting disk Provides arbitration between the cluster nodes when the private network or attached storage is unavailable to one or more nodes e Data and backup disks Provide storage areas for creating the data

Dell 10g Deployment Guide

Contents

Download Pdf Manuals

Related Search

Related Contents