Contents

List of Tables

Title and Copyright Information

Preface

• Intended Audience
• Documentation Accessibility
• Related Documents
• Conventions

What's New in Oracle Grid Infrastructure Installation and Configuration?

• Desupported Options
• New Features for Release 2 (11.2.0.3)
• New Features for Release 2 (11.2.0.2)
• New Features for Release 2 (11.2)
• New Features for Release 1 (11.1)

1 Typical Installation for Oracle Grid Infrastructure for a Cluster

• 1.1 Typical and Advanced Installation
• 1.2 Preinstallation Steps Completed Using Typical Installation
• 1.3 Preinstallation Steps Requiring Manual Tasks
  • 1.3.1 Verify System Requirements
  • 1.3.2 Check Network Requirements
    • 1.3.2.1 Single Client Access Name (SCAN) for the Cluster
    • 1.3.2.2 IP Address Requirements
    • 1.3.2.3 Redundant Interconnect Usage
    • 1.3.2.4 Intended Use of Network Interfaces
  • 1.3.3 Check Operating System Packages
  • 1.3.4 Create Groups and Users
  • 1.3.5 Check Storage
  • 1.3.6 Prepare Storage for Oracle Automatic Storage Management
  • 1.3.7 Install Oracle Grid Infrastructure Software

2 Advanced Installation Oracle Grid Infrastructure for a Cluster Preinstallation Tasks

• 2.1 Reviewing Upgrade Best Practices
• 2.2 Installation Fixup Scripts
• 2.3 Logging In to a Remote System Using X Terminal
• 2.4 Creating Groups, Users and Paths for Oracle Grid Infrastructure
  • 2.4.1 Determining If the Oracle Inventory and Oracle Inventory Group Exists
  • 2.4.2 Creating the Oracle Inventory Group If an Oracle Inventory Does Not Exist
  • 2.4.3 Creating the Oracle Grid Infrastructure User
    • 2.4.3.1 Understanding Restrictions for Oracle Software Installation Owners
    • 2.4.3.2 Determining if an Oracle Software Owner User Exists
    • 2.4.3.3 Creating or Modifying an Oracle Software Owner User for Oracle Grid Infrastructure
  • 2.4.4 Creating the Oracle Base Directory Path
  • 2.4.5 Creating Job Role Separation Operating System Privileges Groups and Users
    • 2.4.5.1 Overview of Creating Job Role Separation Groups and Users
    • 2.4.5.2 Creating Database Groups and Users with Job Role Separation
  • 2.4.6 Example of Creating Standard Groups, Users, and Paths
  • 2.4.7 Example of Creating Role-allocated Groups, Users, and Paths
• 2.5 Checking the Hardware Requirements
• 2.6 Checking the Network Requirements
  • 2.6.1 Network Hardware Requirements
  • 2.6.2 IP Address Requirements
    • 2.6.2.1 IP Address Requirements with Grid Naming Service
    • 2.6.2.2 IP Address Requirements for Manual Configuration
  • 2.6.3 Broadcast Requirements for Networks Used by Oracle Grid Infrastructure
  • 2.6.4 Multicast Requirements for Networks Used by Oracle Grid Infrastructure
  • 2.6.5 DNS Configuration for Domain Delegation to Grid Naming Service
  • 2.6.6 Grid Naming Service Configuration Example
  • 2.6.7 Manual IP Address Configuration Example
  • 2.6.8 Network Interface Configuration Options
  • 2.6.9 Checking the Run Level and Name Service Cache Daemon
  • 2.6.10 Checking Oracle Solaris Service Management Facility Status
• 2.7 Identifying Software Requirements
  • 2.7.1 Software Requirements List for Oracle Solaris (SPARC 64-Bit) Platforms
  • 2.7.2 Software Requirements List for Oracle Solaris (x86 64-Bit) Platforms
• 2.8 Oracle Solaris Cluster Configuration on SPARC Guidelines
• 2.9 Checking the Software Requirements
• 2.10 Verifying UDP and TCP Kernel Parameters
• 2.11 Verifying Operating System Patches
• 2.12 Running the Rootpre.sh Script on x86-64 with Oracle Solaris Cluster
• 2.13 Network Time Protocol Setting
• 2.14 Enabling Intelligent Platform Management Interface (IPMI)
  • 2.14.1 Requirements for Enabling IPMI
    • 2.14.1.1 IPMI Firmware Patches
  • 2.14.2 Configuring the IPMI Management Network
  • 2.14.3 Configuring the BMC
    • 2.14.3.1 Configuring IPMI in the ILOM Processor on Oracle Solaris
    • 2.14.3.2 Example of BMC Configuration Using IPMItool
• 2.15 Automatic SSH Configuration During Installation
• 2.16 Configuring Grid Infrastructure Software Owner User Environments
  • 2.16.1 Environment Requirements for Oracle Grid Infrastructure Software Owner
  • 2.16.2 Procedure for Configuring Oracle Software Owner Environments
  • 2.16.3 Configuring Shell Limits
  • 2.16.4 Setting Display and X11 Forwarding Configuration
  • 2.16.5 Preventing Installation Errors Caused by Terminal Output Commands
• 2.17 Requirements for Creating an Oracle Grid Infrastructure Home Directory
• 2.18 Cluster Name Requirements

3 Configuring Storage for Grid Infrastructure for a Cluster and Oracle Real Application Clusters (Oracle RAC)

• 3.1 Reviewing Oracle Grid Infrastructure Storage Options
  • 3.1.1 Overview of Oracle Clusterware and Oracle RAC Storage Options
  • 3.1.2 General Information About Oracle ACFS
  • 3.1.3 General Storage Considerations for Oracle Grid Infrastructure and Oracle RAC
    • 3.1.3.1 General Storage Considerations for Oracle Clusterware
    • 3.1.3.2 General Storage Considerations for Oracle RAC
  • 3.1.4 Guidelines for Using Oracle ASM Disk Groups for Storage
  • 3.1.5 Using Logical Volume Managers with Oracle Grid Infrastructure and Oracle RAC
  • 3.1.6 Supported Storage Options
  • 3.1.7 After You Have Selected Disk Storage Options
• 3.2 Shared File System Storage Configuration
  • 3.2.1 Requirements for Using a Shared File System
  • 3.2.2 Checking UDP Parameter Settings
  • 3.2.3 Deciding to Use a Cluster File System for Oracle Clusterware Files
  • 3.2.4 Deciding to Use Direct NFS for Data Files
    • 3.2.4.1 About Direct NFS Storage
    • 3.2.4.2 Using the Oranfstab File with Direct NFS
    • 3.2.4.3 Mounting NFS Storage Devices with Direct NFS
    • 3.2.4.4 Specifying Network Paths with the Oranfstab File
  • 3.2.5 Deciding to Use NFS for Data Files
  • 3.2.6 Configuring Storage NFS Mount and Buffer Size Parameters
  • 3.2.7 Checking NFS Mount and Buffer Size Parameters for Oracle Clusterware
  • 3.2.8 Checking NFS Mount and Buffer Size Parameters for Oracle RAC
  • 3.2.9 Enabling Direct NFS Client Oracle Disk Manager Control of NFS
  • 3.2.10 Creating Directories for Oracle Clusterware Files on Shared File Systems
  • 3.2.11 Creating Directories for Oracle Database Files on Shared File Systems
  • 3.2.12 Disabling Direct NFS Client Oracle Disk Management Control of NFS
• 3.3 Oracle Automatic Storage Management Storage Configuration
  • 3.3.1 Configuring Storage for Oracle Automatic Storage Management
    • 3.3.1.1 Identifying Storage Requirements for Oracle ASM
    • 3.3.1.2 Creating Files on a NAS Device for Use with Oracle ASM
    • 3.3.1.3 Using an Existing Oracle ASM Disk Group
    • 3.3.1.4 Configuring Disk Devices for Oracle ASM
  • 3.3.2 Using Disk Groups with Oracle Database Files on Oracle ASM
    • 3.3.2.1 Identifying and Using Existing Oracle Database Disk Groups on Oracle ASM
    • 3.3.2.2 Creating Disk Groups for Oracle Database Data Files
  • 3.3.3 Configuring Oracle Automatic Storage Management Cluster File System
  • 3.3.4 Upgrading Existing Oracle ASM Instances
• 3.4 Desupport of Block and Raw Devices

4 Installing Oracle Grid Infrastructure for a Cluster

• 4.1 Preparing to Install Oracle Grid Infrastructure with OUI
• 4.2 Installing Grid Infrastructure
  • 4.2.1 Running OUI to Install Grid Infrastructure
  • 4.2.2 Installing Grid Infrastructure Using a Cluster Configuration File
• 4.3 Installing Grid Infrastructure Using a Software-Only Installation
  • 4.3.1 Installing the Software Binaries
  • 4.3.2 Configuring the Software Binaries
  • 4.3.3 Configuring the Software Binaries Using a Response File
• 4.4 Restrictions for Oracle Berkeley DB
• 4.5 Confirming Oracle Clusterware Function
• 4.6 Confirming Oracle ASM Function for Oracle Clusterware Files
• 4.7 Understanding Offline Processes in Oracle Grid Infrastructure

5 Oracle Grid Infrastructure Postinstallation Procedures

• 5.1 Required Postinstallation Tasks
  • 5.1.1 Download and Install Patch Updates
• 5.2 Recommended Postinstallation Tasks
  • 5.2.1 Back Up the root.sh Script
  • 5.2.2 Configure IPMI-based Failure Isolation Using Crsctl
  • 5.2.3 Tune Semaphore Parameters
  • 5.2.4 Create a Fast Recovery Area Disk Group
    • 5.2.4.1 About the Fast Recovery Area and the Fast Recovery Area Disk Group
    • 5.2.4.2 Creating the Fast Recovery Area Disk Group
• 5.3 Using Older Oracle Database Versions with Grid Infrastructure
  • 5.3.1 General Restrictions for Using Older Oracle Database Versions
  • 5.3.2 Using ASMCA to Administer Disk Groups for Older Database Versions
  • 5.3.3 Pinning Cluster Nodes for Oracle Database Release 10.x or 11.x
  • 5.3.4 Enabling The Global Services Daemon (GSD) for Oracle Database Release 9.2
  • 5.3.5 Using the Correct LSNRCTL Commands
• 5.4 Modifying Oracle Clusterware Binaries After Installation

6 How to Modify or Deinstall Oracle Grid Infrastructure

• 6.1 Deciding When to Deinstall Oracle Clusterware
• 6.2 Migrating Standalone Grid Infrastructure Servers to a Cluster
• 6.3 Relinking Oracle Grid Infrastructure for a Cluster Binaries
• 6.4 Changing the Oracle Grid Infrastructure Home Path
• 6.5 Deconfiguring Oracle Clusterware Without Removing Binaries
• 6.6 Removing Oracle Clusterware and Oracle ASM
  • 6.6.1 About the Deinstallation Tool
  • 6.6.2 Deinstalling Previous Release Grid Home
  • 6.6.3 Downloading The Deinstall Tool for Use with Failed Installations
  • 6.6.4 Deinstall Command Example for Oracle Clusterware and Oracle ASM
  • 6.6.5 Deinstallation Parameter File Example for Grid Infrastructure for a Cluster

A Troubleshooting the Oracle Grid Infrastructure Installation Process

• A.1 General Installation Issues
  • A.1.1 Other Installation Issues and Errors
• A.2 Interpreting CVU "Unknown" Output Messages Using Verbose Mode
• A.3 Interpreting CVU Messages About Oracle Grid Infrastructure Setup
• A.4 About the Oracle Clusterware Alert Log
• A.5 Performing Cluster Diagnostics During Oracle Grid Infrastructure Installations
• A.6 About Using CVU Cluster Healthchecks After Installation
• A.7 Interconnect Configuration Issues
  • A.7.1 IP Network Multipathing (IPMP) Issues
  • A.7.2 Aggregated NIC Card Issues
  • A.7.3 Highly Available IP Address (HAIP) Issues
• A.8 SCAN VIP and SCAN Listener Issues
• A.9 Storage Configuration Issues
  • A.9.1 Recovery from Losing a Node Filesystem or Grid Home
• A.10 Completing an Installation Before Completing the Scripts

B Installing and Configuring Oracle Database Using Response Files

• B.1 How Response Files Work
  • B.1.1 Reasons for Using Silent Mode or Response File Mode
  • B.1.2 General Procedure for Using Response Files
• B.2 Preparing a Response File
  • B.2.1 Editing a Response File Template
  • B.2.2 Recording a Response File
• B.3 Running the Installer Using a Response File
• B.4 Running Net Configuration Assistant Using a Response File
• B.5 Postinstallation Configuration Using a Response File
  • B.5.1 About the Postinstallation Configuration File
  • B.5.2 Running Postinstallation Configuration Using a Response File

C Oracle Grid Infrastructure for a Cluster Installation Concepts

• C.1 Understanding Preinstallation Configuration
  • C.1.1 Understanding Oracle Groups and Users
    • C.1.1.1 Understanding the Oracle Inventory Group
    • C.1.1.2 Understanding the Oracle Inventory Directory
  • C.1.2 Understanding the Oracle Base Directory Path
    • C.1.2.1 Overview of the Oracle Base directory
    • C.1.2.2 Understanding Oracle Base and Grid Infrastructure Directories
  • C.1.3 Understanding Network Addresses
    • C.1.3.1 About the Public IP Address
    • C.1.3.2 About the Private IP Address
    • C.1.3.3 About the Virtual IP Address
    • C.1.3.4 About the Grid Naming Service (GNS) Virtual IP Address
    • C.1.3.5 About the SCAN
  • C.1.4 Understanding Network Time Requirements
• C.2 Understanding Storage Configuration
  • C.2.1 Understanding Oracle Automatic Storage Management Cluster File System
  • C.2.2 About Migrating Existing Oracle ASM Instances
  • C.2.3 About Converting Standalone Oracle ASM Installations to Clustered Installations
• C.3 Understanding Server Pools
  • C.3.1 Overview of Server Pools and Policy-based Management
  • C.3.2 How Server Pools Work
  • C.3.3 The Free Server Pool
  • C.3.4 The Generic Server Pool
• C.4 Understanding Out-of-Place Upgrade

D How to Complete Installation Prerequisite Tasks Manually

• D.1 Configuring SSH Manually on All Cluster Nodes
  • D.1.1 Checking Existing SSH Configuration on the System
  • D.1.2 Configuring SSH on Cluster Nodes
    • D.1.2.1 Create SSH Directory, and Create SSH Keys On Each Node
    • D.1.2.2 Add All Keys to a Common authorized_keys File
  • D.1.3 Enabling SSH User Equivalency on Cluster Nodes
• D.2 Configuring Kernel Resources
  • D.2.1 Configuring Kernel Parameters for SPARC Systems Running Oracle Solaris 10

E How to Upgrade to Oracle Grid Infrastructure 11g Release 2

• E.1 Back Up the Oracle Software Before Upgrades
• E.2 Unset Oracle Environment Variables
• E.3 About Oracle ASM and Oracle Grid Infrastructure Installation and Upgrade
• E.4 Restrictions for Clusterware and Oracle ASM Upgrades
• E.5 Preparing to Upgrade an Existing Oracle Clusterware Installation
  • E.5.1 Checks to Complete Before Upgrade an Existing Oracle Clusterware Installation
• E.6 Using CVU to Validate Readiness for Oracle Clusterware Upgrades
  • E.6.1 About the CVU Grid Upgrade Validation Command Options
  • E.6.2 Example of Verifying System Upgrade Readiness for Grid Infrastructure
  • E.6.3 Verifying System Readiness for Oracle Database Upgrades
• E.7 Performing Rolling Upgrades From an Earlier Release
  • E.7.1 Performing a Rolling Upgrade of Oracle Clusterware
  • E.7.2 Performing a Rolling Upgrade of Oracle Automatic Storage Management
    • E.7.2.1 Preparing to Upgrade Oracle ASM
    • E.7.2.2 Upgrading Oracle ASM
• E.8 Updating DB Control and Grid Control Target Parameters
• E.9 Unlocking the Existing Oracle Clusterware Installation
• E.10 Downgrading Oracle Clusterware After an Upgrade
• E.11 Checking Cluster Health Monitor Repository Size After Upgrading

Index