Using Virtual SCSI Host Bus Adapters

Oracle^® VM Server for SPARC 3.3 Administration Guide

» ...Documentation Home » Oracle VM Server for SPARC 3.3 Documentation ... » Oracle^® VM Server for SPARC 3.3 ... » Oracle VM Server for SPARC 3.3 Software » Using Virtual SCSI Host Bus Adapters

Updated: October 2015

Oracle^® VM Server for SPARC 3.3 Administration Guide

Document Information

Using This Documentation

Product Documentation Library

Feedback

Part I Oracle VM Server for SPARC 3.3 Software

Chapter 1 Overview of the Oracle VM Server for SPARC Software

About Oracle VM Server for SPARC and Oracle Solaris OS Versions

Hypervisor and Logical Domains

Logical Domains Manager

Roles for Domains

Command-Line Interface

Resource Configuration

Persistent Configurations

Oracle VM Server for SPARC Physical-to-Virtual Conversion Tool

Oracle VM Server for SPARC Management Information Base

Oracle VM Server for SPARC Troubleshooting

Chapter 2 Oracle VM Server for SPARC Security

Delegating the Management of Logical Domains by Using Rights

Using Rights Profiles and Roles

Managing User Rights Profiles

How to Assign a Rights Profile to a User

Assigning Roles to Users

How to Create a Role and Assign the Role to a User

Logical Domains Manager Profile Contents

Controlling Access to a Domain Console by Using Rights

How to Control Access to All Domain Consoles by Using Roles

How to Control Access to All Domain Consoles by Using Rights Profiles

How to Control Access to a Single Console by Using Roles

How to Control Access to a Single Console by Using Rights Profiles

Enabling and Using Logical Domains Manager Auditing

How to Enable Logical Domains Manager Auditing

How to Disable Logical Domains Manager Auditing

How to Review Audit Records

Using Domain Console Logging

How to Enable or Disable Console Logging

Service Domain Requirements for Domain Console Logging

Chapter 3 Setting Up Services and the Control Domain

Output Messages

Creating Default Services

How to Create Default Services

Initial Configuration of the Control Domain

Configuring the Control Domain

How to Configure the Control Domain

Decreasing the CPU and Memory Resources From the Control Domain's Initial factory-default Configuration

How to Decrease the CPU and Memory Resources From the Control Domain's Initial factory-default Configuration

Rebooting to Use Domains

How to Reboot

Enabling Networking Between the Oracle Solaris 10 Service Domain and Other Domains

How to Configure the Virtual Switch as the Primary Interface

Enabling the Virtual Network Terminal Server Daemon

How to Enable the Virtual Network Terminal Server Daemon

Verifying That the ILOM Interconnect Is Enabled

How to Verify the ILOM Interconnect Configuration

How to Re-Enable the ILOM Interconnect Service

Chapter 4 Setting Up Guest Domains

Creating and Starting a Guest Domain

How to Create and Start a Guest Domain

Installing Oracle Solaris OS on a Guest Domain

Memory Size Requirements

How to Install the Oracle Solaris OS on a Guest Domain From a DVD

How to Install the Oracle Solaris OS on a Guest Domain From an Oracle Solaris ISO File

How to Use the Oracle Solaris JumpStart Feature on an Oracle Solaris 10 Guest Domain

Chapter 5 Configuring I/O Domains

I/O Domain Overview

General Guidelines for Creating an I/O Domain

Chapter 6 Creating a Root Domain by Assigning PCIe Buses

Creating a Root Domain by Assigning PCIe Buses

Static PCIe Bus Assignment

Dynamic PCIe Bus Assignment

Dynamic PCIe Bus Assignment Requirements

How to Create a Root Domain by Assigning a PCIe Bus

Chapter 7 Creating an I/O Domain by Using PCIe SR-IOV Virtual Functions

SR-IOV Overview

SR-IOV Hardware and Software Requirements

Current SR-IOV Feature Limitations

Static SR-IOV

Static SR-IOV Software Requirements

Dynamic SR-IOV

Dynamic SR-IOV Software Requirements

Dynamic SR-IOV Configuration Requirements

Enabling I/O Virtualization

How to Enable I/O Virtualization for a PCIe Bus

Planning for the Use of PCIe SR-IOV Virtual Functions

Using Ethernet SR-IOV Virtual Functions

Ethernet SR-IOV Hardware Requirements

Ethernet SR-IOV Limitations

Planning for the Use of Ethernet SR-IOV Virtual Functions

Ethernet Device-Specific and Network-Specific Properties

Creating Ethernet Virtual Functions

How to Create an Ethernet SR-IOV Virtual Function

Destroying Ethernet Virtual Functions

How to Destroy an Ethernet SR-IOV Virtual Function

Modifying Ethernet SR-IOV Virtual Functions

How to Modify Ethernet SR-IOV Virtual Function Properties

Adding and Removing Ethernet SR-IOV Virtual Functions on I/O Domains

How to Add an Ethernet SR-IOV Virtual Function to an I/O Domain

How to Remove an Ethernet Virtual SR-IOV Function From an I/O Domain

Advanced SR-IOV Topics: Ethernet SR-IOV

Advanced Network Configuration for Virtual Functions

Booting an I/O Domain by Using an SR-IOV Virtual Function

SR-IOV Device-Specific Properties

Creating VNICs on SR-IOV Virtual Functions

Using an SR-IOV Virtual Function to Create an I/O Domain

How to Create an I/O Domain by Assigning an SR-IOV Virtual Function to It

Using InfiniBand SR-IOV Virtual Functions

InfiniBand SR-IOV Hardware Requirements

Creating and Destroying InfiniBand Virtual Functions

How to Create an InfiniBand Virtual Function

How to Destroy an InfiniBand Virtual Function

Adding and Removing InfiniBand Virtual Functions on I/O Domains

How to Add an InfiniBand Virtual Function to an I/O Domain

How to Remove an InfiniBand Virtual Function From an I/O Domain

Adding and Removing InfiniBand Virtual Functions to Root Domains

How to Add an InfiniBand Virtual Function to a Root Domain

How to Remove an InfiniBand Virtual Function From a Root Domain

Advanced SR-IOV Topics: InfiniBand SR-IOV

Listing InfiniBand SR-IOV Virtual Functions

Identifying InfiniBand SR-IOV Functions

Using Fibre Channel SR-IOV Virtual Functions

Fibre Channel SR-IOV Hardware Requirements

Fibre Channel SR-IOV Requirements and Limitations

Fibre Channel Device Class-Specific Properties

World-Wide Name Allocation for Fibre Channel Virtual Functions

Creating Fibre Channel SR-IOV Virtual Functions

How to Create a Fibre Channel SR-IOV Virtual Function

Destroying Fibre Channel SR-IOV Virtual Functions

How to Destroy a Fibre Channel SR-IOV Virtual Function

Modifying Fibre Channel SR-IOV Virtual Functions

How to Modify Fibre Channel SR-IOV Virtual Function Properties

Adding and Removing Fibre Channel SR-IOV Virtual Functions on I/O Domains

How to Add a Fibre Channel SR-IOV Virtual Function to an I/O Domain

How to Remove a Fibre Channel SR-IOV Virtual Function From an I/O Domain

Advanced SR-IOV Topics: Fibre Channel SR-IOV

Accessing a Fibre Channel Virtual Function in a Guest Domain

I/O Domain Resiliency

Resilient I/O Domain Requirements

I/O Domain Resiliency Limitations

Configuring Resilient I/O Domains

How to Configure a Resilient I/O Domain

Example – Using Resilient and Non-Resilient Configurations

Rebooting the Root Domain With Non-Resilient I/O Domains Configured

Chapter 8 Creating an I/O Domain by Using Direct I/O

Creating an I/O Domain by Assigning PCIe Endpoint Devices

Direct I/O Hardware and Software Requirements

Current Direct I/O Feature Limitations

Planning PCIe Endpoint Device Configuration

Rebooting the Root Domain With PCIe Endpoints Configured

Making PCIe Hardware Changes

Minimizing Guest Domain Outages When Removing a PCIe Card

How to Minimize Guest Domain Outages When Removing a PCIe Card

Creating an I/O Domain by Assigning a PCIe Endpoint Device

How to Create an I/O Domain by Assigning a PCIe Endpoint Device

Chapter 9 Using Non-primary Root Domains

Non-primary Root Domains Overview

Non-primary Root Domain Requirements

Non-primary Root Domain Limitations

Non-primary Root Domain Examples

Enabling I/O Virtualization for a PCIe Bus

Managing Direct I/O Devices on Non-primary Root Domains

Managing SR-IOV Virtual Functions on Non-primary Root Domains

Chapter 10 Using Virtual Disks

Introduction to Virtual Disks

Virtual Disk Identifier and Device Name

Managing Virtual Disks

How to Add a Virtual Disk

How to Export a Virtual Disk Back End Multiple Times

How to Change Virtual Disk Options

How to Change the Timeout Option

How to Remove a Virtual Disk

Virtual Disk Appearance

Full Disk

Single-Slice Disk

Virtual Disk Back End Options

Read-only (ro) Option

Exclusive (excl) Option

Slice (slice) Option

Virtual Disk Back End

Physical Disk or Disk LUN

How to Export a Physical Disk as a Virtual Disk

Physical Disk Slice

How to Export a Physical Disk Slice as a Virtual Disk

How to Export Slice 2

File and Volume Exporting

File or Volume Exported as a Full Disk

How to Export a File as a Full Disk

How to Export a ZFS Volume as a Full Disk

File or Volume Exported as a Single-Slice Disk

How to Export a ZFS Volume as a Single-Slice Disk

Exporting Volumes and Backward Compatibility

Summary of How Different Types of Back Ends Are Exported

Guidelines for Exporting Files and Disk Slices as Virtual Disks

Using the Loopback File (lofi) Driver

Directly or Indirectly Exporting a Disk Slice

Configuring Virtual Disk Multipathing

Virtual Disk Multipathing and Virtual Disk Timeout

How to Configure Virtual Disk Multipathing

Dynamic Path Selection

CD, DVD and ISO Images

How to Export a CD or DVD From the Service Domain to the Guest Domain

How to Export an ISO Image From the Control Domain to Install a Guest Domain

Virtual Disk Timeout

Virtual Disk and SCSI

Virtual Disk and the format Command

Using ZFS With Virtual Disks

Configuring a ZFS Pool in a Service Domain

Storing Disk Images With ZFS

Examples of Storing Disk Images With ZFS

Creating a Snapshot of a Disk Image

Using Clone to Provision a New Domain

Cloning a Boot Disk Image

How to Create a Snapshot of a Disk Image of an Unconfigured System

Using Volume Managers in an Oracle VM Server for SPARC Environment

Using Virtual Disks With Volume Managers

Using Virtual Disks With Solaris Volume Manager

Using Virtual Disks When VxVM Is Installed

Using Volume Managers With Virtual Disks

Using ZFS With Virtual Disks

Using Solaris Volume Manager With Virtual Disks

Using VxVM With Virtual Disks

Virtual Disk Issues

In Certain Conditions, a Guest Domain's Solaris Volume Manager Configuration or Metadevices Can Be Lost

How to Find a Guest Domain's Solaris Volume Manager Configuration or Metadevices

Oracle Solaris Boot Disk Compatibility

Chapter 11 Using Virtual SCSI Host Bus Adapters

Introduction to Virtual SCSI Host Bus Adapters

Operational Model for Virtual SCSI HBAs

Virtual SCSI HBA Identifier and Device Name

Managing Virtual SCSI HBAs

Obtaining Physical SCSI HBA Information

Creating a Virtual Storage Area Network

Creating a Virtual SCSI Host Bus Adapter

Verifying the Presence of a Virtual SCSI HBA

Setting the Virtual SCSI HBA Timeout Option

Removing a Virtual SCSI Host Bus Adapter

Removing a Virtual Storage Area Network

Adding or Removing a LUN

Appearance of Virtual LUNs in a Guest Domain

Virtual SCSI HBA and Virtual SAN Configurations

Configuring Virtual SCSI HBA Multipathing

How to Configure Virtual SCSI HBA Multipathing

How to Enable Multipathing for Virtual SCSI HBAs

How to Disable Multipathing for Virtual SCSI HBAs

Booting From SCSI Devices

Booting From a Virtual LUN

Booting From a SCSI DVD Device

Installing a Virtual LUN

Virtual SCSI HBA Timeout

Virtual SCSI HBA and SCSI

Supporting Highly Fragmented I/O Buffers in the Guest Domain

Chapter 12 Using Virtual Networks

Introduction to a Virtual Network

Oracle Solaris 11 Networking Overview

Oracle Solaris 10 Networking Overview

Maximizing Virtual Network Performance

Hardware and Software Requirements

Configuring Your Domains to Maximize the Performance of Your Virtual Network

Virtual Switch

Virtual Network Device

Inter-Vnet LDC Channels

Viewing Network Device Configurations and Statistics

Controlling the Amount of Physical Network Bandwidth That Is Consumed by a Virtual Network Device

Network Bandwidth Limitations

Setting the Network Bandwidth Limit

Virtual Device Identifier and Network Interface Name

Finding the Oracle Solaris 11 Network Interface Name

How to Find the Oracle Solaris OS Network Interface Name

Assigning MAC Addresses Automatically or Manually

Range of MAC Addresses Assigned to Domains

Automatic Assignment Algorithm

Duplicate MAC Address Detection

Using Network Adapters With Domains That Run Oracle Solaris 10

How to Determine Whether a Network Adapter Is GLDv3-Compliant

Configuring a Virtual Switch and the Service Domain for NAT and Routing

Configuring NAT on an Oracle Solaris 11 System

How to Set Up a Virtual Switch to Provide External Connectivity to Domains (Oracle Solaris 11)

Configuring NAT on an Oracle Solaris 10 System

How to Set Up a Virtual Switch on Oracle Solaris 10 Service Domains to Provide External Connectivity to Domains

Configuring IPMP in an Oracle VM Server for SPARC Environment

Configuring Virtual Network Devices Into an IPMP Group in an Oracle Solaris 11 Domain

Configuring Virtual Network Devices Into an IPMP Group in an Oracle Solaris 10 Domain

Configuring and Using IPMP in the Service Domain

Using Link-Based IPMP in Oracle VM Server for SPARC Virtual Networking

How to Configure Physical Link Status Updates

Using VLAN Tagging

Port VLAN ID

VLAN ID

Assigning and Using VLANs

How to Assign and Use VLANs in an Oracle Solaris 11 Service Domain

How to Assign and Use VLANs in an Oracle Solaris 10 Service Domain

How to Assign and Use VLANs in an Oracle Solaris 11 Guest Domain

How to Assign and Use VLANs in an Oracle Solaris 10 Guest Domain

How to Install a Guest Domain When the Install Server Is in a VLAN

Viewing PVLAN Information

Tuning Packet Throughput Performance

Using NIU Hybrid I/O

How to Configure a Virtual Switch With an NIU Network Device

How to Enable or Disable Hybrid Mode

Using Link Aggregation With a Virtual Switch

Configuring Jumbo Frames

How to Configure Virtual Network and Virtual Switch Devices to Use Jumbo Frames

Compatibility With Older (Jumbo-Unaware) Versions of the vnet and vsw Drivers (Oracle Solaris 10)

Oracle Solaris 11 Networking-Specific Feature Differences

Using Virtual NICs on Virtual Networks

Configuring Virtual NICs on Virtual Network Devices

Creating Oracle Solaris 11 Zones in a Domain

Chapter 13 Migrating Domains

Introduction to Domain Migration

Overview of a Migration Operation

Software Compatibility

Security for Migration Operations

Configuring SSL Certificates for Migration

How to Configure SSL Certificates for Migration

Removing SSL Certificates

FIPS 140-2 Mode for Domain Migration

How to Run Logical Domains Manager in FIPS 140-2 Mode

How to Revert the Logical Domains Manager to the Default Mode From FIPS 140-2 Mode

Domain Migration Restrictions

Version Restrictions for Migration

Cross-CPU Restrictions for Migration

CPU Restrictions for Migration

Migration Restrictions for Setting perf-counters

Migrating a Domain

Performing a Dry Run

Performing Non-Interactive Migrations

Migrating an Active Domain

Domain Migration Requirements for CPUs

Migration Requirements for Memory

Migration Requirements for Physical I/O Devices

Migration Requirements for Virtual I/O Devices

Migration Requirements for PCIe Endpoint Devices

Migration Requirements for PCIe SR-IOV Virtual Functions

Migration Requirements for NIU Hybrid I/O

Migration Requirements for Cryptographic Units

Delayed Reconfiguration in an Active Domain

Migrating While an Active Domain Has the Power Management Elastic Policy in Effect

Operations on Other Domains

Migrating a Domain From the OpenBoot PROM or a Domain That Is Running in the Kernel Debugger

Migrating Bound or Inactive Domains

Migration Requirements for Virtual I/O Devices

Migration Requirements for PCIe Endpoint Devices

Migration Requirements for PCIe SR-IOV Virtual Functions

Monitoring a Migration in Progress

Canceling a Migration in Progress

Recovering From a Failed Migration

Migration Examples

Chapter 14 Managing Resources

Resource Reconfiguration

Dynamic Reconfiguration

Delayed Reconfiguration

Only One CPU Configuration Operation Is Permitted to Be Performed During a Delayed Reconfiguration

Resource Allocation

CPU Allocation

How to Apply the Whole-Core Constraint

How to Apply the Max-Cores Constraint

Interactions Between the Whole-Core Constraint and Other Domain Features

CPU Dynamic Reconfiguration

Dynamic Resource Management

Configuring the System With Hard Partitions

Checking the Configuration of a Domain

Configuring a Domain With CPU Whole Cores

How to Create a New Domain With CPU Whole Cores

How to Configure an Existing Domain With CPU Whole Cores

How to Configure the Primary Domain With CPU Whole Cores

Interaction of Hard Partitioned Systems With Other Oracle VM Server for SPARC Features

CPU Dynamic Reconfiguration

CPU Dynamic Resource Management

Power Management

Domain Reboot or Rebind

Assigning Physical Resources to Domains

How to Remove the physical-bindings Constraint

How to Remove All Non-Physically Bound Resources

Managing Physical Resources on the Control Domain

Restrictions for Managing Physical Resources on Domains

Using Memory Dynamic Reconfiguration

Adding Memory

Removing Memory

Partial Memory DR Requests

Memory Reconfiguration of the Control Domain

Decrease the Control Domain's Memory

Dynamic and Delayed Reconfiguration

Memory Alignment

Memory Alignment for Active Domains

Memory Alignment for Bound Domains

Memory Alignment for Inactive Domains

Adding Unaligned Memory

Memory DR Examples

Using Resource Groups

Resource Group Requirements and Restrictions

Using Power Management

Using Dynamic Resource Management

Listing Domain Resources

Machine-Readable Output

Flag Definitions

Utilization Statistic Definition

Viewing Various Lists

Listing Constraints

Listing Resource Group Information

Using Perf-Counter Properties

Chapter 15 Managing Domain Configurations

Managing Domain Configurations

Available Configuration Recovery Methods

Restoring Configurations By Using Autosave

Autorecovery Policy

How to Modify the Autorecovery Policy

Saving Domain Configurations

Restoring Domain Configurations

How to Restore a Domain Configuration From an XML File (ldm add-domain)

How to Restore a Domain Configuration From an XML File (ldm init-system)

Addressing Service Processor Connection Problems

Chapter 16 Handling Hardware Errors

Hardware Error-Handling Overview

Using FMA to Blacklist or Unconfigure Faulty Resources

Recovering Domains After Detecting Faulty or Missing Resources

Recovery Mode Hardware and Software Requirements

Degraded Configuration

Controlling Recovery Mode

Marking Domains as Degraded

Marking I/O Resources as Evacuated

Chapter 17 Performing Other Administration Tasks

Entering Names in the CLI

Updating Property Values in the /etc/system File

How to Add or Modify a Tuning Property Value

Connecting to a Guest Console Over the Network

Using Console Groups

How to Combine Multiple Consoles Into One Group

Stopping a Heavily Loaded Domain Can Time Out

Operating the Oracle Solaris OS With Oracle VM Server for SPARC

OpenBoot Firmware Not Available After the Oracle Solaris OS Has Started

Performing a Power Cycle of a Server

Result of Oracle Solaris OS Breaks

Results From Rebooting the Control Domain

Using Oracle VM Server for SPARC With the Service Processor

Configuring Domain Dependencies

Domain Dependency Examples

Dependency Cycles

Determining Where Errors Occur by Mapping CPU and Memory Addresses

CPU Mapping

Memory Mapping

Example of CPU and Memory Mapping

Using Universally Unique Identifiers

Virtual Domain Information Command and API

Using Logical Domain Channels

Booting a Large Number of Domains

Cleanly Shutting Down and Power Cycling an Oracle VM Server for SPARC System

How to Power Off a System With Multiple Active Domains

How to Power Cycle the System

Logical Domains Variable Persistence

Adjusting the Interrupt Limit

Listing Domain I/O Dependencies

Enabling the Logical Domains Manager Daemon

How to Enable the Logical Domains Manager Daemon

Saving and Restoring Autosave Configuration Data

Saving and Restoring Autosave Configuration Directories

How to Save and Restore Autosave Directories

Saving and Restoring the Logical Domains Constraints Database File

Factory Default Configuration and Disabling Domains

How to Remove All Guest Domains

How to Remove All Domain Configurations

How to Restore the Factory Default Configuration

How to Disable the Logical Domains Manager

How to Restore the Factory Default Configuration From the Service Processor

Part II Optional Oracle VM Server for SPARC Software

Chapter 18 Using Oracle VM Server for SPARC Templates

Oracle VM Server for SPARC Templates Overview

Installing the Oracle VM Server for SPARC Template Utilities

Oracle VM Server for SPARC Template Lifecycle

Oracle VM Server for SPARC Template Examples

Chapter 19 Oracle VM Server for SPARC Physical-to-Virtual Conversion Tool

Oracle VM Server for SPARC P2V Tool Overview

Installing and Configuring the Oracle VM Server for SPARC P2V Tool

Prerequisites for using the SPARC P2V Tool

Limitations of Using the SPARC P2V Tool

How to Configure the Oracle VM Server for SPARC P2V Tool

Using the ldmp2v Command

Known Issues With the Oracle VM Server for SPARC Physical-to-Virtual Conversion Tool

ldmp2v convert Command: VxVM Warning Messages During Boot

Upgrade Option Not Presented When Using ldmp2v prepare -R

ldmp2v Command: ufsdump Archiving Method Is No Longer Used

Chapter 20 Using Power Management

Using Power Management

Power Management Features

Viewing Power-Consumption Data

Chapter 21 Using the Oracle VM Server for SPARC Management Information Base Software

Oracle VM Server for SPARC Management Information Base Overview

This chapter describes how to use virtual SCSI Host Bus Adapters (HBAs) with Oracle VM Server for SPARC software.

This chapter covers the following topics: