How do I reset the ILOM from Solaris?

Abstract:

A Solaris is comprised of an OS to run the applications under, as well as a variety of instrumentation and virtualization. A typical stack includes: ILOM or SP, CDom, LDom, Zone. If you need to reboot the SP (System Processor) or ILOM (Integrated Lights Out Management), it can be done from the base OS which is normally a Control Domain, and is non-intrusive to the applications running on the base OS (as long as the CDom is not trying to save the state of the LDoms or attempting to read-write the configuration.)

Check ILOM UpTime

The ILOM tracks it's uptime and it is available through the IPMI Tool

sun1824-cd/root# ipmitool sunoem cli
Connected. Use ^D to exit.
->

-> show /SP/clock

/SP/clock
Targets:

Properties:
datetime = Fri Feb 17 22:47:14 2023
timezone = EST (America/New_York)
uptime = 34 days, 14:45:14
usentpserver = enabled

Commands:
cd
set
show

-> exit
Disconnected

Rebooting the ILOM

The System Processor Card can be rebooted from the base Solaris OS acting as a Control Domain via:

sun1824-cd/root# PATH=/opt/ipmitool/sbin/ipmitool:/usr/sbin
sun1824-cd/root# export PATH
sun1824-cd/root# ipmitool sunoem cli
Connected. Use ^D to exit.
-> reset /SP
Are you sure you want to reset /SP (y/n)? y
Performing reset on /SP

-> exit
Disconnected

Verify ILOM Reboot

The ILOM reboot can be verified by using the IPMI tool.

sun1824-cd/root# ipmitool sunoem cli
Connected. Use ^D to exit.
-> show /SP/clock

/SP/clock
Targets:

Properties:
datetime = Sat Feb 18 22:49:25 2023
timezone = EST (America/New_York)
uptime = 0 days, 00:07:43
usentpserver = enabled

Commands:
cd
set
show

-> exit
Disconnected
sun1824-cd/root#

Installing a ISO from ILOM 4.0.3+ using SSH

Abstract:

The SPARC platform have long come with various Lights Out Management (LOM) capabilities, to access the hardware, and provide for access to the OS from underneath, when there is a hardware issue. A more advanced system called Integrated Lights Out Management (ILOM) was later created. With ILOM 4.0.3, a feature was created to allow for the boot from a remove ISO via SSH!

Where to get ISO:

The easiest place to get the most recent version of Solaris, such as the Common Build Edition

https://www.oracle.com/solaris/solaris11/downloads/solaris-downloads.html

Various ISO's are available from Oracle for Solaris:

What to do from ILOM:

Copy ISO's to a local directory on a server

Make sure there is connectivity from the ILOM to the Server hosting the ISO

-> set /SP/network/test ping=a.b.c.d
Ping of a.b.c.d succeeded

Set the ILOM Host Storage Device to Remote

Set the username, password, and ISO location

-> cd /SP/services/kvms/host_storage_device/remote

-> set username=user
-> set password=password
-> set server_URI=sshfs://a.b.c.d:/export/home/user/sol-11_4-text-sparc.iso

/SP/services/kvms/host_storage_device=remote
Targets:
Properties:
password = *****
server_URI = sshfs://a.b.c.d:/export/home/user/sol-11_4-text-sparc.iso
username = user

Review Values

-> show /SP/services/kvms/host_storage_device/

/SP/services/kvms/host_storage_device

Targets:
remote

Properties:
mode = remote
status = operational

Stop Automatic Boot on Host

-> set /HOST/bootmode script="setenv auto-boot? false"

Mount & Boot the Remote ISO

-> start /SP/console -script

{ok} reset-all
{ok} devalias
...
rcdrom

{ok} ok boot rcdrom

Boot device: /pci@311/pci@1/usb@0/storage@1/disk@0 File and args:
SunOS Release 5.11 Version 11.4.0.15.0 64-bit
Copyright (c) 1983, 2018, Oracle and/or its affiliates. All rights reserved.
Remounting root read/write
Probing for device nodes ...
Preparing image for use
NOTICE: mount: not a UFS magic number (0x0)
NOTICE: mount: not a UFS magic number (0x0)
Done mounting image
USB keyboard
1. Arabic 15. Korean
2. Belgian 16. Latin-American
3. Brazilian 17. Norwegian
4. Canadian-Bilingual 18. Portuguese
5. Canadian-French 19. Russian
6. Danish 20. Spanish
7. Dutch 21. Swedish
8. Dvorak 22. Swiss-French
9. Finnish 23. Swiss-German
10. French 24. Traditional-Chinese
11. German 25. TurkishQ
12. Italian 26. UK-English
13. Japanese-type6 27. US-English
14. Japanese

To select the keyboard layout, enter a number [default 27]:

Additional Information

A good note on this process is available for people with Oracle Support:
How to Install/Re-image a T5-x, S7, T7-x, T8-x, M7-x, or M8-x System Using the sshfs Protocol (Doc ID 2817892.1)
https://support.oracle.com/epmos/faces/DocumentDisplay?id=2817892.1

How to Get to an OK prompt on a SPARC

Abstract:

From the beginning of reasonable UNIX Workstation Time, the Workstation typically had a physical hardware layer, a firmware layer, and an OS layer. The Firmware layer used by UNIX workstations was Open-Sourced by Sun Microsystems as OpenBoot, given to the market for vendors like IBM, Apple, etc. The FORTH based environment was called OpenFirmware by the IEEE. One such feature is to boot the operating system directly, from a pre-selected disk, in a pre-selected order. When booting from a different boot environment, like a USB stick, this can be stopped. All of this can be achieved from the OpenBoot "OK" prompt.

From a Physical Console

If you are lucky enough to have a real SUN Keyboard, Video Monitor, and Mouse (KVM), breaking out to OpenBoot is easily achieved by using the following key sequence "[L1] [A]". The "[L1]" key may be labeled "Stop" on some newer keyboards, but the position is the same, so the simultaneous key sequence would be "[Stop][A]".

{0} ok

From an ILOM Console

If one is not lucky enough to have a physical console, it can be accomplished from an ILOM Console.

Go Directly to OK from ILOM Console

If the system AutoBoot is not configured, the OK prompt will appear on a powered up chassis console

-> start /SP/console
Are you sure you want to start /SP/console (y/n)? y

{0} ok

Go to OK from ILOM Console & Booted OS

If the system AutoBoot is configured, the OS prompt will appear on a powered up chassis console

Go to OK from ILOM Console & Booted OS without root

If the system AutoBoot is configured, the OS prompt will appear on a powered up chassis console.
If there is no root password for the system and the intention is to perform a re-installation,
disable auto-boot from the ILOM and perform a reset.

Conclusions:

The SPARC Chassis, with various access methodologies, can achieve access to the OpenBoot / OpenFirmware prompt, for loading new operating systems, regardless of what was previously loaded on the chassis.

[SPARC T4-4 Chassis Image, Courtesy Oracle]

Oracle SPARC T4-4 - USB Boot & Install

Abstract

UNIX Systems Manufacturers originated their markets as workstations, during a time when they used 32 bit systems and the rest of the PC market was concentrating on 8 and 16 bit systems, and some CPU vendors like Intel use segmentation to keep their 16 bit software alive while struggling to move to 32 bit architectures. Some of the original servers were stacked workstations on a rack in a cabinet. The former high-powered video cards were merely ignored, as remote management needed command line interfaces. Engineering quickly determined that console access needed to be built into a new class of systems: rack mounted servers. These early servers offered boot functionality from Network and Disk. One such boot capability was from USB Disk.This capability was later carried onto other chassis that Oracle would manufacture, such as the SPARC T4-4.

Creating a USB Boot Stick from Solaris

The USB port can be used to create a Solaris 11.4 USB Boot Stick from Solaris, after inserting a SanDisk USB stick into the front port next to the DVD Drive:

T5120/root# echo | format -e | grep -i SanDisk
4. c7t0d0 <SanDisk'-Cruzer Fit-1.00 cyl 1945 alt 0 hd 255 sec 63>
5. c8t0d0 <SanDisk'-Cruzer Fit-1.00 cyl 1945 alt 0 hd 255 sec 63>

T5120/root# ls -al *usb
-rw-r--r-- 1 dh127087 staff 1217341440 May 3 19:38 sol-11_4-text-sparc.usb

T5120/root# time dd bs=16k if=sol-11_4-text-sparc.usb of=/dev/rdsk/c7t0d0s2
74300+1 records in
74300+1 records out

real 8m57.25s
user 0m0.47s
sys 0m13.99s

T5120/root# echo "par\nprint\n" | format -e c7t0d0 | tail -14 | nawk '$NF!="0" && !/partition/'
Total disk cylinders available: 148 + 0 (reserved cylinders)

Part Tag Flag Cylinders Size Blocks
0 unassigned wm 0 - 147 1.13GB (148/0/0) 2377620
2 unassigned wm 0 - 147 1.13GB (148/0/0) 2377620

T5120/root#

This USB stick can now be tested from, from OpenBoot Firmware

Oracle SPARC T4-4

The Oracle SPARC T4-4 is a server with a 4th generation OpenSPARC processor. The SPARC T4 processor was manufactured to the same process size as the SPARC T3 CPU processor, but the core was upgraded, so equivalent throughput could be reached with half as many cores, at the same processor speed. The T4-4 Chassis comes with a Lights Out Management (LOM) capability referred to as Integrated Lights Out Management (ILOM.) Most remote systems management work can be done from the LOM. The system, when looking at the front of the chassis: the T5120 has 2x USB ports next to the DVD drive on the right and 2x USB ports located in the back left corner.

Attaching to the ILOM

The ILOM can be attached to via TCP/IP, if previously configured, or over a serial port.

T5120/user$ ssh root@sun1234-ilom
Password:

Oracle(R) Integrated Lights Out Manager
Version 3.2.6.8 r128095
Copyright (c) 2018, Oracle and/or its affiliates. All rights reserved.
Hostname: ORACLESP-1207BDY075

->

Insert USB Boot

The USB boot flash stick should be inserted into a powered down chassis, to boot from firmware.

-> show /system power_state actual_power_consumption

/System
Properties:
power_state = Off
actual_power_consumption = 37 watts

Power Up Chassis

After the USB boot stick is inserted, the chassis should be powered up from the ILOM.

-> start /SYS
Are you sure you want to start /SYS (y/n)? y
Starting /SYS

After the chassis is powered on, once the power usage increases, attach to the console

-> show /system power_state actual_power_consumption

/System
Properties:
power_state = On
actual_power_consumption = 1384 watts


-> start /SP/console
Are you sure you want to start /SP/console (y/n)? y

Serial console started. To stop, type #.

{0} ok

Note: If the chassis was recently started, the ability to access a prompt does not really occur until after the actual power consumption rises to an expected level.
Note: if the "ok" prompt does not appear, press [RETURN] or [ENTER] key

Select USB Port

When a SanDisk USB Flash Sticks are plugged into the USB ports located to the right of the DVD drive, they can be seen at the OpenFirmware prompt, and can be selected into a copy-paste buffer, for easy use.

{0} ok show-disks
a) /reboot-memory@0
b) /pci@700/pci@1/pci@0/pci@0/LSI,sas@0/disk
c) /pci@500/pci@1/pci@0/pci@1/pci@0/pci@3/SUNW,emlxs@0,1/fp@0,0/disk
d) /pci@500/pci@1/pci@0/pci@1/pci@0/pci@3/SUNW,emlxs@0/fp@0,0/disk
e) /pci@400/pci@2/pci@0/pci@1/pci@0/pci@3/SUNW,emlxs@0,1/fp@0,0/disk
f) /pci@400/pci@2/pci@0/pci@1/pci@0/pci@3/SUNW,emlxs@0/fp@0,0/disk
g) /pci@400/pci@1/pci@0/pci@8/pci@0/usb@0,2/hub@2/hub@3/storage@2/disk
h) /pci@400/pci@1/pci@0/pci@8/pci@0/usb@0,2/hub@2/storage@2/disk
i) /pci@400/pci@1/pci@0/pci@0/LSI,sas@0/disk
j) /iscsi-hba/disk
m) MORE SELECTIONS
q) NO SELECTION
Enter Selection, q to quit: h
/pci@400/pci@1/pci@0/pci@8/pci@0/usb@0,2/hub@2/storage@2/disk has been selected.
Type ^Y ( Control-Y ) to insert it in the command line.
e.g. ok nvalias mydev ^Y
for creating devalias mydev for /pci@400/pci@1/pci@0/pci@8/pci@0/usb@0,2/hub@2/storage@2/disk
{0} ok

Note: the USB stick in position "h" (this lettered position may change as new USB sticks are plugged or unplugged) has it's device name copied into a "copy-paste" buffer by selecting "h"

Boot Solaris 11.4 from USB

After shutting down the OS, while on the console port, attempt to boot from 11.4, which is too new:

Install Solaris 11.4

UnConfigure / Configure

Solaris 10, offered an option to perform a "sys-unconfig", to restore an OS back to factory settings. In Solaris 11, this has been replaced with another option called "sysconfig configure -s" or "sysconfig configure -s --destructive" to destroy the initial user home account to also be destroyed.

This option is good if moving a chassis to a different location.

Sun SPARC Enterprise T5120 - ILOM Introduction

Abstract

UNIX Systems Manufacturers originated their markets as workstations, during a time when they used 32 bit systems and the rest of the PC market was concentrating on 8 and 16 bit systems, and some CPU vendors like Intel use segmentation to keep their 16 bit software alive while struggling to move to 32 bit architectures. Some of the original servers were stacked workstations on a rack in a cabinet. The former high-powered video cards were merely ignored, as remote management needed command line interfaces. Engineering quickly determined that console access needed to be built into a new class of systems: rack mounted servers. These early servers offered traditional ALOM compatibility shell as well as newer ILOM shell. The ALOM compatibility shell is quite functional.

Sun Enterprise T5120 LOM

The Sun Enterprise T5120 is a server with a second generation OpenSPARC processor. It comes with a Lights Out Management (LOM) capability referred to as Integrated Lights Out Management (ILOM.) The Advanced Lights Out Management (ALOM) shell may be it's default. Most remote systems management work can be done from the LOM. Oracle has an ILOM 3.0 manual. There are also manuals formerly published by Sun Microsystems for OpenBoot 3.x and OpenBoot 4.x manuals.

ILOM: Logging In

A 9600 Baud Serial Cable can be added to the Console port, to provide immediate access.

-> help
The help command is used to view information about commands and targets

Usage: help [-o|-output terse|verbose] [<command>|legal|targets|<target>|<target> <property>]

Special characters used in the help command are
[] encloses optional keywords or options
<> encloses a description of the keyword
(If <> is not present, an actual keyword is indicated)
| indicates a choice of keywords or options

help <target> displays description if this target and its properties
help <target> <property> displays description of this property of this target
help targets displays a list of targets
help legal displays the product legal notice

Commands are:
cd
create
delete
dump
exit
help
load
reset
set
show
start
stop
version

->

ILOM: Show System Controller Network

The LOM can be enabled to perform DHCP, so access can be made over an ethernet cable.

{0} ok show-disks
a) /pci@0/pci@0/pci@8/pci@0/pci@9/SUNW,emlxs@0,1/fp@0,0/disk
b) /pci@0/pci@0/pci@8/pci@0/pci@9/SUNW,emlxs@0/fp@0,0/disk
c) /pci@0/pci@0/pci@2/scsi@0/disk
d) /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/storage@3/disk
e) /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/storage@2/disk
f) /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/storage@1/disk
g) /iscsi-hba/disk
q) NO SELECTION
Enter Selection, q to quit: qOpenSPARC Systems are very viable platforms, offering tremendous Lights Out Management capabilities. The most recent SPARC Systems have been the fastest platforms in the world for nearly 4 years, so there is a tremendous growth potential for migrating from these older Open Source SPARC platforms. Being based upon Open Hardware, Open Firmware, and Open Hardware - new hardware vendors can also create their own newer generation platforms, to meet their own requirements if the Light Out Management capabilities are not a requirement.