SPARC T7-1 Sun System Firmware 9.9.3

Product:         SPARC T7-1 Sun System Firmware 9.9.3
Release Version: 9.9.3
Date:            Jan/10/2020

Table of Contents:


Release Summary

This release applies to SPARC T7-1 Systems. This release is called a micro-version, used as a maintenance refresh of the existing minor-version level (e.g. 9.9.2.a). A micro-release (in which the third field of the version increments, such as from 9.9.2.a to 9.9.3 as in this release) does not involve new general features, but includes bug fixes and critical security improvements.

Why Should You Install System Firmware 9.9.3?

You are strongly recommended to update to the latest firmware release in your next maintenance window to ensure optimal system reliability, availability, security and performance.

There are several noteworthy changes in System Firmware 9.9.3 (since 9.9.2.a):



See the Bug Manifest section for a complete list of fixes.   For more information on the security content of this release contact Oracle support.

The table below shows the distribution of bugID's fixed across the five gates since the Sun System Firmware 9.9.2.a release:

Gate

Bug Count

ILOM

38

Nyx

12

Hypervisor

8

OpenBoot

5

POST

5

FWP

-



Release Profile



Reference Information

Please refer to the online documentation for information relevant to this platform:

OTN Firmware Release Hub

http://www.oracle.com/technetwork/systems/patches/firmware/index.html

OVM SPARC

http://www.oracle.com/technetwork/documentation/vm-sparc-194287.html

Oracle ILOM

http://www.oracle.com/technetwork/documentation/sys-mgmt-networking-190072.html

SPARC T7-1

http://www.oracle.com/goto/t7-1/docs

Open Source Link

http://www.oracle.com/goto/opensourcecode
Please visit here to download the firmware's open source components that are required to be made available under open source licenses.



Bug Manifest and History of 9.9 Releases

(Current Release:  Patch ID = 30673922.  Sun System Firmware 9.9.3  Total BugIDs = 68 since 9.9.2.a)

  30457804 certain JFFS configurations cause ILOM SP wdog firing during init
  30434885 change in xslt requires a minor makefile change
  30431167 POST timeout/hang on M7-16
  30429899 Optimize cpu utilization loop by bailing when done
  30429627 HV rejects ldm utilization requests when NGUESTS is at the max
  30407298 Replace invalidated IOTTE entries with a timestamp
  30393790 Need to replace OpenSSL FIPS Object Module (FOM) with Oracle FOM
  30374387 Problem with PLAT-SW
  30350803 Process message from HV indicating invalid guest tod-offset
  30312855 Snapshot should capture "ls -lR" for writeable file systems.
  30282656 Uninitialized vref_sel_reg_max can lead to PLL initialization failures
  30260120 PX bus master is not set back to SVID after margining
  30230799 T7-1/T8-1 can attempt DIMM sparing on 2nd DIMM failure rather than issuing serviceable fault
  30067668 Fast Instruction Access MMU Miss with Aura8 SFF RL03 firmware
  30034051 SPARC ILOM occasionally fails to load the miniroot
  30021907 mbox is enabled in host isolation mode
  29950315 eusb connections repeatedly closing on ILOM 5.0
  29878024 Print memory block size in bytes during memory retirement
  29856646 Skip retirement of resources that have a disabled/retired ancestor
  29849759 HV should reject TOD offsets that are unbootable
  29844763 Fix lint errors
  29844728 dmake should work at any directory level in POST
  29815114 HV should do a better job walking vcpus for utilization data
  29796628 Clean up gm_set_verified_boot_info() based on changes made by 29488285
  29705067 Page fault detected during POST causes CPU to be marked "degraded"
  29679227 Add 25G CX5 card with Oracle FW (Oracle PCIe ID) into ILOM
  29658152 Remove DSN/WWN mask once Samsung PM1725b defined it
  29652958 Add 25G CX5 card with Oracle FW (Oracle PCIe ID) into ILOM
  29631288 device_monitor: no e-report/i-report/faults generated for Samsung Aura8+ SFF SDD
  29593897 DIMM will report faulty even if configured correctly after doing AEP misconfig test.
  29587323 ILOM support Samsung PM1725b SFF NVMe device
  29536519 Fix errors found by GCC 7.3.0
  29536505 Remove remaining uses of /pkg from makefiles
  29530319 Remove dependency on /pkg for builds
  29515090 Update Nyx toolset
  29514337 Update POST toolset
  29514041 Update Openboot toolset
  29481610 NAND bad block test loops infinitely on error
  29461695 Add multi-process/multi-thread locks to GPU access functions
  29456439 RKVM Server Presents Storage Device by default
  29455622 Don't Fault DIMMs for Correctable Memory Test Failures
  29450180 RKVM Server Presents Storage Device by default
  29437954 Checking in preloader with Bug 29437954 fixes
  29437069 Chassis intrusion can go undetected
  29400243 hwdiag doesn't recognize the onboard downstream device of Arua8 internal SSD.
  29396036 ISL8273 Gain+Offset correction for mis-programmed T8 CM 8273 and PM 8273 devices
  29389644 Sign JavaRConsole JARS
  29377373 Problem with PLAT-SW
  29364001 Stoneware - Heap exhausted / fast_square: Number is too big for static tmp array
  29305973 OpenBoot method fcode-image? cannot find device list table because a wrong base address is used.
  29305886 OpenBoot should allow FCode to have a ROM header with PCI Data Structure Revision 3
  29273431 change compiler to latest location
  29215341 remove unused workaround code
  29199792 Corrupt FDD ereport payload in SRAM can lead to GM crash
  29163339 fpga program ALL fails from uboot during ILOM RoT wipe
  29122832 hwdiag io nvme_test gives Invalid Subsystem/Vendor ID for Aura8
  29038076 Add PSU input power, voltage and current reading to hwdiag.
  29030504 Update psupdate to support new part numbers for Mandatory Power Supply Changes for India
  28980086 support ssh commands for users authenticated by remote auth protocols.
  28978873 Create package to configure FSS psnc profile from host
  28957865 Hwdiag reports access failure for GPU power
  28920201 Datatype mismatch between bool hc_is_sp_cold_boot() & int is_sp_cold_boot
  28686286 Device Monitor: Add support for Aura8 AIC
  28435020 ILOM FMA generate ISTOR events due to single medium error on disks
  27958743 psupdate fails to update A266 PSU if PSU is stuck in bootloader mode
  27189223 /var/log/ssl_proxy.log logs storm caused ereport.fs.dir.logs-full
  26194386 Parfait reports buffer overflow due to read outside array bounds
  22855291 Possible buffer overrun when setting ldom config vars


(From:  Patch ID = 29443727.  Sun System Firmware 9.9.2.a  Total BugIDs = 38 since 9.9.1.f)

  29287450 fwupdate with powercycle_metadata.xml flips flash banks too many times
  29205146 New Macronix data flash reports 4B mode in different register, causes error msg
  29166683 Uniqueify error codes from HV to Zeus
  28900151 Device Monitor: Follow NVMELocation to identify the HDD nac
  28888090 Need to integrate new VRD file 08 in X7/X8-2/L ILOM
  28844333 stop /SYS and "reset /SYS" broken for M5/T5
  28828218 X7-2c: PCIE 2 is being disable at Bscan script
  28807052 ferg should avoid setting LANE to -1 if it can't identify failed lane
  28764777 X7/X8-2/2L: IFC SP trace debug log not separate Aura7/8 card.
  28754305 GM should not link with libmsg
  28747033 Minor HV build tweaks needed
  28740638 GM should not #include sp_err.h
  28713946 X7-2L:See fault.chassis.device.fail during Aura7 AIC hotplug on OEL7.5
  28708331 Device Monitor: Extend jitter check to cover device read failures
  28688443 Whitney+ FCode should check v bit first for Rx/Tx completion
  28641071 Names of constants in FCode cannot be more than 31 letters long
  28641000 Whitney+ FCode's Rx descriptor ring must have more than 32 descriptors for FW212
  28618548 Fix Openboot .pstate command to properly display PSTATE bits
  28578606 OEM branding keys should be feature controlled
  28577486 Incorrect firmware update complete mesg in SEL during deep power cycle
  28564539 ILOM Snapshot fails to collect hostconsole.log file after update to ver 4.0.3.1
  28559064 M7-16 failing to start hosts for TPM requirements violation
  28551788 X6: ILOM is not interpreting MRC ERROR Code 0xed / 0x07 correctly
  28547232 X7/8: Support new NVMe devices Aura8 AIC/SFF
  28543849 Compiler generates unreliable code in places
  28520389 Device Monitor: Add support for Aura8 SFF
  28516971 X2-4 ILOM Sideband Not working after upgrading to ILOM version 4.0.3.23
  28506425 TigerVNC viewer sometimes starts with incorrect window size
  28468845 Verified boot data is never repopulated in data flash after MB replacement
  28461725 Running W+ FCode with debugging flag=10 causes "buffer too small" error
  28447223 [WATCH] x7-8 dwngrd 1.3 -> sw 1.1.4 via ipmiflash & power cycle fails turn on
  28349881 T7-4 poweron failed with /SYS/DC_POK_FLT but no hint on faulty component
  28290055 /System/PCI_Devices properties not correct with single CPU config.
  27862107 FPGA workaround: FHF MD5 is corrupted if SPI commands are issued during generation
  27699534 X5-2 SW 2.0.0/2.1.1 ILOM and Sideband - Net0 Port Speed Issue
  27585669 X7-2C: GUI reports GXR cards for X7-GX as not recognized
  27472607 Should check VF reset status by matching register value instead of checking bits
  21458601 ILOM should fault PSU when it is on but not enabled.


(From:  Patch ID = 28902035.  Sun System Firmware 9.9.1.f  Total BugIDs = 134 since 9.8.6)
  28961887 CHECK_REVECTOR_TO_HV needs to be updated to use correct HV PROM address
  28862857 Version info must be provided when gm_get_version_info() returns GM_PDM_BUSY
  28581130 Fix for CVE-2018-3693
  28564421 Fix for CVE-2018-3693
  28511949 Force python2 for live-patch check script
  28496297 Device Monitor: Ignore Vendor-ID for Aura7 AIC controllers
  28495723 ILOM+ push on FRU hotplug or HOST powercycle
  28489349 Locked shared mem mutex in libipmi causes lumain and other clients to deadlock
  28462581 HPC 8 nodes cluster still runs too hot after ILOM fix (temps >= 90C)
  28460111 Device Monitor: Report GPU FRUID info
  28452469 fishwrap core dump when HMP sends DELETE updates
  28432824 Device Monitor: Check status of second Aura7 controller for consistency
  28401353 ILOM+ request should include chassis and system identifying data
  28400977 change naming from chassis deep power cycle to system deep power cycle
  28369054 Suppress FERG warning message caused by Tahoe erratum 1057
  28368595 ILOM+ HTTP headers truncate identity values after comma
  28337587 Add missing exit condition from ldc_copy_read_tags loop
  28336703 Use newer C compiler and tools
  28336417 Reduce build time by minimizing use of hg commands
  28320642 Under /System/PCI_Devices/Add-on, location of NVME drives is vague
  28315423 Device Monitor: bogus fault and "jitter" for Vail during OS install
  28313204 REST SWAGGER:  /sp/services/directconsole/ port PATCH datatype should be integer
  28286838 Missing Install_HistoryR for /SYS/MIOx
  28255341 REST: Invalid JSON response to GET /rest/v1/SYS
  28229645 Whitney+ FCode net boot fails with IP header checksum error
  28216366 Careless mistake, using ">" as rshift in W+ FCode.
  28214423 RESTapi faultmgmt Properties mismatch and Actions missing
  28201499 Address REST faultmgmt issues
  28201264 ILOM SDM reported confusing M.2 SSD locations
  28200917 ILOM CLI reports Fan PWM incorrectly
  28200397 Rest Swagger: Missing /x/services/directconsole/max_auth_attempts
  28194847 Create behavior SUPPORTS_DEFERRED_FLASHUPDATE for ipmiflash and fwupdate
  28194811 Report ILOM hardware-identity in every ILOM+ request to OESHM & bm-stats
  28187206 Wrong FPGA csv file formate in all X_2c, X_8 platforms
  28172724 Live migration fails unable to restore vcpu state on target
  28172371 Device Monitor: Add GPU Simulation
  28165877 help targets shouldn't show hidden targets
  28157386 Deferred Firmware Update: disable in 4.0.4 for SPARC platforms
  28157197 /SP/powermgmt/powerconf/IO/ should not include absent SSDs
  28144765 Extra erroneous fan failures reported when the 2nd fan module was removed
  28142811 Device Monitor: Hotplug of multiple SFFs causes faulty
  28142577 Deferred Firmware Update: disable in 4.0.4
  28129981 Device Monitor: Add support to suspend monitoring for short periods of time
  28129900 Enable monitor_inventory in bringup images
  28129446 Updated FRUID auto-generated files frudefs.h and deinfo.xml from 6/4/18
  28128956 Deferred Firmware Update must not turn off the HOST
  28128457 memory leak in fishwrapd due to use of xmlGetNodePath()
  28110830 Whitney+ watch-net-all error when a link is down
  28109716 RESTapi Swagger: Missing /x/firmware/backupimage target and properties
  28109259 Load source fails with "Running Post Exec Process: /dev/shm/flashupdate.sh FAIL"
  28083767 Update GPU monitoring in device_monitor
  28079059 ILOM TLS ciphers need to be re-prioritized based on latest Oracle Doc, Mar 2018
  28072342 capi_get_cpu_details not working properly.
  28063593 RESTapi Swagger: Missing component_* properties under /System
  28063074 Emulex video driver needs range checking in FetchTiles to prevent memory corrupt
  28058381 Snapshot file is not generated when coredump occurs
  28056977 Deferred Firmware Update
  28049247 Disable TLSv1.1 by default
  28048990 RKVM Server can request video data outside of range
  28041428 RESTapi Swagger: Missing properties for concord platform
  28037045 device_monitor: devmonctl does not list HDD attached to Vail HBA
  28037022 device_monitor: no ereport generated for Vail ctemp of 115 and above
  28036989 device_monitor: no ireport generated for Vail ctemp between 110-114
  28035701 Posting firmware to SP via restapi caused webgo to restart on Nashua/Concord
  28028058 Problem with SYS-MGMT
  28028010 Problem with SYS-MGMT
  28027955 Problem with SYS-MGMT
  28027920 Remove unused client interfaces to ILOM
  28027787 need _suspect_uuid property for recorded faults
  28021819 CLI load command does not honor ^C to abort load
  28018846 incorrectly sized SERs may not be sent to the SP
  28012143 GM's cmn_msg ASSERT() should not be used in release builds
  28011559 Get VAIL attached disk info from ILOM directly and generate ererports
  28003359 Fix session exception list
  28001601 Remove IOEU support
  27998642 RESTapi GET: /SP/services/directconsole/ port=(none) failed
  27994758 ipmitool intermittently coredumps when ILOM is making snapshot
  27988160 A re-install of the libvncserver pkg requires an ILOM reboot
  27979868 jtag read_dram command broken in 9.8 ILOM on sonoma
  27970215 FRUID: Modify TLI long product name support with better FRUID space conservation
  27963819 hw_bti_mitigation resets to "enabled" rather than "default" on glued systems
  27963570 Make ILOM sshd auth mods compatible with sshd option 'UsePrivilegeSeparation'.
  27952614 Direct console port displayed as "(none)"
  27943162 load command leaves behind temporary file
  27939603 T8-1 DBP/NVME[0,1]/T_IN = na when Aura7-SFFs are added before start /SYS
  27939513 T8-1 DBP/NVME[0,1]/T_IN = na after Solaris Hotplug with Aura7-SFF
  27934510 GUI: Miniroot - Can't get back to Upload page after pressing Browser back button
  27928472 SDM Storage/Disks to display percent life used
  27910842 FRUID: TLIP: Primary container does not get synced with data from backup
  27902535 bug.log entry for 'CGI path being invoked with non-prefixed variable'
  27889736 Global pointer race condition in KhUSB driver
  27889703 Problem with SYS-MGMT
  27876848 REST SWAGGER: /System/Memory properties missing in swagger
  27875014 RESTapi: Add support for repairing, clearing faults.
  27869070 /System/Storage may report incorrect location for NVME SFFs
  27838344 Memory configuration broken in simulation
  27829766 Problem with SYS-MGMT
  27829766 Fix for CVE-2018-0739
  27827562 autofpga update log has no size limitation.
  27818518 HOPS reports ILOMs become unresponsive at the rate of approximately 1 per month
  27803946 W+ VF failure - HWRM failed to respond
  27797118 RESTapi Swagger: T7 Missing resources
  27796717 RESTapi Swagger: Missing /SP/policy/ EXCESSIVE_CE_RESET property
  27766540 Problem with SYS-MGMT
  27766272 Problem with SYS-MGMT
  27764942 Updated FRUID auto-generated files frudefs.h and deinfo.xml from 3/26/18
  27745963 RESTFuzz : webgo memory leak
  27733527 Vail Controller Monitoring support in ILOM
  27686540 Consolidate GPU Post Box Interface implementations and add basic monitoring
  27661731 Device Monitor: Placeholder support for Broadcom VAIL Controller
  27629404 Global OBP build should build FCode for all the Fortville based NICs
  27593483 i2c bus recovery fails on OffDuty SPM
  27588039 HC non-fatal RAS trap handler is nonfunctional
  27587322 Include NVMe in the info sent from hv to ilom
  27586227 Add support for Long Chassis / Product Serial Numbers
  27515848 remove stale cacheline retirement code
  27495347 local USB keyboard not detected after upgrading to OBP 4.42.3 SYS_FW 9.8.4
  27486506 Whitney net installation conneted via fiber to OPUS switchs fails with panic
  27485610 Write to the rom_bar as a 32 bit write.
  27456953 Whitney+ FCode failed when using force speed option for booting
  27290574 Problem with SYS-MGMT
  27282361 ldmd should get updates MD from HV, not GM
  27100922 ldom with Fortville port 0 virtual function/IO no device available in guest
  27019481 make MaxAuthRetries of DCA sshd configurable by user
  26737826 Rest POST Exceeded the limit of 3 active firmware update instances
  26703605 Parfait reports buffer overruns
  26663072 Problem with SYS-MGMT
  25779207 ILOM inconsistently reporting PCIe devices
  25705389 %pmcdper not managed correctly by hypervisor
  25653194 libnameValPairDB needs to be rewritten for atomic writes
  24828969 Migration performance regression running specjvm
  22968422 Misc bugs in vHBA code
  22344209 obp boot has irrespective 15 minute timeout for unavailable vdisks
  17318913 Misc bugs in OpenBoot code

Special Release Notes:

Note 1:  Instructions for Firmware Upgrade from Versions older than Sun System Firmware 9.5.2.g

1    Check current Sun System Firmware version

    -> show /HOST sysfw_version

    1.1    If current version is 9.5.2.g or later go directly to Step 10
    1.2    If current version is before 9.5.2.g follow Steps 2 through 10


2    Turn off host power

    -> stop /System
    -> show /System power_state

3    Record current network settings if not using DHCP

    -> show /SP/network
Note:  If not using DHCP, you must have local serial connection before proceeding.
4    Backup current Service Processor configuration (only from CLI or Web browser)

    -> set /SP/config passphrase=<XXXXXXXXXXXXXXXX>
    -> set /SP/config dump_uri=scp://<user>@<ipaddr_or_hostname>/XXXXXX.xml

5    Perform initial load of Sun System Firmware package

    -> load -source http://<ip_address_or_hostname>/Sun_System_Firmware¬-X_X_X.pkg

6    Restore network settings if not using DHCP (from CLI only on Local Serial Connection)

    -> set /SP/network pendingipaddress=<XX.XX.XX.XX> pendingipgateway=<YY.YY.YY.YY> pendingipnetmask=<ZZ.ZZ.ZZ.ZZ> commitpending=true

7    Perform second load of Sun System Firmware package

    -> load -source http://<ip_address_or_hostname>/Sun_System_Firmware¬-X_X_X.pkg

 8   Restore Service Processor configuration (only from CLI or Web browser)

    -> set /SP/config passphrase=<XXXXXXXXXXXXXXXX>
    -> set /SP/config load_uri=scp://<user>@<ipaddr_or_hostname>/XXXXXX.xml

9    Load the fallback image

    -> load /SP/firmware/host/miniroot -source http://<ip_address_or_hostname>/xxxxxxx-fallback_boot-sparc.pkg  
10    Perform final load of Sun System Firmware package

    -> load -source http://<ip_address_or_hostname>/Sun_System_Firmware¬-X_X_X.pkg



Note 2:  Information on the Live Firmware Update feature

In prior Sun System Firmware releases for SPARC T-series servers, both the Oracle ILOM and SPARC Host firmware were updated simultaneously during the Sun System Firmware update process, which required the Host to be powered off.  This was a limitation unique to SPARC T-series platforms.  In contrast, on SPARC M-series platforms, it was possible to download, update and activate the new ILOM firmware while the SPARC Host was powered on, and then in a later maintenance window, the already downloaded new Host components of the Sun System Firmware (OBP, Hypervisor, NYX and POST) were automatically activated when the Host was power cycled.

With the Live Firmware Update feature, the ILOM component of SPARC T-series Sun System Firmware can be updated similar to SPARC M-series platforms, regardless of whether the Host is still powered on.
"Host power must be turned off to execute this command.”
"NOTE: The host is powered on; HOST firmware will be updated automatically when the HOST is restarted.”
at which point the load command will continue execution.  The ILOM portion of the Sun System Firmware will be loaded and ILOM will reset, however the updated version of the Host firmware which has been loaded on the system, will not be activated until the next power cycle.
Note that the Live Firmware Update feature requires a minimum Sun System Firmware version of 9.5.2.g.


You can update Sun System Firmware using the Oracle ILOM CLI or ILOM BUI.  For instructions on how to perform the firmware update, see Performing Firmware Updates in the Oracle ILOM Administrator’s Guide for Configuration and Maintenance Firmware Release 4.0.x.  (https://docs.oracle.com/cd/E81115_01/html/E86149/z400371a1482113.html)



You can update Sun System Firmware using Oracle Solaris by using the fwupdate utility contained in Oracle Hardware Management Pack (OHMP).  OHMP is bundled in the Oracle Solaris operating system.
The command below will update Sun System Firmware and the Host will not be power cycled.  With this command, ILOM is updated, but the HOST portion of the Sun System firmware (OBP, Hypervisor, etc.) will only be updated the next time the Host is power cycled.
"fwupdate update all -x metadata.xml"
The command below will update Sun System Firmware and cause the Host to be power cycled so that the ILOM firmware and the Host firmware will be updated at the same time.  Solaris will be restarted if the system has been configured to auto boot.
"fwupdate update all -x powercycle_metadata.xml"

Note, with Solaris 11.4, the fwupdate command will encrypt data sent over the network to ILOM and certificate checking is enabled by default.  If appropriate, the certification checking can be disabled with the "--no-cert-check” command line option. For more details on the  fwupdate utility, usage, command line options and obtaining SSL certificates, refer to "Using fwupdate to Update Firmware" in the Oracle Server CLI Tools for Oracle Solaris 11.4 User's Guide (https://docs.oracle.com/cd/E79568_01/html/E79574/gyuui.html).

Note 3:  Disregard occasional extraneous messages displayed during fwupdate

"ERROR: Version verification failed."

“Error: Unable to establish IPMI v2 / RMCP+ session”

“Get Device ID command failed: Timeout”
You may disregard any of these messages.  The firmware update actually completed correctly and the messages can be ignored.





Note 4.  PCIe root port FMA alerts after upgrading from Sun System Firmware older than 9.9.1

          The alerts are innocuous and  can be removed using the 'fmadm clear' command. Example alert removal:

# fmadm list-alert
--------------------------------------------------------------------------
TIME EVENT-ID MSG-ID              SEVERITY
--------------------------------------------------------------------------
Apr 19 19:49:11 26553f6d-38d1-4472-8282-87e7a792c78f  FMD-8000-CV Minor

Problem Status    : open
Diag Engine       : software-diagnosis / 0.1
System
    Manufacturer  : Oracle Corporation
    Name          : SPARC T7-1
    Part_Number   : 33940198+1+1
    Serial_Number : AK00345576
    Host_ID       : 8699daa0

----------------------------------------
Suspect 1 of 1 :
   Problem class : alert.oracle.solaris.fmd.fru-monitor.fru-remove
   Certainty   : 100%

   FRU
     Status           : Active
     Location         : "/SYS/MB/IOH/IOS2/RP1"
     Manufacturer     : Oracle-Corporation
     Name             : ASY,MB,T7-1
     Part_Number      : 7315713
     Revision         : 01
     Serial_Number    : 465769T+1550N201JA
     Chassis
        Manufacturer  : Oracle Corporation
        Name          : SPARC T7-1
        Part_Number   : 33940198+1+1
        Serial_Number : AK00345576
   Resource
     Status           : Active

Description : FRU '/SYS/MB/IOH/IOS2/RP1' has been removed from the system.

Response    : FMD topology will be updated.

Impact      : System impact depends on the type of FRU.

Action      : Use 'fmadm faulty' to provide a more detailed view of this
event.
              Please refer to the associated reference document at
              http://support.oracle.com/msg/FMD-8000-CV  for the latest
service
              procedures and policies regarding this diagnosis.

# fmadm clear 26553f6d-38d1-4472-8282-87e7a792c78f