Software Product Description ___________________________________________________________________ PRODUCT NAME: Compaq Galaxy Software Architecture on OpenVMS Alpha, Version 1.0-3 SPD 70.44.04 Note: This SPD describes the Compaq Galaxy Software Architecture on Open- VMS, which is available as a separately licensed System Integrated Prod- uct (SIP). Throughout this document, OpenVMS Galaxy and Galaxy refer to the Com- paq Galaxy Software Architecture on OpenVMS. The term instance refers to a copy of the OpenVMS Alpha operating system. DESCRIPTION OpenVMS Galaxy enables multiple instances of OpenVMS to execute co- operatively in a single computer, giving customers the ability to man- age unpredictable, variable, or growing workloads. With OpenVMS Al- pha Version 7.2-1 or higher, customers can configure AlphaServer ES40, GS140, GS60, GS60E, 8400, 8200, and 4100 systems as OpenVMS Galaxy sys- tems. With OpenVMS Alpha Version 7.2-1H1 or higher, customers can config- ure AlphaServer GS80, GS160 and GS320 systems as OpenVMS Galaxy sys- tems. With OpenVMS Galaxy, many processors and other physical resources are partitioned in order to run multiple instances of operating systems. Each instance has assigned CPUs, memory, and I/O. The instances share a part of the memory, and CPUs can be reassigned from one instance to another while the system is running. This computing environment can be dynamically adapted to meet changing application needs and work- load demands. March 2001 Software logically partitions systems by assigning CPUs, memory, and I/O ports to individual instances of the OpenVMS operating system. This partitioning, which a system manager directs, is a software function; no hardware boundaries are required. Each individual instance has the resources it needs to execute independently. An OpenVMS Galaxy envi- ronment is adaptive in that resources such as CPUs can be dynamically reassigned to different instances of OpenVMS. Memory is logically partitioned into private and shared sections. Each instance of the operating system has its own private memory, which means that no other instance writes to those physical pages. Some of the shared memory is available for instances of OpenVMS to communicate with one another, and the rest of the shared memory is available for applica- tion data. An OpenVMS Galaxy has a highly scalable I/O subsystem because the sys- tem contains multiple primary CPUs - one in each instance. In addi- tion, OpenVMS currently has features for distributing some I/O to sec- ondary CPUs in a symmetric multiprocessing (SMP) system. CPUs within an OpenVMS Galaxy are allocated to instances. In an OpenVMS Galaxy environment, the console firmware plays a crit- ical role in partitioning hardware resources. It maintains the per- manent configuration in NVRAM and the running configuration in mem- ory. The console provides each instance of the OpenVMS operating sys- tem with a pointer to the running configuration data. The console performs power-up self-tests, initializes hardware, ini- tiates system booting, and performs I/O services during system boot- ing and shutdown. The console program also provides run-time services to the operating system for console terminal I/O, retrieval of envi- ronment variables, NVRAM saving, and other services. An OpenVMS Galaxy computing environment lets customers decide how much cooperation exists between instances in a single computer system. In a shared-nothing computing model, the instances do not share any resources; operations are isolated from one another. 2 In a shared-partial computing model, the instances share some resources and cooperate in a limited way. In a shared-everything model, the instances cooperate fully and share all available resources. OpenVMS Galaxy leverages proven OpenVMS Cluster, SMP, and performance capabilities to offer greater levels of performance, scalability, avail- ability, and flexibility. By running multiple instances of OpenVMS in a single computer, an Open- VMS Galaxy computing environment gives you quantum improvements in: o Compatibility-Existing applications run without changes. o Availability-Presents opportunities to upgrade software and expand system capacity without downtime. o Scalability-Offers scaling alternatives that improve performance of SMP and cluster environments. o Adaptability-Physical resources can be dynamically reassigned to meet changing workload demands. o Cost of ownership-Fewer computer systems reduce system management requirements, floor space, and more. For companies looking to improve their ability to manage unpredictable, variable, or growing IT workloads, OpenVMS Galaxy technology provides a flexible way to dynamically reconfigure and manage system resources. An OpenVMS Galaxy computing environment is ideal for high-availability applications, such as: o Database servers o Transaction processing systems o Data warehousing o Data mining o Internet servers 3 Software and Hardware Components An OpenVMS Galaxy computing environment is comprised of the follow- ing: o OpenVMS Alpha operating system o AlphaServer Console Firmware o Supported hardware For more information about these components, see the Software Require- ments and Hardware Requirements sections of this SPD. FEATURES With OpenVMS Alpha Version 7.2-1H1 or later, you can create an Open- VMS Galaxy computing environment that allows you to: o Run two instances of OpenVMS on an AlphaServer GS80. o Run four instances of OpenVMS on an AlphaServer GS160. o Run eight instances of OpenVMS on an AlphaServer GS320. With OpenVMS Alpha Version 7.2-1 or higher, you can create an Open- VMS Galaxy computing environment that allows you to: o Run three instances of OpenVMS on an AlphaServer 8400/GS140. o Run two instances of OpenVMS on an AlphaServer 8200/GS60/GS60E. o Run two instances of OpenVMS on an AlphaServer 4100. o Run two instances of OpenVMS on an AlphaServer ES40. o Reassign CPUs between instances. o Perform independent booting and shutdown of instances. o Use shared memory for interinstance communication. o Create a shared memory RAMdisk with Compaq DECram for OpenVMS Al- pha Version 3.0. 4 o Cluster instances within an OpenVMS Galaxy using the Shared Mem- ory Cluster Interconnect (SMCI). o Cluster instances with non-Galaxy systems. o Create applications using OpenVMS Galaxy application programming interfaces (APIs) for resource management, event notification, lock- ing for synchronization, and shared memory for global sections. o Use the Galaxy Configuration Utility (GCU) to view and control the OpenVMS Galaxy environment. o Run a single-instance OpenVMS Galaxy on any Alpha system for ap- plication development. The following sections describe some of these features in more detail. Galaxy Configuration Utility The Galaxy Configuration Utility is a DECwindows Motif application that allows system managers to configure and manage an OpenVMS Galaxy sys- tem from a single workstation window. Using the GCU, system managers can: o Display the active Galaxy configuration. o Reassign resources among Galaxy instances. o View resource-specific characteristics. o Shut down or reboot one or more Galaxy instances. o Invoke additional management tools. o Create and engage Galaxy configuration models. o Create a single-instance Galaxy on any Alpha system (for software development on non-Galaxy hardware platforms). o View the online Galaxy documentation. o Determine hot-swap characteristics of the current hardware plat- form. 5 Shared Memory Cluster Interconnect The Shared Memory Cluster Interconnect (SMCI) is a System Communica- tions Services (SCS) port for communications between Galaxy instances. When an OpenVMS instance is booted as both a Galaxy and as an Open- VMS Cluster member, the SMCI driver is loaded. This SCS port driver communicates with other cluster instances in the same Galaxy through shared memory. This capability provides one of the major performance benefits of the OpenVMS Galaxy Software Architecture. The ability to communicate to another clustered instance through shared memory pro- vides dramatic performance benefits over traditional cluster inter- connects. Local Area Network (LAN) Shared Memory Device Driver Local Area Network (LAN) communications between OpenVMS Galaxy instances are supported by the Ethernet LAN shared memory driver. This LAN driver communicates to other instances in the same OpenVMS Galaxy system through shared memory. Communicating with other instances through shared mem- ory provides performance benefits over traditional LANs. RAMdisk in Shared Memory In DECram for OpenVMS Alpha Version 3.0, DECram's capability is ex- tended to use OpenVMS Galaxy shared memory to create an OpenVMS shared memory disk. This allows users to take advantage of OpenVMS Galaxy shared memory without modifications to any of their applications. Application Programming Interfaces o Locks for synchronization o Event notification o Shared memory global sections o Configuration information o CPU management For more information about OpenVMS Galaxy APIs, refer to the OpenVMS Alpha Partitioning and Galaxy Guide. 6 Single-Instance Galaxy Configuration A single-instance Galaxy is for non-Galaxy platforms, that is, those without a Galaxy console. Galaxy configuration data, which is normally provided by console firmware, is instead created in a file. By set- ting the system parameter GALAXY to 1, SYSBOOT reads the file into mem- ory and the system boots as a single-instance Galaxy, complete with shared memory, Galaxy system services, and even self-reassignment of CPUs. This can be done on any Alpha platform. Single-instance Galaxy configurations will run on any Alpha worksta- tions or servers (even laptops) running OpenVMS Version 7.2-1 or higher. This capability allows early adopters to evaluate OpenVMS Galaxy fea- tures and, most important, to develop and test Galaxy-aware applica- tions without incurring the expense of setting up a full-scale Galaxy platform. Because a single-instance Galaxy is not an emulator-it is real Galaxy code-applications developed on a single-instance Galaxy will run on multiple-instance configurations. SOFTWARE REQUIREMENTS OpenVMS Galaxy configurations require OpenVMS Alpha Version 7.2-1 or higher. OpenVMS Galaxy console firmware for the supported AlphaServers is lo- cated on the Alpha Systems Firmware Update CD-ROM. HARDWARE REQUIREMENTS Configuring an OpenVMS Galaxy computing environment requires: o One I/O module for each partition o At least one processor module for each partition o A dedicated serial console port for each partition o Sufficient memory for operating system and required applications 7 Optional Hardware OpenVMS Version 7.3 customers might want to use the following optional hardware: o Plug-in units (PIUs) for I/O expansion from an I/O module (PCI or XMI) o I/O adapters for network, storage, or traditional cluster inter- connects o Additional CPUs for SMP instances o Additional memory for Galaxywide global sections GCU Hardware Requirements Compaq recommends an Alpha or VAX workstation running DECwindows or a Windows NT workstation with an X terminal emulator as a display de- vice for the OpenVMS Galaxy Configuration Utility. SUPPORTED HARDWARE AlphaServer GS80/160/320 Galaxy Configuration OpenVMS Alpha Version 7.2-1H1 or higher supports the following max- imum configurations on AlphaServer GS80 systems: 2 instances 2 QBBs 8 CPUs 64 GB memory OpenVMS Alpha Version 7.2-1H1 or higher supports the following max- imum configuration on AlphaServer GS160 systems: 4 instances 4 QBBs 16 CPUs 128 GB memory 8 OpenVMS Alpha Version 7.2-1H1 or higher supports the followng maxi- mum configurations on AlphaServer GS320 systems: 8 instances 8 QBBs 32 CPUs 256 GB memory Configuration Rules Note: The AlphaServer GS80, GS160, and GS320 systems can be config- ured with one or more hard partitions. OpenVMS Galaxy can be installed on each hard partition to configure one or more soft partitions. o Must have standard COM1 UART console line for each soft partition. o Must have a master PCI drawer for each soft partition. o Must have an I/O module per soft partition. o Must have at least one CPU module per soft partition. o Must have at least one memory module per soft partition. AlphaServer ES40 Galaxy Configuration AlphaServer ES40 systems can support a maximum of two instances of Open- VMS. AlphaServer ES40 Clock An AlphaServer ES40 has one clock. For an OpenVMS Galaxy, this means that you cannot run the two instances at different times. Also, the SET TIME command affects both instances. Note that this may not be- come evident until a number of hours have passed. Console Ports On a rack-mounted system: COM1 (lower) is the console port for instance 0. COM2 (upper) is the console port for instance 1. 9 On a pedestal system: COM1 (left) is the console port for instance 0. COM2 (right) is the console port for instance 1. Unlike creating an OpenVMS Galaxy on an AlphaServer 8400 system, you do not need additional hardware for the second console. COM2 is used for this purpose. CPUs CPU0 must be the primary for instance 0. CPU1 must be the primary for instance 1. CPUs 2 and 3 are optional secondary CPUs that can be migrated. I/O Adapters On a rack-mounted system: PCI Hose 0 (PCI0) belongs to instance 0 (upper 4 PCI slots) PCI Hose 1 (PCI1) belongs to instance 1 (lower 6 PCI slots) On a pedestal system: PCI Hose 0 (PCI0) belongs to instance 0 (right-hand slots) PCI Hose 1 (PCI1) belongs to instance 1 (left-hand slots) Note that PCI0 contains an embedded ISA controller. Storage Controllers You will need one storage controller (such as a KZPSA) per instance. For each instance, this can go to a separate StorageWorks box or to the same box for running as a SCSI cluster. Network Cards If each instance needs network access, a network card (such as a DE600) is required for each instance. One card each goes in PCI0 and PCI1. Memory Granularity Restrictions Private memory must start on a 64 MB boundary. 10 Shared memory must start on an 8 MB boundary. Instance 0 must have a multiple of 64 MB. AlphaServer 8400/GS140 Galaxy Configuration AlphaServer 8400 systems can support two or three instances of OpenVMS. 9 slots for: I/O modules Memory modules Processor modules (2 CPUs per module) Console line for each partition: Standard UART for first partition KFE72-DA for each additional partition Example Configuration 1: 2 partitions, 8 CPUs, 12 GB memory 9 slots allocated as follows: Two I/O modules Four Processor modules (2 CPUs each) Three Memory modules (4 GB each) Example Configuration 2: 3 partitions, 8 CPUs, 8 GB memory 9 slots allocated as follows: Three I/O modules Four Processor modules (2 CPUs each) Two Memory modules (4 GB each) AlphaServer 8200/GS60/GS60E Galaxy Configuration AlphaServer 8200, GS60, and GS60E systems can support one possible OpenVMS Galaxy configuration (two instances only). 11 5 slots for: Two processor modules (two CPUs each) Two I/O modules One memory module The AlphaServer GS140, GS60, GS60E, 8400, and 8200 systems provide a built-in UART for the first console line. Each additional console re- quires a module set. The only hardware required for Galaxy operation that is not in the typ- ical AlphaServer GS140, GS60, GS60E, 8400, and 8200 configuration is the KFE72-DA console subsystem. The KFE72-DA module set is the set of EISA bus modules that establish a console port. XMI Bus Support The XMI bus is supported only on the first instance (Instance 0) of a Galaxy configuration in an AlphaServer 8400 system. AlphaServer 8400 systems can support only one DWLM-AA XMI PIU subsys- tem cage for all XMI devices. Note that the DWLM-AA takes up consid- erable space in the system because an I/O bulkhead is required on the back of the system to connect all XMI devices to the system. This al- lows only two additional DWLPB PCI PIUs in the system. EISA Bus Support The EISA bus is supported only on the first instance (instance 0) of a Galaxy configuration. Due to the design of all EISA options, they must always be on instance 0 of the system. A KFE70 must be used in the first instance for any EISA devices in the Galaxy system. All EISA devices must be on Instance 0. No EISA devices are supported on any other instance in a Galaxy system. A KFE72-DA installed in other instances provides console connection only and cannot be used for other EISA devices. AlphaServer 4100 Configuration 12 To create an OpenVMS Galaxy on an AlphaServer 4100 system, you must observe the following configuration and hardware requirements: Two-Instance Maximum You can run a maximum of two instances of OpenVMS on an AlphaServer 4100. Console Firmware You must have AlphaServer 4100 console firmware, which is located on the Alpha Systems Firmware Update Version 5.4 CD-ROM that is included with the OpenVMS Alpha Version 7.2-1 CD-ROM package. AlphaServer 4100 Clock An AlphaServer 4100 has one clock. For an OpenVMS Galaxy, this means that you cannot run the two instances at different times. Also, the SET TIME command affects both instances. Note that this may not be- come evident until a number of hours have passed. Console Ports COM1 (upper) is the console port for instance 0. COM2 (lower) is the console port for instance 1. Unlike creating an OpenVMS Galaxy on an AlphaServer 8400, you do not need additional hardware for the second console. COM2 is used for this purpose. CPUs CPU0 must be the primary for instance 0. CPU1 must be the primary for instance 1. CPUs 2 and 3 are optional secondary CPUs that can be migrated. I/O Adapters The four lower PCI slots belong to IOD0, which is the I/O adapter for instance 0. The four upper PCI slots belong to IOD1, which is the I/O adapter for instance 1. 13 Storage Controllers You will need two storage controllers (such as KZPSAs). These can go to separate StorageWorks boxes or to the same box for running as a SCSI cluster. One controller each goes in IOD0 and IOD1. Network Cards If each instance needs network access, a network card (such as a DE500) is required for each instance. One card each goes in IOD0 and IOD1. Physical Memory Because OpenVMS Galaxy on an AlphaServer 4100 does not support mem- ory holes, physical memory for an OpenVMS Galaxy environment must be contiguous. To achieve this on an AlphaServer 4100, one of the fol- lowing must be true: o All memory modules must be the same size (for example, 1 GB). o If two sizes are present, only one module can be a smaller size. You must put the larger modules into the lower-numbered slots. LICENSING REQUIREMENTS The OpenVMS Galaxy Software Architecture on OpenVMS (OpenVMS Galaxy) is a System Integrated Product (SIP): the OpenVMS Galaxy code is in- tegrated and delivered with the OpenVMS operating system. The License Management Facility (LMF) Product Authorization Keys (PAKs) representing OpenVMS Galaxy licenses allow you to access and use Open- VMS Galaxy software. For more information about the location of the PAKs available with OpenVMS Alpha Version 7.3, see the Guide to Open- VMS Version 7.3 CD-ROMs. The following list summarizes OpenVMS Galaxy licensing requirements: o One OpenVMS Operating System License for a Galaxy system o One SMP Extension License for each CPU after the first CPU 14 o One OpenVMS Galaxy License for each CPU in a Galaxy system o No changes to how Compaq layered products are licensed: One capacity license per system One user license per use The following sections describe these requirements in more detail. OpenVMS Operating System License When an AlphaServer system is configured as an OpenVMS Galaxy system, there are no changes in how a system is licensed for the OpenVMS op- erating system. One OpenVMS Base License is required for the Galaxy system, plus one SMP Extension License for each CPU after the first CPU. OpenVMS Galaxy License In order to create and run multiple instances, one OpenVMS Galaxy Li- cense is required for each CPU in a Galaxy system. License rights for running a single-instance Galaxy on any Alpha sys- tem are provided by the OpenVMS Base License. OpenVMS Layered Products License Compaq software layered products on OpenVMS Galaxy configurations con- tinue to use standard license types: Traditional, Concurrent Use, and Personal Use. o One Traditional capacity License will continue to license the sys- tem, regardless of the number of instances. The license is based on the system class of the hardware system. o Concurrent Use Licenses will continue to license one concurrent use of the product. o Personal Use Licenses will continue to license one named user on the system. Clustering OpenVMS Galaxy Instances 15 Instances in an OpenVMS Galaxy computing environment can be clustered with other instances in a single system, with instances in other Galaxy systems, or with non-Galaxy systems. Each type of clustering has dif- ferent licensing requirements, as described in the following sections. Clustering within a Galaxy System In an OpenVMS Galaxy computing environment, instances can be clustered with other instances within a Galaxy system. Clustered instances use the shared-memory cluster interconnect to communicate with each other. The licensing and functionality for clustering within a Galaxy sys- tem is provided under the OpenVMS Galaxy License. Clustering Outside a Galaxy System Instances in an OpenVMS Galaxy computing environment can be clustered with instances in another OpenVMS Galaxy system or with cluster nodes in non-Galaxy systems. Instances clustered outside of a Galaxy sys- tem use traditional cluster interconnects. Each system that is clustered with another system must be licensed for OpenVMS Cluster Software. Clustering outside the OpenVMS Galaxy sys- tem is not covered by the OpenVMS Galaxy License. DISTRIBUTION MEDIA The Compaq Galaxy Software Architecture on OpenVMS Alpha is supplied on the same distribution media as the OpenVMS operating system. For more information, refer to the Compaq OpenVMS Operating System for VAX and Alpha Software Product Description (SPD 25.01.xx). 16 ORDERING INFORMATION Software Licenses QL-66XAA-3B Compaq Galaxy 1 CPU License QL-66XAA-3C Compaq Galaxy 2 CPU License QL-66XAA-3D Compaq Galaxy 4 CPU License QL-66XAA-3E Compaq Galaxy 8 CPU License QL-66XAA-3F Compaq Galaxy 16 CPU License Documentation The OpenVMS Alpha Partitioning and Galaxy Guide describes how to cre- ate, manage, and use an OpenVMS Galaxy computing environment. This book includes: o OpenVMS Galaxy hardware and configuration requirements o Procedures for creating OpenVMS Galaxy computing environments on OpenVMS AlphaServer GS80, GS160, GS320, ES40, GS140, GS60, GS60E, 8400, 8200, and 4100 systems o Complete details about how to use all of the OpenVMS Galaxy fea- tures and capabilities available in OpenVMS Alpha Versions 7.2-1, 7.2-1H1, and 7.3. The OpenVMS Alpha Partitioning and Galaxy Guide is available on the OpenVMS Version 7.3 documentation CD-ROM in HTML and PDF formats, and on the Version 7.2-1H1 documentation CD-ROM in HTML format. SOFTWARE LICENSING This software is furnished under the licensing provisions of Compaq Computer Corporation's Standard Terms and Conditions and the follow- ing terms. In case of conflict the latter shall govern. For more in- formation about Compaq's licensing terms and policies, contact your local Compaq office. 17 License units for OpenVMS Galaxy are allocated on a CPU-capacity ba- sis. An OpenVMS Galaxy license is required for each CPU within a sys- tem. License Management Facility Support This system integrated product supports the OpenVMS License Manage- ment Facility. For more information on the License Management Facility, refer to the OpenVMS Operating System for VAX and Alpha Software Product Descrip- tion (SPD 25.01.xx), or the appropriate operating system documenta- tion set. SOFTWARE PRODUCT SERVICES A variety of service options are available from Compaq. For more in- formation, contact your local Compaq office. SOFTWARE WARRANTY Warranty for this software product is provided by Compaq with the pur- chase of a license for the product as defined in the Software Warranty Addendum of this SPD. The previous information is valid at time of release. Please contact your local Compaq office for the most up-to-date information. © 2001 Compaq Computer Corporation AlphaServer, Compaq, StorageWorks, VAX, VMS, and the Compaq logo Reg- istered in U.S. Patent and Trademark Office. OpenVMS is a trademark of Compaq Information Technologies Group, L.P. in the United States and other countries. Microsoft, Windows, and Windows NT are trademarks of Microsoft Cor- poration in the United States and other countries. 18 Motif is a trademark of The Open Group in the United States and other countries. All other product names mentioned herein may be the trademarks of their respective companies. Confidential computer software. Valid license from Compaq required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Com- mercial Computer Software, Computer Software Documentation, and Tech- nical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. Compaq shall not be liable for technical or editorial errors or omis- sions contained herein. The information in this document is provided "as is" without warranty of any kind and is subject to change with- out notice. The warranties for Compaq products are set forth in the express limited warranty statements accompanying such products. Noth- ing herein should be construed as constituting an additional warranty. 19 20