Install → Overview
This page gives an overview of the steps to install the various software components needed to enable Job Performance data in XDMoD. Instructions for upgrading the software from are available on the upgrade page
Prerequisites
The Job Performance (SUPReMM) XDMoD module should be installed on an existing XDMoD instance. The XDMoD instance must have job accounting data shredded and ingested and present in the UI. Do not begin the install procedure until the accounting data is loaded into XDMoD. See the main XDMoD documentation for instructions on installing and configuring XDMoD.
Overview
The steps to install and configure the software are as follows:
- Install the PCP Data collection software on the HPC compute nodes.
- Install MongoDB document database to store job-level performance data.
- Install and configure the Job Performance module on an existing XDMoD instance.
- Install and configure the Job Summarization software.
- Run the Job Summarization and Data Ingestion processes.
It is important that the various software components are installed and configured in the order listed. For example, if the XDMoD module is not installed and configured then the summarization software will not be able to access the tables in XDMoD datawarehouse that are needed.
Software Compatibility
The Job Performance (SUPReMM) XDMoD module version number must be identical to the version of the base XDMoD install. The versions of the summarization software and PCP software for a given XDMoD version are listed below.
Open XDMoD 9.5.0
| Package | Recommended Version | Compatible Version(s) |
|---|---|---|
| Job Summarization | 1.4.0 | 1.1.x, 1.2.x |
| PCP | 4.1.0 or 4.3.2 | 4.x |
The SUPReMM software has been tested with MongoDB version 3.4.15. We expect that the software is compatible with any supported release version of MongoDB.
The summarization software is tested against the PCP versions shipped with Centos 7.6 and Centos 7.7. The software should be compatible with the 5.x releases of PCP. However the XDMoD team have not tested this configuration and will not be able to provide support for it.
System Requirements
The detailed list of software packages for each subsystem is listed in the respective system requirements pages.
Hardware requirements
The XDMoD Job Performance (SUPReMM) module must be installed on an existing, functional XDMoD instance.
The PCP data collection software must be installed on the existing HPC compute nodes.
The Job summarization software and Mongo database may be installed on the same server as the XDMoD instance. However, for best performance, it is recommended that a dedicated server is used to host the Mongo database. This server can also be used to run the Job summarization software.
We do not recommend installing databases or webservers on any HPC compute nodes.
Storage requirements
The amount of data storage depends on the amount of historical data that is desired to be stored.
The following estimates are based on using the default configuration:
- Raw node level metrics: 70 MB per node per day (stored as files on the network filesystem)
- Job level summary records: 36 KB per job (stored in MongoDB)
- XDMoD datawarehouse: 2 KB per job (stored in MySQL)
These estimates were obtained from the average storage usage for the SUPReMM system installed on the HPC resource at CCR Buffalo. The actual quantity of data storage required depends on many factors including the rate of job creation and which metrics are collected.
Typical install locations
- HPC Compute Nodes have the PCP data collection software installed on them. The collection software is configured to collect metrics from the nodes periodically and whenever an HPC job starts or ends. The data are logged to shared storage such as a parallel filesystem or a network attached storage device.
- Dedicated web server has the XDMoD software and Job performance (SUPReMM) XDMoD module installed.
- Dedicated MySQL server hosts a MySQL instance containing the XDMoD datawarehouse.
- Dedicated SUPReMM server has the SUPReMM job summarization software and MongoDB document database installed. This server requires read access to the node-level PCP archives generated on the compute nodes and access to the Open XDMoD datawarehouse MySQL database.
