GT 4.0 WS MDS: Cluster Monitoring Information and the GLUE Resource Property
Introduction
The GLUE resource property (as used by GRAM) collects information from two sources: the scheduler and the cluster information system (for example Ganglia or Hawkeye).
These will be merged to form a single output resource property in the GLUE schema.
Configuring
This section describes configuring for use in GRAM.
The scheduler does not need to be configured, as GRAM already knows the scheduler bundle to use through other means.
GT4.0 comes with providers which collect data from two cluster monitoring systems:
- Ganglia
- Hawkeye
These are configured in $GLOBUS_LOCATION/etc/globus_wsrf_mds_usefulrp/gluerp.xml
To collect data from Hawkeye, set the defaultProvider
option in this file to:
<defaultProvider>shell
/scratch/gt4b/I/libexec/globus-mds-cluster-hawkeye
</defaultProvider>
To collect data from Ganglia, use set the default provider option
in this file to:
<defaultProvider>java
org.globus.mds.usefulrp.glue.GangliaElementProducer
</defaultProvider>
If no cluster monitoring
in this file is available, set the defaultProvider as follows:
(this is the way the toolkit comes as installed)
<defaultProvider>none</defaultProvider>
Writing new providers
There are two kinds of providers used by the GLUE Resource Property:
- Scheduler providers - which provide information about the queues that a batch system makes available.
- Cluster information providers - which provide information about the host(s) on which GRAM will run jobs.
Scheduler providers should be written as executables with a name corresponding to the name of the batch system; Cluster providers can be written either as Java classes or as executables.
Java providers should implement the
GLUEElementProducer
interface.
Executable providers should output a single XML document to stdout when executed, and then exit.
The output format for scheduler and cluster providers is defined in
XML schema definitions, located at
$GLOBUS_LOCATION/share/schema/mds/usefulrp/batchproviders.xsd
and
$GLOBUS_LOCATION/share/schema/mds/usefulrp/ce.xsd
.