main
- Date:
26 September 2021
NAME
Plugin_darshan_stream_store - LDMS darshan_stream_store plugin
SYNOPSIS
DESCRIPTION
With LDMS (Lightweight Distributed Metric Service), plugins for the ldmsd (ldms daemon) are configured via ldmsd_controller or a configuration file. The darshan_stream_store plugin writes out a single darshan json stream’s data to SOS container. The input data produced by the LDMS darshan plugin consist of two types of messages: “MOD” for module data and “MET for meta data. Both messages saved into the same SOS container.
CONFIGURATION ATTRIBUTE SYNTAX
- config
- name=darshan_stream_store path=<path> stream=<stream> [mode=<mode>]configuration line
- name=<plugin_name>
- This MUST be darshan_stream_store.
- path=<path>
- The path to the root of the SOS container store (should be created by the user)
- stream=<stream>
- stream to which to subscribe.
- mode=<mode>
- The container permission mode for create, (defaults to 0660).
INPUT JSON FORMAT
The input json has a “type” field, and this type used to select the the message type between module data and meta data.
A MOD darshan JSON example is shown below:
{“job_id”:6582,”rank”:0,”ProducerName”:”nid00021”,”file”:”N/A”,”record_id”:6222542600266098259,”module”:”POSIX”,”type”:”MOD”,”max_byte”:16777215,”switches”:0,”cnt”:1,”op”:”writes_segment_0”,”seg”:[{“off”:0,”len”:16777216,”dur”:0.16,”timestamp”:1631904596.737955}]}
A MET darshan JSON example is shown below:
Some fields are set to -1 if they don’t have data for that message type.
BUGS
No known bugs.
NOTES
This store is in development and may be changed at any time.
Only supports one stream
EXAMPLES
Within ldmsd_controller or a configuration file:
load name=darshan_stream_store
config name=darshan_stream_store path=/tmp/darshan_stream stream=darshanConnector
prdcr_add name=localhost1 host=localhost type=active xprt=sock port=52001 interval=20000000
prdcr_subscribe stream=darshanConnector regex=localhost*
prdcr_start name=localhost1
SEE ALSO
ldmsd(8), ldms_quickstart(7), ldmsd_controller(8), ldms_sampler_base(7), darshan_publisher, darshan_sampler, parser.pl (has perlpod), Plugin_darshan_cat_publisher(7)