[an error occurred while processing this directive]
How to run MTA Monitoring Pipelines
The process for running all MTA pipelines is essentially the same.
Below we will outline this process and then follow this with sample runs
for each pipeline.
Requirements
Procedure
Below is the generic procedure for running the MTA pipelines. Items blocked
by "{" and "}", such as {input directory} ,
are placeholders for items the user defines. Substitute the appropriate value
for these items in the commands listed.
Follow these steps:
- Define items needed for running the pipeline
- {working directory} = Directory in which to run the pipeline
{input directory} = Directory containing input data
{output directory} = Direct to place monitoring output
{report directory} = Directory in which to build the MTA report tree.
{root} = Tag name for pipeline run.
- {pipeline template}
= Name of pipeline template to be run.
- mta_monitor_static.ped = Generic monitor pipe.
mta_monitor_state.ped = State dependent mnemonic pipeline.
- Reset the environment variable for report directory to the desired location.
- setenv MTA_REPORT_DIR {report directory}
- Prepare directories
- cd {working directory}
If they don't exist,
- mkdir -p {input directory}
- mkdir -p {output directory}
- mkdir -p {report directory}
NOTE: These directories DO NOT HAVE to be together. It is assumed in
these instructions that the input data is in a location the user does
not want the pipeline to access directly (i.e. a storage area).
Also, it is most likely that the REPORT directory is in some central
location not related to the run directories.
- Prepare inputs
- Copy the files you want to monitor to the input directory, if necessary
cp {input files} {input directory}
- Make a list of files to monitor
cd {input directory}
ls *.fits > {root}_dat.lis
cd {working directory}
- OPTION: use "pset" to change any pipeline/tool parameters from their defaults.
- Run the pipeline
- pbuilder.pl -i {input directory} -o {output directory} -r {root} -t {pipeline template} > {output directory}/{root}.ped
- pctr -prof {output directory}/{root}.ped -show
pbuilder.pl fills in the pipeline template with run specifics.
pctr executes the pipeline.
NOTE: There is a nifty script (flt_run_pipe) that reduces steps 3 and 4 to a single command.
flt_run_pipe -i {input directory} -o {output directory} -r {root} -t {pipeline template name}
You may find that preferable.
Congratulations on a (hopefully) successfull pipeline run.
Viewing the output
- The pipeline produces an HTML directory tree with summary pages for
each file monitored. To view this tree:
- Using your Web brouser, choose "Open File" to load {report directory}/mta_days.html
- Pick a day... any day (not "dayall") to get a page in outline form that
self-updates every 100 seconds.
- When a link becomes active... you may browse the results
Samples
-
-
-
-
-
-
-
-
-
-
-
-