Skip to main content

F.A.S.T. package for describing datasets

Project description

pypi package pipeline status coverage report

fast-curator

Create, read and write dictionary descriptions of input datasets to process. Currently all datasets are expected to be built from sets of ROOT Trees.

Requirements

Installing

pip install --user fast-curator

Usage

# Local files:
fast_curator -o output_file_list.txt -t tree_name -d dataset_name --mc input/files/*root

# Single XROOTD files:
fast_curator -o output_file_list.txt --mc root://my.domain.with.files://input/files/one_file.root

# XROOTD files with several globs
fast_curator -o output_file_list.txt --mc root://my.domain.with.files://inp*/files/*.root

Notes:

  1. If the command is called multiple times with the same output file (using the -o option), the additional files specified will be appended to the output file.
  2. Arbitrary meta-data (such as cross-section, data quality, generator precision, etc) can be added to each dataset with the -m option.

For more guidance try the built-in help:

fast_curator --help

Reading dataset files back

import fast_curator
datasets = fast_curator.read.from_yaml("my_dataset_file.yml")

Will return a list of datasets with the default section applied to each dataset.

Further Documentation

Is on its way...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fast-curator-0.2.1.tar.gz (6.5 kB view details)

Uploaded Source

Built Distribution

fast_curator-0.2.1-py2.py3-none-any.whl (8.3 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file fast-curator-0.2.1.tar.gz.

File metadata

  • Download URL: fast-curator-0.2.1.tar.gz
  • Upload date:
  • Size: 6.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2

File hashes

Hashes for fast-curator-0.2.1.tar.gz
Algorithm Hash digest
SHA256 42d860a4b2eb6692f6b67f43f025c49dc34e011282d69c740fe356a1ecd3d113
MD5 2a40691bea10c31881c44f72ba4e64a5
BLAKE2b-256 a9bfa7a08373a7dd6bbe1871cca33180d5905da773cfc853e39e59a35803cde7

See more details on using hashes here.

File details

Details for the file fast_curator-0.2.1-py2.py3-none-any.whl.

File metadata

  • Download URL: fast_curator-0.2.1-py2.py3-none-any.whl
  • Upload date:
  • Size: 8.3 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2

File hashes

Hashes for fast_curator-0.2.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 826397b112f4cecf66e8d0ddafa7792d9731658e3be612f32521082f38854bf8
MD5 e0065d71c82fb70218d1a6bdb1338e74
BLAKE2b-256 8a22bf45c91284e277aa2bb0f14552c14de3b90ecbc8b0c6a460e65d385c7c3a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page