Example HEP files for testing and demonstrating
Project description
scikit-hep-testdata
A common package to provide example files (e.g. ROOT) for testing and developing packages against. The sample of files is representative of typical files found "in the wild".
In addition to including some root files directly, this package adds some simple helper methods to get larger files from common open-access data repositories.
Installing and usage
To install:
python -m pip install scikit-hep-testdata
Once installed, absolute file paths can be resolved using the helper methods:
from skhep_testdata import data_path
filename = data_path("some_file.root")
By default, if an unknown file is requested an exception is raised but this can be skipped by passing the above method raise_missing=False:
filename = data_path("unknown_file.root", raise_missing=False)
The files are not stored on PyPI, so if installed from SDist/wheel, the "local"
files will not be present, but will be downloaded from GitHub and cached in the
~/.local/skhepdata directory. If you make an editable install from the Git repo,
or if you set SKHEP_DATA=1 when building/installing from the Git repo, you will
have the data files locally.
You can see all "local" files with skhep_testdata.known_files, and you can
download all files at once with skhep_testdata.download_all(), optionally selecting
the download cache directory.
Remote vs. Local files
Some files, particularly large ones, for example, are not stored within this
package and instead live on a remote server; we call these "remote files". To
obtain these use the same data_path method as above, however this will
trigger the code to download and configure the remote file. This might be slow
the first time round but will subsequently be as fast as for a local file.
WARNING: the local file caching system has not yet been applied to remote
files.
Command-line invocation
You can also interact with this package from the command-line:
# Print a path (download if needed)
python -m skhep_testdata cms_hep_2012_tutorial/data.root
# Show all "local" files
python -m skhep_testdata --list
# Download all files to an existing directory
python -m skhep_testdata --all --dir local
You can also use pipx run scikit-hep-testdata to access the above CLI without installing.
Adding new files
We're on the look out for new, interesting files!
- Large files: If the file is particularly large, for example > 25 MB, it might be worth adding to an external open access data repository and adding a configuration here so that the internal helper methods can pull this down.
- Experiment data policies: Please make sure you have permissions to add the file to this collection, and that any private or sensitive data has been appropriately masked, salted, or scrambled.
List of files
The following lists describe the files known by this package.
Files stored in this package
Known remote files
Acknowledgements
- Many of the files collected directly within this package were collated originally by Jim Pivarski for uproot
Running the tests
This package uses pytest to run the unit tests. Install with pip install scikit-hep-testdata[test] or pip install -e .[test] (dev) to get the testing requirements.
then run:
pytest
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file scikit_hep_testdata-0.4.14.tar.gz.
File metadata
- Download URL: scikit_hep_testdata-0.4.14.tar.gz
- Upload date:
- Size: 20.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.9.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | d141415a7cf2ed41096bd70b1920b7f21db4d5e34f1a58c73852da4756316bd5 |
|
| MD5 | 37a6c517e5668d8ce641ada49f6a0b6e |
|
| BLAKE2b-256 | 00098afc46440c573e5e5221c61b9ec9beca1a2542a22c53705306f9f4b40a89 |
File details
Details for the file scikit_hep_testdata-0.4.14-py2.py3-none-any.whl.
File metadata
- Download URL: scikit_hep_testdata-0.4.14-py2.py3-none-any.whl
- Upload date:
- Size: 11.2 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.9.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c7c1927c0eae88249d0b18b12798e31484bd8287ea585dce99a54a621b7bb51c |
|
| MD5 | db77250d3f9b5fab927f6c37e48d6430 |
|
| BLAKE2b-256 | 53bbf8d4910d5bd3843921742a0903e111152a47355e32dc8aae37f71510ce9f |
