miranda 0.4.0

Improvements have been made to the development documentation; Project URLs, ReadTheDocs theming, and other quality of life changes.

Conversion JSON definitions now support pre-processing to render dimensions and variable names consistent before running corrections/conversions.

New datasets with CF-like attributes conversion supported:

• RDRS (ECCC)

• GRNCH (ETS)

Preliminary miranda.io module for organizing output-writing functionality.

New miranda.io.fetch_chunk_config function for “rechunking” datasets according to project presets.

New mirands.io.utils.name_output_file for generating names from Dataset facets or from a dictionary.

New mirands.gis.subset_domain for clipping dataset to a preconfigured region.

Many data-related utilities now have more accurate static typing.

Converted dataset global attributes are now synchronized for consistency.

ECMWF-based datasets now implement more consistent conversion factors and metadata.

miranda.storage.file_size now handles dictionaries of Pathlib objects.

Pre-commit version updates.

Improvements have been made to the development documentation; Project URLs, ReadTheDocs theming, installation methods, and other quality of life changes.

Schema and folder structure updates:

• gridded-obs -> reconstruction

• bias-adjust-project is used when present and not just when level==”biasadjusted”

CI now using tox>=4.0 and ubuntu-latest virtual machine images.

First public release on PyPI.

Dataset conversion tools (miranda.convert) use a JSON-definition file to dynamically populate metadata, run data quality checks, and convert units to CF-compliant standard. Supported datasets are:

• ERA5/ERA5-Land (complete)

• MELCC (stations) (beta)

• ECCC (stations) (alpha)

• NASA DayMet (WIP)

• NASA AgMerra/AgCFSR (WIP)

• Hydro Québec (stations) (WIP)

• DEH (stations) (WIP)

• WFDEI-GEM-CAPA (WIP)

Module (miranda.eccc) for ECCC station data and ECCC Adjusted and Homogenized Canadian Climate Data (AHCCD) conversion (WIP).

Module (miranda.ncar) for fetching interpolated CORDEX-NAM (22i/44i) from NCAR AWS data storage.

Module (miranda.ecmwf) for fetching ECMWF ERA5/-Land (single-levels, pressure-levels, monthly-means) datasets via CDSAPI.

Module (miranda.gis) for setting specific subsetting domains used when converting gridded datasets.

Modules (miranda.archive and miranda.remote) for performing data archiving actions locally and remotely (powered by fabric and paramiko) (WIP).

Module (miranda.decode) for ingesting and parsing dataset metadata based on filename and dataset attributes. Supported datasets are:

• miranda converted datasets

• CMIP6

• CMIP5

• CMIP5-CORDEX

• ISIMIP-FT

• CanDCS-U6 (PCIC)

Module (miranda.structure) for create constructing file-tree databases based on YAML-defined metadata schemas (WIP).

Modules (miranda.cv and miranda.validators) for validating metadata using ESGF controlled vocabularies (taken from pyessv-archive) and schema definitions (powered by schema), respectively (WIP).