Skip to main content

REANA-Commons.

Project description

https://img.shields.io/pypi/pyversions/reana-commons.svg https://img.shields.io/travis/reanahub/reana-commons.svg https://readthedocs.org/projects/reana-commons/badge/?version=latest https://img.shields.io/coveralls/reanahub/reana-commons.svg https://badges.gitter.im/Join%20Chat.svg https://img.shields.io/github/license/reanahub/reana-commons.svg https://img.shields.io/badge/code%20style-black-000000.svg

About

REANA-Commons is a component of the REANA reusable and reproducible research data analysis platform. It provides common utilities and schemas shared by the REANA cluster components.

Features

  • common API clients for internal communication

  • centralised OpenAPI specifications for REANA components

  • AMQP connection management and communication

  • utility functions for cluster components

Usage

The detailed information on how to install and use REANA can be found in docs.reana.io.

Changes

Version master (UNRELEASED)

  • Adds get_disk_usage utility function to calculate disk usage for a directory.

  • Centralises fs package dependency

Version 0.7.0 (UNRELEASED)

  • Adds new utility to send emails.

  • Adds centralised operational options validation.

  • Fixes memory leak in Bravado client instantiation. (reanahub/reana-server#225)

  • Makes maximum number of running workflows configurable.

  • Adds configurable prefix for component names.

  • Adds central variable for the runtime pods node selector label.

  • Allows specifying unpacked Docker images.

  • Upgrades minimum version of Kubernetes Python library to 11.

  • Centralises CephFS PVC name.

  • Updates to latest CVMFS CSI driver.

  • Introduces new configuration variable REANA_INFRASTRUCTURE_KUBERNETES_NAMESPACE to define the Kubernetes namespace in which REANA infrastructure components run.

  • Introduces new configuration variable REANA_RUNTIME_KUBERNETES_NAMESPACE to define the Kubernetes namespace in which REANA runtime components components run.

  • Increases default log level to INFO.

  • Add Black formatter support.

  • Adds initfiles as an operational option for Yadage.

Version 0.6.1 (2020-05-25)

  • Upgrades Kubernetes Python client.

Version 0.6.0 (2019-12-19)

  • Adds new API for Gitlab integration.

  • Adds new Kubernetes client API for ingresses.

  • Adds new APIs for management of user secrets.

  • Adds EOS storage Kubernetes configuration.

  • Adds HTCondor and Slurm compute backends.

  • Adds support for streaming file uploads.

  • Allows unpacked CVMFS and CMS open data volumes.

  • Adds Serial workflow step name and compute backend.

  • Adds support for Python 3.8.

Version 0.5.0 (2019-04-16)

  • Centralises log level and log format configuration.

  • Adds new utility to inspect the disk usage on a given workspace. (get_workspace_disk_usage)

  • Introduces the module to share Celery tasks accross REANA components. (tasks.py)

  • Introduces common Celery task to determine whether REANA can execute new workflows depending on a set of conditions such as running job count. (reana_ready, check_predefined_conditions, check_running_job_count)

  • Allows the AMQP consumer to be configurable with multiple queues.

  • Introduces new queue for workflow submission. (workflow-submission)

  • Introduces new publisher for workflow submissions. (WorkflowSubmissionPublisher)

  • Centralises Kubernetes API client configuration and initialisation.

  • Adds Kubernetes specific configuration for CVMFS volumes as utils.

  • Introduces a new method, copy_openapi_specs, to automatically move validated OpenAPI specifications from components to REANA Commons openapi_specifications directory.

  • Centralises interactive session types.

  • Introduces central REANA errors through the errors.py module.

  • Skips SSL verification for all HTTPS requests performed with the BaseAPIClient.

Version 0.4.0 (2018-11-06)

  • Aggregates OpenAPI specifications of REANA components.

  • Improves AMQP re-connection handling. Switches from pika to kombu.

  • Enhances test suite and increases code coverage.

  • Changes license to MIT.

Version 0.3.1 (2018-09-04)

  • Adds parameter expansion and validation utilities for parametrised Serial workflows.

Version 0.3.0 (2018-08-10)

  • Initial public release.

  • Provides basic AMQP pub/sub methods for REANA components.

  • Utilities for caching used in different REANA components.

  • Click formatting helpers.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

reana-commons-0.8.0a3.tar.gz (44.5 kB view details)

Uploaded Source

File details

Details for the file reana-commons-0.8.0a3.tar.gz.

File metadata

  • Download URL: reana-commons-0.8.0a3.tar.gz
  • Upload date:
  • Size: 44.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/50.3.0 requests-toolbelt/0.9.1 tqdm/4.49.0 CPython/3.8.5

File hashes

Hashes for reana-commons-0.8.0a3.tar.gz
Algorithm Hash digest
SHA256 c356f5c8c3a3f6d68f334a61f3b6cde4d874d9d9dcfe17040e797fec4118f830
MD5 03ecdcff246a3d70bd787818fc77071d
BLAKE2b-256 7ed3e125b174c1cfe9f3375227018d5e829e88b292092b04c0ccad67726f9361

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page