Skip to main content

Component of klio project that reduces boilerplate while \ writing YAML-config-driven, Dockerized python Beam pipelines\ - probably for audio processing.

Project description

The klio-exec Package

Latest version of klio-exec on PyPI Status of klio-exec unit tests

The executor – not meant to be used directly by the user – is a CLI that launches a pipeline from within a job’s Docker container (a.k.a. an Apache Beam’s “driver”). Many commands from the klio-cli directly wrap to commands in the executor: a klio-cli command will set up the Docker context needed to correctly run the pipeline via the associated command with klio-exec. The Docker context includes mounting the job directory, sets up environment variables, mounting credentials, etc.

As the klio-exec package is not meant to be installed directly, check out the installation guide for how to setup installation. There is also the user guide and the API documentation for more information.

What is Klio?

Klio is an ecosystem that allows you to process audio files – or any binary files – easily and at scale.

Klio jobs are opinionated data pipelines in Python (streaming or batch) built upon Apache Beam and tuned for audio and binary file processing.

Klio was built by Spotify to run our large-scale audio intelligence systems and is used by teams of engineers and audio researchers to help develop and deploy next generation audio algorithms.

Read more about Klio here.

Get Started

Check out our Quick Start guide on how to start using Klio.

Resources

Release Information

0.2.3rc1 (2021-02-16)

Fixed

  • klioexec now writes runtime config to include in setup.py distribution.

Full Changelog.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

klio-exec-0.2.3rc1.tar.gz (46.0 kB view details)

Uploaded Source

Built Distribution

klio_exec-0.2.3rc1-py2.py3-none-any.whl (34.5 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file klio-exec-0.2.3rc1.tar.gz.

File metadata

  • Download URL: klio-exec-0.2.3rc1.tar.gz
  • Upload date:
  • Size: 46.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/53.0.0 requests-toolbelt/0.9.1 tqdm/4.56.2 CPython/3.6.12

File hashes

Hashes for klio-exec-0.2.3rc1.tar.gz
Algorithm Hash digest
SHA256 5d61f81283e476fa058debf780f78211898ea560d4637428a398a5cb04b8f343
MD5 a4374974b2e6ebde5827757ab3395343
BLAKE2b-256 bf3d52c0febccc7b9e20f3d0bd157eedad5be89b891d379f04263a92744eba1a

See more details on using hashes here.

File details

Details for the file klio_exec-0.2.3rc1-py2.py3-none-any.whl.

File metadata

  • Download URL: klio_exec-0.2.3rc1-py2.py3-none-any.whl
  • Upload date:
  • Size: 34.5 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/53.0.0 requests-toolbelt/0.9.1 tqdm/4.56.2 CPython/3.6.12

File hashes

Hashes for klio_exec-0.2.3rc1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 7f0cc142b463c0a5ab9ac236bc66c5c803fd02442f1dab4befb58cc4a18d0b98
MD5 c65d68d860541c1b213ba4aa6517ba1f
BLAKE2b-256 0514120744a2ecba63e5eb366c2767f74a6c347d4f98f6f1da9244a0d4d12c40

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page