Skip to main content

Conventions for Python + Apache Beam

Project description

The klio Library

Latest version of klio on PyPI Status of klio unit tests

The library for implementing Klio-ified Apache Beam transforms with decorators, helper transforms, and leverage Klio’s message-handling logic.

As the klio library is not meant to be installed directly, check out the installation guide for how to setup installation. There is also the user guide and the API documentation for more information.

What is Klio?

Klio is an ecosystem that allows you to process audio files – or any binary files – easily and at scale.

Klio jobs are opinionated data pipelines in Python (streaming or batch) built upon Apache Beam and tuned for audio and binary file processing.

Klio was built by Spotify to run our large-scale audio intelligence systems and is used by teams of engineers and audio researchers to help develop and deploy next generation audio algorithms.

Read more about Klio here.

Get Started

Check out our Quick Start guide on how to start using Klio.

Resources

Release Information

21.10.0 (UNRELEASED)

Fixed

  • Fixed bug in metrics parsing when metrics configuration was set to a bool instead of a dict.

Removed

  • Removed deprecated Stackdriver log-based metrics client.

Changes

  • Updated documentation related to the native metrics client.

  • KlioConfig is now loaded on workers from pickled main session instead of a bundled config file (See PR 220).

Full Changelog.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

klio-21.10.0.dev2.tar.gz (72.7 kB view details)

Uploaded Source

Built Distribution

klio-21.10.0.dev2-py2.py3-none-any.whl (65.7 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file klio-21.10.0.dev2.tar.gz.

File metadata

  • Download URL: klio-21.10.0.dev2.tar.gz
  • Upload date:
  • Size: 72.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7

File hashes

Hashes for klio-21.10.0.dev2.tar.gz
Algorithm Hash digest
SHA256 f34d7c34981e01ba44b5ca1ac753179ce7973956d043c1107eddbdc977574a74
MD5 1c5eda3ac0f5c8f70bb83c64097c8e5d
BLAKE2b-256 48ae1a9ac9d50ab7142cbbe5bf8250195f95524f774f2e2e34fed0f0d9676d1d

See more details on using hashes here.

File details

Details for the file klio-21.10.0.dev2-py2.py3-none-any.whl.

File metadata

  • Download URL: klio-21.10.0.dev2-py2.py3-none-any.whl
  • Upload date:
  • Size: 65.7 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7

File hashes

Hashes for klio-21.10.0.dev2-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 462f21616322ad139a6d8b6e62621afce31232258e229ecff45d996e94a07028
MD5 2747f79b9d4d48fc80f06c73332e99f2
BLAKE2b-256 25ac184c9d82cd6bb331d49c21216862203a0d97e60f2520b8ef6e89c080f7e1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page