Skip to main content

Intake avro plugin

Project description

# Intake-avro

[![Build Status](https://travis-ci.org/ContinuumIO/intake-avro.svg?branch=master)](https://travis-ci.org/ContinuumIO/intake-avro) [![Documentation Status](https://readthedocs.org/projects/intake-avro/badge/?version=latest)](http://intake-avro.readthedocs.io/en/latest/?badge=latest)

The [Apache Avro](https://avro.apache.org/) format is a popular method for information exchange, particularly for message and reord distribution in high-throughput systems.

In [Intake](https://github.com/ContinuumIO/intake/), there are two plugins provided for reading avro data:

  • avro_table is appropriate for data which have a schema simple enough to be represented as columns with simple types, i.e., flat schema. The output of this plugin are dataframes, and the reading is optimized for speed.

  • avro_sequence is more generic and can handle all possible avro schema, but it produces generic python sequences of dictionaries, and is consequently much slower than the table reader.

### Installation

The conda install instructions are:

` conda install -c conda-forge fastavro uavro conda install -c intake intake_avro `

### Examples

See the notebook in the examples/ directory.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

intake-avro-0.2.1.tar.gz (30.5 kB view details)

Uploaded Source

File details

Details for the file intake-avro-0.2.1.tar.gz.

File metadata

  • Download URL: intake-avro-0.2.1.tar.gz
  • Upload date:
  • Size: 30.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.20.1 setuptools/40.6.3 requests-toolbelt/0.8.0 tqdm/4.25.0 CPython/3.6.4

File hashes

Hashes for intake-avro-0.2.1.tar.gz
Algorithm Hash digest
SHA256 741196488f0bc92b4d269a11f5d8fb502ff93d9eafde98d732ec7cd3a9e0daf3
MD5 e34dba4a7b3376feefc7b3fde53d2e91
BLAKE2b-256 400851ffb2b233f3023303e5f90d79ee1453db70726e7e7da15ffe9232318c90

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page