Intake avro plugin
Project description
# Intake-avro
[![Build Status](https://travis-ci.org/ContinuumIO/intake-avro.svg?branch=master)](https://travis-ci.org/ContinuumIO/intake-avro) [![Documentation Status](https://readthedocs.org/projects/intake-avro/badge/?version=latest)](http://intake-avro.readthedocs.io/en/latest/?badge=latest)
The [Apache Avro](https://avro.apache.org/) format is a popular method for information exchange, particularly for message and reord distribution in high-throughput systems.
In [Intake](https://github.com/ContinuumIO/intake/), there are two plugins provided for reading avro data:
avro_table is appropriate for data which have a schema simple enough to be represented as columns with simple types, i.e., flat schema. The output of this plugin are dataframes, and the reading is optimized for speed.
avro_sequence is more generic and can handle all possible avro schema, but it produces generic python sequences of dictionaries, and is consequently much slower than the table reader.
### Installation
The conda install instructions are:
` conda install -c conda-forge fastavro uavro conda install -c intake intake_avro `
### Examples
See the notebook in the examples/ directory.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file intake-avro-0.2.0.tar.gz
.
File metadata
- Download URL: intake-avro-0.2.0.tar.gz
- Upload date:
- Size: 30.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.20.1 setuptools/39.1.0 requests-toolbelt/0.8.0 tqdm/4.25.0 CPython/3.6.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 55c5945ce1b5be1bbf252c949dc5cadca596b06531bbd12a70061cb70c1e6df9 |
|
MD5 | 957f408147d3a1fc317271cbb80fa601 |
|
BLAKE2b-256 | 4b4de99a67e467bdfa4f92b08064b16fe02f9bf77245df1ab09e6ce0fd307a74 |