Data visualization toolchain based on aggregating into a grid
Project description
Turn even the largest data into images, accurately
| Build Status |   |
| Coverage |  |
| Latest dev release |  |
| Latest release |      |
| Docs |  |
What is it?
Datashader is a data rasterization pipeline for automating the process of creating meaningful representations of large amounts of data. Datashader breaks the creation of images of data into 3 main steps:
-
Projection
Each record is projected into zero or more bins of a nominal plotting grid shape, based on a specified glyph.
-
Aggregation
Reductions are computed for each bin, compressing the potentially large dataset into a much smaller aggregate array.
-
Transformation
These aggregates are then further processed, eventually creating an image.
Using this very general pipeline, many interesting data visualizations can be created in a performant and scalable way. Datashader contains tools for easily creating these pipelines in a composable manner, using only a few lines of code. Datashader can be used on its own, but it is also designed to work as a pre-processing stage in a plotting library, allowing that library to work with much larger datasets than it would otherwise.
Installation
Datashader supports Python 2.7, 3.6 and 3.7 on Linux, Windows, or Mac and can be installed with conda:
conda install datashader
or with pip:
pip install datashader
For the best performance, we recommend using conda so that you are sure
to get numerical libraries optimized for your platform. The latest
releases are avalailable on the pyviz channel conda install -c pyviz datashader and the latest pre-release versions are avalailable on the
dev-labelled channel conda install -c pyviz/label/dev datashader.
Fetching Examples
Once you've installed datashader as above you can fetch the examples:
datashader examples
cd datashader-examples
This will create a new directory called datashader-examples with all the data needed to run the examples.
To run all the examples you will need some extra dependencies. If you installed datashader within a conda environment, with that environment active run:
conda env update --file environment.yml
Otherwise create a new environment:
conda env create --name datashader --file environment.yml
conda activate datashader
Developer Instructions
-
Install Python 3 miniconda or anaconda, if you don't already have it on your system.
-
Clone the datashader git repository if you do not already have it:
git clone git://github.com/pyviz/datashader.git -
Set up a new conda environment with all of the dependencies needed to run the examples:
cd datashader conda env create --name datashader --file ./examples/environment.yml conda activate datashader -
Put the datashader directory into the Python path in this environment:
pip install -e .
Learning more
After working through the examples, you can find additional resources linked from the datashader documentation, including API documentation and papers and talks about the approach.
Some Examples
About PyViz
Datashader is part of the PyViz initiative for making Python-based visualization tools work well together. See pyviz.org for related packages that you can use with Datashader and status.pyviz.org for the current status of each PyViz project.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file datashader-0.8.0.tar.gz.
File metadata
- Download URL: datashader-0.8.0.tar.gz
- Upload date:
- Size: 30.2 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 59ac9e3830167d07b350992402a9f547f26eca45cd69a0fb04061a4047e7ff2a |
|
| MD5 | 3018341dfaf4e955a3bcfc3aa8dd1244 |
|
| BLAKE2b-256 | e323df2ba203e2685c0795ec4eaf601f5f3bc7f186a16cfe2f3b63dcde56a1e6 |
Provenance
File details
Details for the file datashader-0.8.0-py2.py3-none-any.whl.
File metadata
- Download URL: datashader-0.8.0-py2.py3-none-any.whl
- Upload date:
- Size: 15.5 MB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 864a4f695dc9471cd003f2a3cc9e3c52d1d7bfa1ee709dd0fc6e1052d1f8d621 |
|
| MD5 | 6d370ff1d8a4f703c89dc946df34a04d |
|
| BLAKE2b-256 | 2d18dc764eb4a4fc73dc1a0c41cfb54bb16d97ed2987e388283a8f81149054de |
