Skip to main content

Data Visualization and Report Building

Project description

CircleCI PyPI ReadTheDocs Coverage Status

PyBloqs is a flexible framework for visualizing data and automated creation of reports.

pybloqs in use in ipython notebook

pybloqs in use in ipython notebook

It works with Pandas, matplotlib and highcharts. PyBloqs creates atomic blocks containing text, tables (from Pandas DataFrame), plots (matplotlib or highcharts) or images. All blocks can be styled with CSS. Each block can be created and displayed separately for fast development turnover. Lists of blocks can be stacked together to form reports. Reports can be displayed as HTML in the browser or exported in a variety of formats (including HTML, PDF, SVG, PNG).

Quickstart

Install PyBloqs

For a minimal install without HighCharts support run:

pip install pybloqs

or when installing in development mode:

python setup.py develop

This will allow you to run the example code below.

External dependencies

For full functionality, PyBloqs requires the following 3rd party programs and libraries. For some, the file location must be specified at install time:

pip install --install-option="INSTALL OPTIONS" git+https://github.com/manahl/pybloqs.git

e.g.

pip install --install-option="--highcharts=~/node_modules/highcharts/,~/node_modules/highcharts-heatmap/" git+https://github.com/manahl/pybloqs.git

wkhtmltopdf is not bundled with PyBloqs. You need to install it from your distribution’s repository (Linux) or download it from the project page (https://wkhtmltopdf.org) . The binaries wkhtmltopdf and wkhtmltoimage are used for file output other than HTML. PyBloqs will search for the binaries on the system path. If you would like to use a local copy of the binaries, install with following option:

--wkhtmltopdf=/path/to/binary

When installing in development mode you can load wkhtmltopdf explicitly:

python setup.py load_wkhtmltopdf --wkhtmltopdf=/path/to/binary
  • Node.js with comander and puppeteer (optional; for PDF output with ‘chrome_headless’ backend). Please make sure these are available globally. In development mode, you can run

    npm install

    in the main PyBloqs directory.

  • Bokeh (optional). To install Bokeh dependency, you can use:

    pip install pybloqs[bokeh]
  • Plotly (optional). To install Plotly dependency, you can use:

    pip install pybloqs[plotly]
  • HighCharts (optional; proprietary license, see https://shop.highsoft.com/highcharts-t2):

Highcharts is not bundled with PyBloqs. To create blocks with Highcharts plots, you need to download Highcharts separately (e.g. with npm install highcharts, npm install highcharts-heatmap etc.), and provide the path to your highcharts installation. Please make sure you have the right license for Highcharts. For full functionality you will need the following highcharts packages: highcharts, highcharts-heatmap, highcharts-funnel, highcharts-exporting, highcharts-export-csv (this example assumes, npm installed files into directory ~/node_modules).

--highcharts=~/node_modules/highcharts/,
~/node_modules/highcharts-heatmap/,~/node_modules/highcharts-funnel,~/node_modules/highcharts-exporting,
~/node_modules/highcharts-export-csv

When installing in development mode you can load highcharts explicitly (this example assumes, npm installed files into directory ~/node_modules)

python setup.py load_highcharts --highcharts=~/node_modules/highcharts/,~/node_modules/highcharts-heatmap/,\
~/node_modules/highcharts-funnel,~/node_modules/highcharts-exporting,~/node_modules/highcharts-export-csv

Using PyBloqs

from pybloqs import Block, HStack, VStack
import pandas as pd
from matplotlib import pyplot as plt

text_block = Block('This is a text block', styles={'text-align':'center', 'color':'blue'})
text_block.show()

df = pd.DataFrame([[1., 2.],[3.,4.]], columns =['a', 'b'])
table_block = Block(df)
table_block.show()

plot_block = Block(plt.plot(df['a'], df['b']))
plot_block.show()

plot_and_table = HStack([plot_block, table_block])
report = VStack([text_block, plot_and_table])
report.show()
report.save('report.pdf')

Configuration

You can specify per-user default parameters in a yaml-formatted file ~/.pybloqs.cfg. This config file allows you to setup a call setup and login sequence against an smtplib.SMTP (https://docs.python.org/2/library/smtplib.html#smtplib.SMTP) object. The following works for Google gmail - more details here (https://support.google.com/a/answer/176600?hl=en)

smtp_kwargs:
  host: smtp.gmail.com
  port: 587
smtp_pre_login_calls:
- !!python/tuple
  - ehlo
  - {}
- !!python/tuple
  - starttls
  - {}
- !!python/tuple
  - ehlo
  - {}
smtp_login:
  user: me@gmail.com
  password: a_secret
public_dir: /tmp
tmp_html_dir: /tmp
user_email_address: me@gmail.com

Documentation

Have a look at the detailed documentation.

Requirements

PyBloqs works with:

  • matplotlib

  • Pandas

  • html5lib

  • lxml

  • jinja2

  • markdown

  • beautifulsoup4

  • docutils

Acknowledgements

PyBloqs has been under active development at Man AHL since 2013.

Original concept and implementation: Tom Farnbauer

Contributors:

Contributions welcome!

License

PyBloqs is licensed under the GNU LGPL v2.1. A copy of which is included in LICENSE

Changelog

1.0.0 (2017-04-07)

  • Initial public release

1.0.1 (2017-04-13)

  • Integration with pypi and ReadTheDocs.

  • Installation on Mac and Windows.

1.0.2 (2017-04-26)

  • Metadata and badge for Python version.

  • Python 3 compatibility changes, part 1.

  • Installation with Coveralls.

1.0.3 (2017-04-26)

  • Bugfix: Import of urlparse corrected, fixes Block.show() .

1.1.0 (2017-05-10)

  • jQuery DataTables support.

  • HTML anchors.

  • Bugfix: Width of HTML-body no longer hard-coded.

1.1.1 (2017-05-10)

  • Bugfix: Static data including DataTables CSS.

1.1.2 (2017-06-2)

  • Bugfix: Image size for Matplotlib figure no longer truncated to whole number.

  • Updated download path for wkhtmltopdf in CI setup.

1.1.3 (2017-06-6)

  • Bugfix: Expansion of user home directory for show().

  • Bugfix: Flexible definition of default type handling for Block() that allows updating.

1.1.4 (2017-06-22)

  • Bugfix: When applying operator on rows or columns (e.g. in totals row), replace nan with zero.

1.1.5 (2017-08-22)

  • Bugfix: Multi-index formatter can now digest DataFrame with nun-unique multi-index.

  • Bugfix: ReadTheDocs autodoc build fixed.

1.1.6 (2017-08-23)

  • Bugfix: Unicode meta tag set in html output and unicode strings working wit Raw() block.

1.1.7 (2018-02-23)

  • Feature: More SMTP options

  • Feature: UTF-8 email mime-type

  • Feature: Allow BCC for email

1.1.8 (2018-03-26)

  • Bugfix: FmtHighlightText - explicitly set non-bold for column header

  • Feature: Add page break example to documentation

  • Bugfix: Pass apply_to_header_and_index to base class on all formatters

1.1.9 (2018-09-19)

  • Bugfix: Indexing error in table.html with non-unique indices

  • Bugfix: Removed Pandas warning in tests

  • Remove WidePanel, update ipynb

  • Feature: Add support for specifying different text colors for MultiIndex levels

  • Feature: Add a context manager for temporarily setting plot format/DPI

1.2.0 (2018-11-21)

  • Feature: Python 3 support

  • Feature: Support for Bokeh plots

  • Feature: Support for Plotly plots

  • Feature: Allow use of different HTML conversion backends

  • Feature: Added Chrome-headless backend for HTML->PDF conversion

  • Updated CircleCI configuration to version 2

1.2.1 (2018-11-23)

  • Bugfix: Removed pybloqs.plot import from top-level init.py

  • Bugfix: puppeteer.js now included in egg/wheel packaging

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pybloqs-1.2.1.tar.gz (129.4 kB view details)

Uploaded Source

Built Distributions

pybloqs-1.2.1-py3.6.egg (123.6 kB view details)

Uploaded Source

pybloqs-1.2.1-py2.py3-none-any.whl (133.6 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file pybloqs-1.2.1.tar.gz.

File metadata

  • Download URL: pybloqs-1.2.1.tar.gz
  • Upload date:
  • Size: 129.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/None requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.5

File hashes

Hashes for pybloqs-1.2.1.tar.gz
Algorithm Hash digest
SHA256 0cfdb7ed674c93ef058af9554792a81cb417fc9f563abac4b7fbce9402c06029
MD5 b94bdb98670a848b11bc3204e6bc179e
BLAKE2b-256 082383e738efaa25d285df8986842a100bbcbf2c477386f24f7107f724e7d2cb

See more details on using hashes here.

File details

Details for the file pybloqs-1.2.1-py3.6.egg.

File metadata

  • Download URL: pybloqs-1.2.1-py3.6.egg
  • Upload date:
  • Size: 123.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/None requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.5

File hashes

Hashes for pybloqs-1.2.1-py3.6.egg
Algorithm Hash digest
SHA256 f680cf9bbde14a7fa4172619afae1a25d40af279facff15d7124cf4c3ce2a120
MD5 d8e4ee75645037cd50fbc86296bfbd06
BLAKE2b-256 8f6321c67d8ac93cc081ea75eb52a4aa49667a790a8b5d7974e7565005cc2955

See more details on using hashes here.

File details

Details for the file pybloqs-1.2.1-py2.py3-none-any.whl.

File metadata

  • Download URL: pybloqs-1.2.1-py2.py3-none-any.whl
  • Upload date:
  • Size: 133.6 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/None requests/2.20.1 setuptools/39.0.1 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.5

File hashes

Hashes for pybloqs-1.2.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 a4be4646287539f987c10d9e69316db1270616db8e470fc5d64960bd7b3526e7
MD5 3eaca6a5df1e71f9e96f6fbc0c5eef71
BLAKE2b-256 610609779cab104717f4c4b6a53f71302d54483edcbca1cd4123b4a7fb919038

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page