Skip to main content

Data Profiler

Project description

The data_profiler module extends the standard CPython profiler by recording the functions’ signatures. For NumPy array types this includes the dtype attribute and the array’s shape.

It also adds functionality to visualise the augmented profile table in snakeviz.

This module is a direct port of Accelerate.profiler available in Anaconda Accelerate.

Documentation is located here

Installing

The easiest way to install data_profiler and get updates is by using the Anaconda Distribution

#> conda install data_profiler

To compile, test and run from source, it is recommended to create a conda environment containing the following:

  • numpy

  • numba >=0.26.0

  • snakeviz

  • jupyter

  • pytest

for instructions on how to do this see the conda documentation, specifically the section on managing environments.

Once a suitable environment is activated, installation achieved simply by running:

#> python setup.py install

and the installation can be tested with:

#> pytest

Documentation

Documentation is located here.

Building Documentation

It is also possible to build a local copy of the documentation from source. This requires GNU Make and sphinx (available via conda).

Documentation is stored in the doc folder, and should be built with:

#> make SPHINXOPTS=-Wn clean html

This ensures that the documentation renders without errors. If errors occur, they can all be seen at once by building with:

#> make SPHINXOPTS=-n clean html

However, these errors should all be fixed so that building with -Wn is possible prior to merging any documentation changes or updates.

Continuous Integration

Continuous integration is provided by Travis CI, the current build state is available here.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_profiler-1.0.1.tar.gz (45.7 kB view details)

Uploaded Source

File details

Details for the file data_profiler-1.0.1.tar.gz.

File metadata

File hashes

Hashes for data_profiler-1.0.1.tar.gz
Algorithm Hash digest
SHA256 af4f92ca8ce2ae413ae7ccf81fa7e2124b2d20f82577f40dbe3f32cd07237ef5
MD5 8b1a545eb532a1d35f080a308d966e1a
BLAKE2b-256 3ec7a2c3582909d7096e8da5087146d7156ac189493e4736fb421cb288f3c1eb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page