Skip to main content

Kedro-Viz helps visualise Kedro data and analytics pipelines

Project description

Kedro-Viz

develop master
CircleCI CircleCI

npm version PyPI version License Python Version code style: prettier

Kedro-Viz shows you how your Kedro data pipelines are structured.

With Kedro-Viz you can:

  • See how your datasets and Python functions (nodes) are resolved in Kedro so that you can understand how your data pipeline is built
  • Get a clear picture when you have lots of datasets and nodes by using tags to visualise sub-pipelines
  • Search for nodes and datasets

Kedro-Viz Pipeline Visualisation

This project was bootstrapped with Create React App, for which more complete documentation is available on the project website.

How do I install and use Kedro-Viz?

For in-depth development and usage notes, see the Contribution Guidelines.

As a Kedro Python plugin

Kedro-Viz is available as a Python plugin named kedro-viz.

The following conditions must be true in order to visualise your pipeline:

  • Your project directory must be available to the Kedro-Viz plugin.
  • You must be using a Kedro project structure with a complete Data Catalog, nodes and pipeline structure.

To install it:

pip install kedro-viz

This will install kedro as a dependency, and add kedro viz as an additional CLI command.

Kedro CLI command

To visualise your pipeline, go to your project root directory and install the project-specific dependencies by running:

kedro install

This will install the dependencies specified in requirements.txt in your Kedro environment (see the Kedro documentation for how to set up your Python virtual environment).

Finally, run the following command from the project directory to visualise your pipeline:

kedro viz

This command will run kedro_viz.server on http://127.0.0.1:4141/ which cannot be accessed from another machine.

Kedro-Viz has a number of options to customise running the visualisation:

CLI command Description
--host Host that viz will listen to. Defaults to 127.0.0.1.
--port TCP port that viz will listen to. Defaults to 4141.
--browser/--no-browser Whether to open viz interface in the default browser or not.
--load-file Path to load the pipeline JSON file
--save-file Path to save the pipeline JSON file
--pipeline Name of the modular pipeline to visualise. If not set, the default pipeline is visualised.
--env, -e Kedro configuration environment. If not specified, catalog config in local will be used.

As a JavaScript React component

Kedro-Viz is also available as an npm package named @quantumblack/kedro-viz. To install it:

npm install @quantumblack/kedro-viz

Then include it in your React application:

import KedroViz from '@quantumblack/kedro-viz';

const MyApp = () => <KedroViz data={json} />;

As a JavaScript React component, the project is designed to be used in two different ways:

  1. Standalone application

    Run npm run build to generate a production build as a full-page app. The built app will be placed in the /build directory. Data for the chart should be placed in /public/api/nodes.json because this directory is marked gitignore.

  2. React component

    Kedro-Viz can be used as a React component that can be imported into other applications. Publishing the package will run npm run lib, which compiles the source code in /src, and places it in the /lib directory.

    The React component exposes props that can be used to supply data and customise its behaviour. For information about the props, their expected prop-types and default values, see /src/components/app/index.js. For examples of the expected data input format, see the mock data examples in /src/utils/data, and compare the resulting demo.

What licence do you use?

Kedro-Viz is licensed under the Apache 2.0 License.

↑↑↓↓←→←→BA

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kedro-viz-3.3.0.tar.gz (1.7 MB view details)

Uploaded Source

Built Distributions

kedro_viz-3.3.0-py3.6.egg (1.7 MB view details)

Uploaded Source

kedro_viz-3.3.0-py3-none-any.whl (1.7 MB view details)

Uploaded Python 3

File details

Details for the file kedro-viz-3.3.0.tar.gz.

File metadata

  • Download URL: kedro-viz-3.3.0.tar.gz
  • Upload date:
  • Size: 1.7 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.4.0.post20200518 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.6.10

File hashes

Hashes for kedro-viz-3.3.0.tar.gz
Algorithm Hash digest
SHA256 6349a6c532caa0d9d56cbb6f9b3f61447b7104e0b9bd9549ce03c275d5457711
MD5 d2f9117e28b9bcfa10318b5e9e67bbe3
BLAKE2b-256 cf8e179744b3906d61032bc4c653e88c2338e6291cac10ec7fee9da64a42a787

See more details on using hashes here.

Provenance

File details

Details for the file kedro_viz-3.3.0-py3.6.egg.

File metadata

  • Download URL: kedro_viz-3.3.0-py3.6.egg
  • Upload date:
  • Size: 1.7 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.4.0.post20200518 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.6.10

File hashes

Hashes for kedro_viz-3.3.0-py3.6.egg
Algorithm Hash digest
SHA256 f11a3be45aaec76e9676ea8c442b6c65d7c6ac1311c99d799fc49f359b921fb4
MD5 36679224e181e2382b295234ffc35543
BLAKE2b-256 e80b5c151ed2e52542afa878672246d46f81ff5743a091ae074a0e84a891ee0c

See more details on using hashes here.

Provenance

File details

Details for the file kedro_viz-3.3.0-py3-none-any.whl.

File metadata

  • Download URL: kedro_viz-3.3.0-py3-none-any.whl
  • Upload date:
  • Size: 1.7 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.4.0.post20200518 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.6.10

File hashes

Hashes for kedro_viz-3.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c31d050d4dff04ef7b85c8d14402979e3fe5a8d8bd5b0b70f22427d61c7a7ff8
MD5 b3fb31e87c5254cecfe708d4af8a2a62
BLAKE2b-256 ec2fc77062986bcbeaf0f91d528239f8c851982ead09516f1418ce8b7aeb00b6

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page