Kedro-Viz helps visualise Kedro data and analytics pipelines
Project description
Kedro-Viz
Kedro-Viz shows you how your Kedro data pipelines are structured.
With Kedro-Viz you can:
- See how your datasets and Python functions (nodes) are resolved in Kedro so that you can understand how your data pipeline is built
- Get a clear picture when you have lots of datasets and nodes by using tags to visualise sub-pipelines
- Search for nodes and datasets
This project was bootstrapped with Create React App, for which more complete documentation is available on the project website.
How do I install and use Kedro-Viz?
For in-depth development and usage notes, see the Contribution Guidelines.
It's likely that Kedro-Viz>=3.8.0 will not work with projects created with older versions of Kedro<=0.16.6. Please migrate your project to Kedro>=0.17.0 before installation of the latest version of Kedro-Viz.
As a Kedro Python plugin
Kedro-Viz is available as a Python plugin named kedro-viz.
The following conditions must be true in order to visualise your pipeline:
- Your project directory must be available to the Kedro-Viz plugin.
- You must be using a Kedro project structure with a complete Data Catalog, nodes and pipeline structure.
To install it:
pip install kedro-viz
This will install kedro as a dependency, and add kedro viz as an additional CLI command.
To visualise your pipeline, go to your project root directory and install the project-specific dependencies by running:
kedro install
This will install the dependencies specified in requirements.txt in your Kedro environment (see the Kedro documentation for how to set up your Python virtual environment).
Finally, run the following command from the project directory to visualise your pipeline:
kedro viz
This command will run kedro_viz.server on http://127.0.0.1:4141/ which cannot be accessed from another machine.
Kedro-Viz has a number of options to customise running the visualisation:
| CLI command | Description |
|---|---|
--host |
Host that viz will listen to. Defaults to 127.0.0.1. |
--port |
TCP port that viz will listen to. Defaults to 4141. |
--browser/--no-browser |
Whether to open viz interface in the default browser or not. |
--load-file |
Path to load the pipeline JSON file |
--save-file |
Path to save the pipeline JSON file |
--pipeline |
Name of the modular pipeline to visualise. If not set, the default pipeline is visualised. |
--env, -e |
Kedro configuration environment. If not specified, catalog config in local will be used. |
As a JavaScript React component
Kedro-Viz is also available as an npm package named @quantumblack/kedro-viz. To install it:
npm install @quantumblack/kedro-viz
Then include it in your React application:
import KedroViz from '@quantumblack/kedro-viz';
const MyApp = () => <KedroViz data={json} />;
As a JavaScript React component, the project is designed to be used in two different ways:
-
Standalone application
Run
npm run buildto generate a production build as a full-page app. The built app will be placed in the/builddirectory. Data for the chart should be placed in/public/api/mainbecause this directory is markedgitignore. -
React component
Kedro-Viz can be used as a React component that can be imported into other applications. Publishing the package will run
npm run lib, which compiles the source code in/src, and places it in the/libdirectory.The React component exposes props that can be used to supply data and customise its behaviour. For information about the props, their expected prop-types and default values, see /src/components/app/index.js. For examples of the expected data input format, see the mock data examples in /src/utils/data, and compare the resulting demo.
Flags
The following flags are available to toggle experimental features:
oldgraph- From release v3.8.0. Display old version of graph (dagre algorithm) without improved graphing algorithm. (defaultfalse)newparams- From release v3.12.0. Disable parameters on page load and highlight parameter connections.sizewarning- From release v3.9.1. Show a warning before rendering very large graphs. (defaulttrue)modularpipeline- From release v3.11.0. Enables filtering of nodes by modular pipelines. Note that selecting both modular pipeline and tag filters will only return nodes that belongs to both categories. (defaultfalse).
Note that newgraph has been removed from v3.8.0 onwards and is now the default functionality. Should there be issues with your project, see the oldgraph flag above.
Setting flags
To enable or disable a flagged feature, add the flag as a parameter with the value true or false to the end of the URL in your browser when running Kedro-Viz, e.g.
http://localhost:4141/?data=demo&oldgraph=true
The setting you provide persists for all sessions on your machine, until you change it.
Viewing flags
Kedro-Viz will log a message in your browser's developer console regarding the available flags and their values as currently set on your machine.
What licence do you use?
Kedro-Viz is licensed under the Apache 2.0 License.
How can I cite Kedro-Viz?
If you're an academic, Kedro-Viz can also help you, for example, as a tool to visualise how your publication's pipeline is structured. Find our citation reference on Zenodo.
↑↑↓↓←→←→BA
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
File details
Details for the file kedro-viz-3.12.1.tar.gz.
File metadata
- Download URL: kedro-viz-3.12.1.tar.gz
- Upload date:
- Size: 2.9 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | ab2678d628c3334d5811687f5d3b2dcd1797fc22bc89915b3a80b6f9b2df17c0 |
|
| MD5 | 5d72396172586b51071ecfa6e8b77bcc |
|
| BLAKE2b-256 | dd49e849bfc0b52d644f22cb81c1c6088b60decb991e9d77dea00e7bca0af01d |
File details
Details for the file kedro_viz-3.12.1-py3.8.egg.
File metadata
- Download URL: kedro_viz-3.12.1-py3.8.egg
- Upload date:
- Size: 3.0 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9d139191a6e543b5ede19ffc34c0e2fe610c2f4d3f20bd2c878dbe279b19d218 |
|
| MD5 | a128eecaa2e444345176d3f9928d20d3 |
|
| BLAKE2b-256 | 7505dcee42b1e65810a19392b3b31be4d6be79abd97d12c5c8f9719cbb13ed48 |
File details
Details for the file kedro_viz-3.12.1-py3-none-any.whl.
File metadata
- Download URL: kedro_viz-3.12.1-py3-none-any.whl
- Upload date:
- Size: 3.0 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3b485536bca4289a565dd56106f2ad880fe406e7a0c67900533393973bbc8c78 |
|
| MD5 | 48e59518ec0cab2588eeeb07d5ec831f |
|
| BLAKE2b-256 | 62a15a2e1c41d8260e659cbecc849dc4bc7892b59b5b489b0a907cf1a533d281 |
