KubeFlow Pipelines SDK
Project description
kfp: Kubeflow Pipelines SDK
Kubeflow Pipelines is a platform for building and deploying portable, scalable machine learning workflows based on Docker containers within the Kubeflow project.
Use Kubeflow Pipelines to compose a multi-step workflow (pipeline) as a graph of containerized tasks using Python code and/or YAML. Then, run your pipeline with specified pipeline arguments, rerun your pipeline with new arguments or data, schedule your pipeline to run on a recurring basis, organize your runs into experiments, save machine learning artifacts to compliant artifact registries, and visualize it all through the Kubeflow Dashboard.
Documentation
Installation
To install the latest stable release, run:
pip install kfp
Getting started
The following is an example of a simple pipeline with one Python function-based component used in two separate tasks to do basic addition:
import kfp
from kfp.components import create_component_from_func
import kfp.dsl as dsl
def add(a: float, b: float) -> float:
'''Calculates sum of two arguments'''
return a + b
# create a component using the add function
add_op = create_component_from_func(add)
# compose your pipeline using the dsl.pipeline decorator
@dsl.pipeline(
name='Addition pipeline',
description='An example pipeline that performs addition calculations.')
def add_pipeline(
a: float=1.0,
b: float=7.0,
):
first_add_task = add_op(a=a, b=4.0)
second_add_task = add_op(a=first_add_task.output, b=b)
# instantiate a client and submit your pipeline with arguments
client = kfp.Client(host='<my-host-url>')
client.create_run_from_pipeline_func(
add_pipeline, arguments={
'a': 7.0,
'b': 8.0
})
For more information, refer to Building Python function-based components.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file kfp-1.8.20.tar.gz.
File metadata
- Download URL: kfp-1.8.20.tar.gz
- Upload date:
- Size: 304.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.7.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 2399ed675dca18eec9ec4d3c7a0e9eb778cee382ad5b859058410a793b134ab3 |
|
| MD5 | e324e03c314c3f579719c7d933248588 |
|
| BLAKE2b-256 | 394fa92391bd04ef76f7476b05366411e4c36d83eaa3fca18f1b643c7d5b75a3 |
