Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

Only symbols exported by sub-modules under tfx_bsl/public are intended for direct use by TFX users, including by standalone TFX library (e.g. TFDV, TFMA, TFT) users, TFX pipeline authors and TFX component authors. Those APIs will become stable and follow semantic versioning once tfx_bsl goes beyond 1.0.

APIs under other directories should be considered internal to TFX (and therefore there is no backward or forward compatibility guarantee for them).

Each minor version of a TFX library or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on, and only work with, tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

Nightly Packages

TFX-BSL also hosts nightly packages at https://pypi-nightly.tensorflow.org on Google Cloud. To install the latest nightly package, please use the following command:

pip install -i https://pypi-nightly.tensorflow.org/simple tfx-bsl

This will install the nightly packages for the major dependencies of TFX-BSL such as TensorFlow Metadata (TFMD).

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {37, 38}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

3. Build the pip package

tfx_bsl wheel is Python version dependent -- to build the pip package that works for a specific Python version, use that Python binary to run:

python setup.py bdist_wheel

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Compatible versions

The following table is the tfx_bsl package versions that are compatible with each other. This is determined by our testing framework, but other untested combinations may also work.

tfx-bsl apache-beam[gcp] pyarrow tensorflow tensorflow-metadata tensorflow-serving-api
GitHub master 2.35.0 5.0.0 nightly (1.x/2.x) 1.6.0 2.7.0
1.6.0 2.35.0 5.0.0 1.15 / 2.7 1.6.0 2.7.0
1.5.0 2.34.0 5.0.0 1.15 / 2.7 1.5.0 2.7.0
1.4.0 2.31.0 5.0.0 1.15 / 2.6 1.4.0 2.6.0
1.3.0 2.31.0 2.0.0 1.15 / 2.6 1.2.0 2.6.0
1.2.0 2.31.0 2.0.0 1.15 / 2.5 1.2.0 2.5.1
1.1.0 2.29.0 2.0.0 1.15 / 2.5 1.1.0 2.5.1
1.0.0 2.29.0 2.0.0 1.15 / 2.5 1.0.0 2.5.1
0.30.0 2.28.0 2.0.0 1.15 / 2.4 0.30.0 2.4.0
0.29.0 2.28.0 2.0.0 1.15 / 2.4 0.29.0 2.4.0
0.28.0 2.28.0 2.0.0 1.15 / 2.4 0.28.0 2.4.0
0.27.1 2.27.0 2.0.0 1.15 / 2.4 0.27.0 2.4.0
0.27.0 2.27.0 2.0.0 1.15 / 2.4 0.27.0 2.4.0
0.26.1 2.25.0 0.17.0 1.15 / 2.3 0.27.0 2.3.0
0.26.0 2.25.0 0.17.0 1.15 / 2.3 0.27.0 2.3.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-1.6.0-cp38-cp38-win_amd64.whl (1.9 MB view details)

Uploaded CPython 3.8 Windows x86-64

tfx_bsl-1.6.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (19.1 MB view details)

Uploaded CPython 3.8 manylinux: glibc 2.12+ x86-64

tfx_bsl-1.6.0-cp38-cp38-macosx_10_9_x86_64.whl (20.4 MB view details)

Uploaded CPython 3.8 macOS 10.9+ x86-64

tfx_bsl-1.6.0-cp37-cp37m-win_amd64.whl (1.9 MB view details)

Uploaded CPython 3.7m Windows x86-64

tfx_bsl-1.6.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (19.1 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-1.6.0-cp37-cp37m-macosx_10_9_x86_64.whl (20.4 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-1.6.0-cp38-cp38-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-1.6.0-cp38-cp38-win_amd64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.8, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.5

File hashes

Hashes for tfx_bsl-1.6.0-cp38-cp38-win_amd64.whl
Algorithm Hash digest
SHA256 34dea4a5f56fdded2eb3e8a97442b8d03728339dc625a9ccd5408020ae75088f
MD5 6950adcb2a4b9213c34fe5fccb87aded
BLAKE2b-256 2273e32a88c31dbeb1eae0181d1f3ae035cff02dc546ab8ece088b1eac3a573c

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.6.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.

File metadata

File hashes

Hashes for tfx_bsl-1.6.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 dd343b2cf52c0a64baf0e4e25f007e321024d7c33be0553b03f5d312dc2b7fe3
MD5 1cb45e921138bb091f3c5714b9397be7
BLAKE2b-256 1a7cb16a81192fd33ac39ce155d8ed11d680596e157b703eda251ca9cf97374e

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.6.0-cp38-cp38-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-1.6.0-cp38-cp38-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 20.4 MB
  • Tags: CPython 3.8, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.2

File hashes

Hashes for tfx_bsl-1.6.0-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 bae949b5a6e5bd7d4154347a6fa0d7fa8b1f496009296ac10f18d2254e00fe7d
MD5 5ba6be83d099d518285aa895ba8f502e
BLAKE2b-256 cfee4c52c2ef807c60bf3f5657aef0926eb599ff0f836fbb0979c358c24887bd

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.6.0-cp37-cp37m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-1.6.0-cp37-cp37m-win_amd64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.7m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.0

File hashes

Hashes for tfx_bsl-1.6.0-cp37-cp37m-win_amd64.whl
Algorithm Hash digest
SHA256 5bb2a014cdf0ec4a89d2f18e13a72744e60cf2a41570919983cec9f6d3b17fb9
MD5 d780d134be3df9a115956465850d0bed
BLAKE2b-256 b1c0d143a7e6a5cfd5de2ac5e53dc4ce4835abd8a729191737d0e42612e7a90e

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.6.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.

File metadata

File hashes

Hashes for tfx_bsl-1.6.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 f99312620601d403eec015dbf529a65c1fe0de48be05b453944c0fae10cec78f
MD5 27a1178be644983d7fbcea8b5d5dc9e8
BLAKE2b-256 bf9038dec1c02a344421f55732e9fcad2536d7a28db97ea34beba79c695bef9a

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.6.0-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-1.6.0-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 20.4 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.3

File hashes

Hashes for tfx_bsl-1.6.0-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 94b7d7cdbf0ff072453acf4d315ab557900e72904c91d3c1f833b47eb9789ebb
MD5 d6f9a98b7a0db40808ee5e3b0801c81a
BLAKE2b-256 91557c0095d6067d1f88ad12033c86b6f61a878a04b143acec3c7648ba8752df

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page