Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

Only symbols exported by sub-modules under tfx_bsl/public are intended for direct use by TFX users, including by standalone TFX library (e.g. TFDV, TFMA, TFT) users, TFX pipeline authors and TFX component authors. Those APIs will become stable and follow semantic versioning once tfx_bsl goes beyond 1.0.

APIs under other directories should be considered internal to TFX (and therefore there is no backward or forward compatibility guarantee for them).

Each minor version of a TFX library or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on, and only work with, tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

Nightly Packages

TFX-BSL also hosts nightly packages at https://pypi-nightly.tensorflow.org on Google Cloud. To install the latest nightly package, please use the following command:

pip install --extra-index-url https://pypi-nightly.tensorflow.org/simple tfx-bsl

This will install the nightly packages for the major dependencies of TFX-BSL such as TensorFlow Metadata (TFMD).

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {39}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

3. Build the pip package

tfx_bsl wheel is Python version dependent -- to build the pip package that works for a specific Python version, use that Python binary to run:

python setup.py bdist_wheel

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 20.04 or later.

Compatible versions

The following table is the tfx_bsl package versions that are compatible with each other. This is determined by our testing framework, but other untested combinations may also work.

tfx-bsl apache-beam[gcp] pyarrow tensorflow tensorflow-metadata tensorflow-serving-api
GitHub master 2.59.0 10.0.1 nightly (2.x) 1.16.0 2.16.1
1.16.0 2.59.0 10.0.1 2.16 1.16.0 2.16.1
1.15.1 2.47.0 10.0.0 2.15 1.15.0 2.15.1
1.15.0 2.47.0 10.0.0 2.15 1.15.0 2.15.1
1.14.0 2.47.0 10.0.0 2.13 1.14.0 2.13.0
1.13.0 2.40.0 6.0.0 2.12 1.13.1 2.9.0
1.12.0 2.40.0 6.0.0 2.11 1.12.0 2.9.0
1.11.0 2.40.0 6.0.0 1.15 / 2.10 1.11.0 2.9.0
1.10.0 2.40.0 6.0.0 1.15 / 2.9 1.10.0 2.9.0
1.9.0 2.38.0 5.0.0 1.15 / 2.9 1.9.0 2.9.0
1.8.0 2.38.0 5.0.0 1.15 / 2.8 1.8.0 2.8.0
1.7.0 2.36.0 5.0.0 1.15 / 2.8 1.7.0 2.8.0
1.6.0 2.35.0 5.0.0 1.15 / 2.7 1.6.0 2.7.0
1.5.0 2.34.0 5.0.0 1.15 / 2.7 1.5.0 2.7.0
1.4.0 2.31.0 5.0.0 1.15 / 2.6 1.4.0 2.6.0
1.3.0 2.31.0 2.0.0 1.15 / 2.6 1.2.0 2.6.0
1.2.0 2.31.0 2.0.0 1.15 / 2.5 1.2.0 2.5.1
1.1.0 2.29.0 2.0.0 1.15 / 2.5 1.1.0 2.5.1
1.0.0 2.29.0 2.0.0 1.15 / 2.5 1.0.0 2.5.1
0.30.0 2.28.0 2.0.0 1.15 / 2.4 0.30.0 2.4.0
0.29.0 2.28.0 2.0.0 1.15 / 2.4 0.29.0 2.4.0
0.28.0 2.28.0 2.0.0 1.15 / 2.4 0.28.0 2.4.0
0.27.1 2.27.0 2.0.0 1.15 / 2.4 0.27.0 2.4.0
0.27.0 2.27.0 2.0.0 1.15 / 2.4 0.27.0 2.4.0
0.26.1 2.25.0 0.17.0 1.15 / 2.3 0.27.0 2.3.0
0.26.0 2.25.0 0.17.0 1.15 / 2.3 0.27.0 2.3.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (22.5 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

tfx_bsl-1.16.0-cp311-cp311-macosx_12_0_x86_64.whl (24.1 MB view details)

Uploaded CPython 3.11 macOS 12.0+ x86-64

tfx_bsl-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (22.5 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

tfx_bsl-1.16.0-cp310-cp310-macosx_12_0_x86_64.whl (24.1 MB view details)

Uploaded CPython 3.10 macOS 12.0+ x86-64

tfx_bsl-1.16.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (22.5 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

tfx_bsl-1.16.0-cp39-cp39-macosx_12_0_x86_64.whl (24.1 MB view details)

Uploaded CPython 3.9 macOS 12.0+ x86-64

File details

Details for the file tfx_bsl-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tfx_bsl-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d4c447763e06cec4c5ba7cb350cc71b7bcda1275f79c0e3b5a89494977856a3b
MD5 76abd665da5874ee810a5c71ab983a92
BLAKE2b-256 e33a4b65fd3de4bdee5ae075e5f9340e9708f3e249b4cc7b7b3f411ecb8941bf

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.16.0-cp311-cp311-macosx_12_0_x86_64.whl.

File metadata

File hashes

Hashes for tfx_bsl-1.16.0-cp311-cp311-macosx_12_0_x86_64.whl
Algorithm Hash digest
SHA256 b347b685ab34839d5f7c05c30681003d1195845d3eb50c4f1ba2ce5e045d1b5c
MD5 dbfc65b7d1afeecd42e82958bda86db4
BLAKE2b-256 a05a8b01d7a8cacd2be2b00264d723bf790e23871e0a76b135de17c112eda8c5

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tfx_bsl-1.16.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 027aecad4f15e090d68c401f401196dad7d3d893dc66e29b864e1ae3ea4756bb
MD5 ab4ad744504cc8cc847702ee1fe141e5
BLAKE2b-256 6e3d705216202a4354559d32c63e1060e13d8cbece88ba0723707cb908fc194d

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.16.0-cp310-cp310-macosx_12_0_x86_64.whl.

File metadata

File hashes

Hashes for tfx_bsl-1.16.0-cp310-cp310-macosx_12_0_x86_64.whl
Algorithm Hash digest
SHA256 66e1859f454a9f08ac41eb42de25278ef3ae158a1cf988cc664352b68cefa3e4
MD5 6cb1257ae61dd99e3849106c47b760db
BLAKE2b-256 8deda485e51cdea97faf6d836c91c79769ebbd782708bfd61a727886422272f9

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.16.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tfx_bsl-1.16.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 4b2edb66ea02da30a76e15bd3c7fa207b8ef347456f72c0efd24ada7ff54e48a
MD5 fdf23f75462eb1f24b7af0e3b0dd6aa4
BLAKE2b-256 9032775552f0fdc88978681fe0ceb48917c0ea73e79ecd6c67727d936e9bb4b0

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-1.16.0-cp39-cp39-macosx_12_0_x86_64.whl.

File metadata

File hashes

Hashes for tfx_bsl-1.16.0-cp39-cp39-macosx_12_0_x86_64.whl
Algorithm Hash digest
SHA256 960526c7ad80e3fad94fe4bd830457f0d53cd9b032063a5c0022e542b6b1ed47
MD5 d8ebde8aaace085f0ca266221e62ae27
BLAKE2b-256 c93c1d4492793d46489cc812ca87e2f39de84289f4ed916a796f40f8fb5ce040

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page