Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

Only APIs in tfx_bsl/public are intended for direct use by TFX users. APIs under other directories should be considered internal to TFX (and therefore there is no backward or forward compatibility guarantee for them).

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.22.1-cp37-cp37m-win_amd64.whl (1.4 MB view details)

Uploaded CPython 3.7m Windows x86-64

tfx_bsl-0.22.1-cp37-cp37m-manylinux2010_x86_64.whl (2.0 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.22.1-cp37-cp37m-macosx_10_9_x86_64.whl (2.3 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.22.1-cp36-cp36m-win_amd64.whl (1.4 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.22.1-cp36-cp36m-manylinux2010_x86_64.whl (2.0 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.22.1-cp36-cp36m-macosx_10_9_x86_64.whl (2.3 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.22.1-cp35-cp35m-win_amd64.whl (1.4 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.22.1-cp35-cp35m-manylinux2010_x86_64.whl (2.0 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.22.1-cp35-cp35m-macosx_10_6_intel.whl (2.3 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

File details

Details for the file tfx_bsl-0.22.1-cp37-cp37m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.1-cp37-cp37m-win_amd64.whl
  • Upload date:
  • Size: 1.4 MB
  • Tags: CPython 3.7m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.1-cp37-cp37m-win_amd64.whl
Algorithm Hash digest
SHA256 6ad51a16ee3625486911b4b7acbd3ad1a3b9b373d07e2e7f94e1a9a95a26e6f7
MD5 9191fa95e4c215e58bc8197670f6cafb
BLAKE2b-256 2b3213398b74a97ea7ec4af83e905f9a1ee7083c809ccd185326e516e46a4855

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.1-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.1-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.1-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 0b0e7b5b6b8394b855a85982fa01af99748d821b31ff1285014e18609c75c687
MD5 bf0536dc98d6b7b1a9d7a75b0b94c5b9
BLAKE2b-256 a5121369b718a4652ce0cd65bc4e2d996c04feb11e5978cf5a95c57d82c43728

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.1-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.1-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.3 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.1-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 6c3827ea109b65f9436678873113de35381151535eff3b2d01b04eb601dadddc
MD5 27b6954f684907a4c991417042ac0e41
BLAKE2b-256 46e31f330b85bc05baf031e863ff9368883e39f38ce1ce54e4d51ac255f9a9ef

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.1-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.1-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.4 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.1-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 5952cddb93dde19bbe8c47c6bd4c65f25627b5bc91cbb57237f6dce3982f7e49
MD5 1891bb6c479e28c76ffd8182db84c47a
BLAKE2b-256 f557c544e0e890ed740c722858d36aabccbc61872cd2374d4fedb9e60eb23618

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.1-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.1-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.1-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 c276973d8ec95a00f2c43a3195af12c64f965731af8ac8a670d356526b343461
MD5 9190c4dca3b5bffecdf38c0a528cc987
BLAKE2b-256 16e2af393a3e6b6088c6d5724450724bcc3a328eabd41391a79859d719503a96

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.1-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.1-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.3 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.1-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 76c047dccac7140ad1cd6eca88ec1d5ee39458a5a81241e715ba7e5a554bf394
MD5 c17a37ea6078d8454fef9a1b52c6db04
BLAKE2b-256 4db402636ff0fc3d41413c2697a3c886f6ec809ed48f28492ef214d6d5e3bb01

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.1-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.1-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.4 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.1-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 a6b8a5dcc5a8ed36fb3e3b6bb26b3428469ad7fc2956b0ccbfd9d7f5a8bac544
MD5 ff78a569c7e9a6fbe2524fef60d754d3
BLAKE2b-256 cbb9a8381a7a6631e15eda06ff7e6fafd5c2f48ea839f1ff9d93166d02cfc4c0

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.1-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.1-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.1-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 eaabbce2f947b52acb21c812472034c85dc1d67595613d2d2d01c2932938b558
MD5 ce6d5ec00fb8532bd7d30a495e5eb5a9
BLAKE2b-256 c9eb234b969a17b0bd6a59ccae57101f3bb21c416ad74e64c1047a5b8ef4ed5a

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.1-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.22.1-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.3 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.1-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 68bf638afc784cc6a85ef79670ef145b06dada324b2ec24172678eb8422e1f36
MD5 4fe256619bdb585338a88ece45d9079b
BLAKE2b-256 7210efc6dac509127a7365532b9c064507a59ce49a7e1981327e8f7105e8abe3

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page