Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

This package is not intended for direct use by TFX users, and its APIs should be considered internal to TFX (therefore there is no backward or forward compatibility guarantee) unless otherwise remarked.

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.21.1-cp37-cp37m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.7m Windows x86-64

tfx_bsl-0.21.1-cp37-cp37m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.1-cp37-cp37m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.21.1-cp36-cp36m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.21.1-cp36-cp36m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.1-cp36-cp36m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.21.1-cp35-cp35m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.21.1-cp35-cp35m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.1-cp35-cp35m-macosx_10_6_intel.whl (2.2 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.21.1-cp27-cp27mu-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.1-cp27-cp27m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-0.21.1-cp37-cp37m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp37-cp37m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.7m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp37-cp37m-win_amd64.whl
Algorithm Hash digest
SHA256 632add62869bd2c35aa27c89e030fdfa3a517bfc9774004a0db0ac0ddaace437
MD5 8aeae1ab3a76e56b2b334143acababfb
BLAKE2b-256 b6981b0344b4fb2f52abd63efc5f5d46fb9d75d66025e7411af33e41879e016c

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 2bfc135a6bf9783a8b0c29ffcff96ff0424d4d46362224db71fe9399145ef085
MD5 bc2bba21f76c83110119f628653f2edd
BLAKE2b-256 fde6892fcfb7a14494ebbc7df90fcbed2dab99f28cb2272213dcc5ff5ed57ef9

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 e071d27b9565f56c7692b5b9020ecf23dca3f1f7d98fa84d9936f05045d645d9
MD5 ce90a27e7b105265e5b62ecff88e370c
BLAKE2b-256 c88c80e7d23c6a10e8b81eb64e77359e80cdf6f51d30e331d56822e7dcf2ee9f

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 ab12afc5f33af302a800c0493f85c1cefb46dc5242b04d0e3b53c6f692fa8bbe
MD5 d76656f7038d17922647b8f6e6301bbc
BLAKE2b-256 75af428401fd978f27ddc8b0a9db0737b00180f883e7b8d461f7c01549206639

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 b8f05f3b9725b146e117c79afdf3952da7a7ef41884e024d07c3d0d13afc4e78
MD5 d4a252309bd325fc0789355ee9d73f21
BLAKE2b-256 3110bba20a3a15faf3877508afec6f294af5bb4e8f553dccaad289738a97a0c5

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 05332cf4836601c888e10db1832d181bc79f201d3929d75bad5699929238c439
MD5 b7e14d0680f4732f86aba331a8d029fb
BLAKE2b-256 3a3cd4445fd690dc5787cb74bf2041150f98400a9f8f392eeeee59d8d08b5e0d

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 0a9ce81e1fa2b82ebacab543ee6126f634fbe22f9daa525bba6110eaa5e1abbe
MD5 2f2ebc64f0c4f43b2defd043f4b59c38
BLAKE2b-256 887aee1644b292fe3db1c9a30bad1ddf0eabb4eaa0ab85a6806819f2ea61977e

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 4af91cd4009f99d23bb20e967e881259855db460eb38deccb455adb4a8ff6107
MD5 b1b728a99439582f12c24ecc6f923429
BLAKE2b-256 24c4cb6d3f1d7cee0df0924bab80a303ad40821462a9547635230113816ce687

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 64ed81d6353abc56bf76aa6d7e4c90f30a5dc87532d0f8114191c3023dfc4f4f
MD5 c569fd2017d3c187a0d78afe0577c646
BLAKE2b-256 1e63226cecdc1899efe442f57ce81f82a26b13c193d0498d6d5c54fcf16cdf81

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp27-cp27mu-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp27-cp27mu-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 2.7mu, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp27-cp27mu-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 d753addf154d0f68bd7b371c2a9a6e77b62aeefff97e49ce58fcf6dcf5932e99
MD5 28f04ba6bc31a24e123645f50cee8f8f
BLAKE2b-256 fd3583b04fdfe17424aa5d66d2974d050e9d0e2f2f7ef1e7b94948a67a03751f

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.1-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.1-cp27-cp27m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 2.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.1-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 9ef0b506adf0d9faa1b52a6a9558fb08118444f7f3ae237ce67fb23488968288
MD5 05f941ae8dc1e5b129a45bb8f6736e06
BLAKE2b-256 776d3a56121e9f96362933d1501ded03149563d9144a31941fd732096b79f1e8

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page