Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

This package is not intended for direct use by TFX users, and its APIs should be considered internal to TFX (therefore there is no backward or forward compatibility guarantee) unless otherwise remarked.

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.15.2-cp37-cp37m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.2-cp37-cp37m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.15.2-cp36-cp36m-win_amd64.whl (1.2 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.15.2-cp36-cp36m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.2-cp36-cp36m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.15.2-cp35-cp35m-win_amd64.whl (1.2 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.15.2-cp35-cp35m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.2-cp35-cp35m-macosx_10_6_intel.whl (2.1 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.15.2-cp27-cp27mu-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.2-cp27-cp27m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-0.15.2-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 78bb280d637df5db8080928e230ff6338293bea1c1b237f9a561cc3055a29b93
MD5 cfd8cd481278fec326ed4c630e47d96c
BLAKE2b-256 2b091c9b2275a2b710b64d128f5bc1c0e151c78b337bab088786b894cd5f709a

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.2-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 95ffc1f70bb294cc72a706fbe388e713042e13550739b809f885d6bcce48c7bb
MD5 6b2571200036f58b80fbf741a32ebc72
BLAKE2b-256 73a8d9f5ee8535b43e94f0eda57490e618c8e208bfbfd02cf4282e05f218df97

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.2-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.2 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 ba211713174ef0eb48dc66ea1f6382e152197c6863dbfd202d584761c2eaa59e
MD5 3085285a08c28b54be6c7af42e2c0c7d
BLAKE2b-256 55b3d548bd397b38931f0b45d2fb3d2920d303da9276f5a3f6884b28a2ec0a09

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.2-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 606251891e6455cfd18ee585093021f45f6c6d8cc14fa0b47dc08aac09738493
MD5 0729705910b846901e4caab2bc8fdb7e
BLAKE2b-256 8a056104753ce76b35e9e92347d6f1593d21e612036b1f9a9466f93e65933d66

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.2-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 1dbc685bb86466d49d935e22e83b81886052d8b5c4501f3e732ae2c77c0bd431
MD5 1d042320f538d9a0b5b384a7714607b7
BLAKE2b-256 8a353ed1992663b03b877da03886cfd9ef013214fe73d980773fe12bbda30384

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.2-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.2 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 2759c1d8d5652cfa4db43897b4ca27a72a4dceb8d225b185a17c5a44ab195d0e
MD5 eae6c9ae7bcf51bf6036bff040fa57de
BLAKE2b-256 02240b9ca07037e576c9301eae1c6487587034bf633fda12cb40c31cdd7781cd

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.2-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 6efe11a1a8c56762142374050ade5ce8f6a04a8e41e2f96f3a2e5b5c22411c6a
MD5 be7e7f4599b47c2c5d37e726fe6a54c5
BLAKE2b-256 8bbb009ccd2705a3cb547b5bc5313e69e6e7eef94d75f7c4c868b8a939ce1ba3

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.2-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 0b9822f626e58f60f9ac22e9665f8a115232814fe5fc90d9ce74c078f3e4f3ba
MD5 c9158f1d79f0299081c3b1b6793bbdc0
BLAKE2b-256 7a9a058448157790897beda1603b9717b609aab966b47977fc14d59aee54debb

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.2-cp27-cp27mu-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp27-cp27mu-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 2.7mu, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp27-cp27mu-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 a8c91ac2022d10a3d33bb110a3566fadb475f8055abb2a7bc14272606cefb30e
MD5 22563c2ad22b6ddae6e71dc45e1bab88
BLAKE2b-256 52bc1f78992dd84da25986654a782e62783f2f541bf5e8ab94c3e3d820151993

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.2-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.2-cp27-cp27m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 2.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.2-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 e408e68240ae04fc6ec425581e324118f3b61ccab97c43d8589c4009d54c37e8
MD5 aed2afca644f4769d8f7587cd3613ef3
BLAKE2b-256 843959520458033934f57624db5c060c435b2dd500245adb4062b1147159ed42

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page