Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

This package is not intended for direct use by TFX users, and its APIs should be considered internal to TFX (therefore there is no backward or forward compatibility guarantee) unless otherwise remarked.

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.21.3-cp37-cp37m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.7m Windows x86-64

tfx_bsl-0.21.3-cp37-cp37m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.3-cp37-cp37m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.21.3-cp36-cp36m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.21.3-cp36-cp36m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.3-cp36-cp36m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.21.3-cp35-cp35m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.21.3-cp35-cp35m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.3-cp35-cp35m-macosx_10_6_intel.whl (2.2 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.21.3-cp27-cp27mu-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.3-cp27-cp27m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-0.21.3-cp37-cp37m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp37-cp37m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.7m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp37-cp37m-win_amd64.whl
Algorithm Hash digest
SHA256 547c4155fd844506e7c75aabbc44f24e2ca3feef9fc05bfa591085fe08dafd34
MD5 0a3d74fb887aa215fb65fe70958ed0ce
BLAKE2b-256 cf9f4265906dd564081c1a44f47568fdaecb365e5434b625d24c6e4253eb13f0

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 a7dc8d16ca4809044a1b0f083ab759fd441ec2524278d5f3bb0ae6f15b77b819
MD5 37e18e8eda00217a2cf3bd51b0513417
BLAKE2b-256 8a350cffb6eaf3ff9b8409d3882f906cff297656ff594c39a8f6a181392f5f94

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 d40fe0cd97dcaefc09af5e9619e13801cebfd72af255b3cb3fa59516a381843a
MD5 9f2611297307643c1295f1da3528d655
BLAKE2b-256 f82294693a03cd07e271c7d1ba1f08556ef02555fc90ad36f2b9490bb6dc99f4

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 c579491283fe54b9e676776d615f116004c66b1ecadca003fbbc5d6f3c1fce56
MD5 0b650d73954f2e80942716f0775984af
BLAKE2b-256 1341ea57c7944e2b9e401e789e4eaa7ff735fa56ee4b0980406147bdcf549da5

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 469266f49f8adedf34f1d87fbf6e751d6c6893c0b88ae6a39dd6ff6d5e1a76bb
MD5 36e8e5d60713c7690a9f233646fd381d
BLAKE2b-256 becfe9ef7d0685b432d9b9ec045833933b47fa54cad46be1b64b1a92d01c862d

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 9b52735e3a4920f47bf52e6ccfc2d5054b916544b33a5aaa162e8953a01f6cff
MD5 7947946661e1c0e54f80d54336c7540f
BLAKE2b-256 6562ed11e90c38c0b6926736e66ab41d7b726eb8d5303ce36f7a89f26818b229

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 0f0cc936d52294ca6ac2b8e5669de472754198c8ab2529674b13e297ed15028a
MD5 78c362b766631b9a3dd0928a6917cd67
BLAKE2b-256 b534d3eb9f001f3849fa36fad1c73fea18804081fa79cfa446d9a7409fe309d5

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 9a60a69bf5a23974ebf8a55147a14264a3bb26b80732c0d7ea004d4e57a9b212
MD5 6c489c6d19fbc1b44a84c4a00d6bce4a
BLAKE2b-256 5147b9fadc5745613736c7cedcf4788af2b029f087651d4f8d7dd237556d9ea0

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 97ed5f49bf921c435615bce88ab1cb192bdcd9c55efd352a333fa2611848fe8d
MD5 78a2e501202ae1d473c00e82bd07ceb2
BLAKE2b-256 dd0167fd606a78e86542be45c57508cd4431812cdf3c41b885d7fae7934e01f1

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp27-cp27mu-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp27-cp27mu-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 2.7mu, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp27-cp27mu-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 05546ab90548582c9a4935408a875e5529380d5d125f4fbce395949e5d44efe7
MD5 70ef6965862b74b9d4cda166bf3cdb4a
BLAKE2b-256 6ab42ecd5335f6febc1eae47a9b25cdaf07eac10b08f38cf83f1b51f3e447af8

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.3-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.3-cp27-cp27m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 2.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.3-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 c6a590195e9df7101ffc8f5c586947b73e4721a8199e6e955f529c758cf8489b
MD5 db9f1424f48ddadb75a8d89d03767a7d
BLAKE2b-256 516a28e896a8a60c17d004d387228075049dfaf407b11215b545c063c951bbdb

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page