Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

This package is not intended for direct use by TFX users, and its APIs should be considered internal to TFX (therefore there is no backward or forward compatibility guarantee) unless otherwise remarked.

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.15.1-cp37-cp37m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.1-cp37-cp37m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.15.1-cp36-cp36m-win_amd64.whl (1.2 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.15.1-cp36-cp36m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.1-cp36-cp36m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.15.1-cp35-cp35m-win_amd64.whl (1.2 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.15.1-cp35-cp35m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.1-cp35-cp35m-macosx_10_6_intel.whl (2.1 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.15.1-cp27-cp27mu-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.1-cp27-cp27m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-0.15.1-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 ab469aedabb8721957b9487145bb55150672340652cd71c550249e040d544361
MD5 ee832c850fc754ed8e9037bffb6ad95b
BLAKE2b-256 b205a34e181250b4fb24ac21adb21d502921478937ad689efc67e588e62e3ce5

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.1-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 aee5297177676be63d15cc0a242f15667d230deb15af951c6584123029b3b439
MD5 32bc7aa9d9faba93cb23951b9f029d3e
BLAKE2b-256 2b2e30f484ebfdc46211df9cdb502afe681014e5c8f32f30c3b59d2183840356

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.1-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.2 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 01e1935a0c6de78cea902ca29b817aec3da3ac2165c7639844c7433efa818466
MD5 18d3e44413e4bad1a6b5a15651d13d66
BLAKE2b-256 2e3f318295bc76bfacab6a1928c62f117da5c8f74cdc17a3b7c2212c1c068555

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.1-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 7fc82c606f677ceffebdb9da79ad700a155b649aff5844425167352076c3e729
MD5 8ac7dc2cdde89f79680249106f8d4f98
BLAKE2b-256 63d261819b73f6f866e9b042bc125e2f7e3f3fc6ee4392eaffd17cb6bf044d99

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.1-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 44e0708797aa49eca2518fe5d5654e3f6ddbcaa2e0a0ea98e30bebc888c5f1df
MD5 b2562d1f80294a97ecf99eee173055e3
BLAKE2b-256 9082c81de1f93534439c6b8b50c93ed07c3bfd55d8ee0643f88cab16a958a278

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.1-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.2 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 29b00a0bbe06ecff88b96edddc61c5e446aeabb43a6f7aee3881fd84c6577cbf
MD5 eb5e307609dd5560be1df2eb68398487
BLAKE2b-256 fb203b17319bbec332e2ae8515f501f6abf6aadb871fc422095013c9c7a3f1b2

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.1-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 82ebe9d013efa36ac492eb7c1e5bcdb9edf9e204ba6bd61b667aaf65b158fe70
MD5 97e503f999cb2b393d3bdaeaf0231b6c
BLAKE2b-256 a31b1a8d6ab1fe2377f3d4bf06a9043f8b6db85630c3d4d6b8b07d7e0bc01656

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.1-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 90a833d00e5ef20d0c340621a72c7f3434a1daf55baabfb2bc900b2453e266ce
MD5 f3dc9f39dce8e042b290b3bb688b1f56
BLAKE2b-256 656b5d020bdb88bf07c7d8d5323ef88333a664a01edffdc4fd6ae5082497dbab

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.1-cp27-cp27mu-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp27-cp27mu-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 2.7mu, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp27-cp27mu-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 b299137f1276f643cec9625880dd783d08328f7482f5126e88f750efc35a590a
MD5 5a4760d60b266ca14ea32485933d94f2
BLAKE2b-256 97fbc66a106be11666b65f92a17ea37ca4a2d8955445d3d6db4f0ed3ac22a159

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.1-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.1-cp27-cp27m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 2.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.3

File hashes

Hashes for tfx_bsl-0.15.1-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 dd7b56b8e82dbf4a8533b230742d7a8cd2d25bf303bc5f68d1d6a82d347b0436
MD5 28f35dbb5609f395d7283e28cedd4067
BLAKE2b-256 2472df01aefcfa243aabf99bc2df7f49398adae2a9eccf7446bc6395f4e5b60d

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page