Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

This package is not intended for direct use by TFX users, and its APIs should be considered internal to TFX (therefore there is no backward or forward compatibility guarantee) unless otherwise remarked.

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.21.2-cp37-cp37m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.7m Windows x86-64

tfx_bsl-0.21.2-cp37-cp37m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.2-cp37-cp37m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.21.2-cp36-cp36m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.21.2-cp36-cp36m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.2-cp36-cp36m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.21.2-cp35-cp35m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.21.2-cp35-cp35m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.2-cp35-cp35m-macosx_10_6_intel.whl (2.2 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.21.2-cp27-cp27mu-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.2-cp27-cp27m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-0.21.2-cp37-cp37m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp37-cp37m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.7m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp37-cp37m-win_amd64.whl
Algorithm Hash digest
SHA256 acddc7aa8ad794eaf4d3829b8944f30c3a8823836bb77676da23171cf620cc9f
MD5 9c12efa85ffbccf042a4e9fd90ac1bd3
BLAKE2b-256 0d94831d02b08c14d407ec1284c87cdf47031d0402326e863f50005141f5d7f2

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 3568456d6b984b2f9b904104143272db06d52f770aa2683a6bfa0f9d18e344d4
MD5 5cd7d964ac2fe6e910dc48d752f32de3
BLAKE2b-256 fa04a1d7153a47e7f769b5c5f2965e681dee132d2e1b2fa964d4f5fbd040289a

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 3e223cf6ce915a660bfbdbe6357d2b737fbdb033685bbd0bd058a6cbdbc3ecc6
MD5 4517ae39331b801ce3cd6d2863899d3c
BLAKE2b-256 886ea302016ff4eb2d044f5c8e0e1178af6ab8ccc593f757d9092ab7a63a2ca7

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 919505b473b59eb0750bf8443d03aa0b45c1ad75795c5bc07914f027bf89bd12
MD5 b7778bd085a0b74de24b287ba8434dff
BLAKE2b-256 3e1d3d7903f3420266e6e67ba2c3a141caab8c57f283dbbf40c552b70a4725ca

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 975e8ba9d949b157b786ee3451b716b70dbece6c88531f1da187ff7567aec54d
MD5 25dfb7ce7b276473be845d02a0f25b23
BLAKE2b-256 890469938f4573420a5200c8af5bbcd9b114ed606eb51e2681c336cf082e3f57

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 4a8a48e8541f06ddfcf764367cb592ada11da09867801fc7f8ae877ca795b645
MD5 0f36cde3f6a0216cf2b6d167dccb092d
BLAKE2b-256 6a0417c8883c2ea8c9032edc23584f07b6cf2ce174c355692094cd7f342948ec

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 6f4bda0e56dd1cab0bba7dc284becef1520ad33ee8d7796655735413e94cf834
MD5 5eb408e6029d6c20878fb3d33baca14d
BLAKE2b-256 d183637c8378ad765ec30eef9de7832524c689d18c88842ed837650d5a110662

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 b1f8172118ce6b4f8f1918cdab05c0a952663ad1b543132b224dd6fd5b0d2589
MD5 96207ba48d907eeaed92249ccb2bebb3
BLAKE2b-256 d44e73c222711bf751e704e5419435dc5f49e9318c0b0d9a7329e73c3c62ca7b

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 104e08df3112decec1cfaed3db1163afa846408a6683819d6d4b362044960bad
MD5 9537cf0f515e2d8fac47bed689c10890
BLAKE2b-256 869f28abf40863f936727769545f7ac92ed7fdd58e526d6585f05ccc1755e786

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp27-cp27mu-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp27-cp27mu-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 2.7mu, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp27-cp27mu-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 9036e618dd45e5e1e92481678018f363e14d2b8aa3d49fb76448a7e5db4f0acf
MD5 81b0e9fc180c133c4b35f27afa15b22b
BLAKE2b-256 93392d12b207070d723b0ab5fd66754225b28547b1fe8715b3a7120b93d45940

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.2-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.2-cp27-cp27m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 2.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.2-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 252d2f5dce56853a0238df588bd4f986e0237cc5abcaf17b8c7ddf34f6a41f49
MD5 7b3b5251f9a658438622a7726970e6dd
BLAKE2b-256 979022d4cec4665f306aa9a5ae7b7dbba631ae670428f82d9c061f69bd69b727

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page