Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

This package is not intended for direct use by TFX users, and its APIs should be considered internal to TFX (therefore there is no backward or forward compatibility guarantee) unless otherwise remarked.

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.15.0-cp37-cp37m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.0-cp37-cp37m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.15.0-cp36-cp36m-win_amd64.whl (1.2 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.15.0-cp36-cp36m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.0-cp36-cp36m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.15.0-cp35-cp35m-win_amd64.whl (1.2 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.15.0-cp35-cp35m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.0-cp35-cp35m-macosx_10_6_intel.whl (2.1 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.15.0-cp27-cp27mu-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.0-cp27-cp27m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-0.15.0-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 8a646276513a16813033e0956d25a28d4e6d64ae892effef8af368e43099c2b2
MD5 a41b9b83dbd1d9184b67499c243e6df0
BLAKE2b-256 9b89898ea1213ca265de28bb81a4d62ced07026f336413830a62df032842fb6b

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.0-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 1265a6ab2ba80b4c4325ee65b13b4b6c96c6f0abf06741717ba0ace43e7cd62b
MD5 76514bdb2050871d643abd837812be38
BLAKE2b-256 47c01de0c072c55995af54234aca00a8f206c47f49030b28582eb719f43dfcba

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.0-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.2 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 49101d89cdbb0e5869a97a72afda0c5408074c58dabf87f04396740cc1264d46
MD5 0e2448d48b582214a0b55a58e987856e
BLAKE2b-256 49fa3febaee9dafbd96aa3a22377052b50faa1dc477046dbdafb4215c4d669bd

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.0-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 66d548170b7bd916150c7d583a7b42284406f7440d41debb33545cd6918fed26
MD5 5d7a44328f7d8d4b47edc72d73ab4192
BLAKE2b-256 3004d731895910cb12d71c771129508135dd1de5ce61c6229fdf585c4ec4bd9b

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.0-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 3b6a2c3681be297c2b479dff342f7174049c1af4be88409767939645e9239a70
MD5 b90ef74d436130259ef0dec671bc2277
BLAKE2b-256 f19504c40e35c1f028699e88bd789a1895d419f0d581de07917d94dd081107d2

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.0-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.2 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 d2f23f806abce9105e85a383d30ddc785974029126e961d6a40c1a87eeaa88b0
MD5 382ab2c0b057caeb9e4218f479d2e45b
BLAKE2b-256 8cb94840da7e93272c67cf8b4e46b19ede6f1d6c41ca0a9a830f61b0c2d1d25f

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.0-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 dabd7ad5af227eaabcc3ecb54e1fb1345e3b8140f26726dcf56b0915abadcc3d
MD5 bb47c2b3aefea968661a5f212deb4fcc
BLAKE2b-256 e2de0aab03627ed15ee43b30c0b366ef91e95507d0ea4b1810c780685013eea5

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.0-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 b85c24ac609d3e6cd6e25b3c3fc16d77f39d920448818c92ea405e532085b02a
MD5 8bcd2b2df6b01d7f649fb959519e9687
BLAKE2b-256 08ef132fbfb65e3495d0e0b8e3267074ecf012c125686b28346c66f4a15e6fb6

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.0-cp27-cp27mu-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp27-cp27mu-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 2.7mu, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp27-cp27mu-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 53c515549d5aa339f63434e9250b448993eb948ef69f6cce23afdc9f6c13c5d4
MD5 8df96944235a8a22b819e7ad813c06aa
BLAKE2b-256 7e1654059ba7c1a7ee2e9a22fff19498c9a9da2a907ccd4d2154e3a5e7957691

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.0-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.0-cp27-cp27m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 2.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.6.8

File hashes

Hashes for tfx_bsl-0.15.0-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 cc9fdeb0aa184dc73485acfa314e3c1b6a8fa4c4c1d3927c914acdf637a52910
MD5 ea914cd59ff0b675a58399b177c1a321
BLAKE2b-256 b8354839cc64973a5f3d0027679b6eb975ecac9b01111ad4f963d6c33a3f3295

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page