Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

This package is not intended for direct use by TFX users, and its APIs should be considered internal to TFX (therefore there is no backward or forward compatibility guarantee) unless otherwise remarked.

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.15.3-cp37-cp37m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.3-cp37-cp37m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.15.3-cp36-cp36m-win_amd64.whl (1.2 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.15.3-cp36-cp36m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.3-cp36-cp36m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.15.3-cp35-cp35m-win_amd64.whl (1.2 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.15.3-cp35-cp35m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.3-cp35-cp35m-macosx_10_6_intel.whl (2.1 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.15.3-cp27-cp27mu-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.15.3-cp27-cp27m-macosx_10_9_x86_64.whl (2.1 MB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-0.15.3-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 55bc82a7cefa50314debf1c5dfb921d42273dee4ee21a02896e96b751bc81c86
MD5 591faa8f161da3ece40ba0708c6a3558
BLAKE2b-256 edfce016ef9e90c035cfba25d0c9d16f1faa11145a87e18ae7bc9560d20881dc

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.3-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 a562fa1f58766b05e5bf5a872afd5b48d187b6e44e1282a0b29cee20d3b857a9
MD5 4d5ba5cb74fc888e799825d3f1d78aca
BLAKE2b-256 5ef3ab5148d2ba776323c417cd340be4a38126b1f24c9265d5686abe725ffe63

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.3-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.2 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 8ca66663212cef8ee0487e0669dc6cc74f2ebf1ea4f381dd9be12b89df06e9b5
MD5 199d704fa06c9f33c76e2d129a51747b
BLAKE2b-256 986400ad8c05abaca807de35fcf4dd29bf255670b5b30a141b8df13006590103

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.3-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 3ce28f781ef205dc954d827f6a1db44c9b25f39f52b71803af48d1290b75d00f
MD5 230fd833b681971ad7a911bf2fba58a5
BLAKE2b-256 69f75b3d88b609244df551145bb784db1b282af22e515f29f4c8d1794c42bfe7

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.3-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 81c999e17dd8be61a4429d7e77deb0a187405e2e8e0cfda94ce1a8458b7f6cf2
MD5 4b9b0a766f5602e65a82b1a4b1e621c4
BLAKE2b-256 0dc7c0741c12598381271a3ccf9dd03c3fe20dc12b70222795705fe3ae3fc808

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.3-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.2 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 2f3d1f5a4582ccaf1df00269bb4efdd31b1c3b0208895ccd3bdf47a05378b121
MD5 038793994b0c8a911c9a87af42e3456b
BLAKE2b-256 e583d3996d11607e09bc7481e696235d1816fea54870511f6823fdd3bd48322e

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.3-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 7f5576bcbf707f6341ea5a3f72d20c844462b14e13b5fe4af182b0dde6cded69
MD5 7b87d5effcee56f43cfdbada2ee12a8b
BLAKE2b-256 3b0c56d8e5b36532f33d631afb665f85181299d672e332ae309db49ea2023405

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.3-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 b30774aae07f460dc941b885e33a16086fdeb86d978ae3b4aee031fe538f4936
MD5 420373662b57d42b1aed10d943d76a38
BLAKE2b-256 e61ebb70aaf0a3eae1b867a10b913e0f5c3cbf5b7c5c9dc60eeb2845f8753116

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.3-cp27-cp27mu-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp27-cp27mu-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 2.7mu, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp27-cp27mu-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 bc192bf3d1b0b5c64904d195952dd49ff779ff87b4ac44da177504ad9a3a105b
MD5 221e4033c43bbebadc1bf01b5a9f3d97
BLAKE2b-256 89c5501a33ed2885be2e048447aeb38258747b15462e4424514fc593640d0b6d

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.15.3-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.15.3-cp27-cp27m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: CPython 2.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.15.3-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 3ce3ee1072280d4bdd84ff4fba1fb95109b697b0191b21f26082773ea3086064
MD5 3afd20f48278d9231b5ed1ce3645727d
BLAKE2b-256 718387469d76b5198f243084f77ab427f377bd8bfa13766a2829ae91e6a0fff8

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page