Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

Only APIs in tfx_bsl/public are intended for direct use by TFX users. APIs under other directories should be considered internal to TFX (and therefore there is no backward or forward compatibility guarantee for them).

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.22.0-cp37-cp37m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.7m Windows x86-64

tfx_bsl-0.22.0-cp37-cp37m-manylinux2010_x86_64.whl (2.0 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.22.0-cp37-cp37m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.22.0-cp36-cp36m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.22.0-cp36-cp36m-manylinux2010_x86_64.whl (2.0 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.22.0-cp36-cp36m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.22.0-cp35-cp35m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.22.0-cp35-cp35m-manylinux2010_x86_64.whl (2.0 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.22.0-cp35-cp35m-macosx_10_6_intel.whl (2.2 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.22.0-cp27-cp27mu-manylinux2010_x86_64.whl (2.0 MB view details)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.22.0-cp27-cp27m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-0.22.0-cp37-cp37m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp37-cp37m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.7m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp37-cp37m-win_amd64.whl
Algorithm Hash digest
SHA256 0c841607287efa94e76ebb7759f66b53468b9f107e9988a6e14fbd4c709cc51d
MD5 a78e2724ef9a78f00109de6be1646243
BLAKE2b-256 e5a6c74abdc28760d052ba95001c4b0ff9cfd102a59a17d34455d18dd6175781

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 0464986ae749b330ca1da902a5ba4924796ce56b211b6de6e0b8db839a1e56f6
MD5 4004cbad45ca49ad98c7acbc9d2d1a70
BLAKE2b-256 fa7caee65baf38ef14254fe4d5290ca8d89132ff9fc3362cbd34e82edf955a0b

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 0edc53e813e870f8bf61cff1d22f9bd9a4ce50fdb4571c91d18a8850afbe57bc
MD5 57563a2f0e00cdef369ea6a2d1550477
BLAKE2b-256 5f7401e441220affa8656669f3f598f96e5d9be31722845218ebe8a685f0079f

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 e9cad629a00b07eb2bf388c37a36e2b4f493cf636eee339e00aaded3013b684e
MD5 77966a140d0106a004122fa68beef2f1
BLAKE2b-256 7c76635e0ceacaea6fc46d715f6329da7327f39826a39d7227f91f80e28232b6

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 d5d79dde6423ecbd7c7dae23b9d68b4336cd098c911179a09e996ad55001177d
MD5 e5b0ae416b053cff85f18413ebb4ee7f
BLAKE2b-256 b4019494672a3cd6259adb732fb229eaebfa6fab9d34b2f8e37fb617ba8144e8

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 fd701e14d660fffe6aa4bdfcb78225f5a891ef17f7ff276fe1e2262ee1fbec7a
MD5 c110577e85d80f5a7add2d7d288ee2dc
BLAKE2b-256 d2d66e55fc13905b874fa136929fa44e330b5b916ffd6b5619ee70722f7aaab2

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 633023ee8a46d93a2bdb662150be912bb63787cfe2015eb8e1fc423b1963f044
MD5 21f95e838494de983956ecdbdb5d88c8
BLAKE2b-256 59c603c04a839d6ea80431390e0ef16893d065804240e96fadb6b9fa052d5927

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 175bb960f3ee80833722e8f9afd87675220997658fcdf426db77b7cc42f57db6
MD5 39ba924be77254eb1c4fc47d8046204f
BLAKE2b-256 dd94bd7e6d675e28b33127ed22affeba316c81c6ee0864200c9e319a8b0a0516

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 bbc2786ebac92388286a4484879900652db0ac07eb34fcb02a23d5b1840d7492
MD5 5d80b6943db54750effc9721b6fa3cb3
BLAKE2b-256 9892ffabfd8407aa98e20be6d520aa95400683bfa8b53ea3fbc322fb1f0320ef

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp27-cp27mu-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp27-cp27mu-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: CPython 2.7mu, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp27-cp27mu-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 052bc8d2abb1298fb72dd81d45c2dbc4bb8adcdf53ddf3539101d6942207be4b
MD5 b176c6a15b2d7ec7fe645878330fe6b7
BLAKE2b-256 90e308f522a248a6917244243e93f552dab6d635c6894e1a4174abe5ad9c8752

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.22.0-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.22.0-cp27-cp27m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 2.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.7

File hashes

Hashes for tfx_bsl-0.22.0-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 f8a49e86f14346174f892f35f006ae37b152ee637f388fa4489c32f1d43ae94d
MD5 b8c2b81020470e03738de91c134c5e99
BLAKE2b-256 2ed821cc553b6eda661ec2642d080e62767b0a5e6233a0037e1c6de6b236f542

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page