Skip to main content

tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

This package is not intended for direct use by TFX users, and its APIs should be considered internal to TFX (therefore there is no backward or forward compatibility guarantee) unless otherwise remarked.

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.21.0-cp37-cp37m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.7m Windows x86-64

tfx_bsl-0.21.0-cp37-cp37m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.0-cp37-cp37m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.21.0-cp36-cp36m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.21.0-cp36-cp36m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.0-cp36-cp36m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.21.0-cp35-cp35m-win_amd64.whl (1.3 MB view details)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.21.0-cp35-cp35m-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.0-cp35-cp35m-macosx_10_6_intel.whl (2.2 MB view details)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.21.0-cp27-cp27mu-manylinux2010_x86_64.whl (1.9 MB view details)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.0-cp27-cp27m-macosx_10_9_x86_64.whl (2.2 MB view details)

Uploaded CPython 2.7m macOS 10.9+ x86-64

File details

Details for the file tfx_bsl-0.21.0-cp37-cp37m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp37-cp37m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.7m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.0.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp37-cp37m-win_amd64.whl
Algorithm Hash digest
SHA256 ec21cfd51afa531fbac02b87fc47937ee7f34ce11b57de05fec344102e836b6c
MD5 2f9cede7235559b625517e983e789185
BLAKE2b-256 e97bd0f45ab90d398263e939baae019f70e62daec5e8161629c6f5987dc0e9f3

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp37-cp37m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 cc91b7c035990721c2cdded7571fa817a0474f6813b5ba49d97c76219171ebaf
MD5 19080a3b28a1c041c9bd86497e86d1aa
BLAKE2b-256 85805ecdf1ab0062027a09a74ccf1259952bd12ce0504b91a08872f30b6c57b5

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp37-cp37m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp37-cp37m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 ade59e226c6056ca1ea0c30d80c7da931044e193f755ae5719134e2648764bc8
MD5 bb144833f8a07fcb993d69e7b05a51f1
BLAKE2b-256 d8db37c9d9f59295b63f16cd92375584a8c248398e11719ffcfe0721c4f65c4f

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp36-cp36m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp36-cp36m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.6m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp36-cp36m-win_amd64.whl
Algorithm Hash digest
SHA256 f6dd4e626d3eec304caf7eb94eee51e6e0d77929c491fef34648b09f6000cf57
MD5 942d0dc321ef1b49c105d161febd7400
BLAKE2b-256 74aba4cc5a5cd7a1d2246f041218d05950c68e4d642293ca91075c617f74e88c

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp36-cp36m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 037705d0fb80f4fc5b1dab5214feb8dcaf6ba344df5c4dd7f17c52efa94e680a
MD5 cb0c128d53ee458e83c44e7ad7a7831b
BLAKE2b-256 0cdb859e8f0d1f599343a5d44441084a1bdf27642b17e6a1aed46598784d7bda

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp36-cp36m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp36-cp36m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.6m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 dceb2ff0d0827368732547744059159ed2f8007561d24f7691a5fc249db6e26f
MD5 e5d693072d41038b68bf29a415031b27
BLAKE2b-256 12d4a203765cd8eec5c7dc839e91ccffc34e05c6d21de40ed703dba8d580d6e5

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp35-cp35m-win_amd64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp35-cp35m-win_amd64.whl
  • Upload date:
  • Size: 1.3 MB
  • Tags: CPython 3.5m, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp35-cp35m-win_amd64.whl
Algorithm Hash digest
SHA256 cb7638bf113a5a217a237492f0541e07e89167d2624f12164efd3eb047cf25f5
MD5 99860cbe5550e824cdcfe41a15c437a0
BLAKE2b-256 6747f125534b587705378e7b7bf45ee8c25569af818ef18be07aca805a0a0f16

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp35-cp35m-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp35-cp35m-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 3.5m, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 f4bada952b8903740c58c57b288d29822db129a764a23cbc1e831db33a1b3870
MD5 a8b7225c4c1060f37892743e14efd31e
BLAKE2b-256 47656d9c92ecb010297c53d7fd043e45b45e73dc1a52cfed9896ef1987f7a1ec

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp35-cp35m-macosx_10_6_intel.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp35-cp35m-macosx_10_6_intel.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 3.5m, macOS 10.6+ intel
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp35-cp35m-macosx_10_6_intel.whl
Algorithm Hash digest
SHA256 a8ef13d7d25a60859492cd74748eb451d765b54daf7dc0b2fedfcc8bbe0b7c83
MD5 f7552d67eeabb72c3ac6a65d21d72536
BLAKE2b-256 d7beb05a153246760df7fca0befadefcee0422514fb8c182b1858c16de92862f

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp27-cp27mu-manylinux2010_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp27-cp27mu-manylinux2010_x86_64.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: CPython 2.7mu, manylinux: glibc 2.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp27-cp27mu-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 5052c3dedaca7475d7aedd195e4580f2f171fd7d71794bdbe934b1c7594accd8
MD5 f6e40926e0e7f1236a7aad72a7e98c9f
BLAKE2b-256 ebfc86ef93c7e1f3a406f58c4776504e777399c16bc175be43ac3f4a692a64ad

See more details on using hashes here.

Provenance

File details

Details for the file tfx_bsl-0.21.0-cp27-cp27m-macosx_10_9_x86_64.whl.

File metadata

  • Download URL: tfx_bsl-0.21.0-cp27-cp27m-macosx_10_9_x86_64.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: CPython 2.7m, macOS 10.9+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/41.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.5rc1

File hashes

Hashes for tfx_bsl-0.21.0-cp27-cp27m-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 697c02004fb72ea4d38c83a193c9634c23fb5824d110bd0d47cd2204754264ae
MD5 1d774d47c416619770f3a3fc7649ba4c
BLAKE2b-256 89d563d83f7c347d4ad19c9934bf82fc7b82772bb87a93256aee7e5701f7e6b0

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page