tfx_bsl (TFX Basic Shared Libraries) contains libraries shared by many TFX (TensorFlow eXtended) libraries and components.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for google_opensource from gravatar.com google_opensource Avatar for tfx_oss from gravatar.com tfx_oss Avatar for zhitaoli.google from gravatar.com zhitaoli.google Avatar for zhuo_at_goog from gravatar.com zhuo_at_goog

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache 2.0)
  • Author: Google LLC
  • Tags tfx, bsl
  • Requires: Python >=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*, <4
Classifiers

Project description

TFX Basic Shared Libraries

Python PyPI

TFX Basic Shared Libraries (tfx_bsl) contains libraries shared by many TensorFlow eXtended (TFX) components.

This package is not intended for direct use by TFX users, and its APIs should be considered internal to TFX (therefore there is no backward or forward compatibility guarantee) unless otherwise remarked.

Each minor version of a TFX component or TFX itself, if it needs to depend on tfx_bsl, will depend on a specific minor version of it (e.g. tensorflow_data_validation 0.14.* will depend on and only work with tfx_bsl 0.14.*)

Installing from PyPI

tfx_bsl is available as a PyPI package.

pip install tfx-bsl

However it is a dependency of many TFX components and usually as a user you don't need to install it directly.

Build with Docker

If you want to build a TFX component from the master branch, past the latest release, you may also have to build the latest tfx_bsl, as that TFX component might have depended on new features introduced past the latest tfx_bsl release.

Building from Docker is the recommended way to build tfx_bsl under Linux, and is continuously tested at Google.

1. Install Docker

Please first install docker and docker-compose by following the directions.

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx-bsl. If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

Then, run the following at the project root:

sudo docker-compose build manylinux2010
sudo docker-compose run -e PYTHON_VERSION=${PYTHON_VERSION} manylinux2010

where PYTHON_VERSION is one of {27, 35, 36, 37}.

A wheel will be produced under dist/.

4. Install the pip package

pip install dist/*.whl

Build from source

1. Prerequisites

Install NumPy

If NumPy is not installed on your system, install it now by following these directions.

Install Bazel

If Bazel is not installed on your system, install it now by following these directions.

Install PyArrow

tfx_bsl needs to be built with specific PyArrow versions ( as indicated in third_party/pyarrow.version). Install pyarrow by following these directions.

When installing please make sure to specify the compatible pyarrow version. For example:

pip install "pyarrow>=0.14.0,<0.15.0"

2. Clone the tfx_bsl repository

git clone https://github.com/tensorflow/tfx-bsl
cd tfx-bsl

Note that these instructions will install the latest master branch of tfx_bsl If you want to install a specific branch (such as a release branch), pass -b <branchname> to the git clone command.

When building on Python 2, make sure to strip the Python types in the source code using the following commands:

pip install strip-hints
python tfx_bsl/tools/strip_type_hints.py tfx_bsl/

3. Build the pip package

TFDV uses Bazel to build the pip package from source. Before invoking the following commands, make sure the python in your $PATH is the one of the target version and has NumPy and PyArrow installed.

./configure.sh
bazel run -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 tfx_bsl:build_pip_package

The flag D_GLIBCXX_USE_CXX11_ABI=0 is to use an older std::string ABI. Which is used by all manylinux2010 compliant wheels (including PyArrow). If you also build PyArrow from source without that flag, you may not need to specify it here.

You can find the generated .whl file in the dist subdirectory.

4. Install the pip package

pip install dist/*.whl

Supported platforms

tfx_bsl is tested on the following 64-bit operating systems:

  • macOS 10.12.6 (Sierra) or later.
  • Ubuntu 16.04 or later.
  • Windows 7 or later.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for google_opensource from gravatar.com google_opensource Avatar for tfx_oss from gravatar.com tfx_oss Avatar for zhitaoli.google from gravatar.com zhitaoli.google Avatar for zhuo_at_goog from gravatar.com zhuo_at_goog

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache 2.0)
  • Author: Google LLC
  • Tags tfx, bsl
  • Requires: Python >=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*, <4
Classifiers

Release history Release notifications | RSS feed

1.16.1

1.16.0

1.15.1

1.15.0

1.14.0

1.13.0

1.12.0

1.11.0

1.10.1

1.10.0

1.9.0

1.8.0

1.7.0

1.6.0

1.5.0

1.4.0

1.3.1 yanked

Reason this release was yanked:

google-cloud-bigquery 2.26 release fixed the issue that this patch was trying to solve

1.3.0

1.2.0

1.1.1

1.1.0

1.0.0

0.30.0

0.29.0

0.28.1

0.28.0

0.27.1

0.27.0

0.26.1

0.26.0

0.25.0

0.24.1

0.24.0

0.23.0

0.22.1

0.22.0

This version

0.21.4

0.21.3

0.21.2

0.21.1

0.21.0

0.15.3

0.15.2

0.15.1

0.15.0

0.15.0.dev0 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

tfx_bsl-0.21.4-cp37-cp37m-win_amd64.whl (1.3 MB view hashes)

Uploaded CPython 3.7m Windows x86-64

tfx_bsl-0.21.4-cp37-cp37m-manylinux2010_x86_64.whl (1.9 MB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.4-cp37-cp37m-macosx_10_9_x86_64.whl (2.2 MB view hashes)

Uploaded CPython 3.7m macOS 10.9+ x86-64

tfx_bsl-0.21.4-cp36-cp36m-win_amd64.whl (1.3 MB view hashes)

Uploaded CPython 3.6m Windows x86-64

tfx_bsl-0.21.4-cp36-cp36m-manylinux2010_x86_64.whl (1.9 MB view hashes)

Uploaded CPython 3.6m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.4-cp36-cp36m-macosx_10_9_x86_64.whl (2.2 MB view hashes)

Uploaded CPython 3.6m macOS 10.9+ x86-64

tfx_bsl-0.21.4-cp35-cp35m-win_amd64.whl (1.3 MB view hashes)

Uploaded CPython 3.5m Windows x86-64

tfx_bsl-0.21.4-cp35-cp35m-manylinux2010_x86_64.whl (1.9 MB view hashes)

Uploaded CPython 3.5m manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.4-cp35-cp35m-macosx_10_6_intel.whl (2.2 MB view hashes)

Uploaded CPython 3.5m macOS 10.6+ intel

tfx_bsl-0.21.4-cp27-cp27mu-manylinux2010_x86_64.whl (1.9 MB view hashes)

Uploaded CPython 2.7mu manylinux: glibc 2.12+ x86-64

tfx_bsl-0.21.4-cp27-cp27m-macosx_10_9_x86_64.whl (2.2 MB view hashes)

Uploaded CPython 2.7m macOS 10.9+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page