Read GCS and local paths with the same interface, clone of tensorflow.io.gfile
Project description
blobfile
This is a standalone clone of TensorFlow's gfile, supporting both local paths and gs:// paths.
Writing to a remote path will not actually perform the write incrementally, so don't write to a log file this way. By default reads and writes are streamed, set streaming=False to BlobFile to do a single copy operation per file instead.
The main function is BlobFile, a replacement for GFile. There are also a few additional functions, basename, dirname, and join, which mostly do the same thing as their os.path namesakes, only they also support gs:// paths. There are also a few extra functions:
cache_key- returns a cache key that can be used for the path (this is not guaranteed to change when the content changes, but should hopefully do that)get_url- returns a url for a pathmd5- get the md5 hash for a path, for GCS this is fast, but for other backends this may be slow
A number of existing gfile functions are currently not implemented.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
File details
Details for the file blobfile-0.2.2-py3-none-any.whl.
File metadata
- Download URL: blobfile-0.2.2-py3-none-any.whl
- Upload date:
- Size: 11.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.7.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3d929689b862885802c0c186f012f47d989fa2d67135828f6ce2734958aa929b |
|
| MD5 | 0c5c85e05a75919397122a62a158e34c |
|
| BLAKE2b-256 | 8521e7f7248d0bfdff620c93e1c4e3f1d86bc1be407652851b12ebb58755d890 |
