Download data from URLs quickly, with integrity
Project description
getm: Fast reads with integrity for data URLs
getm provides transparently chunked, buffered, io streams for cloud storage signed URLs.
IO opperations are concurrent by default. The number of concurrent threads can be adjusted using the threads
parameter, or disabled entirely with threads=None
.
import getm
# Readable stream:
with getm.urlopen(url) as fh:
fh.read(size)
# Process blob in chunks:
for chunk in getm.iter_content(url):
my_chunk_processor(chunk)
Installation
pip install getm
Links
Project home page GitHub
Package distribution PyPI
Bugs
Please report bugs, issues, feature requests, etc. on GitHub.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
getm-0.0.0.tar.gz
(17.3 kB
view details)
File details
Details for the file getm-0.0.0.tar.gz
.
File metadata
- Download URL: getm-0.0.0.tar.gz
- Upload date:
- Size: 17.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 36e20d415375f6ea6f107a4dc5a03b79432d78cf5f1dd3152a145ec8a34ed86d |
|
MD5 | 8191a1314d00c0b2bb4ae30080812b29 |
|
BLAKE2b-256 | f749210b788e18acba03ff4fb0116068aef0ca044f70b9b2a93e4da0703e5a09 |