Skip to main content

Download data from URLs quickly, with integrity

Project description

getm: Fast reads with integrity for data URLs

getm provides transparently chunked, buffered, io streams for cloud storage signed URLs.

IO opperations are concurrent by default. The number of concurrent threads can be adjusted using the threads parameter, or disabled entirely with threads=None.

import getm

# Readable stream:
with getm.urlopen(url) as fh:
    fh.read(size)

# Process blob in chunks:
for chunk in getm.iter_content(url):
    my_chunk_processor(chunk)

Installation

pip install getm

Links

Project home page GitHub
Package distribution PyPI

Bugs

Please report bugs, issues, feature requests, etc. on GitHub.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

getm-0.0.0.tar.gz (17.3 kB view details)

Uploaded Source

File details

Details for the file getm-0.0.0.tar.gz.

File metadata

  • Download URL: getm-0.0.0.tar.gz
  • Upload date:
  • Size: 17.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.7.10

File hashes

Hashes for getm-0.0.0.tar.gz
Algorithm Hash digest
SHA256 36e20d415375f6ea6f107a4dc5a03b79432d78cf5f1dd3152a145ec8a34ed86d
MD5 8191a1314d00c0b2bb4ae30080812b29
BLAKE2b-256 f749210b788e18acba03ff4fb0116068aef0ca044f70b9b2a93e4da0703e5a09

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page