Skip to main content

Dask + Delta Table

Project description

Dask Deltatable Reader

Reads a Delta Table from directory using Dask engine.

To Try out the package:

pip install dask-deltatable

Features:

  1. Reads the parquet files based on delta logs parallely using dask engine
  2. Supports all three filesystem like s3, azurefs, gcsfs
  3. Supports some delta features like
    • Time Travel
    • Schema evolution
    • parquet filters
      • row filter
      • partition filter

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dask-deltatable-0.1.tar.gz (6.0 kB view details)

Uploaded Source

Built Distribution

dask_deltatable-0.1-py3-none-any.whl (6.7 kB view details)

Uploaded Python 3

File details

Details for the file dask-deltatable-0.1.tar.gz.

File metadata

  • Download URL: dask-deltatable-0.1.tar.gz
  • Upload date:
  • Size: 6.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.10

File hashes

Hashes for dask-deltatable-0.1.tar.gz
Algorithm Hash digest
SHA256 780895a42481ad245663aca6f556ac2e359f6f27c627aa2a02a4018a2aee35e5
MD5 fc0225e29e35ec7d99886852d4d3b874
BLAKE2b-256 7023c384ee8a3328378cf40d55102f0ed00733d2dc599b3d275436d055d63d5c

See more details on using hashes here.

Provenance

File details

Details for the file dask_deltatable-0.1-py3-none-any.whl.

File metadata

  • Download URL: dask_deltatable-0.1-py3-none-any.whl
  • Upload date:
  • Size: 6.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.10

File hashes

Hashes for dask_deltatable-0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 2e612a58d29cef506cfac45e4247811c42a1641f3b738c3fa236927f3f103f51
MD5 678d0784e3879e298ae5c38051514197
BLAKE2b-256 c65977113b059b0f5f2942dbc2046d8a68969f8a798e38c337a89e926b4b20e8

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page