Python binding for delta-rs

These details have been verified by PyPI

Maintainers

dave2008 fvaleye ion-elgreco wjones127

Project description

Deltalake-python

Native Delta Lake binding for Python based on delta-rs.

Installation

pip install deltalake

NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.

Usage

Resolve partitions for current version of the DeltaTable:

>>> from deltalake import DeltaTable
>>> dt = DeltaTable("../rust/tests/data/delta-0.2.0")
>>> dt.version()
3
>>> dt.files()
['part-00000-cb6b150b-30b8-4662-ad28-ff32ddab96d2-c000.snappy.parquet', 'part-00000-7c2deba3-1994-4fb8-bc07-d46c948aa415-c000.snappy.parquet', 'part-00001-c373a5bd-85f0-4758-815e-7eb62007a15c-c000.snappy.parquet']

Convert DeltaTable into PyArrow Table and Pandas Dataframe:

>>> from deltalake import DeltaTable
>>> dt = DeltaTable("../rust/tests/data/simple_table")
>>> df = dt.to_pyarrow_table().to_pandas()
>>> df
   id
0   5
1   7
2   9
>>> df[df['id'] > 5]
   id
1   7
2   9

Time travel:

>>> from deltalake import DeltaTable
>>> dt = DeltaTable("../rust/tests/data/simple_table")
>>> dt.load_version(2)
>>> dt.to_pyarrow_table().to_pandas()
   id
0   5
1   7
2   9
3   5
4   6
5   7
6   8
7   9

Develop

maturin is used to build the python package.

To install development version of the package into your current Python environment:

$ maturin develop

Build manylinux wheels

docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist

Project details

These details have been verified by PyPI

Maintainers

dave2008 fvaleye ion-elgreco wjones127

Release history Release notifications | RSS feed

0.21.0

Oct 30, 2024

0.20.2

Oct 8, 2024

0.20.1

Sep 27, 2024

0.20.0

Sep 18, 2024

0.19.2

Sep 5, 2024

0.19.1

Aug 19, 2024

0.19.0

Aug 14, 2024

0.18.2

Jul 3, 2024

0.18.1

Jun 12, 2024

0.18.0

Jun 6, 2024

0.17.4

May 11, 2024

0.17.3

May 2, 2024

0.17.2

Apr 25, 2024

0.17.1

Apr 23, 2024

0.17.0

Apr 22, 2024

0.16.4

Apr 1, 2024

0.16.3

Mar 25, 2024

0.16.2

Mar 21, 2024

0.16.1

Mar 18, 2024

0.16.0

Mar 6, 2024

0.15.3

Feb 6, 2024

0.15.2

Feb 5, 2024

0.15.1

Jan 7, 2024

0.15.0

Jan 2, 2024

0.14.0

Dec 5, 2023

0.13.0

Nov 6, 2023

0.12.0

Oct 18, 2023

0.11.0

Sep 26, 2023

0.10.2

Sep 11, 2023

0.10.1

Jul 27, 2023

0.10.0

Jun 9, 2023

0.9.0

May 6, 2023

0.8.1

Mar 13, 2023

0.8.0

Mar 12, 2023

0.7.0

Jan 26, 2023

0.6.4

Nov 28, 2022

0.6.3

Nov 9, 2022

0.6.2

Oct 11, 2022

0.6.1

Sep 6, 2022

0.6.0

Aug 31, 2022

0.5.8

Jun 23, 2022

0.5.7

Apr 20, 2022

0.5.6

Feb 6, 2022

0.5.5

Jan 24, 2022

0.5.4

Nov 17, 2021

0.5.3

Sep 21, 2021

0.5.2

Aug 9, 2021

0.5.1

Jul 20, 2021

0.5.0

Jun 2, 2021

0.4.8

May 10, 2021

0.4.7

Apr 28, 2021

0.4.6

Apr 15, 2021

0.4.5

Apr 5, 2021

0.4.4

Mar 23, 2021

0.4.3 yanked

Mar 21, 2021

Reason this release was yanked:

broken linux build

0.4.2 yanked

Mar 19, 2021

Reason this release was yanked:

broken linux build

0.4.1

Mar 17, 2021

0.4.0

Mar 10, 2021

0.3.0

Mar 2, 2021

0.2.1

Jan 18, 2021

0.2.0

Jan 15, 2021

This version

0.1.4

Jan 11, 2021

0.1.3

Jan 5, 2021

0.1.2

Jan 5, 2021

0.1.1

Dec 28, 2020

0.1.0

Nov 1, 2020

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

deltalake-0.1.4-cp39-none-win_amd64.whl (4.7 MB view details)

Uploaded Jan 11, 2021 CPython 3.9 Windows x86-64

deltalake-0.1.4-cp39-cp39-manylinux2010_x86_64.whl (6.4 MB view details)

Uploaded Jan 11, 2021 CPython 3.9 manylinux: glibc 2.12+ x86-64

deltalake-0.1.4-cp39-cp39-macosx_10_7_x86_64.whl (4.8 MB view details)

Uploaded Jan 11, 2021 CPython 3.9 macOS 10.7+ x86-64

deltalake-0.1.4-cp38-none-win_amd64.whl (4.7 MB view details)

Uploaded Jan 11, 2021 CPython 3.8 Windows x86-64

deltalake-0.1.4-cp38-cp38-manylinux2010_x86_64.whl (6.4 MB view details)

Uploaded Jan 11, 2021 CPython 3.8 manylinux: glibc 2.12+ x86-64

deltalake-0.1.4-cp38-cp38-macosx_10_7_x86_64.whl (4.8 MB view details)

Uploaded Jan 11, 2021 CPython 3.8 macOS 10.7+ x86-64

deltalake-0.1.4-cp37-none-win_amd64.whl (4.7 MB view details)

Uploaded Jan 11, 2021 CPython 3.7 Windows x86-64

deltalake-0.1.4-cp37-cp37m-manylinux2010_x86_64.whl (6.4 MB view details)

Uploaded Jan 11, 2021 CPython 3.7m manylinux: glibc 2.12+ x86-64

deltalake-0.1.4-cp37-cp37m-macosx_10_7_x86_64.whl (4.8 MB view details)

Uploaded Jan 11, 2021 CPython 3.7m macOS 10.7+ x86-64

deltalake-0.1.4-cp36-none-win_amd64.whl (4.7 MB view details)

Uploaded Jan 11, 2021 CPython 3.6 Windows x86-64

deltalake-0.1.4-cp36-cp36m-manylinux2010_x86_64.whl (6.4 MB view details)

Uploaded Jan 11, 2021 CPython 3.6m manylinux: glibc 2.12+ x86-64

deltalake-0.1.4-cp36-cp36m-macosx_10_7_x86_64.whl (4.8 MB view details)

Uploaded Jan 11, 2021 CPython 3.6m macOS 10.7+ x86-64

File details

Details for the file deltalake-0.1.4-cp39-none-win_amd64.whl.

File metadata

Download URL: deltalake-0.1.4-cp39-none-win_amd64.whl
Upload date: Jan 11, 2021
Size: 4.7 MB
Tags: CPython 3.9, Windows x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp39-none-win_amd64.whl
Algorithm	Hash digest
SHA256	`0b8ab6375918535c75935317605cdf9a991e9ac3f1613372108a6224f2f73efc`
MD5	`110bd803581a3ec0fbf3ed2bc2769be9`
BLAKE2b-256	`0aecb04352d37373f3528ca347b2bb1d0d1049dfb78ccf17d3053c86778c490d`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp39-cp39-manylinux2010_x86_64.whl.

File metadata

Download URL: deltalake-0.1.4-cp39-cp39-manylinux2010_x86_64.whl
Upload date: Jan 11, 2021
Size: 6.4 MB
Tags: CPython 3.9, manylinux: glibc 2.12+ x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp39-cp39-manylinux2010_x86_64.whl
Algorithm	Hash digest
SHA256	`273153c8069ceabc1cae38311dc56927a1f56f3d986adda354c4225d0d10ada3`
MD5	`48ec0f6b0679decdd2ee6ea0a8218e39`
BLAKE2b-256	`639599389aa1d59c885215c35d4329d68760db89e7abfa948937fc47a39a2580`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp39-cp39-macosx_10_7_x86_64.whl.

File metadata

Download URL: deltalake-0.1.4-cp39-cp39-macosx_10_7_x86_64.whl
Upload date: Jan 11, 2021
Size: 4.8 MB
Tags: CPython 3.9, macOS 10.7+ x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp39-cp39-macosx_10_7_x86_64.whl
Algorithm	Hash digest
SHA256	`5c5c3949b6185979eb44ae19ee66b259498bb2dbd5271c1db8bff4ef9d7828de`
MD5	`38fb51de6a96f4ef63b0276eb835e6a2`
BLAKE2b-256	`543940c391fc4865b499a194dc7079f2ef3365cfe3d66a04d50e71030fd83cd0`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp38-none-win_amd64.whl.

File metadata

Download URL: deltalake-0.1.4-cp38-none-win_amd64.whl
Upload date: Jan 11, 2021
Size: 4.7 MB
Tags: CPython 3.8, Windows x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp38-none-win_amd64.whl
Algorithm	Hash digest
SHA256	`6c505faf63e21d168243d4cb398209168a3b369d463805eb6d876729d670cb54`
MD5	`90bcea7dc5d502a902fe4c6179f15520`
BLAKE2b-256	`da53f872de0beaad18f04457178428c7b66f1bd9d9fcb19664b211d6a23fa383`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp38-cp38-manylinux2010_x86_64.whl.

File metadata

Download URL: deltalake-0.1.4-cp38-cp38-manylinux2010_x86_64.whl
Upload date: Jan 11, 2021
Size: 6.4 MB
Tags: CPython 3.8, manylinux: glibc 2.12+ x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp38-cp38-manylinux2010_x86_64.whl
Algorithm	Hash digest
SHA256	`7c8ae30c7643bb77b5ecd95bdfa0d6542e5b7cd7896d1bba684653eb9297b946`
MD5	`19d8d5d71c9c75ecea6b9c40d52c76a1`
BLAKE2b-256	`8692f47f36db21c7b656d726eb715c2fe9d4dcc2fe95c26fe0465b0d77afebb2`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp38-cp38-macosx_10_7_x86_64.whl.

File metadata

Download URL: deltalake-0.1.4-cp38-cp38-macosx_10_7_x86_64.whl
Upload date: Jan 11, 2021
Size: 4.8 MB
Tags: CPython 3.8, macOS 10.7+ x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp38-cp38-macosx_10_7_x86_64.whl
Algorithm	Hash digest
SHA256	`a789569d48bf8db520d8616b1416580b9ccd43dbe8c354b1faab9dca68e7a48b`
MD5	`572c4ec073c2948892c9d3f47ee16d5a`
BLAKE2b-256	`a9d1c2696915db06d026d09cfd0d2426ee19c99a77ad822e556fb174a9a4b6e5`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp37-none-win_amd64.whl.

File metadata

Download URL: deltalake-0.1.4-cp37-none-win_amd64.whl
Upload date: Jan 11, 2021
Size: 4.7 MB
Tags: CPython 3.7, Windows x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp37-none-win_amd64.whl
Algorithm	Hash digest
SHA256	`edb7f89ba1720b9495ba31651a3aa56158c190c0855670fa897d08625343cb84`
MD5	`24e9d59ceb20cd9ee715b8aa788502f3`
BLAKE2b-256	`c6a52e382b2bd819028a975f50d0a2cf29dd9af09bc933620a34adbf0d3354a2`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

Download URL: deltalake-0.1.4-cp37-cp37m-manylinux2010_x86_64.whl
Upload date: Jan 11, 2021
Size: 6.4 MB
Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm	Hash digest
SHA256	`dfcbad32824c283d9076b376710d50e5875c133f03c045f7a750eaac478d131d`
MD5	`daa21096766981caf0a2a59509e02673`
BLAKE2b-256	`dd8e7a2159590e8749edb13e687442e3dc6b6e489204b8f1e6d618671587575c`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp37-cp37m-macosx_10_7_x86_64.whl.

File metadata

Download URL: deltalake-0.1.4-cp37-cp37m-macosx_10_7_x86_64.whl
Upload date: Jan 11, 2021
Size: 4.8 MB
Tags: CPython 3.7m, macOS 10.7+ x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp37-cp37m-macosx_10_7_x86_64.whl
Algorithm	Hash digest
SHA256	`f1bf6b1c9df851b97044283d05ba59e68c059f066fad3cf50ef722f4af56533a`
MD5	`5ec2fc313e27d6e75b44cb9f50112aa6`
BLAKE2b-256	`cc56c9c7033acaed5f95d862d1f3af8cd264b1e69abb8809d6a092a7feb4ce91`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp36-none-win_amd64.whl.

File metadata

Download URL: deltalake-0.1.4-cp36-none-win_amd64.whl
Upload date: Jan 11, 2021
Size: 4.7 MB
Tags: CPython 3.6, Windows x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp36-none-win_amd64.whl
Algorithm	Hash digest
SHA256	`739c7fbd206608e70025a0d8f5a4a1b95e30a68c1de52274e9f25686eacc783f`
MD5	`bbfa641177d1e6d5b885bf875c903415`
BLAKE2b-256	`56353f93f88a5ee59627dd410c2ef44a86aeb2717b770e58565dbf03e79974e2`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp36-cp36m-manylinux2010_x86_64.whl.

File metadata

Download URL: deltalake-0.1.4-cp36-cp36m-manylinux2010_x86_64.whl
Upload date: Jan 11, 2021
Size: 6.4 MB
Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm	Hash digest
SHA256	`5b0aa57e5bc80ee3c5cdde5d18ebcadfd8b19c9dd5571bd704267fc589da04b1`
MD5	`5725d59c84bbbde415e9506cebe26eb0`
BLAKE2b-256	`6b9b3ae11f20c2b5da3b6a391c112ce1ebb35afd4677bbf2af5fc071e286c139`

See more details on using hashes here.

Provenance

File details

Details for the file deltalake-0.1.4-cp36-cp36m-macosx_10_7_x86_64.whl.

File metadata

Download URL: deltalake-0.1.4-cp36-cp36m-macosx_10_7_x86_64.whl
Upload date: Jan 11, 2021
Size: 4.8 MB
Tags: CPython 3.6m, macOS 10.7+ x86-64
Uploaded using Trusted Publishing? No
Uploaded via: maturin/0.9.0

File hashes

Hashes for deltalake-0.1.4-cp36-cp36m-macosx_10_7_x86_64.whl
Algorithm	Hash digest
SHA256	`d41247a2e8227218d677899955662f83c617265865dff1a42a5f40ca39f69af2`
MD5	`7766f0faf0530cb1e841c25328878749`
BLAKE2b-256	`406560ad263a8a928e4b15e773de44c665b97a2d3f230abf144e98c802e7527c`

See more details on using hashes here.

deltalake 0.1.4

Navigation

Verified details

Maintainers

Unverified details

Project links

Meta

Project description

Deltalake-python

Installation

Usage

Develop

Build manylinux wheels

Project details

Verified details

Maintainers

Unverified details

Project links

Meta

Release history Release notifications | RSS feed

Download files

Source Distributions

Built Distributions

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance