Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z.
This will trigger our automated release pipeline.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.6.2.tar.gz
(4.3 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.6.2-cp37-abi3-win_amd64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fbe27cee5273bcd9dd5aea428c52f48c5ac28532ab8fb6a5f1ad60ddf1dbc415 |
|
| MD5 | a5302ea8cffdd9512cc639722e6e3341 |
|
| BLAKE2b-256 | 7e4aa07ef0f8ab022a01f5953bdb373c3a2710911016b5e5040a7d6833ae4700 |
Close
Hashes for deltalake-0.6.2-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 35af84086634f8d8dff9ec1b5ba9b1719baca05513708dd84571d814e00c17b2 |
|
| MD5 | 48ecdf7746a6a1608f2eaf20e2ce32f4 |
|
| BLAKE2b-256 | ce9a2f492f3437362165082efc30b4f3667777e9d74cf206249c6f4a33d2e3bb |
Close
Hashes for deltalake-0.6.2-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3e515d2ff51d2be62db34289f38f0aef83e969b467320fd7fee432c0cfc5f2d7 |
|
| MD5 | 3a6088c0cdef74dbf97a85b86057235d |
|
| BLAKE2b-256 | 7eca57f5fb492a9a6cb61bd271bd1be1619d558fd3b78c20cbe9628119dacdd7 |
Close
Hashes for deltalake-0.6.2-cp37-abi3-macosx_11_0_arm64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | cca651cff1731be584f34ccd84990e3708c438cf68ba5487dd43b2e5f9c37ac1 |
|
| MD5 | f136c34e794898d01f8f23570162cee8 |
|
| BLAKE2b-256 | 7c03e3bd9a4b996113f9ad14bda9450047e62f0bf5d497786cbbe725ae2750f6 |
Close
Hashes for deltalake-0.6.2-cp37-abi3-macosx_10_7_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 97e6a687bd7b99a297f51f9bd1755e81eaf8b0e02854693acc4ccdc34bc0505d |
|
| MD5 | 3d89875ad8254dc49c5d1273727ece15 |
|
| BLAKE2b-256 | cbc1afe601323aa645b399e6509a4566ce6c22165da88be31e7d3e3c531a018c |
