Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z.
This will trigger our automated release pipeline.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.6.0.tar.gz
(4.3 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.6.0-cp37-abi3-win_amd64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1ce2a017164729bc08f3bca6fdd954c48db04052e4ebf11240c493b66f1217e5 |
|
| MD5 | 9cd3f103a71dd7b70bba75fda39baa45 |
|
| BLAKE2b-256 | 2948d3c3e6d4b5e8fc89137f603d99b815dfd0f5e862c975b4eb906c5823d811 |
Close
Hashes for deltalake-0.6.0-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1f8a8ba37265fd87a8654abd39fe1e649e01993ff87fe7849475a3df42e3672f |
|
| MD5 | 0ad6e4438252b9fddcff5bab88f9b1e1 |
|
| BLAKE2b-256 | 051a300b27c73a38307a38debf414a96a4fbe084698a1294be28d86367981b66 |
Close
Hashes for deltalake-0.6.0-cp37-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 8e4aa11b4bb59c4e028be608fb12d49b7f22501d67ec0d8c23ad52ed6028477c |
|
| MD5 | d00d79a3dd01981c80a82b1e1f710124 |
|
| BLAKE2b-256 | a71301833435373093207ece42e18155c4ec6714eeb328dd2bbad5eee22e3551 |
Close
Hashes for deltalake-0.6.0-cp37-abi3-macosx_11_0_arm64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | caf75cd50f00089462029377e193ff451947eeda76043ebdb8eb61f025b66954 |
|
| MD5 | 6989ed1223fd1783fb88beb40e79f4ff |
|
| BLAKE2b-256 | ffd3e5264c64774bf55e3e92c9b7262647449d760ec2d665c7706d2bd9a3b33b |
Close
Hashes for deltalake-0.6.0-cp37-abi3-macosx_10_7_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | bac19e3f16a3ef1dc2a4d028cbc59b475750cf938c2931d22e13548462d48a8b |
|
| MD5 | 05a4c0d7c77069c99e9979b3da43e36e |
|
| BLAKE2b-256 | 27057074e2300a1c142369b910e67393cc72a36db9d4121e3d6b537cd8119e93 |
