Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z
.
This will trigger our automated release pipeline.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.5.6.tar.gz
(4.2 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.5.6-cp36-abi3-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7f9029a741522d8c8ef58e41d6ecc4541d8fa2f253248793fc24db4fc755739c |
|
MD5 | 1ae653b34cb5435d5ea4f49c7450c3ec |
|
BLAKE2b-256 | e971e70f04f16f58c057c99fa4a4caebc78688f16bff25470fe18aef4413fe21 |
Close
Hashes for deltalake-0.5.6-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | af2753e5c5f5213c77bb0b0cb18865fb69cf68be500bac3839219fe846d935b4 |
|
MD5 | 87a81e10dcc5f3824756036d6cd924de |
|
BLAKE2b-256 | 8aadfe5aab36841f8623a6cb4647d8ffb8e01d14c72e15b20835343b5d1d6a6e |
Close
Hashes for deltalake-0.5.6-cp36-abi3-macosx_11_0_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3128d6df02ea2a82b2227195743f305f3bac66f308848bb58ba10a79b8565d7a |
|
MD5 | 0f89ffe618419aacf1c63d3bc6b3d1ed |
|
BLAKE2b-256 | acb9ef2daddece10a28506e08fdfc9c9e896d108af11fc210ae0edb0fe41f5c6 |
Close
Hashes for deltalake-0.5.6-cp36-abi3-macosx_10_7_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | eb419eac9382fd01390f091215e31c5c3bb4d29e421ffc94a55cd306805b1dfa |
|
MD5 | 3bf94a9609cff6548e2ff98588cda716 |
|
BLAKE2b-256 | 1aad96275d73b2e140bc30fb2efec607e9002638497cda4365b75d31a9aa5652 |