Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z
.
This will trigger our automated release pipeline.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.6.1.tar.gz
(4.3 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.6.1-cp37-abi3-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 85625eef81018dbb89cb3af6ccbf91d6b84d947b5477df4fc97b61c8ac86c192 |
|
MD5 | 7f6930a9acf0116bdb9845ff1a48955b |
|
BLAKE2b-256 | 86855c8549320fcb79da8b6301a2866ab3a446b771cb88a4ae3edbc80866833b |
Close
Hashes for deltalake-0.6.1-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 700f806dfaa97361a0eb06d6796a0bbaaae086dadf0ef1295eefb9cf083e0fe2 |
|
MD5 | dd4f9dd2172df8524d6a2690464b7807 |
|
BLAKE2b-256 | f8467d88fb917e43f95252257c310c10107ee58c2b74b781dbae89d537f7e30c |
Close
Hashes for deltalake-0.6.1-cp37-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 656ae1220a0c7c7b1c4af714bfa66567721b1dc2de32ebaf60e22bd97cbf383a |
|
MD5 | e6c241a4e1e6259a27fa9f047f753298 |
|
BLAKE2b-256 | be22d23103ece650c46222bc935b52986e4d42931016160392261bc27062c163 |
Close
Hashes for deltalake-0.6.1-cp37-abi3-macosx_11_0_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 823488176864b8d86841931c98f1e46223cc33585cce530430df9caefb9c7551 |
|
MD5 | ebc0556e188fea885179c1fcb31f342c |
|
BLAKE2b-256 | 916ccfb0bbad7815d4f0d09f5b60ffaea335c218f8131ea9d17ff7addb07c7ce |