Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z.
This will trigger our automated release pipeline.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.6.4.tar.gz
(4.4 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.6.4-cp37-abi3-win_amd64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 200ec6316decf91f39c435d520d6c5183f24af2c990ac9154c415b0909c04e19 |
|
| MD5 | c8dfbee7be0062979b003dd45392ce22 |
|
| BLAKE2b-256 | b13f0d066ce52fa5a5c7aee1c87db90ea11abd0adc8ab6add447e3b5595e4a46 |
Close
Hashes for deltalake-0.6.4-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f54ba14251cc4d2caf23ff36a5e1045250dcd40e5e5d330406ac3c69143fc188 |
|
| MD5 | 80b2dc15f96bf0efbce14eb4c25ed819 |
|
| BLAKE2b-256 | 369a5d6bfbfbbec53a56d7f207bbb3ef32816a4ab4a9de630a209ee0e2b14823 |
Close
Hashes for deltalake-0.6.4-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 688725750097cd1d6351e44b8ebd199e69751ff4992eeb8a0156374794f5f724 |
|
| MD5 | 0916bfa060a7dd0cf0ea83fd9c002ec6 |
|
| BLAKE2b-256 | ef44a418aed475d6d365714d13db809757936507589a4af8c522ade79860997a |
Close
Hashes for deltalake-0.6.4-cp37-abi3-macosx_10_9_arm64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 86c590ceac97016dd2ba9f38ea188d1fafc509c3093777ab261203ecc464fefd |
|
| MD5 | f53b8febf6f9ea320b99d2d370b43d01 |
|
| BLAKE2b-256 | 1613cfaa22eed4ff53cb03839a434d7b9aa75a7c6d12955128ed66602a1bffbe |
Close
Hashes for deltalake-0.6.4-cp37-abi3-macosx_10_7_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9803a4aefc1dd83024c29077725ce0892198db1e3e08b1aa0f7f3c0cadefb274 |
|
| MD5 | 1a877ca6b9801e17ad3abf5e40c3b647 |
|
| BLAKE2b-256 | d52ccd1761e2f291100b09384aaf254e352f5ee312da59b078a33260ec9e95e9 |
