Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z.
This will trigger our automated release pipeline.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.6.3.tar.gz
(4.3 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.6.3-cp37-abi3-win_amd64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 88f44bab640f4f43d1485bebd8e84075f9d4cf380c95d799dce7fd905d5b2652 |
|
| MD5 | 4e7d223e30bfa9a311bfc38edadc6045 |
|
| BLAKE2b-256 | e87ad217c141610033dc4eb9d0c4ed9b00358ac952f36d59850ec48841f2eb69 |
Close
Hashes for deltalake-0.6.3-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f32e8eb497f964e4742bb5c045588f930d0d777344d19c63cef7448dff79586e |
|
| MD5 | 02f20a1a96935044bcc7f4deb3b43863 |
|
| BLAKE2b-256 | 3c0733f8ecc7b5e7db4fefb8fb7a1a45cf73fd1d963e0765de78f8e1cd6644a1 |
Close
Hashes for deltalake-0.6.3-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b04551744457b0043878bf636c01eccc93d22983fe0a1fef3a140c1d21e4692e |
|
| MD5 | ea52b47307d628611b7e6be3c4e86e17 |
|
| BLAKE2b-256 | 73a3025a72264d4ef59e16587e438f5814011eaff3d80b2cc886f9755afb4843 |
Close
Hashes for deltalake-0.6.3-cp37-abi3-macosx_11_0_arm64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 73ef984f1b9d1ce911f4c8567940dcfc8cbef359f0d2a58284bb70d151b9eb9f |
|
| MD5 | 00cf10bbdf6ac197fb3e94b7dccd1889 |
|
| BLAKE2b-256 | ef201dfbf568ecd8c888a0332748903de65494c86a7f87bdb17877ae98fd4aca |
Close
Hashes for deltalake-0.6.3-cp37-abi3-macosx_10_7_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 354e2760c2bb98d3d03d5cc42f2fb069644508a4fc88ef7f0335da82f8c185eb |
|
| MD5 | b10a0a1d8c389a6ca508011e2560c4c3 |
|
| BLAKE2b-256 | 1352b428a723b2332d86150cc806ce451ccc98f16b36315d8a9e83a56b4d83ca |
