Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z.
This will trigger our automated release pipeline.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.5.8.tar.gz
(4.3 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.5.8-cp37-abi3-win_amd64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | ef36fd94162a9ed234c3ae8487479fa58994729c038a8ee6599d1bd6d91628fa |
|
| MD5 | df47d017a604e26acdc37a0de1e77e8b |
|
| BLAKE2b-256 | 161688a6afe2bef45f5286ea0c1cfef6f719b1000ebfc8e73a6a3b8ecb924d2e |
Close
Hashes for deltalake-0.5.8-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5f93bea8c7a25c343b9783ba09230a1205145463ab4c546a69469b3da7b97592 |
|
| MD5 | b832a58d8b77ea54edf4b597a5540f40 |
|
| BLAKE2b-256 | 6fb36f1a77eb6b4b76e8e0bb23f172ffdbe1f6719ede4ba1181176cdaad72503 |
Close
Hashes for deltalake-0.5.8-cp37-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 25da93fc520e60b3b5e97469ddd532da9ee0c1c00938b8df826eebd794559636 |
|
| MD5 | 5a84653719b5e15155bf2d4b499c7929 |
|
| BLAKE2b-256 | 7af31b937ea1a3d0c4305f988c1c46bac5abbe788f59b31896c20349af7a6d91 |
Close
Hashes for deltalake-0.5.8-cp37-abi3-macosx_11_0_arm64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | d516c53b3a1acc6b3a39009394ae5f75abafd5a1045a1f6cf8f24e165210581e |
|
| MD5 | 04b97cf99785618f3af5f20bab50fe6f |
|
| BLAKE2b-256 | 328e31bbdd7812580cdfaa0756afa0735360a9d88465706bbdf99943a87cece2 |
Close
Hashes for deltalake-0.5.8-cp37-abi3-macosx_10_7_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | a9bfdcf252cc697e7ca6cb16be270b2fe7aed7689eefd49b187e813ce6c3f39b |
|
| MD5 | bb6595e74e8515c0636a10b592c5972a |
|
| BLAKE2b-256 | c9cb3bb152a5a72fff8ba668be8db2672e609e08508b87c40df5974747fc48f7 |
