Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z.
This will trigger our automated release pipeline.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.5.7.tar.gz
(4.3 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.5.7-cp37-abi3-win_amd64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 071a547ea941e7d3bac860db67d3a780ce99eb4bf59255e34398fda60b1fead0 |
|
| MD5 | d8045fa78d3ad300555154e2e7713b8f |
|
| BLAKE2b-256 | 1574f00da5c3b8cec75229397056624bdfd01dee3469265a8016061655eb94fd |
Close
Hashes for deltalake-0.5.7-cp37-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 331a604adb32fc6bf8a574a8196dac989f2cf8ba2d3bdef99f61857d6b08a424 |
|
| MD5 | ddc771ff2f78747fa0e8d0ef8a7c826e |
|
| BLAKE2b-256 | 10ca794005d5d5088120142f31a86d77b7c622444e6f8c9316dba1ac59866361 |
Close
Hashes for deltalake-0.5.7-cp37-abi3-macosx_11_0_arm64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 382893d985dcff32c3bcdf6c762372f4d2b5cd006913d5d8fa523d47def54746 |
|
| MD5 | c887134b8b2985668db5228d8473b00f |
|
| BLAKE2b-256 | 959ddf74e4351a406014cb5876148693823714e8beacae53b0d8902d470c3505 |
Close
Hashes for deltalake-0.5.7-cp37-abi3-macosx_10_7_x86_64.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 403ff6ab362c5bb3c525c506baa0136af1a9b69c99b52c22adf0987700730b76 |
|
| MD5 | adab1ecef43a9a45b9ba722222e79bfe |
|
| BLAKE2b-256 | 52204a569600565eb8fcb38f39f49a604b478310c8bb27e987911941dbc352d0 |
