Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z
.
This will trigger our automated release pipeline.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.5.5.tar.gz
(4.2 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.5.5-cp36-abi3-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bf55e29c082b8e2061db0172614d6d83eec47d4e52d59e51202c757102bd6929 |
|
MD5 | 5c09e8ccdff0a2ff8575974b81b1ef15 |
|
BLAKE2b-256 | eba52bbf1a4d816c64d5ff0a84c2e4f98368cbc35eb92f9a76996cfcba0142d7 |
Close
Hashes for deltalake-0.5.5-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1d393aac49116e5fac54a95a3a1c5d5362c8ec2e3f8be6d6dcdd7b7ee7f0b2b6 |
|
MD5 | 6ce1dde0d9ec2c05af44e616cdc81f70 |
|
BLAKE2b-256 | 61e598dbcc35420323a4165af0943cf1e714101ac7b53945e819f17eb5bace62 |
Close
Hashes for deltalake-0.5.5-cp36-abi3-macosx_10_7_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d73a7cd69fb76e436c47297461371c38b3b71a848f49578add5a9afd3a605ca9 |
|
MD5 | ccf3417b24a6023dcbd24e3228d09675 |
|
BLAKE2b-256 | 1cb8c65464c15c8b50405ef74eb07f7d3441f38f7b01e44c77b23ba839471ee6 |