Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package. Install delta-rs in the current virtualenv
$ make develop
Then, list all the available tasks
$ make help
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
PyPI release
Publish a new GitHub release with name and tag version set to python-vx.y.z
.
This will trigger our automated release pipeline.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.7.0.tar.gz
(4.4 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.7.0-cp37-abi3-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a6bc4aef5dc32b215e89f0283d29c1a44bda2276b5579eae8274260017632180 |
|
MD5 | 5ef0d7ddec3b70c6de144aa847716f24 |
|
BLAKE2b-256 | d0fb28aac6d2029096ed286d2700466ddfab8bde1bbb4899635ae770993a1be2 |
Close
Hashes for deltalake-0.7.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2589708696175323d8082f2b7e83484271433fa88ba80cc56f57510dc9b7ce4e |
|
MD5 | 730de6726897167d315a852b1332ddd2 |
|
BLAKE2b-256 | e8220bea131d41b73c2e8a0876d94d644537732bda216cecff759ca29e7ea724 |
Close
Hashes for deltalake-0.7.0-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5bbcf1ee1823aefe4587ecd5d8e9096cb66c2debd9604d2d4590669d52d09999 |
|
MD5 | 56cada1ddc261b628315eff2e0396270 |
|
BLAKE2b-256 | 3667d95023b9c9619185464f1ea586fb14cd8595f37027f0d693b872d3ab79c8 |
Close
Hashes for deltalake-0.7.0-cp37-abi3-macosx_11_0_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 95c79d87df73b4097a04d46e9a209e981b8a7c4cb7f3500eecb7ac54207102d7 |
|
MD5 | 8c4374e189e4cb02eb6c94154e6de4d3 |
|
BLAKE2b-256 | b944619c057c9486cb759efeb7b502c0500d62886fc395e98dbf4d074868f0a1 |
Close
Hashes for deltalake-0.7.0-cp37-abi3-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ae081446cf941a23c231b916447054f4319410c72d4e53184d2a7eceba22673e |
|
MD5 | 5637b0946fb0d332622643772c0d6cbf |
|
BLAKE2b-256 | 08737c7bfd61edd96e7ba6136bb1d9bd96108237ab2b4e67bd84836cb384451d |
Close
Hashes for deltalake-0.7.0-cp37-abi3-macosx_10_7_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b267ef2dbcd7becce38fd83557e93d945c2180a2a862c5c76c1c5d0941d65403 |
|
MD5 | 984bb9a18c0025419b1bd7161772be6e |
|
BLAKE2b-256 | ce11e26796cb8d21d32555f3309d94158c4cb964f869b3abaf3be602553654c1 |