Native Delta Lake Python binding based on delta-rs with Pandas integration
Project description
Deltalake-python
Native Delta Lake Python binding based on delta-rs with Pandas integration.
Installation
pip install deltalake
NOTE: official binary wheels are linked against openssl statically for remote objection store communication. Please file Github issue to request for critical openssl upgrade.
Develop
Setup your local environment with virtualenv
$ make setup-venv
Activate it
$ source ./venv/bin/activate
Ready to develop with maturin
maturin is used to build the python package.
To install development version of the package into your current Python environment:
$ make develop
Build manylinux wheels
docker run -e PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig -it -v `pwd`:/io apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 bash
curl https://sh.rustup.rs -sSf | sh -s -- -y
source $HOME/.cargo/env
rustup default stable
cargo install --git https://github.com/PyO3/maturin.git --rev 98636cea89c328b3eba4ebb548124f75c8018200 maturin
cd /io/python
export PATH=/opt/python/cp37-cp37m/bin:/opt/python/cp38-cp38/bin:$PATH
maturin publish -b pyo3 --target x86_64-unknown-linux-gnu --no-sdist
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deltalake-0.5.1.tar.gz
(4.2 MB
view hashes)
Built Distributions
Close
Hashes for deltalake-0.5.1-cp36-abi3-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 053a225130221fd9c7a80af5898d1b6099ae85f0a2c5ec83dae110a696bc547e |
|
MD5 | 5ce42f05e3d462d870024947326160ff |
|
BLAKE2b-256 | 0480fa4dbf607cf6d40ebc27dd6c62e82461fb8b0192a2baffbbfb7802bb8693 |
Close
Hashes for deltalake-0.5.1-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | add70bdcc446c52d8bb8be8429be577ec606bc38616cc36db7433487fd9651b6 |
|
MD5 | 4ad14d9049ce47d96f679cf142eac0a9 |
|
BLAKE2b-256 | 94b047008c83987924ede23a13546f033cdb9291f119f1bcc5a97cc35f640e10 |
Close
Hashes for deltalake-0.5.1-cp36-abi3-macosx_10_7_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f62fdebd23529cf489a5993466ee9fc318469261b09beff6c16727b85c92e48c |
|
MD5 | 27835b9d3b39ff232000209c65a9e720 |
|
BLAKE2b-256 | 844bab3457be20c1c9f11b6b40eef373d1c8cf6fcc7a287902101181b93a89e7 |