Python APIs for using Delta Lake with Apache Spark

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for allisonportis from gravatar.com allisonportis Avatar for deltalake from gravatar.com deltalake Avatar for dennyglee from gravatar.com dennyglee Avatar for scottsandre-db from gravatar.com scottsandre-db Avatar for tathagata.das1565 from gravatar.com tathagata.das1565 Avatar for vkorukanti from gravatar.com vkorukanti

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Project description

Delta Lake

Delta Lake is an open source storage layer that brings reliability to data lakes. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. Delta Lake runs on top of your existing data lake and is fully compatible with Apache Spark APIs.

This PyPi package contains the Python APIs for using Delta Lake with Apache Spark.

Installation and usage

  1. Install using pip install delta-spark
  2. To use the Delta Lake with Apache Spark, you have to set additional configurations when creating the SparkSession. See the online project web page for details.

Documentation

This README file only contains basic information related to pip installed Delta Lake. You can find the full documentation on the project web page

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for allisonportis from gravatar.com allisonportis Avatar for deltalake from gravatar.com deltalake Avatar for dennyglee from gravatar.com dennyglee Avatar for scottsandre-db from gravatar.com scottsandre-db Avatar for tathagata.das1565 from gravatar.com tathagata.das1565 Avatar for vkorukanti from gravatar.com vkorukanti

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Release history Release notifications | RSS feed

4.0.0rc1 pre-release

3.2.1

3.2.0

3.1.0

3.0.0

3.0.0rc1 pre-release

2.4.0

2.3.0

2.2.0

2.1.1

2.1.0

2.0.2

2.0.1

2.0.0

2.0.0rc1 pre-release

1.2.1

1.2.0

1.1.0

This version

1.0.1

1.0.0

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

delta-spark-1.0.1.tar.gz (13.9 kB view details)

Uploaded Source

Built Distribution

delta_spark-1.0.1-py3-none-any.whl (17.4 kB view details)

Uploaded Python 3

File details

Details for the file delta-spark-1.0.1.tar.gz.

File metadata

  • Download URL: delta-spark-1.0.1.tar.gz
  • Upload date:
  • Size: 13.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.8.2 requests/2.25.1 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.5.10

File hashes

Hashes for delta-spark-1.0.1.tar.gz
Algorithm Hash digest
SHA256 f4bc1ff7d59117d9b1314d1311cf15a5bd15202918458397d553a60494bbc514
MD5 4906cfc03318b581a9eb4dd494ddb3ff
BLAKE2b-256 84e810866766c26650064fe6f8e1920ff0410f82856703c1e428b3df725b2098

See more details on using hashes here.

File details

Details for the file delta_spark-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: delta_spark-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 17.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.8.2 requests/2.25.1 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.5.10

File hashes

Hashes for delta_spark-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 31cee84068403cfc386459dc92bab81b186c7b361862c821dce24c429699cf99
MD5 513b9ae791dfdd69a58b3a34f7178f03
BLAKE2b-256 3893fb4b1d5e92a35cf5dabf6c2961d6c6c5929f66d4531e2ca1b0eee0fb8628

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page