Skip to main content

Python APIs for using Delta Lake with Apache Spark

Project description

Delta Lake

Delta Lake is an open source storage layer that brings reliability to data lakes. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. Delta Lake runs on top of your existing data lake and is fully compatible with Apache Spark APIs.

This PyPi package contains the Python APIs for using Delta Lake with Apache Spark.

Installation and usage

  1. Install using pip install delta-spark
  2. To use the Delta Lake with Apache Spark, you have to set additional configurations when creating the SparkSession. See the online project web page for details.

Documentation

This README file only contains basic information related to pip installed Delta Lake. You can find the full documentation on the project web page

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

delta-spark-3.0.0.tar.gz (22.0 kB view details)

Uploaded Source

Built Distribution

delta_spark-3.0.0-py3-none-any.whl (21.0 kB view details)

Uploaded Python 3

File details

Details for the file delta-spark-3.0.0.tar.gz.

File metadata

  • Download URL: delta-spark-3.0.0.tar.gz
  • Upload date:
  • Size: 22.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.9.6 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/1.0.0 urllib3/1.26.17 tqdm/4.64.1 importlib-metadata/4.8.3 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.5 CPython/3.6.9

File hashes

Hashes for delta-spark-3.0.0.tar.gz
Algorithm Hash digest
SHA256 95109ed364b4c68e3f6c628c77eb5e37c02e29e23bb771ddd8b31f66aae0d555
MD5 912334a6ab1eb610fd97cbda60a1dfc7
BLAKE2b-256 43751cbb4e6fa21e4a5713d01d92b4573edd1662e6d68b36a0d01e6a7bcac1a4

See more details on using hashes here.

File details

Details for the file delta_spark-3.0.0-py3-none-any.whl.

File metadata

  • Download URL: delta_spark-3.0.0-py3-none-any.whl
  • Upload date:
  • Size: 21.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.9.6 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/1.0.0 urllib3/1.26.17 tqdm/4.64.1 importlib-metadata/4.8.3 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.5 CPython/3.6.9

File hashes

Hashes for delta_spark-3.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 98fd66445c1de0e5c276b7bf7fbec73c46c378cf9440a2984f5d208b09b4ffc5
MD5 764f3e55f0b9e87b176e786ff9d0d05b
BLAKE2b-256 b21b7b7e4fafc7af2c04fee0c3b51a148104365d2f2eb3aff0bc22a7ccc068be

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page