Provider package apache-airflow-providers-apache-spark for Apache Airflow
Project description
Package apache-airflow-providers-apache-spark
Release: 2.0.0rc1
Provider package
This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.
You can find package information and changelog for the provider in the documentation.
Installation
You can install this package on top of an existing airflow 2.* installation via pip install apache-airflow-providers-apache-spark
PIP requirements
PIP package |
Version required |
---|---|
pyspark |
Changelog
2.0.0
Breaking changes
Auto-apply apply_default decorator (#15667)
Bug fixes
Make SparkSqlHook use Connection (#15794)
1.0.3
Bug fixes
Fix 'logging.exception' redundancy (#14823)
1.0.2
Bug fixes
Use apache.spark provider without kubernetes (#14187)
1.0.1
Updated documentation and readme files.
1.0.0
Initial version of the provider.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for apache-airflow-providers-apache-spark-2.0.0rc1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4eda617d59c2bf5e5c2d03a34aabf1d819133623d6a3ddb024b7b4746107b9b9 |
|
MD5 | a284a9ac0ba777ca9f070f588d3141bc |
|
BLAKE2b-256 | c44bd05f46a5611e16258c7394d76b11bcfc1a2737c04b49244e8f8d74cd11f9 |
Hashes for apache_airflow_providers_apache_spark-2.0.0rc1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1e78d750b375ebb790123fcf47a882e007df69bed75ad5ff1aadf256f3685814 |
|
MD5 | f5e5ce1ea3e9c7b4c60a2b31640738fc |
|
BLAKE2b-256 | 3ad6a839d84ce4447693d6e88e34fb6dbbbd003b9c397cd5c19de36c38c1df18 |