Back-ported airflow.providers.apache.hive.* package for Airflow 1.10.*
Project description
Package apache-airflow-backport-providers-apache-hive
Release: 2020.6.24
Backport package
This is a backport providers package for apache.hive
provider. All classes for this provider package
are in airflow.providers.apache.hive
python package.
Only Python 3.6+ is supported for this backport package.
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you want to use this backport package.
Installation
You can install this package on top of an existing airflow 1.10.* installation via
pip install apache-airflow-backport-providers-apache-hive
Compatibility
For full compatibility and test status of the backport packages check Airflow Backport Package Compatibility
PIP requirements
PIP package | Version required |
---|---|
hmsclient | >=0.1.0 |
pyhive[hive] | >=0.6.0 |
Cross provider package dependencies
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified backport providers package in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-backport-providers-apache-hive[amazon]
Dependent package | Extra |
---|---|
apache-airflow-backport-providers-amazon | amazon |
apache-airflow-backport-providers-microsoft-mssql | microsoft.mssql |
apache-airflow-backport-providers-mysql | mysql |
apache-airflow-backport-providers-presto | presto |
apache-airflow-backport-providers-samba | samba |
apache-airflow-backport-providers-vertica | vertica |
Provider classes summary
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the apache.hive
provider
are in the airflow.providers.apache.hive
package. You can read more about the naming conventions used
in Naming conventions for provider packages
Operators
Moved operators
Airflow 2.0 operators: airflow.providers.apache.hive package |
Airflow 1.10.* previous location (usually airflow.contrib ) |
---|---|
operators.hive.HiveOperator | operators.hive_operator.HiveOperator |
operators.hive_stats.HiveStatsCollectionOperator | operators.hive_stats_operator.HiveStatsCollectionOperator |
Moved transfer operators
Sensors
Moved sensors
Airflow 2.0 sensors: airflow.providers.apache.hive package |
Airflow 1.10.* previous location (usually airflow.contrib ) |
---|---|
sensors.hive_partition.HivePartitionSensor | sensors.hive_partition_sensor.HivePartitionSensor |
sensors.metastore_partition.MetastorePartitionSensor | sensors.metastore_partition_sensor.MetastorePartitionSensor |
sensors.named_hive_partition.NamedHivePartitionSensor | sensors.named_hive_partition_sensor.NamedHivePartitionSensor |
Hooks
Moved hooks
Airflow 2.0 hooks: airflow.providers.apache.hive package |
Airflow 1.10.* previous location (usually airflow.contrib ) |
---|---|
hooks.hive.HiveCliHook | hooks.hive_hooks.HiveCliHook |
hooks.hive.HiveMetastoreHook | hooks.hive_hooks.HiveMetastoreHook |
hooks.hive.HiveServer2Hook | hooks.hive_hooks.HiveServer2Hook |
Releases
Release 2020.6.24
Commit | Committed | Subject |
---|---|---|
12af6a080 | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
c7e5bce57 | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
f6bd817a3 | 2020-06-16 | Introduce 'transfers' packages (#9320) |
c78e2a5fe | 2020-06-16 | Make hive macros py3 compatible (#8598) |
6350fd6eb | 2020-06-08 | Don't use the term "whitelist" - language matters (#9174) |
10796cb7c | 2020-06-03 | Remove Hive/Hadoop/Java dependency from unit tests (#9029) |
0b0e4f7a4 | 2020-05-26 | Preparing for RC3 relase of backports (#9026) |
00642a46d | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
cdb3f2545 | 2020-05-26 | All classes in backport providers are now importable in Airflow 1.10 (#8991) |
375d1ca22 | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
12c5e5d8a | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
f3521fb0e | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
92585ca4c | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
93ea05880 | 2020-04-21 | [AIRFLOW-7059] pass hive_conf to get_pandas_df in HiveServer2Hook (#8380) |
87969a350 | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
cb0bf4a14 | 2020-03-30 | Remove sql like function in base_hook (#7901) |
4bde99f13 | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
7e6372a68 | 2020-03-23 | Add call to Super call in apache providers (#7820) |
3320e432a | 2020-02-24 | [AIRFLOW-6817] Lazy-load airflow.DAG to keep user-facing API untouched (#7517) |
4d03e33c1 | 2020-02-22 | [AIRFLOW-6817] remove imports from airflow/__init__.py , replaced implicit imports with explicit imports, added entry to UPDATING.MD - squashed/rebased (#7456) |
f3ad5cf61 | 2020-02-03 | [AIRFLOW-4681] Make sensors module pylint compatible (#7309) |
97a429f9d | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
83c037873 | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
057f3ae3a | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
059eda05f | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
0481b9a95 | 2020-01-12 | [AIRFLOW-6539][AIP-21] Move Apache classes to providers.apache package (#7142) |
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for apache-airflow-backport-providers-apache-hive-2020.6.24rc1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | f39845e6d14343e88ed72df97e2efc8c3a71d11d008ed04248c0933a321a7f18 |
|
MD5 | 05c631e8e7cd948a108f785fb0de9c84 |
|
BLAKE2b-256 | 16cddd2b79b0cd94b4d7b0bbe984662858c2c091b262ecd89e29da1c3290ae15 |
Hashes for apache_airflow_backport_providers_apache_hive-2020.6.24rc1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 93cf04f9dd481e26ff93d2cff11bad0d59632ae5596b7d0558d8eff4d7b3f946 |
|
MD5 | fb42d6cf8ef4a46426c52592c67c3143 |
|
BLAKE2b-256 | 58b14f1a6bf1d2c8eaa57128535ae2d27bfa02ad1d4e4fe451891f5fc2d9116e |