Backport provider package apache-airflow-backport-providers-google for Apache Airflow
Project description
Package apache-airflow-backport-providers-google
Release: 2020.11.23
Table of contents
- Backport package
- Installation
- PIP requirements
- Cross provider package dependencies
- Provider class summary
- Releases
Backport package
This is a backport providers package for google provider. All classes for this provider package
are in airflow.providers.google python package.
Only Python 3.6+ is supported for this backport package.
While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you want to use this backport package.
Installation
You can install this package on top of an existing airflow 1.10.* installation via
pip install apache-airflow-backport-providers-google
PIP requirements
| PIP package | Version required |
|---|---|
| PyOpenSSL | |
| google-ads | >=4.0.0 |
| google-api-python-client | >=1.6.0,<2.0.0 |
| google-auth | >=1.0.0,<2.0.0 |
| google-auth-httplib2 | >=0.0.1 |
| google-cloud-automl | >=0.4.0,<2.0.0 |
| google-cloud-bigquery-datatransfer | >=0.4.0,<2.0.0 |
| google-cloud-bigtable | >=1.0.0,<2.0.0 |
| google-cloud-container | >=0.1.1,<2.0.0 |
| google-cloud-datacatalog | >=0.5.0, <0.8 |
| google-cloud-dataproc | >=1.0.1,<2.0.0 |
| google-cloud-dlp | >=0.11.0,<2.0.0 |
| google-cloud-kms | >=1.2.1,<2.0.0 |
| google-cloud-language | >=1.1.1,<2.0.0 |
| google-cloud-logging | >=1.14.0,<2.0.0 |
| google-cloud-memcache | >=0.2.0 |
| google-cloud-monitoring | >=0.34.0,<2.0.0 |
| google-cloud-os-login | >=1.0.0,<2.0.0 |
| google-cloud-pubsub | >=1.0.0,<2.0.0 |
| google-cloud-redis | >=0.3.0,<2.0.0 |
| google-cloud-secret-manager | >=0.2.0,<2.0.0 |
| google-cloud-spanner | >=1.10.0,<2.0.0 |
| google-cloud-speech | >=0.36.3,<2.0.0 |
| google-cloud-storage | >=1.16,<2.0.0 |
| google-cloud-tasks | >=1.2.1,<2.0.0 |
| google-cloud-texttospeech | >=0.4.0,<2.0.0 |
| google-cloud-translate | >=1.5.0,<2.0.0 |
| google-cloud-videointelligence | >=1.7.0,<2.0.0 |
| google-cloud-vision | >=0.35.2,<2.0.0 |
| grpcio-gcp | >=0.2.2 |
| pandas-gbq |
Cross provider package dependencies
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified backport providers package in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-backport-providers-google[amazon]
| Dependent package | Extra |
|---|---|
| apache-airflow-backport-providers-amazon | amazon |
| apache-airflow-backport-providers-apache-cassandra | apache.cassandra |
| apache-airflow-backport-providers-cncf-kubernetes | cncf.kubernetes |
| apache-airflow-backport-providers-facebook | |
| apache-airflow-backport-providers-microsoft-azure | microsoft.azure |
| apache-airflow-backport-providers-microsoft-mssql | microsoft.mssql |
| apache-airflow-backport-providers-mysql | mysql |
| apache-airflow-backport-providers-postgres | postgres |
| apache-airflow-backport-providers-presto | presto |
| apache-airflow-backport-providers-salesforce | salesforce |
| apache-airflow-backport-providers-sftp | sftp |
| apache-airflow-backport-providers-ssh | ssh |
Provider classes summary
In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the google provider
are in the airflow.providers.google package. You can read more about the naming conventions used
in Naming conventions for provider packages
Operators
New operators
Moved operators
Transfer operators
New transfer operators
Moved transfer operators
Sensors
New sensors
Moved sensors
Hooks
New hooks
Moved hooks
Secrets
Moved secrets
Airflow 2.0 secrets: airflow.providers.google package |
Airflow 1.10.* previous location (usually airflow.contrib) |
|---|---|
| cloud.secrets.secret_manager.CloudSecretManagerBackend | contrib.secrets.gcp_secrets_manager.CloudSecretsManagerBackend |
Releases
Release 2020.11.23
| Commit | Committed | Subject |
|---|---|---|
| 19b7e4565 | 2020-11-18 | Enable Markdownlint rule MD003/heading-style/header-style (#12427) |
| 8d0950646 | 2020-11-18 | Fix download method in GCSToBigQueryOperator (#12442) |
| 2c0920fba | 2020-11-17 | Adds mechanism for provider package discovery. (#12383) |
| 2cda2f2a0 | 2020-11-17 | Add missing pre-commit definition - provider-yamls (#12393) |
| 80a957f14 | 2020-11-17 | Add Dataflow sensors - job metrics (#12039) |
| ae7cb4a1e | 2020-11-17 | Update wrong commit hash in backport provider changes (#12390) |
| 917e6c442 | 2020-11-16 | Add provide_file_and_upload to GCSHook (#12310) |
| cfa4ecfeb | 2020-11-15 | Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726) |
| 6889a333c | 2020-11-15 | Improvements for operators and hooks ref docs (#12366) |
| 7825e8f59 | 2020-11-13 | Docs installation improvements (#12304) |
| 32b59f835 | 2020-11-12 | Fixes the sending of an empty list to BigQuery list_rows (#12307) |
| 250436d96 | 2020-11-10 | Fix spelling in Python files (#12230) |
| 502ba309e | 2020-11-10 | Enable Markdownlint rule - MD022/blanks-around-headings (#12225) |
| dd2095f4a | 2020-11-10 | Simplify string expressions & Use f-string (#12216) |
| f37c6e6fc | 2020-11-10 | Add Compute Engine SSH hook (#9879) |
| 85a18e13d | 2020-11-09 | Point at pypi project pages for cross-dependency of provider packages (#12212) |
| 59eb5de78 | 2020-11-09 | Update provider READMEs for up-coming 1.0.0beta1 releases (#12206) |
| 61feb6ec4 | 2020-11-09 | Provider's readmes generated for elasticsearch and google packages (#12194) |
Release 2020.11.13
| Commit | Committed | Subject |
|---|---|---|
| b2a28d159 | 2020-11-09 | Moves provider packages scripts to dev (#12082) |
| fcb6b00ef | 2020-11-08 | Add authentication to AWS with Google credentials (#12079) |
| 2ef3b7ef8 | 2020-11-08 | Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172) |
| 0caec9fd3 | 2020-11-06 | Dataflow - add waiting for successful job cancel (#11501) |
| cf9437d79 | 2020-11-06 | Simplify string expressions (#12123) |
| 91a64db50 | 2020-11-04 | Format all files (without excepions) by black (#12091) |
| fd3db778e | 2020-11-04 | Add server side cursor support for postgres to GCS operator (#11793) |
| f1f194026 | 2020-11-04 | Add DataflowStartSQLQuery operator (#8553) |
| 41bf172c1 | 2020-11-04 | Simplify string expressions (#12093) |
| 5f5244b74 | 2020-11-04 | Add template fields renderers to Biguery and Dataproc operators (#12067) |
| 4e8f9cc8d | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) |
| 8c42cf1b0 | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) |
| 45ae145c2 | 2020-11-03 | Log BigQuery job id in insert method of BigQueryHook (#12056) |
| e324b37a6 | 2020-11-03 | Add job name and progress logs to Cloud Storage Transfer Hook (#12014) |
| 6071fdd58 | 2020-11-02 | Improve handling server errors in DataprocSubmitJobOperator (#11947) |
| 2f703df12 | 2020-10-30 | Add SalesforceToGcsOperator (#10760) |
| e5713e00b | 2020-10-29 | Add drain option when canceling Dataflow pipelines (#11374) |
| 37eaac3c5 | 2020-10-29 | The PRs which are not approved run subset of tests (#11828) |
| 79cb77199 | 2020-10-28 | Fixing re pattern and changing to use a single character class. (#11857) |
| 5a439e84e | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) |
| 240c7d4d7 | 2020-10-26 | Google Memcached hooks - improve protobuf messages handling (#11743) |
| 8afdb6ac6 | 2020-10-26 | Fix spellings (#11825) |
| 872b1566a | 2020-10-25 | Generated backport providers readmes/setup for 2020.10.29 (#11826) |
| b680bbc0b | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
Release 2020.10.29
| Commit | Committed | Subject |
|---|---|---|
| b680bbc0b | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 |
| 6ce855af1 | 2020-10-24 | Fix spelling (#11821) |
| 483068745 | 2020-10-24 | Use Python 3 style super classes (#11806) |
| 727c739af | 2020-10-22 | Improve Cloud Memorystore for Redis example (#11735) |
| 1da8379c9 | 2020-10-22 | Fix static checks after merging #10121 (#11737) |
| 91503308c | 2020-10-22 | Add Google Cloud Memorystore Memcached Operators (#10121) |
| 950c16d0b | 2020-10-21 | Retry requests in case of error in Google ML Engine Hook (#11712) |
| 2bfc53b5e | 2020-10-21 | Fix doc errors in google provider files. (#11713) |
| 53e606210 | 2020-10-21 | Enforce strict rules for yamllint (#11709) |
| 349b0811c | 2020-10-20 | Add D200 pydocstyle check (#11688) |
| 2d854c350 | 2020-10-19 | Add service_account to Google ML Engine operator (#11619) |
| 46a121fb7 | 2020-10-18 | docs: Update Bigquery clustering docstrings (#11232) |
| 49c58147f | 2020-10-18 | Strict type checking for provider Google (#11609) |
| 0823d46a7 | 2020-10-16 | Add type annotations for AWS operators and hooks (#11434) |
| 3c10ca650 | 2020-10-16 | Add DataflowStartFlexTemplateOperator (#8550) |
| 8865d14df | 2020-10-16 | Strict type checking for provider google cloud (#11548) |
| 16e712971 | 2020-10-13 | Added support for provider packages for Airflow 2.0 (#11487) |
| 06141d6d0 | 2020-10-12 | Google cloud operator strict type check (#11450) |
| d305876be | 2020-10-12 | Remove redundant None provided as default to dict.get() (#11448) |
| 1845cd11b | 2020-10-11 | Strict type check for google ads and cloud hooks (#11390) |
| bd204bb91 | 2020-10-11 | Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409) |
| 75071831b | 2020-10-10 | Remove redundant parentheses from Python files (#10967) |
| 8baf657fc | 2020-10-09 | Fix regression in DataflowTemplatedJobStartOperator (#11167) |
| b0fcf6755 | 2020-10-07 | Add AzureFileShareToGCSOperator (#10991) |
| 47b05a87f | 2020-10-07 | Improve handling of job_id in BigQuery operators (#11287) |
| 0a0e1af80 | 2020-10-03 | Fix Broken Markdown links in Providers README TOC (#11249) |
Release 2020.10.5
| Commit | Committed | Subject |
|---|---|---|
| ca4238eb4 | 2020-10-02 | Fixed month in backport packages to October (#11242) |
| 5220e4c38 | 2020-10-02 | Prepare Backport release 2020.09.07 (#11238) |
| cb52fb0ae | 2020-09-27 | Add example DAG and system test for MySQLToGCSOperator (#10990) |
| 99accec29 | 2020-09-25 | Fix incorrect Usage of Optional[str] & Optional[int] (#11141) |
| e3f96ce7a | 2020-09-24 | Fix incorrect Usage of Optional[bool] (#11138) |
| daf8f3108 | 2020-09-23 | Add template fields renderers for better UI rendering (#11061) |
| f3e87c503 | 2020-09-22 | Add D202 pydocstyle check (#11032) |
| cb979f9f2 | 2020-09-22 | Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024) |
| 76545bb3d | 2020-09-16 | Add example dag and system test for S3ToGCSOperator (#10951) |
| 22c631625 | 2020-09-16 | Fix more docs spellings (#10965) |
| 12a652f53 | 2020-09-13 | Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869) |
| 41a62735e | 2020-09-11 | Add on_kill method to BigQueryInsertJobOperator (#10866) |
| 3e91da56e | 2020-09-11 | fix typo in firebase/example_filestore DAG (#10875) |
| 68cc7273b | 2020-09-10 | Add on_kill method to DataprocSubmitJobOperator (#10847) |
| f92095721 | 2020-09-10 | Fix and remove some more typos from spelling_wordlist.txt (#10845) |
| 9549274d1 | 2020-09-09 | Upgrade black to 20.8b1 (#10818) |
| 078bfaf60 | 2020-09-08 | Extract missing gcs_to_local example DAG from gcs example (#10767) |
| 10ce31127 | 2020-09-08 | Deprecate using global as the default region in Google Dataproc operators and hooks (#10772) |
| f14f37971 | 2020-09-07 | [AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773) |
| c8ee45568 | 2020-09-07 | Refactor DataprocCreateCluster operator to use simpler interface (#10403) |
| ece685b5b | 2020-09-05 | Asynchronous execution of Dataproc jobs with a Sensor (#10673) |
| 6e3d7b63d | 2020-09-04 | Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578) |
| 804548d58 | 2020-09-01 | Add Dataprep operators (#10304) |
| 11c00bc82 | 2020-08-30 | Fix typos: duplicated "the" (#10647) |
| 2ca615cff | 2020-08-29 | Update Google Cloud branding (#10642) |
| 1b533f617 | 2020-08-28 | Fix broken master - DLP (#10635) |
| 5ae82a56d | 2020-08-28 | Fix Google DLP example and improve ops idempotency (#10608) |
| 3867f7662 | 2020-08-28 | Update Google Cloud branding (#10615) |
| 91ff31ad1 | 2020-08-27 | Documentation for Google Cloud Data Loss Prevention (#8201) (#9651) |
| fdd9b6f65 | 2020-08-25 | Enable Black on Providers Packages (#10543) |
| d76026545 | 2020-08-25 | PyDocStyle: No whitespaces allowed surrounding docstring text (#10533) |
| d1bce91bb | 2020-08-25 | PyDocStyle: Enable D403: Capitalized first word of docstring (#10530) |
| 866701c80 | 2020-08-25 | Fix typo in "Cloud" (#10534) |
| 47265e7b5 | 2020-08-24 | Fix typo in PostgresHook (#10529) |
| 3696c34c2 | 2020-08-24 | Fix typo in the word "release" (#10528) |
| 2f2d8dbfa | 2020-08-25 | Remove all "noinspection" comments native to IntelliJ (#10525) |
| 3734876d9 | 2020-08-24 | Implement impersonation in google operators (#10052) |
| b0598b535 | 2020-08-24 | Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475) |
| ee7ca128a | 2020-08-22 | Fix broken Markdown refernces in Providers README (#10483) |
| 515cc72c9 | 2020-08-22 | Fix typo in timed_out (#10459) |
| 7c206a82a | 2020-08-22 | Replace assigment with Augmented assignment (#10468) |
| 88c7d2e52 | 2020-08-21 | Dataflow operators don't not always create a virtualenv (#10373) |
| 083c3c129 | 2020-08-18 | Simplified GCSTaskHandler configuration (#10365) |
| 1ae5bdf23 | 2020-08-17 | Add test for GCSTaskHandler (#9600) (#9861) |
| e195a980b | 2020-08-16 | Add type annotations for mlengine_operator_utils (#10297) |
| 382c1011b | 2020-08-16 | Add Bigtable Update Instance Hook/Operator (#10340) |
| bfa5a8d5f | 2020-08-15 | CI: Fix failing docs-build (#10342) |
| be46d20fb | 2020-08-15 | Improve idempotency of BigQueryInsertJobOperator (#9590) |
| 47387a69e | 2020-08-14 | Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326) |
| 2f0613b0c | 2020-08-13 | Implement Google BigQuery Table Partition Sensor (#10218) |
| f6734b3b8 | 2020-08-12 | Enable Sphinx spellcheck for doc generation (#10280) |
| 8f8db8959 | 2020-08-12 | DbApiHook: Support kwargs in get_pandas_df (#9730) |
| ef088314f | 2020-08-09 | Added DataprepGetJobsForJobGroupOperator (#10246) |
| b43f90abf | 2020-08-09 | Fix various typos in the repo (#10263) |
| c29533888 | 2020-08-08 | Add labels param to Google MLEngine Operators (#10222) |
| cdec30125 | 2020-08-07 | Add correct signature to all operators and sensors (#10205) |
| eff0f0321 | 2020-08-06 | Update guide for Google Cloud Secret Manager Backend (#10172) |
| 24c8e4c2d | 2020-08-06 | Changes to all the constructors to remove the args argument (#10163) |
| 010322692 | 2020-08-06 | Improve handling Dataproc cluster creation with ERROR state (#9593) |
| 1437cb749 | 2020-08-04 | Add correct signatures for operators in google provider package (#10144) |
| 6efa1b9cb | 2020-08-03 | Add additional Cloud Datastore operators (#10032) |
| 27020f8e5 | 2020-08-03 | Add try clause to DataFusionHook.wait_for_pipeline_state (#10031) |
| 4e3799fec | 2020-08-02 | [AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117) |
| 85c56b173 | 2020-08-02 | Add missing params to GCP Pub/Sub creation_subscription (#10106) |
| b79466c12 | 2020-08-02 | Fix sensor not providing arguments for GCSHook (#10074) |
| 4ee35d027 | 2020-08-02 | Fix hook not passing gcp_conn_id to base class (#10075) |
| aeea71274 | 2020-08-02 | Remove args parameter from provider operator constructors (#10097) |
| 4c84661ad | 2020-07-31 | Split Display Video 360 example into smaler DAGs (#10077) |
| 59cbff087 | 2020-07-29 | Fix docstrings in BigQueryGetDataOperator (#10042) |
| 81b87d48e | 2020-07-27 | Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996) |
| 7d24b088c | 2020-07-25 | Stop using start_date in default_args in example_dags (2) (#9985) |
| 8b10a4b35 | 2020-07-25 | Stop using start_date in default_args in example_dags (#9982) |
| ef98edf4d | 2020-07-23 | Add more information about using GoogleAdsHook (#9951) |
| 33f0cd265 | 2020-07-22 | apply_default keeps the function signature for mypy (#9784) |
| 39a0288a4 | 2020-07-22 | Add Google Authentication for experimental API (#9848) |
| c2db0dfeb | 2020-07-22 | More strict rules in mypy (#9705) (#9906) |
| c4244e18b | 2020-07-22 | Fix calling get_client in BigQueryHook.table_exists (#9916) |
| 5eacc1642 | 2020-07-22 | Add support for impersonation in GCP hooks (#9915) |
| 1cfdebf5f | 2020-07-21 | Fix insert_job method of BigQueryHook (#9899) |
| c8c52e69c | 2020-07-21 | Remove type hint causing DeprecationWarning in Firestore operators (#9819) |
| eb6f1d1cf | 2020-07-16 | Fix typo in datafusion operator (#9859) |
| b01d95ec2 | 2020-07-15 | Change DAG.clear to take dag_run_state (#9824) |
| 6d65c15d1 | 2020-07-15 | Add guide for AI Platform (previously Machine Learning Engine) Operators (#9798) |
| 770de53eb | 2020-07-15 | BigQueryTableExistenceSensor needs to specify keyword arguments (#9832) |
| 2d8dbacdf | 2020-07-15 | Add CloudVisionDeleteReferenceImageOperator (#9698) |
| 9f017951b | 2020-07-15 | Add Google Deployment Manager Hook (#9159) |
| ed5004cca | 2020-07-14 | Allow replace flag in gcs_to_gcs operator. (#9667) |
| 553bb7af7 | 2020-07-13 | Keep functions signatures in decorators (#9786) |
| 68925904e | 2020-07-13 | Add multiple file upload functionality to GCS hook (#8849) |
| 1de78e8f9 | 2020-07-12 | Add Google Stackdriver link (#9765) |
| 092d33f29 | 2020-07-11 | Fix StackdriverTaskHandler + add system tests (#9761) |
| b2305660f | 2020-07-09 | Update example DAG for AI Platform operators (#9727) |
| 23f80f34a | 2020-07-08 | Move gcs & wasb task handlers to their respective provider packages (#9714) |
| 44d4ae809 | 2020-07-06 | Upgrade to latest pre-commit checks (#9686) |
| a79e2d4c4 | 2020-07-06 | Move provider's log task handlers to the provider package (#9604) |
| cd3d9d934 | 2020-07-02 | Fix using .json template extension in GMP operators (#9566) |
| 4799af30e | 2020-06-30 | Extend BigQuery example with include clause (#9572) |
| e33f1a12d | 2020-06-30 | Add template_ext to BigQueryInsertJobOperator (#9568) |
| 40add26d4 | 2020-06-29 | Remove almost all references to airflow.contrib (#9559) |
| c420dbd6e | 2020-06-27 | Bump Pylint to 2.5.3 (#9294) |
| 0051c89cb | 2020-06-26 | nitpick fix (#9527) |
| 87fdbd070 | 2020-06-25 | Use literal syntax instead of function calls to create data structure (#9516) |
| 7256f4caa | 2020-06-22 | Pylint fixes and deprecation of rare used methods in Connection (#9419) |
| e13a14c87 | 2020-06-21 | Enable & Fix Whitespace related PyDocStyle Checks (#9458) |
| 5b680e27e | 2020-06-19 | Don't use connection to store task handler credentials (#9381) |
| d0e7db402 | 2020-06-19 | Fixed release number for fresh release (#9408) |
Release 2020.6.24
| Commit | Committed | Subject |
|---|---|---|
| 416334e2e | 2020-06-19 | Properly propagated warnings in operators (#9348) |
| 12af6a080 | 2020-06-19 | Final cleanup for 2020.6.23rc1 release preparation (#9404) |
| c7e5bce57 | 2020-06-19 | Prepare backport release candidate for 2020.6.23rc1 (#9370) |
| 4e09c6442 | 2020-06-18 | Adds GCP Secret Manager Hook (#9368) |
| 40bf8f28f | 2020-06-18 | Detect automatically the lack of reference to the guide in the operator descriptions (#9290) |
| f6bd817a3 | 2020-06-16 | Introduce 'transfers' packages (#9320) |
| 639972d99 | 2020-06-16 | Add support for latest Apache Beam SDK in Dataflow operators (#9323) |
| 1459970b3 | 2020-06-15 | Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314) |
| 431ea3291 | 2020-06-15 | Resolve upstream tasks when template field is XComArg (#8805) |
| aee6ab94e | 2020-06-15 | Wait for pipeline state in Data Fusion operators (#8954) |
| fb1c8b83d | 2020-06-10 | Add test for BQ operations using location (#9206) |
| a26afbfa5 | 2020-06-10 | Make generated job_id more informative in BQ insert_job (#9203) |
| c41192fa1 | 2020-06-10 | Upgrade pendulum to latest major version ~2.0 (#9184) |
| b1c8c5ed5 | 2020-06-09 | Allows using private endpoints in GKEStartPodOperator (#9169) |
| 5918efc86 | 2020-06-05 | Add 3.8 to the test matrices (#8836) |
| 9bcdadaf7 | 2020-06-05 | Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154) |
| f56811dff | 2020-06-05 | [AIRFLOW-6290] Create guide for GKE operators (#8883) |
| 76962867b | 2020-06-04 | Fix sql_to_gcs hook gzip of schema_file (#9140) |
| 17adcea83 | 2020-06-02 | Fix handling of subprocess error handling in s3_file_transform and gcs (#9106) |
| 789852546 | 2020-06-01 | Add BigQueryInsertJobOperator (#8868) |
| 29eb68b90 | 2020-05-31 | Create guide for Dataproc Operators (#9037) |
| 886afaf62 | 2020-05-29 | Add example dag and system test for LocalFilesystemToGCSOperator (#9043) |
| a779c4dfc | 2020-05-29 | add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066) |
| ada26be23 | 2020-05-29 | Add correct description for dst param in LocalFilesystemToGCSOperator (#9055) |
| 81b2761b8 | 2020-05-29 | add example dag and system test for GoogleSheetsToGCSOperator (#9056) |
| 0b0e4f7a4 | 2020-05-26 | Preparing for RC3 release of backports (#9026) |
| 00642a46d | 2020-05-26 | Fixed name of 20 remaining wrongly named operators. (#8994) |
| 3994030ea | 2020-05-26 | Refactor BigQuery operators (#8858) |
| cdb3f2545 | 2020-05-26 | All classes in backport providers are now importable in Airflow 1.10 (#8991) |
| 1d36b0303 | 2020-05-23 | Fix references in docs (#8984) |
| cf5cf45e1 | 2020-05-23 | Support YAML input for CloudBuildCreateOperator (#8808) |
| 499493c5c | 2020-05-19 | [AIRFLOW-6586] Improvements to gcs sensor (#7197) |
| 375d1ca22 | 2020-05-19 | Release candidate 2 for backport packages 2020.05.20 (#8898) |
| 841d81664 | 2020-05-19 | Allow setting the pooling time in DLPHook (#8824) |
| 12c5e5d8a | 2020-05-17 | Prepare release candidate for backport packages (#8891) |
| f3521fb0e | 2020-05-16 | Regenerate readme files for backport package release (#8886) |
| 15273f0ea | 2020-05-16 | Check for same task instead of Equality to detect Duplicate Tasks (#8828) |
| 92585ca4c | 2020-05-15 | Added automated release notes generation for backport operators (#8807) |
| e1e833bb2 | 2020-05-13 | Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816) |
| 8b5491971 | 2020-05-12 | Refactor BigQuery hook methods to use python library (#8631) |
| 6911dfe83 | 2020-05-12 | Fix template fields in Google operators (#8840) |
| 4b06fde0f | 2020-05-12 | Fix Flake8 errors (#8841) |
| 1d12c347c | 2020-05-12 | Refactor BigQuery check operators (#8813) |
| 493b685d7 | 2020-05-10 | Add separate example DAGs and system tests for google cloud speech (#8778) |
| 79ef8bed8 | 2020-05-10 | Added Upload Multiple Entity Read Files to specified big query dataset (#8610) |
| 280f1f0c4 | 2020-05-10 | Correctly restore upstream_task_ids when deserializing Operators (#8775) |
| 58aefb23b | 2020-05-08 | Added SDFtoGCSOperator (#8740) |
| 723c52c94 | 2020-05-07 | Add documentation for SpannerDeployInstanceOperator (#8750) |
| 25ee4211b | 2020-05-06 | Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531) |
| 8d6f1aa4b | 2020-05-05 | Support num_retries field in env var for GCP connection (#8700) |
| 67caae0f2 | 2020-05-04 | Add system test for gcs_to_bigquery (#8556) |
| bc45fa675 | 2020-05-03 | Add system test and docs for Facebook Ads operators (#8503) |
| a28c66f23 | 2020-04-30 | [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625) |
| 992a24ce4 | 2020-04-28 | Split and improve BigQuery example DAG (#8529) |
| c1fb28230 | 2020-04-28 | Refactor BigQueryHook dataset operations (#8477) |
| e8d0f8fea | 2020-04-26 | Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430) |
| 37fdfa977 | 2020-04-26 | [AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442) |
| 14b22e6ff | 2020-04-25 | Add hook and operator for Google Cloud Life Sciences (#8481) |
| 72ddc94d1 | 2020-04-23 | Pass location using parmamter in Dataflow integration (#8382) |
| 912aa4b42 | 2020-04-23 | Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174) |
| 57c8c0583 | 2020-04-22 | Use python client in BQ hook create_empty_table/dataset and table_exists (#8377) |
| 5d3a7eef3 | 2020-04-20 | Allow multiple extra_packages in Dataflow (#8394) |
| 79c99b1b6 | 2020-04-18 | Added location parameter to BigQueryCheckOperator (#8273) |
| 79d3f33c1 | 2020-04-17 | Clean up temporary files in Dataflow operators (#8313) |
| efcffa323 | 2020-04-16 | Add Dataproc SparkR Example (#8240) |
| b198a1fa9 | 2020-04-15 | Create guide for BigQuery operators (#8276) |
| 2636cc932 | 2020-04-14 | Raise exception when GCP credential doesn't support account impersonation (#8213) |
| eee4ebaee | 2020-04-14 | Added Facebook Ads Operator #7887 (#8008) |
| 8cae07ea1 | 2020-04-14 | fixed typo (#8294) |
| 45c898330 | 2020-04-13 | Less aggressive eager upgrade of requirements (#8267) |
| 1fd9ed384 | 2020-04-13 | Add mypy plugin for decorators. (#8145) |
| 327b0a9f7 | 2020-04-13 | Added GoogleDisplayVideo360UploadLineItemsOperator (#8216) |
| bb5e403a3 | 2020-04-10 | Honor schema type for MySQL to GCS data pre-process (#8090) |
| 87969a350 | 2020-04-09 | [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170) |
| 3fc89f29f | 2020-04-06 | [AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849) |
| 7ef75d239 | 2020-04-03 | [AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049) |
| ed2bc0057 | 2020-04-02 | Add Google Ads list accounts operator (#8007) |
| 3808a6206 | 2020-04-01 | Unify Google class/package names (#8033) |
| 8a0240257 | 2020-03-31 | Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011) |
| 8e8978007 | 2020-03-31 | Add more refactor steps for providers.google (#8010) |
| aae3b8fb2 | 2020-03-31 | Individual package READMEs (#8012) |
| 779023968 | 2020-03-30 | [AIRFLOW-7075] Operators for storing information from GCS into GA (#7743) |
| 49abce521 | 2020-03-30 | Improve system tests for Cloud Build (#8003) |
| 0f19a930d | 2020-03-29 | Remove GKEStartPodOperator when backporting (#7908) |
| 0e1c238b2 | 2020-03-28 | Get Airflow Variables from GCP Secrets Manager (#7946) |
| eb4af4f94 | 2020-03-28 | Make BaseSecretsBackend.build_path generic (#7948) |
| 01f99426f | 2020-03-28 | Add download/upload operators for GCS and Google Sheets (#7866) |
| 892522f8e | 2020-03-26 | Change signature of GSheetsHook methods (#7853) |
| bfd425157 | 2020-03-26 | Improve idempotency in MLEngineHook.create_model (#7811) |
| f9c226343 | 2020-03-26 | Fix CloudSecretsManagerBackend invalid connections_prefix (#7861) |
| e3920f12f | 2020-03-26 | Improve setUp/tearDown in Cloud Firestore system test (#7862) |
| 8ba8a7295 | 2020-03-26 | Improve example DAGs for Cloud Memorystore (#7855) |
| f7d1a437c | 2020-03-26 | Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856) |
| beef6c230 | 2020-03-26 | Improve authorization in GCP system tests (#7863) |
| 5f165f3e4 | 2020-03-26 | [AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869) |
| 686d7d50b | 2020-03-25 | Standardize SecretBackend class names (#7846) |
| 1982c3fdc | 2020-03-24 | Run Dataflow for ML Engine summary in venv (#7809) |
| eef87b995 | 2020-03-23 | [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830) |
| 529db07b2 | 2020-03-23 | Improve Google PubSub hook publish method (#7831) |
| 4bde99f13 | 2020-03-23 | Make airflow/providers pylint compatible (#7802) |
| a001489b5 | 2020-03-23 | Improve example DAG for ML Engine (#7810) |
| 9e5a8e7f8 | 2020-03-23 | Add call to Super class in 'google' providers (#7823) |
| b86bf79bf | 2020-03-23 | Fix typo in GCP credentials_provider's docstring (#7818) |
| 56c013ce9 | 2020-03-23 | Add missing docstring in BigQueryHook.create_empty_table (#7817) |
| 426a79847 | 2020-03-23 | Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812) |
| cdf1809fc | 2020-03-23 | [AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795) |
| 27dac00e1 | 2020-03-22 | [AIRFLOW-7099] Improve system test for cloud transfer service (#7794) |
| 0daf5d729 | 2020-03-22 | Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791) |
| c8088c2bd | 2020-03-20 | [AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781) |
| 5106a2931 | 2020-03-20 | [AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748) |
| 759ce2a80 | 2020-03-20 | [AIRFLOW-6978] Add PubSubPullOperator (#7766) |
| 6b9b214e4 | 2020-03-20 | [AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692) |
| b11891696 | 2020-03-19 | [AIRFLOW-7069] Fix cloudsql system tests (#7770) |
| ae854cae5 | 2020-03-19 | [AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756) |
| 7e1e954d2 | 2020-03-19 | [AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759) |
| 6e21c139b | 2020-03-19 | [AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762) |
| ce022a3f7 | 2020-03-19 | [AIRFLOW-XXXX] Add cross-references for operators guide (#7760) |
| 029c84e55 | 2020-03-18 | [AIRFLOW-5421] Add Presto to GCS transfer operator (#7718) |
| 63a3102ed | 2020-03-18 | [AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725) |
| 73305c7bd | 2020-03-18 | [AIRFLOW-7081] Remove env variables from GCP guide (#7755) |
| 60fdbf6d9 | 2020-03-18 | [AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728) |
| de7e934ca | 2020-03-17 | [AIRFLOW-7079] Remove redundant code for storing template_fields (#7750) |
| 0de0347b2 | 2020-03-17 | [AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475) |
| 91557c6f8 | 2020-03-17 | [AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738) |
| 51161dbd9 | 2020-03-16 | [AIRFLOW-5664] Store timestamps with microseconds precision (#6354) |
| 2bc020c43 | 2020-03-14 | [AIRFLOW-7055] Verbose logging option for google provider (#7711) |
| c997cab42 | 2020-03-13 | [AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630) |
| 137896f32 | 2020-03-12 | [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685) |
| 1f77f943d | 2020-03-10 | [AIRFLOW-6980] Improve system tests and building providers package (#7615) |
| bf9b6b6d7 | 2020-03-09 | [AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664) |
| e5130dc9f | 2020-03-09 | [AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659) |
| faf0df4b9 | 2020-03-09 | [AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666) |
| 42eef3821 | 2020-03-07 | [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506) |
| b5b9795f0 | 2020-03-07 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624) |
| 6b65038fb | 2020-03-06 | [AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631) |
| 755fe5224 | 2020-03-05 | [AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535) |
| cb2f33911 | 2020-03-04 | [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609) |
| 09fea3ce8 | 2020-03-04 | [AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612) |
| 8230ccc48 | 2020-03-04 | [AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547) |
| 0d1e3088a | 2020-03-04 | [AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604) |
| ab6bb0012 | 2020-03-03 | [AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607) |
| 3db4ade3d | 2020-02-29 | [AIRFLOW-6924] Fix Google DLP operators return types (#7546) |
| 008b4bab1 | 2020-02-27 | [AIRFLOW-6730] Use total_seconds instead of seconds (#7363) |
| bb552b2d9 | 2020-02-25 | [AIRFLOW-6908] Lazy load AirflowException (#7528) |
| d1a34246a | 2020-02-25 | [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322) |
| 3320e432a | 2020-02-24 | [AIRFLOW-6817] Lazy-load airflow.DAG to keep user-facing API untouched (#7517) |
| dcf874352 | 2020-02-24 | [AIRFLOW-6894] Prevent db query in example_dags (#7516) |
| 4d03e33c1 | 2020-02-22 | [AIRFLOW-6817] remove imports from airflow/__init__.py, replaced implicit imports with explicit imports, added entry to UPDATING.MD - squashed/rebased (#7456) |
| 35b961637 | 2020-02-21 | [AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486) |
| aff3a361b | 2020-02-20 | [AIRFLOW-6558] Campaign Manager operators for conversions (#7420) |
| 9cbd7de6d | 2020-02-18 | [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412) |
| 5b199cb86 | 2020-02-17 | [AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429) |
| 2c9345a8e | 2020-02-17 | [AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400) |
| 946bdc23c | 2020-02-16 | [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126) |
| 2381c820c | 2020-02-13 | [AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399) |
| 04c1fefbf | 2020-02-03 | [AIRFLOW-6676] added GCSDeleteBucketOperator (#7307) |
| a0252748f | 2020-02-03 | [AIRFLOW-6717] Remove non-existent field from templated_fields (#7340) |
| 97a429f9d | 2020-02-02 | [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338) |
| 9d8d07557 | 2020-02-03 | [AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337) |
| cf141506a | 2020-02-02 | [AIRFLOW-6708] Set unique logger names (#7330) |
| 373c6aa4a | 2020-01-30 | [AIRFLOW-6682] Move GCP classes to providers package (#7295) |
| 83c037873 | 2020-01-30 | [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287) |
| 057f3ae3a | 2020-01-29 | [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286) |
| ceea293c1 | 2020-01-28 | [AIRFLOW-6656] Fix AIP-21 moving (#7272) |
| c42a375e7 | 2020-01-27 | [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265) |
| 059eda05f | 2020-01-21 | [AIRFLOW-6610] Move software classes to providers package (#7231) |
| f4d3e5e54 | 2020-01-13 | [AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151) |
| e7bf8ecb4 | 2020-01-13 | [AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125) |
| 5b6772cb8 | 2020-01-09 | [AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112) |
| 4f8592ae8 | 2020-01-08 | [AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046) |
| 20299473f | 2020-01-03 | [AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020) |
| 18e8cea4e | 2020-01-03 | [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007) |
| 95087af14 | 2019-12-31 | [AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968) |
| 69629a5a9 | 2019-12-09 | [AIRFLOW-5807] Move SFTP from contrib to providers. (#6464) |
| 25e9047a4 | 2019-12-09 | [AIRFLOW-6193] Do not use asserts in Airflow main code (#6749) |
| ed0a14f32 | 2019-12-09 | [AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734) |
| 2f2f89c14 | 2019-12-01 | [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701) |
| 03c870a61 | 2019-11-26 | [AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601) |
| 5c4cfea8c | 2019-11-15 | [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393) |
| 44a8c37a9 | 2019-11-13 | [AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581) |
| d633d3ac4 | 2019-11-13 | [AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371) |
| d985c02d9 | 2019-11-05 | [AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497) |
| a296cdabd | 2019-11-04 | [AIRFLOW-5743] Move Google PubSub to providers package (#6476) |
| 470b2a779 | 2019-10-30 | [AIRFLOW-5741] Move Cloud Natural Language to providers (#6421) |
| f2caa451f | 2019-10-27 | [AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424) |
| 16d7accb2 | 2019-10-22 | [AIRFLOW-4971] Add Google Display & Video 360 integration (#6170) |
| 4e661f535 | 2019-10-22 | [AIRFLOW-5379] Add Google Search Ads 360 operators (#6228) |
| 19e32b4e2 | 2019-10-18 | [AIRFLOW-5656] Rename provider to providers module (#6333) |
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for apache-airflow-backport-providers-google-2020.11.23.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 90f88521b0e78509b8bd42d62a6dcd86d634229054731697e1f7bbfb1e3cbc5d |
|
| MD5 | 9978fb6e22064d612799e80c4427900a |
|
| BLAKE2b-256 | 070f1c7d8ff8ca10c232dc48d11ae9ee977242c8668a43532dcfde5990f48f2d |
Close
Hashes for apache_airflow_backport_providers_google-2020.11.23-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | a93d379c7d88d1fc835be5359470632f3af9b47bb43c5e37a007049475289729 |
|
| MD5 | 20a48f3b0865b2cf27bf3895ba846add |
|
| BLAKE2b-256 | 9f2e1863b2b129faba40559dd91a06ad4c244b4de1cb39b9607a772bcea0044d |
