Python client for Hadoop® YARN API
Project description
Python client for Apache Hadoop® YARN API
Package documentation: python-client-for-hadoop-yarn-api.readthedocs.org
REST API documentation: hadoop.apache.org
Installation
From PyPI
pip install yarn-api-client
From Anaconda (conda forge)
conda install -c conda-forge yarn-api-client
From source code
git clone https://github.com/toidi/hadoop-yarn-api-python-client.git pushd hadoop-yarn-api-python-client python setup.py install popd
Enabling support for Kerberos/SPNEGO Security
To avoid deployment issues on a non Kerberized environment, the requests_kerberos dependency is optional and needs to be explicit installed in order to enable access to YARN console protected by Kerberos/SPNEGO.
pip install requests_kerberos
Usage
CLI interface
bin/yarn_client --help
alternative
python -m yarn_api_client --help
Programmatic interface
from yarn_api_client import ApplicationMaster, HistoryServer, NodeManager, ResourceManagerChangelog
- 0.3.6 Release
Extend ResourceManager to allow applications to better determine resource availability prior to submission.
- 0.3.5 Release
Hotfix release to fix internal signature mismatch
- 0.3.4 Release
More flexible support for discovering Hadoop configuration including multiple Resource Managers when HA is configured
Properly support YARN post response codes
- 0.3.3 Release
Properly set Content-Type in PUT requests
Check for HADOOP_CONF_DIR env variable
- 0.3.2 Release
Make Kerberos/SPNEGO dependency optional
- 0.3.1 Release
Fix cluster_application_kill API
- 0.3.0 Release
Add support for YARN endpoints protected by Kerberos/SPNEGO
Moved to requests package for REST API invocation
Remove http_con property, as connections are now managed by requests package
- 0.2.5 Release
Fixed History REST API
- 0.2.4 Release
Added compatibility with HA enabled Resource Manager
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file yarn-api-client-0.3.7.dev0.tar.gz.
File metadata
- Download URL: yarn-api-client-0.3.7.dev0.tar.gz
- Upload date:
- Size: 15.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.19.1 setuptools/40.2.0 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.6.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9cebdb085feb58a87ba999447a8a6f57fb34175e6d2eb0daaba1e4ba94797633 |
|
| MD5 | f2874ceda28c1f82dec1d5bb8136cc16 |
|
| BLAKE2b-256 | 28311fcad105847abe2da6831e328ab14bec26411ee113098c0ae8a12006a6fd |
File details
Details for the file yarn_api_client-0.3.7.dev0-py2.py3-none-any.whl.
File metadata
- Download URL: yarn_api_client-0.3.7.dev0-py2.py3-none-any.whl
- Upload date:
- Size: 18.8 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.19.1 setuptools/40.2.0 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.6.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b795b1962d7af4cb397f921b9ef09163f27cec5d81e7b929c85bb0882aded8ed |
|
| MD5 | 6958917f10653109719c2f9dd2bfb2fa |
|
| BLAKE2b-256 | b52e2828bdc293a96f2ea76176eaa346feaef5189407625ca50236ec9c7e5337 |
