Skip to main content

Python client for Hadoop® YARN API

Project description

Python client for Apache Hadoop® YARN API

Latest Version Travis CI build status Latest documentation status Test coverage

Package documentation: python-client-for-hadoop-yarn-api.readthedocs.org

REST API documentation: hadoop.apache.org

Installation

From PyPI

pip install yarn-api-client

From Anaconda (conda forge)

conda install -c conda-forge yarn-api-client

From source code

git clone https://github.com/toidi/hadoop-yarn-api-python-client.git
pushd hadoop-yarn-api-python-client
python setup.py install
popd

Enabling support for Kerberos/SPNEGO Security

To avoid deployment issues on a non Kerberized environment, the requests_kerberos dependency is optional and needs to be explicit installed in order to enable access to YARN console protected by Kerberos/SPNEGO.

pip install requests_kerberos

Usage

CLI interface

bin/yarn_client --help

alternative

python -m yarn_api_client --help

Programmatic interface

from yarn_api_client import ApplicationMaster, HistoryServer, NodeManager, ResourceManager

Changelog

0.3.3 Release
  • Properly set Content-Type in PUT requests

  • Check for HADOOP_CONF_DIR env variable

0.3.2 Release
  • Make Kerberos/SPNEGO dependency optional

0.3.1 Release
  • Fix cluster_application_kill API

0.3.0 Release
  • Add support for YARN endpoints protected by Kerberos/SPNEGO

  • Moved to requests package for REST API invocation

  • Remove http_con property, as connections are now managed by requests package

0.2.5 Release
  • Fixed History REST API

0.2.4 Release
  • Added compatibility with HA enabled Resource Manager

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

yarn-api-client-0.3.3.tar.gz (12.8 kB view details)

Uploaded Source

Built Distribution

yarn_api_client-0.3.3-py2.py3-none-any.whl (16.5 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file yarn-api-client-0.3.3.tar.gz.

File metadata

  • Download URL: yarn-api-client-0.3.3.tar.gz
  • Upload date:
  • Size: 12.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/40.6.3 requests-toolbelt/0.9.1 tqdm/4.28.1 CPython/3.7.1

File hashes

Hashes for yarn-api-client-0.3.3.tar.gz
Algorithm Hash digest
SHA256 fa6cb914ec6f29e9b64fcebf36eb126e35e413fe60e10ceef8b0c4818aec45fb
MD5 cc4b443079c80150a70493df8d458719
BLAKE2b-256 a2e866e432c6179eee42f726b0c56d899080e498c3857f54fc995ee74eb73f7d

See more details on using hashes here.

File details

Details for the file yarn_api_client-0.3.3-py2.py3-none-any.whl.

File metadata

  • Download URL: yarn_api_client-0.3.3-py2.py3-none-any.whl
  • Upload date:
  • Size: 16.5 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.4.2 requests/2.21.0 setuptools/40.6.3 requests-toolbelt/0.9.1 tqdm/4.28.1 CPython/3.7.1

File hashes

Hashes for yarn_api_client-0.3.3-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 d2ca10cb61adb871bad947b1259ca7bc1bc729306c8f740ac16a1960b3441bb9
MD5 03ccc708cae06777ed2a9677bb574dc8
BLAKE2b-256 bb2664365ee14380ff4b3f245e12d28753c07e82e2d2e72e9ba7b425f723cdab

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page