Skip to main content

The distributed parallel computing library hooks for xonsh

Project description

The distributed parallel computing library hooks for xonsh

If you like the idea click ⭐ on the repo and tweet.

Importantly this provides a substitute 'dworker' command which enables distributed workers to have access to xonsh builtins.

Furthermore, this xontrib adds a 'DSubmitter' context manager for executing a block remotely. Moreover, this also adds a convenience function 'dsubmit()' for creating DSubmitter and Executor instances at the same time.

Thus users may submit distributed jobs with::

with dsubmit('127.0.0.1:8786', rtn='x') as dsub:
    x = $(echo I am elsewhere)
res = dsub.future.result()
print(res)

This is useful for long running or non-blocking jobs.

Installation

To install use pip:

xpip install xontrib-distributed
# or: xpip install -U git+https://github.com/xonsh/xontrib-distributed

Usage

xontrib load distributed
# TODO: what's next?

Releasing your package

  • Bump the version of your package.
  • Create a GitHub release (The release notes are automatically generated as a draft release after each push).
  • And publish with poetry publish --build or twine

Credits

This package was created with xontrib cookiecutter template.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

xontrib-distributed-0.0.4.tar.gz (4.0 kB view details)

Uploaded Source

Built Distribution

xontrib_distributed-0.0.4-py3-none-any.whl (4.1 kB view details)

Uploaded Python 3

File details

Details for the file xontrib-distributed-0.0.4.tar.gz.

File metadata

  • Download URL: xontrib-distributed-0.0.4.tar.gz
  • Upload date:
  • Size: 4.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.13 CPython/3.10.2 Darwin/21.4.0

File hashes

Hashes for xontrib-distributed-0.0.4.tar.gz
Algorithm Hash digest
SHA256 a1e8543b5cc18d661ba32c25a1296048a8dbff8cb1a9b61c888304e359d3ee4e
MD5 ea46f835ed1bd41dda1f9886ba6aff49
BLAKE2b-256 d11fc6f7a597c66a96e3eb94a2db3640492b5a58ccec45a9aa04fa40718974df

See more details on using hashes here.

File details

Details for the file xontrib_distributed-0.0.4-py3-none-any.whl.

File metadata

File hashes

Hashes for xontrib_distributed-0.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 e1ee19a521d64f1c425edf3f0245cecb15cd0dae6bccd17433c9cbe352c52f0f
MD5 7f68ade645d8cb545d172389b7a9bd6e
BLAKE2b-256 6c5a20d0cd6ec53ac4513fc9db64fb213aafb153a9125268a9aade547d3e138c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page