Skip to main content

Donald is here

Project description

Donald – A fast and simple tasks manager for Asyncio.

Donald supports synchronous and asynchronous paradigms. The package is running coroutines and functions in multi loops. Donald could run periodic tasks and listen AMQP queues.

Tests Status PYPI Version Python Versions

Requirements

  • python 3.8+

Installation

Donald should be installed using pip:

pip install donald

With redis support:

pip install donald[redis]

Quick Start

Init the tasks manager:

# Init Donald
manager = Donald(

    # Params (default values)
    # -----------------------

    # Setup logging
    log_level=logging.INFO,
    log_config=None,

    # Choose a backend (memory|redis|amqp)
    # memory - is only recommended for testing/local development
    backend='memory',

    # Backend connection params
    # redis: {'url': 'redis://localhost:6379/0', 'channel': 'donald'}
    # amqp: {'url': 'amqp://guest:guest@localhost:5672/', 'queue': 'donald', 'exchange': 'donald'}
    backend_params={},

    # Tasks worker params
    worker_params={
      # Max tasks in work
      'max_tasks': 0,

      # Tasks default params (delay, timeout)
      'task_defaults': {},

      # A awaitable function to run on worker start
      'on_start': None

      # A awaitable function to run on worker stop
      'on_stop': None

      # A awaitable function to run on worker error
      'on_error': None

    },
)

# Wrap a function to task
@manager.task
async def myfunc(*args, **kwargs):
    # Do some job here

# Start the manager somewhere (on app start for example)
await manager.start()

# you may run a worker in the same process
# not recommended for production
worker = manager.create_worker()
worker.start()

# ...

# Submit the task to workers
myfunc.submit(*args, **kwargs)

# ...

# Stop the manager when you need
await worker.stop()
await manager.stop()

Schedule tasks

@tasks.schedule('*/5 * * * *')  # Supports cron expressions, number of seconds, timedelta
@tasks.task
async def myfunc(*args, **kwargs):
    """Run every 5 minutes"""
    # Do some job here


# you may run a scheduler in the same process
# not recommended for production
manager.scheduler.start()

# ...

# Stop the scheduler before stop the tasks manager
manager.scheduler.stop()

Run in production

Create a tasks manager somewhere in your app tasks.py:

manager = Donald(backend='amqp')

# Setup your tasks and schedules.
# See the Quick Start section for details.

Run a worker in a separate process:

$ donald -M tasks.manager worker

Run a scheduler (if you need) in a separate process:

$ donald -M tasks.manager scheduler

Bug tracker

If you have any suggestions, bug reports or annoyances please report them to the issue tracker at https://github.com/klen/donald/issues

Contributing

Development of starter happens at github: https://github.com/klen/donald

License

Licensed under a BSD license.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

donald-0.31.6.tar.gz (11.3 kB view details)

Uploaded Source

Built Distribution

donald-0.31.6-py3-none-any.whl (11.8 kB view details)

Uploaded Python 3

File details

Details for the file donald-0.31.6.tar.gz.

File metadata

  • Download URL: donald-0.31.6.tar.gz
  • Upload date:
  • Size: 11.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.9.15

File hashes

Hashes for donald-0.31.6.tar.gz
Algorithm Hash digest
SHA256 fe8186b2be2d7b37b5cf5b89c1a9b7a9f2042fa12bd3f70dccfab035c37bb93d
MD5 53b8f2ef8907e906b92194608b9ff9d3
BLAKE2b-256 23bce7b84c2f391f9aac2d58d1b82d3e33b12eebd04a64e40320fad8a097c02f

See more details on using hashes here.

File details

Details for the file donald-0.31.6-py3-none-any.whl.

File metadata

  • Download URL: donald-0.31.6-py3-none-any.whl
  • Upload date:
  • Size: 11.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.9.15

File hashes

Hashes for donald-0.31.6-py3-none-any.whl
Algorithm Hash digest
SHA256 e7dc3a6379e0f1bb6a284e1b9fc71b05d3e61dc491020f7df723736bac0ec98f
MD5 8b3cb507a101e9db0a7377fc807f175a
BLAKE2b-256 520c5e037c4955154c5638cff28d9c5bcbf55d6d4db609007ef73ddda0574c6b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page