Task manager for asyncio
Project description
Donald – A fast and simple tasks manager for Asyncio.
Donald supports synchronous and asynchronous paradigms. The package is running coroutines and functions in multi loops. Donald could run periodic tasks and listen AMQP queues.
Requirements
python 3.8+
Installation
Donald should be installed using pip:
pip install donald
With redis support:
pip install donald[redis]
Quick Start
Init the tasks manager:
# Init Donald
manager = Donald(
# Params (default values)
# -----------------------
# Setup logging
log_level=logging.INFO,
log_config=None,
# Choose a backend (memory|redis|amqp)
# memory - is only recommended for testing/local development
backend='memory',
# Backend connection params
# redis: {'url': 'redis://localhost:6379/0', 'channel': 'donald'}
# amqp: {'url': 'amqp://guest:guest@localhost:5672/', 'queue': 'donald', 'exchange': 'donald'}
backend_params={},
# Tasks worker params
worker_params={
# Max tasks in work
'max_tasks': 0,
# Tasks default params (delay, timeout)
'task_defaults': {},
# A awaitable function to run on worker start
'on_start': None
# A awaitable function to run on worker stop
'on_stop': None
# A awaitable function to run on worker error
'on_error': None
},
)
# Wrap a function to task
@manager.task
async def myfunc(*args, **kwargs):
# Do some job here
# Start the manager somewhere (on app start for example)
await manager.start()
# you may run a worker in the same process
# not recommended for production
worker = manager.create_worker()
worker.start()
# ...
# Submit the task to workers
myfunc.submit(*args, **kwargs)
# ...
# Stop the manager when you need
await worker.stop()
await manager.stop()Schedule tasks
@tasks.schedule('*/5 * * * *') # Supports cron expressions, number of seconds, timedelta
@tasks.task
async def myfunc(*args, **kwargs):
"""Run every 5 minutes"""
# Do some job here
# you may run a scheduler in the same process
# not recommended for production
manager.scheduler.start()
# ...
# Stop the scheduler before stop the tasks manager
manager.scheduler.stop()Run in production
Create a tasks manager somewhere in your app tasks.py:
manager = Donald(backend='amqp')
# Setup your tasks and schedules.
# See the Quick Start section for details.Run a worker in a separate process:
$ donald -M tasks.manager workerRun a scheduler (if you need) in a separate process:
$ donald -M tasks.manager schedulerBug tracker
If you have any suggestions, bug reports or annoyances please report them to the issue tracker at https://github.com/klen/donald/issues
Contributing
Development of starter happens at github: https://github.com/klen/donald
License
Licensed under a MIT license.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file donald-0.32.0.tar.gz.
File metadata
- Download URL: donald-0.32.0.tar.gz
- Upload date:
- Size: 12.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 116270f77a159023b4be2eb591f2a644ddfce3bc1889a5e1214c914799f3dbb2 |
|
| MD5 | 6d8247bd4c90e3097f2f0c6173e77af0 |
|
| BLAKE2b-256 | 80f8f97662ea86fda5e801f8385a7ced927eb02fd3e78f5441735ed606099397 |
File details
Details for the file donald-0.32.0-py3-none-any.whl.
File metadata
- Download URL: donald-0.32.0-py3-none-any.whl
- Upload date:
- Size: 12.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.9.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9186160fd39398e93c8da7f6d8e642a696e58e130bb5852c533ce2d722b372ae |
|
| MD5 | 845f814c9ab3f0190276146ce7948561 |
|
| BLAKE2b-256 | 3a920dd75ad81f06f2108de56ce958257fb17454e2fa55364f1f7bc2aeca3639 |
