Guillotina addon to split actions into smaller bits
Project description
guillotina_hive is a task runner whose main goal is to provide a mechanism to iterate through all the content on a database as quickly as possible.
To accomplish that end, hive integrates with container orchestrators(k8s or nomad) to schedule jobs on and retrieve results from those jobs.
Installation
With pip:
pip install guillotina_hive
Guillotina configuration
Example here with json:
"applications": ["guillotina_hive"], "hive": { "default_image": None, "default_namespace": "hive", "orchestrator": "k8s", "cluster_config": {}, "guillotina_default": { "entrypoint": None, "volumes": None, "volumeMounts": None, "envFrom": None }, 'quota': None }
Settings explained
default_image: default image to use for jobs to run with
default_namespace: cluster namespace to use
orchestrator: k8s or nomad
cluster_config: what to configure aioclustermanager with
guillotina_default: default configuration for guillotina jobs
quota: define quote on cluster namespace
Defining a job
We use decorators to provide tasks:
from guillotina_hive.decorators import hive_task @hive_task(name='something') async def something(arg1, arg2): return foobar
You can also use application settings:
{ "calculate-numbers": "guillotina_hive.tests.tasks.calculate_numbers" }
1.0.9 (2018-04-26)
apply builtin tasks setup request object url as well [vangheem]
1.0.7 (2018-04-25)
improve user login for apply tasks [vangheem]
1.0.4 (2018-04-24)
Fix working with decorators [vangheem]
1.0.3 (2018-04-24)
fix to work with guillotina 3 [vangheem]
1.0.1 (9/4/2018)
Adding manifest [ramon]
1.0.0 (5/4/2018)
Initial version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for guillotina_hive-1.0.9-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84cf8d559872bcc467b914cf3522ed8dc1d9f68ffd3e5999ce393068539062e2 |
|
MD5 | 092f22d44fa8014801fc530a95cd13cf |
|
BLAKE2b-256 | 018dec238f8dd725e7a7ddda5a1f1f862fa5582b82d4a7b782672b1219edbd2c |