Postgres Broker for Huey Task Queue
Project description
=====================================
huey-pg -- Postgres Broker for Huey
=====================================
huey_ is a simple task queue implementation for Python. huey-pg provides a
Postgres-based implementation of a huey storage.
**The project is not feature complete yet.**
Features
========
- Super simple deployment.
- Stores messages in a single table.
- All data are wrapped in a dedicated schema.
- Uses LISTEN/NOTIFY to keep worker sync. No polling.
- Reliable thanks to Postgres MVCC.
- Using plain psycopg2. No ORM.
Installation
============
- Install huey-pg package from PyPI::
pip install huey-pg
- Apply ``huey-pg.sql`` file in your database::
psql -f huey-pg.sql
- Then use ``PostgresHuey`` class:
import psycopg2.pool
from huey_pg import PostgresHuey
pool = psycopg2.pool.ThreadedConnectionPool(0, 4, conninfo)
huey = Postgres(connection_pool=pool))
@huey.task
def hello(name):
print(f"Hello {name}!")
Roadmap
=======
- Process missed notifies while resuming worker.
- Functionnal tests.
- Result storage.
- Delayed & scheduled task.
.. _huey:: https://huey.rtfd.io/
huey-pg -- Postgres Broker for Huey
=====================================
huey_ is a simple task queue implementation for Python. huey-pg provides a
Postgres-based implementation of a huey storage.
**The project is not feature complete yet.**
Features
========
- Super simple deployment.
- Stores messages in a single table.
- All data are wrapped in a dedicated schema.
- Uses LISTEN/NOTIFY to keep worker sync. No polling.
- Reliable thanks to Postgres MVCC.
- Using plain psycopg2. No ORM.
Installation
============
- Install huey-pg package from PyPI::
pip install huey-pg
- Apply ``huey-pg.sql`` file in your database::
psql -f huey-pg.sql
- Then use ``PostgresHuey`` class:
import psycopg2.pool
from huey_pg import PostgresHuey
pool = psycopg2.pool.ThreadedConnectionPool(0, 4, conninfo)
huey = Postgres(connection_pool=pool))
@huey.task
def hello(name):
print(f"Hello {name}!")
Roadmap
=======
- Process missed notifies while resuming worker.
- Functionnal tests.
- Result storage.
- Delayed & scheduled task.
.. _huey:: https://huey.rtfd.io/
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
huey-pg-0.1.0.tar.gz
(3.2 kB
view details)
Built Distribution
File details
Details for the file huey-pg-0.1.0.tar.gz
.
File metadata
- Download URL: huey-pg-0.1.0.tar.gz
- Upload date:
- Size: 3.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/0.12.10 CPython/3.7.1 Linux/4.19.0-2-amd64
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1e369d0eee319f0465ac06ee58dcd6f745f41ff6dab406dc2330647942184713 |
|
MD5 | 59183d27600343d4a312448576b9de0a |
|
BLAKE2b-256 | fd98b71304c55a1ce8c8ffce2196cbea434eac345954a7edb7887cd19bfe8bca |
File details
Details for the file huey_pg-0.1.0-py3-none-any.whl
.
File metadata
- Download URL: huey_pg-0.1.0-py3-none-any.whl
- Upload date:
- Size: 6.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/0.12.10 CPython/3.7.1 Linux/4.19.0-2-amd64
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9a62dd204d920073e131caf836ae45d0458e98e249c28d8e0522b2a3d2f9a337 |
|
MD5 | 7f47857b52d2d4995f06ed35ab2f36c6 |
|
BLAKE2b-256 | e62ca436612500f4e1e4eed7858511fc57274ea3c05de6d615d541e18fdd8df9 |