Skip to main content

Postgres Broker for Huey Task Queue

Project description

=====================================
huey-pg -- Postgres Broker for Huey
=====================================

huey_ is a simple task queue implementation for Python. huey-pg provides a
Postgres-based implementation of a huey storage.

**The project is not feature complete yet.**


Features
========

- Super simple deployment.
- Stores messages in a single table.
- All data are wrapped in a dedicated schema.
- Uses LISTEN/NOTIFY to keep worker sync. No polling.
- Reliable thanks to Postgres MVCC.
- Using plain psycopg2. No ORM.


Installation
============

- Install huey-pg package from PyPI::

pip install huey-pg

- Apply ``huey-pg.sql`` file in your database::

psql -f huey-pg.sql

- Then use ``PostgresHuey`` class:

import psycopg2.pool
from huey_pg import PostgresHuey

pool = psycopg2.pool.ThreadedConnectionPool(0, 4, conninfo)
huey = Postgres(connection_pool=pool))

@huey.task
def hello(name):
print(f"Hello {name}!")

Roadmap
=======

- Process missed notifies while resuming worker.
- Functionnal tests.
- Result storage.
- Delayed & scheduled task.


.. _huey:: https://huey.rtfd.io/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

huey-pg-0.1.0.tar.gz (3.2 kB view details)

Uploaded Source

Built Distribution

huey_pg-0.1.0-py3-none-any.whl (6.0 kB view details)

Uploaded Python 3

File details

Details for the file huey-pg-0.1.0.tar.gz.

File metadata

  • Download URL: huey-pg-0.1.0.tar.gz
  • Upload date:
  • Size: 3.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/0.12.10 CPython/3.7.1 Linux/4.19.0-2-amd64

File hashes

Hashes for huey-pg-0.1.0.tar.gz
Algorithm Hash digest
SHA256 1e369d0eee319f0465ac06ee58dcd6f745f41ff6dab406dc2330647942184713
MD5 59183d27600343d4a312448576b9de0a
BLAKE2b-256 fd98b71304c55a1ce8c8ffce2196cbea434eac345954a7edb7887cd19bfe8bca

See more details on using hashes here.

File details

Details for the file huey_pg-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: huey_pg-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 6.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/0.12.10 CPython/3.7.1 Linux/4.19.0-2-amd64

File hashes

Hashes for huey_pg-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9a62dd204d920073e131caf836ae45d0458e98e249c28d8e0522b2a3d2f9a337
MD5 7f47857b52d2d4995f06ed35ab2f36c6
BLAKE2b-256 e62ca436612500f4e1e4eed7858511fc57274ea3c05de6d615d541e18fdd8df9

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page