Skip to main content

Dispatch TiddlyWeb jobs using beanstalkd

Project description

A TiddlyWeb plugin to dispatch tiddlers to asynchronous job queues.

This plugin uses beanstalkd to provide an in memory queing system
holding queues to external processes which will do something with
the information in the queue. The general goal is to allow processing
of tiddlers asynchronously: For example to do indexing, send mail,
etc.

The general model goes as follows:

* In init() of the plugin two things happen:
** a Store HOOK for tiddler put and delete is registered, that hooke has
one job: put a message in the default queue of beanstalkd
** N+1 external process are either forked or if launched by some other
mechanism, registered. The '1' processs listens on the default
queue and writes the tiddler ID into a queue named after each of
the N external processes (e.g. a tube named 'index')

* Each of the process listening on non-default tubes, processes
the tiddler, and then deletes it from the queue.

This is _highly_ experimental. You will need to be able to compile
beanstalkd in order to use this.

External requirements are:

client: http://github.com/earl/beanstalkc
server: http://github.com/kr/beanstalkd

Copyright 2010, Chris Dent <cdent@peermore.com>
BSD License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tiddlywebplugins.dispatcher-0.9.tar.gz (5.0 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page