Dispatch TiddlyWeb jobs using beanstalkd
Project description
A TiddlyWeb plugin to dispatch tiddlers to asynchronous job queues.
This plugin uses beanstalkd to provide an in memory queing system
holding queues to external processes which will do something with
the information in the queue. The general goal is to allow processing
of tiddlers asynchronously: For example to do indexing, send mail,
etc.
The general model goes as follows:
* In init() of the plugin two things happen:
** a tiddler_written handler is registered, that handler has one job:
put a message in the default queue of beanstalkd
** N+1 external process are either forked or if launched by some other
mechanism, registered. The '1' processs listens on the default
queue and writes the tiddler ID into a queue named after each of
the N external processes (e.g. a tube named 'index')
* Each of the process listening on non-default tubes, processes
the tiddler, and then deletes it from the queue.
This is _highly_ experimental. You will need to be able to compile
beanstalkd in order to use this.
External requirements are:
client: http://github.com/earl/beanstalkc
server: http://github.com/kr/beanstalkd
Copyright 2010, Chris Dent <cdent@peermore.com>
BSD License
This plugin uses beanstalkd to provide an in memory queing system
holding queues to external processes which will do something with
the information in the queue. The general goal is to allow processing
of tiddlers asynchronously: For example to do indexing, send mail,
etc.
The general model goes as follows:
* In init() of the plugin two things happen:
** a tiddler_written handler is registered, that handler has one job:
put a message in the default queue of beanstalkd
** N+1 external process are either forked or if launched by some other
mechanism, registered. The '1' processs listens on the default
queue and writes the tiddler ID into a queue named after each of
the N external processes (e.g. a tube named 'index')
* Each of the process listening on non-default tubes, processes
the tiddler, and then deletes it from the queue.
This is _highly_ experimental. You will need to be able to compile
beanstalkd in order to use this.
External requirements are:
client: http://github.com/earl/beanstalkc
server: http://github.com/kr/beanstalkd
Copyright 2010, Chris Dent <cdent@peermore.com>
BSD License
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Close
Hashes for tiddlywebplugins.dispatcher-0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 95e715ac3b54c4c241265bab387aa8610ea4b3f7cf87d930af88ce60dce098fc |
|
MD5 | 670f557c9d588230650143ccd35edb5f |
|
BLAKE2b-256 | 53803c60e27d2b68af78dcf739e10260d328a48ecc3a8a233020b1faabc3d836 |