rq (queue | export RQ_Q=q) mode [mode_args]* [options]*
ruby queue (rq) is a zero-admin zero-configuration tool used to
instant linux clusters. rq requires only a central nfs filesystem in
to manage a simple sqlite database as a distributed priority work
this simple design allows researchers to install and configure, in
few minutes and without root privileges, a robust linux cluster
distributing processes to many nodes - bringing dozens of powerful
their knees with a single blow. clearly this software should be kept
the hands of free radicals, seti enthusiasts, and one mr. j safran.
the central concept of rq is that n nodes work in isolation to pull
from an centrally mounted nfs priority work queue in a synchronized
the nodes have absolutely no knowledge of each other and all
is done via the queue meaning that, so long as the queue is available
nfs and a single node is running jobs from it, the system will
process jobs. there is no centralized process whatsoever - all nodes
to take jobs from the queue and run them as fast as possible. this
a system which load balances automatically and is robust in face of
although the rq system is simple in it’s design it features powerful
functionality such as priority management, predicate and sql query ,
streaming command-line processing, programmable api, hot-backup, and
input/capture of the stdin/stdout/stderr io streams of remote jobs.
rq has had no reported runtime failures and is in operation at dozens
research centers around the world.