[Dirvish] Dirvish-runall in parallel mode?
emsearcy at osuosl.org
Mon Jun 16 22:42:22 UTC 2008
On Jun 15, 2008, at 3:28 AM, Arjan Schrijver wrote:
> Hi people,
> Is it already possible to let dirvish-runall backup multiple vaults in
> parallel? By searching Google I have found several user submitted
> patches to do exactly that, but I can't find anything about it on the
> official Dirvish website or documentation.
> Please tell me how I can do this. If it is not possible, please tell
> how you reduce the time needed to backup a lot of servers (3 hours
> for 8
> servers at the moment).
Sorry, I've been meaning to do something about that to get it into the
stable version but haven't. Note that this is still a development
branch, but at
you can get a version of dirvish-runall to do this. Simply download
the 1.2.1 tarball from the home page, extract it, then replace dirvish-
runall.pl with the one from the above directory before running the
As for documentation, you may add the option
concurrent: value (Single)
With a value >= 1. This only works in /etc/dirvish.conf or /etc/
dirvish/master.conf. It will not work in the vault default.confs
because it only affects runall, not the individual dirvish run.
What value you choose depends on your system. Presumably your
limiting factor is the remote drive or the network. Once you get to
concurrent: 3 or higher, you may find that the local disk becomes the
limiting factor and further parallelization doesn't have any benefit
(and, due to context switching on the dirvish master, is actually
Please let me know, on-list is fine, if you have any problems with
this. We've been running this branch in production (we use
concurrent: 2) for over a year now without issue at the OSL.
OSU Open Source Lab
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 194 bytes
Desc: This is a digitally signed message part
Url : http://www.dirvish.org/pipermail/dirvish/attachments/20080616/04607cc2/attachment.bin
More information about the Dirvish