[Dirvish] Filesystems for big partitions
Isaac W Traxler
traxler at lsu.edu
Fri Oct 9 15:26:26 UTC 2015
I create a separate file system (on the dirvish server) for every vault
(vaults for the smae machine are mounted under the machine name). This
works pretty good and keeps my file systems relatively small (other than
some mysql backups).
To deal with all of this, we have a yaml file that defines all config
stuff for dirvish and the run a python configure script that "magically"
- mount points
- creates logical volumes
- mounts them
- prints out dirvish init command
(each item prompts the user before doing it)
Here is a link to the setup I use and the tools we have developed:
Feel free to take advantage of these.
Storage & Infrastructure Manager
High Performance Computing
Louisiana State University, LONI
325 Frey Computing Center, Baton Rouge, LA 70803
225-578-1923 | traxler at lsu.edu
On Thu, 8 Oct 2015, Michael Richardson wrote:
> Date: Thu, 8 Oct 2015 14:54:29
> From: Michael Richardson <michaelr at catalyst.net.nz>
> Reply-To: Dirvish user and developer mailing list <dirvish at dirvish.org>
> To: Dirvish user and developer mailing list <dirvish at dirvish.org>
> Subject: Re: [Dirvish] Filesystems for big partitions
> On Thu, October 8, 2015 8:54 pm, Paul Slootman wrote:
>> I generally use ext4, as it performs well and predictably.
>> Do the resize online and you don't need to perform the fsck (don't ask
>> me about the reasoning behind that, I have no idea).
>> I have had the most terrible problems with XFS as a filesystem for
>> dirvish, a lot of bugs were triggered (this was a couple of years ago).
> We've actually gone the other way, but for different reasons. We use XFS
> widely now, due to the 16 TB limit on ext4. Performance tests on both
> have come out reasonably similar, and we've not had any issues with XFS
> (touch wood!). We also use the concurrency patch for dirvish-runall
> (and a similar one for cleaning up expired vaults).
>  https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=639326
> Michael Richardson
> Catalyst IT Limited
> 150-154 Willis Street, PO Box 11-053 Wellington New Zealand
> DDI: ++64 4 803 2260
> GPG: 0530 4686 F996 4E2C 5DC7 6327 5C98 5EED A302 9071
> Dirvish mailing list
> Dirvish at dirvish.org
More information about the Dirvish