[Dirvish] [Bulk] Re: Full backup every time

[Jens Lang]

Kenneth Lerman schrieb:
> A speedup of 6 thousand times is pretty good.
>
> Go to the vault directory and do a:
> du -csh *
>
> I believe that will show the good news.
>   
Good news? It shows:
> 67G     2008-03-09_11.18
> 57G     2008-03-16_10.29
> 36G     2008-03-21_18.18
> 35G     2008-03-22_18.18
> 12K     dirvish
> 194G    total
Is it of any importance that dirvish is run as root?


Jens

> Ken
>
> ----- Original Message ----- 
> From: "Jens Lang" <jenslang at yahoo.de>
> To: "Dirvish user and developer mailing list" <dirvish at dirvish.org>
> Sent: Saturday, March 22, 2008 7:11 PM
> Subject: Re: [Dirvish] Full backup every time
>
>
>   
>> Jon Radel schrieb:
>>     
>>> Bernd Haug wrote:
>>>
>>>       
>>>> It would be interesting, for each of you, what kind of file system the
>>>> backups are being copied to...if your target filesystem does not accept
>>>> hard links, it's a tough problem for dirvish.
>>>>
>>>>         
>> As already mentioned, its ext3. It is on a seperate hard disk. The
>> partition is mounted at /mnt/backup and /var/backup/dirvish is a soft
>> link to /mnt/backup/dirvish.
>>     
>>> And while we're at it, the log file matching that summary file to give a
>>> bit more information on what rsync did.
>>>
>>>       
>> This is today's summary:
>>     
>>> client: xxx at myclient
>>> tree: /home/xxx
>>> rsh: ssh
>>> Server: myserver
>>> Bank: /var/backups/dirvish/mybank
>>> vault: myvault
>>> branch: default
>>> Image: 2008-03-22_18.18
>>> Reference: 2008-03-21_18.18
>>> Image-now: 2008-03-22 18:18:49
>>> Expire: +14 days == 2008-04-05 18:18:49
>>> exclude:
>>>     *.iso
>>>     *~
>>>     *.tmp
>>>     *.bak
>>>     cache
>>>     .gnupg
>>>     *.vmdk
>>> SET permissions devices numeric-ids stats xdev zxfer
>>> UNSET checksum init sparse whole-file
>>>
>>>
>>> ACTION: rsync -vrltH --delete -pgo --stats -z -D --numeric-ids -x
>>> --exclude-from=/var/backups/dirvish/mybank/myvault/2008-03-22_18.18/exclude
>>> --link-dest=/var/backups/dirvish/mybank/myvault/2008-03-21_18.18/tree
>>> xxx at myclient:/home/xxx/
>>> /var/backups/dirvish/mybank/myvault/2008-03-22_18.18/tree
>>> Backup-begin: 2008-03-22 18:18:50
>>> Backup-complete: 2008-03-22 19:10:07
>>> Status: success
>>>       
>> And this is the corresponding log file:
>>     
>>> ACTION: rsync -vrltH --delete -pgo --stats -z -D --numeric-ids -x
>>> --exclude-from=/var/backups/dirvish/mybank/myvault/2008-03-22_18.18/exclude
>>> --link-dest=/var/backups/dirvish/mybank/myvault/2008-03-21_18.18/tree
>>> xxx at myclient:/home/xxx/
>>> /var/backups/dirvish/mybank/myvault/2008-03-22_18.18/tree
>>>
>>> receiving file list ... done
>>> .ICEauthority
>>> .Xauthority
>>> .bash_history
>>> .kderc
>>> .lesshst
>>> .nano_history
>>>       
>> [...]
>>     
>>> Number of files: 155036
>>> Number of files transferred: 942
>>> Total file size: 60891647542 bytes
>>> Total transferred file size: 208591096 bytes
>>> Literal data: 13875619 bytes
>>> Matched data: 194715792 bytes
>>> File list size: 3239140
>>> File list generation time: 54.763 seconds
>>> File list transfer time: 0.000 seconds
>>> Total bytes sent: 686805
>>> Total bytes received: 8768410
>>>
>>> sent 686805 bytes  received 8768410 bytes  3080.38 bytes/sec
>>> total size is 60891647542  speedup is 6440.01
>>>       
>> It actually shows the names of all my files (I suppose it's all but I'm
>> not really sure). I removed them.
>>     
>>> And which version of rsync is /usr/local/bin/rsync-new anyway?
>>>
>>>       
>> There is no file with this name. "rsync --version" gives:
>>     
>>> rsync  version 2.6.9  protocol version 29
>>> Copyright (C) 1996-2006 by Andrew Tridgell, Wayne Davison, and others.
>>> <http://rsync.samba.org/>
>>> Capabilities: 64-bit files, socketpairs, hard links, symlinks,
>>>               batchfiles, inplace, IPv6, ACLs,
>>>               64-bit system inums, 64-bit internal inums
>>>
>>> rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
>>> are welcome to redistribute it under certain conditions.  See the GNU
>>> General Public Licence for details.
>>>       
>> The dirvish version is 1.2.
>>
>> This is the output of "du -h --max-depth=1":
>>     
>>> 58G     ./2008-03-21_18.18
>>> 35G     ./2008-03-22_18.18
>>> 12K     ./dirvish
>>> 67G     ./2008-03-09_11.18
>>> 36G     ./2008-03-16_10.29
>>> 194G    .
>>>       
>> "2008-03-16_10.29" is a "--init" backup.
>>
>> Well, it seems to me that that not all the data is transferred but
>> nevertheless most (but obviously not all) files are copied instead of
>> being hardlinked.
>>
>> Jens
>>
>> _______________________________________________
>> Dirvish mailing list
>> Dirvish at dirvish.org
>> http://www.dirvish.org/mailman/listinfo/dirvish
>>
>>     
> _______________________________________________
> Dirvish mailing list
> Dirvish at dirvish.org
> http://www.dirvish.org/mailman/listinfo/dirvish
>
>