<br><font size=2 face="sans-serif">Hi Ken,</font>
<br>
<br><font size=2 face="sans-serif">Yes, dirvish is being ran as root. I
have a user that I created called "backupuser". In my sudoers
file, I have the user "backupuser" set to be ran as root without
a password via "sudo". The contents of my rsync-new file...</font>
<br>
<br><font size=2 face="sans-serif">#!/bin/sh</font>
<br><font size=2 face="sans-serif">sudo /usr/bin/rsync</font>
<br>
<br><font size=2 face="sans-serif">So, backupuser will have access to files
that are owned by root. Is this a problem? </font>
<br>
<br><font size=2 face="sans-serif">My rsync version: </font>
<br><font size=2 face="sans-serif">rsync version 2.6.6 protocol
version 29</font>
<br><font size=2 face="sans-serif">Capabilities: 64-bit files, socketpairs,
hard links, symlinks, batchfiles,</font>
<br><font size=2 face="sans-serif">
inplace, IPv6, 64-bit system inums, 64-bit internal inums</font>
<br>
<br><font size=2 face="sans-serif">Filesystem:</font>
<br><font size=2 face="sans-serif">XFS</font>
<br>
<br><font size=2 face="sans-serif">any ideas?</font>
<br>
<br><font size=2 face="sans-serif">Thanks,<br>
Doug<br>
</font>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td width=40%><font size=1 face="sans-serif"><b>Kenneth Lerman <Kenneth.Lerman@se-ltd.com></b>
</font>
<br><font size=1 face="sans-serif">Sent by: dirvish-bounces@dirvish.org</font>
<p><font size=1 face="sans-serif">03/22/2008 03:26 PM</font>
<table border>
<tr valign=top>
<td bgcolor=white>
<div align=center><font size=1 face="sans-serif">Please respond to<br>
Dirvish user and developer mailing list <dirvish@dirvish.org></font></div></table>
<br>
<td width=59%>
<table width=100%>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">To</font></div>
<td valign=top><font size=1 face="sans-serif">"Dirvish user and developer
mailing list" <dirvish@dirvish.org></font>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">cc</font></div>
<td valign=top>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">Subject</font></div>
<td valign=top><font size=1 face="sans-serif">Re: [Dirvish] [Bulk] Re:
Full backup every time</font></table>
<br>
<table>
<tr valign=top>
<td>
<td></table>
<br></table>
<br>
<br>
<br><font size=2 face="Arial">Am I correct that dirvish is being run as
root?</font>
<br><font size=3> </font>
<br><font size=2 face="Arial">Ken</font>
<br><font size=3>----- Original Message ----- </font>
<br><font size=3><b>From:</b> </font><a href=mailto:Doug.Hill@sonydadc.com><font size=3 color=blue><u>Doug.Hill@sonydadc.com</u></font></a><font size=3>
</font>
<br><font size=3><b>To:</b> </font><a href=mailto:dirvish@dirvish.org><font size=3 color=blue><u>Dirvish
user and developer mailing list</u></font></a><font size=3> </font>
<br><font size=3><b>Cc:</b> </font><a href=mailto:dirvish@dirvish.org><font size=3 color=blue><u>dirvish@dirvish.org</u></font></a><font size=3>
; </font><a href="mailto:dirvish-bounces@dirvish.org"><font size=3 color=blue><u>dirvish-bounces@dirvish.org</u></font></a><font size=3>
</font>
<br><font size=3><b>Sent:</b> Saturday, March 22, 2008 2:09 PM</font>
<br><font size=3><b>Subject:</b> Re: [Dirvish] [Bulk] Re: Full backup every
time</font>
<br>
<br><font size=2 face="sans-serif"><br>
Hey Gang,</font><font size=3> <br>
</font><font size=2 face="sans-serif"><br>
I'm having a similar problem. </font><font size=3><br>
</font><font size=2 color=blue face="sans-serif"><u><br>
</u></font><a href=mailto:root@2[deathstar><font size=2 color=blue face="sans-serif"><u>root@2[deathstar</u></font></a><font size=2 face="sans-serif">]#
du -csh *</font><font size=3> </font><font size=2 face="sans-serif"><br>
51G deathstar_03-18-2008</font><font size=3> </font><font size=2 face="sans-serif"><br>
51G deathstar_03-19-2008</font><font size=3> </font><font size=2 face="sans-serif"><br>
51G deathstar_03-20-2008</font><font size=3> </font><font size=2 face="sans-serif"><br>
51G deathstar_03-21-2008</font><font size=3> </font><font size=2 face="sans-serif"><br>
12K dirvish</font><font size=3> </font><font size=2 face="sans-serif"><br>
204G total</font><font size=3> <br>
</font><font size=2 face="sans-serif"><br>
As you can see, each backup is the same size!?! Jens - did you find a solution
to your problem? I am backing up 13 servers, some debian, some Suse, some
Ubuntu. In each case, it is the same deal. This leads me to think that
it is on the drivish server side... Here is my summary file from "deathstar"
for my most recent backup.... I use "/usr/sbin/dirvish-runall"
to run my backups for all 13 servers.</font><font size=3> <br>
</font><font size=2 face="sans-serif"><br>
client: backupuser@deathstar</font><font size=3> </font><font size=2 face="sans-serif"><br>
tree: /</font><font size=3> </font><font size=2 face="sans-serif"><br>
rsh: ssh</font><font size=3> </font><font size=2 face="sans-serif"><br>
Server: deathstar</font><font size=3> </font><font size=2 face="sans-serif"><br>
Bank: /mnt/coraid/system_backups/dirvish</font><font size=3> </font><font size=2 face="sans-serif"><br>
vault: deathstar</font><font size=3> </font><font size=2 face="sans-serif"><br>
branch: default</font><font size=3> </font><font size=2 face="sans-serif"><br>
Image: deathstar_03-21-2008</font><font size=3> </font><font size=2 face="sans-serif"><br>
Reference: deathstar_03-20-2008</font><font size=3> </font><font size=2 face="sans-serif"><br>
Image-now: 2008-03-21 20:00:00</font><font size=3> </font><font size=2 face="sans-serif"><br>
Expire: +10 days == 2008-03-31 20:00:00</font><font size=3> </font><font size=2 face="sans-serif"><br>
exclude:</font><font size=3> </font><font size=2 face="sans-serif"><br>
*~</font><font size=3> </font><font size=2 face="sans-serif"><br>
.nfs*</font><font size=3> </font><font size=2 face="sans-serif"><br>
lost+found/</font><font size=3> </font><font size=2 face="sans-serif"><br>
backup/</font><font size=3> </font><font size=2 face="sans-serif"><br>
boot/</font><font size=3> </font><font size=2 face="sans-serif"><br>
dev/</font><font size=3> </font><font size=2 face="sans-serif"><br>
proc/</font><font size=3> </font><font size=2 face="sans-serif"><br>
sys/</font><font size=3> </font><font size=2 face="sans-serif"><br>
tmp/</font><font size=3> </font><font size=2 face="sans-serif"><br>
var/run/</font><font size=3> </font><font size=2 face="sans-serif"><br>
var/lock/</font><font size=3> </font><font size=2 face="sans-serif"><br>
mnt/</font><font size=3> </font><font size=2 face="sans-serif"><br>
home/admin/Shared/newakamaidownload/</font><font size=3>
</font><font size=2 face="sans-serif"><br>
SET permissions devices numeric-ids stats</font><font size=3> </font><font size=2 face="sans-serif"><br>
UNSET checksum init sparse whole-file xdev zxfer</font><font size=3> <br>
<br>
</font><font size=2 face="sans-serif"><br>
ACTION: rsync -vrltH --delete -pgo --stats -D --numeric-ids --rsync-path="/usr/local/bin/rsync-new"
--exclude-from=/mnt/coraid/system_backups/dirvish/deathsta</font><font size=3>
</font><font size=2 face="sans-serif"><br>
r/deathstar_03-21-2008/exclude --link-dest=/mnt/coraid/system_backups/dirvish/deathstar/deathstar_03-20-2008/tree
backupuser@deathstar:/ /mnt/coraid/system_ba</font><font size=3> </font><font size=2 face="sans-serif"><br>
ckups/dirvish/deathstar/deathstar_03-21-2008/tree</font><font size=3> </font><font size=2 face="sans-serif"><br>
Backup-begin: 2008-03-22 00:57:37</font><font size=3> </font><font size=2 face="sans-serif"><br>
Backup-complete: 2008-03-22 02:18:13</font><font size=3> </font><font size=2 face="sans-serif"><br>
Status: success</font><font size=3> </font><font size=2 face="sans-serif"><br>
<br>
I would appreciate an help on this. I am running out of space!</font><font size=3>
<br>
</font><font size=2 face="sans-serif"><br>
Thanks,</font><font size=3> </font><font size=2 face="sans-serif"><br>
Doug</font><font size=3> <br>
<br>
<br>
</font>
<table width=100%>
<tr valign=top>
<td width=52%><font size=1 face="sans-serif"><b>Jens Lang <jenslang@yahoo.de></b>
<br>
Sent by: dirvish-bounces@dirvish.org</font><font size=3> </font>
<p><font size=1 face="sans-serif">03/21/2008 07:23 PM</font><font size=3>
</font>
<br>
<table border=4 width=100%>
<tr valign=top>
<td width=100% bgcolor=white>
<div align=center><font size=1 face="sans-serif">Please respond to<br>
Dirvish user and developer mailing list <dirvish@dirvish.org></font></div></table>
<p>
<td width=47%>
<br>
<table width=100%>
<tr>
<td width=14%>
<div align=right><font size=1 face="sans-serif">To</font></div>
<td width=85% valign=top><font size=1 face="sans-serif">dirvish@dirvish.org</font><font size=3>
</font>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">cc</font></div>
<td valign=top>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">Subject</font></div>
<td valign=top><font size=1 face="sans-serif">Re: [Dirvish] [Bulk] Re:
Full backup every time</font></table>
<br>
<br>
<table width=100%>
<tr valign=top>
<td width=50%>
<td width=50%></table>
<br></table>
<br><font size=3><br>
<br>
</font><font size=2><tt><br>
Keith Lofstrom schrieb:<br>
>>> what could be the reason that dirvish make a full backup every
time I<br>
>>> start the backup? I am running the lates Ubuntu on both, client
and <br>
>>> server.<br>
>>> <br>
> On Fri, Mar 21, 2008 at 05:24:46PM -0400, Kenneth Lerman wrote:<br>
> <br>
>> It is supposed to.<br>
>> <br>
><br>
> Ken's reply is true, but you might want a little more information<br>
> than that. Dirvish uses rsync to create full and complete images.
<br>
> On the server disk, there should be a succession of complete images.<br>
> Rsync uses unix/linux hard links to share data file information; if<br>
> a file does not change, there may be many links to it, but it is only<br>
> stored on the backup disk once. Thus, a 500GB disk can store
what <br>
> appears to be hundreds of 200GB images - only the changed files and<br>
> the directory information is added for each successive image. For<br>
> example, I have a 500GB backup disk with about 150 images on it,<br>
> each apparently 200GB, and I have used only 350GB of it. By
using<br>
> the "branch" feature of dirvish, files that are identical
on many<br>
> different machines can also share data space.<br>
> <br>
Yes, I know that it is supposed to do a full backup every time. Maybe my<br>
wording was not exact. On my system it transfers the whole directory<br>
every time (e. g. a large photo collection). These files never change.<br>
And, of course, they use disk space on the backup disk.<br>
> This is true in the ideal case. In reality, big files with little<br>
> changes ( rotating-name logs, mbox mail folders, vmware images) <br>
> will chew up disk pretty fast. Use "dateext" for logrotate,
<br>
> Maildir format for mail repositories, and samba links to linux<br>
> filespace from smaller vmware images to minimize the big file <br>
> changes getting backed up. Use dirvish-expire to manage storage.<br>
> And look on the mailing list archives, the wiki, and the many<br>
> FAQs and writeups created by other dirvish users for more hints.<br>
><br>
> If after doing all these things, dirvish is creating huge images<br>
> and not using hardlinks, filling up your backup disk too fast, there<br>
> may be other problems. The helpful people on this list can help<br>
> after you have made an effort characterize your problem.<br>
The thing is that I have no idea how to find the cause. With another<br>
computer it runs absolutely fine. I even don't know whether to search on<br>
the client or on the server side.<br>
<br>
The file system (for the backup) is ext3. I checked the size of the<br>
directory with du–all backups have nearly 40 gb (except those who have<br>
been interrupted). The remaining disk size (checked with df) decreases<br>
by the same amount. I did not check the inode numbers, but I think the<br>
decreasing disk size is proof enough.<br>
<br>
On my client I am running a normal rsync server (version 2.6.9). The<br>
server has enough rights to access the files.<br>
<br>
I suppose that it for some reason thinks the file has changed although<br>
it hasn't. But why? The file size and the date doesn't change.<br>
<br>
Jens<br>
_______________________________________________<br>
Dirvish mailing list<br>
Dirvish@dirvish.org<br>
http://www.dirvish.org/mailman/listinfo/dirvish<br>
</tt></font><font size=3><br>
</font>
<p>
<hr>
<p><font size=3>_______________________________________________<br>
Dirvish mailing list<br>
Dirvish@dirvish.org<br>
http://www.dirvish.org/mailman/listinfo/dirvish</font><font size=2><tt>_______________________________________________<br>
Dirvish mailing list<br>
Dirvish@dirvish.org<br>
http://www.dirvish.org/mailman/listinfo/dirvish<br>
</tt></font>
<p>