Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16

[Farkas Levente]

Farkas Levente wrote:
> Andrew Ferguson wrote:
> > On Jun 24, 2008, at 6:27 AM, Farkas Levente wrote:
> > > yes, but the strange thing if i backup with:
> > > rdiff-backup --force -v5 --print-statistics --ssh-no-compression 
> > > --include-globbing-filelist /etc/rdiff-backup/filelist/windows / 
> > > /srv/backup/windows
> >
> > Ok, right here you have a problem.
> >
> > Do NOT specify the "--force" option unless you are willing to let your 
> > repository be destroyed. I added a bigger warning about it to the 
> > manpage in 1.1.16. Please, please, please do not run your scripts with 
> > that option. :-/
> >
> >
> >
> > Would you be willing to try 1.1.16 one more time and see if it 
> > produces the exact problem in the same way? This problem is really 
> > bugging me. I have been over all of the changes since 1.1.15 and 
> > nothing more jumps out at me.
>
> sorry for the delay, but i was very busy in this week. so 1.1.15 is 
> working all the week and i made 2 different backup of the rdiff-backup 
> directory so now i can play with it a bit.
> - i run rdiff-backup-1.1.15 again, then
> - install 1.1.16 and run exactly the same script again.
> first of all it takes very long! it seem it need to backup everything 
> for some reason when nothing change. it's all such lines:
> ------------------------------------------------------------
> Processing changed file mnt/windows/f/shared/Rajzok/2003/SDIH2
> Incrementing mirror file 
> /srv/backup/windows/mnt/windows/f/shared/Rajzok/2003/SDIH2
> Processing changed file mnt/windows/f/shared/Rajzok/2003/SDIH2/Adaptalas
> Incrementing mirror file 
> /srv/backup/windows/mnt/windows/f/shared/Rajzok/2003/SDIH2/Adaptalas
> Processing changed file 
> mnt/windows/f/shared/Rajzok/2003/SDIH2/Adaptalas/Eredeti
> ------------------------------------------------------------
> which means it's runs more than 12 hours on machine with multicore p4 
> 3ghz with 1gb ram (and the machine do nothing else!) and still not 
> finished. may be tomorrow...

of course just a after a few minutes later...
so why it takes so long?:
--------------[ Session statistics ]--------------
StartTime 1214746406.00 (Sun Jun 29 15:33:26 2008)
EndTime 1214773343.87 (Sun Jun 29 23:02:23 2008)
ElapsedTime 26937.87 (7 hours 28 minutes 57.87 seconds)
SourceFiles 3
SourceFileSize 0 (0 bytes)
MirrorFiles 85490
MirrorFileSize 87746670098 (81.7 GB)
NewFiles 0
NewFileSize 0 (0 bytes)
DeletedFiles 85487
DeletedFileSize 87746670098 (81.7 GB)
ChangedFiles 3
ChangedSourceSize 0 (0 bytes)
ChangedMirrorSize 0 (0 bytes)
IncrementFiles 85490
IncrementFileSize 57065001065 (53.1 GB)
TotalDestinationSizeChange -30681669033 (-28.6 GB)
Errors 5
--------------------------------------------------
because it's delete all my backups!!!
but now i've backup of backups:-)))
so as i said earlier it deletes everything! and it's true again!
now just to belive, what i did after that:
- downgrade to 1.1.15
- restore the backup
- rerun the backup with 1.1.15
- it takes 8 minutes and keep the restored backup (see the process bellow).
so there should have to be a serious bug somewhere in 1.1.16!

--------------------------------------------------
address@hidden:~]# rpm -Uvh rdiff-backup-1.1.15-0.x86_64.rpm --force
Preparing...                ###########################################
[100%]
   1:rdiff-backup           ###########################################
[100%]
address@hidden:~]# cd /srv/backup/
address@hidden:/srv/backup]# rsync -a --delete windows2/ windows/
address@hidden:/srv/backup]# /etc/rdiff-backup/command/windows
Start backup _windows_ :                 Mon Jun 30 08:14:20 CEST 2008
This utility only unmounts cifs filesystems.
rdiff-backup -v5 --print-statistics --ssh-no-compression 
--include-globbing-filelist /etc/rdiff-backup/filelist/windows / 
/srv/backup/windows
Using rdiff-backup version 1.1.15
escape_dos_devices not required by filesystem at /
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
  Access control lists                         On
  Extended attributes                          On
  Case sensitivity                             On
  Escape DOS devices                           Off
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
escape_dos_devices not required by filesystem at 
/srv/backup/windows/rdiff-backup-data/rdiff-backup.tmp.0
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
  Ownership changing                           On
  Hard linking                                 On
  fsync() directories                          On
  Directory inc permissions                    On
  High-bit permissions                         On
  Symlink permissions                          Off
  Extended filenames                           On
  Windows reserved filenames                   Off
  Access control lists                         On
  Extended attributes                          On
  Case sensitivity                             On
  Escape DOS devices                           Off
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Backup: must_escape_dos_devices = 0
Reading globbing filelist /etc/rdiff-backup/filelist/windows
Starting increment operation / to /srv/backup/windows
Warning: listattr(/mnt/windows/f/System Volume Information): [Errno 13] 
Permission denied

here comes a lots of such block:

ListError mnt/windows/f/shared/Document/2007/..... ???.dwg [Errno 2] No 
such file or directory
Exception '[Errno 2] No such file or directory' raised of class 
'exceptions.IOError':
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py", 
line 32, in check_common_error
    try: return function(*args)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 
1032, in append
    return self.__class__(self.conn, self.base, self.index + (ext,))
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 
757, in __init__
    else: self.setdata()
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 
782, in setdata
    if self.lstat(): self.conn.rpath.setdata_local(self)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 
1377, in setdata_local
    if Globals.eas_conn: rpath.data['ea'] = ea_get(rpath)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", 
line 565, in rpath_ea_get
    ea.read_from_rp(rp)
  File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", 
line 59, in read_from_rp
    try: attr_list = rp.conn.xattr.listxattr(rp.path)

and then:
--------------[ Session statistics ]--------------
StartTime 1214806461.00 (Mon Jun 30 08:14:21 2008)
EndTime 1214806943.30 (Mon Jun 30 08:22:23 2008)
ElapsedTime 482.30 (8 minutes 2.30 seconds)
SourceFiles 85493
SourceFileSize 87746745878 (81.7 GB)
MirrorFiles 85490
MirrorFileSize 87746745746 (81.7 GB)
NewFiles 3
NewFileSize 132 (132 bytes)
DeletedFiles 0
DeletedFileSize 0 (0 bytes)
ChangedFiles 12
ChangedSourceSize 0 (0 bytes)
ChangedMirrorSize 0 (0 bytes)
IncrementFiles 22
IncrementFileSize 0 (0 bytes)
TotalDestinationSizeChange 132 (132 bytes)
Errors 199
--------------------------------------------------
Backup windows takes :           8  minutes.



--
  Levente                               "Si vis pacem para bellum!"