Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16

[Farkas Levente]

Andrew Ferguson wrote:
> On Jun 23, 2008, at 5:12 PM, Farkas Levente wrote:
>
> > what kind of proof would be enough:
> >
> > # ls -l /mnt/windows; rdiff-backup --force -v5 --print-statistics 
> > --ssh-no-compression --include-globbing-filelist 
> > /etc/rdiff-backup/filelist/windows / /srv/backup/windows
> > total 24
> > drwxr-xr-x 2 root root 4096 Sep  6  2007 c
> > drwxr-xr-x 2 root root 4096 Sep  6  2007 d
> > drwxr-xr-x 2 root root 4096 Sep  6  2007 e
> > drwxrwxrwx 1 root root    0 Jun 23 22:00 f
>
> Whoa! Why is 'f' so different? I doubt it is only a coincidence that 'f' 
> is the one giving you problems...
>
> c, d, and e all have a count of '2' for link counts, and 'f' has 
> completely different permissions, and also a size of '0' !! I think 
> another important question is: What does the output of `mount` look like?

because that's the mount point:
address@hidden:/mnt/windows/f]# mount
/dev/mapper/VolGroup00-LogVol01 on / type ext3 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
/dev/md0 on /boot type ext3 (rw)
tmpfs on /dev/shm type tmpfs (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
//10.10.10.2/F$ on /mnt/windows/f type cifs (rw,mand)
address@hidden:/mnt/windows/f]# ls -al /mnt/windows/f
total 8
drwxrwxrwx 1 root root    0 Jun 23 23:12 .
drwxr-xr-x 6 root root 4096 Sep  6  2007 ..
drwxrwxrwx 1 root root    0 Dec 29  2006 Exchsrvr
drwxrwxrwx 1 root root    0 Dec 28  2006 Exchsrvr old
drwxrwxrwx 1 root root    0 May 23 12:54 mp3&video
drwxrwxrwx 1 root root    0 Dec 28  2006 pstk
drwxrwxrwx 1 root root    0 May 30  2007 RECYCLER
drwxrwxrwx 1 root root    0 Dec 29  2006 sbs
drwxrwxrwx 1 root root    0 Jan 24 11:12 shared
drwxrwxrwx 1 root root    0 Jun 23 22:28 System Volume Information
drwxrwxrwx 1 root root    0 Mar 13 10:00 temp
drwxrwxrwx 1 root root    0 Jan 13  2007 urlcache
drwxrwxrwx 1 root root    0 May  5 18:27 Users Shared Folders
drwxrwxrwx 1 root root    0 Jan 13  2007 WSUS


> > Using rdiff-backup version 1.1.16
> >
> > --------------[ Session statistics ]--------------
> > StartTime 1214254965.00 (Mon Jun 23 23:02:45 2008)
> > EndTime 1214254965.81 (Mon Jun 23 23:02:45 2008)
> > ElapsedTime 0.81 (0.81 seconds)
> > SourceFiles 3
> > SourceFileSize 0 (0 bytes)
> > MirrorFiles 3
> > MirrorFileSize 0 (0 bytes)
> > NewFiles 0
> > NewFileSize 0 (0 bytes)
> > DeletedFiles 0
> > DeletedFileSize 0 (0 bytes)
> > ChangedFiles 0
> > ChangedSourceSize 0 (0 bytes)
> > ChangedMirrorSize 0 (0 bytes)
> > IncrementFiles 0
> > IncrementFileSize 0 (0 bytes)
> > TotalDestinationSizeChange 0 (0 bytes)
> > Errors 5
> > --------------------------------------------------
>
>
> rdiff-backup completed without any problems! The 5 errors above are all 
> meaningless and should have been suppressed.
>
> However -- it is really important to notice something else in these 
> statistics: There are only 3 SourceFiles ! This explains why 
> rdiff-backup deleted your back before -- the underlying filesystem is 
> missing all of its files. When rdiff-backup executed, it faithfully 
> mirrored the now nearly-empty directory. I bet all of your old files are 
> in the increments directory, safely stored.

just see the above ls output and this (it doesn't seem to be only 3 files):
address@hidden:/mnt/windows/f]# du -sk /mnt/windows/f/shared/
96143110        /mnt/windows/f/shared/

> > Exception '('Document', '2007', 'Hansol', 'Tectonbol', 'Jakab Tamastol 
> > pendrive', '07_0120_Hansol data', '070120 samjin lnd data', 'Samjin 
> > LND Sample', '????(?).JPG')' raised of class 'exceptions.KeyError':
>
> Yes, this looks like a character problem. Hmm. It is completely separate 
> from what you are seeing before and is 100% due to the Vietnamese 
> characters.

yes, but the strange thing if i backup with:
rdiff-backup --force -v5 --print-statistics --ssh-no-compression 
--include-globbing-filelist /etc/rdiff-backup/filelist/windows / 
/srv/backup/windows
-----------------------------------
with this filelist:
-----------------------------------
- /mnt/windows/f/System**
- /mnt/windows/f/shared/backup
+ /mnt/windows/f/shared
- **
-----------------------------------
than only see 3 files. if i backup with
rdiff-backup -v5 --print-statistics --ssh-no-compression --exclude 
/mnt/windows/f/shared/backup /mnt/windows/f/shared /srv/backup/windows
then i've got the above charset problem. so why see the files in that case?
so imho there are two different bug but unfortunately both prevent me to 
do a backup:-(

> Well, there are at least two places where this problem could be: the SMB 
> mount, and rdiff-backup.
>
> - What is the name of that file when you access it directly on Windows?

it's a hard question, how can i write it down here:-)?

> - What is the name of that file when you look at it from Unix?

ls /mnt/windows/f/shared/Document/2007/Hansol/Tectonbol/Jakab\ Tamastol\ 
pendrive/07_0120_Hansol\ data/070120\ samjin\ lnd\ data/Samjin\ LND\ Sample/
?????1.JPG        ?????2.JPG    ???2.JPG           ????(?)3.JPG 
??????.JPG         ?????(?).JPG  ????(??).JPG  ??(????).JPG
1? ???????.JPG    ?????2.JPG    2? ??? ??????.JPG  ????(?)3.JPG 
?????.JPG          ?????(?).JPG  ????(?).JPG   Thumbs.db
1? ???.JPG        ????(?)2.JPG  2? ??? ??.JPG      ???3.JPG 
?????.JPG          ????.JPG      ????(?).JPG   TV?? ???.JPG
1.JPG             ????(?)2.JPG  2? ??(???).JPG     3.JPG 
?????.JPG          ????.JPG      ????(?).JPG   TV?????.JPG
2? ?????2.JPG     ????(?)2.JPG  2?????.JPG         BLU?????????.JPG 
?????(??????).JPG  ????.JPG      ????(?).JPG
???????????2.JPG  ????2.JPG     2.JPG              BLU.JPG 
?????(????).JPG    ????(??).JPG  ???.JPG


> - What options are you using to mount that directory? Codepages? iocharset?

-oiocharset=iso8859-2 unfortunately there is no codepage in cifs (which 
is superior to smbfs)

> Please take a look at the second bullet under the CIFS entry in the FAQ:
> http://www.nongnu.org/rdiff-backup/FAQ.html#cifs
>
> There is also an entry in the Wiki about this:
> http://wiki.rdiff-backup.org/wiki/index.php/BackingUpUnicodeToSmbfsMount

i'll try to see what's happend with smbfs.
but my last concern is still a few problems. it'd be much better for me 
if the above charset error do not prevent me to do a backup. eg in case 
of the above problem only get warning and rdiff-backup skip the given 
files. ie. i'd like to see if rdiff-backup only stop in case of real 
unrecoverable error.
anyway i now downgrade to 1.1.15 and run my original backup and it seems 
to running (although it takes a few hours to backup 90GB). see what's 
happen.
yours.

--
  Levente                               "Si vis pacem para bellum!"