rdiff-backup-users
[Top][All Lists]
Advanced
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16

From: Farkas Levente
Subject: Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16
Date: Mon, 23 Jun 2008 23:12:15 +0200
User-agent: Thunderbird 2.0.0.14 (X11/20080501) 
Andrew Ferguson wrote:


On Jun 23, 2008, at 10:04 AM, Farkas Levente wrote:


Andrew Ferguson wrote:

On Jun 23, 2008, at 5:24 AM, Farkas Levente wrote:

Andrew Ferguson wrote:

On Jun 21, 2008, at 4:45 PM, Farkas Levente wrote:

hi,
we just try rdiff-backup-1.1.16 and we've got this error all the time we run: File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 58, in copyfileobj 
 inbuf = inputfp.read(blocksize)
File "/usr/lib64/python2.4/gzip.py", line 225, in read
 self._read(readsize)
File "/usr/lib64/python2.4/gzip.py", line 273, in _read
 self._read_eof()
File "/usr/lib64/python2.4/gzip.py", line 309, in _read_eof
 raise IOError, "CRC check failed"
IOError: CRC check failed

Hi Farkas,
Does this happen if you revert to 1.1.15? It doesn't look like a 1.1.16-specific bug to me. It looks more like trouble with a file or hardware (CRC check). Do you get this message all computers which you have installed 1.1.16 on? Or only this one? 
I agree the error message could be more helpful!
i've got only one system with 1.1.16 all other use the stable version. this one backup a windows server which is mounted as a cifs filesystem. the reason i try the latest development since there are many hungarian, vietnamese characters in filename and the stable release can't handle it. unfortunately this version has more error and it's not backup anything:-(. this means today i losse 90GB backup. so i start to think it'd be useful to give such option as in rsync --max-delete. 

our command was:
rdiff-backup -v5 --print-statistics --ssh-no-compression --include-globbing-filelist /etc/rdiff-backup/filelist/windows / /srv/backup/windows 

/etc/rdiff-backup/filelist/windows:
-----------------------------
- /mnt/windows/f/System**
- /mnt/windows/f/shared/backup
+ /mnt/windows/f/shared
- **
-----------------------------
my real problems what is the:
what is these file in the error log:
-----------------------------
mnt/windows/f/proc
mnt/windows/f/selinux
mnt/windows/f/sys
-----------------------------
there is no such files and shouldn't have to happened? ha can it be checked???
I'm afraid I don't understand what you've described. Are you claiming rdiff-backup tried to backup files which don't exist? I suppose that could happen since it doesn't look like you excluded "/srv/backup/windows" from the excluded paths. Remember, a circular backup is guaranteed to cause problems.
no. i backup / to /srv/backup/windows (just look at again my command line) this is a bigger script all backups backup / with different filelist. of course there is no such file as mnt/windows/f/proc and i don't know what's the reason for this: 
-----------------------------------
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 357, in read_from_rp 
   sListError mnt/windows/f/proc [Errno 95] Operation not supported
ListError mnt/windows/f/selinux [Errno 95] Operation not supported
ListError mnt/windows/f/sys [Errno 95] Operation not supported
-----------------------------------



Ok, this is what I'm thinking:
1) Rdiff-backup tried to open files like "/mnt/windows/f/proc" and "/mnt/windows/f/selinux" and "/mnt/windows/f/sys". These files MUST have existed when rdiff-backup was running -- there is no way for it to imagine files which don't exist!
2) You claim these files do not exist, never did, and never should. I am inclined to believe you since "proc" "selinux" and "sys" are all 
Linux-specific root-level directories.
The conclusion I draw from these two facts is that your mount points or filepaths were some how screwed-up while rdiff-backup was running. There was nothing rdiff-backup could do about that. The system was simply mis-configured at the time.
it's not happened once, it's always. there should have to be some bug in rdiff-backup somewhere. 
what kind of proof would be enough:
# ls -l /mnt/windows; rdiff-backup --force -v5 --print-statistics --ssh-no-compression --include-globbing-filelist /etc/rdiff-backup/filelist/windows / /srv/backup/windows 
total 24
drwxr-xr-x 2 root root 4096 Sep  6  2007 c
drwxr-xr-x 2 root root 4096 Sep  6  2007 d
drwxr-xr-x 2 root root 4096 Sep  6  2007 e
drwxrwxrwx 1 root root    0 Jun 23 22:00 f
Using rdiff-backup version 1.1.16
escape_dos_devices not required by filesystem at /
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
  Access control lists                         On
  Extended attributes                          On
  Case sensitivity                             On
  Escape DOS devices                           Off
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
escape_dos_devices not required by filesystem at /srv/backup/windows/rdiff-backup-data/rdiff-backup.tmp.0 
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
  Ownership changing                           On
  Hard linking                                 On
  fsync() directories                          On
  Directory inc permissions                    On
  High-bit permissions                         On
  Symlink permissions                          Off
  Extended filenames                           On
  Windows reserved filenames                   Off
  Access control lists                         On
  Extended attributes                          On
  Case sensitivity                             On
  Escape DOS devices                           Off
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Backup: must_escape_dos_devices = 0
Reading globbing filelist /etc/rdiff-backup/filelist/windows
Starting increment operation / to /srv/backup/windows
Exception '[Errno 95] Operation not supported' raised of class 'exceptions.IOError': File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py", line 32, in check_common_error 
    try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1050, in append 
    return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 767, in __init__ 
    else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 792, in setdata 
    if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1396, in setdata_local 
    if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 562, in rpath_acl_get 
    if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 357, in read_from_rp 
    self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 383, in get_acl_lists_from_rp 
    try: acl = posix1e.ACL(file=rp.path)

ListError dev [Errno 95] Operation not supported
Exception '[Errno 95] Operation not supported' raised of class 'exceptions.IOError': File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py", line 32, in check_common_error 
    try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1050, in append 
    return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 767, in __init__ 
    else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 792, in setdata 
    if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1396, in setdata_local 
    if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 562, in rpath_acl_get 
    if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 357, in read_from_rp 
    self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 383, in get_acl_lists_from_rp 
    try: acl = posix1e.ACL(file=rp.path)

ListError mnt/windows/f [Errno 95] Operation not supported
Exception '[Errno 95] Operation not supported' raised of class 'exceptions.IOError': File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py", line 32, in check_common_error 
    try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1050, in append 
    return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 767, in __init__ 
    else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 792, in setdata 
    if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1396, in setdata_local 
    if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 562, in rpath_acl_get 
    if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 357, in read_from_rp 
    self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 383, in get_acl_lists_from_rp 
    try: acl = posix1e.ACL(file=rp.path)

ListError mnt/windows/proc [Errno 95] Operation not supported
Exception '[Errno 95] Operation not supported' raised of class 'exceptions.IOError': File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py", line 32, in check_common_error 
    try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1050, in append 
    return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 767, in __init__ 
    else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 792, in setdata 
    if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1396, in setdata_local 
    if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 562, in rpath_acl_get 
    if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 357, in read_from_rp 
    self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 383, in get_acl_lists_from_rp 
    try: acl = posix1e.ACL(file=rp.path)

ListError mnt/windows/selinux [Errno 95] Operation not supported
Exception '[Errno 95] Operation not supported' raised of class 'exceptions.IOError': File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py", line 32, in check_common_error 
    try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1050, in append 
    return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 767, in __init__ 
    else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 792, in setdata 
    if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line 1396, in setdata_local 
    if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 562, in rpath_acl_get 
    if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 357, in read_from_rp 
    self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py", line 383, in get_acl_lists_from_rp 
    try: acl = posix1e.ACL(file=rp.path)

ListError mnt/windows/sys [Errno 95] Operation not supported
--------------[ Session statistics ]--------------
StartTime 1214254965.00 (Mon Jun 23 23:02:45 2008)
EndTime 1214254965.81 (Mon Jun 23 23:02:45 2008)
ElapsedTime 0.81 (0.81 seconds)
SourceFiles 3
SourceFileSize 0 (0 bytes)
MirrorFiles 3
MirrorFileSize 0 (0 bytes)
NewFiles 0
NewFileSize 0 (0 bytes)
DeletedFiles 0
DeletedFileSize 0 (0 bytes)
ChangedFiles 0
ChangedSourceSize 0 (0 bytes)
ChangedMirrorSize 0 (0 bytes)
IncrementFiles 0
IncrementFileSize 0 (0 bytes)
TotalDestinationSizeChange 0 (0 bytes)
Errors 5
--------------------------------------------------



I have two more concerns:
1) Why are you excluding /mnt/windows/... ? Is that the same machine as "backup" -- what is this mount setup you are running? It clearly has many parts. 

i wan't to backup /mnt/windows/ to /srv/backup/windows/
/mnt/windows/ is a mount point to where the windows drive is mounted.


2) Based on your include file, aren't you really just trying to do this:
$ rdiff-backup -v5 --print-statistics --ssh-no-compression --exclude /mnt/windows/f/shared/backup /mnt/windows/f/shared /srv/backup/windows 

Why aren't you running it like that?
yes this is true, but i've got more scripts which backup different remote and local hosts. that's why i use this way. anyway today i try exactly the above. now i've got a different character problem:
Exception '('Document', '2007', 'Hansol', 'Tectonbol', 'Jakab Tamastol pendrive', '07_0120_Hansol data', '070120 samjin lnd data', 'Samjin LND Sample', '????(?).JPG')' raised of class 'exceptions.KeyError': File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line 302, in error_check_Main 
    try: Main(arglist)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line 322, in Main 
    take_action(rps)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line 278, in take_action 
    elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line 344, in Backup 
    backup.Mirror(rpin, rpout)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 38, in Mirror 
    DestS.patch(dest_rpath, source_diffiter)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 230, in patch 
    for diff in rorpiter.FillInIter(source_diffiter, dest_rpath):
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py", line 177, in FillInIter 
    for rp in rpiter:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 103, in get_diffs 
    for dest_sig in dest_sigiter:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 166, in get_sigs 
    for src_rorp, dest_rorp in cls.CCPP:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 320, in next 
    source_rorp, dest_rorp = self.iter.next()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py", line 103, in Collate2Iters 
    for relem1 in riter1:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py", line 348, in next 
    del self.cache_dict[self.cache_indicies[0]]

Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 23, in ?
    rdiff_backup.Main.error_check_Main(sys.argv[1:])
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line 302, in error_check_Main 
    try: Main(arglist)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line 322, in Main 
    take_action(rps)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line 278, in take_action 
    elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line 344, in Backup 
    backup.Mirror(rpin, rpout)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 38, in Mirror 
    DestS.patch(dest_rpath, source_diffiter)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 230, in patch 
    for diff in rorpiter.FillInIter(source_diffiter, dest_rpath):
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py", line 177, in FillInIter 
    for rp in rpiter:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 103, in get_diffs 
    for dest_sig in dest_sigiter:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 166, in get_sigs 
    for src_rorp, dest_rorp in cls.CCPP:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py", line 320, in next 
    source_rorp, dest_rorp = self.iter.next()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py", line 103, in Collate2Iters 
    for relem1 in riter1:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py", line 348, in next 
    del self.cache_dict[self.cache_indicies[0]]
KeyError: ('Document', '2007', 'Hansol', 'Tectonbol', 'Jakab Tamastol pendrive', '07_0120_Hansol data', '070120 samjin lnd data', 'Samjin LND Sample', '????(?).JPG') 


--
  Levente                               "Si vis pacem para bellum!"
reply via email to
[Prev in Thread] Current Thread [Next in Thread]