rdiff-backup-users
[Top][All Lists]
Advanced
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[rdiff-backup-users] strange crash

From: Robert Weber
Subject: [rdiff-backup-users] strange crash
Date: Fri, 18 Apr 2003 16:45:32 -0600
User-agent: KMail/1.6.9 
I am backing up several systems on several platforms and I have found
almost everything works great.  I am running 0.10.2, and have found that my
MX server is the one problem.  /var/spool on this solaris 9 machine is
quite active(500,000/day on average) and it appears that rdiff-backup
doesn't like having files snatche out from under it.  Here is a -v 7 of the
backup(trimmed down) can Ben or anyone else figure out what is happening?
Is there any way rdiff-backup can go into a less strict mode where if a
devlock fails it can just keep going.  It would be better to get 99% of the
files than none of them in this case.


--
2 3 5 7 B D 11 13 17 1D 1F 25 29 2B 2F 35 3B    Robert Weber
3D 43 47 48 4F 53 59 61 65 67 6B 6D 71 7F 83    UnixOps/ITS UCB
89 8B 95 97 9D A3 A7 AD B3 B5 BF C1 C5 C7 D3    (303) 492-4532
DF E3 E5 E9 EF F1 FB ... still searching ... robertDASHpagerATcoloradoDOTedu

----- crash log -v 7 for wopr::/var/spool ------
Copying attributes from ('mqueue', 'dfh3GFDDnH004014') to 
/mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1741
Setting time of /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1741 to 
1050505994
Renaming /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1741 to 
/mirror/wopr/_var_spool/mqueue/dfh3GFDDnH004014
Setting time of /mirror/wopr/_var_spool/mqueue/dfh3GF7gnH002050 to 1050505662
Processing (Index: ('mqueue', 'dfh3GFGUnH005142')
Data: {'uid': 0, 'perms': 384, 'inode': 47997L, 'filetype': 'snapshot', 
'devloc': 30932995L, 'nlink': 1, 'mtime': 1050506192, 'gid': 25, 'atime': 
1050705243, 'type': 'reg', 'size': 64476L}, None).('mqueue', 'dfh3GFGUnH005142')
Writing file object to /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1742
Copying attributes from ('mqueue', 'dfh3GFGUnH005142') to 
/mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1742
Setting time of /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1742 to 
1050506192
Renaming /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1742 to 
/mirror/wopr/_var_spool/mqueue/dfh3GFGUnH005142
Setting time of /mirror/wopr/_var_spool/mqueue/dfh3GFDDnH004014 to 10Sending 
back exception devloc of type exceptions.KeyError: 
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 332, in answer_request
    result = apply(eval(request.function_string), argument_list)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 478, in readfromid
    return cls.vfiles[id].read(length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
160, in read
    if not self.addtobuffer(): break
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
178, in addtobuffer
    try: currentobj = self.iter.next()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
38, in ToRaw
    for rorp in rorp_iter:
  File "/usr/local/python/lib/python2.2/site-packages/rdiff_backup/lazy.py", 
line 179, in yielda
    elem = iter.next() # exception will be passed
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/selection.py", line 
149, in Iterate_fast
    try: dsrp, val = diryield_stack[-1].next()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/selection.py", line 
140, in diryield
    s = sel_func(new_dsrp)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/selection.py", line 
233, in Select
    result = sf(dsrp)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/selection.py", line 
427, in sel_func
    if dsrp.getdevloc() == root_devloc: return None
  File "/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rpath.py", 
line 377, in getdevloc
    return self.data['devloc']

Sending back exception devloc of type exceptions.KeyError: 
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 332, in answer_request
    result = apply(eval(request.function_string), argument_list)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 478, in readfromid
    return cls.vfiles[id].read(length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
160, in read
    if not self.addtobuffer(): break
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
178, in addtobuffer
    try: currentobj = self.iter.next()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
38, in ToRaw
    for rorp in rorp_iter:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/highlevel.py", line 
107, in diffs
    for dsrp, dest_sig in collated:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
158, in Collate2Iters
    try: relem2 = riter2.next()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
46, in FromRaw
    for index, data, num_files in raw_iter:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
66, in next
    type, data = self._get()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
45, in _get
    buf = self.file.read(length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
240, in read
    array_buf.fromstring(self.file.read(max(self.bufsize, l)))
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 510, in read
    return self.connection.VirtualFile.readfromid(self.id, length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 443, in __call__
    return apply(self.connection.reval, (self.name,) + args)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 365, in reval
    if isinstance(result, Exception): raise result

Exception 'devloc' raised of class 'exceptions.KeyError':
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/highlevel.py", line 
259, in patch_w_datadir_writes
    for indexed_tuple in collated:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
161, in Collate2Iters
    for relem1 in riter1:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
50, in FromRaw
    rorp.setfile(RORPIter.getnext(raw_iter))
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
178, in getnext
    try: next = iter.next()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
66, in next
    type, data = self._get()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
45, in _get
    buf = self.file.read(length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
240, in read
    array_buf.fromstring(self.file.read(max(self.bufsize, l)))
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 510, in read
    return self.connection.VirtualFile.readfromid(self.id, length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 443, in __call__
    return apply(self.connection.reval, (self.name,) + args)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 365, in reval
    if isinstance(result, Exception): raise result

Writing intermediate hard link data to disk
50505994
Processing (Index: ('mqueue', 'dfh3GFIsnH006126')
Data: {'uid': 0, 'perms': 384, 'inode': 45692L, 'filetype': 'snapshot', 
'devloc': 30932995L, 'nlink': 1, 'mtime': 1050506334, 'gid': 25, 'atime': 
1050705244, 'type': 'reg', 'size': 1552L}, None).('mqueue', 'dfh3GFIsnH006126')
Writing file object to /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1743
Copying attributes from ('mqueue', 'dfh3GFIsnH006126') to 
/mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1743
Setting time of /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1743 to 
1050506334
Renaming /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1743 to 
/mirror/wopr/_var_spool/mqueue/dfh3GFIsnH006126
Setting time of /mirror/wopr/_var_spool/mqueue/dfh3GFGUnH005142 to 1050506192
Processing (Index: ('mqueue', 'dfh3GFTinH009967')
Data: {'uid': 0, 'perms': 384, 'inode': 44251L, 'filetype': 'snapshot', 
'devloc': 30932995L, 'nlink': 1, 'mtime': 1050506984, 'gid': 25, 'atime': 
1050705244, 'type': 'reg', 'size': 47396L}, None).('mqueue', 'dfh3GFTinH009967')
Writing file object to /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1744
Copying attributes from ('mqueue', 'dfh3GFTinH009967') to 
/mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1744
Setting time of /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1744 to 
1050506984
Renaming /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1744 to 
/mirror/wopr/_var_spool/mqueue/dfh3GFTinH009967
Setting time of /mirror/wopr/_var_spool/mqueue/dfh3GFIsnH006126 to 1050506334
Processing (Index: ('mqueue', 'dfh3GFUMnH010204')
Data: {'uid': 0, 'perms': 384, 'inode': 46440L, 'filetype': 'snapshot', 
'devloc': 30932995L, 'nlink': 1, 'mtime': 1050507022, 'gid': 25, 'atime': 
1050705244, 'type': 'reg', 'size': 10884L}, None).('mqueue', 'dfh3GFUMnH010204')
Writing file object to /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1745
Copying attributes from ('mqueue', 'dfh3GFUMnH010204') to 
/mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1745
Setting time of /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1745 to 
1050507022
Renaming /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1745 to 
/mirror/wopr/_var_spool/mqueue/dfh3GFUMnH010204
Setting time of /mirror/wopr/_var_spool/mqueue/dfh3GFTinH009967 to 1050506984
Processing (Index: ('mqueue', 'dfh3GFrUnH018469')
Data: {'uid': 0, 'perms': 384, 'inode': 47594L, 'filetype': 'snapshot', 
'devloc': 30932995L, 'nlink': 1, 'mtime': 1050508410, 'gid': 25, 'atime': 
1050705244, 'type': 'reg', 'size': 3088L}, None).('mqueue', 'dfh3GFrUnH018469')
Writing file object to /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1746
Copying attributes from ('mqueue', 'dfh3GFrUnH018469') to 
/mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1746
Setting time of /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1746 to 
1050508410
Renaming /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1746 to 
/mirror/wopr/_var_spool/mqueue/dfh3GFrUnH018469
Setting time of /mirror/wopr/_var_spool/mqueue/dfh3GFUMnH010204 to 1050507022
Processing (Index: ('mqueue', 'dfh3GGAUnH025238')
Data: {'uid': 0, 'perms': 384, 'inode': 50931L, 'filetype': 'snapshot', 
'devloc': 30932995L, 'nlink': 1, 'mtime': 1050509484, 'gid': 25, 'atime': 
1050705244, 'type': 'reg', 'size': 597L}, None).('mqueue', 'dfh3GGAUnH025238')
Writing file object to /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1747
Copying attributes from ('mqueue', 'dfh3GGAUnH025238') to 
/mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1747
Setting time of /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1747 to 
1050509484
Renaming /mirror/wopr/_var_spool/mqueue/rdiff-backup.tmp.1747 to 
/mirror/wopr/_var_spool/mqueue/dfh3GGAUnH025238
Setting time of /mirror/wopr/_var_spool/mqueue/dfh3GFrUnH018469 to 1050508410
Sending back exception devloc of type exceptions.KeyError: 
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 332, in answer_request
    result = apply(eval(request.function_string), argument_list)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 478, in readfromid
    return cls.vfiles[id].read(length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
160, in read
    if not self.addtobuffer(): break
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
178, in addtobuffer
    try: currentobj = self.iter.next()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
38, in ToRaw
    for rorp in rorp_iter:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
77, in Signatures
    for rp in rp_iter:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/highlevel.py", line 
173, in generate_dissimilar
    for src_rorp, dest_dsrp in collated:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
161, in Collate2Iters
    for relem1 in riter1:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
46, in FromRaw
    for index, data, num_files in raw_iter:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
66, in next
    type, data = self._get()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
45, in _get
    buf = self.file.read(length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
240, in read
    array_buf.fromstring(self.file.read(max(self.bufsize, l)))
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 510, in read
    return self.connection.VirtualFile.readfromid(self.id, length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 443, in __call__
    return apply(self.connection.reval, (self.name,) + args)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 365, in reval
    if isinstance(result, Exception): raise result

Writing checkpoint time 1050705817.62
Renaming /mirror/wopr/_var_spool/rdiff-backup-data/rdiff-backup.tmp.1748 to 
/mirror/wopr/_var_spool/rdiff-backup-data/checkpoint-data.2003-04-18T16:43:03-06:00.data
Renaming /mirror/wopr/_var_spool/rdiff-backup-data/rdiff-backup.tmp.1749 to 
/mirror/wopr/_var_spool/rdiff-backup-data/last-file-incremented.2003-04-18T16:43:03-06:00.data
Renaming /mirror/wopr/_var_spool/rdiff-backup-data/rdiff-backup.tmp.1750 to 
/mirror/wopr/_var_spool/rdiff-backup-data/hardlink_source_inode_checkpoint.2003-04-18T16:43:03-06:00.data
Renaming /mirror/wopr/_var_spool/rdiff-backup-data/rdiff-backup.tmp.1751 to 
/mirror/wopr/_var_spool/rdiff-backup-data/hardlink_source_index_checkpoint.2003-04-18T16:43:03-06:00.data
Renaming /mirror/wopr/_var_spool/rdiff-backup-data/rdiff-backup.tmp.1752 to 
/mirror/wopr/_var_spool/rdiff-backup-data/hardlink_dest_inode_checkpoint.2003-04-18T16:43:03-06:00.data
Renaming /mirror/wopr/_var_spool/rdiff-backup-data/rdiff-backup.tmp.1753 to 
/mirror/wopr/_var_spool/rdiff-backup-data/hardlink_dest_index_checkpoint.2003-04-18T16:43:03-06:00.data
Touching 
/mirror/wopr/_var_spool/rdiff-backup-data/last-file-definitive.2003-04-18T16:43:03-06:00.data
Traceback (most recent call last):
  File "/usr/local/python/bin/rdiff-backup", line 24, in ?
    rdiff_backup.Main.Main(sys.argv[1:])
  File "/usr/local/python/lib/python2.2/site-packages/rdiff_backup/Main.py", 
line 229, in Main
    take_action(rps)
  File "/usr/local/python/lib/python2.2/site-packages/rdiff_backup/Main.py", 
line 205, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/local/python/lib/python2.2/site-packages/rdiff_backup/Main.py", 
line 263, in Backup
    else: HighLevel.Mirror(rpin, rpout, incdir, RSI)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/highlevel.py", line 
48, in Mirror
    DestS.patch_w_datadir_writes(dest_rpath, diffiter, inc_rpath)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/highlevel.py", line 
270, in patch_w_datadir_writes
    except: cls.handle_last_error(finished_dsrp, finalizer, ITR)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/highlevel.py", line 
259, in patch_w_datadir_writes
    for indexed_tuple in collated:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
161, in Collate2Iters
    for relem1 in riter1:
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
50, in FromRaw
    rorp.setfile(RORPIter.getnext(raw_iter))
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/rorpiter.py", line 
178, in getnext
    try: next = iter.next()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
66, in next
    type, data = self._get()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
45, in _get
    buf = self.file.read(length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/iterfile.py", line 
240, in read
    array_buf.fromstring(self.file.read(max(self.bufsize, l)))
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 510, in read
    return self.connection.VirtualFile.readfromid(self.id, length)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 443, in __call__
    return apply(self.connection.reval, (self.name,) + args)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 365, in reval
    if isinstance(result, Exception): raise result
KeyError: devloc
Traceback (most recent call last):
  File "/usr/local/etc/rdiff-backup", line 24, in ?
    rdiff_backup.Main.Main(sys.argv[1:])
  File "/usr/local/python/lib/python2.2/site-packages/rdiff_backup/Main.py", 
line 229, in Main
    take_action(rps)
  File "/usr/local/python/lib/python2.2/site-packages/rdiff_backup/Main.py", 
line 204, in take_action
    if action == "server": PipeConnection(sys.stdin, sys.stdout).Server()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 350, in Server
    self.get_response(-1)
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 313, in get_response
    try: req_num, object = self._get()
  File 
"/usr/local/python/lib/python2.2/site-packages/rdiff_backup/connection.py", 
line 219, in _get
    raise ConnectionReadError("Truncated header string (problem "
rdiff_backup.connection.ConnectionReadError: Truncated header string (problem 
probably originated remotely)
reply via email to
[Prev in Thread] Current Thread [Next in Thread]