Re: [Duplicity-talk] gpg io error

[Mitchell Perilstein]

Nick, thanks for checking back.  Happy to gather any experiments needed.

New -v9 data, but no insights yet.  No, there's no disk errors in logs.

It was stopping on something in /var/spool/lpd, so I attempted an exclude on /var/spool 
since we don't care about it anyway, and try again.  (I put the exclude in the wrong 
place, so it attempted /var/spool again, so we get a trace of that below.)

There's no sockets, fifos, or giant files anywhere under /var/spool, just a link to a pid 
file which lpd has open.

--------------------------------------------------------------------------

# du -sh /var/spool
204K    /var/spool

# ls -lR /var/spool/lpd
/var/spool/lpd:
total 8
drwxrwsr-x    2 lp       lp           4096 Mar  2  2004 lp
lrwxrwxrwx    1 root     lp             16 Aug  7 06:47 lpd.lock -> 
/var/run/lpd.pid
drwxrwsr-x    2 lp       lp           4096 Mar  2  2004 remote

/var/spool/lpd/lp:
total 0

/var/spool/lpd/remote:
total 0

# ls -l /var/run/lpd.pid
-rw-r--r--    1 root     root            6 Aug  7 06:47 /var/run/lpd.pid

# lsof /var/run/lpd.pid
COMMAND   PID USER   FD   TYPE DEVICE SIZE    NODE NAME
lpd     11337 root    4wW  REG    3,1    6 4751369 /var/run/lpd.pid

# find /var/spool \( -type p -o -type s \)
 (none found)

# find /var/spool -exec wc {} \; >/dev/null 2>&1
 (terminates quickly)

--------------------------------------------------------------------------

  duplicity -v9 --encrypt-key KKKEEEEYYY --include /export --include /usr/local
   --include /home --include /etc --include /var --include /root
   --exclude /var/spool --exclude '**' / scp://address@hidden//home/foo/bar
Main action: inc
Reading results of 'ssh address@hidden ls /home/foo/bar'
Ignoring file 'duplicity-full-signatures.2004-07-13T20:08:14-04:00.sigtar.gpg'
Ignoring file 
'duplicity-new-signatures.2004-07-13T20:08:14-04:00.to.2004-07-15T11:25:13-04:00.sigtar.gpg'

     [....skip much....]

Selecting /var/spool/exim4/input
Comparing ('var', 'spool', 'exim4', 'input') and ('var', 'spool', 'exim4', 
'input')
Selecting /var/spool/exim4/msglog
Comparing ('var', 'spool', 'exim4', 'msglog') and ('var', 'spool', 'exim4', 
'msglog')
Selecting /var/spool/lpd
Comparing ('var', 'spool', 'lpd') and ('var', 'spool', 'lpd')
Getting delta of (('var', 'spool', 'lpd') /var/spool/lpd dir) and (('var', 'spool', 'lpd') 
dir)
Generating delta - new file: var/spool/lpd
Selecting /var/spool/lpd/lp
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 358, in ?
    if __name__ == "__main__": main()
  File "/usr/bin/duplicity", line 352, in main
    else: incremental_backup(sig_chain)
  File "/usr/bin/duplicity", line 162, in incremental_backup
    bytes_written = write_multivol("inc", tarblock_iter, globals.backend)
  File "/usr/bin/duplicity", line 75, in write_multivol
    globals.gpg_profile)
  File "/usr/lib/python2.3/site-packages/duplicity/gpg.py", line 211, in 
GPGWriteFile
    try: data = block_iter.next(bytes_to_go).data
  File "/usr/lib/python2.3/site-packages/duplicity/diffdir.py", line 407, in 
next
    result = self.process(self.input_iter.next(), size)
  File "/usr/lib/python2.3/site-packages/duplicity/diffdir.py", line 261, in 
get_delta_iter_w_sig
    for new_path, sig_path in collated:
  File "/usr/lib/python2.3/site-packages/duplicity/diffdir.py", line 177, in 
collate2iters
    try: relem2 = riter2.next()
  File "/usr/lib/python2.3/site-packages/duplicity/diffdir.py", line 234, in 
combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/lib/python2.3/site-packages/duplicity/diffdir.py", line 222, in 
refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/lib/python2.3/site-packages/duplicity/diffdir.py", line 211, in 
get_triple
    try: path = path_iter_list[iter_index].next()
  File "/usr/lib/python2.3/site-packages/duplicity/diffdir.py", line 156, in 
sigtar2path_iter
    sigtarobj.close()
  File "/usr/lib/python2.3/site-packages/duplicity/dup_temp.py", line 121, in 
close
    assert not self.fileobj.close()
  File "/usr/lib/python2.3/site-packages/duplicity/gpg.py", line 115, in close
    self.gpg_process.wait()
  File "/usr/lib/site-python/GnuPGInterface.py", line 639, in wait
    raise IOError, "GnuPG exited non-zero, with code %d" % (e << 8)
IOError: GnuPG exited non-zero, with code 131072
gpg: Error writing to `-': Broken pipe
gpg: handle plaintext failed: file write error
gpg: Error writing to `-': Broken pipe

....repeats a few pages then exits ....

--------------------------------------------------------------------------


My next experiment, tonight, will be to remove all the old files around in the destination 
directory and force a full, but it would be nice if there was a way to recognize this 
situation.


Nick Austin wrote:
> Did you have any luck with this?
>
> I would be interested in knowing what the cause was.
>
> Thanks!
>
> On Sun, Aug 07, 2005 at 06:15:42PM -0700, Nick Austin wrote:
>
> > Sure,
> >
> > Add --verbosity 9, and run it in its own shell.
> >
> > When the failure happens, look at which file it was processing, this could
> > be the problem.
> >
> > Also, check dmesg, etc... Look for drive failures.
> >
> > Now is a good time to hang on to your existing backup sets :)
> >
> > Thanks!
> >
> > On Sun, Aug 07, 2005 at 07:48:33PM -0400, Mitchell Perilstein wrote:
> >
> > > Hi Folks,
> > >
> > > After a year of reliable service, I'm starting to get an IOError exception. 
> > > Not being a py.wizard, I'm wondering if anyone has seen this or can help a 
> > > py.noob to help debug it?
> > >
> > > Thanks for any advice.
> > >
> > > duplicity -v4 --encrypt-key ZZZZZZZZZ --include /export --include 
> > > /usr/local --include
> > >  /home --include /etc --include /var --include /root --exclude '**'
> > >  / scp://address@hidden//home/foo/backup
> > > ...
> > > Warning, found incomplete backup sets, probably left from aborted session
>
>
> <..snip..>
>
> > > IOError: GnuPG exited non-zero, with code 131072

--
Mitchell Perilstein
Partner
ACE Technology Group, LLC
http://www.acetechgroup.com
(866) 229-1543 x11

mitch.vcf
Description: Vcard