[Duplicity-talk] gpg: too many files open

[Wolfgang Rohdewald]

I am getting this on restoring. Looking at /proc I find
66 gpg processes, and each of them has about 260 open pipes.

So that opened about 17000 pipes.

Any ideas?

GPG_KEY='...'
GPG_PW='...'
GPG_OPTS="--pinentry-mode loopback" # - needed for GPG 2.1+ _and_

Start duply v2.0.2, time is 2019-02-14 22:15:22.
Using profile '/etc/duply/skull'.
Using installed duplicity version 0.7.18.2, python 2.7.15rc1, gpg 2.2.4 (Home: 
/root/.gnupg), awk 'GNU Awk 4.1.4, API: 1.1 (GNU MPFR 4.0.1, GNU MP 6.1.2)', 
grep 'grep (GNU grep) 3.1', bash '4.4.19(1)-
release (x86_64-pc-linux-gnu)'.
Autoset found secret key of first GPG_KEY entry 'D3AB10749D60BE45' for signing.
Checking TEMP_DIR '/tmp' is a folder and writable (OK)
Test - Encrypt to 'D3AB10749D60BE45' & Sign with 'D3AB10749D60BE45' (OK)
Test - Decrypt (OK)
Test - Compare (OK)
Cleanup - Delete '/tmp/duply.7394.1550178922_*'(OK)

--- Start running command FETCH at 22:15:23.390 ---
Lokale und entfernte Metadaten sind bereits synchron, kein Abgleich benötigt.
Letzte vollständige Sicherung: Tue Jan 22 16:02:36 2019
Traceback (innermost last):
  File "/usr/local/bin/duplicity", line 1560, in <module>
    with_tempdir(main)
  File "/usr/local/bin/duplicity", line 1546, in with_tempdir
    fn()
  File "/usr/local/bin/duplicity", line 1398, in main
    do_backup(action)
  File "/usr/local/bin/duplicity", line 1477, in do_backup
    restore(col_stats)
  File "/usr/local/bin/duplicity", line 733, in restore
    restore_get_patched_rop_iter(col_stats)):
  File "/usr/local/lib/python2.7/dist-packages/duplicity/patchdir.py", line 
558, in Write_ROPaths
    for ropath in rop_iter:
  File "/usr/local/lib/python2.7/dist-packages/duplicity/patchdir.py", line 
521, in integrate_patch_iters
    for patch_seq in collated:
  File "/usr/local/lib/python2.7/dist-packages/duplicity/patchdir.py", line 
389, in yield_tuples
    setrorps(overflow, elems)
  File "/usr/local/lib/python2.7/dist-packages/duplicity/patchdir.py", line 
378, in setrorps
    elems[i] = iter_list[i].next()
  File "/usr/local/lib/python2.7/dist-packages/duplicity/patchdir.py", line 
107, in filter_path_iter
    for path in path_iter:
  File "/usr/local/lib/python2.7/dist-packages/duplicity/patchdir.py", line 
121, in difftar2path_iter
    tarinfo_list = [tar_iter.next()]
  File "/usr/local/lib/python2.7/dist-packages/duplicity/patchdir.py", line 
339, in next
    self.set_tarfile()
  File "/usr/local/lib/python2.7/dist-packages/duplicity/patchdir.py", line 
333, in set_tarfile
    self.current_fp = self.fileobj_iter.next()
  File "/usr/local/bin/duplicity", line 770, in get_fileobj_iter
    manifest.volume_info_dict[vol_num])
  File "/usr/local/bin/duplicity", line 813, in restore_get_enc_fileobj
    fileobj = tdp.filtered_open_with_delete("rb")
  File "/usr/local/lib/python2.7/dist-packages/duplicity/dup_temp.py", line 
120, in filtered_open_with_delete
    fh = FileobjHooked(path.DupPath.filtered_open(self, mode))
  File "/usr/local/lib/python2.7/dist-packages/duplicity/path.py", line 779, in 
filtered_open
    return gpg.GPGFile(False, self, gpg_profile)
  File "/usr/local/lib/python2.7/dist-packages/duplicity/gpg.py", line 225, in 
__init__
    'logger': self.logger_fp})
  File "/usr/local/lib/python2.7/dist-packages/duplicity/gpginterface.py", line 
374, in run
    create_fhs, attach_fhs)
  File "/usr/local/lib/python2.7/dist-packages/duplicity/gpginterface.py", line 
402, in _attach_fork_exec
    pipe = os.pipe()
 OSError: [Errno 24] Too many open files

-- 
Wolfgang