Re: [Duplicity-talk] gpg: too many files open

[Wolfgang Rohdewald]

On Do, 2019-02-14 at 22:29 +0100, Wolfgang Rohdewald via Duplicity-talk wrote:
> I am getting this on restoring. Looking at /proc I find
> 66 gpg processes, and each of them has about 260 open pipes.
> 
> So that opened about 17000 pipes.
> 
> Any ideas?

since I urgently needed the data, I drastically increased ulimit -n.

I believe the problem is that I have a LOT of small incremental
backups (one every work hour), 392 incrementals since last full backup.

And I believe duplicity calls GnuPG.run() for each and every inc
backup and releases all of them only when ending the process.
I added some debug output and got:

Verarbeitung des lokalen Manifest 
/root/.cache/duplicity/duply_skull/duplicity-inc.20190125T200203Z.to.20190125T210204Z.manifest
 (166)
Manifest-Volumen 1 gefunden
1 Volumen in Manifest gefunden
(mktemp) temporäre Datei /tmp/duplicity-a4mLfv-tempdir/mktemp-1ksqTV-59 wird 
registriert
('GnuPG.run gets create_fhs', ['stdout', 'passphrase'])
('len(create_fhs):', 2)
Verarbeitung des lokalen Manifest 
/root/.cache/duplicity/duply_skull/duplicity-inc.20190125T210204Z.to.20190125T220204Z.manifest
 (166)
Manifest-Volumen 1 gefunden
1 Volumen in Manifest gefunden
(mktemp) temporäre Datei /tmp/duplicity-a4mLfv-tempdir/mktemp-FI6AnK-60 wird 
registriert
('GnuPG.run gets create_fhs', ['stdout', 'passphrase'])
('len(create_fhs):', 2)



-- 
Wolfgang