|
| From: | Yang Zhang |
| Subject: | Re: [Duplicity-talk] OSError: [Errno 24] Too many open files |
| Date: | Wed, 13 May 2009 11:49:16 -0400 |
| User-agent: | Thunderbird 2.0.0.21 (X11/20090409) |
Same here - I only started seeing these after the upgrade to Jaunty.$ duplicity collection-status scp://hv//export/home/yang/backup-zs.ath.cx/backup
Last full backup date: Wed May 7 03:05:03 2008
Collection Status
-----------------
Connecting with backend: SSHBackend
Archive dir: None
Found 0 backup chains without signatures.
Found a complete backup chain with matching signature chain:
-------------------------
Chain start time: Wed May 7 03:05:03 2008
Chain end time: Thu Apr 30 07:10:03 2009
Number of contained backup sets: 338
Total number of contained volumes: 1974
Type of backup set: Time: Num volumes:
Full Wed May 7 03:05:03 2008 950
Incremental Fri May 9 17:35:45 2008 1
Incremental Fri May 9 17:53:01 2008 1
Incremental Sat May 10 07:10:01 2008 1
Incremental Sun May 11 07:10:02 2008 4
Incremental Mon May 12 07:10:01 2008 1
Incremental Tue May 13 07:10:02 2008 1
Incremental Wed May 14 07:10:02 2008 1
Incremental Thu May 15 07:10:02 2008 1
Incremental Fri May 16 07:10:02 2008 1
Incremental Sat May 17 07:10:02 2008 1
Incremental Sun May 18 07:10:03 2008 1
Incremental Mon May 19 07:10:03 2008 1
Incremental Tue May 20 07:10:02 2008 1
Incremental Wed May 21 07:10:01 2008 1
Incremental Thu May 22 07:10:02 2008 1
Incremental Fri May 23 07:10:01 2008 1
Incremental Sat May 24 07:10:02 2008 1
Incremental Sun May 25 07:10:02 2008 1
Incremental Mon May 26 07:10:03 2008 1
Incremental Tue May 27 07:10:03 2008 1
Incremental Wed May 28 07:10:01 2008 1
Incremental Thu May 29 07:10:02 2008 1
Incremental Mon Jun 2 07:10:02 2008 1
Incremental Tue Jun 3 07:10:01 2008 1
Incremental Wed Jun 4 07:10:02 2008 1
Incremental Thu Jun 5 07:10:02 2008 1
Incremental Fri Jun 6 07:10:01 2008 1
Incremental Sat Jun 7 07:10:02 2008 1
Incremental Sun Jun 8 07:10:03 2008 1
Incremental Mon Jun 9 07:10:01 2008 1
Incremental Tue Jun 10 07:10:02 2008 1
Incremental Wed Jun 11 07:10:01 2008 1
Incremental Thu Jun 12 07:10:01 2008 1
Incremental Fri Jun 13 07:10:02 2008 1
Incremental Sat Jun 14 07:10:02 2008 1
Incremental Sun Jun 15 07:10:01 2008 1
Incremental Mon Jun 16 07:10:01 2008 1
Incremental Tue Jun 17 07:10:01 2008 1
Incremental Wed Jun 18 07:10:01 2008 1
Incremental Thu Jun 19 07:10:01 2008 1
Incremental Fri Jun 20 07:10:02 2008 1
Incremental Sat Jun 21 07:10:03 2008 1
Incremental Sun Jun 22 07:10:03 2008 1
Incremental Mon Jun 23 07:10:03 2008 1
Incremental Tue Jun 24 07:10:02 2008 1
Incremental Wed Jun 25 07:10:02 2008 1
Incremental Thu Jun 26 07:10:03 2008 1
Incremental Fri Jun 27 07:10:02 2008 1
Incremental Sat Jun 28 07:10:03 2008 1
Incremental Sun Jun 29 07:10:03 2008 168
Incremental Mon Jun 30 07:10:02 2008 1
Incremental Wed Jul 2 07:10:03 2008 1
Incremental Thu Jul 3 07:10:02 2008 168
Incremental Fri Jul 4 07:10:02 2008 42
Incremental Sat Jul 5 07:10:02 2008 1
Incremental Sun Jul 6 07:10:03 2008 1
Incremental Mon Jul 7 07:10:03 2008 1
Incremental Tue Jul 8 07:10:02 2008 32
Incremental Wed Jul 9 07:10:02 2008 32
Incremental Thu Jul 10 07:10:02 2008 1
Incremental Fri Jul 11 07:10:02 2008 1
Incremental Sat Jul 12 07:10:01 2008 1
Incremental Sun Jul 13 07:10:01 2008 1
Incremental Mon Jul 14 07:10:03 2008 23
Incremental Wed Jul 16 07:10:02 2008 6
Incremental Thu Jul 17 07:10:03 2008 1
Incremental Fri Jul 18 07:10:01 2008 1
Incremental Sat Jul 19 07:10:02 2008 1
Incremental Sun Jul 20 07:10:02 2008 1
Incremental Mon Jul 21 07:10:02 2008 4
Incremental Tue Jul 22 07:10:02 2008 6
Incremental Wed Jul 23 07:10:02 2008 13
Incremental Thu Jul 24 07:10:03 2008 1
Incremental Fri Jul 25 07:10:02 2008 1
Incremental Sat Jul 26 07:10:02 2008 1
Incremental Sun Jul 27 07:10:02 2008 13
Incremental Mon Jul 28 07:10:01 2008 1
Incremental Tue Jul 29 07:10:02 2008 1
Incremental Wed Jul 30 07:10:02 2008 1
Incremental Thu Jul 31 07:10:01 2008 1
Incremental Sat Aug 2 07:10:01 2008 1
Incremental Sun Aug 3 07:10:02 2008 1
Incremental Mon Aug 4 07:10:02 2008 1
Incremental Tue Aug 5 07:10:02 2008 1
Incremental Wed Aug 6 07:10:02 2008 1
Incremental Thu Aug 7 07:10:03 2008 1
Incremental Fri Aug 8 07:10:02 2008 1
Incremental Sat Aug 9 07:10:02 2008 1
Incremental Sun Aug 10 07:10:02 2008 1
Incremental Tue Aug 12 07:10:02 2008 6
Incremental Wed Aug 13 07:10:02 2008 1
Incremental Fri Aug 15 07:10:02 2008 1
Incremental Sat Aug 16 07:10:02 2008 1
Incremental Sun Aug 17 07:10:02 2008 1
Incremental Mon Aug 18 07:10:01 2008 1
Incremental Tue Aug 19 07:10:02 2008 4
Incremental Wed Aug 20 07:10:02 2008 1
Incremental Thu Aug 21 07:10:03 2008 1
Incremental Fri Aug 22 07:10:03 2008 1
Incremental Sat Aug 23 07:10:02 2008 1
Incremental Sun Aug 24 07:10:03 2008 1
Incremental Mon Aug 25 07:10:02 2008 1
Incremental Tue Aug 26 07:10:02 2008 1
Incremental Wed Aug 27 07:10:02 2008 1
Incremental Thu Aug 28 07:10:02 2008 1
Incremental Fri Aug 29 07:10:02 2008 1
Incremental Sat Aug 30 07:10:02 2008 1
Incremental Sun Aug 31 07:10:03 2008 1
Incremental Tue Sep 2 07:10:02 2008 1
Incremental Wed Sep 3 07:10:03 2008 1
Incremental Thu Sep 4 07:10:02 2008 1
Incremental Fri Sep 5 07:10:02 2008 1
Incremental Sat Sep 6 07:10:02 2008 1
Incremental Sun Sep 7 07:10:02 2008 1
Incremental Mon Sep 8 07:10:02 2008 1
Incremental Tue Sep 9 07:10:02 2008 1
Incremental Wed Sep 10 07:10:02 2008 1
Incremental Thu Sep 11 07:10:03 2008 1
Incremental Fri Sep 12 07:10:02 2008 1
Incremental Sat Sep 13 07:10:01 2008 1
Incremental Sun Sep 14 07:10:02 2008 1
Incremental Mon Sep 15 07:10:02 2008 1
Incremental Tue Sep 16 07:10:02 2008 1
Incremental Wed Sep 17 07:10:02 2008 1
Incremental Thu Sep 18 07:10:03 2008 1
Incremental Fri Sep 19 07:10:01 2008 1
Incremental Sat Sep 20 07:10:02 2008 1
Incremental Sun Sep 21 07:10:02 2008 1
Incremental Mon Sep 22 07:10:02 2008 1
Incremental Tue Sep 23 07:10:02 2008 1
Incremental Wed Sep 24 07:10:02 2008 1
Incremental Thu Sep 25 07:10:03 2008 1
Incremental Fri Sep 26 07:10:02 2008 1
Incremental Sat Sep 27 07:10:02 2008 1
Incremental Sun Sep 28 07:10:03 2008 1
Incremental Tue Sep 30 07:10:02 2008 1
Incremental Thu Oct 2 07:10:02 2008 1
Incremental Fri Oct 3 07:10:03 2008 1
Incremental Sat Oct 4 07:10:02 2008 1
Incremental Sun Oct 5 07:10:02 2008 1
Incremental Mon Oct 6 07:10:03 2008 1
Incremental Tue Oct 7 07:10:02 2008 1
Incremental Wed Oct 8 07:10:02 2008 1
Incremental Thu Oct 9 07:10:02 2008 1
Incremental Fri Oct 10 07:10:02 2008 1
Incremental Sat Oct 11 07:10:02 2008 1
Incremental Sun Oct 12 07:10:01 2008 1
Incremental Mon Oct 13 07:10:03 2008 1
Incremental Tue Oct 14 07:10:02 2008 1
Incremental Wed Oct 15 07:10:02 2008 1
Incremental Thu Oct 16 07:10:02 2008 1
Incremental Fri Oct 17 07:10:03 2008 1
Incremental Sat Oct 18 07:10:02 2008 1
Incremental Sun Oct 19 07:10:02 2008 1
Incremental Mon Oct 20 07:10:02 2008 1
Incremental Tue Oct 21 07:10:03 2008 1
Incremental Wed Oct 22 07:10:02 2008 1
Incremental Thu Oct 23 07:10:02 2008 1
Incremental Fri Oct 24 07:10:02 2008 1
Incremental Sat Oct 25 07:10:02 2008 1
Incremental Sun Oct 26 07:10:03 2008 1
Incremental Mon Oct 27 07:10:02 2008 1
Incremental Tue Oct 28 07:10:02 2008 1
Incremental Wed Oct 29 07:10:02 2008 1
Incremental Thu Oct 30 07:10:02 2008 1
Incremental Fri Oct 31 07:10:03 2008 1
Incremental Sun Nov 2 07:10:02 2008 1
Incremental Mon Nov 3 07:10:02 2008 1
Incremental Tue Nov 4 07:10:02 2008 1
Incremental Wed Nov 5 07:10:03 2008 1
Incremental Thu Nov 6 07:10:03 2008 1
Incremental Fri Nov 7 07:10:03 2008 1
Incremental Sat Nov 8 07:10:03 2008 1
Incremental Sun Nov 9 07:10:01 2008 5
Incremental Mon Nov 10 07:10:02 2008 1
Incremental Tue Nov 11 07:10:02 2008 1
Incremental Wed Nov 12 07:10:03 2008 1
Incremental Thu Nov 13 07:10:03 2008 1
Incremental Fri Nov 14 07:10:02 2008 1
Incremental Sat Nov 15 07:10:02 2008 1
Incremental Mon Nov 17 07:10:01 2008 1
Incremental Tue Nov 18 07:10:02 2008 1
Incremental Wed Nov 19 07:10:02 2008 1
Incremental Thu Nov 20 07:10:03 2008 1
Incremental Fri Nov 21 07:10:03 2008 1
Incremental Sat Nov 22 07:10:01 2008 1
Incremental Sun Nov 23 07:10:03 2008 1
Incremental Mon Nov 24 07:10:03 2008 7
Incremental Tue Nov 25 07:10:02 2008 1
Incremental Wed Nov 26 07:10:03 2008 1
Incremental Thu Nov 27 07:10:02 2008 1
Incremental Fri Nov 28 07:10:02 2008 1
Incremental Sat Nov 29 07:10:03 2008 1
Incremental Sun Nov 30 07:10:03 2008 1
Incremental Tue Dec 2 07:10:02 2008 10
Incremental Wed Dec 3 07:10:02 2008 1
Incremental Thu Dec 4 07:10:03 2008 1
Incremental Fri Dec 5 07:10:02 2008 1
Incremental Sat Dec 6 07:10:02 2008 1
Incremental Sun Dec 7 07:10:03 2008 1
Incremental Mon Dec 8 07:10:02 2008 1
Incremental Thu Dec 11 07:10:02 2008 1
Incremental Fri Dec 12 07:10:02 2008 1
Incremental Sat Dec 13 07:10:02 2008 1
Incremental Sun Dec 14 07:10:01 2008 1
Incremental Mon Dec 15 07:10:03 2008 1
Incremental Tue Dec 16 07:10:05 2008 62
Incremental Wed Dec 17 07:10:02 2008 1
Incremental Thu Dec 18 07:10:02 2008 1
Incremental Fri Dec 19 07:10:02 2008 1
Incremental Sat Dec 20 07:10:02 2008 1
Incremental Sun Dec 21 07:10:02 2008 1
Incremental Mon Dec 22 07:10:01 2008 1
Incremental Tue Dec 23 07:10:02 2008 1
Incremental Wed Dec 24 07:10:02 2008 1
Incremental Thu Dec 25 07:10:02 2008 1
Incremental Fri Dec 26 07:10:02 2008 1
Incremental Sat Dec 27 07:10:03 2008 1
Incremental Sun Dec 28 07:10:02 2008 1
Incremental Mon Dec 29 07:10:02 2008 1
Incremental Tue Dec 30 07:10:02 2008 1
Incremental Wed Dec 31 07:10:03 2008 1
Incremental Fri Jan 2 07:10:05 2009 1
Incremental Sat Jan 3 07:10:02 2009 1
Incremental Sun Jan 4 07:10:02 2009 1
Incremental Mon Jan 5 07:10:03 2009 1
Incremental Tue Jan 6 07:10:03 2009 1
Incremental Wed Jan 7 07:10:03 2009 1
Incremental Thu Jan 8 07:10:03 2009 1
Incremental Fri Jan 9 07:10:02 2009 1
Incremental Sat Jan 10 07:10:04 2009 1
Incremental Sun Jan 11 07:10:02 2009 1
Incremental Mon Jan 12 07:10:02 2009 1
Incremental Tue Jan 13 07:10:02 2009 1
Incremental Wed Jan 14 07:10:02 2009 1
Incremental Thu Jan 15 07:10:04 2009 1
Incremental Fri Jan 16 07:10:02 2009 1
Incremental Sat Jan 17 07:10:03 2009 1
Incremental Sun Jan 18 07:10:02 2009 1
Incremental Mon Jan 19 07:10:02 2009 1
Incremental Tue Jan 20 07:10:03 2009 1
Incremental Wed Jan 21 07:10:03 2009 1
Incremental Thu Jan 22 07:10:02 2009 1
Incremental Fri Jan 23 07:10:02 2009 1
Incremental Sat Jan 24 07:10:01 2009 1
Incremental Sun Jan 25 07:10:02 2009 1
Incremental Mon Jan 26 07:10:02 2009 1
Incremental Tue Jan 27 07:10:02 2009 1
Incremental Thu Jan 29 07:10:03 2009 1
Incremental Fri Jan 30 07:10:03 2009 1
Incremental Sat Jan 31 07:10:02 2009 1
Incremental Mon Feb 2 07:10:02 2009 1
Incremental Tue Feb 3 07:10:03 2009 1
Incremental Wed Feb 4 07:10:02 2009 1
Incremental Thu Feb 5 07:10:02 2009 1
Incremental Fri Feb 6 07:10:02 2009 1
Incremental Sat Feb 7 07:10:02 2009 1
Incremental Sun Feb 8 07:10:03 2009 1
Incremental Mon Feb 9 07:10:03 2009 1
Incremental Tue Feb 10 07:10:02 2009 1
Incremental Wed Feb 11 07:10:02 2009 1
Incremental Thu Feb 12 07:10:03 2009 1
Incremental Fri Feb 13 07:10:02 2009 1
Incremental Sat Feb 14 07:10:03 2009 1
Incremental Sun Feb 15 07:10:02 2009 1
Incremental Mon Feb 16 07:10:05 2009 1
Incremental Tue Feb 17 07:10:03 2009 4
Incremental Wed Feb 18 07:10:02 2009 1
Incremental Thu Feb 19 07:10:02 2009 1
Incremental Fri Feb 20 07:10:02 2009 1
Incremental Sat Feb 21 07:10:02 2009 1
Incremental Sun Feb 22 07:10:02 2009 1
Incremental Mon Feb 23 07:10:03 2009 1
Incremental Tue Feb 24 07:10:02 2009 62
Incremental Wed Feb 25 07:10:02 2009 1
Incremental Thu Feb 26 07:10:02 2009 1
Incremental Fri Feb 27 07:10:05 2009 1
Incremental Sat Feb 28 07:10:03 2009 1
Incremental Mon Mar 2 07:10:02 2009 1
Incremental Tue Mar 3 07:10:02 2009 1
Incremental Wed Mar 4 07:10:02 2009 4
Incremental Thu Mar 5 07:10:03 2009 3
Incremental Fri Mar 6 07:10:02 2009 1
Incremental Sat Mar 7 07:10:02 2009 1
Incremental Sun Mar 8 07:10:02 2009 1
Incremental Mon Mar 9 07:10:02 2009 1
Incremental Tue Mar 10 07:10:02 2009 1
Incremental Wed Mar 11 07:10:03 2009 1
Incremental Thu Mar 12 07:10:02 2009 1
Incremental Fri Mar 13 07:10:02 2009 1
Incremental Sat Mar 14 07:10:02 2009 1
Incremental Sun Mar 15 07:10:02 2009 1
Incremental Mon Mar 16 07:10:02 2009 1
Incremental Tue Mar 17 07:10:02 2009 1
Incremental Wed Mar 18 07:10:02 2009 1
Incremental Thu Mar 19 07:10:03 2009 1
Incremental Fri Mar 20 07:10:03 2009 1
Incremental Sat Mar 21 07:10:03 2009 1
Incremental Sun Mar 22 07:10:02 2009 1
Incremental Mon Mar 23 07:10:03 2009 1
Incremental Tue Mar 24 07:10:03 2009 1
Incremental Wed Mar 25 07:10:02 2009 1
Incremental Thu Mar 26 07:10:02 2009 1
Incremental Fri Mar 27 07:10:02 2009 1
Incremental Sat Mar 28 07:10:03 2009 1
Incremental Sun Mar 29 07:10:03 2009 1
Incremental Mon Mar 30 07:10:02 2009 1
Incremental Tue Mar 31 07:10:02 2009 1
Incremental Thu Apr 2 07:10:02 2009 1
Incremental Fri Apr 3 07:10:02 2009 1
Incremental Sat Apr 4 07:10:02 2009 1
Incremental Sun Apr 5 07:10:02 2009 1
Incremental Mon Apr 6 07:10:03 2009 1
Incremental Tue Apr 7 07:10:03 2009 1
Incremental Wed Apr 8 07:10:02 2009 1
Incremental Thu Apr 9 07:10:05 2009 1
Incremental Fri Apr 10 07:10:02 2009 1
Incremental Sat Apr 11 07:10:03 2009 1
Incremental Sun Apr 12 07:10:02 2009 1
Incremental Mon Apr 13 07:10:02 2009 4
Incremental Tue Apr 14 07:10:02 2009 1
Incremental Wed Apr 15 07:10:03 2009 1
Incremental Thu Apr 16 07:10:03 2009 1
Incremental Fri Apr 17 07:10:03 2009 1
Incremental Sat Apr 18 07:10:03 2009 1
Incremental Sun Apr 19 07:10:02 2009 1
Incremental Mon Apr 20 07:10:03 2009 1
Incremental Tue Apr 21 07:10:02 2009 24
Incremental Wed Apr 22 07:10:02 2009 6
Incremental Thu Apr 23 07:10:03 2009 1
Incremental Fri Apr 24 07:10:02 2009 1
Incremental Sat Apr 25 07:10:02 2009 1
Incremental Sun Apr 26 07:10:03 2009 1
Incremental Mon Apr 27 07:10:02 2009 1
Incremental Tue Apr 28 07:10:05 2009 1
Incremental Wed Apr 29 07:10:02 2009 1
Incremental Thu Apr 30 07:10:03 2009 1
-------------------------
No orphaned or incomplete backup sets found.
Kenneth Loafman wrote:
I run Hardy and Intrepid and both default to 4096. When I installed Jaunty, it was at 1024, and my guess is that the upstream Debian version is the same. ...Ken address@hidden wrote:any idea why suddenly 3 people come around with this error? I remotely suspect a change in ulimit of distros OR duplicity v0.5.17 ..ede --No difference, other than my testing was flawed. I finally had to go to the debugger to stop the process and then count using lsof. I'm showing 3 file descriptors released with every gpg process after the waitpid() is completed, so it would take 300+ gpg zombies to overrun the 1024 limit. This is a problem in the way duplicity and GnuPGInterface are handling process termination. To fix it, I'll need to add a SIGCHILD signal handler to GnuPGInterface that will allow the process to terminate when it ends, rather than making it wait till we get around to checking. ...Ken Edgar Soldin wrote:------------------------------------------------------------------------just curious, could you detect a difference between 32bit & 64bit systems? how many incrementals did you need to hit the 1024 ulimit? @yang: how many incrementals does your backup hold? just to doublecheck kens findings. ..edeI have found the problem and its going to take me a bit to get it fixed. As it works duplicity creates iterators that traverse each of the sig files. The iterators do not close until the process is complete and the files they are using are being held open. The gpg process is held as well since we don't wait for it until we close the file. The zombie processes were just a symptom of the real problem, too many open resources at one time. This hits directly the issue of too long an incremental chain. Each increments sig file is going to have file descriptors open until the backup/incremental/restore completes. The only workaround at this point is to increase the 'ulimit -n' parameter for any long increment chains and perform a full backup on a more frequent basis. I have some ideas about how to clean this up, but need to examine the code a bit closer before committing to a solution. ...Ken_______________________________________________ Duplicity-talk mailing list address@hidden http://lists.nongnu.org/mailman/listinfo/duplicity-talk_______________________________________________ Duplicity-talk mailing list address@hidden http://lists.nongnu.org/mailman/listinfo/duplicity-talk------------------------------------------------------------------------ _______________________________________________ Duplicity-talk mailing list address@hidden http://lists.nongnu.org/mailman/listinfo/duplicity-talk
-- Yang Zhang http://www.mit.edu/~y_z/
| [Prev in Thread] | Current Thread | [Next in Thread] |