Re: [rdiff-backup-users] Millions of files

[dean gaudet]

On Thu, 28 Apr 2005, Troels Arvin wrote:

> rsync seems to have trouble with jobs operating on millions of files:
> http://lists.samba.org/archive/rsync/2003-October/007546.html
> 
> If that's the case, is it also automatically the case for rdiff-backup?
> Does rdiff-backup create a complete list of files to be backed up before
> working?

yeah rdiff-backup has the same problem.

fwiw i don't have troubles on a 1M+ inode fs (actually it has 2M inodes 
but about 1M are excluded)... but that doesn't mean there isn't a problem.

there have been thoughts towards an improved rsync protocol... such as 
<http://www.blorf.net/new-protocol.html>.  and i think there's another 
proposal along these lines, but i don't seem to be using the right search 
terms to find it today.

-dean