[GNUnet-developers] Insertion speed

[Niklas Höglund]

I've experimented a bit with the insertion speed.  I did a benchmark
using different storage methods and file systems to see if I could get
gnunet to insert files faster.

First I used a 37M file, that I inserted into the same GDBM database on
different filesystems.  What filesystem was used didn't affect
performance a lot.  It took between 633 and 722 seconds for all my
tests.

Then I created a new gnunetd with support for the directory backend, and
inserted the same file into it.  It took only 124 seconds.  Quite fast.

I realized, though, that it may be faster to insert into an empty store,
so I filled it with about the same amount I had had earlier.  That made
the speed go down to about the same as with the GDBM store.

As I see it, there are two things that could cause this: the size of
that directory or filesystem fragmentation.

It might be a good idea to insert one or two levels of directories into
the directory store.


By the way, noone should call me a leecher:

Server Statistics:
Shared files       :         3
Size of shared data:  4294967295k
Connected hosts    :         8
Uptime             :    479620s

I share quite a bit of data :)
-- 
                                                Niklas