[Monotone-devel] mtn cvs_import's memory use

[Lapo Luchini]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Nathaniel Smith wrote:
> On Tue, Aug 01, 2006 at 02:39:35PM +0200, Lapo Luchini wrote:
>> Lapo Luchini wrote:
>>> I was trying to cvs_import the while FreeBSD /src repository
>>> and I got a std::bad_alloc. I guess the problem is that some
>>> data is kept in RAM and swap file finished?
>>>
>> Yes, I guess that's so, because after a few minutes I got 311M of
>> RES in top, when the CLI showed this:
>>
>> % time mtn -d org.freebsd.mtn -b org.freebsd.src cvs_import src/
>> mtn: branches | versions mtn:       80 |    84863
>> contrib/libstdc++/config/Attic/x86-interix.ml,v
> Eric's diagnosis of this sounds very plausible to me -- since I've
> just applied his fixes to mainline, you may want to try this
> cvs_import again with mainline and see if it does any better.

It certainly uses less RAM now (though not "very little") but
importing FreeBSD's full src/ CVS seems to work with 512MB RAM: during
the second phase the memory use is a costant 240MB in top's "RES"
value (I don't know how much it will take to finish nor if memory was
higher during the end of the first phase... but with 0.27 release it
didn't finish at all, so it's certainly better).

% time ~/monotone-trunk/mtn -d org.freebsd.mtn -b org.freebsd.src
cvs_import src/
mtn: branches | versions
mtn:      325 |   501483
mtn: warning: error reading RCS file sys/ia64/ia64/trap.c,v: errore
sintattico 1293:191: mi aspettavo TOK_NONE, ho ricevuto TOK_SYMBOL con
valore '-'
mtn:
mtn: branches | versions
mtn:      403 |   703646 usr.sbin/zzz/zzz.sh,v
mtn: branches | revisioni | versions
mtn:      403 |      2510 |   703646

- --
Lapo Luchini
address@hidden (OpenPGP & X.509)
www.lapo.it (Jabber, ICQ, MSN)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.1 (Cygwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iQIcBAEBAgAGBQJE12ocAAoJELBiMTth2oCDvH4QAMkgnM/9CytlinX7RmhF3qjl
08ekBIT+GsvQEw53FuWSUF6MIB2xr67CONRnMCcZ32E573wC0WzZR9Ip3J1qv2J7
2RtOBDoiHbubu9URUUS3moaraD8txD/rvi48J7g+FlW3dkDC2j7YE1meBQdFDDew
SakO/yJ4L4xDdsr820WsORqfaRvmjOVoLJQLe5KHZ6yanPmhgxrTnUW3ZIKNLEc/
7skCY0kMUnuV00I0IyHOb5CfREuKhzc/A3IeuYug/IvhE48NUoE7tAHDBSitlpB6
MCCkRZ6NNsuLvLQdVx0s1/Uc7o7gq2oHYYlDVpTnaC/nHKjRGUVB3cEWDRaaNxOh
kRb5UIBihQJd33EApd7S6eFIKFvySn7uQGSB1LIsEozTByGNIrphthlSWruLNjjM
lJvwauwVuTbVyCOTJ9BwVG8LV0M3aMk3tJhORUaB3zCPFpMoEQub0jQl8pW+PJz/
J7yo/2atizahORZnVwgGL7ZcP2y2jdB7geZYe3PLViuwNnNuhsgMyr4/7ipoXNRv
CnH4lCJJsdSW+K4XcomIRBbSRuPGsAG1mZ3jylHO+j7SRFHWbk8zM5vflxhu9wT1
e3DDkXwuMQLZkIN/vdNNTZ+vuuPnGioKF4ZVzbalOU9C6QFC9yfCTyX/k5J6mP32
r1JwyW0qpfoRFp5lLyqP
=oAnE
-----END PGP SIGNATURE-----