[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Memory limits?
From: |
Thomas Worthington |
Subject: |
Re: Memory limits? |
Date: |
Mon, 21 Sep 2020 14:24:16 +0100 |
User-agent: |
mu4e 1.1.0; emacs 26.3 |
I'm on the master branch (updated Sat Mar 10 06:12:43 2018) and I built using
configure
make
So I assume that it picked up the fact that this is a 64bit machine (Gentoo
Linux). All the checks pass.
"file" gives
ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically linked,
interpreter /lib64/ld-linux-x86-64.so.2, for GNU/Linux 3.2.0, with debug_info,
not stripped
Thomas
stes@PANDORA.BE writes:
> I'm new to GNU st so I don't know the answer, but when reading your message,
> some questions arise.
>
> Actually first of all I wonder myself whether GNU gst 3.2.91 is the latest
> version,
> and whether any development is still going on ?
>
> (version from 2015 https://alpha.gnu.org/gnu/smalltalk/)
>
> How exactly was GNU st configured and built ?
>
> What's the version and operating system ?
>
> Did you build a 32bit or a 64bit gst ?
>
> For example:
> #smalltalk-3.2.91$ file gst
> gst: ELF 64-bit LSB executable AMD64 Version 1, dynamically linked, not
> stripped, no debugging information available
>
> Was 'gmake check' reporting any failed checks ?
>
> David Stes
>
> ----- Op 21 sep 2020 om 12:19 schreef Thomas Worthington
> thomas@2worthingtons.net:
>
>> I'm testing a bit of code intended for analysing Apache Logs and hitting a
>> memory limit. The log I'm using has a million lines with 18 fields each, so
>> it's not completely trivial (I've already tested it on a 300 line snippet)
>> but
>> it is still an extract of the full-sized logs I want to run it on.
>>
>> When the code runs I initially get a load of
>>
>> "Global garbage collection... done"
>> "Global garbage collection... done, heap grown"
>> "Global garbage collection... done, heap grown"
>> "Global garbage collection... done, heap grown"
>> "Global garbage collection... done, heap grown"
>> "Global garbage collection... done, heap compacted"
>> "Global garbage collection... done, heap grown"
>>
>> Which is expected, but once gst has about a gig of RAM allocated to it I get
>>
>> [Memory allocation failure]
>> Can't allocate enough memory to continue.
>> done"
>> "Global garbage collection...
>>
>> which repeats over and over (I think once per line in the log file from that
>> point on). pidstat on gst at that point gives me
>>
>> 11:01:36 UID PID minflt/s majflt/s VSZ RSS %MEM
>> Command
>> 11:01:36 1000 18064 0.06 0.00 989144 813120 9.96 gst
>>
>> The test box has 8G of RAM and the system I want to run it on has 680GB of
>> RAM,
>> so it would be nice to be able to use it. Is there some hard-coded limit in
>> the
>> source which I can lift or am I stuck? Or just missing something?
>>
>> Thanks,
>> Thomas
Re: Memory limits?, Derek Zhou, 2020/09/21