[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: incremental read of gzipped matrix
|
From: |
Andreas Weber |
|
Subject: |
Re: incremental read of gzipped matrix |
|
Date: |
Sun, 8 Dec 2019 22:30:30 +0100 |
|
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 |
Hey Markus,
Am 08.12.19 um 19:25 schrieb "Markus Mützel":
> Octave has the gzifstream (in zfstream.h) which might be useful for your
> purpose.
I've used this before and only got an improvement by factor 2.
The factor 2 is because load currently parses the inputfile twice: the
first run is to detect number of columns and rows, then the Matrix is
allocated then parsed the second time.
In the meanwhile I've enabled incremental reads in load_gz which is very
important for me if I periodically poll an increasing .gz file.
-- Andy