Re: Importing large amounts of data

[Dmitri A. Sergatskov]

On Mon, Jun 18, 2012 at 9:53 PM, Hannes <address@hidden> wrote:

>> I have attached a compressed file that is 2.5MB unpacked. The big array in
>> this file has dimensions 150x150x55 (roughly). This file  takes about 20s to
>> import on my Workstation.
>> If I export a larger array, like I said, it gets really slow.
>>

This approach (writing data as an inline m-code) does not look good to me
(you force octave interpreter to work too hard).

It is much better to just write a data file first and then import into octave
either with load or by using c-style i/o functions.

In any case it took 2.3 sec on my computer (Octave 3.6.2 on Fedora
17/x86_64,  i7)
 to load your example.m:
(BTW "example" is a core octave function)

octave:3> tic; source ("example.m"); toc
Elapsed time is 2.35138 seconds.
octave:4> who
Variables in the current scope:

ans       fam       families  indiv

octave:5>

Regards,

Dmitri.
--