|
From: | Jose |
Subject: | Parallelization with live stream of data |
Date: | Fri, 14 Sep 2012 17:26:06 +0300 |
User-agent: | Mozilla/5.0 (X11; Linux x86_64; rv:15.0) Gecko/20120827 Thunderbird/15.0 |
Hello all.I have a live stream of measurements that I need to process with octave in real time. The processing basically consists on the execution of a script when a new measurement arrives, with the measurement as argument. The problem is that the time between measurements might be shorter than the time required to execute the script, and I would loose data, as the measurements come at constant rate.
One solution that I can think of is parallelization: as I have several cores in my machine, I could assign the processing of incoming measurements to the free cores (octave instances). Once that a measurement has been processed the core is ready to process a new measurement.
To me this sounds like a classical problem that many others might have faced before.
In this sense, I think I cannot use parcellfun, as I need to assign cores to measurements dynamically. I have also seen the packages multicore and parallel, and the MPITB toolbox. Before diving fiercely into code, documentation and so on, I'd appreciate some comments/suggestions from experienced users, as I am totally new to this world of parallelization.
BR Jose
[Prev in Thread] | Current Thread | [Next in Thread] |