[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: GNU Parallel Bug Reports Truncated large records
From: |
Johannes Dröge |
Subject: |
Re: GNU Parallel Bug Reports Truncated large records |
Date: |
Tue, 24 Feb 2015 13:51:33 +0100 |
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 |
Hello Ole,
Am 24.02.2015 um 02:30 schrieb Ole Tange:>> > 1) The processing run-time of
individual blocks is more than linear with the input size. Therefore, it would
be best if GNU parallel would allow pass single records or a fixed number of
records for each job, or at least would not automatically increase the block
size. Instead, the block size auto-detection increases the block size on large
individual blocks until only very few processes are being run in parallel which
then dominate the overall run-time. This behavior strongly impacts the
granularity of the parallel execution.
> I would recommend using -N, but it segfaults on you example data.
Thanks for your quick fixing! I hadn't seen the -N option in connection with
--pipe, primarily because the description focuses on the number of arguments to
pass. Could you please notify me when this issue with my example data is
solved, or is this not on the priority list and I should investigate on my own?
Gruß Johannes
--
Johannes Dröge, M.Sc.
Algorithmic Bioinformatics, Heinrich Heine University Düsseldorf
25.12.01.50, Universitätsstraße 1, 40225 Düsseldorf, Germany
PGP: http://keys.fungs.de/6ea5e4.asc (55F2720303A7F236A94666F20E2360727A6EA5E4)
Web: algbio.cs.uni-duesseldorf.de | Tel/Fax: +49 211 81-12644/13464
signature.asc
Description: OpenPGP digital signature