[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Bug-wget] GSoC2012 - parallel downloading

From: Ángel González
Subject: Re: [Bug-wget] GSoC2012 - parallel downloading
Date: Sun, 18 Mar 2012 17:14:12 +0100
User-agent: Thunderbird

On 18/03/12 00:35, Adam 'foo-script' Rakowski wrote:
> Hi guys,
> I am Adam, CS student from UE.
> Your idea for this GSoC is very exciting. I have experience with
> parallel programming with OpenMP, but I need dive deeper into wget code
> to find out, if OMP is applicable. A problem with OMP is it can not
> guarantee that IO operations will be held in proper order.
> Do you have any preferred technologies/libs to parallelize downloading?
> Have you any detailed and strong vision of such feature, or is it "to be
> discussed"?
> Best
> Adam
OpenMP uses a different kind of parallelization. wget is I/O driven, OpenMP
wouldn't help there (or be overkill). You would use something like select()
and non-blocking reads. Or simply spawn several threads, which is likely
much easier to do when reusing the current codebase.

PS: Is wget a GSoC project? Under which name? I don't see it at

reply via email to

[Prev in Thread] Current Thread [Next in Thread]