[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Threaded versions of cp, mv, ls for high latency / parallel filesyst
From: |
James Youngman |
Subject: |
Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems? |
Date: |
Sat, 8 Nov 2008 19:42:15 +0000 |
On Sat, Nov 8, 2008 at 6:05 PM, Jim Meyering <address@hidden> wrote:
> How about parallelizing it via xargs, e.g.,
>
> $ echo a b c d e f g h | xargs -t -n4 --no-run-if-empty \
> --max-procs=2 -- cp --target-directory=dest
> cp --target-directory=dest a b c d
> cp --target-directory=dest e f g h
For tools lacking a --target-directory option there is this shell trick:
$ echo a b c d e f g h |
xargs -n4 --no-run-if-empty --max-procs=2 -- sh -c 'prog "$@" destination' prog
James.
- Threaded versions of cp, mv, ls for high latency / parallel filesystems?, Andrew McGill, 2008/11/08
- Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?, Jim Meyering, 2008/11/08
- Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?,
James Youngman <=
- Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?, Andrew McGill, 2008/11/11
- Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?, James Youngman, 2008/11/12
- Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?, Phillip Susi, 2008/11/12
- Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?, James Youngman, 2008/11/13
- Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?, Ralf Wildenhues, 2008/11/13
- Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?, Andrew McGill, 2008/11/14
- Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?, James Youngman, 2008/11/15
Re: Threaded versions of cp, mv, ls for high latency / parallel filesystems?, Dr. David Alan Gilbert, 2008/11/09