Re: GNU Parallel Bug Reports [Bug] Expansion using --header fails on --return argument

[Nazgul]

Update: I was able to reproduce the behaviour with the latest release.

address@hidden /tmp/T $ mkdir -p ~/T
address@hidden /tmp/T $ mkdir -p /tmp/T
address@hidden /tmp/T $ cd /tmp/T
address@hidden /tmp/T $ ~/bin/parallel -S 127.0.0.1 --return {1} --cleanup echo {1} '>' {1} ::: A B
address@hidden /tmp/T $ ls /tmp/T
A  B
address@hidden /tmp/T $ ls ~/T
address@hidden /tmp/T $ rm -rf /tmp/T/*
address@hidden /tmp/T $ rm -rf ~/T/*
address@hidden /tmp/T $ ~/bin/parallel --header : -S 127.0.0.1 --return {G} --cleanup echo {G} '>' {G} ::: G A B
rsync: link_stat "/home/marco/{G}" failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1655) [generator=3.1.0]
rsync: link_stat "/home/marco/{G}" failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1655) [generator=3.1.0]
address@hidden /tmp/T $ ls /tmp/T
address@hidden /tmp/T $ ls ~/T
address@hidden /tmp/T $ rm -rf /tmp/T/*
address@hidden /tmp/T $ rm -rf ~/T/*
address@hidden /tmp/T $ ~/bin/parallel --version
GNU parallel 20150822
Copyright (C) 2007,2008,2009,2010,2011,2012,2013,2014,2015 Ole Tange
and Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
GNU parallel comes with no warranty.

Web site: http://www.gnu.org/software/parallel

When using programs that use GNU Parallel to process data for publication
please cite as described in 'parallel --bibtex'.
address@hidden /tmp/T $

On 9 September 2015 at 16:25, Nazgul <address@hidden> wrote:

Hi all,

First of all, thanks for realizing and maintaining this very useful tool!

This is my first email, so please be understanding if it is in the wrong format.

I am not a pro user of parallel, but I have been using it for some time.

I believe I spotted a bug in the expansion of "--header :" arguments.

With this command I "remotely" generate a file and I want it to be returned back, and everything works fine.

parallel -S 127.0.0.1 --return {1} --cleanup echo {1} '>' {1} ::: A B

However, if I try to use "--header :" to give my parameter a name, the command fails.

parallel --header : -S 127.0.0.1 --return {G} --cleanup echo {G} '>' {G} ::: G A B

It seems like the argument is not expanded after "--return", as the following demonstrates:

address@hidden /tmp/T $ mkdir -p ~/T
address@hidden /tmp/T $ mkdir -p /tmp/T
address@hidden /tmp/T $ cd /tmp/T
address@hidden /tmp/T $
address@hidden /tmp/T $ parallel -S 127.0.0.1 --return {1} --cleanup echo {1} '>' {1} ::: A B
address@hidden /tmp/T $ ls /tmp/T
A  B
address@hidden /tmp/T $ ls ~/T
address@hidden /tmp/T $ rm -rf /tmp/T/*
address@hidden /tmp/T $ rm -rf ~/T/*
address@hidden /tmp/T $
address@hidden /tmp/T $ parallel --header : -S 127.0.0.1 --return {G} --cleanup echo {G} '>' {G} ::: G A B
rsync: link_stat "/home/marco/{G}" failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1655) [Receiver=3.1.0]
rsync: [Receiver] write error: Broken pipe (32)
rsync: link_stat "/home/marco/{G}" failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1655) [Receiver=3.1.0]
rsync: [Receiver] write error: Broken pipe (32)
address@hidden /tmp/T $ ls /tmp/T
address@hidden /tmp/T $ ls ~/T
address@hidden /tmp/T $ rm -rf /tmp/T/*
address@hidden /tmp/T $ rm -rf ~/T/*
address@hidden /tmp/T $

Here is the output of --version

address@hidden /tmp $ parallel --version
GNU parallel 20130922
Copyright (C) 2007,2008,2009,2010,2011,2012,2013 Ole Tange and Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
GNU parallel comes with no warranty.

Web site: http://www.gnu.org/software/parallel

When using GNU Parallel for a publication please cite:

O. Tange (2011): GNU Parallel - The Command-Line Power Tool,
;login: The USENIX Magazine, February 2011:42-47.

--

Marco

--

Marco