Re: verbosity of test failure feedback (was: Automake 1.11.1 glitch?)

[Stefano Lattarini]

On Tuesday 07 September 2010, Ralf Wildenhues wrote:
> * Stefano Lattarini wrote on Tue, Sep 07, 2010 at 06:00:04PM CEST:
> > Darn, I've been sloppy: I should have also asked you to provide
> > us with the (tarred) content of the temporary test directory
> > `tests/silent5.dir'.  Could you kindly send this over to the list
> > too?
> > 
> > (<NOTE> to self and to Ralf: it would be nice if the Automake
> > testsuite could create, whenever a failure occurs, a tarball
> > containg all the relevant logs and the contents of all relevant
> > temporary test directories, to avoid plaguing the poor bug
> > reporters with continuos requests of more details </NOTE>)
> 
> Actually, I haven't come across many test failures where more
> information was necessary.  At least in this case I think it was
> crystal clear from the silent5.log file, no?  ;-)
Only if you are smarter than me (which you probably are ;-)

> One practical problem with sending test directory contents by
> default is that they can be pretty large.
True enough; see my answer to Bob follow-up message.

> When multiple failures occur, say, all Libtool-related tests fail
> due to a Libtool installation bug, we're speaking of several MB
> packed.  I don't really want this sent to a public mailing list
> read by dozens of people.
Agreed; see my answer to Bob follow-up message.
 
Regards,
   Stefano