Re: [PATCH] tests init: new subroutine 'fatal_', for hard errors

[Eric Blake]

On 06/07/2011 03:07 PM, Stefano Lattarini wrote:
>>> So, what is a "hard error"? 
>>
>> Exit status 99 is special to automake - it says quit the testsuite now,
>> regardless of how many tests remain
>>
> Well, no, it means "count this outcome as a failure, even if the testcase is
> expected to fail" (i.e., in automake, it's listed in $(XFAIL_TESTS)).

Oh well, serves me right for answering off the top of my head instead of
reading the automake documentation.

> While the behaviour you describe might be surely useful in some circumstances,
> it's not currently implemented in Automake.

It is implemented in autotest (autoconf's counterpart to automake
tests), but via the '-e' command line option to the testsuite (stop the
testsuite as soon as possible on first error), which is unrelated to the
exit status of individual tests within the testsuite.  And (again if I
had bothered to read instead of type off the top of my head), I see that
autotest also uses status 99 to count a test as a failure even if it is
otherwise marked XFAIL.

-- 
Eric Blake   address@hidden    +1-801-349-2682
Libvirt virtualization library http://libvirt.org

signature.asc
Description: OpenPGP digital signature