Re: [Monotone-devel] RFC: Unit test improvements

[Nathaniel Smith]

On Tue, Aug 22, 2006 at 06:09:55PM -0700, Zack Weinberg wrote:
> * And last but not least: Now that there are options, it is sensible
> to turn debug-log-to-stderr off and require an option (--debug, just
> like in monotone proper) to turn it back on.  Thus, the noise level of
> make check is *dramatically* reduced.  I added fake tests to report
> progress, it looks like this:
> 
> $ ./unit_tests
> Running 96 test cases...
> charset...
[...]
> xdelta...
> 
> *** No errors detected

That seems pretty.  I'm concerned about the buildbots, where we'd
really rather get full output on the first try (since we don't in
general have access to the machine for debugging).

What we do for the lua testsuite is, we have a hacky shell script
line for all the buildslaves that says 'if make check failed, cat
tester_dir/tester.log'.  One possibility would be to simply use this
same mechanism -- if the unit_tests always wrote their full output to
a log file, then we could teach the buildslaves to dump this logfile
into their output whenever the tests failed.

-- Nathaniel

-- 
Details are all that matters; God dwells there, and you never get to
see Him if you don't struggle to get them right. -- Stephen Jay Gould