[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: regression tests for `lilypond-book`?
From: |
Werner LEMBERG |
Subject: |
Re: regression tests for `lilypond-book`? |
Date: |
Fri, 04 Sep 2020 09:25:43 +0200 (CEST) |
>> ... it doesn't do a comparison against correct input.
>
> The lilypond-book directory tests features of lilypond-book, but it
> doesn't any real comparison. Meaningful comparison would be to compare
> PDF files (after processing with LaTeX) across versions,
I disagree. There are two issues that should be tested.
* Check whether PDFs (and other output formats) can be actually
generated. AFAICS, this is what the current tests do.
* Process the test input files with the current `lilypond-book`
version, check its output for correctness (including manual
compilation with LilyPond so that the PDFs can be inspected *once*),
then store the output files from lilypond-book – and only from
lilypond-book, without calling LilyPond – as a baseline.
Newer versions simply compare its output against this baseline.
Werner
- regression tests for `lilypond-book`?, Werner LEMBERG, 2020/09/02
- Re: regression tests for `lilypond-book`?, Jonas Hahnfeld, 2020/09/02
- Re: regression tests for `lilypond-book`?, Werner LEMBERG, 2020/09/02
- Re: regression tests for `lilypond-book`?, Jonas Hahnfeld, 2020/09/02
- Re: regression tests for `lilypond-book`?, Werner LEMBERG, 2020/09/02
- Re: regression tests for `lilypond-book`?, Jonas Hahnfeld, 2020/09/02
- Re: regression tests for `lilypond-book`?, Werner LEMBERG, 2020/09/02
- Re: regression tests for `lilypond-book`?, Han-Wen Nienhuys, 2020/09/03
- Re: regression tests for `lilypond-book`?,
Werner LEMBERG <=