Re: [PATCH v2 0/7] final fixes for 8.2

[Stefan Hajnoczi]

On Fri, 1 Dec 2023 at 07:56, Alex Bennée <alex.bennee@linaro.org> wrote:
>
> 8.2 is looking fairly stable but I do have one bug fix for gdbstub
> which I came across while debugging something else. The changes for
> avocado rationalise all flaky tests under the QEMU_TEST_FLAKY_TESTS
> environment variable. The final patch re-adds the flaky tests to the
> CI as a manually run allow_fail job so we can still attempt to debug
> their failure in the place they tend to fall over.

Acked-by: Stefan Hajnoczi <stefanha@redhat.com>

>
> v2
> --
>
>   - addressed some review comments
>   - emphasised raising a bug for failing tests
>   - drop some tests now missing assets online
>   - fix wrong microblaze target for tests
>
> The following still need review:
>
>   gitlab: build the correct microblaze target
>   tests/avocado: tag sbsa tests as tcg only
>   tests/avocado: drop malta yamon tests
>   tests/avocado: drop BootLinuxConsole.test_mips_malta_cpio test
>
> Alex.
>
> Alex Bennée (7):
>   gdbstub: use a better signal when we halt for IO reasons
>   docs/devel: rationalise unstable gitlab tests under FLAKY_TESTS
>   tests/avocado: drop BootLinuxConsole.test_mips_malta_cpio test
>   tests/avocado: drop malta yamon tests
>   tests/avocado: tag sbsa tests as tcg only
>   gitlab: build the correct microblaze target
>   gitlab: add optional job to run flaky avocado tests
>
>  docs/devel/testing.rst                   | 32 ++++++++++------
>  gdbstub/internals.h                      |  1 +
>  gdbstub/system.c                         |  2 +-
>  .gitlab-ci.d/buildtest.yml               | 32 +++++++++++++++-
>  tests/avocado/boot_linux.py              | 10 +++--
>  tests/avocado/boot_linux_console.py      | 28 ++------------
>  tests/avocado/intel_iommu.py             |  6 ++-
>  tests/avocado/linux_initrd.py            |  7 +++-
>  tests/avocado/machine_aarch64_sbsaref.py |  1 +
>  tests/avocado/machine_aspeed.py          | 10 +++--
>  tests/avocado/machine_mips_malta.py      | 47 ++++--------------------
>  tests/avocado/machine_rx_gdbsim.py       | 10 +++--
>  tests/avocado/machine_s390_ccw_virtio.py |  3 +-
>  tests/avocado/replay_kernel.py           |  8 +++-
>  tests/avocado/reverse_debugging.py       | 16 +++++---
>  tests/avocado/smmu.py                    |  6 ++-
>  tests/avocado/tuxrun_baselines.py        |  5 ++-
>  17 files changed, 122 insertions(+), 102 deletions(-)
>
> --
> 2.39.2
>
>