diff options
| author | Alex Bennée <alex.bennee@linaro.org> | 2023-12-01 09:36:33 +0000 |
|---|---|---|
| committer | Alex Bennée <alex.bennee@linaro.org> | 2023-12-01 17:47:20 +0000 |
| commit | 5d25fcb702406286a17806dd53d10eec1d2cc34f (patch) | |
| tree | ee28ff999fa00720303179b28023fb5b18998071 /docs | |
| parent | aeb5f8f248e6b89732f5745f505742295adf7b66 (diff) | |
| download | qemu-5d25fcb702406286a17806dd53d10eec1d2cc34f.zip qemu-5d25fcb702406286a17806dd53d10eec1d2cc34f.tar.gz qemu-5d25fcb702406286a17806dd53d10eec1d2cc34f.tar.bz2 | |
gitlab: add optional job to run flaky avocado tests
One problem with flaky tests is they often only fail under CI
conditions which makes it hard to debug. We add an optional allow_fail
job so developers can trigger the only the flaky tests in the CI
environment if they are debugging.
Reviewed-by: Richard Henderson <richard.henderson@linaro.org>
Acked-by: Stefan Hajnoczi <stefanha@redhat.com>
Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
Message-Id: <20231201093633.2551497-8-alex.bennee@linaro.org>
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/devel/testing.rst | 15 |
1 files changed, 8 insertions, 7 deletions
diff --git a/docs/devel/testing.rst b/docs/devel/testing.rst index 76465b8..bd13230 100644 --- a/docs/devel/testing.rst +++ b/docs/devel/testing.rst @@ -1387,16 +1387,17 @@ the code snippet below: def test(self): do_something() -Tests should not live in this state forever and should either be fixed -or eventually removed. - -To run such tests locally you will need to set the environment -variable. For example: +You can also add ``:avocado: tags=flaky`` to the test meta-data so +only the flaky tests can be run as a group: .. code:: - env QEMU_TEST_FLAKY_TESTS=1 ./pyvenv/bin/avocado run \ - tests/avocado/boot_linux.py:BootLinuxPPC64.test_pseries_tcg + env QEMU_TEST_FLAKY_TESTS=1 ./pyvenv/bin/avocado \ + run tests/avocado -filter-by-tags=flaky + +Tests should not live in this state forever and should either be fixed +or eventually removed. + Uninstalling Avocado ~~~~~~~~~~~~~~~~~~~~ |