Guillaume Tucker recently fixed the LAVA-side meaning of the sd-card device id
to actually point to the SD card on the ARM64 Renesas R-Car m3ulcb boards.

This solves some out-of-space errors but also means that flashing images takes
more time and sometimes 20 minutes are not enough. Raising the timeout to 60
minutes should be plenty.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

The test issue ended up being a dbus packaging issue
and should be sorted now.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

The debug-build tests shipped with dbus-tests are built with different
configure flags than the system dbus daemon, more specifically the debug-build tests
are built with --enable-verbose-mode, which makes the tests expect for the
DBUS_VERBOSE_INTERFACE which is only present if the dbus daemon is also
built with verbose mode enabled (not the case).

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

The `group-modules-tpl.yaml` template is always included after
`group-common-tpl.yaml` which already runs the
`common/boot-no-crashes.yaml` test, so it would just be a duplicate.

To make things worse, since commit 1f9a12de the
`group-modules-ported-tpl.yaml` template is included at the top of
`group-modules-tpl.yaml`, so the Canterbury tests run before checking
for crashes in the log: this means that any crash in the Canterbury
testsuite would mistakenly trigger the `boot-no-crashes` check.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

The test-dbus-daemon test fails due to some hard limits set in our
default dbus configuration, so lets mark it to skip until the issue
with limits is properly investigated.

See also https://phabricator.apertis.org/T5565

 to track this issue/fix.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

Some of the tests executed by the dbus-installed-tests have shell counterparts that
do some setup work (e.g. load apparmor profiles) before executing the actual binaries,
so lets skip executing the binaries directly when a shell counterpart is available.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

Signed-off-by: Ritesh Raj Sarraf <rrs@debian.org>

Andre Moreira Magalhaes authored 6 years ago and Frédéric Dalleau committed 6 years ago

The tumbler-thumbnailing test has now moved gitlab.apertis.org/tests/tumbler-thumbnailing.git.
The Apertis test plan needs to be updated to use those tests in order to
test on immutable rootfs setups.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

The idea is that the name should communicate what they are instead
of what we did.

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

The apparmor-tumbler test has now moved gitlab.apertis.org/tests/apparmor-tumbler.git.
The Apertis test plan needs to be updated to use those tests in order to
test on immutable rootfs setups.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

The base SDK does not ship any of the packages in the `modules` group
(Canterbury, Ribchester, Didcot, Traprain, etc.) so it should not run
those tests.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

The apparmor test has now moved gitlab.apertis.org/tests/apparmor.git.
The Apertis test plan needs to be updated to use those tests in order to
test on immutable rootfs setups.

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

Andre Moreira Magalhaes authored 6 years ago and Frédéric Dalleau committed 6 years ago

The apparmor-pulseaudio test has now moved gitlab.apertis.org/tests/apparmor-pulseaudio.git.
The Apertis test plan needs to be updated to use those tests in order to
test on immutable rootfs setups.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

The only images running in QEMU are SDK images and they
already contain all the required repositories, so this test
adding repos to the image is not needed there.

This add-repo test was also causing errors because of multiple
entries in the sources.list of the SDK images.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Andre Moreira Magalhaes authored 6 years ago and Frédéric Dalleau committed 6 years ago

The rfkill-toggle test has now moved gitlab.apertis.org/tests/rfkill-toggle.git.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

Signed-off-by: Ritesh Raj Sarraf <ritesh.sarraf@collabora.com>

Ritesh Raj Sarraf authored 6 years ago and Ritesh Raj Sarraf committed 6 years ago

Also invoke ade job through qemu sdk image

Signed-off-by: Ritesh Raj Sarraf <ritesh.sarraf@collabora.com>

Both `common-*boot-tpl.yaml` and `group-*-tpl.yaml` are running the
sanity-check tests due to historical reasons that date back to LAVAv1
where a reboot was needed between the two set of tests.

Nowadays running the test twice is no longer needed, so drop the
sanity-check in `group-*-tpl.yaml` and rename `sanity-check-initial` to
`sanity-check` in `common-*boot-tpl.yaml`.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Signed-off-by: Ritesh Raj Sarraf <ritesh.sarraf@collabora.com>

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

The apparmor-gstreamer1.0 test has now moved gitlab.apertis.org/tests/apparmor-gstreamer1.0.git.
The Apertis test plan needs to be updated to use those tests in order to
test on immutable rootfs setups.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

The gupnp-services test has now moved gitlab.apertis.org/tests/gupnp-services.git.
The Apertis test plan needs to be updated to use those tests in order to
test on immutable rootfs setups.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

Andre Moreira Magalhaes authored 6 years ago and Frédéric Dalleau committed 6 years ago

The glib-gio-fs test has now moved gitlab.apertis.org/tests/glib-gio-fs.git.
The Apertis test plan needs to be updated to use those tests in order to
test on immutable rootfs setups.

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

The librest tests are only running unit tests and there is no
point running them in LAVA.

Fixes: APERTIS-T5492

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

Frédéric Dalleau authored 6 years ago and Frédéric Dalleau committed 6 years ago

Apertis has been derived as image bootable over NFS.
Currently, those images are available at images.apertis.org/lava/nfs

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

Denis Pynkin authored 6 years ago and Denis Pynkin committed 6 years ago

Ported version is able to be started for ostree-based and
apt-based images.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Denis Pynkin authored 6 years ago and Denis Pynkin committed 6 years ago

Internal test version has been removed.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

This test has moved to gitlab.apertis.org/tests/check-dbus-services.git
The files in this project are now deprecated

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Internal test version has been removed.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

This test should be run for all images types.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Ported version is able to be started for ostree-based and
apt-based images.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

This test has been deprecated.
New version is implemented with the new testing framework.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Denis Pynkin authored 6 years ago and Denis Pynkin committed 6 years ago

Add the new version of connman-new-supplicant test.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Denis Pynkin authored 6 years ago and Denis Pynkin committed 6 years ago

This test has been deprecated.
New version is implemented with the new testing framework.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Frédéric Dalleau authored 6 years ago and Denis Pynkin committed 6 years ago

apparmor-dbus test definition disappeared when the test got ported.
Add it back

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>