Sudarshan CP authored 3 years ago and Sudarshan CP committed 3 years ago

Signed-off-by: Monisha Muthukumaran <Muthukumaran.Monisha@in.bosch.com>

`Tumbler` is no more installed on images since apertis/v2022dev2 (05/2021).

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

As PipeWire uses the PulseAudio tools for its configuration, it's better
to only refer to the audio manager in tests.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Test that audio policy to mute song application when switching to video
application.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

The `v2022dev3` image doesn't have enough space to perform the branch
update. This has been fixed in `v2022pre`.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

This test checks basic import-debian-package functionalities.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Our Flatpak repo now implements ED25519 signatures and provides a
`.flatpakrepo` file for making it easier to configure the remote,
including signature verification. Switch this test case to using this
method.

Other Flatpak-related test cases use the `flathub` repo and therefore
should be left untouched for now.

Signed-off-by: Arnaud Ferraris <arnaud.ferraris@collabora.com>

Since commit 9fad8001, the lava timeout has been increase to 20 min.
Do the same for the systemd service tests.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Walter Lozano authored 3 years ago and Emanuele Aina committed 3 years ago

LAVA only has two minnowboards which cannot handle the current load. In
order to reduce the load avoid running OSTree offline test that were
recently added to amd64.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

Frederic Danis authored 3 years ago and Walter Lozano committed 3 years ago

`aum-offline-upgrade-signed` test fails during phase 0 on timeout when
trying to create the different static-delta used during next phases.

Increasing the timeout allows to pass the test.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

When using test cases from git repositories by default LAVA includes their
history, however, in general this is not useful, requires more space on
overlays and extra time to copy them. Remove it by setting history to False.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

When using revision LAVA is forced to do a full clone. However, in case
using branch, LAVA is smart enough to do a shallow clone. Switch
to branch then to take advantage of this feature.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

It seems there's a side effect of geoclue preventing to pass
functional-demo test.
Furthermore geoclue is also failing.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

The test script repositories use `apertis/v20…` default branch name, and
the source archive should be downloaded using it.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Since some scenarios are only covered by HMI images, such using offline
mechanisms, move them to HMI.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

After switching to Fixed Function and HMI images the upgrades from a
previous branch only make sense from a branch that already supports the
new images. Switch then to v2022dev3 for upgradable_release.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

As Fixed Function images don't support offline upgrades move the tests
to HMI images. For automatic test use armhf and amd64 as in other LAVA
OSTree tests, while for manual ones use armhf and arm64.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

This test should also be run on BaseSDK

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Signed-off-by: Ritesh Raj Sarraf <rrs@debian.org>

Walter Lozano authored 3 years ago and Emanuele Aina committed 3 years ago

Test case of iptables-nmap fails on SDK with error

Unable to apt-get update in lxc container
Certificate verification failed: The certificate is NOT trusted. The
certificate issuer is unknown.  Could not handshake: Error in the
certificate verification. [IP: 199.232.142.132 443]

Since the problem is only present on QEMU without a clear cause, after
checking that clock time is OK workaround it by using http instead of
https.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

The expected logo is pointing to an old wifi url, which is missing.

Signed-off-by: Ariel D'Alessandro <ariel.dalessandro@collabora.com>

Frederic Danis authored 3 years ago and Arnaud Ferraris committed 3 years ago

`target` has been replaced by `hmi` images.
And some AUM tests are only run on `fixedfunction` images.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Flatpak apps are now installed by default on `hmi` images. Moreover, we 
now ship Totem instead of the "VIDEO & TV application", so make sure the 
test case reflects the new state.

Signed-off-by: Arnaud Ferraris <arnaud.ferraris@collabora.com>

Frederic Danis authored 3 years ago and Arnaud Ferraris committed 3 years ago

`armhf` is supported by `hmi` images, update test files accordingly;

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

`target` images are being renamed to `hmi` in order to have a more
descriptive name, so the test cases must be updated accordingly.

Signed-off-by: Arnaud Ferraris <arnaud.ferraris@collabora.com>

The fixedfunction image should serve a minimal static web page.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

The test case for traprain requires development and including gpgv to be
run, but installing them on target/hmi makes the test useless since it
does not resemble a standard target/hmi image. Drop it only run in on
sdk.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

As defined in the test description, this test should not be run on
fixedfunction images.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

We don't support `internal` images anymore.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Rename `minimal` to `fixedfunction` to reflects the "Fixed function device
scenario" from Apertis Platform Technical Vision.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Drop tests for didcot, frome and rhosydd since these packages are not
longer supported by Apertis.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

traprain test needs to install devscripts which depends on gnupg2 packages,
and ultimately on gpgv package. When running on target board which embed
the sequoia-gpgv replacement, the installation procedure fails due to the
conflict between sequoia-gpgv and gpgv.
gpgv package should be explicitly installed to replace sequoia-gpgv.

frome and rhosydd have the same dependency problem.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Drop invalid reference to ribchester.yaml as it is not longer supported
in v2022dev3.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

Now that the aum tests no longer redeploy the overlay at every reboot
there's no need to disable verbose reporting in those cases.

Since that was the entire purpose of the `tar_unpack_cmd()` macro and
the relative supporting code, let's drop it.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Deploy the overlay only on the first boot, rather than re-deploying it
every time we reboot.

We deploy it under `/var` so it is preserved over reboots: re-deploying
only makes the tests more time consuming.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

The first reboot is not needed, so skip it to avoid wasting precious
time on the devices under tests.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

SDK should be able to run Docker containers out-of-the-box.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>