After the discussions following test cases will be dropped.
apparmor-tracker
folks-ofono-backend
telepathy-ring
tracker-indexing-local-storage
tracker-indexing-mass-storage
traffic-control-basic

Apertis: T5734
Signed-off-by: Tarun Baghmar <tarun.baghmar@in.bosch.com>

Denis Pynkin authored 4 years ago and Emanuele Aina committed 4 years ago

Ask to wait a few seconds before to check if undeploy is really
finished. Sometimes the human is too fast to enter commands
so undeploy have no chance to finish before the check.
That is leading to false result of manual test while it works well.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Frederic Danis authored 4 years ago and Denis Pynkin committed 4 years ago

wget needs the complete URL to be able to download key0.key file.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

The bundle generation with an unknown key doesn't display correctly.
Move bundle generation to `pre-conditions`.
Add `cryptsetup` package installation

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

The bundle generation with an unknown key doesn't display correctly.
Add a command to retrieve the `key0.key` file from gitlab.apertis.org.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

By default SabreLite board plays sound through HDMI connector.
In case tester want to output sound through headphone connector he should
configure PulseAudio for it.

After the 2 first commands (set-default-sink and set-sink-port) the sound
is heard correctly, but not after a reboot. This is due to mute state not
saved at this time, this needs the third command (after reboot) to fix it.
Further reboot will play sound correctly.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

This commit add commands to generate a static update bundle with a key
not known by the DUT, from the original encrypted update.
It allows to test that a static update encrypted with an unknown key is not
applied.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

New version of apertis-update-manager expects offline updates to be
encrypted.
The apertis-update-manager-automount test ensure that non encrypted
updates are not applied, while encrypted updates applies correctly.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Signed-off-by: Ritesh Raj Sarraf <rrs@debian.org>

The ssh-copy-id command syntax in sdk-ade-remote-debugging.yaml is
incorrect in two ways:

- The user is in capitals, whilst the actual username used should be in
  lower case
- The test case uses `$HOST` as a convention for the hostname/IP to be used
  for the target device, this command is missing the dollar sign.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

Baghmar Tarun authored 4 years ago and Martyn Welch committed 4 years ago

Rework the testcase to not require packages to be installed and thus work on systems with an immutable rootfs like the ostree images.

Apertis: T5734

Signed-off-by: Tarun Baghmar <tarun.baghmar@in.bosch.com>

The test currently fails due to timeout.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Use the multiple ostree preconditions support introduced in 6b2fd91e
instead of hardcoding the blurb for the second repository.

Also fix the branches and the resulting paths for the unpacked scripts.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Baghmar Tarun authored 4 years ago and Emanuele Aina committed 4 years ago

Rework the testcase to not require packages to be installed and thus
work on systems with an immutable rootfs like the ostree images.

Apertis: T5734

Signed-off-by: Baghmar Tarun <tarun.baghmar@in.bosch.com>

The LAVA lab is currently facing badnwidth issues. Switching to a
different ISP is planned, but due to the COVID impact there's no
progress on that front.

The current ade tests got badly impacted, with the download phase
consuming all the allocated time.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Hattihal Basavana Gowda Chethan authored 4 years ago and Emanuele Aina committed 4 years ago

When some test scripts got moved from /usr/share/chaiwala-tests/ to
/usr/lib/apertis-tests/ their path in the test definitions didn't get
updated, causing the tests to fail:

    + common/run-test-in-systemd --basename --user=user -- /usr/share/chaiwala-tests/sdk/automated/test-valgrind.sh
    /var/lib/lava-1826179/1/tests/6_sdk-debug-tools-valgrind/apertis-tests/common/tee-exec: 19: /var/lib/lava-1826179/1/tests/6_sdk-debug-tools-valgrind/apertis-tests/common/tee-exec: Job for generated-test-case-test-valgrind.service failed because the control process exited with error code./usr/share/chaiwala-tests/sdk/automated/test-valgrind.sh: not found

To fix the issue, rather that using the version shipped in
/usr/lib/apertis-tests/ use the one in the git repository since we
already have it checked out.

Fixes: https://phabricator.apertis.org/T6349
Fixes: https://phabricator.apertis.org/T6350
Fixes: https://phabricator.apertis.org/T6351
Fixes: https://phabricator.apertis.org/T6352



Signed-off-by: hattihalbasavanagowda.chethan <hattihalbasavanagowda.chethan@in.bosch.com>

This reverts commit 8ea0915d.
Disable internal armhf image from supported images types
for OTA update tests since their behavior aren't stable and
there is no value to test AUM on this platform.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Luis Araujo authored 5 years ago and Peter Senna Tschudin committed 4 years ago

This commit fixes the name of the virtual machines for the psdk-test,
and make small fixes for typos and grammar issues.

Signed-off-by: Peter Senna Tschudin <peter.senna@collabora.com>
Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Luis Araujo authored 5 years ago and Peter Senna Tschudin committed 4 years ago

This commit updates the SDK persistent disk test cases to use the new
psdk-test script that semi-automate the execution of these tests.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Baghmar Tarun <tarun.baghmar@in.bosch.com>

The templates hardcoded the `master` branch for the repositories
shipping the actual test scripts and binaries, but we use release-coded
branch names like `apertis/v2021dev2` there so the links in the
instructions pointed to the wrong place.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Baghmar Tarun authored 4 years ago and Frederic Danis committed 4 years ago

1. sdk-flatpak-build-helloworld-app.yaml: building the app by using mildenhall runtime.
2. sdk-flatpak-helloworld-app.yaml: running the helloworld-app present in the server.

Signed-off-by: Tarun Baghmar <Tarun.Baghmar@in.bosch.com>

Add internal armhf image into supported images types
for OTA update tests.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Signed-off-by: Baghmar Tarun <tarun.baghmar@in.bosch.com>

Add the test for checking non-successful update during OTA update.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Ensure that only updates signed with valid key can be applied.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Test OTA updates behavior with lack of disk space.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Add automatic test of unattended network updates.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Add automatic test for network updates API.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

This reverts commit ab727249 because the
automation script still needs to be adapted to run under the
restrictions faced by RBEI. The test case will be updated once the
automation is updated.

Signed-off-by: Peter Senna Tschudin <peter.senna@collabora.com>

This reverts commit b7e68a3f because the
automation script still needs to be adapted to run under the
restrictions faced by RBEI. The test case will be updated once the
automation is updated.

Signed-off-by: Peter Senna Tschudin <peter.senna@collabora.com>

Baghmar Tarun authored 4 years ago and Martyn Welch committed 4 years ago

Signed-off-by: Baghmar Tarun <tarun.baghmar@in.bosch.com>

Allow to use the board without fused Apertis SRK for limited
testing -- without validation of signed U-Boot.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

This test ensures:
- U-Boot is compiled with HAB and FIT support
- SRK hash is fused and U-Boot is signed ('hab_status' call)
- U-Boot is able to verify signed OS image in FIT format
- U-Boot hangs in case if we try to boot with unsigned binary

Unfortunately the DUT in "open" mode assume any signature as valid,
hence it is not possible to check the boot hang for FIT image signed
with incorrect key -- the HW return 'success' while checking signature.

If the system is in 'closed' state then it is able to use incorrect
signature for the image, for example taken from document
"High Assurance Boot (HAB) for dummies" by Boundary Devises:
https://boundarydevices.com/high-assurance-boot-hab-dummies/



To check if the system is in "closed" state:
  => fuse read 0 6
     Reading bank 0:

     Word 0x00000006: 00000012

the last digit must be "2".

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>
Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Frederic Danis authored 4 years ago and Emanuele Aina committed 4 years ago

The `connmand` profile is now in enforce mode.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Baghmar Tarun authored 4 years ago and Sjoerd Simons committed 4 years ago

1. ofono-sms-recieve
2. ofono-sms-send

Signed-off-by: Baghmar Tarun <tarun.baghmar@in.bosch.com>

Currently `apparmor-bluez-avrcp-volume` test request to run
`bluez-avrcp-volume` test, allowing to install all dependencies for both
tests. Running solely one test ends up in errors due to missing
dependencies.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Benani Sagar Kishore authored 5 years ago and Luis Araujo committed 5 years ago

Signed-off-by: Sagar Kishore Benani <SagarKishore.Benani@in.bosch.com>

Allow for Mildenhall components known to generate unrelated AppArmor
complaints.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

These ports are valid services that should be running in the images.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>