After commit 7743e46f "Drop the LAVA templates moved to
apertis-test-cases" the package build failed with:

    cp -a templates /usr/src/packages/BUILD/debian/tmp/usr/lib/apertis-tests/
    cp: cannot stat 'templates': No such file or directory

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

This merge includes:
 0c7a9d45 for using portable string
 representation for file path

 f956e3b0 for removing the usage of
 ssh-copy-id script

Signed-off-by: Peter Senna Tschudin <peter.senna@collabora.com>

The LAVA templates have been recently added to apertis-test-cases
to slightly simplify how we deal with the testing machinery:
tests/apertis-test-cases!154

With the correspoding changes in the recipes repository the templates
hosted here are no longer used:
infrastructure/apertis-image-recipes!243



Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

This reverts commit b41413ab.
Need to disable OTA update tests for internal minimal armhf
since their behavior isn't stable and there is no value to
test AUM on this platform.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Currently this test fails due to timeout.

Generation of signed and non-signed static delta in
aum-offline-upgrade/run-test-signature.sh take long time.

In apertis-test-cases/test-cases/aum-offline-upgrade-signed.yaml,
run-test-in-systemd's timeout is already set to 900 secs (15 min).

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Recently large numbers of the daily tests have been failing due to the
initial downloads of the nfs root timing out. Evaluation of the LAVA
logs shows that downloads from images.apertis.org are sub 1MB/s early in
the morning when these tests tend to run.

At least whilst further investigation is performed to determine the cause
of this slowness, massively bump the timeout (3 --> 15 min) so that these
tests will run rather than failing.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

The new GitLab-based image pipeline uses for the LAVA job submission the
same image URL prefix used in the rest of the pipeline to make it work
with secondary branches, while the old Jenkins pipeline didn't submit
LAVA jobs for them.

https://gitlab.apertis.org/infrastructure/apertis-internal-image-recipes/-/blob/ac4ffb86/.gitlab-ci/templates-submit-tests.yml#L20



This means that base URL already includes the `internal/` path component
and thus there's no need to override it in the job profile.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Enable OTA tests for SabreLite minimal internal images

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Denis Pynkin authored 4 years ago and Denis Pynkin committed 4 years ago

Enable OTA tests for SabreLite minimal public images

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Denis Pynkin authored 4 years ago and Denis Pynkin committed 4 years ago

Added templates for testing OTA updates:
- API
- auto
- diskfull
- rollback/blacklist
- signed/unsigned update

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

This test should not be run on `minimal` images as they do not embed
pulseaudio which is part of this test.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

connmand is now in enforce mode.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

`ptsree` tool is not available in Apertis images,
so using `ps` to get processes tree.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Some components, like Mildenhall ones, generate unrelated AppArmor
complaints.
This new parameter allows to pass a list, in `sed` format, to remove these
complaints.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

This commit updates the iptables-nmap test script to recognize more
valid services running in the image.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The iptables-nmap is a new automated test that should run in all platforms.

This commit includes the LAVA job file template and enabling the job in
the profiles file for all platforms.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds the script to automate the iptables-nmap test case:
https://qa.apertis.org/iptables-nmap.html



Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Ritesh Raj Sarraf <rrs@debian.org>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

And instead just copy the SSH key directly using scp command.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Use the Path module to handle the image path in the psdk-test in a
portable way.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Emanuele Aina authored 5 years ago and Andrej Shadura committed 5 years ago

A long time ago, when Apertis was not yet Apertis and SAC was its name,
the LAVA workers had a pre-deployed image that people could use for quick
testing, and this job was used to run `apt dist-upgrade` on those images
to keep them up-to-date.

Now those pre-deployed images are long forgotten, so let's also drop their
vestigial remains.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Emanuele Aina authored 5 years ago and Andrej Shadura committed 5 years ago

The ADE tests have been put in their own group, which mean that a whole new
image gets deployed just to run a couple of tests, for no good reason.

Let's save some trouble and re-use the same instance set up for all the
other SDK tests.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

The `baseurl` variable is useful to load images to be tested from a
non-standard location, for instance when submitting tests from
branches that haven't been merged yet and that uploaded their
artifacts to https://images.apertis.org/test/ instead of
https://images.apertis.org/

.

However, to be used in that way the location of the nfs artifacts used in the
first stage should not change when setting `baseurl`.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

images.apertis.org removes files older than 1 day from test repo.
runtime and app repos has been moved to images.apertis.org/flatpak.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Luis Araujo authored 5 years ago and Peter Senna Tschudin committed 5 years ago

The psdk-test is a script to semi-automate the following SDK persistent
tests:

https://qa.apertis.org/sdk-persistent-disk.html
https://qa.apertis.org/sdk-persistent-disk-home-user.html
https://qa.apertis.org/sdk-persistent-disk-etc.html



The script executes a prompt to enter a set of commands that will
automatically run most of the test setup and execution guiding the tester
through the different stages of the test.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

While converting the package to the new GitLab-to-OBS pipeline the project
was mistakenly forked under `pkg/` rather than transferred and now the
repositories went out of sync.

Fold the changes back so we can replace the forked repository with the
original one.

* packaging/apertis/v2021dev1:
  Releasing apertis version 0.2020.1.
  gitlab-ci: Link to the Apertis GitLab CI pipeline definition

This adds test to install the org.apertis.demo.curl application and test
it by retrieving https://www.apertis.org

 page.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

This commit adds a script to automate the apparmor-session-lockdown-no-deny
test case.

It also adds the test to run in LAVA jobs.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Remove setting terminal properties to show colored text.

This seems to break some tests in LAVA, and it is a feature not really
needed for LAVA test, so just remove it.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Andrew Lee (李健秋) <ajqlee@debian.org>

Commit bc9094f4 broke the first stage in many ways, and commit 3b9a1487
forgot to fix the path to the DTB files needed for the ARM64 Renesas R-Car
boards, resulting in the error below:

  Job error: Invalid job data: ["Resource unavailable at 'https://images.apertis.org/release/v2019/v2019.1/arm64/dtbs/renesas/r8a7796-m3ulcb.dtb

' (404)"]

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Commit bc9094f4 broke the first stage in many ways, the one
being fixed here is the change of the prompts to be expected
during autologin and when getting access to the shell.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Commit bc9094f4 broke the first stage, see for instance
https://lava.collabora.co.uk/scheduler/job/2166454

  Job error: Invalid job data: [
    "Resource unavailable at 'https://images.apertis.org/release/v2019/v2019.1/amd64/initrd.img' (404)",
    "Resource unavailable at 'https://images.apertis.org/release/v2019/v2019.1/amd64/apertis-nfs-amd64.tar.gz

' (404)"]

A `nfs/` component in the path was missing.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>