Having many tests on the same group does make the LAVA overlay
too big for devices with small amount of free space. Thus some
tests randomly fail due to lack of space.

To make things worse, some old tests rely in packages like python
which are not part of the images and need to be installed, consuming
extra space.

To workaround this issue, split the test group in two, moving tests
with similar dependencies to a new to reduce the amount of space
required per group.

This will be fixed once tests will be moved from pkg/apertis-tests
to tests/ but in the meantime let's do the split to reduce the chance
of random failures.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Walter Lozano authored 10 months ago and Martyn Welch committed 10 months ago

As explained in f2100830 RPi4 had a different layout with not enough space
to perform kernel updates. Unfortunately this was properly fixed after the
release of v2023.5 so, to in order to perform the test use a different image
which has been published only for this purpose, which is based on v2023.5
but with the new layout.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>
[Martyn Welch: Backported to v2024]
Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

We are no longer using cgroups in any special way in Apertis. In
addition it has been discovered that these tests have a flaw that allows
them to silently fail. Remove the tests as they are both broken and not
required.

Signed-off-by: Martyn Welch <martyn.welch@collabora.com>

There are several tests that installation additional packages to run tests, even
if this is a bad practice, and additionally requires extra space in the root
partition.

A proper fix is to rewrite the test in its own repo to only hold the important
information and binaries to run the test, but this approach requires much time.
In the meantime, at least remove unneeded dependencies to save space which is
quite limited. Also, the lack of this space in some cases can make tests to
fail, as it is not possible to install the dependencies.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

Since the functionality provided by ade has little value after the switch
to Flatpak, change the test priority to medium.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

Since the current test case uses several customizations to target device,
add additional clarifications and checks to ensure the system is properly
setup.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

Since these tests also are applicable to AMD 64 let's run them.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

This set of tests ensures that Apertis has the support for different type
of WiFi configuration. Since our OSTree image are not shipped with hostapd
enabled a set of configurations are required to properly setup the AP.

While this is possible to in OSTree images, it is easier to do it on APT
images. Moreover, the test seems to be designed to run on APT images as
it tries to create files on a read-only file system.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

Andrej Shadura authored 1 year ago and Walter Lozano committed 1 year ago

Generating license BOM sometimes takes longer than an hour resulting in
jobs being killed.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Andrej Shadura authored 1 year ago and Walter Lozano committed 1 year ago

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Andrej Shadura authored 1 year ago and Walter Lozano committed 1 year ago

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Andrej Shadura authored 1 year ago and Walter Lozano committed 1 year ago

We cannot install any packages in ostree images.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Andrej Shadura authored 1 year ago and Walter Lozano committed 1 year ago

We can use busybox wget instead of curl to avoid installing extra
packages which is not possible with ostree images.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Nithin Mysore Nagesh authored 1 year ago and Walter Lozano committed 1 year ago

Signed-off-by: Nithin M N <MN.Nithin@in.bosch.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

These jobs are only used to test that the jobs can be generated
and not to generate jobs that will be sent to LAVA. The "real"
generate-tests-* jobs are located in the apertis-image-recipes
repositorty.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

These jobs are no longer used here, now they live in the
apertis-image-recipes repository. Keeping them here is
more confusing than useful.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Nithin Mysore Nagesh authored 1 year ago and Nithin Mysore Nagesh committed 1 year ago

After systemd has started to support pstore the test needs to be adapted to use this new functionality.
Upon startup, systemd-pstore will monitor and extract the pstore contents and save it inside /var/lib/systemd/pstore/.

This also fixes the failure in the current test as /sys/fs/pstore: is not longer available.

Signed-off-by: Nithin M N <MN.Nithin@in.bosch.com>


(cherry picked from commit 4e1986fa)

Since package geoclue has been moved to developement it has no sense to
run it on fixed function or HMI images. The test itself passes, however,
the development repositories need to be enabled and many packages need
to be installed, which modifies the image completely.

Additionally, on HMI image, due to the number of packages that need to
be installed the LAVA job fails with

Test error: ['Unable to start test stage 1', 'Unable to start test stage 1']

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

Siva Krishna Prasad Chinthalapudi authored 1 year ago and Walter Lozano committed 1 year ago

remove deprecated pkg `Xephyr` and use agl-compositor

Signed-off-by: Chinthalapudi Siva Krishna Prasad <sivakrishnaprasad.chinthalapudi@in.bosch.com>


(cherry picked from commit d27919af)

During the backport of this test the branch used to pick the tools was not
updated causing the the test to used the wrong version.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

Andrej Shadura authored 1 year ago and Walter Lozano committed 1 year ago

Set image_needs_job_token when generating jobs and only pass
CI_JOB_TOKEN when it’s defined. This avoids having to work around
it when CI_JOB_TOKEN is not necessary and the job definition is used
e.g. with lava-submit/lqa which do not support "job" variable.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

Apertis v2022 is not supported anymore, instead
use the last release of Apertis v2023.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Andrej Shadura authored 1 year ago and Walter Lozano committed 1 year ago

To avoid repeating settings from image recipes, use a tiny Python script
to parse the original pipeline’s YAML definition and collect variables
into .env files to be sourced directly into the image building job’s
shell.

The original pipeline places the devroot tarball in a directory that
would otherwise not be accessible in this job, so we override it by
passing another -t devrootpack: argument to debos.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Andrej Shadura authored 1 year ago and Walter Lozano committed 1 year ago

The image building jobs are made dependencies of test jobs in order to
allow them to use freshly build image artifacts. The dependency is
marked optional to allow the pipeline to run with daily images as
before when build-custom-image: yes is not set for the package.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

While BUILD_RESULTS_URL refers to the artifact from the obs-capture job,
SOURCE_RESULTS_URL refers to the artifact from the build-source job.
To avoid capturing duplicated files on gitlab side, the debian source
package will no longer be captured by obs-capture since it's already
captured by build-source.

Moreover, for native packages, SOURCE_RESULTS_URL refers to the main
tarball instead of the *.debian.tar.* tarball which doesn't exist for
native package.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

Use lava-runner templating to pass package name instead of hardcoding it with generate*jobs.py scripts

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

To be consistent with the LAVA job which retrieve artifacts by
passing CI_JOB_TOKEN in header of curl request.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

In order to retrieve artifacts from private gitlab projects,
we need to pass the gitlab CI_JOB_TOKEN as header to curl
otherwise access is not granted.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

This option is required to trigger the test pipeline as a child pipeline
in our ci-package-builder pipeline. Without 'rules: when' set
the child test pipeline is not triggered.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

This is useful to get a nice summary from the GitLab webui.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

This feature will be used for package centric jobs, since we want to use
includes defined in tests/apertis-test-cases whereas the jobs run in
another repositories (i.e. pkg/***).

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

This script is used by package centric jobs to get
the artefacts URL to retrieve from the target device.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>
Signed-off-by: Malik Mlitat <malik.mlitat@de.bosch.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>
Signed-off-by: Malik Mlitat <malik.mlitat@de.bosch.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 1 year ago

This option allows to select which test type to generate.
This is useful for package centric jobs since we want to generate
jobs only for the type "package".

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Nithin Mysore Nagesh authored 1 year ago and Walter Lozano committed 1 year ago

Create separate job to validate vehicle daemon functionality on target

Signed-off-by: MN Nithin <MN.Nithin@in.bosch.com>

Nithin Mysore Nagesh authored 1 year ago and Walter Lozano committed 1 year ago

Signed-off-by: MN Nithin <MN.Nithin@in.bosch.com>