Address a regression introduced in commit 6b2fd91e "Turn the OSTree
preconditions into a list" where the iteration on the preconditions list
was done improperly.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Baghmar Tarun authored 4 years ago and Emanuele Aina committed 4 years ago

If a test case requires multiple repositories it can now use a list of
objects as the OSTree preconditions to check them all out.

Signed-off-by: Baghmar Tarun <tarun.baghmar@in.bosch.com>

The templates hardcoded the `master` branch for the repositories
shipping the actual test scripts and binaries, but we use release-coded
branch names like `apertis/v2021dev2` there so the links in the
instructions pointed to the wrong place.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Use names for the precondition variables that reflect the properties in
the testcase definitions so it's easier to spot what's going on.

This will alos make it easier to later expand them to use multiple
values.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Emanuele Aina authored 5 years ago and Luis Araujo committed 5 years ago

The lack of links support in the `steps:` list caused the `sdk-persistent-disk`
to lack important instructions, making testers more confused than necessary.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

The pre-condition steps generated by the `install`/`git-repos` directives
where only rendered for automated testcases. Arguably, manual testers are
more interested in those being rendered than LAVA, which usually considers
the YAML enough as-is.

This currently affected the WebKit manual testcases such as
webkit2gtk-ac-3d-rendering.yaml where no installation pre-condition was
rendered, omitting fundamental steps needed by manual testers.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Commit 108fb918 was a bit too eager in changing the branch names and also
changed the ones in the unit tests, breaking them since the reference files
weren't update accordingly.

Revert those changes so that unit tests pass again.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

This field merges the image variant and arch fields in order to clearly
specify in which images a test case should be executed.

This commit adds this new field to each test case file with the specific
images where it should be executed and updates the tests and format
definition files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds support to have multiple image variants in the test
cases files.

It also adds the respective image variants list relevant to each test
case.

This commit also updates the tests files and format definition files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This is a madantory field that specifies the deployment type of the
image where this test case can be executed.

The commit adds the image-deployment field for each test case, and it
currently can be a list with the following values: APT, OSTree, Any.

This commit also updates the tests files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit renames the image-type field to image-variant
in the test cases files.

It also updates the parser, renderer code, test_case template
and unittests files in order to use the new name.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit makes sure that the parser considers the git-repos field
mandatory for automated tests.

It also updates one test file with a new test definition using
git-repos.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This will allow to show the specific branch that needs to be used
during cloning the tests scripts repository in the test cases
pages.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Generate new tests files with the recent format changes.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit improves the modules macro to avoid redundant information
in the test cases using such a macro.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The new install:git-repos directive in the test case YAML files
will allow to clone the tests scripts in order to integrate the
test cases into LAVA.

This commit adapts the renderer to properly generate test case pages
with this new directive.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies several changes in order to turn the
renderer code into a proper python module and command that
can be easily installed using the setuptools module.

Main changes:
- Main executable is named atc
- Use setuptools to install renderer executable
- Improve tests so they can be easily executed by packages
- Update README instructions

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>