Emanuele Aina authored 5 years ago and Luis Araujo committed 5 years ago

Target images using the etnaviv gfx stack are now built daily, and test jobs
are already being submitted, reflect this in the testcases.

See https://phabricator.apertis.org/T6395

 for more details.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Most tests have been converted to use the system journal to check for audit
events, so there's no need to reset the audit.log anymore.

Resetting it is even harmful today since `auditd` is no longer shipped by
default on images, thus the step fails as the file and the directory that
should contain it do not exist.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Use the systemd journal to retrieve audit messages, as the minimal images no
longer ship auditd.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Use branch apertis/v2019pre for all test cases.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

This field merges the image variant and arch fields in order to clearly
specify in which images a test case should be executed.

This commit adds this new field to each test case file with the specific
images where it should be executed and updates the tests and format
definition files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds support to have multiple image variants in the test
cases files.

It also adds the respective image variants list relevant to each test
case.

This commit also updates the tests files and format definition files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This is a madantory field that specifies the deployment type of the
image where this test case can be executed.

The commit adds the image-deployment field for each test case, and it
currently can be a list with the following values: APT, OSTree, Any.

This commit also updates the tests files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit renames the image-type field to image-variant
in the test cases files.

It also updates the parser, renderer code, test_case template
and unittests files in order to use the new name.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit updates the remaining tests cases for LAVA
integration.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

- Update the README listing existing macros and how to
  use the renderer.
- Rename the main program to render-test-case
- Rename the tc directory to tests-cases

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit addes a parser for the test case format, so it can
detect the most common mistakes (missing field or incorrect types
for values) in the test case yaml file.

This commit also adds a few more ported test cases.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>