Use names for the precondition variables that reflect the properties in
the testcase definitions so it's easier to spot what's going on.

This will alos make it easier to later expand them to use multiple
values.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Emanuele Aina authored 5 years ago and Luis Araujo committed 5 years ago

The lack of links support in the `steps:` list caused the `sdk-persistent-disk`
to lack important instructions, making testers more confused than necessary.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

This field merges the image variant and arch fields in order to clearly
specify in which images a test case should be executed.

This commit adds this new field to each test case file with the specific
images where it should be executed and updates the tests and format
definition files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This is a madantory field that specifies the deployment type of the
image where this test case can be executed.

The commit adds the image-deployment field for each test case, and it
currently can be a list with the following values: APT, OSTree, Any.

This commit also updates the tests files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit renames the image-type field to image-variant
in the test cases files.

It also updates the parser, renderer code, test_case template
and unittests files in order to use the new name.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This will allow to show the specific branch that needs to be used
during cloning the tests scripts repository in the test cases
pages.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit improves the modules macro to avoid redundant information
in the test cases using such a macro.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The new install:git-repos directive in the test case YAML files
will allow to clone the tests scripts in order to integrate the
test cases into LAVA.

This commit adapts the renderer to properly generate test case pages
with this new directive.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies several changes in order to turn the
renderer code into a proper python module and command that
can be easily installed using the setuptools module.

Main changes:
- Main executable is named atc
- Use setuptools to install renderer executable
- Improve tests so they can be easily executed by packages
- Update README instructions

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds the --index-page option to create an index
page for the test cases.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

- Add support to add web links.
- Add support to attach images.
- Update test cases to make use of web links.
- Add new ported test cases.
- Add images files required by test cases.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit also adds a new macro 'macro_modules_preconditions'
to make convenient adding the preconditions for the library modules
test cases.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

- Adds a command line interface to the renderer to process a single
  test case yaml file or a directory of files.
- Adds the feature to write the test case html page inside a specific
  directory.
- Port few more test cases to the yaml format.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit addes a parser for the test case format, so it can
detect the most common mistakes (missing field or incorrect types
for values) in the test case yaml file.

This commit also adds a few more ported test cases.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

- Add a new post-condition section.
- Add a new macro to install packages for automated tests.
- Slightly change the way the function to parse lists work. Now
  only the run.steps section will be treated different from
  other sections.
- Apply syntax changes to the already ported test cases.
- Add new ported test cases.
- Update the README explaining a rule for the formatter.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit updates the remaining test cases with the supported
format.

It also adds a first macro to conveniently add common pre-conditions
for ostree test cases.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>