Frédéric Dalleau authored 6 years ago and Denis Pynkin committed 6 years ago

Add a test to exercise the features of the Apertis update manager.
These tests only works on OSTree images and check following:
- API of update manager with `updatectl` utility
- automatic update from mass storage device with static delta
- manual upgrade with static delta file
- automatic rollback from "failed" update
- blacklist feature
- rollback feature of U-Boot bootloader

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>
Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Only remove the suffix automated from the name.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This will allow to show the specific branch that needs to be used
during cloning the tests scripts repository in the test cases
pages.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Update the test cases names so they match the names specified
in the lava job file.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Generate new tests files with the recent format changes.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit updates the sanity-check test case to avoid redundant
information when using the new macro for fetching the test
repository.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit improves the modules macro to avoid redundant information
in the test cases using such a macro.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

These test cases originally didn't have a test case page and they are
all automated tests mainly running sanity checks for different services.

Most of them are marked as High priority.

this commit also adds a new SDK test.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit updates the remaining tests cases for LAVA
integration.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Luis Araujo authored 6 years ago and Frédéric Dalleau committed 6 years ago

This commit applies the required changes to the test cases so
they can be executed in LAVA.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

This commit includes the folks and modules groups.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies the required changes to the ade test case so
it can be executed in LAVA.

The change consists in adding the `git-repos` directive so it
can fetch the tests scripts from LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies the required changes to the test cases so
they can be executed in LAVA.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

This is the SDK group in a serie of commits to integrate
all the tests into LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies the required changes to the test cases so
they can be executed in LAVA.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

This is the apparmor group in a serie of commits to integrate
all the tests into LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies the required changes to the test cases so
they can be executed in LAVA.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

This is the group 0 in a serie of commits to integrate all the
tests into LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The new install:git-repos directive in the test case YAML files
will allow to clone the tests scripts in order to integrate the
test cases into LAVA.

This commit adapts the renderer to properly generate test case pages
with this new directive.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds the debian directory with the required files
to create the deb package.

It also updates the setup.py version to the standard versioning
scheme.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies several changes in order to turn the
renderer code into a proper python module and command that
can be easily installed using the setuptools module.

Main changes:
- Main executable is named atc
- Use setuptools to install renderer executable
- Improve tests so they can be easily executed by packages
- Update README instructions

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit updates the README to explain how to attach images to
test case pages.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The way the execution steps section is formatted recently changed,
so update the rendered test file.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit gives priority to automated tests during formatting
of the execution steps for tests that are both manual and
automated (exec_type: all).

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Just create an index page for single files when the -i option
is passed like expected.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds the --index-page option to create an index
page for the test cases.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This routine will only copy files to the destination directory if
it is not in the current working directory (development dir), and
will properly update the files if they already exist.

It also will take care of creating the destination directory if
it doesn't exist.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds the unit test module for the renderer.

It includes tests for the parser, renderer and relevant formatting
methods. It also adds a set of files that are used by some of these
tests.

The commit also updates the README file explaining how to execute
these tests.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Using exceptions offers a better interface for the parser to
report errors.

It also makes more convenient to test the parser code.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

With the test now ported to https://gitlab.apertis.org/tests/tumbler-thumbnailing


lets update the test template with new instructions to run the test

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

Explain some of the format rules and parser behaviour
in the README file.

This commit also fixes a minimal typo in the render-test-case
comments.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

- Remove the install-tests-cases.yaml test definition. This was
  only used for testing how to install test cases in lava.
- Move the format definition and template to the format/ dir.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Update apparmor-tumbler with new instructions

See merge request tests/apertis-tests-cases!1

With the test now ported to https://gitlab.apertis.org/tests/apparmor-tumbler


lets update the test template with new instructions to run the test

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

- Add the remaining test cases for tiny containers.
- Add a new image type: tiny-lxc
- Add new execution type: all

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

- Add the remaining test cases
- Rename some sdk test cases to keep their name shorter

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

- Add support to add web links.
- Add support to attach images.
- Update test cases to make use of web links.
- Add new ported test cases.
- Add images files required by test cases.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Add the compatibility and performance test cases type to be recognized
by the parser.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>