Denis Pynkin authored 6 years ago and Denis Pynkin committed 6 years ago

Split a single test case to several files per single test for
privileged and unprivileged containers.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Denis Pynkin authored 6 years ago and Denis Pynkin committed 6 years ago

All needed packages are already the part of development image used as
host OS. As soon as we will be ready to switch to minimal image -- we
will need to switch to new test framework as well.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Denis Pynkin authored 6 years ago and Denis Pynkin committed 6 years ago

Add following tests:
- folder mapping
- device mapping

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Run the testcase renderer on merge requests and branches so we can catch some
failures early.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

The preconditions mentionned to download another test.
Actually this is because this test uses bluez-setup so we add the steps for
bluez-setup in generated form.

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

This field merges the image variant and arch fields in order to clearly
specify in which images a test case should be executed.

This commit adds this new field to each test case file with the specific
images where it should be executed and updates the tests and format
definition files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Denis Pynkin authored 6 years ago and Frédéric Dalleau committed 6 years ago

Test is reworked to be more reliable and prevent the system reboot.
Added `core.min-free-space-percent = 0` option to avoid complex
calculation and re-creation of big file.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Additional hint for user stating when he need to remove the flash drive.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

This commit adds support to have multiple image variants in the test
cases files.

It also adds the respective image variants list relevant to each test
case.

This commit also updates the tests files and format definition files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This is a madantory field that specifies the deployment type of the
image where this test case can be executed.

The commit adds the image-deployment field for each test case, and it
currently can be a list with the following values: APT, OSTree, Any.

This commit also updates the tests files.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit renames the image-type field to image-variant
in the test cases files.

It also updates the parser, renderer code, test_case template
and unittests files in order to use the new name.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit makes sure that the parser considers the git-repos field
mandatory for automated tests.

It also updates one test file with a new test definition using
git-repos.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

Add test to check proper behavior in the following circumstances:
- Power cut during an update
- USB mass storage unplug during an update
- The disk is full during an update

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>
Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

Frédéric Dalleau authored 6 years ago and Denis Pynkin committed 6 years ago

Add a test to exercise the features of the Apertis update manager.
These tests only works on OSTree images and check following:
- API of update manager with `updatectl` utility
- automatic update from mass storage device with static delta
- manual upgrade with static delta file
- automatic rollback from "failed" update
- blacklist feature
- rollback feature of U-Boot bootloader

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>
Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Only remove the suffix automated from the name.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This will allow to show the specific branch that needs to be used
during cloning the tests scripts repository in the test cases
pages.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Update the test cases names so they match the names specified
in the lava job file.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Generate new tests files with the recent format changes.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit updates the sanity-check test case to avoid redundant
information when using the new macro for fetching the test
repository.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit improves the modules macro to avoid redundant information
in the test cases using such a macro.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

These test cases originally didn't have a test case page and they are
all automated tests mainly running sanity checks for different services.

Most of them are marked as High priority.

this commit also adds a new SDK test.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit updates the remaining tests cases for LAVA
integration.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Luis Araujo authored 6 years ago and Frédéric Dalleau committed 6 years ago

This commit applies the required changes to the test cases so
they can be executed in LAVA.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

This commit includes the folks and modules groups.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies the required changes to the ade test case so
it can be executed in LAVA.

The change consists in adding the `git-repos` directive so it
can fetch the tests scripts from LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies the required changes to the test cases so
they can be executed in LAVA.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

This is the SDK group in a serie of commits to integrate
all the tests into LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies the required changes to the test cases so
they can be executed in LAVA.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

This is the apparmor group in a serie of commits to integrate
all the tests into LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies the required changes to the test cases so
they can be executed in LAVA.

The change consists in adding the `git-repos` directive so they
can fetch the tests scripts from LAVA.

This is the group 0 in a serie of commits to integrate all the
tests into LAVA.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The new install:git-repos directive in the test case YAML files
will allow to clone the tests scripts in order to integrate the
test cases into LAVA.

This commit adapts the renderer to properly generate test case pages
with this new directive.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit adds the debian directory with the required files
to create the deb package.

It also updates the setup.py version to the standard versioning
scheme.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit applies several changes in order to turn the
renderer code into a proper python module and command that
can be easily installed using the setuptools module.

Main changes:
- Main executable is named atc
- Use setuptools to install renderer executable
- Improve tests so they can be easily executed by packages
- Update README instructions

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit updates the README to explain how to attach images to
test case pages.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

The way the execution steps section is formatted recently changed,
so update the rendered test file.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

This commit gives priority to automated tests during formatting
of the execution steps for tests that are both manual and
automated (exec_type: all).

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>

Just create an index page for single files when the -i option
is passed like expected.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>