Guillaume Tucker recently fixed the LAVA-side meaning of the sd-card device id
to actually point to the SD card on the ARM64 Renesas R-Car m3ulcb boards.

This solves some out-of-space errors but also means that flashing images takes
more time and sometimes 20 minutes are not enough. Raising the timeout to 60
minutes should be plenty.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Guillaume Tucker authored 6 years ago and Andrej Shadura committed 6 years ago

Add missing "fixupdict" definitions to replace status strings with
lower case versions.

Signed-off-by: Guillaume Tucker <guillaume.tucker@collabora.com>
Reviewed-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Review and fix all patterns for the LAVA Common tests.

Signed-off-by: Guillaume Tucker <guillaume.tucker@collabora.com>
Reviewed-by: Andrej Shadura <andrew.shadura@collabora.co.uk>
Apertis: T5005

Review the patterns used in all the "SDK tests" LAVA jobs and adjust
them as required so they always match and report one of the 4 valid
status strings.

Signed-off-by: Guillaume Tucker <guillaume.tucker@collabora.com>
Reviewed-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Apertis: T5005

Update result pattern regex with explicit "PASSED|FAILED" words for
folks test cases where it was left to a wildcard.  This caused other
log messages such as "NOTE: Run..." to be matched as results.  It also
seemed to make it more likely for log lines to stumble upon each other
and cause some message corrpution.

Signed-off-by: Guillaume Tucker <guillaume.tucker@collabora.com>
Reviewed-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>

New LAVA version will check kernel messages to make sure the
kernel can start correctly.

This commit adds the kernel_start_message variable to the
job templates to test for any string as a valid kernel message
after the bootloader is properly matched.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Guillaume Tucker <guillaume.tucker@collabora.com>
Differential Revision: https://phabricator.apertis.org/D7638

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>

Ifconfig's output format has changed recently, leading to parsing
failures. Use iproute's output, as it's more stable.

Apertis: T4500

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Luis Araujo <luis.araujo@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7549

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>

Differential Revision: https://phabricator.apertis.org/D7544

Apertis: T4500

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Sjoerd Simons <sjoerd.simons@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7539

There is no need to test for all locales in minimal
images.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7527

Move tests requiring bash to the bottom, so it's installed after
all non-bash-requiring tests have been performed.

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7528

These are quite difficult to port to dash fully right now, revert to
bash.

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7523

This test actually requires some locale po files installed
by the apertis-tests package in a data dir to execute the
tests.

So revert the previous change to execute this test from git,
and instead keep using the apertis-test package.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7509

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>

This code is unmaintainable as is, and is buggy.

If run with set -e, it would not detect failures properly and
fail only because test would fail with an unquoted $s argument,
which would be unset because echo would fail to run after the
command failed.

Instead, let's just drop this horrific wizardry and use plain
simple || return $? to pass the return code further on.

Also, reduce the function of DEBUG to enabling all output, defaulting
to disabling both stdout and stderr. The original code didn't do
what it said it was doing anyway.

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7506

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Martyn Welch <martyn.welch@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7504

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Martyn Welch <martyn.welch@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7503

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Martyn Welch <martyn.welch@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7502

- Use sed instead of bash replacing substitutions
- Use = instead of == in [.

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Martyn Welch <martyn.welch@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7501

Luis Araujo authored 7 years ago and Andrej Shadura committed 7 years ago

Before creating the temporary directory for tests, create the
baseworkdir path for it.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7500

Luis Araujo authored 7 years ago and Andrej Shadura committed 7 years ago

Before creating the temporary directory for tests, create the
baseworkdir path for it.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7500

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>

Add bash as a dependency and move to the SDK template.

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7498

Add bash as a dependency and move to the SDK template.

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7498

Luis Araujo authored 7 years ago and Andrej Shadura committed 7 years ago

This commit gets the librest, libsoup and glib-gio-fs
tests to run directly from git. It also removes the
unneeded package dependency on chaiwala-tests.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7494

The only tests remaining not ported are tumbler tests and a few
SDK tests.

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7497

SDK images should have bash preinstalled anyway, but we mark these
tests in their definition for clarity so that it's not forgotten
if anything changes.

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7495

This commit gets the librest, libsoup and glib-gio-fs
tests to run directly from git. It also removes the
unneeded package dependency on chaiwala-tests.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7494

POSIX shell doesn't support RANDOM variable getting a new random
number on each read. In fact, we don't need it in most places,
as creating temporary directories is better done by mktemp, and we
don't really need to randomise the port number.

Signed-off-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Luis Araujo <luis.araujo@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7496

The recommended way to run tests is from the git repository
directly since most of the scripts are adapted to run tests
this way.

This commit also removes the unneeded chaiwala-tests package
dependency.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7493

The recommended way to run tests is from the git repository
directly since most of the scripts are adapted to run tests
this way.

This commit also removes the unneeded chaiwala-tests package
dependency.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7492

The recommended way to run tests is from the git repository
directly since most of the scripts are adapted to run tests
this way.

This commit also removes the unneeded chaiwala-tests package
dependency.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7493

The recommended way to run tests is from the git repository
directly since most of the scripts are adapted to run tests
this way.

This commit also removes the unneeded chaiwala-tests package
dependency.

Signed-off-by: Luis Araujo <luis.araujo@collabora.co.uk>
Reviewed-by: Andrew Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7492