Switch package builds to use containerized docker environment.
With dockerized builds:
* build dependnecies can be simply updated by updating (and regenerating)
  the docker image files
* Resources are controlled in a more deterministic order

Signed-off-by: Ritesh Raj Sarraf <ritesh.sarraf@collabora.co.uk>

Denis Pynkin authored 6 years ago and Denis Pynkin committed 6 years ago

Need to update the debug tools for TinyRFS container on regular basis.

Signed-off-by: Denis Pynkin <denis.pynkin@collabora.com>

Commit 5b436fab switched to the use of the `repobase` variable, but
it's not accessible to macros unless explicitly passed in, just like the
`git-credentials-id` variable.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Emanuele Aina authored 6 years ago and Frédéric Dalleau committed 6 years ago

The current job was trying to checkout from invalid addresses,
such as 'git@gitlab.apertis.org/infrastructure/apertis-customizations.git'
(note the missing `:`).

Switch to the `repobase` variable, which is more flexible and also
includes the `:`.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Signed-off-by: Sjoerd Simons <sjoerd.simons@collabora.co.uk>

Add apparmor-bluez-tester as development to autobuild.

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

Signed-off-by: Andre Moreira Magalhaes (andrunko) <andre.magalhaes@collabora.co.uk>

Emanuele Aina authored 6 years ago and Frédéric Dalleau committed 6 years ago

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

The apertis-design-private is not publicly accessible, but given that
this Jenkins job already has the credentials needed to access it, no
separate internal job is needed.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Emanuele Aina authored 6 years ago and Frédéric Dalleau committed 6 years ago

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Emanuele Aina authored 6 years ago and Frédéric Dalleau committed 6 years ago

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Add apparmor-chaiwala-system-tester to autobuild in development section.

Signed-off-by: Andrew Lee (李健秋) <andrew.lee@collabora.co.uk>

Store the id of the credentials used to interact with OBS in a
single place.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Store the id of the credentials used to check out from git in a
single place.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

On older branches we won't build images every day but only once a week,
so templatize that bit so only defaults.yaml.inc needs to be customized.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Emanuele Aina authored 6 years ago and Denis Pynkin committed 6 years ago

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

The jjb templating can be slightly improve so that it's a bit less of a
special case.

Signed-off-by: Sjoerd Simons <sjoerd.simons@collabora.co.uk>

For most packages the name of the git repository is the same as that of
the source package. Unfortunately gitlab doesn't allow + in git urls,
which is a problem for gtk+3.0. Adjust the packaging template a bit so
we can support the git package name and the source package name being
different and special case gtk+3.0

Signed-off-by: Sjoerd Simons <sjoerd.simons@collabora.co.uk>

Correct group on gitlab for apparmor-dbus-tester, bluez-phone-tester
and u-boot-common packages.

Signed-off-by: Andrew Lee (李健秋) <andrew.lee@collabora.co.uk>

Both the job templates in the hotdoc/ folder and the
packaging/apertis-build-packaging.yaml template ended up generating jobs
named {project}-{distro}/packages/build-apertis-designs and
{project}-{distro}/packages/build-apertis-docs.

The hotdoc jobs weren't thus never enabled, with the packaging ones
overwriting them. The hotdoc sites are still kept up-to-date by the
old multi-branch jobs manually created a long time ago.

This commit fixes them up by:
- using a template rather than two mostly-identical job definitions
- naming the jobs {project}-{distro}/hotdoc/hotdoc-{package}
- updating the git URLs after the migration to GitLab
- adding the appropriate credentials to clone from GitLab

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Andrew Lee (李健秋) authored 6 years ago and Sjoerd Simons committed 6 years ago

Add bluez-phone-tester and apparmor-dbus-tester as development to
autobuild.

Signed-off-by: Andrew Lee (李健秋) <andrew.lee@collabora.co.uk>

Andrew Lee (李健秋) authored 6 years ago and Sjoerd Simons committed 6 years ago

Add u-boot-common package to autobuild.

Signed-off-by: Andrew Lee (李健秋) <andrew.lee@collabora.co.uk>

Signed-off-by: Sjoerd Simons <sjoerd.simons@collabora.co.uk>

Signed-off-by: Sjoerd Simons <sjoerd.simons@collabora.co.uk>

Signed-off-by: Sjoerd Simons <sjoerd.simons@collabora.co.uk>

The tests in gitlab.apertis.org/tests may reference some specific
binaries which are copied into each test repository and used in
LAVA tests.

This job handles updating the binaries periodically.

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>

Folders need to be pre-created before adding the actual jobs.
Add a separate job description to automate that.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7907

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Merge has been renamed to apply in git-phab 2.0.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Denis Pynkin <denis.pynkin@collabora.com>
Differential Revision: https://phabricator.apertis.org/D7906

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Denis Pynkin <denis.pynkin@collabora.com>
Differential Revision: https://phabricator.apertis.org/D7904

JJB doesn't support SSHUserPrivateKeyBinding, and doesn't support
raw XML sections on the bindings level, which is why the whole
bindings section has to be raw XML

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Denis Pynkin <denis.pynkin@collabora.com>
Differential Revision: https://phabricator.apertis.org/D7903

Since Jenkins doesn’t know differential-merge.py is in fact checking out
a Git repository, it cannot provide the environment necessary to use the
credentials automatically, and it needs to be set up manually.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Denis Pynkin <denis.pynkin@collabora.com>
Differential Revision: https://phabricator.apertis.org/D7902

Cloning via ssh needs a private key to be provided by Jenkins.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Denis Pynkin <denis.pynkin@collabora.com>
Differential Revision: https://phabricator.apertis.org/D7901

We now have a modified version of the mtd-utils packaging. Add this to the
packages built in Jenkins.

Signed-off-by: Martyn Welch <martyn.welch@collabora.co.uk>
Reviewed-by: Andrej Shadura <andrew.shadura@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7899

This script used to parse the URLs and mangle them to support
staging repositories. Since we're retiring the staging repository
workflow together with cgit, this code won't do anything useful
and will break with ssh URLs.

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7891

`git-phab apply`, from 2.1 onwards, seems to be expecting an explicitng
revision type, as in a TXXXX or a DXXXX.

In our case, we explicitly pass a DXXXX for our diffs. Hence prepend the
variable with the 'D' string

Signed-off-by: Ritesh Raj Sarraf <ritesh.sarraf@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7880

Explicitly disable automatically stashing away changes before performing
the phab operation. This is essentially needed to keep git-phab happy

Otherwise, we run into the following exception.

git phab --arcrc ${ARCRC} apply --no-dependencies -o . ${REVISION}
Traceback (most recent call last):
  File "/usr/lib/python3.5/configparser.py", line 1135, in _unify_values
    sectiondict = self._sections[section]
KeyError: 'phab'

Signed-off-by: Ritesh Raj Sarraf <ritesh.sarraf@collabora.co.uk>
Reviewed-by: Andrej Shadura <andrewsh@phabricator.apertis.org>
Differential Revision: https://phabricator.apertis.org/D7878

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

The Mildenhall-2/Lightwood-2 rewrite never materialized and at the
moment there's no effort in that direction, so let's drop the
non-working repositories rather than keeping them disabled on Jenkins.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>
Reviewed-by: Frédéric Dalleau <frederic.dalleau@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7873