Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

We may want to run the CI pipeline to pull updates from a debian release
backports upstream. Extend this script to handle those branches.

Signed-off-by: Ariel D'Alessandro <ariel.dalessandro@collabora.com>

Updates available in -security and -proposed-updates fall into the main Debian repository
after a Debian release point. In case an update has been imported from -security or -proposed-updates,
our main Debian branch stays out of date. Consequently, the Dashboard wrongly complains about an
available update from Debian.

In this scenario, the main Debian branch needs to be synchronized with the
-security or -proposed-updates branch used previously.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

These being essential packages, a script is needed to backup binaries
used to do the upgrade.

Signed-off-by: Detlev Casanova <detlev.casanova@collabora.com>

Explicitly attempt a fast forward merge before rebasing.

Currently we always try to rebase, which already doews a fast-forward
merge when possible. The issue is that after that we incoditionally try
to append a new changelog entry and if we're fast-forwarding we should
**not** to that since the changelog will already have a version equal or
newer than the one we're trying to add.

By explicitly attempting a fast-forward merge and exiting early we avoid
that issue.

This has not been a particular issue so far since the mirroring
pipeline which uses the rebasing feature does not usually trigger it
when a fast-forward is possible and will create all the branches in
their final state.

However in some cases unrelated errors encountered during the process
have left repositories in a inconsistent state and this change allows to
recover cleanly from those situations.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

gitlab-rulez package is now required to run import-debian-package tests.
Let's test this script on apertis, as it provides the package.

Signed-off-by: Ariel D'Alessandro <ariel.dalessandro@collabora.com>

To import a new package from Debian the current process required several
manual steps. This commit adds the --push-remote option to allow
creating and pushing the imported package to apertis remote gitlab
instance.

The following steps are now automatized:
* package folder is created and import process is performed in there.
* remote repo is created if it doesn't exist.
* remote branches and tags are pushed.
* gitlab settings are applied to remote repo.
* CI pipeline is triggered on all downstream branches.

Signed-off-by: Ariel D'Alessandro <ariel.dalessandro@collabora.com>

With the new application framework, the application bundle is now
implemented using Flatpak, so drop this functionality from ADE.
Keep the sysroot management functionality as well as the
possibility of compile standard applications like dash.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

These tools are moved from
`infrastructure/apertis-docker-images/package-source-builder`.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

This tool is moved from `infrastructure/packaging-tools`.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Running `ade sysroot install --release v2021dev3 --arch amd64` results
in `ade` complaining with:

    usage: ade sysroot install [-h] [--verbose] [--distro DISTRO]
                               [--release RELEASE] [--arch {armhf,arm64}]
                               [--url URL] [--user USER] [--password PASSWORD]
                               [--netrc NETRC] [--file FILE] [--force]
    ade sysroot install: error: argument --arch: invalid choice: 'amd64' (choose from 'armhf', 'arm64')

This means that developers attempting to target amd64 targets aren't
going to be able to follow the ADE documentation and we can't easily
target different releases using ADE when using an amd64 target, so
sync the list of allowable values with the main list of the kind of
sysroots we support.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

When no .netrc file is found, ade resorts to priting an error message.
This can be annoying when users want to use a remote server that doesn't
need auth.

This change demotes the error message to be displayed only in
verbose mode

Closes: https://phabricator.apertis.org/T6301



Signed-off-by: Ritesh Raj Sarraf <ritesh.sarraf@collabora.com>

urllib.parse.unquote() request a string as first parameter.
Check that parsed_url.password exists before calling it.

Fixes: APERTIS-5756

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

Passwords could be having special characters, in which case they need to
be percent encoded as per the RFC-3986 section 2.1. in the URL.

For such fields, where the password may be percent encoded, it also
needs to be decoded. That is what this change does. It takes the
password which may be percent encoded and provides with an ascii
equivalent string

Signed-off-by: Ritesh Raj Sarraf <ritesh.sarraf@collabora.com>

If username and password are not passed on command line, nor in url, try
to find them from .netrc file.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

urllib does not support to set the username and password in the URL.
The URL needs to be parsed to extract them before calling urlopen or
urlretrieve.
The username and password found in the URL are used unless they are
already set on command line.

Signed-off-by: Frédéric Danis <frederic.danis@collabora.com>

At the moment `ade` enforces a NN.NN versioning schema for sysroot with N
strictly being a digit.

Now that we switched to release versions like v2019dev0, v2019pre, v2019.0 this
is no longer appropriate.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

Apertis: T5626

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

A gdbserver may be running left over from a previous debug session.
It will still be listening on the TCP port, preventing a new instance
from starting, so we need to kill it.

However, if we allocate a PTY when spawning it, it will die once the
session ends.

For some reason, with get_pty=True, the gdbserver’s output is coming
from stdout, not stderr.

Apertis: T4463

Signed-off-by: Andrej Shadura <andrew.shadura@collabora.co.uk>

When the debugger thread starts, it spawns a gdbserver and
waits forever. Use the Channel from paramiko to monitor the process
return value and quit when it's terminated.
Discard any output from gdbserver as it can stall the ssh link in extreme
cases.
Additionnaly "while True: pass" loops are busy loops. Relax those.
Do that for non-interactive ade too.

Apertis: https://phabricator.apertis.org/T4462



Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7431

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D7430

sysroot tarball packs `./etc/image_version`, ade fails
to identify it as `etc/image_version`, therefore, we
need to append `./` to the file path.

Signed-off-by: Héctor Orón Martínez <hector.oron@collabora.co.uk>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.com>
Differential Revision: https://phabricator.apertis.org/D7384

It is normal and expected for agent entry points to not have an icon.

Signed-off-by: Simon McVittie <smcv@collabora.com>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D6858

`ade configure` and `ade build` have `--native` option, but `install`
and `uninstall` commands doesn't. To install/uninstall a bundle which
is built with `--native`, user should use `ade install --simulator`
because two options actually do same thing.
For the consistency, the option, `--native`, is added.

Reviewed-by: Emanuele Aina <emanuele.aina@collabora.co.uk>
Signed-off-by: Justin Kim <justin.kim@collabora.com>
Differential Revision: https://phabricator.apertis.org/D6807

When unparsed arguments were picked out, they were appended
to args. This is problematic if the wrapped command takes
command-line options with values of the form "--foo bar" (as
opposed to --foo=bar), because they would be re-ordered to "bar --foo",
likely causing a syntax error. It is obviously also a problem if
order is significant for the wrapped command. Prepend the unparsed
arguments to args instead of appending.

Signed-off-by: Simon McVittie <smcv@collabora.com>
Reviewed-by: André Magalhães <andre.magalhaes@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D6798

Picking out the known arguments and leaving unknown arguments is
dangerous, because typos and prefix-matching can have unintended
results. To discourage this, warn if any unknown arguments were
found. These are all considered correct, and are equivalent
(except for order):

    ade configure --native -- VARIABLE=1 --with-option
    ade configure --native VARIABLE=1 --with-option
    ade configure --native -- --with-option VARIABLE=1

but this will now provoke a warning for --with-option:

    ade configure --native --with-option VARIABLE=1

Signed-off-by: Simon McVittie <smcv@collabora.com>
Reviewed-by: André Magalhães <andre.magalhaes@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D6797

The common convention of passing "--" as a separator between
arguments for this command and arguments for the wrapped command
did not work, because it would also pass the "--" through. For
instance, "ade configure --native -- --device=foo" should pass
"--device=foo" to the configure script instead of interpreting it
as ade's own --device option.

Signed-off-by: Simon McVittie <smcv@collabora.com>
Reviewed-by: André Magalhães <andre.magalhaes@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D6796

Subcommands with no REMAINING arguments, such as "ade uninstall",
would previously accept and ignore unknown arguments. This could be
very bad if the command is something like "ade uninstall --dry-run".

Signed-off-by: Simon McVittie <smcv@collabora.com>
Reviewed-by: André Magalhães <andre.magalhaes@collabora.co.uk>
Differential Revision: https://phabricator.apertis.org/D6795

Because we set args to a new value, any arguments passed to
"ade configure" were ignored.

Apertis: https://phabricator.apertis.org/T3978



Signed-off-by: Simon McVittie <smcv@collabora.com>
Reviewed-by: Justin Kim <justin.kim@collabora.com>
Differential Revision: https://phabricator.apertis.org/D6774

Python arguments are passed by reference, so if we append to these
arrays, the caller's copy of the list is modified. This seems unlikely
to be intended.

Signed-off-by: Simon McVittie <smcv@collabora.com>
Reviewed-by: Justin Kim <justin.kim@collabora.com>
Differential Revision: https://phabricator.apertis.org/D6773

The handler is already present since the info and sysroot subcommand
are already having a --path parameter.

Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.com>
Differential Revision: https://phabricator.apertis.org/D6412

The sysroot tag parser was not tested and a regression occured
To catch future regressions make use for ade info and check
that the expected sysroot info can be read during tests.
Add support for --path to the ade info subcommand parser work
in temporary test directory.

Apertis: https://phabricator.apertis.org/T3777



Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.com>
Differential Revision: https://phabricator.apertis.org/D6390

That error was not defined and triggered an Exception in the Exception.
It was not raised either. Use SysrootManagerError instead

Apertis: https://phabricator.apertis.org/T3777



Signed-off-by: Frédéric Dalleau <frederic.dalleau@collabora.com>
Reviewed-by: Emanuele Aina <emanuele.aina@collabora.com>
Differential Revision: https://phabricator.apertis.org/D6402