apertis-pkg-merge-upstream-to-downstreams: Don't print useless information while canceling pipelines

Printing these values only creates noise in the log.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Depending on the type of changes, upstream or donwstream, it is better to
use different settings while generation the changelog, in order to provide
or not the full set of changes.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

It is common to need locally check for license scan issues, so add initial
support for it to the tooling.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

The commit command is intended to update the changelog and commit the
changes, to make the use of the command clearer rename it to release.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

While working with license scan is very common to add whitelist for
files and folders. To make this job easier, allow ci-license-scan to
propose a whitelist based on known patterns.

This feature is only meant to help developers to reduce the overheard
of the manual work, hence, the proposed changed need to be carefully
reviewed.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

This was a workaround for odd nodes packages that
apt was not able to parse. See
infrastructure/apertis-docker-images@e954d2be

This is no longer required since it was fixed in apt:
https://salsa.debian.org/apt-team/apt/-/merge_requests/167



Having this workaround leads to other apt failures
to resolve dependencies (because of conflicts between
rustc and rustc-web).

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Add a tool to help when a package update cannot be done by CI. This tool
should help developers to perform the merge in a similar way as the CI
and also help to run some basic checks.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

When ci-license-scan tries to fill copyright information from d/copyright
it includes \n if they are present in copyright information. If later,
there is copyright data, the \n is placed in the middle creating an invalid
copyright file.

To overcome this issue, strip \n from the copyright.

Signed-off-by: Walter Lozano <walter.lozano@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

The location of this file has changed with:
infrastructure/apertis-infrastructure@41fed1b1



Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Actually pipelines on downstreams fail at this step because these branches
are missing the debian/apertis/copyright file. Instead we create a merge request,
thus the missing file will be generated with the job scan-licenses.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

apertis-pkg-merge-upstream-to-downstreams: cancel pipelines created through the creation of a branch

Due to GitLab limitation (https://gitlab.com/gitlab-org/gitlab/-/issues/26422

),
it's currently impossible to avoid to trigger a pipeline when creating a
branch with the API. Since these useless pipelines are wasting
GitLab and OBS ressources (and devs' time), as a workaround for now
we can cancel them.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Otherwse, we won't get the full list of pipelines and python will emit
a warning.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

This is only a workaround for missing features in GitLab to disable
some unneeded pipelines.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

This message is also required when a maintainer has to summarize
the remaining Apertis changes. Thus, always add this message to
save their time.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

This is deprecated and will be removed in python 3.13.

/usr/bin/apertis-pkg-merge-updates:38: DeprecationWarning: pathlib.Path.__enter__() is deprecated and scheduled for removal in Python 3.13; Path objects as a context manager is a no-op
/usr/bin/apertis-pkg-merge-updates:75: DeprecationWarning: pathlib.Path.__enter__() is deprecated and scheduled for removal in Python 3.13; Path objects as a context manager is a no-op

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

apertis-pkg-merge-upstream-to-downstreams: Add link to the bug report about missing skip_ci option in REST API

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Only the pipeline in merge request context is relevant here.
"ci.skip" only affect branch pipelines and not merge request pipelines.
See https://docs.gitlab.com/ee/gitlab-basics/add-file.html#push-options-for-gitlab-cicd



Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

These tools come from:
https://gitlab.apertis.org/infrastructure/apertis-docker-images/-/tree/apertis/v2025dev3



Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Sometime the main server of snapshot.debian.org is not sync
which block us from downloading new packages from Debian.
Thus to avoid depending on a single server add a mirror
as fallback.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

This tool, inspired by https://tracker.debian.org/pkg/routine-update

,
performs common cleanups in Apertis packages like:
   - remove deprecated debian/apertis/gitlab-ci.yml
   - add debian/apertis/lintian for packages maintained by Apertis

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

pathlib.Path.__enter__() is deprecated and scheduled for removal
in Python 3.13. Some warnings are generated with Python 3.11:

import-debian-package:281: DeprecationWarning: pathlib.Path.__enter__() is deprecated and scheduled for removal in Python 3.13; Path objects as a context manager is a no-op
  with Path(".git/info/attributes") as f:
import-debian-package:225: DeprecationWarning: pathlib.Path.__enter__() is deprecated and scheduled for removal in Python 3.13; Path objects as a context manager is a no-op
  with Path('debian/apertis/component') as f:
import-debian-package:169: DeprecationWarning: pathlib.Path.__enter__() is deprecated and scheduled for removal in Python 3.13; Path objects as a context manager is a no-op
  with Path("debian/changelog") as f:

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Updates from *-proposed-updates repositories are not pulled anymore
by default because it can contain undesirable updates for Apertis.
However, we still want updates from *-updates repositories instead.

"proposed-updates" contains updates not officialy part of Debian
contrary to "updates".

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

The Apertis pipeline imports backport and/or proposed-updates versions
by default, this is not needed and leads to miss some security updates.
Because, importing versions from backports and proposed-updates is not
part of our standard workflow, this should only be optional to avoid
confusing the pipeline.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

`gbp import-dsc` puts all the new changelog entries in the commit
message, generating big walls of text when, for instance, importing a
new package for the first time.
GitLab then puts the whole log message in the `CI_COMMIT_MESSAGE` env
var, which makes the runner to fail during the executor preparation
section with the error:

    exec /usr/bin/dumb-init: argument list too long

See: https://gitlab.com/gitlab-org/gitlab/-/issues/392406



To avoid that, trim the message to only keep the first line.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

`flake8` said:

    tools/ade:1105:13: E741 ambiguous variable name 'l'

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

`flake` lamented:

    tools/ade:511:21: E722 do not use bare 'except'

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

`flake8` was complaining about:

    tools/ade:473:17: F841 local variable 'e' is assigned to but never used

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

`flake8` did report:

   tools/ade:288:26: W605 invalid escape sequence '\s'

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

`flake8` did report a typo:

    tools/ade:217:23: F821 undefined name 'user'

As far as I can tell nothing ever tries to stringify the `Device`
object, so that's probably dead code and that's why we never noticed.

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>