packaging-updates-upstream-linux: also check for mainline updates if Apertis kernel >= Debian kernel

We should also check for kernel.org updates when Debian provides
kernel of a series since Debian can stop tracking a series that
we still use in Apertis.

Currently, Debian has stopped providing linux 6.6.x, so Apertis
is ahead of Debian by using linux from kernel.org, in this case
we cannot rely on Debian for 6.6.x updates then we have to track
directly kernel.org.

This change fixes a bug that was never noticed before, because
the main users of the dashboard are baseline maintainers who
are usually different than our kernel maintainer.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Otherwise tags from the series 6.10 will also be
fetched for the series 6.1, which is not expected
since we want to stay on the same series.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Using "git" to define "kernel.org" is confusing here since
it could be salsa git, apertis git, etc.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

This allows to quickly run trigger-* jobs without waiting for
the dashboard to be built (which takes a while).

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Since bullseye-backports is going to close, we now
track bookworm for v2023 which still provides 6.1.x.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

To make it less austere

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Updates from backports, testing or unstable are made on
a case-by-case basis, and should be triggered automatically.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Late 2021, dashboard's reports gained their own format. See
c0c77cb6


Since then, trigger-updates was not compatible anymore.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Otherwise, it returns an 404 error.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

buster is no longer tracked, and currently only debian/bullseye-backports
is used.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 8 months ago and Walter Lozano committed 8 months ago

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Initial versions of these packages were uploaded with an incorrect
packaging revision. The new uploads have a correct version, but git
still has the old and wrong tags which confuses the dashboard.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

This makes it easier to check the Debian's package status.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

The delta entry required the branch as first level to store data.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Dylan Aïssi authored 1 year ago and Walter Lozano committed 11 months ago

Packages versions coming from Debian are correctly parsed, so we don't have to
whitelist them, however in Apertis we use the ~v202X suffix which is to
misinterpreted by dashboard and lead to confusion when comparing versions.
For example, the dashboard the of downstream complains about:

Version in apertis/v2023/5.2.5~ds0-1+apertis0 is higher than version 5.2.5~ds0-1+apertis0~v2023 in upstream apertis/v2023

Which is true, but due to our workflow, the version apertis/v2023/5.2.5~ds0-1+apertis0
should not land in v2023 this is the reason of why we add the problematic
suffix allowing us to backport targeted changes to a previous release.
Adding the logic in the dashboard to correctly interpret the ~v202X is
not trivial, so for now we can teach it to ignore some versions.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Only packaging data are required in the cache file,
that was the previous behavior, but it was mistakenly
reverted in 254b71ed.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Just after adding apertis/v202*-security and -updates branches to be
tracked by the dashboard, the returned version is "None" because the
cache file is not yet updated. This "None" value makes the pipeline
failing with:

Traceback (most recent call last):
  File "/builds/infrastructure/dashboard/./bin/packaging-updates-upstream-linux", line 209, in <module>
    results = compute_linux_updates(data)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/builds/infrastructure/dashboard/./bin/packaging-updates-upstream-linux", line 134, in compute_linux_updates
    process = subprocess.run(
              ^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['git', '-c', 'versionsort.suffix=-', 'ls-remote', '--exit-code', '--tags', '--refs', '--sort=version:refname', 'https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git

', 'vNone*']' returned non-zero exit status 2.

To avoid failures, just skip this branch for this iteration.

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

If a package only appears on OBS the dashboard fails with an exception:

    Traceback (most recent call last):
      File "/builds/-RogsxNE/0/infrastructure/dashboard/./bin/packaging-check-invariants", line 854, in <module>
        checker.check_git_and_obs_versions(package)
      File "/builds/-RogsxNE/0/infrastructure/dashboard/./bin/packaging-check-invariants", line 238, in check_git_and_obs_versions
        if package.git.default_branch:
           ^^^^^^^^^^^
      File "/builds/-RogsxNE/0/infrastructure/dashboard/./bin/packaging-check-invariants", line 79, in __getattr__
        item = super(DictWrapper, self).__getitem__(attr)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    KeyError: 'git'

Signed-off-by: Emanuele Aina <emanuele.aina@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>

Signed-off-by: Dylan Aïssi <dylan.aissi@collabora.com>