Failing update-binaries pipeline jobs on test repositories with embedded binaries

Affected images versions

• v2024dev2 branches on GitLab for projects in the tests/ group

Unaffected images versions

• all versions up to v2024dev2

Steps to reproduce

$ gitlab-cli -o json -f id group-project list --group-id tests --get-all |jq ".[].id" | xargs -IID gitlab-cli -o json -f web_url,source,status,created_at project-pipeline list --project-id ID --per-page 1 --ref apertis/v2024dev2 | jq '.[]|select(.status=="failed")'

Expected result

All the pipelines succeeding.

Actual result

{
  "status": "failed",
  "source": "schedule",
  "created_at": "2023-06-22T00:15:07.036Z",
  "web_url": "https://gitlab.apertis.org/tests/suite-connector/-/pipelines/568260"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T12:59:12.445Z",
  "web_url": "https://gitlab.apertis.org/tests/newport/-/pipelines/489869"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T12:59:22.262Z",
  "web_url": "https://gitlab.apertis.org/tests/zlib_broken/-/pipelines/489872"
}
{
  "status": "failed",
  "source": "schedule",
  "created_at": "2023-06-22T00:15:07.688Z",
  "web_url": "https://gitlab.apertis.org/tests/ofono/-/pipelines/568276"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T12:59:27.717Z",
  "web_url": "https://gitlab.apertis.org/tests/sdk/-/pipelines/489878"
}
{
  "status": "failed",
  "source": "schedule",
  "created_at": "2023-06-22T00:15:07.034Z",
  "web_url": "https://gitlab.apertis.org/tests/gupnp-services/-/pipelines/568264"
}
{
  "status": "failed",
  "source": "schedule",
  "created_at": "2023-06-22T00:15:07.735Z",
  "web_url": "https://gitlab.apertis.org/tests/cgroups-resource-control/-/pipelines/568279"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T11:51:23.777Z",
  "web_url": "https://gitlab.apertis.org/tests/helper-tools/-/pipelines/484289"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T12:59:51.884Z",
  "web_url": "https://gitlab.apertis.org/tests/dbus-dos-reply-time/-/pipelines/489897"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T12:59:52.529Z",
  "web_url": "https://gitlab.apertis.org/tests/connman/-/pipelines/489898"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T12:59:54.724Z",
  "web_url": "https://gitlab.apertis.org/tests/gstreamer1.0-decode/-/pipelines/489899"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T12:59:55.604Z",
  "web_url": "https://gitlab.apertis.org/tests/boot-performance-automated/-/pipelines/489900"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T12:59:56.800Z",
  "web_url": "https://gitlab.apertis.org/tests/iptables-basic/-/pipelines/489901"
}
{
  "status": "failed",
  "source": "push",
  "created_at": "2023-02-27T12:59:57.820Z",
  "web_url": "https://gitlab.apertis.org/tests/check-dbus-services/-/pipelines/489902"
}

Reproducibility

1. ✅ always
2. often, but not always
3. rarely

Impact of bug

Test repositories ship old binaries from previous releases.

Root cause

describe in one line what caused the issue to give a hint to product teams whether they may be impacted or not

Outcomes

• tests/dbus-dos-reply-time!6 (merged)

• tests/connman!12 (merged)

• tests/gstreamer1.0-decode!7 (merged)

• tests/boot-performance-automated!6 (merged)

• tests/iptables-basic!17 (merged)

• tests/gupnp-services!10 (merged)

Management data

This section is for management only, it should be the last one in the description.

/cc @em @sagar @sudarshan @wlozano

Phabricator link: https://phabricator.apertis.org/T9854