OBS returns too many "HTTP Error 504: Gateway Time-out"

Background

Since 2nd May, OBS returns too many HTTP Error 504: Gateway Time-out preventing the dashboard to refresh because the job packaging-data-fetch-obs for each run. For instance the last one https://gitlab.apertis.org/infrastructure/dashboard/-/jobs/4354560

At the same time, Stelios has reported that frequent alerts are triggered reporting OBS being down.

Reproducibility

How often the issue is hit when repeating the steps to reproduce and changing nothing?

Put the ✅ in the most appropriate entry:

✅ always
often, but not always
rarely

Impact of bug

Since the dashboard is not updated, we don't know which packages need an update (including security update) from Debian. It's also affect the rebase because we no longer have an overview of packages health.

Outcomes

TBD

Management data

This section is for management only, it should be the last one in the description.

/cc @em @raju.balasubramanian-ext @sudarshan.chikkapuraputtalingaiah-ext @wlozano

Phabricator link: https://phabricator.apertis.org/T11107

Edited Jul 02, 2025 by Apertis CI robot