v2020: gitlab-ci enhancements

The GitLab CI pipeline got backported to v2020 and we never officially moved to it.

We do not build it regularly on a schedule, but it gets run when pushing changes so let's land a few minor improvements that in the meantime have been landed to the newer releases and make the pipeline more efficient/faster.