Speedup test_urls
A bunch of tweaks to make the URLs checker a bit faster.
- Before: 27m57s https://gitlab.apertis.org/docs/apertis-website/-/jobs/1006532
- After: 6m44s https://gitlab.apertis.org/docs/apertis-website/-/jobs/1006736
The URL check now also run in parallel with everything else, so the time for the whole pipeline went from 34m55s to 6m45s.
The URLs below still fail for unclear reasons:
-
💔 http://nl.farnell.com/ept/402-51501-51/conn-stacking-rcpt-440pos-0-5mm/dp/2474236 -
💔 http://www.amazon.co.uk/gp/product/B0033CA2XM -
💔 http://www.amazon.co.uk/gp/product/B002VGQQAE -
💔 http://nl.farnell.com/samtec/qte-040-03-l-d-a/header-dual-80way/dp/1667888 -
💔 https://qa.apertis.org/flatdeb-demo.html -
💔 https://www.amazon.com/TRENDnet-Converter-Installation-Universal-TU-S9/dp/B0007T27H8 -
💔 https://www.renesas.com/us/en/products/automotive-products/automotive-system-chips-socs/r-car-h3-m3-starter-kit
The only actually broken URL is: