Re: [PULL 15/42] tests/functional: enable pre-emptive caching of assets

[Thomas Huth]

On 26/11/2024 23.54, Richard Henderson wrote:
> On 11/26/24 11:52, Thomas Huth wrote:
> > I think we want to continue to maek failing downloads as test failures, 
> > otherwise we'll never notice when an asset is not available from the 
> > internet anymore (since SKIPs just get ignored).
>
> I disagree.  Download failures are not rare.

That's not what I said / meant. Sure, servers can have hiccups and downloads 
can fail, but that's what we have the cache for. So having a working cache 
is essential.

OTOH, if you simply mark tests as SKIP if the download fail, we'll likely 
miss if an asset vanishes completely, since some people already have it in 
their cache and the remaining people will likely just ignore skipped tests.

 Thomas