Re: Disable metalink

[Carles Pina i Estany]

Hi,

I've had another look.

$ wget2 -d --no-metalink 
https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz

[... editted text]

HTTP/1.1 302 Found
Date: Wed, 21 Jun 2023 22:31:43 GMT
Server: Apache
Strict-Transport-Security: max-age=63072000; includeSubdomains;
X-Prefix: 37.29.128.0/17
X-AS: 15704
X-MirrorBrain-Mirror: ukfast.co.uk
X-MirrorBrain-Realm: region
Link: 
<https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz.meta4>;
 rel=describedby; type="application/metalink4+xml"
Link: 
<https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz.torrent>;
 rel=describedby; type="application/x-bittorrent"
Link: 
<https://mirrors.ukfast.co.uk/sites/qt.io/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
 rel=duplicate; pri=1; geo=gb
Link: 
<https://ftp1.nluug.nl/languages/qt/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
 rel=duplicate; pri=2; geo=nl
Link: 
<https://ftp2.nluug.nl/languages/qt/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
 rel=duplicate; pri=3; geo=nl
Link: 
<https://mirror.netcologne.de/qtproject/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
 rel=duplicate; pri=4; geo=de
Link: 
<https://qt-mirror.dannhauer.de/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
 rel=duplicate; pri=5; geo=de
Digest: MD5=TB7AD1CDO8PHTTctLKa1Vg==
Digest: SHA=O5dBjom4naW7Q98NOvszY1gGOKA=
Digest: SHA-256=otiKb4w4NdylLzt0MxScPeYGqWu/AkZAwnZXJ2zHNQo=
Location: 
https://mirrors.ukfast.co.uk/sites/qt.io/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
Content-Length: 283
Keep-Alive: timeout=5, max=100
Connection: Keep-Alive
Content-Type: text/html; charset=iso-8859-1

[...]

Here, because --no-metalink I would have expected that wget2 would
request the Location file (based on HTTP 302 and Location).

If I do:
$ wget2 
https://mirrors.ukfast.co.uk/sites/qt.io/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz

It downloads the file (hurray).

But, as said in my previous email, I get no file and what it seems a
wrong HTTP Response 302 Found:
carles@pinux:[master]~/git/wget2$ wget2 --no-metalink 
https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
[0] Downloading 
'https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz'
 ...
HTTP response 302 Found 
[https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz]
carles@pinux:[master]~/git/wget2$

I'm happy to open a bug if this seems like a bug...

Cheers,



On 21 Jun 2023 at 10:05:46, Carles Pina i Estany wrote:
> 
> Hi wget2 community,
> 
> If there is a better place to send user questions let me know please.
> 
> I'm trying to migrate from wget to wget2 and I've had some unexpected
> behaviour for me.
> 
> The main question is: how to disable downloading what I understand is
> via the metalinks file? (chunking) even though the server allows it?
> 
> E.g.:
> $ wget2 --no-metalink 
> https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> [0] Downloading 
> 'https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz'
>  ...
> HTTP response 302 Found 
> [https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz]
> 
> And nothing gets downloaded (I expected wget2 to follow the redirect and
> download the file).
> If this is a bug I'm happy to open a bug on gitlab.
> 
> I wasn't familiar with the metalink standard. I was surprised that wget
> was downloading the file in chunks which makes it way slower in this
> case:
> 
> $ time wget -O /dev/null -q 
> https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> 
> real  0m7.064s
> user  0m1.006s
> sys   0m0.717s
> 
> $ time wget2 -O /dev/null -q 
> https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> 
> 
> real  0m29.694s
> user  0m5.648s
> sys   0m6.265s
> 
> So in this case I wanted to download the file not follow the metalink...
> and I haven't been able to do it just yet.
> 
> Thank you very much,
> 
> -- 
> Carles Pina i Estany
> https://carles.pina.cat || Wiktionary translations: https://kamus.pina.cat
-- 
Carles Pina i Estany
https://carles.pina.cat || Wiktionary translations: https://kamus.pina.cat