Re: Disable metalink

[Carles Pina i Estany]

Using latest git version (5ad3f21c46f395998490ba7aa30cdd25c4061cb2):

This works as expected:
$ wget2 --no-metalink 
https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz

This one give it a segfault:
root@debusine:~/git/wget2# wget2 
https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
708 files            100% 
[=================================================================================================>]
  176.92M    --.-KB/s/48 files             100% 
[=================================================================================================>]
  771.44M    --.-KB/s
                          [Files: 2  Bytes: 948.37M [103.90MB/s] Redirects: 1  
Todo: 1  Errors: 754                          ]
wget2: nghttp2_session.c:2333: session_prep_frame: Assertion `0' failed.
Aborted
root@debusine:~/git/wget2#

I should have checked the git version earlier!

Cheers,

On 22 Jun 2023 at 00:35:37, Carles Pina i Estany wrote:
> 
> Hi,
> 
> I've had another look.
> 
> $ wget2 -d --no-metalink 
> https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> 
> [... editted text]
> 
> HTTP/1.1 302 Found
> Date: Wed, 21 Jun 2023 22:31:43 GMT
> Server: Apache
> Strict-Transport-Security: max-age=63072000; includeSubdomains;
> X-Prefix: 37.29.128.0/17
> X-AS: 15704
> X-MirrorBrain-Mirror: ukfast.co.uk
> X-MirrorBrain-Realm: region
> Link: 
> <https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz.meta4>;
>  rel=describedby; type="application/metalink4+xml"
> Link: 
> <https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz.torrent>;
>  rel=describedby; type="application/x-bittorrent"
> Link: 
> <https://mirrors.ukfast.co.uk/sites/qt.io/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
>  rel=duplicate; pri=1; geo=gb
> Link: 
> <https://ftp1.nluug.nl/languages/qt/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
>  rel=duplicate; pri=2; geo=nl
> Link: 
> <https://ftp2.nluug.nl/languages/qt/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
>  rel=duplicate; pri=3; geo=nl
> Link: 
> <https://mirror.netcologne.de/qtproject/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
>  rel=duplicate; pri=4; geo=de
> Link: 
> <https://qt-mirror.dannhauer.de/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz>;
>  rel=duplicate; pri=5; geo=de
> Digest: MD5=TB7AD1CDO8PHTTctLKa1Vg==
> Digest: SHA=O5dBjom4naW7Q98NOvszY1gGOKA=
> Digest: SHA-256=otiKb4w4NdylLzt0MxScPeYGqWu/AkZAwnZXJ2zHNQo=
> Location: 
> https://mirrors.ukfast.co.uk/sites/qt.io/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> Content-Length: 283
> Keep-Alive: timeout=5, max=100
> Connection: Keep-Alive
> Content-Type: text/html; charset=iso-8859-1
> 
> [...]
> 
> Here, because --no-metalink I would have expected that wget2 would
> request the Location file (based on HTTP 302 and Location).
> 
> If I do:
> $ wget2 
> https://mirrors.ukfast.co.uk/sites/qt.io/archive/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> 
> It downloads the file (hurray).
> 
> But, as said in my previous email, I get no file and what it seems a
> wrong HTTP Response 302 Found:
> carles@pinux:[master]~/git/wget2$ wget2 --no-metalink 
> https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> [0] Downloading 
> 'https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz'
>  ...
> HTTP response 302 Found 
> [https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz]
> carles@pinux:[master]~/git/wget2$
> 
> I'm happy to open a bug if this seems like a bug...
> 
> Cheers,
> 
> 
> 
> On 21 Jun 2023 at 10:05:46, Carles Pina i Estany wrote:
> > 
> > Hi wget2 community,
> > 
> > If there is a better place to send user questions let me know please.
> > 
> > I'm trying to migrate from wget to wget2 and I've had some unexpected
> > behaviour for me.
> > 
> > The main question is: how to disable downloading what I understand is
> > via the metalinks file? (chunking) even though the server allows it?
> > 
> > E.g.:
> > $ wget2 --no-metalink 
> > https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> > [0] Downloading 
> > 'https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz'
> >  ...
> > HTTP response 302 Found 
> > [https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz]
> > 
> > And nothing gets downloaded (I expected wget2 to follow the redirect and
> > download the file).
> > If this is a bug I'm happy to open a bug on gitlab.
> > 
> > I wasn't familiar with the metalink standard. I was surprised that wget
> > was downloading the file in chunks which makes it way slower in this
> > case:
> > 
> > $ time wget -O /dev/null -q 
> > https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> > 
> > real        0m7.064s
> > user        0m1.006s
> > sys 0m0.717s
> > 
> > $ time wget2 -O /dev/null -q 
> > https://download.qt.io/official_releases/qt/6.5/6.5.1/single/qt-everywhere-src-6.5.1.tar.xz
> > 
> > 
> > real        0m29.694s
> > user        0m5.648s
> > sys 0m6.265s
> > 
> > So in this case I wanted to download the file not follow the metalink...
> > and I haven't been able to do it just yet.
> > 
> > Thank you very much,
> > 
> > -- 
> > Carles Pina i Estany
> > https://carles.pina.cat || Wiktionary translations: https://kamus.pina.cat
> -- 
> Carles Pina i Estany
> https://carles.pina.cat || Wiktionary translations: https://kamus.pina.cat
-- 
Carles Pina i Estany
https://carles.pina.cat || Wiktionary translations: https://kamus.pina.cat