Re: [Bug-wget] Wget authorization failed with --spider option

[Giuseppe Scrivano]

Can it be that the server allows GET but not HEAD?

Can you attach the debug log without --spider as well?  You can drop the
payload if it is confidential :-)  The request and the response headers
matter.

Thanks,
Giuseppe



Avinash <address@hidden> writes:

> Hi ,
>
> I am getting 'Authorization Failed' error on following URL with --spider
> option.
>
> whereas, it works and also downloads the file when I remove --spider
> option.
>
> My requirement is not to download it, but to read the server-response only.
> Anybody any idea as to why it is happening ?
>
> ============================================================================
>
> /usr/bin/wget --debug --server-response --spider
> http://172.20.241.55:8888/9/Acceptable%20Use/Confidential_Internal_Memos.docx--http-user=test
> --http-password=password
>
> s.docx --http-user=test --http-password=password
> Setting --server-response (serverresponse) to 1
> Setting --spider (spider) to 1
> Setting --http-user (httpuser) to test
> Setting --http-password (httppassword) to Recnex#1
> DEBUG output created by Wget 1.10.2 (Red Hat modified) on linux-gnu.
>
> --11:11:43--
> http://172.20.241.55:8888/9/Acceptable%20Use/Confidential_Internal_Memos.docx
>            => `Confidential_Internal_Memos.docx'
> Connecting to 172.20.241.55:8888... connected.
> Created socket 3.
> Releasing 0x00000000005416f0 (new refcount 0).
> Deleting unused 0x00000000005416f0.
>
> ---request begin---
> HEAD /9/Acceptable%20Use/Confidential_Internal_Memos.docx HTTP/1.0
> User-Agent: Wget/1.10.2 (Red Hat modified)
> Accept: */*
> Authorization: Basic dGVzdDpSZWNuZXgjMQ==
> Host: 172.20.241.55:8888
> Connection: Keep-Alive
>
> ---request end---
> HTTP request sent, awaiting response...
> ---response begin---
> HTTP/1.1 401 Unauthorized
> Content-Length: 1656
> Content-Type: text/html
> Server: Microsoft-IIS/6.0
> WWW-Authenticate: Negotiate
> WWW-Authenticate: NTLM
> X-Powered-By: ASP.NET
> Date: Wed, 06 Jul 2011 05:55:12 GMT
> Connection: keep-alive
>
> ---response end---
>
>   HTTP/1.1 401 Unauthorized
>   Content-Length: 1656
>   Content-Type: text/html
>   Server: Microsoft-IIS/6.0
>   WWW-Authenticate: Negotiate
>   WWW-Authenticate: NTLM
>   X-Powered-By: ASP.NET
>   Date: Wed, 06 Jul 2011 05:55:12 GMT
>   Connection: keep-alive
> Registered socket 3 for persistent reuse.
> Disabling further reuse of socket 3.
> Closed fd 3
> Empty NTLM message, starting transaction.
> Creating a type-1 NTLM message.
> Connecting to 172.20.241.55:8888... connected.
> Created socket 3.
> Releasing 0x00000000005415a0 (new refcount 0).
> Deleting unused 0x00000000005415a0.
>
> ---request begin---
> HEAD /9/Acceptable%20Use/Confidential_Internal_Memos.docx HTTP/1.0
> User-Agent: Wget/1.10.2 (Red Hat modified)
> Accept: */*
> Authorization: NTLM TlRMTVNTUAABAAAAAgIAAAAAAAAgAAAAAAAAACAAAAA=
> Host: 172.20.241.55:8888
> Connection: Keep-Alive
>
> ---request end---
> HTTP request sent, awaiting response...
> ---response begin---
> HTTP/1.1 401 Unauthorized
> Content-Length: 1539
> Content-Type: text/html
> Server: Microsoft-IIS/6.0
> WWW-Authenticate: NTLM
> TlRMTVNTUAACAAAAAAAAADgAAAACAgACAugUTcnBdbkAAAAAAAAAAAAAAAA4AAAABQLODgAAAA8=
> X-Powered-By: ASP.NET
> Date: Wed, 06 Jul 2011 05:55:12 GMT
> Connection: keep-alive
>
> ---response end---
>
>   HTTP/1.1 401 Unauthorized
>   Content-Length: 1539
>   Content-Type: text/html
>   Server: Microsoft-IIS/6.0
>   WWW-Authenticate: NTLM
> TlRMTVNTUAACAAAAAAAAADgAAAACAgACAugUTcnBdbkAAAAAAAAAAAAAAAA4AAAABQLODgAAAA8=
>   X-Powered-By: ASP.NET
>   Date: Wed, 06 Jul 2011 05:55:12 GMT
>   Connection: keep-alive
> Registered socket 3 for persistent reuse.
> Disabling further reuse of socket 3.
> Closed fd 3
> Received a type-2 NTLM message.
> Creating a type-3 NTLM message.
> Connecting to 172.20.241.55:8888... connected.
> Created socket 3.
> Releasing 0x00000000005432a0 (new refcount 0).
> Deleting unused 0x00000000005432a0.
>
> ---request begin---
> HEAD /9/Acceptable%20Use/Confidential_Internal_Memos.docx HTTP/1.0
> User-Agent: Wget/1.10.2 (Red Hat modified)
> Accept: */*
> Authorization: NTLM
> TlRMTVNTUAADAAAAGAAYAEQAAAAYABgAXAAAAAAAAABAAAAABAAEAEAAAAAAAAAARAAAAAAAAAB0AAAAAYIAAHRlc3TAT6OiQKrO+dHjEjlknU5AyFpl7cOFhxbwn8z4gcxySH43C9uoPx96OryCmJ3OKAU=
> Host: 172.20.241.55:8888
> Connection: Keep-Alive
>
> ---request end---
> HTTP request sent, awaiting response...
> ---response begin---
> HTTP/1.1 401 Unauthorized
> Content-Length: 1539
> Content-Type: text/html
> Server: Microsoft-IIS/6.0
> WWW-Authenticate: Negotiate
> WWW-Authenticate: NTLM
> X-Powered-By: ASP.NET
> Date: Wed, 06 Jul 2011 05:55:12 GMT
> Connection: keep-alive
>
> ---response end---
>
>   HTTP/1.1 401 Unauthorized
>   Content-Length: 1539
>   Content-Type: text/html
>   Server: Microsoft-IIS/6.0
>   WWW-Authenticate: Negotiate
>   WWW-Authenticate: NTLM
>   X-Powered-By: ASP.NET
>   Date: Wed, 06 Jul 2011 05:55:12 GMT
>   Connection: keep-alive
> Registered socket 3 for persistent reuse.
> Disabling further reuse of socket 3.
> Closed fd 3
> Authorization failed.