Re: [Bug-wget] Truncated files ... --ignore-length bug ??

[Darshit Shah]

Hi,

The server responds with a HTTP 200 response, so it is not returning only
partial content / attempting to stream. The way Wget reads that response is
that the server has sent all the data it had.

Also, since curl too gives you the same problem, but Firefox does not, let
me ask you one question, Did you load the same session cookies on Firefox
too? Or did you authenticate and start a new session?

My guess is that there is something in the cookies that you're loading
which causes the server to behave on the manner you're seeing it. Try
starting a fresh new session and dump its cookies. See if this works
better. Else, the HTTP Request and Response from Firefox could help in
debugging too.

Thanking You,
Darshit Shah
Sent from mobile device. Please excuse my brevity
On 12-Aug-2015 3:01 am, "R." <address@hidden> wrote:

> On 11/08/2015 23:07, Ander Juaristi wrote:
>
>> Hi,
>>
>> Could you run it with the --debug flag and post the output?
>>
>> It looks like the MP4 file is being streamed over HTTP.
>>
>>
> Thanks a lot for your reply !!
>
>
>
> wget --load-cookies cookies.txt http://www.site.com/path/video -O
> video-multi   --ignore-length --no-cache -S --debug
>
>
>
>
> DEBUG output created by Wget 1.14 on linux-gnu.
>
> URI encoding = 'ANSI_X3.4-1968'
>
> Stored cookie site.com -1 (ANY) / <session> <insecure> [expiry none]
> SESS0080xxxxxxxxxxxxxxxxxxxxxxxxxxxx 2fxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
> --2015-08-11 23:23:32--  http://www.site.com/path/video
> Resolving www.site.com (www.site.com)... xx.xx.xxx.xxx
> Caching www.site.com => 87.98.188.243
> Connecting to www.site.com (www.site.com)|xx.xx.xxx.xxx|:80... connected.
> Created socket 4.
> Releasing 0x0000000001a85030 (new refcount 1).
>
> ---request begin---
> GET /path/video HTTP/1.1
> Cache-Control: no-cache, must-revalidate
> Pragma: no-cache
> User-Agent: Mozilla/5.0 (Windows NT 6.3; rv:36.0) Gecko/20100101
> Firefox/36.0
> Accept: */*
> Host: www.site.com
> Connection: Close
> Cookie:
> SESSxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=2fxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
>
> ---request end---
> HTTP request sent, awaiting response...
> ---response begin---
> HTTP/1.1 200 OK
> Date: Tue, 11 Aug 2015 21:23:33 GMT
> Server: Apache
> Vary: Host
> Expires: Sun, 19 Nov 1978 05:00:00 GMT
> Last-Modified: Tue, 11 Aug 2015 21:23:33 GMT
> Cache-Control: store, no-cache, must-revalidate
> Cache-Control: post-check=0, pre-check=0
> P3P: CP="NOI ADM DEV COM NAV OUR STP"
> X-Debug-Data: 313
> X-Content-Duration: 502.109
> Content-Location: path/video
> X-Bandwidth-Control: On
> X-Video-Bitrate: 28064.4
> Accept-Ranges: bytes
> Content-Length: 2925253
> Connection: close
> Content-Type: video/mp4
>
> ---response end---
>
>   HTTP/1.1 200 OK
>   Date: Tue, 11 Aug 2015 21:23:33 GMT
>   Server: Apache
>   Vary: Host
>   Expires: Sun, 19 Nov 1978 05:00:00 GMT
>   Last-Modified: Tue, 11 Aug 2015 21:23:33 GMT
>   Cache-Control: store, no-cache, must-revalidate
>   Cache-Control: post-check=0, pre-check=0
>   P3P: CP="NOI ADM DEV COM NAV OUR STP"
>   X-Debug-Data: 313
>   X-Content-Duration: 502.109
>   Content-Location: path/video
>   X-Bandwidth-Control: On
>   X-Video-Bitrate: 28064.4
>   Accept-Ranges: bytes
>   Content-Length: 2925253
>   Connection: close
>   Content-Type: video/mp4
> Length: ignored [video/mp4]
> Saving to: 'video-multi'
>
>      0K .......... .......... .......... .......... ..........  583K
>     50K .......... .......... .......... .......... ..........  673K
>    100K .......... .......... .......... .......... ..........  865K
>    150K .......... .......... .......... .......... ..........  752K
>    200K .......... .......... .......... .......... ..........  902K
>    250K .......... .......... .......... .......... ..........  989K
>    300K .......... .......... .......... .......... .......... 1020K
>    350K .......... .......... .......... .......... .......... 1024K
>    400K .......... .......... .......... .......... .......... 1.07M
>    450K .......... .......... .......... .......... .......... 1014K
>    500K .......... .......... .......... .......... .......... 1.04M
>    550K .......... .......... .......... .......... .......... 1.13M
>    600K .......... .......... .......... .......... .......... 1.29M
>    650K .......... .......... .......... .......... .......... 1.41M
>    700K .......... .......... .......... .......... .......... 1.12M
>    750K .......... .......... .......... .......... .......... 1.16M
>    800K .......... .......... .......... .......... .......... 1.66M
>    850K .......... .......... .......... .......... .......... 1.41M
>    900K .......... .......... .......... .......... .......... 1.25M
>    950K .......... .......... .......... .......... .......... 1.53M
>   1000K .......... .......... .......... .......... .......... 1.41M
>   1050K .......... .......... .......... .......... .......... 1.33M
>   1100K .......... .......... .......... .......... .......... 1.43M
>   1150K .......... .......... .......... .......... .......... 1.36M
>   1200K .......... .......... .......... .......... .......... 1.43M
>   1250K .......... .......... .......... .......... .......... 1.35M
>   1300K .......... .......... .......... .......... .......... 1.42M
>   1350K .......... .......... .......... .......... .......... 1.38M
>   1400K .......... .......... .......... .......... .......... 1.38M
>   1450K .......... .......... .......... .......... .......... 1.40M
>   1500K .......... .......... .......... .......... ..........  501K
>   1550K .......... .......... .......... .......... .......... 1.77M
>   1600K .......... .......... .......... .......... .......... 13.2M
>   1650K .......... .......... .......... .......... .......... 4.90M
>   1700K .......... .......... .......... .......... .......... 1.28M
>   1750K .......... .......... .......... .......... .......... 1.31M
>   1800K .......... .......... .......... .......... .......... 1.41M
>   1850K .......... .......... .......... .......... .......... 1.36M
>   1900K .......... .......... .......... .......... .......... 1.43M
>   1950K .......... .......... .......... .......... .......... 1.39M
>   2000K .......... .......... .......... .......... .......... 1.38M
>   2050K .......... .......... .......... .......... .......... 1.38M
>   2100K .......... .......... .......... .......... .......... 1.39M
>   2150K .......... .......... .......... .......... .......... 1.36M
>   2200K .......... .......... .......... .......... .......... 1.20M
>   2250K .......... .......... .......... .......... .......... 1.72M
>   2300K .......... .......... .......... .......... .......... 1.37M
>   2350K .......... .......... .......... .......... .......... 1.27M
>   2400K .......... .......... .......... .......... .......... 1.18M
>   2450K .......... .......... .......... .......... .......... 1.95M
>   2500K .......... .......... .......... .......... .......... 1.35M
>   2550K .......... .......... .......... .......... .......... 1.36M
>   2600K .......... .......... .......... .......... .......... 1.42M
>   2650K .......... .......... .......... .......... .......... 1.38M
>   2700K .......... .......... .......... .......... ..........  442K
>   2750K .......... .......... .......... .......... ..........  105M
>   2800K .......... .......... .......... .......... .......... 1011K
>   2850K ...... 1.41M=2.3s
>
> Closed fd 4
> 2015-08-11 23:23:34 (1.19 MB/s) - 'video-multi' saved [2925253]
>
>