Re: lynx-dev wget and lynx, download problem

[Klaus Peter Wegge]

Klaus,

> On Mon, 1 Mar 1999, Klaus Peter Wegge wrote:
> 
> > I'll give you an more precise example:
> > 
> > Plattform: Linux
> > Lynx: 2.8.2dev.17
> > wget 1.5.2
> > 
> > I have just downloaded http://www.flora.org/lynx-dev/mailbox/log99-02
> > iss size is 2,3 mb.
> > wget did the job in 85 min. without any problems.
> > Lynx gave up after 135 kb and about 6 minutes.
> > The line on the bottom of the screen says:
> > LYNXDOWNLOAD://Method=-1/File=/tmp/L23431-3TMP.txt/SugFile=/locals/u2/wegge/l
> > 
> > More info is cut off. SugFile seems to be the path to Lynx or its
> > sources.
> 
> No, it's a Suggested Filename, or at least it should be.
OK. It is. See trace.

> Do TRACE (^T) before starting the download or -trace.
> There should be *something* in Lynx.trace.  Let's see the
> relevant part.
The relevant part of trace file is at the end of this mail.

> Try also lynx -dump or lynx -source with tracing.
> For example   
>    lynx -dump -trace -tlog [URL here] >/dev/null
> should show just the trace messages on the screen.
It's the same result, except some "GridText: split_line" calls
during the Read-Messages.

> Make sure you have enough free disk space in /tmp, or whereever you
> tell lynx to put temp file, and in your home dir for the trace log
> file) (This isn't an issue for the example above with -dump).
There is more than 200 mb free disk space!
And the download of other even bigger sites works fine, if the
connection is rather fast.

> If Lynx's trace doens't give a clue what's happening, running lynx
> under strace may.
The relevant part of the strace file is at the end of this mail.

The number of bytes, downloaded by lynx, seems to depend on the
current speed or usage of the connection.

About networking: My LINUX PC is connected to the local ethernet of
our laboratory, which has a gateway to DFN (Deutsches Forschungsnetz).

Hope, this will give you some more info.

Klaus-Peter

================= Lynx.trace =========================

                Lynx Trace Log (2.8.2dev.17)

User message: Trace ON!
GridText: HText_pageDisplay at line 24 started
GridText: HText_pageDisplay finished

LYpush[2]: address:http://www.flora.org/lynx-dev/mailbox/
        title:Index of /lynx-dev/mailbox
getfile: getting http://www.flora.org/lynx-dev/mailbox/log99-02

HTParse: aName:http://www.flora.org/lynx-dev/mailbox/log99-02   relatedName:
HTParse: result:www.flora.org

HTParse: aName:http://www.flora.org/lynx-dev/mailbox/log99-02   relatedName:
HTParse: result:
Entered HTAnchor_findAddress
Anchor 0x81d26a8 with address `http://www.flora.org/lynx-dev/mailbox/log99-02' 
already exists.
HTAccess: loading document http://www.flora.org/lynx-dev/mailbox/log99-02
HTParse: aName:http://www.flora.org/lynx-dev/mailbox/log99-02   
relatedName:file:
HTParse: result:http
HTParse: aName:http://www.flora.org/lynx-dev/mailbox/log99-02   relatedName:
HTParse: result:www.flora.org
HTParse: aName:http://www.flora.org/lynx-dev/mailbox/log99-02   relatedName:
HTParse: result:http
proxy server found: http://wwwproxy.uni-paderborn.de:8080/
HTParse: 
aName:http://wwwproxy.uni-paderborn.de:8080/http://www.flora.org/lynx-dev/mailbox/log99-02
   relatedName:http:
HTParse: result:http
HTParse: 
aName:http://wwwproxy.uni-paderborn.de:8080/http://www.flora.org/lynx-dev/mailbox/log99-02
   relatedName:
HTParse: result:wwwproxy.uni-paderborn.de:8080
Looking up wwwproxy.uni-paderborn.de:8080.
HTParseInet: parsing `wwwproxy.uni-paderborn.de:8080'.
LYGetHostByName: parsing `wwwproxy.uni-paderborn.de'.
End of LYGetHostByName: 0x400e998c { h_name = 0x400e9a7a 
"stargate.uni-paderborn.de",
         h_aliases = 0x400e99a0 {  0x400e9a46 "wwwproxy.uni-paderborn.de", 0x0 
},
         h_addrtype = 2, h_length = 4,
         h_addr_list = 0x400e98fc { 0x400e9a98 "131.234.22.29", 0x0 } }
LYGetHostByName: Resolved name to a hostent.
HTParseInet: Parsed address as port 8080, IP address 131.234.22.29
Making HTTP connection to wwwproxy.uni-paderborn.de:8080.
HTParse: 
aName:http://wwwproxy.uni-paderborn.de:8080/http://www.flora.org/lynx-dev/mailbox/log99-02
   relatedName:
1
HTParse: result:/http://www.flora.org/lynx-dev/mailbox/log99-02
HTParse: aName:http://www.flora.org/lynx-dev/mailbox/log99-02   relatedName:
HTParse: result:www.flora.org
HTParse: 
aName:http://wwwproxy.uni-paderborn.de:8080/http://www.flora.org/lynx-dev/mailbox/log99-02
   relatedName:
1
HTParse: result:/http://www.flora.org/lynx-dev/mailbox/log99-02
HTParse: 
aName:http://wwwproxy.uni-paderborn.de:8080/http://www.flora.org/lynx-dev/mailbox/log99-02
   relatedName:
1
HTParse: result:http://www.flora.org/lynx-dev/mailbox/log99-02
HTParse: 
aName:http://wwwproxy.uni-paderborn.de:8080/http://www.flora.org/lynx-dev/mailbox/log99-02
   relatedName:
HTParse: result:wwwproxy.uni-paderborn.de:8080
HTParse: aName:http://www.flora.org/lynx-dev/mailbox/log99-02   relatedName:
HTParse: result:www.flora.org
HTParse: aName:http://www.flora.org/lynx-dev/mailbox/log99-02   relatedName:
1
HTParse: result:/lynx-dev/mailbox/log99-02
Composing Authorization for www.flora.org:80//lynx-dev/mailbox/log99-02
HTAASetup_lookup: No template matched `/lynx-dev/mailbox/log99-02' (so probably 
not protected)
HTTP: Not sending authorization (yet).
LYCookie: Searching for 'www.flora.org:80', '/lynx-dev/mailbox/log99-02'.
Composing Proxy Authorization for 
wwwproxy.uni-paderborn.de:8080/http://www.flora.org/lynx-dev/mailbox/log99-02
HTAASetup_lookup: No template matched 
`http://www.flora.org/lynx-dev/mailbox/log99-02' (so probably not protected)
HTTP: Not sending proxy authorization (yet).
Writing:
GET http://www.flora.org/lynx-dev/mailbox/log99-02 HTTP/1.0
Host: www.flora.org
Accept: text/html, text/plain, text/sgml, */*;q=0.01
Accept-Encoding: gzip, compress
Accept-Language: en
User-Agent: Lynx/2.8.2dev.17 libwww-FM/2.14
Referer: http://www.flora.org/lynx-dev/mailbox/

----------------------------------
Sending HTTP request.
HTTP: WRITE delivered OK
HTTP request sent; waiting for response.
HTTP: Trying to read 1535
HTTP: Read 1460
Read 1 KB of data, 1 KB/sec.
HTTP: Rx: HTTP/1.1 200 OK 
HTTP: Scanned 2 fields from line_buffer
--- Talking HTTP1.
HTTP/1.1 200 OK
HTFormat: Constructing stream stack for www/mime to www/download
HTFormat: Looking up presentation for www/mime to www/download
StreamStack: found weak wildcard match: www/download
FindPresentation: found exact match: www/mime
StreamStack: found exact match: www/mime
HTMIME:  Date: Sun, 07 Mar 1999 14:37:45 GMT
Server: Apache/1.3.2 (Unix) PHP/3.0.4
Last-Modified: Sun, 28 Feb 1999 23:19:56 GMT
ETag: "74026-3170c1-36d9cf1c"
Accept-Ranges: bytes
Content-Length: 3240129
Connection: close
Content-Type: text/plain