[lug] Wget Behavior Differnces on Different Machines

[Bill Thoen]

Hi folks,
I'm still muddling about with wget trying to download all the Census 
Bureau's TIGER data fom their server at 
http://www2.census.gov/geo/tiger/tiger2004se. When I tried it on one of 
my machines everything worked great until I ran out of free disk space 
5GB later. So now I'm trying it on a friend's machine (where there's 
lots of space) but as soon as the wget process gets startred it stalls 
trying to connect to a secure connection for some reason. On my machine 
it sails right past this step. If anyone knows what's wrong, I'd like to 
know what I need to do to get wget to work.

Here's thg wget command I'm using:
wget -r -l2 -nH http://www2.census.gov/geo/tiger/tiger2004se

Below is what I see in the logs from the runs on the two machines, On 
machine 'A' here's the last thing I see before it just hangs  (the log 
from my machine follows):
---
Loading robots.txt; please ignore errors.
--11:27:54--  http://www2.census.gov/robots.txt
           => `robots.txt'
Connecting to www2.census.gov[148.129.75.27]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 0 [text/plain]

    [ <=>                                                  ] 
0             --.--K/s

11:27:54 (0.00 B/s) - `robots.txt' saved [0/0]

Loading robots.txt; please ignore errors.
--11:27:54--  https://catalog.mso.census.gov/robots.txt
           => `robots.txt'
Resolving catalog.mso.census.gov... done.
Connecting to catalog.mso.census.gov[148.129.75.139]:443...

--- at this point, this process just hangs waiting for Godot or something.
And here's the same step from my machine, where it works fine, going 
past this point and continuing to download files (but runs out of space 
eventually.)
---

Loading robots.txt; please ignore errors.
--11:02:00--  http://www2.census.gov/robots.txt
           => `robots.txt'
Connecting to www2.census.gov|148.129.75.27|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 0 [text/plain]

    0K                                                           0.00 B/s

11:02:00 (0.00 B/s) - `robots.txt' saved [0/0]

--11:02:00--  http://www2.census.gov/icons/blank.gif
           => `icons/blank.gif'
Connecting to www2.census.gov|148.129.75.27|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 148 [image/gif]