[lug] ftp problem

[Nate Duehr]

I understand the approvals might be painful, but could you switch to rsync with compression?
-----Original Message-----
From: "Gary Hodges" <Gary.Hodges at noaa.gov>
Date: Wed, 09 Mar 2005 08:36:11 
To:"Boulder (Colorado) Linux Users Group -- General Mailing List" <lug at lug.boulder.co.us>
Subject: Re: [lug] ftp problem

I could try it, but I think I have conclusively shown that the problem 
is in the transmission, not inherent in the files.  When a file has come 
in with errors I've verified it is OK on the machine it was created on.  
And often with a second attempt it comes in OK.

Cheers,
Gary

George Sexton wrote:

>What if you try:
>
>tar -c path | bzip2 > file.tar.bz2
>
>And then transmit it.
>
>George Sexton
>MH Software, Inc.
>http://www.mhsoftware.com/
>Voice: 303 438 9585
>  
>
>  
>
>>-----Original Message-----
>>From: lug-bounces at lug.boulder.co.us 
>>[mailto:lug-bounces at lug.boulder.co.us] On Behalf Of Gary Hodges
>>Sent: Tuesday, March 08, 2005 4:32 PM
>>To: Boulder (Colorado) Linux Users Group -- General Mailing List
>>Subject: Re: [lug] ftp problem
>>
>>For another test I tried uploading ten uncompressed tar files 
>>and four 
>>came in without problems.  Tar archives are sequential, 
>>right?  I think 
>>it is strange that files are randomly missing from the tar 
>>archives.  If 
>>the transfer didn't finish, wouldn't the files be missing 
>>from the end?  
>>I'll play with the size verification code below and the md5 
>>suggestion 
>>too...
>>
>>Gary
>>
>>Ron Wright wrote:
>>
>>    
>>
>>>Also, at ftp time you can verify the size on both ends.  Use:
>>>  $localsize = (stat($filename))[7];
>>>  $remotesize = $ftp->size($filename);
>>>
>>>
>>>On Tue, 8 Mar 2005 12:05:06 -0700, Daniel Webb 
>>>      
>>>
>><lists at danielwebb.us> wrote:
>>    
>>
>>> 
>>>
>>>      
>>>
>>>>On Tue, Mar 08, 2005 at 10:36:11AM -0700, Gary Hodges wrote:
>>>>
>>>>   
>>>>
>>>>        
>>>>
>>>>>Is it possible the firewall is stripping files out of the 
>>>>>          
>>>>>
>>tar archive or
>>    
>>
>>>>>should we look somewhere else?
>>>>>     
>>>>>
>>>>>          
>>>>>
>>>>My guess is that the missing files are at the end of the 
>>>>        
>>>>
>>archive, and
>>    
>>
>>>>the archives are sometimes not getting through completely.  
>>>>        
>>>>
>>Maybe add
>>    
>>
>>>>something to your script to send along an md5 hash to make sure the
>>>>received file is the same as the sent file.  The last place I would
>>>>suspect would be that a firewall is set up to examine and 
>>>>        
>>>>
>>filter .tar.gz
>>    
>>
>>>>files...
>>>> 
>>>>


_______________________________________________
Web Page:  http://lug.boulder.co.us
Mailing List: http://lists.lug.boulder.co.us/mailman/listinfo/lug
Join us on IRC: lug.boulder.co.us port=6667 channel=#colug


--
Nate Duehr, nate at natetech.com