[lug] ssh compression

John Hernandez John.Hernandez at noaa.gov
Wed May 1 13:42:11 MDT 2002


For your particular issue, another potential benefit of the rsync (over 
ssh -C) solution would be rsync's --bwlimit=KB/s option.

Peter Hutnick wrote:

> On Wednesday 01 May 2002 10:04 am, Hugh Brown wrote:
> 
>>I am doing an over the net backup of a mail server over an ssh tunnel.
>>The bandwidth that it is consuming is killing me.  Is there any way to
>>throttle it down?  Would using the compression option in ssh help me or
>>hurt me (the man page says it would slow it down, but I don't know if
>>that means less bandwidth, longer download or same bandwidth, longer
>>download).
>>
> 
> Sure, use compression (ssh -C or scp -C).
> 
> If I read you correctly, your main gripe seems to be that the transfer hogs 
> the entire connection.  I have wished for a long time that there was a 
> "netnice" command, so I could do things like "netnice -n 19 scp -C 
> someuser at somehost:~/somefile ."
 
<SNIP>

 
> But what you /really/ ought to do is use rsync, and use ssh -C as your 
> transport.  rsync is practically made for mailspools.
> 
> To summarize what rsync does, it treats all files as binary, breaks them into 
> chunks, does a hash against each chunk on both ends of the connection, then 
> sends chunks that are different.  So, instead of sending that entire 10M 
> mailspool each time you back up, it sends the last five 10k chunks to cover 
> the 47k of new mail.  Nice.
> 


-- 

   - John Hernandez - Network Engineer - 303-497-6392 -
  |  National Oceanic and Atmospheric Administration   |
  |  Mailstop R/OM12. 325 Broadway, Boulder, CO 80305  |
   ----------------------------------------------------




More information about the LUG mailing list