[lug] Google (and other) ftp crawlers.

Dave Pitts dpitts at cozx.com
Fri Feb 25 13:46:12 MST 2011


Hello:

Is there a way to get Google (and other) sites to stop crawling through my anon 
ftp site? They download everything and drop my network access to a crawl.... 
sometimes causing my applications to timeout and die.

Thanks in advance.

-- 
Dave Pitts             PULLMAN: Travel and sleep in safety and comfort.
dpitts at cozx.com        My other RV IS a Pullman (Colorado Pine).
http://www.cozx.com




More information about the LUG mailing list