[lug] Google (and other) ftp crawlers.
Dave Pitts
dpitts at cozx.com
Fri Feb 25 13:46:12 MST 2011
Hello:
Is there a way to get Google (and other) sites to stop crawling through my anon
ftp site? They download everything and drop my network access to a crawl....
sometimes causing my applications to timeout and die.
Thanks in advance.
--
Dave Pitts PULLMAN: Travel and sleep in safety and comfort.
dpitts at cozx.com My other RV IS a Pullman (Colorado Pine).
http://www.cozx.com
More information about the LUG
mailing list