Thread: Google is Leeching Bandwidth!
View Single Post
  #7  
Old November 19th, 2004, 01:47 PM
Aiken's Avatar

Aiken Aiken is offline
Major
  
Join Date: Jan 2004
Location: Taganrog, Russia
Posts: 1,087
Thanks: 0
Thanked 0 Times in 0 Posts
Aiken is on a distinguished road
Default Re: Google is Leeching Bandwidth!
Some people complained about searchbots, consuming their bandwidth. As I understand properly used robots.txt can prevent this.
http://forums.seochat.com/archive/t-14698
Reply With Quote