Quote:
Originally Posted by chrishirst
can you think of any reason why Google would spend time and bandwith crawling every page on your site?
Is there something unique or interesting about it ?
|
Well, once upon time back in the old days Google did index and probably has indexes your hold worthless website at one time.
Google had the worst repetition of links not found so, therefore Google clean their act and that to as many other search engines.
This is because of worthless website and link farms Google and like many other search engines do not index all your pages. It wasted time and ask it is stated spend time and bandwidth crawling every page on your site and not only that, disk space too!
Last edited by wmicro; 10-31-2006 at 04:05 AM..
|