SEO Tycoon

**ved123** · 05-13-2008, 05:37 AM

Hi All,

My server have extra load due to crawler and bot multiple request, Now I want to restrict some use less crawler & bot.

Can you suggest which crawler should I give permission to crawl our website.

Please give all crawler name & bot in sequence..

Thanks,

**chrishirst** · 05-13-2008, 06:05 AM

Get a better server!

**jameskertley** · 05-13-2008, 07:18 AM

Dear
select which have the low crawl rate to your site.

**ved123** · 02:02 AM

Quote:

Originally Posted by chrishirst

Get a better server!

I want a solution..??? not a problem...

Please dont reply if you dont have any idea about server and crawlers..

**ved123** · 05-14-2008, 02:46 AM

look I will be banned, That is why am saying here is worst medarator...

Coz i reveal the foolness of chircrist

Bye......

**chrishirst** · 05-14-2008, 03:16 AM

BTW. it's m o d e r a t o r, foolishness and chrishirst
And you won't get banned by myself for insulting me, I've been insulted by people who are far better than you at it!

If your current server cannot handle the level of traffic, the the ONLY sensible answer is to get a better one.
The only bots you can block reliably are the ones you would WANT on a site. So if you are as you purport in your signature a "SEO Company", one would assume that the likes of the Google, Yahoo, MSN, Ask, etc crawlers are all ones that you would prefer to maintain visiting the site.

**usearchme** · 05-14-2008, 05:29 AM

lol i get 100s of these bots, but they have never affected my server performance, so its a little odd really !

Woc

**mike95910** · 05-14-2008, 02:42 PM

Your server must stink. Especially if bots are slowing it down. You want the bots! Fork up some $$$