SEO Tycoon

#1 (permalink)

Hello Webmaster,

Can anyone suggest me that how can I set crawlers visiting time and period for a specific folder or directory, I don't want it to be crawl on regular basis....

suggest if you have done such type of thing...


Thanks,

__________________

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE

#2 (permalink)

You can't.

Crawlers will visit on their schedule.

__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?

#3 (permalink)

use this, maybe it help.
<meta name="REVISIT-AFTER" content="7 days">

__________________
best-selling brands of
Please login or register to view this content. Registration is FREE
and
Please login or register to view this content. Registration is FREE

#4 (permalink)

Can I use "Crawl-delay: " in robot.txt for this purpose.

__________________

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE

#5 (permalink)

Yep.


but for the robots that use it, it affects the whole site.

__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?