|
The robots meta tag is an exclusion protocol and as "index,follow" is the normal behaviour of crawlers it won't make an iota of difference. If you have a page that you do not want indexing then use it by all means options are;
index | noindex , follow | nofollow
MSN and Google have their own version (<meta name="msnbot" ...>) (<meta name="googlebot" ...>) as well
The revisit-after is not used, and has never been used by any Internet Search Engine at all and probably never will be. It was used by Vancouver Webpages for their own crawler.
The same people developed the VW96 meta tags which used to get used by many so-called SEOs as well.
and BTW if they did follow it you would be telling the bot NOT to return for 30 days.
SE crawlers will visit at their own schedules. You cannot actually change that directly. It does appear though (from observation) that the Yahoo and MSN crawl schedules are both influenced by content expiry and Google uses a combination of external link count and content expiry for it's schedule.
__________________
Chris. ->> Please login or register to view this content. Registration is FREE <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- Is SEO the only industry where all the cowboys are Indians?
|