|
That tag will just limit google-bot not make it return. For instance if you have it set for 3 days and google comes back in 2. The crawler will leave and come back whenever, not the next day. When google-bot comes back in 10 days ( or whenever), the algorithm will check to see if the last visit is greater ten 3 is so, google-bot will crawl the site.
I did a 8 month experiment on robot tags last year, and that's what I found out. Just thought I would share the info.
Last edited by eos; 10-08-2008 at 11:16 PM..
|