Hi:
On checking by logs I noticed that various robots, googlebot in particular, look for absurd urls, like, say
/index.shtml/Curriculum/Calculus/blue/pythagoras/Curriculum/Magic/SimpleGames/FrogsAndToads.shtml
There are several mistakes here:
1. index.shtml is a file not a directory
2. the directory structure at the site is
Code:
index.shtml
Curriculum
Calculus
Magic
blue
pythagoras
SimpleGames
FrogsAndToads.shtml
Does anybody have any idea that might explain this bots' behavior.
I am running linkchecker all the time and there is nothing to indicate that I have any misleading links.
Thank you,
Alex
Last edited by abogom; 07-05-2008 at 09:53 AM..
|