Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.

The Other Search Engines


You are currently viewing our The Other Search Engines as a guest. Please register to participate.
Login



Reply
strange parsing by robots
Old 07-05-2008, 09:49 AM strange parsing by robots
Junior Talker

Posts: 1
Trades: 0
Hi:

On checking by logs I noticed that various robots, googlebot in particular, look for absurd urls, like, say

/index.shtml/Curriculum/Calculus/blue/pythagoras/Curriculum/Magic/SimpleGames/FrogsAndToads.shtml

There are several mistakes here:

1. index.shtml is a file not a directory
2. the directory structure at the site is

Code:
 
index.shtml
Curriculum
  Calculus
  Magic 
blue
pythagoras
SimpleGames
  FrogsAndToads.shtml
Does anybody have any idea that might explain this bots' behavior.

I am running linkchecker all the time and there is nothing to indicate that I have any misleading links.

Thank you,
Alex

Last edited by abogom; 07-05-2008 at 09:53 AM..
abogom is offline
Reply With Quote
View Public Profile
 
 
Register now for full access!
Old 07-05-2008, 12:14 PM Re: strange parsing by robots
chrishirst's Avatar
Missing! presumed drunk.

Posts: 41,520
Name: Chris Hirst
Location: Blackpool. UK
Trades: 0
possibly a malformed link on a scraper site somewhere.

possibly an error in any url-rewriting you may be doing
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
chrishirst is online now
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 08-17-2008, 03:12 AM Re: strange parsing by robots
Ultra Talker

Posts: 353
Name: Michael
Location: Spring Hill, Florida
Trades: 0
where is will smith?
__________________

Please login or register to view this content. Registration is FREE
6,000+ Places to Advertise FREE with

Please login or register to view this content. Registration is FREE
& 25,000 Locals through statistical reference of traffic, quality, popularity, and more!

eautocad is offline
Reply With Quote
View Public Profile Visit eautocad's homepage!
 
Reply     « Reply to strange parsing by robots
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML



Page generated in 0.12166 seconds with 12 queries