Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.

Coding Forum


You are currently viewing our Coding Forum as a guest. Please register to participate.
Login



Reply
robots.txt and addon domains?
Old 11-28-2004, 04:50 PM robots.txt and addon domains?
jeof0411's Avatar
Novice Talker

Posts: 12
Location: Augusta , GA
Trades: 0
I need some clarification if anyone happens to know this:

OK on my hosting account I have 3 addon domains. My main site for the account is on my hosting server under /public_html/. The three addon domains are in subdirectories of the public_html folder , public_html/addon1/, public_html/addon2/, public_html/addon3/. Well I have a script on some of the pages in my main site that lets you search my site as well as a dynamic php sitemap. The problem is that sometimes these search within the subdirectories that the addon domains are in and have somehow caused a few of those pages to be indexed under my main site. (ie: Google shows results for http://www.mainwebsite.com/addon1/addon1index.html)

So I figured I could add a robots.txt file under my main domain (in the public_html folder) and disallow addon1 addon2 addon3. Will this cause any problems with getting my addon domains indexed under their correct domain names? It doesn't seem like they would, but I want to be sure. Should I include a robots.txt in all of their folders that doesnt disallow anything? I only ask because I added the robots.txt about 2 weeks ago and suddenly dropped off yahoo... not sure if this is why though.
thanks
__________________
-Jeoffory Hudson
Your Bottom Drawer
jeof0411 is offline
Reply With Quote
View Public Profile Visit jeof0411's homepage!
 
 
Register now for full access!
Old 11-28-2004, 11:23 PM
Rincewind's Avatar
Super Talker

Posts: 108
Trades: 0
Shouldn't cause a problem. The addons will apear to be unique sites to the search engine and completly unrelated to the main site as if they were all hosted seperatly. However, it may be better to use .htaccess to redirect /addon1 folder to the domain url for the addon rather than blocking it. That way real people will be redirected as well as SE spiders.
__________________
Q-4.net -
Please login or register to view this content. Registration is FREE

Stylegallery.co.uk -
Please login or register to view this content. Registration is FREE

Splodgy.com -
Please login or register to view this content. Registration is FREE
Rincewind is offline
Reply With Quote
View Public Profile
 
Reply     « Reply to robots.txt and addon domains?
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML



Page generated in 0.14018 seconds with 12 queries