Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.

The Google Forum


You are currently viewing our The Google Forum as a guest. Please register to participate.
Login



Reply
When does it make sense to de-list a page?
Old 02-03-2008, 07:52 PM When does it make sense to de-list a page?
ForrestCroce's Avatar
Half Man, Half Amazing

Posts: 3,023
Name: Forrest Croce
Location: Seattle, WA
Trades: 0
I did a site: search, and was pretty surprised to see what Google has on me. My wp-login page shows up, along with plenty of category pages, useless searches, and whatnot. My archives are indexed, along with page2, page3, et cetera, and my categories and tags.

I absolutely want all of my content indexed, and to do well in the major search engine[s]. But I don't need every different way to get to my content in the index; as long as a person searching for one of the subjects I've covered gets to that post. I'm surprised to see most of this is indexed, since it's just the intro of different posts.

I put my login page in robots.txt, and should hack the php to nofollow that link. I've also blocked searches in robots.txt, and nofollow my tag cloud. This might take longer than the remove url form, but work for most ses. Before I lock everything down: should I? The pages don't show up in my logs as entry points, but if Google chooses to index them, that's a lot more internal links with the anchor text I want in the post titles.

What would you do? Oh, and for anyone not familiar, the url is http://blog.forrestcroce.com/
__________________

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
ForrestCroce is offline
Reply With Quote
View Public Profile Visit ForrestCroce's homepage!
 
 
Register now for full access!
Old 02-04-2008, 06:35 PM Re: When does it make sense to de-list a page?
ssandecki's Avatar
SEO Addict

Latest Blog Post:
Wordpress SEO Plugins
Posts: 295
Name: Stephen
Location: Chicago, IL
Trades: 0
The URL provided shows an emtpy robots.txt file. Since Wordpress is known for duplicate content issues you should really consider blocking certian sections of your blog. Due to the nature of how Wodpress works you can usually find the same content around 3 to 4 different URLs. Don't forget to put your robots.txt in your sub-domain root directory. I hope this helps answer your question.
__________________

Please login or register to view this content. Registration is FREE
- Learn how to get a cash advance on your pending lawsuit; if you lose your lawsuit you don't pay it back!
ssandecki is offline
Reply With Quote
View Public Profile Visit ssandecki's homepage!
 
Old 02-04-2008, 09:59 PM Re: When does it make sense to de-list a page?
ForrestCroce's Avatar
Half Man, Half Amazing

Posts: 3,023
Name: Forrest Croce
Location: Seattle, WA
Trades: 0
You're right ... there was an empty file on my server, and in the staging area on my laptop. I got the correct one back, but I guess that would explain why the login page hasn't been removed yet.
__________________

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
ForrestCroce is offline
Reply With Quote
View Public Profile Visit ForrestCroce's homepage!
 
Reply     « Reply to When does it make sense to de-list a page?
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML



Page generated in 0.27187 seconds with 12 queries