I did a site: search, and was pretty surprised to see what Google has on me. My wp-login page shows up, along with plenty of category pages, useless searches, and whatnot. My archives are indexed, along with page2, page3, et cetera, and my categories and tags.
I absolutely want all of my content indexed, and to do well in the major search engine[s]. But I don't need every different way to get to my content in the index; as long as a person searching for one of the subjects I've covered gets to that post. I'm surprised to see most of this is indexed, since it's just the intro of different posts.
I put my login page in robots.txt, and should hack the php to nofollow that link. I've also blocked searches in robots.txt, and nofollow my tag cloud. This might take longer than the remove url form, but work for most ses. Before I lock everything down: should I? The pages don't show up in my logs as entry points, but if Google chooses to index them, that's a lot more internal links with the anchor text I want in the post titles.
What would you do? Oh, and for anyone not familiar, the url is http://blog.forrestcroce.com/
|