I have a robots.txt file for my wordpress blog that pretty much reduces all forms of duplicate content and concentrates the search engines on the pages I want indexed.
Code:
# Root Folders
User-agent: *
Disallow: /images/
Disallow: /2005/
Disallow: /2006/
Disallow: /2007/
Disallow: /2008/
Disallow: /*feed #This is important. Wordpress Feeds are picked up by Search Engines
Disallow: /page/
__________________ Please login or register to view this content. Registration is FREE - Ford Mustang Enthusiast Website
Please login or register to view this content. Registration is FREE - General Music Discussion Forum