SEO Tycoon

**Allieso5** · 03-03-2011, 10:34 PM

Hi everyone,
Does google index pages that are in the root directory on the server but not linked to from any of the pages on the website? I work with another guy on a few sites and we have some test pages in the root directory (so we can both access them) that are basically duplicates of some of the other pages and I don't want them crawled. Is this a problem or should I put them in a separate folder that is blocked by robots.txt?
Thanks!

**Sierra Charlie** · 03-04-2011, 12:30 AM

Quote:

Originally Posted by Allieso5

Hi everyone,
Does google index pages that are in the root directory on the server but not linked to from any of the pages on the website? I work with another guy on a few sites and we have some test pages in the root directory (so we can both access them) that are basically duplicates of some of the other pages and I don't want them crawled. Is this a problem or should I put them in a separate folder that is blocked by robots.txt?
Thanks!

Best would be to block them with a robots.txt. You don't have to put them in a separate folder to do that.

**StoneWilson** · 03-04-2011, 05:39 AM

Robots.txt is enough to do that, just block those test pages.

**Debin Jack** · 03-07-2011, 03:48 AM

Hello Allies!

Avoid the duplicate content into the web pages because it may problem for the web promotion and moreover,flash content too.

**SiberForum** · 03-07-2011, 04:12 AM

You also can add XML site map. There should be some recommendations how to do that on google support page.

**chrishirst** · 03-07-2011, 04:15 AM

Quote:

Originally Posted by SiberForum

You also can add XML site map. There should be some recommendations how to do that on google support page.

The OP wants to HIDE the pages from crawlers NOT help them find the pages!

**SiberForum** · 03-07-2011, 04:19 AM

Quote:

Originally Posted by chrishirst

The OP wants to HIDE the pages from crawlers NOT help them find the pages!

Sorry - my bad. Sleep eyes

In this case nofollow and noindex attributes can help

**chrishirst** · 03-07-2011, 05:36 AM

Quote:

Originally Posted by SiberForum

In this case nofollow and noindex attributes can help

No they won't, the robots meta values of nofollow or noindex are in the page source so the crawler has to read the page source before it can be determined if the nofollow, noindex values are there.

**Click SSL** · 03-07-2011, 05:52 AM

I'd just place a robot.txt in your root directory and list your pages in that, just to be on the safe side. However, I'm sure if it's only a few pages it wouldn't hurt and or affect your Google ranking.

**seo.vijay** · 03-08-2011, 01:18 AM

Quote:

Originally Posted by Sierra Charlie

Best would be to block them with a robots.txt. You don't have to put them in a separate folder to do that.

yeah your are right...

**full house** · 03-08-2011, 08:05 PM

why didn't do the test page in other page???since its already included blocking is the best way.

**kline11** · 03-08-2011, 08:20 PM

Use the robots.txt file. Just remember Google stated somewhere (I can't remeber where off the top of my head) that it will take a few days before Google will update it.

**LarryHeart** · 03-09-2011, 07:37 AM

I think that they'll even won't be crawled at all due to the fact that there are no links to them, but on the other hand you'd better ensure yourself and block them by robots.txt