SEO Tycoon

**jmz2** · 04-17-2007, 09:12 PM

Hello,

I have a site with a page only which is the tipical under-construction and there is nothing else. It has been like this for 2 years.

I just realised that yahoo indexed it (I don't know when). I never submit the site to any SE and no any other page is linking me, so I wonder how is that Yahoo indexed me?

**Vasity** · 04-17-2007, 10:00 PM

Does this indexing affecting you in a bad way? I mean I don't see as it indexing you as that really big of a problem as it is a good thing to happen to your website.

**ForrestCroce** · 04-18-2007, 02:29 AM

I think he's concerned because the particular page wasn't ready for people to see, so in this case, being indexed isn't a good thing, for that particular URL.

Search engines take submissions, but they prefer to find a page through links. Are you sure there are no links anywhere on the web? Does your site allow directory listings? I get traffic to pages that have no links and aren't indexed, because 'bots crawl the directory pages apache serves up. Is it possible someone found the page and liked it?

**ADAM Web Design** · 04-18-2007, 02:36 AM

jmz2: I've seen you asking for help with your sites in the past. I don't see any links immediately, but have you posted one to say a webmaster forum looking for advice or a review?

If so, that's probably what did it. Posting a link in a high-traffic forum with a lot of topics and constantly changing content as a result is one of the easiest ways to get indexed.

Now if you want to avoid getting indexed, either password-protect your site (the best way, since it temporarily shields the content until it's ready) or create a robots.txt file containing the following two lines:

User-Agent: *
Disallow: /

Upload that to the root directory of your site and in a few days, Bob should be your uncle.

**jo_cstd** · 04-18-2007, 09:06 AM

If it's out in the web (live), then expect it to be indexed - unless you're using robots or metatags to prevent it.

**ozhef** · 04-18-2007, 10:24 AM

you should thank yourself lucky - I cant get my sites indexed after years of trying!!

**Vasity** · 04-18-2007, 12:01 PM

That could be the problem if he doesn't want people to see the page just yet.
But indexing is always good my BGOD.NET site was just indexed and it has only been up for 4 days so I like it

**princess06** · 04-18-2007, 01:54 PM

it's because maybe you have back links to your site. submitting to SE's is not the only way to get indexed.

**jmz2** · 04-18-2007, 02:53 PM

This is UNBELIABLE!!!! I just can not belive it.
After 2/3 hours of posting this topic, I just found out just by luck that other of my sites in the same situation (under contruction and not linking) has been indexed by google.
The first site I posted about was indexed by yahoo and alltheweb but not google. This second one has been indexed by google and no one else. This domain and site is about 1 year old.
I didn't have a problem for being indexed with the 1st domain but has been a pity that the second one has been indexed because I was expecting to release it to SE in a week or so (the site wasn't ready at all when it was indexed). Now I find myself with the site in google with an ugly naked 'under construction site' indexed. If I had knew that this could hapen I would use robots.txt to stop SE, but I thought for this to happen was almost as dificult as winning the lottery.
Adam, good point as always. BUT believe me i have never mention thoses URL on internet, FOR SURE there is not linking to those sites, unless someone is linking deliverately to them without me knowing it (but I don't see any point for that to happend).
Well now I am considering to use robots on the second site because I don't want yahoo o another big SE to index me until site is ready. But one question, if the spider come to a site, see the robots.txt says to go away, is the spider going to come back in the near future? I think this isn't a good idea to implement it now just in case spider put the site on the very very last of the queue. What do you think?

**sheena** · 04-19-2007, 04:51 AM

You are lucky if your site index to Yahoo. It happens also to my site. If someone is using your link, I think your site is get indexed in the search engine. To get indexed in yahoo is to submit your site to yahoo search engine, link building, promotion.

Quote:

Originally Posted by jmz2

Hello,

I have a site with a page only which is the tipical under-construction and there is nothing else. It has been like this for 2 years.

I just realised that yahoo indexed it (I don't know when). I never submit the site to any SE and no any other page is linking me, so I wonder how is that Yahoo indexed me?