Is it possible to somehow encourage google to increase the number of pages from your site into the index?

For example right now I have over 30 content rich pages on my site, and for some reason I have only five of them show up in the index. My pages are not just a bunch of keywords, they don't duplicate other pages, originality, etc.

Does it "look" for new pages everytime the googlebot crawls your site? Or does it have something to do with your site's PR, how old it is, etc.?

How old is your site? I'm told Google will only crawl one page per day for the first month or two, to discourage fly-by-night spammers.

If it's older than that, how many links do you have pointing in to each page?

And how do you know they aren't indexed? Remember, the site:www.example.com is worthless.

It's about 5 months old.

I was also asking if there are any general tips to increase no. of pages.

site map, quality links, how do you know google only indexed 5 pages?

I typed in "site:www.toptenlisted.com" (my site) into Google to get the index results.

I see 5 pages of results, how many pages on your site?

Total pages with filled lists = 27
Contact, submission, etc = 8

well 5 pages of google results = 40-50 pages, so it looks to me like google have indexed all of your site - problem solved

Strangely when I type site:http://www.toptenlisted.com/ I get ~ 50 results. Talk about inconclusive.

same as me

Rubbish! You're as conclusive as the rest of us sigma

It's probably because those are supplemental results, which aren't really considered the same.

I should also mention that my site is redesigned, and a lot of those "supplemental results" were apart of my "old site's" design. So those URL's are mostly nonexistant right now, if I could somehow tell Google to *get rid* of those URL's, I would.

Also, I believe that supplemental results don't show up in the results while doing a regular search query, right?

I have the same problem, Some of my pages are just not being found, They page itself is old but the content is new. Would it be better to just create a new page?

Originally Posted by jamestl2

Also, I believe that supplemental results don't show up in the results while doing a regular search query, right?

That's not true at all. I've seen searches were supplemental results outranked normal ones. I don't remember the particular query, but several times when I'm looking for something in particular, like a method in the Win32 API or whatever.

keep adding pages daily and getting links daily, the more pages added the more google will index them faster as they try to keep up, but not your website will not get many crallers on if you have not many backlinks.

www.mkpitstop.co.uk has over 40k of backlinks in total and get a Google spider on every 10 mins and 20 at the max, over the last 2 days my pages have gone from 12k to 15k well what I can see

Google is on my site most of the day. You should get google to crawl more. Try downloading their toolbar, it will help.

No it won't!!

So how many posts (in my case lists) would it take before the search engines begin to take my site seriously? (I have about 30 right now)

Also, the pages are content-filled, so there wouldn't be any "worthless" posts, I'm just looking for a good estimate post number.

It's not necessarily about the number of posts you have. Google wants to rank the most relevant pages for a query. They use a lot of factors to determine what that page is.

Most sites are going to have some pages in the supplemental index. Those pages will show up in search results, but after relevant pages that are in the main index.

The best thing you can do is get more quality links pointing to your site and particularly those pages. That should help them move into the main index. When a site doesn't have a strong enough link profile Google usually decides some of it's pages can be moved to supplemental.

As far as the old URLs go Google will figure out in time they no longer exist and deindex them, but you really should 301 redirect them to the closest matching new URL. That way any link you may have gathered to the old URL will be passed on to the new URL. Also anyone who's perhaps bookmarked a page at the old URL will be taken to the new page.

Some of the indexing problems could also be caused by the old URLs not being there. If Googlebot keeps seeing pages on your site as not existing it could think your site is going away and not feel the need to keep the site in the index.

301 the old URLs to new URLs and build some more links into your pages and it should help some of your pages out of the supplemental index.

Note though that having pages in the supplemental index doesn't mean those or other pages won't rank. And also not that it's not important to try to have every page on your site rank. For example I'd rather a login page on my site didn't rank since it offers users no benefits if it's the first page they find. It's more likely to make them hit the back button. I also don't care if my privacy policy ranks or not. That page is there for good reasons, but it's not meant as an entry into the rest of the site.