|
It crawls a lot more than that per month on my server in a good month, sometimes it's crawled 100s of 1000s of pages per month, and published 100s of 1000s of my pages, but for the first 5 years I completely failed to properly analyse or chart that stuff. Nowadays I'm much more careful, but I've only produced a few 1000 pages, much of which I'm upgrading anyway - but the upshot is that I haven't got much content for them at the moment. Whatever I've got, they seem to have mostly crawled, except for the damage caused by accidentally deciding to let my server be cut off for most of a month (I was preoccupied with money from a different online-profit project altogether).
So I know Google does crawl 100s of 1000s of pages and even list them all, you don't have to be ebay or amazon, anyone with acceptable content can get listed, but I still have nightmares trying to establish the patterns of publishing and crawling.
Anyway, not to worry. Give it another few months and I ought to be able to answer the question myself.
|